2023-07-27T19:13:30.383 INFO:root:teuthology version: 0.0.1.dev160+g407880c 2023-07-27T19:13:30.384 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/vshankar-2023-07-25_11:29:34-fs-wip-vshankar-testing-20230725.043804-testing-default-smithi/7350740 --owner scheduled_vshankar@teuthology --name vshankar-2023-07-25_11:29:34-fs-wip-vshankar-testing-20230725.043804-testing-default-smithi --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} -- /home/teuthworker/archive/vshankar-2023-07-25_11:29:34-fs-wip-vshankar-testing-20230725.043804-testing-default-smithi/7350740/orig.config.yaml 2023-07-27T19:13:30.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T19:13:30.514 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-07-25_11:29:34-fs-wip-vshankar-testing-20230725.043804-testing-default-smithi/7350740 branch: wip-vshankar-testing-20230725.043804 description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} email: vshankar@redhat.com first_in_suite: false job_id: '7350740' kernel: flavor: default kdb: true sha1: bbae19e0824be3daf9282aaf5330af10cdf81109 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-07-25_11:29:34-fs-wip-vshankar-testing-20230725.043804-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-vshankar-testing-20230725.043804 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: a5d48e8c688c2543997a98b8acbae2ce9635578c ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a5d48e8c688c2543997a98b8acbae2ce9635578c selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20230725.043804 sha1: a5d48e8c688c2543997a98b8acbae2ce9635578c owner: scheduled_vshankar@teuthology priority: 150 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 9167 sha1: a5d48e8c688c2543997a98b8acbae2ce9635578c sleep_before_teardown: 0 subset: 269/1024 suite: fs suite_branch: wip-vshankar-testing-20230725.043804 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_a5d48e8c688c2543997a98b8acbae2ce9635578c/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: a5d48e8c688c2543997a98b8acbae2ce9635578c syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi072.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2zK0aM8CVVl3keQCVxE4qZ32bDRP+Ke9iiu3RgQ+U74021QyiO2yQG1pqNb5TqJAp4o52c184qRewU90lFnTNiDyNxWt5VQGY/dMYgxyzcQcBL+DCFHmm3C30IrTlIxnOy1VPbkhFvOTb3jqEwIlZ9qnIr8pSxPZyKIOAex2hgyY2jTHz9+dh1NrPwnZSzsj9BZi1IRw5PhMITJD1ObQdUlrC1dWd6WcxqRFYZ3QtjNk4qWzwZne4QPiLQzbHRGlrw5LCiO/cE590351imnZSARgVlxAbSXeds9Z/H9eSuA+YtsUiKDEVqmuM9MAX1dSNFwEwOq1sQrWF3wm4ed9HnRuZgrr3YuNBBf4G5Gg6FCTkyKA+K6bsJ5CIRaoWWaHPzKcF7RADBQwIY9e5Z2C3+BDlnX5gEW8AMxONkhr+/b6NkkNGUZO4Cte65XuZOvu2uQa9SB9yr/g6S0Yv2wHRteozX31SwpKQs+q35rkIBkLrJgkLxNGNXVlWBKy+VpU= smithi173.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC47mkD2yJI/qkZCaxu9TKQ0sTTDGOwga3QZh6+29NMXumCbAV+47jTsJLMoZ7rFalFEZSFXpgp3yQCapXvNdGI2BX71yfmCmWpqBw1nGrzeuI3sWs7MvbvjYE3/Ts/GhMevSubZp16EnwnS7/RS2RXZ2uwaEiR6RAl2aw7+D3hcky4NrhE6nUafR7zENXKUXJ0MhCRvs8H627qFpStvoopVO9lom/R3UA9aOnLkl0l7UsfVTWikSvK0zJ2lnTJ3qssdCbUghGYfgYAnHNAdWOImgIo+c7kNxRRiqwan4oRAqqCOy4aa1wbS+ANbdSILsChZqEmim65ghqFDFbvkkyNTJZp3mIJhhUpZTUAjTm2hQx/UlMB/15BXZIljNIFhjxTon0Z3qW0v0m5OqMx0OaoTsXfQ9GIoeVJpN1YSBh/l+wQeFBoRIFdAjey2cYA9W1FyGWEob9JX3A54bL8sMMEhtorBw/+BRqiKKynUVE/NaRF+DFEIiita0+9476nQHM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_multifs_auth teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 407880c6d3fb77318fff01c863715090f9c2de69 timestamp: 2023-07-25_11:29:34 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-07-27T19:13:30.514 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_a5d48e8c688c2543997a98b8acbae2ce9635578c/qa; will attempt to use it 2023-07-27T19:13:30.515 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_a5d48e8c688c2543997a98b8acbae2ce9635578c/qa/tasks 2023-07-27T19:13:30.515 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-07-27T19:13:30.517 INFO:teuthology.task.internal:Checking packages... 2023-07-27T19:13:30.545 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a5d48e8c688c2543997a98b8acbae2ce9635578c' 2023-07-27T19:13:30.545 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-07-27T19:13:30.545 INFO:teuthology.packaging:ref: None 2023-07-27T19:13:30.546 INFO:teuthology.packaging:tag: None 2023-07-27T19:13:30.546 INFO:teuthology.packaging:branch: wip-vshankar-testing-20230725.043804 2023-07-27T19:13:30.546 INFO:teuthology.packaging:sha1: a5d48e8c688c2543997a98b8acbae2ce9635578c 2023-07-27T19:13:30.546 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-vshankar-testing-20230725.043804 2023-07-27T19:13:30.891 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-5128.ga5d48e8c 2023-07-27T19:13:30.891 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-07-27T19:13:30.898 INFO:teuthology.task.internal:no buildpackages task found 2023-07-27T19:13:30.898 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-07-27T19:13:30.908 INFO:teuthology.task.internal:Saving configuration 2023-07-27T19:13:30.924 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-07-27T19:13:30.931 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-27T19:13:30.959 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-25_11:29:34-fs-wip-vshankar-testing-20230725.043804-testing-default-smithi/7350740', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-27 19:07:52.920538', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLlYOQrCeooi5OfgXcTaUe4H+FoNkf+mJ/YcOlzZu9TV1GCPqUYGT9NwH31cW9sr/N3tr8Ug383bRkMRQ5aqp1c='} 2023-07-27T19:13:30.987 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-25_11:29:34-fs-wip-vshankar-testing-20230725.043804-testing-default-smithi/7350740', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-27 19:07:52.922103', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGJOX4d2e7tRKC57eLbGK2lh+a+1TW22wFTDQEjmoWBAq3YrrQuZFO+otFaXIZM55TVf6GxjeZqQYM/PzqGFcJM='} 2023-07-27T19:13:30.988 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-07-27T19:13:30.995 INFO:teuthology.task.internal:roles: ubuntu@smithi072.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-07-27T19:13:30.995 INFO:teuthology.task.internal:roles: ubuntu@smithi173.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2023-07-27T19:13:30.995 INFO:teuthology.run_tasks:Running task console_log... 2023-07-27T19:13:31.141 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3d593efe50>, signals=[15]) 2023-07-27T19:13:31.143 INFO:teuthology.run_tasks:Running task internal.connect... 2023-07-27T19:13:31.149 INFO:teuthology.task.internal:Opening connections... 2023-07-27T19:13:31.150 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi072.front.sepia.ceph.com 2023-07-27T19:13:31.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T19:13:31.219 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi173.front.sepia.ceph.com 2023-07-27T19:13:31.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T19:13:31.286 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-07-27T19:13:31.293 DEBUG:teuthology.orchestra.run.smithi072:> uname -m 2023-07-27T19:13:31.315 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2023-07-27T19:13:31.315 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2023-07-27T19:13:31.376 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="CentOS Stream" 2023-07-27T19:13:31.377 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="8" 2023-07-27T19:13:31.377 INFO:teuthology.orchestra.run.smithi072.stdout:ID="centos" 2023-07-27T19:13:31.377 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="rhel fedora" 2023-07-27T19:13:31.378 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="8" 2023-07-27T19:13:31.378 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el8" 2023-07-27T19:13:31.378 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-27T19:13:31.379 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2023-07-27T19:13:31.379 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-27T19:13:31.379 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://centos.org/" 2023-07-27T19:13:31.380 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-27T19:13:31.380 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-27T19:13:31.380 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-27T19:13:31.381 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2023-07-27T19:13:31.413 DEBUG:teuthology.orchestra.run.smithi173:> uname -m 2023-07-27T19:13:31.435 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64 2023-07-27T19:13:31.436 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2023-07-27T19:13:31.497 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Stream" 2023-07-27T19:13:31.497 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="8" 2023-07-27T19:13:31.497 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos" 2023-07-27T19:13:31.497 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora" 2023-07-27T19:13:31.498 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="8" 2023-07-27T19:13:31.498 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el8" 2023-07-27T19:13:31.498 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-27T19:13:31.498 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2023-07-27T19:13:31.498 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-27T19:13:31.498 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/" 2023-07-27T19:13:31.498 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-27T19:13:31.498 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-27T19:13:31.499 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-27T19:13:31.499 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2023-07-27T19:13:31.521 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-07-27T19:13:31.530 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-07-27T19:13:31.542 INFO:teuthology.task.internal:Checking for old test directory... 2023-07-27T19:13:31.542 DEBUG:teuthology.orchestra.run.smithi072:> test '!' -e /home/ubuntu/cephtest 2023-07-27T19:13:31.545 DEBUG:teuthology.orchestra.run.smithi173:> test '!' -e /home/ubuntu/cephtest 2023-07-27T19:13:31.565 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-07-27T19:13:31.573 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-07-27T19:13:31.574 DEBUG:teuthology.orchestra.run.smithi072:> test -z $(ls -A /var/lib/ceph) 2023-07-27T19:13:31.606 DEBUG:teuthology.orchestra.run.smithi173:> test -z $(ls -A /var/lib/ceph) 2023-07-27T19:13:31.641 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-07-27T19:13:31.707 INFO:teuthology.run_tasks:Running task kernel... 2023-07-27T19:13:31.731 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': 'bbae19e0824be3daf9282aaf5330af10cdf81109'} 2023-07-27T19:13:31.732 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': 'bbae19e0824be3daf9282aaf5330af10cdf81109'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': 'bbae19e0824be3daf9282aaf5330af10cdf81109'}}, timeout 300 2023-07-27T19:13:31.733 DEBUG:teuthology.orchestra.run.smithi072:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-27T19:13:31.734 DEBUG:teuthology.orchestra.run.smithi173:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-27T19:13:31.754 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-27T19:13:31.754 DEBUG:teuthology.task.kernel:sha1 for mon.a is bbae19e0824be3daf9282aaf5330af10cdf81109 2023-07-27T19:13:31.755 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "bbae19e0824be3daf9282aaf5330af10cdf81109"... 2023-07-27T19:13:31.755 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2023-07-27T19:13:31.755 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-27T19:13:31.756 DEBUG:teuthology.task.kernel:sha1 for mon.b is bbae19e0824be3daf9282aaf5330af10cdf81109 2023-07-27T19:13:31.756 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "bbae19e0824be3daf9282aaf5330af10cdf81109"... 2023-07-27T19:13:31.757 DEBUG:teuthology.orchestra.run.smithi173:> uname -r 2023-07-27T19:13:31.816 INFO:teuthology.orchestra.run.smithi072.stdout:4.18.0-489.el8.x86_64 2023-07-27T19:13:31.816 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs bbae19e0824be3daf9282aaf5330af10cdf81109 2023-07-27T19:13:31.816 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-27T19:13:31.817 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=bbae19e0824be3daf9282aaf5330af10cdf81109 2023-07-27T19:13:31.819 INFO:teuthology.orchestra.run.smithi173.stdout:4.18.0-489.el8.x86_64 2023-07-27T19:13:31.820 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs bbae19e0824be3daf9282aaf5330af10cdf81109 2023-07-27T19:13:31.820 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-27T19:13:31.820 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=bbae19e0824be3daf9282aaf5330af10cdf81109 2023-07-27T19:13:32.143 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum upgrade -y linux-firmware 2023-07-27T19:13:32.161 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum upgrade -y linux-firmware 2023-07-27T19:26:37.805 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - AppStream 40 kB/s | 31 MB 13:01 2023-07-27T19:26:38.309 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 8 - AppStream 40 kB/s | 31 MB 13:03 2023-07-27T19:26:50.559 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 8 - BaseOS 6.2 MB/s | 41 MB 00:06 2023-07-27T19:26:57.191 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 8 - Extras 30 kB/s | 18 kB 00:00 2023-07-27T19:26:57.909 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 8 - Extras common packages 12 kB/s | 6.6 kB 00:00 2023-07-27T19:26:58.402 INFO:teuthology.orchestra.run.smithi173.stdout:Copr repo for python3-asyncssh owned by ceph 10 kB/s | 3.5 kB 00:00 2023-07-27T19:27:00.436 INFO:teuthology.orchestra.run.smithi173.stdout:Extra Packages for Enterprise Linux 8.3 MB/s | 16 MB 00:01 2023-07-27T19:27:04.195 INFO:teuthology.orchestra.run.smithi173.stdout:lab-extras 503 kB/s | 24 kB 00:00 2023-07-27T19:27:07.625 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2023-07-27T19:27:07.625 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-07-27T19:27:07.625 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2023-07-27T19:27:07.626 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-07-27T19:27:07.626 INFO:teuthology.orchestra.run.smithi173.stdout:Upgrading: 2023-07-27T19:27:07.626 INFO:teuthology.orchestra.run.smithi173.stdout: linux-firmware noarch 20230515-115.gitd1962891.el8 baseos 266 M 2023-07-27T19:27:07.626 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T19:27:07.626 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2023-07-27T19:27:07.626 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-07-27T19:27:07.626 INFO:teuthology.orchestra.run.smithi173.stdout:Upgrade 1 Package 2023-07-27T19:27:07.627 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T19:27:07.627 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 266 M 2023-07-27T19:27:07.627 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2023-07-27T19:27:46.278 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - BaseOS 668 kB/s | 41 MB 01:02 2023-07-27T19:27:53.020 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - Extras 22 kB/s | 18 kB 00:00 2023-07-27T19:27:53.746 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - Extras common packages 12 kB/s | 6.6 kB 00:00 2023-07-27T19:27:54.215 INFO:teuthology.orchestra.run.smithi072.stdout:Copr repo for python3-asyncssh owned by ceph 11 kB/s | 3.5 kB 00:00 2023-07-27T19:28:22.067 INFO:teuthology.orchestra.run.smithi072.stdout:Extra Packages for Enterprise Linux 577 kB/s | 16 MB 00:27 2023-07-27T19:28:25.909 INFO:teuthology.orchestra.run.smithi072.stdout:lab-extras 142 kB/s | 24 kB 00:00 2023-07-27T19:28:29.434 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2023-07-27T19:28:29.435 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2023-07-27T19:28:29.435 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repo Size 2023-07-27T19:28:29.435 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2023-07-27T19:28:29.435 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrading: 2023-07-27T19:28:29.435 INFO:teuthology.orchestra.run.smithi072.stdout: linux-firmware noarch 20230515-115.gitd1962891.el8 baseos 266 M 2023-07-27T19:28:29.436 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T19:28:29.436 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2023-07-27T19:28:29.436 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2023-07-27T19:28:29.436 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrade 1 Package 2023-07-27T19:28:29.436 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T19:28:29.437 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 266 M 2023-07-27T19:28:29.437 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2023-07-27T19:32:54.316 INFO:teuthology.orchestra.run.smithi072.stdout:linux-firmware-20230515-115.gitd1962891.el8.noa 1.0 MB/s | 266 MB 04:24 2023-07-27T19:32:54.316 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2023-07-27T19:32:54.317 INFO:teuthology.orchestra.run.smithi072.stdout:Total 1.0 MB/s | 266 MB 04:24 2023-07-27T19:32:55.892 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2023-07-27T19:32:55.993 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2023-07-27T19:32:55.994 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2023-07-27T19:32:57.654 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2023-07-27T19:32:57.685 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2023-07-27T19:33:16.012 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2023-07-27T19:33:16.364 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-07-27T19:33:16.608 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-27T19:33:16.830 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-27T19:33:16.830 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-07-27T19:33:17.508 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-27T19:33:17.509 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T19:33:17.509 INFO:teuthology.orchestra.run.smithi072.stdout:Upgraded: 2023-07-27T19:33:17.509 INFO:teuthology.orchestra.run.smithi072.stdout: linux-firmware-20230515-115.gitd1962891.el8.noarch 2023-07-27T19:33:17.509 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T19:33:17.509 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2023-07-27T19:33:17.664 INFO:teuthology.task.kernel:Downloading kernel bbae19e0824be3daf9282aaf5330af10cdf81109 on mon.a... 2023-07-27T19:33:17.664 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=bbae19e0824be3daf9282aaf5330af10cdf81109 2023-07-27T19:33:18.001 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/bbae19e0824be3daf9282aaf5330af10cdf81109/centos/8/flavors/default/x86_64/ 2023-07-27T19:33:18.002 DEBUG:teuthology.orchestra.run.smithi072:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc1_gbbae19e0824b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/bbae19e0824be3daf9282aaf5330af10cdf81109/centos/8/flavors/default/x86_64/ --input-file=- 2023-07-27T19:33:18.004 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi072.front.sepia.ceph.com to complete... 2023-07-27T19:33:52.797 INFO:teuthology.orchestra.run.smithi173.stdout:linux-firmware-20230515-115.gitd1962891.el8.noa 672 kB/s | 266 MB 06:44 2023-07-27T19:33:52.797 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2023-07-27T19:33:52.797 INFO:teuthology.orchestra.run.smithi173.stdout:Total 671 kB/s | 266 MB 06:45 2023-07-27T19:33:54.377 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2023-07-27T19:33:54.441 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2023-07-27T19:33:54.441 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2023-07-27T19:33:56.107 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2023-07-27T19:33:56.153 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2023-07-27T19:34:13.925 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2023-07-27T19:34:14.295 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-07-27T19:34:14.532 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-27T19:34:14.771 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-27T19:34:14.771 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-07-27T19:34:15.445 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-27T19:34:15.445 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T19:34:15.446 INFO:teuthology.orchestra.run.smithi173.stdout:Upgraded: 2023-07-27T19:34:15.446 INFO:teuthology.orchestra.run.smithi173.stdout: linux-firmware-20230515-115.gitd1962891.el8.noarch 2023-07-27T19:34:15.446 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T19:34:15.446 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2023-07-27T19:34:15.653 INFO:teuthology.task.kernel:Downloading kernel bbae19e0824be3daf9282aaf5330af10cdf81109 on mon.b... 2023-07-27T19:34:15.653 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=bbae19e0824be3daf9282aaf5330af10cdf81109 2023-07-27T19:34:15.938 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/bbae19e0824be3daf9282aaf5330af10cdf81109/centos/8/flavors/default/x86_64/ 2023-07-27T19:34:15.939 DEBUG:teuthology.orchestra.run.smithi173:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc1_gbbae19e0824b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/bbae19e0824be3daf9282aaf5330af10cdf81109/centos/8/flavors/default/x86_64/ --input-file=- 2023-07-27T19:34:15.941 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi173.front.sepia.ceph.com to complete... 2023-07-27T19:34:54.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27 19:34:54 URL:https://1.chacra.ceph.com/r/kernel/testing/bbae19e0824be3daf9282aaf5330af10cdf81109/centos/8/flavors/default/x86_64/kernel-6.5.0_rc1_gbbae19e0824b-1.x86_64.rpm [380683800/380683800] -> "/tmp/kernel.x86_64.rpm" [1] 2023-07-27T19:34:54.485 INFO:teuthology.orchestra.run.smithi072.stderr:FINISHED --2023-07-27 19:34:54-- 2023-07-27T19:34:54.485 INFO:teuthology.orchestra.run.smithi072.stderr:Total wall clock time: 1m 36s 2023-07-27T19:34:54.486 INFO:teuthology.orchestra.run.smithi072.stderr:Downloaded: 1 files, 363M in 1m 36s (3.78 MB/s) 2023-07-27T19:34:54.612 INFO:teuthology.task.kernel:Installing kernel bbae19e0824be3daf9282aaf5330af10cdf81109 on mon.a... 2023-07-27T19:34:54.613 DEBUG:teuthology.orchestra.run.smithi072:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-07-27T19:34:56.459 INFO:teuthology.orchestra.run.smithi072.stdout:Verifying... ######################################## 2023-07-27T19:34:56.501 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing... ######################################## 2023-07-27T19:34:56.611 INFO:teuthology.orchestra.run.smithi072.stdout:Updating / installing... 2023-07-27T19:35:34.567 INFO:teuthology.orchestra.run.smithi072.stdout:kernel-6.5.0_rc1_gbbae19e0824b-1 ######################################## 2023-07-27T19:35:41.779 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27 19:35:41 URL:https://1.chacra.ceph.com/r/kernel/testing/bbae19e0824be3daf9282aaf5330af10cdf81109/centos/8/flavors/default/x86_64/kernel-6.5.0_rc1_gbbae19e0824b-1.x86_64.rpm [380683800/380683800] -> "/tmp/kernel.x86_64.rpm" [1] 2023-07-27T19:35:41.779 INFO:teuthology.orchestra.run.smithi173.stderr:FINISHED --2023-07-27 19:35:41-- 2023-07-27T19:35:41.779 INFO:teuthology.orchestra.run.smithi173.stderr:Total wall clock time: 1m 26s 2023-07-27T19:35:41.780 INFO:teuthology.orchestra.run.smithi173.stderr:Downloaded: 1 files, 363M in 1m 25s (4.25 MB/s) 2023-07-27T19:35:41.781 INFO:teuthology.task.kernel:Installing kernel bbae19e0824be3daf9282aaf5330af10cdf81109 on mon.b... 2023-07-27T19:35:41.781 DEBUG:teuthology.orchestra.run.smithi173:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-07-27T19:35:43.446 INFO:teuthology.orchestra.run.smithi173.stdout:Verifying... ######################################## 2023-07-27T19:35:43.490 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing... ######################################## 2023-07-27T19:35:43.599 INFO:teuthology.orchestra.run.smithi173.stdout:Updating / installing... 2023-07-27T19:36:10.124 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi072.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-07-27T19:36:10.124 DEBUG:teuthology.orchestra.run.smithi072:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-07-27T19:36:10.169 INFO:teuthology.orchestra.run.smithi072.stdout:/boot/System.map-6.5.0-rc1-gbbae19e0824b 2023-07-27T19:36:10.169 INFO:teuthology.orchestra.run.smithi072.stdout:/boot/config-6.5.0-rc1-gbbae19e0824b 2023-07-27T19:36:10.169 INFO:teuthology.orchestra.run.smithi072.stdout:/boot/vmlinuz-6.5.0-rc1-gbbae19e0824b 2023-07-27T19:36:10.169 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b 2023-07-27T19:36:10.169 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel 2023-07-27T19:36:10.170 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch 2023-07-27T19:36:10.170 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86 2023-07-27T19:36:10.170 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto 2023-07-27T19:36:10.171 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-27T19:36:10.171 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-27T19:36:10.171 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-27T19:36:10.171 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-27T19:36:10.171 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-27T19:36:10.171 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-27T19:36:10.172 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-27T19:36:10.172 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-07-27T19:36:10.172 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-27T19:36:10.172 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-27T19:36:10.172 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-27T19:36:10.172 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-27T19:36:10.172 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-27T19:36:10.173 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-27T19:36:10.173 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-27T19:36:10.173 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-27T19:36:10.173 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-27T19:36:10.173 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-27T19:36:10.173 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-27T19:36:10.173 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-27T19:36:10.173 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/kernel 2023-07-27T19:36:10.174 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/kernel/cpu 2023-07-27T19:36:10.174 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/kernel/cpu/mce 2023-07-27T19:36:10.174 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-27T19:36:10.174 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/kvm 2023-07-27T19:36:10.174 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-27T19:36:10.174 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-27T19:36:10.174 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/kvm/kvm.ko 2023-07-27T19:36:10.174 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto 2023-07-27T19:36:10.175 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/ansi_cprng.ko 2023-07-27T19:36:10.175 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/anubis.ko 2023-07-27T19:36:10.175 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/arc4.ko 2023-07-27T19:36:10.175 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/async_tx 2023-07-27T19:36:10.175 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/async_tx/async_memcpy.ko 2023-07-27T19:36:10.175 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/async_tx/async_pq.ko 2023-07-27T19:36:10.175 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-27T19:36:10.176 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/async_tx/async_tx.ko 2023-07-27T19:36:10.176 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/async_tx/async_xor.ko 2023-07-27T19:36:10.176 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/async_tx/raid6test.ko 2023-07-27T19:36:10.176 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/authenc.ko 2023-07-27T19:36:10.176 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/authencesn.ko 2023-07-27T19:36:10.176 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/blake2b_generic.ko 2023-07-27T19:36:10.176 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/blowfish_common.ko 2023-07-27T19:36:10.177 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/blowfish_generic.ko 2023-07-27T19:36:10.177 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/camellia_generic.ko 2023-07-27T19:36:10.177 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/cast5_generic.ko 2023-07-27T19:36:10.177 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/cast6_generic.ko 2023-07-27T19:36:10.177 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/cast_common.ko 2023-07-27T19:36:10.177 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/ccm.ko 2023-07-27T19:36:10.177 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/cmac.ko 2023-07-27T19:36:10.177 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/crc32_generic.ko 2023-07-27T19:36:10.178 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/crypto_engine.ko 2023-07-27T19:36:10.178 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/crypto_user.ko 2023-07-27T19:36:10.178 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/cts.ko 2023-07-27T19:36:10.178 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/des_generic.ko 2023-07-27T19:36:10.178 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/dh_generic.ko 2023-07-27T19:36:10.178 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/echainiv.ko 2023-07-27T19:36:10.178 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/essiv.ko 2023-07-27T19:36:10.178 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/fcrypt.ko 2023-07-27T19:36:10.179 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/khazad.ko 2023-07-27T19:36:10.179 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/lz4.ko 2023-07-27T19:36:10.179 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/lz4hc.ko 2023-07-27T19:36:10.179 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/md4.ko 2023-07-27T19:36:10.179 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/michael_mic.ko 2023-07-27T19:36:10.179 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/pcbc.ko 2023-07-27T19:36:10.179 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/pcrypt.ko 2023-07-27T19:36:10.180 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/rmd160.ko 2023-07-27T19:36:10.180 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/seed.ko 2023-07-27T19:36:10.180 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/serpent_generic.ko 2023-07-27T19:36:10.180 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/tcrypt.ko 2023-07-27T19:36:10.180 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/tea.ko 2023-07-27T19:36:10.180 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/twofish_common.ko 2023-07-27T19:36:10.181 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/twofish_generic.ko 2023-07-27T19:36:10.181 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/vmac.ko 2023-07-27T19:36:10.181 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/wp512.ko 2023-07-27T19:36:10.181 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/xcbc.ko 2023-07-27T19:36:10.181 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/xor.ko 2023-07-27T19:36:10.181 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/xxhash_generic.ko 2023-07-27T19:36:10.181 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers 2023-07-27T19:36:10.181 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/acpi 2023-07-27T19:36:10.182 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-27T19:36:10.182 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/acpi/acpi_pad.ko 2023-07-27T19:36:10.182 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/acpi/custom_method.ko 2023-07-27T19:36:10.182 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/acpi/ec_sys.ko 2023-07-27T19:36:10.182 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/acpi/platform_profile.ko 2023-07-27T19:36:10.182 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/acpi/sbs.ko 2023-07-27T19:36:10.182 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/acpi/sbshc.ko 2023-07-27T19:36:10.182 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/acpi/video.ko 2023-07-27T19:36:10.183 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata 2023-07-27T19:36:10.183 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/acard-ahci.ko 2023-07-27T19:36:10.183 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/ahci_platform.ko 2023-07-27T19:36:10.183 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/ata_generic.ko 2023-07-27T19:36:10.183 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/libahci_platform.ko 2023-07-27T19:36:10.183 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_acpi.ko 2023-07-27T19:36:10.183 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_ali.ko 2023-07-27T19:36:10.184 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_amd.ko 2023-07-27T19:36:10.184 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_artop.ko 2023-07-27T19:36:10.184 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_atiixp.ko 2023-07-27T19:36:10.184 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_atp867x.ko 2023-07-27T19:36:10.184 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_cmd640.ko 2023-07-27T19:36:10.184 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_cmd64x.ko 2023-07-27T19:36:10.184 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_cypress.ko 2023-07-27T19:36:10.184 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_efar.ko 2023-07-27T19:36:10.185 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_hpt366.ko 2023-07-27T19:36:10.185 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_hpt37x.ko 2023-07-27T19:36:10.185 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-27T19:36:10.185 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-27T19:36:10.185 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_it8213.ko 2023-07-27T19:36:10.185 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_it821x.ko 2023-07-27T19:36:10.185 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_jmicron.ko 2023-07-27T19:36:10.186 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_marvell.ko 2023-07-27T19:36:10.186 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_mpiix.ko 2023-07-27T19:36:10.186 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_netcell.ko 2023-07-27T19:36:10.186 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_ninja32.ko 2023-07-27T19:36:10.186 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_ns87410.ko 2023-07-27T19:36:10.186 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_ns87415.ko 2023-07-27T19:36:10.186 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_oldpiix.ko 2023-07-27T19:36:10.186 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_opti.ko 2023-07-27T19:36:10.187 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_optidma.ko 2023-07-27T19:36:10.187 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_pcmcia.ko 2023-07-27T19:36:10.187 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-27T19:36:10.187 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-27T19:36:10.187 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_piccolo.ko 2023-07-27T19:36:10.187 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_rdc.ko 2023-07-27T19:36:10.188 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_sch.ko 2023-07-27T19:36:10.188 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_serverworks.ko 2023-07-27T19:36:10.188 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_sil680.ko 2023-07-27T19:36:10.188 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_sis.ko 2023-07-27T19:36:10.188 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_sl82c105.ko 2023-07-27T19:36:10.188 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_triflex.ko 2023-07-27T19:36:10.188 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_via.ko 2023-07-27T19:36:10.189 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pdc_adma.ko 2023-07-27T19:36:10.189 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/sata_inic162x.ko 2023-07-27T19:36:10.189 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/sata_mv.ko 2023-07-27T19:36:10.189 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/sata_nv.ko 2023-07-27T19:36:10.189 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/sata_promise.ko 2023-07-27T19:36:10.189 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/sata_qstor.ko 2023-07-27T19:36:10.189 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/sata_sil.ko 2023-07-27T19:36:10.189 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/sata_sil24.ko 2023-07-27T19:36:10.190 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/sata_sis.ko 2023-07-27T19:36:10.190 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/sata_svw.ko 2023-07-27T19:36:10.190 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/sata_sx4.ko 2023-07-27T19:36:10.190 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/sata_uli.ko 2023-07-27T19:36:10.190 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/sata_via.ko 2023-07-27T19:36:10.190 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/sata_vsc.ko 2023-07-27T19:36:10.190 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/auxdisplay 2023-07-27T19:36:10.190 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/auxdisplay/ks0108.ko 2023-07-27T19:36:10.191 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/base 2023-07-27T19:36:10.191 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/base/regmap 2023-07-27T19:36:10.191 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-07-27T19:36:10.191 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-07-27T19:36:10.191 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/bcma 2023-07-27T19:36:10.191 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/bcma/bcma.ko 2023-07-27T19:36:10.191 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block 2023-07-27T19:36:10.191 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/aoe 2023-07-27T19:36:10.192 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/aoe/aoe.ko 2023-07-27T19:36:10.192 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/brd.ko 2023-07-27T19:36:10.192 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/drbd 2023-07-27T19:36:10.192 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/drbd/drbd.ko 2023-07-27T19:36:10.192 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/floppy.ko 2023-07-27T19:36:10.192 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/loop.ko 2023-07-27T19:36:10.192 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/mtip32xx 2023-07-27T19:36:10.193 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-27T19:36:10.193 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/nbd.ko 2023-07-27T19:36:10.193 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/null_blk 2023-07-27T19:36:10.193 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/null_blk/null_blk.ko 2023-07-27T19:36:10.193 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/pktcdvd.ko 2023-07-27T19:36:10.193 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/rbd.ko 2023-07-27T19:36:10.193 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/virtio_blk.ko 2023-07-27T19:36:10.194 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/xen-blkback 2023-07-27T19:36:10.194 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-27T19:36:10.194 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/xen-blkfront.ko 2023-07-27T19:36:10.194 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/zram 2023-07-27T19:36:10.194 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/zram/zram.ko 2023-07-27T19:36:10.194 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char 2023-07-27T19:36:10.194 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/hangcheck-timer.ko 2023-07-27T19:36:10.195 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/hw_random 2023-07-27T19:36:10.195 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-27T19:36:10.195 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-27T19:36:10.195 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-27T19:36:10.195 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/hw_random/via-rng.ko 2023-07-27T19:36:10.195 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-27T19:36:10.195 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/ipmi 2023-07-27T19:36:10.196 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-27T19:36:10.196 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-27T19:36:10.196 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-27T19:36:10.196 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-27T19:36:10.196 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-27T19:36:10.196 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-27T19:36:10.196 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/lp.ko 2023-07-27T19:36:10.197 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/mwave 2023-07-27T19:36:10.197 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/mwave/mwave.ko 2023-07-27T19:36:10.197 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/ppdev.ko 2023-07-27T19:36:10.197 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/tlclk.ko 2023-07-27T19:36:10.197 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/tpm 2023-07-27T19:36:10.197 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/tpm/tpm.ko 2023-07-27T19:36:10.197 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-27T19:36:10.197 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-27T19:36:10.198 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-27T19:36:10.198 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/tpm/tpm_tis.ko 2023-07-27T19:36:10.198 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-07-27T19:36:10.198 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/uv_mmtimer.ko 2023-07-27T19:36:10.198 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/virtio_console.ko 2023-07-27T19:36:10.198 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/cpufreq 2023-07-27T19:36:10.198 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-07-27T19:36:10.198 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-27T19:36:10.199 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-27T19:36:10.199 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-07-27T19:36:10.199 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/cpufreq/powernow-k8.ko 2023-07-27T19:36:10.199 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-27T19:36:10.199 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/crypto 2023-07-27T19:36:10.199 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/crypto/ccp 2023-07-27T19:36:10.200 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-27T19:36:10.200 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/crypto/ccp/ccp.ko 2023-07-27T19:36:10.200 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/crypto/intel 2023-07-27T19:36:10.200 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/crypto/intel/qat 2023-07-27T19:36:10.200 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/crypto/intel/qat/qat_common 2023-07-27T19:36:10.200 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-27T19:36:10.200 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-07-27T19:36:10.201 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-27T19:36:10.201 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/crypto/padlock-aes.ko 2023-07-27T19:36:10.201 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/crypto/padlock-sha.ko 2023-07-27T19:36:10.201 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/crypto/virtio 2023-07-27T19:36:10.201 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-27T19:36:10.201 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/dca 2023-07-27T19:36:10.202 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/dca/dca.ko 2023-07-27T19:36:10.202 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/devfreq 2023-07-27T19:36:10.202 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-07-27T19:36:10.202 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/dma 2023-07-27T19:36:10.202 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/dma/dw 2023-07-27T19:36:10.203 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-27T19:36:10.203 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/dma/ioat 2023-07-27T19:36:10.203 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-27T19:36:10.203 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/edac 2023-07-27T19:36:10.204 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/edac/amd64_edac.ko 2023-07-27T19:36:10.204 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/edac/e752x_edac.ko 2023-07-27T19:36:10.204 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/edac/edac_mce_amd.ko 2023-07-27T19:36:10.205 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/edac/i3000_edac.ko 2023-07-27T19:36:10.205 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/edac/i3200_edac.ko 2023-07-27T19:36:10.205 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/edac/i5100_edac.ko 2023-07-27T19:36:10.205 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/edac/i5400_edac.ko 2023-07-27T19:36:10.206 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/edac/i7300_edac.ko 2023-07-27T19:36:10.206 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/edac/i7core_edac.ko 2023-07-27T19:36:10.206 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/edac/i82975x_edac.ko 2023-07-27T19:36:10.207 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/edac/ie31200_edac.ko 2023-07-27T19:36:10.207 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/edac/sb_edac.ko 2023-07-27T19:36:10.207 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/edac/x38_edac.ko 2023-07-27T19:36:10.207 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/firmware 2023-07-27T19:36:10.208 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/firmware/edd.ko 2023-07-27T19:36:10.208 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-27T19:36:10.208 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/gpio 2023-07-27T19:36:10.209 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/gpio/gpio-ich.ko 2023-07-27T19:36:10.209 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-27T19:36:10.209 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid 2023-07-27T19:36:10.209 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-appleir.ko 2023-07-27T19:36:10.210 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-aureal.ko 2023-07-27T19:36:10.210 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-axff.ko 2023-07-27T19:36:10.210 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-dr.ko 2023-07-27T19:36:10.211 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-elecom.ko 2023-07-27T19:36:10.211 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-elo.ko 2023-07-27T19:36:10.211 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-emsff.ko 2023-07-27T19:36:10.211 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-gaff.ko 2023-07-27T19:36:10.211 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-gt683r.ko 2023-07-27T19:36:10.211 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-gyration.ko 2023-07-27T19:36:10.211 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-27T19:36:10.212 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-27T19:36:10.212 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-holtekff.ko 2023-07-27T19:36:10.212 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-hyperv.ko 2023-07-27T19:36:10.212 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-icade.ko 2023-07-27T19:36:10.212 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-keytouch.ko 2023-07-27T19:36:10.212 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-kye.ko 2023-07-27T19:36:10.212 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-lcpower.ko 2023-07-27T19:36:10.213 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-led.ko 2023-07-27T19:36:10.213 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-lenovo.ko 2023-07-27T19:36:10.213 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-27T19:36:10.213 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-27T19:36:10.213 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-multitouch.ko 2023-07-27T19:36:10.213 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-ortek.ko 2023-07-27T19:36:10.213 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-penmount.ko 2023-07-27T19:36:10.213 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-petalynx.ko 2023-07-27T19:36:10.214 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-picolcd.ko 2023-07-27T19:36:10.214 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-pl.ko 2023-07-27T19:36:10.214 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-plantronics.ko 2023-07-27T19:36:10.214 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-primax.ko 2023-07-27T19:36:10.214 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-rmi.ko 2023-07-27T19:36:10.214 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-27T19:36:10.214 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-roccat-common.ko 2023-07-27T19:36:10.215 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-27T19:36:10.215 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-27T19:36:10.215 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-27T19:36:10.215 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-27T19:36:10.215 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-27T19:36:10.215 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-27T19:36:10.215 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-27T19:36:10.215 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-27T19:36:10.216 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-27T19:36:10.216 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-roccat.ko 2023-07-27T19:36:10.216 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-saitek.ko 2023-07-27T19:36:10.216 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-samsung.ko 2023-07-27T19:36:10.216 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-27T19:36:10.216 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-sjoy.ko 2023-07-27T19:36:10.216 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-sony.ko 2023-07-27T19:36:10.217 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-speedlink.ko 2023-07-27T19:36:10.217 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-steelseries.ko 2023-07-27T19:36:10.217 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-sunplus.ko 2023-07-27T19:36:10.217 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-27T19:36:10.217 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-tivo.ko 2023-07-27T19:36:10.217 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-tmff.ko 2023-07-27T19:36:10.217 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-topseed.ko 2023-07-27T19:36:10.218 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-twinhan.ko 2023-07-27T19:36:10.218 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-uclogic.ko 2023-07-27T19:36:10.218 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-waltop.ko 2023-07-27T19:36:10.218 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-wiimote.ko 2023-07-27T19:36:10.218 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-xinmo.ko 2023-07-27T19:36:10.218 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-zpff.ko 2023-07-27T19:36:10.218 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-zydacron.ko 2023-07-27T19:36:10.218 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/uhid.ko 2023-07-27T19:36:10.219 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/wacom.ko 2023-07-27T19:36:10.219 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hv 2023-07-27T19:36:10.219 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hv/hv_balloon.ko 2023-07-27T19:36:10.219 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hv/hv_utils.ko 2023-07-27T19:36:10.219 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hv/hv_vmbus.ko 2023-07-27T19:36:10.220 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon 2023-07-27T19:36:10.220 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/abituguru.ko 2023-07-27T19:36:10.220 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/abituguru3.ko 2023-07-27T19:36:10.220 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-27T19:36:10.220 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/ad7414.ko 2023-07-27T19:36:10.220 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/ad7418.ko 2023-07-27T19:36:10.221 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/adc128d818.ko 2023-07-27T19:36:10.221 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/adm1025.ko 2023-07-27T19:36:10.221 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/adm1026.ko 2023-07-27T19:36:10.221 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/adm1029.ko 2023-07-27T19:36:10.221 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/adm1031.ko 2023-07-27T19:36:10.221 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/adm9240.ko 2023-07-27T19:36:10.221 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/ads7828.ko 2023-07-27T19:36:10.221 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/adt7410.ko 2023-07-27T19:36:10.222 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/adt7411.ko 2023-07-27T19:36:10.222 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/adt7462.ko 2023-07-27T19:36:10.222 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/adt7470.ko 2023-07-27T19:36:10.222 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/adt7475.ko 2023-07-27T19:36:10.222 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/adt7x10.ko 2023-07-27T19:36:10.222 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/amc6821.ko 2023-07-27T19:36:10.222 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/applesmc.ko 2023-07-27T19:36:10.223 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/asb100.ko 2023-07-27T19:36:10.223 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/asc7621.ko 2023-07-27T19:36:10.223 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-27T19:36:10.223 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/atxp1.ko 2023-07-27T19:36:10.223 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/coretemp.ko 2023-07-27T19:36:10.223 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-27T19:36:10.223 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/dme1737.ko 2023-07-27T19:36:10.224 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/ds1621.ko 2023-07-27T19:36:10.224 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/ds620.ko 2023-07-27T19:36:10.224 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/emc1403.ko 2023-07-27T19:36:10.224 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/emc6w201.ko 2023-07-27T19:36:10.224 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/f71805f.ko 2023-07-27T19:36:10.224 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/f71882fg.ko 2023-07-27T19:36:10.224 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/f75375s.ko 2023-07-27T19:36:10.225 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/fam15h_power.ko 2023-07-27T19:36:10.225 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/fschmd.ko 2023-07-27T19:36:10.225 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/g760a.ko 2023-07-27T19:36:10.225 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/g762.ko 2023-07-27T19:36:10.225 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/gl518sm.ko 2023-07-27T19:36:10.225 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/gl520sm.ko 2023-07-27T19:36:10.225 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-27T19:36:10.225 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/i5500_temp.ko 2023-07-27T19:36:10.226 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/i5k_amb.ko 2023-07-27T19:36:10.226 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/ibmaem.ko 2023-07-27T19:36:10.226 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/ibmpex.ko 2023-07-27T19:36:10.226 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/ina209.ko 2023-07-27T19:36:10.226 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/ina2xx.ko 2023-07-27T19:36:10.226 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/it87.ko 2023-07-27T19:36:10.226 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/k10temp.ko 2023-07-27T19:36:10.226 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/k8temp.ko 2023-07-27T19:36:10.227 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/lineage-pem.ko 2023-07-27T19:36:10.227 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/lm63.ko 2023-07-27T19:36:10.227 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/lm73.ko 2023-07-27T19:36:10.227 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/lm75.ko 2023-07-27T19:36:10.227 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/lm77.ko 2023-07-27T19:36:10.227 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/lm78.ko 2023-07-27T19:36:10.227 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/lm80.ko 2023-07-27T19:36:10.228 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/lm83.ko 2023-07-27T19:36:10.228 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/lm85.ko 2023-07-27T19:36:10.228 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/lm87.ko 2023-07-27T19:36:10.229 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/lm90.ko 2023-07-27T19:36:10.229 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/lm92.ko 2023-07-27T19:36:10.229 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/lm93.ko 2023-07-27T19:36:10.230 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/lm95234.ko 2023-07-27T19:36:10.230 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/lm95241.ko 2023-07-27T19:36:10.230 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/lm95245.ko 2023-07-27T19:36:10.230 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/ltc2945.ko 2023-07-27T19:36:10.231 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/ltc4151.ko 2023-07-27T19:36:10.231 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/ltc4215.ko 2023-07-27T19:36:10.231 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/ltc4222.ko 2023-07-27T19:36:10.231 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/ltc4245.ko 2023-07-27T19:36:10.232 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/ltc4260.ko 2023-07-27T19:36:10.232 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/ltc4261.ko 2023-07-27T19:36:10.232 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/max16065.ko 2023-07-27T19:36:10.232 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/max1619.ko 2023-07-27T19:36:10.233 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/max1668.ko 2023-07-27T19:36:10.233 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/max197.ko 2023-07-27T19:36:10.233 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/max6639.ko 2023-07-27T19:36:10.233 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/max6650.ko 2023-07-27T19:36:10.234 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/max6697.ko 2023-07-27T19:36:10.234 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/mcp3021.ko 2023-07-27T19:36:10.234 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/nct6683.ko 2023-07-27T19:36:10.234 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/nct6775-core.ko 2023-07-27T19:36:10.235 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/nct6775.ko 2023-07-27T19:36:10.235 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/nct7802.ko 2023-07-27T19:36:10.235 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/pc87360.ko 2023-07-27T19:36:10.235 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/pc87427.ko 2023-07-27T19:36:10.235 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/pcf8591.ko 2023-07-27T19:36:10.235 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/pmbus 2023-07-27T19:36:10.235 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-27T19:36:10.236 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-27T19:36:10.236 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-27T19:36:10.236 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-27T19:36:10.236 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-27T19:36:10.236 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-27T19:36:10.236 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-27T19:36:10.236 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-27T19:36:10.237 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-27T19:36:10.237 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-27T19:36:10.237 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-27T19:36:10.237 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-27T19:36:10.237 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/powr1220.ko 2023-07-27T19:36:10.237 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/sch5627.ko 2023-07-27T19:36:10.237 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/sch5636.ko 2023-07-27T19:36:10.237 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-27T19:36:10.238 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/sht15.ko 2023-07-27T19:36:10.238 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/sht21.ko 2023-07-27T19:36:10.238 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/shtc1.ko 2023-07-27T19:36:10.238 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/sis5595.ko 2023-07-27T19:36:10.238 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/smsc47b397.ko 2023-07-27T19:36:10.238 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/smsc47m1.ko 2023-07-27T19:36:10.238 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/smsc47m192.ko 2023-07-27T19:36:10.239 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/thmc50.ko 2023-07-27T19:36:10.239 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/tmp102.ko 2023-07-27T19:36:10.239 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/tmp103.ko 2023-07-27T19:36:10.239 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/tmp401.ko 2023-07-27T19:36:10.239 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/tmp421.ko 2023-07-27T19:36:10.239 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/via-cputemp.ko 2023-07-27T19:36:10.239 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/via686a.ko 2023-07-27T19:36:10.239 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/vt1211.ko 2023-07-27T19:36:10.240 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/vt8231.ko 2023-07-27T19:36:10.240 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/w83627ehf.ko 2023-07-27T19:36:10.240 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/w83627hf.ko 2023-07-27T19:36:10.240 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/w83781d.ko 2023-07-27T19:36:10.240 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/w83791d.ko 2023-07-27T19:36:10.240 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/w83792d.ko 2023-07-27T19:36:10.240 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/w83793.ko 2023-07-27T19:36:10.241 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/w83795.ko 2023-07-27T19:36:10.241 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/w83l785ts.ko 2023-07-27T19:36:10.241 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/w83l786ng.ko 2023-07-27T19:36:10.241 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c 2023-07-27T19:36:10.241 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/algos 2023-07-27T19:36:10.241 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-27T19:36:10.241 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-27T19:36:10.242 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses 2023-07-27T19:36:10.242 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-27T19:36:10.242 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-27T19:36:10.242 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-27T19:36:10.242 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-27T19:36:10.242 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-27T19:36:10.242 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-27T19:36:10.243 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-27T19:36:10.243 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-27T19:36:10.243 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-27T19:36:10.243 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-27T19:36:10.243 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-27T19:36:10.243 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-27T19:36:10.243 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-27T19:36:10.243 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-27T19:36:10.244 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-27T19:36:10.244 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-27T19:36:10.244 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-27T19:36:10.244 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-27T19:36:10.244 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-27T19:36:10.244 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-27T19:36:10.244 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-27T19:36:10.245 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-27T19:36:10.245 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-27T19:36:10.245 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/i2c-dev.ko 2023-07-27T19:36:10.245 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/i2c-mux.ko 2023-07-27T19:36:10.245 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-07-27T19:36:10.245 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/i2c-smbus.ko 2023-07-27T19:36:10.245 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/i2c-stub.ko 2023-07-27T19:36:10.245 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband 2023-07-27T19:36:10.246 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/core 2023-07-27T19:36:10.246 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-27T19:36:10.246 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/core/ib_core.ko 2023-07-27T19:36:10.246 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-27T19:36:10.246 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-27T19:36:10.246 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-27T19:36:10.246 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-27T19:36:10.247 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-27T19:36:10.247 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/hw 2023-07-27T19:36:10.247 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/hw/cxgb4 2023-07-27T19:36:10.247 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-27T19:36:10.247 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/hw/mlx4 2023-07-27T19:36:10.247 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-27T19:36:10.247 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/hw/mlx5 2023-07-27T19:36:10.247 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-27T19:36:10.248 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/hw/mthca 2023-07-27T19:36:10.248 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-27T19:36:10.248 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/ulp 2023-07-27T19:36:10.248 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/ulp/ipoib 2023-07-27T19:36:10.248 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-27T19:36:10.248 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/ulp/iser 2023-07-27T19:36:10.248 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-27T19:36:10.249 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/ulp/isert 2023-07-27T19:36:10.249 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-27T19:36:10.249 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/ulp/srp 2023-07-27T19:36:10.249 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-27T19:36:10.249 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/ulp/srpt 2023-07-27T19:36:10.249 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-27T19:36:10.249 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input 2023-07-27T19:36:10.250 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/gameport 2023-07-27T19:36:10.250 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-27T19:36:10.250 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-27T19:36:10.250 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/gameport/gameport.ko 2023-07-27T19:36:10.250 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/gameport/lightning.ko 2023-07-27T19:36:10.250 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/gameport/ns558.ko 2023-07-27T19:36:10.251 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/joydev.ko 2023-07-27T19:36:10.251 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/keyboard 2023-07-27T19:36:10.251 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-27T19:36:10.251 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/mouse 2023-07-27T19:36:10.251 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/mouse/appletouch.ko 2023-07-27T19:36:10.251 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/mouse/bcm5974.ko 2023-07-27T19:36:10.251 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/mouse/cyapatp.ko 2023-07-27T19:36:10.251 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-27T19:36:10.252 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/mouse/sermouse.ko 2023-07-27T19:36:10.252 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-27T19:36:10.252 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-27T19:36:10.252 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-27T19:36:10.252 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/rmi4 2023-07-27T19:36:10.252 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-27T19:36:10.252 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/serio 2023-07-27T19:36:10.253 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/serio/altera_ps2.ko 2023-07-27T19:36:10.253 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/serio/arc_ps2.ko 2023-07-27T19:36:10.253 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-27T19:36:10.253 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/serio/serio_raw.ko 2023-07-27T19:36:10.253 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/sparse-keymap.ko 2023-07-27T19:36:10.253 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/iommu 2023-07-27T19:36:10.253 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/iommu/amd 2023-07-27T19:36:10.253 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-27T19:36:10.254 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/leds 2023-07-27T19:36:10.254 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/leds/leds-blinkm.ko 2023-07-27T19:36:10.254 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/leds/leds-lm3530.ko 2023-07-27T19:36:10.254 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/leds/leds-lp3944.ko 2023-07-27T19:36:10.254 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/leds/leds-ss4200.ko 2023-07-27T19:36:10.254 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/leds/trigger 2023-07-27T19:36:10.254 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-27T19:36:10.255 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-27T19:36:10.255 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-27T19:36:10.255 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-27T19:36:10.255 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-27T19:36:10.255 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-27T19:36:10.255 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-27T19:36:10.255 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-27T19:36:10.255 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md 2023-07-27T19:36:10.256 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/bcache 2023-07-27T19:36:10.256 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/bcache/bcache.ko 2023-07-27T19:36:10.256 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/dm-bio-prison.ko 2023-07-27T19:36:10.256 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/dm-cache-smq.ko 2023-07-27T19:36:10.256 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/dm-cache.ko 2023-07-27T19:36:10.256 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/dm-crypt.ko 2023-07-27T19:36:10.256 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/dm-delay.ko 2023-07-27T19:36:10.257 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/dm-flakey.ko 2023-07-27T19:36:10.257 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/dm-log-userspace.ko 2023-07-27T19:36:10.257 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/dm-multipath.ko 2023-07-27T19:36:10.257 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/dm-queue-length.ko 2023-07-27T19:36:10.257 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/dm-raid.ko 2023-07-27T19:36:10.257 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/dm-round-robin.ko 2023-07-27T19:36:10.257 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/dm-service-time.ko 2023-07-27T19:36:10.257 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/dm-switch.ko 2023-07-27T19:36:10.258 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/dm-thin-pool.ko 2023-07-27T19:36:10.258 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/dm-verity.ko 2023-07-27T19:36:10.258 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/faulty.ko 2023-07-27T19:36:10.258 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/linear.ko 2023-07-27T19:36:10.258 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/multipath.ko 2023-07-27T19:36:10.258 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/persistent-data 2023-07-27T19:36:10.258 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-27T19:36:10.259 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/raid0.ko 2023-07-27T19:36:10.259 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/raid1.ko 2023-07-27T19:36:10.259 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/raid10.ko 2023-07-27T19:36:10.259 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/raid456.ko 2023-07-27T19:36:10.259 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/message 2023-07-27T19:36:10.259 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/message/fusion 2023-07-27T19:36:10.259 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/message/fusion/mptbase.ko 2023-07-27T19:36:10.259 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/message/fusion/mptctl.ko 2023-07-27T19:36:10.260 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/message/fusion/mptfc.ko 2023-07-27T19:36:10.260 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/message/fusion/mptlan.ko 2023-07-27T19:36:10.260 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/message/fusion/mptsas.ko 2023-07-27T19:36:10.260 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/message/fusion/mptscsih.ko 2023-07-27T19:36:10.260 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/message/fusion/mptspi.ko 2023-07-27T19:36:10.260 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/mfd 2023-07-27T19:36:10.260 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/mfd/lpc_ich.ko 2023-07-27T19:36:10.261 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/mfd/lpc_sch.ko 2023-07-27T19:36:10.261 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/mfd/mfd-core.ko 2023-07-27T19:36:10.261 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/mfd/sm501.ko 2023-07-27T19:36:10.261 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/mfd/viperboard.ko 2023-07-27T19:36:10.261 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/mfd/vx855.ko 2023-07-27T19:36:10.261 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/mfd/wl1273-core.ko 2023-07-27T19:36:10.261 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc 2023-07-27T19:36:10.261 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/altera-stapl 2023-07-27T19:36:10.262 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-27T19:36:10.262 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/apds9802als.ko 2023-07-27T19:36:10.262 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/apds990x.ko 2023-07-27T19:36:10.262 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/bh1770glc.ko 2023-07-27T19:36:10.262 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/cb710 2023-07-27T19:36:10.262 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/cb710/cb710.ko 2023-07-27T19:36:10.262 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/eeprom 2023-07-27T19:36:10.262 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/eeprom/at24.ko 2023-07-27T19:36:10.263 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-27T19:36:10.263 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-27T19:36:10.263 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/eeprom/max6875.ko 2023-07-27T19:36:10.263 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/enclosure.ko 2023-07-27T19:36:10.263 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/hpilo.ko 2023-07-27T19:36:10.263 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/isl29003.ko 2023-07-27T19:36:10.263 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/isl29020.ko 2023-07-27T19:36:10.264 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/lis3lv02d 2023-07-27T19:36:10.264 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-27T19:36:10.264 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-27T19:36:10.264 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/mei 2023-07-27T19:36:10.264 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/mei/mei-me.ko 2023-07-27T19:36:10.264 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/mei/mei-txe.ko 2023-07-27T19:36:10.264 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/mei/mei.ko 2023-07-27T19:36:10.264 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/sgi-gru 2023-07-27T19:36:10.265 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/sgi-gru/gru.ko 2023-07-27T19:36:10.265 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/sgi-xp 2023-07-27T19:36:10.265 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/sgi-xp/xp.ko 2023-07-27T19:36:10.265 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-07-27T19:36:10.265 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-07-27T19:36:10.265 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/tifm_7xx1.ko 2023-07-27T19:36:10.265 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/tifm_core.ko 2023-07-27T19:36:10.266 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/tsl2550.ko 2023-07-27T19:36:10.266 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/vmw_balloon.ko 2023-07-27T19:36:10.266 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/vmw_vmci 2023-07-27T19:36:10.266 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-27T19:36:10.266 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net 2023-07-27T19:36:10.266 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/bonding 2023-07-27T19:36:10.266 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/bonding/bonding.ko 2023-07-27T19:36:10.267 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/dsa 2023-07-27T19:36:10.267 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/dsa/b53 2023-07-27T19:36:10.267 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-27T19:36:10.267 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-27T19:36:10.267 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-27T19:36:10.267 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/dsa/mv88e6xxx 2023-07-27T19:36:10.268 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-27T19:36:10.268 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/dummy.ko 2023-07-27T19:36:10.268 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/eql.ko 2023-07-27T19:36:10.268 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet 2023-07-27T19:36:10.268 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/3com 2023-07-27T19:36:10.268 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-27T19:36:10.268 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-27T19:36:10.269 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-27T19:36:10.269 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-27T19:36:10.269 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/8390 2023-07-27T19:36:10.269 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-27T19:36:10.269 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-27T19:36:10.269 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-27T19:36:10.269 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-27T19:36:10.269 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/adaptec 2023-07-27T19:36:10.270 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-27T19:36:10.270 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/agere 2023-07-27T19:36:10.270 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-27T19:36:10.270 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/alteon 2023-07-27T19:36:10.270 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-27T19:36:10.270 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/altera 2023-07-27T19:36:10.270 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-27T19:36:10.270 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/amd 2023-07-27T19:36:10.271 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-27T19:36:10.271 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-27T19:36:10.271 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-27T19:36:10.271 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/atheros 2023-07-27T19:36:10.271 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/atheros/alx 2023-07-27T19:36:10.271 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-27T19:36:10.272 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/atheros/atl1c 2023-07-27T19:36:10.272 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-27T19:36:10.272 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/atheros/atl1e 2023-07-27T19:36:10.272 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-27T19:36:10.272 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/atheros/atlx 2023-07-27T19:36:10.272 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-27T19:36:10.272 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-27T19:36:10.272 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/broadcom 2023-07-27T19:36:10.273 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-27T19:36:10.273 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-27T19:36:10.273 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-07-27T19:36:10.273 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-27T19:36:10.273 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-27T19:36:10.273 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/broadcom/genet 2023-07-27T19:36:10.273 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-27T19:36:10.274 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-27T19:36:10.274 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/brocade 2023-07-27T19:36:10.274 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/brocade/bna 2023-07-27T19:36:10.274 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-27T19:36:10.274 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/chelsio 2023-07-27T19:36:10.274 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-07-27T19:36:10.274 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-27T19:36:10.274 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-07-27T19:36:10.275 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-27T19:36:10.275 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-07-27T19:36:10.275 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-27T19:36:10.275 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-07-27T19:36:10.275 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-27T19:36:10.275 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-07-27T19:36:10.275 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-27T19:36:10.275 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/cisco 2023-07-27T19:36:10.276 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/cisco/enic 2023-07-27T19:36:10.276 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-27T19:36:10.276 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/dec 2023-07-27T19:36:10.276 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/dec/tulip 2023-07-27T19:36:10.276 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-27T19:36:10.276 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-27T19:36:10.276 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-27T19:36:10.277 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-27T19:36:10.277 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-27T19:36:10.277 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-27T19:36:10.277 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/dlink 2023-07-27T19:36:10.277 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-27T19:36:10.277 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-27T19:36:10.277 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/dnet.ko 2023-07-27T19:36:10.278 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/emulex 2023-07-27T19:36:10.278 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/emulex/benet 2023-07-27T19:36:10.278 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-27T19:36:10.278 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/ethoc.ko 2023-07-27T19:36:10.278 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/fealnx.ko 2023-07-27T19:36:10.278 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel 2023-07-27T19:36:10.278 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-27T19:36:10.278 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel/e1000 2023-07-27T19:36:10.279 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-27T19:36:10.279 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel/e1000e 2023-07-27T19:36:10.279 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-27T19:36:10.279 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel/fm10k 2023-07-27T19:36:10.279 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-27T19:36:10.279 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel/i40e 2023-07-27T19:36:10.279 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-27T19:36:10.279 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel/iavf 2023-07-27T19:36:10.280 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-27T19:36:10.280 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel/igb 2023-07-27T19:36:10.280 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-27T19:36:10.280 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel/igbvf 2023-07-27T19:36:10.280 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-27T19:36:10.280 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel/ixgbe 2023-07-27T19:36:10.281 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-27T19:36:10.281 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-07-27T19:36:10.281 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-27T19:36:10.281 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/jme.ko 2023-07-27T19:36:10.281 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/marvell 2023-07-27T19:36:10.281 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-27T19:36:10.282 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-27T19:36:10.282 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-27T19:36:10.282 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/mellanox 2023-07-27T19:36:10.282 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-07-27T19:36:10.282 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-27T19:36:10.282 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-27T19:36:10.282 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-07-27T19:36:10.283 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-07-27T19:36:10.283 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-27T19:36:10.283 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/micrel 2023-07-27T19:36:10.283 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-27T19:36:10.283 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/myricom 2023-07-27T19:36:10.283 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-07-27T19:36:10.283 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-27T19:36:10.284 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/natsemi 2023-07-27T19:36:10.284 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-27T19:36:10.284 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-27T19:36:10.284 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/neterion 2023-07-27T19:36:10.284 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-27T19:36:10.284 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/nvidia 2023-07-27T19:36:10.284 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-27T19:36:10.285 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/packetengines 2023-07-27T19:36:10.285 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-27T19:36:10.285 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-27T19:36:10.285 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/qlogic 2023-07-27T19:36:10.285 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/qlogic/netxen 2023-07-27T19:36:10.285 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-27T19:36:10.285 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-27T19:36:10.286 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-07-27T19:36:10.286 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-27T19:36:10.286 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/rdc 2023-07-27T19:36:10.286 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-27T19:36:10.286 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/realtek 2023-07-27T19:36:10.287 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-27T19:36:10.287 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-27T19:36:10.287 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-27T19:36:10.287 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-27T19:36:10.287 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/rocker 2023-07-27T19:36:10.287 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-07-27T19:36:10.288 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/sfc 2023-07-27T19:36:10.288 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-27T19:36:10.288 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/silan 2023-07-27T19:36:10.288 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-27T19:36:10.289 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/sis 2023-07-27T19:36:10.289 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-27T19:36:10.289 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-27T19:36:10.289 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/smsc 2023-07-27T19:36:10.289 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-27T19:36:10.289 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-27T19:36:10.290 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-27T19:36:10.290 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-27T19:36:10.290 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/stmicro 2023-07-27T19:36:10.290 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-07-27T19:36:10.290 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-27T19:36:10.290 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-27T19:36:10.291 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/sun 2023-07-27T19:36:10.291 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-27T19:36:10.291 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-27T19:36:10.292 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-27T19:36:10.292 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-27T19:36:10.292 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/tehuti 2023-07-27T19:36:10.292 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-27T19:36:10.292 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/ti 2023-07-27T19:36:10.292 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-27T19:36:10.293 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/via 2023-07-27T19:36:10.293 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-27T19:36:10.293 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-27T19:36:10.293 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/wiznet 2023-07-27T19:36:10.293 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-27T19:36:10.293 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-27T19:36:10.293 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/xircom 2023-07-27T19:36:10.294 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-27T19:36:10.294 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/geneve.ko 2023-07-27T19:36:10.294 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/hyperv 2023-07-27T19:36:10.294 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-27T19:36:10.294 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ieee802154 2023-07-27T19:36:10.294 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-27T19:36:10.294 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ifb.ko 2023-07-27T19:36:10.294 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ipvlan 2023-07-27T19:36:10.295 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-27T19:36:10.295 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/macvlan.ko 2023-07-27T19:36:10.295 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/macvtap.ko 2023-07-27T19:36:10.295 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/mdio 2023-07-27T19:36:10.295 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/mdio.ko 2023-07-27T19:36:10.295 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-27T19:36:10.295 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-27T19:36:10.296 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-07-27T19:36:10.296 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/mii.ko 2023-07-27T19:36:10.296 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/net_failover.ko 2023-07-27T19:36:10.296 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/netconsole.ko 2023-07-27T19:36:10.296 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/nlmon.ko 2023-07-27T19:36:10.296 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/pcs 2023-07-27T19:36:10.296 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-07-27T19:36:10.296 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-27T19:36:10.297 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy 2023-07-27T19:36:10.297 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/amd.ko 2023-07-27T19:36:10.297 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-27T19:36:10.297 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-07-27T19:36:10.297 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-27T19:36:10.297 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/bcm87xx.ko 2023-07-27T19:36:10.297 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/broadcom.ko 2023-07-27T19:36:10.298 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/cicada.ko 2023-07-27T19:36:10.298 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/davicom.ko 2023-07-27T19:36:10.298 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/dp83640.ko 2023-07-27T19:36:10.298 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/et1011c.ko 2023-07-27T19:36:10.298 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/icplus.ko 2023-07-27T19:36:10.298 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/lxt.ko 2023-07-27T19:36:10.298 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/marvell.ko 2023-07-27T19:36:10.299 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/micrel.ko 2023-07-27T19:36:10.299 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/national.ko 2023-07-27T19:36:10.299 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/phylink.ko 2023-07-27T19:36:10.299 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/qsemi.ko 2023-07-27T19:36:10.300 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/realtek.ko 2023-07-27T19:36:10.300 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/smsc.ko 2023-07-27T19:36:10.300 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/ste10Xp.ko 2023-07-27T19:36:10.300 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/vitesse.ko 2023-07-27T19:36:10.300 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ppp 2023-07-27T19:36:10.301 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-27T19:36:10.301 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ppp/ppp_async.ko 2023-07-27T19:36:10.301 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-27T19:36:10.301 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ppp/ppp_generic.ko 2023-07-27T19:36:10.301 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-27T19:36:10.302 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-27T19:36:10.302 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ppp/pppoe.ko 2023-07-27T19:36:10.302 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ppp/pppox.ko 2023-07-27T19:36:10.302 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ppp/pptp.ko 2023-07-27T19:36:10.302 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/slip 2023-07-27T19:36:10.302 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/slip/slhc.ko 2023-07-27T19:36:10.303 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/slip/slip.ko 2023-07-27T19:36:10.303 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/sungem_phy.ko 2023-07-27T19:36:10.303 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/tap.ko 2023-07-27T19:36:10.303 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/team 2023-07-27T19:36:10.303 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/team/team.ko 2023-07-27T19:36:10.303 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-27T19:36:10.303 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-27T19:36:10.304 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-27T19:36:10.304 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/team/team_mode_random.ko 2023-07-27T19:36:10.304 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-27T19:36:10.304 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/tun.ko 2023-07-27T19:36:10.304 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/veth.ko 2023-07-27T19:36:10.304 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/virtio_net.ko 2023-07-27T19:36:10.304 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/vmxnet3 2023-07-27T19:36:10.304 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-27T19:36:10.305 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/vxlan 2023-07-27T19:36:10.305 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/vxlan/vxlan.ko 2023-07-27T19:36:10.305 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/xen-netback 2023-07-27T19:36:10.305 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-27T19:36:10.305 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/xen-netfront.ko 2023-07-27T19:36:10.305 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ntb 2023-07-27T19:36:10.305 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ntb/ntb.ko 2023-07-27T19:36:10.306 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/nvme 2023-07-27T19:36:10.306 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/nvme/host 2023-07-27T19:36:10.306 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/nvme/host/nvme-core.ko 2023-07-27T19:36:10.306 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/nvme/host/nvme.ko 2023-07-27T19:36:10.306 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/parport 2023-07-27T19:36:10.307 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/parport/parport.ko 2023-07-27T19:36:10.307 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/parport/parport_cs.ko 2023-07-27T19:36:10.307 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/parport/parport_pc.ko 2023-07-27T19:36:10.307 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/parport/parport_serial.ko 2023-07-27T19:36:10.307 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/pci 2023-07-27T19:36:10.307 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/pci/hotplug 2023-07-27T19:36:10.307 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-27T19:36:10.307 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/pci/pcie 2023-07-27T19:36:10.308 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/pci/pcie/aer_inject.ko 2023-07-27T19:36:10.308 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/pci/xen-pcifront.ko 2023-07-27T19:36:10.308 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/pcmcia 2023-07-27T19:36:10.308 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/pcmcia/i82092.ko 2023-07-27T19:36:10.308 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/pcmcia/pd6729.ko 2023-07-27T19:36:10.308 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-27T19:36:10.309 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/pinctrl 2023-07-27T19:36:10.309 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/pinctrl/intel 2023-07-27T19:36:10.309 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-27T19:36:10.309 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform 2023-07-27T19:36:10.309 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86 2023-07-27T19:36:10.309 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-27T19:36:10.310 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/acerhdf.ko 2023-07-27T19:36:10.310 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-27T19:36:10.310 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-27T19:36:10.310 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-27T19:36:10.310 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-27T19:36:10.310 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-27T19:36:10.310 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-27T19:36:10.310 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-27T19:36:10.311 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-27T19:36:10.311 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-27T19:36:10.311 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/hdaps.ko 2023-07-27T19:36:10.311 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/intel 2023-07-27T19:36:10.311 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-27T19:36:10.312 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/intel_ips.ko 2023-07-27T19:36:10.312 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-27T19:36:10.312 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-27T19:36:10.312 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-27T19:36:10.312 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-27T19:36:10.312 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-27T19:36:10.313 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-27T19:36:10.313 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-27T19:36:10.313 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-27T19:36:10.313 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-27T19:36:10.313 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/wmi.ko 2023-07-27T19:36:10.313 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/powercap 2023-07-27T19:36:10.313 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-27T19:36:10.314 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-27T19:36:10.314 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/pps 2023-07-27T19:36:10.314 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/pps/clients 2023-07-27T19:36:10.314 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-27T19:36:10.314 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-27T19:36:10.314 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/pps/clients/pps_parport.ko 2023-07-27T19:36:10.315 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/pps/pps_core.ko 2023-07-27T19:36:10.315 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ptp 2023-07-27T19:36:10.315 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ptp/ptp.ko 2023-07-27T19:36:10.315 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ptp/ptp_kvm.ko 2023-07-27T19:36:10.315 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc 2023-07-27T19:36:10.315 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-27T19:36:10.315 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-27T19:36:10.316 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-27T19:36:10.316 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-27T19:36:10.316 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-27T19:36:10.316 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-27T19:36:10.316 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-27T19:36:10.316 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-27T19:36:10.316 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-27T19:36:10.316 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-27T19:36:10.317 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-27T19:36:10.317 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-em3027.ko 2023-07-27T19:36:10.317 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-27T19:36:10.317 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-27T19:36:10.317 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-27T19:36:10.317 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-27T19:36:10.317 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-27T19:36:10.318 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-27T19:36:10.318 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-max6900.ko 2023-07-27T19:36:10.318 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-27T19:36:10.318 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-27T19:36:10.318 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-27T19:36:10.318 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-27T19:36:10.318 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-27T19:36:10.318 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-27T19:36:10.319 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-27T19:36:10.319 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-27T19:36:10.319 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-27T19:36:10.319 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-27T19:36:10.319 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-27T19:36:10.319 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-27T19:36:10.319 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-x1205.ko 2023-07-27T19:36:10.320 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi 2023-07-27T19:36:10.320 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/3w-9xxx.ko 2023-07-27T19:36:10.320 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/3w-sas.ko 2023-07-27T19:36:10.320 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/3w-xxxx.ko 2023-07-27T19:36:10.320 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/BusLogic.ko 2023-07-27T19:36:10.320 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/a100u2w.ko 2023-07-27T19:36:10.320 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/aacraid 2023-07-27T19:36:10.321 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-27T19:36:10.321 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/advansys.ko 2023-07-27T19:36:10.321 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/aic7xxx 2023-07-27T19:36:10.321 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-27T19:36:10.321 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-27T19:36:10.321 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/am53c974.ko 2023-07-27T19:36:10.321 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/arcmsr 2023-07-27T19:36:10.322 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-27T19:36:10.322 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/atp870u.ko 2023-07-27T19:36:10.322 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/be2iscsi 2023-07-27T19:36:10.322 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-27T19:36:10.322 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/bfa 2023-07-27T19:36:10.322 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/bfa/bfa.ko 2023-07-27T19:36:10.322 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/bnx2fc 2023-07-27T19:36:10.322 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-27T19:36:10.323 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/bnx2i 2023-07-27T19:36:10.323 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-27T19:36:10.323 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/ch.ko 2023-07-27T19:36:10.323 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/csiostor 2023-07-27T19:36:10.323 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-27T19:36:10.324 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/cxgbi 2023-07-27T19:36:10.324 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-07-27T19:36:10.324 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-27T19:36:10.324 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-07-27T19:36:10.324 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-27T19:36:10.324 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-27T19:36:10.324 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/dc395x.ko 2023-07-27T19:36:10.325 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/device_handler 2023-07-27T19:36:10.325 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-07-27T19:36:10.325 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-07-27T19:36:10.325 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-07-27T19:36:10.325 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-07-27T19:36:10.325 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/dmx3191d.ko 2023-07-27T19:36:10.325 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/esas2r 2023-07-27T19:36:10.325 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-27T19:36:10.326 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/esp_scsi.ko 2023-07-27T19:36:10.326 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/fcoe 2023-07-27T19:36:10.326 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-27T19:36:10.326 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-27T19:36:10.326 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/fnic 2023-07-27T19:36:10.326 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/fnic/fnic.ko 2023-07-27T19:36:10.326 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/hpsa.ko 2023-07-27T19:36:10.326 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/hptiop.ko 2023-07-27T19:36:10.327 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/hv_storvsc.ko 2023-07-27T19:36:10.327 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/initio.ko 2023-07-27T19:36:10.327 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/ipr.ko 2023-07-27T19:36:10.327 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/ips.ko 2023-07-27T19:36:10.327 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/isci 2023-07-27T19:36:10.327 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/isci/isci.ko 2023-07-27T19:36:10.327 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-27T19:36:10.327 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-27T19:36:10.328 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/libfc 2023-07-27T19:36:10.328 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/libfc/libfc.ko 2023-07-27T19:36:10.328 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/libiscsi.ko 2023-07-27T19:36:10.328 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-27T19:36:10.328 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/libsas 2023-07-27T19:36:10.328 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/libsas/libsas.ko 2023-07-27T19:36:10.328 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/lpfc 2023-07-27T19:36:10.329 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-27T19:36:10.329 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/megaraid 2023-07-27T19:36:10.329 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/megaraid.ko 2023-07-27T19:36:10.329 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-27T19:36:10.329 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-27T19:36:10.329 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-27T19:36:10.329 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/mpt3sas 2023-07-27T19:36:10.330 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-27T19:36:10.330 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/mvsas 2023-07-27T19:36:10.330 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-27T19:36:10.330 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/mvumi.ko 2023-07-27T19:36:10.330 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/pm8001 2023-07-27T19:36:10.330 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-27T19:36:10.331 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/pmcraid.ko 2023-07-27T19:36:10.331 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/qla1280.ko 2023-07-27T19:36:10.331 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/qla2xxx 2023-07-27T19:36:10.331 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-27T19:36:10.331 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-27T19:36:10.331 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/qla4xxx 2023-07-27T19:36:10.331 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-27T19:36:10.331 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/raid_class.ko 2023-07-27T19:36:10.332 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/scsi_debug.ko 2023-07-27T19:36:10.332 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-27T19:36:10.332 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-27T19:36:10.332 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-27T19:36:10.332 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-27T19:36:10.333 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-27T19:36:10.333 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/ses.ko 2023-07-27T19:36:10.333 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/st.ko 2023-07-27T19:36:10.333 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/stex.ko 2023-07-27T19:36:10.333 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/sym53c8xx_2 2023-07-27T19:36:10.333 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-27T19:36:10.334 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/virtio_scsi.ko 2023-07-27T19:36:10.334 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-27T19:36:10.334 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/wd719x.ko 2023-07-27T19:36:10.334 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ssb 2023-07-27T19:36:10.335 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ssb/ssb.ko 2023-07-27T19:36:10.335 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/target 2023-07-27T19:36:10.335 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/target/iscsi 2023-07-27T19:36:10.335 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-27T19:36:10.335 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/target/loopback 2023-07-27T19:36:10.336 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-27T19:36:10.336 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/target/target_core_file.ko 2023-07-27T19:36:10.336 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/target/target_core_iblock.ko 2023-07-27T19:36:10.336 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/target/target_core_mod.ko 2023-07-27T19:36:10.336 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/target/target_core_pscsi.ko 2023-07-27T19:36:10.336 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/target/target_core_user.ko 2023-07-27T19:36:10.336 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/target/tcm_fc 2023-07-27T19:36:10.337 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-27T19:36:10.337 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/thermal 2023-07-27T19:36:10.337 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/thermal/intel 2023-07-27T19:36:10.337 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/thermal/intel/int340x_thermal 2023-07-27T19:36:10.337 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-27T19:36:10.337 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-27T19:36:10.337 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-27T19:36:10.337 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-27T19:36:10.338 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-27T19:36:10.338 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-27T19:36:10.338 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-27T19:36:10.338 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-27T19:36:10.338 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-27T19:36:10.338 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-27T19:36:10.338 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-27T19:36:10.339 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-27T19:36:10.339 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-27T19:36:10.339 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-27T19:36:10.339 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-27T19:36:10.339 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/tty 2023-07-27T19:36:10.339 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/tty/ipwireless 2023-07-27T19:36:10.339 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-27T19:36:10.339 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/tty/n_gsm.ko 2023-07-27T19:36:10.340 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/tty/n_hdlc.ko 2023-07-27T19:36:10.340 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/tty/nozomi.ko 2023-07-27T19:36:10.340 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/tty/serial 2023-07-27T19:36:10.340 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/tty/serial/8250 2023-07-27T19:36:10.340 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-27T19:36:10.340 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/tty/serial/arc_uart.ko 2023-07-27T19:36:10.340 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/tty/serial/jsm 2023-07-27T19:36:10.341 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-27T19:36:10.341 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/tty/synclink_gt.ko 2023-07-27T19:36:10.341 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ufs 2023-07-27T19:36:10.341 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ufs/core 2023-07-27T19:36:10.341 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-27T19:36:10.341 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ufs/host 2023-07-27T19:36:10.341 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-27T19:36:10.342 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/uio 2023-07-27T19:36:10.342 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/uio/uio.ko 2023-07-27T19:36:10.342 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/uio/uio_aec.ko 2023-07-27T19:36:10.342 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/uio/uio_cif.ko 2023-07-27T19:36:10.342 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/uio/uio_pci_generic.ko 2023-07-27T19:36:10.342 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/uio/uio_sercos3.ko 2023-07-27T19:36:10.342 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb 2023-07-27T19:36:10.343 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/class 2023-07-27T19:36:10.343 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/class/cdc-acm.ko 2023-07-27T19:36:10.343 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-27T19:36:10.343 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/class/usblp.ko 2023-07-27T19:36:10.343 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/class/usbtmc.ko 2023-07-27T19:36:10.343 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/host 2023-07-27T19:36:10.343 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-27T19:36:10.343 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/image 2023-07-27T19:36:10.344 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/image/mdc800.ko 2023-07-27T19:36:10.344 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/image/microtek.ko 2023-07-27T19:36:10.344 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/misc 2023-07-27T19:36:10.344 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/misc/adutux.ko 2023-07-27T19:36:10.344 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/misc/appledisplay.ko 2023-07-27T19:36:10.345 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/misc/emi26.ko 2023-07-27T19:36:10.345 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/misc/emi62.ko 2023-07-27T19:36:10.345 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/misc/ezusb.ko 2023-07-27T19:36:10.345 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/misc/idmouse.ko 2023-07-27T19:36:10.345 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/misc/iowarrior.ko 2023-07-27T19:36:10.345 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-27T19:36:10.346 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/misc/ldusb.ko 2023-07-27T19:36:10.346 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/misc/legousbtower.ko 2023-07-27T19:36:10.346 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/misc/sisusbvga 2023-07-27T19:36:10.346 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-27T19:36:10.346 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-27T19:36:10.346 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/misc/usb3503.ko 2023-07-27T19:36:10.347 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/misc/usblcd.ko 2023-07-27T19:36:10.347 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-27T19:36:10.347 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/misc/uss720.ko 2023-07-27T19:36:10.347 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/misc/yurex.ko 2023-07-27T19:36:10.347 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/phy 2023-07-27T19:36:10.347 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/phy/phy-generic.ko 2023-07-27T19:36:10.347 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial 2023-07-27T19:36:10.348 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/aircable.ko 2023-07-27T19:36:10.348 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/ark3116.ko 2023-07-27T19:36:10.348 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-27T19:36:10.348 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/ch341.ko 2023-07-27T19:36:10.348 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/cp210x.ko 2023-07-27T19:36:10.348 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/cyberjack.ko 2023-07-27T19:36:10.349 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-27T19:36:10.349 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-27T19:36:10.349 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/empeg.ko 2023-07-27T19:36:10.349 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-27T19:36:10.349 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-27T19:36:10.349 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-27T19:36:10.349 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/io_ti.ko 2023-07-27T19:36:10.350 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/ipaq.ko 2023-07-27T19:36:10.350 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/ipw.ko 2023-07-27T19:36:10.350 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/ir-usb.ko 2023-07-27T19:36:10.350 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-27T19:36:10.350 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/keyspan.ko 2023-07-27T19:36:10.350 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-27T19:36:10.350 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-27T19:36:10.350 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-27T19:36:10.351 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/mct_u232.ko 2023-07-27T19:36:10.351 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/mos7720.ko 2023-07-27T19:36:10.351 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/mos7840.ko 2023-07-27T19:36:10.351 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/navman.ko 2023-07-27T19:36:10.351 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/omninet.ko 2023-07-27T19:36:10.352 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/opticon.ko 2023-07-27T19:36:10.352 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/option.ko 2023-07-27T19:36:10.352 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/oti6858.ko 2023-07-27T19:36:10.352 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/pl2303.ko 2023-07-27T19:36:10.352 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/qcaux.ko 2023-07-27T19:36:10.352 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/qcserial.ko 2023-07-27T19:36:10.353 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/quatech2.ko 2023-07-27T19:36:10.353 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/safe_serial.ko 2023-07-27T19:36:10.353 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/sierra.ko 2023-07-27T19:36:10.353 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-27T19:36:10.353 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/ssu100.ko 2023-07-27T19:36:10.353 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/symbolserial.ko 2023-07-27T19:36:10.353 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-27T19:36:10.354 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-27T19:36:10.354 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/usb_debug.ko 2023-07-27T19:36:10.354 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-27T19:36:10.354 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/visor.ko 2023-07-27T19:36:10.354 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/whiteheat.ko 2023-07-27T19:36:10.354 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-27T19:36:10.355 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/storage 2023-07-27T19:36:10.355 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/storage/uas.ko 2023-07-27T19:36:10.355 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-27T19:36:10.355 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-27T19:36:10.355 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-27T19:36:10.356 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-27T19:36:10.356 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-27T19:36:10.356 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-27T19:36:10.356 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-27T19:36:10.356 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/storage/ums-karma.ko 2023-07-27T19:36:10.357 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-27T19:36:10.357 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-27T19:36:10.357 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-27T19:36:10.357 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-27T19:36:10.358 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-27T19:36:10.358 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/storage/usb-storage.ko 2023-07-27T19:36:10.358 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/usbip 2023-07-27T19:36:10.358 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-27T19:36:10.358 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-27T19:36:10.358 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-27T19:36:10.359 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/vfio 2023-07-27T19:36:10.359 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/vfio/pci 2023-07-27T19:36:10.359 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-27T19:36:10.359 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-27T19:36:10.360 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/vfio/vfio.ko 2023-07-27T19:36:10.360 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-27T19:36:10.360 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/vhost 2023-07-27T19:36:10.360 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/vhost/vhost.ko 2023-07-27T19:36:10.361 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-27T19:36:10.361 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/vhost/vhost_net.ko 2023-07-27T19:36:10.361 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/vhost/vhost_scsi.ko 2023-07-27T19:36:10.361 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/video 2023-07-27T19:36:10.362 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/video/backlight 2023-07-27T19:36:10.362 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/video/backlight/apple_bl.ko 2023-07-27T19:36:10.362 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/video/backlight/lcd.ko 2023-07-27T19:36:10.363 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-27T19:36:10.363 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/virtio 2023-07-27T19:36:10.363 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/virtio/virtio.ko 2023-07-27T19:36:10.363 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/virtio/virtio_balloon.ko 2023-07-27T19:36:10.364 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/virtio/virtio_mmio.ko 2023-07-27T19:36:10.364 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/virtio/virtio_pci.ko 2023-07-27T19:36:10.364 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-07-27T19:36:10.364 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-07-27T19:36:10.365 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/virtio/virtio_ring.ko 2023-07-27T19:36:10.365 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/w1 2023-07-27T19:36:10.365 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/w1/masters 2023-07-27T19:36:10.365 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/w1/masters/ds2482.ko 2023-07-27T19:36:10.366 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/w1/masters/ds2490.ko 2023-07-27T19:36:10.366 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/w1/slaves 2023-07-27T19:36:10.366 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-27T19:36:10.366 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-27T19:36:10.366 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-27T19:36:10.366 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-27T19:36:10.367 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-27T19:36:10.367 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-27T19:36:10.367 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-27T19:36:10.367 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-27T19:36:10.367 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-27T19:36:10.367 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-27T19:36:10.367 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-27T19:36:10.367 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/w1/wire.ko 2023-07-27T19:36:10.368 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog 2023-07-27T19:36:10.368 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-27T19:36:10.368 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-27T19:36:10.368 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-27T19:36:10.368 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/hpwdt.ko 2023-07-27T19:36:10.369 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/i6300esb.ko 2023-07-27T19:36:10.369 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-27T19:36:10.369 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-27T19:36:10.369 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/ib700wdt.ko 2023-07-27T19:36:10.369 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/ibmasr.ko 2023-07-27T19:36:10.369 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-27T19:36:10.369 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-27T19:36:10.370 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/it87_wdt.ko 2023-07-27T19:36:10.370 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/machzwd.ko 2023-07-27T19:36:10.370 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/nv_tco.ko 2023-07-27T19:36:10.370 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-27T19:36:10.370 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-27T19:36:10.370 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-27T19:36:10.371 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-27T19:36:10.371 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/softdog.ko 2023-07-27T19:36:10.371 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-27T19:36:10.371 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/via_wdt.ko 2023-07-27T19:36:10.371 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-27T19:36:10.372 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-27T19:36:10.372 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-27T19:36:10.372 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/wdt_pci.ko 2023-07-27T19:36:10.372 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/xen_wdt.ko 2023-07-27T19:36:10.372 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/xen 2023-07-27T19:36:10.372 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/xen/xen-acpi-processor.ko 2023-07-27T19:36:10.373 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/xen/xen-evtchn.ko 2023-07-27T19:36:10.373 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/xen/xen-gntalloc.ko 2023-07-27T19:36:10.373 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/xen/xen-gntdev.ko 2023-07-27T19:36:10.373 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/xen/xen-pciback 2023-07-27T19:36:10.373 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-27T19:36:10.373 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/xen/xen-privcmd.ko 2023-07-27T19:36:10.373 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/xen/xenfs 2023-07-27T19:36:10.373 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-27T19:36:10.374 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs 2023-07-27T19:36:10.374 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/9p 2023-07-27T19:36:10.374 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/9p/9p.ko 2023-07-27T19:36:10.374 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/affs 2023-07-27T19:36:10.374 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/affs/affs.ko 2023-07-27T19:36:10.374 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/befs 2023-07-27T19:36:10.374 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/befs/befs.ko 2023-07-27T19:36:10.374 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/binfmt_misc.ko 2023-07-27T19:36:10.375 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/btrfs 2023-07-27T19:36:10.375 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/btrfs/btrfs.ko 2023-07-27T19:36:10.375 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/cachefiles 2023-07-27T19:36:10.375 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/cachefiles/cachefiles.ko 2023-07-27T19:36:10.375 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/ceph 2023-07-27T19:36:10.375 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/ceph/ceph.ko 2023-07-27T19:36:10.375 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/coda 2023-07-27T19:36:10.376 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/coda/coda.ko 2023-07-27T19:36:10.376 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/cramfs 2023-07-27T19:36:10.376 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/cramfs/cramfs.ko 2023-07-27T19:36:10.376 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/dlm 2023-07-27T19:36:10.376 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/dlm/dlm.ko 2023-07-27T19:36:10.376 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/ecryptfs 2023-07-27T19:36:10.377 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/ecryptfs/ecryptfs.ko 2023-07-27T19:36:10.377 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/f2fs 2023-07-27T19:36:10.377 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/f2fs/f2fs.ko 2023-07-27T19:36:10.377 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/fat 2023-07-27T19:36:10.377 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/fat/fat.ko 2023-07-27T19:36:10.377 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/fat/msdos.ko 2023-07-27T19:36:10.377 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/fat/vfat.ko 2023-07-27T19:36:10.378 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/fscache 2023-07-27T19:36:10.378 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/fscache/fscache.ko 2023-07-27T19:36:10.378 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/fuse 2023-07-27T19:36:10.378 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/fuse/cuse.ko 2023-07-27T19:36:10.378 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/fuse/fuse.ko 2023-07-27T19:36:10.378 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/gfs2 2023-07-27T19:36:10.379 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/gfs2/gfs2.ko 2023-07-27T19:36:10.379 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/hfs 2023-07-27T19:36:10.379 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/hfs/hfs.ko 2023-07-27T19:36:10.379 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/hfsplus 2023-07-27T19:36:10.379 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/hfsplus/hfsplus.ko 2023-07-27T19:36:10.379 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/isofs 2023-07-27T19:36:10.379 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/isofs/isofs.ko 2023-07-27T19:36:10.380 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/jfs 2023-07-27T19:36:10.380 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/jfs/jfs.ko 2023-07-27T19:36:10.380 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/lockd 2023-07-27T19:36:10.380 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/lockd/lockd.ko 2023-07-27T19:36:10.380 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/minix 2023-07-27T19:36:10.380 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/minix/minix.ko 2023-07-27T19:36:10.380 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/netfs 2023-07-27T19:36:10.381 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/netfs/netfs.ko 2023-07-27T19:36:10.381 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nfs 2023-07-27T19:36:10.381 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nfs/blocklayout 2023-07-27T19:36:10.381 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-27T19:36:10.381 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nfs/filelayout 2023-07-27T19:36:10.381 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-27T19:36:10.382 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nfs/flexfilelayout 2023-07-27T19:36:10.382 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-27T19:36:10.382 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nfs/nfs.ko 2023-07-27T19:36:10.382 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nfs/nfsv3.ko 2023-07-27T19:36:10.382 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nfs/nfsv4.ko 2023-07-27T19:36:10.382 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nfs_common 2023-07-27T19:36:10.382 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nfs_common/grace.ko 2023-07-27T19:36:10.383 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nfs_common/nfs_acl.ko 2023-07-27T19:36:10.383 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nfsd 2023-07-27T19:36:10.383 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nfsd/nfsd.ko 2023-07-27T19:36:10.383 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nilfs2 2023-07-27T19:36:10.383 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nilfs2/nilfs2.ko 2023-07-27T19:36:10.383 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls 2023-07-27T19:36:10.383 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/mac-celtic.ko 2023-07-27T19:36:10.383 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/mac-centeuro.ko 2023-07-27T19:36:10.384 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/mac-croatian.ko 2023-07-27T19:36:10.384 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/mac-cyrillic.ko 2023-07-27T19:36:10.384 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/mac-gaelic.ko 2023-07-27T19:36:10.384 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/mac-greek.ko 2023-07-27T19:36:10.384 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/mac-iceland.ko 2023-07-27T19:36:10.384 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/mac-inuit.ko 2023-07-27T19:36:10.384 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/mac-roman.ko 2023-07-27T19:36:10.385 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/mac-romanian.ko 2023-07-27T19:36:10.385 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/mac-turkish.ko 2023-07-27T19:36:10.385 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp1250.ko 2023-07-27T19:36:10.385 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp1251.ko 2023-07-27T19:36:10.385 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp1255.ko 2023-07-27T19:36:10.385 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp737.ko 2023-07-27T19:36:10.385 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp775.ko 2023-07-27T19:36:10.385 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp850.ko 2023-07-27T19:36:10.386 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp852.ko 2023-07-27T19:36:10.386 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp855.ko 2023-07-27T19:36:10.386 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp857.ko 2023-07-27T19:36:10.386 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp860.ko 2023-07-27T19:36:10.386 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp861.ko 2023-07-27T19:36:10.386 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp862.ko 2023-07-27T19:36:10.386 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp863.ko 2023-07-27T19:36:10.387 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp864.ko 2023-07-27T19:36:10.387 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp865.ko 2023-07-27T19:36:10.387 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp866.ko 2023-07-27T19:36:10.387 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp869.ko 2023-07-27T19:36:10.387 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp874.ko 2023-07-27T19:36:10.387 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp932.ko 2023-07-27T19:36:10.387 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp936.ko 2023-07-27T19:36:10.388 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp949.ko 2023-07-27T19:36:10.388 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp950.ko 2023-07-27T19:36:10.388 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_euc-jp.ko 2023-07-27T19:36:10.388 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_iso8859-1.ko 2023-07-27T19:36:10.389 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_iso8859-13.ko 2023-07-27T19:36:10.389 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_iso8859-14.ko 2023-07-27T19:36:10.389 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_iso8859-15.ko 2023-07-27T19:36:10.390 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_iso8859-2.ko 2023-07-27T19:36:10.390 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_iso8859-3.ko 2023-07-27T19:36:10.390 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_iso8859-4.ko 2023-07-27T19:36:10.390 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_iso8859-5.ko 2023-07-27T19:36:10.391 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_iso8859-6.ko 2023-07-27T19:36:10.391 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_iso8859-7.ko 2023-07-27T19:36:10.391 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_iso8859-9.ko 2023-07-27T19:36:10.391 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_koi8-r.ko 2023-07-27T19:36:10.392 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_koi8-ru.ko 2023-07-27T19:36:10.392 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_koi8-u.ko 2023-07-27T19:36:10.392 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_utf8.ko 2023-07-27T19:36:10.392 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/ocfs2 2023-07-27T19:36:10.393 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/ocfs2/cluster 2023-07-27T19:36:10.393 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-27T19:36:10.393 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/ocfs2/dlm 2023-07-27T19:36:10.394 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-27T19:36:10.394 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/ocfs2/dlmfs 2023-07-27T19:36:10.394 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-27T19:36:10.394 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/ocfs2/ocfs2.ko 2023-07-27T19:36:10.394 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-27T19:36:10.394 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-27T19:36:10.394 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-27T19:36:10.395 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/overlayfs 2023-07-27T19:36:10.395 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/overlayfs/overlay.ko 2023-07-27T19:36:10.395 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/pstore 2023-07-27T19:36:10.395 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/pstore/ramoops.ko 2023-07-27T19:36:10.395 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/reiserfs 2023-07-27T19:36:10.395 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/reiserfs/reiserfs.ko 2023-07-27T19:36:10.395 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/romfs 2023-07-27T19:36:10.395 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/romfs/romfs.ko 2023-07-27T19:36:10.396 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/smb 2023-07-27T19:36:10.396 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/smb/client 2023-07-27T19:36:10.396 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/smb/client/cifs.ko 2023-07-27T19:36:10.396 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/smb/common 2023-07-27T19:36:10.396 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/smb/common/cifs_arc4.ko 2023-07-27T19:36:10.396 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/smb/common/cifs_md4.ko 2023-07-27T19:36:10.396 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/squashfs 2023-07-27T19:36:10.397 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/squashfs/squashfs.ko 2023-07-27T19:36:10.397 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/sysv 2023-07-27T19:36:10.397 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/sysv/sysv.ko 2023-07-27T19:36:10.397 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/udf 2023-07-27T19:36:10.397 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/udf/udf.ko 2023-07-27T19:36:10.397 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/ufs 2023-07-27T19:36:10.397 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/ufs/ufs.ko 2023-07-27T19:36:10.397 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/xfs 2023-07-27T19:36:10.398 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/xfs/xfs.ko 2023-07-27T19:36:10.398 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/kernel 2023-07-27T19:36:10.398 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/kernel/rcu 2023-07-27T19:36:10.398 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/kernel/rcu/rcutorture.ko 2023-07-27T19:36:10.398 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/kernel/torture.ko 2023-07-27T19:36:10.398 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/kernel/trace 2023-07-27T19:36:10.398 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-07-27T19:36:10.399 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib 2023-07-27T19:36:10.399 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/asn1_encoder.ko 2023-07-27T19:36:10.399 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/crc-itu-t.ko 2023-07-27T19:36:10.399 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/crc8.ko 2023-07-27T19:36:10.399 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/crypto 2023-07-27T19:36:10.399 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/crypto/libarc4.ko 2023-07-27T19:36:10.399 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/crypto/libdes.ko 2023-07-27T19:36:10.399 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/libcrc32c.ko 2023-07-27T19:36:10.400 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/lru_cache.ko 2023-07-27T19:36:10.400 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/lz4 2023-07-27T19:36:10.400 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/lz4/lz4_compress.ko 2023-07-27T19:36:10.400 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/lz4/lz4hc_compress.ko 2023-07-27T19:36:10.400 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/math 2023-07-27T19:36:10.400 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/math/cordic.ko 2023-07-27T19:36:10.400 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/raid6 2023-07-27T19:36:10.401 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/raid6/raid6_pq.ko 2023-07-27T19:36:10.401 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/reed_solomon 2023-07-27T19:36:10.401 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-27T19:36:10.401 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/ts_bm.ko 2023-07-27T19:36:10.401 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/ts_fsm.ko 2023-07-27T19:36:10.401 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/ts_kmp.ko 2023-07-27T19:36:10.401 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/zstd 2023-07-27T19:36:10.401 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/zstd/zstd_compress.ko 2023-07-27T19:36:10.402 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/mm 2023-07-27T19:36:10.402 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/mm/hwpoison-inject.ko 2023-07-27T19:36:10.402 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net 2023-07-27T19:36:10.402 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/6lowpan 2023-07-27T19:36:10.402 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/6lowpan/6lowpan.ko 2023-07-27T19:36:10.402 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/6lowpan/nhc_dest.ko 2023-07-27T19:36:10.402 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/6lowpan/nhc_fragment.ko 2023-07-27T19:36:10.402 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/6lowpan/nhc_hop.ko 2023-07-27T19:36:10.403 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-27T19:36:10.403 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/6lowpan/nhc_mobility.ko 2023-07-27T19:36:10.403 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/6lowpan/nhc_routing.ko 2023-07-27T19:36:10.403 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/6lowpan/nhc_udp.ko 2023-07-27T19:36:10.403 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/802 2023-07-27T19:36:10.403 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/802/garp.ko 2023-07-27T19:36:10.403 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/802/mrp.ko 2023-07-27T19:36:10.403 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/802/p8022.ko 2023-07-27T19:36:10.404 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/802/psnap.ko 2023-07-27T19:36:10.404 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/802/stp.ko 2023-07-27T19:36:10.404 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/8021q 2023-07-27T19:36:10.404 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/8021q/8021q.ko 2023-07-27T19:36:10.404 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/9p 2023-07-27T19:36:10.404 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/9p/9pnet.ko 2023-07-27T19:36:10.404 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/9p/9pnet_fd.ko 2023-07-27T19:36:10.405 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/9p/9pnet_rdma.ko 2023-07-27T19:36:10.405 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/9p/9pnet_virtio.ko 2023-07-27T19:36:10.405 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/batman-adv 2023-07-27T19:36:10.405 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/batman-adv/batman-adv.ko 2023-07-27T19:36:10.405 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge 2023-07-27T19:36:10.405 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/br_netfilter.ko 2023-07-27T19:36:10.405 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/bridge.ko 2023-07-27T19:36:10.405 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter 2023-07-27T19:36:10.406 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-27T19:36:10.406 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-27T19:36:10.406 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-27T19:36:10.406 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-27T19:36:10.406 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-27T19:36:10.406 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-27T19:36:10.406 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-27T19:36:10.407 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-27T19:36:10.407 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-27T19:36:10.407 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-27T19:36:10.407 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-27T19:36:10.407 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-27T19:36:10.407 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-27T19:36:10.407 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-27T19:36:10.407 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-27T19:36:10.408 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-27T19:36:10.408 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-27T19:36:10.408 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-27T19:36:10.408 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-27T19:36:10.408 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-27T19:36:10.408 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebtables.ko 2023-07-27T19:36:10.408 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-07-27T19:36:10.408 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-27T19:36:10.409 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-27T19:36:10.409 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ceph 2023-07-27T19:36:10.409 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ceph/libceph.ko 2023-07-27T19:36:10.409 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/core 2023-07-27T19:36:10.409 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/core/failover.ko 2023-07-27T19:36:10.409 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/core/pktgen.ko 2023-07-27T19:36:10.409 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/dccp 2023-07-27T19:36:10.410 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/dccp/dccp.ko 2023-07-27T19:36:10.410 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/dccp/dccp_diag.ko 2023-07-27T19:36:10.410 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/dccp/dccp_ipv4.ko 2023-07-27T19:36:10.410 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/dccp/dccp_ipv6.ko 2023-07-27T19:36:10.410 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/dns_resolver 2023-07-27T19:36:10.410 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/dns_resolver/dns_resolver.ko 2023-07-27T19:36:10.410 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/dsa 2023-07-27T19:36:10.410 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/dsa/dsa_core.ko 2023-07-27T19:36:10.411 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/dsa/tag_brcm.ko 2023-07-27T19:36:10.411 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/dsa/tag_dsa.ko 2023-07-27T19:36:10.411 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/dsa/tag_none.ko 2023-07-27T19:36:10.411 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/dsa/tag_trailer.ko 2023-07-27T19:36:10.412 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ieee802154 2023-07-27T19:36:10.412 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ieee802154/6lowpan 2023-07-27T19:36:10.412 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-27T19:36:10.412 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ieee802154/ieee802154.ko 2023-07-27T19:36:10.413 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-27T19:36:10.413 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4 2023-07-27T19:36:10.413 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/ah4.ko 2023-07-27T19:36:10.414 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/esp4.ko 2023-07-27T19:36:10.414 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/fou.ko 2023-07-27T19:36:10.414 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/gre.ko 2023-07-27T19:36:10.414 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/inet_diag.ko 2023-07-27T19:36:10.415 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/ip_gre.ko 2023-07-27T19:36:10.415 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/ip_tunnel.ko 2023-07-27T19:36:10.415 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/ip_vti.ko 2023-07-27T19:36:10.416 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/ipcomp.ko 2023-07-27T19:36:10.416 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/ipip.ko 2023-07-27T19:36:10.416 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter 2023-07-27T19:36:10.417 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-27T19:36:10.417 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-27T19:36:10.417 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-27T19:36:10.417 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-27T19:36:10.418 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-27T19:36:10.418 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-27T19:36:10.418 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-27T19:36:10.418 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-27T19:36:10.419 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-27T19:36:10.419 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-27T19:36:10.419 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-27T19:36:10.419 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-27T19:36:10.420 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-27T19:36:10.420 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-27T19:36:10.420 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-27T19:36:10.420 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-27T19:36:10.421 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-27T19:36:10.421 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-27T19:36:10.421 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-27T19:36:10.421 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-27T19:36:10.422 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-27T19:36:10.422 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/tcp_bic.ko 2023-07-27T19:36:10.422 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/tcp_dctcp.ko 2023-07-27T19:36:10.422 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/tcp_diag.ko 2023-07-27T19:36:10.422 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/tcp_highspeed.ko 2023-07-27T19:36:10.422 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/tcp_htcp.ko 2023-07-27T19:36:10.423 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/tcp_hybla.ko 2023-07-27T19:36:10.423 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/tcp_illinois.ko 2023-07-27T19:36:10.423 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/tcp_lp.ko 2023-07-27T19:36:10.423 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/tcp_scalable.ko 2023-07-27T19:36:10.423 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/tcp_vegas.ko 2023-07-27T19:36:10.423 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/tcp_veno.ko 2023-07-27T19:36:10.423 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/tcp_westwood.ko 2023-07-27T19:36:10.423 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/tcp_yeah.ko 2023-07-27T19:36:10.424 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/tunnel4.ko 2023-07-27T19:36:10.424 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/udp_diag.ko 2023-07-27T19:36:10.424 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/udp_tunnel.ko 2023-07-27T19:36:10.424 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-27T19:36:10.424 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6 2023-07-27T19:36:10.424 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/ah6.ko 2023-07-27T19:36:10.424 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/esp6.ko 2023-07-27T19:36:10.425 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/fou6.ko 2023-07-27T19:36:10.425 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/ip6_tunnel.ko 2023-07-27T19:36:10.425 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-27T19:36:10.425 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/ip6_vti.ko 2023-07-27T19:36:10.425 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/ipcomp6.ko 2023-07-27T19:36:10.425 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter 2023-07-27T19:36:10.425 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-27T19:36:10.425 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-27T19:36:10.426 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-27T19:36:10.426 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-27T19:36:10.426 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-27T19:36:10.426 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-27T19:36:10.426 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-27T19:36:10.426 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-27T19:36:10.426 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-27T19:36:10.427 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-27T19:36:10.427 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-27T19:36:10.427 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-27T19:36:10.427 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-27T19:36:10.427 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-27T19:36:10.427 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-27T19:36:10.427 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-27T19:36:10.427 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-27T19:36:10.428 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-27T19:36:10.428 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-27T19:36:10.428 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-27T19:36:10.428 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-27T19:36:10.428 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-27T19:36:10.428 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-27T19:36:10.428 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-27T19:36:10.429 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/sit.ko 2023-07-27T19:36:10.429 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/tunnel6.ko 2023-07-27T19:36:10.429 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-27T19:36:10.429 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/key 2023-07-27T19:36:10.429 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/key/af_key.ko 2023-07-27T19:36:10.429 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/l2tp 2023-07-27T19:36:10.429 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/l2tp/l2tp_core.ko 2023-07-27T19:36:10.429 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-27T19:36:10.430 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/l2tp/l2tp_eth.ko 2023-07-27T19:36:10.430 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/l2tp/l2tp_ip.ko 2023-07-27T19:36:10.430 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/l2tp/l2tp_ip6.ko 2023-07-27T19:36:10.430 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/l2tp/l2tp_netlink.ko 2023-07-27T19:36:10.430 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/l2tp/l2tp_ppp.ko 2023-07-27T19:36:10.430 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/llc 2023-07-27T19:36:10.430 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/llc/llc.ko 2023-07-27T19:36:10.430 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/mac802154 2023-07-27T19:36:10.431 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/mac802154/mac802154.ko 2023-07-27T19:36:10.431 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/mpls 2023-07-27T19:36:10.431 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/mpls/mpls_gso.ko 2023-07-27T19:36:10.431 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter 2023-07-27T19:36:10.431 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipset 2023-07-27T19:36:10.431 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipset/ip_set.ko 2023-07-27T19:36:10.431 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-27T19:36:10.431 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-27T19:36:10.432 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-27T19:36:10.432 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-27T19:36:10.432 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-27T19:36:10.432 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-27T19:36:10.432 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-27T19:36:10.432 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-27T19:36:10.432 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-27T19:36:10.433 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-27T19:36:10.433 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-27T19:36:10.433 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-27T19:36:10.433 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-27T19:36:10.433 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-27T19:36:10.433 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-27T19:36:10.433 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipvs 2023-07-27T19:36:10.433 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-27T19:36:10.434 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-27T19:36:10.434 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-27T19:36:10.434 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-27T19:36:10.434 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-27T19:36:10.434 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-27T19:36:10.434 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-27T19:36:10.434 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-27T19:36:10.435 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-27T19:36:10.435 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-27T19:36:10.435 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-27T19:36:10.435 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-27T19:36:10.435 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-27T19:36:10.435 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-27T19:36:10.435 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_conncount.ko 2023-07-27T19:36:10.435 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_conntrack.ko 2023-07-27T19:36:10.436 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-27T19:36:10.436 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-27T19:36:10.436 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-27T19:36:10.436 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-27T19:36:10.436 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-27T19:36:10.436 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-27T19:36:10.437 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-27T19:36:10.437 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-27T19:36:10.437 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-27T19:36:10.437 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-27T19:36:10.437 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-27T19:36:10.437 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-27T19:36:10.438 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-27T19:36:10.438 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_flow_table.ko 2023-07-27T19:36:10.438 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-27T19:36:10.438 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_log_syslog.ko 2023-07-27T19:36:10.438 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_nat.ko 2023-07-27T19:36:10.438 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-27T19:36:10.438 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-27T19:36:10.438 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_nat_irc.ko 2023-07-27T19:36:10.439 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_nat_sip.ko 2023-07-27T19:36:10.439 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-27T19:36:10.439 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-27T19:36:10.439 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_tables.ko 2023-07-27T19:36:10.439 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nfnetlink.ko 2023-07-27T19:36:10.439 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-27T19:36:10.440 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nfnetlink_log.ko 2023-07-27T19:36:10.440 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-27T19:36:10.440 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-27T19:36:10.440 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nft_chain_nat.ko 2023-07-27T19:36:10.440 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nft_compat.ko 2023-07-27T19:36:10.440 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nft_ct.ko 2023-07-27T19:36:10.440 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-27T19:36:10.441 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nft_fib.ko 2023-07-27T19:36:10.441 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-27T19:36:10.441 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nft_hash.ko 2023-07-27T19:36:10.441 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nft_limit.ko 2023-07-27T19:36:10.441 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nft_log.ko 2023-07-27T19:36:10.441 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nft_masq.ko 2023-07-27T19:36:10.441 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nft_nat.ko 2023-07-27T19:36:10.441 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nft_numgen.ko 2023-07-27T19:36:10.442 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nft_queue.ko 2023-07-27T19:36:10.442 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nft_quota.ko 2023-07-27T19:36:10.442 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nft_redir.ko 2023-07-27T19:36:10.442 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nft_reject.ko 2023-07-27T19:36:10.442 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nft_reject_inet.ko 2023-07-27T19:36:10.442 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nft_socket.ko 2023-07-27T19:36:10.442 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nft_tunnel.ko 2023-07-27T19:36:10.442 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_AUDIT.ko 2023-07-27T19:36:10.443 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-27T19:36:10.443 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-27T19:36:10.443 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-27T19:36:10.443 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_CT.ko 2023-07-27T19:36:10.443 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_DSCP.ko 2023-07-27T19:36:10.443 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_HL.ko 2023-07-27T19:36:10.443 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_HMARK.ko 2023-07-27T19:36:10.444 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-27T19:36:10.444 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_LED.ko 2023-07-27T19:36:10.444 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_LOG.ko 2023-07-27T19:36:10.444 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-27T19:36:10.444 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_NETMAP.ko 2023-07-27T19:36:10.444 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_NFLOG.ko 2023-07-27T19:36:10.445 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-27T19:36:10.445 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_RATEEST.ko 2023-07-27T19:36:10.445 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-27T19:36:10.445 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_SECMARK.ko 2023-07-27T19:36:10.445 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-27T19:36:10.445 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-27T19:36:10.445 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_TEE.ko 2023-07-27T19:36:10.445 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_TPROXY.ko 2023-07-27T19:36:10.446 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_TRACE.ko 2023-07-27T19:36:10.446 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_addrtype.ko 2023-07-27T19:36:10.446 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_bpf.ko 2023-07-27T19:36:10.446 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_cgroup.ko 2023-07-27T19:36:10.446 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_cluster.ko 2023-07-27T19:36:10.446 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_comment.ko 2023-07-27T19:36:10.446 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_connbytes.ko 2023-07-27T19:36:10.446 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_connlabel.ko 2023-07-27T19:36:10.447 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_connlimit.ko 2023-07-27T19:36:10.447 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_connmark.ko 2023-07-27T19:36:10.447 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_conntrack.ko 2023-07-27T19:36:10.447 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_cpu.ko 2023-07-27T19:36:10.447 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_dccp.ko 2023-07-27T19:36:10.447 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_devgroup.ko 2023-07-27T19:36:10.447 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_dscp.ko 2023-07-27T19:36:10.447 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_ecn.ko 2023-07-27T19:36:10.448 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_esp.ko 2023-07-27T19:36:10.448 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_hashlimit.ko 2023-07-27T19:36:10.448 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_helper.ko 2023-07-27T19:36:10.448 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_hl.ko 2023-07-27T19:36:10.448 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_ipcomp.ko 2023-07-27T19:36:10.448 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_iprange.ko 2023-07-27T19:36:10.448 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_ipvs.ko 2023-07-27T19:36:10.449 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_l2tp.ko 2023-07-27T19:36:10.449 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_length.ko 2023-07-27T19:36:10.449 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_limit.ko 2023-07-27T19:36:10.449 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_mac.ko 2023-07-27T19:36:10.449 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_mark.ko 2023-07-27T19:36:10.449 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_multiport.ko 2023-07-27T19:36:10.449 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_nat.ko 2023-07-27T19:36:10.449 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_nfacct.ko 2023-07-27T19:36:10.450 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_osf.ko 2023-07-27T19:36:10.450 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_owner.ko 2023-07-27T19:36:10.450 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_physdev.ko 2023-07-27T19:36:10.450 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_pkttype.ko 2023-07-27T19:36:10.450 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_policy.ko 2023-07-27T19:36:10.450 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_quota.ko 2023-07-27T19:36:10.450 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_rateest.ko 2023-07-27T19:36:10.451 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_realm.ko 2023-07-27T19:36:10.451 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_recent.ko 2023-07-27T19:36:10.451 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_sctp.ko 2023-07-27T19:36:10.451 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_set.ko 2023-07-27T19:36:10.451 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_socket.ko 2023-07-27T19:36:10.451 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_state.ko 2023-07-27T19:36:10.451 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_statistic.ko 2023-07-27T19:36:10.451 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_string.ko 2023-07-27T19:36:10.452 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_tcpmss.ko 2023-07-27T19:36:10.452 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_time.ko 2023-07-27T19:36:10.452 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_u32.ko 2023-07-27T19:36:10.452 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netlink 2023-07-27T19:36:10.452 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netlink/netlink_diag.ko 2023-07-27T19:36:10.452 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/nsh 2023-07-27T19:36:10.452 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/nsh/nsh.ko 2023-07-27T19:36:10.453 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/openvswitch 2023-07-27T19:36:10.453 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/openvswitch/openvswitch.ko 2023-07-27T19:36:10.453 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/openvswitch/vport-geneve.ko 2023-07-27T19:36:10.453 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/openvswitch/vport-gre.ko 2023-07-27T19:36:10.453 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/openvswitch/vport-vxlan.ko 2023-07-27T19:36:10.453 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/packet 2023-07-27T19:36:10.453 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/packet/af_packet_diag.ko 2023-07-27T19:36:10.453 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/rds 2023-07-27T19:36:10.454 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/rds/rds.ko 2023-07-27T19:36:10.454 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/rds/rds_rdma.ko 2023-07-27T19:36:10.454 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/rds/rds_tcp.ko 2023-07-27T19:36:10.454 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched 2023-07-27T19:36:10.454 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/act_csum.ko 2023-07-27T19:36:10.454 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/act_gact.ko 2023-07-27T19:36:10.454 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/act_ipt.ko 2023-07-27T19:36:10.454 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/act_mirred.ko 2023-07-27T19:36:10.455 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/act_nat.ko 2023-07-27T19:36:10.455 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/act_pedit.ko 2023-07-27T19:36:10.455 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/act_police.ko 2023-07-27T19:36:10.455 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/act_simple.ko 2023-07-27T19:36:10.455 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/act_skbedit.ko 2023-07-27T19:36:10.455 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/act_vlan.ko 2023-07-27T19:36:10.455 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/cls_basic.ko 2023-07-27T19:36:10.456 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/cls_bpf.ko 2023-07-27T19:36:10.456 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/cls_flow.ko 2023-07-27T19:36:10.456 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/cls_fw.ko 2023-07-27T19:36:10.456 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/cls_route.ko 2023-07-27T19:36:10.456 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/cls_u32.ko 2023-07-27T19:36:10.456 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/em_cmp.ko 2023-07-27T19:36:10.456 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/em_ipset.ko 2023-07-27T19:36:10.457 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/em_meta.ko 2023-07-27T19:36:10.457 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/em_nbyte.ko 2023-07-27T19:36:10.457 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/em_text.ko 2023-07-27T19:36:10.457 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/em_u32.ko 2023-07-27T19:36:10.457 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_choke.ko 2023-07-27T19:36:10.457 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_codel.ko 2023-07-27T19:36:10.457 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_drr.ko 2023-07-27T19:36:10.458 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_fq.ko 2023-07-27T19:36:10.458 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_gred.ko 2023-07-27T19:36:10.458 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_hfsc.ko 2023-07-27T19:36:10.458 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_hhf.ko 2023-07-27T19:36:10.458 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_htb.ko 2023-07-27T19:36:10.458 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_ingress.ko 2023-07-27T19:36:10.458 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_mqprio.ko 2023-07-27T19:36:10.458 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_mqprio_lib.ko 2023-07-27T19:36:10.459 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_multiq.ko 2023-07-27T19:36:10.459 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_netem.ko 2023-07-27T19:36:10.459 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_pie.ko 2023-07-27T19:36:10.459 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_plug.ko 2023-07-27T19:36:10.459 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_prio.ko 2023-07-27T19:36:10.459 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_qfq.ko 2023-07-27T19:36:10.459 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_red.ko 2023-07-27T19:36:10.459 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_sfb.ko 2023-07-27T19:36:10.460 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_sfq.ko 2023-07-27T19:36:10.460 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_tbf.ko 2023-07-27T19:36:10.460 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_teql.ko 2023-07-27T19:36:10.460 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sctp 2023-07-27T19:36:10.460 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sctp/sctp.ko 2023-07-27T19:36:10.460 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sctp/sctp_diag.ko 2023-07-27T19:36:10.460 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sunrpc 2023-07-27T19:36:10.461 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sunrpc/auth_gss 2023-07-27T19:36:10.461 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-27T19:36:10.461 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-27T19:36:10.461 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sunrpc/sunrpc.ko 2023-07-27T19:36:10.461 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sunrpc/xprtrdma 2023-07-27T19:36:10.461 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-27T19:36:10.461 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/tipc 2023-07-27T19:36:10.461 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/tipc/diag.ko 2023-07-27T19:36:10.462 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/tipc/tipc.ko 2023-07-27T19:36:10.462 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/unix 2023-07-27T19:36:10.462 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/unix/unix_diag.ko 2023-07-27T19:36:10.462 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/vmw_vsock 2023-07-27T19:36:10.462 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-27T19:36:10.462 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-27T19:36:10.462 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/vmw_vsock/vsock.ko 2023-07-27T19:36:10.462 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-27T19:36:10.463 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-27T19:36:10.463 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/xfrm 2023-07-27T19:36:10.463 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-27T19:36:10.463 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/security 2023-07-27T19:36:10.463 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/security/keys 2023-07-27T19:36:10.463 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/security/keys/encrypted-keys 2023-07-27T19:36:10.463 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-07-27T19:36:10.463 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/security/keys/trusted-keys 2023-07-27T19:36:10.464 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/security/keys/trusted-keys/trusted.ko 2023-07-27T19:36:10.464 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/virt 2023-07-27T19:36:10.464 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/virt/lib 2023-07-27T19:36:10.464 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/virt/lib/irqbypass.ko 2023-07-27T19:36:10.464 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/modules.alias 2023-07-27T19:36:10.464 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/modules.alias.bin 2023-07-27T19:36:10.464 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/modules.builtin 2023-07-27T19:36:10.465 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/modules.builtin.bin 2023-07-27T19:36:10.465 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/modules.builtin.modinfo 2023-07-27T19:36:10.465 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/modules.dep 2023-07-27T19:36:10.465 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/modules.dep.bin 2023-07-27T19:36:10.465 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/modules.devname 2023-07-27T19:36:10.465 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/modules.order 2023-07-27T19:36:10.465 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/modules.softdep 2023-07-27T19:36:10.465 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/modules.symbols 2023-07-27T19:36:10.466 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/modules.symbols.bin 2023-07-27T19:36:10.466 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc1-gbbae19e0824b 2023-07-27T19:36:10.467 DEBUG:teuthology.orchestra.run.smithi072:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-07-27T19:36:10.493 INFO:teuthology.orchestra.run.smithi072.stdout:postinstall scriptlet (using /bin/sh): 2023-07-27T19:36:10.494 INFO:teuthology.orchestra.run.smithi072.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc1-gbbae19e0824b -a -r /boot/System.map-6.5.0-rc1-gbbae19e0824b ]; then 2023-07-27T19:36:10.494 INFO:teuthology.orchestra.run.smithi072.stdout:cp /boot/vmlinuz-6.5.0-rc1-gbbae19e0824b /boot/.vmlinuz-6.5.0-rc1-gbbae19e0824b-rpm 2023-07-27T19:36:10.494 INFO:teuthology.orchestra.run.smithi072.stdout:cp /boot/System.map-6.5.0-rc1-gbbae19e0824b /boot/.System.map-6.5.0-rc1-gbbae19e0824b-rpm 2023-07-27T19:36:10.494 INFO:teuthology.orchestra.run.smithi072.stdout:rm -f /boot/vmlinuz-6.5.0-rc1-gbbae19e0824b /boot/System.map-6.5.0-rc1-gbbae19e0824b 2023-07-27T19:36:10.494 INFO:teuthology.orchestra.run.smithi072.stdout:/sbin/installkernel 6.5.0-rc1-gbbae19e0824b /boot/.vmlinuz-6.5.0-rc1-gbbae19e0824b-rpm /boot/.System.map-6.5.0-rc1-gbbae19e0824b-rpm 2023-07-27T19:36:10.494 INFO:teuthology.orchestra.run.smithi072.stdout:rm -f /boot/.vmlinuz-6.5.0-rc1-gbbae19e0824b-rpm /boot/.System.map-6.5.0-rc1-gbbae19e0824b-rpm 2023-07-27T19:36:10.495 INFO:teuthology.orchestra.run.smithi072.stdout:fi 2023-07-27T19:36:10.495 INFO:teuthology.orchestra.run.smithi072.stdout:preuninstall scriptlet (using /bin/sh): 2023-07-27T19:36:10.495 INFO:teuthology.orchestra.run.smithi072.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-07-27T19:36:10.495 INFO:teuthology.orchestra.run.smithi072.stdout:new-kernel-pkg --remove 6.5.0-rc1-gbbae19e0824b --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc1-gbbae19e0824b.img 2023-07-27T19:36:10.495 INFO:teuthology.orchestra.run.smithi072.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-07-27T19:36:10.495 INFO:teuthology.orchestra.run.smithi072.stdout:kernel-install remove 6.5.0-rc1-gbbae19e0824b 2023-07-27T19:36:10.495 INFO:teuthology.orchestra.run.smithi072.stdout:fi 2023-07-27T19:36:10.495 INFO:teuthology.orchestra.run.smithi072.stdout:postuninstall scriptlet (using /bin/sh): 2023-07-27T19:36:10.496 INFO:teuthology.orchestra.run.smithi072.stdout:if [ -x /sbin/update-bootloader ]; then 2023-07-27T19:36:10.496 INFO:teuthology.orchestra.run.smithi072.stdout:/sbin/update-bootloader --remove 6.5.0-rc1-gbbae19e0824b 2023-07-27T19:36:10.496 INFO:teuthology.orchestra.run.smithi072.stdout:fi 2023-07-27T19:36:10.497 DEBUG:teuthology.orchestra.run.smithi072:> sudo rpm -qi grub2-tools 2023-07-27T19:36:10.574 INFO:teuthology.orchestra.run.smithi072.stdout:Name : grub2-tools 2023-07-27T19:36:10.574 INFO:teuthology.orchestra.run.smithi072.stdout:Epoch : 1 2023-07-27T19:36:10.575 INFO:teuthology.orchestra.run.smithi072.stdout:Version : 2.02 2023-07-27T19:36:10.575 INFO:teuthology.orchestra.run.smithi072.stdout:Release : 129.el8 2023-07-27T19:36:10.575 INFO:teuthology.orchestra.run.smithi072.stdout:Architecture: x86_64 2023-07-27T19:36:10.575 INFO:teuthology.orchestra.run.smithi072.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-07-27T19:36:10.576 INFO:teuthology.orchestra.run.smithi072.stdout:Group : System Environment/Base 2023-07-27T19:36:10.576 INFO:teuthology.orchestra.run.smithi072.stdout:Size : 9265586 2023-07-27T19:36:10.576 INFO:teuthology.orchestra.run.smithi072.stdout:License : GPLv3+ 2023-07-27T19:36:10.576 INFO:teuthology.orchestra.run.smithi072.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-07-27T19:36:10.576 INFO:teuthology.orchestra.run.smithi072.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-07-27T19:36:10.577 INFO:teuthology.orchestra.run.smithi072.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-07-27T19:36:10.577 INFO:teuthology.orchestra.run.smithi072.stdout:Build Host : kbuilder.bsys.centos.org 2023-07-27T19:36:10.577 INFO:teuthology.orchestra.run.smithi072.stdout:Relocations : (not relocatable) 2023-07-27T19:36:10.577 INFO:teuthology.orchestra.run.smithi072.stdout:Packager : CentOS BuildSystem 2023-07-27T19:36:10.577 INFO:teuthology.orchestra.run.smithi072.stdout:Vendor : CentOS 2023-07-27T19:36:10.577 INFO:teuthology.orchestra.run.smithi072.stdout:URL : http://www.gnu.org/software/grub/ 2023-07-27T19:36:10.577 INFO:teuthology.orchestra.run.smithi072.stdout:Summary : Support tools for GRUB. 2023-07-27T19:36:10.577 INFO:teuthology.orchestra.run.smithi072.stdout:Description : 2023-07-27T19:36:10.578 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T19:36:10.578 INFO:teuthology.orchestra.run.smithi072.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-07-27T19:36:10.578 INFO:teuthology.orchestra.run.smithi072.stdout:customizable bootloader with modular architecture. It supports a rich 2023-07-27T19:36:10.578 INFO:teuthology.orchestra.run.smithi072.stdout:variety of kernel formats, file systems, computer architectures and 2023-07-27T19:36:10.578 INFO:teuthology.orchestra.run.smithi072.stdout:hardware devices. 2023-07-27T19:36:10.578 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T19:36:10.578 INFO:teuthology.orchestra.run.smithi072.stdout:This subpackage provides tools for support of all platforms. 2023-07-27T19:36:10.579 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-07-27T19:36:10.579 INFO:teuthology.task.kernel:Updating grub on smithi072 to boot 6.5.0-rc1-gbbae19e0824b 2023-07-27T19:36:10.580 DEBUG:teuthology.orchestra.run.smithi072:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-07-27T19:36:11.592 INFO:teuthology.orchestra.run.smithi072.stderr:Generating grub configuration file ... 2023-07-27T19:36:14.354 INFO:teuthology.orchestra.run.smithi072.stderr:done 2023-07-27T19:36:14.355 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2023-07-27T19:36:14.393 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.CTdIETlQJ6 2023-07-27T19:36:14.394 DEBUG:teuthology.orchestra.run.smithi072:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.CTdIETlQJ6 2023-07-27T19:36:14.465 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.CTdIETlQJ6 2023-07-27T19:36:14.636 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.CTdIETlQJ6 is 6KB 2023-07-27T19:36:14.684 DEBUG:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.CTdIETlQJ6 2023-07-27T19:36:14.701 DEBUG:teuthology.orchestra.run.smithi072:> sudo /bin/ls /boot/loader/entries || true 2023-07-27T19:36:14.772 INFO:teuthology.orchestra.run.smithi072.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-07-27T19:36:14.772 INFO:teuthology.orchestra.run.smithi072.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-07-27T19:36:14.772 INFO:teuthology.orchestra.run.smithi072.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-07-27T19:36:14.772 INFO:teuthology.orchestra.run.smithi072.stdout:a1b29d6c289747bdb22930598d39874a-6.5.0-rc1-gbbae19e0824b.conf 2023-07-27T19:36:14.773 DEBUG:teuthology.orchestra.run.smithi072:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.5.0-rc1-gbbae19e0824b 2023-07-27T19:36:14.924 DEBUG:teuthology.orchestra.run.smithi072:> sudo shutdown -r now 2023-07-27T19:36:21.475 INFO:teuthology.orchestra.run.smithi173.stdout:kernel-6.5.0_rc1_gbbae19e0824b-1 ######################################## 2023-07-27T19:36:44.803 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi173.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-07-27T19:36:44.803 DEBUG:teuthology.orchestra.run.smithi173:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-07-27T19:36:44.845 INFO:teuthology.orchestra.run.smithi173.stdout:/boot/System.map-6.5.0-rc1-gbbae19e0824b 2023-07-27T19:36:44.845 INFO:teuthology.orchestra.run.smithi173.stdout:/boot/config-6.5.0-rc1-gbbae19e0824b 2023-07-27T19:36:44.845 INFO:teuthology.orchestra.run.smithi173.stdout:/boot/vmlinuz-6.5.0-rc1-gbbae19e0824b 2023-07-27T19:36:44.845 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b 2023-07-27T19:36:44.846 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel 2023-07-27T19:36:44.846 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch 2023-07-27T19:36:44.846 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86 2023-07-27T19:36:44.846 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto 2023-07-27T19:36:44.846 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-27T19:36:44.846 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-27T19:36:44.846 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-27T19:36:44.847 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-27T19:36:44.847 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-27T19:36:44.847 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-27T19:36:44.847 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-27T19:36:44.847 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-07-27T19:36:44.847 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-27T19:36:44.847 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-27T19:36:44.847 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-27T19:36:44.848 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-27T19:36:44.848 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-27T19:36:44.848 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-27T19:36:44.848 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-27T19:36:44.848 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-27T19:36:44.848 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-27T19:36:44.849 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-27T19:36:44.849 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-27T19:36:44.849 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-27T19:36:44.849 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/kernel 2023-07-27T19:36:44.849 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/kernel/cpu 2023-07-27T19:36:44.849 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/kernel/cpu/mce 2023-07-27T19:36:44.849 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-27T19:36:44.850 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/kvm 2023-07-27T19:36:44.850 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-27T19:36:44.850 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-27T19:36:44.850 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/arch/x86/kvm/kvm.ko 2023-07-27T19:36:44.850 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto 2023-07-27T19:36:44.850 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/ansi_cprng.ko 2023-07-27T19:36:44.850 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/anubis.ko 2023-07-27T19:36:44.850 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/arc4.ko 2023-07-27T19:36:44.851 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/async_tx 2023-07-27T19:36:44.851 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/async_tx/async_memcpy.ko 2023-07-27T19:36:44.851 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/async_tx/async_pq.ko 2023-07-27T19:36:44.851 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-27T19:36:44.851 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/async_tx/async_tx.ko 2023-07-27T19:36:44.851 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/async_tx/async_xor.ko 2023-07-27T19:36:44.851 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/async_tx/raid6test.ko 2023-07-27T19:36:44.852 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/authenc.ko 2023-07-27T19:36:44.852 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/authencesn.ko 2023-07-27T19:36:44.852 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/blake2b_generic.ko 2023-07-27T19:36:44.852 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/blowfish_common.ko 2023-07-27T19:36:44.852 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/blowfish_generic.ko 2023-07-27T19:36:44.852 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/camellia_generic.ko 2023-07-27T19:36:44.852 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/cast5_generic.ko 2023-07-27T19:36:44.852 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/cast6_generic.ko 2023-07-27T19:36:44.853 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/cast_common.ko 2023-07-27T19:36:44.853 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/ccm.ko 2023-07-27T19:36:44.853 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/cmac.ko 2023-07-27T19:36:44.853 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/crc32_generic.ko 2023-07-27T19:36:44.853 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/crypto_engine.ko 2023-07-27T19:36:44.853 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/crypto_user.ko 2023-07-27T19:36:44.853 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/cts.ko 2023-07-27T19:36:44.853 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/des_generic.ko 2023-07-27T19:36:44.854 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/dh_generic.ko 2023-07-27T19:36:44.854 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/echainiv.ko 2023-07-27T19:36:44.854 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/essiv.ko 2023-07-27T19:36:44.854 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/fcrypt.ko 2023-07-27T19:36:44.854 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/khazad.ko 2023-07-27T19:36:44.854 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/lz4.ko 2023-07-27T19:36:44.854 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/lz4hc.ko 2023-07-27T19:36:44.855 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/md4.ko 2023-07-27T19:36:44.855 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/michael_mic.ko 2023-07-27T19:36:44.855 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/pcbc.ko 2023-07-27T19:36:44.855 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/pcrypt.ko 2023-07-27T19:36:44.855 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/rmd160.ko 2023-07-27T19:36:44.855 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/seed.ko 2023-07-27T19:36:44.855 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/serpent_generic.ko 2023-07-27T19:36:44.855 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/tcrypt.ko 2023-07-27T19:36:44.856 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/tea.ko 2023-07-27T19:36:44.856 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/twofish_common.ko 2023-07-27T19:36:44.856 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/twofish_generic.ko 2023-07-27T19:36:44.856 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/vmac.ko 2023-07-27T19:36:44.856 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/wp512.ko 2023-07-27T19:36:44.856 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/xcbc.ko 2023-07-27T19:36:44.856 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/xor.ko 2023-07-27T19:36:44.856 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/crypto/xxhash_generic.ko 2023-07-27T19:36:44.857 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers 2023-07-27T19:36:44.857 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/acpi 2023-07-27T19:36:44.857 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-27T19:36:44.857 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/acpi/acpi_pad.ko 2023-07-27T19:36:44.857 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/acpi/custom_method.ko 2023-07-27T19:36:44.857 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/acpi/ec_sys.ko 2023-07-27T19:36:44.857 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/acpi/platform_profile.ko 2023-07-27T19:36:44.858 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/acpi/sbs.ko 2023-07-27T19:36:44.858 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/acpi/sbshc.ko 2023-07-27T19:36:44.858 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/acpi/video.ko 2023-07-27T19:36:44.858 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata 2023-07-27T19:36:44.858 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/acard-ahci.ko 2023-07-27T19:36:44.858 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/ahci_platform.ko 2023-07-27T19:36:44.858 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/ata_generic.ko 2023-07-27T19:36:44.858 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/libahci_platform.ko 2023-07-27T19:36:44.859 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_acpi.ko 2023-07-27T19:36:44.859 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_ali.ko 2023-07-27T19:36:44.859 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_amd.ko 2023-07-27T19:36:44.859 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_artop.ko 2023-07-27T19:36:44.859 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_atiixp.ko 2023-07-27T19:36:44.859 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_atp867x.ko 2023-07-27T19:36:44.859 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_cmd640.ko 2023-07-27T19:36:44.859 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_cmd64x.ko 2023-07-27T19:36:44.860 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_cypress.ko 2023-07-27T19:36:44.860 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_efar.ko 2023-07-27T19:36:44.860 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_hpt366.ko 2023-07-27T19:36:44.860 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_hpt37x.ko 2023-07-27T19:36:44.860 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-27T19:36:44.860 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-27T19:36:44.860 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_it8213.ko 2023-07-27T19:36:44.860 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_it821x.ko 2023-07-27T19:36:44.861 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_jmicron.ko 2023-07-27T19:36:44.861 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_marvell.ko 2023-07-27T19:36:44.861 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_mpiix.ko 2023-07-27T19:36:44.861 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_netcell.ko 2023-07-27T19:36:44.861 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_ninja32.ko 2023-07-27T19:36:44.861 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_ns87410.ko 2023-07-27T19:36:44.861 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_ns87415.ko 2023-07-27T19:36:44.862 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_oldpiix.ko 2023-07-27T19:36:44.862 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_opti.ko 2023-07-27T19:36:44.862 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_optidma.ko 2023-07-27T19:36:44.862 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_pcmcia.ko 2023-07-27T19:36:44.862 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-27T19:36:44.862 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-27T19:36:44.862 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_piccolo.ko 2023-07-27T19:36:44.862 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_rdc.ko 2023-07-27T19:36:44.863 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_sch.ko 2023-07-27T19:36:44.863 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_serverworks.ko 2023-07-27T19:36:44.863 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_sil680.ko 2023-07-27T19:36:44.863 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_sis.ko 2023-07-27T19:36:44.863 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_sl82c105.ko 2023-07-27T19:36:44.863 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_triflex.ko 2023-07-27T19:36:44.863 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pata_via.ko 2023-07-27T19:36:44.864 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/pdc_adma.ko 2023-07-27T19:36:44.864 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/sata_inic162x.ko 2023-07-27T19:36:44.864 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/sata_mv.ko 2023-07-27T19:36:44.864 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/sata_nv.ko 2023-07-27T19:36:44.864 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/sata_promise.ko 2023-07-27T19:36:44.864 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/sata_qstor.ko 2023-07-27T19:36:44.864 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/sata_sil.ko 2023-07-27T19:36:44.864 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/sata_sil24.ko 2023-07-27T19:36:44.865 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/sata_sis.ko 2023-07-27T19:36:44.865 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/sata_svw.ko 2023-07-27T19:36:44.865 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/sata_sx4.ko 2023-07-27T19:36:44.865 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/sata_uli.ko 2023-07-27T19:36:44.865 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/sata_via.ko 2023-07-27T19:36:44.865 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ata/sata_vsc.ko 2023-07-27T19:36:44.865 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/auxdisplay 2023-07-27T19:36:44.865 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/auxdisplay/ks0108.ko 2023-07-27T19:36:44.866 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/base 2023-07-27T19:36:44.866 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/base/regmap 2023-07-27T19:36:44.866 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-07-27T19:36:44.866 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-07-27T19:36:44.866 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/bcma 2023-07-27T19:36:44.866 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/bcma/bcma.ko 2023-07-27T19:36:44.866 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block 2023-07-27T19:36:44.867 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/aoe 2023-07-27T19:36:44.867 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/aoe/aoe.ko 2023-07-27T19:36:44.867 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/brd.ko 2023-07-27T19:36:44.867 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/drbd 2023-07-27T19:36:44.867 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/drbd/drbd.ko 2023-07-27T19:36:44.867 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/floppy.ko 2023-07-27T19:36:44.867 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/loop.ko 2023-07-27T19:36:44.867 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/mtip32xx 2023-07-27T19:36:44.868 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-27T19:36:44.868 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/nbd.ko 2023-07-27T19:36:44.868 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/null_blk 2023-07-27T19:36:44.868 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/null_blk/null_blk.ko 2023-07-27T19:36:44.868 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/pktcdvd.ko 2023-07-27T19:36:44.868 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/rbd.ko 2023-07-27T19:36:44.868 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/virtio_blk.ko 2023-07-27T19:36:44.869 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/xen-blkback 2023-07-27T19:36:44.869 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-27T19:36:44.869 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/xen-blkfront.ko 2023-07-27T19:36:44.869 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/zram 2023-07-27T19:36:44.869 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/block/zram/zram.ko 2023-07-27T19:36:44.869 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char 2023-07-27T19:36:44.869 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/hangcheck-timer.ko 2023-07-27T19:36:44.869 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/hw_random 2023-07-27T19:36:44.870 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-27T19:36:44.870 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-27T19:36:44.870 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-27T19:36:44.870 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/hw_random/via-rng.ko 2023-07-27T19:36:44.870 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-27T19:36:44.870 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/ipmi 2023-07-27T19:36:44.870 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-27T19:36:44.870 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-27T19:36:44.871 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-27T19:36:44.871 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-27T19:36:44.871 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-27T19:36:44.871 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-27T19:36:44.871 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/lp.ko 2023-07-27T19:36:44.872 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/mwave 2023-07-27T19:36:44.872 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/mwave/mwave.ko 2023-07-27T19:36:44.872 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/ppdev.ko 2023-07-27T19:36:44.872 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/tlclk.ko 2023-07-27T19:36:44.872 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/tpm 2023-07-27T19:36:44.872 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/tpm/tpm.ko 2023-07-27T19:36:44.872 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-27T19:36:44.873 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-27T19:36:44.873 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-27T19:36:44.873 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/tpm/tpm_tis.ko 2023-07-27T19:36:44.873 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-07-27T19:36:44.873 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/uv_mmtimer.ko 2023-07-27T19:36:44.873 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/char/virtio_console.ko 2023-07-27T19:36:44.873 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/cpufreq 2023-07-27T19:36:44.873 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-07-27T19:36:44.874 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-27T19:36:44.874 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-27T19:36:44.874 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-07-27T19:36:44.874 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/cpufreq/powernow-k8.ko 2023-07-27T19:36:44.874 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-27T19:36:44.874 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/crypto 2023-07-27T19:36:44.874 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/crypto/ccp 2023-07-27T19:36:44.875 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-27T19:36:44.875 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/crypto/ccp/ccp.ko 2023-07-27T19:36:44.875 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/crypto/intel 2023-07-27T19:36:44.875 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/crypto/intel/qat 2023-07-27T19:36:44.875 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/crypto/intel/qat/qat_common 2023-07-27T19:36:44.875 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-27T19:36:44.875 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-07-27T19:36:44.875 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-27T19:36:44.876 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/crypto/padlock-aes.ko 2023-07-27T19:36:44.876 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/crypto/padlock-sha.ko 2023-07-27T19:36:44.876 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/crypto/virtio 2023-07-27T19:36:44.876 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-27T19:36:44.876 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/dca 2023-07-27T19:36:44.876 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/dca/dca.ko 2023-07-27T19:36:44.876 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/devfreq 2023-07-27T19:36:44.876 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-07-27T19:36:44.877 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/dma 2023-07-27T19:36:44.877 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/dma/dw 2023-07-27T19:36:44.877 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-27T19:36:44.877 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/dma/ioat 2023-07-27T19:36:44.877 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-27T19:36:44.877 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/edac 2023-07-27T19:36:44.877 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/edac/amd64_edac.ko 2023-07-27T19:36:44.878 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/edac/e752x_edac.ko 2023-07-27T19:36:44.878 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/edac/edac_mce_amd.ko 2023-07-27T19:36:44.878 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/edac/i3000_edac.ko 2023-07-27T19:36:44.878 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/edac/i3200_edac.ko 2023-07-27T19:36:44.878 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/edac/i5100_edac.ko 2023-07-27T19:36:44.878 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/edac/i5400_edac.ko 2023-07-27T19:36:44.878 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/edac/i7300_edac.ko 2023-07-27T19:36:44.878 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/edac/i7core_edac.ko 2023-07-27T19:36:44.879 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/edac/i82975x_edac.ko 2023-07-27T19:36:44.879 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/edac/ie31200_edac.ko 2023-07-27T19:36:44.879 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/edac/sb_edac.ko 2023-07-27T19:36:44.879 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/edac/x38_edac.ko 2023-07-27T19:36:44.879 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/firmware 2023-07-27T19:36:44.879 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/firmware/edd.ko 2023-07-27T19:36:44.879 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-27T19:36:44.879 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/gpio 2023-07-27T19:36:44.880 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/gpio/gpio-ich.ko 2023-07-27T19:36:44.880 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-27T19:36:44.880 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid 2023-07-27T19:36:44.880 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-appleir.ko 2023-07-27T19:36:44.880 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-aureal.ko 2023-07-27T19:36:44.880 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-axff.ko 2023-07-27T19:36:44.880 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-dr.ko 2023-07-27T19:36:44.881 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-elecom.ko 2023-07-27T19:36:44.881 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-elo.ko 2023-07-27T19:36:44.881 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-emsff.ko 2023-07-27T19:36:44.881 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-gaff.ko 2023-07-27T19:36:44.881 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-gt683r.ko 2023-07-27T19:36:44.881 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-gyration.ko 2023-07-27T19:36:44.881 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-27T19:36:44.881 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-27T19:36:44.882 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-holtekff.ko 2023-07-27T19:36:44.882 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-hyperv.ko 2023-07-27T19:36:44.882 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-icade.ko 2023-07-27T19:36:44.882 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-keytouch.ko 2023-07-27T19:36:44.882 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-kye.ko 2023-07-27T19:36:44.882 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-lcpower.ko 2023-07-27T19:36:44.882 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-led.ko 2023-07-27T19:36:44.882 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-lenovo.ko 2023-07-27T19:36:44.883 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-27T19:36:44.883 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-27T19:36:44.883 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-multitouch.ko 2023-07-27T19:36:44.883 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-ortek.ko 2023-07-27T19:36:44.883 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-penmount.ko 2023-07-27T19:36:44.883 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-petalynx.ko 2023-07-27T19:36:44.883 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-picolcd.ko 2023-07-27T19:36:44.883 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-pl.ko 2023-07-27T19:36:44.884 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-plantronics.ko 2023-07-27T19:36:44.884 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-primax.ko 2023-07-27T19:36:44.884 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-rmi.ko 2023-07-27T19:36:44.884 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-27T19:36:44.884 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-roccat-common.ko 2023-07-27T19:36:44.884 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-27T19:36:44.884 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-27T19:36:44.885 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-27T19:36:44.885 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-27T19:36:44.885 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-27T19:36:44.885 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-27T19:36:44.885 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-27T19:36:44.885 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-27T19:36:44.885 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-27T19:36:44.885 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-roccat.ko 2023-07-27T19:36:44.886 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-saitek.ko 2023-07-27T19:36:44.886 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-samsung.ko 2023-07-27T19:36:44.886 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-27T19:36:44.886 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-sjoy.ko 2023-07-27T19:36:44.886 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-sony.ko 2023-07-27T19:36:44.886 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-speedlink.ko 2023-07-27T19:36:44.886 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-steelseries.ko 2023-07-27T19:36:44.886 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-sunplus.ko 2023-07-27T19:36:44.887 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-27T19:36:44.887 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-tivo.ko 2023-07-27T19:36:44.887 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-tmff.ko 2023-07-27T19:36:44.887 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-topseed.ko 2023-07-27T19:36:44.887 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-twinhan.ko 2023-07-27T19:36:44.887 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-uclogic.ko 2023-07-27T19:36:44.887 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-waltop.ko 2023-07-27T19:36:44.887 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-wiimote.ko 2023-07-27T19:36:44.888 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-xinmo.ko 2023-07-27T19:36:44.888 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-zpff.ko 2023-07-27T19:36:44.888 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/hid-zydacron.ko 2023-07-27T19:36:44.888 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/uhid.ko 2023-07-27T19:36:44.888 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hid/wacom.ko 2023-07-27T19:36:44.888 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hv 2023-07-27T19:36:44.888 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hv/hv_balloon.ko 2023-07-27T19:36:44.889 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hv/hv_utils.ko 2023-07-27T19:36:44.889 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hv/hv_vmbus.ko 2023-07-27T19:36:44.889 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon 2023-07-27T19:36:44.889 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/abituguru.ko 2023-07-27T19:36:44.889 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/abituguru3.ko 2023-07-27T19:36:44.889 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-27T19:36:44.889 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/ad7414.ko 2023-07-27T19:36:44.889 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/ad7418.ko 2023-07-27T19:36:44.890 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/adc128d818.ko 2023-07-27T19:36:44.890 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/adm1025.ko 2023-07-27T19:36:44.890 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/adm1026.ko 2023-07-27T19:36:44.890 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/adm1029.ko 2023-07-27T19:36:44.890 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/adm1031.ko 2023-07-27T19:36:44.890 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/adm9240.ko 2023-07-27T19:36:44.890 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/ads7828.ko 2023-07-27T19:36:44.890 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/adt7410.ko 2023-07-27T19:36:44.891 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/adt7411.ko 2023-07-27T19:36:44.891 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/adt7462.ko 2023-07-27T19:36:44.891 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/adt7470.ko 2023-07-27T19:36:44.891 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/adt7475.ko 2023-07-27T19:36:44.891 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/adt7x10.ko 2023-07-27T19:36:44.891 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/amc6821.ko 2023-07-27T19:36:44.891 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/applesmc.ko 2023-07-27T19:36:44.891 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/asb100.ko 2023-07-27T19:36:44.892 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/asc7621.ko 2023-07-27T19:36:44.892 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-27T19:36:44.892 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/atxp1.ko 2023-07-27T19:36:44.892 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/coretemp.ko 2023-07-27T19:36:44.892 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-27T19:36:44.892 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/dme1737.ko 2023-07-27T19:36:44.892 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/ds1621.ko 2023-07-27T19:36:44.893 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/ds620.ko 2023-07-27T19:36:44.893 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/emc1403.ko 2023-07-27T19:36:44.893 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/emc6w201.ko 2023-07-27T19:36:44.893 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/f71805f.ko 2023-07-27T19:36:44.893 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/f71882fg.ko 2023-07-27T19:36:44.893 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/f75375s.ko 2023-07-27T19:36:44.893 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/fam15h_power.ko 2023-07-27T19:36:44.893 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/fschmd.ko 2023-07-27T19:36:44.894 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/g760a.ko 2023-07-27T19:36:44.894 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/g762.ko 2023-07-27T19:36:44.894 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/gl518sm.ko 2023-07-27T19:36:44.894 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/gl520sm.ko 2023-07-27T19:36:44.894 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-27T19:36:44.894 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/i5500_temp.ko 2023-07-27T19:36:44.894 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/i5k_amb.ko 2023-07-27T19:36:44.895 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/ibmaem.ko 2023-07-27T19:36:44.895 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/ibmpex.ko 2023-07-27T19:36:44.895 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/ina209.ko 2023-07-27T19:36:44.895 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/ina2xx.ko 2023-07-27T19:36:44.895 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/it87.ko 2023-07-27T19:36:44.895 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/k10temp.ko 2023-07-27T19:36:44.895 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/k8temp.ko 2023-07-27T19:36:44.895 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/lineage-pem.ko 2023-07-27T19:36:44.896 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/lm63.ko 2023-07-27T19:36:44.896 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/lm73.ko 2023-07-27T19:36:44.896 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/lm75.ko 2023-07-27T19:36:44.896 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/lm77.ko 2023-07-27T19:36:44.896 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/lm78.ko 2023-07-27T19:36:44.896 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/lm80.ko 2023-07-27T19:36:44.896 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/lm83.ko 2023-07-27T19:36:44.896 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/lm85.ko 2023-07-27T19:36:44.897 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/lm87.ko 2023-07-27T19:36:44.897 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/lm90.ko 2023-07-27T19:36:44.897 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/lm92.ko 2023-07-27T19:36:44.897 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/lm93.ko 2023-07-27T19:36:44.897 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/lm95234.ko 2023-07-27T19:36:44.897 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/lm95241.ko 2023-07-27T19:36:44.897 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/lm95245.ko 2023-07-27T19:36:44.897 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/ltc2945.ko 2023-07-27T19:36:44.898 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/ltc4151.ko 2023-07-27T19:36:44.898 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/ltc4215.ko 2023-07-27T19:36:44.898 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/ltc4222.ko 2023-07-27T19:36:44.898 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/ltc4245.ko 2023-07-27T19:36:44.898 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/ltc4260.ko 2023-07-27T19:36:44.898 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/ltc4261.ko 2023-07-27T19:36:44.898 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/max16065.ko 2023-07-27T19:36:44.899 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/max1619.ko 2023-07-27T19:36:44.899 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/max1668.ko 2023-07-27T19:36:44.899 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/max197.ko 2023-07-27T19:36:44.899 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/max6639.ko 2023-07-27T19:36:44.899 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/max6650.ko 2023-07-27T19:36:44.899 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/max6697.ko 2023-07-27T19:36:44.899 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/mcp3021.ko 2023-07-27T19:36:44.899 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/nct6683.ko 2023-07-27T19:36:44.900 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/nct6775-core.ko 2023-07-27T19:36:44.900 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/nct6775.ko 2023-07-27T19:36:44.900 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/nct7802.ko 2023-07-27T19:36:44.900 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/pc87360.ko 2023-07-27T19:36:44.900 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/pc87427.ko 2023-07-27T19:36:44.900 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/pcf8591.ko 2023-07-27T19:36:44.900 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/pmbus 2023-07-27T19:36:44.900 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-27T19:36:44.901 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-27T19:36:44.901 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-27T19:36:44.901 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-27T19:36:44.901 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-27T19:36:44.901 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-27T19:36:44.901 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-27T19:36:44.901 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-27T19:36:44.901 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-27T19:36:44.902 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-27T19:36:44.902 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-27T19:36:44.902 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-27T19:36:44.902 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/powr1220.ko 2023-07-27T19:36:44.902 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/sch5627.ko 2023-07-27T19:36:44.902 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/sch5636.ko 2023-07-27T19:36:44.902 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-27T19:36:44.903 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/sht15.ko 2023-07-27T19:36:44.903 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/sht21.ko 2023-07-27T19:36:44.903 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/shtc1.ko 2023-07-27T19:36:44.903 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/sis5595.ko 2023-07-27T19:36:44.903 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/smsc47b397.ko 2023-07-27T19:36:44.903 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/smsc47m1.ko 2023-07-27T19:36:44.903 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/smsc47m192.ko 2023-07-27T19:36:44.903 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/thmc50.ko 2023-07-27T19:36:44.904 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/tmp102.ko 2023-07-27T19:36:44.904 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/tmp103.ko 2023-07-27T19:36:44.904 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/tmp401.ko 2023-07-27T19:36:44.904 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/tmp421.ko 2023-07-27T19:36:44.904 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/via-cputemp.ko 2023-07-27T19:36:44.904 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/via686a.ko 2023-07-27T19:36:44.904 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/vt1211.ko 2023-07-27T19:36:44.904 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/vt8231.ko 2023-07-27T19:36:44.905 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/w83627ehf.ko 2023-07-27T19:36:44.905 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/w83627hf.ko 2023-07-27T19:36:44.905 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/w83781d.ko 2023-07-27T19:36:44.905 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/w83791d.ko 2023-07-27T19:36:44.905 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/w83792d.ko 2023-07-27T19:36:44.905 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/w83793.ko 2023-07-27T19:36:44.905 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/w83795.ko 2023-07-27T19:36:44.906 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/w83l785ts.ko 2023-07-27T19:36:44.906 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/hwmon/w83l786ng.ko 2023-07-27T19:36:44.906 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c 2023-07-27T19:36:44.906 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/algos 2023-07-27T19:36:44.906 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-27T19:36:44.906 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-27T19:36:44.906 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses 2023-07-27T19:36:44.906 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-27T19:36:44.907 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-27T19:36:44.907 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-27T19:36:44.907 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-27T19:36:44.907 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-27T19:36:44.907 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-27T19:36:44.907 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-27T19:36:44.907 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-27T19:36:44.908 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-27T19:36:44.908 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-27T19:36:44.908 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-27T19:36:44.908 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-27T19:36:44.908 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-27T19:36:44.908 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-27T19:36:44.908 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-27T19:36:44.908 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-27T19:36:44.909 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-27T19:36:44.909 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-27T19:36:44.909 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-27T19:36:44.909 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-27T19:36:44.909 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-27T19:36:44.909 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-27T19:36:44.909 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-27T19:36:44.910 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/i2c-dev.ko 2023-07-27T19:36:44.910 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/i2c-mux.ko 2023-07-27T19:36:44.910 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-07-27T19:36:44.910 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/i2c-smbus.ko 2023-07-27T19:36:44.910 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/i2c/i2c-stub.ko 2023-07-27T19:36:44.910 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband 2023-07-27T19:36:44.910 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/core 2023-07-27T19:36:44.910 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-27T19:36:44.911 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/core/ib_core.ko 2023-07-27T19:36:44.911 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-27T19:36:44.911 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-27T19:36:44.911 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-27T19:36:44.911 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-27T19:36:44.911 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-27T19:36:44.911 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/hw 2023-07-27T19:36:44.911 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/hw/cxgb4 2023-07-27T19:36:44.912 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-27T19:36:44.912 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/hw/mlx4 2023-07-27T19:36:44.912 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-27T19:36:44.912 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/hw/mlx5 2023-07-27T19:36:44.964 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-27T19:36:44.965 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/hw/mthca 2023-07-27T19:36:44.965 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-27T19:36:44.965 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/ulp 2023-07-27T19:36:44.965 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/ulp/ipoib 2023-07-27T19:36:44.965 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-27T19:36:44.965 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/ulp/iser 2023-07-27T19:36:44.965 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-27T19:36:44.966 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/ulp/isert 2023-07-27T19:36:44.966 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-27T19:36:44.966 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/ulp/srp 2023-07-27T19:36:44.966 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-27T19:36:44.966 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/ulp/srpt 2023-07-27T19:36:44.966 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-27T19:36:44.966 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input 2023-07-27T19:36:44.966 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/gameport 2023-07-27T19:36:44.967 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-27T19:36:44.967 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-27T19:36:44.967 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/gameport/gameport.ko 2023-07-27T19:36:44.967 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/gameport/lightning.ko 2023-07-27T19:36:44.967 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/gameport/ns558.ko 2023-07-27T19:36:44.967 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/joydev.ko 2023-07-27T19:36:44.967 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/keyboard 2023-07-27T19:36:44.968 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-27T19:36:44.968 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/mouse 2023-07-27T19:36:44.968 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/mouse/appletouch.ko 2023-07-27T19:36:44.968 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/mouse/bcm5974.ko 2023-07-27T19:36:44.968 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/mouse/cyapatp.ko 2023-07-27T19:36:44.968 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-27T19:36:44.968 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/mouse/sermouse.ko 2023-07-27T19:36:44.969 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-27T19:36:44.969 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-27T19:36:44.969 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-27T19:36:44.969 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/rmi4 2023-07-27T19:36:44.969 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-27T19:36:44.969 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/serio 2023-07-27T19:36:44.969 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/serio/altera_ps2.ko 2023-07-27T19:36:44.969 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/serio/arc_ps2.ko 2023-07-27T19:36:44.970 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-27T19:36:44.970 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/serio/serio_raw.ko 2023-07-27T19:36:44.970 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/input/sparse-keymap.ko 2023-07-27T19:36:44.970 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/iommu 2023-07-27T19:36:44.970 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/iommu/amd 2023-07-27T19:36:44.970 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-27T19:36:44.970 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/leds 2023-07-27T19:36:44.971 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/leds/leds-blinkm.ko 2023-07-27T19:36:44.971 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/leds/leds-lm3530.ko 2023-07-27T19:36:44.971 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/leds/leds-lp3944.ko 2023-07-27T19:36:44.971 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/leds/leds-ss4200.ko 2023-07-27T19:36:44.971 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/leds/trigger 2023-07-27T19:36:44.971 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-27T19:36:44.971 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-27T19:36:44.971 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-27T19:36:44.972 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-27T19:36:44.972 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-27T19:36:44.972 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-27T19:36:44.972 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-27T19:36:44.972 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-27T19:36:44.972 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md 2023-07-27T19:36:44.972 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/bcache 2023-07-27T19:36:44.973 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/bcache/bcache.ko 2023-07-27T19:36:44.973 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/dm-bio-prison.ko 2023-07-27T19:36:44.973 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/dm-cache-smq.ko 2023-07-27T19:36:44.973 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/dm-cache.ko 2023-07-27T19:36:44.973 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/dm-crypt.ko 2023-07-27T19:36:44.973 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/dm-delay.ko 2023-07-27T19:36:44.973 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/dm-flakey.ko 2023-07-27T19:36:44.973 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/dm-log-userspace.ko 2023-07-27T19:36:44.974 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/dm-multipath.ko 2023-07-27T19:36:44.974 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/dm-queue-length.ko 2023-07-27T19:36:44.974 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/dm-raid.ko 2023-07-27T19:36:44.974 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/dm-round-robin.ko 2023-07-27T19:36:44.974 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/dm-service-time.ko 2023-07-27T19:36:44.974 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/dm-switch.ko 2023-07-27T19:36:44.974 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/dm-thin-pool.ko 2023-07-27T19:36:44.975 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/dm-verity.ko 2023-07-27T19:36:44.975 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/faulty.ko 2023-07-27T19:36:44.975 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/linear.ko 2023-07-27T19:36:44.975 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/multipath.ko 2023-07-27T19:36:44.975 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/persistent-data 2023-07-27T19:36:44.975 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-27T19:36:44.975 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/raid0.ko 2023-07-27T19:36:44.975 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/raid1.ko 2023-07-27T19:36:44.976 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/raid10.ko 2023-07-27T19:36:44.976 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/md/raid456.ko 2023-07-27T19:36:44.976 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/message 2023-07-27T19:36:44.976 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/message/fusion 2023-07-27T19:36:44.976 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/message/fusion/mptbase.ko 2023-07-27T19:36:44.976 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/message/fusion/mptctl.ko 2023-07-27T19:36:44.976 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/message/fusion/mptfc.ko 2023-07-27T19:36:44.977 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/message/fusion/mptlan.ko 2023-07-27T19:36:44.977 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/message/fusion/mptsas.ko 2023-07-27T19:36:44.977 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/message/fusion/mptscsih.ko 2023-07-27T19:36:44.977 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/message/fusion/mptspi.ko 2023-07-27T19:36:44.977 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/mfd 2023-07-27T19:36:44.977 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/mfd/lpc_ich.ko 2023-07-27T19:36:44.977 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/mfd/lpc_sch.ko 2023-07-27T19:36:44.977 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/mfd/mfd-core.ko 2023-07-27T19:36:44.978 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/mfd/sm501.ko 2023-07-27T19:36:44.978 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/mfd/viperboard.ko 2023-07-27T19:36:44.978 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/mfd/vx855.ko 2023-07-27T19:36:44.978 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/mfd/wl1273-core.ko 2023-07-27T19:36:44.978 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc 2023-07-27T19:36:44.978 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/altera-stapl 2023-07-27T19:36:44.978 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-27T19:36:44.979 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/apds9802als.ko 2023-07-27T19:36:44.979 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/apds990x.ko 2023-07-27T19:36:44.979 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/bh1770glc.ko 2023-07-27T19:36:44.979 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/cb710 2023-07-27T19:36:44.979 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/cb710/cb710.ko 2023-07-27T19:36:44.979 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/eeprom 2023-07-27T19:36:44.979 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/eeprom/at24.ko 2023-07-27T19:36:44.979 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-27T19:36:44.980 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-27T19:36:44.980 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/eeprom/max6875.ko 2023-07-27T19:36:44.980 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/enclosure.ko 2023-07-27T19:36:44.980 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/hpilo.ko 2023-07-27T19:36:44.980 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/isl29003.ko 2023-07-27T19:36:44.980 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/isl29020.ko 2023-07-27T19:36:44.980 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/lis3lv02d 2023-07-27T19:36:44.981 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-27T19:36:44.981 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-27T19:36:44.981 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/mei 2023-07-27T19:36:44.981 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/mei/mei-me.ko 2023-07-27T19:36:44.981 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/mei/mei-txe.ko 2023-07-27T19:36:44.981 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/mei/mei.ko 2023-07-27T19:36:44.981 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/sgi-gru 2023-07-27T19:36:44.981 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/sgi-gru/gru.ko 2023-07-27T19:36:44.982 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/sgi-xp 2023-07-27T19:36:44.982 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/sgi-xp/xp.ko 2023-07-27T19:36:44.982 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-07-27T19:36:44.982 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-07-27T19:36:44.982 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/tifm_7xx1.ko 2023-07-27T19:36:44.982 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/tifm_core.ko 2023-07-27T19:36:44.982 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/tsl2550.ko 2023-07-27T19:36:44.982 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/vmw_balloon.ko 2023-07-27T19:36:44.983 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/vmw_vmci 2023-07-27T19:36:44.983 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-27T19:36:44.983 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net 2023-07-27T19:36:44.983 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/bonding 2023-07-27T19:36:44.983 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/bonding/bonding.ko 2023-07-27T19:36:44.983 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/dsa 2023-07-27T19:36:44.983 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/dsa/b53 2023-07-27T19:36:44.984 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-27T19:36:44.984 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-27T19:36:44.984 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-27T19:36:44.984 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/dsa/mv88e6xxx 2023-07-27T19:36:44.984 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-27T19:36:44.984 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/dummy.ko 2023-07-27T19:36:44.984 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/eql.ko 2023-07-27T19:36:44.984 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet 2023-07-27T19:36:44.985 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/3com 2023-07-27T19:36:44.985 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-27T19:36:44.985 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-27T19:36:44.985 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-27T19:36:44.985 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-27T19:36:44.985 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/8390 2023-07-27T19:36:44.985 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-27T19:36:44.985 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-27T19:36:44.986 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-27T19:36:44.986 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-27T19:36:44.986 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/adaptec 2023-07-27T19:36:44.986 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-27T19:36:44.986 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/agere 2023-07-27T19:36:44.986 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-27T19:36:44.986 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/alteon 2023-07-27T19:36:44.987 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-27T19:36:44.987 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/altera 2023-07-27T19:36:44.987 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-27T19:36:44.987 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/amd 2023-07-27T19:36:44.987 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-27T19:36:44.987 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-27T19:36:44.987 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-27T19:36:44.987 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/atheros 2023-07-27T19:36:44.988 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/atheros/alx 2023-07-27T19:36:44.988 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-27T19:36:44.988 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/atheros/atl1c 2023-07-27T19:36:44.988 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-27T19:36:44.988 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/atheros/atl1e 2023-07-27T19:36:44.988 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-27T19:36:44.988 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/atheros/atlx 2023-07-27T19:36:44.988 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-27T19:36:44.989 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-27T19:36:44.989 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/broadcom 2023-07-27T19:36:44.989 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-27T19:36:44.989 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-27T19:36:44.989 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-07-27T19:36:44.989 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-27T19:36:44.989 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-27T19:36:44.990 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/broadcom/genet 2023-07-27T19:36:44.990 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-27T19:36:44.990 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-27T19:36:44.990 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/brocade 2023-07-27T19:36:44.990 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/brocade/bna 2023-07-27T19:36:44.990 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-27T19:36:44.990 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/chelsio 2023-07-27T19:36:44.990 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-07-27T19:36:44.991 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-27T19:36:44.991 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-07-27T19:36:44.991 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-27T19:36:44.991 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-07-27T19:36:44.991 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-27T19:36:44.991 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-07-27T19:36:44.991 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-27T19:36:44.991 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-07-27T19:36:44.992 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-27T19:36:44.992 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/cisco 2023-07-27T19:36:44.992 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/cisco/enic 2023-07-27T19:36:44.992 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-27T19:36:44.992 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/dec 2023-07-27T19:36:44.992 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/dec/tulip 2023-07-27T19:36:44.992 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-27T19:36:44.993 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-27T19:36:44.993 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-27T19:36:44.993 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-27T19:36:44.993 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-27T19:36:44.993 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-27T19:36:44.993 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/dlink 2023-07-27T19:36:44.993 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-27T19:36:44.993 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-27T19:36:44.994 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/dnet.ko 2023-07-27T19:36:44.994 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/emulex 2023-07-27T19:36:44.994 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/emulex/benet 2023-07-27T19:36:44.994 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-27T19:36:44.994 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/ethoc.ko 2023-07-27T19:36:44.994 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/fealnx.ko 2023-07-27T19:36:44.994 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel 2023-07-27T19:36:44.994 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-27T19:36:44.995 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel/e1000 2023-07-27T19:36:44.995 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-27T19:36:44.995 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel/e1000e 2023-07-27T19:36:44.995 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-27T19:36:44.995 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel/fm10k 2023-07-27T19:36:44.995 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-27T19:36:44.995 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel/i40e 2023-07-27T19:36:44.995 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-27T19:36:44.996 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel/iavf 2023-07-27T19:36:44.996 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-27T19:36:44.996 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel/igb 2023-07-27T19:36:44.996 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-27T19:36:44.996 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel/igbvf 2023-07-27T19:36:44.996 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-27T19:36:44.996 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel/ixgbe 2023-07-27T19:36:44.997 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-27T19:36:44.997 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-07-27T19:36:44.997 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-27T19:36:44.997 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/jme.ko 2023-07-27T19:36:44.997 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/marvell 2023-07-27T19:36:44.997 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-27T19:36:44.997 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-27T19:36:44.997 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-27T19:36:44.998 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/mellanox 2023-07-27T19:36:44.998 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-07-27T19:36:44.998 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-27T19:36:44.998 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-27T19:36:44.998 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-07-27T19:36:44.998 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-07-27T19:36:44.998 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-27T19:36:44.998 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/micrel 2023-07-27T19:36:44.999 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-27T19:36:44.999 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/myricom 2023-07-27T19:36:44.999 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-07-27T19:36:44.999 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-27T19:36:44.999 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/natsemi 2023-07-27T19:36:44.999 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-27T19:36:44.999 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-27T19:36:44.999 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/neterion 2023-07-27T19:36:45.000 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-27T19:36:45.000 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/nvidia 2023-07-27T19:36:45.000 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-27T19:36:45.000 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/packetengines 2023-07-27T19:36:45.000 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-27T19:36:45.000 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-27T19:36:45.000 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/qlogic 2023-07-27T19:36:45.001 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/qlogic/netxen 2023-07-27T19:36:45.001 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-27T19:36:45.001 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-27T19:36:45.001 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-07-27T19:36:45.001 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-27T19:36:45.001 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/rdc 2023-07-27T19:36:45.001 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-27T19:36:45.001 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/realtek 2023-07-27T19:36:45.002 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-27T19:36:45.002 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-27T19:36:45.002 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-27T19:36:45.002 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-27T19:36:45.002 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/rocker 2023-07-27T19:36:45.002 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-07-27T19:36:45.002 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/sfc 2023-07-27T19:36:45.002 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-27T19:36:45.003 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/silan 2023-07-27T19:36:45.003 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-27T19:36:45.003 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/sis 2023-07-27T19:36:45.003 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-27T19:36:45.003 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-27T19:36:45.003 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/smsc 2023-07-27T19:36:45.003 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-27T19:36:45.004 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-27T19:36:45.004 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-27T19:36:45.004 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-27T19:36:45.004 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/stmicro 2023-07-27T19:36:45.004 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-07-27T19:36:45.004 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-27T19:36:45.004 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-27T19:36:45.004 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/sun 2023-07-27T19:36:45.005 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-27T19:36:45.005 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-27T19:36:45.005 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-27T19:36:45.005 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-27T19:36:45.005 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/tehuti 2023-07-27T19:36:45.005 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-27T19:36:45.005 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/ti 2023-07-27T19:36:45.005 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-27T19:36:45.006 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/via 2023-07-27T19:36:45.006 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-27T19:36:45.006 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-27T19:36:45.006 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/wiznet 2023-07-27T19:36:45.006 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-27T19:36:45.006 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-27T19:36:45.006 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/xircom 2023-07-27T19:36:45.006 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-27T19:36:45.007 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/geneve.ko 2023-07-27T19:36:45.007 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/hyperv 2023-07-27T19:36:45.007 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-27T19:36:45.007 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ieee802154 2023-07-27T19:36:45.007 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-27T19:36:45.007 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ifb.ko 2023-07-27T19:36:45.007 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ipvlan 2023-07-27T19:36:45.008 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-27T19:36:45.008 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/macvlan.ko 2023-07-27T19:36:45.008 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/macvtap.ko 2023-07-27T19:36:45.008 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/mdio 2023-07-27T19:36:45.008 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/mdio.ko 2023-07-27T19:36:45.008 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-27T19:36:45.008 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-27T19:36:45.008 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-07-27T19:36:45.009 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/mii.ko 2023-07-27T19:36:45.009 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/net_failover.ko 2023-07-27T19:36:45.009 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/netconsole.ko 2023-07-27T19:36:45.009 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/nlmon.ko 2023-07-27T19:36:45.009 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/pcs 2023-07-27T19:36:45.009 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-07-27T19:36:45.009 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-27T19:36:45.009 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy 2023-07-27T19:36:45.010 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/amd.ko 2023-07-27T19:36:45.010 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-27T19:36:45.010 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-07-27T19:36:45.010 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-27T19:36:45.010 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/bcm87xx.ko 2023-07-27T19:36:45.010 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/broadcom.ko 2023-07-27T19:36:45.010 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/cicada.ko 2023-07-27T19:36:45.011 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/davicom.ko 2023-07-27T19:36:45.011 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/dp83640.ko 2023-07-27T19:36:45.011 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/et1011c.ko 2023-07-27T19:36:45.011 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/icplus.ko 2023-07-27T19:36:45.011 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/lxt.ko 2023-07-27T19:36:45.011 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/marvell.ko 2023-07-27T19:36:45.011 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/micrel.ko 2023-07-27T19:36:45.011 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/national.ko 2023-07-27T19:36:45.012 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/phylink.ko 2023-07-27T19:36:45.012 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/qsemi.ko 2023-07-27T19:36:45.012 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/realtek.ko 2023-07-27T19:36:45.012 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/smsc.ko 2023-07-27T19:36:45.012 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/ste10Xp.ko 2023-07-27T19:36:45.012 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/phy/vitesse.ko 2023-07-27T19:36:45.012 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ppp 2023-07-27T19:36:45.012 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-27T19:36:45.013 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ppp/ppp_async.ko 2023-07-27T19:36:45.013 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-27T19:36:45.013 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ppp/ppp_generic.ko 2023-07-27T19:36:45.013 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-27T19:36:45.013 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-27T19:36:45.013 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ppp/pppoe.ko 2023-07-27T19:36:45.013 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ppp/pppox.ko 2023-07-27T19:36:45.014 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/ppp/pptp.ko 2023-07-27T19:36:45.014 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/slip 2023-07-27T19:36:45.014 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/slip/slhc.ko 2023-07-27T19:36:45.014 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/slip/slip.ko 2023-07-27T19:36:45.014 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/sungem_phy.ko 2023-07-27T19:36:45.014 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/tap.ko 2023-07-27T19:36:45.014 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/team 2023-07-27T19:36:45.014 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/team/team.ko 2023-07-27T19:36:45.015 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-27T19:36:45.015 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-27T19:36:45.015 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-27T19:36:45.015 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/team/team_mode_random.ko 2023-07-27T19:36:45.015 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-27T19:36:45.016 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/tun.ko 2023-07-27T19:36:45.016 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/veth.ko 2023-07-27T19:36:45.016 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/virtio_net.ko 2023-07-27T19:36:45.017 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/vmxnet3 2023-07-27T19:36:45.017 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-27T19:36:45.017 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/vxlan 2023-07-27T19:36:45.017 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/vxlan/vxlan.ko 2023-07-27T19:36:45.017 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/xen-netback 2023-07-27T19:36:45.017 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-27T19:36:45.017 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/net/xen-netfront.ko 2023-07-27T19:36:45.017 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ntb 2023-07-27T19:36:45.018 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ntb/ntb.ko 2023-07-27T19:36:45.018 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/nvme 2023-07-27T19:36:45.018 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/nvme/host 2023-07-27T19:36:45.018 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/nvme/host/nvme-core.ko 2023-07-27T19:36:45.018 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/nvme/host/nvme.ko 2023-07-27T19:36:45.018 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/parport 2023-07-27T19:36:45.018 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/parport/parport.ko 2023-07-27T19:36:45.019 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/parport/parport_cs.ko 2023-07-27T19:36:45.019 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/parport/parport_pc.ko 2023-07-27T19:36:45.019 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/parport/parport_serial.ko 2023-07-27T19:36:45.019 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/pci 2023-07-27T19:36:45.019 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/pci/hotplug 2023-07-27T19:36:45.019 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-27T19:36:45.019 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/pci/pcie 2023-07-27T19:36:45.019 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/pci/pcie/aer_inject.ko 2023-07-27T19:36:45.020 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/pci/xen-pcifront.ko 2023-07-27T19:36:45.020 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/pcmcia 2023-07-27T19:36:45.020 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/pcmcia/i82092.ko 2023-07-27T19:36:45.020 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/pcmcia/pd6729.ko 2023-07-27T19:36:45.020 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-27T19:36:45.020 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/pinctrl 2023-07-27T19:36:45.020 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/pinctrl/intel 2023-07-27T19:36:45.021 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-27T19:36:45.021 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform 2023-07-27T19:36:45.021 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86 2023-07-27T19:36:45.021 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-27T19:36:45.021 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/acerhdf.ko 2023-07-27T19:36:45.021 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-27T19:36:45.021 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-27T19:36:45.021 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-27T19:36:45.022 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-27T19:36:45.022 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-27T19:36:45.022 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-27T19:36:45.022 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-27T19:36:45.022 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-27T19:36:45.022 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-27T19:36:45.022 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/hdaps.ko 2023-07-27T19:36:45.023 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/intel 2023-07-27T19:36:45.023 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-27T19:36:45.023 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/intel_ips.ko 2023-07-27T19:36:45.023 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-27T19:36:45.023 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-27T19:36:45.023 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-27T19:36:45.023 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-27T19:36:45.023 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-27T19:36:45.024 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-27T19:36:45.024 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-27T19:36:45.024 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-27T19:36:45.024 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-27T19:36:45.024 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/platform/x86/wmi.ko 2023-07-27T19:36:45.024 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/powercap 2023-07-27T19:36:45.024 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-27T19:36:45.024 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-27T19:36:45.025 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/pps 2023-07-27T19:36:45.025 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/pps/clients 2023-07-27T19:36:45.025 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-27T19:36:45.025 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-27T19:36:45.025 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/pps/clients/pps_parport.ko 2023-07-27T19:36:45.025 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/pps/pps_core.ko 2023-07-27T19:36:45.025 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ptp 2023-07-27T19:36:45.026 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ptp/ptp.ko 2023-07-27T19:36:45.026 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ptp/ptp_kvm.ko 2023-07-27T19:36:45.026 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc 2023-07-27T19:36:45.026 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-27T19:36:45.026 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-27T19:36:45.026 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-27T19:36:45.026 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-27T19:36:45.026 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-27T19:36:45.027 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-27T19:36:45.027 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-27T19:36:45.027 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-27T19:36:45.027 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-27T19:36:45.027 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-27T19:36:45.027 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-27T19:36:45.027 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-em3027.ko 2023-07-27T19:36:45.027 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-27T19:36:45.028 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-27T19:36:45.028 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-27T19:36:45.028 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-27T19:36:45.028 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-27T19:36:45.028 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-27T19:36:45.028 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-max6900.ko 2023-07-27T19:36:45.028 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-27T19:36:45.029 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-27T19:36:45.029 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-27T19:36:45.029 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-27T19:36:45.029 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-27T19:36:45.029 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-27T19:36:45.029 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-27T19:36:45.029 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-27T19:36:45.029 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-27T19:36:45.030 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-27T19:36:45.030 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-27T19:36:45.030 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-27T19:36:45.030 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/rtc/rtc-x1205.ko 2023-07-27T19:36:45.030 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi 2023-07-27T19:36:45.030 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/3w-9xxx.ko 2023-07-27T19:36:45.030 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/3w-sas.ko 2023-07-27T19:36:45.030 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/3w-xxxx.ko 2023-07-27T19:36:45.031 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/BusLogic.ko 2023-07-27T19:36:45.031 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/a100u2w.ko 2023-07-27T19:36:45.031 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/aacraid 2023-07-27T19:36:45.031 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-27T19:36:45.031 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/advansys.ko 2023-07-27T19:36:45.031 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/aic7xxx 2023-07-27T19:36:45.031 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-27T19:36:45.031 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-27T19:36:45.032 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/am53c974.ko 2023-07-27T19:36:45.032 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/arcmsr 2023-07-27T19:36:45.032 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-27T19:36:45.032 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/atp870u.ko 2023-07-27T19:36:45.032 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/be2iscsi 2023-07-27T19:36:45.032 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-27T19:36:45.032 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/bfa 2023-07-27T19:36:45.032 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/bfa/bfa.ko 2023-07-27T19:36:45.033 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/bnx2fc 2023-07-27T19:36:45.033 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-27T19:36:45.033 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/bnx2i 2023-07-27T19:36:45.033 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-27T19:36:45.033 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/ch.ko 2023-07-27T19:36:45.033 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/csiostor 2023-07-27T19:36:45.033 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-27T19:36:45.034 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/cxgbi 2023-07-27T19:36:45.034 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-07-27T19:36:45.034 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-27T19:36:45.034 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-07-27T19:36:45.034 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-27T19:36:45.034 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-27T19:36:45.034 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/dc395x.ko 2023-07-27T19:36:45.034 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/device_handler 2023-07-27T19:36:45.035 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-07-27T19:36:45.035 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-07-27T19:36:45.035 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-07-27T19:36:45.035 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-07-27T19:36:45.035 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/dmx3191d.ko 2023-07-27T19:36:45.035 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/esas2r 2023-07-27T19:36:45.035 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-27T19:36:45.036 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/esp_scsi.ko 2023-07-27T19:36:45.036 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/fcoe 2023-07-27T19:36:45.036 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-27T19:36:45.036 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-27T19:36:45.036 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/fnic 2023-07-27T19:36:45.036 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/fnic/fnic.ko 2023-07-27T19:36:45.036 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/hpsa.ko 2023-07-27T19:36:45.036 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/hptiop.ko 2023-07-27T19:36:45.037 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/hv_storvsc.ko 2023-07-27T19:36:45.037 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/initio.ko 2023-07-27T19:36:45.037 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/ipr.ko 2023-07-27T19:36:45.037 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/ips.ko 2023-07-27T19:36:45.037 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/isci 2023-07-27T19:36:45.037 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/isci/isci.ko 2023-07-27T19:36:45.037 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-27T19:36:45.037 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-27T19:36:45.038 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/libfc 2023-07-27T19:36:45.038 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/libfc/libfc.ko 2023-07-27T19:36:45.038 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/libiscsi.ko 2023-07-27T19:36:45.038 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-27T19:36:45.038 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/libsas 2023-07-27T19:36:45.038 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/libsas/libsas.ko 2023-07-27T19:36:45.038 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/lpfc 2023-07-27T19:36:45.039 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-27T19:36:45.039 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/megaraid 2023-07-27T19:36:45.039 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/megaraid.ko 2023-07-27T19:36:45.039 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-27T19:36:45.039 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-27T19:36:45.039 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-27T19:36:45.039 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/mpt3sas 2023-07-27T19:36:45.039 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-27T19:36:45.040 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/mvsas 2023-07-27T19:36:45.040 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-27T19:36:45.040 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/mvumi.ko 2023-07-27T19:36:45.040 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/pm8001 2023-07-27T19:36:45.040 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-27T19:36:45.040 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/pmcraid.ko 2023-07-27T19:36:45.040 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/qla1280.ko 2023-07-27T19:36:45.040 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/qla2xxx 2023-07-27T19:36:45.041 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-27T19:36:45.041 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-27T19:36:45.041 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/qla4xxx 2023-07-27T19:36:45.041 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-27T19:36:45.041 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/raid_class.ko 2023-07-27T19:36:45.041 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/scsi_debug.ko 2023-07-27T19:36:45.041 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-27T19:36:45.042 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-27T19:36:45.042 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-27T19:36:45.042 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-27T19:36:45.042 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-27T19:36:45.042 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/ses.ko 2023-07-27T19:36:45.042 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/st.ko 2023-07-27T19:36:45.042 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/stex.ko 2023-07-27T19:36:45.042 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/sym53c8xx_2 2023-07-27T19:36:45.043 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-27T19:36:45.043 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/virtio_scsi.ko 2023-07-27T19:36:45.043 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-27T19:36:45.043 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/scsi/wd719x.ko 2023-07-27T19:36:45.043 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ssb 2023-07-27T19:36:45.043 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ssb/ssb.ko 2023-07-27T19:36:45.043 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/target 2023-07-27T19:36:45.044 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/target/iscsi 2023-07-27T19:36:45.044 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-27T19:36:45.044 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/target/loopback 2023-07-27T19:36:45.044 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-27T19:36:45.044 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/target/target_core_file.ko 2023-07-27T19:36:45.044 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/target/target_core_iblock.ko 2023-07-27T19:36:45.044 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/target/target_core_mod.ko 2023-07-27T19:36:45.044 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/target/target_core_pscsi.ko 2023-07-27T19:36:45.045 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/target/target_core_user.ko 2023-07-27T19:36:45.045 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/target/tcm_fc 2023-07-27T19:36:45.045 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-27T19:36:45.045 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/thermal 2023-07-27T19:36:45.045 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/thermal/intel 2023-07-27T19:36:45.045 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/thermal/intel/int340x_thermal 2023-07-27T19:36:45.045 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-27T19:36:45.045 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-27T19:36:45.046 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-27T19:36:45.046 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-27T19:36:45.046 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-27T19:36:45.046 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-27T19:36:45.046 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-27T19:36:45.046 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-27T19:36:45.046 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-27T19:36:45.047 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-27T19:36:45.047 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-27T19:36:45.047 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-27T19:36:45.047 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-27T19:36:45.047 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-27T19:36:45.047 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-27T19:36:45.047 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/tty 2023-07-27T19:36:45.047 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/tty/ipwireless 2023-07-27T19:36:45.048 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-27T19:36:45.048 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/tty/n_gsm.ko 2023-07-27T19:36:45.048 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/tty/n_hdlc.ko 2023-07-27T19:36:45.048 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/tty/nozomi.ko 2023-07-27T19:36:45.048 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/tty/serial 2023-07-27T19:36:45.048 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/tty/serial/8250 2023-07-27T19:36:45.048 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-27T19:36:45.049 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/tty/serial/arc_uart.ko 2023-07-27T19:36:45.049 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/tty/serial/jsm 2023-07-27T19:36:45.049 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-27T19:36:45.049 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/tty/synclink_gt.ko 2023-07-27T19:36:45.049 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ufs 2023-07-27T19:36:45.049 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ufs/core 2023-07-27T19:36:45.049 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-27T19:36:45.049 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ufs/host 2023-07-27T19:36:45.050 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-27T19:36:45.050 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/uio 2023-07-27T19:36:45.050 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/uio/uio.ko 2023-07-27T19:36:45.050 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/uio/uio_aec.ko 2023-07-27T19:36:45.050 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/uio/uio_cif.ko 2023-07-27T19:36:45.050 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/uio/uio_pci_generic.ko 2023-07-27T19:36:45.050 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/uio/uio_sercos3.ko 2023-07-27T19:36:45.050 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb 2023-07-27T19:36:45.051 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/class 2023-07-27T19:36:45.051 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/class/cdc-acm.ko 2023-07-27T19:36:45.051 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-27T19:36:45.051 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/class/usblp.ko 2023-07-27T19:36:45.051 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/class/usbtmc.ko 2023-07-27T19:36:45.051 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/host 2023-07-27T19:36:45.051 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-27T19:36:45.052 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/image 2023-07-27T19:36:45.052 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/image/mdc800.ko 2023-07-27T19:36:45.052 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/image/microtek.ko 2023-07-27T19:36:45.052 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/misc 2023-07-27T19:36:45.052 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/misc/adutux.ko 2023-07-27T19:36:45.052 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/misc/appledisplay.ko 2023-07-27T19:36:45.052 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/misc/emi26.ko 2023-07-27T19:36:45.052 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/misc/emi62.ko 2023-07-27T19:36:45.053 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/misc/ezusb.ko 2023-07-27T19:36:45.053 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/misc/idmouse.ko 2023-07-27T19:36:45.053 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/misc/iowarrior.ko 2023-07-27T19:36:45.053 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-27T19:36:45.053 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/misc/ldusb.ko 2023-07-27T19:36:45.053 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/misc/legousbtower.ko 2023-07-27T19:36:45.053 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/misc/sisusbvga 2023-07-27T19:36:45.053 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-27T19:36:45.054 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-27T19:36:45.054 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/misc/usb3503.ko 2023-07-27T19:36:45.054 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/misc/usblcd.ko 2023-07-27T19:36:45.054 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-27T19:36:45.054 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/misc/uss720.ko 2023-07-27T19:36:45.054 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/misc/yurex.ko 2023-07-27T19:36:45.054 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/phy 2023-07-27T19:36:45.055 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/phy/phy-generic.ko 2023-07-27T19:36:45.055 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial 2023-07-27T19:36:45.055 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/aircable.ko 2023-07-27T19:36:45.055 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/ark3116.ko 2023-07-27T19:36:45.055 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-27T19:36:45.055 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/ch341.ko 2023-07-27T19:36:45.055 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/cp210x.ko 2023-07-27T19:36:45.055 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/cyberjack.ko 2023-07-27T19:36:45.056 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-27T19:36:45.056 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-27T19:36:45.056 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/empeg.ko 2023-07-27T19:36:45.056 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-27T19:36:45.056 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-27T19:36:45.056 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-27T19:36:45.056 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/io_ti.ko 2023-07-27T19:36:45.056 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/ipaq.ko 2023-07-27T19:36:45.057 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/ipw.ko 2023-07-27T19:36:45.057 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/ir-usb.ko 2023-07-27T19:36:45.057 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-27T19:36:45.057 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/keyspan.ko 2023-07-27T19:36:45.057 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-27T19:36:45.057 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-27T19:36:45.057 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-27T19:36:45.058 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/mct_u232.ko 2023-07-27T19:36:45.058 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/mos7720.ko 2023-07-27T19:36:45.058 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/mos7840.ko 2023-07-27T19:36:45.058 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/navman.ko 2023-07-27T19:36:45.058 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/omninet.ko 2023-07-27T19:36:45.058 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/opticon.ko 2023-07-27T19:36:45.058 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/option.ko 2023-07-27T19:36:45.058 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/oti6858.ko 2023-07-27T19:36:45.059 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/pl2303.ko 2023-07-27T19:36:45.059 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/qcaux.ko 2023-07-27T19:36:45.059 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/qcserial.ko 2023-07-27T19:36:45.059 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/quatech2.ko 2023-07-27T19:36:45.059 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/safe_serial.ko 2023-07-27T19:36:45.059 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/sierra.ko 2023-07-27T19:36:45.059 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-27T19:36:45.060 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/ssu100.ko 2023-07-27T19:36:45.060 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/symbolserial.ko 2023-07-27T19:36:45.060 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-27T19:36:45.060 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-27T19:36:45.060 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/usb_debug.ko 2023-07-27T19:36:45.060 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-27T19:36:45.060 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/visor.ko 2023-07-27T19:36:45.060 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/whiteheat.ko 2023-07-27T19:36:45.061 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-27T19:36:45.061 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/storage 2023-07-27T19:36:45.061 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/storage/uas.ko 2023-07-27T19:36:45.061 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-27T19:36:45.061 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-27T19:36:45.061 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-27T19:36:45.061 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-27T19:36:45.061 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-27T19:36:45.062 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-27T19:36:45.062 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-27T19:36:45.062 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/storage/ums-karma.ko 2023-07-27T19:36:45.062 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-27T19:36:45.062 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-27T19:36:45.062 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-27T19:36:45.062 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-27T19:36:45.063 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-27T19:36:45.063 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/storage/usb-storage.ko 2023-07-27T19:36:45.063 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/usbip 2023-07-27T19:36:45.063 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-27T19:36:45.063 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-27T19:36:45.063 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-27T19:36:45.063 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/vfio 2023-07-27T19:36:45.063 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/vfio/pci 2023-07-27T19:36:45.064 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-27T19:36:45.064 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-27T19:36:45.064 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/vfio/vfio.ko 2023-07-27T19:36:45.064 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-27T19:36:45.064 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/vhost 2023-07-27T19:36:45.064 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/vhost/vhost.ko 2023-07-27T19:36:45.064 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-27T19:36:45.065 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/vhost/vhost_net.ko 2023-07-27T19:36:45.065 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/vhost/vhost_scsi.ko 2023-07-27T19:36:45.065 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/video 2023-07-27T19:36:45.065 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/video/backlight 2023-07-27T19:36:45.065 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/video/backlight/apple_bl.ko 2023-07-27T19:36:45.065 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/video/backlight/lcd.ko 2023-07-27T19:36:45.065 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-27T19:36:45.065 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/virtio 2023-07-27T19:36:45.066 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/virtio/virtio.ko 2023-07-27T19:36:45.066 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/virtio/virtio_balloon.ko 2023-07-27T19:36:45.066 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/virtio/virtio_mmio.ko 2023-07-27T19:36:45.066 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/virtio/virtio_pci.ko 2023-07-27T19:36:45.066 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-07-27T19:36:45.066 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-07-27T19:36:45.066 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/virtio/virtio_ring.ko 2023-07-27T19:36:45.066 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/w1 2023-07-27T19:36:45.067 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/w1/masters 2023-07-27T19:36:45.067 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/w1/masters/ds2482.ko 2023-07-27T19:36:45.067 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/w1/masters/ds2490.ko 2023-07-27T19:36:45.067 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/w1/slaves 2023-07-27T19:36:45.067 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-27T19:36:45.067 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-27T19:36:45.067 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-27T19:36:45.067 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-27T19:36:45.068 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-27T19:36:45.068 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-27T19:36:45.068 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-27T19:36:45.068 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-27T19:36:45.068 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-27T19:36:45.068 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-27T19:36:45.068 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-27T19:36:45.069 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/w1/wire.ko 2023-07-27T19:36:45.069 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog 2023-07-27T19:36:45.069 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-27T19:36:45.069 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-27T19:36:45.069 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-27T19:36:45.069 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/hpwdt.ko 2023-07-27T19:36:45.069 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/i6300esb.ko 2023-07-27T19:36:45.069 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-27T19:36:45.070 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-27T19:36:45.070 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/ib700wdt.ko 2023-07-27T19:36:45.070 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/ibmasr.ko 2023-07-27T19:36:45.070 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-27T19:36:45.070 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-27T19:36:45.070 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/it87_wdt.ko 2023-07-27T19:36:45.070 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/machzwd.ko 2023-07-27T19:36:45.070 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/nv_tco.ko 2023-07-27T19:36:45.071 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-27T19:36:45.071 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-27T19:36:45.071 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-27T19:36:45.071 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-27T19:36:45.071 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/softdog.ko 2023-07-27T19:36:45.071 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-27T19:36:45.071 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/via_wdt.ko 2023-07-27T19:36:45.071 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-27T19:36:45.072 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-27T19:36:45.072 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-27T19:36:45.072 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/wdt_pci.ko 2023-07-27T19:36:45.072 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/watchdog/xen_wdt.ko 2023-07-27T19:36:45.072 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/xen 2023-07-27T19:36:45.072 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/xen/xen-acpi-processor.ko 2023-07-27T19:36:45.072 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/xen/xen-evtchn.ko 2023-07-27T19:36:45.073 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/xen/xen-gntalloc.ko 2023-07-27T19:36:45.073 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/xen/xen-gntdev.ko 2023-07-27T19:36:45.073 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/xen/xen-pciback 2023-07-27T19:36:45.073 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-27T19:36:45.073 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/xen/xen-privcmd.ko 2023-07-27T19:36:45.073 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/xen/xenfs 2023-07-27T19:36:45.073 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-27T19:36:45.073 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs 2023-07-27T19:36:45.074 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/9p 2023-07-27T19:36:45.074 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/9p/9p.ko 2023-07-27T19:36:45.074 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/affs 2023-07-27T19:36:45.074 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/affs/affs.ko 2023-07-27T19:36:45.074 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/befs 2023-07-27T19:36:45.074 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/befs/befs.ko 2023-07-27T19:36:45.074 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/binfmt_misc.ko 2023-07-27T19:36:45.074 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/btrfs 2023-07-27T19:36:45.075 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/btrfs/btrfs.ko 2023-07-27T19:36:45.075 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/cachefiles 2023-07-27T19:36:45.075 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/cachefiles/cachefiles.ko 2023-07-27T19:36:45.075 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/ceph 2023-07-27T19:36:45.075 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/ceph/ceph.ko 2023-07-27T19:36:45.075 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/coda 2023-07-27T19:36:45.075 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/coda/coda.ko 2023-07-27T19:36:45.075 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/cramfs 2023-07-27T19:36:45.076 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/cramfs/cramfs.ko 2023-07-27T19:36:45.076 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/dlm 2023-07-27T19:36:45.076 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/dlm/dlm.ko 2023-07-27T19:36:45.076 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/ecryptfs 2023-07-27T19:36:45.076 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/ecryptfs/ecryptfs.ko 2023-07-27T19:36:45.076 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/f2fs 2023-07-27T19:36:45.076 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/f2fs/f2fs.ko 2023-07-27T19:36:45.077 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/fat 2023-07-27T19:36:45.077 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/fat/fat.ko 2023-07-27T19:36:45.077 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/fat/msdos.ko 2023-07-27T19:36:45.077 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/fat/vfat.ko 2023-07-27T19:36:45.077 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/fscache 2023-07-27T19:36:45.077 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/fscache/fscache.ko 2023-07-27T19:36:45.077 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/fuse 2023-07-27T19:36:45.077 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/fuse/cuse.ko 2023-07-27T19:36:45.078 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/fuse/fuse.ko 2023-07-27T19:36:45.078 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/gfs2 2023-07-27T19:36:45.078 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/gfs2/gfs2.ko 2023-07-27T19:36:45.078 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/hfs 2023-07-27T19:36:45.078 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/hfs/hfs.ko 2023-07-27T19:36:45.078 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/hfsplus 2023-07-27T19:36:45.078 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/hfsplus/hfsplus.ko 2023-07-27T19:36:45.078 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/isofs 2023-07-27T19:36:45.079 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/isofs/isofs.ko 2023-07-27T19:36:45.079 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/jfs 2023-07-27T19:36:45.079 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/jfs/jfs.ko 2023-07-27T19:36:45.079 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/lockd 2023-07-27T19:36:45.079 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/lockd/lockd.ko 2023-07-27T19:36:45.079 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/minix 2023-07-27T19:36:45.079 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/minix/minix.ko 2023-07-27T19:36:45.080 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/netfs 2023-07-27T19:36:45.080 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/netfs/netfs.ko 2023-07-27T19:36:45.080 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nfs 2023-07-27T19:36:45.080 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nfs/blocklayout 2023-07-27T19:36:45.080 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-27T19:36:45.080 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nfs/filelayout 2023-07-27T19:36:45.080 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-27T19:36:45.080 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nfs/flexfilelayout 2023-07-27T19:36:45.081 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-27T19:36:45.081 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nfs/nfs.ko 2023-07-27T19:36:45.081 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nfs/nfsv3.ko 2023-07-27T19:36:45.081 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nfs/nfsv4.ko 2023-07-27T19:36:45.081 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nfs_common 2023-07-27T19:36:45.081 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nfs_common/grace.ko 2023-07-27T19:36:45.081 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nfs_common/nfs_acl.ko 2023-07-27T19:36:45.081 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nfsd 2023-07-27T19:36:45.082 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nfsd/nfsd.ko 2023-07-27T19:36:45.082 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nilfs2 2023-07-27T19:36:45.082 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nilfs2/nilfs2.ko 2023-07-27T19:36:45.082 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls 2023-07-27T19:36:45.082 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/mac-celtic.ko 2023-07-27T19:36:45.082 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/mac-centeuro.ko 2023-07-27T19:36:45.082 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/mac-croatian.ko 2023-07-27T19:36:45.082 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/mac-cyrillic.ko 2023-07-27T19:36:45.083 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/mac-gaelic.ko 2023-07-27T19:36:45.083 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/mac-greek.ko 2023-07-27T19:36:45.083 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/mac-iceland.ko 2023-07-27T19:36:45.083 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/mac-inuit.ko 2023-07-27T19:36:45.083 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/mac-roman.ko 2023-07-27T19:36:45.083 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/mac-romanian.ko 2023-07-27T19:36:45.083 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/mac-turkish.ko 2023-07-27T19:36:45.084 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp1250.ko 2023-07-27T19:36:45.084 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp1251.ko 2023-07-27T19:36:45.084 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp1255.ko 2023-07-27T19:36:45.084 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp737.ko 2023-07-27T19:36:45.084 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp775.ko 2023-07-27T19:36:45.084 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp850.ko 2023-07-27T19:36:45.084 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp852.ko 2023-07-27T19:36:45.084 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp855.ko 2023-07-27T19:36:45.085 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp857.ko 2023-07-27T19:36:45.085 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp860.ko 2023-07-27T19:36:45.085 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp861.ko 2023-07-27T19:36:45.085 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp862.ko 2023-07-27T19:36:45.085 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp863.ko 2023-07-27T19:36:45.085 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp864.ko 2023-07-27T19:36:45.085 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp865.ko 2023-07-27T19:36:45.085 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp866.ko 2023-07-27T19:36:45.086 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp869.ko 2023-07-27T19:36:45.086 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp874.ko 2023-07-27T19:36:45.086 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp932.ko 2023-07-27T19:36:45.086 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp936.ko 2023-07-27T19:36:45.086 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp949.ko 2023-07-27T19:36:45.086 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_cp950.ko 2023-07-27T19:36:45.086 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_euc-jp.ko 2023-07-27T19:36:45.086 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_iso8859-1.ko 2023-07-27T19:36:45.087 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_iso8859-13.ko 2023-07-27T19:36:45.087 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_iso8859-14.ko 2023-07-27T19:36:45.087 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_iso8859-15.ko 2023-07-27T19:36:45.087 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_iso8859-2.ko 2023-07-27T19:36:45.087 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_iso8859-3.ko 2023-07-27T19:36:45.087 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_iso8859-4.ko 2023-07-27T19:36:45.087 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_iso8859-5.ko 2023-07-27T19:36:45.087 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_iso8859-6.ko 2023-07-27T19:36:45.088 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_iso8859-7.ko 2023-07-27T19:36:45.088 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_iso8859-9.ko 2023-07-27T19:36:45.088 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_koi8-r.ko 2023-07-27T19:36:45.088 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_koi8-ru.ko 2023-07-27T19:36:45.088 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_koi8-u.ko 2023-07-27T19:36:45.088 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/nls/nls_utf8.ko 2023-07-27T19:36:45.088 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/ocfs2 2023-07-27T19:36:45.089 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/ocfs2/cluster 2023-07-27T19:36:45.089 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-27T19:36:45.089 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/ocfs2/dlm 2023-07-27T19:36:45.089 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-27T19:36:45.089 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/ocfs2/dlmfs 2023-07-27T19:36:45.089 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-27T19:36:45.089 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/ocfs2/ocfs2.ko 2023-07-27T19:36:45.089 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-27T19:36:45.090 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-27T19:36:45.090 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-27T19:36:45.090 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/overlayfs 2023-07-27T19:36:45.090 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/overlayfs/overlay.ko 2023-07-27T19:36:45.090 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/pstore 2023-07-27T19:36:45.090 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/pstore/ramoops.ko 2023-07-27T19:36:45.090 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/reiserfs 2023-07-27T19:36:45.090 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/reiserfs/reiserfs.ko 2023-07-27T19:36:45.091 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/romfs 2023-07-27T19:36:45.091 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/romfs/romfs.ko 2023-07-27T19:36:45.091 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/smb 2023-07-27T19:36:45.091 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/smb/client 2023-07-27T19:36:45.091 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/smb/client/cifs.ko 2023-07-27T19:36:45.091 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/smb/common 2023-07-27T19:36:45.091 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/smb/common/cifs_arc4.ko 2023-07-27T19:36:45.092 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/smb/common/cifs_md4.ko 2023-07-27T19:36:45.092 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/squashfs 2023-07-27T19:36:45.092 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/squashfs/squashfs.ko 2023-07-27T19:36:45.092 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/sysv 2023-07-27T19:36:45.092 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/sysv/sysv.ko 2023-07-27T19:36:45.092 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/udf 2023-07-27T19:36:45.092 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/udf/udf.ko 2023-07-27T19:36:45.092 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/ufs 2023-07-27T19:36:45.093 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/ufs/ufs.ko 2023-07-27T19:36:45.093 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/xfs 2023-07-27T19:36:45.093 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/fs/xfs/xfs.ko 2023-07-27T19:36:45.093 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/kernel 2023-07-27T19:36:45.093 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/kernel/rcu 2023-07-27T19:36:45.093 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/kernel/rcu/rcutorture.ko 2023-07-27T19:36:45.093 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/kernel/torture.ko 2023-07-27T19:36:45.093 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/kernel/trace 2023-07-27T19:36:45.094 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-07-27T19:36:45.094 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib 2023-07-27T19:36:45.094 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/asn1_encoder.ko 2023-07-27T19:36:45.094 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/crc-itu-t.ko 2023-07-27T19:36:45.094 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/crc8.ko 2023-07-27T19:36:45.094 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/crypto 2023-07-27T19:36:45.094 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/crypto/libarc4.ko 2023-07-27T19:36:45.095 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/crypto/libdes.ko 2023-07-27T19:36:45.095 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/libcrc32c.ko 2023-07-27T19:36:45.095 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/lru_cache.ko 2023-07-27T19:36:45.095 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/lz4 2023-07-27T19:36:45.095 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/lz4/lz4_compress.ko 2023-07-27T19:36:45.095 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/lz4/lz4hc_compress.ko 2023-07-27T19:36:45.095 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/math 2023-07-27T19:36:45.095 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/math/cordic.ko 2023-07-27T19:36:45.096 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/raid6 2023-07-27T19:36:45.096 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/raid6/raid6_pq.ko 2023-07-27T19:36:45.096 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/reed_solomon 2023-07-27T19:36:45.096 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-27T19:36:45.096 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/ts_bm.ko 2023-07-27T19:36:45.096 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/ts_fsm.ko 2023-07-27T19:36:45.096 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/ts_kmp.ko 2023-07-27T19:36:45.096 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/zstd 2023-07-27T19:36:45.097 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/lib/zstd/zstd_compress.ko 2023-07-27T19:36:45.097 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/mm 2023-07-27T19:36:45.097 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/mm/hwpoison-inject.ko 2023-07-27T19:36:45.097 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net 2023-07-27T19:36:45.097 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/6lowpan 2023-07-27T19:36:45.097 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/6lowpan/6lowpan.ko 2023-07-27T19:36:45.097 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/6lowpan/nhc_dest.ko 2023-07-27T19:36:45.097 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/6lowpan/nhc_fragment.ko 2023-07-27T19:36:45.098 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/6lowpan/nhc_hop.ko 2023-07-27T19:36:45.098 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-27T19:36:45.098 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/6lowpan/nhc_mobility.ko 2023-07-27T19:36:45.098 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/6lowpan/nhc_routing.ko 2023-07-27T19:36:45.098 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/6lowpan/nhc_udp.ko 2023-07-27T19:36:45.098 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/802 2023-07-27T19:36:45.098 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/802/garp.ko 2023-07-27T19:36:45.099 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/802/mrp.ko 2023-07-27T19:36:45.099 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/802/p8022.ko 2023-07-27T19:36:45.099 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/802/psnap.ko 2023-07-27T19:36:45.099 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/802/stp.ko 2023-07-27T19:36:45.099 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/8021q 2023-07-27T19:36:45.099 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/8021q/8021q.ko 2023-07-27T19:36:45.099 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/9p 2023-07-27T19:36:45.099 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/9p/9pnet.ko 2023-07-27T19:36:45.100 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/9p/9pnet_fd.ko 2023-07-27T19:36:45.100 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/9p/9pnet_rdma.ko 2023-07-27T19:36:45.100 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/9p/9pnet_virtio.ko 2023-07-27T19:36:45.100 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/batman-adv 2023-07-27T19:36:45.100 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/batman-adv/batman-adv.ko 2023-07-27T19:36:45.100 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge 2023-07-27T19:36:45.100 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/br_netfilter.ko 2023-07-27T19:36:45.100 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/bridge.ko 2023-07-27T19:36:45.101 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter 2023-07-27T19:36:45.101 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-27T19:36:45.101 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-27T19:36:45.101 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-27T19:36:45.101 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-27T19:36:45.101 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-27T19:36:45.101 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-27T19:36:45.101 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-27T19:36:45.102 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-27T19:36:45.102 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-27T19:36:45.102 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-27T19:36:45.102 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-27T19:36:45.102 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-27T19:36:45.102 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-27T19:36:45.102 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-27T19:36:45.103 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-27T19:36:45.103 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-27T19:36:45.103 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-27T19:36:45.103 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-27T19:36:45.103 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-27T19:36:45.103 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-27T19:36:45.103 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/ebtables.ko 2023-07-27T19:36:45.103 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-07-27T19:36:45.104 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-27T19:36:45.104 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-27T19:36:45.104 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ceph 2023-07-27T19:36:45.104 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ceph/libceph.ko 2023-07-27T19:36:45.104 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/core 2023-07-27T19:36:45.104 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/core/failover.ko 2023-07-27T19:36:45.104 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/core/pktgen.ko 2023-07-27T19:36:45.104 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/dccp 2023-07-27T19:36:45.105 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/dccp/dccp.ko 2023-07-27T19:36:45.105 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/dccp/dccp_diag.ko 2023-07-27T19:36:45.105 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/dccp/dccp_ipv4.ko 2023-07-27T19:36:45.105 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/dccp/dccp_ipv6.ko 2023-07-27T19:36:45.105 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/dns_resolver 2023-07-27T19:36:45.105 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/dns_resolver/dns_resolver.ko 2023-07-27T19:36:45.105 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/dsa 2023-07-27T19:36:45.105 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/dsa/dsa_core.ko 2023-07-27T19:36:45.106 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/dsa/tag_brcm.ko 2023-07-27T19:36:45.106 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/dsa/tag_dsa.ko 2023-07-27T19:36:45.106 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/dsa/tag_none.ko 2023-07-27T19:36:45.106 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/dsa/tag_trailer.ko 2023-07-27T19:36:45.106 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ieee802154 2023-07-27T19:36:45.106 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ieee802154/6lowpan 2023-07-27T19:36:45.106 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-27T19:36:45.107 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ieee802154/ieee802154.ko 2023-07-27T19:36:45.107 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-27T19:36:45.107 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4 2023-07-27T19:36:45.107 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/ah4.ko 2023-07-27T19:36:45.107 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/esp4.ko 2023-07-27T19:36:45.107 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/fou.ko 2023-07-27T19:36:45.107 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/gre.ko 2023-07-27T19:36:45.107 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/inet_diag.ko 2023-07-27T19:36:45.108 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/ip_gre.ko 2023-07-27T19:36:45.108 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/ip_tunnel.ko 2023-07-27T19:36:45.108 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/ip_vti.ko 2023-07-27T19:36:45.108 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/ipcomp.ko 2023-07-27T19:36:45.108 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/ipip.ko 2023-07-27T19:36:45.108 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter 2023-07-27T19:36:45.108 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-27T19:36:45.108 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-27T19:36:45.109 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-27T19:36:45.109 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-27T19:36:45.109 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-27T19:36:45.109 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-27T19:36:45.109 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-27T19:36:45.109 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-27T19:36:45.109 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-27T19:36:45.109 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-27T19:36:45.110 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-27T19:36:45.110 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-27T19:36:45.110 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-27T19:36:45.110 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-27T19:36:45.110 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-27T19:36:45.110 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-27T19:36:45.110 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-27T19:36:45.111 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-27T19:36:45.111 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-27T19:36:45.111 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-27T19:36:45.111 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-27T19:36:45.111 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/tcp_bic.ko 2023-07-27T19:36:45.111 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/tcp_dctcp.ko 2023-07-27T19:36:45.111 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/tcp_diag.ko 2023-07-27T19:36:45.111 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/tcp_highspeed.ko 2023-07-27T19:36:45.112 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/tcp_htcp.ko 2023-07-27T19:36:45.112 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/tcp_hybla.ko 2023-07-27T19:36:45.112 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/tcp_illinois.ko 2023-07-27T19:36:45.112 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/tcp_lp.ko 2023-07-27T19:36:45.112 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/tcp_scalable.ko 2023-07-27T19:36:45.112 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/tcp_vegas.ko 2023-07-27T19:36:45.112 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/tcp_veno.ko 2023-07-27T19:36:45.112 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/tcp_westwood.ko 2023-07-27T19:36:45.113 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/tcp_yeah.ko 2023-07-27T19:36:45.113 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/tunnel4.ko 2023-07-27T19:36:45.113 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/udp_diag.ko 2023-07-27T19:36:45.113 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/udp_tunnel.ko 2023-07-27T19:36:45.113 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-27T19:36:45.113 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6 2023-07-27T19:36:45.113 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/ah6.ko 2023-07-27T19:36:45.114 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/esp6.ko 2023-07-27T19:36:45.114 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/fou6.ko 2023-07-27T19:36:45.114 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/ip6_tunnel.ko 2023-07-27T19:36:45.114 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-27T19:36:45.114 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/ip6_vti.ko 2023-07-27T19:36:45.114 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/ipcomp6.ko 2023-07-27T19:36:45.114 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter 2023-07-27T19:36:45.114 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-27T19:36:45.115 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-27T19:36:45.115 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-27T19:36:45.115 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-27T19:36:45.115 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-27T19:36:45.115 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-27T19:36:45.115 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-27T19:36:45.115 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-27T19:36:45.115 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-27T19:36:45.116 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-27T19:36:45.116 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-27T19:36:45.116 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-27T19:36:45.116 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-27T19:36:45.116 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-27T19:36:45.116 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-27T19:36:45.116 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-27T19:36:45.116 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-27T19:36:45.117 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-27T19:36:45.117 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-27T19:36:45.117 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-27T19:36:45.117 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-27T19:36:45.117 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-27T19:36:45.117 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-27T19:36:45.117 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-27T19:36:45.118 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/sit.ko 2023-07-27T19:36:45.118 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/tunnel6.ko 2023-07-27T19:36:45.118 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-27T19:36:45.118 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/key 2023-07-27T19:36:45.118 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/key/af_key.ko 2023-07-27T19:36:45.118 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/l2tp 2023-07-27T19:36:45.118 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/l2tp/l2tp_core.ko 2023-07-27T19:36:45.118 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-27T19:36:45.119 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/l2tp/l2tp_eth.ko 2023-07-27T19:36:45.119 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/l2tp/l2tp_ip.ko 2023-07-27T19:36:45.119 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/l2tp/l2tp_ip6.ko 2023-07-27T19:36:45.119 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/l2tp/l2tp_netlink.ko 2023-07-27T19:36:45.119 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/l2tp/l2tp_ppp.ko 2023-07-27T19:36:45.119 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/llc 2023-07-27T19:36:45.119 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/llc/llc.ko 2023-07-27T19:36:45.119 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/mac802154 2023-07-27T19:36:45.120 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/mac802154/mac802154.ko 2023-07-27T19:36:45.120 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/mpls 2023-07-27T19:36:45.120 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/mpls/mpls_gso.ko 2023-07-27T19:36:45.120 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter 2023-07-27T19:36:45.120 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipset 2023-07-27T19:36:45.120 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipset/ip_set.ko 2023-07-27T19:36:45.120 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-27T19:36:45.120 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-27T19:36:45.121 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-27T19:36:45.121 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-27T19:36:45.121 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-27T19:36:45.121 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-27T19:36:45.121 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-27T19:36:45.121 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-27T19:36:45.121 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-27T19:36:45.122 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-27T19:36:45.122 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-27T19:36:45.122 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-27T19:36:45.122 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-27T19:36:45.122 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-27T19:36:45.122 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-27T19:36:45.122 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipvs 2023-07-27T19:36:45.122 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-27T19:36:45.123 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-27T19:36:45.123 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-27T19:36:45.123 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-27T19:36:45.123 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-27T19:36:45.123 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-27T19:36:45.123 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-27T19:36:45.123 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-27T19:36:45.123 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-27T19:36:45.124 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-27T19:36:45.124 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-27T19:36:45.124 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-27T19:36:45.124 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-27T19:36:45.124 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-27T19:36:45.124 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_conncount.ko 2023-07-27T19:36:45.124 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_conntrack.ko 2023-07-27T19:36:45.125 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-27T19:36:45.125 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-27T19:36:45.125 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-27T19:36:45.125 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-27T19:36:45.125 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-27T19:36:45.125 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-27T19:36:45.125 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-27T19:36:45.125 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-27T19:36:45.126 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-27T19:36:45.126 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-27T19:36:45.126 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-27T19:36:45.126 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-27T19:36:45.126 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-27T19:36:45.126 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_flow_table.ko 2023-07-27T19:36:45.126 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-27T19:36:45.126 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_log_syslog.ko 2023-07-27T19:36:45.127 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_nat.ko 2023-07-27T19:36:45.127 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-27T19:36:45.127 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-27T19:36:45.127 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_nat_irc.ko 2023-07-27T19:36:45.127 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_nat_sip.ko 2023-07-27T19:36:45.127 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-27T19:36:45.127 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-27T19:36:45.127 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nf_tables.ko 2023-07-27T19:36:45.128 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nfnetlink.ko 2023-07-27T19:36:45.128 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-27T19:36:45.128 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nfnetlink_log.ko 2023-07-27T19:36:45.128 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-27T19:36:45.128 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-27T19:36:45.128 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nft_chain_nat.ko 2023-07-27T19:36:45.128 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nft_compat.ko 2023-07-27T19:36:45.129 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nft_ct.ko 2023-07-27T19:36:45.129 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-27T19:36:45.129 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nft_fib.ko 2023-07-27T19:36:45.129 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-27T19:36:45.129 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nft_hash.ko 2023-07-27T19:36:45.129 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nft_limit.ko 2023-07-27T19:36:45.129 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nft_log.ko 2023-07-27T19:36:45.129 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nft_masq.ko 2023-07-27T19:36:45.130 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nft_nat.ko 2023-07-27T19:36:45.130 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nft_numgen.ko 2023-07-27T19:36:45.130 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nft_queue.ko 2023-07-27T19:36:45.130 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nft_quota.ko 2023-07-27T19:36:45.130 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nft_redir.ko 2023-07-27T19:36:45.130 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nft_reject.ko 2023-07-27T19:36:45.130 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nft_reject_inet.ko 2023-07-27T19:36:45.130 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nft_socket.ko 2023-07-27T19:36:45.131 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/nft_tunnel.ko 2023-07-27T19:36:45.131 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_AUDIT.ko 2023-07-27T19:36:45.131 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-27T19:36:45.131 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-27T19:36:45.131 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-27T19:36:45.131 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_CT.ko 2023-07-27T19:36:45.131 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_DSCP.ko 2023-07-27T19:36:45.131 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_HL.ko 2023-07-27T19:36:45.132 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_HMARK.ko 2023-07-27T19:36:45.132 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-27T19:36:45.132 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_LED.ko 2023-07-27T19:36:45.132 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_LOG.ko 2023-07-27T19:36:45.132 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-27T19:36:45.132 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_NETMAP.ko 2023-07-27T19:36:45.132 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_NFLOG.ko 2023-07-27T19:36:45.133 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-27T19:36:45.133 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_RATEEST.ko 2023-07-27T19:36:45.133 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-27T19:36:45.133 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_SECMARK.ko 2023-07-27T19:36:45.133 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-27T19:36:45.133 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-27T19:36:45.133 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_TEE.ko 2023-07-27T19:36:45.133 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_TPROXY.ko 2023-07-27T19:36:45.134 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_TRACE.ko 2023-07-27T19:36:45.134 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_addrtype.ko 2023-07-27T19:36:45.134 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_bpf.ko 2023-07-27T19:36:45.134 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_cgroup.ko 2023-07-27T19:36:45.134 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_cluster.ko 2023-07-27T19:36:45.134 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_comment.ko 2023-07-27T19:36:45.134 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_connbytes.ko 2023-07-27T19:36:45.134 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_connlabel.ko 2023-07-27T19:36:45.135 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_connlimit.ko 2023-07-27T19:36:45.135 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_connmark.ko 2023-07-27T19:36:45.135 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_conntrack.ko 2023-07-27T19:36:45.135 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_cpu.ko 2023-07-27T19:36:45.135 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_dccp.ko 2023-07-27T19:36:45.135 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_devgroup.ko 2023-07-27T19:36:45.135 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_dscp.ko 2023-07-27T19:36:45.135 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_ecn.ko 2023-07-27T19:36:45.136 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_esp.ko 2023-07-27T19:36:45.136 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_hashlimit.ko 2023-07-27T19:36:45.136 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_helper.ko 2023-07-27T19:36:45.136 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_hl.ko 2023-07-27T19:36:45.136 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_ipcomp.ko 2023-07-27T19:36:45.136 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_iprange.ko 2023-07-27T19:36:45.136 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_ipvs.ko 2023-07-27T19:36:45.137 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_l2tp.ko 2023-07-27T19:36:45.137 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_length.ko 2023-07-27T19:36:45.137 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_limit.ko 2023-07-27T19:36:45.137 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_mac.ko 2023-07-27T19:36:45.137 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_mark.ko 2023-07-27T19:36:45.137 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_multiport.ko 2023-07-27T19:36:45.137 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_nat.ko 2023-07-27T19:36:45.137 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_nfacct.ko 2023-07-27T19:36:45.138 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_osf.ko 2023-07-27T19:36:45.138 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_owner.ko 2023-07-27T19:36:45.138 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_physdev.ko 2023-07-27T19:36:45.138 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_pkttype.ko 2023-07-27T19:36:45.138 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_policy.ko 2023-07-27T19:36:45.138 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_quota.ko 2023-07-27T19:36:45.138 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_rateest.ko 2023-07-27T19:36:45.138 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_realm.ko 2023-07-27T19:36:45.139 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_recent.ko 2023-07-27T19:36:45.139 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_sctp.ko 2023-07-27T19:36:45.139 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_set.ko 2023-07-27T19:36:45.139 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_socket.ko 2023-07-27T19:36:45.139 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_state.ko 2023-07-27T19:36:45.139 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_statistic.ko 2023-07-27T19:36:45.139 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_string.ko 2023-07-27T19:36:45.139 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_tcpmss.ko 2023-07-27T19:36:45.140 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_time.ko 2023-07-27T19:36:45.140 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netfilter/xt_u32.ko 2023-07-27T19:36:45.140 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netlink 2023-07-27T19:36:45.140 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/netlink/netlink_diag.ko 2023-07-27T19:36:45.140 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/nsh 2023-07-27T19:36:45.140 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/nsh/nsh.ko 2023-07-27T19:36:45.140 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/openvswitch 2023-07-27T19:36:45.141 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/openvswitch/openvswitch.ko 2023-07-27T19:36:45.141 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/openvswitch/vport-geneve.ko 2023-07-27T19:36:45.141 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/openvswitch/vport-gre.ko 2023-07-27T19:36:45.141 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/openvswitch/vport-vxlan.ko 2023-07-27T19:36:45.141 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/packet 2023-07-27T19:36:45.141 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/packet/af_packet_diag.ko 2023-07-27T19:36:45.141 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/rds 2023-07-27T19:36:45.141 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/rds/rds.ko 2023-07-27T19:36:45.142 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/rds/rds_rdma.ko 2023-07-27T19:36:45.142 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/rds/rds_tcp.ko 2023-07-27T19:36:45.142 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched 2023-07-27T19:36:45.142 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/act_csum.ko 2023-07-27T19:36:45.142 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/act_gact.ko 2023-07-27T19:36:45.142 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/act_ipt.ko 2023-07-27T19:36:45.142 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/act_mirred.ko 2023-07-27T19:36:45.142 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/act_nat.ko 2023-07-27T19:36:45.143 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/act_pedit.ko 2023-07-27T19:36:45.143 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/act_police.ko 2023-07-27T19:36:45.143 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/act_simple.ko 2023-07-27T19:36:45.143 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/act_skbedit.ko 2023-07-27T19:36:45.143 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/act_vlan.ko 2023-07-27T19:36:45.143 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/cls_basic.ko 2023-07-27T19:36:45.143 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/cls_bpf.ko 2023-07-27T19:36:45.143 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/cls_flow.ko 2023-07-27T19:36:45.144 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/cls_fw.ko 2023-07-27T19:36:45.144 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/cls_route.ko 2023-07-27T19:36:45.144 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/cls_u32.ko 2023-07-27T19:36:45.144 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/em_cmp.ko 2023-07-27T19:36:45.144 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/em_ipset.ko 2023-07-27T19:36:45.144 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/em_meta.ko 2023-07-27T19:36:45.144 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/em_nbyte.ko 2023-07-27T19:36:45.145 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/em_text.ko 2023-07-27T19:36:45.145 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/em_u32.ko 2023-07-27T19:36:45.145 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_choke.ko 2023-07-27T19:36:45.145 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_codel.ko 2023-07-27T19:36:45.145 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_drr.ko 2023-07-27T19:36:45.145 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_fq.ko 2023-07-27T19:36:45.145 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_gred.ko 2023-07-27T19:36:45.145 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_hfsc.ko 2023-07-27T19:36:45.146 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_hhf.ko 2023-07-27T19:36:45.146 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_htb.ko 2023-07-27T19:36:45.146 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_ingress.ko 2023-07-27T19:36:45.146 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_mqprio.ko 2023-07-27T19:36:45.146 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_mqprio_lib.ko 2023-07-27T19:36:45.146 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_multiq.ko 2023-07-27T19:36:45.146 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_netem.ko 2023-07-27T19:36:45.146 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_pie.ko 2023-07-27T19:36:45.147 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_plug.ko 2023-07-27T19:36:45.147 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_prio.ko 2023-07-27T19:36:45.147 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_qfq.ko 2023-07-27T19:36:45.147 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_red.ko 2023-07-27T19:36:45.147 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_sfb.ko 2023-07-27T19:36:45.147 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_sfq.ko 2023-07-27T19:36:45.147 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_tbf.ko 2023-07-27T19:36:45.148 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sched/sch_teql.ko 2023-07-27T19:36:45.148 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sctp 2023-07-27T19:36:45.148 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sctp/sctp.ko 2023-07-27T19:36:45.148 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sctp/sctp_diag.ko 2023-07-27T19:36:45.148 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sunrpc 2023-07-27T19:36:45.148 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sunrpc/auth_gss 2023-07-27T19:36:45.148 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-27T19:36:45.148 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-27T19:36:45.149 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sunrpc/sunrpc.ko 2023-07-27T19:36:45.149 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sunrpc/xprtrdma 2023-07-27T19:36:45.149 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-27T19:36:45.149 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/tipc 2023-07-27T19:36:45.149 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/tipc/diag.ko 2023-07-27T19:36:45.149 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/tipc/tipc.ko 2023-07-27T19:36:45.149 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/unix 2023-07-27T19:36:45.149 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/unix/unix_diag.ko 2023-07-27T19:36:45.150 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/vmw_vsock 2023-07-27T19:36:45.150 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-27T19:36:45.150 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-27T19:36:45.150 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/vmw_vsock/vsock.ko 2023-07-27T19:36:45.150 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-27T19:36:45.150 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-27T19:36:45.150 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/xfrm 2023-07-27T19:36:45.150 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-27T19:36:45.151 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/security 2023-07-27T19:36:45.151 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/security/keys 2023-07-27T19:36:45.151 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/security/keys/encrypted-keys 2023-07-27T19:36:45.151 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-07-27T19:36:45.151 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/security/keys/trusted-keys 2023-07-27T19:36:45.151 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/security/keys/trusted-keys/trusted.ko 2023-07-27T19:36:45.151 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/virt 2023-07-27T19:36:45.152 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/virt/lib 2023-07-27T19:36:45.152 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/kernel/virt/lib/irqbypass.ko 2023-07-27T19:36:45.152 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/modules.alias 2023-07-27T19:36:45.152 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/modules.alias.bin 2023-07-27T19:36:45.152 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/modules.builtin 2023-07-27T19:36:45.152 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/modules.builtin.bin 2023-07-27T19:36:45.152 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/modules.builtin.modinfo 2023-07-27T19:36:45.152 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/modules.dep 2023-07-27T19:36:45.153 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/modules.dep.bin 2023-07-27T19:36:45.153 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/modules.devname 2023-07-27T19:36:45.153 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/modules.order 2023-07-27T19:36:45.153 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/modules.softdep 2023-07-27T19:36:45.153 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/modules.symbols 2023-07-27T19:36:45.153 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.5.0-rc1-gbbae19e0824b/modules.symbols.bin 2023-07-27T19:36:45.154 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc1-gbbae19e0824b 2023-07-27T19:36:45.154 DEBUG:teuthology.orchestra.run.smithi173:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-07-27T19:36:45.155 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-07-27T19:36:45.155 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-07-27T19:36:45.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T19:36:45.182 INFO:teuthology.orchestra.run.smithi173.stdout:postinstall scriptlet (using /bin/sh): 2023-07-27T19:36:45.183 INFO:teuthology.orchestra.run.smithi173.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc1-gbbae19e0824b -a -r /boot/System.map-6.5.0-rc1-gbbae19e0824b ]; then 2023-07-27T19:36:45.183 INFO:teuthology.orchestra.run.smithi173.stdout:cp /boot/vmlinuz-6.5.0-rc1-gbbae19e0824b /boot/.vmlinuz-6.5.0-rc1-gbbae19e0824b-rpm 2023-07-27T19:36:45.183 INFO:teuthology.orchestra.run.smithi173.stdout:cp /boot/System.map-6.5.0-rc1-gbbae19e0824b /boot/.System.map-6.5.0-rc1-gbbae19e0824b-rpm 2023-07-27T19:36:45.183 INFO:teuthology.orchestra.run.smithi173.stdout:rm -f /boot/vmlinuz-6.5.0-rc1-gbbae19e0824b /boot/System.map-6.5.0-rc1-gbbae19e0824b 2023-07-27T19:36:45.183 INFO:teuthology.orchestra.run.smithi173.stdout:/sbin/installkernel 6.5.0-rc1-gbbae19e0824b /boot/.vmlinuz-6.5.0-rc1-gbbae19e0824b-rpm /boot/.System.map-6.5.0-rc1-gbbae19e0824b-rpm 2023-07-27T19:36:45.183 INFO:teuthology.orchestra.run.smithi173.stdout:rm -f /boot/.vmlinuz-6.5.0-rc1-gbbae19e0824b-rpm /boot/.System.map-6.5.0-rc1-gbbae19e0824b-rpm 2023-07-27T19:36:45.183 INFO:teuthology.orchestra.run.smithi173.stdout:fi 2023-07-27T19:36:45.184 INFO:teuthology.orchestra.run.smithi173.stdout:preuninstall scriptlet (using /bin/sh): 2023-07-27T19:36:45.184 INFO:teuthology.orchestra.run.smithi173.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-07-27T19:36:45.184 INFO:teuthology.orchestra.run.smithi173.stdout:new-kernel-pkg --remove 6.5.0-rc1-gbbae19e0824b --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc1-gbbae19e0824b.img 2023-07-27T19:36:45.184 INFO:teuthology.orchestra.run.smithi173.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-07-27T19:36:45.184 INFO:teuthology.orchestra.run.smithi173.stdout:kernel-install remove 6.5.0-rc1-gbbae19e0824b 2023-07-27T19:36:45.184 INFO:teuthology.orchestra.run.smithi173.stdout:fi 2023-07-27T19:36:45.184 INFO:teuthology.orchestra.run.smithi173.stdout:postuninstall scriptlet (using /bin/sh): 2023-07-27T19:36:45.185 INFO:teuthology.orchestra.run.smithi173.stdout:if [ -x /sbin/update-bootloader ]; then 2023-07-27T19:36:45.185 INFO:teuthology.orchestra.run.smithi173.stdout:/sbin/update-bootloader --remove 6.5.0-rc1-gbbae19e0824b 2023-07-27T19:36:45.185 INFO:teuthology.orchestra.run.smithi173.stdout:fi 2023-07-27T19:36:45.186 DEBUG:teuthology.orchestra.run.smithi173:> sudo rpm -qi grub2-tools 2023-07-27T19:36:45.262 INFO:teuthology.orchestra.run.smithi173.stdout:Name : grub2-tools 2023-07-27T19:36:45.262 INFO:teuthology.orchestra.run.smithi173.stdout:Epoch : 1 2023-07-27T19:36:45.263 INFO:teuthology.orchestra.run.smithi173.stdout:Version : 2.02 2023-07-27T19:36:45.263 INFO:teuthology.orchestra.run.smithi173.stdout:Release : 129.el8 2023-07-27T19:36:45.263 INFO:teuthology.orchestra.run.smithi173.stdout:Architecture: x86_64 2023-07-27T19:36:45.263 INFO:teuthology.orchestra.run.smithi173.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-07-27T19:36:45.263 INFO:teuthology.orchestra.run.smithi173.stdout:Group : System Environment/Base 2023-07-27T19:36:45.263 INFO:teuthology.orchestra.run.smithi173.stdout:Size : 9265586 2023-07-27T19:36:45.263 INFO:teuthology.orchestra.run.smithi173.stdout:License : GPLv3+ 2023-07-27T19:36:45.263 INFO:teuthology.orchestra.run.smithi173.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-07-27T19:36:45.264 INFO:teuthology.orchestra.run.smithi173.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-07-27T19:36:45.264 INFO:teuthology.orchestra.run.smithi173.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-07-27T19:36:45.264 INFO:teuthology.orchestra.run.smithi173.stdout:Build Host : kbuilder.bsys.centos.org 2023-07-27T19:36:45.264 INFO:teuthology.orchestra.run.smithi173.stdout:Relocations : (not relocatable) 2023-07-27T19:36:45.264 INFO:teuthology.orchestra.run.smithi173.stdout:Packager : CentOS BuildSystem 2023-07-27T19:36:45.264 INFO:teuthology.orchestra.run.smithi173.stdout:Vendor : CentOS 2023-07-27T19:36:45.264 INFO:teuthology.orchestra.run.smithi173.stdout:URL : http://www.gnu.org/software/grub/ 2023-07-27T19:36:45.265 INFO:teuthology.orchestra.run.smithi173.stdout:Summary : Support tools for GRUB. 2023-07-27T19:36:45.265 INFO:teuthology.orchestra.run.smithi173.stdout:Description : 2023-07-27T19:36:45.265 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T19:36:45.265 INFO:teuthology.orchestra.run.smithi173.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-07-27T19:36:45.265 INFO:teuthology.orchestra.run.smithi173.stdout:customizable bootloader with modular architecture. It supports a rich 2023-07-27T19:36:45.265 INFO:teuthology.orchestra.run.smithi173.stdout:variety of kernel formats, file systems, computer architectures and 2023-07-27T19:36:45.265 INFO:teuthology.orchestra.run.smithi173.stdout:hardware devices. 2023-07-27T19:36:45.265 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T19:36:45.266 INFO:teuthology.orchestra.run.smithi173.stdout:This subpackage provides tools for support of all platforms. 2023-07-27T19:36:45.266 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-07-27T19:36:45.267 INFO:teuthology.task.kernel:Updating grub on smithi173 to boot 6.5.0-rc1-gbbae19e0824b 2023-07-27T19:36:45.267 DEBUG:teuthology.orchestra.run.smithi173:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-07-27T19:36:49.516 INFO:teuthology.orchestra.run.smithi173.stderr:Generating grub configuration file ... 2023-07-27T19:36:51.805 INFO:teuthology.orchestra.run.smithi173.stderr:done 2023-07-27T19:36:51.808 DEBUG:teuthology.orchestra.run.smithi173:> mktemp 2023-07-27T19:36:51.838 INFO:teuthology.orchestra.run.smithi173.stdout:/tmp/tmp.ooz0LULS6F 2023-07-27T19:36:51.838 DEBUG:teuthology.orchestra.run.smithi173:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ooz0LULS6F 2023-07-27T19:36:51.912 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 0666 /tmp/tmp.ooz0LULS6F 2023-07-27T19:36:52.083 DEBUG:teuthology.orchestra.remote:smithi173:/tmp/tmp.ooz0LULS6F is 6KB 2023-07-27T19:36:52.130 DEBUG:teuthology.orchestra.run.smithi173:> rm -fr /tmp/tmp.ooz0LULS6F 2023-07-27T19:36:52.148 DEBUG:teuthology.orchestra.run.smithi173:> sudo /bin/ls /boot/loader/entries || true 2023-07-27T19:36:52.213 INFO:teuthology.orchestra.run.smithi173.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-07-27T19:36:52.214 INFO:teuthology.orchestra.run.smithi173.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-07-27T19:36:52.214 INFO:teuthology.orchestra.run.smithi173.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-07-27T19:36:52.214 INFO:teuthology.orchestra.run.smithi173.stdout:a1b29d6c289747bdb22930598d39874a-6.5.0-rc1-gbbae19e0824b.conf 2023-07-27T19:36:52.216 DEBUG:teuthology.orchestra.run.smithi173:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.5.0-rc1-gbbae19e0824b 2023-07-27T19:36:52.389 DEBUG:teuthology.orchestra.run.smithi173:> sudo shutdown -r now 2023-07-27T19:37:03.600 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-07-27T19:37:12.608 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-07-27T19:37:12.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T19:37:15.664 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-07-27T19:37:22.396 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-07-27T19:37:22.396 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-07-27T19:37:22.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T19:37:27.696 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-07-27T19:37:27.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T19:37:40.720 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-07-27T19:37:49.729 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-07-27T19:37:49.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T19:37:52.788 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-07-27T19:38:04.800 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-07-27T19:38:04.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T19:38:23.216 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-07-27T19:38:27.700 DEBUG:teuthology.orchestra.remote:timed out 2023-07-27T19:38:38.227 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-07-27T19:38:38.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T19:38:38.533 DEBUG:teuthology.orchestra.run.smithi173:> true 2023-07-27T19:38:38.932 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-07-27T19:38:38.932 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.5.0-rc1-gbbae19e0824b"... 2023-07-27T19:38:38.932 DEBUG:teuthology.orchestra.run.smithi173:> uname -r 2023-07-27T19:38:38.977 INFO:teuthology.orchestra.run.smithi173.stdout:6.5.0-rc1-gbbae19e0824b 2023-07-27T19:38:38.978 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc1-gbbae19e0824b vs 6.5.0-rc1-gbbae19e0824b 2023-07-27T19:38:38.978 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-27T19:38:38.978 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-07-27T19:38:39.979 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-07-27T19:38:39.980 DEBUG:teuthology.orchestra.run.smithi173:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-07-27T19:38:40.110 INFO:teuthology.orchestra.run.smithi173.stdout:ttyS1 2023-07-27T19:38:40.134 DEBUG:teuthology.parallel:result is None 2023-07-27T19:38:42.702 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-07-27T19:38:42.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T19:38:43.088 DEBUG:teuthology.orchestra.run.smithi072:> true 2023-07-27T19:38:43.627 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-07-27T19:38:43.627 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.5.0-rc1-gbbae19e0824b"... 2023-07-27T19:38:43.627 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2023-07-27T19:38:43.673 INFO:teuthology.orchestra.run.smithi072.stdout:6.5.0-rc1-gbbae19e0824b 2023-07-27T19:38:43.673 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc1-gbbae19e0824b vs 6.5.0-rc1-gbbae19e0824b 2023-07-27T19:38:43.674 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-27T19:38:43.674 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-07-27T19:38:44.675 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-07-27T19:38:44.675 DEBUG:teuthology.orchestra.run.smithi072:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-07-27T19:38:44.826 INFO:teuthology.orchestra.run.smithi072.stdout:ttyS1 2023-07-27T19:38:44.858 DEBUG:teuthology.parallel:result is None 2023-07-27T19:38:44.858 INFO:teuthology.run_tasks:Running task internal.base... 2023-07-27T19:38:44.866 INFO:teuthology.task.internal:Creating test directory... 2023-07-27T19:38:44.866 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-27T19:38:44.871 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-27T19:38:44.922 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-07-27T19:38:44.933 INFO:teuthology.run_tasks:Running task internal.archive... 2023-07-27T19:38:44.940 INFO:teuthology.task.internal:Creating archive directory... 2023-07-27T19:38:44.940 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-27T19:38:44.945 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-27T19:38:45.015 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-07-27T19:38:45.021 INFO:teuthology.task.internal:Enabling coredump saving... 2023-07-27T19:38:45.022 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-27T19:38:45.027 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-27T19:38:45.104 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-27T19:38:45.130 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-27T19:38:45.164 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-27T19:38:45.190 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-27T19:38:45.193 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-07-27T19:38:45.200 INFO:teuthology.task.internal:Configuring sudo... 2023-07-27T19:38:45.201 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-27T19:38:45.205 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-27T19:38:45.275 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-07-27T19:38:45.284 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-07-27T19:38:45.285 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-27T19:38:45.289 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-27T19:38:45.334 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-27T19:38:45.447 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-27T19:38:45.517 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-27T19:38:45.597 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-27T19:38:45.665 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-27T19:38:45.666 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-27T19:38:45.735 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-27T19:38:45.816 DEBUG:teuthology.orchestra.run.smithi173:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-27T19:38:45.889 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-27T19:38:45.969 DEBUG:teuthology.orchestra.run.smithi173:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-27T19:38:46.037 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-07-27T19:38:46.038 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-27T19:38:46.108 DEBUG:teuthology.orchestra.run.smithi072:> sudo service rsyslog restart 2023-07-27T19:38:46.112 DEBUG:teuthology.orchestra.run.smithi173:> sudo service rsyslog restart 2023-07-27T19:38:46.225 INFO:teuthology.orchestra.run.smithi072.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-27T19:38:46.270 INFO:teuthology.orchestra.run.smithi173.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-27T19:38:46.637 INFO:teuthology.run_tasks:Running task internal.timer... 2023-07-27T19:38:46.645 INFO:teuthology.task.internal:Starting timer... 2023-07-27T19:38:46.645 INFO:teuthology.run_tasks:Running task pcp... 2023-07-27T19:38:46.659 INFO:teuthology.run_tasks:Running task selinux... 2023-07-27T19:38:46.675 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-07-27T19:38:46.676 DEBUG:teuthology.orchestra.run.smithi072:> sudo service auditd rotate 2023-07-27T19:38:46.825 INFO:teuthology.orchestra.run.smithi072.stdout:Rotating logs: 2023-07-27T19:38:46.828 DEBUG:teuthology.orchestra.run.smithi173:> sudo service auditd rotate 2023-07-27T19:38:46.966 INFO:teuthology.orchestra.run.smithi173.stdout:Rotating logs: 2023-07-27T19:38:46.969 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-07-27T19:38:46.969 DEBUG:teuthology.orchestra.run.smithi072:> /usr/sbin/getenforce 2023-07-27T19:38:47.023 INFO:teuthology.orchestra.run.smithi072.stdout:Permissive 2023-07-27T19:38:47.023 DEBUG:teuthology.orchestra.run.smithi173:> /usr/sbin/getenforce 2023-07-27T19:38:47.076 INFO:teuthology.orchestra.run.smithi173.stdout:Permissive 2023-07-27T19:38:47.077 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi072.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi173.front.sepia.ceph.com': 'permissive'} 2023-07-27T19:38:47.078 DEBUG:teuthology.orchestra.run.smithi072:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-27T19:38:47.149 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-27T19:38:47.150 DEBUG:teuthology.orchestra.run.smithi173:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-27T19:38:47.219 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-27T19:38:47.220 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-07-27T19:38:47.221 DEBUG:teuthology.orchestra.run.smithi072:> sudo /usr/sbin/setenforce permissive 2023-07-27T19:38:47.295 DEBUG:teuthology.orchestra.run.smithi173:> sudo /usr/sbin/setenforce permissive 2023-07-27T19:38:47.367 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-07-27T19:38:47.382 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-07-27T19:38:47.383 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-07-27T19:38:47.406 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-07-27T19:38:47.407 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi072.front.sepia.ceph.com,smithi173.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-07-27T20:02:05.269 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi072.front.sepia.ceph.com'), Remote(name='ubuntu@smithi173.front.sepia.ceph.com')] 2023-07-27T20:02:05.271 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-07-27T20:02:05.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T20:02:05.359 DEBUG:teuthology.orchestra.run.smithi072:> true 2023-07-27T20:02:05.481 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-07-27T20:02:05.481 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-07-27T20:02:05.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T20:02:05.564 DEBUG:teuthology.orchestra.run.smithi173:> true 2023-07-27T20:02:05.678 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-07-27T20:02:05.679 INFO:teuthology.run_tasks:Running task clock... 2023-07-27T20:02:05.690 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-07-27T20:02:05.691 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-27T20:02:05.691 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-27T20:02:05.696 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-27T20:02:05.696 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-27T20:02:05.766 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-27T20:02:05.793 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-27T20:02:05.800 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-27T20:02:05.825 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-27T20:02:05.889 INFO:teuthology.orchestra.run.smithi072.stderr:sudo: ntpd: command not found 2023-07-27T20:02:05.912 INFO:teuthology.orchestra.run.smithi173.stderr:sudo: ntpd: command not found 2023-07-27T20:02:05.917 INFO:teuthology.orchestra.run.smithi072.stdout:506 Cannot talk to daemon 2023-07-27T20:02:05.939 INFO:teuthology.orchestra.run.smithi173.stdout:506 Cannot talk to daemon 2023-07-27T20:02:05.950 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-27T20:02:05.973 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-27T20:02:05.983 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-27T20:02:06.005 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-27T20:02:06.072 INFO:teuthology.orchestra.run.smithi072.stderr:bash: ntpq: command not found 2023-07-27T20:02:06.079 INFO:teuthology.orchestra.run.smithi072.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-27T20:02:06.079 INFO:teuthology.orchestra.run.smithi072.stdout:=============================================================================== 2023-07-27T20:02:06.079 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-27T20:02:06.080 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-27T20:02:06.080 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-27T20:02:06.080 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-27T20:02:06.094 INFO:teuthology.orchestra.run.smithi173.stderr:bash: ntpq: command not found 2023-07-27T20:02:06.101 INFO:teuthology.orchestra.run.smithi173.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-27T20:02:06.102 INFO:teuthology.orchestra.run.smithi173.stdout:=============================================================================== 2023-07-27T20:02:06.102 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-27T20:02:06.102 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-27T20:02:06.102 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-27T20:02:06.102 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-27T20:02:06.103 INFO:teuthology.run_tasks:Running task install... 2023-07-27T20:02:06.117 DEBUG:teuthology.task.install:project ceph 2023-07-27T20:02:06.117 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a5d48e8c688c2543997a98b8acbae2ce9635578c'}} 2023-07-27T20:02:06.117 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a5d48e8c688c2543997a98b8acbae2ce9635578c'} 2023-07-27T20:02:06.118 INFO:teuthology.task.install:Using flavor: default 2023-07-27T20:02:06.123 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-07-27T20:02:06.124 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-07-27T20:02:06.124 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a5d48e8c688c2543997a98b8acbae2ce9635578c', 'tag': None, 'wait_for_package': False} 2023-07-27T20:02:06.125 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a5d48e8c688c2543997a98b8acbae2ce9635578c 2023-07-27T20:02:06.127 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a5d48e8c688c2543997a98b8acbae2ce9635578c', 'tag': None, 'wait_for_package': False} 2023-07-27T20:02:06.127 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a5d48e8c688c2543997a98b8acbae2ce9635578c 2023-07-27T20:02:06.347 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230725.043804/a5d48e8c688c2543997a98b8acbae2ce9635578c/centos/8/flavors/default/ 2023-07-27T20:02:06.348 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5128.ga5d48e8c 2023-07-27T20:02:06.361 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230725.043804/a5d48e8c688c2543997a98b8acbae2ce9635578c/centos/8/flavors/default/ 2023-07-27T20:02:06.361 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5128.ga5d48e8c 2023-07-27T20:02:06.536 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230725.043804/a5d48e8c688c2543997a98b8acbae2ce9635578c/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230725.043804/a5d48e8c688c2543997a98b8acbae2ce9635578c/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230725.043804/a5d48e8c688c2543997a98b8acbae2ce9635578c/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-27T20:02:06.536 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-07-27T20:02:06.537 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-27T20:02:06.548 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230725.043804/a5d48e8c688c2543997a98b8acbae2ce9635578c/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230725.043804/a5d48e8c688c2543997a98b8acbae2ce9635578c/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230725.043804/a5d48e8c688c2543997a98b8acbae2ce9635578c/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-27T20:02:06.549 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-27T20:02:06.549 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-27T20:02:06.606 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-27T20:02:06.606 DEBUG:teuthology.orchestra.run.smithi173:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a5d48e8c688c2543997a98b8acbae2ce9635578c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-27T20:02:06.620 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-27T20:02:06.621 DEBUG:teuthology.orchestra.run.smithi072:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a5d48e8c688c2543997a98b8acbae2ce9635578c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-27T20:02:06.716 DEBUG:teuthology.orchestra.run.smithi173:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-27T20:02:06.730 DEBUG:teuthology.orchestra.run.smithi072:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-27T20:02:06.812 DEBUG:teuthology.orchestra.run.smithi173:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-27T20:02:06.825 DEBUG:teuthology.orchestra.run.smithi072:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-27T20:02:06.881 INFO:teuthology.orchestra.run.smithi173.stdout:check_obsoletes = 1 2023-07-27T20:02:06.884 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum clean all 2023-07-27T20:02:06.894 INFO:teuthology.orchestra.run.smithi072.stdout:check_obsoletes = 1 2023-07-27T20:02:06.897 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum clean all 2023-07-27T20:02:07.225 INFO:teuthology.orchestra.run.smithi173.stdout:73 files removed 2023-07-27T20:02:07.236 INFO:teuthology.orchestra.run.smithi072.stdout:73 files removed 2023-07-27T20:02:07.260 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-27T20:02:07.271 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-27T20:02:08.236 INFO:teuthology.orchestra.run.smithi072.stdout:ceph packages for x86_64 188 kB/s | 81 kB 00:00 2023-07-27T20:02:08.250 INFO:teuthology.orchestra.run.smithi173.stdout:ceph packages for x86_64 179 kB/s | 81 kB 00:00 2023-07-27T20:02:08.654 INFO:teuthology.orchestra.run.smithi072.stdout:ceph noarch packages 25 kB/s | 9.4 kB 00:00 2023-07-27T20:02:08.869 INFO:teuthology.orchestra.run.smithi173.stdout:ceph noarch packages 16 kB/s | 9.4 kB 00:00 2023-07-27T20:02:09.105 INFO:teuthology.orchestra.run.smithi072.stdout:ceph source packages 3.5 kB/s | 1.5 kB 00:00 2023-07-27T20:02:09.285 INFO:teuthology.orchestra.run.smithi173.stdout:ceph source packages 4.0 kB/s | 1.5 kB 00:00 2023-07-27T20:10:56.867 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 8 - AppStream 60 kB/s | 31 MB 08:47 2023-07-27T20:11:40.224 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 8 - BaseOS 1.1 MB/s | 41 MB 00:37 2023-07-27T20:11:47.304 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 8 - Extras 24 kB/s | 18 kB 00:00 2023-07-27T20:11:48.088 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 8 - Extras common packages 11 kB/s | 6.6 kB 00:00 2023-07-27T20:12:12.745 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 8 - PowerTools 262 kB/s | 6.3 MB 00:24 2023-07-27T20:12:14.896 INFO:teuthology.orchestra.run.smithi173.stdout:Copr repo for python3-asyncssh owned by ceph 4.2 kB/s | 3.5 kB 00:00 2023-07-27T20:12:45.591 INFO:teuthology.orchestra.run.smithi173.stdout:Extra Packages for Enterprise Linux 523 kB/s | 16 MB 00:30 2023-07-27T20:12:49.960 INFO:teuthology.orchestra.run.smithi173.stdout:lab-extras 228 kB/s | 24 kB 00:00 2023-07-27T20:12:53.930 INFO:teuthology.orchestra.run.smithi173.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-27T20:12:53.931 INFO:teuthology.orchestra.run.smithi173.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-27T20:12:53.943 INFO:teuthology.orchestra.run.smithi173.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-07-27T20:12:53.943 INFO:teuthology.orchestra.run.smithi173.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-07-27T20:12:53.944 INFO:teuthology.orchestra.run.smithi173.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-07-27T20:12:53.945 INFO:teuthology.orchestra.run.smithi173.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-07-27T20:12:53.946 INFO:teuthology.orchestra.run.smithi173.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-27T20:12:53.948 INFO:teuthology.orchestra.run.smithi173.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-27T20:12:53.951 INFO:teuthology.orchestra.run.smithi173.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-27T20:12:53.952 INFO:teuthology.orchestra.run.smithi173.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-27T20:12:54.140 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2023-07-27T20:12:54.154 INFO:teuthology.orchestra.run.smithi173.stdout:==================================================================================================== 2023-07-27T20:12:54.155 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2023-07-27T20:12:54.155 INFO:teuthology.orchestra.run.smithi173.stdout:==================================================================================================== 2023-07-27T20:12:54.155 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2023-07-27T20:12:54.155 INFO:teuthology.orchestra.run.smithi173.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-07-27T20:12:54.155 INFO:teuthology.orchestra.run.smithi173.stdout: ceph x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 6.4 k 2023-07-27T20:12:54.155 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-base x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 5.4 M 2023-07-27T20:12:54.156 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-fuse x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 859 k 2023-07-27T20:12:54.156 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 167 k 2023-07-27T20:12:54.156 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 1.6 M 2023-07-27T20:12:54.156 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 129 k 2023-07-27T20:12:54.156 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 1.7 M 2023-07-27T20:12:54.156 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 7.4 M 2023-07-27T20:12:54.156 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-rook noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 47 k 2023-07-27T20:12:54.157 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-radosgw x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 14 M 2023-07-27T20:12:54.157 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-test x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 48 M 2023-07-27T20:12:54.157 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-volume noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 258 k 2023-07-27T20:12:54.157 INFO:teuthology.orchestra.run.smithi173.stdout: cephadm noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 165 k 2023-07-27T20:12:54.157 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-mirror x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 260 k 2023-07-27T20:12:54.157 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-top noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 18 k 2023-07-27T20:12:54.157 INFO:teuthology.orchestra.run.smithi173.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-07-27T20:12:54.158 INFO:teuthology.orchestra.run.smithi173.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-07-27T20:12:54.158 INFO:teuthology.orchestra.run.smithi173.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-07-27T20:12:54.158 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs-devel x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 31 k 2023-07-27T20:12:54.158 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs2 x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 783 k 2023-07-27T20:12:54.158 INFO:teuthology.orchestra.run.smithi173.stdout: librados-devel x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 139 k 2023-07-27T20:12:54.158 INFO:teuthology.orchestra.run.smithi173.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-07-27T20:12:54.158 INFO:teuthology.orchestra.run.smithi173.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-07-27T20:12:54.158 INFO:teuthology.orchestra.run.smithi173.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-07-27T20:12:54.159 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-07-27T20:12:54.159 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-07-27T20:12:54.159 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-07-27T20:12:54.159 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cephfs x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 197 k 2023-07-27T20:12:54.159 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rados x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 371 k 2023-07-27T20:12:54.159 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rbd x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 364 k 2023-07-27T20:12:54.159 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rgw x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 107 k 2023-07-27T20:12:54.160 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-fuse x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 94 k 2023-07-27T20:12:54.160 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-mirror x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 3.5 M 2023-07-27T20:12:54.160 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-nbd x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 179 k 2023-07-27T20:12:54.160 INFO:teuthology.orchestra.run.smithi173.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-07-27T20:12:54.160 INFO:teuthology.orchestra.run.smithi173.stdout:Upgrading: 2023-07-27T20:12:54.160 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-8.el8 baseos 143 k 2023-07-27T20:12:54.160 INFO:teuthology.orchestra.run.smithi173.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-07-27T20:12:54.161 INFO:teuthology.orchestra.run.smithi173.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-07-27T20:12:54.161 INFO:teuthology.orchestra.run.smithi173.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-07-27T20:12:54.161 INFO:teuthology.orchestra.run.smithi173.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-07-27T20:12:54.161 INFO:teuthology.orchestra.run.smithi173.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-07-27T20:12:54.161 INFO:teuthology.orchestra.run.smithi173.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-07-27T20:12:54.161 INFO:teuthology.orchestra.run.smithi173.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-07-27T20:12:54.161 INFO:teuthology.orchestra.run.smithi173.stdout: librados2 x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 3.7 M 2023-07-27T20:12:54.162 INFO:teuthology.orchestra.run.smithi173.stdout: librbd1 x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 3.6 M 2023-07-27T20:12:54.162 INFO:teuthology.orchestra.run.smithi173.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-07-27T20:12:54.162 INFO:teuthology.orchestra.run.smithi173.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-07-27T20:12:54.162 INFO:teuthology.orchestra.run.smithi173.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-07-27T20:12:54.162 INFO:teuthology.orchestra.run.smithi173.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-07-27T20:12:54.162 INFO:teuthology.orchestra.run.smithi173.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-07-27T20:12:54.162 INFO:teuthology.orchestra.run.smithi173.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-07-27T20:12:54.163 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2023-07-27T20:12:54.163 INFO:teuthology.orchestra.run.smithi173.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-07-27T20:12:54.163 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-common x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 22 M 2023-07-27T20:12:54.163 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 23 k 2023-07-27T20:12:54.163 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mds x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 2.3 M 2023-07-27T20:12:54.163 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 241 k 2023-07-27T20:12:54.163 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mon x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 4.6 M 2023-07-27T20:12:54.163 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-osd x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 18 M 2023-07-27T20:12:54.164 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 14 k 2023-07-27T20:12:54.164 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-selinux x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 24 k 2023-07-27T20:12:54.164 INFO:teuthology.orchestra.run.smithi173.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-07-27T20:12:54.164 INFO:teuthology.orchestra.run.smithi173.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-27T20:12:54.164 INFO:teuthology.orchestra.run.smithi173.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-07-27T20:12:54.164 INFO:teuthology.orchestra.run.smithi173.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-07-27T20:12:54.164 INFO:teuthology.orchestra.run.smithi173.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-07-27T20:12:54.165 INFO:teuthology.orchestra.run.smithi173.stdout: libcephsqlite x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 139 k 2023-07-27T20:12:54.165 INFO:teuthology.orchestra.run.smithi173.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-07-27T20:12:54.165 INFO:teuthology.orchestra.run.smithi173.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-07-27T20:12:54.165 INFO:teuthology.orchestra.run.smithi173.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-27T20:12:54.165 INFO:teuthology.orchestra.run.smithi173.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-07-27T20:12:54.165 INFO:teuthology.orchestra.run.smithi173.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-07-27T20:12:54.165 INFO:teuthology.orchestra.run.smithi173.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-07-27T20:12:54.165 INFO:teuthology.orchestra.run.smithi173.stdout: libradosstriper1 x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 473 k 2023-07-27T20:12:54.166 INFO:teuthology.orchestra.run.smithi173.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-07-27T20:12:54.166 INFO:teuthology.orchestra.run.smithi173.stdout: librgw2 x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 6.8 M 2023-07-27T20:12:54.166 INFO:teuthology.orchestra.run.smithi173.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-07-27T20:12:54.166 INFO:teuthology.orchestra.run.smithi173.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-07-27T20:12:54.166 INFO:teuthology.orchestra.run.smithi173.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-27T20:12:54.166 INFO:teuthology.orchestra.run.smithi173.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-07-27T20:12:54.166 INFO:teuthology.orchestra.run.smithi173.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-07-27T20:12:54.167 INFO:teuthology.orchestra.run.smithi173.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-07-27T20:12:54.167 INFO:teuthology.orchestra.run.smithi173.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-07-27T20:12:54.167 INFO:teuthology.orchestra.run.smithi173.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-07-27T20:12:54.167 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-07-27T20:12:54.167 INFO:teuthology.orchestra.run.smithi173.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-07-27T20:12:54.167 INFO:teuthology.orchestra.run.smithi173.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-07-27T20:12:54.167 INFO:teuthology.orchestra.run.smithi173.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-07-27T20:12:54.168 INFO:teuthology.orchestra.run.smithi173.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-27T20:12:54.168 INFO:teuthology.orchestra.run.smithi173.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-07-27T20:12:54.168 INFO:teuthology.orchestra.run.smithi173.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-27T20:12:54.168 INFO:teuthology.orchestra.run.smithi173.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-27T20:12:54.168 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-27T20:12:54.168 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-argparse x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 45 k 2023-07-27T20:12:54.168 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-common x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 122 k 2023-07-27T20:12:54.168 INFO:teuthology.orchestra.run.smithi173.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-27T20:12:54.169 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-07-27T20:12:54.169 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-27T20:12:54.169 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-27T20:12:54.169 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-07-27T20:12:54.169 INFO:teuthology.orchestra.run.smithi173.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-27T20:12:54.169 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-27T20:12:54.169 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-27T20:12:54.170 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-07-27T20:12:54.170 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-07-27T20:12:54.170 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-07-27T20:12:54.170 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-07-27T20:12:54.170 INFO:teuthology.orchestra.run.smithi173.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-27T20:12:54.170 INFO:teuthology.orchestra.run.smithi173.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-27T20:12:54.170 INFO:teuthology.orchestra.run.smithi173.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-07-27T20:12:54.171 INFO:teuthology.orchestra.run.smithi173.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-07-27T20:12:54.171 INFO:teuthology.orchestra.run.smithi173.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-27T20:12:54.171 INFO:teuthology.orchestra.run.smithi173.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-27T20:12:54.171 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-07-27T20:12:54.171 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-07-27T20:12:54.171 INFO:teuthology.orchestra.run.smithi173.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-07-27T20:12:54.171 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-27T20:12:54.171 INFO:teuthology.orchestra.run.smithi173.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-27T20:12:54.172 INFO:teuthology.orchestra.run.smithi173.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-07-27T20:12:54.172 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-07-27T20:12:54.172 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-07-27T20:12:54.172 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-07-27T20:12:54.172 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-07-27T20:12:54.172 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-07-27T20:12:54.172 INFO:teuthology.orchestra.run.smithi173.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-27T20:12:54.172 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-07-27T20:12:54.173 INFO:teuthology.orchestra.run.smithi173.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-27T20:12:54.173 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-07-27T20:12:54.173 INFO:teuthology.orchestra.run.smithi173.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-07-27T20:12:54.173 INFO:teuthology.orchestra.run.smithi173.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-27T20:12:54.173 INFO:teuthology.orchestra.run.smithi173.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-27T20:12:54.173 INFO:teuthology.orchestra.run.smithi173.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-27T20:12:54.173 INFO:teuthology.orchestra.run.smithi173.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-27T20:12:54.174 INFO:teuthology.orchestra.run.smithi173.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-27T20:12:54.174 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-27T20:12:54.174 INFO:teuthology.orchestra.run.smithi173.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-27T20:12:54.174 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-27T20:12:54.174 INFO:teuthology.orchestra.run.smithi173.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-07-27T20:12:54.174 INFO:teuthology.orchestra.run.smithi173.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-27T20:12:54.174 INFO:teuthology.orchestra.run.smithi173.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-07-27T20:12:54.175 INFO:teuthology.orchestra.run.smithi173.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-27T20:12:54.175 INFO:teuthology.orchestra.run.smithi173.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-07-27T20:12:54.175 INFO:teuthology.orchestra.run.smithi173.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-07-27T20:12:54.175 INFO:teuthology.orchestra.run.smithi173.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-07-27T20:12:54.175 INFO:teuthology.orchestra.run.smithi173.stdout:Enabling module streams: 2023-07-27T20:12:54.175 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql 10 2023-07-27T20:12:54.175 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T20:12:54.176 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2023-07-27T20:12:54.176 INFO:teuthology.orchestra.run.smithi173.stdout:==================================================================================================== 2023-07-27T20:12:54.176 INFO:teuthology.orchestra.run.smithi173.stdout:Install 128 Packages 2023-07-27T20:12:54.176 INFO:teuthology.orchestra.run.smithi173.stdout:Upgrade 16 Packages 2023-07-27T20:12:54.176 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T20:12:54.177 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 213 M 2023-07-27T20:12:54.177 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2023-07-27T20:12:54.811 INFO:teuthology.orchestra.run.smithi173.stdout:(1/144): ceph-18.0.0-5128.ga5d48e8c.el8.x86_64. 24 kB/s | 6.4 kB 00:00 2023-07-27T20:12:55.428 INFO:teuthology.orchestra.run.smithi173.stdout:(2/144): ceph-fuse-18.0.0-5128.ga5d48e8c.el8.x8 1.4 MB/s | 859 kB 00:00 2023-07-27T20:12:55.603 INFO:teuthology.orchestra.run.smithi173.stdout:(3/144): ceph-immutable-object-cache-18.0.0-512 956 kB/s | 167 kB 00:00 2023-07-27T20:12:56.436 INFO:teuthology.orchestra.run.smithi173.stdout:(4/144): ceph-mds-18.0.0-5128.ga5d48e8c.el8.x86 2.7 MB/s | 2.3 MB 00:00 2023-07-27T20:12:56.745 INFO:teuthology.orchestra.run.smithi173.stdout:(5/144): ceph-mgr-18.0.0-5128.ga5d48e8c.el8.x86 5.1 MB/s | 1.6 MB 00:00 2023-07-27T20:12:56.995 INFO:teuthology.orchestra.run.smithi173.stdout:(6/144): ceph-base-18.0.0-5128.ga5d48e8c.el8.x8 2.2 MB/s | 5.4 MB 00:02 2023-07-27T20:12:57.495 INFO:teuthology.orchestra.run.smithi173.stdout:(7/144): ceph-mon-18.0.0-5128.ga5d48e8c.el8.x86 6.1 MB/s | 4.6 MB 00:00 2023-07-27T20:12:58.571 INFO:teuthology.orchestra.run.smithi173.stdout:(8/144): ceph-radosgw-18.0.0-5128.ga5d48e8c.el8 13 MB/s | 14 MB 00:01 2023-07-27T20:12:58.671 INFO:teuthology.orchestra.run.smithi173.stdout:(9/144): ceph-selinux-18.0.0-5128.ga5d48e8c.el8 243 kB/s | 24 kB 00:00 2023-07-27T20:13:03.729 INFO:teuthology.orchestra.run.smithi173.stdout:(10/144): ceph-common-18.0.0-5128.ga5d48e8c.el8 2.4 MB/s | 22 MB 00:09 2023-07-27T20:13:04.221 INFO:teuthology.orchestra.run.smithi173.stdout:(11/144): cephfs-mirror-18.0.0-5128.ga5d48e8c.e 529 kB/s | 260 kB 00:00 2023-07-27T20:13:04.363 INFO:teuthology.orchestra.run.smithi173.stdout:(12/144): libcephfs-devel-18.0.0-5128.ga5d48e8c 220 kB/s | 31 kB 00:00 2023-07-27T20:13:05.779 INFO:teuthology.orchestra.run.smithi173.stdout:(13/144): libcephfs2-18.0.0-5128.ga5d48e8c.el8. 553 kB/s | 783 kB 00:01 2023-07-27T20:13:06.062 INFO:teuthology.orchestra.run.smithi173.stdout:(14/144): libcephsqlite-18.0.0-5128.ga5d48e8c.e 494 kB/s | 139 kB 00:00 2023-07-27T20:13:06.305 INFO:teuthology.orchestra.run.smithi173.stdout:(15/144): librados-devel-18.0.0-5128.ga5d48e8c. 571 kB/s | 139 kB 00:00 2023-07-27T20:13:07.155 INFO:teuthology.orchestra.run.smithi173.stdout:(16/144): libradosstriper1-18.0.0-5128.ga5d48e8 557 kB/s | 473 kB 00:00 2023-07-27T20:13:12.680 INFO:teuthology.orchestra.run.smithi173.stdout:(17/144): ceph-osd-18.0.0-5128.ga5d48e8c.el8.x8 1.1 MB/s | 18 MB 00:15 2023-07-27T20:13:13.330 INFO:teuthology.orchestra.run.smithi173.stdout:(18/144): python3-ceph-argparse-18.0.0-5128.ga5 69 kB/s | 45 kB 00:00 2023-07-27T20:13:13.539 INFO:teuthology.orchestra.run.smithi173.stdout:(19/144): python3-ceph-common-18.0.0-5128.ga5d4 589 kB/s | 122 kB 00:00 2023-07-27T20:13:13.939 INFO:teuthology.orchestra.run.smithi173.stdout:(20/144): python3-cephfs-18.0.0-5128.ga5d48e8c. 492 kB/s | 197 kB 00:00 2023-07-27T20:13:14.573 INFO:teuthology.orchestra.run.smithi173.stdout:(21/144): python3-rados-18.0.0-5128.ga5d48e8c.e 586 kB/s | 371 kB 00:00 2023-07-27T20:13:15.231 INFO:teuthology.orchestra.run.smithi173.stdout:(22/144): python3-rbd-18.0.0-5128.ga5d48e8c.el8 553 kB/s | 364 kB 00:00 2023-07-27T20:13:15.439 INFO:teuthology.orchestra.run.smithi173.stdout:(23/144): python3-rgw-18.0.0-5128.ga5d48e8c.el8 512 kB/s | 107 kB 00:00 2023-07-27T20:13:15.598 INFO:teuthology.orchestra.run.smithi173.stdout:(24/144): rbd-fuse-18.0.0-5128.ga5d48e8c.el8.x8 592 kB/s | 94 kB 00:00 2023-07-27T20:13:16.048 INFO:teuthology.orchestra.run.smithi173.stdout:(25/144): librgw2-18.0.0-5128.ga5d48e8c.el8.x86 780 kB/s | 6.8 MB 00:08 2023-07-27T20:13:16.249 INFO:teuthology.orchestra.run.smithi173.stdout:(26/144): rbd-nbd-18.0.0-5128.ga5d48e8c.el8.x86 894 kB/s | 179 kB 00:00 2023-07-27T20:13:16.349 INFO:teuthology.orchestra.run.smithi173.stdout:(27/144): ceph-grafana-dashboards-18.0.0-5128.g 231 kB/s | 23 kB 00:00 2023-07-27T20:13:16.633 INFO:teuthology.orchestra.run.smithi173.stdout:(28/144): ceph-mgr-cephadm-18.0.0-5128.ga5d48e8 456 kB/s | 129 kB 00:00 2023-07-27T20:13:19.033 INFO:teuthology.orchestra.run.smithi173.stdout:(29/144): ceph-mgr-dashboard-18.0.0-5128.ga5d48 732 kB/s | 1.7 MB 00:02 2023-07-27T20:13:19.375 INFO:teuthology.orchestra.run.smithi173.stdout:(30/144): rbd-mirror-18.0.0-5128.ga5d48e8c.el8. 957 kB/s | 3.5 MB 00:03 2023-07-27T20:13:19.675 INFO:teuthology.orchestra.run.smithi173.stdout:(31/144): ceph-mgr-modules-core-18.0.0-5128.ga5 804 kB/s | 241 kB 00:00 2023-07-27T20:13:20.309 INFO:teuthology.orchestra.run.smithi173.stdout:(32/144): ceph-mgr-rook-18.0.0-5128.ga5d48e8c.e 75 kB/s | 47 kB 00:00 2023-07-27T20:13:20.442 INFO:teuthology.orchestra.run.smithi173.stdout:(33/144): ceph-prometheus-alerts-18.0.0-5128.ga 109 kB/s | 14 kB 00:00 2023-07-27T20:13:20.917 INFO:teuthology.orchestra.run.smithi173.stdout:(34/144): ceph-volume-18.0.0-5128.ga5d48e8c.el8 544 kB/s | 258 kB 00:00 2023-07-27T20:13:21.243 INFO:teuthology.orchestra.run.smithi173.stdout:(35/144): cephadm-18.0.0-5128.ga5d48e8c.el8.noa 508 kB/s | 165 kB 00:00 2023-07-27T20:13:21.385 INFO:teuthology.orchestra.run.smithi173.stdout:(36/144): cephfs-top-18.0.0-5128.ga5d48e8c.el8. 127 kB/s | 18 kB 00:00 2023-07-27T20:13:25.735 INFO:teuthology.orchestra.run.smithi173.stdout:(37/144): ceph-test-18.0.0-5128.ga5d48e8c.el8.x 1.8 MB/s | 48 MB 00:27 2023-07-27T20:13:30.709 INFO:teuthology.orchestra.run.smithi173.stdout:(38/144): ceph-mgr-diskprediction-local-18.0.0- 649 kB/s | 7.4 MB 00:11 2023-07-27T20:15:23.800 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - AppStream 40 kB/s | 31 MB 13:14 2023-07-27T20:16:14.551 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - BaseOS 937 kB/s | 41 MB 00:44 2023-07-27T20:16:21.393 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - Extras 31 kB/s | 18 kB 00:00 2023-07-27T20:16:22.111 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - Extras common packages 12 kB/s | 6.6 kB 00:00 2023-07-27T20:16:54.696 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - PowerTools 198 kB/s | 6.3 MB 00:32 2023-07-27T20:16:56.348 INFO:teuthology.orchestra.run.smithi072.stdout:Copr repo for python3-asyncssh owned by ceph 9.9 kB/s | 3.5 kB 00:00 2023-07-27T20:17:35.458 INFO:teuthology.orchestra.run.smithi072.stdout:Extra Packages for Enterprise Linux 410 kB/s | 16 MB 00:38 2023-07-27T20:17:39.807 INFO:teuthology.orchestra.run.smithi072.stdout:lab-extras 392 kB/s | 24 kB 00:00 2023-07-27T20:17:43.906 INFO:teuthology.orchestra.run.smithi072.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-27T20:17:43.907 INFO:teuthology.orchestra.run.smithi072.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-27T20:17:43.920 INFO:teuthology.orchestra.run.smithi072.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-07-27T20:17:43.920 INFO:teuthology.orchestra.run.smithi072.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-07-27T20:17:43.920 INFO:teuthology.orchestra.run.smithi072.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-07-27T20:17:43.921 INFO:teuthology.orchestra.run.smithi072.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-07-27T20:17:43.922 INFO:teuthology.orchestra.run.smithi072.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-27T20:17:43.924 INFO:teuthology.orchestra.run.smithi072.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-27T20:17:43.927 INFO:teuthology.orchestra.run.smithi072.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-27T20:17:43.928 INFO:teuthology.orchestra.run.smithi072.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-27T20:17:44.118 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2023-07-27T20:17:44.132 INFO:teuthology.orchestra.run.smithi072.stdout:==================================================================================================== 2023-07-27T20:17:44.132 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repository Size 2023-07-27T20:17:44.132 INFO:teuthology.orchestra.run.smithi072.stdout:==================================================================================================== 2023-07-27T20:17:44.132 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2023-07-27T20:17:44.133 INFO:teuthology.orchestra.run.smithi072.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-07-27T20:17:44.133 INFO:teuthology.orchestra.run.smithi072.stdout: ceph x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 6.4 k 2023-07-27T20:17:44.133 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 5.4 M 2023-07-27T20:17:44.133 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 859 k 2023-07-27T20:17:44.133 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 167 k 2023-07-27T20:17:44.134 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 1.6 M 2023-07-27T20:17:44.134 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 129 k 2023-07-27T20:17:44.134 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 1.7 M 2023-07-27T20:17:44.134 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 7.4 M 2023-07-27T20:17:44.134 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-rook noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 47 k 2023-07-27T20:17:44.134 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 14 M 2023-07-27T20:17:44.134 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 48 M 2023-07-27T20:17:44.134 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-volume noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 258 k 2023-07-27T20:17:44.135 INFO:teuthology.orchestra.run.smithi072.stdout: cephadm noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 165 k 2023-07-27T20:17:44.135 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-mirror x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 260 k 2023-07-27T20:17:44.135 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-top noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 18 k 2023-07-27T20:17:44.135 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-07-27T20:17:44.135 INFO:teuthology.orchestra.run.smithi072.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-07-27T20:17:44.135 INFO:teuthology.orchestra.run.smithi072.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-07-27T20:17:44.135 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-devel x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 31 k 2023-07-27T20:17:44.136 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2 x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 783 k 2023-07-27T20:17:44.136 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 139 k 2023-07-27T20:17:44.136 INFO:teuthology.orchestra.run.smithi072.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-07-27T20:17:44.136 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-07-27T20:17:44.136 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-07-27T20:17:44.136 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-07-27T20:17:44.136 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-07-27T20:17:44.137 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-07-27T20:17:44.137 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 197 k 2023-07-27T20:17:44.137 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 371 k 2023-07-27T20:17:44.137 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 364 k 2023-07-27T20:17:44.137 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 107 k 2023-07-27T20:17:44.137 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 94 k 2023-07-27T20:17:44.137 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 3.5 M 2023-07-27T20:17:44.138 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 179 k 2023-07-27T20:17:44.138 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-07-27T20:17:44.138 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrading: 2023-07-27T20:17:44.138 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-8.el8 baseos 143 k 2023-07-27T20:17:44.138 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-07-27T20:17:44.138 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-07-27T20:17:44.138 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-07-27T20:17:44.138 INFO:teuthology.orchestra.run.smithi072.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-07-27T20:17:44.139 INFO:teuthology.orchestra.run.smithi072.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-07-27T20:17:44.139 INFO:teuthology.orchestra.run.smithi072.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-07-27T20:17:44.139 INFO:teuthology.orchestra.run.smithi072.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-07-27T20:17:44.139 INFO:teuthology.orchestra.run.smithi072.stdout: librados2 x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 3.7 M 2023-07-27T20:17:44.139 INFO:teuthology.orchestra.run.smithi072.stdout: librbd1 x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 3.6 M 2023-07-27T20:17:44.139 INFO:teuthology.orchestra.run.smithi072.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-07-27T20:17:44.139 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-07-27T20:17:44.140 INFO:teuthology.orchestra.run.smithi072.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-07-27T20:17:44.140 INFO:teuthology.orchestra.run.smithi072.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-07-27T20:17:44.140 INFO:teuthology.orchestra.run.smithi072.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-07-27T20:17:44.140 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-07-27T20:17:44.140 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2023-07-27T20:17:44.140 INFO:teuthology.orchestra.run.smithi072.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-07-27T20:17:44.140 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 22 M 2023-07-27T20:17:44.141 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 23 k 2023-07-27T20:17:44.141 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 2.3 M 2023-07-27T20:17:44.141 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 241 k 2023-07-27T20:17:44.141 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 4.6 M 2023-07-27T20:17:44.141 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 18 M 2023-07-27T20:17:44.141 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 14 k 2023-07-27T20:17:44.141 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-selinux x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 24 k 2023-07-27T20:17:44.141 INFO:teuthology.orchestra.run.smithi072.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-07-27T20:17:44.142 INFO:teuthology.orchestra.run.smithi072.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-27T20:17:44.142 INFO:teuthology.orchestra.run.smithi072.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-07-27T20:17:44.142 INFO:teuthology.orchestra.run.smithi072.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-07-27T20:17:44.142 INFO:teuthology.orchestra.run.smithi072.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-07-27T20:17:44.142 INFO:teuthology.orchestra.run.smithi072.stdout: libcephsqlite x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 139 k 2023-07-27T20:17:44.142 INFO:teuthology.orchestra.run.smithi072.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-07-27T20:17:44.142 INFO:teuthology.orchestra.run.smithi072.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-07-27T20:17:44.142 INFO:teuthology.orchestra.run.smithi072.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-27T20:17:44.143 INFO:teuthology.orchestra.run.smithi072.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-07-27T20:17:44.143 INFO:teuthology.orchestra.run.smithi072.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-07-27T20:17:44.143 INFO:teuthology.orchestra.run.smithi072.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-07-27T20:17:44.143 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1 x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 473 k 2023-07-27T20:17:44.143 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-07-27T20:17:44.143 INFO:teuthology.orchestra.run.smithi072.stdout: librgw2 x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 6.8 M 2023-07-27T20:17:44.144 INFO:teuthology.orchestra.run.smithi072.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-07-27T20:17:44.144 INFO:teuthology.orchestra.run.smithi072.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-07-27T20:17:44.144 INFO:teuthology.orchestra.run.smithi072.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-27T20:17:44.144 INFO:teuthology.orchestra.run.smithi072.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-07-27T20:17:44.144 INFO:teuthology.orchestra.run.smithi072.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-07-27T20:17:44.144 INFO:teuthology.orchestra.run.smithi072.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-07-27T20:17:44.145 INFO:teuthology.orchestra.run.smithi072.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-07-27T20:17:44.145 INFO:teuthology.orchestra.run.smithi072.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-07-27T20:17:44.145 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-07-27T20:17:44.145 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-07-27T20:17:44.145 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-07-27T20:17:44.145 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-07-27T20:17:44.145 INFO:teuthology.orchestra.run.smithi072.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-27T20:17:44.146 INFO:teuthology.orchestra.run.smithi072.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-07-27T20:17:44.146 INFO:teuthology.orchestra.run.smithi072.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-27T20:17:44.146 INFO:teuthology.orchestra.run.smithi072.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-27T20:17:44.146 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-27T20:17:44.146 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 45 k 2023-07-27T20:17:44.146 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 122 k 2023-07-27T20:17:44.146 INFO:teuthology.orchestra.run.smithi072.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-27T20:17:44.146 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-07-27T20:17:44.147 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-27T20:17:44.147 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-27T20:17:44.147 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-07-27T20:17:44.147 INFO:teuthology.orchestra.run.smithi072.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-27T20:17:44.147 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-27T20:17:44.147 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-27T20:17:44.147 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-07-27T20:17:44.147 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-07-27T20:17:44.148 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-07-27T20:17:44.148 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-07-27T20:17:44.148 INFO:teuthology.orchestra.run.smithi072.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-27T20:17:44.148 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-27T20:17:44.148 INFO:teuthology.orchestra.run.smithi072.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-07-27T20:17:44.148 INFO:teuthology.orchestra.run.smithi072.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-07-27T20:17:44.148 INFO:teuthology.orchestra.run.smithi072.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-27T20:17:44.149 INFO:teuthology.orchestra.run.smithi072.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-27T20:17:44.149 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-07-27T20:17:44.149 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-07-27T20:17:44.149 INFO:teuthology.orchestra.run.smithi072.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-07-27T20:17:44.149 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-27T20:17:44.149 INFO:teuthology.orchestra.run.smithi072.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-27T20:17:44.149 INFO:teuthology.orchestra.run.smithi072.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-07-27T20:17:44.149 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-07-27T20:17:44.150 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-07-27T20:17:44.150 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-07-27T20:17:44.150 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-07-27T20:17:44.150 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-07-27T20:17:44.150 INFO:teuthology.orchestra.run.smithi072.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-27T20:17:44.150 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-07-27T20:17:44.150 INFO:teuthology.orchestra.run.smithi072.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-27T20:17:44.150 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-07-27T20:17:44.151 INFO:teuthology.orchestra.run.smithi072.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-07-27T20:17:44.151 INFO:teuthology.orchestra.run.smithi072.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-27T20:17:44.151 INFO:teuthology.orchestra.run.smithi072.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-27T20:17:44.151 INFO:teuthology.orchestra.run.smithi072.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-27T20:17:44.151 INFO:teuthology.orchestra.run.smithi072.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-27T20:17:44.151 INFO:teuthology.orchestra.run.smithi072.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-27T20:17:44.151 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-27T20:17:44.152 INFO:teuthology.orchestra.run.smithi072.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-27T20:17:44.152 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-27T20:17:44.152 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-07-27T20:17:44.152 INFO:teuthology.orchestra.run.smithi072.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-27T20:17:44.152 INFO:teuthology.orchestra.run.smithi072.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-07-27T20:17:44.152 INFO:teuthology.orchestra.run.smithi072.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-27T20:17:44.152 INFO:teuthology.orchestra.run.smithi072.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-07-27T20:17:44.152 INFO:teuthology.orchestra.run.smithi072.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-07-27T20:17:44.153 INFO:teuthology.orchestra.run.smithi072.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-07-27T20:17:44.153 INFO:teuthology.orchestra.run.smithi072.stdout:Enabling module streams: 2023-07-27T20:17:44.153 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql 10 2023-07-27T20:17:44.153 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:17:44.153 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2023-07-27T20:17:44.153 INFO:teuthology.orchestra.run.smithi072.stdout:==================================================================================================== 2023-07-27T20:17:44.153 INFO:teuthology.orchestra.run.smithi072.stdout:Install 128 Packages 2023-07-27T20:17:44.154 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrade 16 Packages 2023-07-27T20:17:44.154 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:17:44.154 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 213 M 2023-07-27T20:17:44.155 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2023-07-27T20:17:45.261 INFO:teuthology.orchestra.run.smithi072.stdout:(1/144): ceph-18.0.0-5128.ga5d48e8c.el8.x86_64. 13 kB/s | 6.4 kB 00:00 2023-07-27T20:17:45.937 INFO:teuthology.orchestra.run.smithi072.stdout:(2/144): ceph-fuse-18.0.0-5128.ga5d48e8c.el8.x8 1.2 MB/s | 859 kB 00:00 2023-07-27T20:17:46.112 INFO:teuthology.orchestra.run.smithi072.stdout:(3/144): ceph-immutable-object-cache-18.0.0-512 953 kB/s | 167 kB 00:00 2023-07-27T20:17:46.763 INFO:teuthology.orchestra.run.smithi072.stdout:(4/144): ceph-base-18.0.0-5128.ga5d48e8c.el8.x8 2.7 MB/s | 5.4 MB 00:02 2023-07-27T20:17:46.830 INFO:teuthology.orchestra.run.smithi072.stdout:(5/144): ceph-mds-18.0.0-5128.ga5d48e8c.el8.x86 3.2 MB/s | 2.3 MB 00:00 2023-07-27T20:17:47.180 INFO:teuthology.orchestra.run.smithi072.stdout:(6/144): ceph-mgr-18.0.0-5128.ga5d48e8c.el8.x86 3.7 MB/s | 1.6 MB 00:00 2023-07-27T20:17:47.889 INFO:teuthology.orchestra.run.smithi072.stdout:(7/144): ceph-mon-18.0.0-5128.ga5d48e8c.el8.x86 4.3 MB/s | 4.6 MB 00:01 2023-07-27T20:17:50.223 INFO:teuthology.orchestra.run.smithi072.stdout:(8/144): ceph-common-18.0.0-5128.ga5d48e8c.el8. 4.1 MB/s | 22 MB 00:05 2023-07-27T20:17:50.690 INFO:teuthology.orchestra.run.smithi072.stdout:(9/144): ceph-selinux-18.0.0-5128.ga5d48e8c.el8 52 kB/s | 24 kB 00:00 2023-07-27T20:17:54.049 INFO:teuthology.orchestra.run.smithi072.stdout:(10/144): ceph-osd-18.0.0-5128.ga5d48e8c.el8.x8 2.6 MB/s | 18 MB 00:06 2023-07-27T20:17:54.351 INFO:teuthology.orchestra.run.smithi072.stdout:(11/144): ceph-radosgw-18.0.0-5128.ga5d48e8c.el 2.1 MB/s | 14 MB 00:06 2023-07-27T20:17:54.468 INFO:teuthology.orchestra.run.smithi072.stdout:(12/144): cephfs-mirror-18.0.0-5128.ga5d48e8c.e 620 kB/s | 260 kB 00:00 2023-07-27T20:17:54.510 INFO:teuthology.orchestra.run.smithi072.stdout:(13/144): libcephfs-devel-18.0.0-5128.ga5d48e8c 196 kB/s | 31 kB 00:00 2023-07-27T20:17:54.819 INFO:teuthology.orchestra.run.smithi072.stdout:(14/144): libcephsqlite-18.0.0-5128.ga5d48e8c.e 450 kB/s | 139 kB 00:00 2023-07-27T20:17:54.987 INFO:teuthology.orchestra.run.smithi072.stdout:(15/144): librados-devel-18.0.0-5128.ga5d48e8c. 832 kB/s | 139 kB 00:00 2023-07-27T20:17:55.170 INFO:teuthology.orchestra.run.smithi072.stdout:(16/144): libcephfs2-18.0.0-5128.ga5d48e8c.el8. 1.1 MB/s | 783 kB 00:00 2023-07-27T20:17:55.471 INFO:teuthology.orchestra.run.smithi072.stdout:(17/144): libradosstriper1-18.0.0-5128.ga5d48e8 978 kB/s | 473 kB 00:00 2023-07-27T20:17:55.638 INFO:teuthology.orchestra.run.smithi072.stdout:(18/144): python3-ceph-argparse-18.0.0-5128.ga5 268 kB/s | 45 kB 00:00 2023-07-27T20:17:55.822 INFO:teuthology.orchestra.run.smithi072.stdout:(19/144): python3-ceph-common-18.0.0-5128.ga5d4 668 kB/s | 122 kB 00:00 2023-07-27T20:17:56.173 INFO:teuthology.orchestra.run.smithi072.stdout:(20/144): python3-cephfs-18.0.0-5128.ga5d48e8c. 562 kB/s | 197 kB 00:00 2023-07-27T20:17:57.198 INFO:teuthology.orchestra.run.smithi072.stdout:(21/144): python3-rados-18.0.0-5128.ga5d48e8c.e 362 kB/s | 371 kB 00:01 2023-07-27T20:17:58.423 INFO:teuthology.orchestra.run.smithi072.stdout:(22/144): python3-rbd-18.0.0-5128.ga5d48e8c.el8 297 kB/s | 364 kB 00:01 2023-07-27T20:17:58.857 INFO:teuthology.orchestra.run.smithi072.stdout:(23/144): python3-rgw-18.0.0-5128.ga5d48e8c.el8 246 kB/s | 107 kB 00:00 2023-07-27T20:17:59.183 INFO:teuthology.orchestra.run.smithi072.stdout:(24/144): rbd-fuse-18.0.0-5128.ga5d48e8c.el8.x8 288 kB/s | 94 kB 00:00 2023-07-27T20:18:05.226 INFO:teuthology.orchestra.run.smithi072.stdout:(25/144): librgw2-18.0.0-5128.ga5d48e8c.el8.x86 690 kB/s | 6.8 MB 00:10 2023-07-27T20:18:05.560 INFO:teuthology.orchestra.run.smithi072.stdout:(26/144): rbd-nbd-18.0.0-5128.ga5d48e8c.el8.x86 537 kB/s | 179 kB 00:00 2023-07-27T20:18:06.286 INFO:teuthology.orchestra.run.smithi072.stdout:(27/144): ceph-grafana-dashboards-18.0.0-5128.g 32 kB/s | 23 kB 00:00 2023-07-27T20:18:07.003 INFO:teuthology.orchestra.run.smithi072.stdout:(28/144): ceph-mgr-cephadm-18.0.0-5128.ga5d48e8 180 kB/s | 129 kB 00:00 2023-07-27T20:18:07.603 INFO:teuthology.orchestra.run.smithi072.stdout:(29/144): rbd-mirror-18.0.0-5128.ga5d48e8c.el8. 429 kB/s | 3.5 MB 00:08 2023-07-27T20:18:22.120 INFO:teuthology.orchestra.run.smithi072.stdout:(30/144): ceph-mgr-dashboard-18.0.0-5128.ga5d48 116 kB/s | 1.7 MB 00:15 2023-07-27T20:18:23.221 INFO:teuthology.orchestra.run.smithi072.stdout:(31/144): ceph-mgr-modules-core-18.0.0-5128.ga5 219 kB/s | 241 kB 00:01 2023-07-27T20:18:23.479 INFO:teuthology.orchestra.run.smithi072.stdout:(32/144): ceph-mgr-rook-18.0.0-5128.ga5d48e8c.e 183 kB/s | 47 kB 00:00 2023-07-27T20:18:23.588 INFO:teuthology.orchestra.run.smithi072.stdout:(33/144): ceph-prometheus-alerts-18.0.0-5128.ga 134 kB/s | 14 kB 00:00 2023-07-27T20:18:24.597 INFO:teuthology.orchestra.run.smithi072.stdout:(34/144): ceph-volume-18.0.0-5128.ga5d48e8c.el8 256 kB/s | 258 kB 00:01 2023-07-27T20:18:25.098 INFO:teuthology.orchestra.run.smithi072.stdout:(35/144): cephadm-18.0.0-5128.ga5d48e8c.el8.noa 330 kB/s | 165 kB 00:00 2023-07-27T20:18:25.206 INFO:teuthology.orchestra.run.smithi072.stdout:(36/144): cephfs-top-18.0.0-5128.ga5d48e8c.el8. 166 kB/s | 18 kB 00:00 2023-07-27T20:18:26.166 INFO:teuthology.orchestra.run.smithi173.stdout:[MIRROR] bison-3.0.4-10.el8.x86_64.rpm: Curl error (28): Timeout was reached for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/bison-3.0.4-10.el8.x86_64.rpm [Operation too slow. Less than 1000 bytes/sec transferred the last 300 seconds] 2023-07-27T20:18:28.159 INFO:teuthology.orchestra.run.smithi173.stdout:(39/144): bison-3.0.4-10.el8.x86_64.rpm 2.3 kB/s | 688 kB 05:02 2023-07-27T20:18:28.659 INFO:teuthology.orchestra.run.smithi173.stdout:(40/144): jq-1.6-7.el8.x86_64.rpm 405 kB/s | 202 kB 00:00 2023-07-27T20:18:29.159 INFO:teuthology.orchestra.run.smithi173.stdout:(41/144): libpq-13.5-1.el8.x86_64.rpm 396 kB/s | 198 kB 00:00 2023-07-27T20:18:29.835 INFO:teuthology.orchestra.run.smithi173.stdout:(42/144): librdkafka-0.11.4-3.el8.x86_64.rpm 524 kB/s | 354 kB 00:00 2023-07-27T20:18:30.836 INFO:teuthology.orchestra.run.smithi173.stdout:[MIRROR] flex-2.6.1-9.el8.x86_64.rpm: Curl error (28): Timeout was reached for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/flex-2.6.1-9.el8.x86_64.rpm [Operation too slow. Less than 1000 bytes/sec transferred the last 300 seconds] 2023-07-27T20:18:30.894 INFO:teuthology.orchestra.run.smithi173.stdout:(43/144): libtool-2.4.6-25.el8.x86_64.rpm 670 kB/s | 709 kB 00:01 2023-07-27T20:18:31.144 INFO:teuthology.orchestra.run.smithi173.stdout:(44/144): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.0 MB/s | 259 kB 00:00 2023-07-27T20:18:31.510 INFO:teuthology.orchestra.run.smithi173.stdout:(45/144): oniguruma-6.8.2-2.el8.x86_64.rpm 512 kB/s | 187 kB 00:00 2023-07-27T20:18:32.028 INFO:teuthology.orchestra.run.smithi173.stdout:(46/144): flex-2.6.1-9.el8.x86_64.rpm 1.1 kB/s | 320 kB 05:01 2023-07-27T20:18:32.945 INFO:teuthology.orchestra.run.smithi173.stdout:[MIRROR] automake-1.16.1-7.el8.noarch.rpm: Curl error (28): Timeout was reached for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/automake-1.16.1-7.el8.noarch.rpm [Operation too slow. Less than 1000 bytes/sec transferred the last 300 seconds] 2023-07-27T20:18:34.694 INFO:teuthology.orchestra.run.smithi173.stdout:(47/144): automake-1.16.1-7.el8.noarch.rpm 2.3 kB/s | 713 kB 05:13 2023-07-27T20:18:34.883 INFO:teuthology.orchestra.run.smithi072.stdout:(37/144): ceph-mgr-diskprediction-local-18.0.0- 278 kB/s | 7.4 MB 00:27 2023-07-27T20:18:37.003 INFO:teuthology.orchestra.run.smithi173.stdout:(48/144): postgresql-10.23-1.module_el8+300+2c5 693 kB/s | 1.6 MB 00:02 2023-07-27T20:18:38.636 INFO:teuthology.orchestra.run.smithi173.stdout:(49/144): postgresql-contrib-10.23-1.module_el8 553 kB/s | 903 kB 00:01 2023-07-27T20:18:42.152 INFO:teuthology.orchestra.run.smithi173.stdout:(50/144): openblas-0.3.15-4.el8.x86_64.rpm 455 kB/s | 4.7 MB 00:10 2023-07-27T20:18:45.985 INFO:teuthology.orchestra.run.smithi173.stdout:(51/144): openblas-threads-0.3.15-4.el8.x86_64. 356 kB/s | 4.9 MB 00:13 2023-07-27T20:18:48.669 INFO:teuthology.orchestra.run.smithi173.stdout:(52/144): python3-jinja2-2.10.1-3.el8.noarch.rp 200 kB/s | 538 kB 00:02 2023-07-27T20:18:49.019 INFO:teuthology.orchestra.run.smithi173.stdout:(53/144): python3-jsonpatch-1.21-2.el8.noarch.r 76 kB/s | 27 kB 00:00 2023-07-27T20:18:49.177 INFO:teuthology.orchestra.run.smithi173.stdout:(54/144): python3-jsonpointer-1.10-11.el8.noarc 126 kB/s | 20 kB 00:00 2023-07-27T20:18:49.944 INFO:teuthology.orchestra.run.smithi173.stdout:(55/144): python3-mako-1.0.6-14.el8.noarch.rpm 205 kB/s | 157 kB 00:00 2023-07-27T20:18:50.220 INFO:teuthology.orchestra.run.smithi173.stdout:(56/144): python3-markupsafe-0.23-19.el8.x86_64 141 kB/s | 39 kB 00:00 2023-07-27T20:18:55.153 INFO:teuthology.orchestra.run.smithi173.stdout:(57/144): postgresql-server-10.23-1.module_el8+ 317 kB/s | 5.1 MB 00:16 2023-07-27T20:18:55.811 INFO:teuthology.orchestra.run.smithi173.stdout:(58/144): python3-numpy-f2py-1.14.3-10.el8.x86_ 342 kB/s | 225 kB 00:00 2023-07-27T20:18:55.995 INFO:teuthology.orchestra.run.smithi173.stdout:(59/144): python3-babel-2.5.1-7.el8.noarch.rpm 354 kB/s | 4.8 MB 00:13 2023-07-27T20:18:56.011 INFO:teuthology.orchestra.run.smithi173.stdout:(60/144): python3-prettytable-0.7.2-14.el8.noar 219 kB/s | 44 kB 00:00 2023-07-27T20:18:56.395 INFO:teuthology.orchestra.run.smithi173.stdout:(61/144): python3-pyasn1-0.3.7-6.el8.noarch.rpm 330 kB/s | 126 kB 00:00 2023-07-27T20:18:56.770 INFO:teuthology.orchestra.run.smithi173.stdout:(62/144): python3-pyasn1-modules-0.3.7-6.el8.no 293 kB/s | 110 kB 00:00 2023-07-27T20:18:56.879 INFO:teuthology.orchestra.run.smithi173.stdout:(63/144): python3-pyOpenSSL-19.0.0-1.el8.noarch 117 kB/s | 103 kB 00:00 2023-07-27T20:18:57.013 INFO:teuthology.orchestra.run.smithi173.stdout:(64/144): python3-pytz-2017.2-9.el8.noarch.rpm 224 kB/s | 54 kB 00:00 2023-07-27T20:18:58.013 INFO:teuthology.orchestra.run.smithi173.stdout:(65/144): python3-werkzeug-0.12.2-4.el8.noarch. 457 kB/s | 457 kB 00:00 2023-07-27T20:18:58.405 INFO:teuthology.orchestra.run.smithi173.stdout:(66/144): python3-numpy-1.14.3-10.el8.x86_64.rp 467 kB/s | 3.7 MB 00:08 2023-07-27T20:18:58.547 INFO:teuthology.orchestra.run.smithi173.stdout:(67/144): uuid-1.6.2-43.el8.x86_64.rpm 452 kB/s | 64 kB 00:00 2023-07-27T20:18:58.722 INFO:teuthology.orchestra.run.smithi173.stdout:(68/144): socat-1.7.4.1-1.el8.x86_64.rpm 456 kB/s | 323 kB 00:00 2023-07-27T20:18:58.781 INFO:teuthology.orchestra.run.smithi173.stdout:(69/144): xmlstarlet-1.6.1-20.el8.x86_64.rpm 302 kB/s | 71 kB 00:00 2023-07-27T20:18:59.156 INFO:teuthology.orchestra.run.smithi173.stdout:(70/144): elfutils-libelf-devel-0.189-2.el8.x86 142 kB/s | 61 kB 00:00 2023-07-27T20:18:59.190 INFO:teuthology.orchestra.run.smithi173.stdout:(71/144): fuse-2.9.7-17.el8.x86_64.rpm 203 kB/s | 83 kB 00:00 2023-07-27T20:18:59.282 INFO:teuthology.orchestra.run.smithi173.stdout:(72/144): keyutils-libs-devel-1.5.10-9.el8.x86_ 384 kB/s | 48 kB 00:00 2023-07-27T20:18:59.398 INFO:teuthology.orchestra.run.smithi173.stdout:(73/144): libaio-devel-0.3.112-1.el8.x86_64.rpm 161 kB/s | 19 kB 00:00 2023-07-27T20:18:59.507 INFO:teuthology.orchestra.run.smithi173.stdout:(74/144): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.7 MB/s | 561 kB 00:00 2023-07-27T20:18:59.533 INFO:teuthology.orchestra.run.smithi173.stdout:(75/144): libcom_err-devel-1.45.6-5.el8.x86_64. 289 kB/s | 39 kB 00:00 2023-07-27T20:18:59.716 INFO:teuthology.orchestra.run.smithi173.stdout:(76/144): libgfortran-8.5.0-20.el8.x86_64.rpm 3.0 MB/s | 645 kB 00:00 2023-07-27T20:18:59.741 INFO:teuthology.orchestra.run.smithi173.stdout:(77/144): libquadmath-8.5.0-20.el8.x86_64.rpm 828 kB/s | 172 kB 00:00 2023-07-27T20:18:59.825 INFO:teuthology.orchestra.run.smithi173.stdout:(78/144): librabbitmq-0.9.0-4.el8.x86_64.rpm 432 kB/s | 47 kB 00:00 2023-07-27T20:18:59.859 INFO:teuthology.orchestra.run.smithi173.stdout:(79/144): libselinux-devel-2.9-8.el8.x86_64.rpm 1.7 MB/s | 200 kB 00:00 2023-07-27T20:18:59.972 INFO:teuthology.orchestra.run.smithi173.stdout:(80/144): libsepol-devel-2.9-3.el8.x86_64.rpm 593 kB/s | 87 kB 00:00 2023-07-27T20:19:00.009 INFO:teuthology.orchestra.run.smithi173.stdout:(81/144): libuuid-devel-2.32.1-42.el8.x86_64.rp 661 kB/s | 99 kB 00:00 2023-07-27T20:19:00.109 INFO:teuthology.orchestra.run.smithi173.stdout:(82/144): libverto-devel-0.3.2-2.el8.x86_64.rpm 132 kB/s | 18 kB 00:00 2023-07-27T20:19:00.151 INFO:teuthology.orchestra.run.smithi173.stdout:(83/144): libzstd-devel-1.4.4-1.el8.x86_64.rpm 309 kB/s | 44 kB 00:00 2023-07-27T20:19:00.393 INFO:teuthology.orchestra.run.smithi173.stdout:(84/144): pcre2-devel-10.32-3.el8.x86_64.rpm 2.4 MB/s | 605 kB 00:00 2023-07-27T20:19:01.402 INFO:teuthology.orchestra.run.smithi173.stdout:(85/144): pcre2-utf16-10.32-3.el8.x86_64.rpm 227 kB/s | 229 kB 00:01 2023-07-27T20:19:01.535 INFO:teuthology.orchestra.run.smithi173.stdout:(86/144): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.6 MB/s | 220 kB 00:00 2023-07-27T20:19:01.669 INFO:teuthology.orchestra.run.smithi173.stdout:(87/144): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.8 MB/s | 249 kB 00:00 2023-07-27T20:19:01.928 INFO:teuthology.orchestra.run.smithi173.stdout:(88/144): python3-cryptography-3.2.1-6.el8.x86_ 2.4 MB/s | 641 kB 00:00 2023-07-27T20:19:02.044 INFO:teuthology.orchestra.run.smithi173.stdout:(89/144): python3-jwt-1.6.1-2.el8.noarch.rpm 366 kB/s | 43 kB 00:00 2023-07-27T20:19:02.611 INFO:teuthology.orchestra.run.smithi173.stdout:(90/144): openssl-devel-1.1.1k-9.el8.x86_64.rpm 1.3 MB/s | 3.2 MB 00:02 2023-07-27T20:19:02.812 INFO:teuthology.orchestra.run.smithi173.stdout:(91/144): python3-pycparser-2.14-14.el8.noarch. 545 kB/s | 109 kB 00:00 2023-07-27T20:19:02.854 INFO:teuthology.orchestra.run.smithi173.stdout:(92/144): python3-oauthlib-2.1.0-1.el8.noarch.r 192 kB/s | 155 kB 00:00 2023-07-27T20:19:02.920 INFO:teuthology.orchestra.run.smithi173.stdout:(93/144): python3-requests-oauthlib-1.0.0-1.el8 393 kB/s | 43 kB 00:00 2023-07-27T20:19:02.962 INFO:teuthology.orchestra.run.smithi173.stdout:(94/144): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 687 kB/s | 74 kB 00:00 2023-07-27T20:19:03.021 INFO:teuthology.orchestra.run.smithi173.stdout:(95/144): zlib-devel-1.2.11-21.el8.x86_64.rpm 579 kB/s | 58 kB 00:00 2023-07-27T20:19:03.297 INFO:teuthology.orchestra.run.smithi173.stdout:(96/144): liboath-2.6.2-3.el8.x86_64.rpm 214 kB/s | 59 kB 00:00 2023-07-27T20:19:03.347 INFO:teuthology.orchestra.run.smithi173.stdout:(97/144): gperftools-libs-2.7-9.el8.x86_64.rpm 797 kB/s | 306 kB 00:00 2023-07-27T20:19:03.455 INFO:teuthology.orchestra.run.smithi173.stdout:(98/144): libunwind-1.3.1-3.el8.x86_64.rpm 473 kB/s | 75 kB 00:00 2023-07-27T20:19:03.522 INFO:teuthology.orchestra.run.smithi173.stdout:(99/144): python3-asyncssh-2.7.0-2.el8.noarch.r 2.7 MB/s | 476 kB 00:00 2023-07-27T20:19:03.548 INFO:teuthology.orchestra.run.smithi173.stdout:(100/144): python3-bcrypt-3.1.6-2.el8.1.x86_64. 474 kB/s | 44 kB 00:00 2023-07-27T20:19:03.615 INFO:teuthology.orchestra.run.smithi173.stdout:(101/144): python3-beautifulsoup4-4.6.3-2.el8.1 2.0 MB/s | 185 kB 00:00 2023-07-27T20:19:03.631 INFO:teuthology.orchestra.run.smithi173.stdout:(102/144): python3-cachetools-3.1.1-4.el8.noarc 396 kB/s | 33 kB 00:00 2023-07-27T20:19:03.698 INFO:teuthology.orchestra.run.smithi173.stdout:(103/144): python3-certifi-2018.10.15-7.el8.noa 195 kB/s | 16 kB 00:00 2023-07-27T20:19:03.840 INFO:teuthology.orchestra.run.smithi173.stdout:(104/144): python3-cherrypy-18.4.0-1.el8.noarch 2.7 MB/s | 384 kB 00:00 2023-07-27T20:19:03.866 INFO:teuthology.orchestra.run.smithi173.stdout:(105/144): python3-cheroot-8.5.2-1.el8.noarch.r 738 kB/s | 173 kB 00:00 2023-07-27T20:19:03.924 INFO:teuthology.orchestra.run.smithi173.stdout:(106/144): python3-google-auth-1.1.1-10.el8.noa 974 kB/s | 81 kB 00:00 2023-07-27T20:19:03.950 INFO:teuthology.orchestra.run.smithi173.stdout:(107/144): python3-jaraco-6.2-6.el8.noarch.rpm 133 kB/s | 11 kB 00:00 2023-07-27T20:19:04.008 INFO:teuthology.orchestra.run.smithi173.stdout:(108/144): python3-jaraco-functools-2.0-4.el8.n 210 kB/s | 18 kB 00:00 2023-07-27T20:19:04.084 INFO:teuthology.orchestra.run.smithi173.stdout:(109/144): python3-logutils-0.3.5-11.el8.noarch 652 kB/s | 49 kB 00:00 2023-07-27T20:19:04.150 INFO:teuthology.orchestra.run.smithi173.stdout:(110/144): python3-more-itertools-7.2.0-3.el8.n 883 kB/s | 59 kB 00:00 2023-07-27T20:19:04.226 INFO:teuthology.orchestra.run.smithi173.stdout:(111/144): python3-natsort-7.1.1-2.el8.noarch.r 807 kB/s | 60 kB 00:00 2023-07-27T20:19:04.301 INFO:teuthology.orchestra.run.smithi173.stdout:(112/144): python3-pecan-1.3.2-9.el8.noarch.rpm 3.7 MB/s | 283 kB 00:00 2023-07-27T20:19:04.394 INFO:teuthology.orchestra.run.smithi173.stdout:(113/144): python3-portend-2.6-1.el8.noarch.rpm 170 kB/s | 16 kB 00:00 2023-07-27T20:19:04.477 INFO:teuthology.orchestra.run.smithi173.stdout:(114/144): python3-repoze-lru-0.7-6.el8.noarch. 405 kB/s | 34 kB 00:00 2023-07-27T20:19:04.560 INFO:teuthology.orchestra.run.smithi173.stdout:(115/144): python3-routes-2.4.1-12.el8.noarch.r 2.3 MB/s | 196 kB 00:00 2023-07-27T20:19:04.627 INFO:teuthology.orchestra.run.smithi173.stdout:(116/144): python3-rsa-4.9-2.el8.noarch.rpm 965 kB/s | 64 kB 00:00 2023-07-27T20:19:04.711 INFO:teuthology.orchestra.run.smithi173.stdout:(117/144): python3-simplegeneric-0.8.1-17.el8.n 225 kB/s | 19 kB 00:00 2023-07-27T20:19:04.795 INFO:teuthology.orchestra.run.smithi173.stdout:(118/144): python3-singledispatch-3.4.0.3-18.el 286 kB/s | 24 kB 00:00 2023-07-27T20:19:04.853 INFO:teuthology.orchestra.run.smithi173.stdout:(119/144): python3-kubernetes-11.0.0-6.el8.noar 1.3 MB/s | 1.2 MB 00:00 2023-07-27T20:19:04.887 INFO:teuthology.orchestra.run.smithi173.stdout:(120/144): python3-tempora-1.14.1-5.el8.noarch. 319 kB/s | 29 kB 00:00 2023-07-27T20:19:04.962 INFO:teuthology.orchestra.run.smithi173.stdout:(121/144): python3-trustme-0.6.0-4.el8.noarch.r 254 kB/s | 27 kB 00:00 2023-07-27T20:19:04.996 INFO:teuthology.orchestra.run.smithi173.stdout:(122/144): python3-waitress-1.4.3-1.el8.noarch. 2.3 MB/s | 255 kB 00:00 2023-07-27T20:19:05.113 INFO:teuthology.orchestra.run.smithi173.stdout:(123/144): python3-websocket-client-0.56.0-5.el 524 kB/s | 61 kB 00:00 2023-07-27T20:19:05.213 INFO:teuthology.orchestra.run.smithi173.stdout:(124/144): python3-webtest-2.0.33-1.el8.noarch. 857 kB/s | 85 kB 00:00 2023-07-27T20:19:05.255 INFO:teuthology.orchestra.run.smithi173.stdout:(125/144): python3-webob-1.8.5-1.el8.1.noarch.r 858 kB/s | 251 kB 00:00 2023-07-27T20:19:05.322 INFO:teuthology.orchestra.run.smithi173.stdout:(126/144): python3-zc-lockfile-2.0-2.el8.noarch 211 kB/s | 23 kB 00:00 2023-07-27T20:19:06.481 INFO:teuthology.orchestra.run.smithi173.stdout:(127/144): thrift-0.13.0-2.el8.x86_64.rpm 1.4 MB/s | 1.7 MB 00:01 2023-07-27T20:19:12.340 INFO:teuthology.orchestra.run.smithi173.stdout:(128/144): librados2-18.0.0-5128.ga5d48e8c.el8. 537 kB/s | 3.7 MB 00:07 2023-07-27T20:19:13.031 INFO:teuthology.orchestra.run.smithi173.stdout:(129/144): NetworkManager-initscripts-updown-1. 207 kB/s | 143 kB 00:00 2023-07-27T20:19:13.247 INFO:teuthology.orchestra.run.smithi173.stdout:(130/144): elfutils-debuginfod-client-0.189-2.e 351 kB/s | 76 kB 00:00 2023-07-27T20:19:13.623 INFO:teuthology.orchestra.run.smithi173.stdout:(131/144): elfutils-libelf-0.189-2.el8.x86_64.r 619 kB/s | 232 kB 00:00 2023-07-27T20:19:14.081 INFO:teuthology.orchestra.run.smithi173.stdout:(132/144): elfutils-libs-0.189-2.el8.x86_64.rpm 660 kB/s | 302 kB 00:00 2023-07-27T20:19:15.473 INFO:teuthology.orchestra.run.smithi173.stdout:(133/144): iproute-6.2.0-2.el8.x86_64.rpm 633 kB/s | 880 kB 00:01 2023-07-27T20:19:15.790 INFO:teuthology.orchestra.run.smithi173.stdout:(134/144): librbd1-18.0.0-5128.ga5d48e8c.el8.x8 399 kB/s | 3.6 MB 00:09 2023-07-27T20:19:15.932 INFO:teuthology.orchestra.run.smithi173.stdout:(135/144): libblkid-2.32.1-42.el8.x86_64.rpm 480 kB/s | 220 kB 00:00 2023-07-27T20:19:16.349 INFO:teuthology.orchestra.run.smithi173.stdout:(136/144): libmount-2.32.1-42.el8.x86_64.rpm 567 kB/s | 236 kB 00:00 2023-07-27T20:19:16.416 INFO:teuthology.orchestra.run.smithi173.stdout:(137/144): libfdisk-2.32.1-42.el8.x86_64.rpm 406 kB/s | 253 kB 00:00 2023-07-27T20:19:16.558 INFO:teuthology.orchestra.run.smithi173.stdout:(138/144): libuuid-2.32.1-42.el8.x86_64.rpm 695 kB/s | 98 kB 00:00 2023-07-27T20:19:16.841 INFO:teuthology.orchestra.run.smithi173.stdout:(139/144): libsmartcols-2.32.1-42.el8.x86_64.rp 364 kB/s | 179 kB 00:00 2023-07-27T20:19:17.158 INFO:teuthology.orchestra.run.smithi173.stdout:(140/144): util-linux-user-2.32.1-42.el8.x86_64 323 kB/s | 102 kB 00:00 2023-07-27T20:19:17.450 INFO:teuthology.orchestra.run.smithi173.stdout:(141/144): util-linux-2.32.1-42.el8.x86_64.rpm 2.9 MB/s | 2.6 MB 00:00 2023-07-27T20:19:17.767 INFO:teuthology.orchestra.run.smithi173.stdout:(142/144): xfsprogs-5.0.0-12.el8.x86_64.rpm 3.4 MB/s | 1.1 MB 00:00 2023-07-27T20:19:17.975 INFO:teuthology.orchestra.run.smithi173.stdout:(143/144): xfsdump-3.1.8-6.el8.x86_64.rpm 409 kB/s | 334 kB 00:00 2023-07-27T20:19:24.812 INFO:teuthology.orchestra.run.smithi072.stdout:(38/144): ceph-test-18.0.0-5128.ga5d48e8c.el8.x 522 kB/s | 48 MB 01:34 2023-07-27T20:19:32.357 INFO:teuthology.orchestra.run.smithi173.stdout:(144/144): python3-scipy-1.0.0-21.module_el8.5. 395 kB/s | 14 MB 00:35 2023-07-27T20:19:32.360 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2023-07-27T20:19:32.361 INFO:teuthology.orchestra.run.smithi173.stdout:Total 547 kB/s | 213 MB 06:38 2023-07-27T20:19:34.190 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2023-07-27T20:19:34.602 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2023-07-27T20:19:34.603 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2023-07-27T20:19:36.084 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2023-07-27T20:19:36.088 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2023-07-27T20:19:41.484 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2023-07-27T20:19:41.718 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-07-27T20:19:41.874 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/160 2023-07-27T20:19:42.019 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 2/160 2023-07-27T20:19:42.096 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 2/160 2023-07-27T20:19:42.236 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 3/160 2023-07-27T20:19:42.324 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 3/160 2023-07-27T20:19:42.551 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/160 2023-07-27T20:19:42.749 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 5/160 2023-07-27T20:19:42.930 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/160 2023-07-27T20:19:43.069 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-07-27T20:19:43.519 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-07-27T20:19:43.694 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : librados2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 8/160 2023-07-27T20:19:44.177 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 8/160 2023-07-27T20:19:44.343 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : librbd1-2:18.0.0-5128.ga5d48e8c.el8.x86_64 9/160 2023-07-27T20:19:44.484 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librbd1-2:18.0.0-5128.ga5d48e8c.el8.x86_64 9/160 2023-07-27T20:19:44.669 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephfs2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 10/160 2023-07-27T20:19:44.786 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libcephfs2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 10/160 2023-07-27T20:19:44.993 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rados-2:18.0.0-5128.ga5d48e8c.el8.x86_64 11/160 2023-07-27T20:19:45.169 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/160 2023-07-27T20:19:45.390 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/160 2023-07-27T20:19:45.613 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-07-27T20:19:45.706 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-07-27T20:19:45.918 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/160 2023-07-27T20:19:46.103 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/160 2023-07-27T20:19:46.538 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libpq-13.5-1.el8.x86_64 16/160 2023-07-27T20:19:46.731 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 17/160 2023-07-27T20:19:46.877 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephsqlite-2:18.0.0-5128.ga5d48e8c.el8.x86_64 18/160 2023-07-27T20:19:47.002 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5128.ga5d48e8c.el8.x86_64 18/160 2023-07-27T20:19:47.143 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libradosstriper1-2:18.0.0-5128.ga5d48e8c.el8.x86 19/160 2023-07-27T20:19:47.293 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5128.ga5d48e8c.el8.x86 19/160 2023-07-27T20:19:47.484 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/160 2023-07-27T20:19:47.660 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 21/160 2023-07-27T20:19:47.793 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 22/160 2023-07-27T20:19:47.959 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 22/160 2023-07-27T20:19:48.093 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 23/160 2023-07-27T20:19:48.750 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 23/160 2023-07-27T20:19:48.943 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : openblas-0.3.15-4.el8.x86_64 24/160 2023-07-27T20:19:49.622 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 24/160 2023-07-27T20:19:49.793 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-07-27T20:19:50.604 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-07-27T20:19:50.952 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/160 2023-07-27T20:19:51.143 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/160 2023-07-27T20:19:51.300 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 28/160 2023-07-27T20:19:51.546 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 29/160 2023-07-27T20:19:51.784 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ceph-common-2:18.0.0-5128.ga5d48e8c.el8. 30/160 2023-07-27T20:19:51.922 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ceph-argparse-2:18.0.0-5128.ga5d48e8c.el 31/160 2023-07-27T20:19:52.152 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cephfs-2:18.0.0-5128.ga5d48e8c.el8.x86_6 32/160 2023-07-27T20:19:53.254 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 33/160 2023-07-27T20:19:53.595 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 34/160 2023-07-27T20:19:53.893 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 35/160 2023-07-27T20:19:54.134 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-07-27T20:19:56.206 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-07-27T20:19:56.503 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 37/160 2023-07-27T20:19:56.740 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/160 2023-07-27T20:19:56.921 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/160 2023-07-27T20:19:57.083 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rbd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 40/160 2023-07-27T20:19:57.261 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librados-devel-2:18.0.0-5128.ga5d48e8c.el8.x86_6 41/160 2023-07-27T20:19:57.458 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 42/160 2023-07-27T20:19:57.619 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 43/160 2023-07-27T20:19:57.875 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/160 2023-07-27T20:19:57.975 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/160 2023-07-27T20:19:58.141 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/160 2023-07-27T20:19:58.225 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/160 2023-07-27T20:19:58.404 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/160 2023-07-27T20:19:58.583 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-07-27T20:19:59.132 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-07-27T20:19:59.434 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/160 2023-07-27T20:19:59.462 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/160 2023-07-27T20:19:59.673 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/160 2023-07-27T20:19:59.956 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/160 2023-07-27T20:20:00.190 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/160 2023-07-27T20:20:00.355 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/160 2023-07-27T20:20:00.545 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/160 2023-07-27T20:20:00.747 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/160 2023-07-27T20:20:00.940 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/160 2023-07-27T20:20:01.122 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/160 2023-07-27T20:20:01.340 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/160 2023-07-27T20:20:01.865 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/160 2023-07-27T20:20:02.023 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/160 2023-07-27T20:20:02.198 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/160 2023-07-27T20:20:02.343 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/160 2023-07-27T20:20:02.511 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/160 2023-07-27T20:20:02.735 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/160 2023-07-27T20:20:02.980 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/160 2023-07-27T20:20:03.242 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/160 2023-07-27T20:20:03.596 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/160 2023-07-27T20:20:03.834 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/160 2023-07-27T20:20:04.062 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/160 2023-07-27T20:20:04.875 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/160 2023-07-27T20:20:05.057 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librgw2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 70/160 2023-07-27T20:20:05.138 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librgw2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 70/160 2023-07-27T20:20:05.335 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rgw-2:18.0.0-5128.ga5d48e8c.el8.x86_64 71/160 2023-07-27T20:20:05.542 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/160 2023-07-27T20:20:05.963 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 73/160 2023-07-27T20:20:06.222 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 74/160 2023-07-27T20:20:06.406 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/160 2023-07-27T20:20:06.691 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/160 2023-07-27T20:20:06.933 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/160 2023-07-27T20:20:08.190 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/160 2023-07-27T20:20:08.556 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/160 2023-07-27T20:20:08.767 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 80/160 2023-07-27T20:20:09.001 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 81/160 2023-07-27T20:20:09.287 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 82/160 2023-07-27T20:20:09.534 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/160 2023-07-27T20:20:09.761 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 84/160 2023-07-27T20:20:09.929 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 85/160 2023-07-27T20:20:10.252 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 86/160 2023-07-27T20:20:10.454 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 87/160 2023-07-27T20:20:10.592 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 88/160 2023-07-27T20:20:10.817 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 89/160 2023-07-27T20:20:11.161 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 90/160 2023-07-27T20:20:11.378 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 91/160 2023-07-27T20:20:11.513 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 92/160 2023-07-27T20:20:11.746 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 93/160 2023-07-27T20:20:12.017 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 94/160 2023-07-27T20:20:12.243 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : fuse-2.9.7-17.el8.x86_64 95/160 2023-07-27T20:20:12.451 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 96/160 2023-07-27T20:20:12.657 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : uuid-1.6.2-43.el8.x86_64 97/160 2023-07-27T20:20:12.781 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 97/160 2023-07-27T20:20:12.966 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 98/160 2023-07-27T20:20:13.115 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 99/160 2023-07-27T20:20:16.002 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-common-2:18.0.0-5128.ga5d48e8c.el8.x86_64 100/160 2023-07-27T20:20:16.231 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-common-2:18.0.0-5128.ga5d48e8c.el8.x86_64 100/160 2023-07-27T20:20:16.905 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-common-2:18.0.0-5128.ga5d48e8c.el8.x86_64 100/160 2023-07-27T20:20:17.348 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-base-2:18.0.0-5128.ga5d48e8c.el8.x86_64 101/160 2023-07-27T20:20:17.552 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-base-2:18.0.0-5128.ga5d48e8c.el8.x86_64 101/160 2023-07-27T20:20:17.763 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-selinux-2:18.0.0-5128.ga5d48e8c.el8.x86_64 102/160 2023-07-27T20:20:38.116 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5128.ga5d48e8c.el8.x86_64 102/160 2023-07-27T20:20:38.117 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /sys 2023-07-27T20:20:38.117 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /proc 2023-07-27T20:20:38.117 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /dev 2023-07-27T20:20:38.117 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /run 2023-07-27T20:20:38.117 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /mnt 2023-07-27T20:20:38.118 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /var/tmp 2023-07-27T20:20:38.118 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /home 2023-07-27T20:20:38.118 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /tmp 2023-07-27T20:20:38.118 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /dev 2023-07-27T20:20:38.118 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T20:20:38.503 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-volume-2:18.0.0-5128.ga5d48e8c.el8.noarch 103/160 2023-07-27T20:20:40.234 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-volume-2:18.0.0-5128.ga5d48e8c.el8.noarch 103/160 2023-07-27T20:20:40.436 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-osd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 104/160 2023-07-27T20:20:40.704 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-osd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 104/160 2023-07-27T20:20:40.902 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mds-2:18.0.0-5128.ga5d48e8c.el8.x86_64 105/160 2023-07-27T20:20:41.428 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mds-2:18.0.0-5128.ga5d48e8c.el8.x86_64 105/160 2023-07-27T20:20:41.635 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mon-2:18.0.0-5128.ga5d48e8c.el8.x86_64 106/160 2023-07-27T20:20:41.685 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mon-2:18.0.0-5128.ga5d48e8c.el8.x86_64 106/160 2023-07-27T20:20:41.894 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 107/160 2023-07-27T20:20:42.158 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 108/160 2023-07-27T20:20:42.310 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 109/160 2023-07-27T20:20:42.391 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 109/160 2023-07-27T20:20:42.709 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : jq-1.6-7.el8.x86_64 110/160 2023-07-27T20:20:42.935 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : automake-1.16.1-7.el8.noarch 111/160 2023-07-27T20:20:43.569 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: cephadm-2:18.0.0-5128.ga5d48e8c.el8.noarch 112/160 2023-07-27T20:20:43.739 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : cephadm-2:18.0.0-5128.ga5d48e8c.el8.noarch 112/160 2023-07-27T20:20:43.876 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5128.ga5d48e8c.e 113/160 2023-07-27T20:20:44.072 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5128.ga5d48e8c. 114/160 2023-07-27T20:20:44.293 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5128.ga5d48e8c.el8.noa 115/160 2023-07-27T20:20:44.551 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5128.ga5d48e8c.el8.noa 115/160 2023-07-27T20:20:44.793 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5128.ga5d48e8c.el8.n 116/160 2023-07-27T20:20:45.903 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5128.ga5d48e8c.el8.n 116/160 2023-07-27T20:20:46.109 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5128.ga5d 117/160 2023-07-27T20:20:46.235 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5128.ga5d 117/160 2023-07-27T20:20:46.602 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5128.ga5d48e8c.el 118/160 2023-07-27T20:20:46.794 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-2:18.0.0-5128.ga5d48e8c.el8.x86_64 119/160 2023-07-27T20:20:46.859 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5128.ga5d48e8c.el8.x86_64 119/160 2023-07-27T20:20:47.000 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-rook-2:18.0.0-5128.ga5d48e8c.el8.noarch 120/160 2023-07-27T20:20:47.027 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5128.ga5d48e8c.el8.noarch 120/160 2023-07-27T20:20:47.250 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-2:18.0.0-5128.ga5d48e8c.el8.x86_64 121/160 2023-07-27T20:20:47.417 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libtool-2.4.6-25.el8.x86_64 122/160 2023-07-27T20:20:52.426 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 122/160 2023-07-27T20:20:54.004 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-test-2:18.0.0-5128.ga5d48e8c.el8.x86_64 123/160 2023-07-27T20:20:54.185 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-radosgw-2:18.0.0-5128.ga5d48e8c.el8.x86_64 124/160 2023-07-27T20:20:54.245 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5128.ga5d48e8c.el8.x86_64 124/160 2023-07-27T20:20:54.431 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5128.ga5d48 125/160 2023-07-27T20:20:54.502 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5128.ga5d48 125/160 2023-07-27T20:20:54.758 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : cephfs-mirror-2:18.0.0-5128.ga5d48e8c.el8.x86_64 126/160 2023-07-27T20:20:55.174 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5128.ga5d48e8c.el8.x86_64 126/160 2023-07-27T20:20:55.367 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-mirror-2:18.0.0-5128.ga5d48e8c.el8.x86_64 127/160 2023-07-27T20:20:55.641 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5128.ga5d48e8c.el8.x86_64 127/160 2023-07-27T20:20:55.972 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 128/160 2023-07-27T20:20:57.188 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-fuse-2:18.0.0-5128.ga5d48e8c.el8.x86_64 129/160 2023-07-27T20:20:57.822 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 130/160 2023-07-27T20:20:58.040 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 131/160 2023-07-27T20:20:58.231 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 132/160 2023-07-27T20:20:58.388 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/160 2023-07-27T20:20:58.584 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephfs-devel-2:18.0.0-5128.ga5d48e8c.el8.x86_ 134/160 2023-07-27T20:20:59.825 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-27T20:21:00.109 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-27T20:21:00.208 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-27T20:21:00.412 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 136/160 2023-07-27T20:21:00.666 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : cephfs-top-2:18.0.0-5128.ga5d48e8c.el8.noarch 137/160 2023-07-27T20:21:00.900 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-fuse-2:18.0.0-5128.ga5d48e8c.el8.x86_64 138/160 2023-07-27T20:21:01.232 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-nbd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 139/160 2023-07-27T20:21:01.551 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 140/160 2023-07-27T20:21:01.698 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-07-27T20:21:01.723 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-07-27T20:21:01.975 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 142/160 2023-07-27T20:21:02.215 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/160 2023-07-27T20:21:02.334 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/160 2023-07-27T20:21:02.549 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/160 2023-07-27T20:21:02.575 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/160 2023-07-27T20:21:02.775 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 145/160 2023-07-27T20:21:02.935 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 146/160 2023-07-27T20:21:03.111 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 147/160 2023-07-27T20:21:03.112 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-07-27T20:21:03.386 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-07-27T20:21:03.386 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-07-27T20:21:03.635 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-07-27T20:21:03.651 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-07-27T20:21:03.780 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-07-27T20:21:03.780 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 151/160 2023-07-27T20:21:04.081 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 151/160 2023-07-27T20:21:04.275 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 152/160 2023-07-27T20:21:04.408 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 153/160 2023-07-27T20:21:04.617 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 154/160 2023-07-27T20:21:04.617 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 155/160 2023-07-27T20:21:04.818 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 155/160 2023-07-27T20:21:04.818 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 156/160 2023-07-27T20:21:05.035 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 156/160 2023-07-27T20:21:05.035 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 157/160 2023-07-27T20:21:05.243 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 157/160 2023-07-27T20:21:05.243 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 158/160 2023-07-27T20:21:05.468 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 158/160 2023-07-27T20:21:05.468 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-07-27T20:21:05.685 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-07-27T20:21:05.858 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-07-27T20:21:06.066 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-07-27T20:21:06.066 INFO:teuthology.orchestra.run.smithi173.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-07-27T20:21:06.066 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T20:21:06.783 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-2:18.0.0-5128.ga5d48e8c.el8.x86_64 1/160 2023-07-27T20:21:06.783 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-base-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2/160 2023-07-27T20:21:06.783 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-common-2:18.0.0-5128.ga5d48e8c.el8.x86_64 3/160 2023-07-27T20:21:06.783 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-fuse-2:18.0.0-5128.ga5d48e8c.el8.x86_64 4/160 2023-07-27T20:21:06.784 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5128.ga5d48 5/160 2023-07-27T20:21:06.784 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mds-2:18.0.0-5128.ga5d48e8c.el8.x86_64 6/160 2023-07-27T20:21:06.784 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-2:18.0.0-5128.ga5d48e8c.el8.x86_64 7/160 2023-07-27T20:21:06.784 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mon-2:18.0.0-5128.ga5d48e8c.el8.x86_64 8/160 2023-07-27T20:21:06.784 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-osd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 9/160 2023-07-27T20:21:06.784 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-radosgw-2:18.0.0-5128.ga5d48e8c.el8.x86_64 10/160 2023-07-27T20:21:06.784 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-selinux-2:18.0.0-5128.ga5d48e8c.el8.x86_64 11/160 2023-07-27T20:21:06.785 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-test-2:18.0.0-5128.ga5d48e8c.el8.x86_64 12/160 2023-07-27T20:21:06.785 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : cephfs-mirror-2:18.0.0-5128.ga5d48e8c.el8.x86_64 13/160 2023-07-27T20:21:06.785 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephfs-devel-2:18.0.0-5128.ga5d48e8c.el8.x86_ 14/160 2023-07-27T20:21:06.785 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephfs2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 15/160 2023-07-27T20:21:06.785 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephsqlite-2:18.0.0-5128.ga5d48e8c.el8.x86_64 16/160 2023-07-27T20:21:06.785 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados-devel-2:18.0.0-5128.ga5d48e8c.el8.x86_6 17/160 2023-07-27T20:21:06.785 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libradosstriper1-2:18.0.0-5128.ga5d48e8c.el8.x86 18/160 2023-07-27T20:21:06.786 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librgw2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 19/160 2023-07-27T20:21:06.786 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5128.ga5d48e8c.el 20/160 2023-07-27T20:21:06.786 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ceph-common-2:18.0.0-5128.ga5d48e8c.el8. 21/160 2023-07-27T20:21:06.786 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cephfs-2:18.0.0-5128.ga5d48e8c.el8.x86_6 22/160 2023-07-27T20:21:06.786 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rados-2:18.0.0-5128.ga5d48e8c.el8.x86_64 23/160 2023-07-27T20:21:06.786 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rbd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 24/160 2023-07-27T20:21:06.786 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rgw-2:18.0.0-5128.ga5d48e8c.el8.x86_64 25/160 2023-07-27T20:21:06.787 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-fuse-2:18.0.0-5128.ga5d48e8c.el8.x86_64 26/160 2023-07-27T20:21:06.787 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-mirror-2:18.0.0-5128.ga5d48e8c.el8.x86_64 27/160 2023-07-27T20:21:06.787 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-nbd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 28/160 2023-07-27T20:21:06.787 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5128.ga5d48e8c. 29/160 2023-07-27T20:21:06.787 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5128.ga5d48e8c.el8.noa 30/160 2023-07-27T20:21:06.795 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5128.ga5d48e8c.el8.n 31/160 2023-07-27T20:21:06.796 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5128.ga5d 32/160 2023-07-27T20:21:06.796 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5128.ga5d48e8c.el 33/160 2023-07-27T20:21:06.796 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5128.ga5d48e8c.el8.noarch 34/160 2023-07-27T20:21:06.796 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5128.ga5d48e8c.e 35/160 2023-07-27T20:21:06.796 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-volume-2:18.0.0-5128.ga5d48e8c.el8.noarch 36/160 2023-07-27T20:21:06.796 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : cephadm-2:18.0.0-5128.ga5d48e8c.el8.noarch 37/160 2023-07-27T20:21:06.796 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : cephfs-top-2:18.0.0-5128.ga5d48e8c.el8.noarch 38/160 2023-07-27T20:21:06.797 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/160 2023-07-27T20:21:06.797 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/160 2023-07-27T20:21:06.797 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/160 2023-07-27T20:21:06.797 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : jq-1.6-7.el8.x86_64 42/160 2023-07-27T20:21:06.797 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/160 2023-07-27T20:21:06.797 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/160 2023-07-27T20:21:06.797 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/160 2023-07-27T20:21:06.797 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/160 2023-07-27T20:21:06.798 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/160 2023-07-27T20:21:06.798 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/160 2023-07-27T20:21:06.798 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/160 2023-07-27T20:21:06.798 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/160 2023-07-27T20:21:06.798 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/160 2023-07-27T20:21:06.798 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/160 2023-07-27T20:21:06.799 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/160 2023-07-27T20:21:06.799 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/160 2023-07-27T20:21:06.799 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/160 2023-07-27T20:21:06.799 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/160 2023-07-27T20:21:06.799 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/160 2023-07-27T20:21:06.799 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/160 2023-07-27T20:21:06.799 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/160 2023-07-27T20:21:06.799 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/160 2023-07-27T20:21:06.800 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/160 2023-07-27T20:21:06.800 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/160 2023-07-27T20:21:06.800 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/160 2023-07-27T20:21:06.800 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/160 2023-07-27T20:21:06.800 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/160 2023-07-27T20:21:06.800 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/160 2023-07-27T20:21:06.800 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/160 2023-07-27T20:21:06.801 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/160 2023-07-27T20:21:06.801 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/160 2023-07-27T20:21:06.801 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/160 2023-07-27T20:21:06.801 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/160 2023-07-27T20:21:06.801 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/160 2023-07-27T20:21:06.801 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/160 2023-07-27T20:21:06.801 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/160 2023-07-27T20:21:06.801 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/160 2023-07-27T20:21:06.802 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/160 2023-07-27T20:21:06.802 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 77/160 2023-07-27T20:21:06.802 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 78/160 2023-07-27T20:21:06.802 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 79/160 2023-07-27T20:21:06.802 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/160 2023-07-27T20:21:06.802 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/160 2023-07-27T20:21:06.802 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 82/160 2023-07-27T20:21:06.803 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/160 2023-07-27T20:21:06.803 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/160 2023-07-27T20:21:06.803 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/160 2023-07-27T20:21:06.803 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/160 2023-07-27T20:21:06.803 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/160 2023-07-27T20:21:06.803 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/160 2023-07-27T20:21:06.803 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/160 2023-07-27T20:21:06.804 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 90/160 2023-07-27T20:21:06.804 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/160 2023-07-27T20:21:06.804 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/160 2023-07-27T20:21:06.804 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/160 2023-07-27T20:21:06.804 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/160 2023-07-27T20:21:06.804 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/160 2023-07-27T20:21:06.804 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/160 2023-07-27T20:21:06.805 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/160 2023-07-27T20:21:06.805 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/160 2023-07-27T20:21:06.805 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/160 2023-07-27T20:21:06.805 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/160 2023-07-27T20:21:06.805 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/160 2023-07-27T20:21:06.805 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/160 2023-07-27T20:21:06.805 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/160 2023-07-27T20:21:06.805 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/160 2023-07-27T20:21:06.806 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/160 2023-07-27T20:21:06.806 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/160 2023-07-27T20:21:06.806 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/160 2023-07-27T20:21:06.806 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/160 2023-07-27T20:21:06.806 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/160 2023-07-27T20:21:06.806 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/160 2023-07-27T20:21:06.806 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/160 2023-07-27T20:21:06.807 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/160 2023-07-27T20:21:06.807 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/160 2023-07-27T20:21:06.807 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/160 2023-07-27T20:21:06.807 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/160 2023-07-27T20:21:06.807 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/160 2023-07-27T20:21:06.807 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/160 2023-07-27T20:21:06.807 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 118/160 2023-07-27T20:21:06.808 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/160 2023-07-27T20:21:06.808 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/160 2023-07-27T20:21:06.808 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/160 2023-07-27T20:21:06.808 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/160 2023-07-27T20:21:06.808 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 123/160 2023-07-27T20:21:06.808 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/160 2023-07-27T20:21:06.808 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/160 2023-07-27T20:21:06.808 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/160 2023-07-27T20:21:06.809 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/160 2023-07-27T20:21:06.809 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/160 2023-07-27T20:21:06.809 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 129/160 2023-07-27T20:21:06.809 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/160 2023-07-27T20:21:06.809 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librbd1-2:18.0.0-5128.ga5d48e8c.el8.x86_64 131/160 2023-07-27T20:21:06.809 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/160 2023-07-27T20:21:06.809 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-8.el 133/160 2023-07-27T20:21:06.810 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 134/160 2023-07-27T20:21:06.810 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 135/160 2023-07-27T20:21:06.810 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 136/160 2023-07-27T20:21:06.810 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 137/160 2023-07-27T20:21:06.810 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 138/160 2023-07-27T20:21:06.810 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 139/160 2023-07-27T20:21:06.810 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 140/160 2023-07-27T20:21:06.811 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 141/160 2023-07-27T20:21:06.811 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 142/160 2023-07-27T20:21:06.811 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 143/160 2023-07-27T20:21:06.811 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 144/160 2023-07-27T20:21:06.811 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 145/160 2023-07-27T20:21:06.811 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 146/160 2023-07-27T20:21:06.811 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 147/160 2023-07-27T20:21:06.811 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 148/160 2023-07-27T20:21:06.812 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 149/160 2023-07-27T20:21:06.812 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 150/160 2023-07-27T20:21:06.812 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 151/160 2023-07-27T20:21:06.812 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 152/160 2023-07-27T20:21:06.812 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 153/160 2023-07-27T20:21:06.812 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 154/160 2023-07-27T20:21:06.812 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 155/160 2023-07-27T20:21:06.812 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 156/160 2023-07-27T20:21:06.813 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 157/160 2023-07-27T20:21:06.813 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 158/160 2023-07-27T20:21:06.813 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 159/160 2023-07-27T20:21:08.915 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 160/160 2023-07-27T20:21:08.915 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T20:21:08.915 INFO:teuthology.orchestra.run.smithi173.stdout:Upgraded: 2023-07-27T20:21:08.915 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-initscripts-updown-1:1.40.16-8.el8.noarch 2023-07-27T20:21:08.916 INFO:teuthology.orchestra.run.smithi173.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-07-27T20:21:08.916 INFO:teuthology.orchestra.run.smithi173.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-07-27T20:21:08.916 INFO:teuthology.orchestra.run.smithi173.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-07-27T20:21:08.916 INFO:teuthology.orchestra.run.smithi173.stdout: iproute-6.2.0-2.el8.x86_64 2023-07-27T20:21:08.916 INFO:teuthology.orchestra.run.smithi173.stdout: libblkid-2.32.1-42.el8.x86_64 2023-07-27T20:21:08.916 INFO:teuthology.orchestra.run.smithi173.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-07-27T20:21:08.916 INFO:teuthology.orchestra.run.smithi173.stdout: libmount-2.32.1-42.el8.x86_64 2023-07-27T20:21:08.917 INFO:teuthology.orchestra.run.smithi173.stdout: librados2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:21:08.917 INFO:teuthology.orchestra.run.smithi173.stdout: librbd1-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:21:08.917 INFO:teuthology.orchestra.run.smithi173.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-07-27T20:21:08.917 INFO:teuthology.orchestra.run.smithi173.stdout: libuuid-2.32.1-42.el8.x86_64 2023-07-27T20:21:08.917 INFO:teuthology.orchestra.run.smithi173.stdout: util-linux-2.32.1-42.el8.x86_64 2023-07-27T20:21:08.917 INFO:teuthology.orchestra.run.smithi173.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-07-27T20:21:08.917 INFO:teuthology.orchestra.run.smithi173.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-07-27T20:21:08.917 INFO:teuthology.orchestra.run.smithi173.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-07-27T20:21:08.918 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2023-07-27T20:21:08.918 INFO:teuthology.orchestra.run.smithi173.stdout: automake-1.16.1-7.el8.noarch 2023-07-27T20:21:08.918 INFO:teuthology.orchestra.run.smithi173.stdout: bison-3.0.4-10.el8.x86_64 2023-07-27T20:21:08.918 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:21:08.918 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-base-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:21:08.918 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-common-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:21:08.918 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-fuse-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:21:08.919 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-grafana-dashboards-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-27T20:21:08.919 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-immutable-object-cache-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:21:08.919 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mds-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:21:08.919 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:21:08.919 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-cephadm-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-27T20:21:08.919 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-dashboard-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-27T20:21:08.919 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-27T20:21:08.919 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-modules-core-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-27T20:21:08.920 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-rook-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-27T20:21:08.920 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mon-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:21:08.920 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-osd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:21:08.920 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-prometheus-alerts-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-27T20:21:08.920 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-radosgw-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:21:08.920 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-selinux-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:21:08.920 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-test-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:21:08.921 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-volume-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-27T20:21:08.921 INFO:teuthology.orchestra.run.smithi173.stdout: cephadm-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-27T20:21:08.921 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-mirror-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:21:08.921 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-top-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-27T20:21:08.921 INFO:teuthology.orchestra.run.smithi173.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-07-27T20:21:08.921 INFO:teuthology.orchestra.run.smithi173.stdout: flex-2.6.1-9.el8.x86_64 2023-07-27T20:21:08.921 INFO:teuthology.orchestra.run.smithi173.stdout: fuse-2.9.7-17.el8.x86_64 2023-07-27T20:21:08.921 INFO:teuthology.orchestra.run.smithi173.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-27T20:21:08.922 INFO:teuthology.orchestra.run.smithi173.stdout: jq-1.6-7.el8.x86_64 2023-07-27T20:21:08.922 INFO:teuthology.orchestra.run.smithi173.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-27T20:21:08.922 INFO:teuthology.orchestra.run.smithi173.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-07-27T20:21:08.922 INFO:teuthology.orchestra.run.smithi173.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-27T20:21:08.922 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs-devel-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:21:08.922 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:21:08.922 INFO:teuthology.orchestra.run.smithi173.stdout: libcephsqlite-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:21:08.922 INFO:teuthology.orchestra.run.smithi173.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-07-27T20:21:08.923 INFO:teuthology.orchestra.run.smithi173.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-07-27T20:21:08.923 INFO:teuthology.orchestra.run.smithi173.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-27T20:21:08.923 INFO:teuthology.orchestra.run.smithi173.stdout: libpq-13.5-1.el8.x86_64 2023-07-27T20:21:08.923 INFO:teuthology.orchestra.run.smithi173.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-07-27T20:21:08.923 INFO:teuthology.orchestra.run.smithi173.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-07-27T20:21:08.923 INFO:teuthology.orchestra.run.smithi173.stdout: librados-devel-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:21:08.923 INFO:teuthology.orchestra.run.smithi173.stdout: libradosstriper1-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:21:08.924 INFO:teuthology.orchestra.run.smithi173.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-27T20:21:08.924 INFO:teuthology.orchestra.run.smithi173.stdout: librgw2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:21:08.924 INFO:teuthology.orchestra.run.smithi173.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-07-27T20:21:08.924 INFO:teuthology.orchestra.run.smithi173.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-27T20:21:08.924 INFO:teuthology.orchestra.run.smithi173.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-27T20:21:08.924 INFO:teuthology.orchestra.run.smithi173.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-27T20:21:08.924 INFO:teuthology.orchestra.run.smithi173.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-07-27T20:21:08.924 INFO:teuthology.orchestra.run.smithi173.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-07-27T20:21:08.925 INFO:teuthology.orchestra.run.smithi173.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-07-27T20:21:08.925 INFO:teuthology.orchestra.run.smithi173.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-27T20:21:08.925 INFO:teuthology.orchestra.run.smithi173.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-27T20:21:08.925 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-0.3.15-4.el8.x86_64 2023-07-27T20:21:08.925 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-07-27T20:21:08.925 INFO:teuthology.orchestra.run.smithi173.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-07-27T20:21:08.925 INFO:teuthology.orchestra.run.smithi173.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-07-27T20:21:08.925 INFO:teuthology.orchestra.run.smithi173.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-07-27T20:21:08.926 INFO:teuthology.orchestra.run.smithi173.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-07-27T20:21:08.926 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-27T20:21:08.926 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-27T20:21:08.926 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-27T20:21:08.926 INFO:teuthology.orchestra.run.smithi173.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-27T20:21:08.926 INFO:teuthology.orchestra.run.smithi173.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-27T20:21:08.926 INFO:teuthology.orchestra.run.smithi173.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-27T20:21:08.926 INFO:teuthology.orchestra.run.smithi173.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-27T20:21:08.927 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-27T20:21:08.927 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-argparse-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:21:08.927 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-common-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:21:08.927 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cephfs-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:21:08.927 INFO:teuthology.orchestra.run.smithi173.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-27T20:21:08.927 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-07-27T20:21:08.927 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-27T20:21:08.928 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-27T20:21:08.928 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-07-27T20:21:08.928 INFO:teuthology.orchestra.run.smithi173.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-27T20:21:08.928 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-27T20:21:08.928 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-27T20:21:08.928 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-27T20:21:08.928 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-27T20:21:08.928 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-27T20:21:08.929 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-27T20:21:08.929 INFO:teuthology.orchestra.run.smithi173.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-27T20:21:08.929 INFO:teuthology.orchestra.run.smithi173.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-27T20:21:08.929 INFO:teuthology.orchestra.run.smithi173.stdout: python3-mako-1.0.6-14.el8.noarch 2023-07-27T20:21:08.929 INFO:teuthology.orchestra.run.smithi173.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-27T20:21:08.929 INFO:teuthology.orchestra.run.smithi173.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-27T20:21:08.929 INFO:teuthology.orchestra.run.smithi173.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-27T20:21:08.929 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-27T20:21:08.930 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-27T20:21:08.930 INFO:teuthology.orchestra.run.smithi173.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-27T20:21:08.930 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-27T20:21:08.930 INFO:teuthology.orchestra.run.smithi173.stdout: python3-portend-2.6-1.el8.noarch 2023-07-27T20:21:08.930 INFO:teuthology.orchestra.run.smithi173.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-27T20:21:08.930 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-27T20:21:08.930 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-27T20:21:08.931 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-27T20:21:08.931 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-27T20:21:08.931 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-27T20:21:08.931 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rados-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:21:08.931 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rbd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:21:08.931 INFO:teuthology.orchestra.run.smithi173.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-27T20:21:08.931 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-27T20:21:08.931 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rgw-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:21:08.932 INFO:teuthology.orchestra.run.smithi173.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-27T20:21:08.932 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rsa-4.9-2.el8.noarch 2023-07-27T20:21:08.932 INFO:teuthology.orchestra.run.smithi173.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-07-27T20:21:08.932 INFO:teuthology.orchestra.run.smithi173.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-27T20:21:08.932 INFO:teuthology.orchestra.run.smithi173.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-27T20:21:08.932 INFO:teuthology.orchestra.run.smithi173.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-27T20:21:08.932 INFO:teuthology.orchestra.run.smithi173.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-27T20:21:08.932 INFO:teuthology.orchestra.run.smithi173.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-27T20:21:08.933 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-27T20:21:08.933 INFO:teuthology.orchestra.run.smithi173.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-27T20:21:08.933 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-27T20:21:08.933 INFO:teuthology.orchestra.run.smithi173.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-27T20:21:08.933 INFO:teuthology.orchestra.run.smithi173.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-27T20:21:08.933 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-fuse-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:21:08.933 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-mirror-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:21:08.933 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-nbd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:21:08.934 INFO:teuthology.orchestra.run.smithi173.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-27T20:21:08.934 INFO:teuthology.orchestra.run.smithi173.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-27T20:21:08.934 INFO:teuthology.orchestra.run.smithi173.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-27T20:21:08.934 INFO:teuthology.orchestra.run.smithi173.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-07-27T20:21:08.934 INFO:teuthology.orchestra.run.smithi173.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-27T20:21:08.935 INFO:teuthology.orchestra.run.smithi173.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-07-27T20:21:08.935 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T20:21:08.935 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2023-07-27T20:21:09.279 DEBUG:teuthology.parallel:result is None 2023-07-27T20:23:06.228 INFO:teuthology.orchestra.run.smithi072.stdout:[MIRROR] automake-1.16.1-7.el8.noarch.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/automake-1.16.1-7.el8.noarch.rpm [Recv failure: Connection reset by peer] 2023-07-27T20:23:06.228 INFO:teuthology.orchestra.run.smithi072.stdout:[MIRROR] bison-3.0.4-10.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/bison-3.0.4-10.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-07-27T20:23:07.134 INFO:teuthology.orchestra.run.smithi072.stdout:(39/144): bison-3.0.4-10.el8.x86_64.rpm 2.5 kB/s | 688 kB 04:32 2023-07-27T20:23:07.168 INFO:teuthology.orchestra.run.smithi072.stdout:(40/144): automake-1.16.1-7.el8.noarch.rpm 2.5 kB/s | 713 kB 04:41 2023-07-27T20:23:47.254 INFO:teuthology.orchestra.run.smithi072.stdout:[MIRROR] flex-2.6.1-9.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/flex-2.6.1-9.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-07-27T20:23:48.040 INFO:teuthology.orchestra.run.smithi072.stdout:(41/144): flex-2.6.1-9.el8.x86_64.rpm 1.2 kB/s | 320 kB 04:23 2023-07-27T20:23:48.332 INFO:teuthology.orchestra.run.smithi072.stdout:(42/144): librdkafka-0.11.4-3.el8.x86_64.rpm 1.2 MB/s | 354 kB 00:00 2023-07-27T20:23:48.682 INFO:teuthology.orchestra.run.smithi072.stdout:(43/144): libtool-2.4.6-25.el8.x86_64.rpm 2.0 MB/s | 709 kB 00:00 2023-07-27T20:23:48.858 INFO:teuthology.orchestra.run.smithi072.stdout:(44/144): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.4 MB/s | 259 kB 00:00 2023-07-27T20:23:49.042 INFO:teuthology.orchestra.run.smithi072.stdout:(45/144): oniguruma-6.8.2-2.el8.x86_64.rpm 1.0 MB/s | 187 kB 00:00 2023-07-27T20:23:49.667 INFO:teuthology.orchestra.run.smithi072.stdout:(46/144): openblas-0.3.15-4.el8.x86_64.rpm 7.6 MB/s | 4.7 MB 00:00 2023-07-27T20:23:50.268 INFO:teuthology.orchestra.run.smithi072.stdout:(47/144): openblas-threads-0.3.15-4.el8.x86_64. 8.1 MB/s | 4.9 MB 00:00 2023-07-27T20:23:50.577 INFO:teuthology.orchestra.run.smithi072.stdout:(48/144): postgresql-10.23-1.module_el8+300+2c5 5.1 MB/s | 1.6 MB 00:00 2023-07-27T20:23:50.752 INFO:teuthology.orchestra.run.smithi072.stdout:(49/144): postgresql-contrib-10.23-1.module_el8 5.0 MB/s | 903 kB 00:00 2023-07-27T20:23:51.236 INFO:teuthology.orchestra.run.smithi072.stdout:(50/144): postgresql-server-10.23-1.module_el8+ 11 MB/s | 5.1 MB 00:00 2023-07-27T20:23:51.761 INFO:teuthology.orchestra.run.smithi072.stdout:(51/144): python3-babel-2.5.1-7.el8.noarch.rpm 9.1 MB/s | 4.8 MB 00:00 2023-07-27T20:23:51.938 INFO:teuthology.orchestra.run.smithi072.stdout:(52/144): python3-jinja2-2.10.1-3.el8.noarch.rp 3.0 MB/s | 538 kB 00:00 2023-07-27T20:23:52.097 INFO:teuthology.orchestra.run.smithi072.stdout:(53/144): python3-jsonpatch-1.21-2.el8.noarch.r 167 kB/s | 27 kB 00:00 2023-07-27T20:23:52.256 INFO:teuthology.orchestra.run.smithi072.stdout:(54/144): python3-jsonpointer-1.10-11.el8.noarc 126 kB/s | 20 kB 00:00 2023-07-27T20:23:52.415 INFO:teuthology.orchestra.run.smithi072.stdout:(55/144): python3-mako-1.0.6-14.el8.noarch.rpm 990 kB/s | 157 kB 00:00 2023-07-27T20:23:52.566 INFO:teuthology.orchestra.run.smithi072.stdout:(56/144): python3-markupsafe-0.23-19.el8.x86_64 258 kB/s | 39 kB 00:00 2023-07-27T20:23:53.091 INFO:teuthology.orchestra.run.smithi072.stdout:(57/144): python3-numpy-1.14.3-10.el8.x86_64.rp 7.1 MB/s | 3.7 MB 00:00 2023-07-27T20:23:53.258 INFO:teuthology.orchestra.run.smithi072.stdout:(58/144): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.3 MB/s | 225 kB 00:00 2023-07-27T20:23:53.409 INFO:teuthology.orchestra.run.smithi072.stdout:(59/144): python3-prettytable-0.7.2-14.el8.noar 293 kB/s | 44 kB 00:00 2023-07-27T20:23:53.542 INFO:teuthology.orchestra.run.smithi072.stdout:(60/144): python3-pyOpenSSL-19.0.0-1.el8.noarch 775 kB/s | 103 kB 00:00 2023-07-27T20:23:53.668 INFO:teuthology.orchestra.run.smithi072.stdout:(61/144): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.0 MB/s | 126 kB 00:00 2023-07-27T20:23:53.802 INFO:teuthology.orchestra.run.smithi072.stdout:(62/144): python3-pyasn1-modules-0.3.7-6.el8.no 824 kB/s | 110 kB 00:00 2023-07-27T20:23:53.927 INFO:teuthology.orchestra.run.smithi072.stdout:(63/144): python3-pytz-2017.2-9.el8.noarch.rpm 431 kB/s | 54 kB 00:00 2023-07-27T20:23:55.120 INFO:teuthology.orchestra.run.smithi072.stdout:(64/144): python3-scipy-1.0.0-21.module_el8.5.0 11 MB/s | 14 MB 00:01 2023-07-27T20:23:55.212 INFO:teuthology.orchestra.run.smithi072.stdout:(65/144): python3-werkzeug-0.12.2-4.el8.noarch. 4.9 MB/s | 457 kB 00:00 2023-07-27T20:23:55.304 INFO:teuthology.orchestra.run.smithi072.stdout:(66/144): socat-1.7.4.1-1.el8.x86_64.rpm 3.4 MB/s | 323 kB 00:00 2023-07-27T20:23:55.398 INFO:teuthology.orchestra.run.smithi072.stdout:(67/144): uuid-1.6.2-43.el8.x86_64.rpm 686 kB/s | 64 kB 00:00 2023-07-27T20:23:55.532 INFO:teuthology.orchestra.run.smithi072.stdout:(68/144): xmlstarlet-1.6.1-20.el8.x86_64.rpm 528 kB/s | 71 kB 00:00 2023-07-27T20:23:55.932 INFO:teuthology.orchestra.run.smithi072.stdout:(69/144): elfutils-libelf-devel-0.189-2.el8.x86 154 kB/s | 61 kB 00:00 2023-07-27T20:23:56.158 INFO:teuthology.orchestra.run.smithi072.stdout:(70/144): fuse-2.9.7-17.el8.x86_64.rpm 368 kB/s | 83 kB 00:00 2023-07-27T20:23:56.291 INFO:teuthology.orchestra.run.smithi072.stdout:(71/144): keyutils-libs-devel-1.5.10-9.el8.x86_ 360 kB/s | 48 kB 00:00 2023-07-27T20:23:56.684 INFO:teuthology.orchestra.run.smithi072.stdout:(72/144): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.4 MB/s | 561 kB 00:00 2023-07-27T20:23:56.809 INFO:teuthology.orchestra.run.smithi072.stdout:(73/144): libaio-devel-0.3.112-1.el8.x86_64.rpm 149 kB/s | 19 kB 00:00 2023-07-27T20:23:56.935 INFO:teuthology.orchestra.run.smithi072.stdout:(74/144): libcom_err-devel-1.45.6-5.el8.x86_64. 309 kB/s | 39 kB 00:00 2023-07-27T20:23:57.244 INFO:teuthology.orchestra.run.smithi072.stdout:(75/144): libgfortran-8.5.0-20.el8.x86_64.rpm 2.0 MB/s | 645 kB 00:00 2023-07-27T20:23:57.386 INFO:teuthology.orchestra.run.smithi072.stdout:(76/144): libquadmath-8.5.0-20.el8.x86_64.rpm 1.2 MB/s | 172 kB 00:00 2023-07-27T20:23:57.503 INFO:teuthology.orchestra.run.smithi072.stdout:(77/144): librabbitmq-0.9.0-4.el8.x86_64.rpm 402 kB/s | 47 kB 00:00 2023-07-27T20:23:57.637 INFO:teuthology.orchestra.run.smithi072.stdout:(78/144): libselinux-devel-2.9-8.el8.x86_64.rpm 1.5 MB/s | 200 kB 00:00 2023-07-27T20:23:57.829 INFO:teuthology.orchestra.run.smithi072.stdout:(79/144): libsepol-devel-2.9-3.el8.x86_64.rpm 454 kB/s | 87 kB 00:00 2023-07-27T20:23:57.963 INFO:teuthology.orchestra.run.smithi072.stdout:(80/144): libuuid-devel-2.32.1-42.el8.x86_64.rp 745 kB/s | 99 kB 00:00 2023-07-27T20:23:58.088 INFO:teuthology.orchestra.run.smithi072.stdout:(81/144): libverto-devel-0.3.2-2.el8.x86_64.rpm 144 kB/s | 18 kB 00:00 2023-07-27T20:23:58.224 INFO:teuthology.orchestra.run.smithi072.stdout:(82/144): libzstd-devel-1.4.4-1.el8.x86_64.rpm 324 kB/s | 44 kB 00:00 2023-07-27T20:24:00.249 INFO:teuthology.orchestra.run.smithi072.stdout:(83/144): openssl-devel-1.1.1k-9.el8.x86_64.rpm 1.6 MB/s | 3.2 MB 00:02 2023-07-27T20:24:01.425 INFO:teuthology.orchestra.run.smithi072.stdout:(84/144): pcre2-devel-10.32-3.el8.x86_64.rpm 515 kB/s | 605 kB 00:01 2023-07-27T20:24:01.917 INFO:teuthology.orchestra.run.smithi072.stdout:(85/144): pcre2-utf16-10.32-3.el8.x86_64.rpm 466 kB/s | 229 kB 00:00 2023-07-27T20:24:02.443 INFO:teuthology.orchestra.run.smithi072.stdout:(86/144): pcre2-utf32-10.32-3.el8.x86_64.rpm 420 kB/s | 220 kB 00:00 2023-07-27T20:24:03.026 INFO:teuthology.orchestra.run.smithi072.stdout:(87/144): python3-cffi-1.11.5-6.el8.x86_64.rpm 426 kB/s | 249 kB 00:00 2023-07-27T20:24:04.610 INFO:teuthology.orchestra.run.smithi072.stdout:(88/144): python3-cryptography-3.2.1-6.el8.x86_ 405 kB/s | 641 kB 00:01 2023-07-27T20:24:04.811 INFO:teuthology.orchestra.run.smithi072.stdout:(89/144): python3-jwt-1.6.1-2.el8.noarch.rpm 213 kB/s | 43 kB 00:00 2023-07-27T20:24:05.228 INFO:teuthology.orchestra.run.smithi072.stdout:(90/144): python3-oauthlib-2.1.0-1.el8.noarch.r 372 kB/s | 155 kB 00:00 2023-07-27T20:24:05.536 INFO:teuthology.orchestra.run.smithi072.stdout:(91/144): python3-pycparser-2.14-14.el8.noarch. 353 kB/s | 109 kB 00:00 2023-07-27T20:24:05.721 INFO:teuthology.orchestra.run.smithi072.stdout:(92/144): python3-requests-oauthlib-1.0.0-1.el8 232 kB/s | 43 kB 00:00 2023-07-27T20:24:06.063 INFO:teuthology.orchestra.run.smithi072.stdout:(93/144): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 218 kB/s | 74 kB 00:00 2023-07-27T20:24:06.246 INFO:teuthology.orchestra.run.smithi072.stdout:(94/144): zlib-devel-1.2.11-21.el8.x86_64.rpm 317 kB/s | 58 kB 00:00 2023-07-27T20:24:07.114 INFO:teuthology.orchestra.run.smithi072.stdout:(95/144): gperftools-libs-2.7-9.el8.x86_64.rpm 353 kB/s | 306 kB 00:00 2023-07-27T20:24:07.274 INFO:teuthology.orchestra.run.smithi072.stdout:(96/144): liboath-2.6.2-3.el8.x86_64.rpm 368 kB/s | 59 kB 00:00 2023-07-27T20:24:07.433 INFO:teuthology.orchestra.run.smithi072.stdout:(97/144): libunwind-1.3.1-3.el8.x86_64.rpm 473 kB/s | 75 kB 00:00 2023-07-27T20:24:07.725 INFO:teuthology.orchestra.run.smithi072.stdout:(98/144): python3-asyncssh-2.7.0-2.el8.noarch.r 1.6 MB/s | 476 kB 00:00 2023-07-27T20:24:07.843 INFO:teuthology.orchestra.run.smithi072.stdout:(99/144): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 372 kB/s | 44 kB 00:00 2023-07-27T20:24:07.960 INFO:teuthology.orchestra.run.smithi072.stdout:(100/144): python3-beautifulsoup4-4.6.3-2.el8.1 1.6 MB/s | 185 kB 00:00 2023-07-27T20:24:08.077 INFO:teuthology.orchestra.run.smithi072.stdout:(101/144): python3-cachetools-3.1.1-4.el8.noarc 282 kB/s | 33 kB 00:00 2023-07-27T20:24:08.219 INFO:teuthology.orchestra.run.smithi072.stdout:(102/144): python3-certifi-2018.10.15-7.el8.noa 115 kB/s | 16 kB 00:00 2023-07-27T20:24:08.769 INFO:teuthology.orchestra.run.smithi072.stdout:(103/144): python3-cheroot-8.5.2-1.el8.noarch.r 314 kB/s | 173 kB 00:00 2023-07-27T20:24:08.987 INFO:teuthology.orchestra.run.smithi072.stdout:(104/144): python3-cherrypy-18.4.0-1.el8.noarch 1.7 MB/s | 384 kB 00:00 2023-07-27T20:24:09.146 INFO:teuthology.orchestra.run.smithi072.stdout:(105/144): python3-google-auth-1.1.1-10.el8.noa 512 kB/s | 81 kB 00:00 2023-07-27T20:24:09.588 INFO:teuthology.orchestra.run.smithi072.stdout:(106/144): python3-jaraco-6.2-6.el8.noarch.rpm 25 kB/s | 11 kB 00:00 2023-07-27T20:24:09.730 INFO:teuthology.orchestra.run.smithi072.stdout:(107/144): python3-jaraco-functools-2.0-4.el8.n 124 kB/s | 18 kB 00:00 2023-07-27T20:24:10.505 INFO:teuthology.orchestra.run.smithi072.stdout:(108/144): python3-kubernetes-11.0.0-6.el8.noar 1.5 MB/s | 1.2 MB 00:00 2023-07-27T20:24:10.639 INFO:teuthology.orchestra.run.smithi072.stdout:(109/144): python3-logutils-0.3.5-11.el8.noarch 365 kB/s | 49 kB 00:00 2023-07-27T20:24:10.773 INFO:teuthology.orchestra.run.smithi072.stdout:(110/144): python3-more-itertools-7.2.0-3.el8.n 440 kB/s | 59 kB 00:00 2023-07-27T20:24:10.917 INFO:teuthology.orchestra.run.smithi072.stdout:(111/144): python3-natsort-7.1.1-2.el8.noarch.r 420 kB/s | 60 kB 00:00 2023-07-27T20:24:11.184 INFO:teuthology.orchestra.run.smithi072.stdout:(112/144): python3-pecan-1.3.2-9.el8.noarch.rpm 1.0 MB/s | 283 kB 00:00 2023-07-27T20:24:11.326 INFO:teuthology.orchestra.run.smithi072.stdout:(113/144): python3-portend-2.6-1.el8.noarch.rpm 110 kB/s | 16 kB 00:00 2023-07-27T20:24:11.469 INFO:teuthology.orchestra.run.smithi072.stdout:(114/144): python3-repoze-lru-0.7-6.el8.noarch. 237 kB/s | 34 kB 00:00 2023-07-27T20:24:11.661 INFO:teuthology.orchestra.run.smithi072.stdout:(115/144): python3-routes-2.4.1-12.el8.noarch.r 1.0 MB/s | 196 kB 00:00 2023-07-27T20:24:11.820 INFO:teuthology.orchestra.run.smithi072.stdout:(116/144): python3-rsa-4.9-2.el8.noarch.rpm 405 kB/s | 64 kB 00:00 2023-07-27T20:24:11.962 INFO:teuthology.orchestra.run.smithi072.stdout:(117/144): python3-simplegeneric-0.8.1-17.el8.n 132 kB/s | 19 kB 00:00 2023-07-27T20:24:12.104 INFO:teuthology.orchestra.run.smithi072.stdout:(118/144): python3-singledispatch-3.4.0.3-18.el 169 kB/s | 24 kB 00:00 2023-07-27T20:24:12.254 INFO:teuthology.orchestra.run.smithi072.stdout:(119/144): python3-tempora-1.14.1-5.el8.noarch. 195 kB/s | 29 kB 00:00 2023-07-27T20:24:12.405 INFO:teuthology.orchestra.run.smithi072.stdout:(120/144): python3-trustme-0.6.0-4.el8.noarch.r 183 kB/s | 27 kB 00:00 2023-07-27T20:24:12.723 INFO:teuthology.orchestra.run.smithi072.stdout:(121/144): python3-waitress-1.4.3-1.el8.noarch. 806 kB/s | 255 kB 00:00 2023-07-27T20:24:13.381 INFO:teuthology.orchestra.run.smithi072.stdout:(122/144): python3-webob-1.8.5-1.el8.1.noarch.r 381 kB/s | 251 kB 00:00 2023-07-27T20:24:13.515 INFO:teuthology.orchestra.run.smithi072.stdout:(123/144): python3-websocket-client-0.56.0-5.el 458 kB/s | 61 kB 00:00 2023-07-27T20:24:13.674 INFO:teuthology.orchestra.run.smithi072.stdout:(124/144): python3-webtest-2.0.33-1.el8.noarch. 539 kB/s | 85 kB 00:00 2023-07-27T20:24:13.791 INFO:teuthology.orchestra.run.smithi072.stdout:(125/144): python3-zc-lockfile-2.0-2.el8.noarch 196 kB/s | 23 kB 00:00 2023-07-27T20:24:14.818 INFO:teuthology.orchestra.run.smithi072.stdout:(126/144): thrift-0.13.0-2.el8.x86_64.rpm 1.7 MB/s | 1.7 MB 00:01 2023-07-27T20:24:17.577 INFO:teuthology.orchestra.run.smithi072.stdout:(127/144): librados2-18.0.0-5128.ga5d48e8c.el8. 1.3 MB/s | 3.7 MB 00:02 2023-07-27T20:24:18.669 INFO:teuthology.orchestra.run.smithi072.stdout:(128/144): librbd1-18.0.0-5128.ga5d48e8c.el8.x8 3.3 MB/s | 3.6 MB 00:01 2023-07-27T20:24:19.244 INFO:teuthology.orchestra.run.smithi072.stdout:(129/144): NetworkManager-initscripts-updown-1. 249 kB/s | 143 kB 00:00 2023-07-27T20:24:20.686 INFO:teuthology.orchestra.run.smithi072.stdout:(130/144): elfutils-debuginfod-client-0.189-2.e 53 kB/s | 76 kB 00:01 2023-07-27T20:24:23.054 INFO:teuthology.orchestra.run.smithi072.stdout:(131/144): elfutils-libelf-0.189-2.el8.x86_64.r 98 kB/s | 232 kB 00:02 2023-07-27T20:24:24.554 INFO:teuthology.orchestra.run.smithi072.stdout:(132/144): elfutils-libs-0.189-2.el8.x86_64.rpm 202 kB/s | 302 kB 00:01 2023-07-27T20:24:27.212 INFO:teuthology.orchestra.run.smithi072.stdout:(133/144): iproute-6.2.0-2.el8.x86_64.rpm 331 kB/s | 880 kB 00:02 2023-07-27T20:24:28.671 INFO:teuthology.orchestra.run.smithi072.stdout:(134/144): libblkid-2.32.1-42.el8.x86_64.rpm 151 kB/s | 220 kB 00:01 2023-07-27T20:24:30.655 INFO:teuthology.orchestra.run.smithi072.stdout:(135/144): libfdisk-2.32.1-42.el8.x86_64.rpm 128 kB/s | 253 kB 00:01 2023-07-27T20:24:31.672 INFO:teuthology.orchestra.run.smithi072.stdout:(136/144): libmount-2.32.1-42.el8.x86_64.rpm 232 kB/s | 236 kB 00:01 2023-07-27T20:24:32.381 INFO:teuthology.orchestra.run.smithi072.stdout:(137/144): libsmartcols-2.32.1-42.el8.x86_64.rp 253 kB/s | 179 kB 00:00 2023-07-27T20:24:32.806 INFO:teuthology.orchestra.run.smithi072.stdout:(138/144): libuuid-2.32.1-42.el8.x86_64.rpm 232 kB/s | 98 kB 00:00 2023-07-27T20:24:37.815 INFO:teuthology.orchestra.run.smithi072.stdout:(139/144): util-linux-2.32.1-42.el8.x86_64.rpm 530 kB/s | 2.6 MB 00:05 2023-07-27T20:24:37.950 INFO:teuthology.orchestra.run.smithi072.stdout:(140/144): util-linux-user-2.32.1-42.el8.x86_64 758 kB/s | 102 kB 00:00 2023-07-27T20:24:38.234 INFO:teuthology.orchestra.run.smithi072.stdout:(141/144): xfsdump-3.1.8-6.el8.x86_64.rpm 1.1 MB/s | 334 kB 00:00 2023-07-27T20:24:39.101 INFO:teuthology.orchestra.run.smithi072.stdout:(142/144): xfsprogs-5.0.0-12.el8.x86_64.rpm 1.2 MB/s | 1.1 MB 00:00 2023-07-27T20:28:08.138 INFO:teuthology.orchestra.run.smithi072.stdout:[MIRROR] jq-1.6-7.el8.x86_64.rpm: Curl error (28): Timeout was reached for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/jq-1.6-7.el8.x86_64.rpm [Operation too slow. Less than 1000 bytes/sec transferred the last 300 seconds] 2023-07-27T20:28:08.138 INFO:teuthology.orchestra.run.smithi072.stdout:[MIRROR] libpq-13.5-1.el8.x86_64.rpm: Curl error (28): Timeout was reached for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/libpq-13.5-1.el8.x86_64.rpm [Operation too slow. Less than 1000 bytes/sec transferred the last 300 seconds] 2023-07-27T20:28:08.580 INFO:teuthology.orchestra.run.smithi072.stdout:(143/144): libpq-13.5-1.el8.x86_64.rpm 671 B/s | 198 kB 05:01 2023-07-27T20:28:08.614 INFO:teuthology.orchestra.run.smithi072.stdout:(144/144): jq-1.6-7.el8.x86_64.rpm 688 B/s | 202 kB 05:01 2023-07-27T20:28:08.615 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2023-07-27T20:28:08.615 INFO:teuthology.orchestra.run.smithi072.stdout:Total 349 kB/s | 213 MB 10:24 2023-07-27T20:28:10.442 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2023-07-27T20:28:10.858 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2023-07-27T20:28:10.859 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2023-07-27T20:28:12.497 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2023-07-27T20:28:12.501 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2023-07-27T20:28:18.314 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2023-07-27T20:28:18.554 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-07-27T20:28:18.800 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/160 2023-07-27T20:28:18.970 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 2/160 2023-07-27T20:28:19.081 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 2/160 2023-07-27T20:28:19.261 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 3/160 2023-07-27T20:28:19.390 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 3/160 2023-07-27T20:28:19.611 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/160 2023-07-27T20:28:19.833 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 5/160 2023-07-27T20:28:20.109 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/160 2023-07-27T20:28:20.286 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-07-27T20:28:20.759 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-07-27T20:28:21.070 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librados2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 8/160 2023-07-27T20:28:21.522 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 8/160 2023-07-27T20:28:21.786 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librbd1-2:18.0.0-5128.ga5d48e8c.el8.x86_64 9/160 2023-07-27T20:28:21.938 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librbd1-2:18.0.0-5128.ga5d48e8c.el8.x86_64 9/160 2023-07-27T20:28:22.136 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephfs2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 10/160 2023-07-27T20:28:22.325 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephfs2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 10/160 2023-07-27T20:28:22.554 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rados-2:18.0.0-5128.ga5d48e8c.el8.x86_64 11/160 2023-07-27T20:28:22.719 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/160 2023-07-27T20:28:23.045 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/160 2023-07-27T20:28:23.274 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-07-27T20:28:23.367 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-07-27T20:28:23.645 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/160 2023-07-27T20:28:23.837 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/160 2023-07-27T20:28:24.356 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libpq-13.5-1.el8.x86_64 16/160 2023-07-27T20:28:24.641 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 17/160 2023-07-27T20:28:24.803 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephsqlite-2:18.0.0-5128.ga5d48e8c.el8.x86_64 18/160 2023-07-27T20:28:24.929 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5128.ga5d48e8c.el8.x86_64 18/160 2023-07-27T20:28:25.178 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libradosstriper1-2:18.0.0-5128.ga5d48e8c.el8.x86 19/160 2023-07-27T20:28:25.321 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5128.ga5d48e8c.el8.x86 19/160 2023-07-27T20:28:25.564 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/160 2023-07-27T20:28:25.803 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 21/160 2023-07-27T20:28:25.944 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 22/160 2023-07-27T20:28:26.117 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 22/160 2023-07-27T20:28:26.336 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 23/160 2023-07-27T20:28:26.999 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 23/160 2023-07-27T20:28:27.194 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openblas-0.3.15-4.el8.x86_64 24/160 2023-07-27T20:28:27.889 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 24/160 2023-07-27T20:28:28.136 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-07-27T20:28:28.968 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-07-27T20:28:29.422 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/160 2023-07-27T20:28:29.636 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/160 2023-07-27T20:28:29.881 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 28/160 2023-07-27T20:28:30.115 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 29/160 2023-07-27T20:28:30.334 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ceph-common-2:18.0.0-5128.ga5d48e8c.el8. 30/160 2023-07-27T20:28:30.530 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ceph-argparse-2:18.0.0-5128.ga5d48e8c.el 31/160 2023-07-27T20:28:30.805 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cephfs-2:18.0.0-5128.ga5d48e8c.el8.x86_6 32/160 2023-07-27T20:28:31.968 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 33/160 2023-07-27T20:28:32.405 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 34/160 2023-07-27T20:28:32.796 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 35/160 2023-07-27T20:28:33.027 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-07-27T20:28:35.155 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-07-27T20:28:35.489 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 37/160 2023-07-27T20:28:35.742 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/160 2023-07-27T20:28:35.964 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/160 2023-07-27T20:28:36.248 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rbd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 40/160 2023-07-27T20:28:36.477 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librados-devel-2:18.0.0-5128.ga5d48e8c.el8.x86_6 41/160 2023-07-27T20:28:36.748 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 42/160 2023-07-27T20:28:37.528 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 43/160 2023-07-27T20:28:37.734 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/160 2023-07-27T20:28:37.844 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/160 2023-07-27T20:28:38.101 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/160 2023-07-27T20:28:38.192 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/160 2023-07-27T20:28:38.365 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/160 2023-07-27T20:28:38.626 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-07-27T20:28:39.323 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-07-27T20:28:39.627 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/160 2023-07-27T20:28:39.656 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/160 2023-07-27T20:28:39.944 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/160 2023-07-27T20:28:40.232 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/160 2023-07-27T20:28:40.537 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/160 2023-07-27T20:28:40.707 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/160 2023-07-27T20:28:40.941 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/160 2023-07-27T20:28:41.160 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/160 2023-07-27T20:28:41.377 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/160 2023-07-27T20:28:41.668 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/160 2023-07-27T20:28:41.872 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/160 2023-07-27T20:28:42.125 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/160 2023-07-27T20:28:42.316 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/160 2023-07-27T20:28:42.641 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/160 2023-07-27T20:28:42.820 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/160 2023-07-27T20:28:43.021 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/160 2023-07-27T20:28:43.328 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/160 2023-07-27T20:28:43.600 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/160 2023-07-27T20:28:43.884 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/160 2023-07-27T20:28:44.238 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/160 2023-07-27T20:28:44.569 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/160 2023-07-27T20:28:44.824 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/160 2023-07-27T20:28:45.730 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/160 2023-07-27T20:28:45.958 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librgw2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 70/160 2023-07-27T20:28:46.103 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librgw2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 70/160 2023-07-27T20:28:46.337 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rgw-2:18.0.0-5128.ga5d48e8c.el8.x86_64 71/160 2023-07-27T20:28:46.594 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/160 2023-07-27T20:28:47.066 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 73/160 2023-07-27T20:28:47.391 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 74/160 2023-07-27T20:28:47.621 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/160 2023-07-27T20:28:47.970 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/160 2023-07-27T20:28:48.184 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/160 2023-07-27T20:28:49.457 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/160 2023-07-27T20:28:49.935 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/160 2023-07-27T20:28:50.243 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 80/160 2023-07-27T20:28:50.477 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 81/160 2023-07-27T20:28:50.765 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 82/160 2023-07-27T20:28:51.011 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/160 2023-07-27T20:28:51.254 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 84/160 2023-07-27T20:28:51.548 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 85/160 2023-07-27T20:28:51.899 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 86/160 2023-07-27T20:28:52.155 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 87/160 2023-07-27T20:28:52.327 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 88/160 2023-07-27T20:28:52.595 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 89/160 2023-07-27T20:28:53.607 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 90/160 2023-07-27T20:28:53.888 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 91/160 2023-07-27T20:28:54.066 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 92/160 2023-07-27T20:28:54.282 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 93/160 2023-07-27T20:28:54.561 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 94/160 2023-07-27T20:28:54.796 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : fuse-2.9.7-17.el8.x86_64 95/160 2023-07-27T20:28:55.092 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 96/160 2023-07-27T20:28:55.300 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : uuid-1.6.2-43.el8.x86_64 97/160 2023-07-27T20:28:55.426 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 97/160 2023-07-27T20:28:55.675 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 98/160 2023-07-27T20:28:55.824 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 99/160 2023-07-27T20:29:00.030 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-common-2:18.0.0-5128.ga5d48e8c.el8.x86_64 100/160 2023-07-27T20:29:00.283 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-common-2:18.0.0-5128.ga5d48e8c.el8.x86_64 100/160 2023-07-27T20:29:00.978 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-common-2:18.0.0-5128.ga5d48e8c.el8.x86_64 100/160 2023-07-27T20:29:01.295 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-base-2:18.0.0-5128.ga5d48e8c.el8.x86_64 101/160 2023-07-27T20:29:01.518 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-base-2:18.0.0-5128.ga5d48e8c.el8.x86_64 101/160 2023-07-27T20:29:01.798 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-selinux-2:18.0.0-5128.ga5d48e8c.el8.x86_64 102/160 2023-07-27T20:29:23.661 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5128.ga5d48e8c.el8.x86_64 102/160 2023-07-27T20:29:23.661 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /sys 2023-07-27T20:29:23.661 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /proc 2023-07-27T20:29:23.661 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /dev 2023-07-27T20:29:23.661 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /run 2023-07-27T20:29:23.661 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /mnt 2023-07-27T20:29:23.662 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /var/tmp 2023-07-27T20:29:23.662 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /home 2023-07-27T20:29:23.662 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /tmp 2023-07-27T20:29:23.662 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /dev 2023-07-27T20:29:23.662 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:29:24.138 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-volume-2:18.0.0-5128.ga5d48e8c.el8.noarch 103/160 2023-07-27T20:29:25.860 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-volume-2:18.0.0-5128.ga5d48e8c.el8.noarch 103/160 2023-07-27T20:29:26.100 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-osd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 104/160 2023-07-27T20:29:26.367 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-osd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 104/160 2023-07-27T20:29:26.571 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mds-2:18.0.0-5128.ga5d48e8c.el8.x86_64 105/160 2023-07-27T20:29:27.096 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mds-2:18.0.0-5128.ga5d48e8c.el8.x86_64 105/160 2023-07-27T20:29:27.312 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mon-2:18.0.0-5128.ga5d48e8c.el8.x86_64 106/160 2023-07-27T20:29:27.361 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mon-2:18.0.0-5128.ga5d48e8c.el8.x86_64 106/160 2023-07-27T20:29:27.629 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 107/160 2023-07-27T20:29:27.860 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 108/160 2023-07-27T20:29:28.028 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 109/160 2023-07-27T20:29:28.185 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 109/160 2023-07-27T20:29:28.480 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : jq-1.6-7.el8.x86_64 110/160 2023-07-27T20:29:28.779 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : automake-1.16.1-7.el8.noarch 111/160 2023-07-27T20:29:29.484 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: cephadm-2:18.0.0-5128.ga5d48e8c.el8.noarch 112/160 2023-07-27T20:29:29.670 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephadm-2:18.0.0-5128.ga5d48e8c.el8.noarch 112/160 2023-07-27T20:29:29.786 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5128.ga5d48e8c.e 113/160 2023-07-27T20:29:30.049 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5128.ga5d48e8c. 114/160 2023-07-27T20:29:30.270 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5128.ga5d48e8c.el8.noa 115/160 2023-07-27T20:29:30.529 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5128.ga5d48e8c.el8.noa 115/160 2023-07-27T20:29:30.766 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5128.ga5d48e8c.el8.n 116/160 2023-07-27T20:29:31.871 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5128.ga5d48e8c.el8.n 116/160 2023-07-27T20:29:32.077 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5128.ga5d 117/160 2023-07-27T20:29:32.204 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5128.ga5d 117/160 2023-07-27T20:29:32.608 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5128.ga5d48e8c.el 118/160 2023-07-27T20:29:32.891 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-2:18.0.0-5128.ga5d48e8c.el8.x86_64 119/160 2023-07-27T20:29:32.955 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5128.ga5d48e8c.el8.x86_64 119/160 2023-07-27T20:29:33.136 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-rook-2:18.0.0-5128.ga5d48e8c.el8.noarch 120/160 2023-07-27T20:29:33.163 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5128.ga5d48e8c.el8.noarch 120/160 2023-07-27T20:29:33.443 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-2:18.0.0-5128.ga5d48e8c.el8.x86_64 121/160 2023-07-27T20:29:33.619 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libtool-2.4.6-25.el8.x86_64 122/160 2023-07-27T20:29:38.642 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 122/160 2023-07-27T20:29:40.215 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-test-2:18.0.0-5128.ga5d48e8c.el8.x86_64 123/160 2023-07-27T20:29:40.490 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-radosgw-2:18.0.0-5128.ga5d48e8c.el8.x86_64 124/160 2023-07-27T20:29:40.552 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5128.ga5d48e8c.el8.x86_64 124/160 2023-07-27T20:29:40.777 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5128.ga5d48 125/160 2023-07-27T20:29:40.847 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5128.ga5d48 125/160 2023-07-27T20:29:41.077 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephfs-mirror-2:18.0.0-5128.ga5d48e8c.el8.x86_64 126/160 2023-07-27T20:29:41.492 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5128.ga5d48e8c.el8.x86_64 126/160 2023-07-27T20:29:41.719 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-mirror-2:18.0.0-5128.ga5d48e8c.el8.x86_64 127/160 2023-07-27T20:29:42.006 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5128.ga5d48e8c.el8.x86_64 127/160 2023-07-27T20:29:42.349 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 128/160 2023-07-27T20:29:43.616 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-fuse-2:18.0.0-5128.ga5d48e8c.el8.x86_64 129/160 2023-07-27T20:29:44.024 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 130/160 2023-07-27T20:29:44.250 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 131/160 2023-07-27T20:29:44.515 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 132/160 2023-07-27T20:29:44.690 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/160 2023-07-27T20:29:44.961 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephfs-devel-2:18.0.0-5128.ga5d48e8c.el8.x86_ 134/160 2023-07-27T20:29:46.293 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-27T20:29:46.544 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-27T20:29:46.635 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-27T20:29:46.940 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 136/160 2023-07-27T20:29:47.185 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephfs-top-2:18.0.0-5128.ga5d48e8c.el8.noarch 137/160 2023-07-27T20:29:47.486 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-fuse-2:18.0.0-5128.ga5d48e8c.el8.x86_64 138/160 2023-07-27T20:29:47.850 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-nbd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 139/160 2023-07-27T20:29:48.153 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 140/160 2023-07-27T20:29:48.317 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-07-27T20:29:48.350 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-07-27T20:29:48.612 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 142/160 2023-07-27T20:29:48.850 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/160 2023-07-27T20:29:48.971 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/160 2023-07-27T20:29:49.276 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/160 2023-07-27T20:29:49.304 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/160 2023-07-27T20:29:49.527 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 145/160 2023-07-27T20:29:49.807 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 146/160 2023-07-27T20:29:49.991 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 147/160 2023-07-27T20:29:49.992 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-07-27T20:29:50.331 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-07-27T20:29:50.331 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-07-27T20:29:50.596 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-07-27T20:29:50.693 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-07-27T20:29:50.849 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-07-27T20:29:50.849 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 151/160 2023-07-27T20:29:51.142 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 151/160 2023-07-27T20:29:51.403 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 152/160 2023-07-27T20:29:51.568 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 153/160 2023-07-27T20:29:51.794 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 154/160 2023-07-27T20:29:51.795 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 155/160 2023-07-27T20:29:52.095 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 155/160 2023-07-27T20:29:52.096 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 156/160 2023-07-27T20:29:52.321 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 156/160 2023-07-27T20:29:52.321 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 157/160 2023-07-27T20:29:52.637 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 157/160 2023-07-27T20:29:52.638 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 158/160 2023-07-27T20:29:52.862 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 158/160 2023-07-27T20:29:52.862 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-07-27T20:29:53.104 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-07-27T20:29:53.310 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-07-27T20:29:53.521 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-07-27T20:29:53.521 INFO:teuthology.orchestra.run.smithi072.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-07-27T20:29:53.521 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:29:54.238 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-2:18.0.0-5128.ga5d48e8c.el8.x86_64 1/160 2023-07-27T20:29:54.238 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-base-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2/160 2023-07-27T20:29:54.240 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-common-2:18.0.0-5128.ga5d48e8c.el8.x86_64 3/160 2023-07-27T20:29:54.240 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-fuse-2:18.0.0-5128.ga5d48e8c.el8.x86_64 4/160 2023-07-27T20:29:54.240 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5128.ga5d48 5/160 2023-07-27T20:29:54.241 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mds-2:18.0.0-5128.ga5d48e8c.el8.x86_64 6/160 2023-07-27T20:29:54.241 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-2:18.0.0-5128.ga5d48e8c.el8.x86_64 7/160 2023-07-27T20:29:54.241 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mon-2:18.0.0-5128.ga5d48e8c.el8.x86_64 8/160 2023-07-27T20:29:54.241 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-osd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 9/160 2023-07-27T20:29:54.242 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-radosgw-2:18.0.0-5128.ga5d48e8c.el8.x86_64 10/160 2023-07-27T20:29:54.242 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-selinux-2:18.0.0-5128.ga5d48e8c.el8.x86_64 11/160 2023-07-27T20:29:54.242 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-test-2:18.0.0-5128.ga5d48e8c.el8.x86_64 12/160 2023-07-27T20:29:54.242 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephfs-mirror-2:18.0.0-5128.ga5d48e8c.el8.x86_64 13/160 2023-07-27T20:29:54.242 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs-devel-2:18.0.0-5128.ga5d48e8c.el8.x86_ 14/160 2023-07-27T20:29:54.242 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 15/160 2023-07-27T20:29:54.242 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephsqlite-2:18.0.0-5128.ga5d48e8c.el8.x86_64 16/160 2023-07-27T20:29:54.242 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados-devel-2:18.0.0-5128.ga5d48e8c.el8.x86_6 17/160 2023-07-27T20:29:54.252 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libradosstriper1-2:18.0.0-5128.ga5d48e8c.el8.x86 18/160 2023-07-27T20:29:54.253 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librgw2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 19/160 2023-07-27T20:29:54.253 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5128.ga5d48e8c.el 20/160 2023-07-27T20:29:54.253 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-common-2:18.0.0-5128.ga5d48e8c.el8. 21/160 2023-07-27T20:29:54.253 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cephfs-2:18.0.0-5128.ga5d48e8c.el8.x86_6 22/160 2023-07-27T20:29:54.253 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rados-2:18.0.0-5128.ga5d48e8c.el8.x86_64 23/160 2023-07-27T20:29:54.253 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rbd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 24/160 2023-07-27T20:29:54.254 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rgw-2:18.0.0-5128.ga5d48e8c.el8.x86_64 25/160 2023-07-27T20:29:54.254 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-fuse-2:18.0.0-5128.ga5d48e8c.el8.x86_64 26/160 2023-07-27T20:29:54.254 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-mirror-2:18.0.0-5128.ga5d48e8c.el8.x86_64 27/160 2023-07-27T20:29:54.254 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-nbd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 28/160 2023-07-27T20:29:54.254 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5128.ga5d48e8c. 29/160 2023-07-27T20:29:54.254 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5128.ga5d48e8c.el8.noa 30/160 2023-07-27T20:29:54.254 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5128.ga5d48e8c.el8.n 31/160 2023-07-27T20:29:54.255 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5128.ga5d 32/160 2023-07-27T20:29:54.255 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5128.ga5d48e8c.el 33/160 2023-07-27T20:29:54.255 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5128.ga5d48e8c.el8.noarch 34/160 2023-07-27T20:29:54.255 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5128.ga5d48e8c.e 35/160 2023-07-27T20:29:54.255 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-volume-2:18.0.0-5128.ga5d48e8c.el8.noarch 36/160 2023-07-27T20:29:54.255 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephadm-2:18.0.0-5128.ga5d48e8c.el8.noarch 37/160 2023-07-27T20:29:54.255 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephfs-top-2:18.0.0-5128.ga5d48e8c.el8.noarch 38/160 2023-07-27T20:29:54.256 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/160 2023-07-27T20:29:54.256 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/160 2023-07-27T20:29:54.256 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/160 2023-07-27T20:29:54.256 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : jq-1.6-7.el8.x86_64 42/160 2023-07-27T20:29:54.256 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/160 2023-07-27T20:29:54.256 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/160 2023-07-27T20:29:54.257 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/160 2023-07-27T20:29:54.257 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/160 2023-07-27T20:29:54.257 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/160 2023-07-27T20:29:54.257 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/160 2023-07-27T20:29:54.257 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/160 2023-07-27T20:29:54.257 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/160 2023-07-27T20:29:54.257 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/160 2023-07-27T20:29:54.258 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/160 2023-07-27T20:29:54.258 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/160 2023-07-27T20:29:54.258 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/160 2023-07-27T20:29:54.258 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/160 2023-07-27T20:29:54.258 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/160 2023-07-27T20:29:54.258 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/160 2023-07-27T20:29:54.258 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/160 2023-07-27T20:29:54.259 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/160 2023-07-27T20:29:54.259 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/160 2023-07-27T20:29:54.259 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/160 2023-07-27T20:29:54.259 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/160 2023-07-27T20:29:54.259 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/160 2023-07-27T20:29:54.260 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/160 2023-07-27T20:29:54.260 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/160 2023-07-27T20:29:54.260 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/160 2023-07-27T20:29:54.261 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/160 2023-07-27T20:29:54.261 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/160 2023-07-27T20:29:54.261 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/160 2023-07-27T20:29:54.261 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/160 2023-07-27T20:29:54.261 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/160 2023-07-27T20:29:54.261 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/160 2023-07-27T20:29:54.262 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/160 2023-07-27T20:29:54.262 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/160 2023-07-27T20:29:54.262 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/160 2023-07-27T20:29:54.262 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/160 2023-07-27T20:29:54.262 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 77/160 2023-07-27T20:29:54.262 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 78/160 2023-07-27T20:29:54.263 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 79/160 2023-07-27T20:29:54.263 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/160 2023-07-27T20:29:54.263 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/160 2023-07-27T20:29:54.263 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 82/160 2023-07-27T20:29:54.263 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/160 2023-07-27T20:29:54.264 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/160 2023-07-27T20:29:54.264 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/160 2023-07-27T20:29:54.264 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/160 2023-07-27T20:29:54.264 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/160 2023-07-27T20:29:54.264 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/160 2023-07-27T20:29:54.265 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/160 2023-07-27T20:29:54.265 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 90/160 2023-07-27T20:29:54.265 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/160 2023-07-27T20:29:54.265 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/160 2023-07-27T20:29:54.265 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/160 2023-07-27T20:29:54.265 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/160 2023-07-27T20:29:54.265 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/160 2023-07-27T20:29:54.265 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/160 2023-07-27T20:29:54.266 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/160 2023-07-27T20:29:54.266 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/160 2023-07-27T20:29:54.266 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/160 2023-07-27T20:29:54.266 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/160 2023-07-27T20:29:54.266 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/160 2023-07-27T20:29:54.266 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/160 2023-07-27T20:29:54.266 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/160 2023-07-27T20:29:54.267 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/160 2023-07-27T20:29:54.267 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/160 2023-07-27T20:29:54.267 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/160 2023-07-27T20:29:54.267 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/160 2023-07-27T20:29:54.267 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/160 2023-07-27T20:29:54.268 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/160 2023-07-27T20:29:54.268 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/160 2023-07-27T20:29:54.268 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/160 2023-07-27T20:29:54.268 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/160 2023-07-27T20:29:54.268 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/160 2023-07-27T20:29:54.268 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/160 2023-07-27T20:29:54.268 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/160 2023-07-27T20:29:54.269 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/160 2023-07-27T20:29:54.269 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/160 2023-07-27T20:29:54.269 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 118/160 2023-07-27T20:29:54.269 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/160 2023-07-27T20:29:54.269 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/160 2023-07-27T20:29:54.269 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/160 2023-07-27T20:29:54.269 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/160 2023-07-27T20:29:54.270 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 123/160 2023-07-27T20:29:54.270 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/160 2023-07-27T20:29:54.270 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/160 2023-07-27T20:29:54.270 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/160 2023-07-27T20:29:54.270 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/160 2023-07-27T20:29:54.271 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/160 2023-07-27T20:29:54.271 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 129/160 2023-07-27T20:29:54.271 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/160 2023-07-27T20:29:54.271 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librbd1-2:18.0.0-5128.ga5d48e8c.el8.x86_64 131/160 2023-07-27T20:29:54.271 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/160 2023-07-27T20:29:54.271 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-8.el 133/160 2023-07-27T20:29:54.271 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 134/160 2023-07-27T20:29:54.272 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 135/160 2023-07-27T20:29:54.272 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 136/160 2023-07-27T20:29:54.272 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 137/160 2023-07-27T20:29:54.272 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 138/160 2023-07-27T20:29:54.272 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 139/160 2023-07-27T20:29:54.272 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 140/160 2023-07-27T20:29:54.272 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 141/160 2023-07-27T20:29:54.273 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 142/160 2023-07-27T20:29:54.273 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 143/160 2023-07-27T20:29:54.273 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 144/160 2023-07-27T20:29:54.273 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 145/160 2023-07-27T20:29:54.273 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 146/160 2023-07-27T20:29:54.273 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 147/160 2023-07-27T20:29:54.273 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 148/160 2023-07-27T20:29:54.274 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 149/160 2023-07-27T20:29:54.274 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 150/160 2023-07-27T20:29:54.274 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 151/160 2023-07-27T20:29:54.274 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 152/160 2023-07-27T20:29:54.274 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 153/160 2023-07-27T20:29:54.274 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 154/160 2023-07-27T20:29:54.274 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 155/160 2023-07-27T20:29:54.274 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 156/160 2023-07-27T20:29:54.275 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 157/160 2023-07-27T20:29:54.275 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 158/160 2023-07-27T20:29:54.275 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 159/160 2023-07-27T20:29:57.152 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 160/160 2023-07-27T20:29:57.152 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:29:57.153 INFO:teuthology.orchestra.run.smithi072.stdout:Upgraded: 2023-07-27T20:29:57.153 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-initscripts-updown-1:1.40.16-8.el8.noarch 2023-07-27T20:29:57.153 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-07-27T20:29:57.153 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-07-27T20:29:57.153 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-07-27T20:29:57.153 INFO:teuthology.orchestra.run.smithi072.stdout: iproute-6.2.0-2.el8.x86_64 2023-07-27T20:29:57.153 INFO:teuthology.orchestra.run.smithi072.stdout: libblkid-2.32.1-42.el8.x86_64 2023-07-27T20:29:57.154 INFO:teuthology.orchestra.run.smithi072.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-07-27T20:29:57.154 INFO:teuthology.orchestra.run.smithi072.stdout: libmount-2.32.1-42.el8.x86_64 2023-07-27T20:29:57.154 INFO:teuthology.orchestra.run.smithi072.stdout: librados2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:29:57.154 INFO:teuthology.orchestra.run.smithi072.stdout: librbd1-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:29:57.155 INFO:teuthology.orchestra.run.smithi072.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-07-27T20:29:57.155 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid-2.32.1-42.el8.x86_64 2023-07-27T20:29:57.155 INFO:teuthology.orchestra.run.smithi072.stdout: util-linux-2.32.1-42.el8.x86_64 2023-07-27T20:29:57.155 INFO:teuthology.orchestra.run.smithi072.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-07-27T20:29:57.155 INFO:teuthology.orchestra.run.smithi072.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-07-27T20:29:57.155 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-07-27T20:29:57.155 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2023-07-27T20:29:57.156 INFO:teuthology.orchestra.run.smithi072.stdout: automake-1.16.1-7.el8.noarch 2023-07-27T20:29:57.156 INFO:teuthology.orchestra.run.smithi072.stdout: bison-3.0.4-10.el8.x86_64 2023-07-27T20:29:57.156 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:29:57.156 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:29:57.156 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:29:57.157 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:29:57.157 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-grafana-dashboards-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-27T20:29:57.157 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-immutable-object-cache-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:29:57.157 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:29:57.157 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:29:57.157 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-cephadm-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-27T20:29:57.157 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-27T20:29:57.158 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-27T20:29:57.158 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-27T20:29:57.158 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-rook-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-27T20:29:57.158 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:29:57.158 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:29:57.158 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-prometheus-alerts-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-27T20:29:57.158 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:29:57.159 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-selinux-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:29:57.159 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:29:57.159 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-volume-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-27T20:29:57.159 INFO:teuthology.orchestra.run.smithi072.stdout: cephadm-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-27T20:29:57.159 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-mirror-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:29:57.159 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-top-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-27T20:29:57.159 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-07-27T20:29:57.160 INFO:teuthology.orchestra.run.smithi072.stdout: flex-2.6.1-9.el8.x86_64 2023-07-27T20:29:57.160 INFO:teuthology.orchestra.run.smithi072.stdout: fuse-2.9.7-17.el8.x86_64 2023-07-27T20:29:57.160 INFO:teuthology.orchestra.run.smithi072.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-27T20:29:57.160 INFO:teuthology.orchestra.run.smithi072.stdout: jq-1.6-7.el8.x86_64 2023-07-27T20:29:57.160 INFO:teuthology.orchestra.run.smithi072.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-27T20:29:57.160 INFO:teuthology.orchestra.run.smithi072.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-07-27T20:29:57.160 INFO:teuthology.orchestra.run.smithi072.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-27T20:29:57.161 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-devel-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:29:57.161 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:29:57.161 INFO:teuthology.orchestra.run.smithi072.stdout: libcephsqlite-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:29:57.161 INFO:teuthology.orchestra.run.smithi072.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-07-27T20:29:57.161 INFO:teuthology.orchestra.run.smithi072.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-07-27T20:29:57.161 INFO:teuthology.orchestra.run.smithi072.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-27T20:29:57.162 INFO:teuthology.orchestra.run.smithi072.stdout: libpq-13.5-1.el8.x86_64 2023-07-27T20:29:57.162 INFO:teuthology.orchestra.run.smithi072.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-07-27T20:29:57.162 INFO:teuthology.orchestra.run.smithi072.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-07-27T20:29:57.162 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:29:57.162 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:29:57.162 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-27T20:29:57.162 INFO:teuthology.orchestra.run.smithi072.stdout: librgw2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:29:57.163 INFO:teuthology.orchestra.run.smithi072.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-07-27T20:29:57.163 INFO:teuthology.orchestra.run.smithi072.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-27T20:29:57.163 INFO:teuthology.orchestra.run.smithi072.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-27T20:29:57.163 INFO:teuthology.orchestra.run.smithi072.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-27T20:29:57.163 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-07-27T20:29:57.163 INFO:teuthology.orchestra.run.smithi072.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-07-27T20:29:57.163 INFO:teuthology.orchestra.run.smithi072.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-07-27T20:29:57.163 INFO:teuthology.orchestra.run.smithi072.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-27T20:29:57.164 INFO:teuthology.orchestra.run.smithi072.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-27T20:29:57.164 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-0.3.15-4.el8.x86_64 2023-07-27T20:29:57.164 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-07-27T20:29:57.164 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-07-27T20:29:57.164 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-07-27T20:29:57.164 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-07-27T20:29:57.164 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-07-27T20:29:57.165 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-27T20:29:57.165 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-27T20:29:57.165 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-27T20:29:57.165 INFO:teuthology.orchestra.run.smithi072.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-27T20:29:57.165 INFO:teuthology.orchestra.run.smithi072.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-27T20:29:57.165 INFO:teuthology.orchestra.run.smithi072.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-27T20:29:57.166 INFO:teuthology.orchestra.run.smithi072.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-27T20:29:57.166 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-27T20:29:57.166 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:29:57.166 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:29:57.166 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:29:57.166 INFO:teuthology.orchestra.run.smithi072.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-27T20:29:57.166 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-07-27T20:29:57.167 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-27T20:29:57.167 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-27T20:29:57.167 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-07-27T20:29:57.167 INFO:teuthology.orchestra.run.smithi072.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-27T20:29:57.167 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-27T20:29:57.167 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-27T20:29:57.167 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-27T20:29:57.168 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-27T20:29:57.168 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-27T20:29:57.168 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-27T20:29:57.168 INFO:teuthology.orchestra.run.smithi072.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-27T20:29:57.168 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-27T20:29:57.168 INFO:teuthology.orchestra.run.smithi072.stdout: python3-mako-1.0.6-14.el8.noarch 2023-07-27T20:29:57.169 INFO:teuthology.orchestra.run.smithi072.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-27T20:29:57.169 INFO:teuthology.orchestra.run.smithi072.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-27T20:29:57.169 INFO:teuthology.orchestra.run.smithi072.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-27T20:29:57.169 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-27T20:29:57.169 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-27T20:29:57.169 INFO:teuthology.orchestra.run.smithi072.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-27T20:29:57.169 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-27T20:29:57.170 INFO:teuthology.orchestra.run.smithi072.stdout: python3-portend-2.6-1.el8.noarch 2023-07-27T20:29:57.170 INFO:teuthology.orchestra.run.smithi072.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-27T20:29:57.170 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-27T20:29:57.170 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-27T20:29:57.170 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-27T20:29:57.170 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-27T20:29:57.170 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-27T20:29:57.171 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:29:57.171 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:29:57.171 INFO:teuthology.orchestra.run.smithi072.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-27T20:29:57.171 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-27T20:29:57.171 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:29:57.171 INFO:teuthology.orchestra.run.smithi072.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-27T20:29:57.171 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rsa-4.9-2.el8.noarch 2023-07-27T20:29:57.172 INFO:teuthology.orchestra.run.smithi072.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-07-27T20:29:57.172 INFO:teuthology.orchestra.run.smithi072.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-27T20:29:57.172 INFO:teuthology.orchestra.run.smithi072.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-27T20:29:57.172 INFO:teuthology.orchestra.run.smithi072.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-27T20:29:57.172 INFO:teuthology.orchestra.run.smithi072.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-27T20:29:57.172 INFO:teuthology.orchestra.run.smithi072.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-27T20:29:57.172 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-27T20:29:57.173 INFO:teuthology.orchestra.run.smithi072.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-27T20:29:57.173 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-27T20:29:57.173 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-27T20:29:57.173 INFO:teuthology.orchestra.run.smithi072.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-27T20:29:57.173 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:29:57.173 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:29:57.173 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-27T20:29:57.174 INFO:teuthology.orchestra.run.smithi072.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-27T20:29:57.174 INFO:teuthology.orchestra.run.smithi072.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-27T20:29:57.174 INFO:teuthology.orchestra.run.smithi072.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-27T20:29:57.174 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-07-27T20:29:57.174 INFO:teuthology.orchestra.run.smithi072.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-27T20:29:57.175 INFO:teuthology.orchestra.run.smithi072.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-07-27T20:29:57.175 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:29:57.175 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2023-07-27T20:29:57.669 DEBUG:teuthology.parallel:result is None 2023-07-27T20:29:57.670 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a5d48e8c688c2543997a98b8acbae2ce9635578c 2023-07-27T20:29:57.943 DEBUG:teuthology.orchestra.run.smithi072:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-27T20:29:57.999 INFO:teuthology.orchestra.run.smithi072.stdout:18.0.0-5128.ga5d48e8c.el8 2023-07-27T20:29:58.000 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5128.ga5d48e8c.el8 2023-07-27T20:29:58.000 INFO:teuthology.task.install:The correct ceph version 18.0.0-5128.ga5d48e8c is installed. 2023-07-27T20:29:58.001 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a5d48e8c688c2543997a98b8acbae2ce9635578c 2023-07-27T20:29:58.388 DEBUG:teuthology.orchestra.run.smithi173:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-27T20:29:58.451 INFO:teuthology.orchestra.run.smithi173.stdout:18.0.0-5128.ga5d48e8c.el8 2023-07-27T20:29:58.451 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5128.ga5d48e8c.el8 2023-07-27T20:29:58.452 INFO:teuthology.task.install:The correct ceph version 18.0.0-5128.ga5d48e8c is installed. 2023-07-27T20:29:58.452 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-07-27T20:29:58.452 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-27T20:29:58.453 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-27T20:29:58.527 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-07-27T20:29:58.527 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-27T20:29:58.604 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-07-27T20:29:58.604 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-27T20:29:58.605 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/daemon-helper 2023-07-27T20:29:58.676 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-27T20:29:58.789 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-07-27T20:29:58.789 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/daemon-helper 2023-07-27T20:29:58.860 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-27T20:29:58.968 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-07-27T20:29:58.969 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-27T20:29:58.969 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-27T20:29:59.040 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-27T20:29:59.152 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-07-27T20:29:59.153 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-27T20:29:59.221 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-27T20:29:59.330 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-07-27T20:29:59.330 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-27T20:29:59.331 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/stdin-killer 2023-07-27T20:29:59.403 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-27T20:29:59.513 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-07-27T20:29:59.514 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/stdin-killer 2023-07-27T20:29:59.583 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-27T20:29:59.692 INFO:teuthology.run_tasks:Running task ceph... 2023-07-27T20:29:59.777 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-07-27T20:29:59.778 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 777 /var/log/ceph 2023-07-27T20:29:59.784 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 777 /var/log/ceph 2023-07-27T20:29:59.853 INFO:tasks.ceph:Disabling ceph logrotate... 2023-07-27T20:29:59.853 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-27T20:29:59.858 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-27T20:29:59.925 INFO:tasks.ceph:Creating extra log directories... 2023-07-27T20:29:59.926 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-27T20:29:59.931 DEBUG:teuthology.orchestra.run.smithi173:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-27T20:30:00.007 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-07-27T20:30:00.008 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-07-27T20:30:00.008 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-07-27T20:30:00.008 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-27T20:30:00.009 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-27T20:30:00.056 DEBUG:teuthology.orchestra.run.smithi072:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-27T20:30:15.328 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-27T20:30:15.404 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-07-27T20:30:15.405 DEBUG:teuthology.orchestra.run.smithi173:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-27T20:30:15.455 DEBUG:teuthology.orchestra.run.smithi173:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-27T20:30:20.699 DEBUG:teuthology.orchestra.run.smithi173:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-27T20:30:20.781 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-07-27T20:30:20.781 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-07-27T20:30:20.781 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-07-25_11:29:34-fs-wip-vshankar-testing-20230725.043804-testing-default-smithi/7350740', 'branch': 'wip-vshankar-testing-20230725.043804', 'description': 'fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7350740', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': 'bbae19e0824be3daf9282aaf5330af10cdf81109'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-07-25_11:29:34-fs-wip-vshankar-testing-20230725.043804-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20230725.043804'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'a5d48e8c688c2543997a98b8acbae2ce9635578c'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a5d48e8c688c2543997a98b8acbae2ce9635578c'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20230725.043804', 'sha1': 'a5d48e8c688c2543997a98b8acbae2ce9635578c'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 150, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 9167, 'sha1': 'a5d48e8c688c2543997a98b8acbae2ce9635578c', 'sleep_before_teardown': 0, 'subset': '269/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20230725.043804', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_a5d48e8c688c2543997a98b8acbae2ce9635578c/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'a5d48e8c688c2543997a98b8acbae2ce9635578c', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi072.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2zK0aM8CVVl3keQCVxE4qZ32bDRP+Ke9iiu3RgQ+U74021QyiO2yQG1pqNb5TqJAp4o52c184qRewU90lFnTNiDyNxWt5VQGY/dMYgxyzcQcBL+DCFHmm3C30IrTlIxnOy1VPbkhFvOTb3jqEwIlZ9qnIr8pSxPZyKIOAex2hgyY2jTHz9+dh1NrPwnZSzsj9BZi1IRw5PhMITJD1ObQdUlrC1dWd6WcxqRFYZ3QtjNk4qWzwZne4QPiLQzbHRGlrw5LCiO/cE590351imnZSARgVlxAbSXeds9Z/H9eSuA+YtsUiKDEVqmuM9MAX1dSNFwEwOq1sQrWF3wm4ed9HnRuZgrr3YuNBBf4G5Gg6FCTkyKA+K6bsJ5CIRaoWWaHPzKcF7RADBQwIY9e5Z2C3+BDlnX5gEW8AMxONkhr+/b6NkkNGUZO4Cte65XuZOvu2uQa9SB9yr/g6S0Yv2wHRteozX31SwpKQs+q35rkIBkLrJgkLxNGNXVlWBKy+VpU=', 'smithi173.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC47mkD2yJI/qkZCaxu9TKQ0sTTDGOwga3QZh6+29NMXumCbAV+47jTsJLMoZ7rFalFEZSFXpgp3yQCapXvNdGI2BX71yfmCmWpqBw1nGrzeuI3sWs7MvbvjYE3/Ts/GhMevSubZp16EnwnS7/RS2RXZ2uwaEiR6RAl2aw7+D3hcky4NrhE6nUafR7zENXKUXJ0MhCRvs8H627qFpStvoopVO9lom/R3UA9aOnLkl0l7UsfVTWikSvK0zJ2lnTJ3qssdCbUghGYfgYAnHNAdWOImgIo+c7kNxRRiqwan4oRAqqCOy4aa1wbS+ANbdSILsChZqEmim65ghqFDFbvkkyNTJZp3mIJhhUpZTUAjTm2hQx/UlMB/15BXZIljNIFhjxTon0Z3qW0v0m5OqMx0OaoTsXfQ9GIoeVJpN1YSBh/l+wQeFBoRIFdAjey2cYA9W1FyGWEob9JX3A54bL8sMMEhtorBw/+BRqiKKynUVE/NaRF+DFEIiita0+9476nQHM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': 'bbae19e0824be3daf9282aaf5330af10cdf81109'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a5d48e8c688c2543997a98b8acbae2ce9635578c'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_multifs_auth']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '407880c6d3fb77318fff01c863715090f9c2de69', 'timestamp': '2023-07-25_11:29:34', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-07-27T20:30:20.782 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-27T20:30:20.787 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-27T20:30:20.835 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/run/ceph 2023-07-27T20:30:20.840 DEBUG:teuthology.orchestra.run.smithi173:> sudo install -d -m0777 -- /var/run/ceph 2023-07-27T20:30:20.945 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-27T20:30:20.945 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/scratch_devs of=/dev/stdout 2023-07-27T20:30:20.992 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-27T20:30:20.992 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_1 2023-07-27T20:30:21.077 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-27T20:30:21.078 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-27T20:30:21.078 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 444 Links: 1 2023-07-27T20:30:21.078 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-27T20:30:21.078 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-07-27T20:30:21.078 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-07-27 20:29:53.741591578 +0000 2023-07-27T20:30:21.078 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-07-27 19:56:57.083532075 +0000 2023-07-27T20:30:21.078 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-07-27 19:56:57.083532075 +0000 2023-07-27T20:30:21.079 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2023-07-27 19:56:57.054532669 +0000 2023-07-27T20:30:21.079 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-27T20:30:21.183 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-07-27T20:30:21.183 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-07-27T20:30:21.183 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000280783 s, 1.8 MB/s 2023-07-27T20:30:21.185 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-27T20:30:21.233 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_2 2023-07-27T20:30:21.278 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-27T20:30:21.279 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-27T20:30:21.279 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 450 Links: 1 2023-07-27T20:30:21.279 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-27T20:30:21.279 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-07-27T20:30:21.279 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-07-27 20:29:53.741591578 +0000 2023-07-27T20:30:21.279 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-07-27 19:56:57.926514813 +0000 2023-07-27T20:30:21.279 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-07-27 19:56:57.926514813 +0000 2023-07-27T20:30:21.280 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2023-07-27 19:56:57.901515325 +0000 2023-07-27T20:30:21.280 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-27T20:30:21.385 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-07-27T20:30:21.385 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-07-27T20:30:21.386 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000287263 s, 1.8 MB/s 2023-07-27T20:30:21.387 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-27T20:30:21.435 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_3 2023-07-27T20:30:21.481 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-27T20:30:21.481 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-27T20:30:21.482 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 456 Links: 1 2023-07-27T20:30:21.482 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-27T20:30:21.482 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-07-27T20:30:21.482 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-07-27 20:29:53.742591558 +0000 2023-07-27T20:30:21.482 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-07-27 19:56:58.800496916 +0000 2023-07-27T20:30:21.482 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-07-27 19:56:58.800496916 +0000 2023-07-27T20:30:21.482 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2023-07-27 19:56:58.774497449 +0000 2023-07-27T20:30:21.483 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-27T20:30:21.550 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-07-27T20:30:21.550 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-07-27T20:30:21.550 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000288088 s, 1.8 MB/s 2023-07-27T20:30:21.552 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-27T20:30:21.645 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_4 2023-07-27T20:30:21.691 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-27T20:30:21.691 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-27T20:30:21.692 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 462 Links: 1 2023-07-27T20:30:21.692 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-27T20:30:21.692 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-07-27T20:30:21.692 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-07-27 20:29:53.742591558 +0000 2023-07-27T20:30:21.692 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-07-27 19:56:59.637479778 +0000 2023-07-27T20:30:21.692 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-07-27 19:56:59.637479778 +0000 2023-07-27T20:30:21.692 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2023-07-27 19:56:59.612480289 +0000 2023-07-27T20:30:21.693 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-27T20:30:21.797 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-07-27T20:30:21.798 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-07-27T20:30:21.798 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000304543 s, 1.7 MB/s 2023-07-27T20:30:21.800 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-27T20:30:21.847 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-27T20:30:21.848 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-07-27T20:30:21.848 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/scratch_devs of=/dev/stdout 2023-07-27T20:30:21.897 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-27T20:30:21.898 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_1 2023-07-27T20:30:21.945 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-27T20:30:21.946 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-27T20:30:21.946 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 446 Links: 1 2023-07-27T20:30:21.946 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-27T20:30:21.946 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2023-07-27T20:30:21.947 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2023-07-27 20:21:06.296985844 +0000 2023-07-27T20:30:21.947 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2023-07-27 19:56:45.615972407 +0000 2023-07-27T20:30:21.947 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2023-07-27 19:56:45.615972407 +0000 2023-07-27T20:30:21.947 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2023-07-27 19:56:45.586973033 +0000 2023-07-27T20:30:21.947 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-27T20:30:22.015 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2023-07-27T20:30:22.015 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2023-07-27T20:30:22.015 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.0004483 s, 1.1 MB/s 2023-07-27T20:30:22.019 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-27T20:30:22.066 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_2 2023-07-27T20:30:22.112 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-27T20:30:22.113 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-27T20:30:22.113 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 452 Links: 1 2023-07-27T20:30:22.113 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-27T20:30:22.113 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2023-07-27T20:30:22.113 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2023-07-27 20:21:06.296985844 +0000 2023-07-27T20:30:22.113 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2023-07-27 19:56:46.455954263 +0000 2023-07-27T20:30:22.114 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2023-07-27 19:56:46.455954263 +0000 2023-07-27T20:30:22.114 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2023-07-27 19:56:46.428954846 +0000 2023-07-27T20:30:22.114 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-27T20:30:22.180 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2023-07-27T20:30:22.180 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2023-07-27T20:30:22.180 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000287612 s, 1.8 MB/s 2023-07-27T20:30:22.182 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-27T20:30:22.229 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_3 2023-07-27T20:30:22.314 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-27T20:30:22.315 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-27T20:30:22.315 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 458 Links: 1 2023-07-27T20:30:22.315 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-27T20:30:22.315 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2023-07-27T20:30:22.315 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2023-07-27 20:21:06.296985844 +0000 2023-07-27T20:30:22.315 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2023-07-27 19:56:47.291936205 +0000 2023-07-27T20:30:22.316 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2023-07-27 19:56:47.291936205 +0000 2023-07-27T20:30:22.316 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2023-07-27 19:56:47.264936788 +0000 2023-07-27T20:30:22.316 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-27T20:30:22.421 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2023-07-27T20:30:22.421 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2023-07-27T20:30:22.421 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000457899 s, 1.1 MB/s 2023-07-27T20:30:22.423 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-27T20:30:22.470 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_4 2023-07-27T20:30:22.516 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-27T20:30:22.517 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-27T20:30:22.517 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 464 Links: 1 2023-07-27T20:30:22.517 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-27T20:30:22.517 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2023-07-27T20:30:22.517 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2023-07-27 20:21:06.297985822 +0000 2023-07-27T20:30:22.517 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2023-07-27 19:56:48.148917694 +0000 2023-07-27T20:30:22.517 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2023-07-27 19:56:48.148917694 +0000 2023-07-27T20:30:22.518 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2023-07-27 19:56:48.118918342 +0000 2023-07-27T20:30:22.518 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-27T20:30:22.622 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2023-07-27T20:30:22.622 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2023-07-27T20:30:22.622 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.00030043 s, 1.7 MB/s 2023-07-27T20:30:22.624 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-27T20:30:22.671 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-27T20:30:22.672 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi072.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi173.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-27T20:30:22.672 INFO:tasks.ceph:Generating config... 2023-07-27T20:30:22.673 INFO:tasks.ceph:[client] client mount timeout = 600 2023-07-27T20:30:22.673 INFO:tasks.ceph:[client] debug client = 20 2023-07-27T20:30:22.674 INFO:tasks.ceph:[client] debug ms = 1 2023-07-27T20:30:22.674 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-07-27T20:30:22.674 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-07-27T20:30:22.674 INFO:tasks.ceph:[mds] debug mds = 20 2023-07-27T20:30:22.674 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-07-27T20:30:22.675 INFO:tasks.ceph:[mds] debug ms = 1 2023-07-27T20:30:22.675 INFO:tasks.ceph:[mds] mds debug frag = True 2023-07-27T20:30:22.675 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-07-27T20:30:22.675 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-07-27T20:30:22.675 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-07-27T20:30:22.676 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-07-27T20:30:22.676 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-07-27T20:30:22.676 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-07-27T20:30:22.676 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-07-27T20:30:22.677 INFO:tasks.ceph:[mgr] debug ms = 1 2023-07-27T20:30:22.677 INFO:tasks.ceph:[mon] debug mon = 20 2023-07-27T20:30:22.677 INFO:tasks.ceph:[mon] debug ms = 1 2023-07-27T20:30:22.677 INFO:tasks.ceph:[mon] debug paxos = 20 2023-07-27T20:30:22.677 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-07-27T20:30:22.678 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-07-27T20:30:22.678 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-07-27T20:30:22.678 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-07-27T20:30:22.678 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-07-27T20:30:22.678 INFO:tasks.ceph:[osd] debug ms = 1 2023-07-27T20:30:22.679 INFO:tasks.ceph:[osd] debug osd = 20 2023-07-27T20:30:22.679 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-07-27T20:30:22.679 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-07-27T20:30:22.679 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-07-27T20:30:22.679 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-07-27T20:30:22.679 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-07-27T20:30:22.680 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-07-27T20:30:22.680 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-07-27T20:30:22.680 INFO:tasks.ceph:Setting up mon.a... 2023-07-27T20:30:22.680 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-07-27T20:30:22.798 INFO:teuthology.orchestra.run.smithi072.stdout:creating /etc/ceph/ceph.keyring 2023-07-27T20:30:22.804 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-07-27T20:30:22.905 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-27T20:30:22.974 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.72'), ('mon.b', '172.21.15.173'), ('mon.c', '[v2:172.21.15.173:3301,v1:172.21.15.173:6790]')] 2023-07-27T20:30:22.974 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.72,172.21.15.173,[v2:172.21.15.173:3301,v1:172.21.15.173:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-07-27T20:30:22.975 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-27T20:30:22.975 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-07-27T20:30:23.021 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.72 --add b 172.21.15.173 --addv c '[v2:172.21.15.173:3301,v1:172.21.15.173:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-07-27T20:30:23.148 INFO:teuthology.orchestra.run.smithi072.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-07-27T20:30:23.149 INFO:teuthology.orchestra.run.smithi072.stdout:monmaptool: generated fsid 173d349e-573f-4bc7-9f3a-2e1b4345c501 2023-07-27T20:30:23.149 INFO:teuthology.orchestra.run.smithi072.stdout:setting min_mon_release = pacific 2023-07-27T20:30:23.149 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 0 2023-07-27T20:30:23.149 INFO:teuthology.orchestra.run.smithi072.stdout:fsid 173d349e-573f-4bc7-9f3a-2e1b4345c501 2023-07-27T20:30:23.149 INFO:teuthology.orchestra.run.smithi072.stdout:last_changed 2023-07-27T20:30:23.162199+0000 2023-07-27T20:30:23.149 INFO:teuthology.orchestra.run.smithi072.stdout:created 2023-07-27T20:30:23.162199+0000 2023-07-27T20:30:23.150 INFO:teuthology.orchestra.run.smithi072.stdout:min_mon_release 16 (pacific) 2023-07-27T20:30:23.150 INFO:teuthology.orchestra.run.smithi072.stdout:election_strategy: 1 2023-07-27T20:30:23.150 INFO:teuthology.orchestra.run.smithi072.stdout:0: [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] mon.a 2023-07-27T20:30:23.150 INFO:teuthology.orchestra.run.smithi072.stdout:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2023-07-27T20:30:23.150 INFO:teuthology.orchestra.run.smithi072.stdout:2: [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] mon.c 2023-07-27T20:30:23.150 INFO:teuthology.orchestra.run.smithi072.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-07-27T20:30:23.152 DEBUG:teuthology.orchestra.run.smithi072:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-07-27T20:30:23.196 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 173d349e-573f-4bc7-9f3a-2e1b4345c501... 2023-07-27T20:30:23.197 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-27T20:30:23.240 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-27T20:30:23.353 INFO:teuthology.orchestra.run.smithi072.stdout:[global] 2023-07-27T20:30:23.353 INFO:teuthology.orchestra.run.smithi072.stdout: chdir = "" 2023-07-27T20:30:23.353 INFO:teuthology.orchestra.run.smithi072.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-27T20:30:23.353 INFO:teuthology.orchestra.run.smithi072.stdout: auth supported = cephx 2023-07-27T20:30:23.353 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:30:23.353 INFO:teuthology.orchestra.run.smithi072.stdout: filestore xattr use omap = true 2023-07-27T20:30:23.354 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:30:23.354 INFO:teuthology.orchestra.run.smithi072.stdout: mon clock drift allowed = 1.000 2023-07-27T20:30:23.354 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:30:23.354 INFO:teuthology.orchestra.run.smithi072.stdout: osd crush chooseleaf type = 0 2023-07-27T20:30:23.354 INFO:teuthology.orchestra.run.smithi072.stdout: auth debug = true 2023-07-27T20:30:23.354 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:30:23.354 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on old message = true 2023-07-27T20:30:23.355 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on bug = true 2023-07-27T20:30:23.355 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:30:23.355 INFO:teuthology.orchestra.run.smithi072.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-27T20:30:23.355 INFO:teuthology.orchestra.run.smithi072.stdout: mon pg warn max object skew = 0 2023-07-27T20:30:23.355 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:30:23.355 INFO:teuthology.orchestra.run.smithi072.stdout: # disable pg_autoscaler by default for new pools 2023-07-27T20:30:23.355 INFO:teuthology.orchestra.run.smithi072.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-27T20:30:23.355 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:30:23.356 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default size = 2 2023-07-27T20:30:23.356 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:30:23.356 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow primary affinity = true 2023-07-27T20:30:23.356 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow pg remap = true 2023-07-27T20:30:23.356 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on legacy crush tunables = false 2023-07-27T20:30:23.356 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on crush straw calc version zero = false 2023-07-27T20:30:23.356 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on no sortbitwise = false 2023-07-27T20:30:23.356 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on osd down out interval zero = false 2023-07-27T20:30:23.357 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on too few osds = false 2023-07-27T20:30:23.357 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-27T20:30:23.357 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-27T20:30:23.357 INFO:teuthology.orchestra.run.smithi072.stdout: mon_allow_pool_size_one = true 2023-07-27T20:30:23.357 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:30:23.357 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-27T20:30:23.357 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:30:23.358 INFO:teuthology.orchestra.run.smithi072.stdout: osd default data pool replay window = 5 2023-07-27T20:30:23.358 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:30:23.358 INFO:teuthology.orchestra.run.smithi072.stdout: mon allow pool delete = true 2023-07-27T20:30:23.358 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:30:23.358 INFO:teuthology.orchestra.run.smithi072.stdout: mon cluster log file level = debug 2023-07-27T20:30:23.358 INFO:teuthology.orchestra.run.smithi072.stdout: debug asserts on shutdown = true 2023-07-27T20:30:23.358 INFO:teuthology.orchestra.run.smithi072.stdout: mon health detail to clog = false 2023-07-27T20:30:23.358 INFO:teuthology.orchestra.run.smithi072.stdout: mon host = "172.21.15.72,172.21.15.173,[v2:172.21.15.173:3301,v1:172.21.15.173:6790]" 2023-07-27T20:30:23.359 INFO:teuthology.orchestra.run.smithi072.stdout: fsid = 173d349e-573f-4bc7-9f3a-2e1b4345c501 2023-07-27T20:30:23.359 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:30:23.359 INFO:teuthology.orchestra.run.smithi072.stdout:[osd] 2023-07-27T20:30:23.359 INFO:teuthology.orchestra.run.smithi072.stdout: osd journal size = 100 2023-07-27T20:30:23.359 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:30:23.359 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub load threshold = 5.0 2023-07-27T20:30:23.359 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub max interval = 600 2023-07-27T20:30:23.359 INFO:teuthology.orchestra.run.smithi072.stdout: osd mclock profile = high_recovery_ops 2023-07-27T20:30:23.360 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:30:23.360 INFO:teuthology.orchestra.run.smithi072.stdout: osd recover clone overlap = true 2023-07-27T20:30:23.360 INFO:teuthology.orchestra.run.smithi072.stdout: osd recovery max chunk = 1048576 2023-07-27T20:30:23.360 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:30:23.360 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug shutdown = true 2023-07-27T20:30:23.360 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug op order = true 2023-07-27T20:30:23.360 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug verify stray on activate = true 2023-07-27T20:30:23.361 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:30:23.361 INFO:teuthology.orchestra.run.smithi072.stdout: osd open classes on start = true 2023-07-27T20:30:23.361 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug pg log writeout = true 2023-07-27T20:30:23.361 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:30:23.361 INFO:teuthology.orchestra.run.smithi072.stdout: osd deep scrub update digest min age = 30 2023-07-27T20:30:23.361 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:30:23.361 INFO:teuthology.orchestra.run.smithi072.stdout: osd map max advance = 10 2023-07-27T20:30:23.361 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:30:23.362 INFO:teuthology.orchestra.run.smithi072.stdout: journal zero on create = true 2023-07-27T20:30:23.362 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:30:23.362 INFO:teuthology.orchestra.run.smithi072.stdout: filestore ondisk finisher threads = 3 2023-07-27T20:30:23.362 INFO:teuthology.orchestra.run.smithi072.stdout: filestore apply finisher threads = 3 2023-07-27T20:30:23.362 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:30:23.362 INFO:teuthology.orchestra.run.smithi072.stdout: bdev debug aio = true 2023-07-27T20:30:23.362 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug misdirected ops = true 2023-07-27T20:30:23.362 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore block size = 96636764160 2023-07-27T20:30:23.363 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore fsck on mount = True 2023-07-27T20:30:23.363 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluefs = 20 2023-07-27T20:30:23.363 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluestore = 20 2023-07-27T20:30:23.363 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-07-27T20:30:23.363 INFO:teuthology.orchestra.run.smithi072.stdout: debug osd = 20 2023-07-27T20:30:23.363 INFO:teuthology.orchestra.run.smithi072.stdout: debug rocksdb = 10 2023-07-27T20:30:23.363 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd backfillfull_ratio = 0.85 2023-07-27T20:30:23.363 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd full ratio = 0.9 2023-07-27T20:30:23.364 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd nearfull ratio = 0.8 2023-07-27T20:30:23.364 INFO:teuthology.orchestra.run.smithi072.stdout: osd failsafe full ratio = 0.95 2023-07-27T20:30:23.364 INFO:teuthology.orchestra.run.smithi072.stdout: osd objectstore = bluestore 2023-07-27T20:30:23.364 INFO:teuthology.orchestra.run.smithi072.stdout: osd op complaint time = 180 2023-07-27T20:30:23.364 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:30:23.364 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr] 2023-07-27T20:30:23.364 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-07-27T20:30:23.364 INFO:teuthology.orchestra.run.smithi072.stdout: debug mgr = 20 2023-07-27T20:30:23.365 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2023-07-27T20:30:23.365 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2023-07-27T20:30:23.365 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2023-07-27T20:30:23.365 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2023-07-27T20:30:23.365 INFO:teuthology.orchestra.run.smithi072.stdout: mgr/telemetry/nag = false 2023-07-27T20:30:23.365 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:30:23.365 INFO:teuthology.orchestra.run.smithi072.stdout:[mon] 2023-07-27T20:30:23.366 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-07-27T20:30:23.366 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2023-07-27T20:30:23.366 INFO:teuthology.orchestra.run.smithi072.stdout: debug paxos = 20 2023-07-27T20:30:23.366 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2023-07-27T20:30:23.366 INFO:teuthology.orchestra.run.smithi072.stdout: mon data avail warn = 5 2023-07-27T20:30:23.366 INFO:teuthology.orchestra.run.smithi072.stdout: mon mgr mkfs grace = 240 2023-07-27T20:30:23.366 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2023-07-27T20:30:23.366 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd reporter subtree level = osd 2023-07-27T20:30:23.367 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd prime pg temp = true 2023-07-27T20:30:23.367 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2023-07-27T20:30:23.367 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:30:23.367 INFO:teuthology.orchestra.run.smithi072.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-27T20:30:23.367 INFO:teuthology.orchestra.run.smithi072.stdout: auth mon ticket ttl = 660 # 11m 2023-07-27T20:30:23.367 INFO:teuthology.orchestra.run.smithi072.stdout: auth service ticket ttl = 240 # 4m 2023-07-27T20:30:23.367 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:30:23.367 INFO:teuthology.orchestra.run.smithi072.stdout: # don't complain about insecure global_id in the test suite 2023-07-27T20:30:23.368 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-27T20:30:23.368 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-27T20:30:23.368 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:30:23.368 INFO:teuthology.orchestra.run.smithi072.stdout: # 1m isn't quite enough 2023-07-27T20:30:23.368 INFO:teuthology.orchestra.run.smithi072.stdout: mon_down_mkfs_grace = 2m 2023-07-27T20:30:23.369 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:30:23.369 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_filestore_osds = false 2023-07-27T20:30:23.369 INFO:teuthology.orchestra.run.smithi072.stdout: mon op complaint time = 120 2023-07-27T20:30:23.369 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:30:23.370 INFO:teuthology.orchestra.run.smithi072.stdout:[client] 2023-07-27T20:30:23.370 INFO:teuthology.orchestra.run.smithi072.stdout: rgw cache enabled = true 2023-07-27T20:30:23.370 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable ops log = true 2023-07-27T20:30:23.370 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable usage log = true 2023-07-27T20:30:23.370 INFO:teuthology.orchestra.run.smithi072.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-27T20:30:23.370 INFO:teuthology.orchestra.run.smithi072.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-27T20:30:23.370 INFO:teuthology.orchestra.run.smithi072.stdout: client mount timeout = 600 2023-07-27T20:30:23.370 INFO:teuthology.orchestra.run.smithi072.stdout: debug client = 20 2023-07-27T20:30:23.371 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-07-27T20:30:23.371 INFO:teuthology.orchestra.run.smithi072.stdout: rados mon op timeout = 900 2023-07-27T20:30:23.371 INFO:teuthology.orchestra.run.smithi072.stdout: rados osd op timeout = 900 2023-07-27T20:30:23.371 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.a] 2023-07-27T20:30:23.371 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.b] 2023-07-27T20:30:23.371 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.c] 2023-07-27T20:30:23.371 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.a] 2023-07-27T20:30:23.372 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.c] 2023-07-27T20:30:23.372 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.b] 2023-07-27T20:30:23.372 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.d] 2023-07-27T20:30:23.372 INFO:teuthology.orchestra.run.smithi072.stdout:[mds] 2023-07-27T20:30:23.372 INFO:teuthology.orchestra.run.smithi072.stdout: debug mds = 20 2023-07-27T20:30:23.372 INFO:teuthology.orchestra.run.smithi072.stdout: debug mds balancer = 20 2023-07-27T20:30:23.372 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-07-27T20:30:23.373 INFO:teuthology.orchestra.run.smithi072.stdout: mds debug frag = True 2023-07-27T20:30:23.373 INFO:teuthology.orchestra.run.smithi072.stdout: mds debug scatterstat = True 2023-07-27T20:30:23.373 INFO:teuthology.orchestra.run.smithi072.stdout: mds op complaint time = 180 2023-07-27T20:30:23.373 INFO:teuthology.orchestra.run.smithi072.stdout: mds verify scatter = True 2023-07-27T20:30:23.373 INFO:teuthology.orchestra.run.smithi072.stdout: osd op complaint time = 180 2023-07-27T20:30:23.373 INFO:teuthology.orchestra.run.smithi072.stdout: rados mon op timeout = 900 2023-07-27T20:30:23.373 INFO:teuthology.orchestra.run.smithi072.stdout: rados osd op timeout = 900 2023-07-27T20:30:23.374 INFO:teuthology.orchestra.run.smithi173.stdout:[global] 2023-07-27T20:30:23.374 INFO:teuthology.orchestra.run.smithi173.stdout: chdir = "" 2023-07-27T20:30:23.374 INFO:teuthology.orchestra.run.smithi173.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-27T20:30:23.374 INFO:teuthology.orchestra.run.smithi173.stdout: auth supported = cephx 2023-07-27T20:30:23.374 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T20:30:23.375 INFO:teuthology.orchestra.run.smithi173.stdout: filestore xattr use omap = true 2023-07-27T20:30:23.375 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T20:30:23.375 INFO:teuthology.orchestra.run.smithi173.stdout: mon clock drift allowed = 1.000 2023-07-27T20:30:23.375 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T20:30:23.375 INFO:teuthology.orchestra.run.smithi173.stdout: osd crush chooseleaf type = 0 2023-07-27T20:30:23.375 INFO:teuthology.orchestra.run.smithi173.stdout: auth debug = true 2023-07-27T20:30:23.375 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T20:30:23.376 INFO:teuthology.orchestra.run.smithi173.stdout: ms die on old message = true 2023-07-27T20:30:23.376 INFO:teuthology.orchestra.run.smithi173.stdout: ms die on bug = true 2023-07-27T20:30:23.376 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T20:30:23.376 INFO:teuthology.orchestra.run.smithi173.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-27T20:30:23.376 INFO:teuthology.orchestra.run.smithi173.stdout: mon pg warn max object skew = 0 2023-07-27T20:30:23.377 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T20:30:23.377 INFO:teuthology.orchestra.run.smithi173.stdout: # disable pg_autoscaler by default for new pools 2023-07-27T20:30:23.377 INFO:teuthology.orchestra.run.smithi173.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-27T20:30:23.377 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T20:30:23.377 INFO:teuthology.orchestra.run.smithi173.stdout: osd pool default size = 2 2023-07-27T20:30:23.377 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T20:30:23.377 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd allow primary affinity = true 2023-07-27T20:30:23.377 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd allow pg remap = true 2023-07-27T20:30:23.378 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on legacy crush tunables = false 2023-07-27T20:30:23.378 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on crush straw calc version zero = false 2023-07-27T20:30:23.378 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on no sortbitwise = false 2023-07-27T20:30:23.378 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on osd down out interval zero = false 2023-07-27T20:30:23.378 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on too few osds = false 2023-07-27T20:30:23.378 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-27T20:30:23.378 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-27T20:30:23.379 INFO:teuthology.orchestra.run.smithi173.stdout: mon_allow_pool_size_one = true 2023-07-27T20:30:23.379 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T20:30:23.379 INFO:teuthology.orchestra.run.smithi173.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-27T20:30:23.379 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T20:30:23.379 INFO:teuthology.orchestra.run.smithi173.stdout: osd default data pool replay window = 5 2023-07-27T20:30:23.379 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T20:30:23.379 INFO:teuthology.orchestra.run.smithi173.stdout: mon allow pool delete = true 2023-07-27T20:30:23.379 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T20:30:23.380 INFO:teuthology.orchestra.run.smithi173.stdout: mon cluster log file level = debug 2023-07-27T20:30:23.380 INFO:teuthology.orchestra.run.smithi173.stdout: debug asserts on shutdown = true 2023-07-27T20:30:23.380 INFO:teuthology.orchestra.run.smithi173.stdout: mon health detail to clog = false 2023-07-27T20:30:23.380 INFO:teuthology.orchestra.run.smithi173.stdout: mon host = "172.21.15.72,172.21.15.173,[v2:172.21.15.173:3301,v1:172.21.15.173:6790]" 2023-07-27T20:30:23.380 INFO:teuthology.orchestra.run.smithi173.stdout: fsid = 173d349e-573f-4bc7-9f3a-2e1b4345c501 2023-07-27T20:30:23.380 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T20:30:23.380 INFO:teuthology.orchestra.run.smithi173.stdout:[osd] 2023-07-27T20:30:23.381 INFO:teuthology.orchestra.run.smithi173.stdout: osd journal size = 100 2023-07-27T20:30:23.381 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T20:30:23.381 INFO:teuthology.orchestra.run.smithi173.stdout: osd scrub load threshold = 5.0 2023-07-27T20:30:23.381 INFO:teuthology.orchestra.run.smithi173.stdout: osd scrub max interval = 600 2023-07-27T20:30:23.381 INFO:teuthology.orchestra.run.smithi173.stdout: osd mclock profile = high_recovery_ops 2023-07-27T20:30:23.381 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T20:30:23.381 INFO:teuthology.orchestra.run.smithi173.stdout: osd recover clone overlap = true 2023-07-27T20:30:23.381 INFO:teuthology.orchestra.run.smithi173.stdout: osd recovery max chunk = 1048576 2023-07-27T20:30:23.382 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T20:30:23.382 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug shutdown = true 2023-07-27T20:30:23.382 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug op order = true 2023-07-27T20:30:23.382 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug verify stray on activate = true 2023-07-27T20:30:23.382 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T20:30:23.382 INFO:teuthology.orchestra.run.smithi173.stdout: osd open classes on start = true 2023-07-27T20:30:23.382 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug pg log writeout = true 2023-07-27T20:30:23.383 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T20:30:23.383 INFO:teuthology.orchestra.run.smithi173.stdout: osd deep scrub update digest min age = 30 2023-07-27T20:30:23.383 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T20:30:23.383 INFO:teuthology.orchestra.run.smithi173.stdout: osd map max advance = 10 2023-07-27T20:30:23.383 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T20:30:23.383 INFO:teuthology.orchestra.run.smithi173.stdout: journal zero on create = true 2023-07-27T20:30:23.383 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T20:30:23.383 INFO:teuthology.orchestra.run.smithi173.stdout: filestore ondisk finisher threads = 3 2023-07-27T20:30:23.384 INFO:teuthology.orchestra.run.smithi173.stdout: filestore apply finisher threads = 3 2023-07-27T20:30:23.384 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T20:30:23.384 INFO:teuthology.orchestra.run.smithi173.stdout: bdev debug aio = true 2023-07-27T20:30:23.384 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug misdirected ops = true 2023-07-27T20:30:23.384 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore block size = 96636764160 2023-07-27T20:30:23.384 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore fsck on mount = True 2023-07-27T20:30:23.384 INFO:teuthology.orchestra.run.smithi173.stdout: debug bluefs = 20 2023-07-27T20:30:23.385 INFO:teuthology.orchestra.run.smithi173.stdout: debug bluestore = 20 2023-07-27T20:30:23.385 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2023-07-27T20:30:23.385 INFO:teuthology.orchestra.run.smithi173.stdout: debug osd = 20 2023-07-27T20:30:23.385 INFO:teuthology.orchestra.run.smithi173.stdout: debug rocksdb = 10 2023-07-27T20:30:23.385 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd backfillfull_ratio = 0.85 2023-07-27T20:30:23.385 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd full ratio = 0.9 2023-07-27T20:30:23.385 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd nearfull ratio = 0.8 2023-07-27T20:30:23.386 INFO:teuthology.orchestra.run.smithi173.stdout: osd failsafe full ratio = 0.95 2023-07-27T20:30:23.386 INFO:teuthology.orchestra.run.smithi173.stdout: osd objectstore = bluestore 2023-07-27T20:30:23.386 INFO:teuthology.orchestra.run.smithi173.stdout: osd op complaint time = 180 2023-07-27T20:30:23.386 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T20:30:23.386 INFO:teuthology.orchestra.run.smithi173.stdout:[mgr] 2023-07-27T20:30:23.386 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2023-07-27T20:30:23.386 INFO:teuthology.orchestra.run.smithi173.stdout: debug mgr = 20 2023-07-27T20:30:23.386 INFO:teuthology.orchestra.run.smithi173.stdout: debug mon = 20 2023-07-27T20:30:23.387 INFO:teuthology.orchestra.run.smithi173.stdout: debug auth = 20 2023-07-27T20:30:23.387 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min pgs per osd = 4 2023-07-27T20:30:23.387 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min bytes per osd = 10 2023-07-27T20:30:23.387 INFO:teuthology.orchestra.run.smithi173.stdout: mgr/telemetry/nag = false 2023-07-27T20:30:23.387 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T20:30:23.387 INFO:teuthology.orchestra.run.smithi173.stdout:[mon] 2023-07-27T20:30:23.387 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2023-07-27T20:30:23.387 INFO:teuthology.orchestra.run.smithi173.stdout: debug mon = 20 2023-07-27T20:30:23.388 INFO:teuthology.orchestra.run.smithi173.stdout: debug paxos = 20 2023-07-27T20:30:23.388 INFO:teuthology.orchestra.run.smithi173.stdout: debug auth = 20 2023-07-27T20:30:23.388 INFO:teuthology.orchestra.run.smithi173.stdout: mon data avail warn = 5 2023-07-27T20:30:23.388 INFO:teuthology.orchestra.run.smithi173.stdout: mon mgr mkfs grace = 240 2023-07-27T20:30:23.388 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min pgs per osd = 4 2023-07-27T20:30:23.388 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd reporter subtree level = osd 2023-07-27T20:30:23.388 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd prime pg temp = true 2023-07-27T20:30:23.388 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min bytes per osd = 10 2023-07-27T20:30:23.389 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T20:30:23.389 INFO:teuthology.orchestra.run.smithi173.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-27T20:30:23.389 INFO:teuthology.orchestra.run.smithi173.stdout: auth mon ticket ttl = 660 # 11m 2023-07-27T20:30:23.389 INFO:teuthology.orchestra.run.smithi173.stdout: auth service ticket ttl = 240 # 4m 2023-07-27T20:30:23.389 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T20:30:23.389 INFO:teuthology.orchestra.run.smithi173.stdout: # don't complain about insecure global_id in the test suite 2023-07-27T20:30:23.389 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-27T20:30:23.390 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-27T20:30:23.390 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T20:30:23.390 INFO:teuthology.orchestra.run.smithi173.stdout: # 1m isn't quite enough 2023-07-27T20:30:23.390 INFO:teuthology.orchestra.run.smithi173.stdout: mon_down_mkfs_grace = 2m 2023-07-27T20:30:23.390 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T20:30:23.390 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_filestore_osds = false 2023-07-27T20:30:23.390 INFO:teuthology.orchestra.run.smithi173.stdout: mon op complaint time = 120 2023-07-27T20:30:23.390 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-07-27T20:30:23.391 INFO:teuthology.orchestra.run.smithi173.stdout:[client] 2023-07-27T20:30:23.391 INFO:teuthology.orchestra.run.smithi173.stdout: rgw cache enabled = true 2023-07-27T20:30:23.391 INFO:teuthology.orchestra.run.smithi173.stdout: rgw enable ops log = true 2023-07-27T20:30:23.391 INFO:teuthology.orchestra.run.smithi173.stdout: rgw enable usage log = true 2023-07-27T20:30:23.391 INFO:teuthology.orchestra.run.smithi173.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-27T20:30:23.391 INFO:teuthology.orchestra.run.smithi173.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-27T20:30:23.391 INFO:teuthology.orchestra.run.smithi173.stdout: client mount timeout = 600 2023-07-27T20:30:23.391 INFO:teuthology.orchestra.run.smithi173.stdout: debug client = 20 2023-07-27T20:30:23.392 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2023-07-27T20:30:23.392 INFO:teuthology.orchestra.run.smithi173.stdout: rados mon op timeout = 900 2023-07-27T20:30:23.392 INFO:teuthology.orchestra.run.smithi173.stdout: rados osd op timeout = 900 2023-07-27T20:30:23.392 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.a] 2023-07-27T20:30:23.392 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.b] 2023-07-27T20:30:23.392 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.c] 2023-07-27T20:30:23.392 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.a] 2023-07-27T20:30:23.392 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.c] 2023-07-27T20:30:23.393 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.b] 2023-07-27T20:30:23.393 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.d] 2023-07-27T20:30:23.393 INFO:teuthology.orchestra.run.smithi173.stdout:[mds] 2023-07-27T20:30:23.393 INFO:teuthology.orchestra.run.smithi173.stdout: debug mds = 20 2023-07-27T20:30:23.393 INFO:teuthology.orchestra.run.smithi173.stdout: debug mds balancer = 20 2023-07-27T20:30:23.393 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2023-07-27T20:30:23.393 INFO:teuthology.orchestra.run.smithi173.stdout: mds debug frag = True 2023-07-27T20:30:23.394 INFO:teuthology.orchestra.run.smithi173.stdout: mds debug scatterstat = True 2023-07-27T20:30:23.394 INFO:teuthology.orchestra.run.smithi173.stdout: mds op complaint time = 180 2023-07-27T20:30:23.394 INFO:teuthology.orchestra.run.smithi173.stdout: mds verify scatter = True 2023-07-27T20:30:23.394 INFO:teuthology.orchestra.run.smithi173.stdout: osd op complaint time = 180 2023-07-27T20:30:23.394 INFO:teuthology.orchestra.run.smithi173.stdout: rados mon op timeout = 900 2023-07-27T20:30:23.394 INFO:teuthology.orchestra.run.smithi173.stdout: rados osd op timeout = 900 2023-07-27T20:30:23.395 INFO:tasks.ceph:Creating admin key on mon.a... 2023-07-27T20:30:23.396 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-07-27T20:30:23.508 INFO:tasks.ceph:Copying monmap to all nodes... 2023-07-27T20:30:23.508 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-27T20:30:23.508 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-07-27T20:30:23.553 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-27T20:30:23.554 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-07-27T20:30:23.638 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi072.front.sepia.ceph.com 2023-07-27T20:30:23.639 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-27T20:30:23.639 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-27T20:30:23.639 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-27T20:30:23.772 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-27T20:30:23.772 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-27T20:30:23.857 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi173.front.sepia.ceph.com 2023-07-27T20:30:23.858 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-07-27T20:30:23.858 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-27T20:30:23.859 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-27T20:30:23.954 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-07-27T20:30:23.954 DEBUG:teuthology.orchestra.run.smithi173:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-27T20:30:24.039 INFO:tasks.ceph:Setting up mon nodes... 2023-07-27T20:30:24.040 INFO:tasks.ceph:Setting up mgr nodes... 2023-07-27T20:30:24.040 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-07-27T20:30:24.162 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-07-27T20:30:24.168 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-07-27T20:30:24.295 INFO:teuthology.orchestra.run.smithi173.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-07-27T20:30:24.301 INFO:tasks.ceph:Setting up mds nodes... 2023-07-27T20:30:24.302 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-07-27T20:30:24.424 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-07-27T20:30:24.429 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-07-27T20:30:24.499 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-07-27T20:30:24.620 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-07-27T20:30:24.625 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-07-27T20:30:24.694 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-07-27T20:30:24.817 INFO:teuthology.orchestra.run.smithi173.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-07-27T20:30:24.822 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-07-27T20:30:24.891 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-07-27T20:30:25.013 INFO:teuthology.orchestra.run.smithi173.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-07-27T20:30:25.019 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-07-27T20:30:25.088 INFO:tasks.ceph_client:Setting up client nodes... 2023-07-27T20:30:25.089 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-07-27T20:30:25.188 INFO:teuthology.orchestra.run.smithi072.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-07-27T20:30:25.218 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-07-27T20:30:25.316 INFO:teuthology.orchestra.run.smithi173.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-07-27T20:30:25.346 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-07-27T20:30:25.347 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi072.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi173.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-27T20:30:25.347 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-07-27T20:30:25.417 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-27T20:30:25.417 INFO:tasks.ceph:role: osd.0 2023-07-27T20:30:25.417 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi072.front.sepia.ceph.com 2023-07-27T20:30:25.417 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-27T20:30:25.493 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-27T20:30:25.494 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-27T20:30:25.494 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-27T20:30:25.494 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-27T20:30:25.494 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-27T20:30:25.494 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2023-07-27T20:30:25.494 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-27T20:30:25.495 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-27T20:30:25.495 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-27T20:30:25.495 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-27T20:30:25.916 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2023-07-27T20:30:25.919 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2023-07-27T20:30:25.920 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-07-27T20:30:26.123 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-07-27T20:30:26.201 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-07-27T20:30:26.272 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-27T20:30:26.272 INFO:tasks.ceph:role: osd.1 2023-07-27T20:30:26.273 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi072.front.sepia.ceph.com 2023-07-27T20:30:26.273 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-27T20:30:26.349 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-27T20:30:26.350 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-27T20:30:26.350 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-27T20:30:26.350 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-27T20:30:26.350 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-27T20:30:26.350 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2023-07-27T20:30:26.350 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-27T20:30:26.350 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-27T20:30:26.351 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-27T20:30:26.351 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-27T20:30:26.772 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2023-07-27T20:30:26.775 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2023-07-27T20:30:26.775 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-07-27T20:30:26.932 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-07-27T20:30:27.011 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-07-27T20:30:27.082 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-27T20:30:27.082 INFO:tasks.ceph:role: osd.2 2023-07-27T20:30:27.082 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi072.front.sepia.ceph.com 2023-07-27T20:30:27.083 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-27T20:30:27.159 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-27T20:30:27.159 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-27T20:30:27.160 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-27T20:30:27.160 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-27T20:30:27.160 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-27T20:30:27.160 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2023-07-27T20:30:27.160 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-27T20:30:27.160 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-27T20:30:27.160 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-27T20:30:27.161 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-27T20:30:27.602 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2023-07-27T20:30:27.606 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2023-07-27T20:30:27.607 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-07-27T20:30:27.802 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-07-27T20:30:27.878 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-07-27T20:30:27.948 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-27T20:30:27.948 INFO:tasks.ceph:role: osd.3 2023-07-27T20:30:27.948 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi072.front.sepia.ceph.com 2023-07-27T20:30:27.949 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-27T20:30:28.025 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-27T20:30:28.025 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-27T20:30:28.025 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-27T20:30:28.025 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-27T20:30:28.025 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-27T20:30:28.026 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2023-07-27T20:30:28.026 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-27T20:30:28.026 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-27T20:30:28.026 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-27T20:30:28.026 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-27T20:30:28.456 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2023-07-27T20:30:28.460 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2023-07-27T20:30:28.460 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-07-27T20:30:28.583 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-07-27T20:30:28.659 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-27T20:30:28.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:30:28.791+0000 7f6ca90e7640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-07-27T20:30:28.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:30:28.791+0000 7f6ca90e7640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-07-27T20:30:28.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:30:28.791+0000 7f6ca90e7640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-27T20:30:28.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:30:28.791+0000 7f6ca90e7640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-27T20:30:28.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:30:28.791+0000 7f6ca90e7640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-27T20:30:28.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:30:28.793+0000 7f6ca90e7640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-07-27T20:30:31.667 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-07-27T20:30:31.740 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-27T20:30:31.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:30:31.857+0000 7efcedf94640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-07-27T20:30:31.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:30:31.858+0000 7efcedf94640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-07-27T20:30:31.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:30:31.858+0000 7efcedf94640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-27T20:30:31.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:30:31.858+0000 7efcedf94640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-27T20:30:31.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:30:31.858+0000 7efcedf94640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-27T20:30:31.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:30:31.859+0000 7efcedf94640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-07-27T20:30:34.734 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-07-27T20:30:34.808 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-27T20:30:34.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:30:34.926+0000 7efeb6cd2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-07-27T20:30:34.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:30:34.926+0000 7efeb6cd2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-07-27T20:30:34.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:30:34.926+0000 7efeb6cd2640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-27T20:30:34.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:30:34.926+0000 7efeb6cd2640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-27T20:30:34.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:30:34.926+0000 7efeb6cd2640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-27T20:30:34.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:30:34.928+0000 7efeb6cd2640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-07-27T20:30:37.796 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-07-27T20:30:37.871 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-27T20:30:37.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:30:37.989+0000 7f8a30087640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-07-27T20:30:37.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:30:37.989+0000 7f8a30087640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-07-27T20:30:37.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:30:37.989+0000 7f8a30087640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-27T20:30:37.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:30:37.989+0000 7f8a30087640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-27T20:30:37.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:30:37.990+0000 7f8a30087640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-27T20:30:37.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:30:37.992+0000 7f8a30087640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-07-27T20:30:40.860 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-07-27T20:30:40.933 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-07-27T20:30:41.010 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-27T20:30:41.011 INFO:tasks.ceph:role: osd.4 2023-07-27T20:30:41.012 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi173.front.sepia.ceph.com 2023-07-27T20:30:41.012 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-27T20:30:41.091 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-27T20:30:41.091 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-27T20:30:41.092 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-27T20:30:41.092 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-27T20:30:41.092 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-27T20:30:41.092 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2023-07-27T20:30:41.092 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-27T20:30:41.092 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-27T20:30:41.093 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-27T20:30:41.093 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-27T20:30:41.517 INFO:teuthology.orchestra.run.smithi173.stdout:Discarding blocks...Done. 2023-07-27T20:30:41.521 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2023-07-27T20:30:41.522 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-07-27T20:30:41.712 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-07-27T20:30:41.792 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-07-27T20:30:41.861 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-27T20:30:41.862 INFO:tasks.ceph:role: osd.5 2023-07-27T20:30:41.862 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi173.front.sepia.ceph.com 2023-07-27T20:30:41.862 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-27T20:30:41.938 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-27T20:30:41.938 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-27T20:30:41.938 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-27T20:30:41.938 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-27T20:30:41.939 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-27T20:30:41.939 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2023-07-27T20:30:41.939 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-27T20:30:41.939 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-27T20:30:41.939 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-27T20:30:41.939 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-27T20:30:42.352 INFO:teuthology.orchestra.run.smithi173.stdout:Discarding blocks...Done. 2023-07-27T20:30:42.357 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2023-07-27T20:30:42.358 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-07-27T20:30:42.505 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-07-27T20:30:42.585 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-07-27T20:30:42.658 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-27T20:30:42.659 INFO:tasks.ceph:role: osd.6 2023-07-27T20:30:42.659 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi173.front.sepia.ceph.com 2023-07-27T20:30:42.659 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-27T20:30:42.741 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-27T20:30:42.741 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-27T20:30:42.742 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-27T20:30:42.742 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-27T20:30:42.742 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-27T20:30:42.742 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2023-07-27T20:30:42.742 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-27T20:30:42.742 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-27T20:30:42.742 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-27T20:30:42.743 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-27T20:30:43.186 INFO:teuthology.orchestra.run.smithi173.stdout:Discarding blocks...Done. 2023-07-27T20:30:43.190 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2023-07-27T20:30:43.191 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-07-27T20:30:43.384 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-07-27T20:30:43.461 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-07-27T20:30:43.530 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-27T20:30:43.531 INFO:tasks.ceph:role: osd.7 2023-07-27T20:30:43.531 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi173.front.sepia.ceph.com 2023-07-27T20:30:43.531 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-27T20:30:43.606 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-27T20:30:43.607 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-27T20:30:43.607 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-27T20:30:43.607 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-27T20:30:43.607 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-27T20:30:43.607 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2023-07-27T20:30:43.607 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-27T20:30:43.608 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-27T20:30:43.608 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-27T20:30:43.608 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-27T20:30:44.042 INFO:teuthology.orchestra.run.smithi173.stdout:Discarding blocks...Done. 2023-07-27T20:30:44.045 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2023-07-27T20:30:44.046 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-07-27T20:30:44.168 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-07-27T20:30:44.244 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-27T20:30:44.363 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:30:44.375+0000 7f7e771dc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-07-27T20:30:44.364 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:30:44.376+0000 7f7e771dc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-07-27T20:30:44.364 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:30:44.376+0000 7f7e771dc640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-27T20:30:44.365 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:30:44.376+0000 7f7e771dc640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-27T20:30:44.365 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:30:44.376+0000 7f7e771dc640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-27T20:30:44.365 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:30:44.378+0000 7f7e771dc640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-07-27T20:30:47.252 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-07-27T20:30:47.324 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-27T20:30:47.430 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:30:47.442+0000 7f837ed4e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-07-27T20:30:47.431 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:30:47.443+0000 7f837ed4e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-07-27T20:30:47.431 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:30:47.443+0000 7f837ed4e640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-27T20:30:47.431 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:30:47.443+0000 7f837ed4e640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-27T20:30:47.431 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:30:47.443+0000 7f837ed4e640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-27T20:30:47.432 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:30:47.444+0000 7f837ed4e640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-07-27T20:30:50.315 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-07-27T20:30:50.388 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-27T20:30:50.494 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:30:50.506+0000 7fd2a0b6e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-07-27T20:30:50.495 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:30:50.507+0000 7fd2a0b6e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-07-27T20:30:50.495 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:30:50.507+0000 7fd2a0b6e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-27T20:30:50.495 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:30:50.507+0000 7fd2a0b6e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-27T20:30:50.495 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:30:50.507+0000 7fd2a0b6e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-27T20:30:50.496 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:30:50.508+0000 7fd2a0b6e640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-07-27T20:30:50.784 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:30:50.789 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:30:53.385 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-07-27T20:30:53.458 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-27T20:30:53.564 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:30:53.576+0000 7f333814a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-07-27T20:30:53.565 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:30:53.577+0000 7f333814a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-07-27T20:30:53.565 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:30:53.577+0000 7f333814a640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-27T20:30:53.565 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:30:53.577+0000 7f333814a640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-27T20:30:53.565 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:30:53.577+0000 7f333814a640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-27T20:30:53.566 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:30:53.579+0000 7f333814a640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-07-27T20:30:56.439 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-07-27T20:30:56.510 INFO:tasks.ceph:Reading keys from all nodes... 2023-07-27T20:30:56.511 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-27T20:30:56.511 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-07-27T20:30:56.587 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-27T20:30:56.588 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-07-27T20:30:56.659 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-27T20:30:56.659 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-07-27T20:30:56.767 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-27T20:30:56.768 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-07-27T20:30:56.876 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-27T20:30:56.876 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-07-27T20:30:56.983 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-27T20:30:56.984 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-07-27T20:30:57.092 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-27T20:30:57.092 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-07-27T20:30:57.201 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-07-27T20:30:57.202 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-07-27T20:30:57.277 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-07-27T20:30:57.277 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-07-27T20:30:57.346 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-07-27T20:30:57.347 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-07-27T20:30:57.455 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-07-27T20:30:57.455 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-07-27T20:30:57.563 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-07-27T20:30:57.564 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-07-27T20:30:57.671 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-07-27T20:30:57.672 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-07-27T20:30:57.780 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-07-27T20:30:57.780 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-07-27T20:30:57.889 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-27T20:30:57.889 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-07-27T20:30:57.940 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-07-27T20:30:57.941 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-07-27T20:30:57.986 INFO:tasks.ceph:Adding keys to all mons... 2023-07-27T20:30:57.986 DEBUG:teuthology.orchestra.run.smithi072:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-27T20:30:57.990 DEBUG:teuthology.orchestra.run.smithi173:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-27T20:30:58.054 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr.y] 2023-07-27T20:30:58.054 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDg08Jk66J/ChAAHpdL/KV5FPIhwbDRhkyT8A== 2023-07-27T20:30:58.054 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.a] 2023-07-27T20:30:58.054 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDg08Jk8ukYGhAA6bynYjjz+XXymZB7RuOqyg== 2023-07-27T20:30:58.055 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.c] 2023-07-27T20:30:58.055 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDg08JkuNrEJRAAk6SZNv+AQw7s4J3iOVhErQ== 2023-07-27T20:30:58.055 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.0] 2023-07-27T20:30:58.055 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDk08Jk8A5ELxAADkFtWQLUf7i2O+HUYDD6dA== 2023-07-27T20:30:58.055 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.1] 2023-07-27T20:30:58.055 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDn08JkNU47MxAAwT5ryQLH8wuYMZhnm1CgRw== 2023-07-27T20:30:58.055 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.2] 2023-07-27T20:30:58.056 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDq08JkaR9TNxAAYeAjHwr/HXuVstPh8+nXWw== 2023-07-27T20:30:58.056 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.3] 2023-07-27T20:30:58.056 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDt08JkLWcVOxAAq9DWPQe8RBPGfq2rLl2e/A== 2023-07-27T20:30:58.056 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr.x] 2023-07-27T20:30:58.056 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDg08JkkKdiEhAAZL2azzLKEawlPleOomXeAw== 2023-07-27T20:30:58.056 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.b] 2023-07-27T20:30:58.056 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDg08Jkowl/MRAAmGDdjr/lGUKHkBQLMdkEzA== 2023-07-27T20:30:58.057 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.d] 2023-07-27T20:30:58.057 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDh08JkfJacARAAX7dowIhLgEsRPraoAJsqMw== 2023-07-27T20:30:58.057 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.4] 2023-07-27T20:30:58.057 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQD008JkwcxvFhAA7qmRzaoSSEBgafwXN4Vnyw== 2023-07-27T20:30:58.057 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.5] 2023-07-27T20:30:58.057 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQD308JkBB9tGhAAq2gNYDg2awDX4BvmWZuMVg== 2023-07-27T20:30:58.057 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.6] 2023-07-27T20:30:58.057 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQD608Jk3FFCHhAA1EWhQfgPRpxC6U+CrjPENw== 2023-07-27T20:30:58.058 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.7] 2023-07-27T20:30:58.058 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQD908Jk1atrIhAATt3nvk2zvQZSWDbuOcxsqg== 2023-07-27T20:30:58.058 INFO:teuthology.orchestra.run.smithi072.stdout:[client.0] 2023-07-27T20:30:58.058 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDh08Jk6SgHDBAAkcBvssFv+WViV/ToWsnLCA== 2023-07-27T20:30:58.058 INFO:teuthology.orchestra.run.smithi072.stdout:[client.1] 2023-07-27T20:30:58.058 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDh08JktvSlExAAay3fDYh/8Ju3iIWOXW8wmw== 2023-07-27T20:30:58.093 INFO:teuthology.orchestra.run.smithi173.stdout:[mgr.y] 2023-07-27T20:30:58.093 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQDg08Jk66J/ChAAHpdL/KV5FPIhwbDRhkyT8A== 2023-07-27T20:30:58.093 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.a] 2023-07-27T20:30:58.093 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQDg08Jk8ukYGhAA6bynYjjz+XXymZB7RuOqyg== 2023-07-27T20:30:58.093 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.c] 2023-07-27T20:30:58.094 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQDg08JkuNrEJRAAk6SZNv+AQw7s4J3iOVhErQ== 2023-07-27T20:30:58.094 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.0] 2023-07-27T20:30:58.094 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQDk08Jk8A5ELxAADkFtWQLUf7i2O+HUYDD6dA== 2023-07-27T20:30:58.094 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.1] 2023-07-27T20:30:58.094 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQDn08JkNU47MxAAwT5ryQLH8wuYMZhnm1CgRw== 2023-07-27T20:30:58.094 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.2] 2023-07-27T20:30:58.094 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQDq08JkaR9TNxAAYeAjHwr/HXuVstPh8+nXWw== 2023-07-27T20:30:58.094 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.3] 2023-07-27T20:30:58.095 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQDt08JkLWcVOxAAq9DWPQe8RBPGfq2rLl2e/A== 2023-07-27T20:30:58.095 INFO:teuthology.orchestra.run.smithi173.stdout:[mgr.x] 2023-07-27T20:30:58.095 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQDg08JkkKdiEhAAZL2azzLKEawlPleOomXeAw== 2023-07-27T20:30:58.095 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.b] 2023-07-27T20:30:58.095 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQDg08Jkowl/MRAAmGDdjr/lGUKHkBQLMdkEzA== 2023-07-27T20:30:58.095 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.d] 2023-07-27T20:30:58.095 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQDh08JkfJacARAAX7dowIhLgEsRPraoAJsqMw== 2023-07-27T20:30:58.096 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.4] 2023-07-27T20:30:58.096 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQD008JkwcxvFhAA7qmRzaoSSEBgafwXN4Vnyw== 2023-07-27T20:30:58.096 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.5] 2023-07-27T20:30:58.096 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQD308JkBB9tGhAAq2gNYDg2awDX4BvmWZuMVg== 2023-07-27T20:30:58.096 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.6] 2023-07-27T20:30:58.096 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQD608Jk3FFCHhAA1EWhQfgPRpxC6U+CrjPENw== 2023-07-27T20:30:58.096 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.7] 2023-07-27T20:30:58.096 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQD908Jk1atrIhAATt3nvk2zvQZSWDbuOcxsqg== 2023-07-27T20:30:58.097 INFO:teuthology.orchestra.run.smithi173.stdout:[client.0] 2023-07-27T20:30:58.097 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQDh08Jk6SgHDBAAkcBvssFv+WViV/ToWsnLCA== 2023-07-27T20:30:58.097 INFO:teuthology.orchestra.run.smithi173.stdout:[client.1] 2023-07-27T20:30:58.097 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQDh08JktvSlExAAay3fDYh/8Ju3iIWOXW8wmw== 2023-07-27T20:30:58.098 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-27T20:30:58.103 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-27T20:30:58.246 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-27T20:30:58.250 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-27T20:30:58.360 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-27T20:30:58.365 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-27T20:30:58.476 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-27T20:30:58.481 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-27T20:30:58.589 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-27T20:30:58.594 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-27T20:30:58.703 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-27T20:30:58.707 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-27T20:30:58.815 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-27T20:30:58.820 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-27T20:30:58.928 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-27T20:30:58.933 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-27T20:30:59.042 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-27T20:30:59.046 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-27T20:30:59.157 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-27T20:30:59.162 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-27T20:30:59.275 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-27T20:30:59.280 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-27T20:30:59.387 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-27T20:30:59.392 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-27T20:30:59.500 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-27T20:30:59.505 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-27T20:30:59.612 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-27T20:30:59.616 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-27T20:30:59.725 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-27T20:30:59.729 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-27T20:30:59.841 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-27T20:30:59.846 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-27T20:30:59.961 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-07-27T20:30:59.961 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-07-27T20:31:00.030 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-27T20:31:00.153 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-07-27T20:31:00.222 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-07-27T20:31:00.292 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-27T20:31:00.415 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-07-27T20:31:00.485 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-07-27T20:31:00.554 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-27T20:31:00.676 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-07-27T20:31:00.745 DEBUG:teuthology.orchestra.run.smithi072:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-27T20:31:00.750 DEBUG:teuthology.orchestra.run.smithi173:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-27T20:31:00.794 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-07-27T20:31:00.795 INFO:tasks.ceph.mon.a:Restarting daemon 2023-07-27T20:31:00.795 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-07-27T20:31:00.836 INFO:tasks.ceph.mon.a:Started 2023-07-27T20:31:00.837 INFO:tasks.ceph.mon.b:Restarting daemon 2023-07-27T20:31:00.837 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-07-27T20:31:00.841 INFO:tasks.ceph.mon.b:Started 2023-07-27T20:31:00.842 INFO:tasks.ceph.mon.c:Restarting daemon 2023-07-27T20:31:00.842 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-07-27T20:31:00.846 INFO:tasks.ceph.mon.c:Started 2023-07-27T20:31:00.847 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-07-27T20:31:00.847 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-07-27T20:31:00.847 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-07-27T20:31:00.851 INFO:tasks.ceph.mgr.y:Started 2023-07-27T20:31:00.852 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-07-27T20:31:00.852 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-07-27T20:31:00.856 INFO:tasks.ceph.mgr.x:Started 2023-07-27T20:31:00.857 INFO:tasks.ceph:Setting crush tunables to default 2023-07-27T20:31:00.857 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd crush tunables default 2023-07-27T20:31:01.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.067+0000 7f781e7ff700 1 Processor -- start 2023-07-27T20:31:01.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.067+0000 7f781e7ff700 1 -- start start 2023-07-27T20:31:01.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.068+0000 7f781e7ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f78181475a0 0x7f78181516c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:01.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.068+0000 7f781e7ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f78180716f0 0x7f7818071b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:01.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.069+0000 7f781e7ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7818154f50 con 0x7f78180c12f0 2023-07-27T20:31:01.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.069+0000 7f781e7ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7818151c00 con 0x7f78180716f0 2023-07-27T20:31:01.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.069+0000 7f781e7ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7818154340 con 0x7f78181475a0 2023-07-27T20:31:01.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.069+0000 7f7817fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f78181475a0 0x7f78181516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:01.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.069+0000 7f7817fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f78181475a0 0x7f78181516c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.72:55344/0 (socket says 172.21.15.72:55344) 2023-07-27T20:31:01.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.069+0000 7f7817fff700 1 -- 172.21.15.72:0/3147497047 learned_addr learned my addr 172.21.15.72:0/3147497047 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:01.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.069+0000 7f781cd9c700 1 --2- 172.21.15.72:0/3147497047 >> v2:172.21.15.173:3300/0 conn(0x7f78180716f0 0x7f7818071b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:01.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.069+0000 7f7817fff700 1 -- 172.21.15.72:0/3147497047 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f78181475a0 msgr2=0x7f78181516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-27T20:31:01.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.069+0000 7f7817fff700 1 -- 172.21.15.72:0/3147497047 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f78181475a0 msgr2=0x7f78181516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-27T20:31:01.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.069+0000 7f7817fff700 1 --2- 172.21.15.72:0/3147497047 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f78181475a0 0x7f78181516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-27T20:31:01.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.069+0000 7f7817fff700 1 --2- 172.21.15.72:0/3147497047 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f78181475a0 0x7f78181516c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-27T20:31:01.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.069+0000 7f781cd9c700 1 -- 172.21.15.72:0/3147497047 >> v2:172.21.15.173:3300/0 conn(0x7f78180716f0 msgr2=0x7f7818071b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-07-27T20:31:01.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.069+0000 7f781cd9c700 1 -- 172.21.15.72:0/3147497047 >> v2:172.21.15.173:3300/0 conn(0x7f78180716f0 msgr2=0x7f7818071b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-27T20:31:01.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.069+0000 7f781cd9c700 1 --2- 172.21.15.72:0/3147497047 >> v2:172.21.15.173:3300/0 conn(0x7f78180716f0 0x7f7818071b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-27T20:31:01.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.069+0000 7f781cd9c700 1 --2- 172.21.15.72:0/3147497047 >> v2:172.21.15.173:3300/0 conn(0x7f78180716f0 0x7f7818071b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-27T20:31:01.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.264+0000 7f7816ffd700 1 -- 172.21.15.72:0/3147497047 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2672461133 0 0) 0x7f7818154f50 con 0x7f78180c12f0 2023-07-27T20:31:01.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.265+0000 7f7816ffd700 1 -- 172.21.15.72:0/3147497047 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78000035b0 con 0x7f78180c12f0 2023-07-27T20:31:01.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.265+0000 7f7816ffd700 1 -- 172.21.15.72:0/3147497047 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3766430777 0 0) 0x7f78000035b0 con 0x7f78180c12f0 2023-07-27T20:31:01.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.265+0000 7f7816ffd700 1 -- 172.21.15.72:0/3147497047 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f78181475a0 msgr2=0x7f78181516c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-27T20:31:01.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.265+0000 7f7816ffd700 1 --2- 172.21.15.72:0/3147497047 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f78181475a0 0x7f78181516c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:01.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.265+0000 7f7816ffd700 1 -- 172.21.15.72:0/3147497047 >> v2:172.21.15.173:3300/0 conn(0x7f78180716f0 msgr2=0x7f7818071b60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-27T20:31:01.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.265+0000 7f7816ffd700 1 --2- 172.21.15.72:0/3147497047 >> v2:172.21.15.173:3300/0 conn(0x7f78180716f0 0x7f7818071b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:01.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.265+0000 7f7816ffd700 1 -- 172.21.15.72:0/3147497047 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7818154620 con 0x7f78180c12f0 2023-07-27T20:31:01.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.265+0000 7f7816ffd700 1 -- 172.21.15.72:0/3147497047 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f780c001670 con 0x7f78180c12f0 2023-07-27T20:31:01.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.266+0000 7f7816ffd700 1 -- 172.21.15.72:0/3147497047 >> v1:172.21.15.72:6789/0 conn(0x7f78180c12f0 legacy=0x7f78180c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:01.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.266+0000 7f7816ffd700 1 --2- 172.21.15.72:0/3147497047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7800003a00 0x7f7800003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:01.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.266+0000 7f7816ffd700 1 --2- 172.21.15.72:0/3147497047 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f78181475a0 0x7f7800004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:01.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.266+0000 7f7816ffd700 1 --2- 172.21.15.72:0/3147497047 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7800004d90 0x7f7800005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:01.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.266+0000 7f7816ffd700 1 -- 172.21.15.72:0/3147497047 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7818151c00 con 0x7f7800003a00 2023-07-27T20:31:01.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.266+0000 7f7816ffd700 1 -- 172.21.15.72:0/3147497047 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7818154340 con 0x7f7800004d90 2023-07-27T20:31:01.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.266+0000 7f7816ffd700 1 -- 172.21.15.72:0/3147497047 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780000bb40 con 0x7f78181475a0 2023-07-27T20:31:01.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.266+0000 7f7817fff700 1 --2- 172.21.15.72:0/3147497047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7800003a00 0x7f7800003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:01.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.266+0000 7f781cd9c700 1 --2- 172.21.15.72:0/3147497047 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7800004d90 0x7f7800005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:01.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.266+0000 7f78177fe700 1 --2- 172.21.15.72:0/3147497047 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f78181475a0 0x7f7800004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:01.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.266+0000 7f7817fff700 1 -- 172.21.15.72:0/3147497047 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f78181475a0 msgr2=0x7f7800004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:01.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.266+0000 7f7817fff700 1 --2- 172.21.15.72:0/3147497047 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f78181475a0 0x7f7800004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:01.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.266+0000 7f7817fff700 1 -- 172.21.15.72:0/3147497047 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7800004d90 msgr2=0x7f7800005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:01.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.266+0000 7f7817fff700 1 --2- 172.21.15.72:0/3147497047 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7800004d90 0x7f7800005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:01.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.267+0000 7f7817fff700 1 -- 172.21.15.72:0/3147497047 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78000035b0 con 0x7f7800003a00 2023-07-27T20:31:01.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.267+0000 7f7817fff700 1 --2- 172.21.15.72:0/3147497047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7800003a00 0x7f7800003e20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f780800bdc0 tx=0x7f7800005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3fb03b8f97a8ae0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:01.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.267+0000 7f7816ffd700 1 -- 172.21.15.72:0/3147497047 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780800b860 con 0x7f7800003a00 2023-07-27T20:31:01.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.267+0000 7f7816ffd700 1 -- 172.21.15.72:0/3147497047 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7808010d50 con 0x7f7800003a00 2023-07-27T20:31:01.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.267+0000 7f7816ffd700 1 -- 172.21.15.72:0/3147497047 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7808004260 con 0x7f7800003a00 2023-07-27T20:31:01.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.268+0000 7f781e7ff700 1 -- 172.21.15.72:0/3147497047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7800003a00 msgr2=0x7f7800003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:01.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.268+0000 7f781e7ff700 1 --2- 172.21.15.72:0/3147497047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7800003a00 0x7f7800003e20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f780800bdc0 tx=0x7f7800005880 comp rx=0 tx=0).stop 2023-07-27T20:31:01.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.268+0000 7f781cd9c700 1 -- 172.21.15.72:0/3147497047 reap_dead start 2023-07-27T20:31:01.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.268+0000 7f781e7ff700 1 -- 172.21.15.72:0/3147497047 shutdown_connections 2023-07-27T20:31:01.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.268+0000 7f781e7ff700 1 -- 172.21.15.72:0/3147497047 >> 172.21.15.72:0/3147497047 conn(0x7f781806a190 msgr2=0x7f781806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:01.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.268+0000 7f781e7ff700 1 -- 172.21.15.72:0/3147497047 shutdown_connections 2023-07-27T20:31:01.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.268+0000 7f781e7ff700 1 -- 172.21.15.72:0/3147497047 wait complete. 2023-07-27T20:31:01.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.270+0000 7f781e7ff700 1 Processor -- start 2023-07-27T20:31:01.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.271+0000 7f781e7ff700 1 -- start start 2023-07-27T20:31:01.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.272+0000 7f781e7ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7800003a00 0x7f781814bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:01.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.272+0000 7f781e7ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7818153c50 0x7f78180ba920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:01.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.272+0000 7f781e7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78181ed040 0x7f78181ed4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:01.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.272+0000 7f781e7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7818145e80 con 0x7f78181ed040 2023-07-27T20:31:01.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.272+0000 7f781e7ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78180bbaf0 con 0x7f7800003a00 2023-07-27T20:31:01.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.272+0000 7f781e7ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78181eda30 con 0x7f7818153c50 2023-07-27T20:31:01.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.272+0000 7f7817fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7800003a00 0x7f781814bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:01.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.272+0000 7f7817fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7800003a00 0x7f781814bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.72:54752/0 (socket says 172.21.15.72:54752) 2023-07-27T20:31:01.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.272+0000 7f7817fff700 1 -- 172.21.15.72:0/513434945 learned_addr learned my addr 172.21.15.72:0/513434945 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:01.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.272+0000 7f781cd9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78181ed040 0x7f78181ed4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:01.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.272+0000 7f78177fe700 1 --2- 172.21.15.72:0/513434945 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7818153c50 0x7f78180ba920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:01.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.273+0000 7f78177fe700 1 -- 172.21.15.72:0/513434945 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7800003a00 msgr2=0x7f781814bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:01.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.273+0000 7f78177fe700 1 --2- 172.21.15.72:0/513434945 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7800003a00 0x7f781814bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:01.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.273+0000 7f78177fe700 1 -- 172.21.15.72:0/513434945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78181ed040 msgr2=0x7f78181ed4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:01.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.273+0000 7f78177fe700 1 --2- 172.21.15.72:0/513434945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78181ed040 0x7f78181ed4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:01.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.273+0000 7f78177fe700 1 -- 172.21.15.72:0/513434945 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7818153320 con 0x7f7818153c50 2023-07-27T20:31:01.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.273+0000 7f7817fff700 1 --2- 172.21.15.72:0/513434945 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7800003a00 0x7f781814bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:31:01.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.273+0000 7f78177fe700 1 --2- 172.21.15.72:0/513434945 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7818153c50 0x7f78180ba920 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f780c00e800 tx=0x7f780c00eb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:01.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.273+0000 7f7814ff9700 1 -- 172.21.15.72:0/513434945 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c0052e0 con 0x7f7818153c50 2023-07-27T20:31:01.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.273+0000 7f7814ff9700 1 -- 172.21.15.72:0/513434945 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780c005460 con 0x7f7818153c50 2023-07-27T20:31:01.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.273+0000 7f7814ff9700 1 -- 172.21.15.72:0/513434945 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c0038c0 con 0x7f7818153c50 2023-07-27T20:31:01.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.273+0000 7f781e7ff700 1 -- 172.21.15.72:0/513434945 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7818152d60 con 0x7f7818153c50 2023-07-27T20:31:01.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.274+0000 7f781e7ff700 1 -- 172.21.15.72:0/513434945 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78180bbd90 con 0x7f7818153c50 2023-07-27T20:31:01.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.274+0000 7f7814ff9700 1 -- 172.21.15.72:0/513434945 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f780c003d20 con 0x7f7818153c50 2023-07-27T20:31:01.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.274+0000 7f7814ff9700 1 -- 172.21.15.72:0/513434945 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f780c0147c0 con 0x7f7818153c50 2023-07-27T20:31:01.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.275+0000 7f781e7ff700 1 -- 172.21.15.72:0/513434945 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78180bb950 con 0x7f7818153c50 2023-07-27T20:31:01.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.278+0000 7f7814ff9700 1 -- 172.21.15.72:0/513434945 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f78180bb950 con 0x7f7818153c50 2023-07-27T20:31:01.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.355+0000 7f781e7ff700 1 -- 172.21.15.72:0/513434945 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f78180c2390 con 0x7f7818153c50 2023-07-27T20:31:01.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.359+0000 7f7814ff9700 1 -- 172.21.15.72:0/513434945 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f780c023060 con 0x7f7818153c50 2023-07-27T20:31:01.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.361+0000 7f781e7ff700 1 -- 172.21.15.72:0/513434945 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7818153c50 msgr2=0x7f78180ba920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:01.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.361+0000 7f781e7ff700 1 --2- 172.21.15.72:0/513434945 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7818153c50 0x7f78180ba920 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f780c00e800 tx=0x7f780c00eb10 comp rx=0 tx=0).stop 2023-07-27T20:31:01.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.361+0000 7f781e7ff700 1 -- 172.21.15.72:0/513434945 shutdown_connections 2023-07-27T20:31:01.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.361+0000 7f781e7ff700 1 --2- 172.21.15.72:0/513434945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78181ed040 0x7f78181ed4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:01.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.361+0000 7f781e7ff700 1 --2- 172.21.15.72:0/513434945 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7800003a00 0x7f781814bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:01.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.361+0000 7f781e7ff700 1 --2- 172.21.15.72:0/513434945 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7818153c50 0x7f78180ba920 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:01.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.361+0000 7f781e7ff700 1 -- 172.21.15.72:0/513434945 >> 172.21.15.72:0/513434945 conn(0x7f781806a190 msgr2=0x7f781806dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:01.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.361+0000 7f781e7ff700 1 -- 172.21.15.72:0/513434945 shutdown_connections 2023-07-27T20:31:01.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:01.361+0000 7f781e7ff700 1 -- 172.21.15.72:0/513434945 wait complete. 2023-07-27T20:31:01.351 INFO:teuthology.orchestra.run.smithi072.stderr:adjusted tunables profile to default 2023-07-27T20:31:01.366 INFO:tasks.ceph:check_enable_crimson: False 2023-07-27T20:31:01.366 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-07-27T20:31:01.367 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-27T20:31:01.367 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-07-27T20:31:01.418 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-07-27T20:31:01.430+0000 7f2b0af6a200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-27T20:31:01.435 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-27T20:31:01.448+0000 7f6c1e6ad200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-27T20:31:01.436 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-27T20:31:01.436 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-07-27T20:31:01.545 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-27T20:31:01.546 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-07-27T20:31:01.628 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-07-27T20:31:01.639+0000 7f2b0af6a200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-27T20:31:01.655 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-27T20:31:01.668+0000 7f6c1e6ad200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-27T20:31:01.674 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-27T20:31:01.675 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-07-27T20:31:01.744 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-07-27T20:31:01.745 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-07-27T20:31:01.814 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-07-27T20:31:01.814 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-07-27T20:31:01.922 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-07-27T20:31:01.922 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-07-27T20:31:02.031 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-07-27T20:31:02.032 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-07-27T20:31:02.104 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-07-27T20:31:02.116+0000 7f2b0af6a200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-27T20:31:02.142 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 9a156f94-04f1-4ea4-8c5d-18c725fb149a 0 2023-07-27T20:31:02.153 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-27T20:31:02.166+0000 7f6c1e6ad200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-27T20:31:02.372 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.384+0000 7f8982fff700 1 Processor -- start 2023-07-27T20:31:02.372 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.384+0000 7f8982fff700 1 -- start start 2023-07-27T20:31:02.374 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.385+0000 7f8982fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f897c0c7740 0x7f897c0c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:02.374 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.385+0000 7f8982fff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f897c0c4700 0x7f897c06c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:02.374 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.385+0000 7f8982fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f897c0c7c50 con 0x7f897c14aab0 2023-07-27T20:31:02.375 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.385+0000 7f8982fff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f897c06bd40 con 0x7f897c0c4700 2023-07-27T20:31:02.375 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.385+0000 7f8982fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f897c0c62f0 con 0x7f897c0c7740 2023-07-27T20:31:02.375 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.386+0000 7f897bfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f897c0c7740 0x7f897c0c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:02.376 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.386+0000 7f898159c700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f897c0c4700 0x7f897c06c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:02.376 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.386+0000 7f897bfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f897c0c7740 0x7f897c0c41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:37962/0 (socket says 172.21.15.173:37962) 2023-07-27T20:31:02.376 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.386+0000 7f897bfff700 1 -- 172.21.15.173:0/1691944534 learned_addr learned my addr 172.21.15.173:0/1691944534 (peer_addr_for_me v2:172.21.15.173:0/0) 2023-07-27T20:31:02.377 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.386+0000 7f897bfff700 1 -- 172.21.15.173:0/1691944534 >> v2:172.21.15.173:3300/0 conn(0x7f897c0c4700 msgr2=0x7f897c06c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:02.377 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.386+0000 7f897bfff700 1 --2- 172.21.15.173:0/1691944534 >> v2:172.21.15.173:3300/0 conn(0x7f897c0c4700 0x7f897c06c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:02.378 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.386+0000 7f897bfff700 1 -- 172.21.15.173:0/1691944534 >> v1:172.21.15.72:6789/0 conn(0x7f897c14aab0 legacy=0x7f897c154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:02.378 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.386+0000 7f897bfff700 1 -- 172.21.15.173:0/1691944534 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f897c06d200 con 0x7f897c0c7740 2023-07-27T20:31:02.378 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.386+0000 7f897bfff700 1 --2- 172.21.15.173:0/1691944534 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f897c0c7740 0x7f897c0c41c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f89680098f0 tx=0x7f8968009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bdbd9f02e148641 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:02.378 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.387+0000 7f897b7fe700 1 -- 172.21.15.173:0/1691944534 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8968004230 con 0x7f897c0c7740 2023-07-27T20:31:02.378 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.387+0000 7f897b7fe700 1 -- 172.21.15.173:0/1691944534 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8968004390 con 0x7f897c0c7740 2023-07-27T20:31:02.378 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.387+0000 7f897b7fe700 1 -- 172.21.15.173:0/1691944534 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89680036a0 con 0x7f897c0c7740 2023-07-27T20:31:02.379 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.387+0000 7f8982fff700 1 -- 172.21.15.173:0/1691944534 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f897c0c7740 msgr2=0x7f897c0c41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:02.379 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.387+0000 7f8982fff700 1 --2- 172.21.15.173:0/1691944534 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f897c0c7740 0x7f897c0c41c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f89680098f0 tx=0x7f8968009c00 comp rx=0 tx=0).stop 2023-07-27T20:31:02.379 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.388+0000 7f8982fff700 1 -- 172.21.15.173:0/1691944534 shutdown_connections 2023-07-27T20:31:02.379 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.388+0000 7f8982fff700 1 --2- 172.21.15.173:0/1691944534 >> v2:172.21.15.173:3300/0 conn(0x7f897c0c4700 0x7f897c06c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:02.379 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.388+0000 7f8982fff700 1 --2- 172.21.15.173:0/1691944534 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f897c0c7740 0x7f897c0c41c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:02.379 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.388+0000 7f8982fff700 1 -- 172.21.15.173:0/1691944534 >> 172.21.15.173:0/1691944534 conn(0x7f897c0ab3f0 msgr2=0x7f897c0ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:02.379 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.388+0000 7f8982fff700 1 -- 172.21.15.173:0/1691944534 shutdown_connections 2023-07-27T20:31:02.379 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.388+0000 7f8982fff700 1 -- 172.21.15.173:0/1691944534 wait complete. 2023-07-27T20:31:02.380 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.390+0000 7f8982fff700 1 Processor -- start 2023-07-27T20:31:02.380 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.391+0000 7f8982fff700 1 -- start start 2023-07-27T20:31:02.381 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.392+0000 7f8982fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f897c0c4700 0x7f897c1ed230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:02.381 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.392+0000 7f8982fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f897c0c7740 0x7f897c1ed770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:02.381 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.392+0000 7f8982fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f897c14aab0 0x7f897c14c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:02.381 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.392+0000 7f8982fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897c14df70 con 0x7f897c14aab0 2023-07-27T20:31:02.381 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.392+0000 7f8982fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897c1edcb0 con 0x7f897c0c4700 2023-07-27T20:31:02.381 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.392+0000 7f8982fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f897c0bda60 con 0x7f897c0c7740 2023-07-27T20:31:02.383 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.392+0000 7f8980d9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f897c0c4700 0x7f897c1ed230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:02.383 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.392+0000 7f897bfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f897c0c7740 0x7f897c1ed770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:02.383 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.392+0000 7f897bfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f897c0c7740 0x7f897c1ed770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:37974/0 (socket says 172.21.15.173:37974) 2023-07-27T20:31:02.383 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.392+0000 7f8980d9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f897c0c4700 0x7f897c1ed230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60184/0 (socket says 172.21.15.173:60184) 2023-07-27T20:31:02.383 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.392+0000 7f897bfff700 1 -- 172.21.15.173:0/2658551915 learned_addr learned my addr 172.21.15.173:0/2658551915 (peer_addr_for_me v2:172.21.15.173:0/0) 2023-07-27T20:31:02.383 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.392+0000 7f898159c700 1 --2- 172.21.15.173:0/2658551915 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f897c14aab0 0x7f897c14c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:02.384 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.393+0000 7f897bfff700 1 -- 172.21.15.173:0/2658551915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f897c0c4700 msgr2=0x7f897c1ed230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:02.384 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.393+0000 7f897bfff700 1 --2- 172.21.15.173:0/2658551915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f897c0c4700 0x7f897c1ed230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:02.384 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.393+0000 7f897bfff700 1 -- 172.21.15.173:0/2658551915 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f897c14aab0 msgr2=0x7f897c14c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:02.384 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.393+0000 7f897bfff700 1 --2- 172.21.15.173:0/2658551915 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f897c14aab0 0x7f897c14c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:02.384 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.393+0000 7f897bfff700 1 -- 172.21.15.173:0/2658551915 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8968009550 con 0x7f897c0c7740 2023-07-27T20:31:02.384 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.393+0000 7f8980d9b700 1 --2- 172.21.15.173:0/2658551915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f897c0c4700 0x7f897c1ed230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:31:02.384 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.393+0000 7f897bfff700 1 --2- 172.21.15.173:0/2658551915 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f897c0c7740 0x7f897c1ed770 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8968009130 tx=0x7f8968004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:02.385 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.393+0000 7f89797fa700 1 -- 172.21.15.173:0/2658551915 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8968003d60 con 0x7f897c0c7740 2023-07-27T20:31:02.385 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.393+0000 7f89797fa700 1 -- 172.21.15.173:0/2658551915 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8968011630 con 0x7f897c0c7740 2023-07-27T20:31:02.385 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.393+0000 7f89797fa700 1 -- 172.21.15.173:0/2658551915 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89680119e0 con 0x7f897c0c7740 2023-07-27T20:31:02.385 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.393+0000 7f8982fff700 1 -- 172.21.15.173:0/2658551915 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f897c0bdd40 con 0x7f897c0c7740 2023-07-27T20:31:02.385 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.393+0000 7f8982fff700 1 -- 172.21.15.173:0/2658551915 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f897c0c0220 con 0x7f897c0c7740 2023-07-27T20:31:02.385 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.394+0000 7f89797fa700 1 -- 172.21.15.173:0/2658551915 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8968021070 con 0x7f897c0c7740 2023-07-27T20:31:02.385 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.394+0000 7f89797fa700 1 -- 172.21.15.173:0/2658551915 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f896801b440 con 0x7f897c0c7740 2023-07-27T20:31:02.386 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.395+0000 7f8982fff700 1 -- 172.21.15.173:0/2658551915 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f897c0bded0 con 0x7f897c0c7740 2023-07-27T20:31:02.386 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.397+0000 7f89797fa700 1 -- 172.21.15.173:0/2658551915 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f8968029020 con 0x7f897c0c7740 2023-07-27T20:31:02.470 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.481+0000 7f8982fff700 1 -- 172.21.15.173:0/2658551915 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9a156f94-04f1-4ea4-8c5d-18c725fb149a", "id": 0} v 0) v1 -- 0x7f897c0be0d0 con 0x7f897c0c7740 2023-07-27T20:31:02.478 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.489+0000 7f89797fa700 1 -- 172.21.15.173:0/2658551915 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9a156f94-04f1-4ea4-8c5d-18c725fb149a", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8968024470 con 0x7f897c0c7740 2023-07-27T20:31:02.478 INFO:teuthology.orchestra.run.smithi173.stdout:0 2023-07-27T20:31:02.479 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.491+0000 7f8982fff700 1 -- 172.21.15.173:0/2658551915 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f897c0c7740 msgr2=0x7f897c1ed770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:02.479 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.491+0000 7f8982fff700 1 --2- 172.21.15.173:0/2658551915 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f897c0c7740 0x7f897c1ed770 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8968009130 tx=0x7f8968004750 comp rx=0 tx=0).stop 2023-07-27T20:31:02.480 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.491+0000 7f8982fff700 1 -- 172.21.15.173:0/2658551915 shutdown_connections 2023-07-27T20:31:02.480 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.491+0000 7f8982fff700 1 --2- 172.21.15.173:0/2658551915 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f897c14aab0 0x7f897c14c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:02.480 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.491+0000 7f8982fff700 1 --2- 172.21.15.173:0/2658551915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f897c0c4700 0x7f897c1ed230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:02.480 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.491+0000 7f8982fff700 1 --2- 172.21.15.173:0/2658551915 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f897c0c7740 0x7f897c1ed770 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:02.480 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.491+0000 7f8982fff700 1 -- 172.21.15.173:0/2658551915 >> 172.21.15.173:0/2658551915 conn(0x7f897c0ab3f0 msgr2=0x7f897c06c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:02.480 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.491+0000 7f8982fff700 1 -- 172.21.15.173:0/2658551915 shutdown_connections 2023-07-27T20:31:02.481 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.491+0000 7f8982fff700 1 -- 172.21.15.173:0/2658551915 wait complete. 2023-07-27T20:31:02.496 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new bc0cda62-2569-42b5-bb6f-c2916a9199e4 1 2023-07-27T20:31:02.693 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.704+0000 7fdf95bff700 1 Processor -- start 2023-07-27T20:31:02.694 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.705+0000 7fdf95bff700 1 -- start start 2023-07-27T20:31:02.694 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.706+0000 7fdf95bff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fdf9014aab0 0x7fdf90154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:02.695 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.706+0000 7fdf95bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdf900c7740 0x7fdf900c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:02.695 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.706+0000 7fdf95bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf900c4700 0x7fdf9006c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:02.695 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.706+0000 7fdf95bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf900c7c50 con 0x7fdf900c7740 2023-07-27T20:31:02.695 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.706+0000 7fdf95bff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf9006bd40 con 0x7fdf9014aab0 2023-07-27T20:31:02.696 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.706+0000 7fdf95bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf900c62f0 con 0x7fdf900c4700 2023-07-27T20:31:02.696 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.706+0000 7fdf8f7fe700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fdf9014aab0 0x7fdf90154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:02.696 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.706+0000 7fdf8ffff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf900c4700 0x7fdf9006c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:02.696 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.706+0000 7fdf8f7fe700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fdf9014aab0 0x7fdf90154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60198/0 (socket says 172.21.15.173:60198) 2023-07-27T20:31:02.696 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.706+0000 7fdf8f7fe700 1 -- 172.21.15.173:0/3254664905 learned_addr learned my addr 172.21.15.173:0/3254664905 (peer_addr_for_me v2:172.21.15.173:0/0) 2023-07-27T20:31:02.696 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.706+0000 7fdf87fff700 1 --2- 172.21.15.173:0/3254664905 >> v2:172.21.15.72:3300/0 conn(0x7fdf900c7740 0x7fdf900c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:02.698 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.706+0000 7fdf8f7fe700 1 -- 172.21.15.173:0/3254664905 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf900c4700 msgr2=0x7fdf9006c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:02.698 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.706+0000 7fdf8f7fe700 1 --2- 172.21.15.173:0/3254664905 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf900c4700 0x7fdf9006c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:02.698 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.706+0000 7fdf8f7fe700 1 -- 172.21.15.173:0/3254664905 >> v2:172.21.15.72:3300/0 conn(0x7fdf900c7740 msgr2=0x7fdf900c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:02.698 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.706+0000 7fdf8f7fe700 1 --2- 172.21.15.173:0/3254664905 >> v2:172.21.15.72:3300/0 conn(0x7fdf900c7740 0x7fdf900c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:02.698 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.707+0000 7fdf8f7fe700 1 -- 172.21.15.173:0/3254664905 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf90155050 con 0x7fdf9014aab0 2023-07-27T20:31:02.698 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.707+0000 7fdf8f7fe700 1 --2- 172.21.15.173:0/3254664905 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf9014aab0 0x7fdf90154b10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdf9006ad20 tx=0x7fdf80009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=400cf85326d3894a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:02.699 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.707+0000 7fdf8effd700 1 -- 172.21.15.173:0/3254664905 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf80011830 con 0x7fdf9014aab0 2023-07-27T20:31:02.699 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.707+0000 7fdf8effd700 1 -- 172.21.15.173:0/3254664905 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf80011990 con 0x7fdf9014aab0 2023-07-27T20:31:02.699 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.707+0000 7fdf8effd700 1 -- 172.21.15.173:0/3254664905 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf80011d20 con 0x7fdf9014aab0 2023-07-27T20:31:02.699 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.708+0000 7fdf95bff700 1 -- 172.21.15.173:0/3254664905 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf9014aab0 msgr2=0x7fdf90154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:02.699 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.708+0000 7fdf95bff700 1 --2- 172.21.15.173:0/3254664905 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf9014aab0 0x7fdf90154b10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdf9006ad20 tx=0x7fdf80009bd0 comp rx=0 tx=0).stop 2023-07-27T20:31:02.699 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.708+0000 7fdf95bff700 1 -- 172.21.15.173:0/3254664905 shutdown_connections 2023-07-27T20:31:02.699 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.708+0000 7fdf95bff700 1 --2- 172.21.15.173:0/3254664905 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf9014aab0 0x7fdf90154b10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:02.700 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.708+0000 7fdf95bff700 1 --2- 172.21.15.173:0/3254664905 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf900c4700 0x7fdf9006c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:02.700 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.708+0000 7fdf95bff700 1 --2- 172.21.15.173:0/3254664905 >> v2:172.21.15.72:3300/0 conn(0x7fdf900c7740 0x7fdf900c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:02.700 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.708+0000 7fdf95bff700 1 -- 172.21.15.173:0/3254664905 >> 172.21.15.173:0/3254664905 conn(0x7fdf900ab3f0 msgr2=0x7fdf900ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:02.700 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.708+0000 7fdf95bff700 1 -- 172.21.15.173:0/3254664905 shutdown_connections 2023-07-27T20:31:02.700 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.708+0000 7fdf95bff700 1 -- 172.21.15.173:0/3254664905 wait complete. 2023-07-27T20:31:02.702 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.710+0000 7fdf95bff700 1 Processor -- start 2023-07-27T20:31:02.702 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.710+0000 7fdf95bff700 1 -- start start 2023-07-27T20:31:02.703 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.711+0000 7fdf95bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf900c4700 0x7fdf900c3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:02.704 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.711+0000 7fdf95bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf900c7740 0x7fdf900bf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:02.704 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.711+0000 7fdf95bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf9014aab0 0x7fdf900aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:02.704 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.711+0000 7fdf95bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf900aeac0 con 0x7fdf9014aab0 2023-07-27T20:31:02.705 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.711+0000 7fdf95bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf900c2fe0 con 0x7fdf900c7740 2023-07-27T20:31:02.705 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.711+0000 7fdf95bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf900c0fc0 con 0x7fdf900c4700 2023-07-27T20:31:02.705 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.711+0000 7fdf8f7fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf900c4700 0x7fdf900c3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:02.705 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.711+0000 7fdf87fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf900c7740 0x7fdf900bf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:02.705 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.711+0000 7fdf8f7fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf900c4700 0x7fdf900c3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:37992/0 (socket says 172.21.15.173:37992) 2023-07-27T20:31:02.705 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.711+0000 7fdf8f7fe700 1 -- 172.21.15.173:0/3468002234 learned_addr learned my addr 172.21.15.173:0/3468002234 (peer_addr_for_me v2:172.21.15.173:0/0) 2023-07-27T20:31:02.705 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.711+0000 7fdf8ffff700 1 --2- 172.21.15.173:0/3468002234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf9014aab0 0x7fdf900aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:02.706 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.711+0000 7fdf8f7fe700 1 -- 172.21.15.173:0/3468002234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf900c7740 msgr2=0x7fdf900bf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:02.706 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.711+0000 7fdf8f7fe700 1 --2- 172.21.15.173:0/3468002234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf900c7740 0x7fdf900bf8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:02.706 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.711+0000 7fdf8f7fe700 1 -- 172.21.15.173:0/3468002234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf9014aab0 msgr2=0x7fdf900aeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:02.706 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.711+0000 7fdf8f7fe700 1 --2- 172.21.15.173:0/3468002234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf9014aab0 0x7fdf900aeee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:02.706 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.711+0000 7fdf8f7fe700 1 -- 172.21.15.173:0/3468002234 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf80009550 con 0x7fdf900c4700 2023-07-27T20:31:02.706 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.711+0000 7fdf87fff700 1 --2- 172.21.15.173:0/3468002234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf900c7740 0x7fdf900bf8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:31:02.707 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.712+0000 7fdf8f7fe700 1 --2- 172.21.15.173:0/3468002234 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf900c4700 0x7fdf900c3600 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdf80009c10 tx=0x7fdf80004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:02.707 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.712+0000 7fdf8cff9700 1 -- 172.21.15.173:0/3468002234 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf80004450 con 0x7fdf900c4700 2023-07-27T20:31:02.707 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.712+0000 7fdf8cff9700 1 -- 172.21.15.173:0/3468002234 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8001e070 con 0x7fdf900c4700 2023-07-27T20:31:02.707 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.712+0000 7fdf95bff700 1 -- 172.21.15.173:0/3468002234 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf900adee0 con 0x7fdf900c4700 2023-07-27T20:31:02.707 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.712+0000 7fdf8cff9700 1 -- 172.21.15.173:0/3468002234 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf800038e0 con 0x7fdf900c4700 2023-07-27T20:31:02.708 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.712+0000 7fdf95bff700 1 -- 172.21.15.173:0/3468002234 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf900ae4a0 con 0x7fdf900c4700 2023-07-27T20:31:02.708 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.712+0000 7fdf8cff9700 1 -- 172.21.15.173:0/3468002234 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdf80003d40 con 0x7fdf900c4700 2023-07-27T20:31:02.708 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.712+0000 7fdf8cff9700 1 -- 172.21.15.173:0/3468002234 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fdf8001a7d0 con 0x7fdf900c4700 2023-07-27T20:31:02.708 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.713+0000 7fdf95bff700 1 -- 172.21.15.173:0/3468002234 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf9006b5f0 con 0x7fdf900c4700 2023-07-27T20:31:02.708 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.716+0000 7fdf8cff9700 1 -- 172.21.15.173:0/3468002234 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fdf80020070 con 0x7fdf900c4700 2023-07-27T20:31:02.734 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-07-27T20:31:02.746+0000 7f2b0af6a200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-27T20:31:02.752 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-27T20:31:02.765+0000 7f6c1e6ad200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-27T20:31:02.788 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.799+0000 7fdf95bff700 1 -- 172.21.15.173:0/3468002234 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd new", "uuid": "bc0cda62-2569-42b5-bb6f-c2916a9199e4", "id": 1} v 0) v1 -- 0x7fdf9004e470 con 0x7fdf900c4700 2023-07-27T20:31:02.796 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.807+0000 7fdf8cff9700 1 -- 172.21.15.173:0/3468002234 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bc0cda62-2569-42b5-bb6f-c2916a9199e4", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdf80015020 con 0x7fdf900c4700 2023-07-27T20:31:02.797 INFO:teuthology.orchestra.run.smithi173.stdout:1 2023-07-27T20:31:02.798 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.808+0000 7fdf95bff700 1 -- 172.21.15.173:0/3468002234 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf900c4700 msgr2=0x7fdf900c3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:02.798 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.808+0000 7fdf95bff700 1 --2- 172.21.15.173:0/3468002234 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf900c4700 0x7fdf900c3600 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdf80009c10 tx=0x7fdf80004750 comp rx=0 tx=0).stop 2023-07-27T20:31:02.798 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.808+0000 7fdf95bff700 1 -- 172.21.15.173:0/3468002234 shutdown_connections 2023-07-27T20:31:02.799 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.808+0000 7fdf95bff700 1 --2- 172.21.15.173:0/3468002234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf9014aab0 0x7fdf900aeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:02.799 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.808+0000 7fdf95bff700 1 --2- 172.21.15.173:0/3468002234 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf900c4700 0x7fdf900c3600 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:02.799 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.808+0000 7fdf95bff700 1 --2- 172.21.15.173:0/3468002234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf900c7740 0x7fdf900bf8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:02.799 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.808+0000 7fdf95bff700 1 -- 172.21.15.173:0/3468002234 >> 172.21.15.173:0/3468002234 conn(0x7fdf900ab3f0 msgr2=0x7fdf9006c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:02.800 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.809+0000 7fdf95bff700 1 -- 172.21.15.173:0/3468002234 shutdown_connections 2023-07-27T20:31:02.800 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:02.809+0000 7fdf95bff700 1 -- 172.21.15.173:0/3468002234 wait complete. 2023-07-27T20:31:02.815 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new dc042e43-6b4a-424b-afb1-2e96e3c7136a 2 2023-07-27T20:31:02.980 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-07-27T20:31:02.992+0000 7f2b0af6a200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-27T20:31:02.990 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-27T20:31:03.002+0000 7f6c1e6ad200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-27T20:31:03.009 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.020+0000 7f02097ff700 1 Processor -- start 2023-07-27T20:31:03.009 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.020+0000 7f02097ff700 1 -- start start 2023-07-27T20:31:03.011 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.022+0000 7f02097ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f02040c12f0 0x7f02041516c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:03.011 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.022+0000 7f02097ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0204154f50 con 0x7f02041475a0 2023-07-27T20:31:03.011 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.022+0000 7f02097ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0204154340 con 0x7f02040716f0 2023-07-27T20:31:03.011 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.022+0000 7f02097ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0204151c00 con 0x7f02040c12f0 2023-07-27T20:31:03.013 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.023+0000 7f0202ffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f02041475a0 0x7f02040c1d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.173:52038/0 (socket says 172.21.15.173:52038) 2023-07-27T20:31:03.013 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.023+0000 7f0202ffd700 1 -- 172.21.15.173:0/552805354 learned_addr learned my addr 172.21.15.173:0/552805354 (peer_addr_for_me v1:172.21.15.173:0/0) 2023-07-27T20:31:03.013 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.023+0000 7f02027fc700 1 --2- 172.21.15.173:0/552805354 >> v2:172.21.15.173:3300/0 conn(0x7f02040c12f0 0x7f02041516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:03.014 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.023+0000 7f02027fc700 1 -- 172.21.15.173:0/552805354 >> v1:172.21.15.173:6789/0 conn(0x7f02040716f0 legacy=0x7f0204071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:03.014 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.023+0000 7f02027fc700 1 -- 172.21.15.173:0/552805354 >> v1:172.21.15.72:6789/0 conn(0x7f02041475a0 legacy=0x7f02040c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:03.014 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.023+0000 7f02027fc700 1 -- 172.21.15.173:0/552805354 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0204154620 con 0x7f02040c12f0 2023-07-27T20:31:03.014 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.023+0000 7f0201ffb700 1 -- 172.21.15.173:0/552805354 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 80114867 0 0) 0x7f0204154f50 con 0x7f02041475a0 2023-07-27T20:31:03.014 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.023+0000 7f02027fc700 1 --2- 172.21.15.173:0/552805354 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02040c12f0 0x7f02041516c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f01f8009840 tx=0x7f01f8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61184023f9d66099 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:03.014 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.024+0000 7f0201ffb700 1 -- 172.21.15.173:0/552805354 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f800f8a0 con 0x7f02040c12f0 2023-07-27T20:31:03.015 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.024+0000 7f0201ffb700 1 -- 172.21.15.173:0/552805354 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f800fa00 con 0x7f02040c12f0 2023-07-27T20:31:03.015 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.024+0000 7f0201ffb700 1 -- 172.21.15.173:0/552805354 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f800fd90 con 0x7f02040c12f0 2023-07-27T20:31:03.015 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.024+0000 7f02097ff700 1 -- 172.21.15.173:0/552805354 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02040c12f0 msgr2=0x7f02041516c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:03.016 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.024+0000 7f02097ff700 1 --2- 172.21.15.173:0/552805354 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02040c12f0 0x7f02041516c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f01f8009840 tx=0x7f01f8009b50 comp rx=0 tx=0).stop 2023-07-27T20:31:03.016 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.024+0000 7f02097ff700 1 -- 172.21.15.173:0/552805354 shutdown_connections 2023-07-27T20:31:03.016 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.024+0000 7f02097ff700 1 --2- 172.21.15.173:0/552805354 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02040c12f0 0x7f02041516c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:03.016 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.024+0000 7f02097ff700 1 -- 172.21.15.173:0/552805354 >> 172.21.15.173:0/552805354 conn(0x7f020406a190 msgr2=0x7f020406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:03.017 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.024+0000 7f02097ff700 1 -- 172.21.15.173:0/552805354 shutdown_connections 2023-07-27T20:31:03.017 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.025+0000 7f02097ff700 1 -- 172.21.15.173:0/552805354 wait complete. 2023-07-27T20:31:03.021 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.027+0000 7f02097ff700 1 Processor -- start 2023-07-27T20:31:03.021 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.027+0000 7f02097ff700 1 -- start start 2023-07-27T20:31:03.021 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.029+0000 7f02097ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02040716f0 0x7f020414acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:03.021 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.029+0000 7f02097ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f02040c12f0 0x7f020414d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:03.022 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.029+0000 7f02097ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02041475a0 0x7f020414d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:03.022 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.029+0000 7f02097ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020414c020 con 0x7f02040716f0 2023-07-27T20:31:03.022 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.029+0000 7f02097ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020414b390 con 0x7f02041475a0 2023-07-27T20:31:03.022 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.029+0000 7f02097ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f020414bb30 con 0x7f02040c12f0 2023-07-27T20:31:03.023 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.029+0000 7f02027fc700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f02040c12f0 0x7f020414d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:03.023 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.029+0000 7f02037fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02041475a0 0x7f020414d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:03.023 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.029+0000 7f0202ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02040716f0 0x7f020414acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:03.023 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.029+0000 7f02027fc700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f02040c12f0 0x7f020414d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:38002/0 (socket says 172.21.15.173:38002) 2023-07-27T20:31:03.024 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.029+0000 7f0202ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02040716f0 0x7f020414acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.173:49050/0 (socket says 172.21.15.173:49050) 2023-07-27T20:31:03.024 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.029+0000 7f02027fc700 1 -- 172.21.15.173:0/186138448 learned_addr learned my addr 172.21.15.173:0/186138448 (peer_addr_for_me v2:172.21.15.173:0/0) 2023-07-27T20:31:03.024 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.029+0000 7f02037fe700 1 -- 172.21.15.173:0/186138448 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f02040c12f0 msgr2=0x7f020414d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:03.025 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.029+0000 7f02037fe700 1 --2- 172.21.15.173:0/186138448 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f02040c12f0 0x7f020414d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:03.025 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.029+0000 7f02037fe700 1 -- 172.21.15.173:0/186138448 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02040716f0 msgr2=0x7f020414acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:03.025 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.029+0000 7f02037fe700 1 --2- 172.21.15.173:0/186138448 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02040716f0 0x7f020414acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:03.025 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.029+0000 7f02037fe700 1 -- 172.21.15.173:0/186138448 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f80094a0 con 0x7f02041475a0 2023-07-27T20:31:03.026 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.030+0000 7f02037fe700 1 --2- 172.21.15.173:0/186138448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02041475a0 0x7f020414d950 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00cb90 tx=0x7f01fc00cea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:03.026 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.030+0000 7f01eb7fe700 1 -- 172.21.15.173:0/186138448 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc003c00 con 0x7f02041475a0 2023-07-27T20:31:03.026 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.030+0000 7f01eb7fe700 1 -- 172.21.15.173:0/186138448 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01fc003d60 con 0x7f02041475a0 2023-07-27T20:31:03.026 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.030+0000 7f01eb7fe700 1 -- 172.21.15.173:0/186138448 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc00aa80 con 0x7f02041475a0 2023-07-27T20:31:03.027 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.030+0000 7f02097ff700 1 -- 172.21.15.173:0/186138448 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f020414df70 con 0x7f02041475a0 2023-07-27T20:31:03.027 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.030+0000 7f02097ff700 1 -- 172.21.15.173:0/186138448 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02041e9360 con 0x7f02041475a0 2023-07-27T20:31:03.027 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.030+0000 7f01eb7fe700 1 -- 172.21.15.173:0/186138448 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f01fc0050d0 con 0x7f02041475a0 2023-07-27T20:31:03.027 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.030+0000 7f01eb7fe700 1 -- 172.21.15.173:0/186138448 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f01fc0057a0 con 0x7f02041475a0 2023-07-27T20:31:03.027 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.031+0000 7f02097ff700 1 -- 172.21.15.173:0/186138448 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02041e9520 con 0x7f02041475a0 2023-07-27T20:31:03.028 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.034+0000 7f01eb7fe700 1 -- 172.21.15.173:0/186138448 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f01fc005380 con 0x7f02041475a0 2023-07-27T20:31:03.107 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.118+0000 7f02097ff700 1 -- 172.21.15.173:0/186138448 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd new", "uuid": "dc042e43-6b4a-424b-afb1-2e96e3c7136a", "id": 2} v 0) v1 -- 0x7f020404e470 con 0x7f02041475a0 2023-07-27T20:31:03.115 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.126+0000 7f01eb7fe700 1 -- 172.21.15.173:0/186138448 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dc042e43-6b4a-424b-afb1-2e96e3c7136a", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f01fc0055e0 con 0x7f02041475a0 2023-07-27T20:31:03.115 INFO:teuthology.orchestra.run.smithi173.stdout:2 2023-07-27T20:31:03.116 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.127+0000 7f02097ff700 1 -- 172.21.15.173:0/186138448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02041475a0 msgr2=0x7f020414d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:03.117 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.127+0000 7f02097ff700 1 --2- 172.21.15.173:0/186138448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02041475a0 0x7f020414d950 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00cb90 tx=0x7f01fc00cea0 comp rx=0 tx=0).stop 2023-07-27T20:31:03.117 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.127+0000 7f02097ff700 1 -- 172.21.15.173:0/186138448 shutdown_connections 2023-07-27T20:31:03.117 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.127+0000 7f02097ff700 1 --2- 172.21.15.173:0/186138448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02041475a0 0x7f020414d950 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:03.117 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.127+0000 7f02097ff700 1 --2- 172.21.15.173:0/186138448 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02040716f0 0x7f020414acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:03.117 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.127+0000 7f02097ff700 1 --2- 172.21.15.173:0/186138448 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f02040c12f0 0x7f020414d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:03.118 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.127+0000 7f02097ff700 1 -- 172.21.15.173:0/186138448 >> 172.21.15.173:0/186138448 conn(0x7f020406a190 msgr2=0x7f02040bfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:03.118 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.128+0000 7f02097ff700 1 -- 172.21.15.173:0/186138448 shutdown_connections 2023-07-27T20:31:03.118 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.128+0000 7f02097ff700 1 -- 172.21.15.173:0/186138448 wait complete. 2023-07-27T20:31:03.133 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 380f0099-5c43-41cb-97ab-5a326bb3b42e 3 2023-07-27T20:31:03.336 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.347+0000 7f57137ff700 1 Processor -- start 2023-07-27T20:31:03.336 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.347+0000 7f57137ff700 1 -- start start 2023-07-27T20:31:03.337 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.348+0000 7f57137ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f570c14aab0 0x7f570c154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:03.337 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.348+0000 7f57137ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f570c0c7740 0x7f570c0c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:03.337 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.348+0000 7f57137ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f570c0c4700 0x7f570c06c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:03.337 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.348+0000 7f57137ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f570c0c7c50 con 0x7f570c14aab0 2023-07-27T20:31:03.338 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.348+0000 7f57137ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f570c06bd40 con 0x7f570c0c7740 2023-07-27T20:31:03.338 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.348+0000 7f57137ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f570c0c62f0 con 0x7f570c0c4700 2023-07-27T20:31:03.338 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.349+0000 7f5711d9c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f570c0c4700 0x7f570c06c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:03.338 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.349+0000 7f5710d9a700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f570c0c7740 0x7f570c0c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:03.338 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.349+0000 7f571159b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f570c14aab0 0x7f570c154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:03.338 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.349+0000 7f5711d9c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f570c0c4700 0x7f570c06c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:38014/0 (socket says 172.21.15.173:38014) 2023-07-27T20:31:03.338 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.349+0000 7f5711d9c700 1 -- 172.21.15.173:0/2375005546 learned_addr learned my addr 172.21.15.173:0/2375005546 (peer_addr_for_me v2:172.21.15.173:0/0) 2023-07-27T20:31:03.340 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.349+0000 7f5711d9c700 1 -- 172.21.15.173:0/2375005546 >> v2:172.21.15.173:3300/0 conn(0x7f570c0c7740 msgr2=0x7f570c0c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:03.340 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.349+0000 7f5711d9c700 1 --2- 172.21.15.173:0/2375005546 >> v2:172.21.15.173:3300/0 conn(0x7f570c0c7740 0x7f570c0c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:03.340 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.349+0000 7f5711d9c700 1 -- 172.21.15.173:0/2375005546 >> v2:172.21.15.72:3300/0 conn(0x7f570c14aab0 msgr2=0x7f570c154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:03.340 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.349+0000 7f5711d9c700 1 --2- 172.21.15.173:0/2375005546 >> v2:172.21.15.72:3300/0 conn(0x7f570c14aab0 0x7f570c154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:03.340 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.349+0000 7f5711d9c700 1 -- 172.21.15.173:0/2375005546 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f570c155050 con 0x7f570c0c4700 2023-07-27T20:31:03.341 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.349+0000 7f5710d9a700 1 --2- 172.21.15.173:0/2375005546 >> v2:172.21.15.173:3300/0 conn(0x7f570c0c7740 0x7f570c0c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:31:03.341 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.349+0000 7f5711d9c700 1 --2- 172.21.15.173:0/2375005546 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f570c0c4700 0x7f570c06c1d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f570c0a9090 tx=0x7f570400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46ae6a342ec49e21 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:03.341 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.350+0000 7f5703fff700 1 -- 172.21.15.173:0/2375005546 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570400e070 con 0x7f570c0c4700 2023-07-27T20:31:03.341 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.350+0000 7f5703fff700 1 -- 172.21.15.173:0/2375005546 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f570400b910 con 0x7f570c0c4700 2023-07-27T20:31:03.341 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.350+0000 7f5703fff700 1 -- 172.21.15.173:0/2375005546 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570400bcc0 con 0x7f570c0c4700 2023-07-27T20:31:03.341 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.350+0000 7f57137ff700 1 -- 172.21.15.173:0/2375005546 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f570c0c4700 msgr2=0x7f570c06c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:03.341 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.350+0000 7f57137ff700 1 --2- 172.21.15.173:0/2375005546 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f570c0c4700 0x7f570c06c1d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f570c0a9090 tx=0x7f570400b330 comp rx=0 tx=0).stop 2023-07-27T20:31:03.342 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.350+0000 7f57137ff700 1 -- 172.21.15.173:0/2375005546 shutdown_connections 2023-07-27T20:31:03.342 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.350+0000 7f57137ff700 1 --2- 172.21.15.173:0/2375005546 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f570c0c4700 0x7f570c06c1d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:03.342 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.350+0000 7f57137ff700 1 --2- 172.21.15.173:0/2375005546 >> v2:172.21.15.72:3300/0 conn(0x7f570c14aab0 0x7f570c154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:03.342 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.350+0000 7f57137ff700 1 --2- 172.21.15.173:0/2375005546 >> v2:172.21.15.173:3300/0 conn(0x7f570c0c7740 0x7f570c0c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:03.342 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.350+0000 7f57137ff700 1 -- 172.21.15.173:0/2375005546 >> 172.21.15.173:0/2375005546 conn(0x7f570c0ab3f0 msgr2=0x7f570c0ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:03.342 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.350+0000 7f57137ff700 1 -- 172.21.15.173:0/2375005546 shutdown_connections 2023-07-27T20:31:03.342 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.351+0000 7f57137ff700 1 -- 172.21.15.173:0/2375005546 wait complete. 2023-07-27T20:31:03.344 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.352+0000 7f57137ff700 1 Processor -- start 2023-07-27T20:31:03.344 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.352+0000 7f57137ff700 1 -- start start 2023-07-27T20:31:03.344 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.353+0000 7f57137ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f570c0c4700 0x7f570c155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:03.345 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.353+0000 7f57137ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f570c0c7740 0x7f570c1ece30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:03.345 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.353+0000 7f57137ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f570c14aab0 0x7f570c0c2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:03.345 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.353+0000 7f57137ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570c1ed9a0 con 0x7f570c0c7740 2023-07-27T20:31:03.345 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.353+0000 7f57137ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570c0be460 con 0x7f570c0c4700 2023-07-27T20:31:03.345 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.353+0000 7f57137ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f570c1e72b0 con 0x7f570c14aab0 2023-07-27T20:31:03.345 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.353+0000 7f571159b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f570c0c4700 0x7f570c155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:03.345 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.353+0000 7f5711d9c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f570c14aab0 0x7f570c0c2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:03.346 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.353+0000 7f571159b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f570c0c4700 0x7f570c155dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60232/0 (socket says 172.21.15.173:60232) 2023-07-27T20:31:03.346 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.353+0000 7f571159b700 1 -- 172.21.15.173:0/3148728523 learned_addr learned my addr 172.21.15.173:0/3148728523 (peer_addr_for_me v2:172.21.15.173:0/0) 2023-07-27T20:31:03.346 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.353+0000 7f5710d9a700 1 --2- 172.21.15.173:0/3148728523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f570c0c7740 0x7f570c1ece30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:03.346 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.354+0000 7f5711d9c700 1 -- 172.21.15.173:0/3148728523 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f570c0c4700 msgr2=0x7f570c155dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:03.346 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.354+0000 7f5711d9c700 1 --2- 172.21.15.173:0/3148728523 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f570c0c4700 0x7f570c155dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:03.346 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.354+0000 7f5711d9c700 1 -- 172.21.15.173:0/3148728523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f570c0c7740 msgr2=0x7f570c1ece30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:03.346 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.354+0000 7f5711d9c700 1 --2- 172.21.15.173:0/3148728523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f570c0c7740 0x7f570c1ece30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:03.347 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.354+0000 7f5711d9c700 1 -- 172.21.15.173:0/3148728523 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56fc0094a0 con 0x7f570c14aab0 2023-07-27T20:31:03.347 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.354+0000 7f571159b700 1 --2- 172.21.15.173:0/3148728523 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f570c0c4700 0x7f570c155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:31:03.347 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.354+0000 7f5711d9c700 1 --2- 172.21.15.173:0/3148728523 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f570c14aab0 0x7f570c0c2370 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5704015000 tx=0x7f5704004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:03.347 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.354+0000 7f5701ffb700 1 -- 172.21.15.173:0/3148728523 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57040099b0 con 0x7f570c14aab0 2023-07-27T20:31:03.347 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.354+0000 7f5701ffb700 1 -- 172.21.15.173:0/3148728523 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f570400ce80 con 0x7f570c14aab0 2023-07-27T20:31:03.347 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.354+0000 7f5701ffb700 1 -- 172.21.15.173:0/3148728523 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5704004490 con 0x7f570c14aab0 2023-07-27T20:31:03.347 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.354+0000 7f57137ff700 1 -- 172.21.15.173:0/3148728523 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5704009b30 con 0x7f570c14aab0 2023-07-27T20:31:03.348 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.354+0000 7f57137ff700 1 -- 172.21.15.173:0/3148728523 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f570c0c01d0 con 0x7f570c14aab0 2023-07-27T20:31:03.348 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.355+0000 7f5701ffb700 1 -- 172.21.15.173:0/3148728523 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f570401c440 con 0x7f570c14aab0 2023-07-27T20:31:03.348 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.355+0000 7f5701ffb700 1 -- 172.21.15.173:0/3148728523 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f570401cb80 con 0x7f570c14aab0 2023-07-27T20:31:03.348 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.355+0000 7f57137ff700 1 -- 172.21.15.173:0/3148728523 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f570c0c0030 con 0x7f570c14aab0 2023-07-27T20:31:03.349 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.358+0000 7f5701ffb700 1 -- 172.21.15.173:0/3148728523 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f570c0c0030 con 0x7f570c14aab0 2023-07-27T20:31:03.434 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.445+0000 7f57137ff700 1 -- 172.21.15.173:0/3148728523 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd new", "uuid": "380f0099-5c43-41cb-97ab-5a326bb3b42e", "id": 3} v 0) v1 -- 0x7f570c04e470 con 0x7f570c14aab0 2023-07-27T20:31:03.439 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.451+0000 7f5701ffb700 1 -- 172.21.15.173:0/3148728523 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "380f0099-5c43-41cb-97ab-5a326bb3b42e", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5704020030 con 0x7f570c14aab0 2023-07-27T20:31:03.440 INFO:teuthology.orchestra.run.smithi173.stdout:3 2023-07-27T20:31:03.440 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.452+0000 7f57137ff700 1 -- 172.21.15.173:0/3148728523 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f570c14aab0 msgr2=0x7f570c0c2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:03.441 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.452+0000 7f57137ff700 1 --2- 172.21.15.173:0/3148728523 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f570c14aab0 0x7f570c0c2370 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5704015000 tx=0x7f5704004ad0 comp rx=0 tx=0).stop 2023-07-27T20:31:03.441 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.452+0000 7f57137ff700 1 -- 172.21.15.173:0/3148728523 shutdown_connections 2023-07-27T20:31:03.441 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.452+0000 7f57137ff700 1 --2- 172.21.15.173:0/3148728523 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f570c14aab0 0x7f570c0c2370 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:03.441 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.452+0000 7f57137ff700 1 --2- 172.21.15.173:0/3148728523 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f570c0c4700 0x7f570c155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:03.441 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.452+0000 7f57137ff700 1 --2- 172.21.15.173:0/3148728523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f570c0c7740 0x7f570c1ece30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:03.441 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.452+0000 7f57137ff700 1 -- 172.21.15.173:0/3148728523 >> 172.21.15.173:0/3148728523 conn(0x7f570c0ab3f0 msgr2=0x7f570c149d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:03.442 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.452+0000 7f57137ff700 1 -- 172.21.15.173:0/3148728523 shutdown_connections 2023-07-27T20:31:03.442 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.452+0000 7f57137ff700 1 -- 172.21.15.173:0/3148728523 wait complete. 2023-07-27T20:31:03.445 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-27T20:31:03.458+0000 7f6c1e6ad200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-27T20:31:03.457 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new cd446a99-81c1-4dc2-9bd5-bea127288d89 4 2023-07-27T20:31:03.458 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-07-27T20:31:03.469+0000 7f2b0af6a200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-27T20:31:03.651 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.662+0000 7f95bafff700 1 Processor -- start 2023-07-27T20:31:03.651 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.662+0000 7f95bafff700 1 -- start start 2023-07-27T20:31:03.654 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.663+0000 7f95bafff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f95b414f3f0 0x7f95b41528e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:03.654 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.663+0000 7f95bafff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f95b40ab730 0x7f95b40abb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:03.654 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.663+0000 7f95bafff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b4152e20 con 0x7f95b40a8170 2023-07-27T20:31:03.654 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.663+0000 7f95bafff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b40c25f0 con 0x7f95b40ab730 2023-07-27T20:31:03.654 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.663+0000 7f95bafff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b40c1b50 con 0x7f95b414f3f0 2023-07-27T20:31:03.655 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.663+0000 7f95b8d9b700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f95b414f3f0 0x7f95b41528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:03.655 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.663+0000 7f95b8d9b700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f95b414f3f0 0x7f95b41528e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60236/0 (socket says 172.21.15.173:60236) 2023-07-27T20:31:03.655 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.663+0000 7f95b8d9b700 1 -- 172.21.15.173:0/2328685960 learned_addr learned my addr 172.21.15.173:0/2328685960 (peer_addr_for_me v2:172.21.15.173:0/0) 2023-07-27T20:31:03.655 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.663+0000 7f95b3fff700 1 --2- 172.21.15.173:0/2328685960 >> v2:172.21.15.72:3300/0 conn(0x7f95b40ab730 0x7f95b40abb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:03.655 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.664+0000 7f95b8d9b700 1 -- 172.21.15.173:0/2328685960 >> v2:172.21.15.72:3300/0 conn(0x7f95b40ab730 msgr2=0x7f95b40abb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:03.655 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.664+0000 7f95b8d9b700 1 --2- 172.21.15.173:0/2328685960 >> v2:172.21.15.72:3300/0 conn(0x7f95b40ab730 0x7f95b40abb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:03.655 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.664+0000 7f95b8d9b700 1 -- 172.21.15.173:0/2328685960 >> v1:172.21.15.72:6789/0 conn(0x7f95b40a8170 legacy=0x7f95b40a85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:03.656 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.664+0000 7f95b8d9b700 1 -- 172.21.15.173:0/2328685960 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b40c12b0 con 0x7f95b414f3f0 2023-07-27T20:31:03.656 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.664+0000 7f95b8d9b700 1 --2- 172.21.15.173:0/2328685960 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95b414f3f0 0x7f95b41528e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f95b406e160 tx=0x7f95a8009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfcd97d0c6213b0f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:03.656 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.664+0000 7f95b37fe700 1 -- 172.21.15.173:0/2328685960 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a8011830 con 0x7f95b414f3f0 2023-07-27T20:31:03.656 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.664+0000 7f95b37fe700 1 -- 172.21.15.173:0/2328685960 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a8011990 con 0x7f95b414f3f0 2023-07-27T20:31:03.656 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.664+0000 7f95b37fe700 1 -- 172.21.15.173:0/2328685960 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a8011d20 con 0x7f95b414f3f0 2023-07-27T20:31:03.656 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.665+0000 7f95bafff700 1 -- 172.21.15.173:0/2328685960 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95b414f3f0 msgr2=0x7f95b41528e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:03.657 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.665+0000 7f95bafff700 1 --2- 172.21.15.173:0/2328685960 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95b414f3f0 0x7f95b41528e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f95b406e160 tx=0x7f95a8009bd0 comp rx=0 tx=0).stop 2023-07-27T20:31:03.657 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.665+0000 7f95bafff700 1 -- 172.21.15.173:0/2328685960 shutdown_connections 2023-07-27T20:31:03.657 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.665+0000 7f95bafff700 1 --2- 172.21.15.173:0/2328685960 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95b414f3f0 0x7f95b41528e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:03.657 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.665+0000 7f95bafff700 1 --2- 172.21.15.173:0/2328685960 >> v2:172.21.15.72:3300/0 conn(0x7f95b40ab730 0x7f95b40abb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:03.657 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.665+0000 7f95bafff700 1 -- 172.21.15.173:0/2328685960 >> 172.21.15.173:0/2328685960 conn(0x7f95b40c2fd0 msgr2=0x7f95b40c33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:03.657 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.665+0000 7f95bafff700 1 -- 172.21.15.173:0/2328685960 shutdown_connections 2023-07-27T20:31:03.657 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.665+0000 7f95bafff700 1 -- 172.21.15.173:0/2328685960 wait complete. 2023-07-27T20:31:03.659 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.667+0000 7f95bafff700 1 Processor -- start 2023-07-27T20:31:03.660 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.667+0000 7f95bafff700 1 -- start start 2023-07-27T20:31:03.660 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.668+0000 7f95bafff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95b40a8170 0x7f95b4147770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:03.660 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.668+0000 7f95bafff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95b40ab730 0x7f95b40aaef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:03.660 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.668+0000 7f95bafff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f95b414f3f0 0x7f95b4150440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:03.660 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.668+0000 7f95bafff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b414fcd0 con 0x7f95b40ab730 2023-07-27T20:31:03.661 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.668+0000 7f95bafff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b414ffb0 con 0x7f95b40a8170 2023-07-27T20:31:03.661 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.668+0000 7f95bafff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b40ab430 con 0x7f95b414f3f0 2023-07-27T20:31:03.661 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.668+0000 7f95b8d9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95b40a8170 0x7f95b4147770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:03.661 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.668+0000 7f95b8d9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95b40a8170 0x7f95b4147770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60244/0 (socket says 172.21.15.173:60244) 2023-07-27T20:31:03.661 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.668+0000 7f95b8d9b700 1 -- 172.21.15.173:0/3785520664 learned_addr learned my addr 172.21.15.173:0/3785520664 (peer_addr_for_me v2:172.21.15.173:0/0) 2023-07-27T20:31:03.661 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.668+0000 7f95b959c700 1 --2- 172.21.15.173:0/3785520664 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f95b414f3f0 0x7f95b4150440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:03.661 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.668+0000 7f95b3fff700 1 --2- 172.21.15.173:0/3785520664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95b40ab730 0x7f95b40aaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:03.662 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.668+0000 7f95b8d9b700 1 -- 172.21.15.173:0/3785520664 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f95b414f3f0 msgr2=0x7f95b4150440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:03.662 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.668+0000 7f95b8d9b700 1 --2- 172.21.15.173:0/3785520664 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f95b414f3f0 0x7f95b4150440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:03.662 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.668+0000 7f95b8d9b700 1 -- 172.21.15.173:0/3785520664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95b40ab730 msgr2=0x7f95b40aaef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:03.662 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.668+0000 7f95b8d9b700 1 --2- 172.21.15.173:0/3785520664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95b40ab730 0x7f95b40aaef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:03.662 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.668+0000 7f95b8d9b700 1 -- 172.21.15.173:0/3785520664 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a8009550 con 0x7f95b40a8170 2023-07-27T20:31:03.662 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.669+0000 7f95b8d9b700 1 --2- 172.21.15.173:0/3785520664 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95b40a8170 0x7f95b4147770 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f95a8009c10 tx=0x7f95a8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:03.663 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.669+0000 7f95b17fa700 1 -- 172.21.15.173:0/3785520664 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a8004510 con 0x7f95b40a8170 2023-07-27T20:31:03.663 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.669+0000 7f95b17fa700 1 -- 172.21.15.173:0/3785520664 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a801e070 con 0x7f95b40a8170 2023-07-27T20:31:03.663 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.669+0000 7f95bafff700 1 -- 172.21.15.173:0/3785520664 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b40bc1c0 con 0x7f95b40a8170 2023-07-27T20:31:03.663 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.669+0000 7f95b17fa700 1 -- 172.21.15.173:0/3785520664 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a80038e0 con 0x7f95b40a8170 2023-07-27T20:31:03.663 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.669+0000 7f95bafff700 1 -- 172.21.15.173:0/3785520664 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b41eaa40 con 0x7f95b40a8170 2023-07-27T20:31:03.663 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.669+0000 7f95b17fa700 1 -- 172.21.15.173:0/3785520664 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f95a8003d40 con 0x7f95b40a8170 2023-07-27T20:31:03.663 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.669+0000 7f95b17fa700 1 -- 172.21.15.173:0/3785520664 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f95a802dc70 con 0x7f95b40a8170 2023-07-27T20:31:03.664 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.670+0000 7f95bafff700 1 -- 172.21.15.173:0/3785520664 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b4150290 con 0x7f95b40a8170 2023-07-27T20:31:03.664 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.672+0000 7f95b17fa700 1 -- 172.21.15.173:0/3785520664 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f95a8020070 con 0x7f95b40a8170 2023-07-27T20:31:03.747 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.758+0000 7f95bafff700 1 -- 172.21.15.173:0/3785520664 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cd446a99-81c1-4dc2-9bd5-bea127288d89", "id": 4} v 0) v1 -- 0x7f95b404e470 con 0x7f95b40a8170 2023-07-27T20:31:03.754 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.766+0000 7f95b17fa700 1 -- 172.21.15.173:0/3785520664 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cd446a99-81c1-4dc2-9bd5-bea127288d89", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f95a8015020 con 0x7f95b40a8170 2023-07-27T20:31:03.754 INFO:teuthology.orchestra.run.smithi173.stdout:4 2023-07-27T20:31:03.756 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.767+0000 7f95bafff700 1 -- 172.21.15.173:0/3785520664 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95b40a8170 msgr2=0x7f95b4147770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:03.756 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.767+0000 7f95bafff700 1 --2- 172.21.15.173:0/3785520664 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95b40a8170 0x7f95b4147770 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f95a8009c10 tx=0x7f95a8004750 comp rx=0 tx=0).stop 2023-07-27T20:31:03.756 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.767+0000 7f95bafff700 1 -- 172.21.15.173:0/3785520664 shutdown_connections 2023-07-27T20:31:03.756 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.767+0000 7f95bafff700 1 --2- 172.21.15.173:0/3785520664 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f95b414f3f0 0x7f95b4150440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:03.756 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.767+0000 7f95bafff700 1 --2- 172.21.15.173:0/3785520664 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95b40a8170 0x7f95b4147770 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:03.756 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.767+0000 7f95bafff700 1 --2- 172.21.15.173:0/3785520664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95b40ab730 0x7f95b40aaef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:03.757 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.767+0000 7f95bafff700 1 -- 172.21.15.173:0/3785520664 >> 172.21.15.173:0/3785520664 conn(0x7f95b40c2fd0 msgr2=0x7f95b406a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:03.757 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.767+0000 7f95bafff700 1 -- 172.21.15.173:0/3785520664 shutdown_connections 2023-07-27T20:31:03.757 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.767+0000 7f95bafff700 1 -- 172.21.15.173:0/3785520664 wait complete. 2023-07-27T20:31:03.772 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd 5 2023-07-27T20:31:03.969 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.980+0000 7f00d39ff700 1 Processor -- start 2023-07-27T20:31:03.969 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.980+0000 7f00d39ff700 1 -- start start 2023-07-27T20:31:03.970 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.982+0000 7f00d39ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00cc14aab0 0x7f00cc154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:03.971 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.982+0000 7f00d39ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00cc0c7c50 con 0x7f00cc06c1d0 2023-07-27T20:31:03.971 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.982+0000 7f00d39ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00cc06bd40 con 0x7f00cc0c7740 2023-07-27T20:31:03.972 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.982+0000 7f00d39ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00cc06cd50 con 0x7f00cc14aab0 2023-07-27T20:31:03.972 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.982+0000 7f00d179b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00cc14aab0 0x7f00cc154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:03.972 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.982+0000 7f00d0f9a700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f00cc0c7740 0x7f00cc0c41c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:34844/0 (socket says 172.21.15.173:34844) 2023-07-27T20:31:03.972 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.982+0000 7f00d0f9a700 1 -- 172.21.15.173:0/151891893 learned_addr learned my addr 172.21.15.173:0/151891893 (peer_addr_for_me v1:172.21.15.173:0/0) 2023-07-27T20:31:03.972 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.983+0000 7f00d179b700 1 -- 172.21.15.173:0/151891893 >> v1:172.21.15.173:6789/0 conn(0x7f00cc0c7740 legacy=0x7f00cc0c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:03.972 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.983+0000 7f00c3fff700 1 -- 172.21.15.173:0/151891893 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 634228363 0 0) 0x7f00cc06bd40 con 0x7f00cc0c7740 2023-07-27T20:31:03.972 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.983+0000 7f00d179b700 1 -- 172.21.15.173:0/151891893 >> v1:172.21.15.72:6789/0 conn(0x7f00cc06c1d0 legacy=0x7f00cc06c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:03.973 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.983+0000 7f00d179b700 1 -- 172.21.15.173:0/151891893 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00cc0c62f0 con 0x7f00cc14aab0 2023-07-27T20:31:03.973 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.983+0000 7f00d179b700 1 --2- 172.21.15.173:0/151891893 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00cc14aab0 0x7f00cc154b10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f00c8009870 tx=0x7f00c8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c5c4283c8b5d96f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:03.973 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.983+0000 7f00c3fff700 1 -- 172.21.15.173:0/151891893 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c8011830 con 0x7f00cc14aab0 2023-07-27T20:31:03.974 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.983+0000 7f00c3fff700 1 -- 172.21.15.173:0/151891893 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c8011990 con 0x7f00cc14aab0 2023-07-27T20:31:03.974 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.983+0000 7f00c3fff700 1 -- 172.21.15.173:0/151891893 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c8011d20 con 0x7f00cc14aab0 2023-07-27T20:31:03.974 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.984+0000 7f00d39ff700 1 -- 172.21.15.173:0/151891893 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00cc14aab0 msgr2=0x7f00cc154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:03.974 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.984+0000 7f00d39ff700 1 --2- 172.21.15.173:0/151891893 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00cc14aab0 0x7f00cc154b10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f00c8009870 tx=0x7f00c8009b80 comp rx=0 tx=0).stop 2023-07-27T20:31:03.974 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.984+0000 7f00d39ff700 1 -- 172.21.15.173:0/151891893 shutdown_connections 2023-07-27T20:31:03.974 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.984+0000 7f00d39ff700 1 --2- 172.21.15.173:0/151891893 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00cc14aab0 0x7f00cc154b10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:03.974 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.984+0000 7f00d39ff700 1 -- 172.21.15.173:0/151891893 >> 172.21.15.173:0/151891893 conn(0x7f00cc0ab3f0 msgr2=0x7f00cc0ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:03.975 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.984+0000 7f00d39ff700 1 -- 172.21.15.173:0/151891893 shutdown_connections 2023-07-27T20:31:03.975 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.984+0000 7f00d39ff700 1 -- 172.21.15.173:0/151891893 wait complete. 2023-07-27T20:31:03.977 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.986+0000 7f00d39ff700 1 Processor -- start 2023-07-27T20:31:03.977 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.986+0000 7f00d39ff700 1 -- start start 2023-07-27T20:31:03.977 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.987+0000 7f00d39ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00cc06c1d0 0x7f00cc1ec740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:03.978 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.987+0000 7f00d39ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00cc0c7740 0x7f00cc147810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:03.978 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.987+0000 7f00d39ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00cc14aab0 0x7f00cc147d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:03.978 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.987+0000 7f00d39ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00cc155cd0 con 0x7f00cc06c1d0 2023-07-27T20:31:03.978 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.987+0000 7f00d39ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00cc1507a0 con 0x7f00cc14aab0 2023-07-27T20:31:03.978 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.987+0000 7f00d39ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00cc150a80 con 0x7f00cc0c7740 2023-07-27T20:31:03.979 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.987+0000 7f00d0f9a700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00cc0c7740 0x7f00cc147810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:03.979 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.987+0000 7f00d0f9a700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00cc0c7740 0x7f00cc147810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:38066/0 (socket says 172.21.15.173:38066) 2023-07-27T20:31:03.979 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.987+0000 7f00d0f9a700 1 -- 172.21.15.173:0/510817358 learned_addr learned my addr 172.21.15.173:0/510817358 (peer_addr_for_me v2:172.21.15.173:0/0) 2023-07-27T20:31:03.979 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.987+0000 7f00d1f9c700 1 --2- 172.21.15.173:0/510817358 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00cc14aab0 0x7f00cc147d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:03.980 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.987+0000 7f00d179b700 1 --2- 172.21.15.173:0/510817358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00cc06c1d0 0x7f00cc1ec740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:03.980 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.988+0000 7f00d0f9a700 1 -- 172.21.15.173:0/510817358 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00cc14aab0 msgr2=0x7f00cc147d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:03.980 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.988+0000 7f00d0f9a700 1 --2- 172.21.15.173:0/510817358 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00cc14aab0 0x7f00cc147d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:03.981 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.988+0000 7f00d0f9a700 1 -- 172.21.15.173:0/510817358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00cc06c1d0 msgr2=0x7f00cc1ec740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:03.981 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.988+0000 7f00d0f9a700 1 --2- 172.21.15.173:0/510817358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00cc06c1d0 0x7f00cc1ec740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:03.981 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.988+0000 7f00d0f9a700 1 -- 172.21.15.173:0/510817358 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c80094a0 con 0x7f00cc0c7740 2023-07-27T20:31:03.981 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.988+0000 7f00d179b700 1 --2- 172.21.15.173:0/510817358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00cc06c1d0 0x7f00cc1ec740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:31:03.981 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.988+0000 7f00d0f9a700 1 --2- 172.21.15.173:0/510817358 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00cc0c7740 0x7f00cc147810 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f00bc001eb0 tx=0x7f00bc00c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:03.981 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.988+0000 7f00c1ffb700 1 -- 172.21.15.173:0/510817358 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00bc004c80 con 0x7f00cc0c7740 2023-07-27T20:31:03.982 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.988+0000 7f00c1ffb700 1 -- 172.21.15.173:0/510817358 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00bc004de0 con 0x7f00cc0c7740 2023-07-27T20:31:03.982 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.988+0000 7f00d39ff700 1 -- 172.21.15.173:0/510817358 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00cc150d60 con 0x7f00cc0c7740 2023-07-27T20:31:03.982 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.988+0000 7f00c1ffb700 1 -- 172.21.15.173:0/510817358 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00bc007310 con 0x7f00cc0c7740 2023-07-27T20:31:03.982 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.988+0000 7f00d39ff700 1 -- 172.21.15.173:0/510817358 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00cc1483a0 con 0x7f00cc0c7740 2023-07-27T20:31:03.982 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.989+0000 7f00c1ffb700 1 -- 172.21.15.173:0/510817358 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f00bc01d3f0 con 0x7f00cc0c7740 2023-07-27T20:31:03.983 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.989+0000 7f00c1ffb700 1 -- 172.21.15.173:0/510817358 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f00bc01dc20 con 0x7f00cc0c7740 2023-07-27T20:31:03.983 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.989+0000 7f00d39ff700 1 -- 172.21.15.173:0/510817358 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00cc04e470 con 0x7f00cc0c7740 2023-07-27T20:31:03.983 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:03.992+0000 7f00c1ffb700 1 -- 172.21.15.173:0/510817358 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f00bc01d6a0 con 0x7f00cc0c7740 2023-07-27T20:31:04.065 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.077+0000 7f00d39ff700 1 -- 172.21.15.173:0/510817358 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd", "id": 5} v 0) v1 -- 0x7f00cc06cf00 con 0x7f00cc0c7740 2023-07-27T20:31:04.071 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.083+0000 7f00c1ffb700 1 -- 172.21.15.173:0/510817358 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f00bc01d840 con 0x7f00cc0c7740 2023-07-27T20:31:04.072 INFO:teuthology.orchestra.run.smithi173.stdout:5 2023-07-27T20:31:04.073 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.084+0000 7f00d39ff700 1 -- 172.21.15.173:0/510817358 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00cc0c7740 msgr2=0x7f00cc147810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:04.073 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.084+0000 7f00d39ff700 1 --2- 172.21.15.173:0/510817358 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00cc0c7740 0x7f00cc147810 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f00bc001eb0 tx=0x7f00bc00c800 comp rx=0 tx=0).stop 2023-07-27T20:31:04.073 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.084+0000 7f00d39ff700 1 -- 172.21.15.173:0/510817358 shutdown_connections 2023-07-27T20:31:04.073 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.084+0000 7f00d39ff700 1 --2- 172.21.15.173:0/510817358 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00cc14aab0 0x7f00cc147d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:04.073 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.084+0000 7f00d39ff700 1 --2- 172.21.15.173:0/510817358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00cc06c1d0 0x7f00cc1ec740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:04.074 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.084+0000 7f00d39ff700 1 --2- 172.21.15.173:0/510817358 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00cc0c7740 0x7f00cc147810 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:04.074 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.084+0000 7f00d39ff700 1 -- 172.21.15.173:0/510817358 >> 172.21.15.173:0/510817358 conn(0x7f00cc0ab3f0 msgr2=0x7f00cc151bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:04.074 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.084+0000 7f00d39ff700 1 -- 172.21.15.173:0/510817358 shutdown_connections 2023-07-27T20:31:04.074 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.084+0000 7f00d39ff700 1 -- 172.21.15.173:0/510817358 wait complete. 2023-07-27T20:31:04.092 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new ed072ddf-60c6-4166-a82c-88152409c957 6 2023-07-27T20:31:04.261 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-27T20:31:04.273+0000 7f6c1e6ad200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-27T20:31:04.290 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.301+0000 7fb9eafff700 1 Processor -- start 2023-07-27T20:31:04.290 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.301+0000 7fb9eafff700 1 -- start start 2023-07-27T20:31:04.291 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.302+0000 7fb9eafff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb9e41514c0 0x7fb9e41549a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:04.291 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.302+0000 7fb9eafff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9e40c0a90 0x7fb9e406ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:04.291 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.302+0000 7fb9eafff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb9e40c1e40 0x7fb9e40c2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:04.291 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.302+0000 7fb9eafff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e4153ee0 con 0x7fb9e41514c0 2023-07-27T20:31:04.292 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.302+0000 7fb9eafff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e40baf90 con 0x7fb9e40c1e40 2023-07-27T20:31:04.292 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.302+0000 7fb9eafff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e40bb270 con 0x7fb9e40c0a90 2023-07-27T20:31:04.292 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.302+0000 7fb9e3fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9e40c0a90 0x7fb9e406ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:04.292 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.303+0000 7fb9e959c700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb9e40c1e40 0x7fb9e40c2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:04.292 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.303+0000 7fb9e3fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9e40c0a90 0x7fb9e406ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:38072/0 (socket says 172.21.15.173:38072) 2023-07-27T20:31:04.292 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.303+0000 7fb9e3fff700 1 -- 172.21.15.173:0/2085820685 learned_addr learned my addr 172.21.15.173:0/2085820685 (peer_addr_for_me v2:172.21.15.173:0/0) 2023-07-27T20:31:04.293 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.303+0000 7fb9e8d9b700 1 --2- 172.21.15.173:0/2085820685 >> v2:172.21.15.72:3300/0 conn(0x7fb9e41514c0 0x7fb9e41549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:04.294 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.303+0000 7fb9e3fff700 1 -- 172.21.15.173:0/2085820685 >> v2:172.21.15.173:3300/0 conn(0x7fb9e40c1e40 msgr2=0x7fb9e40c2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:04.294 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.303+0000 7fb9e3fff700 1 --2- 172.21.15.173:0/2085820685 >> v2:172.21.15.173:3300/0 conn(0x7fb9e40c1e40 0x7fb9e40c2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:04.294 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.303+0000 7fb9e3fff700 1 -- 172.21.15.173:0/2085820685 >> v2:172.21.15.72:3300/0 conn(0x7fb9e41514c0 msgr2=0x7fb9e41549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:04.294 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.303+0000 7fb9e3fff700 1 --2- 172.21.15.173:0/2085820685 >> v2:172.21.15.72:3300/0 conn(0x7fb9e41514c0 0x7fb9e41549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:04.295 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.303+0000 7fb9e3fff700 1 -- 172.21.15.173:0/2085820685 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e41541a0 con 0x7fb9e40c0a90 2023-07-27T20:31:04.295 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.303+0000 7fb9e3fff700 1 --2- 172.21.15.173:0/2085820685 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9e40c0a90 0x7fb9e406ce10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb9e40c2b40 tx=0x7fb9d0009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcef42044bf4d5ea server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:04.295 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.303+0000 7fb9e37fe700 1 -- 172.21.15.173:0/2085820685 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0011830 con 0x7fb9e40c0a90 2023-07-27T20:31:04.295 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.304+0000 7fb9e37fe700 1 -- 172.21.15.173:0/2085820685 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d0011990 con 0x7fb9e40c0a90 2023-07-27T20:31:04.295 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.304+0000 7fb9e37fe700 1 -- 172.21.15.173:0/2085820685 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0011d20 con 0x7fb9e40c0a90 2023-07-27T20:31:04.295 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.304+0000 7fb9eafff700 1 -- 172.21.15.173:0/2085820685 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9e40c0a90 msgr2=0x7fb9e406ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:04.295 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.304+0000 7fb9eafff700 1 --2- 172.21.15.173:0/2085820685 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9e40c0a90 0x7fb9e406ce10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb9e40c2b40 tx=0x7fb9d0009bd0 comp rx=0 tx=0).stop 2023-07-27T20:31:04.296 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.304+0000 7fb9eafff700 1 -- 172.21.15.173:0/2085820685 shutdown_connections 2023-07-27T20:31:04.296 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.304+0000 7fb9eafff700 1 --2- 172.21.15.173:0/2085820685 >> v2:172.21.15.173:3300/0 conn(0x7fb9e40c1e40 0x7fb9e40c2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:04.296 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.304+0000 7fb9eafff700 1 --2- 172.21.15.173:0/2085820685 >> v2:172.21.15.72:3300/0 conn(0x7fb9e41514c0 0x7fb9e41549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:04.296 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.304+0000 7fb9eafff700 1 --2- 172.21.15.173:0/2085820685 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9e40c0a90 0x7fb9e406ce10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:04.296 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.304+0000 7fb9eafff700 1 -- 172.21.15.173:0/2085820685 >> 172.21.15.173:0/2085820685 conn(0x7fb9e406a190 msgr2=0x7fb9e406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:04.297 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.304+0000 7fb9eafff700 1 -- 172.21.15.173:0/2085820685 shutdown_connections 2023-07-27T20:31:04.297 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.304+0000 7fb9eafff700 1 -- 172.21.15.173:0/2085820685 wait complete. 2023-07-27T20:31:04.300 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.306+0000 7fb9eafff700 1 Processor -- start 2023-07-27T20:31:04.300 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.306+0000 7fb9eafff700 1 -- start start 2023-07-27T20:31:04.301 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.307+0000 7fb9eafff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9e40c0a90 0x7fb9e41de8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:04.301 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.307+0000 7fb9eafff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9e40c1e40 0x7fb9e41e09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:04.301 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.307+0000 7fb9eafff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9e41514c0 0x7fb9e4147120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:04.302 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.307+0000 7fb9eafff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e41481c0 con 0x7fb9e41514c0 2023-07-27T20:31:04.302 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.307+0000 7fb9eafff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e41e0530 con 0x7fb9e40c1e40 2023-07-27T20:31:04.302 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.307+0000 7fb9eafff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e41df340 con 0x7fb9e40c0a90 2023-07-27T20:31:04.303 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.307+0000 7fb9e3fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9e40c1e40 0x7fb9e41e09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:04.303 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.307+0000 7fb9e8d9b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9e40c0a90 0x7fb9e41de8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:04.303 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.307+0000 7fb9e8d9b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9e40c0a90 0x7fb9e41de8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:38080/0 (socket says 172.21.15.173:38080) 2023-07-27T20:31:04.303 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.307+0000 7fb9e8d9b700 1 -- 172.21.15.173:0/3491523027 learned_addr learned my addr 172.21.15.173:0/3491523027 (peer_addr_for_me v2:172.21.15.173:0/0) 2023-07-27T20:31:04.304 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.307+0000 7fb9e959c700 1 --2- 172.21.15.173:0/3491523027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9e41514c0 0x7fb9e4147120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:04.304 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.308+0000 7fb9e8d9b700 1 -- 172.21.15.173:0/3491523027 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9e40c1e40 msgr2=0x7fb9e41e09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:04.304 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.308+0000 7fb9e8d9b700 1 --2- 172.21.15.173:0/3491523027 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9e40c1e40 0x7fb9e41e09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:04.305 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.308+0000 7fb9e8d9b700 1 -- 172.21.15.173:0/3491523027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9e41514c0 msgr2=0x7fb9e4147120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:04.305 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.308+0000 7fb9e8d9b700 1 --2- 172.21.15.173:0/3491523027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9e41514c0 0x7fb9e4147120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:04.305 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.308+0000 7fb9e8d9b700 1 -- 172.21.15.173:0/3491523027 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d0009550 con 0x7fb9e40c0a90 2023-07-27T20:31:04.305 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.308+0000 7fb9e3fff700 1 --2- 172.21.15.173:0/3491523027 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9e40c1e40 0x7fb9e41e09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:31:04.306 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.308+0000 7fb9e8d9b700 1 --2- 172.21.15.173:0/3491523027 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9e40c0a90 0x7fb9e41de8c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800e870 tx=0x7fb9d800eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:04.306 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.308+0000 7fb9e17fa700 1 -- 172.21.15.173:0/3491523027 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8009590 con 0x7fb9e40c0a90 2023-07-27T20:31:04.306 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.308+0000 7fb9e17fa700 1 -- 172.21.15.173:0/3491523027 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d8013680 con 0x7fb9e40c0a90 2023-07-27T20:31:04.307 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.308+0000 7fb9e17fa700 1 -- 172.21.15.173:0/3491523027 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d80139f0 con 0x7fb9e40c0a90 2023-07-27T20:31:04.307 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.308+0000 7fb9eafff700 1 -- 172.21.15.173:0/3491523027 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e41483d0 con 0x7fb9e40c0a90 2023-07-27T20:31:04.307 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.308+0000 7fb9eafff700 1 -- 172.21.15.173:0/3491523027 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e4153740 con 0x7fb9e40c0a90 2023-07-27T20:31:04.307 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.309+0000 7fb9e17fa700 1 -- 172.21.15.173:0/3491523027 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb9d8005a20 con 0x7fb9e40c0a90 2023-07-27T20:31:04.307 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.309+0000 7fb9e17fa700 1 -- 172.21.15.173:0/3491523027 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fb9d8005cd0 con 0x7fb9e40c0a90 2023-07-27T20:31:04.308 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.309+0000 7fb9eafff700 1 -- 172.21.15.173:0/3491523027 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e41e0810 con 0x7fb9e40c0a90 2023-07-27T20:31:04.308 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.312+0000 7fb9e17fa700 1 -- 172.21.15.173:0/3491523027 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fb9d8021060 con 0x7fb9e40c0a90 2023-07-27T20:31:04.309 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-07-27T20:31:04.316+0000 7f2b0af6a200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-27T20:31:04.354 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-27T20:31:04.366+0000 7f6c1e6ad200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-27T20:31:04.385 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.396+0000 7fb9eafff700 1 -- 172.21.15.173:0/3491523027 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ed072ddf-60c6-4166-a82c-88152409c957", "id": 6} v 0) v1 -- 0x7fb9e40bd010 con 0x7fb9e40c0a90 2023-07-27T20:31:04.389 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.400+0000 7fb9e17fa700 1 -- 172.21.15.173:0/3491523027 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ed072ddf-60c6-4166-a82c-88152409c957", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb9e40bd010 con 0x7fb9e40c0a90 2023-07-27T20:31:04.389 INFO:teuthology.orchestra.run.smithi173.stdout:6 2023-07-27T20:31:04.390 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.401+0000 7fb9eafff700 1 -- 172.21.15.173:0/3491523027 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9e40c0a90 msgr2=0x7fb9e41de8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:04.390 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.401+0000 7fb9eafff700 1 --2- 172.21.15.173:0/3491523027 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9e40c0a90 0x7fb9e41de8c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800e870 tx=0x7fb9d800eb80 comp rx=0 tx=0).stop 2023-07-27T20:31:04.391 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.402+0000 7fb9eafff700 1 -- 172.21.15.173:0/3491523027 shutdown_connections 2023-07-27T20:31:04.391 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.402+0000 7fb9eafff700 1 --2- 172.21.15.173:0/3491523027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9e41514c0 0x7fb9e4147120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:04.391 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.402+0000 7fb9eafff700 1 --2- 172.21.15.173:0/3491523027 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9e40c0a90 0x7fb9e41de8c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:04.391 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.402+0000 7fb9eafff700 1 --2- 172.21.15.173:0/3491523027 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9e40c1e40 0x7fb9e41e09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:04.391 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.402+0000 7fb9eafff700 1 -- 172.21.15.173:0/3491523027 >> 172.21.15.173:0/3491523027 conn(0x7fb9e406a190 msgr2=0x7fb9e406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:04.391 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.402+0000 7fb9eafff700 1 -- 172.21.15.173:0/3491523027 shutdown_connections 2023-07-27T20:31:04.392 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.402+0000 7fb9eafff700 1 -- 172.21.15.173:0/3491523027 wait complete. 2023-07-27T20:31:04.400 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-07-27T20:31:04.411+0000 7f2b0af6a200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-27T20:31:04.407 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new b8281df4-63c4-439c-a11f-9f32573463b6 7 2023-07-27T20:31:04.521 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-27T20:31:04.533+0000 7f6c1e6ad200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-27T20:31:04.576 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-07-27T20:31:04.588+0000 7f2b0af6a200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-27T20:31:04.601 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.612+0000 7f56665ff700 1 Processor -- start 2023-07-27T20:31:04.601 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.613+0000 7f56665ff700 1 -- start start 2023-07-27T20:31:04.605 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.614+0000 7f56665ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f566014aab0 0x7f5660154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:04.605 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.614+0000 7f56665ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56600c7c50 con 0x7f566006c1d0 2023-07-27T20:31:04.605 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.614+0000 7f56665ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f566006bd40 con 0x7f56600c7740 2023-07-27T20:31:04.605 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.614+0000 7f56665ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56600c62f0 con 0x7f566014aab0 2023-07-27T20:31:04.606 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.614+0000 7f565ffff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f566014aab0 0x7f5660154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:04.607 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.614+0000 7f565ffff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f566014aab0 0x7f5660154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60276/0 (socket says 172.21.15.173:60276) 2023-07-27T20:31:04.607 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.614+0000 7f565ffff700 1 -- 172.21.15.173:0/974884719 learned_addr learned my addr 172.21.15.173:0/974884719 (peer_addr_for_me v2:172.21.15.173:0/0) 2023-07-27T20:31:04.607 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.614+0000 7f565f7fe700 1 --1- 172.21.15.173:0/974884719 >> v1:172.21.15.173:6789/0 conn(0x7f56600c7740 0x7f56600c41c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:34858/0 (socket says 172.21.15.173:34858) 2023-07-27T20:31:04.607 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.614+0000 7f565ffff700 1 -- 172.21.15.173:0/974884719 >> v1:172.21.15.173:6789/0 conn(0x7f56600c7740 legacy=0x7f56600c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:04.607 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.614+0000 7f565ffff700 1 -- 172.21.15.173:0/974884719 >> v1:172.21.15.72:6789/0 conn(0x7f566006c1d0 legacy=0x7f566006c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:04.607 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.614+0000 7f565ffff700 1 -- 172.21.15.173:0/974884719 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566006cd00 con 0x7f566014aab0 2023-07-27T20:31:04.607 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.615+0000 7f565ffff700 1 --2- 172.21.15.173:0/974884719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f566014aab0 0x7f5660154b10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f56500098f0 tx=0x7f5650009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15982daf1d5e1963 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:04.608 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.615+0000 7f565effd700 1 -- 172.21.15.173:0/974884719 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565000b8a0 con 0x7f566014aab0 2023-07-27T20:31:04.608 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.615+0000 7f565effd700 1 -- 172.21.15.173:0/974884719 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565000ba00 con 0x7f566014aab0 2023-07-27T20:31:04.608 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.615+0000 7f565effd700 1 -- 172.21.15.173:0/974884719 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565000bd90 con 0x7f566014aab0 2023-07-27T20:31:04.608 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.615+0000 7f56665ff700 1 -- 172.21.15.173:0/974884719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f566014aab0 msgr2=0x7f5660154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:04.608 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.615+0000 7f56665ff700 1 --2- 172.21.15.173:0/974884719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f566014aab0 0x7f5660154b10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f56500098f0 tx=0x7f5650009c00 comp rx=0 tx=0).stop 2023-07-27T20:31:04.608 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.616+0000 7f56665ff700 1 -- 172.21.15.173:0/974884719 shutdown_connections 2023-07-27T20:31:04.609 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.616+0000 7f56665ff700 1 --2- 172.21.15.173:0/974884719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f566014aab0 0x7f5660154b10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:04.609 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.616+0000 7f56665ff700 1 -- 172.21.15.173:0/974884719 >> 172.21.15.173:0/974884719 conn(0x7f56600ab3f0 msgr2=0x7f56600ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:04.609 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.616+0000 7f56665ff700 1 -- 172.21.15.173:0/974884719 shutdown_connections 2023-07-27T20:31:04.609 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.616+0000 7f56665ff700 1 -- 172.21.15.173:0/974884719 wait complete. 2023-07-27T20:31:04.610 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-27T20:31:04.621+0000 7f6c1e6ad200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-27T20:31:04.611 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.617+0000 7f56665ff700 1 Processor -- start 2023-07-27T20:31:04.611 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.617+0000 7f56665ff700 1 -- start start 2023-07-27T20:31:04.611 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.618+0000 7f56665ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f566006c1d0 0x7f56600a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:04.611 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.618+0000 7f56665ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56600c7740 0x7f56600adca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:04.612 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.618+0000 7f56665ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f566014aab0 0x7f56601466e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:04.612 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.618+0000 7f56665ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56600ad530 con 0x7f566006c1d0 2023-07-27T20:31:04.612 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.618+0000 7f56665ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5660147710 con 0x7f56600c7740 2023-07-27T20:31:04.612 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.618+0000 7f56665ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5660147430 con 0x7f566014aab0 2023-07-27T20:31:04.612 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.618+0000 7f565f7fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56600c7740 0x7f56600adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:04.612 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.619+0000 7f565ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f566006c1d0 0x7f56600a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:04.612 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.619+0000 7f565ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f566006c1d0 0x7f56600a9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.173:49100/0 (socket says 172.21.15.173:49100) 2023-07-27T20:31:04.613 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.619+0000 7f565ffff700 1 -- 172.21.15.173:0/3966707550 learned_addr learned my addr 172.21.15.173:0/3966707550 (peer_addr_for_me v2:172.21.15.173:0/0) 2023-07-27T20:31:04.613 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.619+0000 7f5664b9c700 1 --2- 172.21.15.173:0/3966707550 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f566014aab0 0x7f56601466e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:04.613 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.619+0000 7f565ffff700 1 -- 172.21.15.173:0/3966707550 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f566014aab0 msgr2=0x7f56601466e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:04.613 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.619+0000 7f565ffff700 1 --2- 172.21.15.173:0/3966707550 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f566014aab0 0x7f56601466e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:04.613 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.619+0000 7f565ffff700 1 -- 172.21.15.173:0/3966707550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56600c7740 msgr2=0x7f56600adca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:04.613 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.619+0000 7f565ffff700 1 --2- 172.21.15.173:0/3966707550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56600c7740 0x7f56600adca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:04.613 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.619+0000 7f565ffff700 1 -- 172.21.15.173:0/3966707550 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5650009550 con 0x7f566006c1d0 2023-07-27T20:31:04.614 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.619+0000 7f565ffff700 1 --2- 172.21.15.173:0/3966707550 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f566006c1d0 0x7f56600a9c50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5650009130 tx=0x7f5650004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:04.614 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.619+0000 7f565cff9700 1 -- 172.21.15.173:0/3966707550 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56500036a0 con 0x7f566006c1d0 2023-07-27T20:31:04.614 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.620+0000 7f565cff9700 1 -- 172.21.15.173:0/3966707550 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565001e070 con 0x7f566006c1d0 2023-07-27T20:31:04.614 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.620+0000 7f565cff9700 1 -- 172.21.15.173:0/3966707550 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5650003a40 con 0x7f566006c1d0 2023-07-27T20:31:04.614 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.620+0000 7f56665ff700 1 -- 172.21.15.173:0/3966707550 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56601ed790 con 0x7f566006c1d0 2023-07-27T20:31:04.614 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.620+0000 7f56665ff700 1 -- 172.21.15.173:0/3966707550 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56600ad780 con 0x7f566006c1d0 2023-07-27T20:31:04.614 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.620+0000 7f565cff9700 1 -- 172.21.15.173:0/3966707550 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5650025480 con 0x7f566006c1d0 2023-07-27T20:31:04.614 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.620+0000 7f565cff9700 1 -- 172.21.15.173:0/3966707550 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f5650020070 con 0x7f566006c1d0 2023-07-27T20:31:04.615 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.621+0000 7f56665ff700 1 -- 172.21.15.173:0/3966707550 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f566004e470 con 0x7f566006c1d0 2023-07-27T20:31:04.615 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.624+0000 7f565cff9700 1 -- 172.21.15.173:0/3966707550 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f565002a020 con 0x7f566006c1d0 2023-07-27T20:31:04.670 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-07-27T20:31:04.682+0000 7f2b0af6a200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-27T20:31:04.699 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.710+0000 7f56665ff700 1 -- 172.21.15.173:0/3966707550 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b8281df4-63c4-439c-a11f-9f32573463b6", "id": 7} v 0) v1 -- 0x7f566006cf00 con 0x7f566006c1d0 2023-07-27T20:31:04.703 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.714+0000 7f565cff9700 1 -- 172.21.15.173:0/3966707550 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b8281df4-63c4-439c-a11f-9f32573463b6", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5650015020 con 0x7f566006c1d0 2023-07-27T20:31:04.703 INFO:teuthology.orchestra.run.smithi173.stdout:7 2023-07-27T20:31:04.705 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.715+0000 7f56665ff700 1 -- 172.21.15.173:0/3966707550 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f566006c1d0 msgr2=0x7f56600a9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:04.705 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.715+0000 7f56665ff700 1 --2- 172.21.15.173:0/3966707550 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f566006c1d0 0x7f56600a9c50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5650009130 tx=0x7f5650004750 comp rx=0 tx=0).stop 2023-07-27T20:31:04.706 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.715+0000 7f56665ff700 1 -- 172.21.15.173:0/3966707550 shutdown_connections 2023-07-27T20:31:04.706 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.715+0000 7f56665ff700 1 --2- 172.21.15.173:0/3966707550 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f566014aab0 0x7f56601466e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:04.706 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.715+0000 7f56665ff700 1 --2- 172.21.15.173:0/3966707550 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f566006c1d0 0x7f56600a9c50 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:04.707 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.715+0000 7f56665ff700 1 --2- 172.21.15.173:0/3966707550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56600c7740 0x7f56600adca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:04.707 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.715+0000 7f56665ff700 1 -- 172.21.15.173:0/3966707550 >> 172.21.15.173:0/3966707550 conn(0x7f56600ab3f0 msgr2=0x7f56600c40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:04.707 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.715+0000 7f56665ff700 1 -- 172.21.15.173:0/3966707550 shutdown_connections 2023-07-27T20:31:04.707 INFO:teuthology.orchestra.run.smithi173.stderr:2023-07-27T20:31:04.715+0000 7f56665ff700 1 -- 172.21.15.173:0/3966707550 wait complete. 2023-07-27T20:31:04.721 INFO:tasks.ceph.osd.0:Restarting daemon 2023-07-27T20:31:04.721 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-07-27T20:31:04.725 INFO:tasks.ceph.osd.0:Started 2023-07-27T20:31:04.726 INFO:tasks.ceph.osd.1:Restarting daemon 2023-07-27T20:31:04.726 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-07-27T20:31:04.730 INFO:tasks.ceph.osd.1:Started 2023-07-27T20:31:04.730 INFO:tasks.ceph.osd.2:Restarting daemon 2023-07-27T20:31:04.730 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-07-27T20:31:04.735 INFO:tasks.ceph.osd.2:Started 2023-07-27T20:31:04.735 INFO:tasks.ceph.osd.3:Restarting daemon 2023-07-27T20:31:04.736 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-07-27T20:31:04.742 INFO:tasks.ceph.osd.3:Started 2023-07-27T20:31:04.742 INFO:tasks.ceph.osd.4:Restarting daemon 2023-07-27T20:31:04.742 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-07-27T20:31:04.747 INFO:tasks.ceph.osd.4:Started 2023-07-27T20:31:04.747 INFO:tasks.ceph.osd.5:Restarting daemon 2023-07-27T20:31:04.747 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-07-27T20:31:04.751 INFO:tasks.ceph.osd.5:Started 2023-07-27T20:31:04.751 INFO:tasks.ceph.osd.6:Restarting daemon 2023-07-27T20:31:04.752 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-07-27T20:31:04.757 INFO:tasks.ceph.osd.6:Started 2023-07-27T20:31:04.757 INFO:tasks.ceph.osd.7:Restarting daemon 2023-07-27T20:31:04.757 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-07-27T20:31:04.763 INFO:tasks.ceph.osd.7:Started 2023-07-27T20:31:04.763 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:31:04.877 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-27T20:31:04.890+0000 7f6c1e6ad200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-27T20:31:04.931 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-07-27T20:31:04.943+0000 7f2b0af6a200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-27T20:31:04.996 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-27T20:31:05.009+0000 7f6c1e6ad200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-27T20:31:05.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.030+0000 7fdf065ff700 1 Processor -- start 2023-07-27T20:31:05.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.031+0000 7fdf065ff700 1 -- start start 2023-07-27T20:31:05.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.032+0000 7fdf065ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdf000c4400 0x7fdf000c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:05.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.032+0000 7fdf065ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf001549f0 0x7fdf001514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:05.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.032+0000 7fdf065ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf0006b710 con 0x7fdf0006b150 2023-07-27T20:31:05.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.032+0000 7fdf065ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf001545d0 con 0x7fdf000c4400 2023-07-27T20:31:05.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.032+0000 7fdf065ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0006c860 con 0x7fdf001549f0 2023-07-27T20:31:05.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.033+0000 7fdefffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdf000c4400 0x7fdf000c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:05.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.033+0000 7fdefffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdf000c4400 0x7fdf000c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34536/0 (socket says 172.21.15.72:34536) 2023-07-27T20:31:05.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.033+0000 7fdefffff700 1 -- 172.21.15.72:0/2537834037 learned_addr learned my addr 172.21.15.72:0/2537834037 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:05.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.033+0000 7fdf04b9c700 1 --2- 172.21.15.72:0/2537834037 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf001549f0 0x7fdf001514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:05.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.033+0000 7fdefffff700 1 -- 172.21.15.72:0/2537834037 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf001549f0 msgr2=0x7fdf001514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:05.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.033+0000 7fdefffff700 1 --2- 172.21.15.72:0/2537834037 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf001549f0 0x7fdf001514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:05.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.033+0000 7fdefffff700 1 -- 172.21.15.72:0/2537834037 >> v1:172.21.15.72:6789/0 conn(0x7fdf0006b150 legacy=0x7fdf000c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:05.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.033+0000 7fdefffff700 1 -- 172.21.15.72:0/2537834037 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0006b9f0 con 0x7fdf000c4400 2023-07-27T20:31:05.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.033+0000 7fdefeffd700 1 -- 172.21.15.72:0/2537834037 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1249945594 0 0) 0x7fdf0006b710 con 0x7fdf0006b150 2023-07-27T20:31:05.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.033+0000 7fdefffff700 1 --2- 172.21.15.72:0/2537834037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf000c4400 0x7fdf000c7710 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdef00098f0 tx=0x7fdef0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44275b61d75f54b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:05.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.034+0000 7fdefeffd700 1 -- 172.21.15.72:0/2537834037 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef0011830 con 0x7fdf000c4400 2023-07-27T20:31:05.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.034+0000 7fdefeffd700 1 -- 172.21.15.72:0/2537834037 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef0011990 con 0x7fdf000c4400 2023-07-27T20:31:05.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.034+0000 7fdefeffd700 1 -- 172.21.15.72:0/2537834037 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef0011d20 con 0x7fdf000c4400 2023-07-27T20:31:05.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.034+0000 7fdf065ff700 1 -- 172.21.15.72:0/2537834037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf000c4400 msgr2=0x7fdf000c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:05.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.034+0000 7fdf065ff700 1 --2- 172.21.15.72:0/2537834037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf000c4400 0x7fdf000c7710 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdef00098f0 tx=0x7fdef0009c00 comp rx=0 tx=0).stop 2023-07-27T20:31:05.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.034+0000 7fdf065ff700 1 -- 172.21.15.72:0/2537834037 shutdown_connections 2023-07-27T20:31:05.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.034+0000 7fdf065ff700 1 --2- 172.21.15.72:0/2537834037 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf001549f0 0x7fdf001514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:05.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.034+0000 7fdf065ff700 1 --2- 172.21.15.72:0/2537834037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf000c4400 0x7fdf000c7710 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:05.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.034+0000 7fdf065ff700 1 -- 172.21.15.72:0/2537834037 >> 172.21.15.72:0/2537834037 conn(0x7fdf000ab300 msgr2=0x7fdf000ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:05.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.034+0000 7fdf065ff700 1 -- 172.21.15.72:0/2537834037 shutdown_connections 2023-07-27T20:31:05.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.035+0000 7fdf065ff700 1 -- 172.21.15.72:0/2537834037 wait complete. 2023-07-27T20:31:05.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.036+0000 7fdf065ff700 1 Processor -- start 2023-07-27T20:31:05.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.036+0000 7fdf065ff700 1 -- start start 2023-07-27T20:31:05.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.037+0000 7fdf065ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf0006b150 0x7fdf000aa920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:05.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.037+0000 7fdf065ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf000c4400 0x7fdf001ed710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:05.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.037+0000 7fdf065ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf001549f0 0x7fdf000a9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:05.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.037+0000 7fdf065ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf001ea2b0 con 0x7fdf000c4400 2023-07-27T20:31:05.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.037+0000 7fdf065ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf001edc50 con 0x7fdf001549f0 2023-07-27T20:31:05.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.037+0000 7fdf065ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf000ab020 con 0x7fdf0006b150 2023-07-27T20:31:05.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.037+0000 7fdeff7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf000c4400 0x7fdf001ed710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:05.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.037+0000 7fdeff7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf000c4400 0x7fdf001ed710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34538/0 (socket says 172.21.15.72:34538) 2023-07-27T20:31:05.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.037+0000 7fdeff7fe700 1 -- 172.21.15.72:0/4113869194 learned_addr learned my addr 172.21.15.72:0/4113869194 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:05.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.037+0000 7fdf04b9c700 1 --2- 172.21.15.72:0/4113869194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf001549f0 0x7fdf000a9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:05.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.038+0000 7fdefffff700 1 --2- 172.21.15.72:0/4113869194 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf0006b150 0x7fdf000aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:05.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.038+0000 7fdeff7fe700 1 -- 172.21.15.72:0/4113869194 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf0006b150 msgr2=0x7fdf000aa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:05.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.038+0000 7fdeff7fe700 1 --2- 172.21.15.72:0/4113869194 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf0006b150 0x7fdf000aa920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:05.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.038+0000 7fdeff7fe700 1 -- 172.21.15.72:0/4113869194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf001549f0 msgr2=0x7fdf000a9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:05.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.038+0000 7fdeff7fe700 1 --2- 172.21.15.72:0/4113869194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf001549f0 0x7fdf000a9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:05.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.038+0000 7fdeff7fe700 1 -- 172.21.15.72:0/4113869194 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef0009550 con 0x7fdf000c4400 2023-07-27T20:31:05.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.038+0000 7fdeff7fe700 1 --2- 172.21.15.72:0/4113869194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf000c4400 0x7fdf001ed710 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdef400c750 tx=0x7fdef400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:05.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.038+0000 7fdefcff9700 1 -- 172.21.15.72:0/4113869194 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef40054e0 con 0x7fdf000c4400 2023-07-27T20:31:05.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.038+0000 7fdefcff9700 1 -- 172.21.15.72:0/4113869194 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef4003680 con 0x7fdf000c4400 2023-07-27T20:31:05.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.038+0000 7fdf065ff700 1 -- 172.21.15.72:0/4113869194 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf001ea6d0 con 0x7fdf000c4400 2023-07-27T20:31:05.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.038+0000 7fdefcff9700 1 -- 172.21.15.72:0/4113869194 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef4003a30 con 0x7fdf000c4400 2023-07-27T20:31:05.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.038+0000 7fdf065ff700 1 -- 172.21.15.72:0/4113869194 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf001e9bf0 con 0x7fdf000c4400 2023-07-27T20:31:05.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.039+0000 7fdefcff9700 1 -- 172.21.15.72:0/4113869194 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdef401c440 con 0x7fdf000c4400 2023-07-27T20:31:05.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.039+0000 7fdefcff9700 1 -- 172.21.15.72:0/4113869194 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fdef4012ad0 con 0x7fdf000c4400 2023-07-27T20:31:05.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.040+0000 7fdf065ff700 1 -- 172.21.15.72:0/4113869194 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf001ea3f0 con 0x7fdf000c4400 2023-07-27T20:31:05.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.042+0000 7fdefcff9700 1 -- 172.21.15.72:0/4113869194 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fdf001ea3f0 con 0x7fdf000c4400 2023-07-27T20:31:05.038 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-07-27T20:31:05.048+0000 7f2b0af6a200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-27T20:31:05.100 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-27T20:31:05.112+0000 7f6c1e6ad200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-27T20:31:05.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.114+0000 7fdf065ff700 1 -- 172.21.15.72:0/4113869194 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf0006bc80 con 0x7fdf000c4400 2023-07-27T20:31:05.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.115+0000 7fdefcff9700 1 -- 172.21.15.72:0/4113869194 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fdef4017070 con 0x7fdf000c4400 2023-07-27T20:31:05.102 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:31:05.102 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":10,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:31:04.712970+0000","last_up_change":"0.000000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:31:05.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.116+0000 7fdf065ff700 1 -- 172.21.15.72:0/4113869194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf000c4400 msgr2=0x7fdf001ed710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:05.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.116+0000 7fdf065ff700 1 --2- 172.21.15.72:0/4113869194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf000c4400 0x7fdf001ed710 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdef400c750 tx=0x7fdef400ca60 comp rx=0 tx=0).stop 2023-07-27T20:31:05.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.116+0000 7fdf065ff700 1 -- 172.21.15.72:0/4113869194 shutdown_connections 2023-07-27T20:31:05.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.116+0000 7fdf065ff700 1 --2- 172.21.15.72:0/4113869194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf001549f0 0x7fdf000a9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:05.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.116+0000 7fdf065ff700 1 --2- 172.21.15.72:0/4113869194 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf0006b150 0x7fdf000aa920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:05.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.116+0000 7fdf065ff700 1 --2- 172.21.15.72:0/4113869194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf000c4400 0x7fdf001ed710 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:05.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.116+0000 7fdf065ff700 1 -- 172.21.15.72:0/4113869194 >> 172.21.15.72:0/4113869194 conn(0x7fdf000ab300 msgr2=0x7fdf0014b060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:05.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.116+0000 7fdf065ff700 1 -- 172.21.15.72:0/4113869194 shutdown_connections 2023-07-27T20:31:05.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:05.116+0000 7fdf065ff700 1 -- 172.21.15.72:0/4113869194 wait complete. 2023-07-27T20:31:05.121 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-07-27T20:31:05.122 INFO:tasks.ceph:Waiting for OSDs to come up 2023-07-27T20:31:05.133 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-07-27T20:31:05.145+0000 7f2b0af6a200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-27T20:31:05.212 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-27T20:31:05.224+0000 7f6c1e6ad200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-27T20:31:05.234 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-07-27T20:31:05.246+0000 7f2b0af6a200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-27T20:31:05.440 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-27T20:31:05.453+0000 7f6c1e6ad200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-27T20:31:05.449 INFO:tasks.ceph.osd.5.smithi173.stderr:2023-07-27T20:31:05.461+0000 7f966b3ae640 -1 Falling back to public interface 2023-07-27T20:31:05.450 INFO:tasks.ceph.osd.4.smithi173.stderr:2023-07-27T20:31:05.462+0000 7f98b4969640 -1 Falling back to public interface 2023-07-27T20:31:05.451 INFO:tasks.ceph.osd.5.smithi173.stderr:2023-07-27T20:31:05.462+0000 7f965d1fd700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6806/0: (98) Address already in use 2023-07-27T20:31:05.463 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-07-27T20:31:05.476+0000 7f53455f3640 -1 Falling back to public interface 2023-07-27T20:31:05.464 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-07-27T20:31:05.474+0000 7f2b0af6a200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-27T20:31:05.464 INFO:tasks.ceph.osd.2.smithi072.stderr:2023-07-27T20:31:05.476+0000 7f459c7aa640 -1 Falling back to public interface 2023-07-27T20:31:05.469 INFO:tasks.ceph.osd.3.smithi072.stderr:2023-07-27T20:31:05.482+0000 7f824ff60640 -1 Falling back to public interface 2023-07-27T20:31:05.470 INFO:tasks.ceph.osd.0.smithi072.stderr:2023-07-27T20:31:05.483+0000 7f08fd5df640 -1 Falling back to public interface 2023-07-27T20:31:05.482 INFO:tasks.ceph.osd.6.smithi173.stderr:2023-07-27T20:31:05.494+0000 7f64cedab640 -1 Falling back to public interface 2023-07-27T20:31:05.493 INFO:tasks.ceph.osd.7.smithi173.stderr:2023-07-27T20:31:05.502+0000 7fcdb745c640 -1 Falling back to public interface 2023-07-27T20:31:05.550 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-27T20:31:05.563+0000 7f6c1e6ad200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-27T20:31:05.567 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-07-27T20:31:05.579+0000 7f2b0af6a200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-27T20:31:05.903 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-27T20:31:05.916+0000 7f6c1e6ad200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-27T20:31:05.922 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-07-27T20:31:05.934+0000 7f2b0af6a200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-27T20:31:05.928 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-27T20:31:05.996 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-27T20:31:06.009+0000 7f6c1e6ad200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-27T20:31:06.012 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-07-27T20:31:06.024+0000 7f2b0af6a200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-27T20:31:06.105 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.118+0000 7fbcf37ff700 1 Processor -- start 2023-07-27T20:31:06.105 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.118+0000 7fbcf37ff700 1 -- start start 2023-07-27T20:31:06.106 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.119+0000 7fbcf37ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbcec151710 0x7fbcec0c4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:06.106 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.119+0000 7fbcf37ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcec158020 con 0x7fbcec0bd030 2023-07-27T20:31:06.107 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.119+0000 7fbcf37ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcec0ca450 con 0x7fbcec0c78a0 2023-07-27T20:31:06.107 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.119+0000 7fbcf37ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcec151af0 con 0x7fbcec151710 2023-07-27T20:31:06.107 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.119+0000 7fbcf159b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbcec151710 0x7fbcec0c4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:06.107 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.119+0000 7fbcf1d9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fbcec0bd030 0x7fbcec1548a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42640/0 (socket says 172.21.15.72:42640) 2023-07-27T20:31:06.107 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.119+0000 7fbcf159b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbcec151710 0x7fbcec0c4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34548/0 (socket says 172.21.15.72:34548) 2023-07-27T20:31:06.107 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.119+0000 7fbcf1d9c700 1 -- 172.21.15.72:0/1194479427 learned_addr learned my addr 172.21.15.72:0/1194479427 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:06.108 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.119+0000 7fbcf159b700 1 -- 172.21.15.72:0/1194479427 >> v1:172.21.15.173:6789/0 conn(0x7fbcec0c78a0 legacy=0x7fbcec154190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:06.109 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.119+0000 7fbcf159b700 1 -- 172.21.15.72:0/1194479427 >> v1:172.21.15.72:6789/0 conn(0x7fbcec0bd030 legacy=0x7fbcec1548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:06.109 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.119+0000 7fbcf159b700 1 -- 172.21.15.72:0/1194479427 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcec158550 con 0x7fbcec151710 2023-07-27T20:31:06.109 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.120+0000 7fbcf159b700 1 --2- 172.21.15.72:0/1194479427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcec151710 0x7fbcec0c4320 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbce8009840 tx=0x7fbce8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e66f35d784b6954c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:06.109 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.120+0000 7fbce3fff700 1 -- 172.21.15.72:0/1194479427 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce8004230 con 0x7fbcec151710 2023-07-27T20:31:06.109 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.120+0000 7fbce3fff700 1 -- 172.21.15.72:0/1194479427 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce8004390 con 0x7fbcec151710 2023-07-27T20:31:06.109 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.120+0000 7fbce3fff700 1 -- 172.21.15.72:0/1194479427 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce80036a0 con 0x7fbcec151710 2023-07-27T20:31:06.109 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.120+0000 7fbcf37ff700 1 -- 172.21.15.72:0/1194479427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcec151710 msgr2=0x7fbcec0c4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:06.110 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.120+0000 7fbcf37ff700 1 --2- 172.21.15.72:0/1194479427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcec151710 0x7fbcec0c4320 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbce8009840 tx=0x7fbce8009b50 comp rx=0 tx=0).stop 2023-07-27T20:31:06.110 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.121+0000 7fbcf37ff700 1 -- 172.21.15.72:0/1194479427 shutdown_connections 2023-07-27T20:31:06.110 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.121+0000 7fbcf37ff700 1 --2- 172.21.15.72:0/1194479427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcec151710 0x7fbcec0c4320 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:06.110 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.121+0000 7fbcf37ff700 1 -- 172.21.15.72:0/1194479427 >> 172.21.15.72:0/1194479427 conn(0x7fbcec071aa0 msgr2=0x7fbcec071eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:06.110 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.121+0000 7fbcf37ff700 1 -- 172.21.15.72:0/1194479427 shutdown_connections 2023-07-27T20:31:06.110 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.121+0000 7fbcf37ff700 1 -- 172.21.15.72:0/1194479427 wait complete. 2023-07-27T20:31:06.112 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.122+0000 7fbcf37ff700 1 Processor -- start 2023-07-27T20:31:06.112 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.122+0000 7fbcf37ff700 1 -- start start 2023-07-27T20:31:06.112 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.123+0000 7fbcf37ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcec0bd030 0x7fbcec151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:06.112 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.123+0000 7fbcf37ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbcec0c78a0 0x7fbcec1eaea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:06.113 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.123+0000 7fbcf37ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbcec151710 0x7fbcec149b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:06.113 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.123+0000 7fbcf37ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcec153eb0 con 0x7fbcec0bd030 2023-07-27T20:31:06.113 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.123+0000 7fbcf37ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcec153bd0 con 0x7fbcec151710 2023-07-27T20:31:06.113 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.123+0000 7fbcf37ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcec149390 con 0x7fbcec0c78a0 2023-07-27T20:31:06.114 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.123+0000 7fbcf159b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcec0bd030 0x7fbcec151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:06.114 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.124+0000 7fbcf159b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcec0bd030 0x7fbcec151e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34554/0 (socket says 172.21.15.72:34554) 2023-07-27T20:31:06.114 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.124+0000 7fbcf159b700 1 -- 172.21.15.72:0/1107343644 learned_addr learned my addr 172.21.15.72:0/1107343644 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:06.114 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.124+0000 7fbcf0d9a700 1 --2- 172.21.15.72:0/1107343644 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbcec0c78a0 0x7fbcec1eaea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:06.114 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.124+0000 7fbcf1d9c700 1 --2- 172.21.15.72:0/1107343644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbcec151710 0x7fbcec149b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:06.114 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.124+0000 7fbcf159b700 1 -- 172.21.15.72:0/1107343644 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbcec0c78a0 msgr2=0x7fbcec1eaea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:06.114 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.124+0000 7fbcf159b700 1 --2- 172.21.15.72:0/1107343644 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbcec0c78a0 0x7fbcec1eaea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:06.115 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.124+0000 7fbcf159b700 1 -- 172.21.15.72:0/1107343644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbcec151710 msgr2=0x7fbcec149b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:06.115 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.124+0000 7fbcf159b700 1 --2- 172.21.15.72:0/1107343644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbcec151710 0x7fbcec149b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:06.115 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.124+0000 7fbcf159b700 1 -- 172.21.15.72:0/1107343644 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce80094a0 con 0x7fbcec0bd030 2023-07-27T20:31:06.115 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.124+0000 7fbcf159b700 1 --2- 172.21.15.72:0/1107343644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcec0bd030 0x7fbcec151e90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbce80090b0 tx=0x7fbce8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:06.115 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.124+0000 7fbce1ffb700 1 -- 172.21.15.72:0/1107343644 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce8003ea0 con 0x7fbcec0bd030 2023-07-27T20:31:06.115 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.124+0000 7fbce1ffb700 1 -- 172.21.15.72:0/1107343644 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce801e070 con 0x7fbcec0bd030 2023-07-27T20:31:06.115 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.124+0000 7fbce1ffb700 1 -- 172.21.15.72:0/1107343644 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce8011850 con 0x7fbcec0bd030 2023-07-27T20:31:06.115 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.125+0000 7fbcf37ff700 1 -- 172.21.15.72:0/1107343644 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcec149670 con 0x7fbcec0bd030 2023-07-27T20:31:06.116 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.125+0000 7fbcf37ff700 1 -- 172.21.15.72:0/1107343644 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcec14d7c0 con 0x7fbcec0bd030 2023-07-27T20:31:06.116 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.125+0000 7fbce1ffb700 1 -- 172.21.15.72:0/1107343644 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbce8011cb0 con 0x7fbcec0bd030 2023-07-27T20:31:06.117 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.125+0000 7fbce1ffb700 1 -- 172.21.15.72:0/1107343644 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fbce801ad90 con 0x7fbcec0bd030 2023-07-27T20:31:06.117 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.126+0000 7fbcf37ff700 1 -- 172.21.15.72:0/1107343644 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcec149830 con 0x7fbcec0bd030 2023-07-27T20:31:06.117 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.128+0000 7fbce1ffb700 1 -- 172.21.15.72:0/1107343644 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fbce8032060 con 0x7fbcec0bd030 2023-07-27T20:31:06.187 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.200+0000 7fbcf37ff700 1 -- 172.21.15.72:0/1107343644 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbcec1491f0 con 0x7fbcec0bd030 2023-07-27T20:31:06.188 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.200+0000 7fbce1ffb700 1 -- 172.21.15.72:0/1107343644 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fbcec1491f0 con 0x7fbcec0bd030 2023-07-27T20:31:06.188 INFO:teuthology.misc.health.smithi072.stdout: 2023-07-27T20:31:06.188 INFO:teuthology.misc.health.smithi072.stdout:{"epoch":10,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:31:04.712970+0000","last_up_change":"0.000000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:31:06.189 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.201+0000 7fbcf37ff700 1 -- 172.21.15.72:0/1107343644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcec0bd030 msgr2=0x7fbcec151e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:06.189 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.201+0000 7fbcf37ff700 1 --2- 172.21.15.72:0/1107343644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcec0bd030 0x7fbcec151e90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbce80090b0 tx=0x7fbce8004750 comp rx=0 tx=0).stop 2023-07-27T20:31:06.189 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.201+0000 7fbcf37ff700 1 -- 172.21.15.72:0/1107343644 shutdown_connections 2023-07-27T20:31:06.190 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.201+0000 7fbcf37ff700 1 --2- 172.21.15.72:0/1107343644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbcec151710 0x7fbcec149b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:06.190 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.201+0000 7fbcf37ff700 1 --2- 172.21.15.72:0/1107343644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcec0bd030 0x7fbcec151e90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:06.190 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.201+0000 7fbcf37ff700 1 --2- 172.21.15.72:0/1107343644 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbcec0c78a0 0x7fbcec1eaea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:06.190 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.201+0000 7fbcf37ff700 1 -- 172.21.15.72:0/1107343644 >> 172.21.15.72:0/1107343644 conn(0x7fbcec071aa0 msgr2=0x7fbcec14dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:06.190 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.201+0000 7fbcf37ff700 1 -- 172.21.15.72:0/1107343644 shutdown_connections 2023-07-27T20:31:06.190 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:06.202+0000 7fbcf37ff700 1 -- 172.21.15.72:0/1107343644 wait complete. 2023-07-27T20:31:06.203 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-27T20:31:06.635 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-27T20:31:06.647+0000 7f6c1e6ad200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-27T20:31:06.641 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-07-27T20:31:06.652+0000 7f2b0af6a200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-27T20:31:07.018 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-27T20:31:07.031+0000 7f6c1e6ad200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-27T20:31:07.026 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-07-27T20:31:07.038+0000 7f2b0af6a200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-27T20:31:07.200 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-27T20:31:07.213+0000 7f6c1e6ad200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-27T20:31:07.208 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-07-27T20:31:07.220+0000 7f2b0af6a200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-27T20:31:07.640 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-27T20:31:07.652+0000 7f6c1e6ad200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-27T20:31:07.649 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-07-27T20:31:07.661+0000 7f2b0af6a200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-27T20:31:07.827 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-27T20:31:07.839+0000 7f6c1e6ad200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-27T20:31:07.835 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-07-27T20:31:07.847+0000 7f2b0af6a200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-27T20:31:08.033 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-27T20:31:08.046+0000 7f6c1e6ad200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-27T20:31:08.055 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-07-27T20:31:08.066+0000 7f2b0af6a200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-27T20:31:08.492 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-07-27T20:31:08.504+0000 7f2b0af6a200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-27T20:31:08.493 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-27T20:31:08.505+0000 7f6c1e6ad200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-27T20:31:08.992 INFO:tasks.ceph.osd.4.smithi173.stderr:2023-07-27T20:31:09.004+0000 7f98b4969640 -1 osd.4 0 log_to_monitors true 2023-07-27T20:31:09.033 INFO:tasks.ceph.osd.3.smithi072.stderr:2023-07-27T20:31:09.045+0000 7f824ff60640 -1 osd.3 0 log_to_monitors true 2023-07-27T20:31:09.037 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-07-27T20:31:09.050+0000 7f53455f3640 -1 osd.1 0 log_to_monitors true 2023-07-27T20:31:09.048 INFO:tasks.ceph.osd.6.smithi173.stderr:2023-07-27T20:31:09.059+0000 7f64cedab640 -1 osd.6 0 log_to_monitors true 2023-07-27T20:31:09.061 INFO:tasks.ceph.osd.0.smithi072.stderr:2023-07-27T20:31:09.074+0000 7f08fd5df640 -1 osd.0 0 log_to_monitors true 2023-07-27T20:31:09.246 INFO:tasks.ceph.osd.5.smithi173.stderr:2023-07-27T20:31:09.258+0000 7f966b3ae640 -1 osd.5 0 log_to_monitors true 2023-07-27T20:31:09.287 INFO:tasks.ceph.osd.2.smithi072.stderr:2023-07-27T20:31:09.300+0000 7f459c7aa640 -1 osd.2 0 log_to_monitors true 2023-07-27T20:31:09.336 INFO:tasks.ceph.osd.7.smithi173.stderr:2023-07-27T20:31:09.347+0000 7fcdb745c640 -1 osd.7 0 log_to_monitors true 2023-07-27T20:31:09.513 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-07-27T20:31:09.524+0000 7f2ac47fa700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-07-27T20:31:09.513 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-07-27T20:31:09.525+0000 7f2ac47fa700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-07-27T20:31:12.702 INFO:tasks.ceph.osd.6.smithi173.stderr:2023-07-27T20:31:12.710+0000 7f64bdbf7700 -1 osd.6 0 waiting for initial osdmap 2023-07-27T20:31:12.704 INFO:tasks.ceph.osd.4.smithi173.stderr:2023-07-27T20:31:12.714+0000 7f98a37f7700 -1 osd.4 0 waiting for initial osdmap 2023-07-27T20:31:12.720 INFO:tasks.ceph.osd.6.smithi173.stderr:2023-07-27T20:31:12.731+0000 7f64b53fa700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-27T20:31:12.723 INFO:tasks.ceph.osd.4.smithi173.stderr:2023-07-27T20:31:12.735+0000 7f989affa700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-27T20:31:12.736 INFO:tasks.ceph.osd.2.smithi072.stderr:2023-07-27T20:31:12.746+0000 7f458b5f7700 -1 osd.2 0 waiting for initial osdmap 2023-07-27T20:31:12.745 INFO:tasks.ceph.osd.0.smithi072.stderr:2023-07-27T20:31:12.755+0000 7f08ec3f7700 -1 osd.0 0 waiting for initial osdmap 2023-07-27T20:31:12.754 INFO:tasks.ceph.osd.2.smithi072.stderr:2023-07-27T20:31:12.766+0000 7f4582dfa700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-27T20:31:12.762 INFO:tasks.ceph.osd.7.smithi173.stderr:2023-07-27T20:31:12.774+0000 7fcda63f7700 -1 osd.7 0 waiting for initial osdmap 2023-07-27T20:31:12.764 INFO:tasks.ceph.osd.5.smithi173.stderr:2023-07-27T20:31:12.775+0000 7f965a1f7700 -1 osd.5 0 waiting for initial osdmap 2023-07-27T20:31:12.764 INFO:tasks.ceph.osd.0.smithi072.stderr:2023-07-27T20:31:12.775+0000 7f08e3bfa700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-27T20:31:12.778 INFO:tasks.ceph.osd.3.smithi072.stderr:2023-07-27T20:31:12.789+0000 7f823edf7700 -1 osd.3 0 waiting for initial osdmap 2023-07-27T20:31:12.783 INFO:tasks.ceph.osd.5.smithi173.stderr:2023-07-27T20:31:12.795+0000 7f96519fa700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-27T20:31:12.784 INFO:tasks.ceph.osd.7.smithi173.stderr:2023-07-27T20:31:12.795+0000 7fcd9dbfa700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-27T20:31:12.793 INFO:tasks.ceph.osd.3.smithi072.stderr:2023-07-27T20:31:12.805+0000 7f82365fa700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-27T20:31:12.796 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-07-27T20:31:12.808+0000 7f53343f7700 -1 osd.1 0 waiting for initial osdmap 2023-07-27T20:31:12.808 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-07-27T20:31:12.820+0000 7f532bbfa700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-27T20:31:13.010 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-27T20:31:13.180 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.192+0000 7f63f09ff700 1 Processor -- start 2023-07-27T20:31:13.181 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.192+0000 7f63f09ff700 1 -- start start 2023-07-27T20:31:13.184 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.194+0000 7f63f09ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f63ec151710 0x7f63ec0c4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:13.184 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.194+0000 7f63f09ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63ec0c78a0 0x7f63ec154190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:13.185 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.194+0000 7f63f09ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63ec158020 con 0x7f63ec0bd030 2023-07-27T20:31:13.185 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.194+0000 7f63f09ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63ec151af0 con 0x7f63ec151710 2023-07-27T20:31:13.185 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.194+0000 7f63f09ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec0ca450 con 0x7f63ec0c78a0 2023-07-27T20:31:13.185 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.194+0000 7f63ea59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f63ec151710 0x7f63ec0c4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:13.186 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.194+0000 7f63ea59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f63ec151710 0x7f63ec0c4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58878/0 (socket says 172.21.15.72:58878) 2023-07-27T20:31:13.186 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.194+0000 7f63ea59c700 1 -- 172.21.15.72:0/2100266592 learned_addr learned my addr 172.21.15.72:0/2100266592 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:13.186 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.194+0000 7f63ea59c700 1 -- 172.21.15.72:0/2100266592 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63ec0c78a0 msgr2=0x7f63ec154190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:13.187 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.194+0000 7f63ea59c700 1 --2- 172.21.15.72:0/2100266592 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63ec0c78a0 0x7f63ec154190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:13.187 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.194+0000 7f63ea59c700 1 -- 172.21.15.72:0/2100266592 >> v1:172.21.15.173:6789/0 conn(0x7f63ec0bd030 legacy=0x7f63ec1546d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:13.187 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.194+0000 7f63ea59c700 1 -- 172.21.15.72:0/2100266592 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ec158550 con 0x7f63ec151710 2023-07-27T20:31:13.187 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.194+0000 7f63ea59c700 1 --2- 172.21.15.72:0/2100266592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63ec151710 0x7f63ec0c4320 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0098f0 tx=0x7f63dc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca44ba3fa3587af server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:13.188 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.195+0000 7f63e959a700 1 -- 172.21.15.72:0/2100266592 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63dc004230 con 0x7f63ec151710 2023-07-27T20:31:13.188 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.195+0000 7f63e959a700 1 -- 172.21.15.72:0/2100266592 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63dc004390 con 0x7f63ec151710 2023-07-27T20:31:13.188 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.195+0000 7f63e959a700 1 -- 172.21.15.72:0/2100266592 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63dc0036a0 con 0x7f63ec151710 2023-07-27T20:31:13.188 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.195+0000 7f63f09ff700 1 -- 172.21.15.72:0/2100266592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63ec151710 msgr2=0x7f63ec0c4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:13.189 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.195+0000 7f63f09ff700 1 --2- 172.21.15.72:0/2100266592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63ec151710 0x7f63ec0c4320 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0098f0 tx=0x7f63dc009c00 comp rx=0 tx=0).stop 2023-07-27T20:31:13.189 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.195+0000 7f63f09ff700 1 -- 172.21.15.72:0/2100266592 shutdown_connections 2023-07-27T20:31:13.189 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.195+0000 7f63f09ff700 1 --2- 172.21.15.72:0/2100266592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63ec151710 0x7f63ec0c4320 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:13.190 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.195+0000 7f63f09ff700 1 --2- 172.21.15.72:0/2100266592 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63ec0c78a0 0x7f63ec154190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:13.190 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.195+0000 7f63f09ff700 1 -- 172.21.15.72:0/2100266592 >> 172.21.15.72:0/2100266592 conn(0x7f63ec071aa0 msgr2=0x7f63ec071eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:13.190 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.195+0000 7f63f09ff700 1 -- 172.21.15.72:0/2100266592 shutdown_connections 2023-07-27T20:31:13.190 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.195+0000 7f63f09ff700 1 -- 172.21.15.72:0/2100266592 wait complete. 2023-07-27T20:31:13.192 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.197+0000 7f63f09ff700 1 Processor -- start 2023-07-27T20:31:13.193 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.197+0000 7f63f09ff700 1 -- start start 2023-07-27T20:31:13.193 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.198+0000 7f63f09ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63ec0bd030 0x7f63ec1e9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:13.193 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.198+0000 7f63f09ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63ec0c78a0 0x7f63ec0aa5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:13.193 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.198+0000 7f63f09ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63ec151710 0x7f63ec1eda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:13.193 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.198+0000 7f63f09ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec1ed2b0 con 0x7f63ec0bd030 2023-07-27T20:31:13.193 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.198+0000 7f63f09ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec152f70 con 0x7f63ec151710 2023-07-27T20:31:13.193 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.198+0000 7f63f09ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec153250 con 0x7f63ec0c78a0 2023-07-27T20:31:13.194 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.198+0000 7f63ea59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63ec0bd030 0x7f63ec1e9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:13.194 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.198+0000 7f63ea59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63ec0bd030 0x7f63ec1e9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58888/0 (socket says 172.21.15.72:58888) 2023-07-27T20:31:13.194 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.198+0000 7f63ea59c700 1 -- 172.21.15.72:0/1357136344 learned_addr learned my addr 172.21.15.72:0/1357136344 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:13.194 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.198+0000 7f63ea59c700 1 -- 172.21.15.72:0/1357136344 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63ec0c78a0 msgr2=0x7f63ec0aa5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:13.194 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.198+0000 7f63ea59c700 1 --2- 172.21.15.72:0/1357136344 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63ec0c78a0 0x7f63ec0aa5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:13.194 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.198+0000 7f63ea59c700 1 -- 172.21.15.72:0/1357136344 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63ec151710 msgr2=0x7f63ec1eda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:13.194 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.198+0000 7f63ea59c700 1 --2- 172.21.15.72:0/1357136344 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63ec151710 0x7f63ec1eda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:13.194 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.198+0000 7f63ea59c700 1 -- 172.21.15.72:0/1357136344 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63dc009550 con 0x7f63ec0bd030 2023-07-27T20:31:13.195 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.199+0000 7f63ea59c700 1 --2- 172.21.15.72:0/1357136344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63ec0bd030 0x7f63ec1e9d40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f63ec0c7520 tx=0x7f63dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:13.195 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.199+0000 7f63daffd700 1 -- 172.21.15.72:0/1357136344 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63dc00b860 con 0x7f63ec0bd030 2023-07-27T20:31:13.195 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.199+0000 7f63daffd700 1 -- 172.21.15.72:0/1357136344 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63dc00b9e0 con 0x7f63ec0bd030 2023-07-27T20:31:13.195 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.199+0000 7f63f09ff700 1 -- 172.21.15.72:0/1357136344 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63ec153530 con 0x7f63ec0bd030 2023-07-27T20:31:13.195 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.199+0000 7f63daffd700 1 -- 172.21.15.72:0/1357136344 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63dc00bd90 con 0x7f63ec0bd030 2023-07-27T20:31:13.195 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.199+0000 7f63f09ff700 1 -- 172.21.15.72:0/1357136344 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63ec0aaaf0 con 0x7f63ec0bd030 2023-07-27T20:31:13.195 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.200+0000 7f63f09ff700 1 -- 172.21.15.72:0/1357136344 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63ec0742a0 con 0x7f63ec0bd030 2023-07-27T20:31:13.196 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.201+0000 7f63daffd700 1 -- 172.21.15.72:0/1357136344 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f63dc01b440 con 0x7f63ec0bd030 2023-07-27T20:31:13.196 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.202+0000 7f63daffd700 1 --2- 172.21.15.72:0/1357136344 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f63cc06ac50 0x7f63cc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:13.196 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.202+0000 7f63daffd700 1 -- 172.21.15.72:0/1357136344 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f63dc089bc0 con 0x7f63ec0bd030 2023-07-27T20:31:13.196 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.202+0000 7f63e9d9b700 1 --2- 172.21.15.72:0/1357136344 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f63cc06ac50 0x7f63cc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:13.196 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.203+0000 7f63e9d9b700 1 --2- 172.21.15.72:0/1357136344 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f63cc06ac50 0x7f63cc06d110 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f63ec1ee370 tx=0x7f63e0006d20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:13.197 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.206+0000 7f63daffd700 1 -- 172.21.15.72:0/1357136344 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f63dc055c30 con 0x7f63ec0bd030 2023-07-27T20:31:13.391 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.402+0000 7f63f09ff700 1 -- 172.21.15.72:0/1357136344 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63ec1ed740 con 0x7f63ec0bd030 2023-07-27T20:31:13.392 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.403+0000 7f63daffd700 1 -- 172.21.15.72:0/1357136344 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f63ec1ed740 con 0x7f63ec0bd030 2023-07-27T20:31:13.392 INFO:teuthology.misc.health.smithi072.stdout: 2023-07-27T20:31:13.392 INFO:teuthology.misc.health.smithi072.stdout:{"epoch":12,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:31:10.572847+0000","last_up_change":"0.000000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:31:13.393 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.405+0000 7f63f09ff700 1 -- 172.21.15.72:0/1357136344 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f63cc06ac50 msgr2=0x7f63cc06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:13.394 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.405+0000 7f63f09ff700 1 --2- 172.21.15.72:0/1357136344 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f63cc06ac50 0x7f63cc06d110 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f63ec1ee370 tx=0x7f63e0006d20 comp rx=0 tx=0).stop 2023-07-27T20:31:13.394 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.405+0000 7f63f09ff700 1 -- 172.21.15.72:0/1357136344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63ec0bd030 msgr2=0x7f63ec1e9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:13.394 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.405+0000 7f63f09ff700 1 --2- 172.21.15.72:0/1357136344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63ec0bd030 0x7f63ec1e9d40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f63ec0c7520 tx=0x7f63dc004750 comp rx=0 tx=0).stop 2023-07-27T20:31:13.394 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.405+0000 7f63f09ff700 1 -- 172.21.15.72:0/1357136344 shutdown_connections 2023-07-27T20:31:13.394 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.405+0000 7f63f09ff700 1 --2- 172.21.15.72:0/1357136344 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63ec151710 0x7f63ec1eda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:13.395 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.405+0000 7f63f09ff700 1 --2- 172.21.15.72:0/1357136344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63ec0bd030 0x7f63ec1e9d40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:13.395 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.405+0000 7f63f09ff700 1 --2- 172.21.15.72:0/1357136344 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f63cc06ac50 0x7f63cc06d110 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:13.395 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.405+0000 7f63f09ff700 1 --2- 172.21.15.72:0/1357136344 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63ec0c78a0 0x7f63ec0aa5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:13.395 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.405+0000 7f63f09ff700 1 -- 172.21.15.72:0/1357136344 >> 172.21.15.72:0/1357136344 conn(0x7f63ec071aa0 msgr2=0x7f63ec154190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:13.395 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.405+0000 7f63f09ff700 1 -- 172.21.15.72:0/1357136344 shutdown_connections 2023-07-27T20:31:13.395 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:13.405+0000 7f63f09ff700 1 -- 172.21.15.72:0/1357136344 wait complete. 2023-07-27T20:31:13.409 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-27T20:31:20.216 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-27T20:31:20.397 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.408+0000 7fb2f95ff700 1 Processor -- start 2023-07-27T20:31:20.397 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.409+0000 7fb2f95ff700 1 -- start start 2023-07-27T20:31:20.398 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.410+0000 7fb2f95ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb2f4151710 0x7fb2f40c4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:20.398 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.410+0000 7fb2f95ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2f4158020 con 0x7fb2f40c78a0 2023-07-27T20:31:20.399 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.410+0000 7fb2f95ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2f40ca450 con 0x7fb2f40bd030 2023-07-27T20:31:20.399 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.410+0000 7fb2f95ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2f4151af0 con 0x7fb2f4151710 2023-07-27T20:31:20.399 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.410+0000 7fb2ebfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb2f40c78a0 0x7fb2f4154190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39700/0 (socket says 172.21.15.72:39700) 2023-07-27T20:31:20.399 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.410+0000 7fb2ebfff700 1 -- 172.21.15.72:0/2308196666 learned_addr learned my addr 172.21.15.72:0/2308196666 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:20.399 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.410+0000 7fb2f2ffd700 1 --2- 172.21.15.72:0/2308196666 >> v2:172.21.15.173:3300/0 conn(0x7fb2f4151710 0x7fb2f40c4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:20.401 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.410+0000 7fb2f27fc700 1 -- 172.21.15.72:0/2308196666 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3146701308 0 0) 0x7fb2f4158020 con 0x7fb2f40c78a0 2023-07-27T20:31:20.401 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.410+0000 7fb2f27fc700 1 -- 172.21.15.72:0/2308196666 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2e00035b0 con 0x7fb2f40c78a0 2023-07-27T20:31:20.401 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.411+0000 7fb2f27fc700 1 -- 172.21.15.72:0/2308196666 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2392929574 0 0) 0x7fb2f40ca450 con 0x7fb2f40bd030 2023-07-27T20:31:20.401 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.411+0000 7fb2f27fc700 1 -- 172.21.15.72:0/2308196666 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2f4158020 con 0x7fb2f40bd030 2023-07-27T20:31:20.402 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.411+0000 7fb2f2ffd700 1 -- 172.21.15.72:0/2308196666 >> v1:172.21.15.173:6789/0 conn(0x7fb2f40bd030 legacy=0x7fb2f41548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:20.402 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.411+0000 7fb2f2ffd700 1 -- 172.21.15.72:0/2308196666 >> v1:172.21.15.72:6789/0 conn(0x7fb2f40c78a0 legacy=0x7fb2f4154190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:20.402 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.411+0000 7fb2f2ffd700 1 -- 172.21.15.72:0/2308196666 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f4158550 con 0x7fb2f4151710 2023-07-27T20:31:20.402 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.411+0000 7fb2f2ffd700 1 --2- 172.21.15.72:0/2308196666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2f4151710 0x7fb2f40c4320 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4009840 tx=0x7fb2e4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be6ee8224cdb9200 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:20.402 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.411+0000 7fb2f27fc700 1 -- 172.21.15.72:0/2308196666 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e4011830 con 0x7fb2f4151710 2023-07-27T20:31:20.402 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.411+0000 7fb2f27fc700 1 -- 172.21.15.72:0/2308196666 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e4011990 con 0x7fb2f4151710 2023-07-27T20:31:20.402 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.411+0000 7fb2f27fc700 1 -- 172.21.15.72:0/2308196666 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e4011d00 con 0x7fb2f4151710 2023-07-27T20:31:20.403 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.412+0000 7fb2f95ff700 1 -- 172.21.15.72:0/2308196666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2f4151710 msgr2=0x7fb2f40c4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:20.403 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.412+0000 7fb2f95ff700 1 --2- 172.21.15.72:0/2308196666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2f4151710 0x7fb2f40c4320 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4009840 tx=0x7fb2e4009b50 comp rx=0 tx=0).stop 2023-07-27T20:31:20.403 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.412+0000 7fb2f95ff700 1 -- 172.21.15.72:0/2308196666 shutdown_connections 2023-07-27T20:31:20.403 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.412+0000 7fb2f95ff700 1 --2- 172.21.15.72:0/2308196666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2f4151710 0x7fb2f40c4320 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:20.403 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.412+0000 7fb2f95ff700 1 -- 172.21.15.72:0/2308196666 >> 172.21.15.72:0/2308196666 conn(0x7fb2f4071aa0 msgr2=0x7fb2f4071eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:20.403 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.412+0000 7fb2f95ff700 1 -- 172.21.15.72:0/2308196666 shutdown_connections 2023-07-27T20:31:20.404 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.412+0000 7fb2f95ff700 1 -- 172.21.15.72:0/2308196666 wait complete. 2023-07-27T20:31:20.406 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.414+0000 7fb2f95ff700 1 Processor -- start 2023-07-27T20:31:20.406 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.414+0000 7fb2f95ff700 1 -- start start 2023-07-27T20:31:20.406 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.415+0000 7fb2f95ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2f40bd030 0x7fb2f414ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:20.406 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.415+0000 7fb2f95ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb2f40c78a0 0x7fb2f4156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:20.406 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.415+0000 7fb2f95ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2f4151710 0x7fb2f40c34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:20.407 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.415+0000 7fb2f95ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f40c0210 con 0x7fb2f40bd030 2023-07-27T20:31:20.407 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.415+0000 7fb2f95ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f40bcad0 con 0x7fb2f4151710 2023-07-27T20:31:20.407 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.415+0000 7fb2f95ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f40bcd20 con 0x7fb2f40c78a0 2023-07-27T20:31:20.407 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.415+0000 7fb2f2ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2f40bd030 0x7fb2f414ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:20.407 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.415+0000 7fb2f2ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2f40bd030 0x7fb2f414ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47698/0 (socket says 172.21.15.72:47698) 2023-07-27T20:31:20.408 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.415+0000 7fb2f2ffd700 1 -- 172.21.15.72:0/2032331883 learned_addr learned my addr 172.21.15.72:0/2032331883 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:20.408 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.415+0000 7fb2ebfff700 1 --2- 172.21.15.72:0/2032331883 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb2f40c78a0 0x7fb2f4156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:20.408 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.415+0000 7fb2f37fe700 1 --2- 172.21.15.72:0/2032331883 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2f4151710 0x7fb2f40c34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:20.408 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.415+0000 7fb2f2ffd700 1 -- 172.21.15.72:0/2032331883 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb2f40c78a0 msgr2=0x7fb2f4156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:20.408 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.415+0000 7fb2f2ffd700 1 --2- 172.21.15.72:0/2032331883 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb2f40c78a0 0x7fb2f4156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:20.408 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.415+0000 7fb2f2ffd700 1 -- 172.21.15.72:0/2032331883 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2f4151710 msgr2=0x7fb2f40c34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:20.408 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.415+0000 7fb2f2ffd700 1 --2- 172.21.15.72:0/2032331883 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2f4151710 0x7fb2f40c34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:20.409 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.415+0000 7fb2f2ffd700 1 -- 172.21.15.72:0/2032331883 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e40094a0 con 0x7fb2f40bd030 2023-07-27T20:31:20.409 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.415+0000 7fb2ebfff700 1 --2- 172.21.15.72:0/2032331883 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb2f40c78a0 0x7fb2f4156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:31:20.409 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.415+0000 7fb2f37fe700 1 --2- 172.21.15.72:0/2032331883 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2f4151710 0x7fb2f40c34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:31:20.409 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.416+0000 7fb2f2ffd700 1 --2- 172.21.15.72:0/2032331883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2f40bd030 0x7fb2f414ada0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4009b90 tx=0x7fb2e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:20.409 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.416+0000 7fb2eb7fe700 1 -- 172.21.15.72:0/2032331883 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e40045c0 con 0x7fb2f40bd030 2023-07-27T20:31:20.409 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.416+0000 7fb2eb7fe700 1 -- 172.21.15.72:0/2032331883 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e401e070 con 0x7fb2f40bd030 2023-07-27T20:31:20.409 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.416+0000 7fb2eb7fe700 1 -- 172.21.15.72:0/2032331883 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e40038e0 con 0x7fb2f40bd030 2023-07-27T20:31:20.409 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.416+0000 7fb2f95ff700 1 -- 172.21.15.72:0/2032331883 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f41e9ca0 con 0x7fb2f40bd030 2023-07-27T20:31:20.410 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.416+0000 7fb2f95ff700 1 -- 172.21.15.72:0/2032331883 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f41ea260 con 0x7fb2f40bd030 2023-07-27T20:31:20.410 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.417+0000 7fb2f95ff700 1 -- 172.21.15.72:0/2032331883 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f41ea5d0 con 0x7fb2f40bd030 2023-07-27T20:31:20.410 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.418+0000 7fb2eb7fe700 1 -- 172.21.15.72:0/2032331883 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb2e4003a40 con 0x7fb2f40bd030 2023-07-27T20:31:20.411 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.419+0000 7fb2eb7fe700 1 --2- 172.21.15.72:0/2032331883 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb2d406ace0 0x7fb2d406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:20.411 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.419+0000 7fb2eb7fe700 1 -- 172.21.15.72:0/2032331883 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb2e4020070 con 0x7fb2f40bd030 2023-07-27T20:31:20.411 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.419+0000 7fb2ebfff700 1 --2- 172.21.15.72:0/2032331883 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb2d406ace0 0x7fb2d406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:20.411 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.420+0000 7fb2ebfff700 1 --2- 172.21.15.72:0/2032331883 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb2d406ace0 0x7fb2d406d1a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb2f414dc00 tx=0x7fb2dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:20.412 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.424+0000 7fb2eb7fe700 1 -- 172.21.15.72:0/2032331883 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb2e4055890 con 0x7fb2f40bd030 2023-07-27T20:31:20.607 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.619+0000 7fb2f95ff700 1 -- 172.21.15.72:0/2032331883 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2f40c7570 con 0x7fb2f40bd030 2023-07-27T20:31:20.608 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.620+0000 7fb2eb7fe700 1 -- 172.21.15.72:0/2032331883 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12850 (secure 0 0 0) 0x7fb2e4058eb0 con 0x7fb2f40bd030 2023-07-27T20:31:20.609 INFO:teuthology.misc.health.smithi072.stdout: 2023-07-27T20:31:20.609 INFO:teuthology.misc.health.smithi072.stdout:{"epoch":16,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:31:16.804227+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:31:20.611 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.622+0000 7fb2f95ff700 1 -- 172.21.15.72:0/2032331883 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb2d406ace0 msgr2=0x7fb2d406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:20.612 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.622+0000 7fb2f95ff700 1 --2- 172.21.15.72:0/2032331883 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb2d406ace0 0x7fb2d406d1a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb2f414dc00 tx=0x7fb2dc009040 comp rx=0 tx=0).stop 2023-07-27T20:31:20.612 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.622+0000 7fb2f95ff700 1 -- 172.21.15.72:0/2032331883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2f40bd030 msgr2=0x7fb2f414ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:20.613 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.622+0000 7fb2f95ff700 1 --2- 172.21.15.72:0/2032331883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2f40bd030 0x7fb2f414ada0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4009b90 tx=0x7fb2e4004750 comp rx=0 tx=0).stop 2023-07-27T20:31:20.613 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.622+0000 7fb2f95ff700 1 -- 172.21.15.72:0/2032331883 shutdown_connections 2023-07-27T20:31:20.613 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.622+0000 7fb2f95ff700 1 --2- 172.21.15.72:0/2032331883 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2f4151710 0x7fb2f40c34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:20.614 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.622+0000 7fb2f95ff700 1 --2- 172.21.15.72:0/2032331883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2f40bd030 0x7fb2f414ada0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:20.614 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.622+0000 7fb2f95ff700 1 --2- 172.21.15.72:0/2032331883 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb2d406ace0 0x7fb2d406d1a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:20.614 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.622+0000 7fb2f95ff700 1 --2- 172.21.15.72:0/2032331883 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb2f40c78a0 0x7fb2f4156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:20.615 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.622+0000 7fb2f95ff700 1 -- 172.21.15.72:0/2032331883 >> 172.21.15.72:0/2032331883 conn(0x7fb2f4071aa0 msgr2=0x7fb2f40c8f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:20.615 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.622+0000 7fb2f95ff700 1 -- 172.21.15.72:0/2032331883 shutdown_connections 2023-07-27T20:31:20.615 INFO:teuthology.misc.health.smithi072.stderr:2023-07-27T20:31:20.623+0000 7fb2f95ff700 1 -- 172.21.15.72:0/2032331883 wait complete. 2023-07-27T20:31:20.626 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-07-27T20:31:20.627 INFO:tasks.ceph:Creating RBD pool 2023-07-27T20:31:20.627 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd pool create rbd 8 2023-07-27T20:31:20.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.828+0000 7f1a933ff700 1 Processor -- start 2023-07-27T20:31:20.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.828+0000 7f1a933ff700 1 -- start start 2023-07-27T20:31:20.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.829+0000 7f1a933ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1a8c14aab0 0x7f1a8c154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:20.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.829+0000 7f1a933ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1a8c0c7740 0x7f1a8c0c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:20.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.829+0000 7f1a933ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a8c0c7c50 con 0x7f1a8c0c4700 2023-07-27T20:31:20.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.829+0000 7f1a933ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a8c06bd40 con 0x7f1a8c0c7740 2023-07-27T20:31:20.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.829+0000 7f1a933ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a8c0c62f0 con 0x7f1a8c14aab0 2023-07-27T20:31:20.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.830+0000 7f1a9099a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1a8c0c7740 0x7f1a8c0c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:20.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.830+0000 7f1a9099a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1a8c0c7740 0x7f1a8c0c41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47712/0 (socket says 172.21.15.72:47712) 2023-07-27T20:31:20.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.830+0000 7f1a9099a700 1 -- 172.21.15.72:0/1522552321 learned_addr learned my addr 172.21.15.72:0/1522552321 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:20.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.830+0000 7f1a9099a700 1 -- 172.21.15.72:0/1522552321 >> v2:172.21.15.173:3300/0 conn(0x7f1a8c14aab0 msgr2=0x7f1a8c154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:20.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.830+0000 7f1a9119b700 1 --2- 172.21.15.72:0/1522552321 >> v2:172.21.15.173:3300/0 conn(0x7f1a8c14aab0 0x7f1a8c154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:20.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.830+0000 7f1a9099a700 1 --2- 172.21.15.72:0/1522552321 >> v2:172.21.15.173:3300/0 conn(0x7f1a8c14aab0 0x7f1a8c154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:20.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.830+0000 7f1a9099a700 1 -- 172.21.15.72:0/1522552321 >> v1:172.21.15.173:6789/0 conn(0x7f1a8c0c4700 legacy=0x7f1a8c06c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:20.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.830+0000 7f1a9099a700 1 -- 172.21.15.72:0/1522552321 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a8c155050 con 0x7f1a8c0c7740 2023-07-27T20:31:20.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.830+0000 7f1a9119b700 1 --2- 172.21.15.72:0/1522552321 >> v2:172.21.15.173:3300/0 conn(0x7f1a8c14aab0 0x7f1a8c154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:31:20.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.830+0000 7f1a9099a700 1 --2- 172.21.15.72:0/1522552321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a8c0c7740 0x7f1a8c0c41c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c06ad20 tx=0x7f1a7c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e50fe04ad660b221 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:20.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.831+0000 7f1a83fff700 1 -- 172.21.15.72:0/1522552321 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c004230 con 0x7f1a8c0c7740 2023-07-27T20:31:20.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.831+0000 7f1a83fff700 1 -- 172.21.15.72:0/1522552321 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7c004390 con 0x7f1a8c0c7740 2023-07-27T20:31:20.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.831+0000 7f1a83fff700 1 -- 172.21.15.72:0/1522552321 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c0036a0 con 0x7f1a8c0c7740 2023-07-27T20:31:20.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.831+0000 7f1a933ff700 1 -- 172.21.15.72:0/1522552321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a8c0c7740 msgr2=0x7f1a8c0c41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:20.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.831+0000 7f1a933ff700 1 --2- 172.21.15.72:0/1522552321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a8c0c7740 0x7f1a8c0c41c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c06ad20 tx=0x7f1a7c009bd0 comp rx=0 tx=0).stop 2023-07-27T20:31:20.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.831+0000 7f1a933ff700 1 -- 172.21.15.72:0/1522552321 shutdown_connections 2023-07-27T20:31:20.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.831+0000 7f1a933ff700 1 --2- 172.21.15.72:0/1522552321 >> v2:172.21.15.173:3300/0 conn(0x7f1a8c14aab0 0x7f1a8c154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:20.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.831+0000 7f1a933ff700 1 --2- 172.21.15.72:0/1522552321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a8c0c7740 0x7f1a8c0c41c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:20.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.831+0000 7f1a933ff700 1 -- 172.21.15.72:0/1522552321 >> 172.21.15.72:0/1522552321 conn(0x7f1a8c0ab3f0 msgr2=0x7f1a8c0ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:20.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.831+0000 7f1a933ff700 1 -- 172.21.15.72:0/1522552321 shutdown_connections 2023-07-27T20:31:20.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.831+0000 7f1a933ff700 1 -- 172.21.15.72:0/1522552321 wait complete. 2023-07-27T20:31:20.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.833+0000 7f1a933ff700 1 Processor -- start 2023-07-27T20:31:20.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.833+0000 7f1a933ff700 1 -- start start 2023-07-27T20:31:20.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.834+0000 7f1a933ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a8c0c4700 0x7f1a8c0ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:20.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.834+0000 7f1a933ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a8c0c7740 0x7f1a8c1e9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:20.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.834+0000 7f1a933ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a8c14aab0 0x7f1a8c0ac750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:20.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.834+0000 7f1a933ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8c0ad1f0 con 0x7f1a8c14aab0 2023-07-27T20:31:20.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.834+0000 7f1a933ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8c0af4d0 con 0x7f1a8c0c7740 2023-07-27T20:31:20.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.834+0000 7f1a933ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8c0c3840 con 0x7f1a8c0c4700 2023-07-27T20:31:20.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.834+0000 7f1a9199c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a8c14aab0 0x7f1a8c0ac750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:20.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.834+0000 7f1a9199c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a8c14aab0 0x7f1a8c0ac750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47716/0 (socket says 172.21.15.72:47716) 2023-07-27T20:31:20.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.834+0000 7f1a9199c700 1 -- 172.21.15.72:0/3198733052 learned_addr learned my addr 172.21.15.72:0/3198733052 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:20.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.834+0000 7f1a9199c700 1 -- 172.21.15.72:0/3198733052 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a8c0c4700 msgr2=0x7f1a8c0ae2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:20.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.834+0000 7f1a9199c700 1 --2- 172.21.15.72:0/3198733052 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a8c0c4700 0x7f1a8c0ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:20.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.835+0000 7f1a9199c700 1 -- 172.21.15.72:0/3198733052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a8c0c7740 msgr2=0x7f1a8c1e9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:20.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.835+0000 7f1a9099a700 1 --2- 172.21.15.72:0/3198733052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a8c0c7740 0x7f1a8c1e9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:20.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.835+0000 7f1a9199c700 1 --2- 172.21.15.72:0/3198733052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a8c0c7740 0x7f1a8c1e9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:20.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.835+0000 7f1a9199c700 1 -- 172.21.15.72:0/3198733052 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a7c009550 con 0x7f1a8c14aab0 2023-07-27T20:31:20.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.835+0000 7f1a9099a700 1 --2- 172.21.15.72:0/3198733052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a8c0c7740 0x7f1a8c1e9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:31:20.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.835+0000 7f1a9199c700 1 --2- 172.21.15.72:0/3198733052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a8c14aab0 0x7f1a8c0ac750 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1a8400cc10 tx=0x7f1a8400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:20.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.835+0000 7f1a81ffb700 1 -- 172.21.15.72:0/3198733052 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8400abb0 con 0x7f1a8c14aab0 2023-07-27T20:31:20.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.835+0000 7f1a81ffb700 1 -- 172.21.15.72:0/3198733052 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8400ad10 con 0x7f1a8c14aab0 2023-07-27T20:31:20.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.835+0000 7f1a933ff700 1 -- 172.21.15.72:0/3198733052 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a8c0ae8c0 con 0x7f1a8c14aab0 2023-07-27T20:31:20.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.835+0000 7f1a81ffb700 1 -- 172.21.15.72:0/3198733052 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a84012660 con 0x7f1a8c14aab0 2023-07-27T20:31:20.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.835+0000 7f1a933ff700 1 -- 172.21.15.72:0/3198733052 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a8c0aee80 con 0x7f1a8c14aab0 2023-07-27T20:31:20.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.836+0000 7f1a933ff700 1 -- 172.21.15.72:0/3198733052 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a8c0c3a00 con 0x7f1a8c14aab0 2023-07-27T20:31:20.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.837+0000 7f1a81ffb700 1 -- 172.21.15.72:0/3198733052 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1a840127c0 con 0x7f1a8c14aab0 2023-07-27T20:31:20.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.838+0000 7f1a81ffb700 1 --2- 172.21.15.72:0/3198733052 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1a7006ace0 0x7f1a7006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:20.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.838+0000 7f1a81ffb700 1 -- 172.21.15.72:0/3198733052 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1a84089730 con 0x7f1a8c14aab0 2023-07-27T20:31:20.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.838+0000 7f1a9119b700 1 --2- 172.21.15.72:0/3198733052 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1a7006ace0 0x7f1a7006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:20.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.839+0000 7f1a9119b700 1 --2- 172.21.15.72:0/3198733052 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1a7006ace0 0x7f1a7006d1a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1a8800a8b0 tx=0x7f1a88008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:20.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:20.842+0000 7f1a81ffb700 1 -- 172.21.15.72:0/3198733052 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1a84054c80 con 0x7f1a8c14aab0 2023-07-27T20:31:20.972 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:31:20.977 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:31:21.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:21.036+0000 7f1a933ff700 1 -- 172.21.15.72:0/3198733052 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f1a8c0af640 con 0x7f1a8c14aab0 2023-07-27T20:31:21.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:21.831+0000 7f1a81ffb700 1 -- 172.21.15.72:0/3198733052 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7f1a840160a0 con 0x7f1a8c14aab0 2023-07-27T20:31:21.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:21.834+0000 7f1a933ff700 1 -- 172.21.15.72:0/3198733052 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1a7006ace0 msgr2=0x7f1a7006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:21.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:21.834+0000 7f1a933ff700 1 --2- 172.21.15.72:0/3198733052 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1a7006ace0 0x7f1a7006d1a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1a8800a8b0 tx=0x7f1a88008040 comp rx=0 tx=0).stop 2023-07-27T20:31:21.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:21.834+0000 7f1a933ff700 1 -- 172.21.15.72:0/3198733052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a8c14aab0 msgr2=0x7f1a8c0ac750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:21.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:21.834+0000 7f1a933ff700 1 --2- 172.21.15.72:0/3198733052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a8c14aab0 0x7f1a8c0ac750 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1a8400cc10 tx=0x7f1a8400a060 comp rx=0 tx=0).stop 2023-07-27T20:31:21.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:21.834+0000 7f1a933ff700 1 -- 172.21.15.72:0/3198733052 shutdown_connections 2023-07-27T20:31:21.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:21.834+0000 7f1a933ff700 1 --2- 172.21.15.72:0/3198733052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a8c14aab0 0x7f1a8c0ac750 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:21.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:21.834+0000 7f1a933ff700 1 --2- 172.21.15.72:0/3198733052 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1a7006ace0 0x7f1a7006d1a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:21.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:21.834+0000 7f1a933ff700 1 --2- 172.21.15.72:0/3198733052 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a8c0c4700 0x7f1a8c0ae2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:21.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:21.834+0000 7f1a933ff700 1 --2- 172.21.15.72:0/3198733052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a8c0c7740 0x7f1a8c1e9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:21.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:21.834+0000 7f1a933ff700 1 -- 172.21.15.72:0/3198733052 >> 172.21.15.72:0/3198733052 conn(0x7f1a8c0ab3f0 msgr2=0x7f1a8c152420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:21.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:21.835+0000 7f1a933ff700 1 -- 172.21.15.72:0/3198733052 shutdown_connections 2023-07-27T20:31:21.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:21.835+0000 7f1a933ff700 1 -- 172.21.15.72:0/3198733052 wait complete. 2023-07-27T20:31:21.826 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'rbd' created 2023-07-27T20:31:21.844 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-07-27T20:31:22.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.051+0000 7fa894dff700 1 Processor -- start 2023-07-27T20:31:22.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.051+0000 7fa894dff700 1 -- start start 2023-07-27T20:31:22.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.052+0000 7fa894dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa8901512c0 0x7fa8900c0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:22.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.052+0000 7fa894dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa89006a190 0x7fa89006ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:22.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.052+0000 7fa894dff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8900c0970 con 0x7fa89014a640 2023-07-27T20:31:22.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.052+0000 7fa894dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8900bfd60 con 0x7fa8901512c0 2023-07-27T20:31:22.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.052+0000 7fa894dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8900c0040 con 0x7fa89006a190 2023-07-27T20:31:22.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.053+0000 7fa88e59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa8901512c0 0x7fa8900c0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:22.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.053+0000 7fa88e59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa8901512c0 0x7fa8900c0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47732/0 (socket says 172.21.15.72:47732) 2023-07-27T20:31:22.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.053+0000 7fa88e59c700 1 -- 172.21.15.72:0/772660621 learned_addr learned my addr 172.21.15.72:0/772660621 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:22.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.053+0000 7fa88ed9d700 1 --2- 172.21.15.72:0/772660621 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa89006a190 0x7fa89006ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:22.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.053+0000 7fa88e59c700 1 -- 172.21.15.72:0/772660621 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa89006a190 msgr2=0x7fa89006ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:22.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.053+0000 7fa88e59c700 1 --2- 172.21.15.72:0/772660621 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa89006a190 0x7fa89006ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:22.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.053+0000 7fa88e59c700 1 -- 172.21.15.72:0/772660621 >> v1:172.21.15.173:6789/0 conn(0x7fa89014a640 legacy=0x7fa8900c1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:22.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.053+0000 7fa88e59c700 1 -- 172.21.15.72:0/772660621 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8900c0320 con 0x7fa8901512c0 2023-07-27T20:31:22.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.053+0000 7fa88ed9d700 1 --2- 172.21.15.72:0/772660621 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa89006a190 0x7fa89006ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:31:22.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.053+0000 7fa88e59c700 1 --2- 172.21.15.72:0/772660621 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8901512c0 0x7fa8900c0e00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa880009e50 tx=0x7fa88000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa2f5073e7db594a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:22.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.053+0000 7fa88d59a700 1 -- 172.21.15.72:0/772660621 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88000e070 con 0x7fa8901512c0 2023-07-27T20:31:22.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.054+0000 7fa88d59a700 1 -- 172.21.15.72:0/772660621 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa880003a20 con 0x7fa8901512c0 2023-07-27T20:31:22.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.054+0000 7fa88d59a700 1 -- 172.21.15.72:0/772660621 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa880003dd0 con 0x7fa8901512c0 2023-07-27T20:31:22.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.054+0000 7fa894dff700 1 -- 172.21.15.72:0/772660621 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8901512c0 msgr2=0x7fa8900c0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:22.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.054+0000 7fa894dff700 1 --2- 172.21.15.72:0/772660621 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8901512c0 0x7fa8900c0e00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa880009e50 tx=0x7fa88000b330 comp rx=0 tx=0).stop 2023-07-27T20:31:22.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.054+0000 7fa894dff700 1 -- 172.21.15.72:0/772660621 shutdown_connections 2023-07-27T20:31:22.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.054+0000 7fa894dff700 1 --2- 172.21.15.72:0/772660621 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa89006a190 0x7fa89006ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:22.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.054+0000 7fa894dff700 1 --2- 172.21.15.72:0/772660621 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8901512c0 0x7fa8900c0e00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:22.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.054+0000 7fa894dff700 1 -- 172.21.15.72:0/772660621 >> 172.21.15.72:0/772660621 conn(0x7fa8900c53e0 msgr2=0x7fa8900c57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:22.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.054+0000 7fa894dff700 1 -- 172.21.15.72:0/772660621 shutdown_connections 2023-07-27T20:31:22.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.054+0000 7fa894dff700 1 -- 172.21.15.72:0/772660621 wait complete. 2023-07-27T20:31:22.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.056+0000 7fa894dff700 1 Processor -- start 2023-07-27T20:31:22.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.057+0000 7fa894dff700 1 -- start start 2023-07-27T20:31:22.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.058+0000 7fa894dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa89006a190 0x7fa8901494c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:22.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.058+0000 7fa894dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa89014a640 0x7fa8901443e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:22.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.058+0000 7fa894dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8901512c0 0x7fa890144920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:22.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.058+0000 7fa894dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8900aaff0 con 0x7fa8901512c0 2023-07-27T20:31:22.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.058+0000 7fa894dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa890153260 con 0x7fa89006a190 2023-07-27T20:31:22.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.058+0000 7fa894dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa890152910 con 0x7fa89014a640 2023-07-27T20:31:22.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.058+0000 7fa88ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8901512c0 0x7fa890144920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:22.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.058+0000 7fa88ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8901512c0 0x7fa890144920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47746/0 (socket says 172.21.15.72:47746) 2023-07-27T20:31:22.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.058+0000 7fa88ed9d700 1 -- 172.21.15.72:0/2076420865 learned_addr learned my addr 172.21.15.72:0/2076420865 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:22.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.058+0000 7fa88e59c700 1 --2- 172.21.15.72:0/2076420865 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa89006a190 0x7fa8901494c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:22.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.058+0000 7fa88dd9b700 1 --2- 172.21.15.72:0/2076420865 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa89014a640 0x7fa8901443e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:22.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.059+0000 7fa88ed9d700 1 -- 172.21.15.72:0/2076420865 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa89014a640 msgr2=0x7fa8901443e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:22.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.059+0000 7fa88ed9d700 1 --2- 172.21.15.72:0/2076420865 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa89014a640 0x7fa8901443e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:22.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.059+0000 7fa88ed9d700 1 -- 172.21.15.72:0/2076420865 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa89006a190 msgr2=0x7fa8901494c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:22.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.059+0000 7fa88ed9d700 1 --2- 172.21.15.72:0/2076420865 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa89006a190 0x7fa8901494c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:22.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.059+0000 7fa88ed9d700 1 -- 172.21.15.72:0/2076420865 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa880009b30 con 0x7fa8901512c0 2023-07-27T20:31:22.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.059+0000 7fa88ed9d700 1 --2- 172.21.15.72:0/2076420865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8901512c0 0x7fa890144920 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa88800c820 tx=0x7fa88800cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:22.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.059+0000 7fa87effd700 1 -- 172.21.15.72:0/2076420865 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa888011800 con 0x7fa8901512c0 2023-07-27T20:31:22.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.059+0000 7fa87effd700 1 -- 172.21.15.72:0/2076420865 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa888011980 con 0x7fa8901512c0 2023-07-27T20:31:22.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.059+0000 7fa87effd700 1 -- 172.21.15.72:0/2076420865 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa888011d30 con 0x7fa8901512c0 2023-07-27T20:31:22.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.059+0000 7fa894dff700 1 -- 172.21.15.72:0/2076420865 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa890152480 con 0x7fa8901512c0 2023-07-27T20:31:22.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.059+0000 7fa894dff700 1 -- 172.21.15.72:0/2076420865 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8900aad10 con 0x7fa8901512c0 2023-07-27T20:31:22.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.060+0000 7fa894dff700 1 -- 172.21.15.72:0/2076420865 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa89014aa80 con 0x7fa8901512c0 2023-07-27T20:31:22.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.061+0000 7fa87effd700 1 -- 172.21.15.72:0/2076420865 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa888022350 con 0x7fa8901512c0 2023-07-27T20:31:22.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.062+0000 7fa87effd700 1 --2- 172.21.15.72:0/2076420865 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa87006ace0 0x7fa87006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:22.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.062+0000 7fa87effd700 1 -- 172.21.15.72:0/2076420865 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5199+0+0 (secure 0 0 0) 0x7fa888089110 con 0x7fa8901512c0 2023-07-27T20:31:22.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.063+0000 7fa88e59c700 1 --2- 172.21.15.72:0/2076420865 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa87006ace0 0x7fa87006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:22.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.063+0000 7fa88e59c700 1 --2- 172.21.15.72:0/2076420865 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa87006ace0 0x7fa87006d1a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa880015040 tx=0x7fa880009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:22.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.067+0000 7fa87effd700 1 -- 172.21.15.72:0/2076420865 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa89014aa80 con 0x7fa8901512c0 2023-07-27T20:31:22.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.264+0000 7fa894dff700 1 -- 172.21.15.72:0/2076420865 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa89014aa80 con 0x7fa8901512c0 2023-07-27T20:31:22.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.837+0000 7fa87effd700 1 -- 172.21.15.72:0/2076420865 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7fa89014aa80 con 0x7fa8901512c0 2023-07-27T20:31:22.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.841+0000 7fa894dff700 1 -- 172.21.15.72:0/2076420865 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa87006ace0 msgr2=0x7fa87006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:22.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.841+0000 7fa894dff700 1 --2- 172.21.15.72:0/2076420865 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa87006ace0 0x7fa87006d1a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa880015040 tx=0x7fa880009000 comp rx=0 tx=0).stop 2023-07-27T20:31:22.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.841+0000 7fa894dff700 1 -- 172.21.15.72:0/2076420865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8901512c0 msgr2=0x7fa890144920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:22.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.841+0000 7fa894dff700 1 --2- 172.21.15.72:0/2076420865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8901512c0 0x7fa890144920 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa88800c820 tx=0x7fa88800cbe0 comp rx=0 tx=0).stop 2023-07-27T20:31:22.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.841+0000 7fa894dff700 1 -- 172.21.15.72:0/2076420865 shutdown_connections 2023-07-27T20:31:22.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.841+0000 7fa894dff700 1 --2- 172.21.15.72:0/2076420865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8901512c0 0x7fa890144920 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:22.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.841+0000 7fa894dff700 1 --2- 172.21.15.72:0/2076420865 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa89006a190 0x7fa8901494c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:22.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.841+0000 7fa894dff700 1 --2- 172.21.15.72:0/2076420865 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa87006ace0 0x7fa87006d1a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:22.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.841+0000 7fa894dff700 1 --2- 172.21.15.72:0/2076420865 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa89014a640 0x7fa8901443e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:22.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.841+0000 7fa894dff700 1 -- 172.21.15.72:0/2076420865 >> 172.21.15.72:0/2076420865 conn(0x7fa8900c53e0 msgr2=0x7fa8900c57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:22.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.841+0000 7fa894dff700 1 -- 172.21.15.72:0/2076420865 shutdown_connections 2023-07-27T20:31:22.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:22.842+0000 7fa894dff700 1 -- 172.21.15.72:0/2076420865 wait complete. 2023-07-27T20:31:22.832 INFO:teuthology.orchestra.run.smithi072.stderr:enabled application 'rbd' on pool 'rbd' 2023-07-27T20:31:22.852 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-07-27T20:31:22.853 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-27T20:31:22.853 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-27T20:31:22.858 INFO:tasks.ceph.mds.a:Started 2023-07-27T20:31:22.859 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-27T20:31:22.859 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-27T20:31:22.863 INFO:tasks.ceph.mds.c:Started 2023-07-27T20:31:22.864 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-27T20:31:22.864 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-27T20:31:22.869 INFO:tasks.ceph.mds.b:Started 2023-07-27T20:31:22.869 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-27T20:31:22.869 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-27T20:31:22.874 INFO:tasks.ceph.mds.d:Started 2023-07-27T20:31:22.875 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-07-27T20:31:22.875 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:31:23.011 INFO:tasks.ceph.mds.a.smithi072.stdout:starting mds.a at 2023-07-27T20:31:23.012 INFO:tasks.ceph.mds.c.smithi072.stdout:starting mds.c at 2023-07-27T20:31:23.017 INFO:tasks.ceph.mds.b.smithi173.stdout:starting mds.b at 2023-07-27T20:31:23.020 INFO:tasks.ceph.mds.d.smithi173.stdout:starting mds.d at 2023-07-27T20:31:23.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.098+0000 7f2f0edff700 1 Processor -- start 2023-07-27T20:31:23.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.098+0000 7f2f0edff700 1 -- start start 2023-07-27T20:31:23.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.099+0000 7f2f0edff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2f080c4400 0x7f2f080c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:23.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.099+0000 7f2f0edff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f0806b710 con 0x7f2f0806b150 2023-07-27T20:31:23.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.099+0000 7f2f0edff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f0806b9f0 con 0x7f2f081549f0 2023-07-27T20:31:23.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.099+0000 7f2f0edff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f081545d0 con 0x7f2f080c4400 2023-07-27T20:31:23.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.100+0000 7f2f07fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2f0806b150 0x7f2f080c4cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39720/0 (socket says 172.21.15.72:39720) 2023-07-27T20:31:23.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.100+0000 7f2f07fff700 1 -- 172.21.15.72:0/3301630860 learned_addr learned my addr 172.21.15.72:0/3301630860 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:23.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.100+0000 7f2f0cb9b700 1 --2- 172.21.15.72:0/3301630860 >> v2:172.21.15.173:3300/0 conn(0x7f2f080c4400 0x7f2f080c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:23.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.100+0000 7f2f077fe700 1 -- 172.21.15.72:0/3301630860 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3626369337 0 0) 0x7f2f0806b710 con 0x7f2f0806b150 2023-07-27T20:31:23.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.100+0000 7f2f077fe700 1 -- 172.21.15.72:0/3301630860 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ef80035b0 con 0x7f2f0806b150 2023-07-27T20:31:23.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.100+0000 7f2f0cb9b700 1 -- 172.21.15.72:0/3301630860 >> v1:172.21.15.173:6789/0 conn(0x7f2f081549f0 legacy=0x7f2f081514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:23.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.100+0000 7f2f0cb9b700 1 -- 172.21.15.72:0/3301630860 >> v1:172.21.15.72:6789/0 conn(0x7f2f0806b150 legacy=0x7f2f080c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:23.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.100+0000 7f2f0cb9b700 1 -- 172.21.15.72:0/3301630860 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0806bcd0 con 0x7f2f080c4400 2023-07-27T20:31:23.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.101+0000 7f2f0cb9b700 1 --2- 172.21.15.72:0/3301630860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f080c4400 0x7f2f080c7710 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2efc009840 tx=0x7f2efc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8315bbe78372196c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:23.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.101+0000 7f2f077fe700 1 -- 172.21.15.72:0/3301630860 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc011830 con 0x7f2f080c4400 2023-07-27T20:31:23.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.101+0000 7f2f077fe700 1 -- 172.21.15.72:0/3301630860 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2efc011990 con 0x7f2f080c4400 2023-07-27T20:31:23.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.101+0000 7f2f077fe700 1 -- 172.21.15.72:0/3301630860 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc011d20 con 0x7f2f080c4400 2023-07-27T20:31:23.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.101+0000 7f2f0edff700 1 -- 172.21.15.72:0/3301630860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f080c4400 msgr2=0x7f2f080c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:23.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.101+0000 7f2f0edff700 1 --2- 172.21.15.72:0/3301630860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f080c4400 0x7f2f080c7710 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2efc009840 tx=0x7f2efc009b50 comp rx=0 tx=0).stop 2023-07-27T20:31:23.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.101+0000 7f2f0edff700 1 -- 172.21.15.72:0/3301630860 shutdown_connections 2023-07-27T20:31:23.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.101+0000 7f2f0edff700 1 --2- 172.21.15.72:0/3301630860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f080c4400 0x7f2f080c7710 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:23.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.101+0000 7f2f0edff700 1 -- 172.21.15.72:0/3301630860 >> 172.21.15.72:0/3301630860 conn(0x7f2f080ab300 msgr2=0x7f2f080ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:23.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.101+0000 7f2f0edff700 1 -- 172.21.15.72:0/3301630860 shutdown_connections 2023-07-27T20:31:23.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.102+0000 7f2f0edff700 1 -- 172.21.15.72:0/3301630860 wait complete. 2023-07-27T20:31:23.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.103+0000 7f2f0edff700 1 Processor -- start 2023-07-27T20:31:23.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.103+0000 7f2f0edff700 1 -- start start 2023-07-27T20:31:23.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.104+0000 7f2f0edff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f0806b150 0x7f2f080c33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:23.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.104+0000 7f2f0edff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f080c4400 0x7f2f080c08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:23.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.104+0000 7f2f0edff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2f081549f0 0x7f2f080c0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:23.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.104+0000 7f2f0edff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f080c2010 con 0x7f2f0806b150 2023-07-27T20:31:23.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.104+0000 7f2f0edff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f081ea7c0 con 0x7f2f080c4400 2023-07-27T20:31:23.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.104+0000 7f2f0edff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0814e400 con 0x7f2f081549f0 2023-07-27T20:31:23.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.104+0000 7f2f0cb9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f0806b150 0x7f2f080c33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:23.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.104+0000 7f2f0cb9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f0806b150 0x7f2f080c33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47776/0 (socket says 172.21.15.72:47776) 2023-07-27T20:31:23.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.104+0000 7f2f0cb9b700 1 -- 172.21.15.72:0/918491859 learned_addr learned my addr 172.21.15.72:0/918491859 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:23.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.105+0000 7f2f0cb9b700 1 -- 172.21.15.72:0/918491859 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2f081549f0 msgr2=0x7f2f080c0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:23.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.105+0000 7f2f0cb9b700 1 --2- 172.21.15.72:0/918491859 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2f081549f0 0x7f2f080c0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:23.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.105+0000 7f2f0cb9b700 1 -- 172.21.15.72:0/918491859 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f080c4400 msgr2=0x7f2f080c08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:23.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.105+0000 7f2f0cb9b700 1 --2- 172.21.15.72:0/918491859 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f080c4400 0x7f2f080c08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:23.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.105+0000 7f2f0cb9b700 1 -- 172.21.15.72:0/918491859 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2efc0094a0 con 0x7f2f0806b150 2023-07-27T20:31:23.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.105+0000 7f2f0cb9b700 1 --2- 172.21.15.72:0/918491859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f0806b150 0x7f2f080c33f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2efc009fd0 tx=0x7f2efc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:23.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.105+0000 7f2f057fa700 1 -- 172.21.15.72:0/918491859 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc0045b0 con 0x7f2f0806b150 2023-07-27T20:31:23.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.105+0000 7f2f057fa700 1 -- 172.21.15.72:0/918491859 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2efc01f070 con 0x7f2f0806b150 2023-07-27T20:31:23.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.105+0000 7f2f0edff700 1 -- 172.21.15.72:0/918491859 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f081ea240 con 0x7f2f0806b150 2023-07-27T20:31:23.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.105+0000 7f2f057fa700 1 -- 172.21.15.72:0/918491859 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc0038c0 con 0x7f2f0806b150 2023-07-27T20:31:23.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.105+0000 7f2f0edff700 1 -- 172.21.15.72:0/918491859 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f0814e090 con 0x7f2f0806b150 2023-07-27T20:31:23.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.106+0000 7f2f0edff700 1 -- 172.21.15.72:0/918491859 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f0814ed10 con 0x7f2f0806b150 2023-07-27T20:31:23.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.107+0000 7f2f057fa700 1 -- 172.21.15.72:0/918491859 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2efc021030 con 0x7f2f0806b150 2023-07-27T20:31:23.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.108+0000 7f2f057fa700 1 --2- 172.21.15.72:0/918491859 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f2eec06ace0 0x7f2eec06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:23.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.108+0000 7f2f057fa700 1 -- 172.21.15.72:0/918491859 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2efc08a440 con 0x7f2f0806b150 2023-07-27T20:31:23.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.109+0000 7f2f07fff700 1 --2- 172.21.15.72:0/918491859 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f2eec06ace0 0x7f2eec06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:23.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.109+0000 7f2f07fff700 1 --2- 172.21.15.72:0/918491859 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f2eec06ace0 0x7f2eec06d1a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2f08152c40 tx=0x7f2ef40079c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:23.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.112+0000 7f2f057fa700 1 -- 172.21.15.72:0/918491859 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2efc055830 con 0x7f2f0806b150 2023-07-27T20:31:23.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.307+0000 7f2f0edff700 1 -- 172.21.15.72:0/918491859 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f08074310 con 0x7f2f0806b150 2023-07-27T20:31:23.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.308+0000 7f2f057fa700 1 -- 172.21.15.72:0/918491859 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+14649 (secure 0 0 0) 0x7f2efc058e50 con 0x7f2f0806b150 2023-07-27T20:31:23.296 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:31:23.296 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":18,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:31:22.831431+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:31:23.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.310+0000 7f2f0edff700 1 -- 172.21.15.72:0/918491859 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f2eec06ace0 msgr2=0x7f2eec06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:23.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.310+0000 7f2f0edff700 1 --2- 172.21.15.72:0/918491859 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f2eec06ace0 0x7f2eec06d1a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2f08152c40 tx=0x7f2ef40079c0 comp rx=0 tx=0).stop 2023-07-27T20:31:23.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.310+0000 7f2f0edff700 1 -- 172.21.15.72:0/918491859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f0806b150 msgr2=0x7f2f080c33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:23.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.310+0000 7f2f0edff700 1 --2- 172.21.15.72:0/918491859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f0806b150 0x7f2f080c33f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2efc009fd0 tx=0x7f2efc004750 comp rx=0 tx=0).stop 2023-07-27T20:31:23.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.310+0000 7f2f0edff700 1 -- 172.21.15.72:0/918491859 shutdown_connections 2023-07-27T20:31:23.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.310+0000 7f2f0edff700 1 --2- 172.21.15.72:0/918491859 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f2eec06ace0 0x7f2eec06d1a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:23.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.310+0000 7f2f0edff700 1 --2- 172.21.15.72:0/918491859 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2f081549f0 0x7f2f080c0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:23.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.310+0000 7f2f0edff700 1 --2- 172.21.15.72:0/918491859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f0806b150 0x7f2f080c33f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:23.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.310+0000 7f2f0edff700 1 --2- 172.21.15.72:0/918491859 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f080c4400 0x7f2f080c08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:23.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.310+0000 7f2f0edff700 1 -- 172.21.15.72:0/918491859 >> 172.21.15.72:0/918491859 conn(0x7f2f080ab300 msgr2=0x7f2f080ab6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:23.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.310+0000 7f2f0edff700 1 -- 172.21.15.72:0/918491859 shutdown_connections 2023-07-27T20:31:23.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.310+0000 7f2f0edff700 1 -- 172.21.15.72:0/918491859 wait complete. 2023-07-27T20:31:23.316 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-27T20:31:14.581785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T20:31:21.077941+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-27T20:31:23.317 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-27T20:31:23.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.526+0000 7fd12dbff700 1 Processor -- start 2023-07-27T20:31:23.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.526+0000 7fd12dbff700 1 -- start start 2023-07-27T20:31:23.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.527+0000 7fd12dbff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd12814aab0 0x7fd128154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:23.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.527+0000 7fd12dbff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd12806c1d0 0x7fd12806c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:23.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.528+0000 7fd12dbff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1280c7c50 con 0x7fd1280c7740 2023-07-27T20:31:23.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.528+0000 7fd12dbff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd12806bd40 con 0x7fd12806c1d0 2023-07-27T20:31:23.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.528+0000 7fd12dbff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1280c62f0 con 0x7fd12814aab0 2023-07-27T20:31:23.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.528+0000 7fd1277fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd12814aab0 0x7fd128154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:23.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.528+0000 7fd126ffd700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fd1280c7740 0x7fd1280c41c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.72:55218/0 (socket says 172.21.15.72:55218) 2023-07-27T20:31:23.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.528+0000 7fd126ffd700 1 -- 172.21.15.72:0/1522460699 learned_addr learned my addr 172.21.15.72:0/1522460699 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:23.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.528+0000 7fd127fff700 1 --2- 172.21.15.72:0/1522460699 >> v2:172.21.15.173:3300/0 conn(0x7fd12806c1d0 0x7fd12806c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:23.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.528+0000 7fd1267fc700 1 -- 172.21.15.72:0/1522460699 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3627719816 0 0) 0x7fd1280c7c50 con 0x7fd1280c7740 2023-07-27T20:31:23.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.528+0000 7fd1267fc700 1 -- 172.21.15.72:0/1522460699 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1100035b0 con 0x7fd1280c7740 2023-07-27T20:31:23.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.528+0000 7fd1277fe700 1 -- 172.21.15.72:0/1522460699 >> v2:172.21.15.173:3300/0 conn(0x7fd12806c1d0 msgr2=0x7fd12806c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:23.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.528+0000 7fd1277fe700 1 --2- 172.21.15.72:0/1522460699 >> v2:172.21.15.173:3300/0 conn(0x7fd12806c1d0 0x7fd12806c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:23.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.528+0000 7fd1277fe700 1 -- 172.21.15.72:0/1522460699 >> v1:172.21.15.173:6789/0 conn(0x7fd1280c7740 legacy=0x7fd1280c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:23.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.528+0000 7fd1277fe700 1 -- 172.21.15.72:0/1522460699 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd128155050 con 0x7fd12814aab0 2023-07-27T20:31:23.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.529+0000 7fd1277fe700 1 --2- 172.21.15.72:0/1522460699 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd12814aab0 0x7fd128154b10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd118009840 tx=0x7fd118009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b572904512f3ca41 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:23.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.529+0000 7fd1267fc700 1 -- 172.21.15.72:0/1522460699 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd118011830 con 0x7fd12814aab0 2023-07-27T20:31:23.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.529+0000 7fd1267fc700 1 -- 172.21.15.72:0/1522460699 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd118011990 con 0x7fd12814aab0 2023-07-27T20:31:23.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.529+0000 7fd1267fc700 1 -- 172.21.15.72:0/1522460699 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd118011d20 con 0x7fd12814aab0 2023-07-27T20:31:23.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.529+0000 7fd12dbff700 1 -- 172.21.15.72:0/1522460699 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd12814aab0 msgr2=0x7fd128154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:23.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.529+0000 7fd12dbff700 1 --2- 172.21.15.72:0/1522460699 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd12814aab0 0x7fd128154b10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd118009840 tx=0x7fd118009b50 comp rx=0 tx=0).stop 2023-07-27T20:31:23.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.529+0000 7fd12dbff700 1 -- 172.21.15.72:0/1522460699 shutdown_connections 2023-07-27T20:31:23.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.529+0000 7fd12dbff700 1 --2- 172.21.15.72:0/1522460699 >> v2:172.21.15.173:3300/0 conn(0x7fd12806c1d0 0x7fd12806c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:23.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.529+0000 7fd12dbff700 1 --2- 172.21.15.72:0/1522460699 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd12814aab0 0x7fd128154b10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:23.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.529+0000 7fd12dbff700 1 -- 172.21.15.72:0/1522460699 >> 172.21.15.72:0/1522460699 conn(0x7fd1280ab3f0 msgr2=0x7fd1280ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:23.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.530+0000 7fd12dbff700 1 -- 172.21.15.72:0/1522460699 shutdown_connections 2023-07-27T20:31:23.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.530+0000 7fd12dbff700 1 -- 172.21.15.72:0/1522460699 wait complete. 2023-07-27T20:31:23.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.531+0000 7fd12dbff700 1 Processor -- start 2023-07-27T20:31:23.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.531+0000 7fd12dbff700 1 -- start start 2023-07-27T20:31:23.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.532+0000 7fd12dbff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd12806c1d0 0x7fd1280be780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:23.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.532+0000 7fd12dbff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1280c7740 0x7fd1280bfed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:23.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.532+0000 7fd12dbff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd12814aab0 0x7fd1281ea7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:23.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.532+0000 7fd12dbff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd128157d00 con 0x7fd12806c1d0 2023-07-27T20:31:23.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.532+0000 7fd12dbff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1280be2f0 con 0x7fd1280c7740 2023-07-27T20:31:23.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.532+0000 7fd12dbff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1280bd6e0 con 0x7fd12814aab0 2023-07-27T20:31:23.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.532+0000 7fd1277fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd12806c1d0 0x7fd1280be780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:23.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.532+0000 7fd1277fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd12806c1d0 0x7fd1280be780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47782/0 (socket says 172.21.15.72:47782) 2023-07-27T20:31:23.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.533+0000 7fd1277fe700 1 -- 172.21.15.72:0/3191074499 learned_addr learned my addr 172.21.15.72:0/3191074499 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:23.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.533+0000 7fd126ffd700 1 --2- 172.21.15.72:0/3191074499 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1280c7740 0x7fd1280bfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:23.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.533+0000 7fd127fff700 1 --2- 172.21.15.72:0/3191074499 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd12814aab0 0x7fd1281ea7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:23.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.533+0000 7fd1277fe700 1 -- 172.21.15.72:0/3191074499 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd12814aab0 msgr2=0x7fd1281ea7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:23.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.533+0000 7fd1277fe700 1 --2- 172.21.15.72:0/3191074499 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd12814aab0 0x7fd1281ea7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:23.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.533+0000 7fd1277fe700 1 -- 172.21.15.72:0/3191074499 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1280c7740 msgr2=0x7fd1280bfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:23.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.533+0000 7fd1277fe700 1 --2- 172.21.15.72:0/3191074499 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1280c7740 0x7fd1280bfed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:23.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.533+0000 7fd1277fe700 1 -- 172.21.15.72:0/3191074499 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1180094a0 con 0x7fd12806c1d0 2023-07-27T20:31:23.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.533+0000 7fd126ffd700 1 --2- 172.21.15.72:0/3191074499 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1280c7740 0x7fd1280bfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:31:23.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.533+0000 7fd1277fe700 1 --2- 172.21.15.72:0/3191074499 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd12806c1d0 0x7fd1280be780 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd118014040 tx=0x7fd118004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:23.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.533+0000 7fd10ffff700 1 -- 172.21.15.72:0/3191074499 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1180036a0 con 0x7fd12806c1d0 2023-07-27T20:31:23.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.533+0000 7fd10ffff700 1 -- 172.21.15.72:0/3191074499 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11801f070 con 0x7fd12806c1d0 2023-07-27T20:31:23.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.533+0000 7fd10ffff700 1 -- 172.21.15.72:0/3191074499 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd118003a20 con 0x7fd12806c1d0 2023-07-27T20:31:23.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.533+0000 7fd12dbff700 1 -- 172.21.15.72:0/3191074499 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1280bd9c0 con 0x7fd12806c1d0 2023-07-27T20:31:23.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.534+0000 7fd12dbff700 1 -- 172.21.15.72:0/3191074499 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1280bdf80 con 0x7fd12806c1d0 2023-07-27T20:31:23.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.534+0000 7fd12dbff700 1 -- 172.21.15.72:0/3191074499 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd12804e470 con 0x7fd12806c1d0 2023-07-27T20:31:23.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.535+0000 7fd10ffff700 1 -- 172.21.15.72:0/3191074499 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd118003b80 con 0x7fd12806c1d0 2023-07-27T20:31:23.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.537+0000 7fd10ffff700 1 --2- 172.21.15.72:0/3191074499 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd11406ace0 0x7fd11406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:23.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.537+0000 7fd10ffff700 1 -- 172.21.15.72:0/3191074499 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd118021070 con 0x7fd12806c1d0 2023-07-27T20:31:23.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.537+0000 7fd126ffd700 1 --2- 172.21.15.72:0/3191074499 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd11406ace0 0x7fd11406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:23.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.538+0000 7fd126ffd700 1 --2- 172.21.15.72:0/3191074499 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd11406ace0 0x7fd11406d1a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd128154f00 tx=0x7fd11c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:23.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.541+0000 7fd10ffff700 1 -- 172.21.15.72:0/3191074499 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd118055c30 con 0x7fd12806c1d0 2023-07-27T20:31:23.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.733+0000 7fd12dbff700 1 -- 172.21.15.72:0/3191074499 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd12806cf00 con 0x7fd12806c1d0 2023-07-27T20:31:23.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.734+0000 7fd10ffff700 1 -- 172.21.15.72:0/3191074499 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd118059250 con 0x7fd12806c1d0 2023-07-27T20:31:23.934 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-27T20:31:23.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.736+0000 7fd12dbff700 1 -- 172.21.15.72:0/3191074499 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd11406ace0 msgr2=0x7fd11406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:23.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.736+0000 7fd12dbff700 1 --2- 172.21.15.72:0/3191074499 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd11406ace0 0x7fd11406d1a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd128154f00 tx=0x7fd11c009040 comp rx=0 tx=0).stop 2023-07-27T20:31:23.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.736+0000 7fd12dbff700 1 -- 172.21.15.72:0/3191074499 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd12806c1d0 msgr2=0x7fd1280be780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:23.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.736+0000 7fd12dbff700 1 --2- 172.21.15.72:0/3191074499 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd12806c1d0 0x7fd1280be780 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd118014040 tx=0x7fd118004750 comp rx=0 tx=0).stop 2023-07-27T20:31:23.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.736+0000 7fd12dbff700 1 -- 172.21.15.72:0/3191074499 shutdown_connections 2023-07-27T20:31:23.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.736+0000 7fd12dbff700 1 --2- 172.21.15.72:0/3191074499 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd11406ace0 0x7fd11406d1a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:23.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.736+0000 7fd12dbff700 1 --2- 172.21.15.72:0/3191074499 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd12814aab0 0x7fd1281ea7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:23.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.736+0000 7fd12dbff700 1 --2- 172.21.15.72:0/3191074499 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd12806c1d0 0x7fd1280be780 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:23.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.736+0000 7fd12dbff700 1 --2- 172.21.15.72:0/3191074499 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1280c7740 0x7fd1280bfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:23.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.736+0000 7fd12dbff700 1 -- 172.21.15.72:0/3191074499 >> 172.21.15.72:0/3191074499 conn(0x7fd1280ab3f0 msgr2=0x7fd1281def70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:23.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.736+0000 7fd12dbff700 1 -- 172.21.15.72:0/3191074499 shutdown_connections 2023-07-27T20:31:23.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:23.736+0000 7fd12dbff700 1 -- 172.21.15.72:0/3191074499 wait complete. 2023-07-27T20:31:23.938 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T20:31:24.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.148+0000 7f5a753ff700 1 Processor -- start 2023-07-27T20:31:24.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.148+0000 7f5a753ff700 1 -- start start 2023-07-27T20:31:24.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.149+0000 7f5a753ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5a700c7740 0x7f5a700c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:24.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.149+0000 7f5a753ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a700c7c50 con 0x7f5a700c4700 2023-07-27T20:31:24.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.150+0000 7f5a753ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a7006bd40 con 0x7f5a7014aab0 2023-07-27T20:31:24.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.150+0000 7f5a753ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a700c62f0 con 0x7f5a700c7740 2023-07-27T20:31:24.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.150+0000 7f5a6f7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5a700c4700 0x7f5a7006c1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39730/0 (socket says 172.21.15.72:39730) 2023-07-27T20:31:24.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.150+0000 7f5a6f7fe700 1 -- 172.21.15.72:0/1975434605 learned_addr learned my addr 172.21.15.72:0/1975434605 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:24.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.150+0000 7f5a67fff700 1 --2- 172.21.15.72:0/1975434605 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5a700c7740 0x7f5a700c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:24.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.150+0000 7f5a6e7fc700 1 -- 172.21.15.72:0/1975434605 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 832305957 0 0) 0x7f5a700c7c50 con 0x7f5a700c4700 2023-07-27T20:31:24.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.150+0000 7f5a6e7fc700 1 -- 172.21.15.72:0/1975434605 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a5c0035b0 con 0x7f5a700c4700 2023-07-27T20:31:24.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.150+0000 7f5a6e7fc700 1 -- 172.21.15.72:0/1975434605 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 563184383 0 0) 0x7f5a7006bd40 con 0x7f5a7014aab0 2023-07-27T20:31:24.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.150+0000 7f5a6e7fc700 1 -- 172.21.15.72:0/1975434605 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a700c7c50 con 0x7f5a7014aab0 2023-07-27T20:31:24.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.150+0000 7f5a67fff700 1 -- 172.21.15.72:0/1975434605 >> v1:172.21.15.173:6789/0 conn(0x7f5a7014aab0 legacy=0x7f5a70154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:24.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.150+0000 7f5a67fff700 1 -- 172.21.15.72:0/1975434605 >> v1:172.21.15.72:6789/0 conn(0x7f5a700c4700 legacy=0x7f5a7006c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:24.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.150+0000 7f5a67fff700 1 -- 172.21.15.72:0/1975434605 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a7006d200 con 0x7f5a700c7740 2023-07-27T20:31:24.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.151+0000 7f5a67fff700 1 --2- 172.21.15.72:0/1975434605 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5a700c7740 0x7f5a700c41c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5a58009870 tx=0x7f5a58009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72927a0a92cc644d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:24.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.151+0000 7f5a6e7fc700 1 -- 172.21.15.72:0/1975434605 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a58011830 con 0x7f5a700c7740 2023-07-27T20:31:24.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.151+0000 7f5a6e7fc700 1 -- 172.21.15.72:0/1975434605 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a58011990 con 0x7f5a700c7740 2023-07-27T20:31:24.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.151+0000 7f5a6e7fc700 1 -- 172.21.15.72:0/1975434605 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a58011d20 con 0x7f5a700c7740 2023-07-27T20:31:24.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.151+0000 7f5a753ff700 1 -- 172.21.15.72:0/1975434605 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5a700c7740 msgr2=0x7f5a700c41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:24.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.151+0000 7f5a753ff700 1 --2- 172.21.15.72:0/1975434605 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5a700c7740 0x7f5a700c41c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5a58009870 tx=0x7f5a58009b80 comp rx=0 tx=0).stop 2023-07-27T20:31:24.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.152+0000 7f5a753ff700 1 -- 172.21.15.72:0/1975434605 shutdown_connections 2023-07-27T20:31:24.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.152+0000 7f5a753ff700 1 --2- 172.21.15.72:0/1975434605 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5a700c7740 0x7f5a700c41c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:24.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.152+0000 7f5a753ff700 1 -- 172.21.15.72:0/1975434605 >> 172.21.15.72:0/1975434605 conn(0x7f5a700ab3f0 msgr2=0x7f5a700ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:24.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.152+0000 7f5a753ff700 1 -- 172.21.15.72:0/1975434605 shutdown_connections 2023-07-27T20:31:24.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.152+0000 7f5a753ff700 1 -- 172.21.15.72:0/1975434605 wait complete. 2023-07-27T20:31:24.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.153+0000 7f5a753ff700 1 Processor -- start 2023-07-27T20:31:24.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.153+0000 7f5a753ff700 1 -- start start 2023-07-27T20:31:24.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.154+0000 7f5a753ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a700c4700 0x7f5a701ed2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:24.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.154+0000 7f5a753ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a700c7740 0x7f5a701e93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:24.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.154+0000 7f5a753ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5a7014aab0 0x7f5a70157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:24.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.154+0000 7f5a753ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a701ece40 con 0x7f5a700c4700 2023-07-27T20:31:24.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.154+0000 7f5a753ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a701ed810 con 0x7f5a700c7740 2023-07-27T20:31:24.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.154+0000 7f5a753ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a70156060 con 0x7f5a7014aab0 2023-07-27T20:31:24.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.154+0000 7f5a6effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a700c4700 0x7f5a701ed2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:24.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.155+0000 7f5a6effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a700c4700 0x7f5a701ed2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47794/0 (socket says 172.21.15.72:47794) 2023-07-27T20:31:24.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.155+0000 7f5a6effd700 1 -- 172.21.15.72:0/1401472026 learned_addr learned my addr 172.21.15.72:0/1401472026 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:24.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.155+0000 7f5a67fff700 1 --2- 172.21.15.72:0/1401472026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a700c7740 0x7f5a701e93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:24.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.155+0000 7f5a6f7fe700 1 --2- 172.21.15.72:0/1401472026 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5a7014aab0 0x7f5a70157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:24.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.155+0000 7f5a6effd700 1 -- 172.21.15.72:0/1401472026 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5a7014aab0 msgr2=0x7f5a70157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:24.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.155+0000 7f5a6effd700 1 --2- 172.21.15.72:0/1401472026 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5a7014aab0 0x7f5a70157100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:24.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.155+0000 7f5a6effd700 1 -- 172.21.15.72:0/1401472026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a700c7740 msgr2=0x7f5a701e93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:24.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.155+0000 7f5a6effd700 1 --2- 172.21.15.72:0/1401472026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a700c7740 0x7f5a701e93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:24.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.155+0000 7f5a6effd700 1 -- 172.21.15.72:0/1401472026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a580094a0 con 0x7f5a700c4700 2023-07-27T20:31:24.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.155+0000 7f5a6f7fe700 1 --2- 172.21.15.72:0/1401472026 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5a7014aab0 0x7f5a70157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:31:24.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.155+0000 7f5a6effd700 1 --2- 172.21.15.72:0/1401472026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a700c4700 0x7f5a701ed2d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5a6000c500 tx=0x7f5a6000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:24.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.155+0000 7f5a677fe700 1 -- 172.21.15.72:0/1401472026 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a600052d0 con 0x7f5a700c4700 2023-07-27T20:31:24.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.155+0000 7f5a677fe700 1 -- 172.21.15.72:0/1401472026 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a60005450 con 0x7f5a700c4700 2023-07-27T20:31:24.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.155+0000 7f5a677fe700 1 -- 172.21.15.72:0/1401472026 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a600038c0 con 0x7f5a700c4700 2023-07-27T20:31:24.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.155+0000 7f5a753ff700 1 -- 172.21.15.72:0/1401472026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a70156340 con 0x7f5a700c4700 2023-07-27T20:31:24.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.156+0000 7f5a753ff700 1 -- 172.21.15.72:0/1401472026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a701ecad0 con 0x7f5a700c4700 2023-07-27T20:31:24.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.156+0000 7f5a753ff700 1 -- 172.21.15.72:0/1401472026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a70156860 con 0x7f5a700c4700 2023-07-27T20:31:24.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.157+0000 7f5a677fe700 1 -- 172.21.15.72:0/1401472026 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5a60003a20 con 0x7f5a700c4700 2023-07-27T20:31:24.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.158+0000 7f5a677fe700 1 --2- 172.21.15.72:0/1401472026 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5a5006ace0 0x7f5a5006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:24.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.158+0000 7f5a677fe700 1 -- 172.21.15.72:0/1401472026 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5a60088660 con 0x7f5a700c4700 2023-07-27T20:31:24.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.159+0000 7f5a67fff700 1 --2- 172.21.15.72:0/1401472026 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5a5006ace0 0x7f5a5006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:24.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.159+0000 7f5a67fff700 1 --2- 172.21.15.72:0/1401472026 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5a5006ace0 0x7f5a5006d1a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5a58009870 tx=0x7f5a5801c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:24.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.162+0000 7f5a677fe700 1 -- 172.21.15.72:0/1401472026 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5a70156860 con 0x7f5a700c4700 2023-07-27T20:31:24.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.356+0000 7f5a753ff700 1 -- 172.21.15.72:0/1401472026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5a701ec930 con 0x7f5a700c4700 2023-07-27T20:31:24.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.356+0000 7f5a677fe700 1 -- 172.21.15.72:0/1401472026 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5a701ec930 con 0x7f5a700c4700 2023-07-27T20:31:24.345 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-27T20:31:24.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.358+0000 7f5a753ff700 1 -- 172.21.15.72:0/1401472026 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5a5006ace0 msgr2=0x7f5a5006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:24.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.358+0000 7f5a753ff700 1 --2- 172.21.15.72:0/1401472026 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5a5006ace0 0x7f5a5006d1a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5a58009870 tx=0x7f5a5801c040 comp rx=0 tx=0).stop 2023-07-27T20:31:24.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.358+0000 7f5a753ff700 1 -- 172.21.15.72:0/1401472026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a700c4700 msgr2=0x7f5a701ed2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:24.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.358+0000 7f5a753ff700 1 --2- 172.21.15.72:0/1401472026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a700c4700 0x7f5a701ed2d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5a6000c500 tx=0x7f5a6000c8c0 comp rx=0 tx=0).stop 2023-07-27T20:31:24.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.358+0000 7f5a753ff700 1 -- 172.21.15.72:0/1401472026 shutdown_connections 2023-07-27T20:31:24.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.358+0000 7f5a753ff700 1 --2- 172.21.15.72:0/1401472026 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5a5006ace0 0x7f5a5006d1a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:24.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.358+0000 7f5a753ff700 1 --2- 172.21.15.72:0/1401472026 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5a7014aab0 0x7f5a70157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:24.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.358+0000 7f5a753ff700 1 --2- 172.21.15.72:0/1401472026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a700c4700 0x7f5a701ed2d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:24.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.358+0000 7f5a753ff700 1 --2- 172.21.15.72:0/1401472026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a700c7740 0x7f5a701e93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:24.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.358+0000 7f5a753ff700 1 -- 172.21.15.72:0/1401472026 >> 172.21.15.72:0/1401472026 conn(0x7f5a700ab3f0 msgr2=0x7f5a700aacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:24.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.358+0000 7f5a753ff700 1 -- 172.21.15.72:0/1401472026 shutdown_connections 2023-07-27T20:31:24.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.358+0000 7f5a753ff700 1 -- 172.21.15.72:0/1401472026 wait complete. 2023-07-27T20:31:24.365 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T20:31:24.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.573+0000 7f4a565ff700 1 Processor -- start 2023-07-27T20:31:24.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.573+0000 7f4a565ff700 1 -- start start 2023-07-27T20:31:24.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.574+0000 7f4a565ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4a5006b150 0x7f4a500c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:24.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.574+0000 7f4a565ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a5006b710 con 0x7f4a500c4400 2023-07-27T20:31:24.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.574+0000 7f4a565ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a5006b9f0 con 0x7f4a501549f0 2023-07-27T20:31:24.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.574+0000 7f4a565ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a501545d0 con 0x7f4a5006b150 2023-07-27T20:31:24.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.575+0000 7f4a4ffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4a500c4400 0x7f4a500c4cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39740/0 (socket says 172.21.15.72:39740) 2023-07-27T20:31:24.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.575+0000 7f4a4ffff700 1 -- 172.21.15.72:0/1020311273 learned_addr learned my addr 172.21.15.72:0/1020311273 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:24.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.575+0000 7f4a4f7fe700 1 --2- 172.21.15.72:0/1020311273 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4a5006b150 0x7f4a500c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:24.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.575+0000 7f4a4effd700 1 -- 172.21.15.72:0/1020311273 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 244964012 0 0) 0x7f4a5006b710 con 0x7f4a500c4400 2023-07-27T20:31:24.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.575+0000 7f4a4effd700 1 -- 172.21.15.72:0/1020311273 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a380035b0 con 0x7f4a500c4400 2023-07-27T20:31:24.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.575+0000 7f4a4effd700 1 -- 172.21.15.72:0/1020311273 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3443065841 0 0) 0x7f4a380035b0 con 0x7f4a500c4400 2023-07-27T20:31:24.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.575+0000 7f4a4effd700 1 -- 172.21.15.72:0/1020311273 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4a5006b150 msgr2=0x7f4a500c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:24.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.575+0000 7f4a4effd700 1 --2- 172.21.15.72:0/1020311273 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4a5006b150 0x7f4a500c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:24.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.575+0000 7f4a4effd700 1 -- 172.21.15.72:0/1020311273 >> v1:172.21.15.173:6789/0 conn(0x7f4a501549f0 legacy=0x7f4a501514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:24.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.575+0000 7f4a4effd700 1 -- 172.21.15.72:0/1020311273 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a5006bcd0 con 0x7f4a500c4400 2023-07-27T20:31:24.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.575+0000 7f4a4effd700 1 -- 172.21.15.72:0/1020311273 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f4a40001670 con 0x7f4a500c4400 2023-07-27T20:31:24.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.575+0000 7f4a4effd700 1 -- 172.21.15.72:0/1020311273 >> v1:172.21.15.72:6789/0 conn(0x7f4a500c4400 legacy=0x7f4a500c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:24.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.575+0000 7f4a4effd700 1 --2- 172.21.15.72:0/1020311273 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4a5006b150 0x7f4a38003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:24.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.575+0000 7f4a4effd700 1 --2- 172.21.15.72:0/1020311273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a38003f70 0x7f4a38004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:24.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.576+0000 7f4a4effd700 1 --2- 172.21.15.72:0/1020311273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a38004d90 0x7f4a38005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:24.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.576+0000 7f4a4effd700 1 -- 172.21.15.72:0/1020311273 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a501545d0 con 0x7f4a38004d90 2023-07-27T20:31:24.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.576+0000 7f4a4effd700 1 -- 172.21.15.72:0/1020311273 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3800bb20 con 0x7f4a38003f70 2023-07-27T20:31:24.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.576+0000 7f4a4effd700 1 -- 172.21.15.72:0/1020311273 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3800bce0 con 0x7f4a5006b150 2023-07-27T20:31:24.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.576+0000 7f4a54b9c700 1 --2- 172.21.15.72:0/1020311273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a38004d90 0x7f4a38005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:24.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.576+0000 7f4a4f7fe700 1 --2- 172.21.15.72:0/1020311273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a38003f70 0x7f4a38004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:24.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.576+0000 7f4a4ffff700 1 --2- 172.21.15.72:0/1020311273 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4a5006b150 0x7f4a38003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:24.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.576+0000 7f4a54b9c700 1 -- 172.21.15.72:0/1020311273 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4a5006b150 msgr2=0x7f4a38003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:24.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.576+0000 7f4a54b9c700 1 --2- 172.21.15.72:0/1020311273 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4a5006b150 0x7f4a38003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:24.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.576+0000 7f4a54b9c700 1 -- 172.21.15.72:0/1020311273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a38003f70 msgr2=0x7f4a38004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:24.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.576+0000 7f4a54b9c700 1 --2- 172.21.15.72:0/1020311273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a38003f70 0x7f4a38004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:24.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.576+0000 7f4a54b9c700 1 -- 172.21.15.72:0/1020311273 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a380035b0 con 0x7f4a38004d90 2023-07-27T20:31:24.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.576+0000 7f4a54b9c700 1 --2- 172.21.15.72:0/1020311273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a38004d90 0x7f4a38005210 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4a4800c290 tx=0x7f4a38005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7024f217d291fe37 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:24.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.577+0000 7f4a4effd700 1 -- 172.21.15.72:0/1020311273 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a48001e70 con 0x7f4a38004d90 2023-07-27T20:31:24.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.577+0000 7f4a4effd700 1 -- 172.21.15.72:0/1020311273 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4800ce50 con 0x7f4a38004d90 2023-07-27T20:31:24.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.577+0000 7f4a4effd700 1 -- 172.21.15.72:0/1020311273 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a48012660 con 0x7f4a38004d90 2023-07-27T20:31:24.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.577+0000 7f4a565ff700 1 -- 172.21.15.72:0/1020311273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a38004d90 msgr2=0x7f4a38005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:24.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.577+0000 7f4a565ff700 1 --2- 172.21.15.72:0/1020311273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a38004d90 0x7f4a38005210 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4a4800c290 tx=0x7f4a38005880 comp rx=0 tx=0).stop 2023-07-27T20:31:24.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.577+0000 7f4a54b9c700 1 -- 172.21.15.72:0/1020311273 reap_dead start 2023-07-27T20:31:24.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.577+0000 7f4a565ff700 1 -- 172.21.15.72:0/1020311273 shutdown_connections 2023-07-27T20:31:24.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.577+0000 7f4a565ff700 1 -- 172.21.15.72:0/1020311273 >> 172.21.15.72:0/1020311273 conn(0x7f4a500ab300 msgr2=0x7f4a500ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:24.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.577+0000 7f4a565ff700 1 -- 172.21.15.72:0/1020311273 shutdown_connections 2023-07-27T20:31:24.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.577+0000 7f4a565ff700 1 -- 172.21.15.72:0/1020311273 wait complete. 2023-07-27T20:31:24.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.579+0000 7f4a565ff700 1 Processor -- start 2023-07-27T20:31:24.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.579+0000 7f4a565ff700 1 -- start start 2023-07-27T20:31:24.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.580+0000 7f4a565ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a38004d90 0x7f4a501e9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:24.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.580+0000 7f4a565ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a500c3430 0x7f4a500c08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:24.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.580+0000 7f4a565ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4a5014b9b0 0x7f4a500c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:24.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.580+0000 7f4a565ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a501e9350 con 0x7f4a500c3430 2023-07-27T20:31:24.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.580+0000 7f4a565ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5014cb40 con 0x7f4a38004d90 2023-07-27T20:31:24.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.580+0000 7f4a565ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a501ea2a0 con 0x7f4a5014b9b0 2023-07-27T20:31:24.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.580+0000 7f4a4f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a500c3430 0x7f4a500c08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:24.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.580+0000 7f4a4f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a500c3430 0x7f4a500c08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47812/0 (socket says 172.21.15.72:47812) 2023-07-27T20:31:24.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.580+0000 7f4a4f7fe700 1 -- 172.21.15.72:0/1424165775 learned_addr learned my addr 172.21.15.72:0/1424165775 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:24.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.580+0000 7f4a4ffff700 1 --2- 172.21.15.72:0/1424165775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a38004d90 0x7f4a501e9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:24.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.580+0000 7f4a54b9c700 1 --2- 172.21.15.72:0/1424165775 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4a5014b9b0 0x7f4a500c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:24.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.580+0000 7f4a4f7fe700 1 -- 172.21.15.72:0/1424165775 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4a5014b9b0 msgr2=0x7f4a500c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:24.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.580+0000 7f4a4f7fe700 1 --2- 172.21.15.72:0/1424165775 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4a5014b9b0 0x7f4a500c7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:24.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.580+0000 7f4a4f7fe700 1 -- 172.21.15.72:0/1424165775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a38004d90 msgr2=0x7f4a501e9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:24.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.580+0000 7f4a4f7fe700 1 --2- 172.21.15.72:0/1424165775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a38004d90 0x7f4a501e9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:24.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.580+0000 7f4a4f7fe700 1 -- 172.21.15.72:0/1424165775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a500c0e20 con 0x7f4a500c3430 2023-07-27T20:31:24.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.581+0000 7f4a4f7fe700 1 --2- 172.21.15.72:0/1424165775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a500c3430 0x7f4a500c08e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4a44011aa0 tx=0x7f4a44011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:24.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.581+0000 7f4a4cff9700 1 -- 172.21.15.72:0/1424165775 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4400f980 con 0x7f4a500c3430 2023-07-27T20:31:24.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.581+0000 7f4a4cff9700 1 -- 172.21.15.72:0/1424165775 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4400fae0 con 0x7f4a500c3430 2023-07-27T20:31:24.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.581+0000 7f4a4cff9700 1 -- 172.21.15.72:0/1424165775 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4400fe90 con 0x7f4a500c3430 2023-07-27T20:31:24.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.581+0000 7f4a565ff700 1 -- 172.21.15.72:0/1424165775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a5014c580 con 0x7f4a500c3430 2023-07-27T20:31:24.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.581+0000 7f4a565ff700 1 -- 172.21.15.72:0/1424165775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a501e9560 con 0x7f4a500c3430 2023-07-27T20:31:24.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.582+0000 7f4a565ff700 1 -- 172.21.15.72:0/1424165775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a501e9bb0 con 0x7f4a500c3430 2023-07-27T20:31:24.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.583+0000 7f4a4cff9700 1 -- 172.21.15.72:0/1424165775 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4a44014440 con 0x7f4a500c3430 2023-07-27T20:31:24.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.584+0000 7f4a4cff9700 1 --2- 172.21.15.72:0/1424165775 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4a3c06ace0 0x7f4a3c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:24.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.584+0000 7f4a4cff9700 1 -- 172.21.15.72:0/1424165775 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4a44089930 con 0x7f4a500c3430 2023-07-27T20:31:24.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.584+0000 7f4a4ffff700 1 --2- 172.21.15.72:0/1424165775 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4a3c06ace0 0x7f4a3c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:24.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.585+0000 7f4a4ffff700 1 --2- 172.21.15.72:0/1424165775 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4a3c06ace0 0x7f4a3c06d1a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4a500ae830 tx=0x7f4a40009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:24.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.588+0000 7f4a4cff9700 1 -- 172.21.15.72:0/1424165775 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4a44058870 con 0x7f4a500c3430 2023-07-27T20:31:24.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.826+0000 7f4a565ff700 1 -- 172.21.15.72:0/1424165775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a50154100 con 0x7f4a500c3430 2023-07-27T20:31:24.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.826+0000 7f4a4cff9700 1 -- 172.21.15.72:0/1424165775 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3527 (secure 0 0 0) 0x7f4a44022090 con 0x7f4a500c3430 2023-07-27T20:31:24.815 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:31:24.816 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/1913374698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1913374698},{"type":"v1","addr":"172.21.15.72:6834","nonce":1913374698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/3260445560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":3260445560},{"type":"v1","addr":"172.21.15.72:6835","nonce":3260445560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1305837931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1305837931},{"type":"v1","addr":"172.21.15.173:6837","nonce":1305837931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/516740687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":516740687},{"type":"v1","addr":"172.21.15.173:6835","nonce":516740687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-07-27T20:31:24.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.829+0000 7f4a565ff700 1 -- 172.21.15.72:0/1424165775 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4a3c06ace0 msgr2=0x7f4a3c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:24.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.829+0000 7f4a565ff700 1 --2- 172.21.15.72:0/1424165775 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4a3c06ace0 0x7f4a3c06d1a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4a500ae830 tx=0x7f4a40009040 comp rx=0 tx=0).stop 2023-07-27T20:31:24.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.829+0000 7f4a565ff700 1 -- 172.21.15.72:0/1424165775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a500c3430 msgr2=0x7f4a500c08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:24.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.829+0000 7f4a565ff700 1 --2- 172.21.15.72:0/1424165775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a500c3430 0x7f4a500c08e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4a44011aa0 tx=0x7f4a44011e60 comp rx=0 tx=0).stop 2023-07-27T20:31:24.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.829+0000 7f4a565ff700 1 -- 172.21.15.72:0/1424165775 shutdown_connections 2023-07-27T20:31:24.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.829+0000 7f4a565ff700 1 --2- 172.21.15.72:0/1424165775 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4a3c06ace0 0x7f4a3c06d1a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:24.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.829+0000 7f4a565ff700 1 --2- 172.21.15.72:0/1424165775 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4a5014b9b0 0x7f4a500c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:24.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.829+0000 7f4a565ff700 1 --2- 172.21.15.72:0/1424165775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a38004d90 0x7f4a501e9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:24.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.829+0000 7f4a565ff700 1 --2- 172.21.15.72:0/1424165775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a500c3430 0x7f4a500c08e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:24.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.829+0000 7f4a565ff700 1 -- 172.21.15.72:0/1424165775 >> 172.21.15.72:0/1424165775 conn(0x7f4a500ab300 msgr2=0x7f4a50151270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:24.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.829+0000 7f4a565ff700 1 -- 172.21.15.72:0/1424165775 shutdown_connections 2023-07-27T20:31:24.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:24.829+0000 7f4a565ff700 1 -- 172.21.15.72:0/1424165775 wait complete. 2023-07-27T20:31:24.820 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 3 2023-07-27T20:31:24.837 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:31:25.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.045+0000 7fe0921ff700 1 Processor -- start 2023-07-27T20:31:25.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.045+0000 7fe0921ff700 1 -- start start 2023-07-27T20:31:25.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.046+0000 7fe0921ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe08c139f80 0x7fe08c0c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:25.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.046+0000 7fe0921ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe08c0c1810 con 0x7fe08c139960 2023-07-27T20:31:25.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.046+0000 7fe0921ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe08c139d40 con 0x7fe08c1542e0 2023-07-27T20:31:25.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.046+0000 7fe0921ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe08c0c0ee0 con 0x7fe08c139f80 2023-07-27T20:31:25.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.046+0000 7fe08b7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe08c139960 0x7fe08c0c1e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39744/0 (socket says 172.21.15.72:39744) 2023-07-27T20:31:25.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.047+0000 7fe08b7fe700 1 -- 172.21.15.72:0/3389755314 learned_addr learned my addr 172.21.15.72:0/3389755314 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:25.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.047+0000 7fe08affd700 1 --2- 172.21.15.72:0/3389755314 >> v2:172.21.15.72:3300/0 conn(0x7fe08c139f80 0x7fe08c0c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:25.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.047+0000 7fe08a7fc700 1 -- 172.21.15.72:0/3389755314 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 431169767 0 0) 0x7fe08c0c1810 con 0x7fe08c139960 2023-07-27T20:31:25.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.047+0000 7fe08a7fc700 1 -- 172.21.15.72:0/3389755314 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0740035b0 con 0x7fe08c139960 2023-07-27T20:31:25.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.047+0000 7fe08affd700 1 -- 172.21.15.72:0/3389755314 >> v1:172.21.15.173:6789/0 conn(0x7fe08c1542e0 legacy=0x7fe08c154710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:25.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.047+0000 7fe08affd700 1 -- 172.21.15.72:0/3389755314 >> v1:172.21.15.72:6789/0 conn(0x7fe08c139960 legacy=0x7fe08c0c1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:25.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.047+0000 7fe08affd700 1 -- 172.21.15.72:0/3389755314 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe08c151060 con 0x7fe08c139f80 2023-07-27T20:31:25.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.047+0000 7fe08affd700 1 --2- 172.21.15.72:0/3389755314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe08c139f80 0x7fe08c0c12d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe080009840 tx=0x7fe080009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815752ba9295a9a0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:25.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.047+0000 7fe08a7fc700 1 -- 172.21.15.72:0/3389755314 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe080004230 con 0x7fe08c139f80 2023-07-27T20:31:25.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.047+0000 7fe08a7fc700 1 -- 172.21.15.72:0/3389755314 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe080004390 con 0x7fe08c139f80 2023-07-27T20:31:25.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.047+0000 7fe08a7fc700 1 -- 172.21.15.72:0/3389755314 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0800036c0 con 0x7fe08c139f80 2023-07-27T20:31:25.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.048+0000 7fe0921ff700 1 -- 172.21.15.72:0/3389755314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe08c139f80 msgr2=0x7fe08c0c12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:25.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.048+0000 7fe0921ff700 1 --2- 172.21.15.72:0/3389755314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe08c139f80 0x7fe08c0c12d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe080009840 tx=0x7fe080009b50 comp rx=0 tx=0).stop 2023-07-27T20:31:25.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.048+0000 7fe0921ff700 1 -- 172.21.15.72:0/3389755314 shutdown_connections 2023-07-27T20:31:25.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.048+0000 7fe0921ff700 1 --2- 172.21.15.72:0/3389755314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe08c139f80 0x7fe08c0c12d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:25.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.048+0000 7fe0921ff700 1 -- 172.21.15.72:0/3389755314 >> 172.21.15.72:0/3389755314 conn(0x7fe08c06a190 msgr2=0x7fe08c06a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:25.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.048+0000 7fe0921ff700 1 -- 172.21.15.72:0/3389755314 shutdown_connections 2023-07-27T20:31:25.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.048+0000 7fe0921ff700 1 -- 172.21.15.72:0/3389755314 wait complete. 2023-07-27T20:31:25.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.050+0000 7fe0921ff700 1 Processor -- start 2023-07-27T20:31:25.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.050+0000 7fe0921ff700 1 -- start start 2023-07-27T20:31:25.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.051+0000 7fe0921ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe08c139960 0x7fe08c147980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:25.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.051+0000 7fe0921ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe08c139f80 0x7fe08c147ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:25.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.051+0000 7fe0921ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe08c1542e0 0x7fe08c0aa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:25.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.051+0000 7fe0921ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08c14bda0 con 0x7fe08c139f80 2023-07-27T20:31:25.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.051+0000 7fe0921ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08c1ea3e0 con 0x7fe08c1542e0 2023-07-27T20:31:25.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.051+0000 7fe0921ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe08c1e9ad0 con 0x7fe08c139960 2023-07-27T20:31:25.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.051+0000 7fe08affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe08c139f80 0x7fe08c147ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:25.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.051+0000 7fe08affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe08c139f80 0x7fe08c147ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47836/0 (socket says 172.21.15.72:47836) 2023-07-27T20:31:25.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.051+0000 7fe08affd700 1 -- 172.21.15.72:0/1469434804 learned_addr learned my addr 172.21.15.72:0/1469434804 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:25.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.051+0000 7fe08bfff700 1 --2- 172.21.15.72:0/1469434804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe08c1542e0 0x7fe08c0aa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:25.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.051+0000 7fe08b7fe700 1 --2- 172.21.15.72:0/1469434804 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe08c139960 0x7fe08c147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:25.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.051+0000 7fe08affd700 1 -- 172.21.15.72:0/1469434804 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe08c139960 msgr2=0x7fe08c147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:25.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.051+0000 7fe08affd700 1 --2- 172.21.15.72:0/1469434804 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe08c139960 0x7fe08c147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:25.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.051+0000 7fe08affd700 1 -- 172.21.15.72:0/1469434804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe08c1542e0 msgr2=0x7fe08c0aa6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:25.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.051+0000 7fe08affd700 1 --2- 172.21.15.72:0/1469434804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe08c1542e0 0x7fe08c0aa6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:25.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.051+0000 7fe08affd700 1 -- 172.21.15.72:0/1469434804 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0800094a0 con 0x7fe08c139f80 2023-07-27T20:31:25.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.051+0000 7fe08bfff700 1 --2- 172.21.15.72:0/1469434804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe08c1542e0 0x7fe08c0aa6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:31:25.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.051+0000 7fe08b7fe700 1 --2- 172.21.15.72:0/1469434804 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe08c139960 0x7fe08c147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:31:25.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.052+0000 7fe08affd700 1 --2- 172.21.15.72:0/1469434804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe08c139f80 0x7fe08c147ec0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe0800090b0 tx=0x7fe080004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:25.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.052+0000 7fe073fff700 1 -- 172.21.15.72:0/1469434804 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe080011630 con 0x7fe08c139f80 2023-07-27T20:31:25.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.052+0000 7fe073fff700 1 -- 172.21.15.72:0/1469434804 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe080011790 con 0x7fe08c139f80 2023-07-27T20:31:25.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.052+0000 7fe0921ff700 1 -- 172.21.15.72:0/1469434804 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe08c1eddc0 con 0x7fe08c139f80 2023-07-27T20:31:25.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.052+0000 7fe073fff700 1 -- 172.21.15.72:0/1469434804 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe080011b20 con 0x7fe08c139f80 2023-07-27T20:31:25.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.052+0000 7fe0921ff700 1 -- 172.21.15.72:0/1469434804 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe08c1ea070 con 0x7fe08c139f80 2023-07-27T20:31:25.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.053+0000 7fe0921ff700 1 -- 172.21.15.72:0/1469434804 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe08c074310 con 0x7fe08c139f80 2023-07-27T20:31:25.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.054+0000 7fe073fff700 1 -- 172.21.15.72:0/1469434804 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe080018040 con 0x7fe08c139f80 2023-07-27T20:31:25.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.055+0000 7fe073fff700 1 --2- 172.21.15.72:0/1469434804 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe07806ace0 0x7fe07806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:25.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.055+0000 7fe073fff700 1 -- 172.21.15.72:0/1469434804 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe080089980 con 0x7fe08c139f80 2023-07-27T20:31:25.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.056+0000 7fe08b7fe700 1 --2- 172.21.15.72:0/1469434804 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe07806ace0 0x7fe07806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:25.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.057+0000 7fe08b7fe700 1 --2- 172.21.15.72:0/1469434804 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe07806ace0 0x7fe07806d1a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe07c005910 tx=0x7fe07c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:25.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.060+0000 7fe073fff700 1 -- 172.21.15.72:0/1469434804 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe080054e10 con 0x7fe08c139f80 2023-07-27T20:31:25.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.258+0000 7fe0921ff700 1 -- 172.21.15.72:0/1469434804 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe08c0ab420 con 0x7fe08c139f80 2023-07-27T20:31:25.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.259+0000 7fe073fff700 1 -- 172.21.15.72:0/1469434804 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14636 (secure 0 0 0) 0x7fe080016090 con 0x7fe08c139f80 2023-07-27T20:31:25.248 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:31:25.248 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":19,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:31:23.837623+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:31:25.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.261+0000 7fe0921ff700 1 -- 172.21.15.72:0/1469434804 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe07806ace0 msgr2=0x7fe07806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:25.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.261+0000 7fe0921ff700 1 --2- 172.21.15.72:0/1469434804 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe07806ace0 0x7fe07806d1a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe07c005910 tx=0x7fe07c009040 comp rx=0 tx=0).stop 2023-07-27T20:31:25.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.261+0000 7fe0921ff700 1 -- 172.21.15.72:0/1469434804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe08c139f80 msgr2=0x7fe08c147ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:25.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.261+0000 7fe0921ff700 1 --2- 172.21.15.72:0/1469434804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe08c139f80 0x7fe08c147ec0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe0800090b0 tx=0x7fe080004750 comp rx=0 tx=0).stop 2023-07-27T20:31:25.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.261+0000 7fe0921ff700 1 -- 172.21.15.72:0/1469434804 shutdown_connections 2023-07-27T20:31:25.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.261+0000 7fe0921ff700 1 --2- 172.21.15.72:0/1469434804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe08c1542e0 0x7fe08c0aa6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:25.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.261+0000 7fe0921ff700 1 --2- 172.21.15.72:0/1469434804 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe07806ace0 0x7fe07806d1a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:25.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.261+0000 7fe0921ff700 1 --2- 172.21.15.72:0/1469434804 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe08c139960 0x7fe08c147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:25.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.261+0000 7fe0921ff700 1 --2- 172.21.15.72:0/1469434804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe08c139f80 0x7fe08c147ec0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:25.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.261+0000 7fe0921ff700 1 -- 172.21.15.72:0/1469434804 >> 172.21.15.72:0/1469434804 conn(0x7fe08c06a190 msgr2=0x7fe08c070c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:25.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.261+0000 7fe0921ff700 1 -- 172.21.15.72:0/1469434804 shutdown_connections 2023-07-27T20:31:25.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.262+0000 7fe0921ff700 1 -- 172.21.15.72:0/1469434804 wait complete. 2023-07-27T20:31:25.268 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-27T20:31:14.581785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T20:31:21.077941+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-27T20:31:25.271 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-27T20:31:25.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.481+0000 7f58c35ff700 1 Processor -- start 2023-07-27T20:31:25.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.481+0000 7f58c35ff700 1 -- start start 2023-07-27T20:31:25.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.482+0000 7f58c35ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58bc06ffc0 0x7f58bc0c6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:25.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.482+0000 7f58c35ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58bc06d1c0 con 0x7f58bc0c6c50 2023-07-27T20:31:25.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.482+0000 7f58c35ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58bc155070 con 0x7f58bc0c77c0 2023-07-27T20:31:25.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.482+0000 7f58c35ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc06ce90 con 0x7f58bc06ffc0 2023-07-27T20:31:25.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.482+0000 7f58c1b9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f58bc0c6c50 0x7f58bc0c3e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39750/0 (socket says 172.21.15.72:39750) 2023-07-27T20:31:25.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.482+0000 7f58c1b9c700 1 -- 172.21.15.72:0/1358467513 learned_addr learned my addr 172.21.15.72:0/1358467513 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:25.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.482+0000 7f58c0b9a700 1 --2- 172.21.15.72:0/1358467513 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58bc06ffc0 0x7f58bc0c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:25.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.483+0000 7f58b3fff700 1 -- 172.21.15.72:0/1358467513 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4283800198 0 0) 0x7f58bc06d1c0 con 0x7f58bc0c6c50 2023-07-27T20:31:25.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.483+0000 7f58b3fff700 1 -- 172.21.15.72:0/1358467513 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58a80035b0 con 0x7f58bc0c6c50 2023-07-27T20:31:25.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.483+0000 7f58b3fff700 1 -- 172.21.15.72:0/1358467513 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 140026261 0 0) 0x7f58bc155070 con 0x7f58bc0c77c0 2023-07-27T20:31:25.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.483+0000 7f58b3fff700 1 -- 172.21.15.72:0/1358467513 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58bc06d1c0 con 0x7f58bc0c77c0 2023-07-27T20:31:25.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.483+0000 7f58b3fff700 1 -- 172.21.15.72:0/1358467513 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4229306967 0 0) 0x7f58a80035b0 con 0x7f58bc0c6c50 2023-07-27T20:31:25.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.483+0000 7f58b3fff700 1 -- 172.21.15.72:0/1358467513 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58bc06ffc0 msgr2=0x7f58bc0c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:25.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.483+0000 7f58b3fff700 1 --2- 172.21.15.72:0/1358467513 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58bc06ffc0 0x7f58bc0c6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:25.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.483+0000 7f58b3fff700 1 -- 172.21.15.72:0/1358467513 >> v1:172.21.15.173:6789/0 conn(0x7f58bc0c77c0 legacy=0x7f58bc151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:25.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.483+0000 7f58b3fff700 1 -- 172.21.15.72:0/1358467513 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58bc154d90 con 0x7f58bc0c6c50 2023-07-27T20:31:25.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.483+0000 7f58b3fff700 1 -- 172.21.15.72:0/1358467513 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f58b40019f0 con 0x7f58bc0c6c50 2023-07-27T20:31:25.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.483+0000 7f58b3fff700 1 -- 172.21.15.72:0/1358467513 >> v1:172.21.15.72:6789/0 conn(0x7f58bc0c6c50 legacy=0x7f58bc0c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:25.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.483+0000 7f58b3fff700 1 --2- 172.21.15.72:0/1358467513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58a8003bc0 0x7f58a8003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:25.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.483+0000 7f58b3fff700 1 --2- 172.21.15.72:0/1358467513 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58bc06ffc0 0x7f58a8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:25.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.483+0000 7f58b3fff700 1 --2- 172.21.15.72:0/1358467513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58a8004d90 0x7f58a8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:25.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.483+0000 7f58b3fff700 1 -- 172.21.15.72:0/1358467513 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc06ce90 con 0x7f58a8004d90 2023-07-27T20:31:25.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.483+0000 7f58b3fff700 1 -- 172.21.15.72:0/1358467513 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a800bc20 con 0x7f58a8003bc0 2023-07-27T20:31:25.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.483+0000 7f58b3fff700 1 -- 172.21.15.72:0/1358467513 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a800bde0 con 0x7f58bc06ffc0 2023-07-27T20:31:25.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.483+0000 7f58c1b9c700 1 --2- 172.21.15.72:0/1358467513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58a8004d90 0x7f58a8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:25.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.483+0000 7f58c139b700 1 --2- 172.21.15.72:0/1358467513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58a8003bc0 0x7f58a8003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:25.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.483+0000 7f58c0b9a700 1 --2- 172.21.15.72:0/1358467513 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58bc06ffc0 0x7f58a8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:25.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.484+0000 7f58c1b9c700 1 -- 172.21.15.72:0/1358467513 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58bc06ffc0 msgr2=0x7f58a8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:25.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.484+0000 7f58c1b9c700 1 --2- 172.21.15.72:0/1358467513 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58bc06ffc0 0x7f58a8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:25.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.484+0000 7f58c1b9c700 1 -- 172.21.15.72:0/1358467513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58a8003bc0 msgr2=0x7f58a8003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:25.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.484+0000 7f58c1b9c700 1 --2- 172.21.15.72:0/1358467513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58a8003bc0 0x7f58a8003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:25.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.484+0000 7f58c1b9c700 1 -- 172.21.15.72:0/1358467513 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a80035b0 con 0x7f58a8004d90 2023-07-27T20:31:25.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.484+0000 7f58c1b9c700 1 --2- 172.21.15.72:0/1358467513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58a8004d90 0x7f58a8005210 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f58b400a710 tx=0x7f58a8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc5d3e13a9bc02c8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:25.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.484+0000 7f58b3fff700 1 -- 172.21.15.72:0/1358467513 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b40072d0 con 0x7f58a8004d90 2023-07-27T20:31:25.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.484+0000 7f58b3fff700 1 -- 172.21.15.72:0/1358467513 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b4007430 con 0x7f58a8004d90 2023-07-27T20:31:25.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.484+0000 7f58b3fff700 1 -- 172.21.15.72:0/1358467513 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b40077e0 con 0x7f58a8004d90 2023-07-27T20:31:25.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.484+0000 7f58c35ff700 1 -- 172.21.15.72:0/1358467513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58a8004d90 msgr2=0x7f58a8005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:25.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.485+0000 7f58c35ff700 1 --2- 172.21.15.72:0/1358467513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58a8004d90 0x7f58a8005210 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f58b400a710 tx=0x7f58a8005880 comp rx=0 tx=0).stop 2023-07-27T20:31:25.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.485+0000 7f58c1b9c700 1 -- 172.21.15.72:0/1358467513 reap_dead start 2023-07-27T20:31:25.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.485+0000 7f58c35ff700 1 -- 172.21.15.72:0/1358467513 shutdown_connections 2023-07-27T20:31:25.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.485+0000 7f58c35ff700 1 -- 172.21.15.72:0/1358467513 >> 172.21.15.72:0/1358467513 conn(0x7f58bc06a190 msgr2=0x7f58bc06a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:25.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.485+0000 7f58c35ff700 1 -- 172.21.15.72:0/1358467513 shutdown_connections 2023-07-27T20:31:25.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.485+0000 7f58c35ff700 1 -- 172.21.15.72:0/1358467513 wait complete. 2023-07-27T20:31:25.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.486+0000 7f58c35ff700 1 Processor -- start 2023-07-27T20:31:25.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.487+0000 7f58c35ff700 1 -- start start 2023-07-27T20:31:25.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.487+0000 7f58c35ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58a8004d90 0x7f58bc14efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:25.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.487+0000 7f58c35ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58bc0ad650 0x7f58bc14f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:25.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.487+0000 7f58c35ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58bc1ecaf0 0x7f58bc1ecf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:25.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.487+0000 7f58c35ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc1e1290 con 0x7f58bc1ecaf0 2023-07-27T20:31:25.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.487+0000 7f58c35ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc157e60 con 0x7f58a8004d90 2023-07-27T20:31:25.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.487+0000 7f58c35ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc1ed4b0 con 0x7f58bc0ad650 2023-07-27T20:31:25.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.488+0000 7f58c1b9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58bc1ecaf0 0x7f58bc1ecf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:25.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.488+0000 7f58c1b9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58bc1ecaf0 0x7f58bc1ecf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47848/0 (socket says 172.21.15.72:47848) 2023-07-27T20:31:25.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.488+0000 7f58c1b9c700 1 -- 172.21.15.72:0/2326290020 learned_addr learned my addr 172.21.15.72:0/2326290020 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:25.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.488+0000 7f58c139b700 1 --2- 172.21.15.72:0/2326290020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58a8004d90 0x7f58bc14efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:25.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.488+0000 7f58c0b9a700 1 --2- 172.21.15.72:0/2326290020 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58bc0ad650 0x7f58bc14f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:25.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.488+0000 7f58c1b9c700 1 -- 172.21.15.72:0/2326290020 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58bc0ad650 msgr2=0x7f58bc14f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:25.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.488+0000 7f58c1b9c700 1 --2- 172.21.15.72:0/2326290020 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58bc0ad650 0x7f58bc14f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:25.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.488+0000 7f58c1b9c700 1 -- 172.21.15.72:0/2326290020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58a8004d90 msgr2=0x7f58bc14efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:25.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.488+0000 7f58c1b9c700 1 --2- 172.21.15.72:0/2326290020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58a8004d90 0x7f58bc14efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:25.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.488+0000 7f58c1b9c700 1 -- 172.21.15.72:0/2326290020 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58bc14fb60 con 0x7f58bc1ecaf0 2023-07-27T20:31:25.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.488+0000 7f58c1b9c700 1 --2- 172.21.15.72:0/2326290020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58bc1ecaf0 0x7f58bc1ecf70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f58b400ad00 tx=0x7f58b4001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:25.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.489+0000 7f58b1ffb700 1 -- 172.21.15.72:0/2326290020 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b4025030 con 0x7f58bc1ecaf0 2023-07-27T20:31:25.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.489+0000 7f58b1ffb700 1 -- 172.21.15.72:0/2326290020 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b40079d0 con 0x7f58bc1ecaf0 2023-07-27T20:31:25.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.489+0000 7f58b1ffb700 1 -- 172.21.15.72:0/2326290020 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b4012640 con 0x7f58bc1ecaf0 2023-07-27T20:31:25.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.489+0000 7f58c35ff700 1 -- 172.21.15.72:0/2326290020 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58bc0a9340 con 0x7f58bc1ecaf0 2023-07-27T20:31:25.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.489+0000 7f58c35ff700 1 -- 172.21.15.72:0/2326290020 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58bc158390 con 0x7f58bc1ecaf0 2023-07-27T20:31:25.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.490+0000 7f58c35ff700 1 -- 172.21.15.72:0/2326290020 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58bc04e470 con 0x7f58bc1ecaf0 2023-07-27T20:31:25.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.491+0000 7f58b1ffb700 1 -- 172.21.15.72:0/2326290020 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f58b4028070 con 0x7f58bc1ecaf0 2023-07-27T20:31:25.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.491+0000 7f58b1ffb700 1 --2- 172.21.15.72:0/2326290020 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f58a006ad10 0x7f58a006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:25.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.492+0000 7f58b1ffb700 1 -- 172.21.15.72:0/2326290020 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f58b4026070 con 0x7f58bc1ecaf0 2023-07-27T20:31:25.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.492+0000 7f58c139b700 1 --2- 172.21.15.72:0/2326290020 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f58a006ad10 0x7f58a006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:25.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.493+0000 7f58c139b700 1 --2- 172.21.15.72:0/2326290020 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f58a006ad10 0x7f58a006d1d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f58b8007fd0 tx=0x7f58b8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:25.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.495+0000 7f58b1ffb700 1 -- 172.21.15.72:0/2326290020 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f58b4055f90 con 0x7f58bc1ecaf0 2023-07-27T20:31:25.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.689+0000 7f58c35ff700 1 -- 172.21.15.72:0/2326290020 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f58bc06fda0 con 0x7f58bc1ecaf0 2023-07-27T20:31:25.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.690+0000 7f58b1ffb700 1 -- 172.21.15.72:0/2326290020 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f58b40595b0 con 0x7f58bc1ecaf0 2023-07-27T20:31:25.680 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-27T20:31:25.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.692+0000 7f58c35ff700 1 -- 172.21.15.72:0/2326290020 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f58a006ad10 msgr2=0x7f58a006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:25.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.692+0000 7f58c35ff700 1 --2- 172.21.15.72:0/2326290020 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f58a006ad10 0x7f58a006d1d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f58b8007fd0 tx=0x7f58b8009040 comp rx=0 tx=0).stop 2023-07-27T20:31:25.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.692+0000 7f58c35ff700 1 -- 172.21.15.72:0/2326290020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58bc1ecaf0 msgr2=0x7f58bc1ecf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:25.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.692+0000 7f58c35ff700 1 --2- 172.21.15.72:0/2326290020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58bc1ecaf0 0x7f58bc1ecf70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f58b400ad00 tx=0x7f58b4001cb0 comp rx=0 tx=0).stop 2023-07-27T20:31:25.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.692+0000 7f58c35ff700 1 -- 172.21.15.72:0/2326290020 shutdown_connections 2023-07-27T20:31:25.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.692+0000 7f58c35ff700 1 --2- 172.21.15.72:0/2326290020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58bc1ecaf0 0x7f58bc1ecf70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:25.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.692+0000 7f58c35ff700 1 --2- 172.21.15.72:0/2326290020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58a8004d90 0x7f58bc14efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:25.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.692+0000 7f58c35ff700 1 --2- 172.21.15.72:0/2326290020 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f58a006ad10 0x7f58a006d1d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:25.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.692+0000 7f58c35ff700 1 --2- 172.21.15.72:0/2326290020 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58bc0ad650 0x7f58bc14f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:25.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.692+0000 7f58c35ff700 1 -- 172.21.15.72:0/2326290020 >> 172.21.15.72:0/2326290020 conn(0x7f58bc06a190 msgr2=0x7f58bc153210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:25.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.692+0000 7f58c35ff700 1 -- 172.21.15.72:0/2326290020 shutdown_connections 2023-07-27T20:31:25.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.692+0000 7f58c35ff700 1 -- 172.21.15.72:0/2326290020 wait complete. 2023-07-27T20:31:25.699 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T20:31:25.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.908+0000 7fd8435ff700 1 Processor -- start 2023-07-27T20:31:25.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.908+0000 7fd8435ff700 1 -- start start 2023-07-27T20:31:25.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.909+0000 7fd8435ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd83c14aab0 0x7fd83c154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:25.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.909+0000 7fd8435ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd83c0c7740 0x7fd83c0c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:25.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.910+0000 7fd8435ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd83c0c7c50 con 0x7fd83c0c4700 2023-07-27T20:31:25.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.910+0000 7fd8435ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd83c06bd40 con 0x7fd83c0c7740 2023-07-27T20:31:25.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.910+0000 7fd8435ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd83c0c62f0 con 0x7fd83c14aab0 2023-07-27T20:31:25.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.910+0000 7fd840b9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd83c0c7740 0x7fd83c0c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:25.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.910+0000 7fd840b9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd83c0c7740 0x7fd83c0c41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47858/0 (socket says 172.21.15.72:47858) 2023-07-27T20:31:25.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.910+0000 7fd840b9a700 1 -- 172.21.15.72:0/3505728288 learned_addr learned my addr 172.21.15.72:0/3505728288 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:25.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.910+0000 7fd840b9a700 1 -- 172.21.15.72:0/3505728288 >> v2:172.21.15.173:3300/0 conn(0x7fd83c14aab0 msgr2=0x7fd83c154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:25.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.910+0000 7fd84139b700 1 --2- 172.21.15.72:0/3505728288 >> v2:172.21.15.173:3300/0 conn(0x7fd83c14aab0 0x7fd83c154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:25.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.910+0000 7fd840b9a700 1 --2- 172.21.15.72:0/3505728288 >> v2:172.21.15.173:3300/0 conn(0x7fd83c14aab0 0x7fd83c154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:25.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.910+0000 7fd840b9a700 1 -- 172.21.15.72:0/3505728288 >> v1:172.21.15.173:6789/0 conn(0x7fd83c0c4700 legacy=0x7fd83c06c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:25.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.910+0000 7fd840b9a700 1 -- 172.21.15.72:0/3505728288 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd83c155050 con 0x7fd83c0c7740 2023-07-27T20:31:25.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.910+0000 7fd84139b700 1 --2- 172.21.15.72:0/3505728288 >> v2:172.21.15.173:3300/0 conn(0x7fd83c14aab0 0x7fd83c154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:31:25.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.910+0000 7fd840b9a700 1 --2- 172.21.15.72:0/3505728288 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd83c0c7740 0x7fd83c0c41c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd83c06ad20 tx=0x7fd82c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e3ad2a496cc15d4 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:25.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.911+0000 7fd833fff700 1 -- 172.21.15.72:0/3505728288 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c004230 con 0x7fd83c0c7740 2023-07-27T20:31:25.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.911+0000 7fd833fff700 1 -- 172.21.15.72:0/3505728288 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82c004390 con 0x7fd83c0c7740 2023-07-27T20:31:25.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.911+0000 7fd833fff700 1 -- 172.21.15.72:0/3505728288 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c0036a0 con 0x7fd83c0c7740 2023-07-27T20:31:25.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.911+0000 7fd8435ff700 1 -- 172.21.15.72:0/3505728288 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd83c0c7740 msgr2=0x7fd83c0c41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:25.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.911+0000 7fd8435ff700 1 --2- 172.21.15.72:0/3505728288 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd83c0c7740 0x7fd83c0c41c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd83c06ad20 tx=0x7fd82c009bd0 comp rx=0 tx=0).stop 2023-07-27T20:31:25.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.911+0000 7fd8435ff700 1 -- 172.21.15.72:0/3505728288 shutdown_connections 2023-07-27T20:31:25.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.911+0000 7fd8435ff700 1 --2- 172.21.15.72:0/3505728288 >> v2:172.21.15.173:3300/0 conn(0x7fd83c14aab0 0x7fd83c154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:25.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.911+0000 7fd8435ff700 1 --2- 172.21.15.72:0/3505728288 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd83c0c7740 0x7fd83c0c41c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:25.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.911+0000 7fd8435ff700 1 -- 172.21.15.72:0/3505728288 >> 172.21.15.72:0/3505728288 conn(0x7fd83c0ab3f0 msgr2=0x7fd83c0ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:25.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.911+0000 7fd8435ff700 1 -- 172.21.15.72:0/3505728288 shutdown_connections 2023-07-27T20:31:25.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.911+0000 7fd8435ff700 1 -- 172.21.15.72:0/3505728288 wait complete. 2023-07-27T20:31:25.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.913+0000 7fd8435ff700 1 Processor -- start 2023-07-27T20:31:25.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.913+0000 7fd8435ff700 1 -- start start 2023-07-27T20:31:25.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.914+0000 7fd8435ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd83c0c4700 0x7fd83c148ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:25.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.914+0000 7fd8435ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd83c0c7740 0x7fd83c149010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:25.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.914+0000 7fd8435ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd83c14aab0 0x7fd83c150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:25.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.914+0000 7fd8435ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c14e730 con 0x7fd83c0c7740 2023-07-27T20:31:25.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.914+0000 7fd8435ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c14ef40 con 0x7fd83c14aab0 2023-07-27T20:31:25.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.914+0000 7fd8435ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c1edda0 con 0x7fd83c0c4700 2023-07-27T20:31:25.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.914+0000 7fd840b9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd83c0c7740 0x7fd83c149010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:25.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.914+0000 7fd840b9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd83c0c7740 0x7fd83c149010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47866/0 (socket says 172.21.15.72:47866) 2023-07-27T20:31:25.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.914+0000 7fd840b9a700 1 -- 172.21.15.72:0/1202721731 learned_addr learned my addr 172.21.15.72:0/1202721731 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:25.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.914+0000 7fd84139b700 1 --2- 172.21.15.72:0/1202721731 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd83c0c4700 0x7fd83c148ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:25.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.914+0000 7fd841b9c700 1 --2- 172.21.15.72:0/1202721731 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd83c14aab0 0x7fd83c150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:25.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.914+0000 7fd840b9a700 1 -- 172.21.15.72:0/1202721731 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd83c0c4700 msgr2=0x7fd83c148ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:25.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.914+0000 7fd840b9a700 1 --2- 172.21.15.72:0/1202721731 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd83c0c4700 0x7fd83c148ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:25.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.914+0000 7fd840b9a700 1 -- 172.21.15.72:0/1202721731 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd83c14aab0 msgr2=0x7fd83c150710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:25.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.914+0000 7fd840b9a700 1 --2- 172.21.15.72:0/1202721731 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd83c14aab0 0x7fd83c150710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:25.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.915+0000 7fd840b9a700 1 -- 172.21.15.72:0/1202721731 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82c009550 con 0x7fd83c0c7740 2023-07-27T20:31:25.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.915+0000 7fd840b9a700 1 --2- 172.21.15.72:0/1202721731 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd83c0c7740 0x7fd83c149010 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd82c009130 tx=0x7fd82c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:25.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.915+0000 7fd831ffb700 1 -- 172.21.15.72:0/1202721731 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c003d10 con 0x7fd83c0c7740 2023-07-27T20:31:25.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.915+0000 7fd831ffb700 1 -- 172.21.15.72:0/1202721731 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82c01f070 con 0x7fd83c0c7740 2023-07-27T20:31:25.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.915+0000 7fd8435ff700 1 -- 172.21.15.72:0/1202721731 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd83c14e980 con 0x7fd83c0c7740 2023-07-27T20:31:25.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.915+0000 7fd831ffb700 1 -- 172.21.15.72:0/1202721731 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c011870 con 0x7fd83c0c7740 2023-07-27T20:31:25.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.915+0000 7fd8435ff700 1 -- 172.21.15.72:0/1202721731 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd83c1eda30 con 0x7fd83c0c7740 2023-07-27T20:31:25.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.916+0000 7fd8435ff700 1 -- 172.21.15.72:0/1202721731 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd83c04e470 con 0x7fd83c0c7740 2023-07-27T20:31:25.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.917+0000 7fd831ffb700 1 -- 172.21.15.72:0/1202721731 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd82c021030 con 0x7fd83c0c7740 2023-07-27T20:31:25.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.918+0000 7fd831ffb700 1 --2- 172.21.15.72:0/1202721731 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd82006ace0 0x7fd82006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:25.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.918+0000 7fd831ffb700 1 -- 172.21.15.72:0/1202721731 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd82c08a720 con 0x7fd83c0c7740 2023-07-27T20:31:25.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.919+0000 7fd84139b700 1 --2- 172.21.15.72:0/1202721731 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd82006ace0 0x7fd82006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:25.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.919+0000 7fd84139b700 1 --2- 172.21.15.72:0/1202721731 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd82006ace0 0x7fd82006d1a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd838006fd0 tx=0x7fd838008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:25.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:25.922+0000 7fd831ffb700 1 -- 172.21.15.72:0/1202721731 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd82c055b10 con 0x7fd83c0c7740 2023-07-27T20:31:26.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.123+0000 7fd8435ff700 1 -- 172.21.15.72:0/1202721731 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd83c06cf00 con 0x7fd83c0c7740 2023-07-27T20:31:26.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.124+0000 7fd831ffb700 1 -- 172.21.15.72:0/1202721731 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd82c059130 con 0x7fd83c0c7740 2023-07-27T20:31:26.113 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-27T20:31:26.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.126+0000 7fd8435ff700 1 -- 172.21.15.72:0/1202721731 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd82006ace0 msgr2=0x7fd82006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:26.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.126+0000 7fd8435ff700 1 --2- 172.21.15.72:0/1202721731 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd82006ace0 0x7fd82006d1a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd838006fd0 tx=0x7fd838008040 comp rx=0 tx=0).stop 2023-07-27T20:31:26.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.126+0000 7fd8435ff700 1 -- 172.21.15.72:0/1202721731 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd83c0c7740 msgr2=0x7fd83c149010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:26.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.126+0000 7fd8435ff700 1 --2- 172.21.15.72:0/1202721731 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd83c0c7740 0x7fd83c149010 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd82c009130 tx=0x7fd82c004750 comp rx=0 tx=0).stop 2023-07-27T20:31:26.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.126+0000 7fd8435ff700 1 -- 172.21.15.72:0/1202721731 shutdown_connections 2023-07-27T20:31:26.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.126+0000 7fd8435ff700 1 --2- 172.21.15.72:0/1202721731 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd83c14aab0 0x7fd83c150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:26.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.126+0000 7fd8435ff700 1 --2- 172.21.15.72:0/1202721731 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd82006ace0 0x7fd82006d1a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:26.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.126+0000 7fd8435ff700 1 --2- 172.21.15.72:0/1202721731 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd83c0c4700 0x7fd83c148ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:26.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.126+0000 7fd8435ff700 1 --2- 172.21.15.72:0/1202721731 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd83c0c7740 0x7fd83c149010 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:26.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.126+0000 7fd8435ff700 1 -- 172.21.15.72:0/1202721731 >> 172.21.15.72:0/1202721731 conn(0x7fd83c0ab3f0 msgr2=0x7fd83c151f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:26.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.126+0000 7fd8435ff700 1 -- 172.21.15.72:0/1202721731 shutdown_connections 2023-07-27T20:31:26.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.126+0000 7fd8435ff700 1 -- 172.21.15.72:0/1202721731 wait complete. 2023-07-27T20:31:26.132 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-27T20:31:26.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.339+0000 7f442af9d700 1 Processor -- start 2023-07-27T20:31:26.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.340+0000 7f442af9d700 1 -- start start 2023-07-27T20:31:26.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.341+0000 7f442af9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4424151530 0x7f44240c4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:26.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.341+0000 7f442af9d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44240c5920 con 0x7f44241549f0 2023-07-27T20:31:26.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.341+0000 7f442af9d700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4424154560 con 0x7f44240c54c0 2023-07-27T20:31:26.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.341+0000 7f442af9d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4424154e80 con 0x7f4424151530 2023-07-27T20:31:26.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.341+0000 7f4429f9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4424151530 0x7f44240c4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:26.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.341+0000 7f442a79c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f44241549f0 0x7f442406aff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39756/0 (socket says 172.21.15.72:39756) 2023-07-27T20:31:26.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.341+0000 7f4429f9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4424151530 0x7f44240c4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47868/0 (socket says 172.21.15.72:47868) 2023-07-27T20:31:26.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.341+0000 7f442a79c700 1 -- 172.21.15.72:0/2650192409 learned_addr learned my addr 172.21.15.72:0/2650192409 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:26.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.341+0000 7f4429f9b700 1 -- 172.21.15.72:0/2650192409 >> v1:172.21.15.173:6789/0 conn(0x7f44240c54c0 legacy=0x7f44240c75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:26.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.341+0000 7f4429f9b700 1 -- 172.21.15.72:0/2650192409 >> v1:172.21.15.72:6789/0 conn(0x7f44241549f0 legacy=0x7f442406aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:26.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.341+0000 7f4429f9b700 1 -- 172.21.15.72:0/2650192409 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4424151910 con 0x7f4424151530 2023-07-27T20:31:26.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.341+0000 7f4429f9b700 1 --2- 172.21.15.72:0/2650192409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4424151530 0x7f44240c4ef0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4420009840 tx=0x7f4420009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11ef1ad089d6c5d1 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:26.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.342+0000 7f4428f99700 1 -- 172.21.15.72:0/2650192409 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4420004230 con 0x7f4424151530 2023-07-27T20:31:26.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.342+0000 7f4428f99700 1 -- 172.21.15.72:0/2650192409 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4420004390 con 0x7f4424151530 2023-07-27T20:31:26.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.342+0000 7f4428f99700 1 -- 172.21.15.72:0/2650192409 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44200036a0 con 0x7f4424151530 2023-07-27T20:31:26.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.342+0000 7f442af9d700 1 -- 172.21.15.72:0/2650192409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4424151530 msgr2=0x7f44240c4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:26.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.342+0000 7f442af9d700 1 --2- 172.21.15.72:0/2650192409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4424151530 0x7f44240c4ef0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4420009840 tx=0x7f4420009b50 comp rx=0 tx=0).stop 2023-07-27T20:31:26.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.342+0000 7f442af9d700 1 -- 172.21.15.72:0/2650192409 shutdown_connections 2023-07-27T20:31:26.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.342+0000 7f442af9d700 1 --2- 172.21.15.72:0/2650192409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4424151530 0x7f44240c4ef0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:26.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.342+0000 7f442af9d700 1 -- 172.21.15.72:0/2650192409 >> 172.21.15.72:0/2650192409 conn(0x7f44240c96a0 msgr2=0x7f44240c9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:26.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.342+0000 7f442af9d700 1 -- 172.21.15.72:0/2650192409 shutdown_connections 2023-07-27T20:31:26.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.342+0000 7f442af9d700 1 -- 172.21.15.72:0/2650192409 wait complete. 2023-07-27T20:31:26.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.345+0000 7f442af9d700 1 Processor -- start 2023-07-27T20:31:26.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.345+0000 7f442af9d700 1 -- start start 2023-07-27T20:31:26.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.346+0000 7f442af9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44240c54c0 0x7f44240c21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:26.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.346+0000 7f442af9d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4424151530 0x7f44240c30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:26.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.346+0000 7f442af9d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44241549f0 0x7f44240c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:26.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.346+0000 7f442af9d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4424157c20 con 0x7f44240c54c0 2023-07-27T20:31:26.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.346+0000 7f442af9d700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4424157660 con 0x7f44241549f0 2023-07-27T20:31:26.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.346+0000 7f442af9d700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4424157940 con 0x7f4424151530 2023-07-27T20:31:26.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.346+0000 7f4429f9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44240c54c0 0x7f44240c21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:26.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.346+0000 7f4429f9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44240c54c0 0x7f44240c21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47874/0 (socket says 172.21.15.72:47874) 2023-07-27T20:31:26.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.346+0000 7f4429f9b700 1 -- 172.21.15.72:0/618684035 learned_addr learned my addr 172.21.15.72:0/618684035 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:26.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.346+0000 7f442a79c700 1 --2- 172.21.15.72:0/618684035 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44241549f0 0x7f44240c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:26.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.346+0000 7f442979a700 1 --2- 172.21.15.72:0/618684035 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4424151530 0x7f44240c30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:26.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.346+0000 7f4429f9b700 1 -- 172.21.15.72:0/618684035 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4424151530 msgr2=0x7f44240c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:26.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.346+0000 7f4429f9b700 1 --2- 172.21.15.72:0/618684035 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4424151530 0x7f44240c30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:26.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.346+0000 7f4429f9b700 1 -- 172.21.15.72:0/618684035 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44241549f0 msgr2=0x7f44240c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:26.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.346+0000 7f4429f9b700 1 --2- 172.21.15.72:0/618684035 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44241549f0 0x7f44240c0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:26.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.346+0000 7f4429f9b700 1 -- 172.21.15.72:0/618684035 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44200094a0 con 0x7f44240c54c0 2023-07-27T20:31:26.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.346+0000 7f442a79c700 1 --2- 172.21.15.72:0/618684035 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44241549f0 0x7f44240c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:31:26.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.346+0000 7f442979a700 1 --2- 172.21.15.72:0/618684035 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4424151530 0x7f44240c30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:31:26.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.346+0000 7f4429f9b700 1 --2- 172.21.15.72:0/618684035 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44240c54c0 0x7f44240c21d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4420009b90 tx=0x7f4420004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:26.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.347+0000 7f441a7fc700 1 -- 172.21.15.72:0/618684035 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4420011630 con 0x7f44240c54c0 2023-07-27T20:31:26.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.347+0000 7f441a7fc700 1 -- 172.21.15.72:0/618684035 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f442001e070 con 0x7f44240c54c0 2023-07-27T20:31:26.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.347+0000 7f442af9d700 1 -- 172.21.15.72:0/618684035 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44241ed240 con 0x7f44240c54c0 2023-07-27T20:31:26.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.347+0000 7f441a7fc700 1 -- 172.21.15.72:0/618684035 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44200119d0 con 0x7f44240c54c0 2023-07-27T20:31:26.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.347+0000 7f442af9d700 1 -- 172.21.15.72:0/618684035 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44241ed4e0 con 0x7f44240c54c0 2023-07-27T20:31:26.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.348+0000 7f442af9d700 1 -- 172.21.15.72:0/618684035 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f442404ecc0 con 0x7f44240c54c0 2023-07-27T20:31:26.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.349+0000 7f441a7fc700 1 -- 172.21.15.72:0/618684035 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4420011b30 con 0x7f44240c54c0 2023-07-27T20:31:26.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.350+0000 7f441a7fc700 1 --2- 172.21.15.72:0/618684035 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f440806ace0 0x7f440806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:26.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.350+0000 7f441a7fc700 1 -- 172.21.15.72:0/618684035 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f442008a440 con 0x7f44240c54c0 2023-07-27T20:31:26.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.350+0000 7f442979a700 1 --2- 172.21.15.72:0/618684035 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f440806ace0 0x7f440806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:26.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.351+0000 7f442979a700 1 --2- 172.21.15.72:0/618684035 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f440806ace0 0x7f440806d1a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f442414d730 tx=0x7f4414009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:26.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.354+0000 7f441a7fc700 1 -- 172.21.15.72:0/618684035 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4420055830 con 0x7f44240c54c0 2023-07-27T20:31:26.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.551+0000 7f442af9d700 1 -- 172.21.15.72:0/618684035 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f44240c42c0 con 0x7f44240c54c0 2023-07-27T20:31:26.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.551+0000 7f441a7fc700 1 -- 172.21.15.72:0/618684035 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+126 (secure 0 0 0) 0x7f4420058e50 con 0x7f44240c54c0 2023-07-27T20:31:26.540 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:31:26.540 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2023-07-27T20:31:26.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:31:26.541 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 1, 2023-07-27T20:31:26.541 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": ".mgr" 2023-07-27T20:31:26.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:31:26.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:31:26.541 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 2, 2023-07-27T20:31:26.542 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "rbd" 2023-07-27T20:31:26.542 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:31:26.542 INFO:teuthology.orchestra.run.smithi072.stdout:] 2023-07-27T20:31:26.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.554+0000 7f442af9d700 1 -- 172.21.15.72:0/618684035 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f440806ace0 msgr2=0x7f440806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:26.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.554+0000 7f442af9d700 1 --2- 172.21.15.72:0/618684035 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f440806ace0 0x7f440806d1a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f442414d730 tx=0x7f4414009040 comp rx=0 tx=0).stop 2023-07-27T20:31:26.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.554+0000 7f442af9d700 1 -- 172.21.15.72:0/618684035 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44240c54c0 msgr2=0x7f44240c21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:26.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.554+0000 7f442af9d700 1 --2- 172.21.15.72:0/618684035 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44240c54c0 0x7f44240c21d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4420009b90 tx=0x7f4420004750 comp rx=0 tx=0).stop 2023-07-27T20:31:26.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.554+0000 7f442af9d700 1 -- 172.21.15.72:0/618684035 shutdown_connections 2023-07-27T20:31:26.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.554+0000 7f442af9d700 1 --2- 172.21.15.72:0/618684035 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44241549f0 0x7f44240c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:26.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.554+0000 7f442af9d700 1 --2- 172.21.15.72:0/618684035 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44240c54c0 0x7f44240c21d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:26.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.554+0000 7f442af9d700 1 --2- 172.21.15.72:0/618684035 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f440806ace0 0x7f440806d1a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:26.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.554+0000 7f442af9d700 1 --2- 172.21.15.72:0/618684035 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4424151530 0x7f44240c30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:26.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.554+0000 7f442af9d700 1 -- 172.21.15.72:0/618684035 >> 172.21.15.72:0/618684035 conn(0x7f44240c96a0 msgr2=0x7f442414fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:26.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.554+0000 7f442af9d700 1 -- 172.21.15.72:0/618684035 shutdown_connections 2023-07-27T20:31:26.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.554+0000 7f442af9d700 1 -- 172.21.15.72:0/618684035 wait complete. 2023-07-27T20:31:26.561 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-27T20:31:26.561 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-27T20:31:26.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.771+0000 7efdbe39d700 1 Processor -- start 2023-07-27T20:31:26.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.771+0000 7efdbe39d700 1 -- start start 2023-07-27T20:31:26.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.772+0000 7efdbe39d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efdb81513b0 0x7efdb806abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:26.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.772+0000 7efdbe39d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efdb80c4d10 0x7efdb806b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:26.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.772+0000 7efdbe39d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdb8154930 con 0x7efdb80c5b50 2023-07-27T20:31:26.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.772+0000 7efdbe39d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb806c460 con 0x7efdb80c4d10 2023-07-27T20:31:26.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.772+0000 7efdbe39d700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb80c7c50 con 0x7efdb81513b0 2023-07-27T20:31:26.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.773+0000 7efdbdb9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efdb80c4d10 0x7efdb806b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:26.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.773+0000 7efdbdb9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efdb80c4d10 0x7efdb806b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47882/0 (socket says 172.21.15.72:47882) 2023-07-27T20:31:26.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.773+0000 7efdbdb9c700 1 -- 172.21.15.72:0/750298170 learned_addr learned my addr 172.21.15.72:0/750298170 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:26.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.773+0000 7efdbcb9a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7efdb80c5b50 0x7efdb80c7540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39770/0 (socket says 172.21.15.72:39770) 2023-07-27T20:31:26.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.773+0000 7efdbd39b700 1 --2- 172.21.15.72:0/750298170 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efdb81513b0 0x7efdb806abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:26.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.773+0000 7efdbdb9c700 1 -- 172.21.15.72:0/750298170 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efdb81513b0 msgr2=0x7efdb806abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:26.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.773+0000 7efdbdb9c700 1 --2- 172.21.15.72:0/750298170 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efdb81513b0 0x7efdb806abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:26.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.773+0000 7efdbdb9c700 1 -- 172.21.15.72:0/750298170 >> v1:172.21.15.72:6789/0 conn(0x7efdb80c5b50 legacy=0x7efdb80c7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:26.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.773+0000 7efdbdb9c700 1 -- 172.21.15.72:0/750298170 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb80c49c0 con 0x7efdb80c4d10 2023-07-27T20:31:26.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.773+0000 7efdaffff700 1 -- 172.21.15.72:0/750298170 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3132697760 0 0) 0x7efdb8154930 con 0x7efdb80c5b50 2023-07-27T20:31:26.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.773+0000 7efdbdb9c700 1 --2- 172.21.15.72:0/750298170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdb80c4d10 0x7efdb806b280 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efdb0009920 tx=0x7efdb0009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf3582d8477770f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:26.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.774+0000 7efdaffff700 1 -- 172.21.15.72:0/750298170 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb0011830 con 0x7efdb80c4d10 2023-07-27T20:31:26.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.774+0000 7efdaffff700 1 -- 172.21.15.72:0/750298170 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb0011990 con 0x7efdb80c4d10 2023-07-27T20:31:26.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.774+0000 7efdaffff700 1 -- 172.21.15.72:0/750298170 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb0011d20 con 0x7efdb80c4d10 2023-07-27T20:31:26.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.774+0000 7efdbe39d700 1 -- 172.21.15.72:0/750298170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdb80c4d10 msgr2=0x7efdb806b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:26.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.774+0000 7efdbe39d700 1 --2- 172.21.15.72:0/750298170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdb80c4d10 0x7efdb806b280 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efdb0009920 tx=0x7efdb0009c30 comp rx=0 tx=0).stop 2023-07-27T20:31:26.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.774+0000 7efdbe39d700 1 -- 172.21.15.72:0/750298170 shutdown_connections 2023-07-27T20:31:26.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.774+0000 7efdbe39d700 1 --2- 172.21.15.72:0/750298170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdb80c4d10 0x7efdb806b280 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:26.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.774+0000 7efdbe39d700 1 --2- 172.21.15.72:0/750298170 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efdb81513b0 0x7efdb806abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:26.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.774+0000 7efdbe39d700 1 -- 172.21.15.72:0/750298170 >> 172.21.15.72:0/750298170 conn(0x7efdb80ab130 msgr2=0x7efdb80ab540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:26.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.774+0000 7efdbe39d700 1 -- 172.21.15.72:0/750298170 shutdown_connections 2023-07-27T20:31:26.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.774+0000 7efdbe39d700 1 -- 172.21.15.72:0/750298170 wait complete. 2023-07-27T20:31:26.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.776+0000 7efdbe39d700 1 Processor -- start 2023-07-27T20:31:26.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.776+0000 7efdbe39d700 1 -- start start 2023-07-27T20:31:26.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.777+0000 7efdbe39d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efdb80c4d10 0x7efdb8153120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:26.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.777+0000 7efdbe39d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdb80c5b50 0x7efdb8157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:26.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.777+0000 7efdbe39d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efdb81513b0 0x7efdb8157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:26.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.777+0000 7efdbe39d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb80c3250 con 0x7efdb80c5b50 2023-07-27T20:31:26.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.777+0000 7efdbe39d700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb81ed270 con 0x7efdb81513b0 2023-07-27T20:31:26.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.777+0000 7efdbe39d700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb81ed550 con 0x7efdb80c4d10 2023-07-27T20:31:26.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.777+0000 7efdbcb9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdb80c5b50 0x7efdb8157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:26.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.777+0000 7efdbcb9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdb80c5b50 0x7efdb8157010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47892/0 (socket says 172.21.15.72:47892) 2023-07-27T20:31:26.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.777+0000 7efdbcb9a700 1 -- 172.21.15.72:0/2091612934 learned_addr learned my addr 172.21.15.72:0/2091612934 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:26.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.777+0000 7efdbcb9a700 1 -- 172.21.15.72:0/2091612934 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efdb80c4d10 msgr2=0x7efdb8153120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:26.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.777+0000 7efdbcb9a700 1 --2- 172.21.15.72:0/2091612934 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efdb80c4d10 0x7efdb8153120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:26.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.777+0000 7efdbcb9a700 1 -- 172.21.15.72:0/2091612934 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efdb81513b0 msgr2=0x7efdb8157550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:26.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.777+0000 7efdbcb9a700 1 --2- 172.21.15.72:0/2091612934 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efdb81513b0 0x7efdb8157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:26.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.778+0000 7efdbcb9a700 1 -- 172.21.15.72:0/2091612934 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb0009550 con 0x7efdb80c5b50 2023-07-27T20:31:26.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.778+0000 7efdbcb9a700 1 --2- 172.21.15.72:0/2091612934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdb80c5b50 0x7efdb8157010 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efda80011e0 tx=0x7efda800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:26.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.778+0000 7efdadffb700 1 -- 172.21.15.72:0/2091612934 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda8004c80 con 0x7efdb80c5b50 2023-07-27T20:31:26.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.778+0000 7efdadffb700 1 -- 172.21.15.72:0/2091612934 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda8004e00 con 0x7efdb80c5b50 2023-07-27T20:31:26.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.778+0000 7efdbe39d700 1 -- 172.21.15.72:0/2091612934 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb81ed830 con 0x7efdb80c5b50 2023-07-27T20:31:26.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.778+0000 7efdadffb700 1 -- 172.21.15.72:0/2091612934 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda8007310 con 0x7efdb80c5b50 2023-07-27T20:31:26.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.778+0000 7efdbe39d700 1 -- 172.21.15.72:0/2091612934 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb81eddf0 con 0x7efdb80c5b50 2023-07-27T20:31:26.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.779+0000 7efdbe39d700 1 -- 172.21.15.72:0/2091612934 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb80c9080 con 0x7efdb80c5b50 2023-07-27T20:31:26.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.780+0000 7efdadffb700 1 -- 172.21.15.72:0/2091612934 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efda8007470 con 0x7efdb80c5b50 2023-07-27T20:31:26.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.781+0000 7efdadffb700 1 --2- 172.21.15.72:0/2091612934 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7efd9c06ace0 0x7efd9c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:26.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.781+0000 7efdadffb700 1 -- 172.21.15.72:0/2091612934 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7efda8088ff0 con 0x7efdb80c5b50 2023-07-27T20:31:26.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.782+0000 7efdbd39b700 1 --2- 172.21.15.72:0/2091612934 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7efd9c06ace0 0x7efd9c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:26.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.782+0000 7efdbd39b700 1 --2- 172.21.15.72:0/2091612934 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7efd9c06ace0 0x7efd9c06d1a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efdb4009fa0 tx=0x7efdb400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:26.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.785+0000 7efdadffb700 1 -- 172.21.15.72:0/2091612934 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7efda8054320 con 0x7efdb80c5b50 2023-07-27T20:31:26.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:26.981+0000 7efdbe39d700 1 -- 172.21.15.72:0/2091612934 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7efdb81ee010 con 0x7efdb80c5b50 2023-07-27T20:31:27.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.096+0000 7efdadffb700 1 -- 172.21.15.72:0/2091612934 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7efda8057940 con 0x7efdb80c5b50 2023-07-27T20:31:27.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.100+0000 7efdbe39d700 1 -- 172.21.15.72:0/2091612934 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7efd9c06ace0 msgr2=0x7efd9c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:27.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.100+0000 7efdbe39d700 1 --2- 172.21.15.72:0/2091612934 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7efd9c06ace0 0x7efd9c06d1a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efdb4009fa0 tx=0x7efdb400b040 comp rx=0 tx=0).stop 2023-07-27T20:31:27.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.100+0000 7efdbe39d700 1 -- 172.21.15.72:0/2091612934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdb80c5b50 msgr2=0x7efdb8157010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:27.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.100+0000 7efdbe39d700 1 --2- 172.21.15.72:0/2091612934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdb80c5b50 0x7efdb8157010 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efda80011e0 tx=0x7efda800cae0 comp rx=0 tx=0).stop 2023-07-27T20:31:27.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.100+0000 7efdbe39d700 1 -- 172.21.15.72:0/2091612934 shutdown_connections 2023-07-27T20:31:27.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.100+0000 7efdbe39d700 1 --2- 172.21.15.72:0/2091612934 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efdb81513b0 0x7efdb8157550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:27.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.100+0000 7efdbe39d700 1 --2- 172.21.15.72:0/2091612934 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7efd9c06ace0 0x7efd9c06d1a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:27.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.100+0000 7efdbe39d700 1 --2- 172.21.15.72:0/2091612934 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efdb80c4d10 0x7efdb8153120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:27.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.100+0000 7efdbe39d700 1 --2- 172.21.15.72:0/2091612934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdb80c5b50 0x7efdb8157010 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:27.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.100+0000 7efdbe39d700 1 -- 172.21.15.72:0/2091612934 >> 172.21.15.72:0/2091612934 conn(0x7efdb80ab130 msgr2=0x7efdb814dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:27.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.100+0000 7efdbe39d700 1 -- 172.21.15.72:0/2091612934 shutdown_connections 2023-07-27T20:31:27.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.100+0000 7efdbe39d700 1 -- 172.21.15.72:0/2091612934 wait complete. 2023-07-27T20:31:27.091 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' created 2023-07-27T20:31:27.107 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-07-27T20:31:27.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.320+0000 7fb6e09ff700 1 Processor -- start 2023-07-27T20:31:27.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.320+0000 7fb6e09ff700 1 -- start start 2023-07-27T20:31:27.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.322+0000 7fb6e09ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb6dc0c4d60 0x7fb6dc0c45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:27.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.322+0000 7fb6e09ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb6dc0c7760 0x7fb6dc15e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:27.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.322+0000 7fb6e09ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6dc0ca7f0 con 0x7fb6dc0c41e0 2023-07-27T20:31:27.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.322+0000 7fb6e09ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6dc154060 con 0x7fb6dc0c4d60 2023-07-27T20:31:27.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.322+0000 7fb6e09ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6dc0c5990 con 0x7fb6dc0c7760 2023-07-27T20:31:27.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.322+0000 7fb6d3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb6dc0c4d60 0x7fb6dc0c45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:27.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.322+0000 7fb6d3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb6dc0c4d60 0x7fb6dc0c45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47896/0 (socket says 172.21.15.72:47896) 2023-07-27T20:31:27.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.322+0000 7fb6d3fff700 1 -- 172.21.15.72:0/1405345761 learned_addr learned my addr 172.21.15.72:0/1405345761 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:27.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.322+0000 7fb6da59c700 1 --1- 172.21.15.72:0/1405345761 >> v1:172.21.15.72:6789/0 conn(0x7fb6dc0c41e0 0x7fb6dc154770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39776/0 (socket says 172.21.15.72:39776) 2023-07-27T20:31:27.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.322+0000 7fb6dad9d700 1 --2- 172.21.15.72:0/1405345761 >> v2:172.21.15.173:3300/0 conn(0x7fb6dc0c7760 0x7fb6dc15e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:27.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.322+0000 7fb6d3fff700 1 -- 172.21.15.72:0/1405345761 >> v2:172.21.15.173:3300/0 conn(0x7fb6dc0c7760 msgr2=0x7fb6dc15e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:27.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.322+0000 7fb6d3fff700 1 --2- 172.21.15.72:0/1405345761 >> v2:172.21.15.173:3300/0 conn(0x7fb6dc0c7760 0x7fb6dc15e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:27.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.322+0000 7fb6d3fff700 1 -- 172.21.15.72:0/1405345761 >> v1:172.21.15.72:6789/0 conn(0x7fb6dc0c41e0 legacy=0x7fb6dc154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:27.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.322+0000 7fb6d3fff700 1 -- 172.21.15.72:0/1405345761 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6dc0c5c10 con 0x7fb6dc0c4d60 2023-07-27T20:31:27.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.323+0000 7fb6d3fff700 1 --2- 172.21.15.72:0/1405345761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6dc0c4d60 0x7fb6dc0c45c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc06ae80 tx=0x7fb6c4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=657c78de07d63a84 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:27.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.323+0000 7fb6d9d9b700 1 -- 172.21.15.72:0/1405345761 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c400b870 con 0x7fb6dc0c4d60 2023-07-27T20:31:27.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.323+0000 7fb6d9d9b700 1 -- 172.21.15.72:0/1405345761 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c400b9d0 con 0x7fb6dc0c4d60 2023-07-27T20:31:27.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.323+0000 7fb6d9d9b700 1 -- 172.21.15.72:0/1405345761 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c400bd60 con 0x7fb6dc0c4d60 2023-07-27T20:31:27.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.323+0000 7fb6e09ff700 1 -- 172.21.15.72:0/1405345761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6dc0c4d60 msgr2=0x7fb6dc0c45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:27.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.323+0000 7fb6e09ff700 1 --2- 172.21.15.72:0/1405345761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6dc0c4d60 0x7fb6dc0c45c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc06ae80 tx=0x7fb6c4009bd0 comp rx=0 tx=0).stop 2023-07-27T20:31:27.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.323+0000 7fb6e09ff700 1 -- 172.21.15.72:0/1405345761 shutdown_connections 2023-07-27T20:31:27.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.323+0000 7fb6e09ff700 1 --2- 172.21.15.72:0/1405345761 >> v2:172.21.15.173:3300/0 conn(0x7fb6dc0c7760 0x7fb6dc15e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:27.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.323+0000 7fb6e09ff700 1 --2- 172.21.15.72:0/1405345761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6dc0c4d60 0x7fb6dc0c45c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:27.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.323+0000 7fb6e09ff700 1 -- 172.21.15.72:0/1405345761 >> 172.21.15.72:0/1405345761 conn(0x7fb6dc0c9860 msgr2=0x7fb6dc0c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:27.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.324+0000 7fb6e09ff700 1 -- 172.21.15.72:0/1405345761 shutdown_connections 2023-07-27T20:31:27.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.324+0000 7fb6e09ff700 1 -- 172.21.15.72:0/1405345761 wait complete. 2023-07-27T20:31:27.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.325+0000 7fb6e09ff700 1 Processor -- start 2023-07-27T20:31:27.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.325+0000 7fb6e09ff700 1 -- start start 2023-07-27T20:31:27.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.326+0000 7fb6e09ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6dc0c41e0 0x7fb6dc0c3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:27.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.326+0000 7fb6e09ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6dc0c4d60 0x7fb6dc0aa5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:27.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.326+0000 7fb6e09ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb6dc0c7760 0x7fb6dc0bd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:27.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.326+0000 7fb6e09ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6dc14fdd0 con 0x7fb6dc0c4d60 2023-07-27T20:31:27.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.326+0000 7fb6e09ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6dc0c2390 con 0x7fb6dc0c41e0 2023-07-27T20:31:27.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.326+0000 7fb6e09ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6dc0c3370 con 0x7fb6dc0c7760 2023-07-27T20:31:27.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.326+0000 7fb6d3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6dc0c4d60 0x7fb6dc0aa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:27.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.327+0000 7fb6d3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6dc0c4d60 0x7fb6dc0aa5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47902/0 (socket says 172.21.15.72:47902) 2023-07-27T20:31:27.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.327+0000 7fb6d3fff700 1 -- 172.21.15.72:0/2940335161 learned_addr learned my addr 172.21.15.72:0/2940335161 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:27.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.327+0000 7fb6da59c700 1 --2- 172.21.15.72:0/2940335161 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6dc0c41e0 0x7fb6dc0c3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:27.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.327+0000 7fb6dad9d700 1 --2- 172.21.15.72:0/2940335161 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb6dc0c7760 0x7fb6dc0bd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:27.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.327+0000 7fb6d3fff700 1 -- 172.21.15.72:0/2940335161 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb6dc0c7760 msgr2=0x7fb6dc0bd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:27.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.327+0000 7fb6d3fff700 1 --2- 172.21.15.72:0/2940335161 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb6dc0c7760 0x7fb6dc0bd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:27.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.327+0000 7fb6d3fff700 1 -- 172.21.15.72:0/2940335161 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6dc0c41e0 msgr2=0x7fb6dc0c3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:27.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.327+0000 7fb6d3fff700 1 --2- 172.21.15.72:0/2940335161 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6dc0c41e0 0x7fb6dc0c3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:27.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.327+0000 7fb6d3fff700 1 -- 172.21.15.72:0/2940335161 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c4009550 con 0x7fb6dc0c4d60 2023-07-27T20:31:27.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.327+0000 7fb6dad9d700 1 --2- 172.21.15.72:0/2940335161 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb6dc0c7760 0x7fb6dc0bd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:31:27.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.327+0000 7fb6da59c700 1 --2- 172.21.15.72:0/2940335161 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6dc0c41e0 0x7fb6dc0c3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:31:27.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.327+0000 7fb6d3fff700 1 --2- 172.21.15.72:0/2940335161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6dc0c4d60 0x7fb6dc0aa5d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4000c00 tx=0x7fb6c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:27.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.327+0000 7fb6d2ffd700 1 -- 172.21.15.72:0/2940335161 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4004540 con 0x7fb6dc0c4d60 2023-07-27T20:31:27.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.327+0000 7fb6d2ffd700 1 -- 172.21.15.72:0/2940335161 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c40036a0 con 0x7fb6dc0c4d60 2023-07-27T20:31:27.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.327+0000 7fb6e09ff700 1 -- 172.21.15.72:0/2940335161 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6dc0c28c0 con 0x7fb6dc0c4d60 2023-07-27T20:31:27.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.327+0000 7fb6d2ffd700 1 -- 172.21.15.72:0/2940335161 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4003a30 con 0x7fb6dc0c4d60 2023-07-27T20:31:27.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.328+0000 7fb6e09ff700 1 -- 172.21.15.72:0/2940335161 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6dc0c3000 con 0x7fb6dc0c4d60 2023-07-27T20:31:27.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.329+0000 7fb6e09ff700 1 -- 172.21.15.72:0/2940335161 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6dc0c34e0 con 0x7fb6dc0c4d60 2023-07-27T20:31:27.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.330+0000 7fb6d2ffd700 1 -- 172.21.15.72:0/2940335161 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb6c4021070 con 0x7fb6dc0c4d60 2023-07-27T20:31:27.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.331+0000 7fb6d2ffd700 1 --2- 172.21.15.72:0/2940335161 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb6bc06ace0 0x7fb6bc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:27.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.331+0000 7fb6d2ffd700 1 -- 172.21.15.72:0/2940335161 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fb6c408aa40 con 0x7fb6dc0c4d60 2023-07-27T20:31:27.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.331+0000 7fb6da59c700 1 --2- 172.21.15.72:0/2940335161 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb6bc06ace0 0x7fb6bc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:27.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.332+0000 7fb6da59c700 1 --2- 172.21.15.72:0/2940335161 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb6bc06ace0 0x7fb6bc06d1a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc000f60 tx=0x7fb6cc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:27.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.334+0000 7fb6d2ffd700 1 -- 172.21.15.72:0/2940335161 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb6c4055d40 con 0x7fb6dc0c4d60 2023-07-27T20:31:27.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:27.526+0000 7fb6e09ff700 1 -- 172.21.15.72:0/2940335161 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fb6dc04e470 con 0x7fb6dc0c4d60 2023-07-27T20:31:28.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.096+0000 7fb6d2ffd700 1 -- 172.21.15.72:0/2940335161 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v21) v1 ==== 171+0+0 (secure 0 0 0) 0x7fb6c4059360 con 0x7fb6dc0c4d60 2023-07-27T20:31:28.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.100+0000 7fb6e09ff700 1 -- 172.21.15.72:0/2940335161 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb6bc06ace0 msgr2=0x7fb6bc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:28.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.100+0000 7fb6e09ff700 1 --2- 172.21.15.72:0/2940335161 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb6bc06ace0 0x7fb6bc06d1a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc000f60 tx=0x7fb6cc009040 comp rx=0 tx=0).stop 2023-07-27T20:31:28.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.100+0000 7fb6e09ff700 1 -- 172.21.15.72:0/2940335161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6dc0c4d60 msgr2=0x7fb6dc0aa5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:28.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.100+0000 7fb6e09ff700 1 --2- 172.21.15.72:0/2940335161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6dc0c4d60 0x7fb6dc0aa5d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4000c00 tx=0x7fb6c4004750 comp rx=0 tx=0).stop 2023-07-27T20:31:28.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.113+0000 7fb6e09ff700 1 -- 172.21.15.72:0/2940335161 shutdown_connections 2023-07-27T20:31:28.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.113+0000 7fb6e09ff700 1 --2- 172.21.15.72:0/2940335161 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb6bc06ace0 0x7fb6bc06d1a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:28.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.113+0000 7fb6e09ff700 1 --2- 172.21.15.72:0/2940335161 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb6dc0c7760 0x7fb6dc0bd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:28.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.113+0000 7fb6e09ff700 1 --2- 172.21.15.72:0/2940335161 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6dc0c41e0 0x7fb6dc0c3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:28.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.113+0000 7fb6e09ff700 1 --2- 172.21.15.72:0/2940335161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6dc0c4d60 0x7fb6dc0aa5d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:28.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.113+0000 7fb6e09ff700 1 -- 172.21.15.72:0/2940335161 >> 172.21.15.72:0/2940335161 conn(0x7fb6dc0c9860 msgr2=0x7fb6dc152620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:28.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.118+0000 7fb6e09ff700 1 -- 172.21.15.72:0/2940335161 shutdown_connections 2023-07-27T20:31:28.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.118+0000 7fb6e09ff700 1 -- 172.21.15.72:0/2940335161 wait complete. 2023-07-27T20:31:28.113 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' created 2023-07-27T20:31:28.129 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-27T20:31:28.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.340+0000 7fad65bff700 1 Processor -- start 2023-07-27T20:31:28.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.340+0000 7fad65bff700 1 -- start start 2023-07-27T20:31:28.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.341+0000 7fad65bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fad6014aab0 0x7fad60154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:28.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.341+0000 7fad65bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fad6006c1d0 0x7fad6006c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:28.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.341+0000 7fad65bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad600c7c50 con 0x7fad600c7740 2023-07-27T20:31:28.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.341+0000 7fad65bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad6006bd40 con 0x7fad6014aab0 2023-07-27T20:31:28.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.341+0000 7fad65bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad600c62f0 con 0x7fad6006c1d0 2023-07-27T20:31:28.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.341+0000 7fad5f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fad6014aab0 0x7fad60154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:28.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.341+0000 7fad5f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fad6014aab0 0x7fad60154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47912/0 (socket says 172.21.15.72:47912) 2023-07-27T20:31:28.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.341+0000 7fad5f7fe700 1 -- 172.21.15.72:0/755807712 learned_addr learned my addr 172.21.15.72:0/755807712 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:28.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.341+0000 7fad5ffff700 1 --2- 172.21.15.72:0/755807712 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fad6006c1d0 0x7fad6006c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:28.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.342+0000 7fad5f7fe700 1 -- 172.21.15.72:0/755807712 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fad6006c1d0 msgr2=0x7fad6006c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:28.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.342+0000 7fad5f7fe700 1 --2- 172.21.15.72:0/755807712 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fad6006c1d0 0x7fad6006c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:28.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.342+0000 7fad5f7fe700 1 -- 172.21.15.72:0/755807712 >> v1:172.21.15.72:6789/0 conn(0x7fad600c7740 legacy=0x7fad600c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:28.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.342+0000 7fad5f7fe700 1 -- 172.21.15.72:0/755807712 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad60155050 con 0x7fad6014aab0 2023-07-27T20:31:28.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.342+0000 7fad5f7fe700 1 --2- 172.21.15.72:0/755807712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad6014aab0 0x7fad60154b10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fad500098f0 tx=0x7fad50009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e635e66022e019 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:28.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.342+0000 7fad5effd700 1 -- 172.21.15.72:0/755807712 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5000b8a0 con 0x7fad6014aab0 2023-07-27T20:31:28.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.342+0000 7fad5effd700 1 -- 172.21.15.72:0/755807712 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5000ba00 con 0x7fad6014aab0 2023-07-27T20:31:28.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.342+0000 7fad5effd700 1 -- 172.21.15.72:0/755807712 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5000bd90 con 0x7fad6014aab0 2023-07-27T20:31:28.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.343+0000 7fad65bff700 1 -- 172.21.15.72:0/755807712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad6014aab0 msgr2=0x7fad60154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:28.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.343+0000 7fad65bff700 1 --2- 172.21.15.72:0/755807712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad6014aab0 0x7fad60154b10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fad500098f0 tx=0x7fad50009c00 comp rx=0 tx=0).stop 2023-07-27T20:31:28.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.343+0000 7fad65bff700 1 -- 172.21.15.72:0/755807712 shutdown_connections 2023-07-27T20:31:28.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.343+0000 7fad65bff700 1 --2- 172.21.15.72:0/755807712 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fad6006c1d0 0x7fad6006c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:28.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.343+0000 7fad65bff700 1 --2- 172.21.15.72:0/755807712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad6014aab0 0x7fad60154b10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:28.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.343+0000 7fad65bff700 1 -- 172.21.15.72:0/755807712 >> 172.21.15.72:0/755807712 conn(0x7fad600ab3f0 msgr2=0x7fad600ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:28.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.343+0000 7fad65bff700 1 -- 172.21.15.72:0/755807712 shutdown_connections 2023-07-27T20:31:28.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.343+0000 7fad65bff700 1 -- 172.21.15.72:0/755807712 wait complete. 2023-07-27T20:31:28.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.344+0000 7fad65bff700 1 Processor -- start 2023-07-27T20:31:28.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.344+0000 7fad65bff700 1 -- start start 2023-07-27T20:31:28.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.345+0000 7fad65bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad6006c1d0 0x7fad60148cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:28.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.345+0000 7fad65bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fad600c7740 0x7fad60144c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:28.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.345+0000 7fad65bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad6014aab0 0x7fad60145150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:28.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.345+0000 7fad65bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad60157250 con 0x7fad6014aab0 2023-07-27T20:31:28.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.345+0000 7fad65bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad601ede30 con 0x7fad6006c1d0 2023-07-27T20:31:28.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.345+0000 7fad65bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad60156920 con 0x7fad600c7740 2023-07-27T20:31:28.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.346+0000 7fad5ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad6014aab0 0x7fad60145150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:28.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.346+0000 7fad5ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad6014aab0 0x7fad60145150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47928/0 (socket says 172.21.15.72:47928) 2023-07-27T20:31:28.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.346+0000 7fad5ffff700 1 -- 172.21.15.72:0/4123988292 learned_addr learned my addr 172.21.15.72:0/4123988292 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:28.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.346+0000 7fad5f7fe700 1 --2- 172.21.15.72:0/4123988292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad6006c1d0 0x7fad60148cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:28.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.346+0000 7fad57fff700 1 --2- 172.21.15.72:0/4123988292 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fad600c7740 0x7fad60144c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:28.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.346+0000 7fad5ffff700 1 -- 172.21.15.72:0/4123988292 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fad600c7740 msgr2=0x7fad60144c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:28.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.346+0000 7fad5ffff700 1 --2- 172.21.15.72:0/4123988292 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fad600c7740 0x7fad60144c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:28.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.346+0000 7fad5ffff700 1 -- 172.21.15.72:0/4123988292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad6006c1d0 msgr2=0x7fad60148cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:28.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.346+0000 7fad5ffff700 1 --2- 172.21.15.72:0/4123988292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad6006c1d0 0x7fad60148cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:28.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.346+0000 7fad5ffff700 1 -- 172.21.15.72:0/4123988292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad50009550 con 0x7fad6014aab0 2023-07-27T20:31:28.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.346+0000 7fad5ffff700 1 --2- 172.21.15.72:0/4123988292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad6014aab0 0x7fad60145150 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fad58007e40 tx=0x7fad5800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:28.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.346+0000 7fad5cff9700 1 -- 172.21.15.72:0/4123988292 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5800eea0 con 0x7fad6014aab0 2023-07-27T20:31:28.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.346+0000 7fad5cff9700 1 -- 172.21.15.72:0/4123988292 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad58014420 con 0x7fad6014aab0 2023-07-27T20:31:28.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.346+0000 7fad65bff700 1 -- 172.21.15.72:0/4123988292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad60156c00 con 0x7fad6014aab0 2023-07-27T20:31:28.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.346+0000 7fad5cff9700 1 -- 172.21.15.72:0/4123988292 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad580147b0 con 0x7fad6014aab0 2023-07-27T20:31:28.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.347+0000 7fad65bff700 1 -- 172.21.15.72:0/4123988292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad60149200 con 0x7fad6014aab0 2023-07-27T20:31:28.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.347+0000 7fad65bff700 1 -- 172.21.15.72:0/4123988292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad60157400 con 0x7fad6014aab0 2023-07-27T20:31:28.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.349+0000 7fad5cff9700 1 -- 172.21.15.72:0/4123988292 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fad58014910 con 0x7fad6014aab0 2023-07-27T20:31:28.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.349+0000 7fad5cff9700 1 --2- 172.21.15.72:0/4123988292 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fad4006ace0 0x7fad4006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:28.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.350+0000 7fad5cff9700 1 -- 172.21.15.72:0/4123988292 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fad5808a950 con 0x7fad6014aab0 2023-07-27T20:31:28.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.350+0000 7fad5f7fe700 1 --2- 172.21.15.72:0/4123988292 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fad4006ace0 0x7fad4006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:28.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.351+0000 7fad5f7fe700 1 --2- 172.21.15.72:0/4123988292 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fad4006ace0 0x7fad4006d1a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fad50014040 tx=0x7fad50008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:28.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.353+0000 7fad5cff9700 1 -- 172.21.15.72:0/4123988292 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fad58055ad0 con 0x7fad6014aab0 2023-07-27T20:31:28.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:28.590+0000 7fad65bff700 1 -- 172.21.15.72:0/4123988292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fad6004e470 con 0x7fad6014aab0 2023-07-27T20:31:29.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.108+0000 7fad5cff9700 1 -- 172.21.15.72:0/4123988292 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fad580590f0 con 0x7fad6014aab0 2023-07-27T20:31:29.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.116+0000 7fad65bff700 1 -- 172.21.15.72:0/4123988292 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fad4006ace0 msgr2=0x7fad4006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:29.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.116+0000 7fad65bff700 1 --2- 172.21.15.72:0/4123988292 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fad4006ace0 0x7fad4006d1a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fad50014040 tx=0x7fad50008030 comp rx=0 tx=0).stop 2023-07-27T20:31:29.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.116+0000 7fad65bff700 1 -- 172.21.15.72:0/4123988292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad6014aab0 msgr2=0x7fad60145150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:29.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.116+0000 7fad65bff700 1 --2- 172.21.15.72:0/4123988292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad6014aab0 0x7fad60145150 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fad58007e40 tx=0x7fad5800e3c0 comp rx=0 tx=0).stop 2023-07-27T20:31:29.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.118+0000 7fad65bff700 1 -- 172.21.15.72:0/4123988292 shutdown_connections 2023-07-27T20:31:29.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.118+0000 7fad65bff700 1 --2- 172.21.15.72:0/4123988292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad6014aab0 0x7fad60145150 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:29.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.118+0000 7fad65bff700 1 --2- 172.21.15.72:0/4123988292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad6006c1d0 0x7fad60148cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:29.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.118+0000 7fad65bff700 1 --2- 172.21.15.72:0/4123988292 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fad4006ace0 0x7fad4006d1a0 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fad50014040 tx=0x7fad50008030 comp rx=0 tx=0).stop 2023-07-27T20:31:29.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.118+0000 7fad65bff700 1 --2- 172.21.15.72:0/4123988292 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fad600c7740 0x7fad60144c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:29.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.118+0000 7fad65bff700 1 -- 172.21.15.72:0/4123988292 >> 172.21.15.72:0/4123988292 conn(0x7fad600ab3f0 msgr2=0x7fad600aacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:29.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.123+0000 7fad65bff700 1 -- 172.21.15.72:0/4123988292 shutdown_connections 2023-07-27T20:31:29.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.123+0000 7fad65bff700 1 -- 172.21.15.72:0/4123988292 wait complete. 2023-07-27T20:31:29.125 INFO:teuthology.orchestra.run.smithi072.stderr:new fs with metadata pool 3 and data pool 4 2023-07-27T20:31:29.145 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-07-27T20:31:29.146 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-07-27T20:31:29.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.361+0000 7fc91bfff700 1 Processor -- start 2023-07-27T20:31:29.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.361+0000 7fc91bfff700 1 -- start start 2023-07-27T20:31:29.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.362+0000 7fc91bfff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc9140c17d0 0x7fc91406cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:29.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.362+0000 7fc91bfff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc914152f30 con 0x7fc9140a8d90 2023-07-27T20:31:29.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.362+0000 7fc91bfff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9141521b0 con 0x7fc91406a400 2023-07-27T20:31:29.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.362+0000 7fc91bfff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9140a9170 con 0x7fc9140c17d0 2023-07-27T20:31:29.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.362+0000 7fc91a59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc9140a8d90 0x7fc91406d440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39790/0 (socket says 172.21.15.72:39790) 2023-07-27T20:31:29.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.362+0000 7fc91a59c700 1 -- 172.21.15.72:0/1940807054 learned_addr learned my addr 172.21.15.72:0/1940807054 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:29.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.363+0000 7fc91959a700 1 --2- 172.21.15.72:0/1940807054 >> v2:172.21.15.173:3300/0 conn(0x7fc9140c17d0 0x7fc91406cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:29.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.363+0000 7fc918d99700 1 -- 172.21.15.72:0/1940807054 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4043956373 0 0) 0x7fc90c001490 con 0x7fc9140a8d90 2023-07-27T20:31:29.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.363+0000 7fc918d99700 1 -- 172.21.15.72:0/1940807054 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9000035b0 con 0x7fc9140a8d90 2023-07-27T20:31:29.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.363+0000 7fc918d99700 1 -- 172.21.15.72:0/1940807054 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3922369841 0 0) 0x7fc9000035b0 con 0x7fc9140a8d90 2023-07-27T20:31:29.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.363+0000 7fc918d99700 1 -- 172.21.15.72:0/1940807054 >> v2:172.21.15.173:3300/0 conn(0x7fc9140c17d0 msgr2=0x7fc91406cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:29.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.363+0000 7fc918d99700 1 --2- 172.21.15.72:0/1940807054 >> v2:172.21.15.173:3300/0 conn(0x7fc9140c17d0 0x7fc91406cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:29.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.363+0000 7fc918d99700 1 -- 172.21.15.72:0/1940807054 >> v1:172.21.15.173:6789/0 conn(0x7fc91406a400 legacy=0x7fc91414f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:29.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.363+0000 7fc918d99700 1 -- 172.21.15.72:0/1940807054 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9140a9350 con 0x7fc9140a8d90 2023-07-27T20:31:29.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.363+0000 7fc918d99700 1 -- 172.21.15.72:0/1940807054 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7fc90c001b80 con 0x7fc9140a8d90 2023-07-27T20:31:29.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.363+0000 7fc918d99700 1 -- 172.21.15.72:0/1940807054 >> v1:172.21.15.72:6789/0 conn(0x7fc9140a8d90 legacy=0x7fc91406d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:29.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.363+0000 7fc918d99700 1 --2- 172.21.15.72:0/1940807054 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc900003a00 0x7fc900003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:29.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.363+0000 7fc918d99700 1 --2- 172.21.15.72:0/1940807054 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc900004850 0x7fc900004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:29.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.363+0000 7fc918d99700 1 --2- 172.21.15.72:0/1940807054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc900005210 0x7fc90000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:29.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.363+0000 7fc918d99700 1 -- 172.21.15.72:0/1940807054 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9140a9170 con 0x7fc900005210 2023-07-27T20:31:29.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.363+0000 7fc918d99700 1 -- 172.21.15.72:0/1940807054 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc90000c0b0 con 0x7fc900003a00 2023-07-27T20:31:29.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.363+0000 7fc918d99700 1 -- 172.21.15.72:0/1940807054 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc90000c270 con 0x7fc900004850 2023-07-27T20:31:29.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.363+0000 7fc91a59c700 1 --2- 172.21.15.72:0/1940807054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc900005210 0x7fc90000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:29.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.363+0000 7fc919d9b700 1 --2- 172.21.15.72:0/1940807054 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc900003a00 0x7fc900003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:29.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.363+0000 7fc91959a700 1 --2- 172.21.15.72:0/1940807054 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc900004850 0x7fc900004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:29.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.364+0000 7fc91a59c700 1 -- 172.21.15.72:0/1940807054 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc900004850 msgr2=0x7fc900004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:29.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.364+0000 7fc91a59c700 1 --2- 172.21.15.72:0/1940807054 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc900004850 0x7fc900004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:29.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.364+0000 7fc91a59c700 1 -- 172.21.15.72:0/1940807054 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc900003a00 msgr2=0x7fc900003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:29.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.364+0000 7fc91a59c700 1 --2- 172.21.15.72:0/1940807054 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc900003a00 0x7fc900003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:29.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.364+0000 7fc91a59c700 1 -- 172.21.15.72:0/1940807054 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9000035b0 con 0x7fc900005210 2023-07-27T20:31:29.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.364+0000 7fc91a59c700 1 -- 172.21.15.72:0/1940807054 reap_dead start 2023-07-27T20:31:29.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.364+0000 7fc91a59c700 1 --2- 172.21.15.72:0/1940807054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc900005210 0x7fc90000ba10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc90c00a830 tx=0x7fc900005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7dc5f7dea93de35 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:29.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.364+0000 7fc918d99700 1 -- 172.21.15.72:0/1940807054 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c00a490 con 0x7fc900005210 2023-07-27T20:31:29.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.364+0000 7fc918d99700 1 -- 172.21.15.72:0/1940807054 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90c012620 con 0x7fc900005210 2023-07-27T20:31:29.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.364+0000 7fc918d99700 1 -- 172.21.15.72:0/1940807054 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c0129d0 con 0x7fc900005210 2023-07-27T20:31:29.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.365+0000 7fc91bfff700 1 -- 172.21.15.72:0/1940807054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc900005210 msgr2=0x7fc90000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:29.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.365+0000 7fc91bfff700 1 --2- 172.21.15.72:0/1940807054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc900005210 0x7fc90000ba10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc90c00a830 tx=0x7fc900005880 comp rx=0 tx=0).stop 2023-07-27T20:31:29.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.365+0000 7fc91bfff700 1 -- 172.21.15.72:0/1940807054 shutdown_connections 2023-07-27T20:31:29.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.365+0000 7fc91bfff700 1 --2- 172.21.15.72:0/1940807054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc900005210 0x7fc90000ba10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:29.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.365+0000 7fc91bfff700 1 -- 172.21.15.72:0/1940807054 >> 172.21.15.72:0/1940807054 conn(0x7fc9140c53e0 msgr2=0x7fc9140c57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:29.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.365+0000 7fc91bfff700 1 -- 172.21.15.72:0/1940807054 shutdown_connections 2023-07-27T20:31:29.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.365+0000 7fc91bfff700 1 -- 172.21.15.72:0/1940807054 wait complete. 2023-07-27T20:31:29.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.367+0000 7fc91bfff700 1 Processor -- start 2023-07-27T20:31:29.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.367+0000 7fc91bfff700 1 -- start start 2023-07-27T20:31:29.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.367+0000 7fc91bfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc900005210 0x7fc9140bea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:29.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.367+0000 7fc91bfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc914071df0 0x7fc9141498e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:29.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.368+0000 7fc91bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc914149e20 0x7fc9141ecdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:29.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.368+0000 7fc91bfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9141e9a00 con 0x7fc914149e20 2023-07-27T20:31:29.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.368+0000 7fc91bfff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9141e9ce0 con 0x7fc914071df0 2023-07-27T20:31:29.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.368+0000 7fc91bfff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9141e9fc0 con 0x7fc900005210 2023-07-27T20:31:29.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.368+0000 7fc91a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc914149e20 0x7fc9141ecdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:29.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.368+0000 7fc91a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc914149e20 0x7fc9141ecdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47936/0 (socket says 172.21.15.72:47936) 2023-07-27T20:31:29.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.368+0000 7fc91a59c700 1 -- 172.21.15.72:0/3865492114 learned_addr learned my addr 172.21.15.72:0/3865492114 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:29.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.368+0000 7fc91a59c700 1 -- 172.21.15.72:0/3865492114 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc900005210 msgr2=0x7fc9140bea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:29.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.368+0000 7fc91a59c700 1 --2- 172.21.15.72:0/3865492114 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc900005210 0x7fc9140bea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:29.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.368+0000 7fc91a59c700 1 -- 172.21.15.72:0/3865492114 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc914071df0 msgr2=0x7fc9141498e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:29.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.368+0000 7fc91a59c700 1 --2- 172.21.15.72:0/3865492114 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc914071df0 0x7fc9141498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:29.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.368+0000 7fc91a59c700 1 -- 172.21.15.72:0/3865492114 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9141ea2a0 con 0x7fc914149e20 2023-07-27T20:31:29.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.368+0000 7fc91a59c700 1 --2- 172.21.15.72:0/3865492114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc914149e20 0x7fc9141ecdd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc90c000f80 tx=0x7fc90c001f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:29.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.368+0000 7fc90a7fc700 1 -- 172.21.15.72:0/3865492114 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c001f80 con 0x7fc914149e20 2023-07-27T20:31:29.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.369+0000 7fc90a7fc700 1 -- 172.21.15.72:0/3865492114 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90c001980 con 0x7fc914149e20 2023-07-27T20:31:29.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.369+0000 7fc91bfff700 1 -- 172.21.15.72:0/3865492114 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9141ea580 con 0x7fc914149e20 2023-07-27T20:31:29.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.369+0000 7fc90a7fc700 1 -- 172.21.15.72:0/3865492114 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c026670 con 0x7fc914149e20 2023-07-27T20:31:29.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.369+0000 7fc91bfff700 1 -- 172.21.15.72:0/3865492114 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc91414d2f0 con 0x7fc914149e20 2023-07-27T20:31:29.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.370+0000 7fc91bfff700 1 -- 172.21.15.72:0/3865492114 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc91404e470 con 0x7fc914149e20 2023-07-27T20:31:29.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.370+0000 7fc90a7fc700 1 -- 172.21.15.72:0/3865492114 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc90c01c410 con 0x7fc914149e20 2023-07-27T20:31:29.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.371+0000 7fc90a7fc700 1 --2- 172.21.15.72:0/3865492114 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc8f806ace0 0x7fc8f806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:29.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.371+0000 7fc90a7fc700 1 -- 172.21.15.72:0/3865492114 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc90c08b3d0 con 0x7fc914149e20 2023-07-27T20:31:29.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.372+0000 7fc919d9b700 1 --2- 172.21.15.72:0/3865492114 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc8f806ace0 0x7fc8f806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:29.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.372+0000 7fc919d9b700 1 --2- 172.21.15.72:0/3865492114 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc8f806ace0 0x7fc8f806d1a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc914149460 tx=0x7fc910009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:29.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.376+0000 7fc90a7fc700 1 -- 172.21.15.72:0/3865492114 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc90c056470 con 0x7fc914149e20 2023-07-27T20:31:29.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:29.578+0000 7fc91bfff700 1 -- 172.21.15.72:0/3865492114 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fc914152f30 con 0x7fc914149e20 2023-07-27T20:31:30.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.123+0000 7fc90a7fc700 1 -- 172.21.15.72:0/3865492114 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) v1 ==== 157+0+0 (secure 0 0 0) 0x7fc914152f30 con 0x7fc914149e20 2023-07-27T20:31:30.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.127+0000 7fc91bfff700 1 -- 172.21.15.72:0/3865492114 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc8f806ace0 msgr2=0x7fc8f806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:30.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.127+0000 7fc91bfff700 1 --2- 172.21.15.72:0/3865492114 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc8f806ace0 0x7fc8f806d1a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc914149460 tx=0x7fc910009040 comp rx=0 tx=0).stop 2023-07-27T20:31:30.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.127+0000 7fc91bfff700 1 -- 172.21.15.72:0/3865492114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc914149e20 msgr2=0x7fc9141ecdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:30.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.127+0000 7fc91bfff700 1 --2- 172.21.15.72:0/3865492114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc914149e20 0x7fc9141ecdd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc90c000f80 tx=0x7fc90c001f10 comp rx=0 tx=0).stop 2023-07-27T20:31:30.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.127+0000 7fc91bfff700 1 -- 172.21.15.72:0/3865492114 shutdown_connections 2023-07-27T20:31:30.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.127+0000 7fc91bfff700 1 --2- 172.21.15.72:0/3865492114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc914149e20 0x7fc9141ecdd0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:30.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.127+0000 7fc91bfff700 1 --2- 172.21.15.72:0/3865492114 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc8f806ace0 0x7fc8f806d1a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:30.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.127+0000 7fc91bfff700 1 --2- 172.21.15.72:0/3865492114 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc900005210 0x7fc9140bea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:30.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.127+0000 7fc91bfff700 1 --2- 172.21.15.72:0/3865492114 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc914071df0 0x7fc9141498e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:30.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.127+0000 7fc91bfff700 1 -- 172.21.15.72:0/3865492114 >> 172.21.15.72:0/3865492114 conn(0x7fc9140c53e0 msgr2=0x7fc91414f130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:30.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.127+0000 7fc91bfff700 1 -- 172.21.15.72:0/3865492114 shutdown_connections 2023-07-27T20:31:30.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.127+0000 7fc91bfff700 1 -- 172.21.15.72:0/3865492114 wait complete. 2023-07-27T20:31:30.135 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-07-27T20:31:30.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.355+0000 7f10951ff700 1 Processor -- start 2023-07-27T20:31:30.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.355+0000 7f10951ff700 1 -- start start 2023-07-27T20:31:30.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.356+0000 7f10951ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10900c7740 0x7f10900c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:30.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.356+0000 7f10951ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f10900c4700 0x7f109006c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:30.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.356+0000 7f10951ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10900c7c50 con 0x7f109014aab0 2023-07-27T20:31:30.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.356+0000 7f10951ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f109006bd40 con 0x7f10900c4700 2023-07-27T20:31:30.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.356+0000 7f10951ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10900c62f0 con 0x7f10900c7740 2023-07-27T20:31:30.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.357+0000 7f108ed9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f109014aab0 0x7f1090154b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36666/0 (socket says 172.21.15.72:36666) 2023-07-27T20:31:30.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.357+0000 7f108ed9d700 1 -- 172.21.15.72:0/1774566257 learned_addr learned my addr 172.21.15.72:0/1774566257 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:30.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.357+0000 7f108f59e700 1 --2- 172.21.15.72:0/1774566257 >> v2:172.21.15.173:3300/0 conn(0x7f10900c4700 0x7f109006c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:30.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.357+0000 7f1087fff700 1 --2- 172.21.15.72:0/1774566257 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10900c7740 0x7f10900c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:30.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.357+0000 7f108e59c700 1 -- 172.21.15.72:0/1774566257 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3121651421 0 0) 0x7f10900c7c50 con 0x7f109014aab0 2023-07-27T20:31:30.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.357+0000 7f108e59c700 1 -- 172.21.15.72:0/1774566257 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f107c0035b0 con 0x7f109014aab0 2023-07-27T20:31:30.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.357+0000 7f108f59e700 1 -- 172.21.15.72:0/1774566257 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10900c7740 msgr2=0x7f10900c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:30.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.357+0000 7f108f59e700 1 --2- 172.21.15.72:0/1774566257 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10900c7740 0x7f10900c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:30.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.357+0000 7f108f59e700 1 -- 172.21.15.72:0/1774566257 >> v1:172.21.15.72:6789/0 conn(0x7f109014aab0 legacy=0x7f1090154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:30.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.357+0000 7f108f59e700 1 -- 172.21.15.72:0/1774566257 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f109006d200 con 0x7f10900c4700 2023-07-27T20:31:30.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.358+0000 7f108f59e700 1 --2- 172.21.15.72:0/1774566257 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10900c4700 0x7f109006c1d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1088009d90 tx=0x7f108800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93d529f5d019664b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:30.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.358+0000 7f108e59c700 1 -- 172.21.15.72:0/1774566257 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108800e070 con 0x7f10900c4700 2023-07-27T20:31:30.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.358+0000 7f108e59c700 1 -- 172.21.15.72:0/1774566257 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108800bb20 con 0x7f10900c4700 2023-07-27T20:31:30.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.358+0000 7f108e59c700 1 -- 172.21.15.72:0/1774566257 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1088012430 con 0x7f10900c4700 2023-07-27T20:31:30.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.358+0000 7f10951ff700 1 -- 172.21.15.72:0/1774566257 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10900c4700 msgr2=0x7f109006c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:30.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.358+0000 7f10951ff700 1 --2- 172.21.15.72:0/1774566257 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10900c4700 0x7f109006c1d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1088009d90 tx=0x7f108800b330 comp rx=0 tx=0).stop 2023-07-27T20:31:30.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.359+0000 7f10951ff700 1 -- 172.21.15.72:0/1774566257 shutdown_connections 2023-07-27T20:31:30.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.359+0000 7f10951ff700 1 --2- 172.21.15.72:0/1774566257 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10900c4700 0x7f109006c1d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:30.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.359+0000 7f10951ff700 1 --2- 172.21.15.72:0/1774566257 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10900c7740 0x7f10900c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:30.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.359+0000 7f10951ff700 1 -- 172.21.15.72:0/1774566257 >> 172.21.15.72:0/1774566257 conn(0x7f10900ab3f0 msgr2=0x7f10900ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:30.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.359+0000 7f10951ff700 1 -- 172.21.15.72:0/1774566257 shutdown_connections 2023-07-27T20:31:30.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.359+0000 7f10951ff700 1 -- 172.21.15.72:0/1774566257 wait complete. 2023-07-27T20:31:30.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.360+0000 7f10951ff700 1 Processor -- start 2023-07-27T20:31:30.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.360+0000 7f10951ff700 1 -- start start 2023-07-27T20:31:30.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.361+0000 7f10951ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10900c4700 0x7f109014ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:30.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.361+0000 7f10951ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10900c7740 0x7f109014d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:30.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.361+0000 7f10951ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f109014aab0 0x7f10900bfba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:30.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.361+0000 7f10951ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1090154780 con 0x7f109014aab0 2023-07-27T20:31:30.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.361+0000 7f10951ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109014b390 con 0x7f10900c4700 2023-07-27T20:31:30.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.361+0000 7f10951ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f109014b670 con 0x7f10900c7740 2023-07-27T20:31:30.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.361+0000 7f108f59e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f109014aab0 0x7f10900bfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:30.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.361+0000 7f108f59e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f109014aab0 0x7f10900bfba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55288/0 (socket says 172.21.15.72:55288) 2023-07-27T20:31:30.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.362+0000 7f108f59e700 1 -- 172.21.15.72:0/3958429136 learned_addr learned my addr 172.21.15.72:0/3958429136 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:30.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.362+0000 7f1087fff700 1 --2- 172.21.15.72:0/3958429136 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10900c7740 0x7f109014d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:30.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.362+0000 7f108ed9d700 1 --2- 172.21.15.72:0/3958429136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10900c4700 0x7f109014ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:30.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.362+0000 7f108f59e700 1 -- 172.21.15.72:0/3958429136 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10900c7740 msgr2=0x7f109014d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:30.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.362+0000 7f108f59e700 1 --2- 172.21.15.72:0/3958429136 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10900c7740 0x7f109014d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:30.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.362+0000 7f108f59e700 1 -- 172.21.15.72:0/3958429136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10900c4700 msgr2=0x7f109014ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:30.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.362+0000 7f108f59e700 1 --2- 172.21.15.72:0/3958429136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10900c4700 0x7f109014ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:30.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.362+0000 7f108f59e700 1 -- 172.21.15.72:0/3958429136 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1088009a70 con 0x7f109014aab0 2023-07-27T20:31:30.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.362+0000 7f108f59e700 1 --2- 172.21.15.72:0/3958429136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f109014aab0 0x7f10900bfba0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1088014040 tx=0x7f1088004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:30.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.362+0000 7f10877fe700 1 -- 172.21.15.72:0/3958429136 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10880129f0 con 0x7f109014aab0 2023-07-27T20:31:30.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.362+0000 7f10877fe700 1 -- 172.21.15.72:0/3958429136 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1088020070 con 0x7f109014aab0 2023-07-27T20:31:30.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.363+0000 7f10877fe700 1 -- 172.21.15.72:0/3958429136 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1088012dd0 con 0x7f109014aab0 2023-07-27T20:31:30.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.363+0000 7f10951ff700 1 -- 172.21.15.72:0/3958429136 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f109014b950 con 0x7f109014aab0 2023-07-27T20:31:30.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.363+0000 7f10951ff700 1 -- 172.21.15.72:0/3958429136 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f109014bf10 con 0x7f109014aab0 2023-07-27T20:31:30.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.364+0000 7f10951ff700 1 -- 172.21.15.72:0/3958429136 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f109004e470 con 0x7f109014aab0 2023-07-27T20:31:30.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.364+0000 7f10877fe700 1 -- 172.21.15.72:0/3958429136 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1088004040 con 0x7f109014aab0 2023-07-27T20:31:30.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.365+0000 7f10877fe700 1 --2- 172.21.15.72:0/3958429136 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f107006ace0 0x7f107006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:30.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.365+0000 7f10877fe700 1 -- 172.21.15.72:0/3958429136 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6288+0+0 (secure 0 0 0) 0x7f1088022070 con 0x7f109014aab0 2023-07-27T20:31:30.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.366+0000 7f108ed9d700 1 --2- 172.21.15.72:0/3958429136 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f107006ace0 0x7f107006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:30.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.366+0000 7f108ed9d700 1 --2- 172.21.15.72:0/3958429136 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f107006ace0 0x7f107006d1a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1080007fd0 tx=0x7f1080007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:30.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.369+0000 7f10877fe700 1 -- 172.21.15.72:0/3958429136 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1088056140 con 0x7f109014aab0 2023-07-27T20:31:30.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:30.564+0000 7f10951ff700 1 -- 172.21.15.72:0/3958429136 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f10900c92b0 con 0x7f109014aab0 2023-07-27T20:31:32.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.148+0000 7f10877fe700 1 -- 172.21.15.72:0/3958429136 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v25) v1 ==== 228+0+0 (secure 0 0 0) 0x7f108802c100 con 0x7f109014aab0 2023-07-27T20:31:32.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.154+0000 7f10951ff700 1 -- 172.21.15.72:0/3958429136 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f107006ace0 msgr2=0x7f107006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:32.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.154+0000 7f10951ff700 1 --2- 172.21.15.72:0/3958429136 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f107006ace0 0x7f107006d1a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1080007fd0 tx=0x7f1080007dc0 comp rx=0 tx=0).stop 2023-07-27T20:31:32.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.154+0000 7f10951ff700 1 -- 172.21.15.72:0/3958429136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f109014aab0 msgr2=0x7f10900bfba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:32.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.154+0000 7f10951ff700 1 --2- 172.21.15.72:0/3958429136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f109014aab0 0x7f10900bfba0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1088014040 tx=0x7f1088004ad0 comp rx=0 tx=0).stop 2023-07-27T20:31:32.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.154+0000 7f10951ff700 1 -- 172.21.15.72:0/3958429136 shutdown_connections 2023-07-27T20:31:32.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.155+0000 7f10951ff700 1 --2- 172.21.15.72:0/3958429136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f109014aab0 0x7f10900bfba0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:32.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.155+0000 7f10951ff700 1 --2- 172.21.15.72:0/3958429136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10900c4700 0x7f109014ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:32.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.155+0000 7f10951ff700 1 --2- 172.21.15.72:0/3958429136 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f107006ace0 0x7f107006d1a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:32.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.155+0000 7f10951ff700 1 --2- 172.21.15.72:0/3958429136 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10900c7740 0x7f109014d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:32.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.155+0000 7f10951ff700 1 -- 172.21.15.72:0/3958429136 >> 172.21.15.72:0/3958429136 conn(0x7f10900ab3f0 msgr2=0x7f1090148a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:32.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.155+0000 7f10951ff700 1 -- 172.21.15.72:0/3958429136 shutdown_connections 2023-07-27T20:31:32.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.156+0000 7f10951ff700 1 -- 172.21.15.72:0/3958429136 wait complete. 2023-07-27T20:31:32.152 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data_ec' created 2023-07-27T20:31:32.170 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-07-27T20:31:32.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.384+0000 7f94af1ff700 1 Processor -- start 2023-07-27T20:31:32.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.384+0000 7f94af1ff700 1 -- start start 2023-07-27T20:31:32.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.385+0000 7f94af1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f94a80c5410 0x7f94a80c7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:32.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.385+0000 7f94af1ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f94a80c4180 0x7f94a80c4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:32.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.385+0000 7f94af1ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94a80c59f0 con 0x7f94a8151600 2023-07-27T20:31:32.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.385+0000 7f94af1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94a8155090 con 0x7f94a80c5410 2023-07-27T20:31:32.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.385+0000 7f94af1ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94a80c5cd0 con 0x7f94a80c4180 2023-07-27T20:31:32.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.386+0000 7f94a7fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f94a80c5410 0x7f94a80c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:32.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.386+0000 7f94a7fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f94a80c5410 0x7f94a80c7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55298/0 (socket says 172.21.15.72:55298) 2023-07-27T20:31:32.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.386+0000 7f94a7fff700 1 -- 172.21.15.72:0/2323065010 learned_addr learned my addr 172.21.15.72:0/2323065010 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:32.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.386+0000 7f94ad79c700 1 --2- 172.21.15.72:0/2323065010 >> v2:172.21.15.173:3300/0 conn(0x7f94a80c4180 0x7f94a80c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:32.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.386+0000 7f94a7fff700 1 -- 172.21.15.72:0/2323065010 >> v2:172.21.15.173:3300/0 conn(0x7f94a80c4180 msgr2=0x7f94a80c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:32.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.386+0000 7f94a7fff700 1 --2- 172.21.15.72:0/2323065010 >> v2:172.21.15.173:3300/0 conn(0x7f94a80c4180 0x7f94a80c4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:32.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.386+0000 7f94a7fff700 1 -- 172.21.15.72:0/2323065010 >> v1:172.21.15.173:6789/0 conn(0x7f94a8151600 legacy=0x7f94a8154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:32.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.386+0000 7f94a7fff700 1 -- 172.21.15.72:0/2323065010 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a8154180 con 0x7f94a80c5410 2023-07-27T20:31:32.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.386+0000 7f94a7fff700 1 --2- 172.21.15.72:0/2323065010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94a80c5410 0x7f94a80c7700 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f94a80c3c90 tx=0x7f9494009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b400c30a6c5d62 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:32.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.387+0000 7f94a77fe700 1 -- 172.21.15.72:0/2323065010 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9494011830 con 0x7f94a80c5410 2023-07-27T20:31:32.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.387+0000 7f94a77fe700 1 -- 172.21.15.72:0/2323065010 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9494011990 con 0x7f94a80c5410 2023-07-27T20:31:32.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.387+0000 7f94a77fe700 1 -- 172.21.15.72:0/2323065010 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9494011d20 con 0x7f94a80c5410 2023-07-27T20:31:32.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.387+0000 7f94af1ff700 1 -- 172.21.15.72:0/2323065010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94a80c5410 msgr2=0x7f94a80c7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:32.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.387+0000 7f94af1ff700 1 --2- 172.21.15.72:0/2323065010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94a80c5410 0x7f94a80c7700 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f94a80c3c90 tx=0x7f9494009bd0 comp rx=0 tx=0).stop 2023-07-27T20:31:32.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.387+0000 7f94af1ff700 1 -- 172.21.15.72:0/2323065010 shutdown_connections 2023-07-27T20:31:32.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.387+0000 7f94af1ff700 1 --2- 172.21.15.72:0/2323065010 >> v2:172.21.15.173:3300/0 conn(0x7f94a80c4180 0x7f94a80c4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:32.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.387+0000 7f94af1ff700 1 --2- 172.21.15.72:0/2323065010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94a80c5410 0x7f94a80c7700 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:32.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.387+0000 7f94af1ff700 1 -- 172.21.15.72:0/2323065010 >> 172.21.15.72:0/2323065010 conn(0x7f94a80c9800 msgr2=0x7f94a80c9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:32.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.387+0000 7f94af1ff700 1 -- 172.21.15.72:0/2323065010 shutdown_connections 2023-07-27T20:31:32.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.387+0000 7f94af1ff700 1 -- 172.21.15.72:0/2323065010 wait complete. 2023-07-27T20:31:32.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.389+0000 7f94af1ff700 1 Processor -- start 2023-07-27T20:31:32.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.389+0000 7f94af1ff700 1 -- start start 2023-07-27T20:31:32.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.390+0000 7f94af1ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94a80c4180 0x7f94a8149e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:32.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.390+0000 7f94af1ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94a80c5410 0x7f94a80c08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:32.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.390+0000 7f94af1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94a8151600 0x7f94a81575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:32.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.390+0000 7f94af1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a80c25e0 con 0x7f94a8151600 2023-07-27T20:31:32.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.390+0000 7f94af1ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a814a3d0 con 0x7f94a80c5410 2023-07-27T20:31:32.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.390+0000 7f94af1ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a814d2f0 con 0x7f94a80c4180 2023-07-27T20:31:32.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.390+0000 7f94ad79c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94a8151600 0x7f94a81575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:32.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.390+0000 7f94ad79c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94a8151600 0x7f94a81575b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55302/0 (socket says 172.21.15.72:55302) 2023-07-27T20:31:32.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.390+0000 7f94ad79c700 1 -- 172.21.15.72:0/1376620320 learned_addr learned my addr 172.21.15.72:0/1376620320 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:32.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.390+0000 7f94acf9b700 1 --2- 172.21.15.72:0/1376620320 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94a80c4180 0x7f94a8149e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:32.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.390+0000 7f94a7fff700 1 --2- 172.21.15.72:0/1376620320 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94a80c5410 0x7f94a80c08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:32.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.391+0000 7f94ad79c700 1 -- 172.21.15.72:0/1376620320 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94a80c4180 msgr2=0x7f94a8149e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:32.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.391+0000 7f94ad79c700 1 --2- 172.21.15.72:0/1376620320 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94a80c4180 0x7f94a8149e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:32.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.391+0000 7f94ad79c700 1 -- 172.21.15.72:0/1376620320 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94a80c5410 msgr2=0x7f94a80c08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:32.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.391+0000 7f94ad79c700 1 --2- 172.21.15.72:0/1376620320 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94a80c5410 0x7f94a80c08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:32.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.391+0000 7f94ad79c700 1 -- 172.21.15.72:0/1376620320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9494009550 con 0x7f94a8151600 2023-07-27T20:31:32.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.391+0000 7f94ad79c700 1 --2- 172.21.15.72:0/1376620320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94a8151600 0x7f94a81575b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f94a000efc0 tx=0x7f94a000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:32.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.391+0000 7f94a57fa700 1 -- 172.21.15.72:0/1376620320 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a0009ea0 con 0x7f94a8151600 2023-07-27T20:31:32.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.391+0000 7f94a57fa700 1 -- 172.21.15.72:0/1376620320 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a000f040 con 0x7f94a8151600 2023-07-27T20:31:32.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.391+0000 7f94a57fa700 1 -- 172.21.15.72:0/1376620320 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a000ced0 con 0x7f94a8151600 2023-07-27T20:31:32.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.391+0000 7f94af1ff700 1 -- 172.21.15.72:0/1376620320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94a814d5d0 con 0x7f94a8151600 2023-07-27T20:31:32.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.391+0000 7f94af1ff700 1 -- 172.21.15.72:0/1376620320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94a80c1690 con 0x7f94a8151600 2023-07-27T20:31:32.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.392+0000 7f94af1ff700 1 -- 172.21.15.72:0/1376620320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94a80c1880 con 0x7f94a8151600 2023-07-27T20:31:32.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.393+0000 7f94a57fa700 1 -- 172.21.15.72:0/1376620320 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f94a0014480 con 0x7f94a8151600 2023-07-27T20:31:32.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.394+0000 7f94a57fa700 1 --2- 172.21.15.72:0/1376620320 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f948c06ace0 0x7f948c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:32.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.395+0000 7f94a57fa700 1 -- 172.21.15.72:0/1376620320 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f94a0089f60 con 0x7f94a8151600 2023-07-27T20:31:32.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.395+0000 7f94acf9b700 1 --2- 172.21.15.72:0/1376620320 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f948c06ace0 0x7f948c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:32.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.396+0000 7f94acf9b700 1 --2- 172.21.15.72:0/1376620320 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f948c06ace0 0x7f948c06d1a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f94a81506f0 tx=0x7f949c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:32.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.399+0000 7f94a57fa700 1 -- 172.21.15.72:0/1376620320 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f94a0054d30 con 0x7f94a8151600 2023-07-27T20:31:32.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:32.594+0000 7f94af1ff700 1 -- 172.21.15.72:0/1376620320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f94a804e470 con 0x7f94a8151600 2023-07-27T20:31:33.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.154+0000 7f94a57fa700 1 -- 172.21.15.72:0/1376620320 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7f94a00180c0 con 0x7f94a8151600 2023-07-27T20:31:33.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.159+0000 7f94af1ff700 1 -- 172.21.15.72:0/1376620320 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f948c06ace0 msgr2=0x7f948c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:33.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.159+0000 7f94af1ff700 1 --2- 172.21.15.72:0/1376620320 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f948c06ace0 0x7f948c06d1a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f94a81506f0 tx=0x7f949c009040 comp rx=0 tx=0).stop 2023-07-27T20:31:33.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.160+0000 7f94af1ff700 1 -- 172.21.15.72:0/1376620320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94a8151600 msgr2=0x7f94a81575b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:33.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.160+0000 7f94af1ff700 1 --2- 172.21.15.72:0/1376620320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94a8151600 0x7f94a81575b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f94a000efc0 tx=0x7f94a000c3a0 comp rx=0 tx=0).stop 2023-07-27T20:31:33.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.160+0000 7f94af1ff700 1 -- 172.21.15.72:0/1376620320 shutdown_connections 2023-07-27T20:31:33.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.160+0000 7f94af1ff700 1 --2- 172.21.15.72:0/1376620320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94a8151600 0x7f94a81575b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:33.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.160+0000 7f94af1ff700 1 --2- 172.21.15.72:0/1376620320 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f948c06ace0 0x7f948c06d1a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:33.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.160+0000 7f94af1ff700 1 --2- 172.21.15.72:0/1376620320 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94a80c4180 0x7f94a8149e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:33.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.160+0000 7f94af1ff700 1 --2- 172.21.15.72:0/1376620320 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94a80c5410 0x7f94a80c08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:33.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.160+0000 7f94af1ff700 1 -- 172.21.15.72:0/1376620320 >> 172.21.15.72:0/1376620320 conn(0x7f94a80c9800 msgr2=0x7f94a814fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:33.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.162+0000 7f94af1ff700 1 -- 172.21.15.72:0/1376620320 shutdown_connections 2023-07-27T20:31:33.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.163+0000 7f94af1ff700 1 -- 172.21.15.72:0/1376620320 wait complete. 2023-07-27T20:31:33.163 INFO:teuthology.orchestra.run.smithi072.stderr:set pool 5 allow_ec_overwrites to true 2023-07-27T20:31:33.186 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-07-27T20:31:33.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.395+0000 7f6c11dff700 1 Processor -- start 2023-07-27T20:31:33.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.396+0000 7f6c11dff700 1 -- start start 2023-07-27T20:31:33.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.397+0000 7f6c11dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6c0c0c12f0 0x7f6c0c1516c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:33.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.397+0000 7f6c11dff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6c0c0716f0 0x7f6c0c071b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:33.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.397+0000 7f6c11dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c0c154f50 con 0x7f6c0c1475a0 2023-07-27T20:31:33.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.397+0000 7f6c11dff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c0c151c00 con 0x7f6c0c0716f0 2023-07-27T20:31:33.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.397+0000 7f6c11dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c154340 con 0x7f6c0c0c12f0 2023-07-27T20:31:33.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.397+0000 7f6c0b7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6c0c1475a0 0x7f6c0c0c1d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36672/0 (socket says 172.21.15.72:36672) 2023-07-27T20:31:33.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.397+0000 7f6c0b7fe700 1 -- 172.21.15.72:0/520622041 learned_addr learned my addr 172.21.15.72:0/520622041 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:33.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.397+0000 7f6c0bfff700 1 --2- 172.21.15.72:0/520622041 >> v2:172.21.15.173:3300/0 conn(0x7f6c0c0716f0 0x7f6c0c071b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:33.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.397+0000 7f6c0affd700 1 --2- 172.21.15.72:0/520622041 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6c0c0c12f0 0x7f6c0c1516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:33.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.397+0000 7f6c0a7fc700 1 -- 172.21.15.72:0/520622041 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3307381454 0 0) 0x7f6c0c154f50 con 0x7f6c0c1475a0 2023-07-27T20:31:33.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.397+0000 7f6c0a7fc700 1 -- 172.21.15.72:0/520622041 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bf40035b0 con 0x7f6c0c1475a0 2023-07-27T20:31:33.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.398+0000 7f6c0a7fc700 1 -- 172.21.15.72:0/520622041 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 686238163 0 0) 0x7f6bf40035b0 con 0x7f6c0c1475a0 2023-07-27T20:31:33.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.398+0000 7f6c0a7fc700 1 -- 172.21.15.72:0/520622041 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6c0c0c12f0 msgr2=0x7f6c0c1516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:33.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.398+0000 7f6c0a7fc700 1 --2- 172.21.15.72:0/520622041 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6c0c0c12f0 0x7f6c0c1516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:33.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.398+0000 7f6c0a7fc700 1 -- 172.21.15.72:0/520622041 >> v2:172.21.15.173:3300/0 conn(0x7f6c0c0716f0 msgr2=0x7f6c0c071b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:33.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.398+0000 7f6c0a7fc700 1 --2- 172.21.15.72:0/520622041 >> v2:172.21.15.173:3300/0 conn(0x7f6c0c0716f0 0x7f6c0c071b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:33.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.398+0000 7f6c0a7fc700 1 -- 172.21.15.72:0/520622041 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0c154620 con 0x7f6c0c1475a0 2023-07-27T20:31:33.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.398+0000 7f6c0a7fc700 1 -- 172.21.15.72:0/520622041 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f6bfc001670 con 0x7f6c0c1475a0 2023-07-27T20:31:33.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.398+0000 7f6c0a7fc700 1 -- 172.21.15.72:0/520622041 >> v1:172.21.15.72:6789/0 conn(0x7f6c0c1475a0 legacy=0x7f6c0c0c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:33.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.398+0000 7f6c0a7fc700 1 --2- 172.21.15.72:0/520622041 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bf4003a00 0x7f6bf4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:33.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.398+0000 7f6c0a7fc700 1 --2- 172.21.15.72:0/520622041 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6c0c0c12f0 0x7f6bf4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:33.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.398+0000 7f6c0a7fc700 1 --2- 172.21.15.72:0/520622041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bf4004d90 0x7f6bf4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:33.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.398+0000 7f6c0a7fc700 1 -- 172.21.15.72:0/520622041 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c151c00 con 0x7f6bf4004d90 2023-07-27T20:31:33.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.398+0000 7f6c0a7fc700 1 -- 172.21.15.72:0/520622041 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c154340 con 0x7f6bf4003a00 2023-07-27T20:31:33.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.398+0000 7f6c0a7fc700 1 -- 172.21.15.72:0/520622041 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf400dc20 con 0x7f6c0c0c12f0 2023-07-27T20:31:33.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.398+0000 7f6c0bfff700 1 --2- 172.21.15.72:0/520622041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bf4004d90 0x7f6bf4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:33.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.398+0000 7f6c0affd700 1 --2- 172.21.15.72:0/520622041 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6c0c0c12f0 0x7f6bf4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:33.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.398+0000 7f6c0b7fe700 1 --2- 172.21.15.72:0/520622041 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bf4003a00 0x7f6bf4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:33.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.399+0000 7f6c0bfff700 1 -- 172.21.15.72:0/520622041 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6c0c0c12f0 msgr2=0x7f6bf4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:33.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.399+0000 7f6c0bfff700 1 --2- 172.21.15.72:0/520622041 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6c0c0c12f0 0x7f6bf4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:33.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.399+0000 7f6c0bfff700 1 -- 172.21.15.72:0/520622041 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bf4003a00 msgr2=0x7f6bf4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:33.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.399+0000 7f6c0bfff700 1 --2- 172.21.15.72:0/520622041 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bf4003a00 0x7f6bf4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:33.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.399+0000 7f6c0bfff700 1 -- 172.21.15.72:0/520622041 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf40035b0 con 0x7f6bf4004d90 2023-07-27T20:31:33.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.399+0000 7f6c0bfff700 1 --2- 172.21.15.72:0/520622041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bf4004d90 0x7f6bf4005210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6c0400e170 tx=0x7f6bf4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7ef5255a2539f51 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:33.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.399+0000 7f6c0a7fc700 1 -- 172.21.15.72:0/520622041 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0400ec90 con 0x7f6bf4004d90 2023-07-27T20:31:33.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.399+0000 7f6c0a7fc700 1 -- 172.21.15.72:0/520622041 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0400f040 con 0x7f6bf4004d90 2023-07-27T20:31:33.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.399+0000 7f6c0a7fc700 1 -- 172.21.15.72:0/520622041 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c04014480 con 0x7f6bf4004d90 2023-07-27T20:31:33.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.399+0000 7f6c11dff700 1 -- 172.21.15.72:0/520622041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bf4004d90 msgr2=0x7f6bf4005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:33.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.399+0000 7f6c11dff700 1 --2- 172.21.15.72:0/520622041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bf4004d90 0x7f6bf4005210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6c0400e170 tx=0x7f6bf4005880 comp rx=0 tx=0).stop 2023-07-27T20:31:33.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.400+0000 7f6c0bfff700 1 -- 172.21.15.72:0/520622041 reap_dead start 2023-07-27T20:31:33.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.400+0000 7f6c11dff700 1 -- 172.21.15.72:0/520622041 shutdown_connections 2023-07-27T20:31:33.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.400+0000 7f6c11dff700 1 -- 172.21.15.72:0/520622041 >> 172.21.15.72:0/520622041 conn(0x7f6c0c06a190 msgr2=0x7f6c0c06a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:33.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.400+0000 7f6c11dff700 1 -- 172.21.15.72:0/520622041 shutdown_connections 2023-07-27T20:31:33.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.400+0000 7f6c11dff700 1 -- 172.21.15.72:0/520622041 wait complete. 2023-07-27T20:31:33.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.401+0000 7f6c11dff700 1 Processor -- start 2023-07-27T20:31:33.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.402+0000 7f6c11dff700 1 -- start start 2023-07-27T20:31:33.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.402+0000 7f6c11dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bf4004d90 0x7f6c0c152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:33.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.402+0000 7f6c11dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c0c0c42c0 0x7f6c0c0bc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:33.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.402+0000 7f6c11dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c0c13eef0 0x7f6c0c13f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:33.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.402+0000 7f6c11dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c152d40 con 0x7f6c0c0c42c0 2023-07-27T20:31:33.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.402+0000 7f6c11dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c152370 con 0x7f6c0c13eef0 2023-07-27T20:31:33.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.402+0000 7f6c11dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c151d40 con 0x7f6bf4004d90 2023-07-27T20:31:33.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.403+0000 7f6c0affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c0c0c42c0 0x7f6c0c0bc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:33.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.403+0000 7f6c0affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c0c0c42c0 0x7f6c0c0bc9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55312/0 (socket says 172.21.15.72:55312) 2023-07-27T20:31:33.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.403+0000 7f6c0affd700 1 -- 172.21.15.72:0/3265098904 learned_addr learned my addr 172.21.15.72:0/3265098904 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:33.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.403+0000 7f6c0bfff700 1 --2- 172.21.15.72:0/3265098904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c0c13eef0 0x7f6c0c13f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:33.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.403+0000 7f6c0b7fe700 1 --2- 172.21.15.72:0/3265098904 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bf4004d90 0x7f6c0c152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:33.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.403+0000 7f6c0affd700 1 -- 172.21.15.72:0/3265098904 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bf4004d90 msgr2=0x7f6c0c152800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:33.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.403+0000 7f6c0affd700 1 --2- 172.21.15.72:0/3265098904 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bf4004d90 0x7f6c0c152800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:33.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.403+0000 7f6c0affd700 1 -- 172.21.15.72:0/3265098904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c0c13eef0 msgr2=0x7f6c0c13f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:33.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.403+0000 7f6c0affd700 1 --2- 172.21.15.72:0/3265098904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c0c13eef0 0x7f6c0c13f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:33.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.403+0000 7f6c0affd700 1 -- 172.21.15.72:0/3265098904 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0c144d40 con 0x7f6c0c0c42c0 2023-07-27T20:31:33.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.403+0000 7f6c0bfff700 1 --2- 172.21.15.72:0/3265098904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c0c13eef0 0x7f6c0c13f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:31:33.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.403+0000 7f6c0affd700 1 --2- 172.21.15.72:0/3265098904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c0c0c42c0 0x7f6c0c0bc9c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6c00011ad0 tx=0x7f6c00011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:33.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.403+0000 7f6bf3fff700 1 -- 172.21.15.72:0/3265098904 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0000f9a0 con 0x7f6c0c0c42c0 2023-07-27T20:31:33.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.403+0000 7f6bf3fff700 1 -- 172.21.15.72:0/3265098904 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0000fb00 con 0x7f6c0c0c42c0 2023-07-27T20:31:33.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.404+0000 7f6c11dff700 1 -- 172.21.15.72:0/3265098904 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c0c145020 con 0x7f6c0c0c42c0 2023-07-27T20:31:33.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.404+0000 7f6bf3fff700 1 -- 172.21.15.72:0/3265098904 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0000feb0 con 0x7f6c0c0c42c0 2023-07-27T20:31:33.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.404+0000 7f6c11dff700 1 -- 172.21.15.72:0/3265098904 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c0c153e30 con 0x7f6c0c0c42c0 2023-07-27T20:31:33.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.405+0000 7f6c11dff700 1 -- 172.21.15.72:0/3265098904 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c0c04e470 con 0x7f6c0c0c42c0 2023-07-27T20:31:33.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.405+0000 7f6bf3fff700 1 -- 172.21.15.72:0/3265098904 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6c00014440 con 0x7f6c0c0c42c0 2023-07-27T20:31:33.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.406+0000 7f6bf3fff700 1 --2- 172.21.15.72:0/3265098904 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f6bf806ace0 0x7f6bf806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:33.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.406+0000 7f6bf3fff700 1 -- 172.21.15.72:0/3265098904 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f6c00089e80 con 0x7f6c0c0c42c0 2023-07-27T20:31:33.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.407+0000 7f6c0b7fe700 1 --2- 172.21.15.72:0/3265098904 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f6bf806ace0 0x7f6bf806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:33.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.407+0000 7f6c0b7fe700 1 --2- 172.21.15.72:0/3265098904 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f6bf806ace0 0x7f6bf806d1a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc0015d0 tx=0x7f6bfc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:33.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.411+0000 7f6bf3fff700 1 -- 172.21.15.72:0/3265098904 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6c000587a0 con 0x7f6c0c0c42c0 2023-07-27T20:31:33.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:33.646+0000 7f6c11dff700 1 -- 172.21.15.72:0/3265098904 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f6c0c0c23e0 con 0x7f6c0c0c42c0 2023-07-27T20:31:34.032 INFO:tasks.ceph.mds.b.smithi173.stderr:2023-07-27T20:31:34.044+0000 7f5c863f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-27T20:31:34.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.156+0000 7f6bf3fff700 1 -- 172.21.15.72:0/3265098904 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f6c000220b0 con 0x7f6c0c0c42c0 2023-07-27T20:31:34.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.159+0000 7f6c11dff700 1 -- 172.21.15.72:0/3265098904 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f6bf806ace0 msgr2=0x7f6bf806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:34.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.159+0000 7f6c11dff700 1 --2- 172.21.15.72:0/3265098904 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f6bf806ace0 0x7f6bf806d1a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc0015d0 tx=0x7f6bfc009040 comp rx=0 tx=0).stop 2023-07-27T20:31:34.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.159+0000 7f6c11dff700 1 -- 172.21.15.72:0/3265098904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c0c0c42c0 msgr2=0x7f6c0c0bc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:34.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.159+0000 7f6c11dff700 1 --2- 172.21.15.72:0/3265098904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c0c0c42c0 0x7f6c0c0bc9c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6c00011ad0 tx=0x7f6c00011e90 comp rx=0 tx=0).stop 2023-07-27T20:31:34.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.160+0000 7f6c11dff700 1 -- 172.21.15.72:0/3265098904 shutdown_connections 2023-07-27T20:31:34.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.160+0000 7f6c11dff700 1 --2- 172.21.15.72:0/3265098904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c0c13eef0 0x7f6c0c13f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:34.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.160+0000 7f6c11dff700 1 --2- 172.21.15.72:0/3265098904 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f6bf806ace0 0x7f6bf806d1a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:34.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.160+0000 7f6c11dff700 1 --2- 172.21.15.72:0/3265098904 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bf4004d90 0x7f6c0c152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:34.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.160+0000 7f6c11dff700 1 --2- 172.21.15.72:0/3265098904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c0c0c42c0 0x7f6c0c0bc9c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:34.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.160+0000 7f6c11dff700 1 -- 172.21.15.72:0/3265098904 >> 172.21.15.72:0/3265098904 conn(0x7f6c0c06a190 msgr2=0x7f6c0c0bfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:34.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.160+0000 7f6c11dff700 1 -- 172.21.15.72:0/3265098904 shutdown_connections 2023-07-27T20:31:34.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.160+0000 7f6c11dff700 1 -- 172.21.15.72:0/3265098904 wait complete. 2023-07-27T20:31:34.151 INFO:teuthology.orchestra.run.smithi072.stderr:added data pool 5 to fsmap 2023-07-27T20:31:34.167 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T20:31:34.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.377+0000 7faddc3ff700 1 Processor -- start 2023-07-27T20:31:34.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.377+0000 7faddc3ff700 1 -- start start 2023-07-27T20:31:34.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.378+0000 7faddc3ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fadd406ef00 0x7fadd40a8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:34.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.378+0000 7faddc3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fadd406b900 0x7fadd4154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:34.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.378+0000 7faddc3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd406bd90 con 0x7fadd406b520 2023-07-27T20:31:34.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.378+0000 7faddc3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd40c1850 con 0x7fadd406b900 2023-07-27T20:31:34.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.378+0000 7faddc3ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd406e270 con 0x7fadd406ef00 2023-07-27T20:31:34.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.378+0000 7fadda19b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fadd406b520 0x7fadd4158000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36682/0 (socket says 172.21.15.72:36682) 2023-07-27T20:31:34.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.378+0000 7fadda19b700 1 -- 172.21.15.72:0/3764838361 learned_addr learned my addr 172.21.15.72:0/3764838361 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:34.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.378+0000 7fadda99c700 1 --2- 172.21.15.72:0/3764838361 >> v2:172.21.15.72:3300/0 conn(0x7fadd406b900 0x7fadd4154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:34.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.378+0000 7fadd9199700 1 -- 172.21.15.72:0/3764838361 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1719219688 0 0) 0x7fadd0001110 con 0x7fadd406b520 2023-07-27T20:31:34.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.378+0000 7fadd9199700 1 -- 172.21.15.72:0/3764838361 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadc00035b0 con 0x7fadd406b520 2023-07-27T20:31:34.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.378+0000 7fadd999a700 1 --2- 172.21.15.72:0/3764838361 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fadd406ef00 0x7fadd40a8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:34.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.379+0000 7fadda99c700 1 -- 172.21.15.72:0/3764838361 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fadd406ef00 msgr2=0x7fadd40a8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:34.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.379+0000 7fadda99c700 1 --2- 172.21.15.72:0/3764838361 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fadd406ef00 0x7fadd40a8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:34.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.379+0000 7fadda99c700 1 -- 172.21.15.72:0/3764838361 >> v1:172.21.15.72:6789/0 conn(0x7fadd406b520 legacy=0x7fadd4158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:34.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.379+0000 7fadda99c700 1 -- 172.21.15.72:0/3764838361 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd406e7a0 con 0x7fadd406b900 2023-07-27T20:31:34.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.379+0000 7fadd999a700 1 --2- 172.21.15.72:0/3764838361 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fadd406ef00 0x7fadd40a8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:31:34.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.379+0000 7fadda99c700 1 --2- 172.21.15.72:0/3764838361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadd406b900 0x7fadd4154000 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fadcc009d90 tx=0x7fadcc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a7809ea73c836dd server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:34.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.379+0000 7fadd9199700 1 -- 172.21.15.72:0/3764838361 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc00e070 con 0x7fadd406b900 2023-07-27T20:31:34.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.379+0000 7fadd9199700 1 -- 172.21.15.72:0/3764838361 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadcc00bb20 con 0x7fadd406b900 2023-07-27T20:31:34.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.379+0000 7fadd9199700 1 -- 172.21.15.72:0/3764838361 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc012430 con 0x7fadd406b900 2023-07-27T20:31:34.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.380+0000 7faddc3ff700 1 -- 172.21.15.72:0/3764838361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadd406b900 msgr2=0x7fadd4154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:34.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.380+0000 7faddc3ff700 1 --2- 172.21.15.72:0/3764838361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadd406b900 0x7fadd4154000 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fadcc009d90 tx=0x7fadcc00b330 comp rx=0 tx=0).stop 2023-07-27T20:31:34.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.380+0000 7faddc3ff700 1 -- 172.21.15.72:0/3764838361 shutdown_connections 2023-07-27T20:31:34.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.380+0000 7faddc3ff700 1 --2- 172.21.15.72:0/3764838361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadd406b900 0x7fadd4154000 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:34.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.380+0000 7faddc3ff700 1 --2- 172.21.15.72:0/3764838361 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fadd406ef00 0x7fadd40a8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:34.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.380+0000 7faddc3ff700 1 -- 172.21.15.72:0/3764838361 >> 172.21.15.72:0/3764838361 conn(0x7fadd40c6800 msgr2=0x7fadd40c6c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:34.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.380+0000 7faddc3ff700 1 -- 172.21.15.72:0/3764838361 shutdown_connections 2023-07-27T20:31:34.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.380+0000 7faddc3ff700 1 -- 172.21.15.72:0/3764838361 wait complete. 2023-07-27T20:31:34.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.381+0000 7faddc3ff700 1 Processor -- start 2023-07-27T20:31:34.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.382+0000 7faddc3ff700 1 -- start start 2023-07-27T20:31:34.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.382+0000 7faddc3ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fadd406b520 0x7fadd40a7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:34.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.382+0000 7faddc3ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fadd406b900 0x7fadd40abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:34.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.382+0000 7faddc3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadd406ef00 0x7fadd40a6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:34.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.382+0000 7faddc3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd40ab830 con 0x7fadd406ef00 2023-07-27T20:31:34.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.382+0000 7faddc3ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd41e9b20 con 0x7fadd406b900 2023-07-27T20:31:34.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.382+0000 7faddc3ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd40ac4c0 con 0x7fadd406b520 2023-07-27T20:31:34.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.383+0000 7fadda99c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadd406ef00 0x7fadd40a6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:34.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.383+0000 7fadda99c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadd406ef00 0x7fadd40a6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55334/0 (socket says 172.21.15.72:55334) 2023-07-27T20:31:34.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.383+0000 7fadda99c700 1 -- 172.21.15.72:0/3095696435 learned_addr learned my addr 172.21.15.72:0/3095696435 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:34.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.383+0000 7fadda19b700 1 --2- 172.21.15.72:0/3095696435 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fadd406b520 0x7fadd40a7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:34.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.383+0000 7fadd999a700 1 --2- 172.21.15.72:0/3095696435 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fadd406b900 0x7fadd40abbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:34.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.383+0000 7fadda99c700 1 -- 172.21.15.72:0/3095696435 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fadd406b520 msgr2=0x7fadd40a7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:34.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.383+0000 7fadda99c700 1 --2- 172.21.15.72:0/3095696435 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fadd406b520 0x7fadd40a7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:34.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.383+0000 7fadda99c700 1 -- 172.21.15.72:0/3095696435 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fadd406b900 msgr2=0x7fadd40abbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:34.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.383+0000 7fadda99c700 1 --2- 172.21.15.72:0/3095696435 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fadd406b900 0x7fadd40abbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:34.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.383+0000 7fadda99c700 1 -- 172.21.15.72:0/3095696435 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadcc009a70 con 0x7fadd406ef00 2023-07-27T20:31:34.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.383+0000 7fadda99c700 1 --2- 172.21.15.72:0/3095696435 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadd406ef00 0x7fadd40a6170 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fadcc014040 tx=0x7fadcc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:34.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.384+0000 7fadcaffd700 1 -- 172.21.15.72:0/3095696435 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc012430 con 0x7fadd406ef00 2023-07-27T20:31:34.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.384+0000 7fadcaffd700 1 -- 172.21.15.72:0/3095696435 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadcc020070 con 0x7fadd406ef00 2023-07-27T20:31:34.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.384+0000 7faddc3ff700 1 -- 172.21.15.72:0/3095696435 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd41e9da0 con 0x7fadd406ef00 2023-07-27T20:31:34.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.384+0000 7fadcaffd700 1 -- 172.21.15.72:0/3095696435 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc003ea0 con 0x7fadd406ef00 2023-07-27T20:31:34.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.384+0000 7faddc3ff700 1 -- 172.21.15.72:0/3095696435 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd41ea360 con 0x7fadd406ef00 2023-07-27T20:31:34.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.385+0000 7faddc3ff700 1 -- 172.21.15.72:0/3095696435 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd41ea580 con 0x7fadd406ef00 2023-07-27T20:31:34.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.386+0000 7fadcaffd700 1 -- 172.21.15.72:0/3095696435 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fadcc004040 con 0x7fadd406ef00 2023-07-27T20:31:34.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.387+0000 7fadcaffd700 1 --2- 172.21.15.72:0/3095696435 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fadb806ace0 0x7fadb806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:34.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.387+0000 7fadcaffd700 1 -- 172.21.15.72:0/3095696435 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fadcc022070 con 0x7fadd406ef00 2023-07-27T20:31:34.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.387+0000 7fadda19b700 1 --2- 172.21.15.72:0/3095696435 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fadb806ace0 0x7fadb806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:34.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.388+0000 7fadda19b700 1 --2- 172.21.15.72:0/3095696435 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fadb806ace0 0x7fadb806d1a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fadd0007fd0 tx=0x7fadd0007c40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:34.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.391+0000 7fadcaffd700 1 -- 172.21.15.72:0/3095696435 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fadcc056140 con 0x7fadd406ef00 2023-07-27T20:31:34.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.628+0000 7faddc3ff700 1 -- 172.21.15.72:0/3095696435 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadd4074310 con 0x7fadd406ef00 2023-07-27T20:31:34.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.629+0000 7fadcaffd700 1 -- 172.21.15.72:0/3095696435 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4670 (secure 0 0 0) 0x7fadcc059760 con 0x7fadd406ef00 2023-07-27T20:31:34.616 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:31:34.617 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/1913374698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1913374698},{"type":"v1","addr":"172.21.15.72:6834","nonce":1913374698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/3260445560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":3260445560},{"type":"v1","addr":"172.21.15.72:6835","nonce":3260445560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1305837931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1305837931},{"type":"v1","addr":"172.21.15.173:6837","nonce":1305837931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T20:31:28.592113+0000","modified":"2023-07-27T20:31:34.152667+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6835/516740687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":516740687},{"type":"v1","addr":"172.21.15.173:6835","nonce":516740687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-07-27T20:31:34.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.631+0000 7faddc3ff700 1 -- 172.21.15.72:0/3095696435 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fadb806ace0 msgr2=0x7fadb806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:34.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.631+0000 7faddc3ff700 1 --2- 172.21.15.72:0/3095696435 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fadb806ace0 0x7fadb806d1a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fadd0007fd0 tx=0x7fadd0007c40 comp rx=0 tx=0).stop 2023-07-27T20:31:34.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.631+0000 7faddc3ff700 1 -- 172.21.15.72:0/3095696435 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadd406ef00 msgr2=0x7fadd40a6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:34.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.631+0000 7faddc3ff700 1 --2- 172.21.15.72:0/3095696435 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadd406ef00 0x7fadd40a6170 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fadcc014040 tx=0x7fadcc004ad0 comp rx=0 tx=0).stop 2023-07-27T20:31:34.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.631+0000 7faddc3ff700 1 -- 172.21.15.72:0/3095696435 shutdown_connections 2023-07-27T20:31:34.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.631+0000 7faddc3ff700 1 --2- 172.21.15.72:0/3095696435 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadd406ef00 0x7fadd40a6170 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:34.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.631+0000 7faddc3ff700 1 --2- 172.21.15.72:0/3095696435 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fadb806ace0 0x7fadb806d1a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:34.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.631+0000 7faddc3ff700 1 --2- 172.21.15.72:0/3095696435 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fadd406b520 0x7fadd40a7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:34.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.631+0000 7faddc3ff700 1 --2- 172.21.15.72:0/3095696435 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fadd406b900 0x7fadd40abbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:34.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.631+0000 7faddc3ff700 1 -- 172.21.15.72:0/3095696435 >> 172.21.15.72:0/3095696435 conn(0x7fadd40c6800 msgr2=0x7fadd4154780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:34.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.631+0000 7faddc3ff700 1 -- 172.21.15.72:0/3095696435 shutdown_connections 2023-07-27T20:31:34.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.631+0000 7faddc3ff700 1 -- 172.21.15.72:0/3095696435 wait complete. 2023-07-27T20:31:34.620 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 7 2023-07-27T20:31:34.636 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:31:34.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.844+0000 7f4b109ff700 1 Processor -- start 2023-07-27T20:31:34.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.844+0000 7f4b109ff700 1 -- start start 2023-07-27T20:31:34.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.845+0000 7f4b109ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4b0c06b150 0x7f4b0c0c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:34.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.845+0000 7f4b109ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b0c1549f0 0x7f4b0c1514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:34.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.845+0000 7f4b109ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b0c06b710 con 0x7f4b0c0c4400 2023-07-27T20:31:34.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.845+0000 7f4b109ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b0c1545d0 con 0x7f4b0c06b150 2023-07-27T20:31:34.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.845+0000 7f4b109ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c06c860 con 0x7f4b0c1549f0 2023-07-27T20:31:34.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.845+0000 7f4b0a59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4b0c0c4400 0x7f4b0c0c4cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36688/0 (socket says 172.21.15.72:36688) 2023-07-27T20:31:34.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.845+0000 7f4b0a59c700 1 -- 172.21.15.72:0/456406947 learned_addr learned my addr 172.21.15.72:0/456406947 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:34.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.846+0000 7f4b0ad9d700 1 --2- 172.21.15.72:0/456406947 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b0c1549f0 0x7f4b0c1514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:34.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.846+0000 7f4b09d9b700 1 --2- 172.21.15.72:0/456406947 >> v2:172.21.15.173:3300/0 conn(0x7f4b0c06b150 0x7f4b0c0c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:34.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.846+0000 7f4b0959a700 1 -- 172.21.15.72:0/456406947 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1332376480 0 0) 0x7f4b0c06b710 con 0x7f4b0c0c4400 2023-07-27T20:31:34.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.846+0000 7f4b0959a700 1 -- 172.21.15.72:0/456406947 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4af40035b0 con 0x7f4b0c0c4400 2023-07-27T20:31:34.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.846+0000 7f4b0959a700 1 -- 172.21.15.72:0/456406947 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1133659074 0 0) 0x7f4af40035b0 con 0x7f4b0c0c4400 2023-07-27T20:31:34.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.846+0000 7f4b0959a700 1 -- 172.21.15.72:0/456406947 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b0c1549f0 msgr2=0x7f4b0c1514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:34.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.846+0000 7f4b0959a700 1 --2- 172.21.15.72:0/456406947 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b0c1549f0 0x7f4b0c1514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:34.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.846+0000 7f4b0959a700 1 -- 172.21.15.72:0/456406947 >> v2:172.21.15.173:3300/0 conn(0x7f4b0c06b150 msgr2=0x7f4b0c0c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:34.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.846+0000 7f4b0959a700 1 --2- 172.21.15.72:0/456406947 >> v2:172.21.15.173:3300/0 conn(0x7f4b0c06b150 0x7f4b0c0c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:34.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.846+0000 7f4b0959a700 1 -- 172.21.15.72:0/456406947 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0c06b9f0 con 0x7f4b0c0c4400 2023-07-27T20:31:34.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.846+0000 7f4b0959a700 1 -- 172.21.15.72:0/456406947 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f4afc001670 con 0x7f4b0c0c4400 2023-07-27T20:31:34.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.846+0000 7f4b0959a700 1 -- 172.21.15.72:0/456406947 >> v1:172.21.15.72:6789/0 conn(0x7f4b0c0c4400 legacy=0x7f4b0c0c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:34.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.846+0000 7f4b0959a700 1 --2- 172.21.15.72:0/456406947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4af4003a00 0x7f4af4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:34.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.846+0000 7f4b0959a700 1 --2- 172.21.15.72:0/456406947 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b0c1549f0 0x7f4af4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:34.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.846+0000 7f4b0959a700 1 --2- 172.21.15.72:0/456406947 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4af4004d90 0x7f4af4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:34.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.846+0000 7f4b0959a700 1 -- 172.21.15.72:0/456406947 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c1545d0 con 0x7f4af4003a00 2023-07-27T20:31:34.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.846+0000 7f4b0959a700 1 -- 172.21.15.72:0/456406947 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af400ba10 con 0x7f4af4004d90 2023-07-27T20:31:34.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.846+0000 7f4b0959a700 1 -- 172.21.15.72:0/456406947 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af400bbd0 con 0x7f4b0c1549f0 2023-07-27T20:31:34.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.846+0000 7f4b09d9b700 1 --2- 172.21.15.72:0/456406947 >> v2:172.21.15.173:3300/0 conn(0x7f4b0c06b150 0x7f4b0c0c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:31:34.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.846+0000 7f4b0a59c700 1 --2- 172.21.15.72:0/456406947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4af4003a00 0x7f4af4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:34.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.847+0000 7f4b0ad9d700 1 --2- 172.21.15.72:0/456406947 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4af4004d90 0x7f4af4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:34.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.847+0000 7f4b09d9b700 1 --2- 172.21.15.72:0/456406947 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b0c1549f0 0x7f4af4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:34.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.847+0000 7f4b0a59c700 1 -- 172.21.15.72:0/456406947 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b0c1549f0 msgr2=0x7f4af4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:34.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.847+0000 7f4b0a59c700 1 --2- 172.21.15.72:0/456406947 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b0c1549f0 0x7f4af4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:34.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.847+0000 7f4b0a59c700 1 -- 172.21.15.72:0/456406947 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4af4004d90 msgr2=0x7f4af4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:34.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.847+0000 7f4b0a59c700 1 --2- 172.21.15.72:0/456406947 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4af4004d90 0x7f4af4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:34.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.847+0000 7f4b0a59c700 1 -- 172.21.15.72:0/456406947 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af40035b0 con 0x7f4af4003a00 2023-07-27T20:31:34.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.847+0000 7f4b09d9b700 1 --2- 172.21.15.72:0/456406947 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b0c1549f0 0x7f4af4004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:31:34.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.847+0000 7f4b0a59c700 1 --2- 172.21.15.72:0/456406947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4af4003a00 0x7f4af4003e20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4afc00c320 tx=0x7f4af4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb274679127f3bd server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:34.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.847+0000 7f4b0959a700 1 -- 172.21.15.72:0/456406947 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc00ce60 con 0x7f4af4003a00 2023-07-27T20:31:34.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.847+0000 7f4b0959a700 1 -- 172.21.15.72:0/456406947 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4afc005960 con 0x7f4af4003a00 2023-07-27T20:31:34.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.847+0000 7f4b0959a700 1 -- 172.21.15.72:0/456406947 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc005cf0 con 0x7f4af4003a00 2023-07-27T20:31:34.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.848+0000 7f4b109ff700 1 -- 172.21.15.72:0/456406947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4af4003a00 msgr2=0x7f4af4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:34.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.848+0000 7f4b109ff700 1 --2- 172.21.15.72:0/456406947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4af4003a00 0x7f4af4003e20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4afc00c320 tx=0x7f4af4005880 comp rx=0 tx=0).stop 2023-07-27T20:31:34.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.848+0000 7f4b0ad9d700 1 -- 172.21.15.72:0/456406947 reap_dead start 2023-07-27T20:31:34.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.848+0000 7f4b109ff700 1 -- 172.21.15.72:0/456406947 shutdown_connections 2023-07-27T20:31:34.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.848+0000 7f4b109ff700 1 -- 172.21.15.72:0/456406947 >> 172.21.15.72:0/456406947 conn(0x7f4b0c0ab300 msgr2=0x7f4b0c0ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:34.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.848+0000 7f4b109ff700 1 -- 172.21.15.72:0/456406947 shutdown_connections 2023-07-27T20:31:34.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.848+0000 7f4b109ff700 1 -- 172.21.15.72:0/456406947 wait complete. 2023-07-27T20:31:34.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.850+0000 7f4b109ff700 1 Processor -- start 2023-07-27T20:31:34.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.850+0000 7f4b109ff700 1 -- start start 2023-07-27T20:31:34.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.850+0000 7f4b109ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4af4003a00 0x7f4b0c147b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:34.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.851+0000 7f4b109ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b0c152ce0 0x7f4b0c0ae530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:34.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.851+0000 7f4b109ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b0c0c08e0 0x7f4b0c0c0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:34.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.851+0000 7f4b109ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c0adf00 con 0x7f4b0c0c08e0 2023-07-27T20:31:34.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.851+0000 7f4b109ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c0ada70 con 0x7f4b0c152ce0 2023-07-27T20:31:34.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.851+0000 7f4b109ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c0af4a0 con 0x7f4af4003a00 2023-07-27T20:31:34.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.851+0000 7f4b0ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b0c0c08e0 0x7f4b0c0c0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:34.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.851+0000 7f4b0ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b0c0c08e0 0x7f4b0c0c0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55352/0 (socket says 172.21.15.72:55352) 2023-07-27T20:31:34.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.851+0000 7f4b0ad9d700 1 -- 172.21.15.72:0/1516884787 learned_addr learned my addr 172.21.15.72:0/1516884787 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:34.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.851+0000 7f4b0a59c700 1 --2- 172.21.15.72:0/1516884787 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4af4003a00 0x7f4b0c147b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:34.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.851+0000 7f4b09d9b700 1 --2- 172.21.15.72:0/1516884787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b0c152ce0 0x7f4b0c0ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:34.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.851+0000 7f4b0ad9d700 1 -- 172.21.15.72:0/1516884787 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4af4003a00 msgr2=0x7f4b0c147b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:34.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.851+0000 7f4b0ad9d700 1 --2- 172.21.15.72:0/1516884787 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4af4003a00 0x7f4b0c147b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:34.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.851+0000 7f4b0ad9d700 1 -- 172.21.15.72:0/1516884787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b0c152ce0 msgr2=0x7f4b0c0ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:34.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.851+0000 7f4b0ad9d700 1 --2- 172.21.15.72:0/1516884787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b0c152ce0 0x7f4b0c0ae530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:34.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.851+0000 7f4b0ad9d700 1 -- 172.21.15.72:0/1516884787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0c0ad180 con 0x7f4b0c0c08e0 2023-07-27T20:31:34.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.851+0000 7f4b09d9b700 1 --2- 172.21.15.72:0/1516884787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b0c152ce0 0x7f4b0c0ae530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:31:34.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.851+0000 7f4b0a59c700 1 --2- 172.21.15.72:0/1516884787 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4af4003a00 0x7f4b0c147b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:31:34.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.851+0000 7f4b0ad9d700 1 --2- 172.21.15.72:0/1516884787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b0c0c08e0 0x7f4b0c0c0d60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c06ae60 tx=0x7f4b040114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:34.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.852+0000 7f4afaffd700 1 -- 172.21.15.72:0/1516884787 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0400e070 con 0x7f4b0c0c08e0 2023-07-27T20:31:34.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.852+0000 7f4afaffd700 1 -- 172.21.15.72:0/1516884787 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b04003c30 con 0x7f4b0c0c08e0 2023-07-27T20:31:34.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.852+0000 7f4b109ff700 1 -- 172.21.15.72:0/1516884787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b0c0ad420 con 0x7f4b0c0c08e0 2023-07-27T20:31:34.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.852+0000 7f4afaffd700 1 -- 172.21.15.72:0/1516884787 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b04003de0 con 0x7f4b0c0c08e0 2023-07-27T20:31:34.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.852+0000 7f4b109ff700 1 -- 172.21.15.72:0/1516884787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b0c0aea70 con 0x7f4b0c0c08e0 2023-07-27T20:31:34.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.853+0000 7f4b109ff700 1 -- 172.21.15.72:0/1516884787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b0c04e470 con 0x7f4b0c0c08e0 2023-07-27T20:31:34.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.854+0000 7f4afaffd700 1 -- 172.21.15.72:0/1516884787 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4b04011a10 con 0x7f4b0c0c08e0 2023-07-27T20:31:34.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.855+0000 7f4afaffd700 1 --2- 172.21.15.72:0/1516884787 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4aec06ace0 0x7f4aec06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:34.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.855+0000 7f4afaffd700 1 -- 172.21.15.72:0/1516884787 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4b04089d80 con 0x7f4b0c0c08e0 2023-07-27T20:31:34.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.855+0000 7f4b0a59c700 1 --2- 172.21.15.72:0/1516884787 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4aec06ace0 0x7f4aec06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:34.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.856+0000 7f4b0a59c700 1 --2- 172.21.15.72:0/1516884787 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4aec06ace0 0x7f4aec06d1a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4afc015040 tx=0x7f4afc00a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:34.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:34.859+0000 7f4afaffd700 1 -- 172.21.15.72:0/1516884787 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4b04054b30 con 0x7f4b0c0c08e0 2023-07-27T20:31:35.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.056+0000 7f4b109ff700 1 -- 172.21.15.72:0/1516884787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b0c06a190 con 0x7f4b0c0c08e0 2023-07-27T20:31:35.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.057+0000 7f4afaffd700 1 -- 172.21.15.72:0/1516884787 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20120 (secure 0 0 0) 0x7f4b04058150 con 0x7f4b0c0c08e0 2023-07-27T20:31:35.045 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:31:35.046 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:31:33.647304+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:31:27.020951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T20:31:27.566022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-27T20:31:31.182401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:31:35.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.060+0000 7f4b109ff700 1 -- 172.21.15.72:0/1516884787 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4aec06ace0 msgr2=0x7f4aec06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:35.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.060+0000 7f4b109ff700 1 --2- 172.21.15.72:0/1516884787 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4aec06ace0 0x7f4aec06d1a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4afc015040 tx=0x7f4afc00a000 comp rx=0 tx=0).stop 2023-07-27T20:31:35.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.060+0000 7f4b109ff700 1 -- 172.21.15.72:0/1516884787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b0c0c08e0 msgr2=0x7f4b0c0c0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:35.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.060+0000 7f4b109ff700 1 --2- 172.21.15.72:0/1516884787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b0c0c08e0 0x7f4b0c0c0d60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c06ae60 tx=0x7f4b040114b0 comp rx=0 tx=0).stop 2023-07-27T20:31:35.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.060+0000 7f4b109ff700 1 -- 172.21.15.72:0/1516884787 shutdown_connections 2023-07-27T20:31:35.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.060+0000 7f4b109ff700 1 --2- 172.21.15.72:0/1516884787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b0c0c08e0 0x7f4b0c0c0d60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:35.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.060+0000 7f4b109ff700 1 --2- 172.21.15.72:0/1516884787 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4aec06ace0 0x7f4aec06d1a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:35.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.060+0000 7f4b109ff700 1 --2- 172.21.15.72:0/1516884787 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4af4003a00 0x7f4b0c147b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:35.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.060+0000 7f4b109ff700 1 --2- 172.21.15.72:0/1516884787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b0c152ce0 0x7f4b0c0ae530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:35.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.060+0000 7f4b109ff700 1 -- 172.21.15.72:0/1516884787 >> 172.21.15.72:0/1516884787 conn(0x7f4b0c0ab300 msgr2=0x7f4b0c1505c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:35.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.060+0000 7f4b109ff700 1 -- 172.21.15.72:0/1516884787 shutdown_connections 2023-07-27T20:31:35.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.060+0000 7f4b109ff700 1 -- 172.21.15.72:0/1516884787 wait complete. 2023-07-27T20:31:35.066 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:31:35.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.275+0000 7f25eebff700 1 Processor -- start 2023-07-27T20:31:35.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.275+0000 7f25eebff700 1 -- start start 2023-07-27T20:31:35.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.276+0000 7f25eebff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f25e8139960 0x7f25e80c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:35.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.276+0000 7f25eebff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f25e81542e0 0x7f25e8154750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:35.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.276+0000 7f25eebff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e80c1810 con 0x7f25e8139f80 2023-07-27T20:31:35.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.276+0000 7f25eebff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25e80c0ee0 con 0x7f25e8139960 2023-07-27T20:31:35.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.276+0000 7f25eebff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e8139d40 con 0x7f25e81542e0 2023-07-27T20:31:35.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.276+0000 7f25ec99b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f25e8139960 0x7f25e80c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:35.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.277+0000 7f25ec99b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f25e8139960 0x7f25e80c12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55360/0 (socket says 172.21.15.72:55360) 2023-07-27T20:31:35.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.277+0000 7f25ec99b700 1 -- 172.21.15.72:0/1451534051 learned_addr learned my addr 172.21.15.72:0/1451534051 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:35.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.277+0000 7f25ed19c700 1 --2- 172.21.15.72:0/1451534051 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f25e81542e0 0x7f25e8154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:35.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.277+0000 7f25ec99b700 1 -- 172.21.15.72:0/1451534051 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f25e81542e0 msgr2=0x7f25e8154750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:35.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.277+0000 7f25ec99b700 1 --2- 172.21.15.72:0/1451534051 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f25e81542e0 0x7f25e8154750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:35.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.277+0000 7f25ec99b700 1 -- 172.21.15.72:0/1451534051 >> v1:172.21.15.173:6789/0 conn(0x7f25e8139f80 legacy=0x7f25e80c1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:35.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.277+0000 7f25ec99b700 1 -- 172.21.15.72:0/1451534051 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e8151060 con 0x7f25e8139960 2023-07-27T20:31:35.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.277+0000 7f25ed19c700 1 --2- 172.21.15.72:0/1451534051 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f25e81542e0 0x7f25e8154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:31:35.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.277+0000 7f25ec99b700 1 --2- 172.21.15.72:0/1451534051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25e8139960 0x7f25e80c12d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f25dc00bb90 tx=0x7f25dc00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea7ce9d733c85fcf server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:35.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.277+0000 7f25e77fe700 1 -- 172.21.15.72:0/1451534051 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc00dd10 con 0x7f25e8139960 2023-07-27T20:31:35.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.277+0000 7f25e77fe700 1 -- 172.21.15.72:0/1451534051 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25dc00de70 con 0x7f25e8139960 2023-07-27T20:31:35.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.277+0000 7f25e77fe700 1 -- 172.21.15.72:0/1451534051 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc004230 con 0x7f25e8139960 2023-07-27T20:31:35.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.278+0000 7f25eebff700 1 -- 172.21.15.72:0/1451534051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25e8139960 msgr2=0x7f25e80c12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:35.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.278+0000 7f25eebff700 1 --2- 172.21.15.72:0/1451534051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25e8139960 0x7f25e80c12d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f25dc00bb90 tx=0x7f25dc00bea0 comp rx=0 tx=0).stop 2023-07-27T20:31:35.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.278+0000 7f25eebff700 1 -- 172.21.15.72:0/1451534051 shutdown_connections 2023-07-27T20:31:35.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.278+0000 7f25eebff700 1 --2- 172.21.15.72:0/1451534051 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f25e81542e0 0x7f25e8154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:35.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.278+0000 7f25eebff700 1 --2- 172.21.15.72:0/1451534051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25e8139960 0x7f25e80c12d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:35.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.278+0000 7f25eebff700 1 -- 172.21.15.72:0/1451534051 >> 172.21.15.72:0/1451534051 conn(0x7f25e806a190 msgr2=0x7f25e806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:35.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.278+0000 7f25eebff700 1 -- 172.21.15.72:0/1451534051 shutdown_connections 2023-07-27T20:31:35.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.278+0000 7f25eebff700 1 -- 172.21.15.72:0/1451534051 wait complete. 2023-07-27T20:31:35.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.280+0000 7f25eebff700 1 Processor -- start 2023-07-27T20:31:35.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.280+0000 7f25eebff700 1 -- start start 2023-07-27T20:31:35.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.281+0000 7f25eebff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25e8139960 0x7f25e8132780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:35.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.281+0000 7f25eebff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f25e8139f80 0x7f25e814dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:35.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.281+0000 7f25eebff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25e81542e0 0x7f25e814e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:35.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.281+0000 7f25eebff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e81302a0 con 0x7f25e8139960 2023-07-27T20:31:35.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.281+0000 7f25eebff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e81348b0 con 0x7f25e81542e0 2023-07-27T20:31:35.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.281+0000 7f25eebff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e814e640 con 0x7f25e8139f80 2023-07-27T20:31:35.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.281+0000 7f25ec99b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25e8139960 0x7f25e8132780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:35.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.281+0000 7f25ec99b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25e8139960 0x7f25e8132780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55372/0 (socket says 172.21.15.72:55372) 2023-07-27T20:31:35.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.281+0000 7f25ec99b700 1 -- 172.21.15.72:0/1609076996 learned_addr learned my addr 172.21.15.72:0/1609076996 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:35.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.281+0000 7f25e7fff700 1 --2- 172.21.15.72:0/1609076996 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f25e8139f80 0x7f25e814dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:35.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.281+0000 7f25ed19c700 1 --2- 172.21.15.72:0/1609076996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25e81542e0 0x7f25e814e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:35.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.282+0000 7f25ec99b700 1 -- 172.21.15.72:0/1609076996 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f25e8139f80 msgr2=0x7f25e814dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:35.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.282+0000 7f25ec99b700 1 --2- 172.21.15.72:0/1609076996 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f25e8139f80 0x7f25e814dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:35.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.282+0000 7f25ec99b700 1 -- 172.21.15.72:0/1609076996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25e81542e0 msgr2=0x7f25e814e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:35.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.282+0000 7f25ec99b700 1 --2- 172.21.15.72:0/1609076996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25e81542e0 0x7f25e814e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:35.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.282+0000 7f25ec99b700 1 -- 172.21.15.72:0/1609076996 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25dc00b7f0 con 0x7f25e8139960 2023-07-27T20:31:35.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.282+0000 7f25ec99b700 1 --2- 172.21.15.72:0/1609076996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25e8139960 0x7f25e8132780 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f25dc00b340 tx=0x7f25dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:35.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.282+0000 7f25e57fa700 1 -- 172.21.15.72:0/1609076996 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc00dcc0 con 0x7f25e8139960 2023-07-27T20:31:35.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.282+0000 7f25e57fa700 1 -- 172.21.15.72:0/1609076996 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25dc010470 con 0x7f25e8139960 2023-07-27T20:31:35.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.282+0000 7f25e57fa700 1 -- 172.21.15.72:0/1609076996 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc010820 con 0x7f25e8139960 2023-07-27T20:31:35.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.282+0000 7f25eebff700 1 -- 172.21.15.72:0/1609076996 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e8133ca0 con 0x7f25e8139960 2023-07-27T20:31:35.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.282+0000 7f25eebff700 1 -- 172.21.15.72:0/1609076996 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e8134260 con 0x7f25e8139960 2023-07-27T20:31:35.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.283+0000 7f25eebff700 1 -- 172.21.15.72:0/1609076996 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25e8074310 con 0x7f25e8139960 2023-07-27T20:31:35.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.284+0000 7f25e57fa700 1 -- 172.21.15.72:0/1609076996 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f25dc0193f0 con 0x7f25e8139960 2023-07-27T20:31:35.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.286+0000 7f25e57fa700 1 --2- 172.21.15.72:0/1609076996 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f25cc06ace0 0x7f25cc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:35.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.286+0000 7f25e57fa700 1 -- 172.21.15.72:0/1609076996 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f25dc08b770 con 0x7f25e8139960 2023-07-27T20:31:35.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.286+0000 7f25e7fff700 1 --2- 172.21.15.72:0/1609076996 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f25cc06ace0 0x7f25cc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:35.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.287+0000 7f25e7fff700 1 --2- 172.21.15.72:0/1609076996 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f25cc06ace0 0x7f25cc06d1a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f25e8139300 tx=0x7f25d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:35.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.290+0000 7f25e57fa700 1 -- 172.21.15.72:0/1609076996 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f25dc0565c0 con 0x7f25e8139960 2023-07-27T20:31:35.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.484+0000 7f25eebff700 1 -- 172.21.15.72:0/1609076996 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25e80bf570 con 0x7f25e8139960 2023-07-27T20:31:35.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.486+0000 7f25e57fa700 1 -- 172.21.15.72:0/1609076996 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20120 (secure 0 0 0) 0x7f25dc006d80 con 0x7f25e8139960 2023-07-27T20:31:35.473 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:31:35.474 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:31:33.647304+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:31:27.020951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T20:31:27.566022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-27T20:31:31.182401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:31:35.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.488+0000 7f25eebff700 1 -- 172.21.15.72:0/1609076996 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f25cc06ace0 msgr2=0x7f25cc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:35.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.488+0000 7f25eebff700 1 --2- 172.21.15.72:0/1609076996 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f25cc06ace0 0x7f25cc06d1a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f25e8139300 tx=0x7f25d4009040 comp rx=0 tx=0).stop 2023-07-27T20:31:35.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.488+0000 7f25eebff700 1 -- 172.21.15.72:0/1609076996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25e8139960 msgr2=0x7f25e8132780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:35.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.488+0000 7f25eebff700 1 --2- 172.21.15.72:0/1609076996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25e8139960 0x7f25e8132780 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f25dc00b340 tx=0x7f25dc004750 comp rx=0 tx=0).stop 2023-07-27T20:31:35.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.488+0000 7f25eebff700 1 -- 172.21.15.72:0/1609076996 shutdown_connections 2023-07-27T20:31:35.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.488+0000 7f25eebff700 1 --2- 172.21.15.72:0/1609076996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25e81542e0 0x7f25e814e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:35.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.488+0000 7f25eebff700 1 --2- 172.21.15.72:0/1609076996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25e8139960 0x7f25e8132780 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:35.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.488+0000 7f25eebff700 1 --2- 172.21.15.72:0/1609076996 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f25cc06ace0 0x7f25cc06d1a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:35.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.488+0000 7f25eebff700 1 --2- 172.21.15.72:0/1609076996 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f25e8139f80 0x7f25e814dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:35.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.488+0000 7f25eebff700 1 -- 172.21.15.72:0/1609076996 >> 172.21.15.72:0/1609076996 conn(0x7f25e806a190 msgr2=0x7f25e806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:35.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.488+0000 7f25eebff700 1 -- 172.21.15.72:0/1609076996 shutdown_connections 2023-07-27T20:31:35.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.488+0000 7f25eebff700 1 -- 172.21.15.72:0/1609076996 wait complete. 2023-07-27T20:31:35.509 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T20:31:35.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.716+0000 7faf2dfff700 1 Processor -- start 2023-07-27T20:31:35.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.717+0000 7faf2dfff700 1 -- start start 2023-07-27T20:31:35.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.718+0000 7faf2dfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faf280c4400 0x7faf280c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:35.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.718+0000 7faf2dfff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7faf2806b150 0x7faf280c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:35.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.718+0000 7faf2dfff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf280c5230 con 0x7faf281549f0 2023-07-27T20:31:35.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.718+0000 7faf2dfff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf281545d0 con 0x7faf280c4400 2023-07-27T20:31:35.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.718+0000 7faf2dfff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf2806c860 con 0x7faf2806b150 2023-07-27T20:31:35.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.718+0000 7faf277fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faf280c4400 0x7faf280c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:35.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.718+0000 7faf277fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faf280c4400 0x7faf280c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55384/0 (socket says 172.21.15.72:55384) 2023-07-27T20:31:35.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.718+0000 7faf277fe700 1 -- 172.21.15.72:0/3038063379 learned_addr learned my addr 172.21.15.72:0/3038063379 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:35.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.718+0000 7faf1ffff700 1 --2- 172.21.15.72:0/3038063379 >> v2:172.21.15.173:3300/0 conn(0x7faf2806b150 0x7faf280c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:35.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.718+0000 7faf277fe700 1 -- 172.21.15.72:0/3038063379 >> v2:172.21.15.173:3300/0 conn(0x7faf2806b150 msgr2=0x7faf280c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:35.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.718+0000 7faf277fe700 1 --2- 172.21.15.72:0/3038063379 >> v2:172.21.15.173:3300/0 conn(0x7faf2806b150 0x7faf280c4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:35.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.718+0000 7faf277fe700 1 -- 172.21.15.72:0/3038063379 >> v1:172.21.15.173:6789/0 conn(0x7faf281549f0 legacy=0x7faf281514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:35.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.718+0000 7faf277fe700 1 -- 172.21.15.72:0/3038063379 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2806b710 con 0x7faf280c4400 2023-07-27T20:31:35.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.719+0000 7faf277fe700 1 --2- 172.21.15.72:0/3038063379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf280c4400 0x7faf280c7710 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7faf280c0870 tx=0x7faf18009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16dd3eb5d30b9bb7 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:35.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.719+0000 7faf26ffd700 1 -- 172.21.15.72:0/3038063379 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf18011830 con 0x7faf280c4400 2023-07-27T20:31:35.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.719+0000 7faf26ffd700 1 -- 172.21.15.72:0/3038063379 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf18011990 con 0x7faf280c4400 2023-07-27T20:31:35.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.719+0000 7faf26ffd700 1 -- 172.21.15.72:0/3038063379 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf18011d20 con 0x7faf280c4400 2023-07-27T20:31:35.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.719+0000 7faf2dfff700 1 -- 172.21.15.72:0/3038063379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf280c4400 msgr2=0x7faf280c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:35.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.719+0000 7faf2dfff700 1 --2- 172.21.15.72:0/3038063379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf280c4400 0x7faf280c7710 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7faf280c0870 tx=0x7faf18009bd0 comp rx=0 tx=0).stop 2023-07-27T20:31:35.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.719+0000 7faf2dfff700 1 -- 172.21.15.72:0/3038063379 shutdown_connections 2023-07-27T20:31:35.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.719+0000 7faf2dfff700 1 --2- 172.21.15.72:0/3038063379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf280c4400 0x7faf280c7710 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:35.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.719+0000 7faf2dfff700 1 --2- 172.21.15.72:0/3038063379 >> v2:172.21.15.173:3300/0 conn(0x7faf2806b150 0x7faf280c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:35.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.719+0000 7faf2dfff700 1 -- 172.21.15.72:0/3038063379 >> 172.21.15.72:0/3038063379 conn(0x7faf280ab300 msgr2=0x7faf280ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:35.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.720+0000 7faf2dfff700 1 -- 172.21.15.72:0/3038063379 shutdown_connections 2023-07-27T20:31:35.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.720+0000 7faf2dfff700 1 -- 172.21.15.72:0/3038063379 wait complete. 2023-07-27T20:31:35.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.721+0000 7faf2dfff700 1 Processor -- start 2023-07-27T20:31:35.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.721+0000 7faf2dfff700 1 -- start start 2023-07-27T20:31:35.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.722+0000 7faf2dfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faf2806b150 0x7faf2814b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:35.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.722+0000 7faf2dfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf280c4400 0x7faf280aed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:35.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.722+0000 7faf2dfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf281549f0 0x7faf280c1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:35.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.722+0000 7faf2dfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf280c1e80 con 0x7faf281549f0 2023-07-27T20:31:35.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.722+0000 7faf2dfff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2814e5c0 con 0x7faf280c4400 2023-07-27T20:31:35.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.722+0000 7faf2dfff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf2814bef0 con 0x7faf2806b150 2023-07-27T20:31:35.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.722+0000 7faf27fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf281549f0 0x7faf280c1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:35.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.723+0000 7faf27fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf281549f0 0x7faf280c1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55394/0 (socket says 172.21.15.72:55394) 2023-07-27T20:31:35.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.723+0000 7faf27fff700 1 -- 172.21.15.72:0/3827187641 learned_addr learned my addr 172.21.15.72:0/3827187641 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:35.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.723+0000 7faf277fe700 1 --2- 172.21.15.72:0/3827187641 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faf2806b150 0x7faf2814b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:35.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.723+0000 7faf1ffff700 1 --2- 172.21.15.72:0/3827187641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf280c4400 0x7faf280aed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:35.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.723+0000 7faf27fff700 1 -- 172.21.15.72:0/3827187641 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faf2806b150 msgr2=0x7faf2814b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:35.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.723+0000 7faf27fff700 1 --2- 172.21.15.72:0/3827187641 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faf2806b150 0x7faf2814b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:35.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.723+0000 7faf27fff700 1 -- 172.21.15.72:0/3827187641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf280c4400 msgr2=0x7faf280aed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:35.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.723+0000 7faf27fff700 1 --2- 172.21.15.72:0/3827187641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf280c4400 0x7faf280aed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:35.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.723+0000 7faf27fff700 1 -- 172.21.15.72:0/3827187641 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf18009550 con 0x7faf281549f0 2023-07-27T20:31:35.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.723+0000 7faf1ffff700 1 --2- 172.21.15.72:0/3827187641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf280c4400 0x7faf280aed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:31:35.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.723+0000 7faf27fff700 1 --2- 172.21.15.72:0/3827187641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf281549f0 0x7faf280c1430 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faf2000cc80 tx=0x7faf2000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:35.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.723+0000 7faf24ff9700 1 -- 172.21.15.72:0/3827187641 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf20003c00 con 0x7faf281549f0 2023-07-27T20:31:35.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.723+0000 7faf24ff9700 1 -- 172.21.15.72:0/3827187641 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf20003d60 con 0x7faf281549f0 2023-07-27T20:31:35.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.723+0000 7faf2dfff700 1 -- 172.21.15.72:0/3827187641 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf28149e30 con 0x7faf281549f0 2023-07-27T20:31:35.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.723+0000 7faf24ff9700 1 -- 172.21.15.72:0/3827187641 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2000ab50 con 0x7faf281549f0 2023-07-27T20:31:35.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.724+0000 7faf2dfff700 1 -- 172.21.15.72:0/3827187641 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf2814e810 con 0x7faf281549f0 2023-07-27T20:31:35.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.724+0000 7faf2dfff700 1 -- 172.21.15.72:0/3827187641 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf28074310 con 0x7faf281549f0 2023-07-27T20:31:35.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.725+0000 7faf24ff9700 1 -- 172.21.15.72:0/3827187641 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faf2000acb0 con 0x7faf281549f0 2023-07-27T20:31:35.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.726+0000 7faf24ff9700 1 --2- 172.21.15.72:0/3827187641 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7faf0806ace0 0x7faf0806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:35.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.726+0000 7faf24ff9700 1 -- 172.21.15.72:0/3827187641 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7faf20089820 con 0x7faf281549f0 2023-07-27T20:31:35.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.727+0000 7faf277fe700 1 --2- 172.21.15.72:0/3827187641 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7faf0806ace0 0x7faf0806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:35.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.727+0000 7faf277fe700 1 --2- 172.21.15.72:0/3827187641 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7faf0806ace0 0x7faf0806d1a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faf18014040 tx=0x7faf18008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:35.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.730+0000 7faf24ff9700 1 -- 172.21.15.72:0/3827187641 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7faf200545d0 con 0x7faf281549f0 2023-07-27T20:31:35.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.968+0000 7faf2dfff700 1 -- 172.21.15.72:0/3827187641 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf28150a40 con 0x7faf281549f0 2023-07-27T20:31:35.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.969+0000 7faf24ff9700 1 -- 172.21.15.72:0/3827187641 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4670 (secure 0 0 0) 0x7faf20057bf0 con 0x7faf281549f0 2023-07-27T20:31:35.957 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:31:35.957 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/1913374698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1913374698},{"type":"v1","addr":"172.21.15.72:6834","nonce":1913374698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/3260445560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":3260445560},{"type":"v1","addr":"172.21.15.72:6835","nonce":3260445560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1305837931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1305837931},{"type":"v1","addr":"172.21.15.173:6837","nonce":1305837931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T20:31:28.592113+0000","modified":"2023-07-27T20:31:34.152667+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6835/516740687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":516740687},{"type":"v1","addr":"172.21.15.173:6835","nonce":516740687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-07-27T20:31:35.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.971+0000 7faf2dfff700 1 -- 172.21.15.72:0/3827187641 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7faf0806ace0 msgr2=0x7faf0806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:35.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.971+0000 7faf2dfff700 1 --2- 172.21.15.72:0/3827187641 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7faf0806ace0 0x7faf0806d1a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faf18014040 tx=0x7faf18008030 comp rx=0 tx=0).stop 2023-07-27T20:31:35.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.971+0000 7faf2dfff700 1 -- 172.21.15.72:0/3827187641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf281549f0 msgr2=0x7faf280c1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:35.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.971+0000 7faf2dfff700 1 --2- 172.21.15.72:0/3827187641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf281549f0 0x7faf280c1430 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faf2000cc80 tx=0x7faf2000cf90 comp rx=0 tx=0).stop 2023-07-27T20:31:35.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.971+0000 7faf2dfff700 1 -- 172.21.15.72:0/3827187641 shutdown_connections 2023-07-27T20:31:35.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.971+0000 7faf2dfff700 1 --2- 172.21.15.72:0/3827187641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf281549f0 0x7faf280c1430 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:35.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.971+0000 7faf2dfff700 1 --2- 172.21.15.72:0/3827187641 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7faf0806ace0 0x7faf0806d1a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:35.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.971+0000 7faf2dfff700 1 --2- 172.21.15.72:0/3827187641 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faf2806b150 0x7faf2814b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:35.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.971+0000 7faf2dfff700 1 --2- 172.21.15.72:0/3827187641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf280c4400 0x7faf280aed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:35.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.971+0000 7faf2dfff700 1 -- 172.21.15.72:0/3827187641 >> 172.21.15.72:0/3827187641 conn(0x7faf280ab300 msgr2=0x7faf280ab6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:35.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.972+0000 7faf2dfff700 1 -- 172.21.15.72:0/3827187641 shutdown_connections 2023-07-27T20:31:35.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:35.972+0000 7faf2dfff700 1 -- 172.21.15.72:0/3827187641 wait complete. 2023-07-27T20:31:35.963 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 7 2023-07-27T20:31:35.977 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:31:36.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.187+0000 7fef81bff700 1 Processor -- start 2023-07-27T20:31:36.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.187+0000 7fef81bff700 1 -- start start 2023-07-27T20:31:36.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.188+0000 7fef81bff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fef7c0c4400 0x7fef7c0c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:36.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.188+0000 7fef81bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fef7c06b150 0x7fef7c0c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:36.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.188+0000 7fef81bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fef7c1549f0 0x7fef7c1514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:36.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.188+0000 7fef81bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef7c1545d0 con 0x7fef7c06b150 2023-07-27T20:31:36.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.188+0000 7fef81bff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef7c06c860 con 0x7fef7c0c4400 2023-07-27T20:31:36.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.188+0000 7fef81bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c0c5230 con 0x7fef7c1549f0 2023-07-27T20:31:36.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.188+0000 7fef7affd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fef7c06b150 0x7fef7c0c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:36.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.188+0000 7fef7affd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fef7c06b150 0x7fef7c0c4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55396/0 (socket says 172.21.15.72:55396) 2023-07-27T20:31:36.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.188+0000 7fef7affd700 1 -- 172.21.15.72:0/3612438459 learned_addr learned my addr 172.21.15.72:0/3612438459 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:36.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.188+0000 7fef7b7fe700 1 --2- 172.21.15.72:0/3612438459 >> v2:172.21.15.173:3300/0 conn(0x7fef7c0c4400 0x7fef7c0c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:36.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.188+0000 7fef7bfff700 1 --2- 172.21.15.72:0/3612438459 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fef7c1549f0 0x7fef7c1514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:36.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.189+0000 7fef7affd700 1 -- 172.21.15.72:0/3612438459 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fef7c1549f0 msgr2=0x7fef7c1514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:36.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.189+0000 7fef7affd700 1 --2- 172.21.15.72:0/3612438459 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fef7c1549f0 0x7fef7c1514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:36.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.189+0000 7fef7affd700 1 -- 172.21.15.72:0/3612438459 >> v2:172.21.15.173:3300/0 conn(0x7fef7c0c4400 msgr2=0x7fef7c0c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:36.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.189+0000 7fef7affd700 1 --2- 172.21.15.72:0/3612438459 >> v2:172.21.15.173:3300/0 conn(0x7fef7c0c4400 0x7fef7c0c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:36.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.189+0000 7fef7affd700 1 -- 172.21.15.72:0/3612438459 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef7c06b710 con 0x7fef7c06b150 2023-07-27T20:31:36.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.189+0000 7fef7affd700 1 --2- 172.21.15.72:0/3612438459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef7c06b150 0x7fef7c0c4cf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fef7c08b040 tx=0x7fef70009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55670327e665bfc3 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:36.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.189+0000 7fef7a7fc700 1 -- 172.21.15.72:0/3612438459 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef70011830 con 0x7fef7c06b150 2023-07-27T20:31:36.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.189+0000 7fef7a7fc700 1 -- 172.21.15.72:0/3612438459 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef70011990 con 0x7fef7c06b150 2023-07-27T20:31:36.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.189+0000 7fef7a7fc700 1 -- 172.21.15.72:0/3612438459 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef70011d20 con 0x7fef7c06b150 2023-07-27T20:31:36.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.190+0000 7fef81bff700 1 -- 172.21.15.72:0/3612438459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef7c06b150 msgr2=0x7fef7c0c4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:36.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.190+0000 7fef81bff700 1 --2- 172.21.15.72:0/3612438459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef7c06b150 0x7fef7c0c4cf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fef7c08b040 tx=0x7fef70009bd0 comp rx=0 tx=0).stop 2023-07-27T20:31:36.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.190+0000 7fef81bff700 1 -- 172.21.15.72:0/3612438459 shutdown_connections 2023-07-27T20:31:36.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.190+0000 7fef81bff700 1 --2- 172.21.15.72:0/3612438459 >> v2:172.21.15.173:3300/0 conn(0x7fef7c0c4400 0x7fef7c0c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:36.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.190+0000 7fef81bff700 1 --2- 172.21.15.72:0/3612438459 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fef7c1549f0 0x7fef7c1514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:36.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.190+0000 7fef81bff700 1 --2- 172.21.15.72:0/3612438459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef7c06b150 0x7fef7c0c4cf0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:36.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.190+0000 7fef81bff700 1 -- 172.21.15.72:0/3612438459 >> 172.21.15.72:0/3612438459 conn(0x7fef7c0ab300 msgr2=0x7fef7c0ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:36.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.190+0000 7fef81bff700 1 -- 172.21.15.72:0/3612438459 shutdown_connections 2023-07-27T20:31:36.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.190+0000 7fef81bff700 1 -- 172.21.15.72:0/3612438459 wait complete. 2023-07-27T20:31:36.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.192+0000 7fef81bff700 1 Processor -- start 2023-07-27T20:31:36.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.192+0000 7fef81bff700 1 -- start start 2023-07-27T20:31:36.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.193+0000 7fef81bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef7c06b150 0x7fef7c1ea0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:36.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.193+0000 7fef81bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef7c0c4400 0x7fef7c14f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:36.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.193+0000 7fef81bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fef7c1549f0 0x7fef7c149de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:36.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.193+0000 7fef81bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c14ec20 con 0x7fef7c06b150 2023-07-27T20:31:36.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.193+0000 7fef81bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c14e940 con 0x7fef7c0c4400 2023-07-27T20:31:36.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.193+0000 7fef81bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c0c2280 con 0x7fef7c1549f0 2023-07-27T20:31:36.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.193+0000 7fef7b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef7c06b150 0x7fef7c1ea0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:36.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.193+0000 7fef7b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef7c06b150 0x7fef7c1ea0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55404/0 (socket says 172.21.15.72:55404) 2023-07-27T20:31:36.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.193+0000 7fef7b7fe700 1 -- 172.21.15.72:0/3554430034 learned_addr learned my addr 172.21.15.72:0/3554430034 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:36.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.193+0000 7fef7affd700 1 --2- 172.21.15.72:0/3554430034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef7c0c4400 0x7fef7c14f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:36.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.193+0000 7fef7bfff700 1 --2- 172.21.15.72:0/3554430034 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fef7c1549f0 0x7fef7c149de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:36.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.193+0000 7fef7b7fe700 1 -- 172.21.15.72:0/3554430034 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fef7c1549f0 msgr2=0x7fef7c149de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:36.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.193+0000 7fef7b7fe700 1 --2- 172.21.15.72:0/3554430034 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fef7c1549f0 0x7fef7c149de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:36.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.193+0000 7fef7b7fe700 1 -- 172.21.15.72:0/3554430034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef7c0c4400 msgr2=0x7fef7c14f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:36.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.193+0000 7fef7b7fe700 1 --2- 172.21.15.72:0/3554430034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef7c0c4400 0x7fef7c14f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:36.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.193+0000 7fef7b7fe700 1 -- 172.21.15.72:0/3554430034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef70009550 con 0x7fef7c06b150 2023-07-27T20:31:36.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.193+0000 7fef7affd700 1 --2- 172.21.15.72:0/3554430034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef7c0c4400 0x7fef7c14f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:31:36.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.193+0000 7fef7b7fe700 1 --2- 172.21.15.72:0/3554430034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef7c06b150 0x7fef7c1ea0f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fef6c00e930 tx=0x7fef6c00ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:36.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.194+0000 7fef63fff700 1 -- 172.21.15.72:0/3554430034 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c009690 con 0x7fef7c06b150 2023-07-27T20:31:36.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.194+0000 7fef63fff700 1 -- 172.21.15.72:0/3554430034 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6c00c850 con 0x7fef7c06b150 2023-07-27T20:31:36.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.194+0000 7fef81bff700 1 -- 172.21.15.72:0/3554430034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef7c0c2560 con 0x7fef7c06b150 2023-07-27T20:31:36.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.194+0000 7fef63fff700 1 -- 172.21.15.72:0/3554430034 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c00cbe0 con 0x7fef7c06b150 2023-07-27T20:31:36.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.194+0000 7fef81bff700 1 -- 172.21.15.72:0/3554430034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef7c14fac0 con 0x7fef7c06b150 2023-07-27T20:31:36.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.195+0000 7fef81bff700 1 -- 172.21.15.72:0/3554430034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef7c0c28d0 con 0x7fef7c06b150 2023-07-27T20:31:36.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.196+0000 7fef63fff700 1 -- 172.21.15.72:0/3554430034 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fef6c00cd40 con 0x7fef7c06b150 2023-07-27T20:31:36.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.196+0000 7fef63fff700 1 --2- 172.21.15.72:0/3554430034 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fef6806ace0 0x7fef6806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:36.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.197+0000 7fef63fff700 1 -- 172.21.15.72:0/3554430034 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fef6c0898a0 con 0x7fef7c06b150 2023-07-27T20:31:36.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.197+0000 7fef7affd700 1 --2- 172.21.15.72:0/3554430034 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fef6806ace0 0x7fef6806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:36.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.198+0000 7fef7affd700 1 --2- 172.21.15.72:0/3554430034 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fef6806ace0 0x7fef6806d1a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fef70009c10 tx=0x7fef70008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:36.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.201+0000 7fef63fff700 1 -- 172.21.15.72:0/3554430034 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fef6c054650 con 0x7fef7c06b150 2023-07-27T20:31:36.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.397+0000 7fef81bff700 1 -- 172.21.15.72:0/3554430034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef7c0c26f0 con 0x7fef7c06b150 2023-07-27T20:31:36.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.399+0000 7fef63fff700 1 -- 172.21.15.72:0/3554430034 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20120 (secure 0 0 0) 0x7fef6c057c70 con 0x7fef7c06b150 2023-07-27T20:31:36.386 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:31:36.387 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:31:33.647304+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:31:27.020951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T20:31:27.566022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-27T20:31:31.182401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:31:36.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.401+0000 7fef81bff700 1 -- 172.21.15.72:0/3554430034 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fef6806ace0 msgr2=0x7fef6806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:36.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.401+0000 7fef81bff700 1 --2- 172.21.15.72:0/3554430034 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fef6806ace0 0x7fef6806d1a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fef70009c10 tx=0x7fef70008030 comp rx=0 tx=0).stop 2023-07-27T20:31:36.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.401+0000 7fef81bff700 1 -- 172.21.15.72:0/3554430034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef7c06b150 msgr2=0x7fef7c1ea0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:36.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.401+0000 7fef81bff700 1 --2- 172.21.15.72:0/3554430034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef7c06b150 0x7fef7c1ea0f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fef6c00e930 tx=0x7fef6c00ecf0 comp rx=0 tx=0).stop 2023-07-27T20:31:36.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.401+0000 7fef81bff700 1 -- 172.21.15.72:0/3554430034 shutdown_connections 2023-07-27T20:31:36.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.401+0000 7fef81bff700 1 --2- 172.21.15.72:0/3554430034 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fef6806ace0 0x7fef6806d1a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:36.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.401+0000 7fef81bff700 1 --2- 172.21.15.72:0/3554430034 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fef7c1549f0 0x7fef7c149de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:36.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.401+0000 7fef81bff700 1 --2- 172.21.15.72:0/3554430034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef7c06b150 0x7fef7c1ea0f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:36.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.401+0000 7fef81bff700 1 --2- 172.21.15.72:0/3554430034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef7c0c4400 0x7fef7c14f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:36.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.401+0000 7fef81bff700 1 -- 172.21.15.72:0/3554430034 >> 172.21.15.72:0/3554430034 conn(0x7fef7c0ab300 msgr2=0x7fef7c150920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:36.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.401+0000 7fef81bff700 1 -- 172.21.15.72:0/3554430034 shutdown_connections 2023-07-27T20:31:36.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:36.401+0000 7fef81bff700 1 -- 172.21.15.72:0/3554430034 wait complete. 2023-07-27T20:31:36.809 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-27T20:31:28.592113+0000', 'modified': '2023-07-27T20:31:34.152667+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4267}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4267': {'gid': 4267, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.173:6835/516740687', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6834', 'nonce': 516740687}, {'type': 'v1', 'addr': '172.21.15.173:6835', 'nonce': 516740687}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-07-27T20:31:36.809 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-27T20:31:36.810 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-07-27T20:31:37.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.018+0000 7f35689ff700 1 Processor -- start 2023-07-27T20:31:37.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.018+0000 7f35689ff700 1 -- start start 2023-07-27T20:31:37.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.019+0000 7f35689ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f35640c4400 0x7f35640c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:37.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.019+0000 7f35689ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f356406b710 con 0x7f356406b150 2023-07-27T20:31:37.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.019+0000 7f35689ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f356406b9f0 con 0x7f35641549f0 2023-07-27T20:31:37.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.019+0000 7f35689ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35641545d0 con 0x7f35640c4400 2023-07-27T20:31:37.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.019+0000 7f356259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f35640c4400 0x7f35640c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:37.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.019+0000 7f3561d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f356406b150 0x7f35640c4cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36700/0 (socket says 172.21.15.72:36700) 2023-07-27T20:31:37.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.019+0000 7f356259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f35640c4400 0x7f35640c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55410/0 (socket says 172.21.15.72:55410) 2023-07-27T20:31:37.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.019+0000 7f3561d9b700 1 -- 172.21.15.72:0/553800059 learned_addr learned my addr 172.21.15.72:0/553800059 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:37.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.020+0000 7f356259c700 1 -- 172.21.15.72:0/553800059 >> v1:172.21.15.173:6789/0 conn(0x7f35641549f0 legacy=0x7f35641514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:37.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.020+0000 7f356259c700 1 -- 172.21.15.72:0/553800059 >> v1:172.21.15.72:6789/0 conn(0x7f356406b150 legacy=0x7f35640c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:37.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.020+0000 7f356259c700 1 -- 172.21.15.72:0/553800059 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f356406bcd0 con 0x7f35640c4400 2023-07-27T20:31:37.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.020+0000 7f356159a700 1 -- 172.21.15.72:0/553800059 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3936220049 0 0) 0x7f356406b710 con 0x7f356406b150 2023-07-27T20:31:37.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.020+0000 7f356259c700 1 --2- 172.21.15.72:0/553800059 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35640c4400 0x7f35640c7710 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3554009840 tx=0x7f3554009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a52d7fc8090573 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:37.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.020+0000 7f356159a700 1 -- 172.21.15.72:0/553800059 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3554011830 con 0x7f35640c4400 2023-07-27T20:31:37.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.020+0000 7f356159a700 1 -- 172.21.15.72:0/553800059 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3554011990 con 0x7f35640c4400 2023-07-27T20:31:37.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.020+0000 7f356159a700 1 -- 172.21.15.72:0/553800059 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3554011d20 con 0x7f35640c4400 2023-07-27T20:31:37.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.021+0000 7f35689ff700 1 -- 172.21.15.72:0/553800059 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35640c4400 msgr2=0x7f35640c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:37.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.021+0000 7f35689ff700 1 --2- 172.21.15.72:0/553800059 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35640c4400 0x7f35640c7710 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3554009840 tx=0x7f3554009b50 comp rx=0 tx=0).stop 2023-07-27T20:31:37.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.021+0000 7f35689ff700 1 -- 172.21.15.72:0/553800059 shutdown_connections 2023-07-27T20:31:37.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.021+0000 7f35689ff700 1 --2- 172.21.15.72:0/553800059 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35640c4400 0x7f35640c7710 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.021+0000 7f35689ff700 1 -- 172.21.15.72:0/553800059 >> 172.21.15.72:0/553800059 conn(0x7f35640ab300 msgr2=0x7f35640ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:37.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.021+0000 7f35689ff700 1 -- 172.21.15.72:0/553800059 shutdown_connections 2023-07-27T20:31:37.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.021+0000 7f35689ff700 1 -- 172.21.15.72:0/553800059 wait complete. 2023-07-27T20:31:37.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.023+0000 7f35689ff700 1 Processor -- start 2023-07-27T20:31:37.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.023+0000 7f35689ff700 1 -- start start 2023-07-27T20:31:37.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.024+0000 7f35689ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f356406b150 0x7f356414a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:37.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.024+0000 7f35689ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f35640c4400 0x7f35640aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:37.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.024+0000 7f35689ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35641549f0 0x7f3564149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:37.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.024+0000 7f35689ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35640c2360 con 0x7f35641549f0 2023-07-27T20:31:37.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.024+0000 7f35689ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356414e050 con 0x7f356406b150 2023-07-27T20:31:37.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.024+0000 7f35689ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356414a660 con 0x7f35640c4400 2023-07-27T20:31:37.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.024+0000 7f3562d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35641549f0 0x7f3564149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:37.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.024+0000 7f3562d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35641549f0 0x7f3564149190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55414/0 (socket says 172.21.15.72:55414) 2023-07-27T20:31:37.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.024+0000 7f3562d9d700 1 -- 172.21.15.72:0/303064800 learned_addr learned my addr 172.21.15.72:0/303064800 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:37.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.024+0000 7f3561d9b700 1 --2- 172.21.15.72:0/303064800 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f35640c4400 0x7f35640aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:37.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.024+0000 7f356259c700 1 --2- 172.21.15.72:0/303064800 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f356406b150 0x7f356414a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:37.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.024+0000 7f3562d9d700 1 -- 172.21.15.72:0/303064800 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f35640c4400 msgr2=0x7f35640aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:37.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.024+0000 7f3562d9d700 1 --2- 172.21.15.72:0/303064800 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f35640c4400 0x7f35640aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.024+0000 7f3562d9d700 1 -- 172.21.15.72:0/303064800 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f356406b150 msgr2=0x7f356414a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:37.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.024+0000 7f3562d9d700 1 --2- 172.21.15.72:0/303064800 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f356406b150 0x7f356414a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.024+0000 7f3562d9d700 1 -- 172.21.15.72:0/303064800 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35540094a0 con 0x7f35641549f0 2023-07-27T20:31:37.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.024+0000 7f356259c700 1 --2- 172.21.15.72:0/303064800 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f356406b150 0x7f356414a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:31:37.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.025+0000 7f3562d9d700 1 --2- 172.21.15.72:0/303064800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35641549f0 0x7f3564149190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f355c00cc80 tx=0x7f355c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:37.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.025+0000 7f3552ffd700 1 -- 172.21.15.72:0/303064800 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c003c00 con 0x7f35641549f0 2023-07-27T20:31:37.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.025+0000 7f3552ffd700 1 -- 172.21.15.72:0/303064800 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355c003d60 con 0x7f35641549f0 2023-07-27T20:31:37.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.025+0000 7f3552ffd700 1 -- 172.21.15.72:0/303064800 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c00ab50 con 0x7f35641549f0 2023-07-27T20:31:37.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.025+0000 7f35689ff700 1 -- 172.21.15.72:0/303064800 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f356414e780 con 0x7f35641549f0 2023-07-27T20:31:37.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.025+0000 7f35689ff700 1 -- 172.21.15.72:0/303064800 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f356414d380 con 0x7f35641549f0 2023-07-27T20:31:37.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.027+0000 7f3552ffd700 1 -- 172.21.15.72:0/303064800 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f355c00acb0 con 0x7f35641549f0 2023-07-27T20:31:37.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.028+0000 7f3552ffd700 1 --2- 172.21.15.72:0/303064800 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f354406ad10 0x7f354406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:37.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.029+0000 7f3552ffd700 1 -- 172.21.15.72:0/303064800 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f355c089820 con 0x7f35641549f0 2023-07-27T20:31:37.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.029+0000 7f356259c700 1 --2- 172.21.15.72:0/303064800 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f354406ad10 0x7f354406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:37.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.030+0000 7f356259c700 1 --2- 172.21.15.72:0/303064800 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f354406ad10 0x7f354406d1d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f35640af380 tx=0x7f355401c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:37.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.030+0000 7f357c295b80 1 Processor -- start 2023-07-27T20:31:37.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.031+0000 7f357c295b80 1 -- start start 2023-07-27T20:31:37.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.031+0000 7f357c295b80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55d449839d20 0x55d44981d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:37.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.031+0000 7f357c295b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d44983a100 0x55d449816db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:37.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.031+0000 7f357c295b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d44983a580 0x55d4498172f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:37.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.031+0000 7f357c295b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d449790ab0 con 0x55d44983a580 2023-07-27T20:31:37.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.031+0000 7f357c295b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d449775440 con 0x55d44983a100 2023-07-27T20:31:37.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.031+0000 7f357c295b80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d449772ba0 con 0x55d449839d20 2023-07-27T20:31:37.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.032+0000 7f3562d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d44983a580 0x55d4498172f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:37.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.032+0000 7f356259c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55d449839d20 0x55d44981d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:37.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.032+0000 7f3561d9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d44983a100 0x55d449816db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:37.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.032+0000 7f3562d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d44983a580 0x55d4498172f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55420/0 (socket says 172.21.15.72:55420) 2023-07-27T20:31:37.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.032+0000 7f3562d9d700 1 -- 172.21.15.72:0/1060140361 learned_addr learned my addr 172.21.15.72:0/1060140361 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:37.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.032+0000 7f3562d9d700 1 -- 172.21.15.72:0/1060140361 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55d449839d20 msgr2=0x55d44981d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:37.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.032+0000 7f3562d9d700 1 --2- 172.21.15.72:0/1060140361 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55d449839d20 0x55d44981d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.032+0000 7f3562d9d700 1 -- 172.21.15.72:0/1060140361 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d44983a100 msgr2=0x55d449816db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:37.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.032+0000 7f3562d9d700 1 --2- 172.21.15.72:0/1060140361 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d44983a100 0x55d449816db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.032+0000 7f3562d9d700 1 -- 172.21.15.72:0/1060140361 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d449561790 con 0x55d44983a580 2023-07-27T20:31:37.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.032+0000 7f3562d9d700 1 --2- 172.21.15.72:0/1060140361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d44983a580 0x55d4498172f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f355c057c70 tx=0x7f355c057ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c6020b0849e9d8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:37.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.032+0000 7f3543fff700 1 -- 172.21.15.72:0/1060140361 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c0605e0 con 0x55d44983a580 2023-07-27T20:31:37.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.032+0000 7f3543fff700 1 -- 172.21.15.72:0/1060140361 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355c06be90 con 0x55d44983a580 2023-07-27T20:31:37.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.032+0000 7f3543fff700 1 -- 172.21.15.72:0/1060140361 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c05e0b0 con 0x55d44983a580 2023-07-27T20:31:37.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.033+0000 7f357c295b80 1 -- 172.21.15.72:0/1060140361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d44983a580 msgr2=0x55d4498172f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:37.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.033+0000 7f357c295b80 1 --2- 172.21.15.72:0/1060140361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d44983a580 0x55d4498172f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f355c057c70 tx=0x7f355c057ca0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.033+0000 7f357c295b80 1 -- 172.21.15.72:0/1060140361 shutdown_connections 2023-07-27T20:31:37.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.033+0000 7f357c295b80 1 --2- 172.21.15.72:0/1060140361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d44983a580 0x55d4498172f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.033+0000 7f357c295b80 1 --2- 172.21.15.72:0/1060140361 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55d449839d20 0x55d44981d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.033+0000 7f357c295b80 1 --2- 172.21.15.72:0/1060140361 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d44983a100 0x55d449816db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.033+0000 7f357c295b80 1 -- 172.21.15.72:0/1060140361 >> 172.21.15.72:0/1060140361 conn(0x55d44977c3a0 msgr2=0x55d449819ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:37.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.033+0000 7f357c295b80 1 -- 172.21.15.72:0/1060140361 shutdown_connections 2023-07-27T20:31:37.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.033+0000 7f357c295b80 1 -- 172.21.15.72:0/1060140361 wait complete. 2023-07-27T20:31:37.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.034+0000 7f357c295b80 1 -- start start 2023-07-27T20:31:37.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.034+0000 7f357c295b80 1 Processor -- start 2023-07-27T20:31:37.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.035+0000 7f357c295b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d449839d20 0x55d449857960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:37.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.035+0000 7f357c295b80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55d44983a100 0x55d4498327e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:37.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.035+0000 7f357c295b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d44983a580 0x55d4498555a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:37.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.035+0000 7f357c295b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d44976e490 con 0x55d44983a580 2023-07-27T20:31:37.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.035+0000 7f357c295b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d44972b5b0 con 0x55d449839d20 2023-07-27T20:31:37.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.035+0000 7f357c295b80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d449711910 con 0x55d44983a100 2023-07-27T20:31:37.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.035+0000 7f357c295b80 10 client.0 _ll_register_callbacks cb 0x55d44956aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-27T20:31:37.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.035+0000 7f3562d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d44983a580 0x55d4498555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:37.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.035+0000 7f3562d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d44983a580 0x55d4498555a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55422/0 (socket says 172.21.15.72:55422) 2023-07-27T20:31:37.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.035+0000 7f3562d9d700 1 -- 172.21.15.72:0/1527470775 learned_addr learned my addr 172.21.15.72:0/1527470775 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:37.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.035+0000 7f3561d9b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55d44983a100 0x55d4498327e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:37.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.035+0000 7f356259c700 1 --2- 172.21.15.72:0/1527470775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d449839d20 0x55d449857960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:37.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.036+0000 7f3562d9d700 1 -- 172.21.15.72:0/1527470775 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55d44983a100 msgr2=0x55d4498327e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:37.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.036+0000 7f3562d9d700 1 --2- 172.21.15.72:0/1527470775 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55d44983a100 0x55d4498327e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.036+0000 7f3562d9d700 1 -- 172.21.15.72:0/1527470775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d449839d20 msgr2=0x55d449857960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:37.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.036+0000 7f3562d9d700 1 --2- 172.21.15.72:0/1527470775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d449839d20 0x55d449857960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.036+0000 7f3562d9d700 1 -- 172.21.15.72:0/1527470775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f356414d380 con 0x55d44983a580 2023-07-27T20:31:37.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.036+0000 7f3562d9d700 1 --2- 172.21.15.72:0/1527470775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d44983a580 0x55d4498555a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f355c0600b0 tx=0x7f355c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d360f2853623d467 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:37.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.036+0000 7f35417fa700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-07-27T20:31:37.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.036+0000 7f35417fa700 1 -- 172.21.15.72:0/1527470775 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c057980 con 0x55d44983a580 2023-07-27T20:31:37.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.036+0000 7f35417fa700 1 -- 172.21.15.72:0/1527470775 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f355c0605e0 con 0x55d44983a580 2023-07-27T20:31:37.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.036+0000 7f357c295b80 1 -- 172.21.15.72:0/1527470775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d44980ed80 con 0x55d44983a580 2023-07-27T20:31:37.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.036+0000 7f35417fa700 1 -- 172.21.15.72:0/1527470775 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f355c05e0b0 con 0x55d44983a580 2023-07-27T20:31:37.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.036+0000 7f357c295b80 10 client.4446 fetch_fsmap learned FSMap version 7 2023-07-27T20:31:37.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.036+0000 7f357c295b80 1 -- 172.21.15.72:0/1527470775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55d44964e0a0 con 0x55d44983a580 2023-07-27T20:31:37.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.036+0000 7f35417fa700 1 -- 172.21.15.72:0/1527470775 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d44980ed80 con 0x55d44983a580 2023-07-27T20:31:37.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.036+0000 7f35417fa700 1 -- 172.21.15.72:0/1527470775 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f355c060150 con 0x55d44983a580 2023-07-27T20:31:37.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.036+0000 7f357c295b80 10 client.4446 fetch_fsmap finished waiting for FSMap version 7 2023-07-27T20:31:37.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.037+0000 7f357c295b80 10 client.4446 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-27T20:31:37.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.037+0000 7f357c295b80 20 client.4446 populate_metadata read hostname 'smithi072' 2023-07-27T20:31:37.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.037+0000 7f357c295b80 1 --2- 172.21.15.72:0/1527470775 >> [v2:172.21.15.173:6834/516740687,v1:172.21.15.173:6835/516740687] conn(0x55d44985bc10 0x55d449855ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:37.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.037+0000 7f357c295b80 4 client.4446 mds_command: new command op to 4267 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-27T20:31:37.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.037+0000 7f357c295b80 1 -- 172.21.15.72:0/1527470775 --> [v2:172.21.15.173:6834/516740687,v1:172.21.15.173:6835/516740687] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d4497ebb50 con 0x55d44985bc10 2023-07-27T20:31:37.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.037+0000 7f356259c700 1 --2- 172.21.15.72:0/1527470775 >> [v2:172.21.15.173:6834/516740687,v1:172.21.15.173:6835/516740687] conn(0x55d44985bc10 0x55d449855ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:37.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.038+0000 7f35417fa700 10 client.4446 ms_handle_connect on v2:172.21.15.173:6834/516740687 2023-07-27T20:31:37.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.038+0000 7f356259c700 1 --2- 172.21.15.72:0/1527470775 >> [v2:172.21.15.173:6834/516740687,v1:172.21.15.173:6835/516740687] conn(0x55d44985bc10 0x55d449855ef0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96ed172f73686896 server_cookie=53340c05af33a608 in_seq=0 out_seq=0 2023-07-27T20:31:37.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.038+0000 7f35417fa700 1 -- 172.21.15.72:0/1527470775 <== mds.0 v2:172.21.15.173:6834/516740687 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55d4497ebb50 con 0x55d44985bc10 2023-07-27T20:31:37.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.038+0000 7f35417fa700 10 client.4446 handle_command_reply: tid=0 2023-07-27T20:31:37.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.038+0000 7f357c295b80 1 client.4446 shutdown 2023-07-27T20:31:37.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.039+0000 7f357c295b80 1 -- 172.21.15.72:0/1527470775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d44983a580 msgr2=0x55d4498555a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:37.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.039+0000 7f357c295b80 1 --2- 172.21.15.72:0/1527470775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d44983a580 0x55d4498555a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f355c0600b0 tx=0x7f355c0014a0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.039+0000 7f357c295b80 1 -- 172.21.15.72:0/1527470775 shutdown_connections 2023-07-27T20:31:37.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.039+0000 7f357c295b80 1 --2- 172.21.15.72:0/1527470775 >> [v2:172.21.15.173:6834/516740687,v1:172.21.15.173:6835/516740687] conn(0x55d44985bc10 0x55d449855ef0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.039+0000 7f357c295b80 1 --2- 172.21.15.72:0/1527470775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d44983a580 0x55d4498555a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.039+0000 7f357c295b80 1 --2- 172.21.15.72:0/1527470775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d449839d20 0x55d449857960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.039+0000 7f357c295b80 1 --2- 172.21.15.72:0/1527470775 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55d44983a100 0x55d4498327e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.039+0000 7f357c295b80 1 -- 172.21.15.72:0/1527470775 >> 172.21.15.72:0/1527470775 conn(0x55d44977c3a0 msgr2=0x55d44981a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:37.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.039+0000 7f35417fa700 0 client.4446 ms_handle_reset on v2:172.21.15.173:6834/516740687 2023-07-27T20:31:37.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.039+0000 7f357c295b80 1 -- 172.21.15.72:0/1527470775 shutdown_connections 2023-07-27T20:31:37.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.039+0000 7f357c295b80 1 -- 172.21.15.72:0/1527470775 wait complete. 2023-07-27T20:31:37.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.039+0000 7f357c295b80 20 client.4446 trim_cache size 0 max 16384 2023-07-27T20:31:37.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.057+0000 7f357c295b80 1 Processor -- start 2023-07-27T20:31:37.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.057+0000 7f357c295b80 1 -- start start 2023-07-27T20:31:37.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.057+0000 7f357c295b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d449839d20 0x55d449831b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:37.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.057+0000 7f357c295b80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55d44983a100 0x55d4498530b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:37.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.057+0000 7f357c295b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d44983a580 0x55d4498649e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:37.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.057+0000 7f357c295b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d449562390 con 0x55d449839d20 2023-07-27T20:31:37.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.058+0000 7f357c295b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4498196f0 con 0x55d44983a580 2023-07-27T20:31:37.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.058+0000 7f357c295b80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d44983ac40 con 0x55d44983a100 2023-07-27T20:31:37.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.058+0000 7f356259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d449839d20 0x55d449831b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:37.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.058+0000 7f356259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d449839d20 0x55d449831b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55436/0 (socket says 172.21.15.72:55436) 2023-07-27T20:31:37.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.058+0000 7f356259c700 1 -- 172.21.15.72:0/1189147973 learned_addr learned my addr 172.21.15.72:0/1189147973 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:37.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.058+0000 7f356259c700 1 -- 172.21.15.72:0/1189147973 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55d44983a100 msgr2=0x55d4498530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:37.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.058+0000 7f356259c700 1 --2- 172.21.15.72:0/1189147973 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55d44983a100 0x55d4498530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.058+0000 7f356259c700 1 -- 172.21.15.72:0/1189147973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d44983a580 msgr2=0x55d4498649e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:37.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.058+0000 7f3562d9d700 1 --2- 172.21.15.72:0/1189147973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d44983a580 0x55d4498649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:37.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.058+0000 7f356259c700 1 --2- 172.21.15.72:0/1189147973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d44983a580 0x55d4498649e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.058+0000 7f356259c700 1 -- 172.21.15.72:0/1189147973 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d449733b10 con 0x55d449839d20 2023-07-27T20:31:37.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.058+0000 7f3562d9d700 1 --2- 172.21.15.72:0/1189147973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d44983a580 0x55d4498649e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:31:37.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.058+0000 7f356259c700 1 --2- 172.21.15.72:0/1189147973 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d449839d20 0x55d449831b90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f356408b450 tx=0x7f3554010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e222b23b1f444f8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:37.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.059+0000 7f3550ff9700 1 -- 172.21.15.72:0/1189147973 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355401ad90 con 0x55d449839d20 2023-07-27T20:31:37.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.059+0000 7f3550ff9700 1 -- 172.21.15.72:0/1189147973 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3554037040 con 0x55d449839d20 2023-07-27T20:31:37.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.059+0000 7f3550ff9700 1 -- 172.21.15.72:0/1189147973 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35540373b0 con 0x55d449839d20 2023-07-27T20:31:37.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.059+0000 7f357c295b80 1 -- 172.21.15.72:0/1189147973 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d449839d20 msgr2=0x55d449831b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:37.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.059+0000 7f357c295b80 1 --2- 172.21.15.72:0/1189147973 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d449839d20 0x55d449831b90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f356408b450 tx=0x7f3554010000 comp rx=0 tx=0).stop 2023-07-27T20:31:37.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.059+0000 7f357c295b80 1 -- 172.21.15.72:0/1189147973 shutdown_connections 2023-07-27T20:31:37.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.059+0000 7f357c295b80 1 --2- 172.21.15.72:0/1189147973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d44983a580 0x55d4498649e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.059+0000 7f357c295b80 1 --2- 172.21.15.72:0/1189147973 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d449839d20 0x55d449831b90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.059+0000 7f357c295b80 1 --2- 172.21.15.72:0/1189147973 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55d44983a100 0x55d4498530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.059+0000 7f357c295b80 1 -- 172.21.15.72:0/1189147973 >> 172.21.15.72:0/1189147973 conn(0x55d44977c3a0 msgr2=0x55d4498390f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:37.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.059+0000 7f357c295b80 1 -- 172.21.15.72:0/1189147973 shutdown_connections 2023-07-27T20:31:37.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.059+0000 7f357c295b80 1 -- 172.21.15.72:0/1189147973 wait complete. 2023-07-27T20:31:37.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.060+0000 7f357c295b80 1 -- start start 2023-07-27T20:31:37.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.060+0000 7f357c295b80 1 Processor -- start 2023-07-27T20:31:37.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.061+0000 7f357c295b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d449839d20 0x55d4498bb450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:37.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.061+0000 7f357c295b80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55d44983a100 0x55d4498407c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:37.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.061+0000 7f357c295b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d44983a580 0x55d4498153f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:37.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.061+0000 7f357c295b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4498679b0 con 0x55d449839d20 2023-07-27T20:31:37.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.061+0000 7f357c295b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4498530b0 con 0x55d44983a580 2023-07-27T20:31:37.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.061+0000 7f357c295b80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d4498532f0 con 0x55d44983a100 2023-07-27T20:31:37.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.061+0000 7f357c295b80 10 client.0 _ll_register_callbacks cb 0x55d44956aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-27T20:31:37.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.061+0000 7f356259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d449839d20 0x55d4498bb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:37.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.061+0000 7f356259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d449839d20 0x55d4498bb450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55438/0 (socket says 172.21.15.72:55438) 2023-07-27T20:31:37.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.061+0000 7f356259c700 1 -- 172.21.15.72:0/2409086727 learned_addr learned my addr 172.21.15.72:0/2409086727 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:37.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.061+0000 7f3562d9d700 1 --2- 172.21.15.72:0/2409086727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d44983a580 0x55d4498153f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:37.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.061+0000 7f3561d9b700 1 --2- 172.21.15.72:0/2409086727 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55d44983a100 0x55d4498407c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:37.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.062+0000 7f356259c700 1 -- 172.21.15.72:0/2409086727 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55d44983a100 msgr2=0x55d4498407c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:37.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.062+0000 7f356259c700 1 --2- 172.21.15.72:0/2409086727 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55d44983a100 0x55d4498407c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.062+0000 7f356259c700 1 -- 172.21.15.72:0/2409086727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d44983a580 msgr2=0x55d4498153f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:37.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.062+0000 7f356259c700 1 --2- 172.21.15.72:0/2409086727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d44983a580 0x55d4498153f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.062+0000 7f356259c700 1 -- 172.21.15.72:0/2409086727 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f356406bcd0 con 0x55d449839d20 2023-07-27T20:31:37.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.062+0000 7f3561d9b700 1 --2- 172.21.15.72:0/2409086727 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55d44983a100 0x55d4498407c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:31:37.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.062+0000 7f3562d9d700 1 --2- 172.21.15.72:0/2409086727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d44983a580 0x55d4498153f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:31:37.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.062+0000 7f356259c700 1 --2- 172.21.15.72:0/2409086727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d449839d20 0x55d4498bb450 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3554009840 tx=0x7f35540047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4886772cc5db895a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:37.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.062+0000 7f35417fa700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-07-27T20:31:37.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.062+0000 7f35417fa700 1 -- 172.21.15.72:0/2409086727 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35540376e0 con 0x55d449839d20 2023-07-27T20:31:37.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.062+0000 7f35417fa700 1 -- 172.21.15.72:0/2409086727 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f355401f070 con 0x55d449839d20 2023-07-27T20:31:37.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.062+0000 7f357c295b80 1 -- 172.21.15.72:0/2409086727 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f355c06be90 con 0x55d449839d20 2023-07-27T20:31:37.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.062+0000 7f35417fa700 1 -- 172.21.15.72:0/2409086727 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3554037840 con 0x55d449839d20 2023-07-27T20:31:37.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.062+0000 7f357c295b80 10 client.4452 fetch_fsmap learned FSMap version 7 2023-07-27T20:31:37.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.062+0000 7f357c295b80 1 -- 172.21.15.72:0/2409086727 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55d4495c21d0 con 0x55d449839d20 2023-07-27T20:31:37.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.062+0000 7f35417fa700 1 -- 172.21.15.72:0/2409086727 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355c06be90 con 0x55d449839d20 2023-07-27T20:31:37.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.063+0000 7f35417fa700 1 -- 172.21.15.72:0/2409086727 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f35540379a0 con 0x55d449839d20 2023-07-27T20:31:37.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.063+0000 7f357c295b80 10 client.4452 fetch_fsmap finished waiting for FSMap version 7 2023-07-27T20:31:37.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.063+0000 7f357c295b80 10 client.4452 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-27T20:31:37.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.063+0000 7f357c295b80 20 client.4452 populate_metadata read hostname 'smithi072' 2023-07-27T20:31:37.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.063+0000 7f357c295b80 1 --2- 172.21.15.72:0/2409086727 >> [v2:172.21.15.173:6834/516740687,v1:172.21.15.173:6835/516740687] conn(0x55d449815930 0x55d4498c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:37.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.063+0000 7f357c295b80 4 client.4452 mds_command: new command op to 4267 tid=0[{"prefix": "status"}] 2023-07-27T20:31:37.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.063+0000 7f357c295b80 1 -- 172.21.15.72:0/2409086727 --> [v2:172.21.15.173:6834/516740687,v1:172.21.15.173:6835/516740687] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d4497675d0 con 0x55d449815930 2023-07-27T20:31:37.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.063+0000 7f3561d9b700 1 --2- 172.21.15.72:0/2409086727 >> [v2:172.21.15.173:6834/516740687,v1:172.21.15.173:6835/516740687] conn(0x55d449815930 0x55d4498c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:37.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.063+0000 7f3561d9b700 1 --2- 172.21.15.72:0/2409086727 >> [v2:172.21.15.173:6834/516740687,v1:172.21.15.173:6835/516740687] conn(0x55d449815930 0x55d4498c12b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a393f8e5812617d2 server_cookie=e76e2a1ec56987d7 in_seq=0 out_seq=0 2023-07-27T20:31:37.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.063+0000 7f35417fa700 10 client.4452 ms_handle_connect on v2:172.21.15.173:6834/516740687 2023-07-27T20:31:37.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.064+0000 7f35417fa700 1 -- 172.21.15.72:0/2409086727 <== mds.0 v2:172.21.15.173:6834/516740687 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55d4497675d0 con 0x55d449815930 2023-07-27T20:31:37.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.064+0000 7f35417fa700 10 client.4452 handle_command_reply: tid=0 2023-07-27T20:31:37.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.064+0000 7f357c295b80 1 client.4452 shutdown 2023-07-27T20:31:37.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.064+0000 7f357c295b80 1 -- 172.21.15.72:0/2409086727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d449839d20 msgr2=0x55d4498bb450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:37.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.064+0000 7f357c295b80 1 --2- 172.21.15.72:0/2409086727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d449839d20 0x55d4498bb450 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3554009840 tx=0x7f35540047c0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.064+0000 7f357c295b80 1 -- 172.21.15.72:0/2409086727 shutdown_connections 2023-07-27T20:31:37.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.064+0000 7f357c295b80 1 --2- 172.21.15.72:0/2409086727 >> [v2:172.21.15.173:6834/516740687,v1:172.21.15.173:6835/516740687] conn(0x55d449815930 0x55d4498c12b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.064+0000 7f357c295b80 1 --2- 172.21.15.72:0/2409086727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d44983a580 0x55d4498153f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.064+0000 7f357c295b80 1 --2- 172.21.15.72:0/2409086727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d449839d20 0x55d4498bb450 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.064+0000 7f35417fa700 0 client.4452 ms_handle_reset on v2:172.21.15.173:6834/516740687 2023-07-27T20:31:37.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.064+0000 7f357c295b80 1 --2- 172.21.15.72:0/2409086727 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55d44983a100 0x55d4498407c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.064+0000 7f357c295b80 1 -- 172.21.15.72:0/2409086727 >> 172.21.15.72:0/2409086727 conn(0x55d44977c3a0 msgr2=0x55d449858100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:37.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.064+0000 7f357c295b80 1 -- 172.21.15.72:0/2409086727 shutdown_connections 2023-07-27T20:31:37.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.064+0000 7f357c295b80 1 -- 172.21.15.72:0/2409086727 wait complete. 2023-07-27T20:31:37.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.064+0000 7f357c295b80 20 client.4452 trim_cache size 0 max 16384 2023-07-27T20:31:37.060 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-07-27T20:31:37.060 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "173d349e-573f-4bc7-9f3a-2e1b4345c501", 2023-07-27T20:31:37.061 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 0, 2023-07-27T20:31:37.061 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4267, 2023-07-27T20:31:37.061 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2023-07-27T20:31:37.061 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2023-07-27T20:31:37.061 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2023-07-27T20:31:37.061 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 7.9568556600000004, 2023-07-27T20:31:37.061 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 7, 2023-07-27T20:31:37.061 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 27, 2023-07-27T20:31:37.062 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 26, 2023-07-27T20:31:37.062 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 14.030021321 2023-07-27T20:31:37.062 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-07-27T20:31:37.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.065+0000 7f35689ff700 1 -- 172.21.15.72:0/303064800 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f354406ad10 msgr2=0x7f354406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:37.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.065+0000 7f35689ff700 1 --2- 172.21.15.72:0/303064800 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f354406ad10 0x7f354406d1d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f35640af380 tx=0x7f355401c040 comp rx=0 tx=0).stop 2023-07-27T20:31:37.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.065+0000 7f35689ff700 1 -- 172.21.15.72:0/303064800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35641549f0 msgr2=0x7f3564149190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:37.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.065+0000 7f35689ff700 1 --2- 172.21.15.72:0/303064800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35641549f0 0x7f3564149190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f355c00cc80 tx=0x7f355c00cf90 comp rx=0 tx=0).stop 2023-07-27T20:31:37.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.065+0000 7f35689ff700 1 -- 172.21.15.72:0/303064800 shutdown_connections 2023-07-27T20:31:37.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.065+0000 7f35689ff700 1 --2- 172.21.15.72:0/303064800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35641549f0 0x7f3564149190 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.065+0000 7f35689ff700 1 --2- 172.21.15.72:0/303064800 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f356406b150 0x7f356414a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.065+0000 7f35689ff700 1 --2- 172.21.15.72:0/303064800 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f354406ad10 0x7f354406d1d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.065+0000 7f35689ff700 1 --2- 172.21.15.72:0/303064800 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f35640c4400 0x7f35640aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.065+0000 7f35689ff700 1 -- 172.21.15.72:0/303064800 >> 172.21.15.72:0/303064800 conn(0x7f35640ab300 msgr2=0x7f35640c7390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:37.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.065+0000 7f35689ff700 1 -- 172.21.15.72:0/303064800 shutdown_connections 2023-07-27T20:31:37.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.065+0000 7f35689ff700 1 -- 172.21.15.72:0/303064800 wait complete. 2023-07-27T20:31:37.069 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-27T20:31:37.070 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-07-27T20:31:37.070 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-27T20:31:37.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.280+0000 7f86069ff700 1 Processor -- start 2023-07-27T20:31:37.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.280+0000 7f86069ff700 1 -- start start 2023-07-27T20:31:37.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.281+0000 7f86069ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8600139960 0x7f86000c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:37.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.281+0000 7f86069ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8600139f80 0x7f86000c1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:37.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.281+0000 7f86069ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86000c1810 con 0x7f86000c2340 2023-07-27T20:31:37.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.281+0000 7f86069ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86000c0ee0 con 0x7f8600139f80 2023-07-27T20:31:37.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.281+0000 7f86069ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8600139d40 con 0x7f8600139960 2023-07-27T20:31:37.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.281+0000 7f8604f9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f86000c2340 0x7f86001542e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36702/0 (socket says 172.21.15.72:36702) 2023-07-27T20:31:37.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.281+0000 7f8604f9c700 1 -- 172.21.15.72:0/3950331330 learned_addr learned my addr 172.21.15.72:0/3950331330 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:37.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.282+0000 7f85fffff700 1 --2- 172.21.15.72:0/3950331330 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8600139960 0x7f86000c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:37.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.282+0000 7f85ff7fe700 1 --2- 172.21.15.72:0/3950331330 >> v2:172.21.15.173:3300/0 conn(0x7f8600139f80 0x7f86000c1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:37.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.282+0000 7f85feffd700 1 -- 172.21.15.72:0/3950331330 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1458350339 0 0) 0x7f86000c1810 con 0x7f86000c2340 2023-07-27T20:31:37.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.282+0000 7f85feffd700 1 -- 172.21.15.72:0/3950331330 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85e80035b0 con 0x7f86000c2340 2023-07-27T20:31:37.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.282+0000 7f85feffd700 1 -- 172.21.15.72:0/3950331330 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 83449556 0 0) 0x7f85e80035b0 con 0x7f86000c2340 2023-07-27T20:31:37.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.282+0000 7f85feffd700 1 -- 172.21.15.72:0/3950331330 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8600139960 msgr2=0x7f86000c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:37.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.282+0000 7f85feffd700 1 --2- 172.21.15.72:0/3950331330 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8600139960 0x7f86000c12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.282+0000 7f85feffd700 1 -- 172.21.15.72:0/3950331330 >> v2:172.21.15.173:3300/0 conn(0x7f8600139f80 msgr2=0x7f86000c1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:37.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.282+0000 7f85feffd700 1 --2- 172.21.15.72:0/3950331330 >> v2:172.21.15.173:3300/0 conn(0x7f8600139f80 0x7f86000c1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.282+0000 7f85feffd700 1 -- 172.21.15.72:0/3950331330 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8600151060 con 0x7f86000c2340 2023-07-27T20:31:37.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.282+0000 7f85feffd700 1 -- 172.21.15.72:0/3950331330 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f85f80019f0 con 0x7f86000c2340 2023-07-27T20:31:37.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.282+0000 7f85ff7fe700 1 --2- 172.21.15.72:0/3950331330 >> v2:172.21.15.173:3300/0 conn(0x7f8600139f80 0x7f86000c1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:31:37.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.282+0000 7f85feffd700 1 -- 172.21.15.72:0/3950331330 >> v1:172.21.15.72:6789/0 conn(0x7f86000c2340 legacy=0x7f86001542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:37.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.282+0000 7f85feffd700 1 --2- 172.21.15.72:0/3950331330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85e8003a00 0x7f85e8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:37.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.282+0000 7f85feffd700 1 --2- 172.21.15.72:0/3950331330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85e8004850 0x7f85e8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:37.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.282+0000 7f85feffd700 1 --2- 172.21.15.72:0/3950331330 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8600139960 0x7f85e8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:37.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.282+0000 7f85feffd700 1 -- 172.21.15.72:0/3950331330 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86000c0ee0 con 0x7f85e8003a00 2023-07-27T20:31:37.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.282+0000 7f85feffd700 1 -- 172.21.15.72:0/3950331330 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8600139d40 con 0x7f85e8004850 2023-07-27T20:31:37.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.282+0000 7f85feffd700 1 -- 172.21.15.72:0/3950331330 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e800ba10 con 0x7f8600139960 2023-07-27T20:31:37.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.283+0000 7f85fffff700 1 --2- 172.21.15.72:0/3950331330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85e8003a00 0x7f85e8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:37.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.283+0000 7f85ff7fe700 1 --2- 172.21.15.72:0/3950331330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85e8004850 0x7f85e8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:37.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.283+0000 7f8604f9c700 1 --2- 172.21.15.72:0/3950331330 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8600139960 0x7f85e8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:37.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.283+0000 7f85fffff700 1 -- 172.21.15.72:0/3950331330 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8600139960 msgr2=0x7f85e8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:37.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.283+0000 7f85fffff700 1 --2- 172.21.15.72:0/3950331330 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8600139960 0x7f85e8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.283+0000 7f85fffff700 1 -- 172.21.15.72:0/3950331330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85e8004850 msgr2=0x7f85e8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:37.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.283+0000 7f85fffff700 1 --2- 172.21.15.72:0/3950331330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85e8004850 0x7f85e8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.283+0000 7f85fffff700 1 -- 172.21.15.72:0/3950331330 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e80035b0 con 0x7f85e8003a00 2023-07-27T20:31:37.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.283+0000 7f85fffff700 1 --2- 172.21.15.72:0/3950331330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85e8003a00 0x7f85e8003e20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f85f0009b90 tx=0x7f85e8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bd780deb33e7035 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:37.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.283+0000 7f85feffd700 1 -- 172.21.15.72:0/3950331330 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f000e6c0 con 0x7f85e8003a00 2023-07-27T20:31:37.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.283+0000 7f85feffd700 1 -- 172.21.15.72:0/3950331330 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f000e820 con 0x7f85e8003a00 2023-07-27T20:31:37.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.283+0000 7f85feffd700 1 -- 172.21.15.72:0/3950331330 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f000eb90 con 0x7f85e8003a00 2023-07-27T20:31:37.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.284+0000 7f86069ff700 1 -- 172.21.15.72:0/3950331330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85e8003a00 msgr2=0x7f85e8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:37.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.284+0000 7f86069ff700 1 --2- 172.21.15.72:0/3950331330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85e8003a00 0x7f85e8003e20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f85f0009b90 tx=0x7f85e8005880 comp rx=0 tx=0).stop 2023-07-27T20:31:37.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.284+0000 7f8604f9c700 1 -- 172.21.15.72:0/3950331330 reap_dead start 2023-07-27T20:31:37.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.284+0000 7f86069ff700 1 -- 172.21.15.72:0/3950331330 shutdown_connections 2023-07-27T20:31:37.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.284+0000 7f86069ff700 1 -- 172.21.15.72:0/3950331330 >> 172.21.15.72:0/3950331330 conn(0x7f860006a190 msgr2=0x7f860006a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:37.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.284+0000 7f86069ff700 1 -- 172.21.15.72:0/3950331330 shutdown_connections 2023-07-27T20:31:37.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.284+0000 7f86069ff700 1 -- 172.21.15.72:0/3950331330 wait complete. 2023-07-27T20:31:37.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.286+0000 7f86069ff700 1 Processor -- start 2023-07-27T20:31:37.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.286+0000 7f86069ff700 1 -- start start 2023-07-27T20:31:37.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.287+0000 7f86069ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85e8003a00 0x7f860014e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:37.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.287+0000 7f86069ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86001537d0 0x7f8600136140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:37.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.287+0000 7f86069ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86000c5e80 0x7f86001e79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:37.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.287+0000 7f86069ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86000c3410 con 0x7f86001537d0 2023-07-27T20:31:37.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.287+0000 7f86069ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8600153340 con 0x7f86000c5e80 2023-07-27T20:31:37.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.287+0000 7f86069ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8600070fa0 con 0x7f85e8003a00 2023-07-27T20:31:37.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.287+0000 7f85ff7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86001537d0 0x7f8600136140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:37.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.287+0000 7f85ff7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86001537d0 0x7f8600136140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55456/0 (socket says 172.21.15.72:55456) 2023-07-27T20:31:37.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.287+0000 7f85ff7fe700 1 -- 172.21.15.72:0/675427127 learned_addr learned my addr 172.21.15.72:0/675427127 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:37.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.287+0000 7f8604f9c700 1 --2- 172.21.15.72:0/675427127 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86000c5e80 0x7f86001e79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:37.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.287+0000 7f85fffff700 1 --2- 172.21.15.72:0/675427127 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85e8003a00 0x7f860014e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:37.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.287+0000 7f85ff7fe700 1 -- 172.21.15.72:0/675427127 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85e8003a00 msgr2=0x7f860014e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:37.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.287+0000 7f85ff7fe700 1 --2- 172.21.15.72:0/675427127 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85e8003a00 0x7f860014e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.287+0000 7f85ff7fe700 1 -- 172.21.15.72:0/675427127 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86000c5e80 msgr2=0x7f86001e79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:37.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.287+0000 7f85ff7fe700 1 --2- 172.21.15.72:0/675427127 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86000c5e80 0x7f86001e79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.287+0000 7f85ff7fe700 1 -- 172.21.15.72:0/675427127 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86000c3130 con 0x7f86001537d0 2023-07-27T20:31:37.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.287+0000 7f8604f9c700 1 --2- 172.21.15.72:0/675427127 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86000c5e80 0x7f86001e79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:31:37.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.288+0000 7f85ff7fe700 1 --2- 172.21.15.72:0/675427127 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86001537d0 0x7f8600136140 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f85f4011c20 tx=0x7f85f400f240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:37.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.288+0000 7f85fcff9700 1 -- 172.21.15.72:0/675427127 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f400fb80 con 0x7f86001537d0 2023-07-27T20:31:37.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.288+0000 7f85fcff9700 1 -- 172.21.15.72:0/675427127 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f400fce0 con 0x7f86001537d0 2023-07-27T20:31:37.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.288+0000 7f86069ff700 1 -- 172.21.15.72:0/675427127 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86000c3ac0 con 0x7f86001537d0 2023-07-27T20:31:37.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.288+0000 7f85fcff9700 1 -- 172.21.15.72:0/675427127 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f4004240 con 0x7f86001537d0 2023-07-27T20:31:37.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.288+0000 7f86069ff700 1 -- 172.21.15.72:0/675427127 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86000c3da0 con 0x7f86001537d0 2023-07-27T20:31:37.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.289+0000 7f86069ff700 1 -- 172.21.15.72:0/675427127 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86000c3920 con 0x7f86001537d0 2023-07-27T20:31:37.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.290+0000 7f85fcff9700 1 -- 172.21.15.72:0/675427127 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f85f40043a0 con 0x7f86001537d0 2023-07-27T20:31:37.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.291+0000 7f85fcff9700 1 --2- 172.21.15.72:0/675427127 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f85ec06ad10 0x7f85ec06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:37.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.291+0000 7f85fcff9700 1 -- 172.21.15.72:0/675427127 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f85f4089d60 con 0x7f86001537d0 2023-07-27T20:31:37.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.291+0000 7f85fffff700 1 --2- 172.21.15.72:0/675427127 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f85ec06ad10 0x7f85ec06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:37.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.292+0000 7f85fffff700 1 --2- 172.21.15.72:0/675427127 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f85ec06ad10 0x7f85ec06d1d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f85f00090b0 tx=0x7f85f0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:37.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.295+0000 7f85fcff9700 1 -- 172.21.15.72:0/675427127 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f86000c3920 con 0x7f86001537d0 2023-07-27T20:31:37.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.535+0000 7f86069ff700 1 -- 172.21.15.72:0/675427127 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f86000c3920 con 0x7f86001537d0 2023-07-27T20:31:37.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.536+0000 7f85fcff9700 1 -- 172.21.15.72:0/675427127 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f86000c3920 con 0x7f86001537d0 2023-07-27T20:31:37.524 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-27T20:31:37.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.538+0000 7f86069ff700 1 -- 172.21.15.72:0/675427127 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f85ec06ad10 msgr2=0x7f85ec06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:37.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.538+0000 7f86069ff700 1 --2- 172.21.15.72:0/675427127 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f85ec06ad10 0x7f85ec06d1d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f85f00090b0 tx=0x7f85f0008030 comp rx=0 tx=0).stop 2023-07-27T20:31:37.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.538+0000 7f86069ff700 1 -- 172.21.15.72:0/675427127 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86001537d0 msgr2=0x7f8600136140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:37.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.538+0000 7f86069ff700 1 --2- 172.21.15.72:0/675427127 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86001537d0 0x7f8600136140 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f85f4011c20 tx=0x7f85f400f240 comp rx=0 tx=0).stop 2023-07-27T20:31:37.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.538+0000 7f86069ff700 1 -- 172.21.15.72:0/675427127 shutdown_connections 2023-07-27T20:31:37.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.538+0000 7f86069ff700 1 --2- 172.21.15.72:0/675427127 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86000c5e80 0x7f86001e79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.538+0000 7f86069ff700 1 --2- 172.21.15.72:0/675427127 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f85ec06ad10 0x7f85ec06d1d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.538+0000 7f86069ff700 1 --2- 172.21.15.72:0/675427127 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85e8003a00 0x7f860014e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.538+0000 7f86069ff700 1 --2- 172.21.15.72:0/675427127 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86001537d0 0x7f8600136140 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:37.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.538+0000 7f86069ff700 1 -- 172.21.15.72:0/675427127 >> 172.21.15.72:0/675427127 conn(0x7f860006a190 msgr2=0x7f8600137c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:37.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.538+0000 7f86069ff700 1 -- 172.21.15.72:0/675427127 shutdown_connections 2023-07-27T20:31:37.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:37.538+0000 7f86069ff700 1 -- 172.21.15.72:0/675427127 wait complete. 2023-07-27T20:31:37.543 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-27T20:31:37.543 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T20:31:37.544 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2023-07-27T20:31:37.544 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-07-27T20:31:37.544 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-07-27T20:31:37.544 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-27T20:31:37.545 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-27T20:31:37.545 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-27T20:31:37.545 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-07-27T20:31:37.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:31:37.546 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2023-07-27T20:31:37.593 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T20:31:37.593 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T20:31:37.593 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T20:31:37.594 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:31:37.594 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-07-27T20:31:37.594 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:31:37.594 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T20:31:37.594 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2023-07-27T20:31:37.594 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f0 2023-07-27T20:31:37.594 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T20:31:37.595 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2023-07-27T20:31:37.595 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f1 2023-07-27T20:31:37.595 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T20:31:37.595 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2023-07-27T20:31:37.595 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T20:31:37.595 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2023-07-27T20:31:37.595 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T20:31:37.596 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 39986sec preferred_lft 39986sec 2023-07-27T20:31:37.596 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2023-07-27T20:31:37.596 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:31:37.596 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-27T20:31:37.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:31:37.597 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-07-27T20:31:37.598 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-07-27T20:31:37.598 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add name ceph-brx type bridge 2023-07-27T20:31:37.598 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr flush dev ceph-brx 2023-07-27T20:31:37.598 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set ceph-brx up 2023-07-27T20:31:37.599 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-27T20:31:37.599 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-07-27T20:31:38.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:31:38.210 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T20:31:38.321 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-07-27T20:31:38.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:31:38.325 DEBUG:teuthology.orchestra.run.smithi072:> route 2023-07-27T20:31:38.458 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2023-07-27T20:31:38.458 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T20:31:38.458 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T20:31:38.458 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T20:31:38.458 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T20:31:38.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:31:38.460 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-07-27T20:31:38.460 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-07-27T20:31:38.460 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T20:31:38.461 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T20:31:38.461 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T20:31:38.461 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-07-27T20:31:39.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:31:39.388 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-07-27T20:31:39.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:31:39.438 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list-id 2023-07-27T20:31:39.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:31:39.524 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-07-27T20:31:39.525 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-07-27T20:31:39.525 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-07-27T20:31:39.526 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-07-27T20:31:39.526 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-07-27T20:31:39.668 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-07-27T20:31:39.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:31:39.669 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-07-27T20:31:39.669 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-07-27T20:31:39.670 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-07-27T20:31:39.670 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-27T20:31:39.670 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-07-27T20:31:39.670 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-07-27T20:31:39.671 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-07-27T20:31:39.671 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-07-27T20:31:39.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:31:39.953 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-07-27T20:31:39.953 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-07-27T20:31:39.953 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2023-07-27T20:31:39.953 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set dev brx.0 master ceph-brx 2023-07-27T20:31:39.954 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-07-27T20:31:40.126 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-07-27T20:31:40.126 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-27T20:31:40.127 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-07-27T20:31:40.173 INFO:teuthology.orchestra.run.smithi072.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-07-27T20:31:40.173 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-27T20:31:40.174 DEBUG:teuthology.orchestra.run.smithi072:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-07-27T20:31:40.258 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-07-27T20:31:40.369 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-27T20:31:40.369 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-27T20:31:40.437 INFO:teuthology.orchestra.run.smithi072.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-27T20:31:40.440 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-27T20:31:40.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:31:40.441 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-07-27T20:31:40.487 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-27T20:31:40.487 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-07-27T20:31:40.492 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-07-27T20:31:40.564 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-27T20:31:40.564 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-27T20:31:40.634 INFO:teuthology.orchestra.run.smithi072.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-27T20:31:40.637 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-27T20:31:40.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:31:40.638 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-07-27T20:31:40.663 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi072.stderr:2023-07-27T20:31:40.675+0000 7f020021c5c0 -1 init, newargv = 0x5637e4152330 newargc=15 2023-07-27T20:31:40.663 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi072.stderr:ceph-fuse[148836]: starting ceph client 2023-07-27T20:31:40.673 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi072.stderr:ceph-fuse[148836]: starting fuse 2023-07-27T20:31:40.690 INFO:teuthology.orchestra.run.smithi072.stdout:44 2023-07-27T20:31:40.690 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2023-07-27T20:31:40.691 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-27T20:31:40.691 DEBUG:teuthology.orchestra.run.smithi072:> import glob 2023-07-27T20:31:40.691 DEBUG:teuthology.orchestra.run.smithi072:> import re 2023-07-27T20:31:40.692 DEBUG:teuthology.orchestra.run.smithi072:> import os 2023-07-27T20:31:40.692 DEBUG:teuthology.orchestra.run.smithi072:> import subprocess 2023-07-27T20:31:40.692 DEBUG:teuthology.orchestra.run.smithi072:> 2023-07-27T20:31:40.693 DEBUG:teuthology.orchestra.run.smithi072:> def _find_admin_socket(client_name): 2023-07-27T20:31:40.693 DEBUG:teuthology.orchestra.run.smithi072:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-07-27T20:31:40.693 DEBUG:teuthology.orchestra.run.smithi072:> files = glob.glob(asok_path) 2023-07-27T20:31:40.693 DEBUG:teuthology.orchestra.run.smithi072:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-07-27T20:31:40.694 DEBUG:teuthology.orchestra.run.smithi072:> 2023-07-27T20:31:40.694 DEBUG:teuthology.orchestra.run.smithi072:> # Given a non-glob path, it better be there 2023-07-27T20:31:40.694 DEBUG:teuthology.orchestra.run.smithi072:> if "*" not in asok_path: 2023-07-27T20:31:40.694 DEBUG:teuthology.orchestra.run.smithi072:> assert(len(files) == 1) 2023-07-27T20:31:40.695 DEBUG:teuthology.orchestra.run.smithi072:> return files[0] 2023-07-27T20:31:40.695 DEBUG:teuthology.orchestra.run.smithi072:> 2023-07-27T20:31:40.695 DEBUG:teuthology.orchestra.run.smithi072:> for f in files: 2023-07-27T20:31:40.695 DEBUG:teuthology.orchestra.run.smithi072:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-27T20:31:40.696 DEBUG:teuthology.orchestra.run.smithi072:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-27T20:31:40.696 DEBUG:teuthology.orchestra.run.smithi072:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-27T20:31:40.696 DEBUG:teuthology.orchestra.run.smithi072:> contents = proc_f.read() 2023-07-27T20:31:40.697 DEBUG:teuthology.orchestra.run.smithi072:> if mountpoint in contents: 2023-07-27T20:31:40.697 DEBUG:teuthology.orchestra.run.smithi072:> return f 2023-07-27T20:31:40.697 DEBUG:teuthology.orchestra.run.smithi072:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-27T20:31:40.697 DEBUG:teuthology.orchestra.run.smithi072:> 2023-07-27T20:31:40.698 DEBUG:teuthology.orchestra.run.smithi072:> print(_find_admin_socket("client.admin")) 2023-07-27T20:31:40.698 DEBUG:teuthology.orchestra.run.smithi072:> ' 2023-07-27T20:31:40.873 INFO:teuthology.orchestra.run.smithi072.stdout:/var/run/ceph/ceph-client.admin.148836.asok 2023-07-27T20:31:41.051 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.148836.asok 2023-07-27T20:31:41.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:31:41.052 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.148836.asok status 2023-07-27T20:31:41.279 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-07-27T20:31:41.279 INFO:teuthology.orchestra.run.smithi072.stdout: "metadata": { 2023-07-27T20:31:41.280 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_sha1": "a5d48e8c688c2543997a98b8acbae2ce9635578c", 2023-07-27T20:31:41.280 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_version": "ceph version 18.0.0-5128-ga5d48e8c (a5d48e8c688c2543997a98b8acbae2ce9635578c) reef (dev)", 2023-07-27T20:31:41.280 INFO:teuthology.orchestra.run.smithi072.stdout: "entity_id": "admin", 2023-07-27T20:31:41.280 INFO:teuthology.orchestra.run.smithi072.stdout: "hostname": "smithi072", 2023-07-27T20:31:41.280 INFO:teuthology.orchestra.run.smithi072.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-07-27T20:31:41.280 INFO:teuthology.orchestra.run.smithi072.stdout: "pid": "148836", 2023-07-27T20:31:41.281 INFO:teuthology.orchestra.run.smithi072.stdout: "root": "/" 2023-07-27T20:31:41.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:31:41.281 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_count": 0, 2023-07-27T20:31:41.281 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_pinned_count": 0, 2023-07-27T20:31:41.282 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4464, 2023-07-27T20:31:41.282 INFO:teuthology.orchestra.run.smithi072.stdout: "inst": { 2023-07-27T20:31:41.282 INFO:teuthology.orchestra.run.smithi072.stdout: "name": { 2023-07-27T20:31:41.282 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "client", 2023-07-27T20:31:41.282 INFO:teuthology.orchestra.run.smithi072.stdout: "num": 4464 2023-07-27T20:31:41.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:31:41.282 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2023-07-27T20:31:41.282 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-07-27T20:31:41.283 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "192.168.0.1:0", 2023-07-27T20:31:41.283 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 2593074095 2023-07-27T20:31:41.283 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:31:41.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:31:41.283 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2023-07-27T20:31:41.283 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-07-27T20:31:41.283 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "192.168.0.1:0", 2023-07-27T20:31:41.284 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 2593074095 2023-07-27T20:31:41.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:31:41.284 INFO:teuthology.orchestra.run.smithi072.stdout: "inst_str": "client.4464 192.168.0.1:0/2593074095", 2023-07-27T20:31:41.284 INFO:teuthology.orchestra.run.smithi072.stdout: "addr_str": "192.168.0.1:0/2593074095", 2023-07-27T20:31:41.284 INFO:teuthology.orchestra.run.smithi072.stdout: "inode_count": 1, 2023-07-27T20:31:41.284 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_epoch": 7, 2023-07-27T20:31:41.284 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch": 27, 2023-07-27T20:31:41.284 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch_barrier": 0, 2023-07-27T20:31:41.285 INFO:teuthology.orchestra.run.smithi072.stdout: "blocklisted": false, 2023-07-27T20:31:41.285 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs" 2023-07-27T20:31:41.285 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-07-27T20:31:41.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:31:41.293 DEBUG:teuthology.orchestra.run.smithi072:> stat --file-system '--printf=%T 2023-07-27T20:31:41.294 DEBUG:teuthology.orchestra.run.smithi072:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-07-27T20:31:41.341 INFO:teuthology.orchestra.run.smithi072.stdout:fuseblk 2023-07-27T20:31:41.341 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-07-27T20:31:41.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:31:41.342 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-07-27T20:31:41.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:31:41.414 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-07-27T20:31:41.538 INFO:teuthology.orchestra.run.smithi072.stdout:# file: . 2023-07-27T20:31:41.538 INFO:teuthology.orchestra.run.smithi072.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-07-27T20:31:41.539 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:31:41.540 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-27T20:31:41.541 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-27T20:31:41.586 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:31:41.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.832+0000 7f18ce5ff700 1 Processor -- start 2023-07-27T20:31:41.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.832+0000 7f18ce5ff700 1 -- start start 2023-07-27T20:31:41.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.833+0000 7f18ce5ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18c8139f80 0x7f18c80c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:41.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.833+0000 7f18ce5ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f18c81542e0 0x7f18c8154730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:41.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.833+0000 7f18ce5ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18c80c1810 con 0x7f18c8139960 2023-07-27T20:31:41.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.833+0000 7f18ce5ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18c80c0ee0 con 0x7f18c81542e0 2023-07-27T20:31:41.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.833+0000 7f18ce5ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18c8139d40 con 0x7f18c8139f80 2023-07-27T20:31:41.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.833+0000 7f18c7fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f18c8139960 0x7f18c80c1e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57966/0 (socket says 172.21.15.72:57966) 2023-07-27T20:31:41.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.833+0000 7f18c7fff700 1 -- 172.21.15.72:0/1696140450 learned_addr learned my addr 172.21.15.72:0/1696140450 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:41.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.834+0000 7f18ccb9c700 1 --2- 172.21.15.72:0/1696140450 >> v2:172.21.15.173:3300/0 conn(0x7f18c81542e0 0x7f18c8154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:41.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.834+0000 7f18c77fe700 1 --2- 172.21.15.72:0/1696140450 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18c8139f80 0x7f18c80c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:41.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.834+0000 7f18c6ffd700 1 -- 172.21.15.72:0/1696140450 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2410102062 0 0) 0x7f18c80c1810 con 0x7f18c8139960 2023-07-27T20:31:41.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.834+0000 7f18c6ffd700 1 -- 172.21.15.72:0/1696140450 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18b00035b0 con 0x7f18c8139960 2023-07-27T20:31:41.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.834+0000 7f18c6ffd700 1 -- 172.21.15.72:0/1696140450 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3202233990 0 0) 0x7f18b00035b0 con 0x7f18c8139960 2023-07-27T20:31:41.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.834+0000 7f18c6ffd700 1 -- 172.21.15.72:0/1696140450 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18c8139f80 msgr2=0x7f18c80c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:41.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.834+0000 7f18c6ffd700 1 --2- 172.21.15.72:0/1696140450 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18c8139f80 0x7f18c80c12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:41.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.834+0000 7f18c6ffd700 1 -- 172.21.15.72:0/1696140450 >> v2:172.21.15.173:3300/0 conn(0x7f18c81542e0 msgr2=0x7f18c8154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:41.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.834+0000 7f18c6ffd700 1 --2- 172.21.15.72:0/1696140450 >> v2:172.21.15.173:3300/0 conn(0x7f18c81542e0 0x7f18c8154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:41.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.834+0000 7f18c6ffd700 1 -- 172.21.15.72:0/1696140450 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c8151060 con 0x7f18c8139960 2023-07-27T20:31:41.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.834+0000 7f18c6ffd700 1 -- 172.21.15.72:0/1696140450 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f18b8001670 con 0x7f18c8139960 2023-07-27T20:31:41.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.834+0000 7f18c6ffd700 1 -- 172.21.15.72:0/1696140450 >> v1:172.21.15.72:6789/0 conn(0x7f18c8139960 legacy=0x7f18c80c1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:41.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.834+0000 7f18c6ffd700 1 --2- 172.21.15.72:0/1696140450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18b0003a00 0x7f18b0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:41.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.834+0000 7f18c6ffd700 1 --2- 172.21.15.72:0/1696140450 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18b0004850 0x7f18b0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:41.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.834+0000 7f18c6ffd700 1 --2- 172.21.15.72:0/1696140450 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18c8139f80 0x7f18b0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:41.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.834+0000 7f18c6ffd700 1 -- 172.21.15.72:0/1696140450 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c80c0ee0 con 0x7f18b0003a00 2023-07-27T20:31:41.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.834+0000 7f18c6ffd700 1 -- 172.21.15.72:0/1696140450 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c8139d40 con 0x7f18b0004850 2023-07-27T20:31:41.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.834+0000 7f18c6ffd700 1 -- 172.21.15.72:0/1696140450 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b000ba90 con 0x7f18c8139f80 2023-07-27T20:31:41.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.835+0000 7f18c7fff700 1 --2- 172.21.15.72:0/1696140450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18b0003a00 0x7f18b0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:41.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.835+0000 7f18c77fe700 1 --2- 172.21.15.72:0/1696140450 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18b0004850 0x7f18b0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:41.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.835+0000 7f18ccb9c700 1 --2- 172.21.15.72:0/1696140450 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18c8139f80 0x7f18b0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:41.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.835+0000 7f18c7fff700 1 -- 172.21.15.72:0/1696140450 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18c8139f80 msgr2=0x7f18b0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:41.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.835+0000 7f18c7fff700 1 --2- 172.21.15.72:0/1696140450 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18c8139f80 0x7f18b0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:41.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.835+0000 7f18c7fff700 1 -- 172.21.15.72:0/1696140450 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18b0004850 msgr2=0x7f18b0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:41.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.835+0000 7f18c7fff700 1 --2- 172.21.15.72:0/1696140450 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18b0004850 0x7f18b0004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:41.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.835+0000 7f18c7fff700 1 -- 172.21.15.72:0/1696140450 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b00035b0 con 0x7f18b0003a00 2023-07-27T20:31:41.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.835+0000 7f18ccb9c700 1 --2- 172.21.15.72:0/1696140450 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18c8139f80 0x7f18b0005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:31:41.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.835+0000 7f18c7fff700 1 --2- 172.21.15.72:0/1696140450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18b0003a00 0x7f18b0003e20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f18b8007cb0 tx=0x7f18b0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5973e6e42aa90de8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:41.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.835+0000 7f18c6ffd700 1 -- 172.21.15.72:0/1696140450 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b800cd20 con 0x7f18b0003a00 2023-07-27T20:31:41.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.835+0000 7f18c6ffd700 1 -- 172.21.15.72:0/1696140450 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b800ce80 con 0x7f18b0003a00 2023-07-27T20:31:41.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.835+0000 7f18c6ffd700 1 -- 172.21.15.72:0/1696140450 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b8005ba0 con 0x7f18b0003a00 2023-07-27T20:31:41.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.836+0000 7f18ce5ff700 1 -- 172.21.15.72:0/1696140450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18b0003a00 msgr2=0x7f18b0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:41.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.836+0000 7f18ce5ff700 1 --2- 172.21.15.72:0/1696140450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18b0003a00 0x7f18b0003e20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f18b8007cb0 tx=0x7f18b0005880 comp rx=0 tx=0).stop 2023-07-27T20:31:41.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.836+0000 7f18ccb9c700 1 -- 172.21.15.72:0/1696140450 reap_dead start 2023-07-27T20:31:41.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.836+0000 7f18ce5ff700 1 -- 172.21.15.72:0/1696140450 shutdown_connections 2023-07-27T20:31:41.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.836+0000 7f18ce5ff700 1 -- 172.21.15.72:0/1696140450 >> 172.21.15.72:0/1696140450 conn(0x7f18c806a190 msgr2=0x7f18c806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:41.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.836+0000 7f18ce5ff700 1 -- 172.21.15.72:0/1696140450 shutdown_connections 2023-07-27T20:31:41.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.836+0000 7f18ce5ff700 1 -- 172.21.15.72:0/1696140450 wait complete. 2023-07-27T20:31:41.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.838+0000 7f18ce5ff700 1 Processor -- start 2023-07-27T20:31:41.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.838+0000 7f18ce5ff700 1 -- start start 2023-07-27T20:31:41.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.839+0000 7f18ce5ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18b0003a00 0x7f18c8135430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:41.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.839+0000 7f18ce5ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18c8134580 0x7f18c8134a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:41.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.839+0000 7f18ce5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18c81e8cf0 0x7f18c81e9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:41.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.839+0000 7f18ce5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c80c3710 con 0x7f18c81e8cf0 2023-07-27T20:31:41.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.839+0000 7f18ce5ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c8150210 con 0x7f18c8134580 2023-07-27T20:31:41.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.839+0000 7f18ce5ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18c81340f0 con 0x7f18b0003a00 2023-07-27T20:31:41.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.839+0000 7f18ccb9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18c81e8cf0 0x7f18c81e9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:41.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.839+0000 7f18ccb9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18c81e8cf0 0x7f18c81e9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50338/0 (socket says 172.21.15.72:50338) 2023-07-27T20:31:41.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.839+0000 7f18ccb9c700 1 -- 172.21.15.72:0/3648720755 learned_addr learned my addr 172.21.15.72:0/3648720755 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:41.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.839+0000 7f18c7fff700 1 --2- 172.21.15.72:0/3648720755 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18b0003a00 0x7f18c8135430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:41.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.839+0000 7f18c77fe700 1 --2- 172.21.15.72:0/3648720755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18c8134580 0x7f18c8134a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:41.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.840+0000 7f18ccb9c700 1 -- 172.21.15.72:0/3648720755 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18b0003a00 msgr2=0x7f18c8135430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:41.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.840+0000 7f18ccb9c700 1 --2- 172.21.15.72:0/3648720755 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18b0003a00 0x7f18c8135430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:41.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.840+0000 7f18ccb9c700 1 -- 172.21.15.72:0/3648720755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18c8134580 msgr2=0x7f18c8134a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:41.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.840+0000 7f18ccb9c700 1 --2- 172.21.15.72:0/3648720755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18c8134580 0x7f18c8134a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:41.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.840+0000 7f18ccb9c700 1 -- 172.21.15.72:0/3648720755 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c8150460 con 0x7f18c81e8cf0 2023-07-27T20:31:41.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.840+0000 7f18ccb9c700 1 --2- 172.21.15.72:0/3648720755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18c81e8cf0 0x7f18c81e9170 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f18c8072930 tx=0x7f18c00104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:41.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.840+0000 7f18c4ff9700 1 -- 172.21.15.72:0/3648720755 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c000e050 con 0x7f18c81e8cf0 2023-07-27T20:31:41.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.840+0000 7f18c4ff9700 1 -- 172.21.15.72:0/3648720755 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c000f040 con 0x7f18c81e8cf0 2023-07-27T20:31:41.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.840+0000 7f18c4ff9700 1 -- 172.21.15.72:0/3648720755 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c0010e50 con 0x7f18c81e8cf0 2023-07-27T20:31:41.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.840+0000 7f18ce5ff700 1 -- 172.21.15.72:0/3648720755 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18c81e5920 con 0x7f18c81e8cf0 2023-07-27T20:31:41.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.840+0000 7f18ce5ff700 1 -- 172.21.15.72:0/3648720755 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18c8135970 con 0x7f18c81e8cf0 2023-07-27T20:31:41.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.841+0000 7f18ce5ff700 1 -- 172.21.15.72:0/3648720755 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18c81e5b10 con 0x7f18c81e8cf0 2023-07-27T20:31:41.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.842+0000 7f18c4ff9700 1 -- 172.21.15.72:0/3648720755 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f18c0015440 con 0x7f18c81e8cf0 2023-07-27T20:31:41.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.843+0000 7f18c4ff9700 1 --2- 172.21.15.72:0/3648720755 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f18b406ace0 0x7f18b406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:41.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.843+0000 7f18c4ff9700 1 -- 172.21.15.72:0/3648720755 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f18c0089b70 con 0x7f18c81e8cf0 2023-07-27T20:31:41.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.844+0000 7f18c7fff700 1 --2- 172.21.15.72:0/3648720755 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f18b406ace0 0x7f18b406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:41.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.844+0000 7f18c7fff700 1 --2- 172.21.15.72:0/3648720755 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f18b406ace0 0x7f18b406d1a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f18b8000c00 tx=0x7f18b801e040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:41.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:41.847+0000 7f18c4ff9700 1 -- 172.21.15.72:0/3648720755 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f18c0054920 con 0x7f18c81e8cf0 2023-07-27T20:31:42.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.042+0000 7f18ce5ff700 1 -- 172.21.15.72:0/3648720755 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18c8133bd0 con 0x7f18c81e8cf0 2023-07-27T20:31:42.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.044+0000 7f18c4ff9700 1 -- 172.21.15.72:0/3648720755 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20120 (secure 0 0 0) 0x7f18c0007ea0 con 0x7f18c81e8cf0 2023-07-27T20:31:42.031 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:31:42.032 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:31:33.647304+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:31:27.020951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T20:31:27.566022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-27T20:31:31.182401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:31:42.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.046+0000 7f18ce5ff700 1 -- 172.21.15.72:0/3648720755 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f18b406ace0 msgr2=0x7f18b406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:42.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.046+0000 7f18ce5ff700 1 --2- 172.21.15.72:0/3648720755 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f18b406ace0 0x7f18b406d1a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f18b8000c00 tx=0x7f18b801e040 comp rx=0 tx=0).stop 2023-07-27T20:31:42.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.046+0000 7f18ce5ff700 1 -- 172.21.15.72:0/3648720755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18c81e8cf0 msgr2=0x7f18c81e9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:42.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.046+0000 7f18ce5ff700 1 --2- 172.21.15.72:0/3648720755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18c81e8cf0 0x7f18c81e9170 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f18c8072930 tx=0x7f18c00104a0 comp rx=0 tx=0).stop 2023-07-27T20:31:42.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.046+0000 7f18ce5ff700 1 -- 172.21.15.72:0/3648720755 shutdown_connections 2023-07-27T20:31:42.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.046+0000 7f18ce5ff700 1 --2- 172.21.15.72:0/3648720755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18c81e8cf0 0x7f18c81e9170 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:42.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.046+0000 7f18ce5ff700 1 --2- 172.21.15.72:0/3648720755 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f18b406ace0 0x7f18b406d1a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:42.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.046+0000 7f18ce5ff700 1 --2- 172.21.15.72:0/3648720755 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18b0003a00 0x7f18c8135430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:42.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.046+0000 7f18ce5ff700 1 --2- 172.21.15.72:0/3648720755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18c8134580 0x7f18c8134a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:42.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.046+0000 7f18ce5ff700 1 -- 172.21.15.72:0/3648720755 >> 172.21.15.72:0/3648720755 conn(0x7f18c806a190 msgr2=0x7f18c8132780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:42.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.046+0000 7f18ce5ff700 1 -- 172.21.15.72:0/3648720755 shutdown_connections 2023-07-27T20:31:42.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.046+0000 7f18ce5ff700 1 -- 172.21.15.72:0/3648720755 wait complete. 2023-07-27T20:31:42.053 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-27T20:31:14.581785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T20:31:21.077941+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T20:31:27.020951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T20:31:27.566022+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-27T20:31:31.182401+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-27T20:31:42.054 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-27T20:31:42.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.265+0000 7fce21dff700 1 Processor -- start 2023-07-27T20:31:42.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.265+0000 7fce21dff700 1 -- start start 2023-07-27T20:31:42.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.266+0000 7fce21dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce1c0c7740 0x7fce1c0c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:42.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.266+0000 7fce21dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce1c0c7c50 con 0x7fce1c0c4700 2023-07-27T20:31:42.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.266+0000 7fce21dff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce1c06bd40 con 0x7fce1c14aab0 2023-07-27T20:31:42.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.266+0000 7fce21dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce1c0c62f0 con 0x7fce1c0c7740 2023-07-27T20:31:42.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.267+0000 7fce1bfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fce1c0c4700 0x7fce1c06c1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57982/0 (socket says 172.21.15.72:57982) 2023-07-27T20:31:42.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.267+0000 7fce1bfff700 1 -- 172.21.15.72:0/1549077031 learned_addr learned my addr 172.21.15.72:0/1549077031 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:42.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.267+0000 7fce1affd700 1 --2- 172.21.15.72:0/1549077031 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce1c0c7740 0x7fce1c0c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:42.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.267+0000 7fce1a7fc700 1 -- 172.21.15.72:0/1549077031 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4279642623 0 0) 0x7fce1c0c7c50 con 0x7fce1c0c4700 2023-07-27T20:31:42.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.267+0000 7fce1a7fc700 1 -- 172.21.15.72:0/1549077031 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce040035b0 con 0x7fce1c0c4700 2023-07-27T20:31:42.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.267+0000 7fce1a7fc700 1 -- 172.21.15.72:0/1549077031 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3564324166 0 0) 0x7fce1c06bd40 con 0x7fce1c14aab0 2023-07-27T20:31:42.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.267+0000 7fce1a7fc700 1 -- 172.21.15.72:0/1549077031 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce1c0c7c50 con 0x7fce1c14aab0 2023-07-27T20:31:42.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.267+0000 7fce1a7fc700 1 -- 172.21.15.72:0/1549077031 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2192816446 0 0) 0x7fce040035b0 con 0x7fce1c0c4700 2023-07-27T20:31:42.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.267+0000 7fce1a7fc700 1 -- 172.21.15.72:0/1549077031 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce1c0c7740 msgr2=0x7fce1c0c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:42.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.267+0000 7fce1a7fc700 1 --2- 172.21.15.72:0/1549077031 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce1c0c7740 0x7fce1c0c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:42.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.267+0000 7fce1a7fc700 1 -- 172.21.15.72:0/1549077031 >> v1:172.21.15.173:6789/0 conn(0x7fce1c14aab0 legacy=0x7fce1c154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:42.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.267+0000 7fce1a7fc700 1 -- 172.21.15.72:0/1549077031 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce1c06d200 con 0x7fce1c0c4700 2023-07-27T20:31:42.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.267+0000 7fce1a7fc700 1 -- 172.21.15.72:0/1549077031 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7fce140019f0 con 0x7fce1c0c4700 2023-07-27T20:31:42.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.267+0000 7fce1a7fc700 1 -- 172.21.15.72:0/1549077031 >> v1:172.21.15.72:6789/0 conn(0x7fce1c0c4700 legacy=0x7fce1c06c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:42.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.267+0000 7fce1a7fc700 1 --2- 172.21.15.72:0/1549077031 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce04003bc0 0x7fce04003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:42.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.268+0000 7fce1a7fc700 1 --2- 172.21.15.72:0/1549077031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce04004850 0x7fce04004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:42.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.268+0000 7fce1a7fc700 1 --2- 172.21.15.72:0/1549077031 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce1c0c7740 0x7fce04005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:42.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.268+0000 7fce1a7fc700 1 -- 172.21.15.72:0/1549077031 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1c0c62f0 con 0x7fce04004850 2023-07-27T20:31:42.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.268+0000 7fce1a7fc700 1 -- 172.21.15.72:0/1549077031 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0400bac0 con 0x7fce04003bc0 2023-07-27T20:31:42.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.268+0000 7fce1a7fc700 1 -- 172.21.15.72:0/1549077031 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce0400bc50 con 0x7fce1c0c7740 2023-07-27T20:31:42.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.268+0000 7fce1affd700 1 --2- 172.21.15.72:0/1549077031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce04004850 0x7fce04004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:42.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.268+0000 7fce1b7fe700 1 --2- 172.21.15.72:0/1549077031 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce04003bc0 0x7fce04003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:42.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.268+0000 7fce1bfff700 1 --2- 172.21.15.72:0/1549077031 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce1c0c7740 0x7fce04005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:42.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.268+0000 7fce1affd700 1 -- 172.21.15.72:0/1549077031 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce1c0c7740 msgr2=0x7fce04005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:42.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.268+0000 7fce1affd700 1 --2- 172.21.15.72:0/1549077031 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce1c0c7740 0x7fce04005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:42.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.268+0000 7fce1affd700 1 -- 172.21.15.72:0/1549077031 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce04003bc0 msgr2=0x7fce04003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:42.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.268+0000 7fce1affd700 1 --2- 172.21.15.72:0/1549077031 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce04003bc0 0x7fce04003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:42.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.268+0000 7fce1affd700 1 -- 172.21.15.72:0/1549077031 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce040035b0 con 0x7fce04004850 2023-07-27T20:31:42.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.268+0000 7fce1bfff700 1 --2- 172.21.15.72:0/1549077031 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce1c0c7740 0x7fce04005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:31:42.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.268+0000 7fce1affd700 1 --2- 172.21.15.72:0/1549077031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce04004850 0x7fce04004cd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fce10009b30 tx=0x7fce04005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da81f7baab59bdae server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:42.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.269+0000 7fce1a7fc700 1 -- 172.21.15.72:0/1549077031 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1000e6c0 con 0x7fce04004850 2023-07-27T20:31:42.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.269+0000 7fce1a7fc700 1 -- 172.21.15.72:0/1549077031 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce1000e820 con 0x7fce04004850 2023-07-27T20:31:42.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.269+0000 7fce1a7fc700 1 -- 172.21.15.72:0/1549077031 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1000eb90 con 0x7fce04004850 2023-07-27T20:31:42.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.269+0000 7fce21dff700 1 -- 172.21.15.72:0/1549077031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce04004850 msgr2=0x7fce04004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:42.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.269+0000 7fce21dff700 1 --2- 172.21.15.72:0/1549077031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce04004850 0x7fce04004cd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fce10009b30 tx=0x7fce04005880 comp rx=0 tx=0).stop 2023-07-27T20:31:42.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.269+0000 7fce1bfff700 1 -- 172.21.15.72:0/1549077031 reap_dead start 2023-07-27T20:31:42.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.269+0000 7fce21dff700 1 -- 172.21.15.72:0/1549077031 shutdown_connections 2023-07-27T20:31:42.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.269+0000 7fce21dff700 1 -- 172.21.15.72:0/1549077031 >> 172.21.15.72:0/1549077031 conn(0x7fce1c0ab3f0 msgr2=0x7fce1c0ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:42.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.269+0000 7fce21dff700 1 -- 172.21.15.72:0/1549077031 shutdown_connections 2023-07-27T20:31:42.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.269+0000 7fce21dff700 1 -- 172.21.15.72:0/1549077031 wait complete. 2023-07-27T20:31:42.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.271+0000 7fce21dff700 1 Processor -- start 2023-07-27T20:31:42.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.271+0000 7fce21dff700 1 -- start start 2023-07-27T20:31:42.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.272+0000 7fce21dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce04004850 0x7fce1c1522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:42.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.272+0000 7fce21dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce1c1557f0 0x7fce1c1ed1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:42.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.272+0000 7fce21dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce1c155c40 0x7fce1c1ed6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:42.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.272+0000 7fce21dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1c1ea090 con 0x7fce04004850 2023-07-27T20:31:42.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.272+0000 7fce21dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1c1ecd60 con 0x7fce1c155c40 2023-07-27T20:31:42.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.272+0000 7fce21dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce1c156630 con 0x7fce1c1557f0 2023-07-27T20:31:42.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.272+0000 7fce1b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce04004850 0x7fce1c1522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:42.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.272+0000 7fce1b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce04004850 0x7fce1c1522e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50362/0 (socket says 172.21.15.72:50362) 2023-07-27T20:31:42.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.272+0000 7fce1b7fe700 1 -- 172.21.15.72:0/1770478341 learned_addr learned my addr 172.21.15.72:0/1770478341 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:42.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.272+0000 7fce1affd700 1 --2- 172.21.15.72:0/1770478341 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce1c1557f0 0x7fce1c1ed1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:42.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.272+0000 7fce1b7fe700 1 -- 172.21.15.72:0/1770478341 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce1c1557f0 msgr2=0x7fce1c1ed1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:42.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.272+0000 7fce1bfff700 1 --2- 172.21.15.72:0/1770478341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce1c155c40 0x7fce1c1ed6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:42.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.272+0000 7fce1b7fe700 1 --2- 172.21.15.72:0/1770478341 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce1c1557f0 0x7fce1c1ed1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:42.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.272+0000 7fce1b7fe700 1 -- 172.21.15.72:0/1770478341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce1c155c40 msgr2=0x7fce1c1ed6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:42.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.273+0000 7fce1b7fe700 1 --2- 172.21.15.72:0/1770478341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce1c155c40 0x7fce1c1ed6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:42.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.273+0000 7fce1b7fe700 1 -- 172.21.15.72:0/1770478341 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce1c1ea580 con 0x7fce04004850 2023-07-27T20:31:42.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.273+0000 7fce1affd700 1 --2- 172.21.15.72:0/1770478341 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce1c1557f0 0x7fce1c1ed1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:31:42.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.273+0000 7fce1bfff700 1 --2- 172.21.15.72:0/1770478341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce1c155c40 0x7fce1c1ed6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:31:42.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.273+0000 7fce1b7fe700 1 --2- 172.21.15.72:0/1770478341 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce04004850 0x7fce1c1522e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fce0c00f810 tx=0x7fce0c00fbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:42.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.273+0000 7fce03fff700 1 -- 172.21.15.72:0/1770478341 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c0052e0 con 0x7fce04004850 2023-07-27T20:31:42.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.273+0000 7fce03fff700 1 -- 172.21.15.72:0/1770478341 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0c005440 con 0x7fce04004850 2023-07-27T20:31:42.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.273+0000 7fce21dff700 1 -- 172.21.15.72:0/1770478341 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce1c0a9b70 con 0x7fce04004850 2023-07-27T20:31:42.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.273+0000 7fce03fff700 1 -- 172.21.15.72:0/1770478341 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c0038c0 con 0x7fce04004850 2023-07-27T20:31:42.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.273+0000 7fce21dff700 1 -- 172.21.15.72:0/1770478341 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce1c1ea2a0 con 0x7fce04004850 2023-07-27T20:31:42.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.274+0000 7fce21dff700 1 -- 172.21.15.72:0/1770478341 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce1c06a200 con 0x7fce04004850 2023-07-27T20:31:42.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.275+0000 7fce03fff700 1 -- 172.21.15.72:0/1770478341 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fce0c003a20 con 0x7fce04004850 2023-07-27T20:31:42.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.276+0000 7fce03fff700 1 --2- 172.21.15.72:0/1770478341 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fce0806ace0 0x7fce0806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:42.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.276+0000 7fce03fff700 1 -- 172.21.15.72:0/1770478341 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fce0c089700 con 0x7fce04004850 2023-07-27T20:31:42.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.277+0000 7fce1affd700 1 --2- 172.21.15.72:0/1770478341 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fce0806ace0 0x7fce0806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:42.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.277+0000 7fce1affd700 1 --2- 172.21.15.72:0/1770478341 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fce0806ace0 0x7fce0806d1a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fce1c14a3b0 tx=0x7fce10008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:42.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.280+0000 7fce03fff700 1 -- 172.21.15.72:0/1770478341 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fce0c0544b0 con 0x7fce04004850 2023-07-27T20:31:42.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.473+0000 7fce21dff700 1 -- 172.21.15.72:0/1770478341 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fce1c1ed000 con 0x7fce04004850 2023-07-27T20:31:42.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.474+0000 7fce03fff700 1 -- 172.21.15.72:0/1770478341 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fce0c057ad0 con 0x7fce04004850 2023-07-27T20:31:42.461 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-27T20:31:42.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.476+0000 7fce21dff700 1 -- 172.21.15.72:0/1770478341 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fce0806ace0 msgr2=0x7fce0806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:42.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.476+0000 7fce21dff700 1 --2- 172.21.15.72:0/1770478341 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fce0806ace0 0x7fce0806d1a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fce1c14a3b0 tx=0x7fce10008030 comp rx=0 tx=0).stop 2023-07-27T20:31:42.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.476+0000 7fce21dff700 1 -- 172.21.15.72:0/1770478341 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce04004850 msgr2=0x7fce1c1522e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:42.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.476+0000 7fce21dff700 1 --2- 172.21.15.72:0/1770478341 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce04004850 0x7fce1c1522e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fce0c00f810 tx=0x7fce0c00fbd0 comp rx=0 tx=0).stop 2023-07-27T20:31:42.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.476+0000 7fce21dff700 1 -- 172.21.15.72:0/1770478341 shutdown_connections 2023-07-27T20:31:42.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.476+0000 7fce21dff700 1 --2- 172.21.15.72:0/1770478341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce1c155c40 0x7fce1c1ed6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:42.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.476+0000 7fce21dff700 1 --2- 172.21.15.72:0/1770478341 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce04004850 0x7fce1c1522e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:42.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.476+0000 7fce21dff700 1 --2- 172.21.15.72:0/1770478341 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fce0806ace0 0x7fce0806d1a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:42.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.476+0000 7fce21dff700 1 --2- 172.21.15.72:0/1770478341 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce1c1557f0 0x7fce1c1ed1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:42.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.476+0000 7fce21dff700 1 -- 172.21.15.72:0/1770478341 >> 172.21.15.72:0/1770478341 conn(0x7fce1c0ab3f0 msgr2=0x7fce1c0aa5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:42.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.476+0000 7fce21dff700 1 -- 172.21.15.72:0/1770478341 shutdown_connections 2023-07-27T20:31:42.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.476+0000 7fce21dff700 1 -- 172.21.15.72:0/1770478341 wait complete. 2023-07-27T20:31:42.482 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T20:31:42.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.692+0000 7fc047bff700 1 Processor -- start 2023-07-27T20:31:42.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.693+0000 7fc047bff700 1 -- start start 2023-07-27T20:31:42.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.694+0000 7fc047bff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc04014aab0 0x7fc040154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:42.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.694+0000 7fc047bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0400c7c50 con 0x7fc0400c7740 2023-07-27T20:31:42.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.694+0000 7fc047bff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc04006bd40 con 0x7fc04006c1d0 2023-07-27T20:31:42.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.694+0000 7fc047bff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0400c62f0 con 0x7fc04014aab0 2023-07-27T20:31:42.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.694+0000 7fc04519a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc0400c7740 0x7fc0400c41c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57988/0 (socket says 172.21.15.72:57988) 2023-07-27T20:31:42.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.694+0000 7fc04519a700 1 -- 172.21.15.72:0/66586319 learned_addr learned my addr 172.21.15.72:0/66586319 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:42.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.694+0000 7fc04599b700 1 --2- 172.21.15.72:0/66586319 >> v2:172.21.15.173:3300/0 conn(0x7fc04014aab0 0x7fc040154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:42.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.694+0000 7fc04599b700 1 -- 172.21.15.72:0/66586319 >> v1:172.21.15.173:6789/0 conn(0x7fc04006c1d0 legacy=0x7fc04006c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:42.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.694+0000 7fc044999700 1 -- 172.21.15.72:0/66586319 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2054936062 0 0) 0x7fc0400c7c50 con 0x7fc0400c7740 2023-07-27T20:31:42.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.695+0000 7fc04599b700 1 -- 172.21.15.72:0/66586319 >> v1:172.21.15.72:6789/0 conn(0x7fc0400c7740 legacy=0x7fc0400c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:42.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.695+0000 7fc04599b700 1 -- 172.21.15.72:0/66586319 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04006cd00 con 0x7fc04014aab0 2023-07-27T20:31:42.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.695+0000 7fc04599b700 1 --2- 172.21.15.72:0/66586319 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc04014aab0 0x7fc040154b10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc03c009840 tx=0x7fc03c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16eb97812ea16919 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:42.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.695+0000 7fc044999700 1 -- 172.21.15.72:0/66586319 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c011830 con 0x7fc04014aab0 2023-07-27T20:31:42.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.695+0000 7fc044999700 1 -- 172.21.15.72:0/66586319 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03c011990 con 0x7fc04014aab0 2023-07-27T20:31:42.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.695+0000 7fc044999700 1 -- 172.21.15.72:0/66586319 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c011d20 con 0x7fc04014aab0 2023-07-27T20:31:42.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.696+0000 7fc047bff700 1 -- 172.21.15.72:0/66586319 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc04014aab0 msgr2=0x7fc040154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:42.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.696+0000 7fc047bff700 1 --2- 172.21.15.72:0/66586319 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc04014aab0 0x7fc040154b10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc03c009840 tx=0x7fc03c009b50 comp rx=0 tx=0).stop 2023-07-27T20:31:42.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.696+0000 7fc047bff700 1 -- 172.21.15.72:0/66586319 shutdown_connections 2023-07-27T20:31:42.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.696+0000 7fc047bff700 1 --2- 172.21.15.72:0/66586319 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc04014aab0 0x7fc040154b10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:42.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.696+0000 7fc047bff700 1 -- 172.21.15.72:0/66586319 >> 172.21.15.72:0/66586319 conn(0x7fc0400ab3f0 msgr2=0x7fc0400ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:42.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.696+0000 7fc047bff700 1 -- 172.21.15.72:0/66586319 shutdown_connections 2023-07-27T20:31:42.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.696+0000 7fc047bff700 1 -- 172.21.15.72:0/66586319 wait complete. 2023-07-27T20:31:42.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.697+0000 7fc047bff700 1 Processor -- start 2023-07-27T20:31:42.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.698+0000 7fc047bff700 1 -- start start 2023-07-27T20:31:42.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.698+0000 7fc047bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc04006c1d0 0x7fc0401ed1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:42.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.698+0000 7fc047bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0400c7740 0x7fc0401ed6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:42.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.698+0000 7fc047bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc04014aab0 0x7fc040157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:42.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.698+0000 7fc047bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0401edc30 con 0x7fc0400c7740 2023-07-27T20:31:42.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.698+0000 7fc047bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0400bd970 con 0x7fc04014aab0 2023-07-27T20:31:42.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.698+0000 7fc047bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc04014e220 con 0x7fc04006c1d0 2023-07-27T20:31:42.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.699+0000 7fc04519a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0400c7740 0x7fc0401ed6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:42.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.699+0000 7fc04519a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0400c7740 0x7fc0401ed6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50374/0 (socket says 172.21.15.72:50374) 2023-07-27T20:31:42.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.699+0000 7fc04519a700 1 -- 172.21.15.72:0/3243914978 learned_addr learned my addr 172.21.15.72:0/3243914978 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:42.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.699+0000 7fc04599b700 1 --2- 172.21.15.72:0/3243914978 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc04006c1d0 0x7fc0401ed1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:42.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.699+0000 7fc04619c700 1 --2- 172.21.15.72:0/3243914978 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc04014aab0 0x7fc040157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:42.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.699+0000 7fc04519a700 1 -- 172.21.15.72:0/3243914978 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc04006c1d0 msgr2=0x7fc0401ed1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:42.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.699+0000 7fc04519a700 1 --2- 172.21.15.72:0/3243914978 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc04006c1d0 0x7fc0401ed1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:42.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.699+0000 7fc04519a700 1 -- 172.21.15.72:0/3243914978 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc04014aab0 msgr2=0x7fc040157230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:42.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.699+0000 7fc04519a700 1 --2- 172.21.15.72:0/3243914978 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc04014aab0 0x7fc040157230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:42.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.699+0000 7fc04519a700 1 -- 172.21.15.72:0/3243914978 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc03c0094a0 con 0x7fc0400c7740 2023-07-27T20:31:42.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.699+0000 7fc04519a700 1 --2- 172.21.15.72:0/3243914978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0400c7740 0x7fc0401ed6f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc03000c520 tx=0x7fc03000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:42.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.699+0000 7fc0367fc700 1 -- 172.21.15.72:0/3243914978 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc030004c80 con 0x7fc0400c7740 2023-07-27T20:31:42.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.699+0000 7fc0367fc700 1 -- 172.21.15.72:0/3243914978 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc030004de0 con 0x7fc0400c7740 2023-07-27T20:31:42.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.699+0000 7fc0367fc700 1 -- 172.21.15.72:0/3243914978 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc030007310 con 0x7fc0400c7740 2023-07-27T20:31:42.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.700+0000 7fc047bff700 1 -- 172.21.15.72:0/3243914978 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0401ee0f0 con 0x7fc0400c7740 2023-07-27T20:31:42.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.700+0000 7fc047bff700 1 -- 172.21.15.72:0/3243914978 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0401ede10 con 0x7fc0400c7740 2023-07-27T20:31:42.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.701+0000 7fc047bff700 1 -- 172.21.15.72:0/3243914978 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc040156f50 con 0x7fc0400c7740 2023-07-27T20:31:42.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.702+0000 7fc0367fc700 1 -- 172.21.15.72:0/3243914978 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc030007470 con 0x7fc0400c7740 2023-07-27T20:31:42.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.702+0000 7fc0367fc700 1 --2- 172.21.15.72:0/3243914978 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc02406ace0 0x7fc02406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:42.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.703+0000 7fc0367fc700 1 -- 172.21.15.72:0/3243914978 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc030089380 con 0x7fc0400c7740 2023-07-27T20:31:42.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.703+0000 7fc04599b700 1 --2- 172.21.15.72:0/3243914978 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc02406ace0 0x7fc02406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:42.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.704+0000 7fc04599b700 1 --2- 172.21.15.72:0/3243914978 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc02406ace0 0x7fc02406d1a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc03c0090b0 tx=0x7fc03c01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:42.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.707+0000 7fc0367fc700 1 -- 172.21.15.72:0/3243914978 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc040156f50 con 0x7fc0400c7740 2023-07-27T20:31:42.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.899+0000 7fc047bff700 1 -- 172.21.15.72:0/3243914978 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc040156f50 con 0x7fc0400c7740 2023-07-27T20:31:42.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.899+0000 7fc0367fc700 1 -- 172.21.15.72:0/3243914978 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc040156f50 con 0x7fc0400c7740 2023-07-27T20:31:42.887 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-27T20:31:42.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.902+0000 7fc047bff700 1 -- 172.21.15.72:0/3243914978 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc02406ace0 msgr2=0x7fc02406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:42.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.902+0000 7fc047bff700 1 --2- 172.21.15.72:0/3243914978 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc02406ace0 0x7fc02406d1a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc03c0090b0 tx=0x7fc03c01c040 comp rx=0 tx=0).stop 2023-07-27T20:31:42.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.902+0000 7fc047bff700 1 -- 172.21.15.72:0/3243914978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0400c7740 msgr2=0x7fc0401ed6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:42.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.902+0000 7fc047bff700 1 --2- 172.21.15.72:0/3243914978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0400c7740 0x7fc0401ed6f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc03000c520 tx=0x7fc03000c830 comp rx=0 tx=0).stop 2023-07-27T20:31:42.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.902+0000 7fc047bff700 1 -- 172.21.15.72:0/3243914978 shutdown_connections 2023-07-27T20:31:42.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.902+0000 7fc047bff700 1 --2- 172.21.15.72:0/3243914978 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc04014aab0 0x7fc040157230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:42.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.902+0000 7fc047bff700 1 --2- 172.21.15.72:0/3243914978 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc02406ace0 0x7fc02406d1a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:42.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.902+0000 7fc047bff700 1 --2- 172.21.15.72:0/3243914978 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc04006c1d0 0x7fc0401ed1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:42.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.902+0000 7fc047bff700 1 --2- 172.21.15.72:0/3243914978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0400c7740 0x7fc0401ed6f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:42.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.902+0000 7fc047bff700 1 -- 172.21.15.72:0/3243914978 >> 172.21.15.72:0/3243914978 conn(0x7fc0400ab3f0 msgr2=0x7fc0400c8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:42.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.902+0000 7fc047bff700 1 -- 172.21.15.72:0/3243914978 shutdown_connections 2023-07-27T20:31:42.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:42.902+0000 7fc047bff700 1 -- 172.21.15.72:0/3243914978 wait complete. 2023-07-27T20:31:42.907 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T20:31:43.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.120+0000 7f97847ff700 1 Processor -- start 2023-07-27T20:31:43.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.121+0000 7f97847ff700 1 -- start start 2023-07-27T20:31:43.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.122+0000 7f97847ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f977c14aab0 0x7f977c154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:43.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.122+0000 7f97847ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f977c0c7740 0x7f977c0c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:43.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.122+0000 7f97847ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f977c0c4700 0x7f977c06c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:43.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.122+0000 7f97847ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f977c0c7c50 con 0x7f977c0c7740 2023-07-27T20:31:43.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.122+0000 7f97847ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f977c06bd40 con 0x7f977c0c4700 2023-07-27T20:31:43.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.122+0000 7f97847ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977c0c62f0 con 0x7f977c14aab0 2023-07-27T20:31:43.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.122+0000 7f9781d9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f977c0c7740 0x7f977c0c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:43.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.122+0000 7f9781d9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f977c0c7740 0x7f977c0c41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50384/0 (socket says 172.21.15.72:50384) 2023-07-27T20:31:43.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.122+0000 7f9781d9a700 1 -- 172.21.15.72:0/4212889505 learned_addr learned my addr 172.21.15.72:0/4212889505 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:43.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.122+0000 7f978259b700 1 --2- 172.21.15.72:0/4212889505 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f977c14aab0 0x7f977c154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:43.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.122+0000 7f9782d9c700 1 --2- 172.21.15.72:0/4212889505 >> v2:172.21.15.173:3300/0 conn(0x7f977c0c4700 0x7f977c06c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:43.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.123+0000 7f9781d9a700 1 -- 172.21.15.72:0/4212889505 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f977c14aab0 msgr2=0x7f977c154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:43.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.123+0000 7f9781d9a700 1 --2- 172.21.15.72:0/4212889505 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f977c14aab0 0x7f977c154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:43.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.123+0000 7f9781d9a700 1 -- 172.21.15.72:0/4212889505 >> v2:172.21.15.173:3300/0 conn(0x7f977c0c4700 msgr2=0x7f977c06c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:43.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.123+0000 7f9781d9a700 1 --2- 172.21.15.72:0/4212889505 >> v2:172.21.15.173:3300/0 conn(0x7f977c0c4700 0x7f977c06c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:43.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.123+0000 7f9781d9a700 1 -- 172.21.15.72:0/4212889505 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977c155050 con 0x7f977c0c7740 2023-07-27T20:31:43.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.123+0000 7f9781d9a700 1 --2- 172.21.15.72:0/4212889505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f977c0c7740 0x7f977c0c41c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f977c08ba30 tx=0x7f976c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f847c5547ebd18bc server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:43.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.123+0000 7f9781599700 1 -- 172.21.15.72:0/4212889505 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c011830 con 0x7f977c0c7740 2023-07-27T20:31:43.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.123+0000 7f9781599700 1 -- 172.21.15.72:0/4212889505 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976c011990 con 0x7f977c0c7740 2023-07-27T20:31:43.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.123+0000 7f9781599700 1 -- 172.21.15.72:0/4212889505 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c011d20 con 0x7f977c0c7740 2023-07-27T20:31:43.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.124+0000 7f97847ff700 1 -- 172.21.15.72:0/4212889505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f977c0c7740 msgr2=0x7f977c0c41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:43.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.124+0000 7f97847ff700 1 --2- 172.21.15.72:0/4212889505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f977c0c7740 0x7f977c0c41c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f977c08ba30 tx=0x7f976c009bd0 comp rx=0 tx=0).stop 2023-07-27T20:31:43.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.124+0000 7f97847ff700 1 -- 172.21.15.72:0/4212889505 shutdown_connections 2023-07-27T20:31:43.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.124+0000 7f97847ff700 1 --2- 172.21.15.72:0/4212889505 >> v2:172.21.15.173:3300/0 conn(0x7f977c0c4700 0x7f977c06c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:43.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.124+0000 7f97847ff700 1 --2- 172.21.15.72:0/4212889505 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f977c14aab0 0x7f977c154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:43.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.124+0000 7f97847ff700 1 --2- 172.21.15.72:0/4212889505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f977c0c7740 0x7f977c0c41c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:43.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.124+0000 7f97847ff700 1 -- 172.21.15.72:0/4212889505 >> 172.21.15.72:0/4212889505 conn(0x7f977c0ab3f0 msgr2=0x7f977c0ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:43.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.124+0000 7f97847ff700 1 -- 172.21.15.72:0/4212889505 shutdown_connections 2023-07-27T20:31:43.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.124+0000 7f97847ff700 1 -- 172.21.15.72:0/4212889505 wait complete. 2023-07-27T20:31:43.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.125+0000 7f97847ff700 1 Processor -- start 2023-07-27T20:31:43.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.126+0000 7f97847ff700 1 -- start start 2023-07-27T20:31:43.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.126+0000 7f97847ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f977c0c4700 0x7f977c1451c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:43.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.126+0000 7f97847ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f977c0c7740 0x7f977c146200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:43.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.126+0000 7f97847ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f977c14aab0 0x7f977c146740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:43.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.126+0000 7f97847ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c0c1e40 con 0x7f977c0c7740 2023-07-27T20:31:43.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.126+0000 7f97847ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c1ea3b0 con 0x7f977c14aab0 2023-07-27T20:31:43.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.126+0000 7f97847ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977c1e9aa0 con 0x7f977c0c4700 2023-07-27T20:31:43.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.127+0000 7f9781d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f977c0c7740 0x7f977c146200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:43.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.127+0000 7f9781d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f977c0c7740 0x7f977c146200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50388/0 (socket says 172.21.15.72:50388) 2023-07-27T20:31:43.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.127+0000 7f9781d9a700 1 -- 172.21.15.72:0/2946777949 learned_addr learned my addr 172.21.15.72:0/2946777949 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:43.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.127+0000 7f9781d9a700 1 -- 172.21.15.72:0/2946777949 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f977c0c4700 msgr2=0x7f977c1451c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:43.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.127+0000 7f9781d9a700 1 --2- 172.21.15.72:0/2946777949 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f977c0c4700 0x7f977c1451c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:43.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.127+0000 7f9781d9a700 1 -- 172.21.15.72:0/2946777949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f977c14aab0 msgr2=0x7f977c146740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:43.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.127+0000 7f9781d9a700 1 --2- 172.21.15.72:0/2946777949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f977c14aab0 0x7f977c146740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:43.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.127+0000 7f9781d9a700 1 -- 172.21.15.72:0/2946777949 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976c009550 con 0x7f977c0c7740 2023-07-27T20:31:43.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.127+0000 7f9781d9a700 1 --2- 172.21.15.72:0/2946777949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f977c0c7740 0x7f977c146200 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f976c000c00 tx=0x7f976c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:43.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.127+0000 7f9772ffd700 1 -- 172.21.15.72:0/2946777949 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c004300 con 0x7f977c0c7740 2023-07-27T20:31:43.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.127+0000 7f9772ffd700 1 -- 172.21.15.72:0/2946777949 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976c01f070 con 0x7f977c0c7740 2023-07-27T20:31:43.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.128+0000 7f9772ffd700 1 -- 172.21.15.72:0/2946777949 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c0036a0 con 0x7f977c0c7740 2023-07-27T20:31:43.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.128+0000 7f97847ff700 1 -- 172.21.15.72:0/2946777949 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f977c0c1820 con 0x7f977c0c7740 2023-07-27T20:31:43.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.128+0000 7f97847ff700 1 -- 172.21.15.72:0/2946777949 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f977c1ea040 con 0x7f977c0c7740 2023-07-27T20:31:43.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.129+0000 7f97847ff700 1 -- 172.21.15.72:0/2946777949 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f977c04e470 con 0x7f977c0c7740 2023-07-27T20:31:43.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.129+0000 7f9772ffd700 1 -- 172.21.15.72:0/2946777949 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f976c021030 con 0x7f977c0c7740 2023-07-27T20:31:43.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.130+0000 7f9772ffd700 1 --2- 172.21.15.72:0/2946777949 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f976006ace0 0x7f976006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:43.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.130+0000 7f9772ffd700 1 -- 172.21.15.72:0/2946777949 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f976c08ab30 con 0x7f977c0c7740 2023-07-27T20:31:43.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.131+0000 7f978259b700 1 --2- 172.21.15.72:0/2946777949 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f976006ace0 0x7f976006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:43.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.131+0000 7f978259b700 1 --2- 172.21.15.72:0/2946777949 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f976006ace0 0x7f976006d1a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9778006b20 tx=0x7f9778006ab0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:43.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.135+0000 7f9772ffd700 1 -- 172.21.15.72:0/2946777949 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f976c0558e0 con 0x7f977c0c7740 2023-07-27T20:31:43.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.330+0000 7f97847ff700 1 -- 172.21.15.72:0/2946777949 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f977c1ea4f0 con 0x7f977c0c7740 2023-07-27T20:31:43.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.330+0000 7f9772ffd700 1 -- 172.21.15.72:0/2946777949 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f977c1ea4f0 con 0x7f977c0c7740 2023-07-27T20:31:43.318 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:31:43.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.332+0000 7f97847ff700 1 -- 172.21.15.72:0/2946777949 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f976006ace0 msgr2=0x7f976006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:43.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.332+0000 7f97847ff700 1 --2- 172.21.15.72:0/2946777949 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f976006ace0 0x7f976006d1a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9778006b20 tx=0x7f9778006ab0 comp rx=0 tx=0).stop 2023-07-27T20:31:43.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.332+0000 7f97847ff700 1 -- 172.21.15.72:0/2946777949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f977c0c7740 msgr2=0x7f977c146200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:43.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.332+0000 7f97847ff700 1 --2- 172.21.15.72:0/2946777949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f977c0c7740 0x7f977c146200 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f976c000c00 tx=0x7f976c004750 comp rx=0 tx=0).stop 2023-07-27T20:31:43.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.333+0000 7f97847ff700 1 -- 172.21.15.72:0/2946777949 shutdown_connections 2023-07-27T20:31:43.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.333+0000 7f97847ff700 1 --2- 172.21.15.72:0/2946777949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f977c14aab0 0x7f977c146740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:43.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.333+0000 7f97847ff700 1 --2- 172.21.15.72:0/2946777949 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f976006ace0 0x7f976006d1a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:43.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.333+0000 7f97847ff700 1 --2- 172.21.15.72:0/2946777949 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f977c0c4700 0x7f977c1451c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:43.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.333+0000 7f97847ff700 1 --2- 172.21.15.72:0/2946777949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f977c0c7740 0x7f977c146200 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:43.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.333+0000 7f97847ff700 1 -- 172.21.15.72:0/2946777949 >> 172.21.15.72:0/2946777949 conn(0x7f977c0ab3f0 msgr2=0x7f977c149cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:43.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.333+0000 7f97847ff700 1 -- 172.21.15.72:0/2946777949 shutdown_connections 2023-07-27T20:31:43.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.333+0000 7f97847ff700 1 -- 172.21.15.72:0/2946777949 wait complete. 2023-07-27T20:31:43.338 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T20:31:43.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.550+0000 7f40a33ff700 1 Processor -- start 2023-07-27T20:31:43.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.550+0000 7f40a33ff700 1 -- start start 2023-07-27T20:31:43.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.551+0000 7f40a33ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f409c14aab0 0x7f409c154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:43.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.551+0000 7f40a33ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f409c06c1d0 0x7f409c06c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:43.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.551+0000 7f40a33ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f409c0c7c50 con 0x7f409c0c7740 2023-07-27T20:31:43.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.551+0000 7f40a33ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f409c06bd40 con 0x7f409c14aab0 2023-07-27T20:31:43.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.551+0000 7f40a33ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f409c0c62f0 con 0x7f409c06c1d0 2023-07-27T20:31:43.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.551+0000 7f40a119b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f409c14aab0 0x7f409c154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:43.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.551+0000 7f40a119b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f409c14aab0 0x7f409c154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50396/0 (socket says 172.21.15.72:50396) 2023-07-27T20:31:43.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.551+0000 7f40a119b700 1 -- 172.21.15.72:0/130542317 learned_addr learned my addr 172.21.15.72:0/130542317 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:43.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.552+0000 7f40a199c700 1 --2- 172.21.15.72:0/130542317 >> v2:172.21.15.173:3300/0 conn(0x7f409c06c1d0 0x7f409c06c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:43.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.552+0000 7f40a119b700 1 -- 172.21.15.72:0/130542317 >> v2:172.21.15.173:3300/0 conn(0x7f409c06c1d0 msgr2=0x7f409c06c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:43.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.552+0000 7f40a119b700 1 --2- 172.21.15.72:0/130542317 >> v2:172.21.15.173:3300/0 conn(0x7f409c06c1d0 0x7f409c06c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:43.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.552+0000 7f40a119b700 1 -- 172.21.15.72:0/130542317 >> v1:172.21.15.173:6789/0 conn(0x7f409c0c7740 legacy=0x7f409c0c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:43.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.552+0000 7f40a119b700 1 -- 172.21.15.72:0/130542317 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f409c155050 con 0x7f409c14aab0 2023-07-27T20:31:43.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.552+0000 7f40a119b700 1 --2- 172.21.15.72:0/130542317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f409c14aab0 0x7f409c154b10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f409c0c96f0 tx=0x7f4098009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7871c70e09c177d6 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:43.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.552+0000 7f4093fff700 1 -- 172.21.15.72:0/130542317 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4098004230 con 0x7f409c14aab0 2023-07-27T20:31:43.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.552+0000 7f4093fff700 1 -- 172.21.15.72:0/130542317 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4098004390 con 0x7f409c14aab0 2023-07-27T20:31:43.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.552+0000 7f4093fff700 1 -- 172.21.15.72:0/130542317 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40980036a0 con 0x7f409c14aab0 2023-07-27T20:31:43.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.553+0000 7f40a33ff700 1 -- 172.21.15.72:0/130542317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f409c14aab0 msgr2=0x7f409c154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:43.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.553+0000 7f40a33ff700 1 --2- 172.21.15.72:0/130542317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f409c14aab0 0x7f409c154b10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f409c0c96f0 tx=0x7f4098009bd0 comp rx=0 tx=0).stop 2023-07-27T20:31:43.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.553+0000 7f40a33ff700 1 -- 172.21.15.72:0/130542317 shutdown_connections 2023-07-27T20:31:43.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.553+0000 7f40a33ff700 1 --2- 172.21.15.72:0/130542317 >> v2:172.21.15.173:3300/0 conn(0x7f409c06c1d0 0x7f409c06c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:43.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.553+0000 7f40a33ff700 1 --2- 172.21.15.72:0/130542317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f409c14aab0 0x7f409c154b10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:43.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.553+0000 7f40a33ff700 1 -- 172.21.15.72:0/130542317 >> 172.21.15.72:0/130542317 conn(0x7f409c0ab3f0 msgr2=0x7f409c0ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:43.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.553+0000 7f40a33ff700 1 -- 172.21.15.72:0/130542317 shutdown_connections 2023-07-27T20:31:43.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.553+0000 7f40a33ff700 1 -- 172.21.15.72:0/130542317 wait complete. 2023-07-27T20:31:43.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.555+0000 7f40a33ff700 1 Processor -- start 2023-07-27T20:31:43.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.555+0000 7f40a33ff700 1 -- start start 2023-07-27T20:31:43.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.556+0000 7f40a33ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f409c06c1d0 0x7f409c0bdff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:43.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.556+0000 7f40a33ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f409c0c7740 0x7f409c1ecc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:43.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.556+0000 7f40a33ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f409c14aab0 0x7f409c1ed150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:43.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.556+0000 7f40a33ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409c14bb00 con 0x7f409c14aab0 2023-07-27T20:31:43.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.556+0000 7f40a33ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409c14b560 con 0x7f409c06c1d0 2023-07-27T20:31:43.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.556+0000 7f40a33ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f409c1ed690 con 0x7f409c0c7740 2023-07-27T20:31:43.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.556+0000 7f40a199c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f409c14aab0 0x7f409c1ed150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:43.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.556+0000 7f40a119b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f409c06c1d0 0x7f409c0bdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:43.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.556+0000 7f40a199c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f409c14aab0 0x7f409c1ed150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50402/0 (socket says 172.21.15.72:50402) 2023-07-27T20:31:43.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.556+0000 7f40a199c700 1 -- 172.21.15.72:0/852272337 learned_addr learned my addr 172.21.15.72:0/852272337 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:43.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.556+0000 7f40a099a700 1 --2- 172.21.15.72:0/852272337 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f409c0c7740 0x7f409c1ecc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:43.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.556+0000 7f40a199c700 1 -- 172.21.15.72:0/852272337 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f409c0c7740 msgr2=0x7f409c1ecc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:43.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.556+0000 7f40a199c700 1 --2- 172.21.15.72:0/852272337 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f409c0c7740 0x7f409c1ecc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:43.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.556+0000 7f40a199c700 1 -- 172.21.15.72:0/852272337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f409c06c1d0 msgr2=0x7f409c0bdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:43.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.556+0000 7f40a199c700 1 --2- 172.21.15.72:0/852272337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f409c06c1d0 0x7f409c0bdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:43.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.556+0000 7f40a199c700 1 -- 172.21.15.72:0/852272337 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4098009550 con 0x7f409c14aab0 2023-07-27T20:31:43.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.557+0000 7f40a199c700 1 --2- 172.21.15.72:0/852272337 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f409c14aab0 0x7f409c1ed150 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4094007e70 tx=0x7f409400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:43.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.557+0000 7f4091ffb700 1 -- 172.21.15.72:0/852272337 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409400ed30 con 0x7f409c14aab0 2023-07-27T20:31:43.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.557+0000 7f4091ffb700 1 -- 172.21.15.72:0/852272337 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409400eeb0 con 0x7f409c14aab0 2023-07-27T20:31:43.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.557+0000 7f4091ffb700 1 -- 172.21.15.72:0/852272337 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4094014640 con 0x7f409c14aab0 2023-07-27T20:31:43.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.557+0000 7f40a33ff700 1 -- 172.21.15.72:0/852272337 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f409c14b760 con 0x7f409c14aab0 2023-07-27T20:31:43.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.557+0000 7f40a33ff700 1 -- 172.21.15.72:0/852272337 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f409c14c070 con 0x7f409c14aab0 2023-07-27T20:31:43.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.558+0000 7f40a33ff700 1 -- 172.21.15.72:0/852272337 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f409c04e470 con 0x7f409c14aab0 2023-07-27T20:31:43.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.559+0000 7f4091ffb700 1 -- 172.21.15.72:0/852272337 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f40940147a0 con 0x7f409c14aab0 2023-07-27T20:31:43.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.560+0000 7f4091ffb700 1 --2- 172.21.15.72:0/852272337 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f408006ace0 0x7f408006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:43.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.560+0000 7f4091ffb700 1 -- 172.21.15.72:0/852272337 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4094089e90 con 0x7f409c14aab0 2023-07-27T20:31:43.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.561+0000 7f40a119b700 1 --2- 172.21.15.72:0/852272337 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f408006ace0 0x7f408006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:43.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.561+0000 7f40a119b700 1 --2- 172.21.15.72:0/852272337 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f408006ace0 0x7f408006d1a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4098009130 tx=0x7f4098008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:43.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.565+0000 7f4091ffb700 1 -- 172.21.15.72:0/852272337 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f40940586d0 con 0x7f409c14aab0 2023-07-27T20:31:43.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.758+0000 7f40a33ff700 1 -- 172.21.15.72:0/852272337 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f409c06cf00 con 0x7f409c14aab0 2023-07-27T20:31:43.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.759+0000 7f4091ffb700 1 -- 172.21.15.72:0/852272337 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f409408b0a0 con 0x7f409c14aab0 2023-07-27T20:31:43.746 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-27T20:31:43.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.761+0000 7f40a33ff700 1 -- 172.21.15.72:0/852272337 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f408006ace0 msgr2=0x7f408006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:43.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.761+0000 7f40a33ff700 1 --2- 172.21.15.72:0/852272337 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f408006ace0 0x7f408006d1a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4098009130 tx=0x7f4098008030 comp rx=0 tx=0).stop 2023-07-27T20:31:43.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.761+0000 7f40a33ff700 1 -- 172.21.15.72:0/852272337 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f409c14aab0 msgr2=0x7f409c1ed150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:43.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.761+0000 7f40a33ff700 1 --2- 172.21.15.72:0/852272337 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f409c14aab0 0x7f409c1ed150 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4094007e70 tx=0x7f409400e3c0 comp rx=0 tx=0).stop 2023-07-27T20:31:43.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.761+0000 7f40a33ff700 1 -- 172.21.15.72:0/852272337 shutdown_connections 2023-07-27T20:31:43.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.761+0000 7f40a33ff700 1 --2- 172.21.15.72:0/852272337 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f409c14aab0 0x7f409c1ed150 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:43.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.761+0000 7f40a33ff700 1 --2- 172.21.15.72:0/852272337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f409c06c1d0 0x7f409c0bdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:43.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.761+0000 7f40a33ff700 1 --2- 172.21.15.72:0/852272337 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f408006ace0 0x7f408006d1a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:43.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.761+0000 7f40a33ff700 1 --2- 172.21.15.72:0/852272337 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f409c0c7740 0x7f409c1ecc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:43.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.761+0000 7f40a33ff700 1 -- 172.21.15.72:0/852272337 >> 172.21.15.72:0/852272337 conn(0x7f409c0ab3f0 msgr2=0x7f409c0c40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:43.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.761+0000 7f40a33ff700 1 -- 172.21.15.72:0/852272337 shutdown_connections 2023-07-27T20:31:43.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.761+0000 7f40a33ff700 1 -- 172.21.15.72:0/852272337 wait complete. 2023-07-27T20:31:43.766 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-27T20:31:43.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.976+0000 7f75821ff700 1 Processor -- start 2023-07-27T20:31:43.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.976+0000 7f75821ff700 1 -- start start 2023-07-27T20:31:43.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.977+0000 7f75821ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f757c0c77c0 0x7f757c151210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:43.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.977+0000 7f75821ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f757c151750 0x7f757c0c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:43.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.977+0000 7f75821ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f757c06d1c0 con 0x7f757c06ffc0 2023-07-27T20:31:43.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.977+0000 7f75821ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f757c155070 con 0x7f757c0c77c0 2023-07-27T20:31:43.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.977+0000 7f75821ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f757c0c7360 con 0x7f757c151750 2023-07-27T20:31:43.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.977+0000 7f757b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f757c0c77c0 0x7f757c151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:43.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.977+0000 7f757b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f757c0c77c0 0x7f757c151210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50416/0 (socket says 172.21.15.72:50416) 2023-07-27T20:31:43.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.977+0000 7f757b7fe700 1 -- 172.21.15.72:0/2754105509 learned_addr learned my addr 172.21.15.72:0/2754105509 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:43.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.977+0000 7f757bfff700 1 --2- 172.21.15.72:0/2754105509 >> v2:172.21.15.173:3300/0 conn(0x7f757c151750 0x7f757c0c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:43.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.978+0000 7f757b7fe700 1 -- 172.21.15.72:0/2754105509 >> v2:172.21.15.173:3300/0 conn(0x7f757c151750 msgr2=0x7f757c0c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:43.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.978+0000 7f757b7fe700 1 --2- 172.21.15.72:0/2754105509 >> v2:172.21.15.173:3300/0 conn(0x7f757c151750 0x7f757c0c6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:43.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.978+0000 7f757b7fe700 1 -- 172.21.15.72:0/2754105509 >> v1:172.21.15.173:6789/0 conn(0x7f757c06ffc0 legacy=0x7f757c0c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:43.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.978+0000 7f757b7fe700 1 -- 172.21.15.72:0/2754105509 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757c06ce90 con 0x7f757c0c77c0 2023-07-27T20:31:43.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.978+0000 7f757b7fe700 1 --2- 172.21.15.72:0/2754105509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f757c0c77c0 0x7f757c151210 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f757c0ad970 tx=0x7f756c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e65b73216268f67 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:43.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.978+0000 7f757a7fc700 1 -- 172.21.15.72:0/2754105509 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c011830 con 0x7f757c0c77c0 2023-07-27T20:31:43.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.978+0000 7f757a7fc700 1 -- 172.21.15.72:0/2754105509 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756c011990 con 0x7f757c0c77c0 2023-07-27T20:31:43.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.978+0000 7f757a7fc700 1 -- 172.21.15.72:0/2754105509 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c011d20 con 0x7f757c0c77c0 2023-07-27T20:31:43.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.979+0000 7f75821ff700 1 -- 172.21.15.72:0/2754105509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f757c0c77c0 msgr2=0x7f757c151210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:43.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.979+0000 7f75821ff700 1 --2- 172.21.15.72:0/2754105509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f757c0c77c0 0x7f757c151210 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f757c0ad970 tx=0x7f756c009bd0 comp rx=0 tx=0).stop 2023-07-27T20:31:43.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.979+0000 7f75821ff700 1 -- 172.21.15.72:0/2754105509 shutdown_connections 2023-07-27T20:31:43.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.979+0000 7f75821ff700 1 --2- 172.21.15.72:0/2754105509 >> v2:172.21.15.173:3300/0 conn(0x7f757c151750 0x7f757c0c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:43.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.979+0000 7f75821ff700 1 --2- 172.21.15.72:0/2754105509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f757c0c77c0 0x7f757c151210 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:43.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.979+0000 7f75821ff700 1 -- 172.21.15.72:0/2754105509 >> 172.21.15.72:0/2754105509 conn(0x7f757c06a190 msgr2=0x7f757c06a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:43.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.979+0000 7f75821ff700 1 -- 172.21.15.72:0/2754105509 shutdown_connections 2023-07-27T20:31:43.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.979+0000 7f75821ff700 1 -- 172.21.15.72:0/2754105509 wait complete. 2023-07-27T20:31:43.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.981+0000 7f75821ff700 1 Processor -- start 2023-07-27T20:31:43.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.981+0000 7f75821ff700 1 -- start start 2023-07-27T20:31:43.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.981+0000 7f75821ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f757c06ffc0 0x7f757c0acd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:43.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.982+0000 7f75821ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f757c0c77c0 0x7f757c1533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:43.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.982+0000 7f75821ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f757c151750 0x7f757c0c0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:43.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.982+0000 7f75821ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757c0ad2a0 con 0x7f757c06ffc0 2023-07-27T20:31:43.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.982+0000 7f75821ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757c0c00f0 con 0x7f757c0c77c0 2023-07-27T20:31:43.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.982+0000 7f75821ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757c14d690 con 0x7f757c151750 2023-07-27T20:31:43.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.982+0000 7f757b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f757c06ffc0 0x7f757c0acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:43.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.982+0000 7f757b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f757c06ffc0 0x7f757c0acd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50420/0 (socket says 172.21.15.72:50420) 2023-07-27T20:31:43.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.982+0000 7f757b7fe700 1 -- 172.21.15.72:0/949656796 learned_addr learned my addr 172.21.15.72:0/949656796 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:43.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.982+0000 7f757bfff700 1 --2- 172.21.15.72:0/949656796 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f757c151750 0x7f757c0c0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:43.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.982+0000 7f757affd700 1 --2- 172.21.15.72:0/949656796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f757c0c77c0 0x7f757c1533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:43.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.982+0000 7f757b7fe700 1 -- 172.21.15.72:0/949656796 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f757c151750 msgr2=0x7f757c0c0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:43.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.982+0000 7f757b7fe700 1 --2- 172.21.15.72:0/949656796 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f757c151750 0x7f757c0c0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:43.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.982+0000 7f757b7fe700 1 -- 172.21.15.72:0/949656796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f757c0c77c0 msgr2=0x7f757c1533f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:43.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.982+0000 7f757b7fe700 1 --2- 172.21.15.72:0/949656796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f757c0c77c0 0x7f757c1533f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:43.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.982+0000 7f757b7fe700 1 -- 172.21.15.72:0/949656796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f756c009550 con 0x7f757c06ffc0 2023-07-27T20:31:43.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.982+0000 7f757b7fe700 1 --2- 172.21.15.72:0/949656796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f757c06ffc0 0x7f757c0acd60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f756c000c00 tx=0x7f756c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:43.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.983+0000 7f7563fff700 1 -- 172.21.15.72:0/949656796 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c004480 con 0x7f757c06ffc0 2023-07-27T20:31:43.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.983+0000 7f7563fff700 1 -- 172.21.15.72:0/949656796 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756c01f070 con 0x7f757c06ffc0 2023-07-27T20:31:43.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.983+0000 7f75821ff700 1 -- 172.21.15.72:0/949656796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f757c0bfaa0 con 0x7f757c06ffc0 2023-07-27T20:31:43.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.983+0000 7f7563fff700 1 -- 172.21.15.72:0/949656796 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c0038e0 con 0x7f757c06ffc0 2023-07-27T20:31:43.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.983+0000 7f75821ff700 1 -- 172.21.15.72:0/949656796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f757c0aa4a0 con 0x7f757c06ffc0 2023-07-27T20:31:43.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.984+0000 7f75821ff700 1 -- 172.21.15.72:0/949656796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f755c0052f0 con 0x7f757c06ffc0 2023-07-27T20:31:43.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.985+0000 7f7563fff700 1 -- 172.21.15.72:0/949656796 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f756c021030 con 0x7f757c06ffc0 2023-07-27T20:31:43.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.986+0000 7f7563fff700 1 --2- 172.21.15.72:0/949656796 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f756806ad10 0x7f756806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:43.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.986+0000 7f7563fff700 1 -- 172.21.15.72:0/949656796 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f756c08aa70 con 0x7f757c06ffc0 2023-07-27T20:31:43.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.986+0000 7f757affd700 1 --2- 172.21.15.72:0/949656796 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f756806ad10 0x7f756806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:43.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.987+0000 7f757affd700 1 --2- 172.21.15.72:0/949656796 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f756806ad10 0x7f756806d1d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f757c0a9c40 tx=0x7f7570009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:43.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:43.990+0000 7f7563fff700 1 -- 172.21.15.72:0/949656796 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f756c055820 con 0x7f757c06ffc0 2023-07-27T20:31:44.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.188+0000 7f75821ff700 1 -- 172.21.15.72:0/949656796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f755c005b20 con 0x7f757c06ffc0 2023-07-27T20:31:44.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.188+0000 7f7563fff700 1 -- 172.21.15.72:0/949656796 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f756c058e40 con 0x7f757c06ffc0 2023-07-27T20:31:44.176 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:31:44.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.191+0000 7f75821ff700 1 -- 172.21.15.72:0/949656796 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f756806ad10 msgr2=0x7f756806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:44.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.191+0000 7f75821ff700 1 --2- 172.21.15.72:0/949656796 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f756806ad10 0x7f756806d1d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f757c0a9c40 tx=0x7f7570009040 comp rx=0 tx=0).stop 2023-07-27T20:31:44.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.191+0000 7f75821ff700 1 -- 172.21.15.72:0/949656796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f757c06ffc0 msgr2=0x7f757c0acd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:44.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.191+0000 7f75821ff700 1 --2- 172.21.15.72:0/949656796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f757c06ffc0 0x7f757c0acd60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f756c000c00 tx=0x7f756c004750 comp rx=0 tx=0).stop 2023-07-27T20:31:44.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.191+0000 7f75821ff700 1 -- 172.21.15.72:0/949656796 shutdown_connections 2023-07-27T20:31:44.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.191+0000 7f75821ff700 1 --2- 172.21.15.72:0/949656796 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f756806ad10 0x7f756806d1d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:44.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.191+0000 7f75821ff700 1 --2- 172.21.15.72:0/949656796 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f757c151750 0x7f757c0c0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:44.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.191+0000 7f75821ff700 1 --2- 172.21.15.72:0/949656796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f757c06ffc0 0x7f757c0acd60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:44.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.191+0000 7f75821ff700 1 --2- 172.21.15.72:0/949656796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f757c0c77c0 0x7f757c1533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:44.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.191+0000 7f75821ff700 1 -- 172.21.15.72:0/949656796 >> 172.21.15.72:0/949656796 conn(0x7f757c06a190 msgr2=0x7f757c0a7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:44.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.191+0000 7f75821ff700 1 -- 172.21.15.72:0/949656796 shutdown_connections 2023-07-27T20:31:44.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.191+0000 7f75821ff700 1 -- 172.21.15.72:0/949656796 wait complete. 2023-07-27T20:31:44.197 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-27T20:31:44.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.406+0000 7fccd7bff700 1 Processor -- start 2023-07-27T20:31:44.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.407+0000 7fccd7bff700 1 -- start start 2023-07-27T20:31:44.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.408+0000 7fccd7bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fccd006b150 0x7fccd00c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:44.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.408+0000 7fccd7bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccd006b710 con 0x7fccd00c4400 2023-07-27T20:31:44.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.408+0000 7fccd7bff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccd006b9f0 con 0x7fccd01549f0 2023-07-27T20:31:44.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.408+0000 7fccd7bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd01545d0 con 0x7fccd006b150 2023-07-27T20:31:44.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.408+0000 7fccd599b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fccd00c4400 0x7fccd00c4cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57990/0 (socket says 172.21.15.72:57990) 2023-07-27T20:31:44.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.408+0000 7fccd599b700 1 -- 172.21.15.72:0/853494490 learned_addr learned my addr 172.21.15.72:0/853494490 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:44.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.408+0000 7fccd519a700 1 --2- 172.21.15.72:0/853494490 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fccd006b150 0x7fccd00c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:44.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.408+0000 7fccd4999700 1 -- 172.21.15.72:0/853494490 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1371330758 0 0) 0x7fccd006b710 con 0x7fccd00c4400 2023-07-27T20:31:44.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.408+0000 7fccd4999700 1 -- 172.21.15.72:0/853494490 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccbc0035b0 con 0x7fccd00c4400 2023-07-27T20:31:44.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.408+0000 7fccd4999700 1 -- 172.21.15.72:0/853494490 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3741897541 0 0) 0x7fccd006b9f0 con 0x7fccd01549f0 2023-07-27T20:31:44.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.409+0000 7fccd4999700 1 -- 172.21.15.72:0/853494490 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccd006b710 con 0x7fccd01549f0 2023-07-27T20:31:44.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.409+0000 7fccd4999700 1 -- 172.21.15.72:0/853494490 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1431443652 0 0) 0x7fccbc0035b0 con 0x7fccd00c4400 2023-07-27T20:31:44.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.409+0000 7fccd519a700 1 -- 172.21.15.72:0/853494490 >> v1:172.21.15.173:6789/0 conn(0x7fccd01549f0 legacy=0x7fccd01514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:44.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.409+0000 7fccd519a700 1 -- 172.21.15.72:0/853494490 >> v1:172.21.15.72:6789/0 conn(0x7fccd00c4400 legacy=0x7fccd00c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:44.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.409+0000 7fccd519a700 1 -- 172.21.15.72:0/853494490 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd006bcd0 con 0x7fccd006b150 2023-07-27T20:31:44.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.409+0000 7fccd519a700 1 --2- 172.21.15.72:0/853494490 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fccd006b150 0x7fccd00c7710 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fccc0009870 tx=0x7fccc0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c37a963c3c591ea server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:44.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.409+0000 7fccd4999700 1 -- 172.21.15.72:0/853494490 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcccc001670 con 0x7fccd006b150 2023-07-27T20:31:44.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.409+0000 7fccd4999700 1 -- 172.21.15.72:0/853494490 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc0004030 con 0x7fccd006b150 2023-07-27T20:31:44.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.409+0000 7fccd4999700 1 -- 172.21.15.72:0/853494490 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc00043c0 con 0x7fccd006b150 2023-07-27T20:31:44.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.410+0000 7fccd7bff700 1 -- 172.21.15.72:0/853494490 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fccd006b150 msgr2=0x7fccd00c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:44.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.410+0000 7fccd7bff700 1 --2- 172.21.15.72:0/853494490 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fccd006b150 0x7fccd00c7710 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fccc0009870 tx=0x7fccc0009b80 comp rx=0 tx=0).stop 2023-07-27T20:31:44.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.410+0000 7fccd7bff700 1 -- 172.21.15.72:0/853494490 shutdown_connections 2023-07-27T20:31:44.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.410+0000 7fccd7bff700 1 --2- 172.21.15.72:0/853494490 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fccd006b150 0x7fccd00c7710 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:44.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.410+0000 7fccd7bff700 1 -- 172.21.15.72:0/853494490 >> 172.21.15.72:0/853494490 conn(0x7fccd00ab300 msgr2=0x7fccd00ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:44.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.410+0000 7fccd7bff700 1 -- 172.21.15.72:0/853494490 shutdown_connections 2023-07-27T20:31:44.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.410+0000 7fccd7bff700 1 -- 172.21.15.72:0/853494490 wait complete. 2023-07-27T20:31:44.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.412+0000 7fccd7bff700 1 Processor -- start 2023-07-27T20:31:44.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.412+0000 7fccd7bff700 1 -- start start 2023-07-27T20:31:44.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.413+0000 7fccd7bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fccd006b150 0x7fccd0149800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:44.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.413+0000 7fccd7bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccd00c4400 0x7fccd0149d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:44.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.413+0000 7fccd7bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccd01549f0 0x7fccd01ec870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:44.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.413+0000 7fccd7bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd00ae320 con 0x7fccd00c4400 2023-07-27T20:31:44.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.413+0000 7fccd7bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd00ac9b0 con 0x7fccd01549f0 2023-07-27T20:31:44.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.413+0000 7fccd7bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd00ab0e0 con 0x7fccd006b150 2023-07-27T20:31:44.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.413+0000 7fccd519a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccd00c4400 0x7fccd0149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:44.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.413+0000 7fccd519a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccd00c4400 0x7fccd0149d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50428/0 (socket says 172.21.15.72:50428) 2023-07-27T20:31:44.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.413+0000 7fccd519a700 1 -- 172.21.15.72:0/3333071462 learned_addr learned my addr 172.21.15.72:0/3333071462 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:44.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.413+0000 7fccd599b700 1 --2- 172.21.15.72:0/3333071462 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fccd006b150 0x7fccd0149800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:44.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.413+0000 7fccd619c700 1 --2- 172.21.15.72:0/3333071462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccd01549f0 0x7fccd01ec870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:44.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.413+0000 7fccd519a700 1 -- 172.21.15.72:0/3333071462 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fccd006b150 msgr2=0x7fccd0149800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:44.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.413+0000 7fccd519a700 1 --2- 172.21.15.72:0/3333071462 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fccd006b150 0x7fccd0149800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:44.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.413+0000 7fccd519a700 1 -- 172.21.15.72:0/3333071462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccd01549f0 msgr2=0x7fccd01ec870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:44.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.413+0000 7fccd519a700 1 --2- 172.21.15.72:0/3333071462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccd01549f0 0x7fccd01ec870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:44.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.413+0000 7fccd519a700 1 -- 172.21.15.72:0/3333071462 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc00094a0 con 0x7fccd00c4400 2023-07-27T20:31:44.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.414+0000 7fccd519a700 1 --2- 172.21.15.72:0/3333071462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccd00c4400 0x7fccd0149d40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fccc0000c00 tx=0x7fccc0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:44.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.414+0000 7fccc67fc700 1 -- 172.21.15.72:0/3333071462 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc0003e60 con 0x7fccd00c4400 2023-07-27T20:31:44.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.414+0000 7fccc67fc700 1 -- 172.21.15.72:0/3333071462 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc001f070 con 0x7fccd00c4400 2023-07-27T20:31:44.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.414+0000 7fccd7bff700 1 -- 172.21.15.72:0/3333071462 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccd00aa570 con 0x7fccd00c4400 2023-07-27T20:31:44.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.414+0000 7fccc67fc700 1 -- 172.21.15.72:0/3333071462 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc0011850 con 0x7fccd00c4400 2023-07-27T20:31:44.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.414+0000 7fccd7bff700 1 -- 172.21.15.72:0/3333071462 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccd00aab30 con 0x7fccd00c4400 2023-07-27T20:31:44.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.415+0000 7fccd7bff700 1 -- 172.21.15.72:0/3333071462 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd0074310 con 0x7fccd00c4400 2023-07-27T20:31:44.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.416+0000 7fccc67fc700 1 -- 172.21.15.72:0/3333071462 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fccc00119b0 con 0x7fccd00c4400 2023-07-27T20:31:44.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.417+0000 7fccc67fc700 1 --2- 172.21.15.72:0/3333071462 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fccb406ace0 0x7fccb406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:44.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.417+0000 7fccc67fc700 1 -- 172.21.15.72:0/3333071462 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fccc0021070 con 0x7fccd00c4400 2023-07-27T20:31:44.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.417+0000 7fccd599b700 1 --2- 172.21.15.72:0/3333071462 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fccb406ace0 0x7fccb406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:44.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.418+0000 7fccd599b700 1 --2- 172.21.15.72:0/3333071462 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fccb406ace0 0x7fccb406d1a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcccc001380 tx=0x7fcccc000f10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:44.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.421+0000 7fccc67fc700 1 -- 172.21.15.72:0/3333071462 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fccc0055ac0 con 0x7fccd00c4400 2023-07-27T20:31:44.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.630+0000 7fccd7bff700 1 -- 172.21.15.72:0/3333071462 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fccd00acaf0 con 0x7fccd00c4400 2023-07-27T20:31:44.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.630+0000 7fccc67fc700 1 -- 172.21.15.72:0/3333071462 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fccc002b080 con 0x7fccd00c4400 2023-07-27T20:31:44.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.633+0000 7fccd7bff700 1 -- 172.21.15.72:0/3333071462 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fccb406ace0 msgr2=0x7fccb406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:44.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.633+0000 7fccd7bff700 1 --2- 172.21.15.72:0/3333071462 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fccb406ace0 0x7fccb406d1a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcccc001380 tx=0x7fcccc000f10 comp rx=0 tx=0).stop 2023-07-27T20:31:44.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.633+0000 7fccd7bff700 1 -- 172.21.15.72:0/3333071462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccd00c4400 msgr2=0x7fccd0149d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:44.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.633+0000 7fccd7bff700 1 --2- 172.21.15.72:0/3333071462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccd00c4400 0x7fccd0149d40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fccc0000c00 tx=0x7fccc0004750 comp rx=0 tx=0).stop 2023-07-27T20:31:44.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.633+0000 7fccd7bff700 1 -- 172.21.15.72:0/3333071462 shutdown_connections 2023-07-27T20:31:44.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.633+0000 7fccd7bff700 1 --2- 172.21.15.72:0/3333071462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccd01549f0 0x7fccd01ec870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:44.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.633+0000 7fccd7bff700 1 --2- 172.21.15.72:0/3333071462 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fccb406ace0 0x7fccb406d1a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:44.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.633+0000 7fccd7bff700 1 --2- 172.21.15.72:0/3333071462 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fccd006b150 0x7fccd0149800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:44.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.633+0000 7fccd7bff700 1 --2- 172.21.15.72:0/3333071462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccd00c4400 0x7fccd0149d40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:44.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.633+0000 7fccd7bff700 1 -- 172.21.15.72:0/3333071462 >> 172.21.15.72:0/3333071462 conn(0x7fccd00ab300 msgr2=0x7fccd0151ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:44.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.633+0000 7fccd7bff700 1 -- 172.21.15.72:0/3333071462 shutdown_connections 2023-07-27T20:31:44.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.633+0000 7fccd7bff700 1 -- 172.21.15.72:0/3333071462 wait complete. 2023-07-27T20:31:44.628 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-07-27T20:31:44.640 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-27T20:31:44.642 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-27T20:31:44.695 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:31:44.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.945+0000 7fb5e1fff700 1 Processor -- start 2023-07-27T20:31:44.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.945+0000 7fb5e1fff700 1 -- start start 2023-07-27T20:31:44.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.946+0000 7fb5e1fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb5dc06b150 0x7fb5dc0c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:44.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.946+0000 7fb5e1fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5dc06b710 con 0x7fb5dc1549f0 2023-07-27T20:31:44.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.946+0000 7fb5e1fff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5dc06b9f0 con 0x7fb5dc0c4400 2023-07-27T20:31:44.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.946+0000 7fb5e1fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5dc1545d0 con 0x7fb5dc06b150 2023-07-27T20:31:44.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.946+0000 7fb5daffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb5dc06b150 0x7fb5dc0c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:44.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.946+0000 7fb5dbfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb5dc1549f0 0x7fb5dc1514a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58004/0 (socket says 172.21.15.72:58004) 2023-07-27T20:31:44.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.946+0000 7fb5daffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb5dc06b150 0x7fb5dc0c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50438/0 (socket says 172.21.15.72:50438) 2023-07-27T20:31:44.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.947+0000 7fb5dbfff700 1 -- 172.21.15.72:0/2201588673 learned_addr learned my addr 172.21.15.72:0/2201588673 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:44.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.947+0000 7fb5daffd700 1 -- 172.21.15.72:0/2201588673 >> v1:172.21.15.173:6789/0 conn(0x7fb5dc0c4400 legacy=0x7fb5dc0c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:44.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.947+0000 7fb5daffd700 1 -- 172.21.15.72:0/2201588673 >> v1:172.21.15.72:6789/0 conn(0x7fb5dc1549f0 legacy=0x7fb5dc1514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:44.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.947+0000 7fb5daffd700 1 -- 172.21.15.72:0/2201588673 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5dc06bcd0 con 0x7fb5dc06b150 2023-07-27T20:31:44.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.947+0000 7fb5daffd700 1 --2- 172.21.15.72:0/2201588673 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5dc06b150 0x7fb5dc0c7710 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0009840 tx=0x7fb5d0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f11f7d27d0296f08 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:44.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.947+0000 7fb5da7fc700 1 -- 172.21.15.72:0/2201588673 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d0004230 con 0x7fb5dc06b150 2023-07-27T20:31:44.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.947+0000 7fb5da7fc700 1 -- 172.21.15.72:0/2201588673 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d0004390 con 0x7fb5dc06b150 2023-07-27T20:31:44.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.947+0000 7fb5da7fc700 1 -- 172.21.15.72:0/2201588673 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d00036a0 con 0x7fb5dc06b150 2023-07-27T20:31:44.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.948+0000 7fb5e1fff700 1 -- 172.21.15.72:0/2201588673 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5dc06b150 msgr2=0x7fb5dc0c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:44.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.948+0000 7fb5e1fff700 1 --2- 172.21.15.72:0/2201588673 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5dc06b150 0x7fb5dc0c7710 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0009840 tx=0x7fb5d0009b50 comp rx=0 tx=0).stop 2023-07-27T20:31:44.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.948+0000 7fb5e1fff700 1 -- 172.21.15.72:0/2201588673 shutdown_connections 2023-07-27T20:31:44.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.948+0000 7fb5e1fff700 1 --2- 172.21.15.72:0/2201588673 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5dc06b150 0x7fb5dc0c7710 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:44.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.948+0000 7fb5e1fff700 1 -- 172.21.15.72:0/2201588673 >> 172.21.15.72:0/2201588673 conn(0x7fb5dc0ab300 msgr2=0x7fb5dc0ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:44.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.948+0000 7fb5e1fff700 1 -- 172.21.15.72:0/2201588673 shutdown_connections 2023-07-27T20:31:44.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.948+0000 7fb5e1fff700 1 -- 172.21.15.72:0/2201588673 wait complete. 2023-07-27T20:31:44.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.950+0000 7fb5e1fff700 1 Processor -- start 2023-07-27T20:31:44.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.950+0000 7fb5e1fff700 1 -- start start 2023-07-27T20:31:44.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.951+0000 7fb5e1fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb5dc06b150 0x7fb5dc0aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:44.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.951+0000 7fb5e1fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5dc0c4400 0x7fb5dc14c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:44.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.951+0000 7fb5e1fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5dc1549f0 0x7fb5dc14c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:44.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.951+0000 7fb5e1fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc14bdc0 con 0x7fb5dc1549f0 2023-07-27T20:31:44.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.951+0000 7fb5e1fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc14d160 con 0x7fb5dc0c4400 2023-07-27T20:31:44.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.951+0000 7fb5e1fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc0c34d0 con 0x7fb5dc06b150 2023-07-27T20:31:44.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.951+0000 7fb5dbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5dc1549f0 0x7fb5dc14c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:44.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.951+0000 7fb5dbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5dc1549f0 0x7fb5dc14c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50442/0 (socket says 172.21.15.72:50442) 2023-07-27T20:31:44.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.951+0000 7fb5dbfff700 1 -- 172.21.15.72:0/76300451 learned_addr learned my addr 172.21.15.72:0/76300451 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:44.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.951+0000 7fb5daffd700 1 --2- 172.21.15.72:0/76300451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5dc0c4400 0x7fb5dc14c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:44.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.951+0000 7fb5db7fe700 1 --2- 172.21.15.72:0/76300451 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb5dc06b150 0x7fb5dc0aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:44.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.951+0000 7fb5dbfff700 1 -- 172.21.15.72:0/76300451 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb5dc06b150 msgr2=0x7fb5dc0aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:44.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.951+0000 7fb5dbfff700 1 --2- 172.21.15.72:0/76300451 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb5dc06b150 0x7fb5dc0aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:44.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.951+0000 7fb5dbfff700 1 -- 172.21.15.72:0/76300451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5dc0c4400 msgr2=0x7fb5dc14c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:44.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.951+0000 7fb5dbfff700 1 --2- 172.21.15.72:0/76300451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5dc0c4400 0x7fb5dc14c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:44.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.951+0000 7fb5dbfff700 1 -- 172.21.15.72:0/76300451 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d00094a0 con 0x7fb5dc1549f0 2023-07-27T20:31:44.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.951+0000 7fb5db7fe700 1 --2- 172.21.15.72:0/76300451 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb5dc06b150 0x7fb5dc0aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:31:44.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.952+0000 7fb5dbfff700 1 --2- 172.21.15.72:0/76300451 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5dc1549f0 0x7fb5dc14c790 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb5d400cbc0 tx=0x7fb5d400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:44.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.952+0000 7fb5c3fff700 1 -- 172.21.15.72:0/76300451 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d400aaa0 con 0x7fb5dc1549f0 2023-07-27T20:31:44.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.952+0000 7fb5c3fff700 1 -- 172.21.15.72:0/76300451 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d400ac00 con 0x7fb5dc1549f0 2023-07-27T20:31:44.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.952+0000 7fb5e1fff700 1 -- 172.21.15.72:0/76300451 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5dc0c37b0 con 0x7fb5dc1549f0 2023-07-27T20:31:44.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.952+0000 7fb5c3fff700 1 -- 172.21.15.72:0/76300451 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4012400 con 0x7fb5dc1549f0 2023-07-27T20:31:44.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.952+0000 7fb5e1fff700 1 -- 172.21.15.72:0/76300451 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5dc14ba50 con 0x7fb5dc1549f0 2023-07-27T20:31:44.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.953+0000 7fb5e1fff700 1 -- 172.21.15.72:0/76300451 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5dc14bf70 con 0x7fb5dc1549f0 2023-07-27T20:31:44.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.954+0000 7fb5c3fff700 1 -- 172.21.15.72:0/76300451 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb5d401b3b0 con 0x7fb5dc1549f0 2023-07-27T20:31:44.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.955+0000 7fb5c3fff700 1 --2- 172.21.15.72:0/76300451 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb5c806ace0 0x7fb5c806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:44.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.955+0000 7fb5c3fff700 1 -- 172.21.15.72:0/76300451 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb5d4089410 con 0x7fb5dc1549f0 2023-07-27T20:31:44.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.955+0000 7fb5db7fe700 1 --2- 172.21.15.72:0/76300451 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb5c806ace0 0x7fb5c806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:44.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.956+0000 7fb5db7fe700 1 --2- 172.21.15.72:0/76300451 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb5c806ace0 0x7fb5c806d1a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc003fc0 tx=0x7fb5cc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:44.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:44.959+0000 7fb5c3fff700 1 -- 172.21.15.72:0/76300451 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb5dc14bf70 con 0x7fb5dc1549f0 2023-07-27T20:31:45.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.159+0000 7fb5e1fff700 1 -- 172.21.15.72:0/76300451 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5dc14bf70 con 0x7fb5dc1549f0 2023-07-27T20:31:45.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.160+0000 7fb5c3fff700 1 -- 172.21.15.72:0/76300451 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20120 (secure 0 0 0) 0x7fb5dc14bf70 con 0x7fb5dc1549f0 2023-07-27T20:31:45.148 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:31:45.148 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:31:33.647304+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:31:27.020951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T20:31:27.566022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-27T20:31:31.182401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:31:45.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.162+0000 7fb5e1fff700 1 -- 172.21.15.72:0/76300451 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb5c806ace0 msgr2=0x7fb5c806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:45.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.162+0000 7fb5e1fff700 1 --2- 172.21.15.72:0/76300451 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb5c806ace0 0x7fb5c806d1a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc003fc0 tx=0x7fb5cc009040 comp rx=0 tx=0).stop 2023-07-27T20:31:45.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.162+0000 7fb5e1fff700 1 -- 172.21.15.72:0/76300451 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5dc1549f0 msgr2=0x7fb5dc14c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:45.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.162+0000 7fb5e1fff700 1 --2- 172.21.15.72:0/76300451 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5dc1549f0 0x7fb5dc14c790 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb5d400cbc0 tx=0x7fb5d400ced0 comp rx=0 tx=0).stop 2023-07-27T20:31:45.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.162+0000 7fb5e1fff700 1 -- 172.21.15.72:0/76300451 shutdown_connections 2023-07-27T20:31:45.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.162+0000 7fb5e1fff700 1 --2- 172.21.15.72:0/76300451 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5dc1549f0 0x7fb5dc14c790 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:45.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.162+0000 7fb5e1fff700 1 --2- 172.21.15.72:0/76300451 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb5c806ace0 0x7fb5c806d1a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:45.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.162+0000 7fb5e1fff700 1 --2- 172.21.15.72:0/76300451 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb5dc06b150 0x7fb5dc0aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:45.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.162+0000 7fb5e1fff700 1 --2- 172.21.15.72:0/76300451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5dc0c4400 0x7fb5dc14c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:45.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.162+0000 7fb5e1fff700 1 -- 172.21.15.72:0/76300451 >> 172.21.15.72:0/76300451 conn(0x7fb5dc0ab300 msgr2=0x7fb5dc152940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:45.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.163+0000 7fb5e1fff700 1 -- 172.21.15.72:0/76300451 shutdown_connections 2023-07-27T20:31:45.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.163+0000 7fb5e1fff700 1 -- 172.21.15.72:0/76300451 wait complete. 2023-07-27T20:31:45.168 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-27T20:31:14.581785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T20:31:21.077941+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T20:31:27.020951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T20:31:27.566022+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-27T20:31:31.182401+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-27T20:31:45.169 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-27T20:31:45.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.382+0000 7f51debff700 1 Processor -- start 2023-07-27T20:31:45.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.382+0000 7f51debff700 1 -- start start 2023-07-27T20:31:45.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.383+0000 7f51debff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f51d81475a0 0x7f51d81516c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:45.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.383+0000 7f51debff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f51d80c12f0 0x7f51d80c1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:45.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.383+0000 7f51debff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51d8154f50 con 0x7f51d80c2240 2023-07-27T20:31:45.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.383+0000 7f51debff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51d8151c00 con 0x7f51d81475a0 2023-07-27T20:31:45.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.383+0000 7f51debff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d8154340 con 0x7f51d80c12f0 2023-07-27T20:31:45.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.384+0000 7f51dc99b700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f51d81475a0 0x7f51d81516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:45.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.384+0000 7f51d7fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f51d80c12f0 0x7f51d80c1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:45.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.384+0000 7f51d7fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f51d80c12f0 0x7f51d80c1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.72:44446/0 (socket says 172.21.15.72:44446) 2023-07-27T20:31:45.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.384+0000 7f51d7fff700 1 -- 172.21.15.72:0/138351434 learned_addr learned my addr 172.21.15.72:0/138351434 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:45.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.384+0000 7f51d7fff700 1 -- 172.21.15.72:0/138351434 >> v2:172.21.15.173:3300/0 conn(0x7f51d81475a0 msgr2=0x7f51d81516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:45.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.384+0000 7f51d7fff700 1 --2- 172.21.15.72:0/138351434 >> v2:172.21.15.173:3300/0 conn(0x7f51d81475a0 0x7f51d81516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:45.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.384+0000 7f51d7fff700 1 -- 172.21.15.72:0/138351434 >> v1:172.21.15.173:6789/0 conn(0x7f51d80c2240 legacy=0x7f51d80716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:45.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.384+0000 7f51d7fff700 1 -- 172.21.15.72:0/138351434 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d8154620 con 0x7f51d80c12f0 2023-07-27T20:31:45.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.385+0000 7f51d7fff700 1 --2- 172.21.15.72:0/138351434 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f51d80c12f0 0x7f51d80c1d00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f51c40098f0 tx=0x7f51c4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1b8748762f61b38 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:45.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.385+0000 7f51d77fe700 1 -- 172.21.15.72:0/138351434 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c4011830 con 0x7f51d80c12f0 2023-07-27T20:31:45.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.385+0000 7f51d77fe700 1 -- 172.21.15.72:0/138351434 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c4011990 con 0x7f51d80c12f0 2023-07-27T20:31:45.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.385+0000 7f51d77fe700 1 -- 172.21.15.72:0/138351434 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c4011d20 con 0x7f51d80c12f0 2023-07-27T20:31:45.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.385+0000 7f51debff700 1 -- 172.21.15.72:0/138351434 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f51d80c12f0 msgr2=0x7f51d80c1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:45.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.385+0000 7f51debff700 1 --2- 172.21.15.72:0/138351434 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f51d80c12f0 0x7f51d80c1d00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f51c40098f0 tx=0x7f51c4009c00 comp rx=0 tx=0).stop 2023-07-27T20:31:45.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.385+0000 7f51debff700 1 -- 172.21.15.72:0/138351434 shutdown_connections 2023-07-27T20:31:45.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.385+0000 7f51debff700 1 --2- 172.21.15.72:0/138351434 >> v2:172.21.15.173:3300/0 conn(0x7f51d81475a0 0x7f51d81516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:45.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.385+0000 7f51debff700 1 --2- 172.21.15.72:0/138351434 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f51d80c12f0 0x7f51d80c1d00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:45.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.385+0000 7f51debff700 1 -- 172.21.15.72:0/138351434 >> 172.21.15.72:0/138351434 conn(0x7f51d806a190 msgr2=0x7f51d806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:45.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.385+0000 7f51debff700 1 -- 172.21.15.72:0/138351434 shutdown_connections 2023-07-27T20:31:45.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.386+0000 7f51debff700 1 -- 172.21.15.72:0/138351434 wait complete. 2023-07-27T20:31:45.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.387+0000 7f51debff700 1 Processor -- start 2023-07-27T20:31:45.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.387+0000 7f51debff700 1 -- start start 2023-07-27T20:31:45.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.388+0000 7f51debff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f51d80c12f0 0x7f51d81ea4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:45.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.388+0000 7f51debff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51d80c2240 0x7f51d80bb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:45.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.388+0000 7f51debff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51d81475a0 0x7f51d8152030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:45.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.388+0000 7f51debff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d81eaa30 con 0x7f51d81475a0 2023-07-27T20:31:45.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.388+0000 7f51debff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d81e9a70 con 0x7f51d80c2240 2023-07-27T20:31:45.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.388+0000 7f51debff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d81539b0 con 0x7f51d80c12f0 2023-07-27T20:31:45.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.389+0000 7f51dd19c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51d81475a0 0x7f51d8152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:45.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.389+0000 7f51dd19c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51d81475a0 0x7f51d8152030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50448/0 (socket says 172.21.15.72:50448) 2023-07-27T20:31:45.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.389+0000 7f51dd19c700 1 -- 172.21.15.72:0/2904480720 learned_addr learned my addr 172.21.15.72:0/2904480720 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:45.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.389+0000 7f51dc99b700 1 --2- 172.21.15.72:0/2904480720 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f51d80c12f0 0x7f51d81ea4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:45.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.389+0000 7f51d7fff700 1 --2- 172.21.15.72:0/2904480720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51d80c2240 0x7f51d80bb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:45.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.389+0000 7f51dd19c700 1 -- 172.21.15.72:0/2904480720 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f51d80c12f0 msgr2=0x7f51d81ea4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:45.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.389+0000 7f51dd19c700 1 --2- 172.21.15.72:0/2904480720 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f51d80c12f0 0x7f51d81ea4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:45.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.389+0000 7f51dd19c700 1 -- 172.21.15.72:0/2904480720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51d80c2240 msgr2=0x7f51d80bb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:45.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.389+0000 7f51dd19c700 1 --2- 172.21.15.72:0/2904480720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51d80c2240 0x7f51d80bb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:45.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.389+0000 7f51dd19c700 1 -- 172.21.15.72:0/2904480720 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c4009550 con 0x7f51d81475a0 2023-07-27T20:31:45.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.389+0000 7f51dd19c700 1 --2- 172.21.15.72:0/2904480720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51d81475a0 0x7f51d8152030 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f51d000cb50 tx=0x7f51d000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:45.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.389+0000 7f51d57fa700 1 -- 172.21.15.72:0/2904480720 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d0003c00 con 0x7f51d81475a0 2023-07-27T20:31:45.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.389+0000 7f51d57fa700 1 -- 172.21.15.72:0/2904480720 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d0003d60 con 0x7f51d81475a0 2023-07-27T20:31:45.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.389+0000 7f51d57fa700 1 -- 172.21.15.72:0/2904480720 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d000aa20 con 0x7f51d81475a0 2023-07-27T20:31:45.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.389+0000 7f51debff700 1 -- 172.21.15.72:0/2904480720 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51d8153c90 con 0x7f51d81475a0 2023-07-27T20:31:45.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.390+0000 7f51debff700 1 -- 172.21.15.72:0/2904480720 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51d81e9fd0 con 0x7f51d81475a0 2023-07-27T20:31:45.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.391+0000 7f51debff700 1 -- 172.21.15.72:0/2904480720 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51d804e470 con 0x7f51d81475a0 2023-07-27T20:31:45.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.391+0000 7f51d57fa700 1 -- 172.21.15.72:0/2904480720 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f51d000ab80 con 0x7f51d81475a0 2023-07-27T20:31:45.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.393+0000 7f51d57fa700 1 --2- 172.21.15.72:0/2904480720 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f51bc06ace0 0x7f51bc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:45.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.393+0000 7f51d57fa700 1 -- 172.21.15.72:0/2904480720 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f51d0089790 con 0x7f51d81475a0 2023-07-27T20:31:45.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.393+0000 7f51dc99b700 1 --2- 172.21.15.72:0/2904480720 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f51bc06ace0 0x7f51bc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:45.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.394+0000 7f51dc99b700 1 --2- 172.21.15.72:0/2904480720 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f51bc06ace0 0x7f51bc06d1a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f51cc009b40 tx=0x7f51cc009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:45.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.396+0000 7f51d57fa700 1 -- 172.21.15.72:0/2904480720 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f51d0054540 con 0x7f51d81475a0 2023-07-27T20:31:45.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.590+0000 7f51debff700 1 -- 172.21.15.72:0/2904480720 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f51d80c10d0 con 0x7f51d81475a0 2023-07-27T20:31:45.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.591+0000 7f51d57fa700 1 -- 172.21.15.72:0/2904480720 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f51d0057b60 con 0x7f51d81475a0 2023-07-27T20:31:45.578 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-27T20:31:45.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.593+0000 7f51debff700 1 -- 172.21.15.72:0/2904480720 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f51bc06ace0 msgr2=0x7f51bc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:45.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.593+0000 7f51debff700 1 --2- 172.21.15.72:0/2904480720 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f51bc06ace0 0x7f51bc06d1a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f51cc009b40 tx=0x7f51cc009210 comp rx=0 tx=0).stop 2023-07-27T20:31:45.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.593+0000 7f51debff700 1 -- 172.21.15.72:0/2904480720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51d81475a0 msgr2=0x7f51d8152030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:45.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.593+0000 7f51debff700 1 --2- 172.21.15.72:0/2904480720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51d81475a0 0x7f51d8152030 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f51d000cb50 tx=0x7f51d000ce60 comp rx=0 tx=0).stop 2023-07-27T20:31:45.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.593+0000 7f51debff700 1 -- 172.21.15.72:0/2904480720 shutdown_connections 2023-07-27T20:31:45.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.593+0000 7f51debff700 1 --2- 172.21.15.72:0/2904480720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51d81475a0 0x7f51d8152030 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:45.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.593+0000 7f51debff700 1 --2- 172.21.15.72:0/2904480720 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f51bc06ace0 0x7f51bc06d1a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:45.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.593+0000 7f51debff700 1 --2- 172.21.15.72:0/2904480720 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f51d80c12f0 0x7f51d81ea4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:45.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.593+0000 7f51debff700 1 --2- 172.21.15.72:0/2904480720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51d80c2240 0x7f51d80bb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:45.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.593+0000 7f51debff700 1 -- 172.21.15.72:0/2904480720 >> 172.21.15.72:0/2904480720 conn(0x7f51d806a190 msgr2=0x7f51d80c1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:45.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.593+0000 7f51debff700 1 -- 172.21.15.72:0/2904480720 shutdown_connections 2023-07-27T20:31:45.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.593+0000 7f51debff700 1 -- 172.21.15.72:0/2904480720 wait complete. 2023-07-27T20:31:45.598 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T20:31:45.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.810+0000 7ff40c5ff700 1 Processor -- start 2023-07-27T20:31:45.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.810+0000 7ff40c5ff700 1 -- start start 2023-07-27T20:31:45.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.812+0000 7ff40c5ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff40414aab0 0x7ff404154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:45.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.812+0000 7ff40c5ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff4040c7740 0x7ff4040c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:45.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.812+0000 7ff40c5ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4040c7c50 con 0x7ff4040c4700 2023-07-27T20:31:45.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.812+0000 7ff40c5ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff40406bd40 con 0x7ff40414aab0 2023-07-27T20:31:45.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.812+0000 7ff40c5ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4040c62f0 con 0x7ff4040c7740 2023-07-27T20:31:45.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.812+0000 7ff40a39b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff40414aab0 0x7ff404154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:45.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.812+0000 7ff40ab9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff4040c4700 0x7ff40406c1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58020/0 (socket says 172.21.15.72:58020) 2023-07-27T20:31:45.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.812+0000 7ff40ab9c700 1 -- 172.21.15.72:0/4138834428 learned_addr learned my addr 172.21.15.72:0/4138834428 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:45.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.812+0000 7ff409b9a700 1 --2- 172.21.15.72:0/4138834428 >> v2:172.21.15.173:3300/0 conn(0x7ff4040c7740 0x7ff4040c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:45.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.812+0000 7ff40a39b700 1 -- 172.21.15.72:0/4138834428 >> v2:172.21.15.173:3300/0 conn(0x7ff4040c7740 msgr2=0x7ff4040c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:45.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.812+0000 7ff40a39b700 1 --2- 172.21.15.72:0/4138834428 >> v2:172.21.15.173:3300/0 conn(0x7ff4040c7740 0x7ff4040c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:45.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.812+0000 7ff40a39b700 1 -- 172.21.15.72:0/4138834428 >> v1:172.21.15.72:6789/0 conn(0x7ff4040c4700 legacy=0x7ff40406c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:45.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.812+0000 7ff40a39b700 1 -- 172.21.15.72:0/4138834428 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff404155050 con 0x7ff40414aab0 2023-07-27T20:31:45.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.812+0000 7ff409399700 1 -- 172.21.15.72:0/4138834428 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2186041516 0 0) 0x7ff4040c7c50 con 0x7ff4040c4700 2023-07-27T20:31:45.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.813+0000 7ff40a39b700 1 --2- 172.21.15.72:0/4138834428 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff40414aab0 0x7ff404154b10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff4040a9090 tx=0x7ff400009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c4e4b989f523873 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:45.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.813+0000 7ff409399700 1 -- 172.21.15.72:0/4138834428 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff400011830 con 0x7ff40414aab0 2023-07-27T20:31:45.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.813+0000 7ff409399700 1 -- 172.21.15.72:0/4138834428 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff400011990 con 0x7ff40414aab0 2023-07-27T20:31:45.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.813+0000 7ff409399700 1 -- 172.21.15.72:0/4138834428 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff400011d20 con 0x7ff40414aab0 2023-07-27T20:31:45.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.813+0000 7ff40c5ff700 1 -- 172.21.15.72:0/4138834428 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff40414aab0 msgr2=0x7ff404154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:45.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.813+0000 7ff40c5ff700 1 --2- 172.21.15.72:0/4138834428 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff40414aab0 0x7ff404154b10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff4040a9090 tx=0x7ff400009b20 comp rx=0 tx=0).stop 2023-07-27T20:31:45.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.814+0000 7ff40c5ff700 1 -- 172.21.15.72:0/4138834428 shutdown_connections 2023-07-27T20:31:45.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.814+0000 7ff40c5ff700 1 --2- 172.21.15.72:0/4138834428 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff40414aab0 0x7ff404154b10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:45.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.814+0000 7ff40c5ff700 1 --2- 172.21.15.72:0/4138834428 >> v2:172.21.15.173:3300/0 conn(0x7ff4040c7740 0x7ff4040c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:45.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.814+0000 7ff40c5ff700 1 -- 172.21.15.72:0/4138834428 >> 172.21.15.72:0/4138834428 conn(0x7ff4040ab3f0 msgr2=0x7ff4040ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:45.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.814+0000 7ff40c5ff700 1 -- 172.21.15.72:0/4138834428 shutdown_connections 2023-07-27T20:31:45.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.814+0000 7ff40c5ff700 1 -- 172.21.15.72:0/4138834428 wait complete. 2023-07-27T20:31:45.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.815+0000 7ff40c5ff700 1 Processor -- start 2023-07-27T20:31:45.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.815+0000 7ff40c5ff700 1 -- start start 2023-07-27T20:31:45.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.816+0000 7ff40c5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4040c4700 0x7ff404150140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:45.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.816+0000 7ff40c5ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4040c7740 0x7ff4041ea340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:45.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.816+0000 7ff40c5ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff40414aab0 0x7ff404149a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:45.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.816+0000 7ff40c5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40414f730 con 0x7ff4040c4700 2023-07-27T20:31:45.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.816+0000 7ff40c5ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff404150680 con 0x7ff4040c7740 2023-07-27T20:31:45.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.816+0000 7ff40c5ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4041ea880 con 0x7ff40414aab0 2023-07-27T20:31:45.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.816+0000 7ff40a39b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4040c4700 0x7ff404150140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:45.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.817+0000 7ff40a39b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4040c4700 0x7ff404150140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50472/0 (socket says 172.21.15.72:50472) 2023-07-27T20:31:45.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.817+0000 7ff40a39b700 1 -- 172.21.15.72:0/984438216 learned_addr learned my addr 172.21.15.72:0/984438216 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:45.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.817+0000 7ff409b9a700 1 --2- 172.21.15.72:0/984438216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4040c7740 0x7ff4041ea340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:45.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.817+0000 7ff40ab9c700 1 --2- 172.21.15.72:0/984438216 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff40414aab0 0x7ff404149a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:45.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.817+0000 7ff40a39b700 1 -- 172.21.15.72:0/984438216 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff40414aab0 msgr2=0x7ff404149a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:45.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.817+0000 7ff40a39b700 1 --2- 172.21.15.72:0/984438216 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff40414aab0 0x7ff404149a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:45.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.817+0000 7ff40a39b700 1 -- 172.21.15.72:0/984438216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4040c7740 msgr2=0x7ff4041ea340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:45.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.817+0000 7ff40a39b700 1 --2- 172.21.15.72:0/984438216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4040c7740 0x7ff4041ea340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:45.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.817+0000 7ff40a39b700 1 -- 172.21.15.72:0/984438216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4000094a0 con 0x7ff4040c4700 2023-07-27T20:31:45.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.817+0000 7ff40a39b700 1 --2- 172.21.15.72:0/984438216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4040c4700 0x7ff404150140 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff400014040 tx=0x7ff400004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:45.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.817+0000 7ff3faffd700 1 -- 172.21.15.72:0/984438216 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4000036a0 con 0x7ff4040c4700 2023-07-27T20:31:45.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.817+0000 7ff3faffd700 1 -- 172.21.15.72:0/984438216 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40001e070 con 0x7ff4040c4700 2023-07-27T20:31:45.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.817+0000 7ff40c5ff700 1 -- 172.21.15.72:0/984438216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff404151540 con 0x7ff4040c4700 2023-07-27T20:31:45.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.818+0000 7ff3faffd700 1 -- 172.21.15.72:0/984438216 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff400003a60 con 0x7ff4040c4700 2023-07-27T20:31:45.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.818+0000 7ff40c5ff700 1 -- 172.21.15.72:0/984438216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff40414f940 con 0x7ff4040c4700 2023-07-27T20:31:45.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.819+0000 7ff40c5ff700 1 -- 172.21.15.72:0/984438216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff40404e470 con 0x7ff4040c4700 2023-07-27T20:31:45.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.820+0000 7ff3faffd700 1 -- 172.21.15.72:0/984438216 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff400003bc0 con 0x7ff4040c4700 2023-07-27T20:31:45.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.820+0000 7ff3faffd700 1 --2- 172.21.15.72:0/984438216 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff3e806ace0 0x7ff3e806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:45.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.820+0000 7ff3faffd700 1 -- 172.21.15.72:0/984438216 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff40008a640 con 0x7ff4040c4700 2023-07-27T20:31:45.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.821+0000 7ff409b9a700 1 --2- 172.21.15.72:0/984438216 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff3e806ace0 0x7ff3e806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:45.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.822+0000 7ff409b9a700 1 --2- 172.21.15.72:0/984438216 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff3e806ace0 0x7ff3e806d1a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff404154160 tx=0x7ff3f4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:45.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:45.824+0000 7ff3faffd700 1 -- 172.21.15.72:0/984438216 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff400055490 con 0x7ff4040c4700 2023-07-27T20:31:46.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.021+0000 7ff40c5ff700 1 -- 172.21.15.72:0/984438216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff40406cf00 con 0x7ff4040c4700 2023-07-27T20:31:46.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.021+0000 7ff3faffd700 1 -- 172.21.15.72:0/984438216 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff400058ab0 con 0x7ff4040c4700 2023-07-27T20:31:46.009 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-27T20:31:46.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.024+0000 7ff40c5ff700 1 -- 172.21.15.72:0/984438216 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff3e806ace0 msgr2=0x7ff3e806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:46.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.024+0000 7ff40c5ff700 1 --2- 172.21.15.72:0/984438216 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff3e806ace0 0x7ff3e806d1a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff404154160 tx=0x7ff3f4008040 comp rx=0 tx=0).stop 2023-07-27T20:31:46.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.024+0000 7ff40c5ff700 1 -- 172.21.15.72:0/984438216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4040c4700 msgr2=0x7ff404150140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:46.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.024+0000 7ff40c5ff700 1 --2- 172.21.15.72:0/984438216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4040c4700 0x7ff404150140 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff400014040 tx=0x7ff400004750 comp rx=0 tx=0).stop 2023-07-27T20:31:46.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.024+0000 7ff40c5ff700 1 -- 172.21.15.72:0/984438216 shutdown_connections 2023-07-27T20:31:46.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.024+0000 7ff40c5ff700 1 --2- 172.21.15.72:0/984438216 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff3e806ace0 0x7ff3e806d1a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:46.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.024+0000 7ff40c5ff700 1 --2- 172.21.15.72:0/984438216 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff40414aab0 0x7ff404149a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:46.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.024+0000 7ff40c5ff700 1 --2- 172.21.15.72:0/984438216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4040c4700 0x7ff404150140 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:46.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.024+0000 7ff40c5ff700 1 --2- 172.21.15.72:0/984438216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4040c7740 0x7ff4041ea340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:46.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.024+0000 7ff40c5ff700 1 -- 172.21.15.72:0/984438216 >> 172.21.15.72:0/984438216 conn(0x7ff4040ab3f0 msgr2=0x7ff404151bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:46.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.024+0000 7ff40c5ff700 1 -- 172.21.15.72:0/984438216 shutdown_connections 2023-07-27T20:31:46.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.024+0000 7ff40c5ff700 1 -- 172.21.15.72:0/984438216 wait complete. 2023-07-27T20:31:46.030 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T20:31:46.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.245+0000 7f3c059ff700 1 Processor -- start 2023-07-27T20:31:46.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.245+0000 7f3c059ff700 1 -- start start 2023-07-27T20:31:46.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.246+0000 7f3c059ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3c000c7740 0x7f3c000c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:46.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.246+0000 7f3c059ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3c000c4700 0x7f3c0006c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:46.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.246+0000 7f3c059ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c000c7c50 con 0x7f3c0014aab0 2023-07-27T20:31:46.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.246+0000 7f3c059ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c0006bd40 con 0x7f3c000c7740 2023-07-27T20:31:46.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.246+0000 7f3c059ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c000c62f0 con 0x7f3c000c4700 2023-07-27T20:31:46.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.246+0000 7f3bfe7fc700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3c000c7740 0x7f3c000c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:46.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.247+0000 7f3bff7fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3c000c4700 0x7f3c0006c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:46.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.247+0000 7f3bfe7fc700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3c000c7740 0x7f3c000c41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.72:43600/0 (socket says 172.21.15.72:43600) 2023-07-27T20:31:46.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.247+0000 7f3bfe7fc700 1 -- 172.21.15.72:0/785473679 learned_addr learned my addr 172.21.15.72:0/785473679 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:46.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.247+0000 7f3bfe7fc700 1 -- 172.21.15.72:0/785473679 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3c000c4700 msgr2=0x7f3c0006c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:46.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.247+0000 7f3bfe7fc700 1 --2- 172.21.15.72:0/785473679 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3c000c4700 0x7f3c0006c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:46.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.247+0000 7f3bfe7fc700 1 -- 172.21.15.72:0/785473679 >> v1:172.21.15.173:6789/0 conn(0x7f3c0014aab0 legacy=0x7f3c00154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:46.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.247+0000 7f3bfe7fc700 1 -- 172.21.15.72:0/785473679 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c0006d200 con 0x7f3c000c7740 2023-07-27T20:31:46.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.247+0000 7f3bfe7fc700 1 --2- 172.21.15.72:0/785473679 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c000c7740 0x7f3c000c41c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3bf40098f0 tx=0x7f3bf4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89f6f5a2c1178188 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:46.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.247+0000 7f3bfdffb700 1 -- 172.21.15.72:0/785473679 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf4011830 con 0x7f3c000c7740 2023-07-27T20:31:46.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.248+0000 7f3bfdffb700 1 -- 172.21.15.72:0/785473679 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf4011990 con 0x7f3c000c7740 2023-07-27T20:31:46.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.248+0000 7f3bfdffb700 1 -- 172.21.15.72:0/785473679 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf4011d20 con 0x7f3c000c7740 2023-07-27T20:31:46.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.248+0000 7f3c059ff700 1 -- 172.21.15.72:0/785473679 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c000c7740 msgr2=0x7f3c000c41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:46.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.248+0000 7f3c059ff700 1 --2- 172.21.15.72:0/785473679 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c000c7740 0x7f3c000c41c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3bf40098f0 tx=0x7f3bf4009c00 comp rx=0 tx=0).stop 2023-07-27T20:31:46.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.248+0000 7f3c059ff700 1 -- 172.21.15.72:0/785473679 shutdown_connections 2023-07-27T20:31:46.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.248+0000 7f3c059ff700 1 --2- 172.21.15.72:0/785473679 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3c000c4700 0x7f3c0006c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:46.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.248+0000 7f3c059ff700 1 --2- 172.21.15.72:0/785473679 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c000c7740 0x7f3c000c41c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:46.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.248+0000 7f3c059ff700 1 -- 172.21.15.72:0/785473679 >> 172.21.15.72:0/785473679 conn(0x7f3c000ab3f0 msgr2=0x7f3c000ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:46.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.248+0000 7f3c059ff700 1 -- 172.21.15.72:0/785473679 shutdown_connections 2023-07-27T20:31:46.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.248+0000 7f3c059ff700 1 -- 172.21.15.72:0/785473679 wait complete. 2023-07-27T20:31:46.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.250+0000 7f3c059ff700 1 Processor -- start 2023-07-27T20:31:46.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.250+0000 7f3c059ff700 1 -- start start 2023-07-27T20:31:46.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.251+0000 7f3c059ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3c000c4700 0x7f3c001e9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:46.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.251+0000 7f3c059ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c000c7740 0x7f3c000be7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:46.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.251+0000 7f3c059ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c0014aab0 0x7f3c000bd810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:46.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.251+0000 7f3c059ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c00157ed0 con 0x7f3c000c7740 2023-07-27T20:31:46.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.251+0000 7f3c059ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c00156b30 con 0x7f3c0014aab0 2023-07-27T20:31:46.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.251+0000 7f3c059ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c00155c70 con 0x7f3c000c4700 2023-07-27T20:31:46.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.251+0000 7f3bfe7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c000c7740 0x7f3c000be7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:46.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.251+0000 7f3bfe7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c000c7740 0x7f3c000be7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50474/0 (socket says 172.21.15.72:50474) 2023-07-27T20:31:46.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.251+0000 7f3bfe7fc700 1 -- 172.21.15.72:0/3737609148 learned_addr learned my addr 172.21.15.72:0/3737609148 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:46.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.251+0000 7f3bfeffd700 1 --2- 172.21.15.72:0/3737609148 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3c000c4700 0x7f3c001e9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:46.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.251+0000 7f3bff7fe700 1 --2- 172.21.15.72:0/3737609148 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c0014aab0 0x7f3c000bd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:46.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.251+0000 7f3bfe7fc700 1 -- 172.21.15.72:0/3737609148 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3c000c4700 msgr2=0x7f3c001e9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:46.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.252+0000 7f3bfe7fc700 1 --2- 172.21.15.72:0/3737609148 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3c000c4700 0x7f3c001e9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:46.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.252+0000 7f3bfe7fc700 1 -- 172.21.15.72:0/3737609148 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c0014aab0 msgr2=0x7f3c000bd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:46.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.252+0000 7f3bfe7fc700 1 --2- 172.21.15.72:0/3737609148 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c0014aab0 0x7f3c000bd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:46.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.252+0000 7f3bfe7fc700 1 -- 172.21.15.72:0/3737609148 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf4009550 con 0x7f3c000c7740 2023-07-27T20:31:46.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.252+0000 7f3bff7fe700 1 --2- 172.21.15.72:0/3737609148 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c0014aab0 0x7f3c000bd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:31:46.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.252+0000 7f3bfe7fc700 1 --2- 172.21.15.72:0/3737609148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c000c7740 0x7f3c000be7a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4000c00 tx=0x7f3bf4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:46.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.252+0000 7f3be7fff700 1 -- 172.21.15.72:0/3737609148 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf4004480 con 0x7f3c000c7740 2023-07-27T20:31:46.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.252+0000 7f3be7fff700 1 -- 172.21.15.72:0/3737609148 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf401f070 con 0x7f3c000c7740 2023-07-27T20:31:46.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.252+0000 7f3be7fff700 1 -- 172.21.15.72:0/3737609148 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf40038c0 con 0x7f3c000c7740 2023-07-27T20:31:46.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.252+0000 7f3c059ff700 1 -- 172.21.15.72:0/3737609148 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c00155f20 con 0x7f3c000c7740 2023-07-27T20:31:46.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.252+0000 7f3c059ff700 1 -- 172.21.15.72:0/3737609148 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c001564e0 con 0x7f3c000c7740 2023-07-27T20:31:46.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.253+0000 7f3c059ff700 1 -- 172.21.15.72:0/3737609148 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c00156ce0 con 0x7f3c000c7740 2023-07-27T20:31:46.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.254+0000 7f3be7fff700 1 -- 172.21.15.72:0/3737609148 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3bf4021030 con 0x7f3c000c7740 2023-07-27T20:31:46.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.255+0000 7f3be7fff700 1 --2- 172.21.15.72:0/3737609148 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3bec06ace0 0x7f3bec06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:46.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.255+0000 7f3be7fff700 1 -- 172.21.15.72:0/3737609148 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3bf408abc0 con 0x7f3c000c7740 2023-07-27T20:31:46.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.255+0000 7f3bfeffd700 1 --2- 172.21.15.72:0/3737609148 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3bec06ace0 0x7f3bec06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:46.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.256+0000 7f3bfeffd700 1 --2- 172.21.15.72:0/3737609148 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3bec06ace0 0x7f3bec06d1a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0007fd0 tx=0x7f3bf0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:46.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.259+0000 7f3be7fff700 1 -- 172.21.15.72:0/3737609148 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3c00156ce0 con 0x7f3c000c7740 2023-07-27T20:31:46.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.456+0000 7f3c059ff700 1 -- 172.21.15.72:0/3737609148 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3c00157690 con 0x7f3c000c7740 2023-07-27T20:31:46.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.457+0000 7f3be7fff700 1 -- 172.21.15.72:0/3737609148 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3bf4015020 con 0x7f3c000c7740 2023-07-27T20:31:46.445 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:31:46.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.459+0000 7f3c059ff700 1 -- 172.21.15.72:0/3737609148 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3bec06ace0 msgr2=0x7f3bec06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:46.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.459+0000 7f3c059ff700 1 --2- 172.21.15.72:0/3737609148 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3bec06ace0 0x7f3bec06d1a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0007fd0 tx=0x7f3bf0009040 comp rx=0 tx=0).stop 2023-07-27T20:31:46.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.459+0000 7f3c059ff700 1 -- 172.21.15.72:0/3737609148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c000c7740 msgr2=0x7f3c000be7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:46.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.459+0000 7f3c059ff700 1 --2- 172.21.15.72:0/3737609148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c000c7740 0x7f3c000be7a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4000c00 tx=0x7f3bf4004750 comp rx=0 tx=0).stop 2023-07-27T20:31:46.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.459+0000 7f3c059ff700 1 -- 172.21.15.72:0/3737609148 shutdown_connections 2023-07-27T20:31:46.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.459+0000 7f3c059ff700 1 --2- 172.21.15.72:0/3737609148 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c0014aab0 0x7f3c000bd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:46.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.459+0000 7f3c059ff700 1 --2- 172.21.15.72:0/3737609148 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3bec06ace0 0x7f3bec06d1a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:46.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.459+0000 7f3c059ff700 1 --2- 172.21.15.72:0/3737609148 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3c000c4700 0x7f3c001e9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:46.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.459+0000 7f3c059ff700 1 --2- 172.21.15.72:0/3737609148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c000c7740 0x7f3c000be7a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:46.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.459+0000 7f3c059ff700 1 -- 172.21.15.72:0/3737609148 >> 172.21.15.72:0/3737609148 conn(0x7f3c000ab3f0 msgr2=0x7f3c00154b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:46.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.459+0000 7f3c059ff700 1 -- 172.21.15.72:0/3737609148 shutdown_connections 2023-07-27T20:31:46.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.459+0000 7f3c059ff700 1 -- 172.21.15.72:0/3737609148 wait complete. 2023-07-27T20:31:46.465 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T20:31:46.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.677+0000 7ff00c7ff700 1 Processor -- start 2023-07-27T20:31:46.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.678+0000 7ff00c7ff700 1 -- start start 2023-07-27T20:31:46.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.679+0000 7ff00c7ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff00414aab0 0x7ff004154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:46.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.679+0000 7ff00c7ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0040c7c50 con 0x7ff00406c1d0 2023-07-27T20:31:46.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.679+0000 7ff00c7ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff00406bd40 con 0x7ff0040c7740 2023-07-27T20:31:46.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.679+0000 7ff00c7ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff00406cd50 con 0x7ff00414aab0 2023-07-27T20:31:46.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.679+0000 7ff00ad9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff00406c1d0 0x7ff00406c640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58026/0 (socket says 172.21.15.72:58026) 2023-07-27T20:31:46.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.679+0000 7ff00ad9c700 1 -- 172.21.15.72:0/197473643 learned_addr learned my addr 172.21.15.72:0/197473643 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:46.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.679+0000 7ff00a59b700 1 --2- 172.21.15.72:0/197473643 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff00414aab0 0x7ff004154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:46.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.679+0000 7ff009599700 1 -- 172.21.15.72:0/197473643 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 816767715 0 0) 0x7ff0040c7c50 con 0x7ff00406c1d0 2023-07-27T20:31:46.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.679+0000 7ff009599700 1 -- 172.21.15.72:0/197473643 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feff00035b0 con 0x7ff00406c1d0 2023-07-27T20:31:46.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.680+0000 7ff009599700 1 -- 172.21.15.72:0/197473643 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 503394200 0 0) 0x7feff00035b0 con 0x7ff00406c1d0 2023-07-27T20:31:46.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.680+0000 7ff009599700 1 -- 172.21.15.72:0/197473643 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff00414aab0 msgr2=0x7ff004154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:46.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.680+0000 7ff009599700 1 --2- 172.21.15.72:0/197473643 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff00414aab0 0x7ff004154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:46.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.680+0000 7ff009599700 1 -- 172.21.15.72:0/197473643 >> v1:172.21.15.173:6789/0 conn(0x7ff0040c7740 legacy=0x7ff0040c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:46.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.680+0000 7ff009599700 1 -- 172.21.15.72:0/197473643 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0040c62f0 con 0x7ff00406c1d0 2023-07-27T20:31:46.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.680+0000 7ff009599700 1 -- 172.21.15.72:0/197473643 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7feffc0019f0 con 0x7ff00406c1d0 2023-07-27T20:31:46.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.680+0000 7ff009599700 1 -- 172.21.15.72:0/197473643 >> v1:172.21.15.72:6789/0 conn(0x7ff00406c1d0 legacy=0x7ff00406c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:46.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.680+0000 7ff009599700 1 --2- 172.21.15.72:0/197473643 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff00414aab0 0x7feff0003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:46.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.680+0000 7ff009599700 1 --2- 172.21.15.72:0/197473643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feff0003fb0 0x7feff0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:46.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.680+0000 7ff009599700 1 --2- 172.21.15.72:0/197473643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feff0004d90 0x7feff0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:46.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.680+0000 7ff009599700 1 -- 172.21.15.72:0/197473643 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00406cd50 con 0x7feff0003fb0 2023-07-27T20:31:46.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.680+0000 7ff009599700 1 -- 172.21.15.72:0/197473643 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff000baf0 con 0x7feff0004d90 2023-07-27T20:31:46.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.680+0000 7ff009599700 1 -- 172.21.15.72:0/197473643 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff000bcb0 con 0x7ff00414aab0 2023-07-27T20:31:46.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.680+0000 7ff009d9a700 1 --2- 172.21.15.72:0/197473643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feff0003fb0 0x7feff0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:46.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.680+0000 7ff00ad9c700 1 --2- 172.21.15.72:0/197473643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feff0004d90 0x7feff0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:46.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.680+0000 7ff00a59b700 1 --2- 172.21.15.72:0/197473643 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff00414aab0 0x7feff0003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:46.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.680+0000 7ff009d9a700 1 -- 172.21.15.72:0/197473643 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff00414aab0 msgr2=0x7feff0003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:46.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.680+0000 7ff009d9a700 1 --2- 172.21.15.72:0/197473643 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff00414aab0 0x7feff0003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:46.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.680+0000 7ff009d9a700 1 -- 172.21.15.72:0/197473643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feff0004d90 msgr2=0x7feff0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:46.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.680+0000 7ff009d9a700 1 --2- 172.21.15.72:0/197473643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feff0004d90 0x7feff0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:46.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.680+0000 7ff009d9a700 1 -- 172.21.15.72:0/197473643 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff00035b0 con 0x7feff0003fb0 2023-07-27T20:31:46.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.681+0000 7ff009d9a700 1 --2- 172.21.15.72:0/197473643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feff0003fb0 0x7feff0004850 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff0040c7ba0 tx=0x7feff0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c61d0aaa20fec53 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:46.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.681+0000 7ff009599700 1 -- 172.21.15.72:0/197473643 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff40052d0 con 0x7feff0003fb0 2023-07-27T20:31:46.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.681+0000 7ff009599700 1 -- 172.21.15.72:0/197473643 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff4005470 con 0x7feff0003fb0 2023-07-27T20:31:46.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.681+0000 7ff009599700 1 -- 172.21.15.72:0/197473643 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff40038c0 con 0x7feff0003fb0 2023-07-27T20:31:46.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.681+0000 7ff00c7ff700 1 -- 172.21.15.72:0/197473643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feff0003fb0 msgr2=0x7feff0004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:46.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.681+0000 7ff00c7ff700 1 --2- 172.21.15.72:0/197473643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feff0003fb0 0x7feff0004850 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff0040c7ba0 tx=0x7feff0005880 comp rx=0 tx=0).stop 2023-07-27T20:31:46.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.681+0000 7ff00ad9c700 1 -- 172.21.15.72:0/197473643 reap_dead start 2023-07-27T20:31:46.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.681+0000 7ff00c7ff700 1 -- 172.21.15.72:0/197473643 shutdown_connections 2023-07-27T20:31:46.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.681+0000 7ff00c7ff700 1 -- 172.21.15.72:0/197473643 >> 172.21.15.72:0/197473643 conn(0x7ff0040ab3f0 msgr2=0x7ff0040ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:46.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.681+0000 7ff00c7ff700 1 -- 172.21.15.72:0/197473643 shutdown_connections 2023-07-27T20:31:46.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.682+0000 7ff00c7ff700 1 -- 172.21.15.72:0/197473643 wait complete. 2023-07-27T20:31:46.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.683+0000 7ff00c7ff700 1 Processor -- start 2023-07-27T20:31:46.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.683+0000 7ff00c7ff700 1 -- start start 2023-07-27T20:31:46.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.684+0000 7ff00c7ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feff0003fb0 0x7ff00414fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:46.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.684+0000 7ff00c7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0040bccc0 0x7ff0041ea720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:46.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.684+0000 7ff00c7ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff0041ec820 0x7ff0041ecca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:46.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.684+0000 7ff00c7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0040aee80 con 0x7ff0040bccc0 2023-07-27T20:31:46.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.684+0000 7ff00c7ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0041ed5b0 con 0x7feff0003fb0 2023-07-27T20:31:46.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.684+0000 7ff00c7ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff00414f650 con 0x7ff0041ec820 2023-07-27T20:31:46.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.684+0000 7ff009d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0040bccc0 0x7ff0041ea720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:46.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.684+0000 7ff009d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0040bccc0 0x7ff0041ea720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50478/0 (socket says 172.21.15.72:50478) 2023-07-27T20:31:46.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.684+0000 7ff009d9a700 1 -- 172.21.15.72:0/1763455120 learned_addr learned my addr 172.21.15.72:0/1763455120 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:46.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.685+0000 7ff00a59b700 1 --2- 172.21.15.72:0/1763455120 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feff0003fb0 0x7ff00414fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:46.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.685+0000 7ff00ad9c700 1 --2- 172.21.15.72:0/1763455120 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff0041ec820 0x7ff0041ecca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:46.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.685+0000 7ff009d9a700 1 -- 172.21.15.72:0/1763455120 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff0041ec820 msgr2=0x7ff0041ecca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:46.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.685+0000 7ff009d9a700 1 --2- 172.21.15.72:0/1763455120 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff0041ec820 0x7ff0041ecca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:46.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.685+0000 7ff009d9a700 1 -- 172.21.15.72:0/1763455120 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feff0003fb0 msgr2=0x7ff00414fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:46.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.685+0000 7ff009d9a700 1 --2- 172.21.15.72:0/1763455120 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feff0003fb0 0x7ff00414fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:46.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.685+0000 7ff009d9a700 1 -- 172.21.15.72:0/1763455120 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff004150020 con 0x7ff0040bccc0 2023-07-27T20:31:46.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.685+0000 7ff009d9a700 1 --2- 172.21.15.72:0/1763455120 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0040bccc0 0x7ff0041ea720 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feff000bac0 tx=0x7feff4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:46.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.685+0000 7feffaffd700 1 -- 172.21.15.72:0/1763455120 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff4007240 con 0x7ff0040bccc0 2023-07-27T20:31:46.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.685+0000 7feffaffd700 1 -- 172.21.15.72:0/1763455120 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff40073a0 con 0x7ff0040bccc0 2023-07-27T20:31:46.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.685+0000 7feffaffd700 1 -- 172.21.15.72:0/1763455120 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff4001290 con 0x7ff0040bccc0 2023-07-27T20:31:46.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.685+0000 7ff00c7ff700 1 -- 172.21.15.72:0/1763455120 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0041514f0 con 0x7ff0040bccc0 2023-07-27T20:31:46.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.686+0000 7ff00c7ff700 1 -- 172.21.15.72:0/1763455120 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0041ed2d0 con 0x7ff0040bccc0 2023-07-27T20:31:46.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.686+0000 7ff00c7ff700 1 -- 172.21.15.72:0/1763455120 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff00414f7e0 con 0x7ff0040bccc0 2023-07-27T20:31:46.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.687+0000 7feffaffd700 1 -- 172.21.15.72:0/1763455120 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feff4003680 con 0x7ff0040bccc0 2023-07-27T20:31:46.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.688+0000 7feffaffd700 1 --2- 172.21.15.72:0/1763455120 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fefe806ad10 0x7fefe806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:46.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.688+0000 7feffaffd700 1 -- 172.21.15.72:0/1763455120 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7feff408a4b0 con 0x7ff0040bccc0 2023-07-27T20:31:46.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.689+0000 7ff00a59b700 1 --2- 172.21.15.72:0/1763455120 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fefe806ad10 0x7fefe806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:46.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.689+0000 7ff00a59b700 1 --2- 172.21.15.72:0/1763455120 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fefe806ad10 0x7fefe806d1d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff000009c60 tx=0x7ff000009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:46.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.692+0000 7feffaffd700 1 -- 172.21.15.72:0/1763455120 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7feff40554e0 con 0x7ff0040bccc0 2023-07-27T20:31:46.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.888+0000 7ff00c7ff700 1 -- 172.21.15.72:0/1763455120 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff00404e470 con 0x7ff0040bccc0 2023-07-27T20:31:46.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.888+0000 7feffaffd700 1 -- 172.21.15.72:0/1763455120 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7feff4058b00 con 0x7ff0040bccc0 2023-07-27T20:31:46.877 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-27T20:31:46.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.890+0000 7ff00c7ff700 1 -- 172.21.15.72:0/1763455120 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fefe806ad10 msgr2=0x7fefe806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:46.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.890+0000 7ff00c7ff700 1 --2- 172.21.15.72:0/1763455120 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fefe806ad10 0x7fefe806d1d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff000009c60 tx=0x7ff000009210 comp rx=0 tx=0).stop 2023-07-27T20:31:46.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.890+0000 7ff00c7ff700 1 -- 172.21.15.72:0/1763455120 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0040bccc0 msgr2=0x7ff0041ea720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:46.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.890+0000 7ff00c7ff700 1 --2- 172.21.15.72:0/1763455120 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0040bccc0 0x7ff0041ea720 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feff000bac0 tx=0x7feff4001120 comp rx=0 tx=0).stop 2023-07-27T20:31:46.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.891+0000 7ff00c7ff700 1 -- 172.21.15.72:0/1763455120 shutdown_connections 2023-07-27T20:31:46.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.891+0000 7ff00c7ff700 1 --2- 172.21.15.72:0/1763455120 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fefe806ad10 0x7fefe806d1d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:46.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.891+0000 7ff00c7ff700 1 --2- 172.21.15.72:0/1763455120 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff0041ec820 0x7ff0041ecca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:46.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.891+0000 7ff00c7ff700 1 --2- 172.21.15.72:0/1763455120 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feff0003fb0 0x7ff00414fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:46.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.891+0000 7ff00c7ff700 1 --2- 172.21.15.72:0/1763455120 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0040bccc0 0x7ff0041ea720 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:46.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.891+0000 7ff00c7ff700 1 -- 172.21.15.72:0/1763455120 >> 172.21.15.72:0/1763455120 conn(0x7ff0040ab3f0 msgr2=0x7ff0040c40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:46.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.891+0000 7ff00c7ff700 1 -- 172.21.15.72:0/1763455120 shutdown_connections 2023-07-27T20:31:46.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:46.891+0000 7ff00c7ff700 1 -- 172.21.15.72:0/1763455120 wait complete. 2023-07-27T20:31:46.896 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-27T20:31:47.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.108+0000 7f89ef1ff700 1 Processor -- start 2023-07-27T20:31:47.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.108+0000 7f89ef1ff700 1 -- start start 2023-07-27T20:31:47.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.109+0000 7f89ef1ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f89e814aab0 0x7f89e8154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:47.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.109+0000 7f89ef1ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f89e806c1d0 0x7f89e806c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:47.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.109+0000 7f89ef1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89e80c7c50 con 0x7f89e80c7740 2023-07-27T20:31:47.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.109+0000 7f89ef1ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89e806bd40 con 0x7f89e806c1d0 2023-07-27T20:31:47.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.109+0000 7f89ef1ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e80c62f0 con 0x7f89e814aab0 2023-07-27T20:31:47.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.109+0000 7f89e7fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f89e80c7740 0x7f89e80c41c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58038/0 (socket says 172.21.15.72:58038) 2023-07-27T20:31:47.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.109+0000 7f89e7fff700 1 -- 172.21.15.72:0/2217022473 learned_addr learned my addr 172.21.15.72:0/2217022473 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:47.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.109+0000 7f89ed79c700 1 --2- 172.21.15.72:0/2217022473 >> v2:172.21.15.173:3300/0 conn(0x7f89e806c1d0 0x7f89e806c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:47.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.109+0000 7f89ecf9b700 1 --2- 172.21.15.72:0/2217022473 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f89e814aab0 0x7f89e8154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:47.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.110+0000 7f89e77fe700 1 -- 172.21.15.72:0/2217022473 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2079701521 0 0) 0x7f89e80c7c50 con 0x7f89e80c7740 2023-07-27T20:31:47.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.110+0000 7f89e77fe700 1 -- 172.21.15.72:0/2217022473 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89d80035b0 con 0x7f89e80c7740 2023-07-27T20:31:47.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.110+0000 7f89ecf9b700 1 -- 172.21.15.72:0/2217022473 >> v2:172.21.15.173:3300/0 conn(0x7f89e806c1d0 msgr2=0x7f89e806c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:47.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.110+0000 7f89ecf9b700 1 --2- 172.21.15.72:0/2217022473 >> v2:172.21.15.173:3300/0 conn(0x7f89e806c1d0 0x7f89e806c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:47.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.110+0000 7f89ecf9b700 1 -- 172.21.15.72:0/2217022473 >> v1:172.21.15.72:6789/0 conn(0x7f89e80c7740 legacy=0x7f89e80c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:47.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.110+0000 7f89ecf9b700 1 -- 172.21.15.72:0/2217022473 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e8155050 con 0x7f89e814aab0 2023-07-27T20:31:47.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.110+0000 7f89ed79c700 1 --2- 172.21.15.72:0/2217022473 >> v2:172.21.15.173:3300/0 conn(0x7f89e806c1d0 0x7f89e806c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:31:47.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.110+0000 7f89ecf9b700 1 --2- 172.21.15.72:0/2217022473 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f89e814aab0 0x7f89e8154b10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f89dc009840 tx=0x7f89dc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7820b37175832ea server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:47.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.110+0000 7f89e77fe700 1 -- 172.21.15.72:0/2217022473 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89dc011830 con 0x7f89e814aab0 2023-07-27T20:31:47.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.110+0000 7f89e77fe700 1 -- 172.21.15.72:0/2217022473 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89dc011990 con 0x7f89e814aab0 2023-07-27T20:31:47.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.111+0000 7f89e77fe700 1 -- 172.21.15.72:0/2217022473 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89dc011d00 con 0x7f89e814aab0 2023-07-27T20:31:47.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.111+0000 7f89ef1ff700 1 -- 172.21.15.72:0/2217022473 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f89e814aab0 msgr2=0x7f89e8154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:47.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.111+0000 7f89ef1ff700 1 --2- 172.21.15.72:0/2217022473 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f89e814aab0 0x7f89e8154b10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f89dc009840 tx=0x7f89dc009b50 comp rx=0 tx=0).stop 2023-07-27T20:31:47.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.111+0000 7f89ef1ff700 1 -- 172.21.15.72:0/2217022473 shutdown_connections 2023-07-27T20:31:47.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.111+0000 7f89ef1ff700 1 --2- 172.21.15.72:0/2217022473 >> v2:172.21.15.173:3300/0 conn(0x7f89e806c1d0 0x7f89e806c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:47.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.111+0000 7f89ef1ff700 1 --2- 172.21.15.72:0/2217022473 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f89e814aab0 0x7f89e8154b10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:47.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.111+0000 7f89ef1ff700 1 -- 172.21.15.72:0/2217022473 >> 172.21.15.72:0/2217022473 conn(0x7f89e80ab3f0 msgr2=0x7f89e80ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:47.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.111+0000 7f89ef1ff700 1 -- 172.21.15.72:0/2217022473 shutdown_connections 2023-07-27T20:31:47.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.111+0000 7f89ef1ff700 1 -- 172.21.15.72:0/2217022473 wait complete. 2023-07-27T20:31:47.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.113+0000 7f89ef1ff700 1 Processor -- start 2023-07-27T20:31:47.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.113+0000 7f89ef1ff700 1 -- start start 2023-07-27T20:31:47.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.114+0000 7f89ef1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89e806c1d0 0x7f89e8149090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:47.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.114+0000 7f89ef1ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f89e80c7740 0x7f89e8149a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:47.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.114+0000 7f89ef1ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89e814aab0 0x7f89e8145ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:47.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.114+0000 7f89ef1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e8156270 con 0x7f89e806c1d0 2023-07-27T20:31:47.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.114+0000 7f89ef1ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e8158090 con 0x7f89e814aab0 2023-07-27T20:31:47.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.114+0000 7f89ef1ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e8157480 con 0x7f89e80c7740 2023-07-27T20:31:47.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.114+0000 7f89ecf9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89e806c1d0 0x7f89e8149090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:47.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.114+0000 7f89ecf9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89e806c1d0 0x7f89e8149090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50488/0 (socket says 172.21.15.72:50488) 2023-07-27T20:31:47.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.114+0000 7f89ecf9b700 1 -- 172.21.15.72:0/3630781793 learned_addr learned my addr 172.21.15.72:0/3630781793 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:47.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.114+0000 7f89e7fff700 1 --2- 172.21.15.72:0/3630781793 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f89e80c7740 0x7f89e8149a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:47.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.114+0000 7f89ed79c700 1 --2- 172.21.15.72:0/3630781793 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89e814aab0 0x7f89e8145ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:47.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.114+0000 7f89ecf9b700 1 -- 172.21.15.72:0/3630781793 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f89e80c7740 msgr2=0x7f89e8149a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:47.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.114+0000 7f89ecf9b700 1 --2- 172.21.15.72:0/3630781793 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f89e80c7740 0x7f89e8149a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:47.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.114+0000 7f89ecf9b700 1 -- 172.21.15.72:0/3630781793 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89e814aab0 msgr2=0x7f89e8145ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:47.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.114+0000 7f89ecf9b700 1 --2- 172.21.15.72:0/3630781793 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89e814aab0 0x7f89e8145ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:47.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.114+0000 7f89ecf9b700 1 -- 172.21.15.72:0/3630781793 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e0009a70 con 0x7f89e806c1d0 2023-07-27T20:31:47.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.115+0000 7f89ecf9b700 1 --2- 172.21.15.72:0/3630781793 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89e806c1d0 0x7f89e8149090 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f89dc014040 tx=0x7f89dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:47.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.115+0000 7f89e57fa700 1 -- 172.21.15.72:0/3630781793 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89dc004550 con 0x7f89e806c1d0 2023-07-27T20:31:47.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.115+0000 7f89e57fa700 1 -- 172.21.15.72:0/3630781793 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89dc01f070 con 0x7f89e806c1d0 2023-07-27T20:31:47.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.115+0000 7f89ef1ff700 1 -- 172.21.15.72:0/3630781793 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89dc0094a0 con 0x7f89e806c1d0 2023-07-27T20:31:47.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.115+0000 7f89e57fa700 1 -- 172.21.15.72:0/3630781793 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89dc0038c0 con 0x7f89e806c1d0 2023-07-27T20:31:47.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.115+0000 7f89ef1ff700 1 -- 172.21.15.72:0/3630781793 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89e8157a40 con 0x7f89e806c1d0 2023-07-27T20:31:47.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.116+0000 7f89d2ffd700 1 -- 172.21.15.72:0/3630781793 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89c00052f0 con 0x7f89e806c1d0 2023-07-27T20:31:47.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.117+0000 7f89e57fa700 1 -- 172.21.15.72:0/3630781793 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f89dc003a20 con 0x7f89e806c1d0 2023-07-27T20:31:47.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.118+0000 7f89e57fa700 1 --2- 172.21.15.72:0/3630781793 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f89cc06ace0 0x7f89cc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:47.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.118+0000 7f89e57fa700 1 -- 172.21.15.72:0/3630781793 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f89dc021070 con 0x7f89e806c1d0 2023-07-27T20:31:47.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.119+0000 7f89e7fff700 1 --2- 172.21.15.72:0/3630781793 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f89cc06ace0 0x7f89cc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:47.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.119+0000 7f89e7fff700 1 --2- 172.21.15.72:0/3630781793 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f89cc06ace0 0x7f89cc06d1a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f89e81df440 tx=0x7f89d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:47.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.122+0000 7f89e57fa700 1 -- 172.21.15.72:0/3630781793 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f89dc055c40 con 0x7f89e806c1d0 2023-07-27T20:31:47.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.317+0000 7f89d2ffd700 1 -- 172.21.15.72:0/3630781793 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f89c0005b20 con 0x7f89e806c1d0 2023-07-27T20:31:47.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.317+0000 7f89e57fa700 1 -- 172.21.15.72:0/3630781793 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f89dc059260 con 0x7f89e806c1d0 2023-07-27T20:31:47.305 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:31:47.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.319+0000 7f89d2ffd700 1 -- 172.21.15.72:0/3630781793 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f89cc06ace0 msgr2=0x7f89cc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:47.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.319+0000 7f89d2ffd700 1 --2- 172.21.15.72:0/3630781793 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f89cc06ace0 0x7f89cc06d1a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f89e81df440 tx=0x7f89d4009040 comp rx=0 tx=0).stop 2023-07-27T20:31:47.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.319+0000 7f89d2ffd700 1 -- 172.21.15.72:0/3630781793 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89e806c1d0 msgr2=0x7f89e8149090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:47.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.319+0000 7f89d2ffd700 1 --2- 172.21.15.72:0/3630781793 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89e806c1d0 0x7f89e8149090 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f89dc014040 tx=0x7f89dc004750 comp rx=0 tx=0).stop 2023-07-27T20:31:47.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.320+0000 7f89d2ffd700 1 -- 172.21.15.72:0/3630781793 shutdown_connections 2023-07-27T20:31:47.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.320+0000 7f89d2ffd700 1 --2- 172.21.15.72:0/3630781793 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89e814aab0 0x7f89e8145ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:47.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.320+0000 7f89d2ffd700 1 --2- 172.21.15.72:0/3630781793 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89e806c1d0 0x7f89e8149090 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:47.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.320+0000 7f89d2ffd700 1 --2- 172.21.15.72:0/3630781793 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f89cc06ace0 0x7f89cc06d1a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:47.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.320+0000 7f89d2ffd700 1 --2- 172.21.15.72:0/3630781793 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f89e80c7740 0x7f89e8149a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:47.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.320+0000 7f89d2ffd700 1 -- 172.21.15.72:0/3630781793 >> 172.21.15.72:0/3630781793 conn(0x7f89e80ab3f0 msgr2=0x7f89e81524a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:47.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.320+0000 7f89d2ffd700 1 -- 172.21.15.72:0/3630781793 shutdown_connections 2023-07-27T20:31:47.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.320+0000 7f89d2ffd700 1 -- 172.21.15.72:0/3630781793 wait complete. 2023-07-27T20:31:47.325 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-27T20:31:47.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.534+0000 7f64305ff700 1 Processor -- start 2023-07-27T20:31:47.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.534+0000 7f64305ff700 1 -- start start 2023-07-27T20:31:47.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.535+0000 7f64305ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f64280c4400 0x7f64280c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:47.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.535+0000 7f64305ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f64281549f0 0x7f64281514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:47.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.535+0000 7f64305ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f642806b710 con 0x7f642806b150 2023-07-27T20:31:47.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.535+0000 7f64305ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64281545d0 con 0x7f64280c4400 2023-07-27T20:31:47.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.535+0000 7f64305ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f642806c860 con 0x7f64281549f0 2023-07-27T20:31:47.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.536+0000 7f642e39b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f64280c4400 0x7f64280c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:47.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.536+0000 7f642e39b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f64280c4400 0x7f64280c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50494/0 (socket says 172.21.15.72:50494) 2023-07-27T20:31:47.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.536+0000 7f642e39b700 1 -- 172.21.15.72:0/3518424540 learned_addr learned my addr 172.21.15.72:0/3518424540 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:47.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.536+0000 7f642eb9c700 1 --2- 172.21.15.72:0/3518424540 >> v2:172.21.15.173:3300/0 conn(0x7f64281549f0 0x7f64281514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:47.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.536+0000 7f642e39b700 1 -- 172.21.15.72:0/3518424540 >> v2:172.21.15.173:3300/0 conn(0x7f64281549f0 msgr2=0x7f64281514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:47.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.536+0000 7f642e39b700 1 --2- 172.21.15.72:0/3518424540 >> v2:172.21.15.173:3300/0 conn(0x7f64281549f0 0x7f64281514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:47.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.536+0000 7f642e39b700 1 -- 172.21.15.72:0/3518424540 >> v1:172.21.15.173:6789/0 conn(0x7f642806b150 legacy=0x7f64280c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:47.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.536+0000 7f642e39b700 1 -- 172.21.15.72:0/3518424540 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f642806b9f0 con 0x7f64280c4400 2023-07-27T20:31:47.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.536+0000 7f642e39b700 1 --2- 172.21.15.72:0/3518424540 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64280c4400 0x7f64280c7710 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f64280af950 tx=0x7f6424009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50898c2d2a7ee537 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:47.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.537+0000 7f642d399700 1 -- 172.21.15.72:0/3518424540 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6424011830 con 0x7f64280c4400 2023-07-27T20:31:47.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.537+0000 7f642d399700 1 -- 172.21.15.72:0/3518424540 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6424011990 con 0x7f64280c4400 2023-07-27T20:31:47.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.537+0000 7f642d399700 1 -- 172.21.15.72:0/3518424540 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6424011d20 con 0x7f64280c4400 2023-07-27T20:31:47.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.537+0000 7f64305ff700 1 -- 172.21.15.72:0/3518424540 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64280c4400 msgr2=0x7f64280c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:47.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.537+0000 7f64305ff700 1 --2- 172.21.15.72:0/3518424540 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64280c4400 0x7f64280c7710 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f64280af950 tx=0x7f6424009bd0 comp rx=0 tx=0).stop 2023-07-27T20:31:47.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.537+0000 7f64305ff700 1 -- 172.21.15.72:0/3518424540 shutdown_connections 2023-07-27T20:31:47.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.537+0000 7f64305ff700 1 --2- 172.21.15.72:0/3518424540 >> v2:172.21.15.173:3300/0 conn(0x7f64281549f0 0x7f64281514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:47.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.537+0000 7f64305ff700 1 --2- 172.21.15.72:0/3518424540 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64280c4400 0x7f64280c7710 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:47.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.537+0000 7f64305ff700 1 -- 172.21.15.72:0/3518424540 >> 172.21.15.72:0/3518424540 conn(0x7f64280ab300 msgr2=0x7f64280ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:47.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.537+0000 7f64305ff700 1 -- 172.21.15.72:0/3518424540 shutdown_connections 2023-07-27T20:31:47.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.537+0000 7f64305ff700 1 -- 172.21.15.72:0/3518424540 wait complete. 2023-07-27T20:31:47.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.539+0000 7f64305ff700 1 Processor -- start 2023-07-27T20:31:47.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.539+0000 7f64305ff700 1 -- start start 2023-07-27T20:31:47.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.540+0000 7f64305ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f642806b150 0x7f64280c1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:47.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.540+0000 7f64305ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f64280c4400 0x7f64280ae9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:47.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.540+0000 7f64305ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64281549f0 0x7f64280c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:47.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.540+0000 7f64305ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642814ff90 con 0x7f64281549f0 2023-07-27T20:31:47.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.540+0000 7f64305ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642814e800 con 0x7f642806b150 2023-07-27T20:31:47.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.540+0000 7f64305ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64280c00d0 con 0x7f64280c4400 2023-07-27T20:31:47.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.540+0000 7f642eb9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64281549f0 0x7f64280c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:47.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.540+0000 7f642eb9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64281549f0 0x7f64280c34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50506/0 (socket says 172.21.15.72:50506) 2023-07-27T20:31:47.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.540+0000 7f642eb9c700 1 -- 172.21.15.72:0/2358683753 learned_addr learned my addr 172.21.15.72:0/2358683753 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:47.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.540+0000 7f642e39b700 1 --2- 172.21.15.72:0/2358683753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f642806b150 0x7f64280c1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:47.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.540+0000 7f642db9a700 1 --2- 172.21.15.72:0/2358683753 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f64280c4400 0x7f64280ae9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:47.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.541+0000 7f642eb9c700 1 -- 172.21.15.72:0/2358683753 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f64280c4400 msgr2=0x7f64280ae9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:47.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.541+0000 7f642eb9c700 1 --2- 172.21.15.72:0/2358683753 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f64280c4400 0x7f64280ae9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:47.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.541+0000 7f642eb9c700 1 -- 172.21.15.72:0/2358683753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f642806b150 msgr2=0x7f64280c1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:47.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.541+0000 7f642eb9c700 1 --2- 172.21.15.72:0/2358683753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f642806b150 0x7f64280c1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:47.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.541+0000 7f642eb9c700 1 -- 172.21.15.72:0/2358683753 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6424009550 con 0x7f64281549f0 2023-07-27T20:31:47.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.541+0000 7f642eb9c700 1 --2- 172.21.15.72:0/2358683753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64281549f0 0x7f64280c34b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6420009d30 tx=0x7f642000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:47.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.541+0000 7f641effd700 1 -- 172.21.15.72:0/2358683753 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642000cc90 con 0x7f64281549f0 2023-07-27T20:31:47.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.541+0000 7f641effd700 1 -- 172.21.15.72:0/2358683753 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642000f040 con 0x7f64281549f0 2023-07-27T20:31:47.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.541+0000 7f641effd700 1 -- 172.21.15.72:0/2358683753 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6420009e80 con 0x7f64281549f0 2023-07-27T20:31:47.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.541+0000 7f64305ff700 1 -- 172.21.15.72:0/2358683753 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f642814d4c0 con 0x7f64281549f0 2023-07-27T20:31:47.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.541+0000 7f64305ff700 1 -- 172.21.15.72:0/2358683753 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f642814e490 con 0x7f64281549f0 2023-07-27T20:31:47.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.542+0000 7f64305ff700 1 -- 172.21.15.72:0/2358683753 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f642814e990 con 0x7f64281549f0 2023-07-27T20:31:47.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.543+0000 7f641effd700 1 -- 172.21.15.72:0/2358683753 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6420014480 con 0x7f64281549f0 2023-07-27T20:31:47.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.545+0000 7f641effd700 1 --2- 172.21.15.72:0/2358683753 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f640c06ace0 0x7f640c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:47.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.545+0000 7f641effd700 1 -- 172.21.15.72:0/2358683753 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6420089eb0 con 0x7f64281549f0 2023-07-27T20:31:47.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.545+0000 7f642e39b700 1 --2- 172.21.15.72:0/2358683753 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f640c06ace0 0x7f640c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:47.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.546+0000 7f642e39b700 1 --2- 172.21.15.72:0/2358683753 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f640c06ace0 0x7f640c06d1a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6424009c10 tx=0x7f6424008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:47.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.549+0000 7f641effd700 1 -- 172.21.15.72:0/2358683753 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6420054c70 con 0x7f64281549f0 2023-07-27T20:31:47.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.754+0000 7f64305ff700 1 -- 172.21.15.72:0/2358683753 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6428074310 con 0x7f64281549f0 2023-07-27T20:31:47.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.755+0000 7f641effd700 1 -- 172.21.15.72:0/2358683753 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6420018080 con 0x7f64281549f0 2023-07-27T20:31:47.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.757+0000 7f64305ff700 1 -- 172.21.15.72:0/2358683753 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f640c06ace0 msgr2=0x7f640c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:47.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.757+0000 7f64305ff700 1 --2- 172.21.15.72:0/2358683753 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f640c06ace0 0x7f640c06d1a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6424009c10 tx=0x7f6424008030 comp rx=0 tx=0).stop 2023-07-27T20:31:47.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.757+0000 7f64305ff700 1 -- 172.21.15.72:0/2358683753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64281549f0 msgr2=0x7f64280c34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:47.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.757+0000 7f64305ff700 1 --2- 172.21.15.72:0/2358683753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64281549f0 0x7f64280c34b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6420009d30 tx=0x7f642000c3a0 comp rx=0 tx=0).stop 2023-07-27T20:31:47.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.757+0000 7f64305ff700 1 -- 172.21.15.72:0/2358683753 shutdown_connections 2023-07-27T20:31:47.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.757+0000 7f64305ff700 1 --2- 172.21.15.72:0/2358683753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64281549f0 0x7f64280c34b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:47.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.757+0000 7f64305ff700 1 --2- 172.21.15.72:0/2358683753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f642806b150 0x7f64280c1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:47.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.757+0000 7f64305ff700 1 --2- 172.21.15.72:0/2358683753 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f640c06ace0 0x7f640c06d1a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:47.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.757+0000 7f64305ff700 1 --2- 172.21.15.72:0/2358683753 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f64280c4400 0x7f64280ae9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:47.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.757+0000 7f64305ff700 1 -- 172.21.15.72:0/2358683753 >> 172.21.15.72:0/2358683753 conn(0x7f64280ab300 msgr2=0x7f64281509b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:47.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.757+0000 7f64305ff700 1 -- 172.21.15.72:0/2358683753 shutdown_connections 2023-07-27T20:31:47.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:47.757+0000 7f64305ff700 1 -- 172.21.15.72:0/2358683753 wait complete. 2023-07-27T20:31:47.746 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-07-27T20:31:47.762 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi072.front.sepia.ceph.com... 2023-07-27T20:31:47.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:31:47.763 DEBUG:teuthology.orchestra.run.smithi072:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-07-27T20:31:47.830 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi072.stderr:ceph-fuse[148836]: fuse finished with error 0 and tester_r 0 2023-07-27T20:31:47.834 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T20:31:47.852 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2023-07-27T20:31:47.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:31:47.852 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-07-27T20:31:47.954 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:31:48.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.162+0000 7fa4a49ff700 1 Processor -- start 2023-07-27T20:31:48.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.162+0000 7fa4a49ff700 1 -- start start 2023-07-27T20:31:48.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.164+0000 7fa4a49ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa4a0151630 0x7fa4a00c7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:48.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.164+0000 7fa4a49ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa4a00c4760 0x7fa4a01547c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:48.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.164+0000 7fa4a49ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4a01576a0 con 0x7fa4a00c42b0 2023-07-27T20:31:48.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.164+0000 7fa4a49ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4a0157980 con 0x7fa4a0151630 2023-07-27T20:31:48.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.164+0000 7fa4a49ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a0157c60 con 0x7fa4a00c4760 2023-07-27T20:31:48.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.164+0000 7fa49dd9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa4a00c42b0 0x7fa4a01540b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58048/0 (socket says 172.21.15.72:58048) 2023-07-27T20:31:48.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.164+0000 7fa49dd9b700 1 -- 172.21.15.72:0/3379594436 learned_addr learned my addr 172.21.15.72:0/3379594436 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.164+0000 7fa49e59c700 1 --2- 172.21.15.72:0/3379594436 >> v2:172.21.15.173:3300/0 conn(0x7fa4a0151630 0x7fa4a00c7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.164+0000 7fa49ed9d700 1 --2- 172.21.15.72:0/3379594436 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa4a00c4760 0x7fa4a01547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.165+0000 7fa49d59a700 1 -- 172.21.15.72:0/3379594436 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2818825731 0 0) 0x7fa4a01576a0 con 0x7fa4a00c42b0 2023-07-27T20:31:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.165+0000 7fa49d59a700 1 -- 172.21.15.72:0/3379594436 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4880035b0 con 0x7fa4a00c42b0 2023-07-27T20:31:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.165+0000 7fa49ed9d700 1 -- 172.21.15.72:0/3379594436 >> v2:172.21.15.173:3300/0 conn(0x7fa4a0151630 msgr2=0x7fa4a00c7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.165+0000 7fa49ed9d700 1 --2- 172.21.15.72:0/3379594436 >> v2:172.21.15.173:3300/0 conn(0x7fa4a0151630 0x7fa4a00c7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.165+0000 7fa49ed9d700 1 -- 172.21.15.72:0/3379594436 >> v1:172.21.15.72:6789/0 conn(0x7fa4a00c42b0 legacy=0x7fa4a01540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.165+0000 7fa49ed9d700 1 -- 172.21.15.72:0/3379594436 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a0157f40 con 0x7fa4a00c4760 2023-07-27T20:31:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.165+0000 7fa49e59c700 1 --2- 172.21.15.72:0/3379594436 >> v2:172.21.15.173:3300/0 conn(0x7fa4a0151630 0x7fa4a00c7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:31:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.165+0000 7fa49ed9d700 1 --2- 172.21.15.72:0/3379594436 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa4a00c4760 0x7fa4a01547c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa498009d90 tx=0x7fa49800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb5fd2f012a78cf2 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.165+0000 7fa49d59a700 1 -- 172.21.15.72:0/3379594436 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49800e070 con 0x7fa4a00c4760 2023-07-27T20:31:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.165+0000 7fa49d59a700 1 -- 172.21.15.72:0/3379594436 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49800bb20 con 0x7fa4a00c4760 2023-07-27T20:31:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.165+0000 7fa49d59a700 1 -- 172.21.15.72:0/3379594436 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa498012430 con 0x7fa4a00c4760 2023-07-27T20:31:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.166+0000 7fa4a49ff700 1 -- 172.21.15.72:0/3379594436 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa4a00c4760 msgr2=0x7fa4a01547c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.166+0000 7fa4a49ff700 1 --2- 172.21.15.72:0/3379594436 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa4a00c4760 0x7fa4a01547c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa498009d90 tx=0x7fa49800b330 comp rx=0 tx=0).stop 2023-07-27T20:31:48.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.166+0000 7fa4a49ff700 1 -- 172.21.15.72:0/3379594436 shutdown_connections 2023-07-27T20:31:48.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.166+0000 7fa4a49ff700 1 --2- 172.21.15.72:0/3379594436 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa4a00c4760 0x7fa4a01547c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:48.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.166+0000 7fa4a49ff700 1 --2- 172.21.15.72:0/3379594436 >> v2:172.21.15.173:3300/0 conn(0x7fa4a0151630 0x7fa4a00c7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:48.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.166+0000 7fa4a49ff700 1 -- 172.21.15.72:0/3379594436 >> 172.21.15.72:0/3379594436 conn(0x7fa4a0071ce0 msgr2=0x7fa4a00720f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:48.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.166+0000 7fa4a49ff700 1 -- 172.21.15.72:0/3379594436 shutdown_connections 2023-07-27T20:31:48.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.166+0000 7fa4a49ff700 1 -- 172.21.15.72:0/3379594436 wait complete. 2023-07-27T20:31:48.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.168+0000 7fa4a49ff700 1 Processor -- start 2023-07-27T20:31:48.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.169+0000 7fa4a49ff700 1 -- start start 2023-07-27T20:31:48.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.170+0000 7fa4a49ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa4a00c42b0 0x7fa4a01ea040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:48.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.170+0000 7fa4a49ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4a00c4760 0x7fa4a014ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:48.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.170+0000 7fa4a49ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4a0151630 0x7fa4a01ed230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:48.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.170+0000 7fa4a49ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a0153a50 con 0x7fa4a00c4760 2023-07-27T20:31:48.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.170+0000 7fa4a49ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a0153240 con 0x7fa4a0151630 2023-07-27T20:31:48.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.170+0000 7fa4a49ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a01507d0 con 0x7fa4a00c42b0 2023-07-27T20:31:48.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.170+0000 7fa49dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4a00c4760 0x7fa4a014ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:48.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.170+0000 7fa49e59c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa4a00c42b0 0x7fa4a01ea040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:48.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.170+0000 7fa49dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4a00c4760 0x7fa4a014ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50510/0 (socket says 172.21.15.72:50510) 2023-07-27T20:31:48.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.170+0000 7fa49dd9b700 1 -- 172.21.15.72:0/887091879 learned_addr learned my addr 172.21.15.72:0/887091879 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:48.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.170+0000 7fa49ed9d700 1 --2- 172.21.15.72:0/887091879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4a0151630 0x7fa4a01ed230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:48.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.170+0000 7fa49dd9b700 1 -- 172.21.15.72:0/887091879 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa4a00c42b0 msgr2=0x7fa4a01ea040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:48.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.170+0000 7fa49dd9b700 1 --2- 172.21.15.72:0/887091879 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa4a00c42b0 0x7fa4a01ea040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:48.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.171+0000 7fa49dd9b700 1 -- 172.21.15.72:0/887091879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4a0151630 msgr2=0x7fa4a01ed230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:48.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.171+0000 7fa49dd9b700 1 --2- 172.21.15.72:0/887091879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4a0151630 0x7fa4a01ed230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:48.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.171+0000 7fa49dd9b700 1 -- 172.21.15.72:0/887091879 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4900094a0 con 0x7fa4a00c4760 2023-07-27T20:31:48.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.171+0000 7fa49dd9b700 1 --2- 172.21.15.72:0/887091879 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4a00c4760 0x7fa4a014ffc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa49400c700 tx=0x7fa49400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:48.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.171+0000 7fa48effd700 1 -- 172.21.15.72:0/887091879 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa494005d70 con 0x7fa4a00c4760 2023-07-27T20:31:48.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.171+0000 7fa48effd700 1 -- 172.21.15.72:0/887091879 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4940070d0 con 0x7fa4a00c4760 2023-07-27T20:31:48.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.171+0000 7fa4a49ff700 1 -- 172.21.15.72:0/887091879 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa498009a70 con 0x7fa4a00c4760 2023-07-27T20:31:48.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.171+0000 7fa48effd700 1 -- 172.21.15.72:0/887091879 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa494007460 con 0x7fa4a00c4760 2023-07-27T20:31:48.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.171+0000 7fa4a49ff700 1 -- 172.21.15.72:0/887091879 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a0153770 con 0x7fa4a00c4760 2023-07-27T20:31:48.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.172+0000 7fa4a49ff700 1 -- 172.21.15.72:0/887091879 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a0074310 con 0x7fa4a00c4760 2023-07-27T20:31:48.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.173+0000 7fa48effd700 1 -- 172.21.15.72:0/887091879 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa4940075c0 con 0x7fa4a00c4760 2023-07-27T20:31:48.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.174+0000 7fa48effd700 1 --2- 172.21.15.72:0/887091879 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa48006ace0 0x7fa48006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:48.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.175+0000 7fa48effd700 1 -- 172.21.15.72:0/887091879 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa494088af0 con 0x7fa4a00c4760 2023-07-27T20:31:48.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.175+0000 7fa49e59c700 1 --2- 172.21.15.72:0/887091879 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa48006ace0 0x7fa48006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:48.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.176+0000 7fa49e59c700 1 --2- 172.21.15.72:0/887091879 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa48006ace0 0x7fa48006d1a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa490009cd0 tx=0x7fa490009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:48.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.179+0000 7fa48effd700 1 -- 172.21.15.72:0/887091879 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa494053940 con 0x7fa4a00c4760 2023-07-27T20:31:48.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.379+0000 7fa4a49ff700 1 -- 172.21.15.72:0/887091879 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4a0154240 con 0x7fa4a00c4760 2023-07-27T20:31:48.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.380+0000 7fa48effd700 1 -- 172.21.15.72:0/887091879 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20120 (secure 0 0 0) 0x7fa494017070 con 0x7fa4a00c4760 2023-07-27T20:31:48.368 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:31:48.368 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:31:33.647304+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:31:27.020951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T20:31:27.566022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-27T20:31:31.182401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:31:48.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.383+0000 7fa4a49ff700 1 -- 172.21.15.72:0/887091879 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa48006ace0 msgr2=0x7fa48006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:48.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.383+0000 7fa4a49ff700 1 --2- 172.21.15.72:0/887091879 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa48006ace0 0x7fa48006d1a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa490009cd0 tx=0x7fa490009210 comp rx=0 tx=0).stop 2023-07-27T20:31:48.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.383+0000 7fa4a49ff700 1 -- 172.21.15.72:0/887091879 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4a00c4760 msgr2=0x7fa4a014ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:48.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.383+0000 7fa4a49ff700 1 --2- 172.21.15.72:0/887091879 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4a00c4760 0x7fa4a014ffc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa49400c700 tx=0x7fa49400ca10 comp rx=0 tx=0).stop 2023-07-27T20:31:48.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.383+0000 7fa4a49ff700 1 -- 172.21.15.72:0/887091879 shutdown_connections 2023-07-27T20:31:48.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.383+0000 7fa4a49ff700 1 --2- 172.21.15.72:0/887091879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4a0151630 0x7fa4a01ed230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:48.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.383+0000 7fa4a49ff700 1 --2- 172.21.15.72:0/887091879 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa48006ace0 0x7fa48006d1a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:48.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.383+0000 7fa4a49ff700 1 --2- 172.21.15.72:0/887091879 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa4a00c42b0 0x7fa4a01ea040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:48.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.383+0000 7fa4a49ff700 1 --2- 172.21.15.72:0/887091879 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4a00c4760 0x7fa4a014ffc0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:48.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.383+0000 7fa4a49ff700 1 -- 172.21.15.72:0/887091879 >> 172.21.15.72:0/887091879 conn(0x7fa4a0071ce0 msgr2=0x7fa4a00bc860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:48.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.383+0000 7fa4a49ff700 1 -- 172.21.15.72:0/887091879 shutdown_connections 2023-07-27T20:31:48.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.383+0000 7fa4a49ff700 1 -- 172.21.15.72:0/887091879 wait complete. 2023-07-27T20:31:48.389 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:31:48.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.599+0000 7fb305dff700 1 Processor -- start 2023-07-27T20:31:48.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.599+0000 7fb305dff700 1 -- start start 2023-07-27T20:31:48.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.600+0000 7fb305dff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb3000c4400 0x7fb3000c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:48.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.600+0000 7fb305dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb30006b150 0x7fb3000c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:48.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.600+0000 7fb305dff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3000c5230 con 0x7fb3001549f0 2023-07-27T20:31:48.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.600+0000 7fb305dff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3001545d0 con 0x7fb3000c4400 2023-07-27T20:31:48.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.600+0000 7fb305dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb30006c860 con 0x7fb30006b150 2023-07-27T20:31:48.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.601+0000 7fb2ff7fe700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb3000c4400 0x7fb3000c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:48.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.601+0000 7fb2feffd700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb30006b150 0x7fb3000c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:48.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.601+0000 7fb2ff7fe700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb3000c4400 0x7fb3000c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.72:43704/0 (socket says 172.21.15.72:43704) 2023-07-27T20:31:48.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.601+0000 7fb2ff7fe700 1 -- 172.21.15.72:0/3577641214 learned_addr learned my addr 172.21.15.72:0/3577641214 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:48.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.601+0000 7fb2feffd700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb30006b150 0x7fb3000c4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.72:44588/0 (socket says 172.21.15.72:44588) 2023-07-27T20:31:48.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.601+0000 7fb2fe7fc700 1 -- 172.21.15.72:0/3577641214 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1106171392 0 0) 0x7fb3000c5230 con 0x7fb3001549f0 2023-07-27T20:31:48.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.601+0000 7fb2fe7fc700 1 -- 172.21.15.72:0/3577641214 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2e80035b0 con 0x7fb3001549f0 2023-07-27T20:31:48.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.601+0000 7fb2ff7fe700 1 -- 172.21.15.72:0/3577641214 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb30006b150 msgr2=0x7fb3000c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:48.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.601+0000 7fb2ff7fe700 1 --2- 172.21.15.72:0/3577641214 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb30006b150 0x7fb3000c4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:48.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.601+0000 7fb2ff7fe700 1 -- 172.21.15.72:0/3577641214 >> v1:172.21.15.173:6789/0 conn(0x7fb3001549f0 legacy=0x7fb3001514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:48.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.601+0000 7fb2ff7fe700 1 -- 172.21.15.72:0/3577641214 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb30006b710 con 0x7fb3000c4400 2023-07-27T20:31:48.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.601+0000 7fb2feffd700 1 --2- 172.21.15.72:0/3577641214 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb30006b150 0x7fb3000c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:31:48.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.602+0000 7fb2ff7fe700 1 --2- 172.21.15.72:0/3577641214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3000c4400 0x7fb3000c7710 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0009920 tx=0x7fb2f0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5062c90e4971e2bf server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:48.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.602+0000 7fb2fe7fc700 1 -- 172.21.15.72:0/3577641214 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f0011830 con 0x7fb3000c4400 2023-07-27T20:31:48.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.602+0000 7fb2fe7fc700 1 -- 172.21.15.72:0/3577641214 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f0011990 con 0x7fb3000c4400 2023-07-27T20:31:48.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.602+0000 7fb2fe7fc700 1 -- 172.21.15.72:0/3577641214 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f0011d20 con 0x7fb3000c4400 2023-07-27T20:31:48.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.602+0000 7fb305dff700 1 -- 172.21.15.72:0/3577641214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3000c4400 msgr2=0x7fb3000c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:48.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.602+0000 7fb305dff700 1 --2- 172.21.15.72:0/3577641214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3000c4400 0x7fb3000c7710 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0009920 tx=0x7fb2f0009c30 comp rx=0 tx=0).stop 2023-07-27T20:31:48.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.603+0000 7fb305dff700 1 -- 172.21.15.72:0/3577641214 shutdown_connections 2023-07-27T20:31:48.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.603+0000 7fb305dff700 1 --2- 172.21.15.72:0/3577641214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3000c4400 0x7fb3000c7710 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:48.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.603+0000 7fb305dff700 1 --2- 172.21.15.72:0/3577641214 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb30006b150 0x7fb3000c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:48.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.603+0000 7fb305dff700 1 -- 172.21.15.72:0/3577641214 >> 172.21.15.72:0/3577641214 conn(0x7fb3000ab300 msgr2=0x7fb3000ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:48.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.603+0000 7fb305dff700 1 -- 172.21.15.72:0/3577641214 shutdown_connections 2023-07-27T20:31:48.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.603+0000 7fb305dff700 1 -- 172.21.15.72:0/3577641214 wait complete. 2023-07-27T20:31:48.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.604+0000 7fb305dff700 1 Processor -- start 2023-07-27T20:31:48.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.604+0000 7fb305dff700 1 -- start start 2023-07-27T20:31:48.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.605+0000 7fb305dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb30006b150 0x7fb3001ec9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:48.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.605+0000 7fb305dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3000c4400 0x7fb3001dedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:48.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.605+0000 7fb305dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3001549f0 0x7fb3001ddcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:48.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.605+0000 7fb305dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb300152090 con 0x7fb3000c4400 2023-07-27T20:31:48.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.605+0000 7fb305dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3000aa720 con 0x7fb3001549f0 2023-07-27T20:31:48.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.605+0000 7fb305dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3001dd580 con 0x7fb30006b150 2023-07-27T20:31:48.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.606+0000 7fb2feffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3000c4400 0x7fb3001dedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:48.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.606+0000 7fb2feffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3000c4400 0x7fb3001dedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50526/0 (socket says 172.21.15.72:50526) 2023-07-27T20:31:48.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.606+0000 7fb2feffd700 1 -- 172.21.15.72:0/290846497 learned_addr learned my addr 172.21.15.72:0/290846497 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:48.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.606+0000 7fb2fffff700 1 --2- 172.21.15.72:0/290846497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3001549f0 0x7fb3001ddcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:48.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.606+0000 7fb2ff7fe700 1 --2- 172.21.15.72:0/290846497 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb30006b150 0x7fb3001ec9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:48.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.606+0000 7fb2feffd700 1 -- 172.21.15.72:0/290846497 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb30006b150 msgr2=0x7fb3001ec9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:48.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.606+0000 7fb2feffd700 1 --2- 172.21.15.72:0/290846497 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb30006b150 0x7fb3001ec9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:48.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.606+0000 7fb2feffd700 1 -- 172.21.15.72:0/290846497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3001549f0 msgr2=0x7fb3001ddcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:48.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.606+0000 7fb2feffd700 1 --2- 172.21.15.72:0/290846497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3001549f0 0x7fb3001ddcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:48.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.606+0000 7fb2feffd700 1 -- 172.21.15.72:0/290846497 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f40094a0 con 0x7fb3000c4400 2023-07-27T20:31:48.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.606+0000 7fb2feffd700 1 --2- 172.21.15.72:0/290846497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3000c4400 0x7fb3001dedb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb2f400ec10 tx=0x7fb2f4009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:48.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.607+0000 7fb2e7fff700 1 -- 172.21.15.72:0/290846497 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f400c940 con 0x7fb3000c4400 2023-07-27T20:31:48.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.607+0000 7fb2e7fff700 1 -- 172.21.15.72:0/290846497 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f400caa0 con 0x7fb3000c4400 2023-07-27T20:31:48.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.607+0000 7fb2e7fff700 1 -- 172.21.15.72:0/290846497 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f400ce10 con 0x7fb3000c4400 2023-07-27T20:31:48.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.607+0000 7fb305dff700 1 -- 172.21.15.72:0/290846497 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f0009550 con 0x7fb3000c4400 2023-07-27T20:31:48.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.607+0000 7fb305dff700 1 -- 172.21.15.72:0/290846497 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3001dd860 con 0x7fb3000c4400 2023-07-27T20:31:48.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.608+0000 7fb305dff700 1 -- 172.21.15.72:0/290846497 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3001dd9f0 con 0x7fb3000c4400 2023-07-27T20:31:48.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.609+0000 7fb2e7fff700 1 -- 172.21.15.72:0/290846497 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb2f4013470 con 0x7fb3000c4400 2023-07-27T20:31:48.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.610+0000 7fb2e7fff700 1 --2- 172.21.15.72:0/290846497 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb2ec06ace0 0x7fb2ec06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:48.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.610+0000 7fb2e7fff700 1 -- 172.21.15.72:0/290846497 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb2f4089930 con 0x7fb3000c4400 2023-07-27T20:31:48.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.610+0000 7fb2ff7fe700 1 --2- 172.21.15.72:0/290846497 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb2ec06ace0 0x7fb2ec06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:48.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.611+0000 7fb2ff7fe700 1 --2- 172.21.15.72:0/290846497 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb2ec06ace0 0x7fb2ec06d1a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0000c00 tx=0x7fb2f0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:48.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.614+0000 7fb2e7fff700 1 -- 172.21.15.72:0/290846497 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb2f40546e0 con 0x7fb3000c4400 2023-07-27T20:31:48.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.808+0000 7fb305dff700 1 -- 172.21.15.72:0/290846497 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb300074310 con 0x7fb3000c4400 2023-07-27T20:31:48.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.810+0000 7fb2e7fff700 1 -- 172.21.15.72:0/290846497 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20120 (secure 0 0 0) 0x7fb2f4057d00 con 0x7fb3000c4400 2023-07-27T20:31:48.798 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:31:48.798 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:31:33.647304+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:31:27.020951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T20:31:27.566022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-27T20:31:31.182401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:31:48.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.812+0000 7fb305dff700 1 -- 172.21.15.72:0/290846497 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb2ec06ace0 msgr2=0x7fb2ec06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:48.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.812+0000 7fb305dff700 1 --2- 172.21.15.72:0/290846497 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb2ec06ace0 0x7fb2ec06d1a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0000c00 tx=0x7fb2f0008030 comp rx=0 tx=0).stop 2023-07-27T20:31:48.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.812+0000 7fb305dff700 1 -- 172.21.15.72:0/290846497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3000c4400 msgr2=0x7fb3001dedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:48.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.812+0000 7fb305dff700 1 --2- 172.21.15.72:0/290846497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3000c4400 0x7fb3001dedb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb2f400ec10 tx=0x7fb2f4009ec0 comp rx=0 tx=0).stop 2023-07-27T20:31:48.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.812+0000 7fb305dff700 1 -- 172.21.15.72:0/290846497 shutdown_connections 2023-07-27T20:31:48.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.812+0000 7fb305dff700 1 --2- 172.21.15.72:0/290846497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3001549f0 0x7fb3001ddcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:48.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.812+0000 7fb305dff700 1 --2- 172.21.15.72:0/290846497 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb2ec06ace0 0x7fb2ec06d1a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:48.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.812+0000 7fb305dff700 1 --2- 172.21.15.72:0/290846497 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb30006b150 0x7fb3001ec9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:48.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.812+0000 7fb305dff700 1 --2- 172.21.15.72:0/290846497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3000c4400 0x7fb3001dedb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:48.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.812+0000 7fb305dff700 1 -- 172.21.15.72:0/290846497 >> 172.21.15.72:0/290846497 conn(0x7fb3000ab300 msgr2=0x7fb300154e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:48.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.812+0000 7fb305dff700 1 -- 172.21.15.72:0/290846497 shutdown_connections 2023-07-27T20:31:48.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:48.812+0000 7fb305dff700 1 -- 172.21.15.72:0/290846497 wait complete. 2023-07-27T20:31:48.818 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-27T20:31:49.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.029+0000 7f8d92dff700 1 Processor -- start 2023-07-27T20:31:49.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.029+0000 7f8d92dff700 1 -- start start 2023-07-27T20:31:49.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.030+0000 7f8d92dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8d8c0c77c0 0x7f8d8c151210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:49.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.030+0000 7f8d92dff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8d8c151750 0x7f8d8c0c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:49.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.030+0000 7f8d92dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d8c06d1c0 con 0x7f8d8c06ffc0 2023-07-27T20:31:49.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.030+0000 7f8d92dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d8c155070 con 0x7f8d8c0c77c0 2023-07-27T20:31:49.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.030+0000 7f8d92dff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d8c0c7360 con 0x7f8d8c151750 2023-07-27T20:31:49.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.030+0000 7f8d90b9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8d8c0c77c0 0x7f8d8c151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:49.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.030+0000 7f8d90b9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8d8c0c77c0 0x7f8d8c151210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50528/0 (socket says 172.21.15.72:50528) 2023-07-27T20:31:49.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.030+0000 7f8d90b9b700 1 -- 172.21.15.72:0/325148357 learned_addr learned my addr 172.21.15.72:0/325148357 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:49.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.031+0000 7f8d9139c700 1 --2- 172.21.15.72:0/325148357 >> v2:172.21.15.173:3300/0 conn(0x7f8d8c151750 0x7f8d8c0c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:49.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.031+0000 7f8d90b9b700 1 -- 172.21.15.72:0/325148357 >> v2:172.21.15.173:3300/0 conn(0x7f8d8c151750 msgr2=0x7f8d8c0c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:49.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.031+0000 7f8d90b9b700 1 --2- 172.21.15.72:0/325148357 >> v2:172.21.15.173:3300/0 conn(0x7f8d8c151750 0x7f8d8c0c6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:49.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.031+0000 7f8d90b9b700 1 -- 172.21.15.72:0/325148357 >> v1:172.21.15.72:6789/0 conn(0x7f8d8c06ffc0 legacy=0x7f8d8c0c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:49.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.031+0000 7f8d90b9b700 1 -- 172.21.15.72:0/325148357 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d8c06ce90 con 0x7f8d8c0c77c0 2023-07-27T20:31:49.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.031+0000 7f8d8b7fe700 1 -- 172.21.15.72:0/325148357 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2602052910 0 0) 0x7f8d8c06d1c0 con 0x7f8d8c06ffc0 2023-07-27T20:31:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.031+0000 7f8d90b9b700 1 --2- 172.21.15.72:0/325148357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d8c0c77c0 0x7f8d8c151210 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c0ad970 tx=0x7f8d80009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3cea6d8f920af7a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.031+0000 7f8d8b7fe700 1 -- 172.21.15.72:0/325148357 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8000b870 con 0x7f8d8c0c77c0 2023-07-27T20:31:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.031+0000 7f8d8b7fe700 1 -- 172.21.15.72:0/325148357 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d8000b9d0 con 0x7f8d8c0c77c0 2023-07-27T20:31:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.031+0000 7f8d8b7fe700 1 -- 172.21.15.72:0/325148357 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8000bd60 con 0x7f8d8c0c77c0 2023-07-27T20:31:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.032+0000 7f8d92dff700 1 -- 172.21.15.72:0/325148357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d8c0c77c0 msgr2=0x7f8d8c151210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.032+0000 7f8d92dff700 1 --2- 172.21.15.72:0/325148357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d8c0c77c0 0x7f8d8c151210 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c0ad970 tx=0x7f8d80009bd0 comp rx=0 tx=0).stop 2023-07-27T20:31:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.032+0000 7f8d92dff700 1 -- 172.21.15.72:0/325148357 shutdown_connections 2023-07-27T20:31:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.032+0000 7f8d92dff700 1 --2- 172.21.15.72:0/325148357 >> v2:172.21.15.173:3300/0 conn(0x7f8d8c151750 0x7f8d8c0c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:49.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.032+0000 7f8d92dff700 1 --2- 172.21.15.72:0/325148357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d8c0c77c0 0x7f8d8c151210 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:49.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.032+0000 7f8d92dff700 1 -- 172.21.15.72:0/325148357 >> 172.21.15.72:0/325148357 conn(0x7f8d8c06a190 msgr2=0x7f8d8c06a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:49.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.032+0000 7f8d92dff700 1 -- 172.21.15.72:0/325148357 shutdown_connections 2023-07-27T20:31:49.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.032+0000 7f8d92dff700 1 -- 172.21.15.72:0/325148357 wait complete. 2023-07-27T20:31:49.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.034+0000 7f8d92dff700 1 Processor -- start 2023-07-27T20:31:49.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.034+0000 7f8d92dff700 1 -- start start 2023-07-27T20:31:49.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.035+0000 7f8d92dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d8c06ffc0 0x7f8d8c0bd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:49.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.035+0000 7f8d92dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d8c0c77c0 0x7f8d8c0be8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:49.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.035+0000 7f8d92dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8d8c151750 0x7f8d8c152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:49.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.035+0000 7f8d92dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c0be640 con 0x7f8d8c0c77c0 2023-07-27T20:31:49.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.035+0000 7f8d92dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c1537f0 con 0x7f8d8c06ffc0 2023-07-27T20:31:49.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.035+0000 7f8d92dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c0bdd00 con 0x7f8d8c151750 2023-07-27T20:31:49.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.035+0000 7f8d8bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d8c0c77c0 0x7f8d8c0be8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:49.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.035+0000 7f8d8bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d8c0c77c0 0x7f8d8c0be8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50542/0 (socket says 172.21.15.72:50542) 2023-07-27T20:31:49.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.035+0000 7f8d8bfff700 1 -- 172.21.15.72:0/3112250200 learned_addr learned my addr 172.21.15.72:0/3112250200 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:49.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.035+0000 7f8d90b9b700 1 --2- 172.21.15.72:0/3112250200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d8c06ffc0 0x7f8d8c0bd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:49.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.035+0000 7f8d9139c700 1 --2- 172.21.15.72:0/3112250200 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8d8c151750 0x7f8d8c152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:49.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.036+0000 7f8d8bfff700 1 -- 172.21.15.72:0/3112250200 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8d8c151750 msgr2=0x7f8d8c152c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:49.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.036+0000 7f8d8bfff700 1 --2- 172.21.15.72:0/3112250200 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8d8c151750 0x7f8d8c152c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:49.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.036+0000 7f8d8bfff700 1 -- 172.21.15.72:0/3112250200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d8c06ffc0 msgr2=0x7f8d8c0bd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:49.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.036+0000 7f8d8bfff700 1 --2- 172.21.15.72:0/3112250200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d8c06ffc0 0x7f8d8c0bd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:49.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.036+0000 7f8d8bfff700 1 -- 172.21.15.72:0/3112250200 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d80009550 con 0x7f8d8c0c77c0 2023-07-27T20:31:49.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.036+0000 7f8d8bfff700 1 --2- 172.21.15.72:0/3112250200 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d8c0c77c0 0x7f8d8c0be8d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8d7800c520 tx=0x7f8d7800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:49.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.036+0000 7f8d897fa700 1 -- 172.21.15.72:0/3112250200 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d780054e0 con 0x7f8d8c0c77c0 2023-07-27T20:31:49.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.036+0000 7f8d897fa700 1 -- 172.21.15.72:0/3112250200 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d78003680 con 0x7f8d8c0c77c0 2023-07-27T20:31:49.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.036+0000 7f8d92dff700 1 -- 172.21.15.72:0/3112250200 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d8c1ed6b0 con 0x7f8d8c0c77c0 2023-07-27T20:31:49.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.036+0000 7f8d897fa700 1 -- 172.21.15.72:0/3112250200 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d78003a30 con 0x7f8d8c0c77c0 2023-07-27T20:31:49.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.036+0000 7f8d92dff700 1 -- 172.21.15.72:0/3112250200 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d8c0be2d0 con 0x7f8d8c0c77c0 2023-07-27T20:31:49.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.037+0000 7f8d92dff700 1 -- 172.21.15.72:0/3112250200 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d8c0be490 con 0x7f8d8c0c77c0 2023-07-27T20:31:49.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.038+0000 7f8d897fa700 1 -- 172.21.15.72:0/3112250200 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8d78003b90 con 0x7f8d8c0c77c0 2023-07-27T20:31:49.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.039+0000 7f8d897fa700 1 --2- 172.21.15.72:0/3112250200 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8d7006ace0 0x7f8d7006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:49.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.039+0000 7f8d897fa700 1 -- 172.21.15.72:0/3112250200 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8d78088bc0 con 0x7f8d8c0c77c0 2023-07-27T20:31:49.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.040+0000 7f8d90b9b700 1 --2- 172.21.15.72:0/3112250200 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8d7006ace0 0x7f8d7006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:49.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.040+0000 7f8d90b9b700 1 --2- 172.21.15.72:0/3112250200 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8d7006ace0 0x7f8d7006d1a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8d80009c10 tx=0x7f8d80008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:49.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.043+0000 7f8d897fa700 1 -- 172.21.15.72:0/3112250200 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8d78053970 con 0x7f8d8c0c77c0 2023-07-27T20:31:49.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:49.291+0000 7f8d92dff700 1 -- 172.21.15.72:0/3112250200 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8d8c0be130 con 0x7f8d8c0c77c0 2023-07-27T20:31:50.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.215+0000 7f8d897fa700 1 -- 172.21.15.72:0/3112250200 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8d8c0be130 con 0x7f8d8c0c77c0 2023-07-27T20:31:50.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.219+0000 7f8d92dff700 1 -- 172.21.15.72:0/3112250200 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8d7006ace0 msgr2=0x7f8d7006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:50.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.219+0000 7f8d92dff700 1 --2- 172.21.15.72:0/3112250200 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8d7006ace0 0x7f8d7006d1a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8d80009c10 tx=0x7f8d80008030 comp rx=0 tx=0).stop 2023-07-27T20:31:50.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.219+0000 7f8d92dff700 1 -- 172.21.15.72:0/3112250200 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d8c0c77c0 msgr2=0x7f8d8c0be8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:50.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.219+0000 7f8d92dff700 1 --2- 172.21.15.72:0/3112250200 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d8c0c77c0 0x7f8d8c0be8d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8d7800c520 tx=0x7f8d7800c830 comp rx=0 tx=0).stop 2023-07-27T20:31:50.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.219+0000 7f8d92dff700 1 -- 172.21.15.72:0/3112250200 shutdown_connections 2023-07-27T20:31:50.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.219+0000 7f8d92dff700 1 --2- 172.21.15.72:0/3112250200 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8d7006ace0 0x7f8d7006d1a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:50.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.219+0000 7f8d92dff700 1 --2- 172.21.15.72:0/3112250200 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8d8c151750 0x7f8d8c152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:50.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.219+0000 7f8d92dff700 1 --2- 172.21.15.72:0/3112250200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d8c06ffc0 0x7f8d8c0bd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:50.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.219+0000 7f8d92dff700 1 --2- 172.21.15.72:0/3112250200 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d8c0c77c0 0x7f8d8c0be8d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:50.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.219+0000 7f8d92dff700 1 -- 172.21.15.72:0/3112250200 >> 172.21.15.72:0/3112250200 conn(0x7f8d8c06a190 msgr2=0x7f8d8c0a8610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:50.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.219+0000 7f8d92dff700 1 -- 172.21.15.72:0/3112250200 shutdown_connections 2023-07-27T20:31:50.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.220+0000 7f8d92dff700 1 -- 172.21.15.72:0/3112250200 wait complete. 2023-07-27T20:31:50.228 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-07-27T20:31:50.229 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-27T20:31:50.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.442+0000 7fc2ce9ff700 1 Processor -- start 2023-07-27T20:31:50.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.442+0000 7fc2ce9ff700 1 -- start start 2023-07-27T20:31:50.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.443+0000 7fc2ce9ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc2c81475a0 0x7fc2c81516c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:50.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.444+0000 7fc2ce9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2c8154f50 con 0x7fc2c80716f0 2023-07-27T20:31:50.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.444+0000 7fc2ce9ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2c8154340 con 0x7fc2c80c12f0 2023-07-27T20:31:50.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.444+0000 7fc2ce9ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2c8151c00 con 0x7fc2c81475a0 2023-07-27T20:31:50.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.444+0000 7fc2ccf9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc2c80716f0 0x7fc2c8071b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55380/0 (socket says 172.21.15.72:55380) 2023-07-27T20:31:50.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.444+0000 7fc2ccf9c700 1 -- 172.21.15.72:0/3511848514 learned_addr learned my addr 172.21.15.72:0/3511848514 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:50.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.444+0000 7fc2c7fff700 1 --2- 172.21.15.72:0/3511848514 >> v2:172.21.15.173:3300/0 conn(0x7fc2c81475a0 0x7fc2c81516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:50.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.444+0000 7fc2c77fe700 1 -- 172.21.15.72:0/3511848514 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2982369296 0 0) 0x7fc2c8154f50 con 0x7fc2c80716f0 2023-07-27T20:31:50.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.444+0000 7fc2c77fe700 1 -- 172.21.15.72:0/3511848514 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2b40035b0 con 0x7fc2c80716f0 2023-07-27T20:31:50.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.444+0000 7fc2c7fff700 1 -- 172.21.15.72:0/3511848514 >> v1:172.21.15.173:6789/0 conn(0x7fc2c80c12f0 legacy=0x7fc2c80c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:50.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.445+0000 7fc2c7fff700 1 -- 172.21.15.72:0/3511848514 >> v1:172.21.15.72:6789/0 conn(0x7fc2c80716f0 legacy=0x7fc2c8071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:50.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.445+0000 7fc2c77fe700 1 -- 172.21.15.72:0/3511848514 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2971941401 0 0) 0x7fc2b40035b0 con 0x7fc2c80716f0 2023-07-27T20:31:50.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.445+0000 7fc2c7fff700 1 -- 172.21.15.72:0/3511848514 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c8154620 con 0x7fc2c81475a0 2023-07-27T20:31:50.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.445+0000 7fc2c7fff700 1 --2- 172.21.15.72:0/3511848514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2c81475a0 0x7fc2c81516c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8009840 tx=0x7fc2b8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b06e37cae66bc3d8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:50.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.445+0000 7fc2c77fe700 1 -- 172.21.15.72:0/3511848514 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c00019f0 con 0x7fc2c81475a0 2023-07-27T20:31:50.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.445+0000 7fc2c77fe700 1 -- 172.21.15.72:0/3511848514 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b8004030 con 0x7fc2c81475a0 2023-07-27T20:31:50.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.445+0000 7fc2c77fe700 1 -- 172.21.15.72:0/3511848514 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b80043a0 con 0x7fc2c81475a0 2023-07-27T20:31:50.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.445+0000 7fc2ce9ff700 1 -- 172.21.15.72:0/3511848514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2c81475a0 msgr2=0x7fc2c81516c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:50.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.446+0000 7fc2ce9ff700 1 --2- 172.21.15.72:0/3511848514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2c81475a0 0x7fc2c81516c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8009840 tx=0x7fc2b8009b50 comp rx=0 tx=0).stop 2023-07-27T20:31:50.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.446+0000 7fc2ce9ff700 1 -- 172.21.15.72:0/3511848514 shutdown_connections 2023-07-27T20:31:50.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.446+0000 7fc2ce9ff700 1 --2- 172.21.15.72:0/3511848514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2c81475a0 0x7fc2c81516c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:50.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.446+0000 7fc2ce9ff700 1 -- 172.21.15.72:0/3511848514 >> 172.21.15.72:0/3511848514 conn(0x7fc2c806a190 msgr2=0x7fc2c806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:50.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.446+0000 7fc2ce9ff700 1 -- 172.21.15.72:0/3511848514 shutdown_connections 2023-07-27T20:31:50.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.446+0000 7fc2ce9ff700 1 -- 172.21.15.72:0/3511848514 wait complete. 2023-07-27T20:31:50.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.447+0000 7fc2ce9ff700 1 Processor -- start 2023-07-27T20:31:50.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.447+0000 7fc2ce9ff700 1 -- start start 2023-07-27T20:31:50.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.448+0000 7fc2ce9ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2c80716f0 0x7fc2c81e89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:50.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.448+0000 7fc2ce9ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc2c80c12f0 0x7fc2c80bea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:50.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.448+0000 7fc2ce9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2c81475a0 0x7fc2c81400c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:50.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.448+0000 7fc2ce9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c80bc630 con 0x7fc2c81475a0 2023-07-27T20:31:50.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.448+0000 7fc2ce9ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c80bd9a0 con 0x7fc2c80716f0 2023-07-27T20:31:50.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.448+0000 7fc2ce9ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c8140c60 con 0x7fc2c80c12f0 2023-07-27T20:31:50.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.449+0000 7fc2ccf9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2c81475a0 0x7fc2c81400c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:50.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.449+0000 7fc2ccf9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2c81475a0 0x7fc2c81400c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58350/0 (socket says 172.21.15.72:58350) 2023-07-27T20:31:50.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.449+0000 7fc2ccf9c700 1 -- 172.21.15.72:0/2104551191 learned_addr learned my addr 172.21.15.72:0/2104551191 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:50.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.449+0000 7fc2c7fff700 1 --2- 172.21.15.72:0/2104551191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2c80716f0 0x7fc2c81e89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:50.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.449+0000 7fc2bffff700 1 --2- 172.21.15.72:0/2104551191 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc2c80c12f0 0x7fc2c80bea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:50.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.449+0000 7fc2ccf9c700 1 -- 172.21.15.72:0/2104551191 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc2c80c12f0 msgr2=0x7fc2c80bea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:50.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.449+0000 7fc2ccf9c700 1 --2- 172.21.15.72:0/2104551191 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc2c80c12f0 0x7fc2c80bea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:50.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.449+0000 7fc2ccf9c700 1 -- 172.21.15.72:0/2104551191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2c80716f0 msgr2=0x7fc2c81e89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:50.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.449+0000 7fc2ccf9c700 1 --2- 172.21.15.72:0/2104551191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2c80716f0 0x7fc2c81e89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:50.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.449+0000 7fc2ccf9c700 1 -- 172.21.15.72:0/2104551191 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b80094a0 con 0x7fc2c81475a0 2023-07-27T20:31:50.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.449+0000 7fc2bffff700 1 --2- 172.21.15.72:0/2104551191 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc2c80c12f0 0x7fc2c80bea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:31:50.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.449+0000 7fc2ccf9c700 1 --2- 172.21.15.72:0/2104551191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2c81475a0 0x7fc2c81400c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc2c000cc90 tx=0x7fc2c000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:50.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.450+0000 7fc2c57fa700 1 -- 172.21.15.72:0/2104551191 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c000ab80 con 0x7fc2c81475a0 2023-07-27T20:31:50.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.450+0000 7fc2c57fa700 1 -- 172.21.15.72:0/2104551191 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c000ace0 con 0x7fc2c81475a0 2023-07-27T20:31:50.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.450+0000 7fc2c57fa700 1 -- 172.21.15.72:0/2104551191 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c0007310 con 0x7fc2c81475a0 2023-07-27T20:31:50.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.450+0000 7fc2ce9ff700 1 -- 172.21.15.72:0/2104551191 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2c81e9300 con 0x7fc2c81475a0 2023-07-27T20:31:50.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.450+0000 7fc2ce9ff700 1 -- 172.21.15.72:0/2104551191 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2c81e95e0 con 0x7fc2c81475a0 2023-07-27T20:31:50.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.451+0000 7fc2ce9ff700 1 -- 172.21.15.72:0/2104551191 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2c80bc7a0 con 0x7fc2c81475a0 2023-07-27T20:31:50.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.452+0000 7fc2c57fa700 1 -- 172.21.15.72:0/2104551191 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc2c0007470 con 0x7fc2c81475a0 2023-07-27T20:31:50.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.452+0000 7fc2c57fa700 1 --2- 172.21.15.72:0/2104551191 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc2a806ad10 0x7fc2a806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:50.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.453+0000 7fc2c57fa700 1 -- 172.21.15.72:0/2104551191 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc2c0089320 con 0x7fc2c81475a0 2023-07-27T20:31:50.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.453+0000 7fc2c7fff700 1 --2- 172.21.15.72:0/2104551191 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc2a806ad10 0x7fc2a806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:50.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.454+0000 7fc2c7fff700 1 --2- 172.21.15.72:0/2104551191 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc2a806ad10 0x7fc2a806d1d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc2b80090b0 tx=0x7fc2b8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:50.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.457+0000 7fc2c57fa700 1 -- 172.21.15.72:0/2104551191 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc2c80bc7a0 con 0x7fc2c81475a0 2023-07-27T20:31:50.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:50.697+0000 7fc2ce9ff700 1 -- 172.21.15.72:0/2104551191 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc2c80bc770 con 0x7fc2c81475a0 2023-07-27T20:31:51.092 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:31:51.096 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:31:51.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.224+0000 7fc2c57fa700 1 -- 172.21.15.72:0/2104551191 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc2c00540d0 con 0x7fc2c81475a0 2023-07-27T20:31:51.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.226+0000 7fc2ce9ff700 1 -- 172.21.15.72:0/2104551191 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc2a806ad10 msgr2=0x7fc2a806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:51.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.226+0000 7fc2ce9ff700 1 --2- 172.21.15.72:0/2104551191 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc2a806ad10 0x7fc2a806d1d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc2b80090b0 tx=0x7fc2b8008030 comp rx=0 tx=0).stop 2023-07-27T20:31:51.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.226+0000 7fc2ce9ff700 1 -- 172.21.15.72:0/2104551191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2c81475a0 msgr2=0x7fc2c81400c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:51.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.226+0000 7fc2ce9ff700 1 --2- 172.21.15.72:0/2104551191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2c81475a0 0x7fc2c81400c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc2c000cc90 tx=0x7fc2c000a060 comp rx=0 tx=0).stop 2023-07-27T20:31:51.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.226+0000 7fc2ce9ff700 1 -- 172.21.15.72:0/2104551191 shutdown_connections 2023-07-27T20:31:51.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.226+0000 7fc2ce9ff700 1 --2- 172.21.15.72:0/2104551191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2c81475a0 0x7fc2c81400c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:51.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.226+0000 7fc2ce9ff700 1 --2- 172.21.15.72:0/2104551191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2c80716f0 0x7fc2c81e89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:51.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.226+0000 7fc2ce9ff700 1 --2- 172.21.15.72:0/2104551191 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc2a806ad10 0x7fc2a806d1d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:51.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.226+0000 7fc2ce9ff700 1 --2- 172.21.15.72:0/2104551191 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc2c80c12f0 0x7fc2c80bea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:51.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.226+0000 7fc2ce9ff700 1 -- 172.21.15.72:0/2104551191 >> 172.21.15.72:0/2104551191 conn(0x7fc2c806a190 msgr2=0x7fc2c8145440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:51.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.226+0000 7fc2ce9ff700 1 -- 172.21.15.72:0/2104551191 shutdown_connections 2023-07-27T20:31:51.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.226+0000 7fc2ce9ff700 1 -- 172.21.15.72:0/2104551191 wait complete. 2023-07-27T20:31:51.231 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-27T20:31:51.232 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T20:31:51.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.479+0000 7f84661ff700 1 Processor -- start 2023-07-27T20:31:51.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.479+0000 7f84661ff700 1 -- start start 2023-07-27T20:31:51.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.480+0000 7f84661ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84600c4400 0x7f84600c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:51.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.480+0000 7f84661ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f846006b710 con 0x7f846006b150 2023-07-27T20:31:51.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.480+0000 7f84661ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f846006b9f0 con 0x7f84601549f0 2023-07-27T20:31:51.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.480+0000 7f84661ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84601545d0 con 0x7f84600c4400 2023-07-27T20:31:51.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.480+0000 7f845effd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f846006b150 0x7f84600c4cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55382/0 (socket says 172.21.15.72:55382) 2023-07-27T20:31:51.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.481+0000 7f845effd700 1 -- 172.21.15.72:0/697756724 learned_addr learned my addr 172.21.15.72:0/697756724 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:51.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.481+0000 7f845f7fe700 1 --2- 172.21.15.72:0/697756724 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84600c4400 0x7f84600c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:51.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.481+0000 7f845e7fc700 1 -- 172.21.15.72:0/697756724 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3655625588 0 0) 0x7f846006b710 con 0x7f846006b150 2023-07-27T20:31:51.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.481+0000 7f845e7fc700 1 -- 172.21.15.72:0/697756724 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84480035b0 con 0x7f846006b150 2023-07-27T20:31:51.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.481+0000 7f845e7fc700 1 -- 172.21.15.72:0/697756724 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1915974270 0 0) 0x7f846006b9f0 con 0x7f84601549f0 2023-07-27T20:31:51.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.481+0000 7f845e7fc700 1 -- 172.21.15.72:0/697756724 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f846006b710 con 0x7f84601549f0 2023-07-27T20:31:51.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.481+0000 7f845f7fe700 1 -- 172.21.15.72:0/697756724 >> v1:172.21.15.173:6789/0 conn(0x7f84601549f0 legacy=0x7f84601514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:51.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.481+0000 7f845f7fe700 1 -- 172.21.15.72:0/697756724 >> v1:172.21.15.72:6789/0 conn(0x7f846006b150 legacy=0x7f84600c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:51.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.481+0000 7f845e7fc700 1 -- 172.21.15.72:0/697756724 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1758949850 0 0) 0x7f84480035b0 con 0x7f846006b150 2023-07-27T20:31:51.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.481+0000 7f845f7fe700 1 -- 172.21.15.72:0/697756724 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846006bcd0 con 0x7f84600c4400 2023-07-27T20:31:51.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.482+0000 7f845f7fe700 1 --2- 172.21.15.72:0/697756724 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84600c4400 0x7f84600c7710 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8450009870 tx=0x7f8450009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=849d18e43928317a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:51.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.482+0000 7f845e7fc700 1 -- 172.21.15.72:0/697756724 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8454001670 con 0x7f84600c4400 2023-07-27T20:31:51.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.482+0000 7f845e7fc700 1 -- 172.21.15.72:0/697756724 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8450004030 con 0x7f84600c4400 2023-07-27T20:31:51.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.482+0000 7f845e7fc700 1 -- 172.21.15.72:0/697756724 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84500043c0 con 0x7f84600c4400 2023-07-27T20:31:51.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.482+0000 7f84661ff700 1 -- 172.21.15.72:0/697756724 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84600c4400 msgr2=0x7f84600c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:51.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.482+0000 7f84661ff700 1 --2- 172.21.15.72:0/697756724 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84600c4400 0x7f84600c7710 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8450009870 tx=0x7f8450009b80 comp rx=0 tx=0).stop 2023-07-27T20:31:51.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.482+0000 7f84661ff700 1 -- 172.21.15.72:0/697756724 shutdown_connections 2023-07-27T20:31:51.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.482+0000 7f84661ff700 1 --2- 172.21.15.72:0/697756724 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84600c4400 0x7f84600c7710 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:51.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.482+0000 7f84661ff700 1 -- 172.21.15.72:0/697756724 >> 172.21.15.72:0/697756724 conn(0x7f84600ab300 msgr2=0x7f84600ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:51.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.482+0000 7f84661ff700 1 -- 172.21.15.72:0/697756724 shutdown_connections 2023-07-27T20:31:51.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.483+0000 7f84661ff700 1 -- 172.21.15.72:0/697756724 wait complete. 2023-07-27T20:31:51.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.484+0000 7f84661ff700 1 Processor -- start 2023-07-27T20:31:51.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.484+0000 7f84661ff700 1 -- start start 2023-07-27T20:31:51.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.485+0000 7f84661ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f846006b150 0x7f84601498f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:51.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.485+0000 7f84661ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84600c4400 0x7f84600aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:51.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.485+0000 7f84661ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84601549f0 0x7f84601e9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:51.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.485+0000 7f84661ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8460149760 con 0x7f84601549f0 2023-07-27T20:31:51.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.485+0000 7f84661ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846014cd10 con 0x7f846006b150 2023-07-27T20:31:51.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.485+0000 7f84661ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f846014c230 con 0x7f84600c4400 2023-07-27T20:31:51.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.486+0000 7f845ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84601549f0 0x7f84601e9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:51.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.486+0000 7f845f7fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f846006b150 0x7f84601498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:51.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.486+0000 7f845ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84601549f0 0x7f84601e9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58366/0 (socket says 172.21.15.72:58366) 2023-07-27T20:31:51.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.486+0000 7f845ffff700 1 -- 172.21.15.72:0/1542191641 learned_addr learned my addr 172.21.15.72:0/1542191641 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:51.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.486+0000 7f845effd700 1 --2- 172.21.15.72:0/1542191641 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84600c4400 0x7f84600aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:51.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.486+0000 7f845ffff700 1 -- 172.21.15.72:0/1542191641 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84600c4400 msgr2=0x7f84600aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:51.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.486+0000 7f845ffff700 1 --2- 172.21.15.72:0/1542191641 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84600c4400 0x7f84600aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:51.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.486+0000 7f845ffff700 1 -- 172.21.15.72:0/1542191641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f846006b150 msgr2=0x7f84601498f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:51.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.486+0000 7f845ffff700 1 --2- 172.21.15.72:0/1542191641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f846006b150 0x7f84601498f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:51.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.486+0000 7f845ffff700 1 -- 172.21.15.72:0/1542191641 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84500094a0 con 0x7f84601549f0 2023-07-27T20:31:51.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.486+0000 7f845ffff700 1 --2- 172.21.15.72:0/1542191641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84601549f0 0x7f84601e9910 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f845800cbf0 tx=0x7f845800cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:51.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.486+0000 7f8447fff700 1 -- 172.21.15.72:0/1542191641 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8458003c00 con 0x7f84601549f0 2023-07-27T20:31:51.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.487+0000 7f8447fff700 1 -- 172.21.15.72:0/1542191641 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8458003d60 con 0x7f84601549f0 2023-07-27T20:31:51.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.487+0000 7f84661ff700 1 -- 172.21.15.72:0/1542191641 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84600c02a0 con 0x7f84601549f0 2023-07-27T20:31:51.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.487+0000 7f8447fff700 1 -- 172.21.15.72:0/1542191641 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845800aa60 con 0x7f84601549f0 2023-07-27T20:31:51.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.487+0000 7f84661ff700 1 -- 172.21.15.72:0/1542191641 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f846014c760 con 0x7f84601549f0 2023-07-27T20:31:51.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.488+0000 7f84661ff700 1 -- 172.21.15.72:0/1542191641 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f846004e470 con 0x7f84601549f0 2023-07-27T20:31:51.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.489+0000 7f8447fff700 1 -- 172.21.15.72:0/1542191641 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f845800abc0 con 0x7f84601549f0 2023-07-27T20:31:51.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.489+0000 7f8447fff700 1 --2- 172.21.15.72:0/1542191641 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f844c06ace0 0x7f844c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:51.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.490+0000 7f8447fff700 1 -- 172.21.15.72:0/1542191641 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8458089750 con 0x7f84601549f0 2023-07-27T20:31:51.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.490+0000 7f845f7fe700 1 --2- 172.21.15.72:0/1542191641 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f844c06ace0 0x7f844c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:51.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.491+0000 7f845f7fe700 1 --2- 172.21.15.72:0/1542191641 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f844c06ace0 0x7f844c06d1a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f84500097c0 tx=0x7f8450008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:51.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.494+0000 7f8447fff700 1 -- 172.21.15.72:0/1542191641 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8458054500 con 0x7f84601549f0 2023-07-27T20:31:51.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.733+0000 7f84661ff700 1 -- 172.21.15.72:0/1542191641 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8460074310 con 0x7f84601549f0 2023-07-27T20:31:51.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.734+0000 7f8447fff700 1 -- 172.21.15.72:0/1542191641 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f8458057b20 con 0x7f84601549f0 2023-07-27T20:31:51.722 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:31:51.722 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/1913374698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1913374698},{"type":"v1","addr":"172.21.15.72:6834","nonce":1913374698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/3260445560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":3260445560},{"type":"v1","addr":"172.21.15.72:6835","nonce":3260445560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1305837931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1305837931},{"type":"v1","addr":"172.21.15.173:6837","nonce":1305837931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T20:31:28.592113+0000","modified":"2023-07-27T20:31:51.217923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6835/516740687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":516740687},{"type":"v1","addr":"172.21.15.173:6835","nonce":516740687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-27T20:31:51.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.736+0000 7f84661ff700 1 -- 172.21.15.72:0/1542191641 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f844c06ace0 msgr2=0x7f844c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:51.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.736+0000 7f84661ff700 1 --2- 172.21.15.72:0/1542191641 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f844c06ace0 0x7f844c06d1a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f84500097c0 tx=0x7f8450008030 comp rx=0 tx=0).stop 2023-07-27T20:31:51.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.736+0000 7f84661ff700 1 -- 172.21.15.72:0/1542191641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84601549f0 msgr2=0x7f84601e9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:51.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.736+0000 7f84661ff700 1 --2- 172.21.15.72:0/1542191641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84601549f0 0x7f84601e9910 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f845800cbf0 tx=0x7f845800cf00 comp rx=0 tx=0).stop 2023-07-27T20:31:51.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.736+0000 7f84661ff700 1 -- 172.21.15.72:0/1542191641 shutdown_connections 2023-07-27T20:31:51.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.736+0000 7f84661ff700 1 --2- 172.21.15.72:0/1542191641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84601549f0 0x7f84601e9910 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:51.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.736+0000 7f84661ff700 1 --2- 172.21.15.72:0/1542191641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f846006b150 0x7f84601498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:51.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.736+0000 7f84661ff700 1 --2- 172.21.15.72:0/1542191641 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f844c06ace0 0x7f844c06d1a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:51.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.736+0000 7f84661ff700 1 --2- 172.21.15.72:0/1542191641 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84600c4400 0x7f84600aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:51.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.736+0000 7f84661ff700 1 -- 172.21.15.72:0/1542191641 >> 172.21.15.72:0/1542191641 conn(0x7f84600ab300 msgr2=0x7f8460151270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:51.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.736+0000 7f84661ff700 1 -- 172.21.15.72:0/1542191641 shutdown_connections 2023-07-27T20:31:51.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.736+0000 7f84661ff700 1 -- 172.21.15.72:0/1542191641 wait complete. 2023-07-27T20:31:51.728 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 9 2023-07-27T20:31:51.742 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:31:51.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.949+0000 7efdeddff700 1 Processor -- start 2023-07-27T20:31:51.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.949+0000 7efdeddff700 1 -- start start 2023-07-27T20:31:51.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.950+0000 7efdeddff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efde80c7710 0x7efde81514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:51.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.950+0000 7efdeddff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde8155100 con 0x7efde806b150 2023-07-27T20:31:51.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.950+0000 7efdeddff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde80c7b20 con 0x7efde80c4400 2023-07-27T20:31:51.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.950+0000 7efdeddff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde81545d0 con 0x7efde80c7710 2023-07-27T20:31:51.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.951+0000 7efddffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7efde806b150 0x7efde81549f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55396/0 (socket says 172.21.15.72:55396) 2023-07-27T20:31:51.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.951+0000 7efddffff700 1 -- 172.21.15.72:0/4045111844 learned_addr learned my addr 172.21.15.72:0/4045111844 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:51.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.951+0000 7efde7fff700 1 --2- 172.21.15.72:0/4045111844 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efde80c7710 0x7efde81514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:51.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.951+0000 7efde6ffd700 1 -- 172.21.15.72:0/4045111844 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1913261751 0 0) 0x7efde8155100 con 0x7efde806b150 2023-07-27T20:31:51.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.951+0000 7efde6ffd700 1 -- 172.21.15.72:0/4045111844 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdd40035b0 con 0x7efde806b150 2023-07-27T20:31:51.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.951+0000 7efde6ffd700 1 -- 172.21.15.72:0/4045111844 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1713050949 0 0) 0x7efde80c7b20 con 0x7efde80c4400 2023-07-27T20:31:51.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.951+0000 7efde6ffd700 1 -- 172.21.15.72:0/4045111844 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efde8155100 con 0x7efde80c4400 2023-07-27T20:31:51.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.951+0000 7efde6ffd700 1 -- 172.21.15.72:0/4045111844 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3858306596 0 0) 0x7efdd40035b0 con 0x7efde806b150 2023-07-27T20:31:51.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.951+0000 7efde7fff700 1 -- 172.21.15.72:0/4045111844 >> v1:172.21.15.173:6789/0 conn(0x7efde80c4400 legacy=0x7efde80c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:51.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.951+0000 7efde7fff700 1 -- 172.21.15.72:0/4045111844 >> v1:172.21.15.72:6789/0 conn(0x7efde806b150 legacy=0x7efde81549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:51.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.951+0000 7efde7fff700 1 -- 172.21.15.72:0/4045111844 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde806b710 con 0x7efde80c7710 2023-07-27T20:31:51.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.952+0000 7efde7fff700 1 --2- 172.21.15.72:0/4045111844 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efde80c7710 0x7efde81514a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efde0009dc0 tx=0x7efde000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3397cc0b174b5466 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:51.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.952+0000 7efde6ffd700 1 -- 172.21.15.72:0/4045111844 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde000e070 con 0x7efde80c7710 2023-07-27T20:31:51.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.952+0000 7efde6ffd700 1 -- 172.21.15.72:0/4045111844 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde0003a20 con 0x7efde80c7710 2023-07-27T20:31:51.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.952+0000 7efde6ffd700 1 -- 172.21.15.72:0/4045111844 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd0001670 con 0x7efde80c7710 2023-07-27T20:31:51.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.952+0000 7efdeddff700 1 -- 172.21.15.72:0/4045111844 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efde80c7710 msgr2=0x7efde81514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:51.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.952+0000 7efdeddff700 1 --2- 172.21.15.72:0/4045111844 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efde80c7710 0x7efde81514a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efde0009dc0 tx=0x7efde000b330 comp rx=0 tx=0).stop 2023-07-27T20:31:51.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.953+0000 7efdeddff700 1 -- 172.21.15.72:0/4045111844 shutdown_connections 2023-07-27T20:31:51.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.953+0000 7efdeddff700 1 --2- 172.21.15.72:0/4045111844 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efde80c7710 0x7efde81514a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:51.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.953+0000 7efdeddff700 1 -- 172.21.15.72:0/4045111844 >> 172.21.15.72:0/4045111844 conn(0x7efde80ab300 msgr2=0x7efde80ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:51.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.953+0000 7efdeddff700 1 -- 172.21.15.72:0/4045111844 shutdown_connections 2023-07-27T20:31:51.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.953+0000 7efdeddff700 1 -- 172.21.15.72:0/4045111844 wait complete. 2023-07-27T20:31:51.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.954+0000 7efdeddff700 1 Processor -- start 2023-07-27T20:31:51.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.955+0000 7efdeddff700 1 -- start start 2023-07-27T20:31:51.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.955+0000 7efdeddff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efde806b150 0x7efde80ac640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:51.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.955+0000 7efdeddff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efde80c4400 0x7efde8151ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:51.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.955+0000 7efdeddff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efde80c7710 0x7efde81e9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:51.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.955+0000 7efdeddff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde81ed260 con 0x7efde806b150 2023-07-27T20:31:51.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.955+0000 7efdeddff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde81e74e0 con 0x7efde80c7710 2023-07-27T20:31:51.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.955+0000 7efdeddff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde81ea110 con 0x7efde80c4400 2023-07-27T20:31:51.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.956+0000 7efde77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efde806b150 0x7efde80ac640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:51.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.956+0000 7efde77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efde806b150 0x7efde80ac640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58380/0 (socket says 172.21.15.72:58380) 2023-07-27T20:31:51.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.956+0000 7efde77fe700 1 -- 172.21.15.72:0/1860762701 learned_addr learned my addr 172.21.15.72:0/1860762701 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:51.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.956+0000 7efddffff700 1 --2- 172.21.15.72:0/1860762701 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efde80c4400 0x7efde8151ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:51.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.956+0000 7efde7fff700 1 --2- 172.21.15.72:0/1860762701 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efde80c7710 0x7efde81e9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:51.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.956+0000 7efde77fe700 1 -- 172.21.15.72:0/1860762701 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efde80c4400 msgr2=0x7efde8151ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:51.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.956+0000 7efde77fe700 1 --2- 172.21.15.72:0/1860762701 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efde80c4400 0x7efde8151ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:51.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.956+0000 7efde77fe700 1 -- 172.21.15.72:0/1860762701 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efde80c7710 msgr2=0x7efde81e9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:51.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.956+0000 7efde77fe700 1 --2- 172.21.15.72:0/1860762701 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efde80c7710 0x7efde81e9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:51.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.956+0000 7efde77fe700 1 -- 172.21.15.72:0/1860762701 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde0009a70 con 0x7efde806b150 2023-07-27T20:31:51.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.956+0000 7efde7fff700 1 --2- 172.21.15.72:0/1860762701 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efde80c7710 0x7efde81e9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:31:51.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.956+0000 7efddffff700 1 --2- 172.21.15.72:0/1860762701 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efde80c4400 0x7efde8151ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:31:51.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.956+0000 7efde77fe700 1 --2- 172.21.15.72:0/1860762701 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efde806b150 0x7efde80ac640 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efdd800c520 tx=0x7efdd800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:51.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.956+0000 7efde4ff9700 1 -- 172.21.15.72:0/1860762701 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd80052d0 con 0x7efde806b150 2023-07-27T20:31:51.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.956+0000 7efde4ff9700 1 -- 172.21.15.72:0/1860762701 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd8005430 con 0x7efde806b150 2023-07-27T20:31:51.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.956+0000 7efde4ff9700 1 -- 172.21.15.72:0/1860762701 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd80038c0 con 0x7efde806b150 2023-07-27T20:31:51.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.956+0000 7efdeddff700 1 -- 172.21.15.72:0/1860762701 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efde81ea3f0 con 0x7efde806b150 2023-07-27T20:31:51.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.957+0000 7efdeddff700 1 -- 172.21.15.72:0/1860762701 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde8152000 con 0x7efde806b150 2023-07-27T20:31:51.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.958+0000 7efdeddff700 1 -- 172.21.15.72:0/1860762701 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efde8074310 con 0x7efde806b150 2023-07-27T20:31:51.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.958+0000 7efde4ff9700 1 -- 172.21.15.72:0/1860762701 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efdd8003a20 con 0x7efde806b150 2023-07-27T20:31:51.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.959+0000 7efde4ff9700 1 --2- 172.21.15.72:0/1860762701 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7efdc806ace0 0x7efdc806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:51.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.959+0000 7efde4ff9700 1 -- 172.21.15.72:0/1860762701 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efdd8088d90 con 0x7efde806b150 2023-07-27T20:31:51.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.960+0000 7efddffff700 1 --2- 172.21.15.72:0/1860762701 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7efdc806ace0 0x7efdc806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:51.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.960+0000 7efddffff700 1 --2- 172.21.15.72:0/1860762701 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7efdc806ace0 0x7efdc806d1a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efde80ab2d0 tx=0x7efdd0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:51.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:51.963+0000 7efde4ff9700 1 -- 172.21.15.72:0/1860762701 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7efdd8053b40 con 0x7efde806b150 2023-07-27T20:31:52.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.159+0000 7efdeddff700 1 -- 172.21.15.72:0/1860762701 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efde80c3bd0 con 0x7efde806b150 2023-07-27T20:31:52.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.161+0000 7efde4ff9700 1 -- 172.21.15.72:0/1860762701 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20120 (secure 0 0 0) 0x7efdd8057160 con 0x7efde806b150 2023-07-27T20:31:52.149 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:31:52.149 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:31:33.647304+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:31:27.020951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T20:31:27.566022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-27T20:31:31.182401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:31:52.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.163+0000 7efdeddff700 1 -- 172.21.15.72:0/1860762701 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7efdc806ace0 msgr2=0x7efdc806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:52.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.163+0000 7efdeddff700 1 --2- 172.21.15.72:0/1860762701 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7efdc806ace0 0x7efdc806d1a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efde80ab2d0 tx=0x7efdd0009040 comp rx=0 tx=0).stop 2023-07-27T20:31:52.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.163+0000 7efdeddff700 1 -- 172.21.15.72:0/1860762701 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efde806b150 msgr2=0x7efde80ac640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:52.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.163+0000 7efdeddff700 1 --2- 172.21.15.72:0/1860762701 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efde806b150 0x7efde80ac640 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efdd800c520 tx=0x7efdd800c8e0 comp rx=0 tx=0).stop 2023-07-27T20:31:52.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.163+0000 7efdeddff700 1 -- 172.21.15.72:0/1860762701 shutdown_connections 2023-07-27T20:31:52.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.163+0000 7efdeddff700 1 --2- 172.21.15.72:0/1860762701 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efde80c7710 0x7efde81e9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:52.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.163+0000 7efdeddff700 1 --2- 172.21.15.72:0/1860762701 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efde806b150 0x7efde80ac640 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:52.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.163+0000 7efdeddff700 1 --2- 172.21.15.72:0/1860762701 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7efdc806ace0 0x7efdc806d1a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:52.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.163+0000 7efdeddff700 1 --2- 172.21.15.72:0/1860762701 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efde80c4400 0x7efde8151ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:52.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.163+0000 7efdeddff700 1 -- 172.21.15.72:0/1860762701 >> 172.21.15.72:0/1860762701 conn(0x7efde80ab300 msgr2=0x7efde8152d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:52.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.163+0000 7efdeddff700 1 -- 172.21.15.72:0/1860762701 shutdown_connections 2023-07-27T20:31:52.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.163+0000 7efdeddff700 1 -- 172.21.15.72:0/1860762701 wait complete. 2023-07-27T20:31:52.169 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-27T20:31:52.170 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T20:31:52.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.378+0000 7f14f13ff700 1 Processor -- start 2023-07-27T20:31:52.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.378+0000 7f14f13ff700 1 -- start start 2023-07-27T20:31:52.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.379+0000 7f14f13ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f14ec0c1fb0 0x7f14ec0c39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:52.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.380+0000 7f14f13ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14ec0a99e0 con 0x7f14ec0a9570 2023-07-27T20:31:52.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.380+0000 7f14f13ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14ec154ba0 con 0x7f14ec0a9190 2023-07-27T20:31:52.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.380+0000 7f14f13ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14ec0c2ea0 con 0x7f14ec0c1fb0 2023-07-27T20:31:52.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.380+0000 7f14eb7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f14ec0a9570 0x7f14ec157dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55402/0 (socket says 172.21.15.72:55402) 2023-07-27T20:31:52.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.380+0000 7f14eb7fe700 1 -- 172.21.15.72:0/1721514407 learned_addr learned my addr 172.21.15.72:0/1721514407 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:52.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.380+0000 7f14e3fff700 1 --2- 172.21.15.72:0/1721514407 >> v2:172.21.15.173:3300/0 conn(0x7f14ec0c1fb0 0x7f14ec0c39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:52.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.380+0000 7f14ea7fc700 1 -- 172.21.15.72:0/1721514407 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1511693645 0 0) 0x7f14ec0a99e0 con 0x7f14ec0a9570 2023-07-27T20:31:52.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.380+0000 7f14ea7fc700 1 -- 172.21.15.72:0/1721514407 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14d80035b0 con 0x7f14ec0a9570 2023-07-27T20:31:52.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.380+0000 7f14ea7fc700 1 -- 172.21.15.72:0/1721514407 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2361698762 0 0) 0x7f14d80035b0 con 0x7f14ec0a9570 2023-07-27T20:31:52.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.381+0000 7f14e3fff700 1 -- 172.21.15.72:0/1721514407 >> v1:172.21.15.173:6789/0 conn(0x7f14ec0a9190 legacy=0x7f14ec1576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:52.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.381+0000 7f14e3fff700 1 -- 172.21.15.72:0/1721514407 >> v1:172.21.15.72:6789/0 conn(0x7f14ec0a9570 legacy=0x7f14ec157dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:52.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.381+0000 7f14e3fff700 1 -- 172.21.15.72:0/1721514407 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ec154e80 con 0x7f14ec0c1fb0 2023-07-27T20:31:52.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.381+0000 7f14e3fff700 1 --2- 172.21.15.72:0/1721514407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14ec0c1fb0 0x7f14ec0c39d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f14d4009840 tx=0x7f14d4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5374984d49a50b1b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:52.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.381+0000 7f14ea7fc700 1 -- 172.21.15.72:0/1721514407 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e40019f0 con 0x7f14ec0c1fb0 2023-07-27T20:31:52.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.381+0000 7f14ea7fc700 1 -- 172.21.15.72:0/1721514407 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d4004030 con 0x7f14ec0c1fb0 2023-07-27T20:31:52.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.381+0000 7f14ea7fc700 1 -- 172.21.15.72:0/1721514407 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d40043a0 con 0x7f14ec0c1fb0 2023-07-27T20:31:52.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.382+0000 7f14f13ff700 1 -- 172.21.15.72:0/1721514407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14ec0c1fb0 msgr2=0x7f14ec0c39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:52.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.382+0000 7f14f13ff700 1 --2- 172.21.15.72:0/1721514407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14ec0c1fb0 0x7f14ec0c39d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f14d4009840 tx=0x7f14d4009b50 comp rx=0 tx=0).stop 2023-07-27T20:31:52.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.382+0000 7f14f13ff700 1 -- 172.21.15.72:0/1721514407 shutdown_connections 2023-07-27T20:31:52.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.382+0000 7f14f13ff700 1 --2- 172.21.15.72:0/1721514407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14ec0c1fb0 0x7f14ec0c39d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:52.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.382+0000 7f14f13ff700 1 -- 172.21.15.72:0/1721514407 >> 172.21.15.72:0/1721514407 conn(0x7f14ec06a7c0 msgr2=0x7f14ec0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:52.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.382+0000 7f14f13ff700 1 -- 172.21.15.72:0/1721514407 shutdown_connections 2023-07-27T20:31:52.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.382+0000 7f14f13ff700 1 -- 172.21.15.72:0/1721514407 wait complete. 2023-07-27T20:31:52.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.383+0000 7f14f13ff700 1 Processor -- start 2023-07-27T20:31:52.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.384+0000 7f14f13ff700 1 -- start start 2023-07-27T20:31:52.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.384+0000 7f14f13ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14ec0a9190 0x7f14ec06cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:52.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.384+0000 7f14f13ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14ec0a9570 0x7f14ec1eaf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:52.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.384+0000 7f14f13ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f14ec0c7630 0x7f14ec1eb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:52.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.384+0000 7f14f13ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec1ed810 con 0x7f14ec0a9190 2023-07-27T20:31:52.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.384+0000 7f14f13ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec0a5fc0 con 0x7f14ec0a9570 2023-07-27T20:31:52.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.384+0000 7f14f13ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec0a62a0 con 0x7f14ec0c7630 2023-07-27T20:31:52.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.385+0000 7f14eaffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14ec0a9190 0x7f14ec06cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:52.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.385+0000 7f14eaffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14ec0a9190 0x7f14ec06cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58390/0 (socket says 172.21.15.72:58390) 2023-07-27T20:31:52.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.385+0000 7f14eaffd700 1 -- 172.21.15.72:0/4027367877 learned_addr learned my addr 172.21.15.72:0/4027367877 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:52.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.385+0000 7f14e3fff700 1 --2- 172.21.15.72:0/4027367877 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14ec0a9570 0x7f14ec1eaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:52.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.385+0000 7f14eb7fe700 1 --2- 172.21.15.72:0/4027367877 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f14ec0c7630 0x7f14ec1eb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:52.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.385+0000 7f14eaffd700 1 -- 172.21.15.72:0/4027367877 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f14ec0c7630 msgr2=0x7f14ec1eb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:52.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.385+0000 7f14eaffd700 1 --2- 172.21.15.72:0/4027367877 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f14ec0c7630 0x7f14ec1eb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:52.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.385+0000 7f14eaffd700 1 -- 172.21.15.72:0/4027367877 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14ec0a9570 msgr2=0x7f14ec1eaf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:52.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.385+0000 7f14eaffd700 1 --2- 172.21.15.72:0/4027367877 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14ec0a9570 0x7f14ec1eaf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:52.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.385+0000 7f14eaffd700 1 -- 172.21.15.72:0/4027367877 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d40094a0 con 0x7f14ec0a9190 2023-07-27T20:31:52.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.385+0000 7f14eb7fe700 1 --2- 172.21.15.72:0/4027367877 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f14ec0c7630 0x7f14ec1eb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:31:52.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.385+0000 7f14eaffd700 1 --2- 172.21.15.72:0/4027367877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14ec0a9190 0x7f14ec06cb00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f14dc00c4e0 tx=0x7f14dc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:52.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.385+0000 7f14e37fe700 1 -- 172.21.15.72:0/4027367877 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc0052d0 con 0x7f14ec0a9190 2023-07-27T20:31:52.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.386+0000 7f14e37fe700 1 -- 172.21.15.72:0/4027367877 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14dc005430 con 0x7f14ec0a9190 2023-07-27T20:31:52.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.386+0000 7f14e37fe700 1 -- 172.21.15.72:0/4027367877 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc0038c0 con 0x7f14ec0a9190 2023-07-27T20:31:52.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.386+0000 7f14f13ff700 1 -- 172.21.15.72:0/4027367877 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14ec06d040 con 0x7f14ec0a9190 2023-07-27T20:31:52.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.386+0000 7f14f13ff700 1 -- 172.21.15.72:0/4027367877 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14ec14c260 con 0x7f14ec0a9190 2023-07-27T20:31:52.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.387+0000 7f14f13ff700 1 -- 172.21.15.72:0/4027367877 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14ec074310 con 0x7f14ec0a9190 2023-07-27T20:31:52.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.388+0000 7f14e37fe700 1 -- 172.21.15.72:0/4027367877 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f14dc003a20 con 0x7f14ec0a9190 2023-07-27T20:31:52.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.388+0000 7f14e37fe700 1 --2- 172.21.15.72:0/4027367877 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f14cc06ace0 0x7f14cc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:52.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.388+0000 7f14e37fe700 1 -- 172.21.15.72:0/4027367877 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f14dc088ca0 con 0x7f14ec0a9190 2023-07-27T20:31:52.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.389+0000 7f14e3fff700 1 --2- 172.21.15.72:0/4027367877 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f14cc06ace0 0x7f14cc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:52.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.389+0000 7f14e3fff700 1 --2- 172.21.15.72:0/4027367877 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f14cc06ace0 0x7f14cc06d1a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f14d40090b0 tx=0x7f14d4013040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:52.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.393+0000 7f14e37fe700 1 -- 172.21.15.72:0/4027367877 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f14dc053a50 con 0x7f14ec0a9190 2023-07-27T20:31:52.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.586+0000 7f14f13ff700 1 -- 172.21.15.72:0/4027367877 --> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f14ec0a6130 con 0x7f14cc06ace0 2023-07-27T20:31:52.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.600+0000 7f14e37fe700 1 -- 172.21.15.72:0/4027367877 <== mgr.4107 v2:172.21.15.173:6832/910681537 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367430 (secure 0 0 0) 0x7f14ec0a6130 con 0x7f14cc06ace0 2023-07-27T20:31:52.593 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:31:52.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.605+0000 7f14f13ff700 1 -- 172.21.15.72:0/4027367877 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f14cc06ace0 msgr2=0x7f14cc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:52.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.605+0000 7f14f13ff700 1 --2- 172.21.15.72:0/4027367877 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f14cc06ace0 0x7f14cc06d1a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f14d40090b0 tx=0x7f14d4013040 comp rx=0 tx=0).stop 2023-07-27T20:31:52.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.605+0000 7f14f13ff700 1 -- 172.21.15.72:0/4027367877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14ec0a9190 msgr2=0x7f14ec06cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:52.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.605+0000 7f14f13ff700 1 --2- 172.21.15.72:0/4027367877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14ec0a9190 0x7f14ec06cb00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f14dc00c4e0 tx=0x7f14dc00c8a0 comp rx=0 tx=0).stop 2023-07-27T20:31:52.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.605+0000 7f14f13ff700 1 -- 172.21.15.72:0/4027367877 shutdown_connections 2023-07-27T20:31:52.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.605+0000 7f14f13ff700 1 --2- 172.21.15.72:0/4027367877 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f14cc06ace0 0x7f14cc06d1a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:52.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.605+0000 7f14f13ff700 1 --2- 172.21.15.72:0/4027367877 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f14ec0c7630 0x7f14ec1eb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:52.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.605+0000 7f14f13ff700 1 --2- 172.21.15.72:0/4027367877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14ec0a9190 0x7f14ec06cb00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:52.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.605+0000 7f14f13ff700 1 --2- 172.21.15.72:0/4027367877 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14ec0a9570 0x7f14ec1eaf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:52.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.605+0000 7f14f13ff700 1 -- 172.21.15.72:0/4027367877 >> 172.21.15.72:0/4027367877 conn(0x7f14ec06a7c0 msgr2=0x7f14ec0a8520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:52.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.605+0000 7f14f13ff700 1 -- 172.21.15.72:0/4027367877 shutdown_connections 2023-07-27T20:31:52.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.605+0000 7f14f13ff700 1 -- 172.21.15.72:0/4027367877 wait complete. 2023-07-27T20:31:52.598 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-07-27T20:31:52.611 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2023-07-27T20:31:52.531191+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219676,"kb_used_data":3496,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755044,"statfs":{"total":773094113280,"available":772869165056,"internally_reserved":0,"allocated":3579904,"data_stored":2149128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003529"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964347+0000","last_change":"2023-07-27T20:31:29.128137+0000","last_active":"2023-07-27T20:31:34.964347+0000","last_peered":"2023-07-27T20:31:34.964347+0000","last_clean":"2023-07-27T20:31:34.964347+0000","last_became_active":"2023-07-27T20:31:29.127840+0000","last_became_peered":"2023-07-27T20:31:29.127840+0000","last_unstale":"2023-07-27T20:31:34.964347+0000","last_undegraded":"2023-07-27T20:31:34.964347+0000","last_fullsized":"2023-07-27T20:31:34.964347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:59:36.649918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963365+0000","last_change":"2023-07-27T20:31:29.140868+0000","last_active":"2023-07-27T20:31:34.963365+0000","last_peered":"2023-07-27T20:31:34.963365+0000","last_clean":"2023-07-27T20:31:34.963365+0000","last_became_active":"2023-07-27T20:31:29.140592+0000","last_became_peered":"2023-07-27T20:31:29.140592+0000","last_unstale":"2023-07-27T20:31:34.963365+0000","last_undegraded":"2023-07-27T20:31:34.963365+0000","last_fullsized":"2023-07-27T20:31:34.963365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:48:10.867603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160140+0000","last_change":"2023-07-27T20:31:29.129303+0000","last_active":"2023-07-27T20:31:34.160140+0000","last_peered":"2023-07-27T20:31:34.160140+0000","last_clean":"2023-07-27T20:31:34.160140+0000","last_became_active":"2023-07-27T20:31:29.128569+0000","last_became_peered":"2023-07-27T20:31:29.128569+0000","last_unstale":"2023-07-27T20:31:34.160140+0000","last_undegraded":"2023-07-27T20:31:34.160140+0000","last_fullsized":"2023-07-27T20:31:34.160140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:10:18.495424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.962918+0000","last_change":"2023-07-27T20:31:29.134687+0000","last_active":"2023-07-27T20:31:34.962918+0000","last_peered":"2023-07-27T20:31:34.962918+0000","last_clean":"2023-07-27T20:31:34.962918+0000","last_became_active":"2023-07-27T20:31:29.134388+0000","last_became_peered":"2023-07-27T20:31:29.134388+0000","last_unstale":"2023-07-27T20:31:34.962918+0000","last_undegraded":"2023-07-27T20:31:34.962918+0000","last_fullsized":"2023-07-27T20:31:34.962918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:05:57.560432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158183+0000","last_change":"2023-07-27T20:31:29.127581+0000","last_active":"2023-07-27T20:31:34.158183+0000","last_peered":"2023-07-27T20:31:34.158183+0000","last_clean":"2023-07-27T20:31:34.158183+0000","last_became_active":"2023-07-27T20:31:29.127256+0000","last_became_peered":"2023-07-27T20:31:29.127256+0000","last_unstale":"2023-07-27T20:31:34.158183+0000","last_undegraded":"2023-07-27T20:31:34.158183+0000","last_fullsized":"2023-07-27T20:31:34.158183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:04:20.052228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158888+0000","last_change":"2023-07-27T20:31:29.130522+0000","last_active":"2023-07-27T20:31:34.158888+0000","last_peered":"2023-07-27T20:31:34.158888+0000","last_clean":"2023-07-27T20:31:34.158888+0000","last_became_active":"2023-07-27T20:31:29.129964+0000","last_became_peered":"2023-07-27T20:31:29.129964+0000","last_unstale":"2023-07-27T20:31:34.158888+0000","last_undegraded":"2023-07-27T20:31:34.158888+0000","last_fullsized":"2023-07-27T20:31:34.158888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:32:37.192663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159958+0000","last_change":"2023-07-27T20:31:29.138061+0000","last_active":"2023-07-27T20:31:34.159958+0000","last_peered":"2023-07-27T20:31:34.159958+0000","last_clean":"2023-07-27T20:31:34.159958+0000","last_became_active":"2023-07-27T20:31:29.137407+0000","last_became_peered":"2023-07-27T20:31:29.137407+0000","last_unstale":"2023-07-27T20:31:34.159958+0000","last_undegraded":"2023-07-27T20:31:34.159958+0000","last_fullsized":"2023-07-27T20:31:34.159958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:52:37.919677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.962665+0000","last_change":"2023-07-27T20:31:29.142667+0000","last_active":"2023-07-27T20:31:34.962665+0000","last_peered":"2023-07-27T20:31:34.962665+0000","last_clean":"2023-07-27T20:31:34.962665+0000","last_became_active":"2023-07-27T20:31:29.141164+0000","last_became_peered":"2023-07-27T20:31:29.141164+0000","last_unstale":"2023-07-27T20:31:34.962665+0000","last_undegraded":"2023-07-27T20:31:34.962665+0000","last_fullsized":"2023-07-27T20:31:34.962665+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:32:33.408454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157543+0000","last_change":"2023-07-27T20:31:29.129290+0000","last_active":"2023-07-27T20:31:34.157543+0000","last_peered":"2023-07-27T20:31:34.157543+0000","last_clean":"2023-07-27T20:31:34.157543+0000","last_became_active":"2023-07-27T20:31:29.127546+0000","last_became_peered":"2023-07-27T20:31:29.127546+0000","last_unstale":"2023-07-27T20:31:34.157543+0000","last_undegraded":"2023-07-27T20:31:34.157543+0000","last_fullsized":"2023-07-27T20:31:34.157543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:07:33.134307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963982+0000","last_change":"2023-07-27T20:31:29.146424+0000","last_active":"2023-07-27T20:31:34.963982+0000","last_peered":"2023-07-27T20:31:34.963982+0000","last_clean":"2023-07-27T20:31:34.963982+0000","last_became_active":"2023-07-27T20:31:29.146170+0000","last_became_peered":"2023-07-27T20:31:29.146170+0000","last_unstale":"2023-07-27T20:31:34.963982+0000","last_undegraded":"2023-07-27T20:31:34.963982+0000","last_fullsized":"2023-07-27T20:31:34.963982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:30:09.671437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160355+0000","last_change":"2023-07-27T20:31:29.137685+0000","last_active":"2023-07-27T20:31:34.160355+0000","last_peered":"2023-07-27T20:31:34.160355+0000","last_clean":"2023-07-27T20:31:34.160355+0000","last_became_active":"2023-07-27T20:31:29.130560+0000","last_became_peered":"2023-07-27T20:31:29.130560+0000","last_unstale":"2023-07-27T20:31:34.160355+0000","last_undegraded":"2023-07-27T20:31:34.160355+0000","last_fullsized":"2023-07-27T20:31:34.160355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:11:40.101545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963386+0000","last_change":"2023-07-27T20:31:29.134204+0000","last_active":"2023-07-27T20:31:34.963386+0000","last_peered":"2023-07-27T20:31:34.963386+0000","last_clean":"2023-07-27T20:31:34.963386+0000","last_became_active":"2023-07-27T20:31:29.133944+0000","last_became_peered":"2023-07-27T20:31:29.133944+0000","last_unstale":"2023-07-27T20:31:34.963386+0000","last_undegraded":"2023-07-27T20:31:34.963386+0000","last_fullsized":"2023-07-27T20:31:34.963386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:18:04.393407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964703+0000","last_change":"2023-07-27T20:31:29.126910+0000","last_active":"2023-07-27T20:31:34.964703+0000","last_peered":"2023-07-27T20:31:34.964703+0000","last_clean":"2023-07-27T20:31:34.964703+0000","last_became_active":"2023-07-27T20:31:29.126575+0000","last_became_peered":"2023-07-27T20:31:29.126575+0000","last_unstale":"2023-07-27T20:31:34.964703+0000","last_undegraded":"2023-07-27T20:31:34.964703+0000","last_fullsized":"2023-07-27T20:31:34.964703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:31:04.071892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.962855+0000","last_change":"2023-07-27T20:31:29.139957+0000","last_active":"2023-07-27T20:31:34.962855+0000","last_peered":"2023-07-27T20:31:34.962855+0000","last_clean":"2023-07-27T20:31:34.962855+0000","last_became_active":"2023-07-27T20:31:29.139623+0000","last_became_peered":"2023-07-27T20:31:29.139623+0000","last_unstale":"2023-07-27T20:31:34.962855+0000","last_undegraded":"2023-07-27T20:31:34.962855+0000","last_fullsized":"2023-07-27T20:31:34.962855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:22:49.467838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159607+0000","last_change":"2023-07-27T20:31:29.143739+0000","last_active":"2023-07-27T20:31:34.159607+0000","last_peered":"2023-07-27T20:31:34.159607+0000","last_clean":"2023-07-27T20:31:34.159607+0000","last_became_active":"2023-07-27T20:31:29.143337+0000","last_became_peered":"2023-07-27T20:31:29.143337+0000","last_unstale":"2023-07-27T20:31:34.159607+0000","last_undegraded":"2023-07-27T20:31:34.159607+0000","last_fullsized":"2023-07-27T20:31:34.159607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:24:57.182748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158603+0000","last_change":"2023-07-27T20:31:29.125242+0000","last_active":"2023-07-27T20:31:34.158603+0000","last_peered":"2023-07-27T20:31:34.158603+0000","last_clean":"2023-07-27T20:31:34.158603+0000","last_became_active":"2023-07-27T20:31:29.124967+0000","last_became_peered":"2023-07-27T20:31:29.124967+0000","last_unstale":"2023-07-27T20:31:34.158603+0000","last_undegraded":"2023-07-27T20:31:34.158603+0000","last_fullsized":"2023-07-27T20:31:34.158603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:31:04.269016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157859+0000","last_change":"2023-07-27T20:31:29.127644+0000","last_active":"2023-07-27T20:31:34.157859+0000","last_peered":"2023-07-27T20:31:34.157859+0000","last_clean":"2023-07-27T20:31:34.157859+0000","last_became_active":"2023-07-27T20:31:29.127277+0000","last_became_peered":"2023-07-27T20:31:29.127277+0000","last_unstale":"2023-07-27T20:31:34.157859+0000","last_undegraded":"2023-07-27T20:31:34.157859+0000","last_fullsized":"2023-07-27T20:31:34.157859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:38:08.459694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160497+0000","last_change":"2023-07-27T20:31:29.131333+0000","last_active":"2023-07-27T20:31:34.160497+0000","last_peered":"2023-07-27T20:31:34.160497+0000","last_clean":"2023-07-27T20:31:34.160497+0000","last_became_active":"2023-07-27T20:31:29.131016+0000","last_became_peered":"2023-07-27T20:31:29.131016+0000","last_unstale":"2023-07-27T20:31:34.160497+0000","last_undegraded":"2023-07-27T20:31:34.160497+0000","last_fullsized":"2023-07-27T20:31:34.160497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:22:01.318022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963957+0000","last_change":"2023-07-27T20:31:29.133266+0000","last_active":"2023-07-27T20:31:34.963957+0000","last_peered":"2023-07-27T20:31:34.963957+0000","last_clean":"2023-07-27T20:31:34.963957+0000","last_became_active":"2023-07-27T20:31:29.132915+0000","last_became_peered":"2023-07-27T20:31:29.132915+0000","last_unstale":"2023-07-27T20:31:34.963957+0000","last_undegraded":"2023-07-27T20:31:34.963957+0000","last_fullsized":"2023-07-27T20:31:34.963957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:56:38.159541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158925+0000","last_change":"2023-07-27T20:31:29.141130+0000","last_active":"2023-07-27T20:31:34.158925+0000","last_peered":"2023-07-27T20:31:34.158925+0000","last_clean":"2023-07-27T20:31:34.158925+0000","last_became_active":"2023-07-27T20:31:29.140883+0000","last_became_peered":"2023-07-27T20:31:29.140883+0000","last_unstale":"2023-07-27T20:31:34.158925+0000","last_undegraded":"2023-07-27T20:31:34.158925+0000","last_fullsized":"2023-07-27T20:31:34.158925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:08:14.703624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159167+0000","last_change":"2023-07-27T20:31:29.139144+0000","last_active":"2023-07-27T20:31:34.159167+0000","last_peered":"2023-07-27T20:31:34.159167+0000","last_clean":"2023-07-27T20:31:34.159167+0000","last_became_active":"2023-07-27T20:31:29.137774+0000","last_became_peered":"2023-07-27T20:31:29.137774+0000","last_unstale":"2023-07-27T20:31:34.159167+0000","last_undegraded":"2023-07-27T20:31:34.159167+0000","last_fullsized":"2023-07-27T20:31:34.159167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:21:00.439118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157696+0000","last_change":"2023-07-27T20:31:29.131957+0000","last_active":"2023-07-27T20:31:34.157696+0000","last_peered":"2023-07-27T20:31:34.157696+0000","last_clean":"2023-07-27T20:31:34.157696+0000","last_became_active":"2023-07-27T20:31:29.131512+0000","last_became_peered":"2023-07-27T20:31:29.131512+0000","last_unstale":"2023-07-27T20:31:34.157696+0000","last_undegraded":"2023-07-27T20:31:34.157696+0000","last_fullsized":"2023-07-27T20:31:34.157696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:41:18.405424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964757+0000","last_change":"2023-07-27T20:31:29.130648+0000","last_active":"2023-07-27T20:31:34.964757+0000","last_peered":"2023-07-27T20:31:34.964757+0000","last_clean":"2023-07-27T20:31:34.964757+0000","last_became_active":"2023-07-27T20:31:29.130145+0000","last_became_peered":"2023-07-27T20:31:29.130145+0000","last_unstale":"2023-07-27T20:31:34.964757+0000","last_undegraded":"2023-07-27T20:31:34.964757+0000","last_fullsized":"2023-07-27T20:31:34.964757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:25:53.220364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159388+0000","last_change":"2023-07-27T20:31:29.138599+0000","last_active":"2023-07-27T20:31:34.159388+0000","last_peered":"2023-07-27T20:31:34.159388+0000","last_clean":"2023-07-27T20:31:34.159388+0000","last_became_active":"2023-07-27T20:31:29.138323+0000","last_became_peered":"2023-07-27T20:31:29.138323+0000","last_unstale":"2023-07-27T20:31:34.159388+0000","last_undegraded":"2023-07-27T20:31:34.159388+0000","last_fullsized":"2023-07-27T20:31:34.159388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:03:16.615704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965611+0000","last_change":"2023-07-27T20:31:29.136600+0000","last_active":"2023-07-27T20:31:34.965611+0000","last_peered":"2023-07-27T20:31:34.965611+0000","last_clean":"2023-07-27T20:31:34.965611+0000","last_became_active":"2023-07-27T20:31:29.136316+0000","last_became_peered":"2023-07-27T20:31:29.136316+0000","last_unstale":"2023-07-27T20:31:34.965611+0000","last_undegraded":"2023-07-27T20:31:34.965611+0000","last_fullsized":"2023-07-27T20:31:34.965611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:46:44.091855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963642+0000","last_change":"2023-07-27T20:31:29.135116+0000","last_active":"2023-07-27T20:31:34.963642+0000","last_peered":"2023-07-27T20:31:34.963642+0000","last_clean":"2023-07-27T20:31:34.963642+0000","last_became_active":"2023-07-27T20:31:29.134786+0000","last_became_peered":"2023-07-27T20:31:29.134786+0000","last_unstale":"2023-07-27T20:31:34.963642+0000","last_undegraded":"2023-07-27T20:31:34.963642+0000","last_fullsized":"2023-07-27T20:31:34.963642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:21:00.439118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963660+0000","last_change":"2023-07-27T20:31:29.145388+0000","last_active":"2023-07-27T20:31:34.963660+0000","last_peered":"2023-07-27T20:31:34.963660+0000","last_clean":"2023-07-27T20:31:34.963660+0000","last_became_active":"2023-07-27T20:31:29.141813+0000","last_became_peered":"2023-07-27T20:31:29.141813+0000","last_unstale":"2023-07-27T20:31:34.963660+0000","last_undegraded":"2023-07-27T20:31:34.963660+0000","last_fullsized":"2023-07-27T20:31:34.963660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:52:37.919677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159610+0000","last_change":"2023-07-27T20:31:33.179641+0000","last_active":"2023-07-27T20:31:34.159610+0000","last_peered":"2023-07-27T20:31:34.159610+0000","last_clean":"2023-07-27T20:31:34.159610+0000","last_became_active":"2023-07-27T20:31:33.179219+0000","last_became_peered":"2023-07-27T20:31:33.179219+0000","last_unstale":"2023-07-27T20:31:34.159610+0000","last_undegraded":"2023-07-27T20:31:34.159610+0000","last_fullsized":"2023-07-27T20:31:34.159610+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:22:32.926771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158940+0000","last_change":"2023-07-27T20:31:28.123712+0000","last_active":"2023-07-27T20:31:34.158940+0000","last_peered":"2023-07-27T20:31:34.158940+0000","last_clean":"2023-07-27T20:31:34.158940+0000","last_became_active":"2023-07-27T20:31:28.123425+0000","last_became_peered":"2023-07-27T20:31:28.123425+0000","last_unstale":"2023-07-27T20:31:34.158940+0000","last_undegraded":"2023-07-27T20:31:34.158940+0000","last_fullsized":"2023-07-27T20:31:34.158940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:26:08.939256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964276+0000","last_change":"2023-07-27T20:31:29.130374+0000","last_active":"2023-07-27T20:31:34.964276+0000","last_peered":"2023-07-27T20:31:34.964276+0000","last_clean":"2023-07-27T20:31:34.964276+0000","last_became_active":"2023-07-27T20:31:29.130099+0000","last_became_peered":"2023-07-27T20:31:29.130099+0000","last_unstale":"2023-07-27T20:31:34.964276+0000","last_undegraded":"2023-07-27T20:31:34.964276+0000","last_fullsized":"2023-07-27T20:31:34.964276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:17:03.497602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963430+0000","last_change":"2023-07-27T20:31:33.178251+0000","last_active":"2023-07-27T20:31:34.963430+0000","last_peered":"2023-07-27T20:31:34.963430+0000","last_clean":"2023-07-27T20:31:34.963430+0000","last_became_active":"2023-07-27T20:31:33.177826+0000","last_became_peered":"2023-07-27T20:31:33.177826+0000","last_unstale":"2023-07-27T20:31:34.963430+0000","last_undegraded":"2023-07-27T20:31:34.963430+0000","last_fullsized":"2023-07-27T20:31:34.963430+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:59:12.877709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.962935+0000","last_change":"2023-07-27T20:31:28.123837+0000","last_active":"2023-07-27T20:31:34.962935+0000","last_peered":"2023-07-27T20:31:34.962935+0000","last_clean":"2023-07-27T20:31:34.962935+0000","last_became_active":"2023-07-27T20:31:28.123456+0000","last_became_peered":"2023-07-27T20:31:28.123456+0000","last_unstale":"2023-07-27T20:31:34.962935+0000","last_undegraded":"2023-07-27T20:31:34.962935+0000","last_fullsized":"2023-07-27T20:31:34.962935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:56:54.247350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158484+0000","last_change":"2023-07-27T20:31:29.141212+0000","last_active":"2023-07-27T20:31:34.158484+0000","last_peered":"2023-07-27T20:31:34.158484+0000","last_clean":"2023-07-27T20:31:34.158484+0000","last_became_active":"2023-07-27T20:31:29.140956+0000","last_became_peered":"2023-07-27T20:31:29.140956+0000","last_unstale":"2023-07-27T20:31:34.158484+0000","last_undegraded":"2023-07-27T20:31:34.158484+0000","last_fullsized":"2023-07-27T20:31:34.158484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:43:10.912905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158360+0000","last_change":"2023-07-27T20:31:33.182932+0000","last_active":"2023-07-27T20:31:34.158360+0000","last_peered":"2023-07-27T20:31:34.158360+0000","last_clean":"2023-07-27T20:31:34.158360+0000","last_became_active":"2023-07-27T20:31:33.182477+0000","last_became_peered":"2023-07-27T20:31:33.182477+0000","last_unstale":"2023-07-27T20:31:34.158360+0000","last_undegraded":"2023-07-27T20:31:34.158360+0000","last_fullsized":"2023-07-27T20:31:34.158360+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:25:57.270856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965391+0000","last_change":"2023-07-27T20:31:28.120846+0000","last_active":"2023-07-27T20:31:34.965391+0000","last_peered":"2023-07-27T20:31:34.965391+0000","last_clean":"2023-07-27T20:31:34.965391+0000","last_became_active":"2023-07-27T20:31:28.120544+0000","last_became_peered":"2023-07-27T20:31:28.120544+0000","last_unstale":"2023-07-27T20:31:34.965391+0000","last_undegraded":"2023-07-27T20:31:34.965391+0000","last_fullsized":"2023-07-27T20:31:34.965391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:17:24.488257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963834+0000","last_change":"2023-07-27T20:31:29.144062+0000","last_active":"2023-07-27T20:31:34.963834+0000","last_peered":"2023-07-27T20:31:34.963834+0000","last_clean":"2023-07-27T20:31:34.963834+0000","last_became_active":"2023-07-27T20:31:29.143781+0000","last_became_peered":"2023-07-27T20:31:29.143781+0000","last_unstale":"2023-07-27T20:31:34.963834+0000","last_undegraded":"2023-07-27T20:31:34.963834+0000","last_fullsized":"2023-07-27T20:31:34.963834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:17:24.376438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963333+0000","last_change":"2023-07-27T20:31:33.185760+0000","last_active":"2023-07-27T20:31:34.963333+0000","last_peered":"2023-07-27T20:31:34.963333+0000","last_clean":"2023-07-27T20:31:34.963333+0000","last_became_active":"2023-07-27T20:31:33.185326+0000","last_became_peered":"2023-07-27T20:31:33.185326+0000","last_unstale":"2023-07-27T20:31:34.963333+0000","last_undegraded":"2023-07-27T20:31:34.963333+0000","last_fullsized":"2023-07-27T20:31:34.963333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:13:18.283879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157795+0000","last_change":"2023-07-27T20:31:28.130352+0000","last_active":"2023-07-27T20:31:34.157795+0000","last_peered":"2023-07-27T20:31:34.157795+0000","last_clean":"2023-07-27T20:31:34.157795+0000","last_became_active":"2023-07-27T20:31:28.130107+0000","last_became_peered":"2023-07-27T20:31:28.130107+0000","last_unstale":"2023-07-27T20:31:34.157795+0000","last_undegraded":"2023-07-27T20:31:34.157795+0000","last_fullsized":"2023-07-27T20:31:34.157795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:32:39.371251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965281+0000","last_change":"2023-07-27T20:31:29.130936+0000","last_active":"2023-07-27T20:31:34.965281+0000","last_peered":"2023-07-27T20:31:34.965281+0000","last_clean":"2023-07-27T20:31:34.965281+0000","last_became_active":"2023-07-27T20:31:29.130687+0000","last_became_peered":"2023-07-27T20:31:29.130687+0000","last_unstale":"2023-07-27T20:31:34.965281+0000","last_undegraded":"2023-07-27T20:31:34.965281+0000","last_fullsized":"2023-07-27T20:31:34.965281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:26:00.598434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158984+0000","last_change":"2023-07-27T20:31:33.180364+0000","last_active":"2023-07-27T20:31:34.158984+0000","last_peered":"2023-07-27T20:31:34.158984+0000","last_clean":"2023-07-27T20:31:34.158984+0000","last_became_active":"2023-07-27T20:31:33.179972+0000","last_became_peered":"2023-07-27T20:31:33.179972+0000","last_unstale":"2023-07-27T20:31:34.158984+0000","last_undegraded":"2023-07-27T20:31:34.158984+0000","last_fullsized":"2023-07-27T20:31:34.158984+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:59:31.342576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963829+0000","last_change":"2023-07-27T20:31:28.127766+0000","last_active":"2023-07-27T20:31:34.963829+0000","last_peered":"2023-07-27T20:31:34.963829+0000","last_clean":"2023-07-27T20:31:34.963829+0000","last_became_active":"2023-07-27T20:31:28.127443+0000","last_became_peered":"2023-07-27T20:31:28.127443+0000","last_unstale":"2023-07-27T20:31:34.963829+0000","last_undegraded":"2023-07-27T20:31:34.963829+0000","last_fullsized":"2023-07-27T20:31:34.963829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:04:21.752471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964865+0000","last_change":"2023-07-27T20:31:29.144710+0000","last_active":"2023-07-27T20:31:34.964865+0000","last_peered":"2023-07-27T20:31:34.964865+0000","last_clean":"2023-07-27T20:31:34.964865+0000","last_became_active":"2023-07-27T20:31:29.142111+0000","last_became_peered":"2023-07-27T20:31:29.142111+0000","last_unstale":"2023-07-27T20:31:34.964865+0000","last_undegraded":"2023-07-27T20:31:34.964865+0000","last_fullsized":"2023-07-27T20:31:34.964865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:23:30.181522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963728+0000","last_change":"2023-07-27T20:31:33.183443+0000","last_active":"2023-07-27T20:31:34.963728+0000","last_peered":"2023-07-27T20:31:34.963728+0000","last_clean":"2023-07-27T20:31:34.963728+0000","last_became_active":"2023-07-27T20:31:33.183014+0000","last_became_peered":"2023-07-27T20:31:33.183014+0000","last_unstale":"2023-07-27T20:31:34.963728+0000","last_undegraded":"2023-07-27T20:31:34.963728+0000","last_fullsized":"2023-07-27T20:31:34.963728+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:41:22.455916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160506+0000","last_change":"2023-07-27T20:31:28.123550+0000","last_active":"2023-07-27T20:31:34.160506+0000","last_peered":"2023-07-27T20:31:34.160506+0000","last_clean":"2023-07-27T20:31:34.160506+0000","last_became_active":"2023-07-27T20:31:28.123257+0000","last_became_peered":"2023-07-27T20:31:28.123257+0000","last_unstale":"2023-07-27T20:31:34.160506+0000","last_undegraded":"2023-07-27T20:31:34.160506+0000","last_fullsized":"2023-07-27T20:31:34.160506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:32:39.371251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963506+0000","last_change":"2023-07-27T20:31:29.136453+0000","last_active":"2023-07-27T20:31:34.963506+0000","last_peered":"2023-07-27T20:31:34.963506+0000","last_clean":"2023-07-27T20:31:34.963506+0000","last_became_active":"2023-07-27T20:31:29.136266+0000","last_became_peered":"2023-07-27T20:31:29.136266+0000","last_unstale":"2023-07-27T20:31:34.963506+0000","last_undegraded":"2023-07-27T20:31:34.963506+0000","last_fullsized":"2023-07-27T20:31:34.963506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:59:27.292083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.962973+0000","last_change":"2023-07-27T20:31:33.184926+0000","last_active":"2023-07-27T20:31:34.962973+0000","last_peered":"2023-07-27T20:31:34.962973+0000","last_clean":"2023-07-27T20:31:34.962973+0000","last_became_active":"2023-07-27T20:31:33.184543+0000","last_became_peered":"2023-07-27T20:31:33.184543+0000","last_unstale":"2023-07-27T20:31:34.962973+0000","last_undegraded":"2023-07-27T20:31:34.962973+0000","last_fullsized":"2023-07-27T20:31:34.962973+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:14:53.290135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:47.846131+0000","last_change":"2023-07-27T20:31:28.109472+0000","last_active":"2023-07-27T20:31:47.846131+0000","last_peered":"2023-07-27T20:31:47.846131+0000","last_clean":"2023-07-27T20:31:47.846131+0000","last_became_active":"2023-07-27T20:31:28.108072+0000","last_became_peered":"2023-07-27T20:31:28.108072+0000","last_unstale":"2023-07-27T20:31:47.846131+0000","last_undegraded":"2023-07-27T20:31:47.846131+0000","last_fullsized":"2023-07-27T20:31:47.846131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:10:52.937708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159663+0000","last_change":"2023-07-27T20:31:29.140753+0000","last_active":"2023-07-27T20:31:34.159663+0000","last_peered":"2023-07-27T20:31:34.159663+0000","last_clean":"2023-07-27T20:31:34.159663+0000","last_became_active":"2023-07-27T20:31:29.140474+0000","last_became_peered":"2023-07-27T20:31:29.140474+0000","last_unstale":"2023-07-27T20:31:34.159663+0000","last_undegraded":"2023-07-27T20:31:34.159663+0000","last_fullsized":"2023-07-27T20:31:34.159663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:19:38.010331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963783+0000","last_change":"2023-07-27T20:31:33.183268+0000","last_active":"2023-07-27T20:31:34.963783+0000","last_peered":"2023-07-27T20:31:34.963783+0000","last_clean":"2023-07-27T20:31:34.963783+0000","last_became_active":"2023-07-27T20:31:33.182894+0000","last_became_peered":"2023-07-27T20:31:33.182894+0000","last_unstale":"2023-07-27T20:31:34.963783+0000","last_undegraded":"2023-07-27T20:31:34.963783+0000","last_fullsized":"2023-07-27T20:31:34.963783+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:07:37.184799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159042+0000","last_change":"2023-07-27T20:31:28.126200+0000","last_active":"2023-07-27T20:31:34.159042+0000","last_peered":"2023-07-27T20:31:34.159042+0000","last_clean":"2023-07-27T20:31:34.159042+0000","last_became_active":"2023-07-27T20:31:28.125867+0000","last_became_peered":"2023-07-27T20:31:28.125867+0000","last_unstale":"2023-07-27T20:31:34.159042+0000","last_undegraded":"2023-07-27T20:31:34.159042+0000","last_fullsized":"2023-07-27T20:31:34.159042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:59:02.266953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965069+0000","last_change":"2023-07-27T20:31:29.132793+0000","last_active":"2023-07-27T20:31:34.965069+0000","last_peered":"2023-07-27T20:31:34.965069+0000","last_clean":"2023-07-27T20:31:34.965069+0000","last_became_active":"2023-07-27T20:31:29.132532+0000","last_became_peered":"2023-07-27T20:31:29.132532+0000","last_unstale":"2023-07-27T20:31:34.965069+0000","last_undegraded":"2023-07-27T20:31:34.965069+0000","last_fullsized":"2023-07-27T20:31:34.965069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:08:38.076682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964916+0000","last_change":"2023-07-27T20:31:33.177965+0000","last_active":"2023-07-27T20:31:34.964916+0000","last_peered":"2023-07-27T20:31:34.964916+0000","last_clean":"2023-07-27T20:31:34.964916+0000","last_became_active":"2023-07-27T20:31:33.177476+0000","last_became_peered":"2023-07-27T20:31:33.177476+0000","last_unstale":"2023-07-27T20:31:34.964916+0000","last_undegraded":"2023-07-27T20:31:34.964916+0000","last_fullsized":"2023-07-27T20:31:34.964916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:00:33.711486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157385+0000","last_change":"2023-07-27T20:31:28.108577+0000","last_active":"2023-07-27T20:31:34.157385+0000","last_peered":"2023-07-27T20:31:34.157385+0000","last_clean":"2023-07-27T20:31:34.157385+0000","last_became_active":"2023-07-27T20:31:28.108279+0000","last_became_peered":"2023-07-27T20:31:28.108279+0000","last_unstale":"2023-07-27T20:31:34.157385+0000","last_undegraded":"2023-07-27T20:31:34.157385+0000","last_fullsized":"2023-07-27T20:31:34.157385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:29:56.003949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963523+0000","last_change":"2023-07-27T20:31:29.142170+0000","last_active":"2023-07-27T20:31:34.963523+0000","last_peered":"2023-07-27T20:31:34.963523+0000","last_clean":"2023-07-27T20:31:34.963523+0000","last_became_active":"2023-07-27T20:31:29.141464+0000","last_became_peered":"2023-07-27T20:31:29.141464+0000","last_unstale":"2023-07-27T20:31:34.963523+0000","last_undegraded":"2023-07-27T20:31:34.963523+0000","last_fullsized":"2023-07-27T20:31:34.963523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:29:57.010683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965238+0000","last_change":"2023-07-27T20:31:33.181354+0000","last_active":"2023-07-27T20:31:34.965238+0000","last_peered":"2023-07-27T20:31:34.965238+0000","last_clean":"2023-07-27T20:31:34.965238+0000","last_became_active":"2023-07-27T20:31:33.180937+0000","last_became_peered":"2023-07-27T20:31:33.180937+0000","last_unstale":"2023-07-27T20:31:34.965238+0000","last_undegraded":"2023-07-27T20:31:34.965238+0000","last_fullsized":"2023-07-27T20:31:34.965238+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:09:47.445321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159771+0000","last_change":"2023-07-27T20:31:28.126220+0000","last_active":"2023-07-27T20:31:34.159771+0000","last_peered":"2023-07-27T20:31:34.159771+0000","last_clean":"2023-07-27T20:31:34.159771+0000","last_became_active":"2023-07-27T20:31:28.125857+0000","last_became_peered":"2023-07-27T20:31:28.125857+0000","last_unstale":"2023-07-27T20:31:34.159771+0000","last_undegraded":"2023-07-27T20:31:34.159771+0000","last_fullsized":"2023-07-27T20:31:34.159771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:29:56.003949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157853+0000","last_change":"2023-07-27T20:31:29.128032+0000","last_active":"2023-07-27T20:31:34.157853+0000","last_peered":"2023-07-27T20:31:34.157853+0000","last_clean":"2023-07-27T20:31:34.157853+0000","last_became_active":"2023-07-27T20:31:29.127199+0000","last_became_peered":"2023-07-27T20:31:29.127199+0000","last_unstale":"2023-07-27T20:31:34.157853+0000","last_undegraded":"2023-07-27T20:31:34.157853+0000","last_fullsized":"2023-07-27T20:31:34.157853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:30:09.671437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963089+0000","last_change":"2023-07-27T20:31:33.190228+0000","last_active":"2023-07-27T20:31:34.963089+0000","last_peered":"2023-07-27T20:31:34.963089+0000","last_clean":"2023-07-27T20:31:34.963089+0000","last_became_active":"2023-07-27T20:31:33.188522+0000","last_became_peered":"2023-07-27T20:31:33.188522+0000","last_unstale":"2023-07-27T20:31:34.963089+0000","last_undegraded":"2023-07-27T20:31:34.963089+0000","last_fullsized":"2023-07-27T20:31:34.963089+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:13:45.447971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.962746+0000","last_change":"2023-07-27T20:31:28.119987+0000","last_active":"2023-07-27T20:31:34.962746+0000","last_peered":"2023-07-27T20:31:34.962746+0000","last_clean":"2023-07-27T20:31:34.962746+0000","last_became_active":"2023-07-27T20:31:28.119662+0000","last_became_peered":"2023-07-27T20:31:28.119662+0000","last_unstale":"2023-07-27T20:31:34.962746+0000","last_undegraded":"2023-07-27T20:31:34.962746+0000","last_fullsized":"2023-07-27T20:31:34.962746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:13:43.260178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965357+0000","last_change":"2023-07-27T20:31:29.138880+0000","last_active":"2023-07-27T20:31:34.965357+0000","last_peered":"2023-07-27T20:31:34.965357+0000","last_clean":"2023-07-27T20:31:34.965357+0000","last_became_active":"2023-07-27T20:31:29.138642+0000","last_became_peered":"2023-07-27T20:31:29.138642+0000","last_unstale":"2023-07-27T20:31:34.965357+0000","last_undegraded":"2023-07-27T20:31:34.965357+0000","last_fullsized":"2023-07-27T20:31:34.965357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:59:15.743619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160177+0000","last_change":"2023-07-27T20:31:33.184734+0000","last_active":"2023-07-27T20:31:34.160177+0000","last_peered":"2023-07-27T20:31:34.160177+0000","last_clean":"2023-07-27T20:31:34.160177+0000","last_became_active":"2023-07-27T20:31:33.183711+0000","last_became_peered":"2023-07-27T20:31:33.183711+0000","last_unstale":"2023-07-27T20:31:34.160177+0000","last_undegraded":"2023-07-27T20:31:34.160177+0000","last_fullsized":"2023-07-27T20:31:34.160177+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:07:37.184799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160260+0000","last_change":"2023-07-27T20:31:28.126412+0000","last_active":"2023-07-27T20:31:34.160260+0000","last_peered":"2023-07-27T20:31:34.160260+0000","last_clean":"2023-07-27T20:31:34.160260+0000","last_became_active":"2023-07-27T20:31:28.125276+0000","last_became_peered":"2023-07-27T20:31:28.125276+0000","last_unstale":"2023-07-27T20:31:34.160260+0000","last_undegraded":"2023-07-27T20:31:34.160260+0000","last_fullsized":"2023-07-27T20:31:34.160260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:04:21.752471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.962588+0000","last_change":"2023-07-27T20:31:29.141157+0000","last_active":"2023-07-27T20:31:34.962588+0000","last_peered":"2023-07-27T20:31:34.962588+0000","last_clean":"2023-07-27T20:31:34.962588+0000","last_became_active":"2023-07-27T20:31:29.140721+0000","last_became_peered":"2023-07-27T20:31:29.140721+0000","last_unstale":"2023-07-27T20:31:34.962588+0000","last_undegraded":"2023-07-27T20:31:34.962588+0000","last_fullsized":"2023-07-27T20:31:34.962588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:31:18.732492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.962761+0000","last_change":"2023-07-27T20:31:33.179053+0000","last_active":"2023-07-27T20:31:34.962761+0000","last_peered":"2023-07-27T20:31:34.962761+0000","last_clean":"2023-07-27T20:31:34.962761+0000","last_became_active":"2023-07-27T20:31:33.178636+0000","last_became_peered":"2023-07-27T20:31:33.178636+0000","last_unstale":"2023-07-27T20:31:34.962761+0000","last_undegraded":"2023-07-27T20:31:34.962761+0000","last_fullsized":"2023-07-27T20:31:34.962761+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:21:33.766448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160260+0000","last_change":"2023-07-27T20:31:28.122016+0000","last_active":"2023-07-27T20:31:34.160260+0000","last_peered":"2023-07-27T20:31:34.160260+0000","last_clean":"2023-07-27T20:31:34.160260+0000","last_became_active":"2023-07-27T20:31:28.121722+0000","last_became_peered":"2023-07-27T20:31:28.121722+0000","last_unstale":"2023-07-27T20:31:34.160260+0000","last_undegraded":"2023-07-27T20:31:34.160260+0000","last_fullsized":"2023-07-27T20:31:34.160260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:38:07.452960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159369+0000","last_change":"2023-07-27T20:31:29.126285+0000","last_active":"2023-07-27T20:31:34.159369+0000","last_peered":"2023-07-27T20:31:34.159369+0000","last_clean":"2023-07-27T20:31:34.159369+0000","last_became_active":"2023-07-27T20:31:29.126028+0000","last_became_peered":"2023-07-27T20:31:29.126028+0000","last_unstale":"2023-07-27T20:31:34.159369+0000","last_undegraded":"2023-07-27T20:31:34.159369+0000","last_fullsized":"2023-07-27T20:31:34.159369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:34:02.603036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964503+0000","last_change":"2023-07-27T20:31:33.192421+0000","last_active":"2023-07-27T20:31:34.964503+0000","last_peered":"2023-07-27T20:31:34.964503+0000","last_clean":"2023-07-27T20:31:34.964503+0000","last_became_active":"2023-07-27T20:31:33.188383+0000","last_became_peered":"2023-07-27T20:31:33.188383+0000","last_unstale":"2023-07-27T20:31:34.964503+0000","last_undegraded":"2023-07-27T20:31:34.964503+0000","last_fullsized":"2023-07-27T20:31:34.964503+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:19:59.171464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160661+0000","last_change":"2023-07-27T20:31:28.130299+0000","last_active":"2023-07-27T20:31:34.160661+0000","last_peered":"2023-07-27T20:31:34.160661+0000","last_clean":"2023-07-27T20:31:34.160661+0000","last_became_active":"2023-07-27T20:31:28.129986+0000","last_became_peered":"2023-07-27T20:31:28.129986+0000","last_unstale":"2023-07-27T20:31:34.160661+0000","last_undegraded":"2023-07-27T20:31:34.160661+0000","last_fullsized":"2023-07-27T20:31:34.160661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:02:56.272252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963299+0000","last_change":"2023-07-27T20:31:29.132566+0000","last_active":"2023-07-27T20:31:34.963299+0000","last_peered":"2023-07-27T20:31:34.963299+0000","last_clean":"2023-07-27T20:31:34.963299+0000","last_became_active":"2023-07-27T20:31:29.132163+0000","last_became_peered":"2023-07-27T20:31:29.132163+0000","last_unstale":"2023-07-27T20:31:34.963299+0000","last_undegraded":"2023-07-27T20:31:34.963299+0000","last_fullsized":"2023-07-27T20:31:34.963299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:39:29.240358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963259+0000","last_change":"2023-07-27T20:31:33.186162+0000","last_active":"2023-07-27T20:31:34.963259+0000","last_peered":"2023-07-27T20:31:34.963259+0000","last_clean":"2023-07-27T20:31:34.963259+0000","last_became_active":"2023-07-27T20:31:33.185738+0000","last_became_peered":"2023-07-27T20:31:33.185738+0000","last_unstale":"2023-07-27T20:31:34.963259+0000","last_undegraded":"2023-07-27T20:31:34.963259+0000","last_fullsized":"2023-07-27T20:31:34.963259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:59:46.029831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963161+0000","last_change":"2023-07-27T20:31:28.124073+0000","last_active":"2023-07-27T20:31:34.963161+0000","last_peered":"2023-07-27T20:31:34.963161+0000","last_clean":"2023-07-27T20:31:34.963161+0000","last_became_active":"2023-07-27T20:31:28.123661+0000","last_became_peered":"2023-07-27T20:31:28.123661+0000","last_unstale":"2023-07-27T20:31:34.963161+0000","last_undegraded":"2023-07-27T20:31:34.963161+0000","last_fullsized":"2023-07-27T20:31:34.963161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:20:59.432383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158518+0000","last_change":"2023-07-27T20:31:29.135207+0000","last_active":"2023-07-27T20:31:34.158518+0000","last_peered":"2023-07-27T20:31:34.158518+0000","last_clean":"2023-07-27T20:31:34.158518+0000","last_became_active":"2023-07-27T20:31:29.134951+0000","last_became_peered":"2023-07-27T20:31:29.134951+0000","last_unstale":"2023-07-27T20:31:34.158518+0000","last_undegraded":"2023-07-27T20:31:34.158518+0000","last_fullsized":"2023-07-27T20:31:34.158518+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:00:29.660993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964088+0000","last_change":"2023-07-27T20:31:33.192124+0000","last_active":"2023-07-27T20:31:34.964088+0000","last_peered":"2023-07-27T20:31:34.964088+0000","last_clean":"2023-07-27T20:31:34.964088+0000","last_became_active":"2023-07-27T20:31:33.187632+0000","last_became_peered":"2023-07-27T20:31:33.187632+0000","last_unstale":"2023-07-27T20:31:34.964088+0000","last_undegraded":"2023-07-27T20:31:34.964088+0000","last_fullsized":"2023-07-27T20:31:34.964088+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:07:10.295169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963580+0000","last_change":"2023-07-27T20:31:28.121108+0000","last_active":"2023-07-27T20:31:34.963580+0000","last_peered":"2023-07-27T20:31:34.963580+0000","last_clean":"2023-07-27T20:31:34.963580+0000","last_became_active":"2023-07-27T20:31:28.120493+0000","last_became_peered":"2023-07-27T20:31:28.120493+0000","last_unstale":"2023-07-27T20:31:34.963580+0000","last_undegraded":"2023-07-27T20:31:34.963580+0000","last_fullsized":"2023-07-27T20:31:34.963580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:01:29.799303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158619+0000","last_change":"2023-07-27T20:31:29.131480+0000","last_active":"2023-07-27T20:31:34.158619+0000","last_peered":"2023-07-27T20:31:34.158619+0000","last_clean":"2023-07-27T20:31:34.158619+0000","last_became_active":"2023-07-27T20:31:29.131095+0000","last_became_peered":"2023-07-27T20:31:29.131095+0000","last_unstale":"2023-07-27T20:31:34.158619+0000","last_undegraded":"2023-07-27T20:31:34.158619+0000","last_fullsized":"2023-07-27T20:31:34.158619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:34:08.272287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963660+0000","last_change":"2023-07-27T20:31:33.187021+0000","last_active":"2023-07-27T20:31:34.963660+0000","last_peered":"2023-07-27T20:31:34.963660+0000","last_clean":"2023-07-27T20:31:34.963660+0000","last_became_active":"2023-07-27T20:31:33.186607+0000","last_became_peered":"2023-07-27T20:31:33.186607+0000","last_unstale":"2023-07-27T20:31:34.963660+0000","last_undegraded":"2023-07-27T20:31:34.963660+0000","last_fullsized":"2023-07-27T20:31:34.963660+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:13:45.447971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963434+0000","last_change":"2023-07-27T20:31:28.127262+0000","last_active":"2023-07-27T20:31:34.963434+0000","last_peered":"2023-07-27T20:31:34.963434+0000","last_clean":"2023-07-27T20:31:34.963434+0000","last_became_active":"2023-07-27T20:31:28.126885+0000","last_became_peered":"2023-07-27T20:31:28.126885+0000","last_unstale":"2023-07-27T20:31:34.963434+0000","last_undegraded":"2023-07-27T20:31:34.963434+0000","last_fullsized":"2023-07-27T20:31:34.963434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:06:53.409694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160256+0000","last_change":"2023-07-27T20:31:29.129706+0000","last_active":"2023-07-27T20:31:34.160256+0000","last_peered":"2023-07-27T20:31:34.160256+0000","last_clean":"2023-07-27T20:31:34.160256+0000","last_became_active":"2023-07-27T20:31:29.129331+0000","last_became_peered":"2023-07-27T20:31:29.129331+0000","last_unstale":"2023-07-27T20:31:34.160256+0000","last_undegraded":"2023-07-27T20:31:34.160256+0000","last_fullsized":"2023-07-27T20:31:34.160256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:16:54.006335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964068+0000","last_change":"2023-07-27T20:31:33.189952+0000","last_active":"2023-07-27T20:31:34.964068+0000","last_peered":"2023-07-27T20:31:34.964068+0000","last_clean":"2023-07-27T20:31:34.964068+0000","last_became_active":"2023-07-27T20:31:33.188619+0000","last_became_peered":"2023-07-27T20:31:33.188619+0000","last_unstale":"2023-07-27T20:31:34.964068+0000","last_undegraded":"2023-07-27T20:31:34.964068+0000","last_fullsized":"2023-07-27T20:31:34.964068+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:03:01.329479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158999+0000","last_change":"2023-07-27T20:31:28.115944+0000","last_active":"2023-07-27T20:31:34.158999+0000","last_peered":"2023-07-27T20:31:34.158999+0000","last_clean":"2023-07-27T20:31:34.158999+0000","last_became_active":"2023-07-27T20:31:28.115533+0000","last_became_peered":"2023-07-27T20:31:28.115533+0000","last_unstale":"2023-07-27T20:31:34.158999+0000","last_undegraded":"2023-07-27T20:31:34.158999+0000","last_fullsized":"2023-07-27T20:31:34.158999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:08:41.229908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160623+0000","last_change":"2023-07-27T20:31:29.143123+0000","last_active":"2023-07-27T20:31:34.160623+0000","last_peered":"2023-07-27T20:31:34.160623+0000","last_clean":"2023-07-27T20:31:34.160623+0000","last_became_active":"2023-07-27T20:31:29.142870+0000","last_became_peered":"2023-07-27T20:31:29.142870+0000","last_unstale":"2023-07-27T20:31:34.160623+0000","last_undegraded":"2023-07-27T20:31:34.160623+0000","last_fullsized":"2023-07-27T20:31:34.160623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:38:22.765710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160570+0000","last_change":"2023-07-27T20:31:33.181739+0000","last_active":"2023-07-27T20:31:34.160570+0000","last_peered":"2023-07-27T20:31:34.160570+0000","last_clean":"2023-07-27T20:31:34.160570+0000","last_became_active":"2023-07-27T20:31:33.181198+0000","last_became_peered":"2023-07-27T20:31:33.181198+0000","last_unstale":"2023-07-27T20:31:34.160570+0000","last_undegraded":"2023-07-27T20:31:34.160570+0000","last_fullsized":"2023-07-27T20:31:34.160570+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:45:59.627493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965266+0000","last_change":"2023-07-27T20:31:28.120507+0000","last_active":"2023-07-27T20:31:34.965266+0000","last_peered":"2023-07-27T20:31:34.965266+0000","last_clean":"2023-07-27T20:31:34.965266+0000","last_became_active":"2023-07-27T20:31:28.120181+0000","last_became_peered":"2023-07-27T20:31:28.120181+0000","last_unstale":"2023-07-27T20:31:34.965266+0000","last_undegraded":"2023-07-27T20:31:34.965266+0000","last_fullsized":"2023-07-27T20:31:34.965266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:35:11.181105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965561+0000","last_change":"2023-07-27T20:31:29.128643+0000","last_active":"2023-07-27T20:31:34.965561+0000","last_peered":"2023-07-27T20:31:34.965561+0000","last_clean":"2023-07-27T20:31:34.965561+0000","last_became_active":"2023-07-27T20:31:29.128351+0000","last_became_peered":"2023-07-27T20:31:29.128351+0000","last_unstale":"2023-07-27T20:31:34.965561+0000","last_undegraded":"2023-07-27T20:31:34.965561+0000","last_fullsized":"2023-07-27T20:31:34.965561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:52:37.919677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157930+0000","last_change":"2023-07-27T20:31:33.185100+0000","last_active":"2023-07-27T20:31:34.157930+0000","last_peered":"2023-07-27T20:31:34.157930+0000","last_clean":"2023-07-27T20:31:34.157930+0000","last_became_active":"2023-07-27T20:31:33.184683+0000","last_became_peered":"2023-07-27T20:31:33.184683+0000","last_unstale":"2023-07-27T20:31:34.157930+0000","last_undegraded":"2023-07-27T20:31:34.157930+0000","last_fullsized":"2023-07-27T20:31:34.157930+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:03:01.329479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963884+0000","last_change":"2023-07-27T20:31:22.848698+0000","last_active":"2023-07-27T20:31:34.963884+0000","last_peered":"2023-07-27T20:31:34.963884+0000","last_clean":"2023-07-27T20:31:34.963884+0000","last_became_active":"2023-07-27T20:31:22.848346+0000","last_became_peered":"2023-07-27T20:31:22.848346+0000","last_unstale":"2023-07-27T20:31:34.963884+0000","last_undegraded":"2023-07-27T20:31:34.963884+0000","last_fullsized":"2023-07-27T20:31:34.963884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:48:04.598381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963400+0000","last_change":"2023-07-27T20:31:28.127873+0000","last_active":"2023-07-27T20:31:34.963400+0000","last_peered":"2023-07-27T20:31:34.963400+0000","last_clean":"2023-07-27T20:31:34.963400+0000","last_became_active":"2023-07-27T20:31:28.127528+0000","last_became_peered":"2023-07-27T20:31:28.127528+0000","last_unstale":"2023-07-27T20:31:34.963400+0000","last_undegraded":"2023-07-27T20:31:34.963400+0000","last_fullsized":"2023-07-27T20:31:34.963400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:11:16.759020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963300+0000","last_change":"2023-07-27T20:31:29.141185+0000","last_active":"2023-07-27T20:31:34.963300+0000","last_peered":"2023-07-27T20:31:34.963300+0000","last_clean":"2023-07-27T20:31:34.963300+0000","last_became_active":"2023-07-27T20:31:29.140892+0000","last_became_peered":"2023-07-27T20:31:29.140892+0000","last_unstale":"2023-07-27T20:31:34.963300+0000","last_undegraded":"2023-07-27T20:31:34.963300+0000","last_fullsized":"2023-07-27T20:31:34.963300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:32:33.408454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157575+0000","last_change":"2023-07-27T20:31:33.181796+0000","last_active":"2023-07-27T20:31:34.157575+0000","last_peered":"2023-07-27T20:31:34.157575+0000","last_clean":"2023-07-27T20:31:34.157575+0000","last_became_active":"2023-07-27T20:31:33.181416+0000","last_became_peered":"2023-07-27T20:31:33.181416+0000","last_unstale":"2023-07-27T20:31:34.157575+0000","last_undegraded":"2023-07-27T20:31:34.157575+0000","last_fullsized":"2023-07-27T20:31:34.157575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:52:41.970170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963001+0000","last_change":"2023-07-27T20:31:22.849178+0000","last_active":"2023-07-27T20:31:34.963001+0000","last_peered":"2023-07-27T20:31:34.963001+0000","last_clean":"2023-07-27T20:31:34.963001+0000","last_became_active":"2023-07-27T20:31:22.848856+0000","last_became_peered":"2023-07-27T20:31:22.848856+0000","last_unstale":"2023-07-27T20:31:34.963001+0000","last_undegraded":"2023-07-27T20:31:34.963001+0000","last_fullsized":"2023-07-27T20:31:34.963001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:59:21.022861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159361+0000","last_change":"2023-07-27T20:31:28.121194+0000","last_active":"2023-07-27T20:31:34.159361+0000","last_peered":"2023-07-27T20:31:34.159361+0000","last_clean":"2023-07-27T20:31:34.159361+0000","last_became_active":"2023-07-27T20:31:28.120865+0000","last_became_peered":"2023-07-27T20:31:28.120865+0000","last_unstale":"2023-07-27T20:31:34.159361+0000","last_undegraded":"2023-07-27T20:31:34.159361+0000","last_fullsized":"2023-07-27T20:31:34.159361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:12:37.554428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963780+0000","last_change":"2023-07-27T20:31:29.127748+0000","last_active":"2023-07-27T20:31:34.963780+0000","last_peered":"2023-07-27T20:31:34.963780+0000","last_clean":"2023-07-27T20:31:34.963780+0000","last_became_active":"2023-07-27T20:31:29.127213+0000","last_became_peered":"2023-07-27T20:31:29.127213+0000","last_unstale":"2023-07-27T20:31:34.963780+0000","last_undegraded":"2023-07-27T20:31:34.963780+0000","last_fullsized":"2023-07-27T20:31:34.963780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:59:03.273688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964666+0000","last_change":"2023-07-27T20:31:33.193059+0000","last_active":"2023-07-27T20:31:34.964666+0000","last_peered":"2023-07-27T20:31:34.964666+0000","last_clean":"2023-07-27T20:31:34.964666+0000","last_became_active":"2023-07-27T20:31:33.192317+0000","last_became_peered":"2023-07-27T20:31:33.192317+0000","last_unstale":"2023-07-27T20:31:34.964666+0000","last_undegraded":"2023-07-27T20:31:34.964666+0000","last_fullsized":"2023-07-27T20:31:34.964666+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:22:24.070420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964167+0000","last_change":"2023-07-27T20:31:22.959811+0000","last_active":"2023-07-27T20:31:34.964167+0000","last_peered":"2023-07-27T20:31:34.964167+0000","last_clean":"2023-07-27T20:31:34.964167+0000","last_became_active":"2023-07-27T20:31:22.959449+0000","last_became_peered":"2023-07-27T20:31:22.959449+0000","last_unstale":"2023-07-27T20:31:34.964167+0000","last_undegraded":"2023-07-27T20:31:34.964167+0000","last_fullsized":"2023-07-27T20:31:34.964167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:39:22.049301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.962890+0000","last_change":"2023-07-27T20:31:28.112790+0000","last_active":"2023-07-27T20:31:34.962890+0000","last_peered":"2023-07-27T20:31:34.962890+0000","last_clean":"2023-07-27T20:31:34.962890+0000","last_became_active":"2023-07-27T20:31:28.112486+0000","last_became_peered":"2023-07-27T20:31:28.112486+0000","last_unstale":"2023-07-27T20:31:34.962890+0000","last_undegraded":"2023-07-27T20:31:34.962890+0000","last_fullsized":"2023-07-27T20:31:34.962890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:06:07.656544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965439+0000","last_change":"2023-07-27T20:31:29.150778+0000","last_active":"2023-07-27T20:31:34.965439+0000","last_peered":"2023-07-27T20:31:34.965439+0000","last_clean":"2023-07-27T20:31:34.965439+0000","last_became_active":"2023-07-27T20:31:29.150479+0000","last_became_peered":"2023-07-27T20:31:29.150479+0000","last_unstale":"2023-07-27T20:31:34.965439+0000","last_undegraded":"2023-07-27T20:31:34.965439+0000","last_fullsized":"2023-07-27T20:31:34.965439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:29:57.010683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160099+0000","last_change":"2023-07-27T20:31:33.175158+0000","last_active":"2023-07-27T20:31:34.160099+0000","last_peered":"2023-07-27T20:31:34.160099+0000","last_clean":"2023-07-27T20:31:34.160099+0000","last_became_active":"2023-07-27T20:31:33.174727+0000","last_became_peered":"2023-07-27T20:31:33.174727+0000","last_unstale":"2023-07-27T20:31:34.160099+0000","last_undegraded":"2023-07-27T20:31:34.160099+0000","last_fullsized":"2023-07-27T20:31:34.160099+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:46:48.142348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963380+0000","last_change":"2023-07-27T20:31:22.847766+0000","last_active":"2023-07-27T20:31:34.963380+0000","last_peered":"2023-07-27T20:31:34.963380+0000","last_clean":"2023-07-27T20:31:34.963380+0000","last_became_active":"2023-07-27T20:31:22.847396+0000","last_became_peered":"2023-07-27T20:31:22.847396+0000","last_unstale":"2023-07-27T20:31:34.963380+0000","last_undegraded":"2023-07-27T20:31:34.963380+0000","last_fullsized":"2023-07-27T20:31:34.963380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:24:50.913525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":181,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159241+0000","last_change":"2023-07-27T20:31:15.812727+0000","last_active":"2023-07-27T20:31:34.159241+0000","last_peered":"2023-07-27T20:31:34.159241+0000","last_clean":"2023-07-27T20:31:34.159241+0000","last_became_active":"2023-07-27T20:31:15.811803+0000","last_became_peered":"2023-07-27T20:31:15.811803+0000","last_unstale":"2023-07-27T20:31:34.159241+0000","last_undegraded":"2023-07-27T20:31:34.159241+0000","last_fullsized":"2023-07-27T20:31:34.159241+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:14.789257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:14.789257+0000","last_clean_scrub_stamp":"2023-07-27T20:31:14.789257+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:13:28.096429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963324+0000","last_change":"2023-07-27T20:31:28.128776+0000","last_active":"2023-07-27T20:31:34.963324+0000","last_peered":"2023-07-27T20:31:34.963324+0000","last_clean":"2023-07-27T20:31:34.963324+0000","last_became_active":"2023-07-27T20:31:28.128519+0000","last_became_peered":"2023-07-27T20:31:28.128519+0000","last_unstale":"2023-07-27T20:31:34.963324+0000","last_undegraded":"2023-07-27T20:31:34.963324+0000","last_fullsized":"2023-07-27T20:31:34.963324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:02:56.272252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963298+0000","last_change":"2023-07-27T20:31:29.144327+0000","last_active":"2023-07-27T20:31:34.963298+0000","last_peered":"2023-07-27T20:31:34.963298+0000","last_clean":"2023-07-27T20:31:34.963298+0000","last_became_active":"2023-07-27T20:31:29.143987+0000","last_became_peered":"2023-07-27T20:31:29.143987+0000","last_unstale":"2023-07-27T20:31:34.963298+0000","last_undegraded":"2023-07-27T20:31:34.963298+0000","last_fullsized":"2023-07-27T20:31:34.963298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:09:04.213951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963855+0000","last_change":"2023-07-27T20:31:33.185843+0000","last_active":"2023-07-27T20:31:34.963855+0000","last_peered":"2023-07-27T20:31:34.963855+0000","last_clean":"2023-07-27T20:31:34.963855+0000","last_became_active":"2023-07-27T20:31:33.185433+0000","last_became_peered":"2023-07-27T20:31:33.185433+0000","last_unstale":"2023-07-27T20:31:34.963855+0000","last_undegraded":"2023-07-27T20:31:34.963855+0000","last_fullsized":"2023-07-27T20:31:34.963855+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:32:44.428479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159531+0000","last_change":"2023-07-27T20:31:22.848181+0000","last_active":"2023-07-27T20:31:34.159531+0000","last_peered":"2023-07-27T20:31:34.159531+0000","last_clean":"2023-07-27T20:31:34.159531+0000","last_became_active":"2023-07-27T20:31:22.847865+0000","last_became_peered":"2023-07-27T20:31:22.847865+0000","last_unstale":"2023-07-27T20:31:34.159531+0000","last_undegraded":"2023-07-27T20:31:34.159531+0000","last_fullsized":"2023-07-27T20:31:34.159531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:48:04.598381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157019+0000","last_change":"2023-07-27T20:31:28.126023+0000","last_active":"2023-07-27T20:31:34.157019+0000","last_peered":"2023-07-27T20:31:34.157019+0000","last_clean":"2023-07-27T20:31:34.157019+0000","last_became_active":"2023-07-27T20:31:28.125763+0000","last_became_peered":"2023-07-27T20:31:28.125763+0000","last_unstale":"2023-07-27T20:31:34.157019+0000","last_undegraded":"2023-07-27T20:31:34.157019+0000","last_fullsized":"2023-07-27T20:31:34.157019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:11:16.759020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157525+0000","last_change":"2023-07-27T20:31:29.134648+0000","last_active":"2023-07-27T20:31:34.157525+0000","last_peered":"2023-07-27T20:31:34.157525+0000","last_clean":"2023-07-27T20:31:34.157525+0000","last_became_active":"2023-07-27T20:31:29.133686+0000","last_became_peered":"2023-07-27T20:31:29.133686+0000","last_unstale":"2023-07-27T20:31:34.157525+0000","last_undegraded":"2023-07-27T20:31:34.157525+0000","last_fullsized":"2023-07-27T20:31:34.157525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:46:44.091855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963906+0000","last_change":"2023-07-27T20:31:33.173136+0000","last_active":"2023-07-27T20:31:34.963906+0000","last_peered":"2023-07-27T20:31:34.963906+0000","last_clean":"2023-07-27T20:31:34.963906+0000","last_became_active":"2023-07-27T20:31:33.171872+0000","last_became_peered":"2023-07-27T20:31:33.171872+0000","last_unstale":"2023-07-27T20:31:34.963906+0000","last_undegraded":"2023-07-27T20:31:34.963906+0000","last_fullsized":"2023-07-27T20:31:34.963906+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:54:08.677930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160575+0000","last_change":"2023-07-27T20:31:22.848025+0000","last_active":"2023-07-27T20:31:34.160575+0000","last_peered":"2023-07-27T20:31:34.160575+0000","last_clean":"2023-07-27T20:31:34.160575+0000","last_became_active":"2023-07-27T20:31:22.847603+0000","last_became_peered":"2023-07-27T20:31:22.847603+0000","last_unstale":"2023-07-27T20:31:34.160575+0000","last_undegraded":"2023-07-27T20:31:34.160575+0000","last_fullsized":"2023-07-27T20:31:34.160575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:30:03.402215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964111+0000","last_change":"2023-07-27T20:31:28.113523+0000","last_active":"2023-07-27T20:31:34.964111+0000","last_peered":"2023-07-27T20:31:34.964111+0000","last_clean":"2023-07-27T20:31:34.964111+0000","last_became_active":"2023-07-27T20:31:28.113279+0000","last_became_peered":"2023-07-27T20:31:28.113279+0000","last_unstale":"2023-07-27T20:31:34.964111+0000","last_undegraded":"2023-07-27T20:31:34.964111+0000","last_fullsized":"2023-07-27T20:31:34.964111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:11:16.759020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158082+0000","last_change":"2023-07-27T20:31:29.142859+0000","last_active":"2023-07-27T20:31:34.158082+0000","last_peered":"2023-07-27T20:31:34.158082+0000","last_clean":"2023-07-27T20:31:34.158082+0000","last_became_active":"2023-07-27T20:31:29.142567+0000","last_became_peered":"2023-07-27T20:31:29.142567+0000","last_unstale":"2023-07-27T20:31:34.158082+0000","last_undegraded":"2023-07-27T20:31:34.158082+0000","last_fullsized":"2023-07-27T20:31:34.158082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:17:03.497602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159475+0000","last_change":"2023-07-27T20:31:33.178764+0000","last_active":"2023-07-27T20:31:34.159475+0000","last_peered":"2023-07-27T20:31:34.159475+0000","last_clean":"2023-07-27T20:31:34.159475+0000","last_became_active":"2023-07-27T20:31:33.178284+0000","last_became_peered":"2023-07-27T20:31:33.178284+0000","last_unstale":"2023-07-27T20:31:34.159475+0000","last_undegraded":"2023-07-27T20:31:34.159475+0000","last_fullsized":"2023-07-27T20:31:34.159475+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:37:30.584016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965462+0000","last_change":"2023-07-27T20:31:28.120924+0000","last_active":"2023-07-27T20:31:34.965462+0000","last_peered":"2023-07-27T20:31:34.965462+0000","last_clean":"2023-07-27T20:31:34.965462+0000","last_became_active":"2023-07-27T20:31:28.120646+0000","last_became_peered":"2023-07-27T20:31:28.120646+0000","last_unstale":"2023-07-27T20:31:34.965462+0000","last_undegraded":"2023-07-27T20:31:34.965462+0000","last_fullsized":"2023-07-27T20:31:34.965462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:53:34.775079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963414+0000","last_change":"2023-07-27T20:31:22.845641+0000","last_active":"2023-07-27T20:31:34.963414+0000","last_peered":"2023-07-27T20:31:34.963414+0000","last_clean":"2023-07-27T20:31:34.963414+0000","last_became_active":"2023-07-27T20:31:22.845368+0000","last_became_peered":"2023-07-27T20:31:22.845368+0000","last_unstale":"2023-07-27T20:31:34.963414+0000","last_undegraded":"2023-07-27T20:31:34.963414+0000","last_fullsized":"2023-07-27T20:31:34.963414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:22:43.198616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965145+0000","last_change":"2023-07-27T20:31:29.144935+0000","last_active":"2023-07-27T20:31:34.965145+0000","last_peered":"2023-07-27T20:31:34.965145+0000","last_clean":"2023-07-27T20:31:34.965145+0000","last_became_active":"2023-07-27T20:31:29.144500+0000","last_became_peered":"2023-07-27T20:31:29.144500+0000","last_unstale":"2023-07-27T20:31:34.965145+0000","last_undegraded":"2023-07-27T20:31:34.965145+0000","last_fullsized":"2023-07-27T20:31:34.965145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:43:50.810308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964904+0000","last_change":"2023-07-27T20:31:33.178800+0000","last_active":"2023-07-27T20:31:34.964904+0000","last_peered":"2023-07-27T20:31:34.964904+0000","last_clean":"2023-07-27T20:31:34.964904+0000","last_became_active":"2023-07-27T20:31:33.178392+0000","last_became_peered":"2023-07-27T20:31:33.178392+0000","last_unstale":"2023-07-27T20:31:34.964904+0000","last_undegraded":"2023-07-27T20:31:34.964904+0000","last_fullsized":"2023-07-27T20:31:34.964904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:43:14.963398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963516+0000","last_change":"2023-07-27T20:31:22.846540+0000","last_active":"2023-07-27T20:31:34.963516+0000","last_peered":"2023-07-27T20:31:34.963516+0000","last_clean":"2023-07-27T20:31:34.963516+0000","last_became_active":"2023-07-27T20:31:22.846128+0000","last_became_peered":"2023-07-27T20:31:22.846128+0000","last_unstale":"2023-07-27T20:31:34.963516+0000","last_undegraded":"2023-07-27T20:31:34.963516+0000","last_fullsized":"2023-07-27T20:31:34.963516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:43:06.660613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157642+0000","last_change":"2023-07-27T20:31:28.113438+0000","last_active":"2023-07-27T20:31:34.157642+0000","last_peered":"2023-07-27T20:31:34.157642+0000","last_clean":"2023-07-27T20:31:34.157642+0000","last_became_active":"2023-07-27T20:31:28.113146+0000","last_became_peered":"2023-07-27T20:31:28.113146+0000","last_unstale":"2023-07-27T20:31:34.157642+0000","last_undegraded":"2023-07-27T20:31:34.157642+0000","last_fullsized":"2023-07-27T20:31:34.157642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:04:21.752471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159254+0000","last_change":"2023-07-27T20:31:29.141507+0000","last_active":"2023-07-27T20:31:34.159254+0000","last_peered":"2023-07-27T20:31:34.159254+0000","last_clean":"2023-07-27T20:31:34.159254+0000","last_became_active":"2023-07-27T20:31:29.141217+0000","last_became_peered":"2023-07-27T20:31:29.141217+0000","last_unstale":"2023-07-27T20:31:34.159254+0000","last_undegraded":"2023-07-27T20:31:34.159254+0000","last_fullsized":"2023-07-27T20:31:34.159254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:07:23.817773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963812+0000","last_change":"2023-07-27T20:31:33.184984+0000","last_active":"2023-07-27T20:31:34.963812+0000","last_peered":"2023-07-27T20:31:34.963812+0000","last_clean":"2023-07-27T20:31:34.963812+0000","last_became_active":"2023-07-27T20:31:33.184413+0000","last_became_peered":"2023-07-27T20:31:33.184413+0000","last_unstale":"2023-07-27T20:31:34.963812+0000","last_undegraded":"2023-07-27T20:31:34.963812+0000","last_fullsized":"2023-07-27T20:31:34.963812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:03:20.666196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157892+0000","last_change":"2023-07-27T20:31:28.122480+0000","last_active":"2023-07-27T20:31:34.157892+0000","last_peered":"2023-07-27T20:31:34.157892+0000","last_clean":"2023-07-27T20:31:34.157892+0000","last_became_active":"2023-07-27T20:31:28.121841+0000","last_became_peered":"2023-07-27T20:31:28.121841+0000","last_unstale":"2023-07-27T20:31:34.157892+0000","last_undegraded":"2023-07-27T20:31:34.157892+0000","last_fullsized":"2023-07-27T20:31:34.157892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:01:29.799303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963780+0000","last_change":"2023-07-27T20:31:29.129723+0000","last_active":"2023-07-27T20:31:34.963780+0000","last_peered":"2023-07-27T20:31:34.963780+0000","last_clean":"2023-07-27T20:31:34.963780+0000","last_became_active":"2023-07-27T20:31:29.129256+0000","last_became_peered":"2023-07-27T20:31:29.129256+0000","last_unstale":"2023-07-27T20:31:34.963780+0000","last_undegraded":"2023-07-27T20:31:34.963780+0000","last_fullsized":"2023-07-27T20:31:34.963780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:40:12.799013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159801+0000","last_change":"2023-07-27T20:31:33.182234+0000","last_active":"2023-07-27T20:31:34.159801+0000","last_peered":"2023-07-27T20:31:34.159801+0000","last_clean":"2023-07-27T20:31:34.159801+0000","last_became_active":"2023-07-27T20:31:33.181660+0000","last_became_peered":"2023-07-27T20:31:33.181660+0000","last_unstale":"2023-07-27T20:31:34.159801+0000","last_undegraded":"2023-07-27T20:31:34.159801+0000","last_fullsized":"2023-07-27T20:31:34.159801+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:11:21.816247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963312+0000","last_change":"2023-07-27T20:31:28.127766+0000","last_active":"2023-07-27T20:31:34.963312+0000","last_peered":"2023-07-27T20:31:34.963312+0000","last_clean":"2023-07-27T20:31:34.963312+0000","last_became_active":"2023-07-27T20:31:28.127414+0000","last_became_peered":"2023-07-27T20:31:28.127414+0000","last_unstale":"2023-07-27T20:31:34.963312+0000","last_undegraded":"2023-07-27T20:31:34.963312+0000","last_fullsized":"2023-07-27T20:31:34.963312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:03:15.608969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159150+0000","last_change":"2023-07-27T20:31:29.129596+0000","last_active":"2023-07-27T20:31:34.159150+0000","last_peered":"2023-07-27T20:31:34.159150+0000","last_clean":"2023-07-27T20:31:34.159150+0000","last_became_active":"2023-07-27T20:31:29.129291+0000","last_became_peered":"2023-07-27T20:31:29.129291+0000","last_unstale":"2023-07-27T20:31:34.159150+0000","last_undegraded":"2023-07-27T20:31:34.159150+0000","last_fullsized":"2023-07-27T20:31:34.159150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:27:22.233669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963655+0000","last_change":"2023-07-27T20:31:33.178602+0000","last_active":"2023-07-27T20:31:34.963655+0000","last_peered":"2023-07-27T20:31:34.963655+0000","last_clean":"2023-07-27T20:31:34.963655+0000","last_became_active":"2023-07-27T20:31:33.178225+0000","last_became_peered":"2023-07-27T20:31:33.178225+0000","last_unstale":"2023-07-27T20:31:34.963655+0000","last_undegraded":"2023-07-27T20:31:34.963655+0000","last_fullsized":"2023-07-27T20:31:34.963655+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:46:48.142348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963262+0000","last_change":"2023-07-27T20:31:28.127934+0000","last_active":"2023-07-27T20:31:34.963262+0000","last_peered":"2023-07-27T20:31:34.963262+0000","last_clean":"2023-07-27T20:31:34.963262+0000","last_became_active":"2023-07-27T20:31:28.127614+0000","last_became_peered":"2023-07-27T20:31:28.127614+0000","last_unstale":"2023-07-27T20:31:34.963262+0000","last_undegraded":"2023-07-27T20:31:34.963262+0000","last_fullsized":"2023-07-27T20:31:34.963262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:59:02.266953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158703+0000","last_change":"2023-07-27T20:31:29.129192+0000","last_active":"2023-07-27T20:31:34.158703+0000","last_peered":"2023-07-27T20:31:34.158703+0000","last_clean":"2023-07-27T20:31:34.158703+0000","last_became_active":"2023-07-27T20:31:29.128942+0000","last_became_peered":"2023-07-27T20:31:29.128942+0000","last_unstale":"2023-07-27T20:31:34.158703+0000","last_undegraded":"2023-07-27T20:31:34.158703+0000","last_fullsized":"2023-07-27T20:31:34.158703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:47:04.874275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158302+0000","last_change":"2023-07-27T20:31:33.181755+0000","last_active":"2023-07-27T20:31:34.158302+0000","last_peered":"2023-07-27T20:31:34.158302+0000","last_clean":"2023-07-27T20:31:34.158302+0000","last_became_active":"2023-07-27T20:31:33.181272+0000","last_became_peered":"2023-07-27T20:31:33.181272+0000","last_unstale":"2023-07-27T20:31:34.158302+0000","last_undegraded":"2023-07-27T20:31:34.158302+0000","last_fullsized":"2023-07-27T20:31:34.158302+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:17:29.545484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964561+0000","last_change":"2023-07-27T20:31:28.120798+0000","last_active":"2023-07-27T20:31:34.964561+0000","last_peered":"2023-07-27T20:31:34.964561+0000","last_clean":"2023-07-27T20:31:34.964561+0000","last_became_active":"2023-07-27T20:31:28.120445+0000","last_became_peered":"2023-07-27T20:31:28.120445+0000","last_unstale":"2023-07-27T20:31:34.964561+0000","last_undegraded":"2023-07-27T20:31:34.964561+0000","last_fullsized":"2023-07-27T20:31:34.964561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:04:19.045494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964977+0000","last_change":"2023-07-27T20:31:29.133577+0000","last_active":"2023-07-27T20:31:34.964977+0000","last_peered":"2023-07-27T20:31:34.964977+0000","last_clean":"2023-07-27T20:31:34.964977+0000","last_became_active":"2023-07-27T20:31:29.133170+0000","last_became_peered":"2023-07-27T20:31:29.133170+0000","last_unstale":"2023-07-27T20:31:34.964977+0000","last_undegraded":"2023-07-27T20:31:34.964977+0000","last_fullsized":"2023-07-27T20:31:34.964977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:58:10.754493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963156+0000","last_change":"2023-07-27T20:31:33.185023+0000","last_active":"2023-07-27T20:31:34.963156+0000","last_peered":"2023-07-27T20:31:34.963156+0000","last_clean":"2023-07-27T20:31:34.963156+0000","last_became_active":"2023-07-27T20:31:33.184664+0000","last_became_peered":"2023-07-27T20:31:33.184664+0000","last_unstale":"2023-07-27T20:31:34.963156+0000","last_undegraded":"2023-07-27T20:31:34.963156+0000","last_fullsized":"2023-07-27T20:31:34.963156+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:31:22.782985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158280+0000","last_change":"2023-07-27T20:31:28.130218+0000","last_active":"2023-07-27T20:31:34.158280+0000","last_peered":"2023-07-27T20:31:34.158280+0000","last_clean":"2023-07-27T20:31:34.158280+0000","last_became_active":"2023-07-27T20:31:28.129985+0000","last_became_peered":"2023-07-27T20:31:28.129985+0000","last_unstale":"2023-07-27T20:31:34.158280+0000","last_undegraded":"2023-07-27T20:31:34.158280+0000","last_fullsized":"2023-07-27T20:31:34.158280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:23:29.174787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158489+0000","last_change":"2023-07-27T20:31:29.134396+0000","last_active":"2023-07-27T20:31:34.158489+0000","last_peered":"2023-07-27T20:31:34.158489+0000","last_clean":"2023-07-27T20:31:34.158489+0000","last_became_active":"2023-07-27T20:31:29.134100+0000","last_became_peered":"2023-07-27T20:31:29.134100+0000","last_unstale":"2023-07-27T20:31:34.158489+0000","last_undegraded":"2023-07-27T20:31:34.158489+0000","last_fullsized":"2023-07-27T20:31:34.158489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:53:35.781814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963026+0000","last_change":"2023-07-27T20:31:29.131991+0000","last_active":"2023-07-27T20:31:34.963026+0000","last_peered":"2023-07-27T20:31:34.963026+0000","last_clean":"2023-07-27T20:31:34.963026+0000","last_became_active":"2023-07-27T20:31:29.131669+0000","last_became_peered":"2023-07-27T20:31:29.131669+0000","last_unstale":"2023-07-27T20:31:34.963026+0000","last_undegraded":"2023-07-27T20:31:34.963026+0000","last_fullsized":"2023-07-27T20:31:34.963026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:57:21.999388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965148+0000","last_change":"2023-07-27T20:31:29.130808+0000","last_active":"2023-07-27T20:31:34.965148+0000","last_peered":"2023-07-27T20:31:34.965148+0000","last_clean":"2023-07-27T20:31:34.965148+0000","last_became_active":"2023-07-27T20:31:29.130489+0000","last_became_peered":"2023-07-27T20:31:29.130489+0000","last_unstale":"2023-07-27T20:31:34.965148+0000","last_undegraded":"2023-07-27T20:31:34.965148+0000","last_fullsized":"2023-07-27T20:31:34.965148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:58:01.396658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159103+0000","last_change":"2023-07-27T20:31:29.135952+0000","last_active":"2023-07-27T20:31:34.159103+0000","last_peered":"2023-07-27T20:31:34.159103+0000","last_clean":"2023-07-27T20:31:34.159103+0000","last_became_active":"2023-07-27T20:31:29.135040+0000","last_became_peered":"2023-07-27T20:31:29.135040+0000","last_unstale":"2023-07-27T20:31:34.159103+0000","last_undegraded":"2023-07-27T20:31:34.159103+0000","last_fullsized":"2023-07-27T20:31:34.159103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:41:09.372503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963458+0000","last_change":"2023-07-27T20:31:29.148526+0000","last_active":"2023-07-27T20:31:34.963458+0000","last_peered":"2023-07-27T20:31:34.963458+0000","last_clean":"2023-07-27T20:31:34.963458+0000","last_became_active":"2023-07-27T20:31:29.148256+0000","last_became_peered":"2023-07-27T20:31:29.148256+0000","last_unstale":"2023-07-27T20:31:34.963458+0000","last_undegraded":"2023-07-27T20:31:34.963458+0000","last_fullsized":"2023-07-27T20:31:34.963458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:38:08.459694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963994+0000","last_change":"2023-07-27T20:31:29.129400+0000","last_active":"2023-07-27T20:31:34.963994+0000","last_peered":"2023-07-27T20:31:34.963994+0000","last_clean":"2023-07-27T20:31:34.963994+0000","last_became_active":"2023-07-27T20:31:29.129138+0000","last_became_peered":"2023-07-27T20:31:29.129138+0000","last_unstale":"2023-07-27T20:31:34.963994+0000","last_undegraded":"2023-07-27T20:31:34.963994+0000","last_fullsized":"2023-07-27T20:31:34.963994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:24:57.182748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":913408,"data_stored":714279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":888832,"data_stored":710851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":294912,"data_stored":119991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":123751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":120553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T20:31:52.622 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T20:31:52.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.859+0000 7f867b9ff700 1 Processor -- start 2023-07-27T20:31:52.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.859+0000 7f867b9ff700 1 -- start start 2023-07-27T20:31:52.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.860+0000 7f867b9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f867406b150 0x7f86740c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:52.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.860+0000 7f867b9ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86741549f0 0x7f86741514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:52.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.861+0000 7f867b9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f867406b710 con 0x7f86740c4400 2023-07-27T20:31:52.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.861+0000 7f867b9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86741545d0 con 0x7f867406b150 2023-07-27T20:31:52.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.861+0000 7f867b9ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867406c860 con 0x7f86741549f0 2023-07-27T20:31:52.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.861+0000 7f8678f9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f867406b150 0x7f86740c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:52.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.861+0000 7f867979b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f86740c4400 0x7f86740c4cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55414/0 (socket says 172.21.15.72:55414) 2023-07-27T20:31:52.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.861+0000 7f867979b700 1 -- 172.21.15.72:0/1790923336 learned_addr learned my addr 172.21.15.72:0/1790923336 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:52.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.861+0000 7f8678f9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f867406b150 0x7f86740c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58392/0 (socket says 172.21.15.72:58392) 2023-07-27T20:31:52.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.861+0000 7f8679f9c700 1 --2- 172.21.15.72:0/1790923336 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86741549f0 0x7f86741514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:52.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.861+0000 7f8678f9a700 1 -- 172.21.15.72:0/1790923336 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86741549f0 msgr2=0x7f86741514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:52.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.861+0000 7f8678f9a700 1 --2- 172.21.15.72:0/1790923336 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86741549f0 0x7f86741514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:52.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.861+0000 7f8678f9a700 1 -- 172.21.15.72:0/1790923336 >> v1:172.21.15.72:6789/0 conn(0x7f86740c4400 legacy=0x7f86740c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:52.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.861+0000 7f8678f9a700 1 -- 172.21.15.72:0/1790923336 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867406b9f0 con 0x7f867406b150 2023-07-27T20:31:52.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.861+0000 7f8679f9c700 1 --2- 172.21.15.72:0/1790923336 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86741549f0 0x7f86741514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:31:52.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.861+0000 7f8678f9a700 1 --2- 172.21.15.72:0/1790923336 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f867406b150 0x7f86740c7710 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8664009840 tx=0x7f8664009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc931acc693fc6f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:52.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.862+0000 7f866bfff700 1 -- 172.21.15.72:0/1790923336 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8664011830 con 0x7f867406b150 2023-07-27T20:31:52.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.862+0000 7f866bfff700 1 -- 172.21.15.72:0/1790923336 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8664011990 con 0x7f867406b150 2023-07-27T20:31:52.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.862+0000 7f866bfff700 1 -- 172.21.15.72:0/1790923336 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8664011d20 con 0x7f867406b150 2023-07-27T20:31:52.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.862+0000 7f867b9ff700 1 -- 172.21.15.72:0/1790923336 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f867406b150 msgr2=0x7f86740c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:52.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.862+0000 7f867b9ff700 1 --2- 172.21.15.72:0/1790923336 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f867406b150 0x7f86740c7710 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8664009840 tx=0x7f8664009b50 comp rx=0 tx=0).stop 2023-07-27T20:31:52.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.862+0000 7f867b9ff700 1 -- 172.21.15.72:0/1790923336 shutdown_connections 2023-07-27T20:31:52.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.862+0000 7f867b9ff700 1 --2- 172.21.15.72:0/1790923336 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86741549f0 0x7f86741514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:52.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.862+0000 7f867b9ff700 1 --2- 172.21.15.72:0/1790923336 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f867406b150 0x7f86740c7710 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:52.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.862+0000 7f867b9ff700 1 -- 172.21.15.72:0/1790923336 >> 172.21.15.72:0/1790923336 conn(0x7f86740ab300 msgr2=0x7f86740ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:52.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.862+0000 7f867b9ff700 1 -- 172.21.15.72:0/1790923336 shutdown_connections 2023-07-27T20:31:52.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.862+0000 7f867b9ff700 1 -- 172.21.15.72:0/1790923336 wait complete. 2023-07-27T20:31:52.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.864+0000 7f867b9ff700 1 Processor -- start 2023-07-27T20:31:52.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.864+0000 7f867b9ff700 1 -- start start 2023-07-27T20:31:52.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.865+0000 7f867b9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f867406b150 0x7f86741e9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:52.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.865+0000 7f867b9ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86740c4400 0x7f86740add60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:52.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.865+0000 7f867b9ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86741549f0 0x7f86740c2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:52.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.865+0000 7f867b9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86740c3900 con 0x7f867406b150 2023-07-27T20:31:52.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.865+0000 7f867b9ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86740af050 con 0x7f86741549f0 2023-07-27T20:31:52.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.865+0000 7f867b9ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867414ebb0 con 0x7f86740c4400 2023-07-27T20:31:52.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.865+0000 7f867979b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f867406b150 0x7f86741e9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:52.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.865+0000 7f867979b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f867406b150 0x7f86741e9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58400/0 (socket says 172.21.15.72:58400) 2023-07-27T20:31:52.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.865+0000 7f867979b700 1 -- 172.21.15.72:0/3273701067 learned_addr learned my addr 172.21.15.72:0/3273701067 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:52.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.866+0000 7f8679f9c700 1 --2- 172.21.15.72:0/3273701067 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86741549f0 0x7f86740c2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:52.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.866+0000 7f8678f9a700 1 --2- 172.21.15.72:0/3273701067 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86740c4400 0x7f86740add60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:52.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.866+0000 7f867979b700 1 -- 172.21.15.72:0/3273701067 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86740c4400 msgr2=0x7f86740add60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:52.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.866+0000 7f867979b700 1 --2- 172.21.15.72:0/3273701067 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86740c4400 0x7f86740add60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:52.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.866+0000 7f867979b700 1 -- 172.21.15.72:0/3273701067 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86741549f0 msgr2=0x7f86740c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:52.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.866+0000 7f867979b700 1 --2- 172.21.15.72:0/3273701067 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86741549f0 0x7f86740c2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:52.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.866+0000 7f867979b700 1 -- 172.21.15.72:0/3273701067 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86640094a0 con 0x7f867406b150 2023-07-27T20:31:52.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.866+0000 7f867979b700 1 --2- 172.21.15.72:0/3273701067 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f867406b150 0x7f86741e9600 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f867000c550 tx=0x7f867000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:52.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.866+0000 7f8669ffb700 1 -- 172.21.15.72:0/3273701067 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8670005d70 con 0x7f867406b150 2023-07-27T20:31:52.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.866+0000 7f8669ffb700 1 -- 172.21.15.72:0/3273701067 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86700070d0 con 0x7f867406b150 2023-07-27T20:31:52.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.866+0000 7f867b9ff700 1 -- 172.21.15.72:0/3273701067 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86741ed940 con 0x7f867406b150 2023-07-27T20:31:52.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.866+0000 7f8669ffb700 1 -- 172.21.15.72:0/3273701067 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8670007440 con 0x7f867406b150 2023-07-27T20:31:52.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.866+0000 7f867b9ff700 1 -- 172.21.15.72:0/3273701067 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f867414e5a0 con 0x7f867406b150 2023-07-27T20:31:52.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.867+0000 7f867b9ff700 1 -- 172.21.15.72:0/3273701067 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86740bd1b0 con 0x7f867406b150 2023-07-27T20:31:52.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.868+0000 7f8669ffb700 1 -- 172.21.15.72:0/3273701067 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f86700075a0 con 0x7f867406b150 2023-07-27T20:31:52.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.870+0000 7f8669ffb700 1 --2- 172.21.15.72:0/3273701067 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f865806ace0 0x7f865806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:52.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.870+0000 7f8669ffb700 1 -- 172.21.15.72:0/3273701067 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8670088bf0 con 0x7f867406b150 2023-07-27T20:31:52.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.870+0000 7f8678f9a700 1 --2- 172.21.15.72:0/3273701067 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f865806ace0 0x7f865806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:52.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.871+0000 7f8678f9a700 1 --2- 172.21.15.72:0/3273701067 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f865806ace0 0x7f865806d1a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f86640090b0 tx=0x7f8664008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:52.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:52.874+0000 7f8669ffb700 1 -- 172.21.15.72:0/3273701067 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f86700539c0 con 0x7f867406b150 2023-07-27T20:31:53.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.062+0000 7f867b9ff700 1 -- 172.21.15.72:0/3273701067 --> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8674154180 con 0x7f865806ace0 2023-07-27T20:31:53.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.072+0000 7f8669ffb700 1 -- 172.21.15.72:0/3273701067 <== mgr.4107 v2:172.21.15.173:6832/910681537 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367430 (secure 0 0 0) 0x7f8664011750 con 0x7f865806ace0 2023-07-27T20:31:53.065 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:31:53.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.077+0000 7f867b9ff700 1 -- 172.21.15.72:0/3273701067 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f865806ace0 msgr2=0x7f865806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:53.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.077+0000 7f867b9ff700 1 --2- 172.21.15.72:0/3273701067 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f865806ace0 0x7f865806d1a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f86640090b0 tx=0x7f8664008030 comp rx=0 tx=0).stop 2023-07-27T20:31:53.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.077+0000 7f867b9ff700 1 -- 172.21.15.72:0/3273701067 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f867406b150 msgr2=0x7f86741e9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:53.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.077+0000 7f867b9ff700 1 --2- 172.21.15.72:0/3273701067 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f867406b150 0x7f86741e9600 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f867000c550 tx=0x7f867000c910 comp rx=0 tx=0).stop 2023-07-27T20:31:53.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.077+0000 7f867b9ff700 1 -- 172.21.15.72:0/3273701067 shutdown_connections 2023-07-27T20:31:53.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.077+0000 7f867b9ff700 1 --2- 172.21.15.72:0/3273701067 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86741549f0 0x7f86740c2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:53.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.077+0000 7f867b9ff700 1 --2- 172.21.15.72:0/3273701067 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f867406b150 0x7f86741e9600 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:53.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.077+0000 7f867b9ff700 1 --2- 172.21.15.72:0/3273701067 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f865806ace0 0x7f865806d1a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:53.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.077+0000 7f867b9ff700 1 --2- 172.21.15.72:0/3273701067 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86740c4400 0x7f86740add60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:53.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.077+0000 7f867b9ff700 1 -- 172.21.15.72:0/3273701067 >> 172.21.15.72:0/3273701067 conn(0x7f86740ab300 msgr2=0x7f86741509b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:53.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.077+0000 7f867b9ff700 1 -- 172.21.15.72:0/3273701067 shutdown_connections 2023-07-27T20:31:53.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.078+0000 7f867b9ff700 1 -- 172.21.15.72:0/3273701067 wait complete. 2023-07-27T20:31:53.069 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-07-27T20:31:53.083 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2023-07-27T20:31:52.531191+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219676,"kb_used_data":3496,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755044,"statfs":{"total":773094113280,"available":772869165056,"internally_reserved":0,"allocated":3579904,"data_stored":2149128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003529"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964347+0000","last_change":"2023-07-27T20:31:29.128137+0000","last_active":"2023-07-27T20:31:34.964347+0000","last_peered":"2023-07-27T20:31:34.964347+0000","last_clean":"2023-07-27T20:31:34.964347+0000","last_became_active":"2023-07-27T20:31:29.127840+0000","last_became_peered":"2023-07-27T20:31:29.127840+0000","last_unstale":"2023-07-27T20:31:34.964347+0000","last_undegraded":"2023-07-27T20:31:34.964347+0000","last_fullsized":"2023-07-27T20:31:34.964347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:59:36.649918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963365+0000","last_change":"2023-07-27T20:31:29.140868+0000","last_active":"2023-07-27T20:31:34.963365+0000","last_peered":"2023-07-27T20:31:34.963365+0000","last_clean":"2023-07-27T20:31:34.963365+0000","last_became_active":"2023-07-27T20:31:29.140592+0000","last_became_peered":"2023-07-27T20:31:29.140592+0000","last_unstale":"2023-07-27T20:31:34.963365+0000","last_undegraded":"2023-07-27T20:31:34.963365+0000","last_fullsized":"2023-07-27T20:31:34.963365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:48:10.867603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160140+0000","last_change":"2023-07-27T20:31:29.129303+0000","last_active":"2023-07-27T20:31:34.160140+0000","last_peered":"2023-07-27T20:31:34.160140+0000","last_clean":"2023-07-27T20:31:34.160140+0000","last_became_active":"2023-07-27T20:31:29.128569+0000","last_became_peered":"2023-07-27T20:31:29.128569+0000","last_unstale":"2023-07-27T20:31:34.160140+0000","last_undegraded":"2023-07-27T20:31:34.160140+0000","last_fullsized":"2023-07-27T20:31:34.160140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:10:18.495424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.962918+0000","last_change":"2023-07-27T20:31:29.134687+0000","last_active":"2023-07-27T20:31:34.962918+0000","last_peered":"2023-07-27T20:31:34.962918+0000","last_clean":"2023-07-27T20:31:34.962918+0000","last_became_active":"2023-07-27T20:31:29.134388+0000","last_became_peered":"2023-07-27T20:31:29.134388+0000","last_unstale":"2023-07-27T20:31:34.962918+0000","last_undegraded":"2023-07-27T20:31:34.962918+0000","last_fullsized":"2023-07-27T20:31:34.962918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:05:57.560432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158183+0000","last_change":"2023-07-27T20:31:29.127581+0000","last_active":"2023-07-27T20:31:34.158183+0000","last_peered":"2023-07-27T20:31:34.158183+0000","last_clean":"2023-07-27T20:31:34.158183+0000","last_became_active":"2023-07-27T20:31:29.127256+0000","last_became_peered":"2023-07-27T20:31:29.127256+0000","last_unstale":"2023-07-27T20:31:34.158183+0000","last_undegraded":"2023-07-27T20:31:34.158183+0000","last_fullsized":"2023-07-27T20:31:34.158183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:04:20.052228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158888+0000","last_change":"2023-07-27T20:31:29.130522+0000","last_active":"2023-07-27T20:31:34.158888+0000","last_peered":"2023-07-27T20:31:34.158888+0000","last_clean":"2023-07-27T20:31:34.158888+0000","last_became_active":"2023-07-27T20:31:29.129964+0000","last_became_peered":"2023-07-27T20:31:29.129964+0000","last_unstale":"2023-07-27T20:31:34.158888+0000","last_undegraded":"2023-07-27T20:31:34.158888+0000","last_fullsized":"2023-07-27T20:31:34.158888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:32:37.192663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159958+0000","last_change":"2023-07-27T20:31:29.138061+0000","last_active":"2023-07-27T20:31:34.159958+0000","last_peered":"2023-07-27T20:31:34.159958+0000","last_clean":"2023-07-27T20:31:34.159958+0000","last_became_active":"2023-07-27T20:31:29.137407+0000","last_became_peered":"2023-07-27T20:31:29.137407+0000","last_unstale":"2023-07-27T20:31:34.159958+0000","last_undegraded":"2023-07-27T20:31:34.159958+0000","last_fullsized":"2023-07-27T20:31:34.159958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:52:37.919677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.962665+0000","last_change":"2023-07-27T20:31:29.142667+0000","last_active":"2023-07-27T20:31:34.962665+0000","last_peered":"2023-07-27T20:31:34.962665+0000","last_clean":"2023-07-27T20:31:34.962665+0000","last_became_active":"2023-07-27T20:31:29.141164+0000","last_became_peered":"2023-07-27T20:31:29.141164+0000","last_unstale":"2023-07-27T20:31:34.962665+0000","last_undegraded":"2023-07-27T20:31:34.962665+0000","last_fullsized":"2023-07-27T20:31:34.962665+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:32:33.408454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157543+0000","last_change":"2023-07-27T20:31:29.129290+0000","last_active":"2023-07-27T20:31:34.157543+0000","last_peered":"2023-07-27T20:31:34.157543+0000","last_clean":"2023-07-27T20:31:34.157543+0000","last_became_active":"2023-07-27T20:31:29.127546+0000","last_became_peered":"2023-07-27T20:31:29.127546+0000","last_unstale":"2023-07-27T20:31:34.157543+0000","last_undegraded":"2023-07-27T20:31:34.157543+0000","last_fullsized":"2023-07-27T20:31:34.157543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:07:33.134307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963982+0000","last_change":"2023-07-27T20:31:29.146424+0000","last_active":"2023-07-27T20:31:34.963982+0000","last_peered":"2023-07-27T20:31:34.963982+0000","last_clean":"2023-07-27T20:31:34.963982+0000","last_became_active":"2023-07-27T20:31:29.146170+0000","last_became_peered":"2023-07-27T20:31:29.146170+0000","last_unstale":"2023-07-27T20:31:34.963982+0000","last_undegraded":"2023-07-27T20:31:34.963982+0000","last_fullsized":"2023-07-27T20:31:34.963982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:30:09.671437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160355+0000","last_change":"2023-07-27T20:31:29.137685+0000","last_active":"2023-07-27T20:31:34.160355+0000","last_peered":"2023-07-27T20:31:34.160355+0000","last_clean":"2023-07-27T20:31:34.160355+0000","last_became_active":"2023-07-27T20:31:29.130560+0000","last_became_peered":"2023-07-27T20:31:29.130560+0000","last_unstale":"2023-07-27T20:31:34.160355+0000","last_undegraded":"2023-07-27T20:31:34.160355+0000","last_fullsized":"2023-07-27T20:31:34.160355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:11:40.101545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963386+0000","last_change":"2023-07-27T20:31:29.134204+0000","last_active":"2023-07-27T20:31:34.963386+0000","last_peered":"2023-07-27T20:31:34.963386+0000","last_clean":"2023-07-27T20:31:34.963386+0000","last_became_active":"2023-07-27T20:31:29.133944+0000","last_became_peered":"2023-07-27T20:31:29.133944+0000","last_unstale":"2023-07-27T20:31:34.963386+0000","last_undegraded":"2023-07-27T20:31:34.963386+0000","last_fullsized":"2023-07-27T20:31:34.963386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:18:04.393407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964703+0000","last_change":"2023-07-27T20:31:29.126910+0000","last_active":"2023-07-27T20:31:34.964703+0000","last_peered":"2023-07-27T20:31:34.964703+0000","last_clean":"2023-07-27T20:31:34.964703+0000","last_became_active":"2023-07-27T20:31:29.126575+0000","last_became_peered":"2023-07-27T20:31:29.126575+0000","last_unstale":"2023-07-27T20:31:34.964703+0000","last_undegraded":"2023-07-27T20:31:34.964703+0000","last_fullsized":"2023-07-27T20:31:34.964703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:31:04.071892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.962855+0000","last_change":"2023-07-27T20:31:29.139957+0000","last_active":"2023-07-27T20:31:34.962855+0000","last_peered":"2023-07-27T20:31:34.962855+0000","last_clean":"2023-07-27T20:31:34.962855+0000","last_became_active":"2023-07-27T20:31:29.139623+0000","last_became_peered":"2023-07-27T20:31:29.139623+0000","last_unstale":"2023-07-27T20:31:34.962855+0000","last_undegraded":"2023-07-27T20:31:34.962855+0000","last_fullsized":"2023-07-27T20:31:34.962855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:22:49.467838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159607+0000","last_change":"2023-07-27T20:31:29.143739+0000","last_active":"2023-07-27T20:31:34.159607+0000","last_peered":"2023-07-27T20:31:34.159607+0000","last_clean":"2023-07-27T20:31:34.159607+0000","last_became_active":"2023-07-27T20:31:29.143337+0000","last_became_peered":"2023-07-27T20:31:29.143337+0000","last_unstale":"2023-07-27T20:31:34.159607+0000","last_undegraded":"2023-07-27T20:31:34.159607+0000","last_fullsized":"2023-07-27T20:31:34.159607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:24:57.182748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158603+0000","last_change":"2023-07-27T20:31:29.125242+0000","last_active":"2023-07-27T20:31:34.158603+0000","last_peered":"2023-07-27T20:31:34.158603+0000","last_clean":"2023-07-27T20:31:34.158603+0000","last_became_active":"2023-07-27T20:31:29.124967+0000","last_became_peered":"2023-07-27T20:31:29.124967+0000","last_unstale":"2023-07-27T20:31:34.158603+0000","last_undegraded":"2023-07-27T20:31:34.158603+0000","last_fullsized":"2023-07-27T20:31:34.158603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:31:04.269016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157859+0000","last_change":"2023-07-27T20:31:29.127644+0000","last_active":"2023-07-27T20:31:34.157859+0000","last_peered":"2023-07-27T20:31:34.157859+0000","last_clean":"2023-07-27T20:31:34.157859+0000","last_became_active":"2023-07-27T20:31:29.127277+0000","last_became_peered":"2023-07-27T20:31:29.127277+0000","last_unstale":"2023-07-27T20:31:34.157859+0000","last_undegraded":"2023-07-27T20:31:34.157859+0000","last_fullsized":"2023-07-27T20:31:34.157859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:38:08.459694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160497+0000","last_change":"2023-07-27T20:31:29.131333+0000","last_active":"2023-07-27T20:31:34.160497+0000","last_peered":"2023-07-27T20:31:34.160497+0000","last_clean":"2023-07-27T20:31:34.160497+0000","last_became_active":"2023-07-27T20:31:29.131016+0000","last_became_peered":"2023-07-27T20:31:29.131016+0000","last_unstale":"2023-07-27T20:31:34.160497+0000","last_undegraded":"2023-07-27T20:31:34.160497+0000","last_fullsized":"2023-07-27T20:31:34.160497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:22:01.318022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963957+0000","last_change":"2023-07-27T20:31:29.133266+0000","last_active":"2023-07-27T20:31:34.963957+0000","last_peered":"2023-07-27T20:31:34.963957+0000","last_clean":"2023-07-27T20:31:34.963957+0000","last_became_active":"2023-07-27T20:31:29.132915+0000","last_became_peered":"2023-07-27T20:31:29.132915+0000","last_unstale":"2023-07-27T20:31:34.963957+0000","last_undegraded":"2023-07-27T20:31:34.963957+0000","last_fullsized":"2023-07-27T20:31:34.963957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:56:38.159541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158925+0000","last_change":"2023-07-27T20:31:29.141130+0000","last_active":"2023-07-27T20:31:34.158925+0000","last_peered":"2023-07-27T20:31:34.158925+0000","last_clean":"2023-07-27T20:31:34.158925+0000","last_became_active":"2023-07-27T20:31:29.140883+0000","last_became_peered":"2023-07-27T20:31:29.140883+0000","last_unstale":"2023-07-27T20:31:34.158925+0000","last_undegraded":"2023-07-27T20:31:34.158925+0000","last_fullsized":"2023-07-27T20:31:34.158925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:08:14.703624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159167+0000","last_change":"2023-07-27T20:31:29.139144+0000","last_active":"2023-07-27T20:31:34.159167+0000","last_peered":"2023-07-27T20:31:34.159167+0000","last_clean":"2023-07-27T20:31:34.159167+0000","last_became_active":"2023-07-27T20:31:29.137774+0000","last_became_peered":"2023-07-27T20:31:29.137774+0000","last_unstale":"2023-07-27T20:31:34.159167+0000","last_undegraded":"2023-07-27T20:31:34.159167+0000","last_fullsized":"2023-07-27T20:31:34.159167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:21:00.439118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157696+0000","last_change":"2023-07-27T20:31:29.131957+0000","last_active":"2023-07-27T20:31:34.157696+0000","last_peered":"2023-07-27T20:31:34.157696+0000","last_clean":"2023-07-27T20:31:34.157696+0000","last_became_active":"2023-07-27T20:31:29.131512+0000","last_became_peered":"2023-07-27T20:31:29.131512+0000","last_unstale":"2023-07-27T20:31:34.157696+0000","last_undegraded":"2023-07-27T20:31:34.157696+0000","last_fullsized":"2023-07-27T20:31:34.157696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:41:18.405424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964757+0000","last_change":"2023-07-27T20:31:29.130648+0000","last_active":"2023-07-27T20:31:34.964757+0000","last_peered":"2023-07-27T20:31:34.964757+0000","last_clean":"2023-07-27T20:31:34.964757+0000","last_became_active":"2023-07-27T20:31:29.130145+0000","last_became_peered":"2023-07-27T20:31:29.130145+0000","last_unstale":"2023-07-27T20:31:34.964757+0000","last_undegraded":"2023-07-27T20:31:34.964757+0000","last_fullsized":"2023-07-27T20:31:34.964757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:25:53.220364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159388+0000","last_change":"2023-07-27T20:31:29.138599+0000","last_active":"2023-07-27T20:31:34.159388+0000","last_peered":"2023-07-27T20:31:34.159388+0000","last_clean":"2023-07-27T20:31:34.159388+0000","last_became_active":"2023-07-27T20:31:29.138323+0000","last_became_peered":"2023-07-27T20:31:29.138323+0000","last_unstale":"2023-07-27T20:31:34.159388+0000","last_undegraded":"2023-07-27T20:31:34.159388+0000","last_fullsized":"2023-07-27T20:31:34.159388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:03:16.615704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965611+0000","last_change":"2023-07-27T20:31:29.136600+0000","last_active":"2023-07-27T20:31:34.965611+0000","last_peered":"2023-07-27T20:31:34.965611+0000","last_clean":"2023-07-27T20:31:34.965611+0000","last_became_active":"2023-07-27T20:31:29.136316+0000","last_became_peered":"2023-07-27T20:31:29.136316+0000","last_unstale":"2023-07-27T20:31:34.965611+0000","last_undegraded":"2023-07-27T20:31:34.965611+0000","last_fullsized":"2023-07-27T20:31:34.965611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:46:44.091855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963642+0000","last_change":"2023-07-27T20:31:29.135116+0000","last_active":"2023-07-27T20:31:34.963642+0000","last_peered":"2023-07-27T20:31:34.963642+0000","last_clean":"2023-07-27T20:31:34.963642+0000","last_became_active":"2023-07-27T20:31:29.134786+0000","last_became_peered":"2023-07-27T20:31:29.134786+0000","last_unstale":"2023-07-27T20:31:34.963642+0000","last_undegraded":"2023-07-27T20:31:34.963642+0000","last_fullsized":"2023-07-27T20:31:34.963642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:21:00.439118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963660+0000","last_change":"2023-07-27T20:31:29.145388+0000","last_active":"2023-07-27T20:31:34.963660+0000","last_peered":"2023-07-27T20:31:34.963660+0000","last_clean":"2023-07-27T20:31:34.963660+0000","last_became_active":"2023-07-27T20:31:29.141813+0000","last_became_peered":"2023-07-27T20:31:29.141813+0000","last_unstale":"2023-07-27T20:31:34.963660+0000","last_undegraded":"2023-07-27T20:31:34.963660+0000","last_fullsized":"2023-07-27T20:31:34.963660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:52:37.919677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159610+0000","last_change":"2023-07-27T20:31:33.179641+0000","last_active":"2023-07-27T20:31:34.159610+0000","last_peered":"2023-07-27T20:31:34.159610+0000","last_clean":"2023-07-27T20:31:34.159610+0000","last_became_active":"2023-07-27T20:31:33.179219+0000","last_became_peered":"2023-07-27T20:31:33.179219+0000","last_unstale":"2023-07-27T20:31:34.159610+0000","last_undegraded":"2023-07-27T20:31:34.159610+0000","last_fullsized":"2023-07-27T20:31:34.159610+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:22:32.926771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158940+0000","last_change":"2023-07-27T20:31:28.123712+0000","last_active":"2023-07-27T20:31:34.158940+0000","last_peered":"2023-07-27T20:31:34.158940+0000","last_clean":"2023-07-27T20:31:34.158940+0000","last_became_active":"2023-07-27T20:31:28.123425+0000","last_became_peered":"2023-07-27T20:31:28.123425+0000","last_unstale":"2023-07-27T20:31:34.158940+0000","last_undegraded":"2023-07-27T20:31:34.158940+0000","last_fullsized":"2023-07-27T20:31:34.158940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:26:08.939256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964276+0000","last_change":"2023-07-27T20:31:29.130374+0000","last_active":"2023-07-27T20:31:34.964276+0000","last_peered":"2023-07-27T20:31:34.964276+0000","last_clean":"2023-07-27T20:31:34.964276+0000","last_became_active":"2023-07-27T20:31:29.130099+0000","last_became_peered":"2023-07-27T20:31:29.130099+0000","last_unstale":"2023-07-27T20:31:34.964276+0000","last_undegraded":"2023-07-27T20:31:34.964276+0000","last_fullsized":"2023-07-27T20:31:34.964276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:17:03.497602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963430+0000","last_change":"2023-07-27T20:31:33.178251+0000","last_active":"2023-07-27T20:31:34.963430+0000","last_peered":"2023-07-27T20:31:34.963430+0000","last_clean":"2023-07-27T20:31:34.963430+0000","last_became_active":"2023-07-27T20:31:33.177826+0000","last_became_peered":"2023-07-27T20:31:33.177826+0000","last_unstale":"2023-07-27T20:31:34.963430+0000","last_undegraded":"2023-07-27T20:31:34.963430+0000","last_fullsized":"2023-07-27T20:31:34.963430+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:59:12.877709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.962935+0000","last_change":"2023-07-27T20:31:28.123837+0000","last_active":"2023-07-27T20:31:34.962935+0000","last_peered":"2023-07-27T20:31:34.962935+0000","last_clean":"2023-07-27T20:31:34.962935+0000","last_became_active":"2023-07-27T20:31:28.123456+0000","last_became_peered":"2023-07-27T20:31:28.123456+0000","last_unstale":"2023-07-27T20:31:34.962935+0000","last_undegraded":"2023-07-27T20:31:34.962935+0000","last_fullsized":"2023-07-27T20:31:34.962935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:56:54.247350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158484+0000","last_change":"2023-07-27T20:31:29.141212+0000","last_active":"2023-07-27T20:31:34.158484+0000","last_peered":"2023-07-27T20:31:34.158484+0000","last_clean":"2023-07-27T20:31:34.158484+0000","last_became_active":"2023-07-27T20:31:29.140956+0000","last_became_peered":"2023-07-27T20:31:29.140956+0000","last_unstale":"2023-07-27T20:31:34.158484+0000","last_undegraded":"2023-07-27T20:31:34.158484+0000","last_fullsized":"2023-07-27T20:31:34.158484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:43:10.912905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158360+0000","last_change":"2023-07-27T20:31:33.182932+0000","last_active":"2023-07-27T20:31:34.158360+0000","last_peered":"2023-07-27T20:31:34.158360+0000","last_clean":"2023-07-27T20:31:34.158360+0000","last_became_active":"2023-07-27T20:31:33.182477+0000","last_became_peered":"2023-07-27T20:31:33.182477+0000","last_unstale":"2023-07-27T20:31:34.158360+0000","last_undegraded":"2023-07-27T20:31:34.158360+0000","last_fullsized":"2023-07-27T20:31:34.158360+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:25:57.270856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965391+0000","last_change":"2023-07-27T20:31:28.120846+0000","last_active":"2023-07-27T20:31:34.965391+0000","last_peered":"2023-07-27T20:31:34.965391+0000","last_clean":"2023-07-27T20:31:34.965391+0000","last_became_active":"2023-07-27T20:31:28.120544+0000","last_became_peered":"2023-07-27T20:31:28.120544+0000","last_unstale":"2023-07-27T20:31:34.965391+0000","last_undegraded":"2023-07-27T20:31:34.965391+0000","last_fullsized":"2023-07-27T20:31:34.965391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:17:24.488257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963834+0000","last_change":"2023-07-27T20:31:29.144062+0000","last_active":"2023-07-27T20:31:34.963834+0000","last_peered":"2023-07-27T20:31:34.963834+0000","last_clean":"2023-07-27T20:31:34.963834+0000","last_became_active":"2023-07-27T20:31:29.143781+0000","last_became_peered":"2023-07-27T20:31:29.143781+0000","last_unstale":"2023-07-27T20:31:34.963834+0000","last_undegraded":"2023-07-27T20:31:34.963834+0000","last_fullsized":"2023-07-27T20:31:34.963834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:17:24.376438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963333+0000","last_change":"2023-07-27T20:31:33.185760+0000","last_active":"2023-07-27T20:31:34.963333+0000","last_peered":"2023-07-27T20:31:34.963333+0000","last_clean":"2023-07-27T20:31:34.963333+0000","last_became_active":"2023-07-27T20:31:33.185326+0000","last_became_peered":"2023-07-27T20:31:33.185326+0000","last_unstale":"2023-07-27T20:31:34.963333+0000","last_undegraded":"2023-07-27T20:31:34.963333+0000","last_fullsized":"2023-07-27T20:31:34.963333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:13:18.283879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157795+0000","last_change":"2023-07-27T20:31:28.130352+0000","last_active":"2023-07-27T20:31:34.157795+0000","last_peered":"2023-07-27T20:31:34.157795+0000","last_clean":"2023-07-27T20:31:34.157795+0000","last_became_active":"2023-07-27T20:31:28.130107+0000","last_became_peered":"2023-07-27T20:31:28.130107+0000","last_unstale":"2023-07-27T20:31:34.157795+0000","last_undegraded":"2023-07-27T20:31:34.157795+0000","last_fullsized":"2023-07-27T20:31:34.157795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:32:39.371251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965281+0000","last_change":"2023-07-27T20:31:29.130936+0000","last_active":"2023-07-27T20:31:34.965281+0000","last_peered":"2023-07-27T20:31:34.965281+0000","last_clean":"2023-07-27T20:31:34.965281+0000","last_became_active":"2023-07-27T20:31:29.130687+0000","last_became_peered":"2023-07-27T20:31:29.130687+0000","last_unstale":"2023-07-27T20:31:34.965281+0000","last_undegraded":"2023-07-27T20:31:34.965281+0000","last_fullsized":"2023-07-27T20:31:34.965281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:26:00.598434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158984+0000","last_change":"2023-07-27T20:31:33.180364+0000","last_active":"2023-07-27T20:31:34.158984+0000","last_peered":"2023-07-27T20:31:34.158984+0000","last_clean":"2023-07-27T20:31:34.158984+0000","last_became_active":"2023-07-27T20:31:33.179972+0000","last_became_peered":"2023-07-27T20:31:33.179972+0000","last_unstale":"2023-07-27T20:31:34.158984+0000","last_undegraded":"2023-07-27T20:31:34.158984+0000","last_fullsized":"2023-07-27T20:31:34.158984+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:59:31.342576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963829+0000","last_change":"2023-07-27T20:31:28.127766+0000","last_active":"2023-07-27T20:31:34.963829+0000","last_peered":"2023-07-27T20:31:34.963829+0000","last_clean":"2023-07-27T20:31:34.963829+0000","last_became_active":"2023-07-27T20:31:28.127443+0000","last_became_peered":"2023-07-27T20:31:28.127443+0000","last_unstale":"2023-07-27T20:31:34.963829+0000","last_undegraded":"2023-07-27T20:31:34.963829+0000","last_fullsized":"2023-07-27T20:31:34.963829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:04:21.752471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964865+0000","last_change":"2023-07-27T20:31:29.144710+0000","last_active":"2023-07-27T20:31:34.964865+0000","last_peered":"2023-07-27T20:31:34.964865+0000","last_clean":"2023-07-27T20:31:34.964865+0000","last_became_active":"2023-07-27T20:31:29.142111+0000","last_became_peered":"2023-07-27T20:31:29.142111+0000","last_unstale":"2023-07-27T20:31:34.964865+0000","last_undegraded":"2023-07-27T20:31:34.964865+0000","last_fullsized":"2023-07-27T20:31:34.964865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:23:30.181522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963728+0000","last_change":"2023-07-27T20:31:33.183443+0000","last_active":"2023-07-27T20:31:34.963728+0000","last_peered":"2023-07-27T20:31:34.963728+0000","last_clean":"2023-07-27T20:31:34.963728+0000","last_became_active":"2023-07-27T20:31:33.183014+0000","last_became_peered":"2023-07-27T20:31:33.183014+0000","last_unstale":"2023-07-27T20:31:34.963728+0000","last_undegraded":"2023-07-27T20:31:34.963728+0000","last_fullsized":"2023-07-27T20:31:34.963728+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:41:22.455916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160506+0000","last_change":"2023-07-27T20:31:28.123550+0000","last_active":"2023-07-27T20:31:34.160506+0000","last_peered":"2023-07-27T20:31:34.160506+0000","last_clean":"2023-07-27T20:31:34.160506+0000","last_became_active":"2023-07-27T20:31:28.123257+0000","last_became_peered":"2023-07-27T20:31:28.123257+0000","last_unstale":"2023-07-27T20:31:34.160506+0000","last_undegraded":"2023-07-27T20:31:34.160506+0000","last_fullsized":"2023-07-27T20:31:34.160506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:32:39.371251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963506+0000","last_change":"2023-07-27T20:31:29.136453+0000","last_active":"2023-07-27T20:31:34.963506+0000","last_peered":"2023-07-27T20:31:34.963506+0000","last_clean":"2023-07-27T20:31:34.963506+0000","last_became_active":"2023-07-27T20:31:29.136266+0000","last_became_peered":"2023-07-27T20:31:29.136266+0000","last_unstale":"2023-07-27T20:31:34.963506+0000","last_undegraded":"2023-07-27T20:31:34.963506+0000","last_fullsized":"2023-07-27T20:31:34.963506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:59:27.292083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.962973+0000","last_change":"2023-07-27T20:31:33.184926+0000","last_active":"2023-07-27T20:31:34.962973+0000","last_peered":"2023-07-27T20:31:34.962973+0000","last_clean":"2023-07-27T20:31:34.962973+0000","last_became_active":"2023-07-27T20:31:33.184543+0000","last_became_peered":"2023-07-27T20:31:33.184543+0000","last_unstale":"2023-07-27T20:31:34.962973+0000","last_undegraded":"2023-07-27T20:31:34.962973+0000","last_fullsized":"2023-07-27T20:31:34.962973+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:14:53.290135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:47.846131+0000","last_change":"2023-07-27T20:31:28.109472+0000","last_active":"2023-07-27T20:31:47.846131+0000","last_peered":"2023-07-27T20:31:47.846131+0000","last_clean":"2023-07-27T20:31:47.846131+0000","last_became_active":"2023-07-27T20:31:28.108072+0000","last_became_peered":"2023-07-27T20:31:28.108072+0000","last_unstale":"2023-07-27T20:31:47.846131+0000","last_undegraded":"2023-07-27T20:31:47.846131+0000","last_fullsized":"2023-07-27T20:31:47.846131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:10:52.937708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159663+0000","last_change":"2023-07-27T20:31:29.140753+0000","last_active":"2023-07-27T20:31:34.159663+0000","last_peered":"2023-07-27T20:31:34.159663+0000","last_clean":"2023-07-27T20:31:34.159663+0000","last_became_active":"2023-07-27T20:31:29.140474+0000","last_became_peered":"2023-07-27T20:31:29.140474+0000","last_unstale":"2023-07-27T20:31:34.159663+0000","last_undegraded":"2023-07-27T20:31:34.159663+0000","last_fullsized":"2023-07-27T20:31:34.159663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:19:38.010331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963783+0000","last_change":"2023-07-27T20:31:33.183268+0000","last_active":"2023-07-27T20:31:34.963783+0000","last_peered":"2023-07-27T20:31:34.963783+0000","last_clean":"2023-07-27T20:31:34.963783+0000","last_became_active":"2023-07-27T20:31:33.182894+0000","last_became_peered":"2023-07-27T20:31:33.182894+0000","last_unstale":"2023-07-27T20:31:34.963783+0000","last_undegraded":"2023-07-27T20:31:34.963783+0000","last_fullsized":"2023-07-27T20:31:34.963783+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:07:37.184799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159042+0000","last_change":"2023-07-27T20:31:28.126200+0000","last_active":"2023-07-27T20:31:34.159042+0000","last_peered":"2023-07-27T20:31:34.159042+0000","last_clean":"2023-07-27T20:31:34.159042+0000","last_became_active":"2023-07-27T20:31:28.125867+0000","last_became_peered":"2023-07-27T20:31:28.125867+0000","last_unstale":"2023-07-27T20:31:34.159042+0000","last_undegraded":"2023-07-27T20:31:34.159042+0000","last_fullsized":"2023-07-27T20:31:34.159042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:59:02.266953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965069+0000","last_change":"2023-07-27T20:31:29.132793+0000","last_active":"2023-07-27T20:31:34.965069+0000","last_peered":"2023-07-27T20:31:34.965069+0000","last_clean":"2023-07-27T20:31:34.965069+0000","last_became_active":"2023-07-27T20:31:29.132532+0000","last_became_peered":"2023-07-27T20:31:29.132532+0000","last_unstale":"2023-07-27T20:31:34.965069+0000","last_undegraded":"2023-07-27T20:31:34.965069+0000","last_fullsized":"2023-07-27T20:31:34.965069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:08:38.076682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964916+0000","last_change":"2023-07-27T20:31:33.177965+0000","last_active":"2023-07-27T20:31:34.964916+0000","last_peered":"2023-07-27T20:31:34.964916+0000","last_clean":"2023-07-27T20:31:34.964916+0000","last_became_active":"2023-07-27T20:31:33.177476+0000","last_became_peered":"2023-07-27T20:31:33.177476+0000","last_unstale":"2023-07-27T20:31:34.964916+0000","last_undegraded":"2023-07-27T20:31:34.964916+0000","last_fullsized":"2023-07-27T20:31:34.964916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:00:33.711486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157385+0000","last_change":"2023-07-27T20:31:28.108577+0000","last_active":"2023-07-27T20:31:34.157385+0000","last_peered":"2023-07-27T20:31:34.157385+0000","last_clean":"2023-07-27T20:31:34.157385+0000","last_became_active":"2023-07-27T20:31:28.108279+0000","last_became_peered":"2023-07-27T20:31:28.108279+0000","last_unstale":"2023-07-27T20:31:34.157385+0000","last_undegraded":"2023-07-27T20:31:34.157385+0000","last_fullsized":"2023-07-27T20:31:34.157385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:29:56.003949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963523+0000","last_change":"2023-07-27T20:31:29.142170+0000","last_active":"2023-07-27T20:31:34.963523+0000","last_peered":"2023-07-27T20:31:34.963523+0000","last_clean":"2023-07-27T20:31:34.963523+0000","last_became_active":"2023-07-27T20:31:29.141464+0000","last_became_peered":"2023-07-27T20:31:29.141464+0000","last_unstale":"2023-07-27T20:31:34.963523+0000","last_undegraded":"2023-07-27T20:31:34.963523+0000","last_fullsized":"2023-07-27T20:31:34.963523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:29:57.010683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965238+0000","last_change":"2023-07-27T20:31:33.181354+0000","last_active":"2023-07-27T20:31:34.965238+0000","last_peered":"2023-07-27T20:31:34.965238+0000","last_clean":"2023-07-27T20:31:34.965238+0000","last_became_active":"2023-07-27T20:31:33.180937+0000","last_became_peered":"2023-07-27T20:31:33.180937+0000","last_unstale":"2023-07-27T20:31:34.965238+0000","last_undegraded":"2023-07-27T20:31:34.965238+0000","last_fullsized":"2023-07-27T20:31:34.965238+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:09:47.445321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159771+0000","last_change":"2023-07-27T20:31:28.126220+0000","last_active":"2023-07-27T20:31:34.159771+0000","last_peered":"2023-07-27T20:31:34.159771+0000","last_clean":"2023-07-27T20:31:34.159771+0000","last_became_active":"2023-07-27T20:31:28.125857+0000","last_became_peered":"2023-07-27T20:31:28.125857+0000","last_unstale":"2023-07-27T20:31:34.159771+0000","last_undegraded":"2023-07-27T20:31:34.159771+0000","last_fullsized":"2023-07-27T20:31:34.159771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:29:56.003949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157853+0000","last_change":"2023-07-27T20:31:29.128032+0000","last_active":"2023-07-27T20:31:34.157853+0000","last_peered":"2023-07-27T20:31:34.157853+0000","last_clean":"2023-07-27T20:31:34.157853+0000","last_became_active":"2023-07-27T20:31:29.127199+0000","last_became_peered":"2023-07-27T20:31:29.127199+0000","last_unstale":"2023-07-27T20:31:34.157853+0000","last_undegraded":"2023-07-27T20:31:34.157853+0000","last_fullsized":"2023-07-27T20:31:34.157853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:30:09.671437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963089+0000","last_change":"2023-07-27T20:31:33.190228+0000","last_active":"2023-07-27T20:31:34.963089+0000","last_peered":"2023-07-27T20:31:34.963089+0000","last_clean":"2023-07-27T20:31:34.963089+0000","last_became_active":"2023-07-27T20:31:33.188522+0000","last_became_peered":"2023-07-27T20:31:33.188522+0000","last_unstale":"2023-07-27T20:31:34.963089+0000","last_undegraded":"2023-07-27T20:31:34.963089+0000","last_fullsized":"2023-07-27T20:31:34.963089+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:13:45.447971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.962746+0000","last_change":"2023-07-27T20:31:28.119987+0000","last_active":"2023-07-27T20:31:34.962746+0000","last_peered":"2023-07-27T20:31:34.962746+0000","last_clean":"2023-07-27T20:31:34.962746+0000","last_became_active":"2023-07-27T20:31:28.119662+0000","last_became_peered":"2023-07-27T20:31:28.119662+0000","last_unstale":"2023-07-27T20:31:34.962746+0000","last_undegraded":"2023-07-27T20:31:34.962746+0000","last_fullsized":"2023-07-27T20:31:34.962746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:13:43.260178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965357+0000","last_change":"2023-07-27T20:31:29.138880+0000","last_active":"2023-07-27T20:31:34.965357+0000","last_peered":"2023-07-27T20:31:34.965357+0000","last_clean":"2023-07-27T20:31:34.965357+0000","last_became_active":"2023-07-27T20:31:29.138642+0000","last_became_peered":"2023-07-27T20:31:29.138642+0000","last_unstale":"2023-07-27T20:31:34.965357+0000","last_undegraded":"2023-07-27T20:31:34.965357+0000","last_fullsized":"2023-07-27T20:31:34.965357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:59:15.743619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160177+0000","last_change":"2023-07-27T20:31:33.184734+0000","last_active":"2023-07-27T20:31:34.160177+0000","last_peered":"2023-07-27T20:31:34.160177+0000","last_clean":"2023-07-27T20:31:34.160177+0000","last_became_active":"2023-07-27T20:31:33.183711+0000","last_became_peered":"2023-07-27T20:31:33.183711+0000","last_unstale":"2023-07-27T20:31:34.160177+0000","last_undegraded":"2023-07-27T20:31:34.160177+0000","last_fullsized":"2023-07-27T20:31:34.160177+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:07:37.184799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160260+0000","last_change":"2023-07-27T20:31:28.126412+0000","last_active":"2023-07-27T20:31:34.160260+0000","last_peered":"2023-07-27T20:31:34.160260+0000","last_clean":"2023-07-27T20:31:34.160260+0000","last_became_active":"2023-07-27T20:31:28.125276+0000","last_became_peered":"2023-07-27T20:31:28.125276+0000","last_unstale":"2023-07-27T20:31:34.160260+0000","last_undegraded":"2023-07-27T20:31:34.160260+0000","last_fullsized":"2023-07-27T20:31:34.160260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:04:21.752471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.962588+0000","last_change":"2023-07-27T20:31:29.141157+0000","last_active":"2023-07-27T20:31:34.962588+0000","last_peered":"2023-07-27T20:31:34.962588+0000","last_clean":"2023-07-27T20:31:34.962588+0000","last_became_active":"2023-07-27T20:31:29.140721+0000","last_became_peered":"2023-07-27T20:31:29.140721+0000","last_unstale":"2023-07-27T20:31:34.962588+0000","last_undegraded":"2023-07-27T20:31:34.962588+0000","last_fullsized":"2023-07-27T20:31:34.962588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:31:18.732492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.962761+0000","last_change":"2023-07-27T20:31:33.179053+0000","last_active":"2023-07-27T20:31:34.962761+0000","last_peered":"2023-07-27T20:31:34.962761+0000","last_clean":"2023-07-27T20:31:34.962761+0000","last_became_active":"2023-07-27T20:31:33.178636+0000","last_became_peered":"2023-07-27T20:31:33.178636+0000","last_unstale":"2023-07-27T20:31:34.962761+0000","last_undegraded":"2023-07-27T20:31:34.962761+0000","last_fullsized":"2023-07-27T20:31:34.962761+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:21:33.766448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160260+0000","last_change":"2023-07-27T20:31:28.122016+0000","last_active":"2023-07-27T20:31:34.160260+0000","last_peered":"2023-07-27T20:31:34.160260+0000","last_clean":"2023-07-27T20:31:34.160260+0000","last_became_active":"2023-07-27T20:31:28.121722+0000","last_became_peered":"2023-07-27T20:31:28.121722+0000","last_unstale":"2023-07-27T20:31:34.160260+0000","last_undegraded":"2023-07-27T20:31:34.160260+0000","last_fullsized":"2023-07-27T20:31:34.160260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:38:07.452960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159369+0000","last_change":"2023-07-27T20:31:29.126285+0000","last_active":"2023-07-27T20:31:34.159369+0000","last_peered":"2023-07-27T20:31:34.159369+0000","last_clean":"2023-07-27T20:31:34.159369+0000","last_became_active":"2023-07-27T20:31:29.126028+0000","last_became_peered":"2023-07-27T20:31:29.126028+0000","last_unstale":"2023-07-27T20:31:34.159369+0000","last_undegraded":"2023-07-27T20:31:34.159369+0000","last_fullsized":"2023-07-27T20:31:34.159369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:34:02.603036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964503+0000","last_change":"2023-07-27T20:31:33.192421+0000","last_active":"2023-07-27T20:31:34.964503+0000","last_peered":"2023-07-27T20:31:34.964503+0000","last_clean":"2023-07-27T20:31:34.964503+0000","last_became_active":"2023-07-27T20:31:33.188383+0000","last_became_peered":"2023-07-27T20:31:33.188383+0000","last_unstale":"2023-07-27T20:31:34.964503+0000","last_undegraded":"2023-07-27T20:31:34.964503+0000","last_fullsized":"2023-07-27T20:31:34.964503+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:19:59.171464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160661+0000","last_change":"2023-07-27T20:31:28.130299+0000","last_active":"2023-07-27T20:31:34.160661+0000","last_peered":"2023-07-27T20:31:34.160661+0000","last_clean":"2023-07-27T20:31:34.160661+0000","last_became_active":"2023-07-27T20:31:28.129986+0000","last_became_peered":"2023-07-27T20:31:28.129986+0000","last_unstale":"2023-07-27T20:31:34.160661+0000","last_undegraded":"2023-07-27T20:31:34.160661+0000","last_fullsized":"2023-07-27T20:31:34.160661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:02:56.272252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963299+0000","last_change":"2023-07-27T20:31:29.132566+0000","last_active":"2023-07-27T20:31:34.963299+0000","last_peered":"2023-07-27T20:31:34.963299+0000","last_clean":"2023-07-27T20:31:34.963299+0000","last_became_active":"2023-07-27T20:31:29.132163+0000","last_became_peered":"2023-07-27T20:31:29.132163+0000","last_unstale":"2023-07-27T20:31:34.963299+0000","last_undegraded":"2023-07-27T20:31:34.963299+0000","last_fullsized":"2023-07-27T20:31:34.963299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:39:29.240358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963259+0000","last_change":"2023-07-27T20:31:33.186162+0000","last_active":"2023-07-27T20:31:34.963259+0000","last_peered":"2023-07-27T20:31:34.963259+0000","last_clean":"2023-07-27T20:31:34.963259+0000","last_became_active":"2023-07-27T20:31:33.185738+0000","last_became_peered":"2023-07-27T20:31:33.185738+0000","last_unstale":"2023-07-27T20:31:34.963259+0000","last_undegraded":"2023-07-27T20:31:34.963259+0000","last_fullsized":"2023-07-27T20:31:34.963259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:59:46.029831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963161+0000","last_change":"2023-07-27T20:31:28.124073+0000","last_active":"2023-07-27T20:31:34.963161+0000","last_peered":"2023-07-27T20:31:34.963161+0000","last_clean":"2023-07-27T20:31:34.963161+0000","last_became_active":"2023-07-27T20:31:28.123661+0000","last_became_peered":"2023-07-27T20:31:28.123661+0000","last_unstale":"2023-07-27T20:31:34.963161+0000","last_undegraded":"2023-07-27T20:31:34.963161+0000","last_fullsized":"2023-07-27T20:31:34.963161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:20:59.432383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158518+0000","last_change":"2023-07-27T20:31:29.135207+0000","last_active":"2023-07-27T20:31:34.158518+0000","last_peered":"2023-07-27T20:31:34.158518+0000","last_clean":"2023-07-27T20:31:34.158518+0000","last_became_active":"2023-07-27T20:31:29.134951+0000","last_became_peered":"2023-07-27T20:31:29.134951+0000","last_unstale":"2023-07-27T20:31:34.158518+0000","last_undegraded":"2023-07-27T20:31:34.158518+0000","last_fullsized":"2023-07-27T20:31:34.158518+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:00:29.660993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964088+0000","last_change":"2023-07-27T20:31:33.192124+0000","last_active":"2023-07-27T20:31:34.964088+0000","last_peered":"2023-07-27T20:31:34.964088+0000","last_clean":"2023-07-27T20:31:34.964088+0000","last_became_active":"2023-07-27T20:31:33.187632+0000","last_became_peered":"2023-07-27T20:31:33.187632+0000","last_unstale":"2023-07-27T20:31:34.964088+0000","last_undegraded":"2023-07-27T20:31:34.964088+0000","last_fullsized":"2023-07-27T20:31:34.964088+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:07:10.295169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963580+0000","last_change":"2023-07-27T20:31:28.121108+0000","last_active":"2023-07-27T20:31:34.963580+0000","last_peered":"2023-07-27T20:31:34.963580+0000","last_clean":"2023-07-27T20:31:34.963580+0000","last_became_active":"2023-07-27T20:31:28.120493+0000","last_became_peered":"2023-07-27T20:31:28.120493+0000","last_unstale":"2023-07-27T20:31:34.963580+0000","last_undegraded":"2023-07-27T20:31:34.963580+0000","last_fullsized":"2023-07-27T20:31:34.963580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:01:29.799303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158619+0000","last_change":"2023-07-27T20:31:29.131480+0000","last_active":"2023-07-27T20:31:34.158619+0000","last_peered":"2023-07-27T20:31:34.158619+0000","last_clean":"2023-07-27T20:31:34.158619+0000","last_became_active":"2023-07-27T20:31:29.131095+0000","last_became_peered":"2023-07-27T20:31:29.131095+0000","last_unstale":"2023-07-27T20:31:34.158619+0000","last_undegraded":"2023-07-27T20:31:34.158619+0000","last_fullsized":"2023-07-27T20:31:34.158619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:34:08.272287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963660+0000","last_change":"2023-07-27T20:31:33.187021+0000","last_active":"2023-07-27T20:31:34.963660+0000","last_peered":"2023-07-27T20:31:34.963660+0000","last_clean":"2023-07-27T20:31:34.963660+0000","last_became_active":"2023-07-27T20:31:33.186607+0000","last_became_peered":"2023-07-27T20:31:33.186607+0000","last_unstale":"2023-07-27T20:31:34.963660+0000","last_undegraded":"2023-07-27T20:31:34.963660+0000","last_fullsized":"2023-07-27T20:31:34.963660+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:13:45.447971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963434+0000","last_change":"2023-07-27T20:31:28.127262+0000","last_active":"2023-07-27T20:31:34.963434+0000","last_peered":"2023-07-27T20:31:34.963434+0000","last_clean":"2023-07-27T20:31:34.963434+0000","last_became_active":"2023-07-27T20:31:28.126885+0000","last_became_peered":"2023-07-27T20:31:28.126885+0000","last_unstale":"2023-07-27T20:31:34.963434+0000","last_undegraded":"2023-07-27T20:31:34.963434+0000","last_fullsized":"2023-07-27T20:31:34.963434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:06:53.409694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160256+0000","last_change":"2023-07-27T20:31:29.129706+0000","last_active":"2023-07-27T20:31:34.160256+0000","last_peered":"2023-07-27T20:31:34.160256+0000","last_clean":"2023-07-27T20:31:34.160256+0000","last_became_active":"2023-07-27T20:31:29.129331+0000","last_became_peered":"2023-07-27T20:31:29.129331+0000","last_unstale":"2023-07-27T20:31:34.160256+0000","last_undegraded":"2023-07-27T20:31:34.160256+0000","last_fullsized":"2023-07-27T20:31:34.160256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:16:54.006335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964068+0000","last_change":"2023-07-27T20:31:33.189952+0000","last_active":"2023-07-27T20:31:34.964068+0000","last_peered":"2023-07-27T20:31:34.964068+0000","last_clean":"2023-07-27T20:31:34.964068+0000","last_became_active":"2023-07-27T20:31:33.188619+0000","last_became_peered":"2023-07-27T20:31:33.188619+0000","last_unstale":"2023-07-27T20:31:34.964068+0000","last_undegraded":"2023-07-27T20:31:34.964068+0000","last_fullsized":"2023-07-27T20:31:34.964068+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:03:01.329479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158999+0000","last_change":"2023-07-27T20:31:28.115944+0000","last_active":"2023-07-27T20:31:34.158999+0000","last_peered":"2023-07-27T20:31:34.158999+0000","last_clean":"2023-07-27T20:31:34.158999+0000","last_became_active":"2023-07-27T20:31:28.115533+0000","last_became_peered":"2023-07-27T20:31:28.115533+0000","last_unstale":"2023-07-27T20:31:34.158999+0000","last_undegraded":"2023-07-27T20:31:34.158999+0000","last_fullsized":"2023-07-27T20:31:34.158999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:08:41.229908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160623+0000","last_change":"2023-07-27T20:31:29.143123+0000","last_active":"2023-07-27T20:31:34.160623+0000","last_peered":"2023-07-27T20:31:34.160623+0000","last_clean":"2023-07-27T20:31:34.160623+0000","last_became_active":"2023-07-27T20:31:29.142870+0000","last_became_peered":"2023-07-27T20:31:29.142870+0000","last_unstale":"2023-07-27T20:31:34.160623+0000","last_undegraded":"2023-07-27T20:31:34.160623+0000","last_fullsized":"2023-07-27T20:31:34.160623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:38:22.765710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160570+0000","last_change":"2023-07-27T20:31:33.181739+0000","last_active":"2023-07-27T20:31:34.160570+0000","last_peered":"2023-07-27T20:31:34.160570+0000","last_clean":"2023-07-27T20:31:34.160570+0000","last_became_active":"2023-07-27T20:31:33.181198+0000","last_became_peered":"2023-07-27T20:31:33.181198+0000","last_unstale":"2023-07-27T20:31:34.160570+0000","last_undegraded":"2023-07-27T20:31:34.160570+0000","last_fullsized":"2023-07-27T20:31:34.160570+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:45:59.627493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965266+0000","last_change":"2023-07-27T20:31:28.120507+0000","last_active":"2023-07-27T20:31:34.965266+0000","last_peered":"2023-07-27T20:31:34.965266+0000","last_clean":"2023-07-27T20:31:34.965266+0000","last_became_active":"2023-07-27T20:31:28.120181+0000","last_became_peered":"2023-07-27T20:31:28.120181+0000","last_unstale":"2023-07-27T20:31:34.965266+0000","last_undegraded":"2023-07-27T20:31:34.965266+0000","last_fullsized":"2023-07-27T20:31:34.965266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:35:11.181105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965561+0000","last_change":"2023-07-27T20:31:29.128643+0000","last_active":"2023-07-27T20:31:34.965561+0000","last_peered":"2023-07-27T20:31:34.965561+0000","last_clean":"2023-07-27T20:31:34.965561+0000","last_became_active":"2023-07-27T20:31:29.128351+0000","last_became_peered":"2023-07-27T20:31:29.128351+0000","last_unstale":"2023-07-27T20:31:34.965561+0000","last_undegraded":"2023-07-27T20:31:34.965561+0000","last_fullsized":"2023-07-27T20:31:34.965561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:52:37.919677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157930+0000","last_change":"2023-07-27T20:31:33.185100+0000","last_active":"2023-07-27T20:31:34.157930+0000","last_peered":"2023-07-27T20:31:34.157930+0000","last_clean":"2023-07-27T20:31:34.157930+0000","last_became_active":"2023-07-27T20:31:33.184683+0000","last_became_peered":"2023-07-27T20:31:33.184683+0000","last_unstale":"2023-07-27T20:31:34.157930+0000","last_undegraded":"2023-07-27T20:31:34.157930+0000","last_fullsized":"2023-07-27T20:31:34.157930+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:03:01.329479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963884+0000","last_change":"2023-07-27T20:31:22.848698+0000","last_active":"2023-07-27T20:31:34.963884+0000","last_peered":"2023-07-27T20:31:34.963884+0000","last_clean":"2023-07-27T20:31:34.963884+0000","last_became_active":"2023-07-27T20:31:22.848346+0000","last_became_peered":"2023-07-27T20:31:22.848346+0000","last_unstale":"2023-07-27T20:31:34.963884+0000","last_undegraded":"2023-07-27T20:31:34.963884+0000","last_fullsized":"2023-07-27T20:31:34.963884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:48:04.598381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963400+0000","last_change":"2023-07-27T20:31:28.127873+0000","last_active":"2023-07-27T20:31:34.963400+0000","last_peered":"2023-07-27T20:31:34.963400+0000","last_clean":"2023-07-27T20:31:34.963400+0000","last_became_active":"2023-07-27T20:31:28.127528+0000","last_became_peered":"2023-07-27T20:31:28.127528+0000","last_unstale":"2023-07-27T20:31:34.963400+0000","last_undegraded":"2023-07-27T20:31:34.963400+0000","last_fullsized":"2023-07-27T20:31:34.963400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:11:16.759020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963300+0000","last_change":"2023-07-27T20:31:29.141185+0000","last_active":"2023-07-27T20:31:34.963300+0000","last_peered":"2023-07-27T20:31:34.963300+0000","last_clean":"2023-07-27T20:31:34.963300+0000","last_became_active":"2023-07-27T20:31:29.140892+0000","last_became_peered":"2023-07-27T20:31:29.140892+0000","last_unstale":"2023-07-27T20:31:34.963300+0000","last_undegraded":"2023-07-27T20:31:34.963300+0000","last_fullsized":"2023-07-27T20:31:34.963300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:32:33.408454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157575+0000","last_change":"2023-07-27T20:31:33.181796+0000","last_active":"2023-07-27T20:31:34.157575+0000","last_peered":"2023-07-27T20:31:34.157575+0000","last_clean":"2023-07-27T20:31:34.157575+0000","last_became_active":"2023-07-27T20:31:33.181416+0000","last_became_peered":"2023-07-27T20:31:33.181416+0000","last_unstale":"2023-07-27T20:31:34.157575+0000","last_undegraded":"2023-07-27T20:31:34.157575+0000","last_fullsized":"2023-07-27T20:31:34.157575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:52:41.970170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963001+0000","last_change":"2023-07-27T20:31:22.849178+0000","last_active":"2023-07-27T20:31:34.963001+0000","last_peered":"2023-07-27T20:31:34.963001+0000","last_clean":"2023-07-27T20:31:34.963001+0000","last_became_active":"2023-07-27T20:31:22.848856+0000","last_became_peered":"2023-07-27T20:31:22.848856+0000","last_unstale":"2023-07-27T20:31:34.963001+0000","last_undegraded":"2023-07-27T20:31:34.963001+0000","last_fullsized":"2023-07-27T20:31:34.963001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:59:21.022861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159361+0000","last_change":"2023-07-27T20:31:28.121194+0000","last_active":"2023-07-27T20:31:34.159361+0000","last_peered":"2023-07-27T20:31:34.159361+0000","last_clean":"2023-07-27T20:31:34.159361+0000","last_became_active":"2023-07-27T20:31:28.120865+0000","last_became_peered":"2023-07-27T20:31:28.120865+0000","last_unstale":"2023-07-27T20:31:34.159361+0000","last_undegraded":"2023-07-27T20:31:34.159361+0000","last_fullsized":"2023-07-27T20:31:34.159361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:12:37.554428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963780+0000","last_change":"2023-07-27T20:31:29.127748+0000","last_active":"2023-07-27T20:31:34.963780+0000","last_peered":"2023-07-27T20:31:34.963780+0000","last_clean":"2023-07-27T20:31:34.963780+0000","last_became_active":"2023-07-27T20:31:29.127213+0000","last_became_peered":"2023-07-27T20:31:29.127213+0000","last_unstale":"2023-07-27T20:31:34.963780+0000","last_undegraded":"2023-07-27T20:31:34.963780+0000","last_fullsized":"2023-07-27T20:31:34.963780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:59:03.273688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964666+0000","last_change":"2023-07-27T20:31:33.193059+0000","last_active":"2023-07-27T20:31:34.964666+0000","last_peered":"2023-07-27T20:31:34.964666+0000","last_clean":"2023-07-27T20:31:34.964666+0000","last_became_active":"2023-07-27T20:31:33.192317+0000","last_became_peered":"2023-07-27T20:31:33.192317+0000","last_unstale":"2023-07-27T20:31:34.964666+0000","last_undegraded":"2023-07-27T20:31:34.964666+0000","last_fullsized":"2023-07-27T20:31:34.964666+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:22:24.070420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964167+0000","last_change":"2023-07-27T20:31:22.959811+0000","last_active":"2023-07-27T20:31:34.964167+0000","last_peered":"2023-07-27T20:31:34.964167+0000","last_clean":"2023-07-27T20:31:34.964167+0000","last_became_active":"2023-07-27T20:31:22.959449+0000","last_became_peered":"2023-07-27T20:31:22.959449+0000","last_unstale":"2023-07-27T20:31:34.964167+0000","last_undegraded":"2023-07-27T20:31:34.964167+0000","last_fullsized":"2023-07-27T20:31:34.964167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:39:22.049301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.962890+0000","last_change":"2023-07-27T20:31:28.112790+0000","last_active":"2023-07-27T20:31:34.962890+0000","last_peered":"2023-07-27T20:31:34.962890+0000","last_clean":"2023-07-27T20:31:34.962890+0000","last_became_active":"2023-07-27T20:31:28.112486+0000","last_became_peered":"2023-07-27T20:31:28.112486+0000","last_unstale":"2023-07-27T20:31:34.962890+0000","last_undegraded":"2023-07-27T20:31:34.962890+0000","last_fullsized":"2023-07-27T20:31:34.962890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:06:07.656544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965439+0000","last_change":"2023-07-27T20:31:29.150778+0000","last_active":"2023-07-27T20:31:34.965439+0000","last_peered":"2023-07-27T20:31:34.965439+0000","last_clean":"2023-07-27T20:31:34.965439+0000","last_became_active":"2023-07-27T20:31:29.150479+0000","last_became_peered":"2023-07-27T20:31:29.150479+0000","last_unstale":"2023-07-27T20:31:34.965439+0000","last_undegraded":"2023-07-27T20:31:34.965439+0000","last_fullsized":"2023-07-27T20:31:34.965439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:29:57.010683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160099+0000","last_change":"2023-07-27T20:31:33.175158+0000","last_active":"2023-07-27T20:31:34.160099+0000","last_peered":"2023-07-27T20:31:34.160099+0000","last_clean":"2023-07-27T20:31:34.160099+0000","last_became_active":"2023-07-27T20:31:33.174727+0000","last_became_peered":"2023-07-27T20:31:33.174727+0000","last_unstale":"2023-07-27T20:31:34.160099+0000","last_undegraded":"2023-07-27T20:31:34.160099+0000","last_fullsized":"2023-07-27T20:31:34.160099+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:46:48.142348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963380+0000","last_change":"2023-07-27T20:31:22.847766+0000","last_active":"2023-07-27T20:31:34.963380+0000","last_peered":"2023-07-27T20:31:34.963380+0000","last_clean":"2023-07-27T20:31:34.963380+0000","last_became_active":"2023-07-27T20:31:22.847396+0000","last_became_peered":"2023-07-27T20:31:22.847396+0000","last_unstale":"2023-07-27T20:31:34.963380+0000","last_undegraded":"2023-07-27T20:31:34.963380+0000","last_fullsized":"2023-07-27T20:31:34.963380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:24:50.913525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":181,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159241+0000","last_change":"2023-07-27T20:31:15.812727+0000","last_active":"2023-07-27T20:31:34.159241+0000","last_peered":"2023-07-27T20:31:34.159241+0000","last_clean":"2023-07-27T20:31:34.159241+0000","last_became_active":"2023-07-27T20:31:15.811803+0000","last_became_peered":"2023-07-27T20:31:15.811803+0000","last_unstale":"2023-07-27T20:31:34.159241+0000","last_undegraded":"2023-07-27T20:31:34.159241+0000","last_fullsized":"2023-07-27T20:31:34.159241+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:14.789257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:14.789257+0000","last_clean_scrub_stamp":"2023-07-27T20:31:14.789257+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:13:28.096429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963324+0000","last_change":"2023-07-27T20:31:28.128776+0000","last_active":"2023-07-27T20:31:34.963324+0000","last_peered":"2023-07-27T20:31:34.963324+0000","last_clean":"2023-07-27T20:31:34.963324+0000","last_became_active":"2023-07-27T20:31:28.128519+0000","last_became_peered":"2023-07-27T20:31:28.128519+0000","last_unstale":"2023-07-27T20:31:34.963324+0000","last_undegraded":"2023-07-27T20:31:34.963324+0000","last_fullsized":"2023-07-27T20:31:34.963324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:02:56.272252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963298+0000","last_change":"2023-07-27T20:31:29.144327+0000","last_active":"2023-07-27T20:31:34.963298+0000","last_peered":"2023-07-27T20:31:34.963298+0000","last_clean":"2023-07-27T20:31:34.963298+0000","last_became_active":"2023-07-27T20:31:29.143987+0000","last_became_peered":"2023-07-27T20:31:29.143987+0000","last_unstale":"2023-07-27T20:31:34.963298+0000","last_undegraded":"2023-07-27T20:31:34.963298+0000","last_fullsized":"2023-07-27T20:31:34.963298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:09:04.213951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963855+0000","last_change":"2023-07-27T20:31:33.185843+0000","last_active":"2023-07-27T20:31:34.963855+0000","last_peered":"2023-07-27T20:31:34.963855+0000","last_clean":"2023-07-27T20:31:34.963855+0000","last_became_active":"2023-07-27T20:31:33.185433+0000","last_became_peered":"2023-07-27T20:31:33.185433+0000","last_unstale":"2023-07-27T20:31:34.963855+0000","last_undegraded":"2023-07-27T20:31:34.963855+0000","last_fullsized":"2023-07-27T20:31:34.963855+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:32:44.428479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159531+0000","last_change":"2023-07-27T20:31:22.848181+0000","last_active":"2023-07-27T20:31:34.159531+0000","last_peered":"2023-07-27T20:31:34.159531+0000","last_clean":"2023-07-27T20:31:34.159531+0000","last_became_active":"2023-07-27T20:31:22.847865+0000","last_became_peered":"2023-07-27T20:31:22.847865+0000","last_unstale":"2023-07-27T20:31:34.159531+0000","last_undegraded":"2023-07-27T20:31:34.159531+0000","last_fullsized":"2023-07-27T20:31:34.159531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:48:04.598381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157019+0000","last_change":"2023-07-27T20:31:28.126023+0000","last_active":"2023-07-27T20:31:34.157019+0000","last_peered":"2023-07-27T20:31:34.157019+0000","last_clean":"2023-07-27T20:31:34.157019+0000","last_became_active":"2023-07-27T20:31:28.125763+0000","last_became_peered":"2023-07-27T20:31:28.125763+0000","last_unstale":"2023-07-27T20:31:34.157019+0000","last_undegraded":"2023-07-27T20:31:34.157019+0000","last_fullsized":"2023-07-27T20:31:34.157019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:11:16.759020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157525+0000","last_change":"2023-07-27T20:31:29.134648+0000","last_active":"2023-07-27T20:31:34.157525+0000","last_peered":"2023-07-27T20:31:34.157525+0000","last_clean":"2023-07-27T20:31:34.157525+0000","last_became_active":"2023-07-27T20:31:29.133686+0000","last_became_peered":"2023-07-27T20:31:29.133686+0000","last_unstale":"2023-07-27T20:31:34.157525+0000","last_undegraded":"2023-07-27T20:31:34.157525+0000","last_fullsized":"2023-07-27T20:31:34.157525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:46:44.091855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963906+0000","last_change":"2023-07-27T20:31:33.173136+0000","last_active":"2023-07-27T20:31:34.963906+0000","last_peered":"2023-07-27T20:31:34.963906+0000","last_clean":"2023-07-27T20:31:34.963906+0000","last_became_active":"2023-07-27T20:31:33.171872+0000","last_became_peered":"2023-07-27T20:31:33.171872+0000","last_unstale":"2023-07-27T20:31:34.963906+0000","last_undegraded":"2023-07-27T20:31:34.963906+0000","last_fullsized":"2023-07-27T20:31:34.963906+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:54:08.677930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160575+0000","last_change":"2023-07-27T20:31:22.848025+0000","last_active":"2023-07-27T20:31:34.160575+0000","last_peered":"2023-07-27T20:31:34.160575+0000","last_clean":"2023-07-27T20:31:34.160575+0000","last_became_active":"2023-07-27T20:31:22.847603+0000","last_became_peered":"2023-07-27T20:31:22.847603+0000","last_unstale":"2023-07-27T20:31:34.160575+0000","last_undegraded":"2023-07-27T20:31:34.160575+0000","last_fullsized":"2023-07-27T20:31:34.160575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:30:03.402215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964111+0000","last_change":"2023-07-27T20:31:28.113523+0000","last_active":"2023-07-27T20:31:34.964111+0000","last_peered":"2023-07-27T20:31:34.964111+0000","last_clean":"2023-07-27T20:31:34.964111+0000","last_became_active":"2023-07-27T20:31:28.113279+0000","last_became_peered":"2023-07-27T20:31:28.113279+0000","last_unstale":"2023-07-27T20:31:34.964111+0000","last_undegraded":"2023-07-27T20:31:34.964111+0000","last_fullsized":"2023-07-27T20:31:34.964111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:11:16.759020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158082+0000","last_change":"2023-07-27T20:31:29.142859+0000","last_active":"2023-07-27T20:31:34.158082+0000","last_peered":"2023-07-27T20:31:34.158082+0000","last_clean":"2023-07-27T20:31:34.158082+0000","last_became_active":"2023-07-27T20:31:29.142567+0000","last_became_peered":"2023-07-27T20:31:29.142567+0000","last_unstale":"2023-07-27T20:31:34.158082+0000","last_undegraded":"2023-07-27T20:31:34.158082+0000","last_fullsized":"2023-07-27T20:31:34.158082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:17:03.497602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159475+0000","last_change":"2023-07-27T20:31:33.178764+0000","last_active":"2023-07-27T20:31:34.159475+0000","last_peered":"2023-07-27T20:31:34.159475+0000","last_clean":"2023-07-27T20:31:34.159475+0000","last_became_active":"2023-07-27T20:31:33.178284+0000","last_became_peered":"2023-07-27T20:31:33.178284+0000","last_unstale":"2023-07-27T20:31:34.159475+0000","last_undegraded":"2023-07-27T20:31:34.159475+0000","last_fullsized":"2023-07-27T20:31:34.159475+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:37:30.584016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965462+0000","last_change":"2023-07-27T20:31:28.120924+0000","last_active":"2023-07-27T20:31:34.965462+0000","last_peered":"2023-07-27T20:31:34.965462+0000","last_clean":"2023-07-27T20:31:34.965462+0000","last_became_active":"2023-07-27T20:31:28.120646+0000","last_became_peered":"2023-07-27T20:31:28.120646+0000","last_unstale":"2023-07-27T20:31:34.965462+0000","last_undegraded":"2023-07-27T20:31:34.965462+0000","last_fullsized":"2023-07-27T20:31:34.965462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:53:34.775079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963414+0000","last_change":"2023-07-27T20:31:22.845641+0000","last_active":"2023-07-27T20:31:34.963414+0000","last_peered":"2023-07-27T20:31:34.963414+0000","last_clean":"2023-07-27T20:31:34.963414+0000","last_became_active":"2023-07-27T20:31:22.845368+0000","last_became_peered":"2023-07-27T20:31:22.845368+0000","last_unstale":"2023-07-27T20:31:34.963414+0000","last_undegraded":"2023-07-27T20:31:34.963414+0000","last_fullsized":"2023-07-27T20:31:34.963414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:22:43.198616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965145+0000","last_change":"2023-07-27T20:31:29.144935+0000","last_active":"2023-07-27T20:31:34.965145+0000","last_peered":"2023-07-27T20:31:34.965145+0000","last_clean":"2023-07-27T20:31:34.965145+0000","last_became_active":"2023-07-27T20:31:29.144500+0000","last_became_peered":"2023-07-27T20:31:29.144500+0000","last_unstale":"2023-07-27T20:31:34.965145+0000","last_undegraded":"2023-07-27T20:31:34.965145+0000","last_fullsized":"2023-07-27T20:31:34.965145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:43:50.810308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964904+0000","last_change":"2023-07-27T20:31:33.178800+0000","last_active":"2023-07-27T20:31:34.964904+0000","last_peered":"2023-07-27T20:31:34.964904+0000","last_clean":"2023-07-27T20:31:34.964904+0000","last_became_active":"2023-07-27T20:31:33.178392+0000","last_became_peered":"2023-07-27T20:31:33.178392+0000","last_unstale":"2023-07-27T20:31:34.964904+0000","last_undegraded":"2023-07-27T20:31:34.964904+0000","last_fullsized":"2023-07-27T20:31:34.964904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:43:14.963398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963516+0000","last_change":"2023-07-27T20:31:22.846540+0000","last_active":"2023-07-27T20:31:34.963516+0000","last_peered":"2023-07-27T20:31:34.963516+0000","last_clean":"2023-07-27T20:31:34.963516+0000","last_became_active":"2023-07-27T20:31:22.846128+0000","last_became_peered":"2023-07-27T20:31:22.846128+0000","last_unstale":"2023-07-27T20:31:34.963516+0000","last_undegraded":"2023-07-27T20:31:34.963516+0000","last_fullsized":"2023-07-27T20:31:34.963516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:43:06.660613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157642+0000","last_change":"2023-07-27T20:31:28.113438+0000","last_active":"2023-07-27T20:31:34.157642+0000","last_peered":"2023-07-27T20:31:34.157642+0000","last_clean":"2023-07-27T20:31:34.157642+0000","last_became_active":"2023-07-27T20:31:28.113146+0000","last_became_peered":"2023-07-27T20:31:28.113146+0000","last_unstale":"2023-07-27T20:31:34.157642+0000","last_undegraded":"2023-07-27T20:31:34.157642+0000","last_fullsized":"2023-07-27T20:31:34.157642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:04:21.752471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159254+0000","last_change":"2023-07-27T20:31:29.141507+0000","last_active":"2023-07-27T20:31:34.159254+0000","last_peered":"2023-07-27T20:31:34.159254+0000","last_clean":"2023-07-27T20:31:34.159254+0000","last_became_active":"2023-07-27T20:31:29.141217+0000","last_became_peered":"2023-07-27T20:31:29.141217+0000","last_unstale":"2023-07-27T20:31:34.159254+0000","last_undegraded":"2023-07-27T20:31:34.159254+0000","last_fullsized":"2023-07-27T20:31:34.159254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:07:23.817773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963812+0000","last_change":"2023-07-27T20:31:33.184984+0000","last_active":"2023-07-27T20:31:34.963812+0000","last_peered":"2023-07-27T20:31:34.963812+0000","last_clean":"2023-07-27T20:31:34.963812+0000","last_became_active":"2023-07-27T20:31:33.184413+0000","last_became_peered":"2023-07-27T20:31:33.184413+0000","last_unstale":"2023-07-27T20:31:34.963812+0000","last_undegraded":"2023-07-27T20:31:34.963812+0000","last_fullsized":"2023-07-27T20:31:34.963812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:03:20.666196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157892+0000","last_change":"2023-07-27T20:31:28.122480+0000","last_active":"2023-07-27T20:31:34.157892+0000","last_peered":"2023-07-27T20:31:34.157892+0000","last_clean":"2023-07-27T20:31:34.157892+0000","last_became_active":"2023-07-27T20:31:28.121841+0000","last_became_peered":"2023-07-27T20:31:28.121841+0000","last_unstale":"2023-07-27T20:31:34.157892+0000","last_undegraded":"2023-07-27T20:31:34.157892+0000","last_fullsized":"2023-07-27T20:31:34.157892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:01:29.799303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963780+0000","last_change":"2023-07-27T20:31:29.129723+0000","last_active":"2023-07-27T20:31:34.963780+0000","last_peered":"2023-07-27T20:31:34.963780+0000","last_clean":"2023-07-27T20:31:34.963780+0000","last_became_active":"2023-07-27T20:31:29.129256+0000","last_became_peered":"2023-07-27T20:31:29.129256+0000","last_unstale":"2023-07-27T20:31:34.963780+0000","last_undegraded":"2023-07-27T20:31:34.963780+0000","last_fullsized":"2023-07-27T20:31:34.963780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:40:12.799013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159801+0000","last_change":"2023-07-27T20:31:33.182234+0000","last_active":"2023-07-27T20:31:34.159801+0000","last_peered":"2023-07-27T20:31:34.159801+0000","last_clean":"2023-07-27T20:31:34.159801+0000","last_became_active":"2023-07-27T20:31:33.181660+0000","last_became_peered":"2023-07-27T20:31:33.181660+0000","last_unstale":"2023-07-27T20:31:34.159801+0000","last_undegraded":"2023-07-27T20:31:34.159801+0000","last_fullsized":"2023-07-27T20:31:34.159801+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:11:21.816247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963312+0000","last_change":"2023-07-27T20:31:28.127766+0000","last_active":"2023-07-27T20:31:34.963312+0000","last_peered":"2023-07-27T20:31:34.963312+0000","last_clean":"2023-07-27T20:31:34.963312+0000","last_became_active":"2023-07-27T20:31:28.127414+0000","last_became_peered":"2023-07-27T20:31:28.127414+0000","last_unstale":"2023-07-27T20:31:34.963312+0000","last_undegraded":"2023-07-27T20:31:34.963312+0000","last_fullsized":"2023-07-27T20:31:34.963312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:03:15.608969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159150+0000","last_change":"2023-07-27T20:31:29.129596+0000","last_active":"2023-07-27T20:31:34.159150+0000","last_peered":"2023-07-27T20:31:34.159150+0000","last_clean":"2023-07-27T20:31:34.159150+0000","last_became_active":"2023-07-27T20:31:29.129291+0000","last_became_peered":"2023-07-27T20:31:29.129291+0000","last_unstale":"2023-07-27T20:31:34.159150+0000","last_undegraded":"2023-07-27T20:31:34.159150+0000","last_fullsized":"2023-07-27T20:31:34.159150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:27:22.233669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963655+0000","last_change":"2023-07-27T20:31:33.178602+0000","last_active":"2023-07-27T20:31:34.963655+0000","last_peered":"2023-07-27T20:31:34.963655+0000","last_clean":"2023-07-27T20:31:34.963655+0000","last_became_active":"2023-07-27T20:31:33.178225+0000","last_became_peered":"2023-07-27T20:31:33.178225+0000","last_unstale":"2023-07-27T20:31:34.963655+0000","last_undegraded":"2023-07-27T20:31:34.963655+0000","last_fullsized":"2023-07-27T20:31:34.963655+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:46:48.142348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963262+0000","last_change":"2023-07-27T20:31:28.127934+0000","last_active":"2023-07-27T20:31:34.963262+0000","last_peered":"2023-07-27T20:31:34.963262+0000","last_clean":"2023-07-27T20:31:34.963262+0000","last_became_active":"2023-07-27T20:31:28.127614+0000","last_became_peered":"2023-07-27T20:31:28.127614+0000","last_unstale":"2023-07-27T20:31:34.963262+0000","last_undegraded":"2023-07-27T20:31:34.963262+0000","last_fullsized":"2023-07-27T20:31:34.963262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:59:02.266953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158703+0000","last_change":"2023-07-27T20:31:29.129192+0000","last_active":"2023-07-27T20:31:34.158703+0000","last_peered":"2023-07-27T20:31:34.158703+0000","last_clean":"2023-07-27T20:31:34.158703+0000","last_became_active":"2023-07-27T20:31:29.128942+0000","last_became_peered":"2023-07-27T20:31:29.128942+0000","last_unstale":"2023-07-27T20:31:34.158703+0000","last_undegraded":"2023-07-27T20:31:34.158703+0000","last_fullsized":"2023-07-27T20:31:34.158703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:47:04.874275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158302+0000","last_change":"2023-07-27T20:31:33.181755+0000","last_active":"2023-07-27T20:31:34.158302+0000","last_peered":"2023-07-27T20:31:34.158302+0000","last_clean":"2023-07-27T20:31:34.158302+0000","last_became_active":"2023-07-27T20:31:33.181272+0000","last_became_peered":"2023-07-27T20:31:33.181272+0000","last_unstale":"2023-07-27T20:31:34.158302+0000","last_undegraded":"2023-07-27T20:31:34.158302+0000","last_fullsized":"2023-07-27T20:31:34.158302+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:17:29.545484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964561+0000","last_change":"2023-07-27T20:31:28.120798+0000","last_active":"2023-07-27T20:31:34.964561+0000","last_peered":"2023-07-27T20:31:34.964561+0000","last_clean":"2023-07-27T20:31:34.964561+0000","last_became_active":"2023-07-27T20:31:28.120445+0000","last_became_peered":"2023-07-27T20:31:28.120445+0000","last_unstale":"2023-07-27T20:31:34.964561+0000","last_undegraded":"2023-07-27T20:31:34.964561+0000","last_fullsized":"2023-07-27T20:31:34.964561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:04:19.045494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964977+0000","last_change":"2023-07-27T20:31:29.133577+0000","last_active":"2023-07-27T20:31:34.964977+0000","last_peered":"2023-07-27T20:31:34.964977+0000","last_clean":"2023-07-27T20:31:34.964977+0000","last_became_active":"2023-07-27T20:31:29.133170+0000","last_became_peered":"2023-07-27T20:31:29.133170+0000","last_unstale":"2023-07-27T20:31:34.964977+0000","last_undegraded":"2023-07-27T20:31:34.964977+0000","last_fullsized":"2023-07-27T20:31:34.964977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:58:10.754493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963156+0000","last_change":"2023-07-27T20:31:33.185023+0000","last_active":"2023-07-27T20:31:34.963156+0000","last_peered":"2023-07-27T20:31:34.963156+0000","last_clean":"2023-07-27T20:31:34.963156+0000","last_became_active":"2023-07-27T20:31:33.184664+0000","last_became_peered":"2023-07-27T20:31:33.184664+0000","last_unstale":"2023-07-27T20:31:34.963156+0000","last_undegraded":"2023-07-27T20:31:34.963156+0000","last_fullsized":"2023-07-27T20:31:34.963156+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:31:22.782985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158280+0000","last_change":"2023-07-27T20:31:28.130218+0000","last_active":"2023-07-27T20:31:34.158280+0000","last_peered":"2023-07-27T20:31:34.158280+0000","last_clean":"2023-07-27T20:31:34.158280+0000","last_became_active":"2023-07-27T20:31:28.129985+0000","last_became_peered":"2023-07-27T20:31:28.129985+0000","last_unstale":"2023-07-27T20:31:34.158280+0000","last_undegraded":"2023-07-27T20:31:34.158280+0000","last_fullsized":"2023-07-27T20:31:34.158280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:23:29.174787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158489+0000","last_change":"2023-07-27T20:31:29.134396+0000","last_active":"2023-07-27T20:31:34.158489+0000","last_peered":"2023-07-27T20:31:34.158489+0000","last_clean":"2023-07-27T20:31:34.158489+0000","last_became_active":"2023-07-27T20:31:29.134100+0000","last_became_peered":"2023-07-27T20:31:29.134100+0000","last_unstale":"2023-07-27T20:31:34.158489+0000","last_undegraded":"2023-07-27T20:31:34.158489+0000","last_fullsized":"2023-07-27T20:31:34.158489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:53:35.781814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963026+0000","last_change":"2023-07-27T20:31:29.131991+0000","last_active":"2023-07-27T20:31:34.963026+0000","last_peered":"2023-07-27T20:31:34.963026+0000","last_clean":"2023-07-27T20:31:34.963026+0000","last_became_active":"2023-07-27T20:31:29.131669+0000","last_became_peered":"2023-07-27T20:31:29.131669+0000","last_unstale":"2023-07-27T20:31:34.963026+0000","last_undegraded":"2023-07-27T20:31:34.963026+0000","last_fullsized":"2023-07-27T20:31:34.963026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:57:21.999388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965148+0000","last_change":"2023-07-27T20:31:29.130808+0000","last_active":"2023-07-27T20:31:34.965148+0000","last_peered":"2023-07-27T20:31:34.965148+0000","last_clean":"2023-07-27T20:31:34.965148+0000","last_became_active":"2023-07-27T20:31:29.130489+0000","last_became_peered":"2023-07-27T20:31:29.130489+0000","last_unstale":"2023-07-27T20:31:34.965148+0000","last_undegraded":"2023-07-27T20:31:34.965148+0000","last_fullsized":"2023-07-27T20:31:34.965148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:58:01.396658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159103+0000","last_change":"2023-07-27T20:31:29.135952+0000","last_active":"2023-07-27T20:31:34.159103+0000","last_peered":"2023-07-27T20:31:34.159103+0000","last_clean":"2023-07-27T20:31:34.159103+0000","last_became_active":"2023-07-27T20:31:29.135040+0000","last_became_peered":"2023-07-27T20:31:29.135040+0000","last_unstale":"2023-07-27T20:31:34.159103+0000","last_undegraded":"2023-07-27T20:31:34.159103+0000","last_fullsized":"2023-07-27T20:31:34.159103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:41:09.372503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963458+0000","last_change":"2023-07-27T20:31:29.148526+0000","last_active":"2023-07-27T20:31:34.963458+0000","last_peered":"2023-07-27T20:31:34.963458+0000","last_clean":"2023-07-27T20:31:34.963458+0000","last_became_active":"2023-07-27T20:31:29.148256+0000","last_became_peered":"2023-07-27T20:31:29.148256+0000","last_unstale":"2023-07-27T20:31:34.963458+0000","last_undegraded":"2023-07-27T20:31:34.963458+0000","last_fullsized":"2023-07-27T20:31:34.963458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:38:08.459694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963994+0000","last_change":"2023-07-27T20:31:29.129400+0000","last_active":"2023-07-27T20:31:34.963994+0000","last_peered":"2023-07-27T20:31:34.963994+0000","last_clean":"2023-07-27T20:31:34.963994+0000","last_became_active":"2023-07-27T20:31:29.129138+0000","last_became_peered":"2023-07-27T20:31:29.129138+0000","last_unstale":"2023-07-27T20:31:34.963994+0000","last_undegraded":"2023-07-27T20:31:34.963994+0000","last_fullsized":"2023-07-27T20:31:34.963994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:24:57.182748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":913408,"data_stored":714279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":888832,"data_stored":710851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":294912,"data_stored":119991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":123751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":120553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T20:31:53.091 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-27T20:31:53.092 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-07-27T20:31:53.092 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-07-27T20:31:53.093 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-07-27T20:31:53.093 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-07-27T20:31:53.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.332+0000 7fb859fff700 1 Processor -- start 2023-07-27T20:31:53.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.332+0000 7fb859fff700 1 -- start start 2023-07-27T20:31:53.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.333+0000 7fb859fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb8540a9400 0x7fb8540c3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:53.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.333+0000 7fb859fff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb8540c1fb0 0x7fb85414f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:53.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.333+0000 7fb859fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb85414f880 0x7fb854152000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:53.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.333+0000 7fb859fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8540c2b50 con 0x7fb8540a9400 2023-07-27T20:31:53.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.333+0000 7fb859fff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8540c3ea0 con 0x7fb8540c1fb0 2023-07-27T20:31:53.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.333+0000 7fb859fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb854156120 con 0x7fb85414f880 2023-07-27T20:31:53.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.334+0000 7fb8537fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb8540a9400 0x7fb8540c3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:53.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.334+0000 7fb8537fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb8540a9400 0x7fb8540c3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58410/0 (socket says 172.21.15.72:58410) 2023-07-27T20:31:53.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.334+0000 7fb8537fe700 1 -- 172.21.15.72:0/4071833491 learned_addr learned my addr 172.21.15.72:0/4071833491 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:53.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.334+0000 7fb852ffd700 1 --2- 172.21.15.72:0/4071833491 >> v2:172.21.15.173:3300/0 conn(0x7fb8540c1fb0 0x7fb85414f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:53.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.334+0000 7fb853fff700 1 --2- 172.21.15.72:0/4071833491 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb85414f880 0x7fb854152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:53.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.334+0000 7fb8537fe700 1 -- 172.21.15.72:0/4071833491 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb85414f880 msgr2=0x7fb854152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:53.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.334+0000 7fb8537fe700 1 --2- 172.21.15.72:0/4071833491 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb85414f880 0x7fb854152000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:53.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.334+0000 7fb8537fe700 1 -- 172.21.15.72:0/4071833491 >> v2:172.21.15.173:3300/0 conn(0x7fb8540c1fb0 msgr2=0x7fb85414f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:53.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.334+0000 7fb8537fe700 1 --2- 172.21.15.72:0/4071833491 >> v2:172.21.15.173:3300/0 conn(0x7fb8540c1fb0 0x7fb85414f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:53.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.334+0000 7fb8537fe700 1 -- 172.21.15.72:0/4071833491 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8540c5a60 con 0x7fb8540a9400 2023-07-27T20:31:53.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.334+0000 7fb8537fe700 1 --2- 172.21.15.72:0/4071833491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8540a9400 0x7fb8540c3960 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb8540c7fc0 tx=0x7fb844009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c8f7436aa0b8c4 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:53.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.335+0000 7fb8527fc700 1 -- 172.21.15.72:0/4071833491 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84400b870 con 0x7fb8540a9400 2023-07-27T20:31:53.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.335+0000 7fb8527fc700 1 -- 172.21.15.72:0/4071833491 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84400b9d0 con 0x7fb8540a9400 2023-07-27T20:31:53.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.335+0000 7fb8527fc700 1 -- 172.21.15.72:0/4071833491 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84400bd60 con 0x7fb8540a9400 2023-07-27T20:31:53.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.335+0000 7fb859fff700 1 -- 172.21.15.72:0/4071833491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8540a9400 msgr2=0x7fb8540c3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:53.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.335+0000 7fb859fff700 1 --2- 172.21.15.72:0/4071833491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8540a9400 0x7fb8540c3960 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb8540c7fc0 tx=0x7fb844009bd0 comp rx=0 tx=0).stop 2023-07-27T20:31:53.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.335+0000 7fb859fff700 1 -- 172.21.15.72:0/4071833491 shutdown_connections 2023-07-27T20:31:53.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.335+0000 7fb859fff700 1 --2- 172.21.15.72:0/4071833491 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb85414f880 0x7fb854152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:53.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.335+0000 7fb859fff700 1 --2- 172.21.15.72:0/4071833491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8540a9400 0x7fb8540c3960 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:53.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.335+0000 7fb859fff700 1 --2- 172.21.15.72:0/4071833491 >> v2:172.21.15.173:3300/0 conn(0x7fb8540c1fb0 0x7fb85414f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:53.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.335+0000 7fb859fff700 1 -- 172.21.15.72:0/4071833491 >> 172.21.15.72:0/4071833491 conn(0x7fb85406a7c0 msgr2=0x7fb8540c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:53.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.335+0000 7fb859fff700 1 -- 172.21.15.72:0/4071833491 shutdown_connections 2023-07-27T20:31:53.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.335+0000 7fb859fff700 1 -- 172.21.15.72:0/4071833491 wait complete. 2023-07-27T20:31:53.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.337+0000 7fb859fff700 1 Processor -- start 2023-07-27T20:31:53.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.337+0000 7fb859fff700 1 -- start start 2023-07-27T20:31:53.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.338+0000 7fb859fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8540a9400 0x7fb8541ecc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:53.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.338+0000 7fb859fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8540c1fb0 0x7fb8541ed180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:53.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.338+0000 7fb859fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb85414f880 0x7fb854150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:53.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.338+0000 7fb859fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8541ec820 con 0x7fb8540a9400 2023-07-27T20:31:53.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.338+0000 7fb859fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8541ec2f0 con 0x7fb8540c1fb0 2023-07-27T20:31:53.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.338+0000 7fb859fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8541ec540 con 0x7fb85414f880 2023-07-27T20:31:53.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.338+0000 7fb8537fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8540a9400 0x7fb8541ecc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:53.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.338+0000 7fb8537fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8540a9400 0x7fb8541ecc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58424/0 (socket says 172.21.15.72:58424) 2023-07-27T20:31:53.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.338+0000 7fb8537fe700 1 -- 172.21.15.72:0/3344710287 learned_addr learned my addr 172.21.15.72:0/3344710287 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:53.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.339+0000 7fb852ffd700 1 --2- 172.21.15.72:0/3344710287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8540c1fb0 0x7fb8541ed180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:53.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.339+0000 7fb853fff700 1 --2- 172.21.15.72:0/3344710287 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb85414f880 0x7fb854150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:53.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.339+0000 7fb8537fe700 1 -- 172.21.15.72:0/3344710287 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb85414f880 msgr2=0x7fb854150710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:53.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.339+0000 7fb8537fe700 1 --2- 172.21.15.72:0/3344710287 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb85414f880 0x7fb854150710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:53.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.339+0000 7fb8537fe700 1 -- 172.21.15.72:0/3344710287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8540c1fb0 msgr2=0x7fb8541ed180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:53.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.339+0000 7fb8537fe700 1 --2- 172.21.15.72:0/3344710287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8540c1fb0 0x7fb8541ed180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:53.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.339+0000 7fb8537fe700 1 -- 172.21.15.72:0/3344710287 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb844009550 con 0x7fb8540a9400 2023-07-27T20:31:53.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.339+0000 7fb8537fe700 1 --2- 172.21.15.72:0/3344710287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8540a9400 0x7fb8541ecc40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb844000c00 tx=0x7fb844004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:53.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.339+0000 7fb83bfff700 1 -- 172.21.15.72:0/3344710287 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb844004520 con 0x7fb8540a9400 2023-07-27T20:31:53.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.339+0000 7fb83bfff700 1 -- 172.21.15.72:0/3344710287 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84401e070 con 0x7fb8540a9400 2023-07-27T20:31:53.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.339+0000 7fb83bfff700 1 -- 172.21.15.72:0/3344710287 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8440038c0 con 0x7fb8540a9400 2023-07-27T20:31:53.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.339+0000 7fb859fff700 1 -- 172.21.15.72:0/3344710287 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb85414ff10 con 0x7fb8540a9400 2023-07-27T20:31:53.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.339+0000 7fb859fff700 1 -- 172.21.15.72:0/3344710287 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8540c6e40 con 0x7fb8540a9400 2023-07-27T20:31:53.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.340+0000 7fb859fff700 1 -- 172.21.15.72:0/3344710287 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb85414fd70 con 0x7fb8540a9400 2023-07-27T20:31:53.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.341+0000 7fb83bfff700 1 -- 172.21.15.72:0/3344710287 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb844003a20 con 0x7fb8540a9400 2023-07-27T20:31:53.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.342+0000 7fb83bfff700 1 --2- 172.21.15.72:0/3344710287 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb84006ace0 0x7fb84006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:53.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.342+0000 7fb83bfff700 1 -- 172.21.15.72:0/3344710287 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb844020070 con 0x7fb8540a9400 2023-07-27T20:31:53.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.343+0000 7fb852ffd700 1 --2- 172.21.15.72:0/3344710287 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb84006ace0 0x7fb84006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:53.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.343+0000 7fb852ffd700 1 --2- 172.21.15.72:0/3344710287 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb84006ace0 0x7fb84006d1a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb85414e9a0 tx=0x7fb848008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:53.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.346+0000 7fb83bfff700 1 -- 172.21.15.72:0/3344710287 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb85414fd70 con 0x7fb8540a9400 2023-07-27T20:31:53.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.599+0000 7fb859fff700 1 -- 172.21.15.72:0/3344710287 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fb85414fd70 con 0x7fb8540a9400 2023-07-27T20:31:53.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.602+0000 7fb83bfff700 1 -- 172.21.15.72:0/3344710287 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170844 (secure 0 0 0) 0x7fb85414fd70 con 0x7fb8540a9400 2023-07-27T20:31:53.591 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:31:53.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.605+0000 7fb859fff700 1 -- 172.21.15.72:0/3344710287 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb84006ace0 msgr2=0x7fb84006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:53.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.605+0000 7fb859fff700 1 --2- 172.21.15.72:0/3344710287 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb84006ace0 0x7fb84006d1a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb85414e9a0 tx=0x7fb848008040 comp rx=0 tx=0).stop 2023-07-27T20:31:53.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.605+0000 7fb859fff700 1 -- 172.21.15.72:0/3344710287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8540a9400 msgr2=0x7fb8541ecc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:53.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.605+0000 7fb859fff700 1 --2- 172.21.15.72:0/3344710287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8540a9400 0x7fb8541ecc40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb844000c00 tx=0x7fb844004750 comp rx=0 tx=0).stop 2023-07-27T20:31:53.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.605+0000 7fb859fff700 1 -- 172.21.15.72:0/3344710287 shutdown_connections 2023-07-27T20:31:53.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.605+0000 7fb859fff700 1 --2- 172.21.15.72:0/3344710287 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb84006ace0 0x7fb84006d1a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:53.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.605+0000 7fb859fff700 1 --2- 172.21.15.72:0/3344710287 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb85414f880 0x7fb854150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:53.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.605+0000 7fb859fff700 1 --2- 172.21.15.72:0/3344710287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8540a9400 0x7fb8541ecc40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:53.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.605+0000 7fb859fff700 1 --2- 172.21.15.72:0/3344710287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8540c1fb0 0x7fb8541ed180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:53.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.605+0000 7fb859fff700 1 -- 172.21.15.72:0/3344710287 >> 172.21.15.72:0/3344710287 conn(0x7fb85406a7c0 msgr2=0x7fb8540a7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:53.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.605+0000 7fb859fff700 1 -- 172.21.15.72:0/3344710287 shutdown_connections 2023-07-27T20:31:53.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.605+0000 7fb859fff700 1 -- 172.21.15.72:0/3344710287 wait complete. 2023-07-27T20:31:53.611 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":5,"active_gid":4107,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":910681537},{"type":"v1","addr":"172.21.15.173:6833","nonce":910681537}]},"active_addr":"172.21.15.173:6833/910681537","active_change":"2023-07-27T20:31:08.508114+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4108,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.173:0","nonce":670242007}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.173:0","nonce":601523268}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.173:0","nonce":1687878173}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.173:0","nonce":4172786960}]}]} 2023-07-27T20:31:53.615 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-07-27T20:31:53.616 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-07-27T20:31:53.616 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:31:53.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.824+0000 7fb6f41ff700 1 Processor -- start 2023-07-27T20:31:53.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.824+0000 7fb6f41ff700 1 -- start start 2023-07-27T20:31:53.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.825+0000 7fb6f41ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb6ec0c4400 0x7fb6ec0c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:53.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.825+0000 7fb6f41ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb6ec06b150 0x7fb6ec0c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:53.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.825+0000 7fb6f41ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6ec0c5230 con 0x7fb6ec1549f0 2023-07-27T20:31:53.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.825+0000 7fb6f41ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6ec1545d0 con 0x7fb6ec0c4400 2023-07-27T20:31:53.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.825+0000 7fb6f41ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6ec06c860 con 0x7fb6ec06b150 2023-07-27T20:31:53.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.825+0000 7fb6f1f9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb6ec0c4400 0x7fb6ec0c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:53.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.825+0000 7fb6f1f9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb6ec0c4400 0x7fb6ec0c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58434/0 (socket says 172.21.15.72:58434) 2023-07-27T20:31:53.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.825+0000 7fb6f1f9b700 1 -- 172.21.15.72:0/790853493 learned_addr learned my addr 172.21.15.72:0/790853493 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:53.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.825+0000 7fb6f179a700 1 --2- 172.21.15.72:0/790853493 >> v2:172.21.15.173:3300/0 conn(0x7fb6ec06b150 0x7fb6ec0c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:53.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.826+0000 7fb6f1f9b700 1 -- 172.21.15.72:0/790853493 >> v2:172.21.15.173:3300/0 conn(0x7fb6ec06b150 msgr2=0x7fb6ec0c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:53.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.826+0000 7fb6f1f9b700 1 --2- 172.21.15.72:0/790853493 >> v2:172.21.15.173:3300/0 conn(0x7fb6ec06b150 0x7fb6ec0c4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:53.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.826+0000 7fb6f1f9b700 1 -- 172.21.15.72:0/790853493 >> v1:172.21.15.173:6789/0 conn(0x7fb6ec1549f0 legacy=0x7fb6ec1514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:53.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.826+0000 7fb6f1f9b700 1 -- 172.21.15.72:0/790853493 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ec06b710 con 0x7fb6ec0c4400 2023-07-27T20:31:53.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.826+0000 7fb6f179a700 1 --2- 172.21.15.72:0/790853493 >> v2:172.21.15.173:3300/0 conn(0x7fb6ec06b150 0x7fb6ec0c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:31:53.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.826+0000 7fb6f1f9b700 1 --2- 172.21.15.72:0/790853493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6ec0c4400 0x7fb6ec0c7710 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec0c0870 tx=0x7fb6e8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a2e77b038b00228 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:53.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.826+0000 7fb6f0f99700 1 -- 172.21.15.72:0/790853493 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e800b870 con 0x7fb6ec0c4400 2023-07-27T20:31:53.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.826+0000 7fb6f0f99700 1 -- 172.21.15.72:0/790853493 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e800b9d0 con 0x7fb6ec0c4400 2023-07-27T20:31:53.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.826+0000 7fb6f0f99700 1 -- 172.21.15.72:0/790853493 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e800bd60 con 0x7fb6ec0c4400 2023-07-27T20:31:53.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.827+0000 7fb6f41ff700 1 -- 172.21.15.72:0/790853493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6ec0c4400 msgr2=0x7fb6ec0c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:53.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.827+0000 7fb6f41ff700 1 --2- 172.21.15.72:0/790853493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6ec0c4400 0x7fb6ec0c7710 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec0c0870 tx=0x7fb6e8009bd0 comp rx=0 tx=0).stop 2023-07-27T20:31:53.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.827+0000 7fb6f41ff700 1 -- 172.21.15.72:0/790853493 shutdown_connections 2023-07-27T20:31:53.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.827+0000 7fb6f41ff700 1 --2- 172.21.15.72:0/790853493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6ec0c4400 0x7fb6ec0c7710 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:53.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.827+0000 7fb6f41ff700 1 --2- 172.21.15.72:0/790853493 >> v2:172.21.15.173:3300/0 conn(0x7fb6ec06b150 0x7fb6ec0c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:53.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.827+0000 7fb6f41ff700 1 -- 172.21.15.72:0/790853493 >> 172.21.15.72:0/790853493 conn(0x7fb6ec0ab300 msgr2=0x7fb6ec0ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:53.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.827+0000 7fb6f41ff700 1 -- 172.21.15.72:0/790853493 shutdown_connections 2023-07-27T20:31:53.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.827+0000 7fb6f41ff700 1 -- 172.21.15.72:0/790853493 wait complete. 2023-07-27T20:31:53.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.828+0000 7fb6f41ff700 1 Processor -- start 2023-07-27T20:31:53.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.829+0000 7fb6f41ff700 1 -- start start 2023-07-27T20:31:53.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.829+0000 7fb6f41ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6ec06b150 0x7fb6ec14b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:53.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.829+0000 7fb6f41ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6ec0c4400 0x7fb6ec0aed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:53.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.829+0000 7fb6f41ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb6ec1549f0 0x7fb6ec0c1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:53.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.829+0000 7fb6f41ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec0c1e80 con 0x7fb6ec06b150 2023-07-27T20:31:53.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.829+0000 7fb6f41ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec14e5c0 con 0x7fb6ec0c4400 2023-07-27T20:31:53.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.829+0000 7fb6f41ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec14bef0 con 0x7fb6ec1549f0 2023-07-27T20:31:53.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.830+0000 7fb6f1f9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6ec06b150 0x7fb6ec14b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:53.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.830+0000 7fb6f1f9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6ec06b150 0x7fb6ec14b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58442/0 (socket says 172.21.15.72:58442) 2023-07-27T20:31:53.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.830+0000 7fb6f1f9b700 1 -- 172.21.15.72:0/4028940916 learned_addr learned my addr 172.21.15.72:0/4028940916 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:53.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.830+0000 7fb6f179a700 1 --2- 172.21.15.72:0/4028940916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6ec0c4400 0x7fb6ec0aed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:53.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.830+0000 7fb6f279c700 1 --2- 172.21.15.72:0/4028940916 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb6ec1549f0 0x7fb6ec0c1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:53.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.830+0000 7fb6f1f9b700 1 -- 172.21.15.72:0/4028940916 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb6ec1549f0 msgr2=0x7fb6ec0c1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:53.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.830+0000 7fb6f1f9b700 1 --2- 172.21.15.72:0/4028940916 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb6ec1549f0 0x7fb6ec0c1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:53.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.830+0000 7fb6f1f9b700 1 -- 172.21.15.72:0/4028940916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6ec0c4400 msgr2=0x7fb6ec0aed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:53.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.830+0000 7fb6f1f9b700 1 --2- 172.21.15.72:0/4028940916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6ec0c4400 0x7fb6ec0aed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:53.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.830+0000 7fb6f1f9b700 1 -- 172.21.15.72:0/4028940916 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e8009550 con 0x7fb6ec06b150 2023-07-27T20:31:53.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.830+0000 7fb6f179a700 1 --2- 172.21.15.72:0/4028940916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6ec0c4400 0x7fb6ec0aed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:31:53.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.830+0000 7fb6f1f9b700 1 --2- 172.21.15.72:0/4028940916 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6ec06b150 0x7fb6ec14b9b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8014040 tx=0x7fb6e8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:53.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.831+0000 7fb6e27fc700 1 -- 172.21.15.72:0/4028940916 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e8004520 con 0x7fb6ec06b150 2023-07-27T20:31:53.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.831+0000 7fb6e27fc700 1 -- 172.21.15.72:0/4028940916 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e801e070 con 0x7fb6ec06b150 2023-07-27T20:31:53.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.831+0000 7fb6e27fc700 1 -- 172.21.15.72:0/4028940916 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e80038a0 con 0x7fb6ec06b150 2023-07-27T20:31:53.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.831+0000 7fb6f41ff700 1 -- 172.21.15.72:0/4028940916 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6ec149e30 con 0x7fb6ec06b150 2023-07-27T20:31:53.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.831+0000 7fb6f41ff700 1 -- 172.21.15.72:0/4028940916 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6ec14e810 con 0x7fb6ec06b150 2023-07-27T20:31:53.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.832+0000 7fb6f41ff700 1 -- 172.21.15.72:0/4028940916 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6ec074310 con 0x7fb6ec06b150 2023-07-27T20:31:53.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.833+0000 7fb6e27fc700 1 -- 172.21.15.72:0/4028940916 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb6e8003a00 con 0x7fb6ec06b150 2023-07-27T20:31:53.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.834+0000 7fb6e27fc700 1 --2- 172.21.15.72:0/4028940916 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb6d006ace0 0x7fb6d006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:53.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.834+0000 7fb6e27fc700 1 -- 172.21.15.72:0/4028940916 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb6e8020070 con 0x7fb6ec06b150 2023-07-27T20:31:53.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.834+0000 7fb6f179a700 1 --2- 172.21.15.72:0/4028940916 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb6d006ace0 0x7fb6d006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:53.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.835+0000 7fb6f179a700 1 --2- 172.21.15.72:0/4028940916 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb6d006ace0 0x7fb6d006d1a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc00c960 tx=0x7fb6dc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:53.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:53.838+0000 7fb6e27fc700 1 -- 172.21.15.72:0/4028940916 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb6e8055a40 con 0x7fb6ec06b150 2023-07-27T20:31:54.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.034+0000 7fb6f41ff700 1 -- 172.21.15.72:0/4028940916 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6ec0c11f0 con 0x7fb6ec06b150 2023-07-27T20:31:54.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.036+0000 7fb6e27fc700 1 -- 172.21.15.72:0/4028940916 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20120 (secure 0 0 0) 0x7fb6e8015090 con 0x7fb6ec06b150 2023-07-27T20:31:54.024 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:31:54.024 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:31:33.647304+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:31:27.020951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T20:31:27.566022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-27T20:31:31.182401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:31:54.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.038+0000 7fb6f41ff700 1 -- 172.21.15.72:0/4028940916 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb6d006ace0 msgr2=0x7fb6d006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.038+0000 7fb6f41ff700 1 --2- 172.21.15.72:0/4028940916 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb6d006ace0 0x7fb6d006d1a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc00c960 tx=0x7fb6dc008040 comp rx=0 tx=0).stop 2023-07-27T20:31:54.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.038+0000 7fb6f41ff700 1 -- 172.21.15.72:0/4028940916 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6ec06b150 msgr2=0x7fb6ec14b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.038+0000 7fb6f41ff700 1 --2- 172.21.15.72:0/4028940916 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6ec06b150 0x7fb6ec14b9b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8014040 tx=0x7fb6e8004750 comp rx=0 tx=0).stop 2023-07-27T20:31:54.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.038+0000 7fb6f41ff700 1 -- 172.21.15.72:0/4028940916 shutdown_connections 2023-07-27T20:31:54.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.038+0000 7fb6f41ff700 1 --2- 172.21.15.72:0/4028940916 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb6d006ace0 0x7fb6d006d1a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.038+0000 7fb6f41ff700 1 --2- 172.21.15.72:0/4028940916 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb6ec1549f0 0x7fb6ec0c1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.038+0000 7fb6f41ff700 1 --2- 172.21.15.72:0/4028940916 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6ec06b150 0x7fb6ec14b9b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.038+0000 7fb6f41ff700 1 --2- 172.21.15.72:0/4028940916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6ec0c4400 0x7fb6ec0aed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.039+0000 7fb6f41ff700 1 -- 172.21.15.72:0/4028940916 >> 172.21.15.72:0/4028940916 conn(0x7fb6ec0ab300 msgr2=0x7fb6ec0ab6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:54.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.039+0000 7fb6f41ff700 1 -- 172.21.15.72:0/4028940916 shutdown_connections 2023-07-27T20:31:54.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.039+0000 7fb6f41ff700 1 -- 172.21.15.72:0/4028940916 wait complete. 2023-07-27T20:31:54.045 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-07-27T20:31:54.045 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:31:54.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.254+0000 7f9419bff700 1 Processor -- start 2023-07-27T20:31:54.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.254+0000 7f9419bff700 1 -- start start 2023-07-27T20:31:54.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.255+0000 7f9419bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f94140c4400 0x7f94140c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.255+0000 7f9419bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94141549f0 0x7f94141514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.255+0000 7f9419bff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f941406b710 con 0x7f941406b150 2023-07-27T20:31:54.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.255+0000 7f9419bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94141545d0 con 0x7f94140c4400 2023-07-27T20:31:54.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.255+0000 7f9419bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941406c860 con 0x7f94141549f0 2023-07-27T20:31:54.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.255+0000 7f94137fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f94140c4400 0x7f94140c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.255+0000 7f94137fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f94140c4400 0x7f94140c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58448/0 (socket says 172.21.15.72:58448) 2023-07-27T20:31:54.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.255+0000 7f94137fe700 1 -- 172.21.15.72:0/3169881371 learned_addr learned my addr 172.21.15.72:0/3169881371 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:54.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.256+0000 7f9413fff700 1 --2- 172.21.15.72:0/3169881371 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94141549f0 0x7f94141514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.256+0000 7f94137fe700 1 -- 172.21.15.72:0/3169881371 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94141549f0 msgr2=0x7f94141514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:54.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.256+0000 7f94137fe700 1 --2- 172.21.15.72:0/3169881371 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94141549f0 0x7f94141514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.256+0000 7f94137fe700 1 -- 172.21.15.72:0/3169881371 >> v1:172.21.15.173:6789/0 conn(0x7f941406b150 legacy=0x7f94140c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.256+0000 7f94137fe700 1 -- 172.21.15.72:0/3169881371 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941406b9f0 con 0x7f94140c4400 2023-07-27T20:31:54.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.256+0000 7f94137fe700 1 --2- 172.21.15.72:0/3169881371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94140c4400 0x7f94140c7710 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f94040098f0 tx=0x7f9404009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de063dc35f87c9a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:54.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.256+0000 7f94127fc700 1 -- 172.21.15.72:0/3169881371 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940400b8a0 con 0x7f94140c4400 2023-07-27T20:31:54.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.256+0000 7f94127fc700 1 -- 172.21.15.72:0/3169881371 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940400ba00 con 0x7f94140c4400 2023-07-27T20:31:54.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.256+0000 7f94127fc700 1 -- 172.21.15.72:0/3169881371 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940400bd90 con 0x7f94140c4400 2023-07-27T20:31:54.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.257+0000 7f9419bff700 1 -- 172.21.15.72:0/3169881371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94140c4400 msgr2=0x7f94140c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.257+0000 7f9419bff700 1 --2- 172.21.15.72:0/3169881371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94140c4400 0x7f94140c7710 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f94040098f0 tx=0x7f9404009c00 comp rx=0 tx=0).stop 2023-07-27T20:31:54.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.257+0000 7f9419bff700 1 -- 172.21.15.72:0/3169881371 shutdown_connections 2023-07-27T20:31:54.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.257+0000 7f9419bff700 1 --2- 172.21.15.72:0/3169881371 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94141549f0 0x7f94141514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.257+0000 7f9419bff700 1 --2- 172.21.15.72:0/3169881371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94140c4400 0x7f94140c7710 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.257+0000 7f9419bff700 1 -- 172.21.15.72:0/3169881371 >> 172.21.15.72:0/3169881371 conn(0x7f94140ab300 msgr2=0x7f94140ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:54.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.257+0000 7f9419bff700 1 -- 172.21.15.72:0/3169881371 shutdown_connections 2023-07-27T20:31:54.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.257+0000 7f9419bff700 1 -- 172.21.15.72:0/3169881371 wait complete. 2023-07-27T20:31:54.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.259+0000 7f9419bff700 1 Processor -- start 2023-07-27T20:31:54.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.260+0000 7f9419bff700 1 -- start start 2023-07-27T20:31:54.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.261+0000 7f9419bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f941406b150 0x7f94140c32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.261+0000 7f9419bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94140c4400 0x7f94140c23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.261+0000 7f9419bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94141549f0 0x7f94140c0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.261+0000 7f9419bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94140bef50 con 0x7f941406b150 2023-07-27T20:31:54.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.261+0000 7f9419bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94140ae250 con 0x7f94141549f0 2023-07-27T20:31:54.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.261+0000 7f9419bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94140ae530 con 0x7f94140c4400 2023-07-27T20:31:54.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.261+0000 7f94137fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f941406b150 0x7f94140c32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.261+0000 7f94137fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f941406b150 0x7f94140c32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58452/0 (socket says 172.21.15.72:58452) 2023-07-27T20:31:54.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.261+0000 7f94137fe700 1 -- 172.21.15.72:0/2883705716 learned_addr learned my addr 172.21.15.72:0/2883705716 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:54.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.261+0000 7f9413fff700 1 --2- 172.21.15.72:0/2883705716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94141549f0 0x7f94140c0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.261+0000 7f9412ffd700 1 --2- 172.21.15.72:0/2883705716 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94140c4400 0x7f94140c23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.261+0000 7f94137fe700 1 -- 172.21.15.72:0/2883705716 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94140c4400 msgr2=0x7f94140c23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.261+0000 7f94137fe700 1 --2- 172.21.15.72:0/2883705716 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94140c4400 0x7f94140c23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.261+0000 7f94137fe700 1 -- 172.21.15.72:0/2883705716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94141549f0 msgr2=0x7f94140c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.261+0000 7f94137fe700 1 --2- 172.21.15.72:0/2883705716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94141549f0 0x7f94140c0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.261+0000 7f94137fe700 1 -- 172.21.15.72:0/2883705716 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9404009550 con 0x7f941406b150 2023-07-27T20:31:54.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.261+0000 7f9412ffd700 1 --2- 172.21.15.72:0/2883705716 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94140c4400 0x7f94140c23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:31:54.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.262+0000 7f94137fe700 1 --2- 172.21.15.72:0/2883705716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f941406b150 0x7f94140c32c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9404000c00 tx=0x7f9404004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:54.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.262+0000 7f93fbfff700 1 -- 172.21.15.72:0/2883705716 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9404004380 con 0x7f941406b150 2023-07-27T20:31:54.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.262+0000 7f93fbfff700 1 -- 172.21.15.72:0/2883705716 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940401f070 con 0x7f941406b150 2023-07-27T20:31:54.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.262+0000 7f9419bff700 1 -- 172.21.15.72:0/2883705716 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94140ae810 con 0x7f941406b150 2023-07-27T20:31:54.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.262+0000 7f93fbfff700 1 -- 172.21.15.72:0/2883705716 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94040036a0 con 0x7f941406b150 2023-07-27T20:31:54.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.262+0000 7f9419bff700 1 -- 172.21.15.72:0/2883705716 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94140af250 con 0x7f941406b150 2023-07-27T20:31:54.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.263+0000 7f9419bff700 1 -- 172.21.15.72:0/2883705716 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94140aeb80 con 0x7f941406b150 2023-07-27T20:31:54.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.264+0000 7f93fbfff700 1 -- 172.21.15.72:0/2883705716 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9404021030 con 0x7f941406b150 2023-07-27T20:31:54.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.265+0000 7f93fbfff700 1 --2- 172.21.15.72:0/2883705716 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f940006ace0 0x7f940006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.265+0000 7f93fbfff700 1 -- 172.21.15.72:0/2883705716 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f940408aa80 con 0x7f941406b150 2023-07-27T20:31:54.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.265+0000 7f9412ffd700 1 --2- 172.21.15.72:0/2883705716 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f940006ace0 0x7f940006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.266+0000 7f9412ffd700 1 --2- 172.21.15.72:0/2883705716 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f940006ace0 0x7f940006d1a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9408000f60 tx=0x7f9408009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:54.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.269+0000 7f93fbfff700 1 -- 172.21.15.72:0/2883705716 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9404055830 con 0x7f941406b150 2023-07-27T20:31:54.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.464+0000 7f9419bff700 1 -- 172.21.15.72:0/2883705716 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9414074310 con 0x7f941406b150 2023-07-27T20:31:54.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.465+0000 7f93fbfff700 1 -- 172.21.15.72:0/2883705716 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20120 (secure 0 0 0) 0x7f9404058e50 con 0x7f941406b150 2023-07-27T20:31:54.453 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:31:54.453 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:31:33.647304+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:31:27.020951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T20:31:27.566022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-27T20:31:31.182401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:31:54.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.468+0000 7f9419bff700 1 -- 172.21.15.72:0/2883705716 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f940006ace0 msgr2=0x7f940006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.468+0000 7f9419bff700 1 --2- 172.21.15.72:0/2883705716 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f940006ace0 0x7f940006d1a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9408000f60 tx=0x7f9408009040 comp rx=0 tx=0).stop 2023-07-27T20:31:54.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.468+0000 7f9419bff700 1 -- 172.21.15.72:0/2883705716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f941406b150 msgr2=0x7f94140c32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.468+0000 7f9419bff700 1 --2- 172.21.15.72:0/2883705716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f941406b150 0x7f94140c32c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9404000c00 tx=0x7f9404004750 comp rx=0 tx=0).stop 2023-07-27T20:31:54.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.468+0000 7f9419bff700 1 -- 172.21.15.72:0/2883705716 shutdown_connections 2023-07-27T20:31:54.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.468+0000 7f9419bff700 1 --2- 172.21.15.72:0/2883705716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94141549f0 0x7f94140c0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.468+0000 7f9419bff700 1 --2- 172.21.15.72:0/2883705716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f941406b150 0x7f94140c32c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.468+0000 7f9419bff700 1 --2- 172.21.15.72:0/2883705716 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f940006ace0 0x7f940006d1a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.468+0000 7f9419bff700 1 --2- 172.21.15.72:0/2883705716 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94140c4400 0x7f94140c23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.468+0000 7f9419bff700 1 -- 172.21.15.72:0/2883705716 >> 172.21.15.72:0/2883705716 conn(0x7f94140ab300 msgr2=0x7f9414153a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:54.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.468+0000 7f9419bff700 1 -- 172.21.15.72:0/2883705716 shutdown_connections 2023-07-27T20:31:54.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.468+0000 7f9419bff700 1 -- 172.21.15.72:0/2883705716 wait complete. 2023-07-27T20:31:54.473 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-07-27T20:31:54.474 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-07-27T20:31:54.475 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-07-27T20:31:54.475 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-07-27T20:31:54.476 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-07-27T20:31:54.476 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-07-27T20:31:54.477 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-07-27T20:31:54.477 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-07-27T20:31:54.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.842+0000 7f4e3f7ff700 1 Processor -- start 2023-07-27T20:31:54.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.842+0000 7f4e3f7ff700 1 -- start start 2023-07-27T20:31:54.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.844+0000 7f4e3f7ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e380c24c0 0x7f4e381556d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.844+0000 7f4e3f7ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4e380c1750 0x7f4e380c0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.844+0000 7f4e3f7ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e3806d100 con 0x7f4e38155c10 2023-07-27T20:31:54.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.844+0000 7f4e3f7ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e380bfd90 con 0x7f4e380c1750 2023-07-27T20:31:54.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.844+0000 7f4e3f7ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e38158860 con 0x7f4e380c24c0 2023-07-27T20:31:54.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.845+0000 7f4e3cd9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4e380c1750 0x7f4e380c0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.845+0000 7f4e3cd9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4e380c1750 0x7f4e380c0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58464/0 (socket says 172.21.15.72:58464) 2023-07-27T20:31:54.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.845+0000 7f4e3cd9a700 1 -- 172.21.15.72:0/4095899410 learned_addr learned my addr 172.21.15.72:0/4095899410 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:54.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.845+0000 7f4e3d59b700 1 --2- 172.21.15.72:0/4095899410 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e380c24c0 0x7f4e381556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.847+0000 7f4e3cd9a700 1 -- 172.21.15.72:0/4095899410 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e380c24c0 msgr2=0x7f4e381556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:54.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.847+0000 7f4e3cd9a700 1 --2- 172.21.15.72:0/4095899410 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e380c24c0 0x7f4e381556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.847+0000 7f4e3cd9a700 1 -- 172.21.15.72:0/4095899410 >> v1:172.21.15.173:6789/0 conn(0x7f4e38155c10 legacy=0x7f4e380c0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:54.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.847+0000 7f4e3cd9a700 1 -- 172.21.15.72:0/4095899410 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e38158b40 con 0x7f4e380c1750 2023-07-27T20:31:54.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.848+0000 7f4e3cd9a700 1 --2- 172.21.15.72:0/4095899410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e380c1750 0x7f4e380c0220 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4e30009e50 tx=0x7f4e3000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5264809c3ede9dda server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:54.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.849+0000 7f1bff5ff700 1 Processor -- start 2023-07-27T20:31:54.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.849+0000 7f4e2ffff700 1 -- 172.21.15.72:0/4095899410 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3000e070 con 0x7f4e380c1750 2023-07-27T20:31:54.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.849+0000 7f4e2ffff700 1 -- 172.21.15.72:0/4095899410 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e30003a20 con 0x7f4e380c1750 2023-07-27T20:31:54.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.849+0000 7f4e2ffff700 1 -- 172.21.15.72:0/4095899410 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e30003dd0 con 0x7f4e380c1750 2023-07-27T20:31:54.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.849+0000 7f1bff5ff700 1 -- start start 2023-07-27T20:31:54.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.851+0000 7f1bff5ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1bf8070a90 0x7f1bf8153f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.851+0000 7f1bff5ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1bf80c2390 0x7f1bf8070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.851+0000 7f1bff5ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bf81509d0 0x7f1bf80c0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.851+0000 7f1bff5ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bf8071820 con 0x7f1bf8070a90 2023-07-27T20:31:54.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.851+0000 7f1bff5ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bf80c2de0 con 0x7f1bf80c2390 2023-07-27T20:31:54.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.851+0000 7f1bff5ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf8153540 con 0x7f1bf81509d0 2023-07-27T20:31:54.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.852+0000 7f1bfdb9c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bf81509d0 0x7f1bf80c0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.852+0000 7f1bfd39b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1bf8070a90 0x7f1bf8153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.852+0000 7f1bfd39b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1bf8070a90 0x7f1bf8153f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58466/0 (socket says 172.21.15.72:58466) 2023-07-27T20:31:54.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.852+0000 7f1bfdb9c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bf81509d0 0x7f1bf80c0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.72:47934/0 (socket says 172.21.15.72:47934) 2023-07-27T20:31:54.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.852+0000 7f1bfd39b700 1 -- 172.21.15.72:0/3181175168 learned_addr learned my addr 172.21.15.72:0/3181175168 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:54.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.852+0000 7f1bfcb9a700 1 --2- 172.21.15.72:0/3181175168 >> v2:172.21.15.173:3300/0 conn(0x7f1bf80c2390 0x7f1bf8070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.853+0000 7f1bfd39b700 1 -- 172.21.15.72:0/3181175168 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bf81509d0 msgr2=0x7f1bf80c0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:54.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.853+0000 7f1bfd39b700 1 --2- 172.21.15.72:0/3181175168 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bf81509d0 0x7f1bf80c0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.853+0000 7f1bfd39b700 1 -- 172.21.15.72:0/3181175168 >> v2:172.21.15.173:3300/0 conn(0x7f1bf80c2390 msgr2=0x7f1bf8070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:54.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.853+0000 7f1bfd39b700 1 --2- 172.21.15.72:0/3181175168 >> v2:172.21.15.173:3300/0 conn(0x7f1bf80c2390 0x7f1bf8070e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.853+0000 7f1bfd39b700 1 -- 172.21.15.72:0/3181175168 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf8150e80 con 0x7f1bf8070a90 2023-07-27T20:31:54.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.853+0000 7f1bfd39b700 1 --2- 172.21.15.72:0/3181175168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bf8070a90 0x7f1bf8153f50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1bf80c64e0 tx=0x7f1bf000f5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76f91767dafcbe58 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:54.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.854+0000 7f4e3f7ff700 1 -- 172.21.15.72:0/4095899410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e380c1750 msgr2=0x7f4e380c0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.854+0000 7f4e3f7ff700 1 --2- 172.21.15.72:0/4095899410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e380c1750 0x7f4e380c0220 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4e30009e50 tx=0x7f4e3000b330 comp rx=0 tx=0).stop 2023-07-27T20:31:54.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.854+0000 7f1beffff700 1 -- 172.21.15.72:0/3181175168 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf0012070 con 0x7f1bf8070a90 2023-07-27T20:31:54.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.854+0000 7f1beffff700 1 -- 172.21.15.72:0/3181175168 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf000fe90 con 0x7f1bf8070a90 2023-07-27T20:31:54.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.854+0000 7f1beffff700 1 -- 172.21.15.72:0/3181175168 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf0016650 con 0x7f1bf8070a90 2023-07-27T20:31:54.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.854+0000 7f4e3f7ff700 1 -- 172.21.15.72:0/4095899410 shutdown_connections 2023-07-27T20:31:54.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.854+0000 7f4e3f7ff700 1 --2- 172.21.15.72:0/4095899410 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e380c24c0 0x7f4e381556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.854+0000 7f4e3f7ff700 1 --2- 172.21.15.72:0/4095899410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e380c1750 0x7f4e380c0220 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.854+0000 7f4e3f7ff700 1 -- 172.21.15.72:0/4095899410 >> 172.21.15.72:0/4095899410 conn(0x7f4e3806a190 msgr2=0x7f4e3806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:54.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.855+0000 7f1bff5ff700 1 -- 172.21.15.72:0/3181175168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bf8070a90 msgr2=0x7f1bf8153f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.855+0000 7f1bff5ff700 1 --2- 172.21.15.72:0/3181175168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bf8070a90 0x7f1bf8153f50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1bf80c64e0 tx=0x7f1bf000f5c0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.856+0000 7f4e3f7ff700 1 -- 172.21.15.72:0/4095899410 shutdown_connections 2023-07-27T20:31:54.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.856+0000 7f4e3f7ff700 1 -- 172.21.15.72:0/4095899410 wait complete. 2023-07-27T20:31:54.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.858+0000 7f4e3f7ff700 1 Processor -- start 2023-07-27T20:31:54.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.859+0000 7f4e3f7ff700 1 -- start start 2023-07-27T20:31:54.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.857+0000 7f1bff5ff700 1 -- 172.21.15.72:0/3181175168 shutdown_connections 2023-07-27T20:31:54.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.857+0000 7f1bff5ff700 1 --2- 172.21.15.72:0/3181175168 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bf81509d0 0x7f1bf80c0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.857+0000 7f1bff5ff700 1 --2- 172.21.15.72:0/3181175168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bf8070a90 0x7f1bf8153f50 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.857+0000 7f1bff5ff700 1 --2- 172.21.15.72:0/3181175168 >> v2:172.21.15.173:3300/0 conn(0x7f1bf80c2390 0x7f1bf8070e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.857+0000 7f1bff5ff700 1 -- 172.21.15.72:0/3181175168 >> 172.21.15.72:0/3181175168 conn(0x7f1bf806a190 msgr2=0x7f1bf806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:54.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.857+0000 7f38b39ff700 1 Processor -- start 2023-07-27T20:31:54.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.857+0000 7f38b39ff700 1 -- start start 2023-07-27T20:31:54.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.858+0000 7fb8a89ff700 1 Processor -- start 2023-07-27T20:31:54.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.860+0000 7f4e3f7ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e380c1750 0x7f4e380c4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.860+0000 7f4e3f7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e380c24c0 0x7f4e381446c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.860+0000 7f4e3f7ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e38155c10 0x7f4e38144c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.860+0000 7f4e3f7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e381ee880 con 0x7f4e380c24c0 2023-07-27T20:31:54.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.860+0000 7f4e3f7ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e381eda10 con 0x7f4e380c1750 2023-07-27T20:31:54.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.860+0000 7f4e3f7ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e380ab260 con 0x7f4e38155c10 2023-07-27T20:31:54.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.861+0000 7f4e3d59b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e380c1750 0x7f4e380c4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.861+0000 7f4e3cd9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e380c24c0 0x7f4e381446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.861+0000 7f4e3cd9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e380c24c0 0x7f4e381446c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58472/0 (socket says 172.21.15.72:58472) 2023-07-27T20:31:54.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.861+0000 7f4e3cd9a700 1 -- 172.21.15.72:0/3993370495 learned_addr learned my addr 172.21.15.72:0/3993370495 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:54.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.861+0000 7f4e3dd9c700 1 --2- 172.21.15.72:0/3993370495 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e38155c10 0x7f4e38144c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.861+0000 7f4e3d59b700 1 -- 172.21.15.72:0/3993370495 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e38155c10 msgr2=0x7f4e38144c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.861+0000 7f4e3d59b700 1 --2- 172.21.15.72:0/3993370495 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e38155c10 0x7f4e38144c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.861+0000 7f4e3d59b700 1 -- 172.21.15.72:0/3993370495 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e380c24c0 msgr2=0x7f4e381446c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.862+0000 7f4e3d59b700 1 --2- 172.21.15.72:0/3993370495 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e380c24c0 0x7f4e381446c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.862+0000 7f4e3d59b700 1 -- 172.21.15.72:0/3993370495 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e30009b30 con 0x7f4e380c1750 2023-07-27T20:31:54.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.860+0000 7f38b39ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f38ac150950 0x7f38ac0c1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.860+0000 7f38b39ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38ac070de0 con 0x7f38ac06e420 2023-07-27T20:31:54.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.860+0000 7f38b39ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38ac0c1b60 con 0x7f38ac070950 2023-07-27T20:31:54.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.860+0000 7f38b39ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38ac0715d0 con 0x7f38ac150950 2023-07-27T20:31:54.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.861+0000 7f38b179b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f38ac06e420 0x7f38ac153e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55428/0 (socket says 172.21.15.72:55428) 2023-07-27T20:31:54.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.861+0000 7f38b179b700 1 -- 172.21.15.72:0/4161291127 learned_addr learned my addr 172.21.15.72:0/4161291127 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:54.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.861+0000 7f38b1f9c700 1 --2- 172.21.15.72:0/4161291127 >> v2:172.21.15.173:3300/0 conn(0x7f38ac150950 0x7f38ac0c1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.858+0000 7fb8a89ff700 1 -- start start 2023-07-27T20:31:54.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.862+0000 7f38a3fff700 1 -- 172.21.15.72:0/4161291127 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3226210178 0 0) 0x7f38ac070de0 con 0x7f38ac06e420 2023-07-27T20:31:54.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.862+0000 7f38a3fff700 1 -- 172.21.15.72:0/4161291127 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38980035b0 con 0x7f38ac06e420 2023-07-27T20:31:54.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.862+0000 7f38b1f9c700 1 -- 172.21.15.72:0/4161291127 >> v1:172.21.15.173:6789/0 conn(0x7f38ac070950 legacy=0x7f38ac0c1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.862+0000 7f38b1f9c700 1 -- 172.21.15.72:0/4161291127 >> v1:172.21.15.72:6789/0 conn(0x7f38ac06e420 legacy=0x7f38ac153e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.862+0000 7f38b1f9c700 1 -- 172.21.15.72:0/4161291127 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ac153990 con 0x7f38ac150950 2023-07-27T20:31:54.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.862+0000 7f4e3d59b700 1 --2- 172.21.15.72:0/3993370495 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e380c1750 0x7f4e380c4840 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4e3401f580 tx=0x7f4e3401f940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:54.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.861+0000 7fb8a89ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb8a4070a90 0x7fb8a4153f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.861+0000 7fb8a89ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb8a4070e70 0x7fb8a41509d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.861+0000 7fb8a89ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8a40712e0 con 0x7fb8a40c2390 2023-07-27T20:31:54.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.861+0000 7fb8a89ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8a4071820 con 0x7fb8a4070e70 2023-07-27T20:31:54.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.861+0000 7fb8a89ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a40c2de0 con 0x7fb8a4070a90 2023-07-27T20:31:54.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.862+0000 7fb8a2d9d700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb8a4070e70 0x7fb8a41509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.862+0000 7fb8a2d9d700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb8a4070e70 0x7fb8a41509d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.72:46846/0 (socket says 172.21.15.72:46846) 2023-07-27T20:31:54.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.862+0000 7fb8a2d9d700 1 -- 172.21.15.72:0/140965570 learned_addr learned my addr 172.21.15.72:0/140965570 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:54.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.863+0000 7fb8a259c700 1 --2- 172.21.15.72:0/140965570 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb8a4070a90 0x7fb8a4153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.862+0000 7f1bff5ff700 1 -- 172.21.15.72:0/3181175168 shutdown_connections 2023-07-27T20:31:54.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.863+0000 7fcadd9ff700 1 Processor -- start 2023-07-27T20:31:54.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.863+0000 7f38b1f9c700 1 --2- 172.21.15.72:0/4161291127 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38ac150950 0x7f38ac0c1620 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f389c009840 tx=0x7f389c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=135402dd13c0405c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:54.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.863+0000 7fb8a2d9d700 1 -- 172.21.15.72:0/140965570 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb8a4070a90 msgr2=0x7fb8a4153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:54.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.863+0000 7f4e2dffb700 1 -- 172.21.15.72:0/3993370495 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e34024890 con 0x7f4e380c1750 2023-07-27T20:31:54.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.863+0000 7fb8a2d9d700 1 --2- 172.21.15.72:0/140965570 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb8a4070a90 0x7fb8a4153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.863+0000 7fb8a2d9d700 1 -- 172.21.15.72:0/140965570 >> v1:172.21.15.72:6789/0 conn(0x7fb8a40c2390 legacy=0x7fb8a40c0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:54.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.863+0000 7fb8a2d9d700 1 -- 172.21.15.72:0/140965570 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a40bffd0 con 0x7fb8a4070e70 2023-07-27T20:31:54.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.863+0000 7f4e2dffb700 1 -- 172.21.15.72:0/3993370495 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e340249f0 con 0x7f4e380c1750 2023-07-27T20:31:54.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.863+0000 7f4e2dffb700 1 -- 172.21.15.72:0/3993370495 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e34024d80 con 0x7f4e380c1750 2023-07-27T20:31:54.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.863+0000 7f38a3fff700 1 -- 172.21.15.72:0/4161291127 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389c004230 con 0x7f38ac150950 2023-07-27T20:31:54.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.863+0000 7f38a3fff700 1 -- 172.21.15.72:0/4161291127 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f389c004390 con 0x7f38ac150950 2023-07-27T20:31:54.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.863+0000 7f38a3fff700 1 -- 172.21.15.72:0/4161291127 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389c0036c0 con 0x7f38ac150950 2023-07-27T20:31:54.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.863+0000 7fb8a2d9d700 1 --2- 172.21.15.72:0/140965570 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8a4070e70 0x7fb8a41509d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb88c0098f0 tx=0x7fb88c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=724802ae6231cf69 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:54.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.865+0000 7f4e3f7ff700 1 -- 172.21.15.72:0/3993370495 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e381edc00 con 0x7f4e380c1750 2023-07-27T20:31:54.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.865+0000 7f4e3f7ff700 1 -- 172.21.15.72:0/3993370495 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e381ee1c0 con 0x7f4e380c1750 2023-07-27T20:31:54.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.864+0000 7f1bff5ff700 1 -- 172.21.15.72:0/3181175168 wait complete. 2023-07-27T20:31:54.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.863+0000 7fcadd9ff700 1 -- start start 2023-07-27T20:31:54.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.865+0000 7f38b39ff700 1 -- 172.21.15.72:0/4161291127 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38ac150950 msgr2=0x7f38ac0c1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.865+0000 7f38b39ff700 1 --2- 172.21.15.72:0/4161291127 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38ac150950 0x7f38ac0c1620 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f389c009840 tx=0x7f389c009b50 comp rx=0 tx=0).stop 2023-07-27T20:31:54.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.864+0000 7fb8a159a700 1 -- 172.21.15.72:0/140965570 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88c004230 con 0x7fb8a4070e70 2023-07-27T20:31:54.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.864+0000 7fb8a159a700 1 -- 172.21.15.72:0/140965570 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88c004390 con 0x7fb8a4070e70 2023-07-27T20:31:54.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.864+0000 7fb8a159a700 1 -- 172.21.15.72:0/140965570 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88c0036a0 con 0x7fb8a4070e70 2023-07-27T20:31:54.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.865+0000 7fb8a89ff700 1 -- 172.21.15.72:0/140965570 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8a4070e70 msgr2=0x7fb8a41509d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.865+0000 7fb8a89ff700 1 --2- 172.21.15.72:0/140965570 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8a4070e70 0x7fb8a41509d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb88c0098f0 tx=0x7fb88c009c00 comp rx=0 tx=0).stop 2023-07-27T20:31:54.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.865+0000 7fb8a89ff700 1 -- 172.21.15.72:0/140965570 shutdown_connections 2023-07-27T20:31:54.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.865+0000 7fb8a89ff700 1 --2- 172.21.15.72:0/140965570 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8a4070e70 0x7fb8a41509d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.864+0000 7f354c1ff700 1 Processor -- start 2023-07-27T20:31:54.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.865+0000 7f354c1ff700 1 -- start start 2023-07-27T20:31:54.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.865+0000 7fb8a89ff700 1 --2- 172.21.15.72:0/140965570 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb8a4070a90 0x7fb8a4153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.865+0000 7fb8a89ff700 1 -- 172.21.15.72:0/140965570 >> 172.21.15.72:0/140965570 conn(0x7fb8a406a190 msgr2=0x7fb8a406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:54.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.866+0000 7f38b39ff700 1 -- 172.21.15.72:0/4161291127 shutdown_connections 2023-07-27T20:31:54.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.866+0000 7f38b39ff700 1 --2- 172.21.15.72:0/4161291127 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38ac150950 0x7f38ac0c1620 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.866+0000 7f38b39ff700 1 -- 172.21.15.72:0/4161291127 >> 172.21.15.72:0/4161291127 conn(0x7f38ac06a190 msgr2=0x7f38ac06a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:54.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.866+0000 7fb8a89ff700 1 -- 172.21.15.72:0/140965570 shutdown_connections 2023-07-27T20:31:54.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.866+0000 7f4e3f7ff700 1 -- 172.21.15.72:0/3993370495 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4e38159100 con 0x7f4e380c1750 2023-07-27T20:31:54.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.867+0000 7f1bff5ff700 1 Processor -- start 2023-07-27T20:31:54.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.866+0000 7fcadd9ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcad806ad20 0x7fcad8146aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.866+0000 7fcadd9ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcad8153f50 0x7fcad81509d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.867+0000 7fcadd9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad8154380 con 0x7fcad80c2390 2023-07-27T20:31:54.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.867+0000 7fcadd9ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad8071820 con 0x7fcad806ad20 2023-07-27T20:31:54.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.867+0000 7fcadd9ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad80c2de0 con 0x7fcad8153f50 2023-07-27T20:31:54.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.867+0000 7fcad77fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcad8153f50 0x7fcad81509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.867+0000 7f354c1ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3544155c50 0x7f35440c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.867+0000 7f354c1ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f35440ca370 0x7f35440c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.867+0000 7f354c1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f354406ccb0 con 0x7f35440c7830 2023-07-27T20:31:54.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.867+0000 7f354c1ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35440c7d40 con 0x7f35440ca370 2023-07-27T20:31:54.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.867+0000 7f354c1ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35440c4bb0 con 0x7f3544155c50 2023-07-27T20:31:54.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.868+0000 7f1bff5ff700 1 -- start start 2023-07-27T20:31:54.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.867+0000 7fcad77fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcad8153f50 0x7fcad81509d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.72:47952/0 (socket says 172.21.15.72:47952) 2023-07-27T20:31:54.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.867+0000 7fcad77fe700 1 -- 172.21.15.72:0/1955803054 learned_addr learned my addr 172.21.15.72:0/1955803054 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:54.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.867+0000 7fcad67fc700 1 --2- 172.21.15.72:0/1955803054 >> v2:172.21.15.173:3300/0 conn(0x7fcad806ad20 0x7fcad8146aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.867+0000 7f3549f9b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3544155c50 0x7f35440c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.868+0000 7f354a79c700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f35440ca370 0x7f35440c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.868+0000 7f3549f9b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3544155c50 0x7f35440c9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.72:47958/0 (socket says 172.21.15.72:47958) 2023-07-27T20:31:54.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.868+0000 7f3549f9b700 1 -- 172.21.15.72:0/2863712758 learned_addr learned my addr 172.21.15.72:0/2863712758 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:54.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.868+0000 7f354979a700 1 --1- 172.21.15.72:0/2863712758 >> v1:172.21.15.72:6789/0 conn(0x7f35440c7830 0x7f35440c66b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55434/0 (socket says 172.21.15.72:55434) 2023-07-27T20:31:54.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.868+0000 7fcad77fe700 1 -- 172.21.15.72:0/1955803054 >> v2:172.21.15.173:3300/0 conn(0x7fcad806ad20 msgr2=0x7fcad8146aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:54.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.868+0000 7fcad77fe700 1 --2- 172.21.15.72:0/1955803054 >> v2:172.21.15.173:3300/0 conn(0x7fcad806ad20 0x7fcad8146aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.868+0000 7fcad77fe700 1 -- 172.21.15.72:0/1955803054 >> v1:172.21.15.72:6789/0 conn(0x7fcad80c2390 legacy=0x7fcad80c0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.868+0000 7fcad77fe700 1 -- 172.21.15.72:0/1955803054 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad80c2820 con 0x7fcad8153f50 2023-07-27T20:31:54.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.868+0000 7f38b39ff700 1 -- 172.21.15.72:0/4161291127 shutdown_connections 2023-07-27T20:31:54.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.868+0000 7f3549f9b700 1 -- 172.21.15.72:0/2863712758 >> v2:172.21.15.173:3300/0 conn(0x7f35440ca370 msgr2=0x7f35440c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:54.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.868+0000 7f3549f9b700 1 --2- 172.21.15.72:0/2863712758 >> v2:172.21.15.173:3300/0 conn(0x7f35440ca370 0x7f35440c6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.868+0000 7f3549f9b700 1 -- 172.21.15.72:0/2863712758 >> v1:172.21.15.72:6789/0 conn(0x7f35440c7830 legacy=0x7f35440c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.868+0000 7f3549f9b700 1 -- 172.21.15.72:0/2863712758 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35440c4350 con 0x7f3544155c50 2023-07-27T20:31:54.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.868+0000 7f3548f99700 1 -- 172.21.15.72:0/2863712758 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 126643641 0 0) 0x7f354406ccb0 con 0x7f35440c7830 2023-07-27T20:31:54.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.866+0000 7fb8a89ff700 1 -- 172.21.15.72:0/140965570 wait complete. 2023-07-27T20:31:54.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.869+0000 7fcad77fe700 1 --2- 172.21.15.72:0/1955803054 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcad8153f50 0x7fcad81509d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcad0009e50 tx=0x7fcad000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebf870f3d7a146b7 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:54.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.868+0000 7fb8a89ff700 1 Processor -- start 2023-07-27T20:31:54.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.869+0000 7f3549f9b700 1 --2- 172.21.15.72:0/2863712758 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3544155c50 0x7f35440c9e30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f35380098f0 tx=0x7f3538009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d67c82cfb6f1aca0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:54.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.869+0000 7f3548f99700 1 -- 172.21.15.72:0/2863712758 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3538011830 con 0x7f3544155c50 2023-07-27T20:31:54.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.869+0000 7f3548f99700 1 -- 172.21.15.72:0/2863712758 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3538011990 con 0x7f3544155c50 2023-07-27T20:31:54.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.869+0000 7f3548f99700 1 -- 172.21.15.72:0/2863712758 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3538011d20 con 0x7f3544155c50 2023-07-27T20:31:54.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.869+0000 7fcad5ffb700 1 -- 172.21.15.72:0/1955803054 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad000e070 con 0x7fcad8153f50 2023-07-27T20:31:54.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.868+0000 7f38b39ff700 1 -- 172.21.15.72:0/4161291127 wait complete. 2023-07-27T20:31:54.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.869+0000 7fcad5ffb700 1 -- 172.21.15.72:0/1955803054 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad000b910 con 0x7fcad8153f50 2023-07-27T20:31:54.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.869+0000 7fcad5ffb700 1 -- 172.21.15.72:0/1955803054 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad000bcc0 con 0x7fcad8153f50 2023-07-27T20:31:54.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.869+0000 7f1bff5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bf8070a90 0x7f1bf80aad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.869+0000 7f1bff5ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bf81509d0 0x7f1bf813f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.869+0000 7f1bff5ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bf8146f20 0x7f1bf813fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.869+0000 7f1bff5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf8147460 con 0x7f1bf8070a90 2023-07-27T20:31:54.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.869+0000 7f1bff5ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf80a9630 con 0x7f1bf81509d0 2023-07-27T20:31:54.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.869+0000 7f1bff5ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf80a9910 con 0x7f1bf8146f20 2023-07-27T20:31:54.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.870+0000 7f1bfcb9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bf81509d0 0x7f1bf813f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.870+0000 7f1bfcb9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bf81509d0 0x7f1bf813f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.72:46860/0 (socket says 172.21.15.72:46860) 2023-07-27T20:31:54.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.870+0000 7f1bfcb9a700 1 -- 172.21.15.72:0/1607347658 learned_addr learned my addr 172.21.15.72:0/1607347658 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:54.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.870+0000 7f1bfdb9c700 1 --2- 172.21.15.72:0/1607347658 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bf8146f20 0x7f1bf813fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.871+0000 7f1bfdb9c700 1 -- 172.21.15.72:0/1607347658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bf81509d0 msgr2=0x7f1bf813f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.871+0000 7f1bfdb9c700 1 --2- 172.21.15.72:0/1607347658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bf81509d0 0x7f1bf813f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.871+0000 7f1bfdb9c700 1 -- 172.21.15.72:0/1607347658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bf8070a90 msgr2=0x7f1bf80aad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.871+0000 7f1bfdb9c700 1 --2- 172.21.15.72:0/1607347658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bf8070a90 0x7f1bf80aad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.871+0000 7f1bfdb9c700 1 -- 172.21.15.72:0/1607347658 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf000f050 con 0x7f1bf8146f20 2023-07-27T20:31:54.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.871+0000 7f1bfdb9c700 1 --2- 172.21.15.72:0/1607347658 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bf8146f20 0x7f1bf813fd40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1bf400e7e0 tx=0x7f1bf400eaf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:54.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.870+0000 7fcadd9ff700 1 -- 172.21.15.72:0/1955803054 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcad8153f50 msgr2=0x7fcad81509d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.870+0000 7fcadd9ff700 1 --2- 172.21.15.72:0/1955803054 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcad8153f50 0x7fcad81509d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcad0009e50 tx=0x7fcad000b330 comp rx=0 tx=0).stop 2023-07-27T20:31:54.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.870+0000 7fcadd9ff700 1 -- 172.21.15.72:0/1955803054 shutdown_connections 2023-07-27T20:31:54.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.870+0000 7fcadd9ff700 1 --2- 172.21.15.72:0/1955803054 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcad8153f50 0x7fcad81509d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.870+0000 7fcadd9ff700 1 --2- 172.21.15.72:0/1955803054 >> v2:172.21.15.173:3300/0 conn(0x7fcad806ad20 0x7fcad8146aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.870+0000 7fcadd9ff700 1 -- 172.21.15.72:0/1955803054 >> 172.21.15.72:0/1955803054 conn(0x7fcad806a190 msgr2=0x7fcad806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:54.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.871+0000 7fcadd9ff700 1 -- 172.21.15.72:0/1955803054 shutdown_connections 2023-07-27T20:31:54.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.871+0000 7f38b39ff700 1 Processor -- start 2023-07-27T20:31:54.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.870+0000 7f354c1ff700 1 -- 172.21.15.72:0/2863712758 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3544155c50 msgr2=0x7f35440c9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.870+0000 7f354c1ff700 1 --2- 172.21.15.72:0/2863712758 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3544155c50 0x7f35440c9e30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f35380098f0 tx=0x7f3538009c00 comp rx=0 tx=0).stop 2023-07-27T20:31:54.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.871+0000 7f4e2dffb700 1 -- 172.21.15.72:0/3993370495 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4e34005a20 con 0x7f4e380c1750 2023-07-27T20:31:54.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.872+0000 7f4e2dffb700 1 --2- 172.21.15.72:0/3993370495 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4e1c06adb0 0x7f4e1c06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.873+0000 7f4e2dffb700 1 -- 172.21.15.72:0/3993370495 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4e3409a890 con 0x7f4e380c1750 2023-07-27T20:31:54.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.873+0000 7f4e2dffb700 1 --2- 172.21.15.72:0/3993370495 >> [v2:172.21.15.72:6819/1712741452,v1:172.21.15.72:6821/1712741452] conn(0x7f4e1c074a90 0x7f4e1c076ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.873+0000 7f4e2dffb700 1 -- 172.21.15.72:0/3993370495 --> [v2:172.21.15.72:6819/1712741452,v1:172.21.15.72:6821/1712741452] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4e1c0775a0 con 0x7f4e1c074a90 2023-07-27T20:31:54.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.873+0000 7f4e2dffb700 1 -- 172.21.15.72:0/3993370495 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e3409ac40 con 0x7f4e380c1750 2023-07-27T20:31:54.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.872+0000 7f1bedffb700 1 -- 172.21.15.72:0/1607347658 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf400c070 con 0x7f1bf8146f20 2023-07-27T20:31:54.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.872+0000 7f1bedffb700 1 -- 172.21.15.72:0/1607347658 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf4013610 con 0x7f1bf8146f20 2023-07-27T20:31:54.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.872+0000 7f1bedffb700 1 -- 172.21.15.72:0/1607347658 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf40139a0 con 0x7f1bf8146f20 2023-07-27T20:31:54.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.872+0000 7f1bff5ff700 1 -- 172.21.15.72:0/1607347658 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bf80a9bf0 con 0x7f1bf8146f20 2023-07-27T20:31:54.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.872+0000 7f1bff5ff700 1 -- 172.21.15.72:0/1607347658 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bf80a9ed0 con 0x7f1bf8146f20 2023-07-27T20:31:54.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.873+0000 7f1bff5ff700 1 -- 172.21.15.72:0/1607347658 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1bf80bffd0 con 0x7f1bf8146f20 2023-07-27T20:31:54.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.871+0000 7fcadd9ff700 1 -- 172.21.15.72:0/1955803054 wait complete. 2023-07-27T20:31:54.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.871+0000 7f38b39ff700 1 -- start start 2023-07-27T20:31:54.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.873+0000 7f38b39ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38ac06e420 0x7f38ac14f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.873+0000 7f38b39ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38ac070950 0x7f38ac0a9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.873+0000 7f38b39ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f38ac150950 0x7f38ac0ba450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.873+0000 7f38b39ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac142780 con 0x7f38ac06e420 2023-07-27T20:31:54.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.873+0000 7f38b39ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac14f8c0 con 0x7f38ac070950 2023-07-27T20:31:54.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.873+0000 7f38b39ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac1420c0 con 0x7f38ac150950 2023-07-27T20:31:54.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.871+0000 7f61e5fff700 1 Processor -- start 2023-07-27T20:31:54.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.871+0000 7f61e5fff700 1 -- start start 2023-07-27T20:31:54.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.873+0000 7f61e5fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61e00c1fe0 0x7f61e0070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.873+0000 7f61e5fff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f61e00c23c0 0x7f61e0150950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.873+0000 7f61e5fff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61e00715d0 con 0x7f61e0153e20 2023-07-27T20:31:54.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.873+0000 7f61e5fff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61e0153990 con 0x7f61e00c23c0 2023-07-27T20:31:54.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.873+0000 7f61e5fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e0071010 con 0x7f61e00c1fe0 2023-07-27T20:31:54.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.873+0000 7fcadd9ff700 1 Processor -- start 2023-07-27T20:31:54.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.873+0000 7f354c1ff700 1 -- 172.21.15.72:0/2863712758 shutdown_connections 2023-07-27T20:31:54.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.873+0000 7f354c1ff700 1 --2- 172.21.15.72:0/2863712758 >> v2:172.21.15.173:3300/0 conn(0x7f35440ca370 0x7f35440c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.873+0000 7f354c1ff700 1 --2- 172.21.15.72:0/2863712758 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3544155c50 0x7f35440c9e30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.873+0000 7f354c1ff700 1 -- 172.21.15.72:0/2863712758 >> 172.21.15.72:0/2863712758 conn(0x7f3544071ce0 msgr2=0x7f35440720f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:54.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.869+0000 7fb8a89ff700 1 -- start start 2023-07-27T20:31:54.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.870+0000 7fb8a89ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8a4070a90 0x7fb8a414e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.870+0000 7fb8a89ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8a4070e70 0x7fb8a40c4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.870+0000 7fb8a89ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb8a41f6d00 0x7fb8a41eb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.870+0000 7fb8a89ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a40a9220 con 0x7fb8a4070e70 2023-07-27T20:31:54.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.870+0000 7fb8a89ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a41ed0c0 con 0x7fb8a4070a90 2023-07-27T20:31:54.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.870+0000 7fb8a89ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a41f6010 con 0x7fb8a41f6d00 2023-07-27T20:31:54.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.874+0000 7f4e3cd9a700 1 --2- 172.21.15.72:0/3993370495 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4e1c06adb0 0x7f4e1c06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.874+0000 7f4e3dd9c700 1 --2- 172.21.15.72:0/3993370495 >> [v2:172.21.15.72:6819/1712741452,v1:172.21.15.72:6821/1712741452] conn(0x7f4e1c074a90 0x7f4e1c076ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.874+0000 7f354c1ff700 1 -- 172.21.15.72:0/2863712758 shutdown_connections 2023-07-27T20:31:54.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.874+0000 7fcadd9ff700 1 -- start start 2023-07-27T20:31:54.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.874+0000 7f61dffff700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f61e0153e20 0x7f61e0149ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.72:53618/0 (socket says 172.21.15.72:53618) 2023-07-27T20:31:54.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.874+0000 7f61dffff700 1 -- 172.21.15.72:0/2801428364 learned_addr learned my addr 172.21.15.72:0/2801428364 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:54.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.874+0000 7f61deffd700 1 --2- 172.21.15.72:0/2801428364 >> v2:172.21.15.173:3300/0 conn(0x7f61e00c23c0 0x7f61e0150950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.874+0000 7f61df7fe700 1 --2- 172.21.15.72:0/2801428364 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61e00c1fe0 0x7f61e0070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.874+0000 7f61deffd700 1 -- 172.21.15.72:0/2801428364 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61e00c1fe0 msgr2=0x7f61e0070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:54.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.874+0000 7fb8a259c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8a4070a90 0x7fb8a414e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.875+0000 7fb8a259c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8a4070a90 0x7fb8a414e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.72:46894/0 (socket says 172.21.15.72:46894) 2023-07-27T20:31:54.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.875+0000 7fb8a259c700 1 -- 172.21.15.72:0/344091098 learned_addr learned my addr 172.21.15.72:0/344091098 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:54.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.875+0000 7f61deffd700 1 --2- 172.21.15.72:0/2801428364 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61e00c1fe0 0x7f61e0070950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.875+0000 7f61deffd700 1 -- 172.21.15.72:0/2801428364 >> v1:172.21.15.173:6789/0 conn(0x7f61e0153e20 legacy=0x7f61e0149ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.875+0000 7f61deffd700 1 -- 172.21.15.72:0/2801428364 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e00712f0 con 0x7f61e00c23c0 2023-07-27T20:31:54.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.875+0000 7f61df7fe700 1 --2- 172.21.15.72:0/2801428364 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61e00c1fe0 0x7f61e0070950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:31:54.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.875+0000 7fcadd9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcad806ad20 0x7fcad813b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.875+0000 7f4e3cd9a700 1 --2- 172.21.15.72:0/3993370495 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4e1c06adb0 0x7f4e1c06d270 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4e3000b370 tx=0x7f4e30009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:54.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.875+0000 7fcadd9ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcad8153f50 0x7fcad813aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.874+0000 7f38b1f9c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f38ac150950 0x7f38ac0ba450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.874+0000 7f38b0f9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38ac070950 0x7f38ac0a9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.874+0000 7f38b0f9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38ac070950 0x7f38ac0a9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.72:46872/0 (socket says 172.21.15.72:46872) 2023-07-27T20:31:54.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.874+0000 7f38b0f9a700 1 -- 172.21.15.72:0/1068055218 learned_addr learned my addr 172.21.15.72:0/1068055218 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:54.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.875+0000 7f38b0f9a700 1 -- 172.21.15.72:0/1068055218 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f38ac150950 msgr2=0x7f38ac0ba450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.875+0000 7f38b0f9a700 1 --2- 172.21.15.72:0/1068055218 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f38ac150950 0x7f38ac0ba450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.875+0000 7f38b0f9a700 1 -- 172.21.15.72:0/1068055218 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38ac06e420 msgr2=0x7f38ac14f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.875+0000 7f38b0f9a700 1 --2- 172.21.15.72:0/1068055218 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38ac06e420 0x7f38ac14f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.875+0000 7f38b0f9a700 1 -- 172.21.15.72:0/1068055218 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f389c0094a0 con 0x7f38ac070950 2023-07-27T20:31:54.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.875+0000 7fb8a259c700 1 -- 172.21.15.72:0/344091098 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb8a41f6d00 msgr2=0x7fb8a41eb200 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-27T20:31:54.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.875+0000 7fb8a259c700 1 --2- 172.21.15.72:0/344091098 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb8a41f6d00 0x7fb8a41eb200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.875+0000 7fb8a259c700 1 -- 172.21.15.72:0/344091098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8a4070e70 msgr2=0x7fb8a40c4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.875+0000 7fb8a259c700 1 --2- 172.21.15.72:0/344091098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8a4070e70 0x7fb8a40c4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.875+0000 7fb8a259c700 1 -- 172.21.15.72:0/344091098 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb88c009550 con 0x7fb8a4070a90 2023-07-27T20:31:54.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.875+0000 7f61deffd700 1 --2- 172.21.15.72:0/2801428364 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61e00c23c0 0x7f61e0150950 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f61d4010ba0 tx=0x7f61d4010eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=631078af90865f17 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:54.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.876+0000 7fcadd9ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcad813eae0 0x7fcad80aa250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.876+0000 7fcadd9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad80a9dc0 con 0x7fcad806ad20 2023-07-27T20:31:54.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.876+0000 7fcadd9ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad8138e10 con 0x7fcad813eae0 2023-07-27T20:31:54.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.876+0000 7fcadd9ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad81390f0 con 0x7fcad8153f50 2023-07-27T20:31:54.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.876+0000 7fb8a259c700 1 --2- 172.21.15.72:0/344091098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8a4070a90 0x7fb8a414e2a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb89c00a7a0 tx=0x7fb89c00ab60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:54.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.876+0000 7f61de7fc700 1 -- 172.21.15.72:0/2801428364 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d400bc90 con 0x7f61e00c23c0 2023-07-27T20:31:54.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.876+0000 7f61de7fc700 1 -- 172.21.15.72:0/2801428364 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d400bdf0 con 0x7f61e00c23c0 2023-07-27T20:31:54.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.876+0000 7f61de7fc700 1 -- 172.21.15.72:0/2801428364 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d4006d50 con 0x7f61e00c23c0 2023-07-27T20:31:54.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.876+0000 7fcad67fc700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcad8153f50 0x7fcad813aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.876+0000 7fcad67fc700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcad8153f50 0x7fcad813aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.72:47998/0 (socket says 172.21.15.72:47998) 2023-07-27T20:31:54.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.876+0000 7fcad67fc700 1 -- 172.21.15.72:0/406358588 learned_addr learned my addr 172.21.15.72:0/406358588 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:54.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.876+0000 7fcad6ffd700 1 --2- 172.21.15.72:0/406358588 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcad806ad20 0x7fcad813b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.876+0000 7f4e3dd9c700 1 --2- 172.21.15.72:0/3993370495 >> [v2:172.21.15.72:6819/1712741452,v1:172.21.15.72:6821/1712741452] conn(0x7f4e1c074a90 0x7f4e1c076ed0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:54.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.876+0000 7fcad77fe700 1 --2- 172.21.15.72:0/406358588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcad813eae0 0x7fcad80aa250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.876+0000 7f38b0f9a700 1 --2- 172.21.15.72:0/1068055218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38ac070950 0x7f38ac0a9ad0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f38a4001f00 tx=0x7f38a400a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:54.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.874+0000 7f354c1ff700 1 -- 172.21.15.72:0/2863712758 wait complete. 2023-07-27T20:31:54.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.877+0000 7f354c1ff700 1 Processor -- start 2023-07-27T20:31:54.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.877+0000 7fcad6ffd700 1 -- 172.21.15.72:0/406358588 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcad8153f50 msgr2=0x7fcad813aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.877+0000 7fcad6ffd700 1 --2- 172.21.15.72:0/406358588 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcad8153f50 0x7fcad813aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.877+0000 7fcad6ffd700 1 -- 172.21.15.72:0/406358588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcad813eae0 msgr2=0x7fcad80aa250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.877+0000 7fcad6ffd700 1 --2- 172.21.15.72:0/406358588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcad813eae0 0x7fcad80aa250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.877+0000 7fcad6ffd700 1 -- 172.21.15.72:0/406358588 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad0009b30 con 0x7fcad806ad20 2023-07-27T20:31:54.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.877+0000 7fcad6ffd700 1 --2- 172.21.15.72:0/406358588 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcad806ad20 0x7fcad813b760 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcacc000f60 tx=0x7fcacc00c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:54.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.877+0000 7f38a1ffb700 1 -- 172.21.15.72:0/1068055218 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a4003c00 con 0x7f38ac070950 2023-07-27T20:31:54.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.877+0000 7f38a1ffb700 1 -- 172.21.15.72:0/1068055218 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a4003d60 con 0x7f38ac070950 2023-07-27T20:31:54.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.877+0000 7f38a1ffb700 1 -- 172.21.15.72:0/1068055218 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a400ac20 con 0x7f38ac070950 2023-07-27T20:31:54.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.877+0000 7f38b39ff700 1 -- 172.21.15.72:0/1068055218 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38ac1423a0 con 0x7f38ac070950 2023-07-27T20:31:54.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.877+0000 7f61e5fff700 1 -- 172.21.15.72:0/2801428364 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61e00c23c0 msgr2=0x7f61e0150950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.877+0000 7f61e5fff700 1 --2- 172.21.15.72:0/2801428364 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61e00c23c0 0x7f61e0150950 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f61d4010ba0 tx=0x7f61d4010eb0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.877+0000 7f354c1ff700 1 -- start start 2023-07-27T20:31:54.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.878+0000 7f4e2dffb700 1 -- 172.21.15.72:0/3993370495 <== osd.0 v2:172.21.15.72:6819/1712741452 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f4e1c0775a0 con 0x7f4e1c074a90 2023-07-27T20:31:54.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.878+0000 7fcabffff700 1 -- 172.21.15.72:0/406358588 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc0052d0 con 0x7fcad806ad20 2023-07-27T20:31:54.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.878+0000 7fcabffff700 1 -- 172.21.15.72:0/406358588 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcacc005430 con 0x7fcad806ad20 2023-07-27T20:31:54.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.878+0000 7fcabffff700 1 -- 172.21.15.72:0/406358588 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc0038a0 con 0x7fcad806ad20 2023-07-27T20:31:54.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.878+0000 7fcadd9ff700 1 -- 172.21.15.72:0/406358588 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad80a9a50 con 0x7fcad806ad20 2023-07-27T20:31:54.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.878+0000 7fcadd9ff700 1 -- 172.21.15.72:0/406358588 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad813ef90 con 0x7fcad806ad20 2023-07-27T20:31:54.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.878+0000 7f38b39ff700 1 -- 172.21.15.72:0/1068055218 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38ac0aa940 con 0x7f38ac070950 2023-07-27T20:31:54.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.879+0000 7f38b39ff700 1 -- 172.21.15.72:0/1068055218 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f38ac0712f0 con 0x7f38ac070950 2023-07-27T20:31:54.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.878+0000 7fb89affd700 1 -- 172.21.15.72:0/344091098 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c00f040 con 0x7fb8a4070a90 2023-07-27T20:31:54.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.878+0000 7fb89affd700 1 -- 172.21.15.72:0/344091098 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89c013810 con 0x7fb8a4070a90 2023-07-27T20:31:54.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.878+0000 7fb89affd700 1 -- 172.21.15.72:0/344091098 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c013bc0 con 0x7fb8a4070a90 2023-07-27T20:31:54.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.879+0000 7f61e5fff700 1 -- 172.21.15.72:0/2801428364 shutdown_connections 2023-07-27T20:31:54.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.879+0000 7f61e5fff700 1 --2- 172.21.15.72:0/2801428364 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61e00c1fe0 0x7f61e0070950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.879+0000 7f61e5fff700 1 --2- 172.21.15.72:0/2801428364 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61e00c23c0 0x7f61e0150950 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.879+0000 7f61e5fff700 1 -- 172.21.15.72:0/2801428364 >> 172.21.15.72:0/2801428364 conn(0x7f61e006a190 msgr2=0x7f61e006a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:54.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.879+0000 7f61e5fff700 1 -- 172.21.15.72:0/2801428364 shutdown_connections 2023-07-27T20:31:54.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.879+0000 7f1bedffb700 1 -- 172.21.15.72:0/1607347658 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1bf4013b00 con 0x7f1bf8146f20 2023-07-27T20:31:54.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.880+0000 7f1bedffb700 1 --2- 172.21.15.72:0/1607347658 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1bdc06adb0 0x7f1bdc06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.880+0000 7f1bedffb700 1 -- 172.21.15.72:0/1607347658 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1bf4089a00 con 0x7f1bf8146f20 2023-07-27T20:31:54.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.880+0000 7f1bedffb700 1 --2- 172.21.15.72:0/1607347658 >> [v2:172.21.15.72:6800/3619214830,v1:172.21.15.72:6801/3619214830] conn(0x7f1bdc074a90 0x7f1bdc076ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.881+0000 7f1bedffb700 1 -- 172.21.15.72:0/1607347658 --> [v2:172.21.15.72:6800/3619214830,v1:172.21.15.72:6801/3619214830] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1bdc0775a0 con 0x7f1bdc074a90 2023-07-27T20:31:54.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.881+0000 7f1bedffb700 1 -- 172.21.15.72:0/1607347658 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1bf4089db0 con 0x7f1bf8146f20 2023-07-27T20:31:54.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.882+0000 7f1bfd39b700 1 --2- 172.21.15.72:0/1607347658 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1bdc06adb0 0x7f1bdc06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.883+0000 7f1bfd39b700 1 --2- 172.21.15.72:0/1607347658 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1bdc06adb0 0x7f1bdc06d270 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1bf000f600 tx=0x7f1bf000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:54.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.884+0000 7f1bfcb9a700 1 --2- 172.21.15.72:0/1607347658 >> [v2:172.21.15.72:6800/3619214830,v1:172.21.15.72:6801/3619214830] conn(0x7f1bdc074a90 0x7f1bdc076ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.883+0000 7fcabffff700 1 -- 172.21.15.72:0/406358588 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcacc003a00 con 0x7fcad806ad20 2023-07-27T20:31:54.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.884+0000 7f38a1ffb700 1 -- 172.21.15.72:0/1068055218 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f38a40050d0 con 0x7f38ac070950 2023-07-27T20:31:54.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.881+0000 7fb8a89ff700 1 -- 172.21.15.72:0/344091098 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a41428c0 con 0x7fb8a4070a90 2023-07-27T20:31:54.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.881+0000 7fb8a89ff700 1 -- 172.21.15.72:0/344091098 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a41f6220 con 0x7fb8a4070a90 2023-07-27T20:31:54.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.882+0000 7fb8a89ff700 1 -- 172.21.15.72:0/344091098 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb8a40c0b60 con 0x7fb8a4070a90 2023-07-27T20:31:54.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.881+0000 7f354c1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35440c7830 0x7f35441f6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.881+0000 7f354c1ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f35440ca370 0x7f3544150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.881+0000 7f354c1ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3544155c50 0x7f35441fa100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.881+0000 7f354c1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35441f9c70 con 0x7f35440c7830 2023-07-27T20:31:54.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.881+0000 7f354c1ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3544154710 con 0x7f3544155c50 2023-07-27T20:31:54.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.881+0000 7f354c1ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35440c2400 con 0x7f35440ca370 2023-07-27T20:31:54.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.882+0000 7f354979a700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f35440ca370 0x7f3544150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.882+0000 7f354979a700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f35440ca370 0x7f3544150f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.72:48004/0 (socket says 172.21.15.72:48004) 2023-07-27T20:31:54.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.882+0000 7f354979a700 1 -- 172.21.15.72:0/3969703806 learned_addr learned my addr 172.21.15.72:0/3969703806 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:54.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.882+0000 7f354a79c700 1 --2- 172.21.15.72:0/3969703806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3544155c50 0x7f35441fa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.882+0000 7f3549f9b700 1 --2- 172.21.15.72:0/3969703806 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35440c7830 0x7f35441f6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.883+0000 7f354979a700 1 -- 172.21.15.72:0/3969703806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3544155c50 msgr2=0x7f35441fa100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.883+0000 7f354979a700 1 --2- 172.21.15.72:0/3969703806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3544155c50 0x7f35441fa100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.883+0000 7f354979a700 1 -- 172.21.15.72:0/3969703806 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35440c7830 msgr2=0x7f35441f6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.883+0000 7f354979a700 1 --2- 172.21.15.72:0/3969703806 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35440c7830 0x7f35441f6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.883+0000 7f354979a700 1 -- 172.21.15.72:0/3969703806 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3538009550 con 0x7f35440ca370 2023-07-27T20:31:54.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.883+0000 7f354979a700 1 --2- 172.21.15.72:0/3969703806 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f35440ca370 0x7f3544150f90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f354000c540 tx=0x7f354000c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:54.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.883+0000 7f35367fc700 1 -- 172.21.15.72:0/3969703806 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3540004c80 con 0x7f35440ca370 2023-07-27T20:31:54.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.883+0000 7f35367fc700 1 -- 172.21.15.72:0/3969703806 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3540004de0 con 0x7f35440ca370 2023-07-27T20:31:54.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.883+0000 7f35367fc700 1 -- 172.21.15.72:0/3969703806 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3540007310 con 0x7f35440ca370 2023-07-27T20:31:54.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.884+0000 7f354c1ff700 1 -- 172.21.15.72:0/3969703806 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35440c26e0 con 0x7f35440ca370 2023-07-27T20:31:54.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.884+0000 7f354c1ff700 1 -- 172.21.15.72:0/3969703806 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35441f9900 con 0x7f35440ca370 2023-07-27T20:31:54.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.879+0000 7f61e5fff700 1 -- 172.21.15.72:0/2801428364 wait complete. 2023-07-27T20:31:54.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.882+0000 7f61e5fff700 1 Processor -- start 2023-07-27T20:31:54.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.882+0000 7f61e5fff700 1 -- start start 2023-07-27T20:31:54.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.885+0000 7f1bfcb9a700 1 --2- 172.21.15.72:0/1607347658 >> [v2:172.21.15.72:6800/3619214830,v1:172.21.15.72:6801/3619214830] conn(0x7f1bdc074a90 0x7f1bdc076ed0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:54.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.884+0000 7f61e5fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61e00c1fe0 0x7f61e00c3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.885+0000 7f61df7fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61e00c1fe0 0x7f61e00c3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.885+0000 7f61e5fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61e00c23c0 0x7f61e014f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.885+0000 7f61e5fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61e0153e20 0x7f61e01f9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.885+0000 7f61e5fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e00bb5c0 con 0x7f61e00c23c0 2023-07-27T20:31:54.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.885+0000 7f61e5fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e014e560 con 0x7f61e00c1fe0 2023-07-27T20:31:54.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.885+0000 7f61e5fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e00c4660 con 0x7f61e0153e20 2023-07-27T20:31:54.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.885+0000 7f61df7fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61e00c1fe0 0x7f61e00c3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.72:46924/0 (socket says 172.21.15.72:46924) 2023-07-27T20:31:54.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.885+0000 7f61df7fe700 1 -- 172.21.15.72:0/2785903850 learned_addr learned my addr 172.21.15.72:0/2785903850 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:54.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.885+0000 7fcadd9ff700 1 -- 172.21.15.72:0/406358588 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcab8000fc0 con 0x7fcad806ad20 2023-07-27T20:31:54.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.885+0000 7f38a1ffb700 1 --2- 172.21.15.72:0/1068055218 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f389006adb0 0x7f389006d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.885+0000 7f38a1ffb700 1 -- 172.21.15.72:0/1068055218 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f38a40896d0 con 0x7f38ac070950 2023-07-27T20:31:54.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.886+0000 7f38a1ffb700 1 --2- 172.21.15.72:0/1068055218 >> [v2:172.21.15.72:6816/2537282190,v1:172.21.15.72:6817/2537282190] conn(0x7f3890074a90 0x7f3890076ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.886+0000 7f38a1ffb700 1 -- 172.21.15.72:0/1068055218 --> [v2:172.21.15.72:6816/2537282190,v1:172.21.15.72:6817/2537282190] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f38900775a0 con 0x7f3890074a90 2023-07-27T20:31:54.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.886+0000 7f38a1ffb700 1 -- 172.21.15.72:0/1068055218 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38a408bcf0 con 0x7f38ac070950 2023-07-27T20:31:54.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.886+0000 7f38b179b700 1 --2- 172.21.15.72:0/1068055218 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f389006adb0 0x7f389006d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.886+0000 7fcabffff700 1 --2- 172.21.15.72:0/406358588 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcac406adb0 0x7fcac406d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.886+0000 7f61dffff700 1 --2- 172.21.15.72:0/2785903850 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61e0153e20 0x7f61e01f9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.886+0000 7fcabffff700 1 -- 172.21.15.72:0/406358588 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcacc088a30 con 0x7fcad806ad20 2023-07-27T20:31:54.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.885+0000 7fb89affd700 1 -- 172.21.15.72:0/344091098 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb89c013d20 con 0x7fb8a4070a90 2023-07-27T20:31:54.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.886+0000 7fb89affd700 1 --2- 172.21.15.72:0/344091098 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb88406ad30 0x7fb88406d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.886+0000 7fb89affd700 1 -- 172.21.15.72:0/344091098 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb89c0894e0 con 0x7fb8a4070a90 2023-07-27T20:31:54.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.887+0000 7fcabffff700 1 --2- 172.21.15.72:0/406358588 >> [v2:172.21.15.72:6805/2307669444,v1:172.21.15.72:6807/2307669444] conn(0x7fcac4074a10 0x7fcac4076e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.887+0000 7fcabffff700 1 -- 172.21.15.72:0/406358588 --> [v2:172.21.15.72:6805/2307669444,v1:172.21.15.72:6807/2307669444] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcac4077520 con 0x7fcac4074a10 2023-07-27T20:31:54.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.887+0000 7fb89affd700 1 --2- 172.21.15.72:0/344091098 >> [v2:172.21.15.173:6806/3445931157,v1:172.21.15.173:6808/3445931157] conn(0x7fb884074a10 0x7fb884076e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.887+0000 7fb89affd700 1 -- 172.21.15.72:0/344091098 --> [v2:172.21.15.173:6806/3445931157,v1:172.21.15.173:6808/3445931157] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb884077520 con 0x7fb884074a10 2023-07-27T20:31:54.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.887+0000 7fb89affd700 1 -- 172.21.15.72:0/344091098 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb89c089850 con 0x7fb8a4070a90 2023-07-27T20:31:54.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.887+0000 7fcad67fc700 1 --2- 172.21.15.72:0/406358588 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcac406adb0 0x7fcac406d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.887+0000 7f1bedffb700 1 -- 172.21.15.72:0/1607347658 <== osd.1 v2:172.21.15.72:6800/3619214830 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f1bdc0775a0 con 0x7f1bdc074a90 2023-07-27T20:31:54.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.887+0000 7f61df7fe700 1 -- 172.21.15.72:0/2785903850 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61e0153e20 msgr2=0x7f61e01f9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.887+0000 7f61df7fe700 1 --2- 172.21.15.72:0/2785903850 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61e0153e20 0x7f61e01f9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.887+0000 7f61df7fe700 1 -- 172.21.15.72:0/2785903850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61e00c23c0 msgr2=0x7f61e014f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.887+0000 7f61df7fe700 1 --2- 172.21.15.72:0/2785903850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61e00c23c0 0x7f61e014f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.887+0000 7f61df7fe700 1 -- 172.21.15.72:0/2785903850 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d4010800 con 0x7f61e00c1fe0 2023-07-27T20:31:54.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.887+0000 7fb8a1d9b700 1 --2- 172.21.15.72:0/344091098 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb88406ad30 0x7fb88406d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.887+0000 7f38b1f9c700 1 --2- 172.21.15.72:0/1068055218 >> [v2:172.21.15.72:6816/2537282190,v1:172.21.15.72:6817/2537282190] conn(0x7f3890074a90 0x7f3890076ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.888+0000 7f38b179b700 1 --2- 172.21.15.72:0/1068055218 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f389006adb0 0x7f389006d270 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f38a8000c00 tx=0x7f38a8007990 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:54.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.888+0000 7fcad77fe700 1 --2- 172.21.15.72:0/406358588 >> [v2:172.21.15.72:6805/2307669444,v1:172.21.15.72:6807/2307669444] conn(0x7fcac4074a10 0x7fcac4076e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.888+0000 7fcad67fc700 1 --2- 172.21.15.72:0/406358588 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcac406adb0 0x7fcac406d270 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcac8009ca0 tx=0x7fcac8009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:54.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.888+0000 7fb8a2d9d700 1 --2- 172.21.15.72:0/344091098 >> [v2:172.21.15.173:6806/3445931157,v1:172.21.15.173:6808/3445931157] conn(0x7fb884074a10 0x7fb884076e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.885+0000 7f354c1ff700 1 -- 172.21.15.72:0/3969703806 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f35440c48d0 con 0x7f35440ca370 2023-07-27T20:31:54.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.888+0000 7fcabffff700 1 -- 172.21.15.72:0/406358588 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcacc053860 con 0x7fcad806ad20 2023-07-27T20:31:54.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.888+0000 7f61df7fe700 1 --2- 172.21.15.72:0/2785903850 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61e00c1fe0 0x7f61e00c3c60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f61d000cf90 tx=0x7f61d000a3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:54.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.889+0000 7fcad77fe700 1 --2- 172.21.15.72:0/406358588 >> [v2:172.21.15.72:6805/2307669444,v1:172.21.15.72:6807/2307669444] conn(0x7fcac4074a10 0x7fcac4076e50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:54.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.890+0000 7fcabffff700 1 -- 172.21.15.72:0/406358588 <== osd.2 v2:172.21.15.72:6805/2307669444 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fcac4077520 con 0x7fcac4074a10 2023-07-27T20:31:54.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.889+0000 7f61c7fff700 1 -- 172.21.15.72:0/2785903850 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d0015440 con 0x7f61e00c1fe0 2023-07-27T20:31:54.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.889+0000 7f61c7fff700 1 -- 172.21.15.72:0/2785903850 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d00155a0 con 0x7f61e00c1fe0 2023-07-27T20:31:54.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.889+0000 7f61c7fff700 1 -- 172.21.15.72:0/2785903850 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d0015930 con 0x7f61e00c1fe0 2023-07-27T20:31:54.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.889+0000 7f61e5fff700 1 -- 172.21.15.72:0/2785903850 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61e01543c0 con 0x7f61e00c1fe0 2023-07-27T20:31:54.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.889+0000 7f61e5fff700 1 -- 172.21.15.72:0/2785903850 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e014df10 con 0x7f61e00c1fe0 2023-07-27T20:31:54.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.890+0000 7f61e5fff700 1 -- 172.21.15.72:0/2785903850 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f61e0154240 con 0x7f61e00c1fe0 2023-07-27T20:31:54.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.891+0000 7f38b1f9c700 1 --2- 172.21.15.72:0/1068055218 >> [v2:172.21.15.72:6816/2537282190,v1:172.21.15.72:6817/2537282190] conn(0x7f3890074a90 0x7f3890076ed0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:54.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.891+0000 7fb8a1d9b700 1 --2- 172.21.15.72:0/344091098 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb88406ad30 0x7fb88406d1f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb8a41ec2e0 tx=0x7fb894003eb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:54.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.891+0000 7fe95599d700 1 Processor -- start 2023-07-27T20:31:54.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.892+0000 7f35367fc700 1 -- 172.21.15.72:0/3969703806 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3540007470 con 0x7f35440ca370 2023-07-27T20:31:54.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.892+0000 7fe95599d700 1 -- start start 2023-07-27T20:31:54.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.892+0000 7fb8a2d9d700 1 --2- 172.21.15.72:0/344091098 >> [v2:172.21.15.173:6806/3445931157,v1:172.21.15.173:6808/3445931157] conn(0x7fb884074a10 0x7fb884076e50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:54.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.893+0000 7f38a1ffb700 1 -- 172.21.15.72:0/1068055218 <== osd.3 v2:172.21.15.72:6816/2537282190 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f38900775a0 con 0x7f3890074a90 2023-07-27T20:31:54.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.893+0000 7f35367fc700 1 --2- 172.21.15.72:0/3969703806 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f352806adb0 0x7f352806d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.893+0000 7f35367fc700 1 -- 172.21.15.72:0/3969703806 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f35400898b0 con 0x7f35440ca370 2023-07-27T20:31:54.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.894+0000 7f35367fc700 1 --2- 172.21.15.72:0/3969703806 >> [v2:172.21.15.173:6800/1077261990,v1:172.21.15.173:6801/1077261990] conn(0x7f3528074a90 0x7f3528076ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.894+0000 7f35367fc700 1 -- 172.21.15.72:0/3969703806 --> [v2:172.21.15.173:6800/1077261990,v1:172.21.15.173:6801/1077261990] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f35280775a0 con 0x7f3528074a90 2023-07-27T20:31:54.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.894+0000 7f35367fc700 1 -- 172.21.15.72:0/3969703806 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3540089c60 con 0x7f35440ca370 2023-07-27T20:31:54.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.894+0000 7fe95599d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe950151620 0x7fe9500c4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.894+0000 7fe95599d700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe9500c45c0 0x7fe9501546a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.894+0000 7fe95599d700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe950157e20 con 0x7fe9500c7600 2023-07-27T20:31:54.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.894+0000 7fe95599d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe950158350 con 0x7fe950151620 2023-07-27T20:31:54.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.894+0000 7fe95599d700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe950158070 con 0x7fe9500c45c0 2023-07-27T20:31:54.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.894+0000 7f354a79c700 1 --2- 172.21.15.72:0/3969703806 >> [v2:172.21.15.173:6800/1077261990,v1:172.21.15.173:6801/1077261990] conn(0x7f3528074a90 0x7f3528076ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.894+0000 7f3549f9b700 1 --2- 172.21.15.72:0/3969703806 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f352806adb0 0x7f352806d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.895+0000 7fe95519c700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe9500c45c0 0x7fe9501546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.895+0000 7fe95519c700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe9500c45c0 0x7fe9501546a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.72:46932/0 (socket says 172.21.15.72:46932) 2023-07-27T20:31:54.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.895+0000 7fe95519c700 1 -- 172.21.15.72:0/2856664020 learned_addr learned my addr 172.21.15.72:0/2856664020 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:54.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.895+0000 7f354a79c700 1 --2- 172.21.15.72:0/3969703806 >> [v2:172.21.15.173:6800/1077261990,v1:172.21.15.173:6801/1077261990] conn(0x7f3528074a90 0x7f3528076ed0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:54.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.895+0000 7f3549f9b700 1 --2- 172.21.15.72:0/3969703806 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f352806adb0 0x7f352806d270 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3538014040 tx=0x7f3538008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:54.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.895+0000 7fe95519c700 1 -- 172.21.15.72:0/2856664020 >> v2:172.21.15.72:3300/0 conn(0x7fe950151620 msgr2=0x7fe9500c4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:54.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.895+0000 7fe95519c700 1 --2- 172.21.15.72:0/2856664020 >> v2:172.21.15.72:3300/0 conn(0x7fe950151620 0x7fe9500c4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.895+0000 7fe95519c700 1 -- 172.21.15.72:0/2856664020 >> v1:172.21.15.173:6789/0 conn(0x7fe9500c7600 legacy=0x7fe950153f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:54.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.895+0000 7fe95519c700 1 -- 172.21.15.72:0/2856664020 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9500c6240 con 0x7fe9500c45c0 2023-07-27T20:31:54.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.896+0000 7fe95519c700 1 --2- 172.21.15.72:0/2856664020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9500c45c0 0x7fe9501546a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe9500a9130 tx=0x7fe94800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=373bd9fd97da77bb server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:54.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.896+0000 7fe94f7fe700 1 -- 172.21.15.72:0/2856664020 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94800e070 con 0x7fe9500c45c0 2023-07-27T20:31:54.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.896+0000 7fe94f7fe700 1 -- 172.21.15.72:0/2856664020 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe948003a20 con 0x7fe9500c45c0 2023-07-27T20:31:54.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.896+0000 7f35367fc700 1 -- 172.21.15.72:0/3969703806 <== osd.5 v2:172.21.15.173:6800/1077261990 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f35280775a0 con 0x7f3528074a90 2023-07-27T20:31:54.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.897+0000 7fb89affd700 1 -- 172.21.15.72:0/344091098 <== osd.4 v2:172.21.15.173:6806/3445931157 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fb884077520 con 0x7fb884074a10 2023-07-27T20:31:54.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.896+0000 7f61c7fff700 1 -- 172.21.15.72:0/2785903850 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f61d0015a90 con 0x7f61e00c1fe0 2023-07-27T20:31:54.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.898+0000 7f61c7fff700 1 --2- 172.21.15.72:0/2785903850 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f61cc06adb0 0x7f61cc06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.898+0000 7f61c7fff700 1 -- 172.21.15.72:0/2785903850 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f61d008a7c0 con 0x7f61e00c1fe0 2023-07-27T20:31:54.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.898+0000 7f61c7fff700 1 --2- 172.21.15.72:0/2785903850 >> [v2:172.21.15.173:6816/898998598,v1:172.21.15.173:6817/898998598] conn(0x7f61cc074a90 0x7f61cc076ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.898+0000 7f61c7fff700 1 -- 172.21.15.72:0/2785903850 --> [v2:172.21.15.173:6816/898998598,v1:172.21.15.173:6817/898998598] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f61cc0775a0 con 0x7f61cc074a90 2023-07-27T20:31:54.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.898+0000 7f61c7fff700 1 -- 172.21.15.72:0/2785903850 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61d008ab70 con 0x7f61e00c1fe0 2023-07-27T20:31:54.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.899+0000 7f61dffff700 1 --2- 172.21.15.72:0/2785903850 >> [v2:172.21.15.173:6816/898998598,v1:172.21.15.173:6817/898998598] conn(0x7f61cc074a90 0x7f61cc076ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.899+0000 7fe94f7fe700 1 -- 172.21.15.72:0/2856664020 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe948003dd0 con 0x7fe9500c45c0 2023-07-27T20:31:54.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.900+0000 7fe95599d700 1 -- 172.21.15.72:0/2856664020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9500c45c0 msgr2=0x7fe9501546a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.900+0000 7fe95599d700 1 --2- 172.21.15.72:0/2856664020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9500c45c0 0x7fe9501546a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe9500a9130 tx=0x7fe94800b330 comp rx=0 tx=0).stop 2023-07-27T20:31:54.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.901+0000 7fe95599d700 1 -- 172.21.15.72:0/2856664020 shutdown_connections 2023-07-27T20:31:54.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.901+0000 7fe95599d700 1 --2- 172.21.15.72:0/2856664020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9500c45c0 0x7fe9501546a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.901+0000 7fe95599d700 1 --2- 172.21.15.72:0/2856664020 >> v2:172.21.15.72:3300/0 conn(0x7fe950151620 0x7fe9500c4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.901+0000 7fe95599d700 1 -- 172.21.15.72:0/2856664020 >> 172.21.15.72:0/2856664020 conn(0x7fe9500ab230 msgr2=0x7fe9500ab610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:54.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.904+0000 7f61deffd700 1 --2- 172.21.15.72:0/2785903850 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f61cc06adb0 0x7f61cc06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.904+0000 7fe95599d700 1 -- 172.21.15.72:0/2856664020 shutdown_connections 2023-07-27T20:31:54.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.905+0000 7f61dffff700 1 --2- 172.21.15.72:0/2785903850 >> [v2:172.21.15.173:6816/898998598,v1:172.21.15.173:6817/898998598] conn(0x7f61cc074a90 0x7f61cc076ed0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:54.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.905+0000 7f61deffd700 1 --2- 172.21.15.72:0/2785903850 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f61cc06adb0 0x7f61cc06d270 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f61e00c27e0 tx=0x7f61d4013000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:54.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.904+0000 7fe95599d700 1 -- 172.21.15.72:0/2856664020 wait complete. 2023-07-27T20:31:54.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.907+0000 7f4e3f7ff700 1 -- 172.21.15.72:0/3993370495 --> [v2:172.21.15.72:6819/1712741452,v1:172.21.15.72:6821/1712741452] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4e38158e20 con 0x7f4e1c074a90 2023-07-27T20:31:54.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.907+0000 7fe95599d700 1 Processor -- start 2023-07-27T20:31:54.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.908+0000 7f61c7fff700 1 -- 172.21.15.72:0/2785903850 <== osd.6 v2:172.21.15.173:6816/898998598 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f61cc0775a0 con 0x7f61cc074a90 2023-07-27T20:31:54.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.908+0000 7f4e2dffb700 1 -- 172.21.15.72:0/3993370495 <== osd.0 v2:172.21.15.72:6819/1712741452 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4e28003a10 con 0x7f4e1c074a90 2023-07-27T20:31:54.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.908+0000 7fe95599d700 1 -- start start 2023-07-27T20:31:54.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.908+0000 7f4e3f7ff700 1 -- 172.21.15.72:0/3993370495 >> [v2:172.21.15.72:6819/1712741452,v1:172.21.15.72:6821/1712741452] conn(0x7f4e1c074a90 msgr2=0x7f4e1c076ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.908+0000 7f4e3f7ff700 1 --2- 172.21.15.72:0/3993370495 >> [v2:172.21.15.72:6819/1712741452,v1:172.21.15.72:6821/1712741452] conn(0x7f4e1c074a90 0x7f4e1c076ed0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.909+0000 7f4e3f7ff700 1 -- 172.21.15.72:0/3993370495 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4e1c06adb0 msgr2=0x7f4e1c06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.909+0000 7f4e3f7ff700 1 --2- 172.21.15.72:0/3993370495 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4e1c06adb0 0x7f4e1c06d270 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4e3000b370 tx=0x7f4e30009000 comp rx=0 tx=0).stop 2023-07-27T20:31:54.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.909+0000 7f4e3f7ff700 1 -- 172.21.15.72:0/3993370495 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e380c1750 msgr2=0x7f4e380c4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.909+0000 7f4e3f7ff700 1 --2- 172.21.15.72:0/3993370495 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e380c1750 0x7f4e380c4840 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4e3401f580 tx=0x7f4e3401f940 comp rx=0 tx=0).stop 2023-07-27T20:31:54.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.909+0000 7f4e3dd9c700 1 -- 172.21.15.72:0/3993370495 reap_dead start 2023-07-27T20:31:54.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.909+0000 7f4e3f7ff700 1 -- 172.21.15.72:0/3993370495 shutdown_connections 2023-07-27T20:31:54.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.909+0000 7f4e3f7ff700 1 -- 172.21.15.72:0/3993370495 >> 172.21.15.72:0/3993370495 conn(0x7f4e3806a190 msgr2=0x7f4e38153870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:54.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.909+0000 7fe95599d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9500c45c0 0x7fe95014cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.909+0000 7fe95599d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9500c7600 0x7fe950155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.909+0000 7fe95599d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe950151620 0x7fe950156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.909+0000 7fe95599d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe950155940 con 0x7fe9500c7600 2023-07-27T20:31:54.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.909+0000 7fe95599d700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9500c35c0 con 0x7fe9500c45c0 2023-07-27T20:31:54.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.909+0000 7fe95599d700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9500c9ea0 con 0x7fe950151620 2023-07-27T20:31:54.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.910+0000 7fe94ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9500c7600 0x7fe950155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.910+0000 7fe94ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9500c7600 0x7fe950155dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58520/0 (socket says 172.21.15.72:58520) 2023-07-27T20:31:54.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.910+0000 7fe94ffff700 1 -- 172.21.15.72:0/340662121 learned_addr learned my addr 172.21.15.72:0/340662121 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:54.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.910+0000 7fe95519c700 1 --2- 172.21.15.72:0/340662121 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe950151620 0x7fe950156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.910+0000 7f4e3f7ff700 1 -- 172.21.15.72:0/3993370495 shutdown_connections 2023-07-27T20:31:54.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.910+0000 7f4e3f7ff700 1 -- 172.21.15.72:0/3993370495 wait complete. 2023-07-27T20:31:54.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.911+0000 7fe94ffff700 1 -- 172.21.15.72:0/340662121 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe950151620 msgr2=0x7fe950156310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.911+0000 7fe94ffff700 1 --2- 172.21.15.72:0/340662121 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe950151620 0x7fe950156310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.911+0000 7fe94ffff700 1 -- 172.21.15.72:0/340662121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9500c45c0 msgr2=0x7fe95014cb40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-27T20:31:54.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.911+0000 7fe94ffff700 1 --2- 172.21.15.72:0/340662121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9500c45c0 0x7fe95014cb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.911+0000 7fe94ffff700 1 -- 172.21.15.72:0/340662121 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe948009b30 con 0x7fe9500c7600 2023-07-27T20:31:54.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.911+0000 7fe94ffff700 1 --2- 172.21.15.72:0/340662121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9500c7600 0x7fe950155dd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe94400b470 tx=0x7fe94400b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:54.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.911+0000 7fe94d7fa700 1 -- 172.21.15.72:0/340662121 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe944011830 con 0x7fe9500c7600 2023-07-27T20:31:54.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.911+0000 7fe94d7fa700 1 -- 172.21.15.72:0/340662121 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe944011990 con 0x7fe9500c7600 2023-07-27T20:31:54.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.911+0000 7fe94d7fa700 1 -- 172.21.15.72:0/340662121 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe944011d40 con 0x7fe9500c7600 2023-07-27T20:31:54.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.911+0000 7fe95599d700 1 -- 172.21.15.72:0/340662121 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe95014b340 con 0x7fe9500c7600 2023-07-27T20:31:54.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.912+0000 7fe95599d700 1 -- 172.21.15.72:0/340662121 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9500bdbf0 con 0x7fe9500c7600 2023-07-27T20:31:54.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.914+0000 7f1bff5ff700 1 -- 172.21.15.72:0/1607347658 --> [v2:172.21.15.72:6800/3619214830,v1:172.21.15.72:6801/3619214830] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1bf80c18a0 con 0x7f1bdc074a90 2023-07-27T20:31:54.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.914+0000 7fe94d7fa700 1 -- 172.21.15.72:0/340662121 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe94401a400 con 0x7fe9500c7600 2023-07-27T20:31:54.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.915+0000 7fe95599d700 1 -- 172.21.15.72:0/340662121 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe9500c6800 con 0x7fe9500c7600 2023-07-27T20:31:54.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.915+0000 7fe94d7fa700 1 --2- 172.21.15.72:0/340662121 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe93c06ad30 0x7fe93c06d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.916+0000 7f1bedffb700 1 -- 172.21.15.72:0/1607347658 <== osd.1 v2:172.21.15.72:6800/3619214830 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1be8009950 con 0x7f1bdc074a90 2023-07-27T20:31:54.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.915+0000 7fe94d7fa700 1 -- 172.21.15.72:0/340662121 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe9440889e0 con 0x7fe9500c7600 2023-07-27T20:31:54.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.916+0000 7fe94d7fa700 1 --2- 172.21.15.72:0/340662121 >> [v2:172.21.15.173:6824/3471340321,v1:172.21.15.173:6825/3471340321] conn(0x7fe93c074990 0x7fe93c076dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:54.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.916+0000 7fe94d7fa700 1 -- 172.21.15.72:0/340662121 --> [v2:172.21.15.173:6824/3471340321,v1:172.21.15.173:6825/3471340321] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe93c0774a0 con 0x7fe93c074990 2023-07-27T20:31:54.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.916+0000 7fe95519c700 1 --2- 172.21.15.72:0/340662121 >> [v2:172.21.15.173:6824/3471340321,v1:172.21.15.173:6825/3471340321] conn(0x7fe93c074990 0x7fe93c076dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.916+0000 7fe94d7fa700 1 -- 172.21.15.72:0/340662121 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe944011ea0 con 0x7fe9500c7600 2023-07-27T20:31:54.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.919+0000 7fb8a89ff700 1 -- 172.21.15.72:0/344091098 --> [v2:172.21.15.173:6806/3445931157,v1:172.21.15.173:6808/3445931157] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb8a40c2820 con 0x7fb884074a10 2023-07-27T20:31:54.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.919+0000 7fe95519c700 1 --2- 172.21.15.72:0/340662121 >> [v2:172.21.15.173:6824/3471340321,v1:172.21.15.173:6825/3471340321] conn(0x7fe93c074990 0x7fe93c076dd0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:54.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.920+0000 7fe95499b700 1 --2- 172.21.15.72:0/340662121 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe93c06ad30 0x7fe93c06d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:54.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.920+0000 7fe95499b700 1 --2- 172.21.15.72:0/340662121 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe93c06ad30 0x7fe93c06d1f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe940009730 tx=0x7fe940006ca0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:54.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.921+0000 7fe94d7fa700 1 -- 172.21.15.72:0/340662121 <== osd.7 v2:172.21.15.173:6824/3471340321 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fe93c0774a0 con 0x7fe93c074990 2023-07-27T20:31:54.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.926+0000 7fb89affd700 1 -- 172.21.15.72:0/344091098 <== osd.4 v2:172.21.15.173:6806/3445931157 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb88c020040 con 0x7fb884074a10 2023-07-27T20:31:54.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.926+0000 7fb8a89ff700 1 -- 172.21.15.72:0/344091098 >> [v2:172.21.15.173:6806/3445931157,v1:172.21.15.173:6808/3445931157] conn(0x7fb884074a10 msgr2=0x7fb884076e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.926+0000 7fb8a89ff700 1 --2- 172.21.15.72:0/344091098 >> [v2:172.21.15.173:6806/3445931157,v1:172.21.15.173:6808/3445931157] conn(0x7fb884074a10 0x7fb884076e50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.927+0000 7f1bff5ff700 1 -- 172.21.15.72:0/1607347658 >> [v2:172.21.15.72:6800/3619214830,v1:172.21.15.72:6801/3619214830] conn(0x7f1bdc074a90 msgr2=0x7f1bdc076ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.927+0000 7f1bff5ff700 1 --2- 172.21.15.72:0/1607347658 >> [v2:172.21.15.72:6800/3619214830,v1:172.21.15.72:6801/3619214830] conn(0x7f1bdc074a90 0x7f1bdc076ed0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.927+0000 7fb8a89ff700 1 -- 172.21.15.72:0/344091098 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb88406ad30 msgr2=0x7fb88406d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.927+0000 7fb8a89ff700 1 --2- 172.21.15.72:0/344091098 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb88406ad30 0x7fb88406d1f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb8a41ec2e0 tx=0x7fb894003eb0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.927+0000 7fb8a89ff700 1 -- 172.21.15.72:0/344091098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8a4070a90 msgr2=0x7fb8a414e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.927+0000 7fb8a89ff700 1 --2- 172.21.15.72:0/344091098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8a4070a90 0x7fb8a414e2a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb89c00a7a0 tx=0x7fb89c00ab60 comp rx=0 tx=0).stop 2023-07-27T20:31:54.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.927+0000 7f1bff5ff700 1 -- 172.21.15.72:0/1607347658 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1bdc06adb0 msgr2=0x7f1bdc06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.927+0000 7f1bff5ff700 1 --2- 172.21.15.72:0/1607347658 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1bdc06adb0 0x7f1bdc06d270 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1bf000f600 tx=0x7f1bf000b040 comp rx=0 tx=0).stop 2023-07-27T20:31:54.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.927+0000 7f1bff5ff700 1 -- 172.21.15.72:0/1607347658 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bf8146f20 msgr2=0x7f1bf813fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.927+0000 7f1bff5ff700 1 --2- 172.21.15.72:0/1607347658 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bf8146f20 0x7f1bf813fd40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1bf400e7e0 tx=0x7f1bf400eaf0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.927+0000 7fb8a2d9d700 1 -- 172.21.15.72:0/344091098 reap_dead start 2023-07-27T20:31:54.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.928+0000 7fb8a89ff700 1 -- 172.21.15.72:0/344091098 shutdown_connections 2023-07-27T20:31:54.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.928+0000 7fb8a89ff700 1 -- 172.21.15.72:0/344091098 >> 172.21.15.72:0/344091098 conn(0x7fb8a406a190 msgr2=0x7fb8a406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:54.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.928+0000 7f1bfdb9c700 1 -- 172.21.15.72:0/1607347658 reap_dead start 2023-07-27T20:31:54.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.928+0000 7f1bff5ff700 1 -- 172.21.15.72:0/1607347658 shutdown_connections 2023-07-27T20:31:54.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.928+0000 7f1bff5ff700 1 -- 172.21.15.72:0/1607347658 >> 172.21.15.72:0/1607347658 conn(0x7f1bf806a190 msgr2=0x7f1bf8152910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:54.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.928+0000 7fb8a89ff700 1 -- 172.21.15.72:0/344091098 shutdown_connections 2023-07-27T20:31:54.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.928+0000 7fb8a89ff700 1 -- 172.21.15.72:0/344091098 wait complete. 2023-07-27T20:31:54.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.929+0000 7f1bff5ff700 1 -- 172.21.15.72:0/1607347658 shutdown_connections 2023-07-27T20:31:54.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.929+0000 7f1bff5ff700 1 -- 172.21.15.72:0/1607347658 wait complete. 2023-07-27T20:31:54.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.931+0000 7fcadd9ff700 1 -- 172.21.15.72:0/406358588 --> [v2:172.21.15.72:6805/2307669444,v1:172.21.15.72:6807/2307669444] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcab8002d40 con 0x7fcac4074a10 2023-07-27T20:31:54.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.933+0000 7fcabffff700 1 -- 172.21.15.72:0/406358588 <== osd.2 v2:172.21.15.72:6805/2307669444 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcab8002d40 con 0x7fcac4074a10 2023-07-27T20:31:54.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.932+0000 7f38b39ff700 1 -- 172.21.15.72:0/1068055218 --> [v2:172.21.15.72:6816/2537282190,v1:172.21.15.72:6817/2537282190] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f38ac150da0 con 0x7f3890074a90 2023-07-27T20:31:54.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.933+0000 7f38a1ffb700 1 -- 172.21.15.72:0/1068055218 <== osd.3 v2:172.21.15.72:6816/2537282190 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f389c0045c0 con 0x7f3890074a90 2023-07-27T20:31:54.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.934+0000 7fcadd9ff700 1 -- 172.21.15.72:0/406358588 >> [v2:172.21.15.72:6805/2307669444,v1:172.21.15.72:6807/2307669444] conn(0x7fcac4074a10 msgr2=0x7fcac4076e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.934+0000 7fcadd9ff700 1 --2- 172.21.15.72:0/406358588 >> [v2:172.21.15.72:6805/2307669444,v1:172.21.15.72:6807/2307669444] conn(0x7fcac4074a10 0x7fcac4076e50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.934+0000 7fcadd9ff700 1 -- 172.21.15.72:0/406358588 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcac406adb0 msgr2=0x7fcac406d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.934+0000 7fcadd9ff700 1 --2- 172.21.15.72:0/406358588 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcac406adb0 0x7fcac406d270 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcac8009ca0 tx=0x7fcac8009210 comp rx=0 tx=0).stop 2023-07-27T20:31:54.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.934+0000 7fcadd9ff700 1 -- 172.21.15.72:0/406358588 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcad806ad20 msgr2=0x7fcad813b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.934+0000 7fcadd9ff700 1 --2- 172.21.15.72:0/406358588 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcad806ad20 0x7fcad813b760 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcacc000f60 tx=0x7fcacc00c730 comp rx=0 tx=0).stop 2023-07-27T20:31:54.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.934+0000 7fcad77fe700 1 -- 172.21.15.72:0/406358588 reap_dead start 2023-07-27T20:31:54.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.934+0000 7f38b39ff700 1 -- 172.21.15.72:0/1068055218 >> [v2:172.21.15.72:6816/2537282190,v1:172.21.15.72:6817/2537282190] conn(0x7f3890074a90 msgr2=0x7f3890076ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.934+0000 7f38b39ff700 1 --2- 172.21.15.72:0/1068055218 >> [v2:172.21.15.72:6816/2537282190,v1:172.21.15.72:6817/2537282190] conn(0x7f3890074a90 0x7f3890076ed0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.934+0000 7f38b39ff700 1 -- 172.21.15.72:0/1068055218 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f389006adb0 msgr2=0x7f389006d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.934+0000 7f38b39ff700 1 --2- 172.21.15.72:0/1068055218 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f389006adb0 0x7f389006d270 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f38a8000c00 tx=0x7f38a8007990 comp rx=0 tx=0).stop 2023-07-27T20:31:54.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.934+0000 7f38b39ff700 1 -- 172.21.15.72:0/1068055218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38ac070950 msgr2=0x7f38ac0a9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.934+0000 7f38b39ff700 1 --2- 172.21.15.72:0/1068055218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38ac070950 0x7f38ac0a9ad0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f38a4001f00 tx=0x7f38a400a060 comp rx=0 tx=0).stop 2023-07-27T20:31:54.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.934+0000 7f38b1f9c700 1 -- 172.21.15.72:0/1068055218 reap_dead start 2023-07-27T20:31:54.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.935+0000 7f38b39ff700 1 -- 172.21.15.72:0/1068055218 shutdown_connections 2023-07-27T20:31:54.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.935+0000 7f38b39ff700 1 -- 172.21.15.72:0/1068055218 >> 172.21.15.72:0/1068055218 conn(0x7f38ac06a190 msgr2=0x7f38ac0c1400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:54.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.936+0000 7fcadd9ff700 1 -- 172.21.15.72:0/406358588 shutdown_connections 2023-07-27T20:31:54.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.936+0000 7fcadd9ff700 1 -- 172.21.15.72:0/406358588 >> 172.21.15.72:0/406358588 conn(0x7fcad806a190 msgr2=0x7fcad80c4970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:54.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.936+0000 7f38b39ff700 1 -- 172.21.15.72:0/1068055218 shutdown_connections 2023-07-27T20:31:54.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.936+0000 7f38b39ff700 1 -- 172.21.15.72:0/1068055218 wait complete. 2023-07-27T20:31:54.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.936+0000 7fcadd9ff700 1 -- 172.21.15.72:0/406358588 shutdown_connections 2023-07-27T20:31:54.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.937+0000 7f354c1ff700 1 -- 172.21.15.72:0/3969703806 --> [v2:172.21.15.173:6800/1077261990,v1:172.21.15.173:6801/1077261990] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f35440c45f0 con 0x7f3528074a90 2023-07-27T20:31:54.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.938+0000 7f35367fc700 1 -- 172.21.15.72:0/3969703806 <== osd.5 v2:172.21.15.173:6800/1077261990 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f353c00f040 con 0x7f3528074a90 2023-07-27T20:31:54.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.939+0000 7f354c1ff700 1 -- 172.21.15.72:0/3969703806 >> [v2:172.21.15.173:6800/1077261990,v1:172.21.15.173:6801/1077261990] conn(0x7f3528074a90 msgr2=0x7f3528076ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.939+0000 7f354c1ff700 1 --2- 172.21.15.72:0/3969703806 >> [v2:172.21.15.173:6800/1077261990,v1:172.21.15.173:6801/1077261990] conn(0x7f3528074a90 0x7f3528076ed0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.959 INFO:teuthology.orchestra.run.smithi072.stdout:55834574860 2023-07-27T20:31:54.959 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-27T20:31:54.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.940+0000 7fcadd9ff700 1 -- 172.21.15.72:0/406358588 wait complete. 2023-07-27T20:31:54.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.940+0000 7f354c1ff700 1 -- 172.21.15.72:0/3969703806 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f352806adb0 msgr2=0x7f352806d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.940+0000 7f354c1ff700 1 --2- 172.21.15.72:0/3969703806 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f352806adb0 0x7f352806d270 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3538014040 tx=0x7f3538008030 comp rx=0 tx=0).stop 2023-07-27T20:31:54.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.940+0000 7f354c1ff700 1 -- 172.21.15.72:0/3969703806 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f35440ca370 msgr2=0x7f3544150f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.940+0000 7f354c1ff700 1 --2- 172.21.15.72:0/3969703806 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f35440ca370 0x7f3544150f90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f354000c540 tx=0x7f354000c850 comp rx=0 tx=0).stop 2023-07-27T20:31:54.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.940+0000 7f354a79c700 1 -- 172.21.15.72:0/3969703806 reap_dead start 2023-07-27T20:31:54.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.940+0000 7f354c1ff700 1 -- 172.21.15.72:0/3969703806 shutdown_connections 2023-07-27T20:31:54.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.940+0000 7f354c1ff700 1 -- 172.21.15.72:0/3969703806 >> 172.21.15.72:0/3969703806 conn(0x7f3544071ce0 msgr2=0x7f35440c65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:54.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.941+0000 7f354c1ff700 1 -- 172.21.15.72:0/3969703806 shutdown_connections 2023-07-27T20:31:54.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.941+0000 7f354c1ff700 1 -- 172.21.15.72:0/3969703806 wait complete. 2023-07-27T20:31:54.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.945+0000 7f61e5fff700 1 -- 172.21.15.72:0/2785903850 --> [v2:172.21.15.173:6816/898998598,v1:172.21.15.173:6817/898998598] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f61e00bb810 con 0x7f61cc074a90 2023-07-27T20:31:54.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.945+0000 7f61c7fff700 1 -- 172.21.15.72:0/2785903850 <== osd.6 v2:172.21.15.173:6816/898998598 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f61e00bb810 con 0x7f61cc074a90 2023-07-27T20:31:54.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.947+0000 7f61e5fff700 1 -- 172.21.15.72:0/2785903850 >> [v2:172.21.15.173:6816/898998598,v1:172.21.15.173:6817/898998598] conn(0x7f61cc074a90 msgr2=0x7f61cc076ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.947+0000 7f61e5fff700 1 --2- 172.21.15.72:0/2785903850 >> [v2:172.21.15.173:6816/898998598,v1:172.21.15.173:6817/898998598] conn(0x7f61cc074a90 0x7f61cc076ed0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.947+0000 7f61e5fff700 1 -- 172.21.15.72:0/2785903850 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f61cc06adb0 msgr2=0x7f61cc06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.947+0000 7f61e5fff700 1 --2- 172.21.15.72:0/2785903850 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f61cc06adb0 0x7f61cc06d270 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f61e00c27e0 tx=0x7f61d4013000 comp rx=0 tx=0).stop 2023-07-27T20:31:54.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.947+0000 7f61e5fff700 1 -- 172.21.15.72:0/2785903850 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61e00c1fe0 msgr2=0x7f61e00c3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.947+0000 7f61e5fff700 1 --2- 172.21.15.72:0/2785903850 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61e00c1fe0 0x7f61e00c3c60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f61d000cf90 tx=0x7f61d000a3f0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.947+0000 7f61dffff700 1 -- 172.21.15.72:0/2785903850 reap_dead start 2023-07-27T20:31:54.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.947+0000 7f61e5fff700 1 -- 172.21.15.72:0/2785903850 shutdown_connections 2023-07-27T20:31:54.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.947+0000 7f61e5fff700 1 -- 172.21.15.72:0/2785903850 >> 172.21.15.72:0/2785903850 conn(0x7f61e006a190 msgr2=0x7f61e00c13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:54.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.948+0000 7fe95599d700 1 -- 172.21.15.72:0/340662121 --> [v2:172.21.15.173:6824/3471340321,v1:172.21.15.173:6825/3471340321] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe9500c6520 con 0x7fe93c074990 2023-07-27T20:31:54.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.949+0000 7fe94d7fa700 1 -- 172.21.15.72:0/340662121 <== osd.7 v2:172.21.15.173:6824/3471340321 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe9480092e0 con 0x7fe93c074990 2023-07-27T20:31:54.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.949+0000 7fe95599d700 1 -- 172.21.15.72:0/340662121 >> [v2:172.21.15.173:6824/3471340321,v1:172.21.15.173:6825/3471340321] conn(0x7fe93c074990 msgr2=0x7fe93c076dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.949+0000 7fe95599d700 1 --2- 172.21.15.72:0/340662121 >> [v2:172.21.15.173:6824/3471340321,v1:172.21.15.173:6825/3471340321] conn(0x7fe93c074990 0x7fe93c076dd0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.949+0000 7fe95599d700 1 -- 172.21.15.72:0/340662121 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe93c06ad30 msgr2=0x7fe93c06d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.949+0000 7fe95599d700 1 --2- 172.21.15.72:0/340662121 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe93c06ad30 0x7fe93c06d1f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe940009730 tx=0x7fe940006ca0 comp rx=0 tx=0).stop 2023-07-27T20:31:54.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.949+0000 7fe95599d700 1 -- 172.21.15.72:0/340662121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9500c7600 msgr2=0x7fe950155dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:54.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.949+0000 7fe95599d700 1 --2- 172.21.15.72:0/340662121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9500c7600 0x7fe950155dd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe94400b470 tx=0x7fe94400b830 comp rx=0 tx=0).stop 2023-07-27T20:31:54.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.949+0000 7fe95519c700 1 -- 172.21.15.72:0/340662121 reap_dead start 2023-07-27T20:31:54.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.952+0000 7fe95599d700 1 -- 172.21.15.72:0/340662121 shutdown_connections 2023-07-27T20:31:54.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.952+0000 7fe95599d700 1 -- 172.21.15.72:0/340662121 >> 172.21.15.72:0/340662121 conn(0x7fe9500ab230 msgr2=0x7fe95006c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:54.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.953+0000 7fe95599d700 1 -- 172.21.15.72:0/340662121 shutdown_connections 2023-07-27T20:31:54.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.953+0000 7fe95599d700 1 -- 172.21.15.72:0/340662121 wait complete. 2023-07-27T20:31:54.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.953+0000 7f61e5fff700 1 -- 172.21.15.72:0/2785903850 shutdown_connections 2023-07-27T20:31:54.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:54.953+0000 7f61e5fff700 1 -- 172.21.15.72:0/2785903850 wait complete. 2023-07-27T20:31:54.968 INFO:teuthology.orchestra.run.smithi072.stdout:55834574860 2023-07-27T20:31:54.968 INFO:teuthology.orchestra.run.smithi072.stdout:55834574858 2023-07-27T20:31:54.969 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-27T20:31:54.969 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-27T20:31:54.970 INFO:teuthology.orchestra.run.smithi072.stdout:55834574860 2023-07-27T20:31:54.971 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-27T20:31:54.972 INFO:teuthology.orchestra.run.smithi072.stdout:55834574859 2023-07-27T20:31:54.972 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-27T20:31:54.973 INFO:teuthology.orchestra.run.smithi072.stdout:55834574860 2023-07-27T20:31:54.973 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-27T20:31:54.974 INFO:teuthology.orchestra.run.smithi072.stdout:55834574860 2023-07-27T20:31:54.974 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-27T20:31:54.975 INFO:teuthology.orchestra.run.smithi072.stdout:55834574860 2023-07-27T20:31:54.975 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-27T20:31:55.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.372+0000 7ff6ce9ff700 1 Processor -- start 2023-07-27T20:31:55.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.372+0000 7ff6ce9ff700 1 -- start start 2023-07-27T20:31:55.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.373+0000 7fb9e19ff700 1 Processor -- start 2023-07-27T20:31:55.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.373+0000 7fb9e19ff700 1 -- start start 2023-07-27T20:31:55.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.377+0000 7ff6ce9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff6c80c2390 0x7ff6c8146aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.377+0000 7ff6ce9ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6c806ad20 0x7ff6c8153f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.377+0000 7ff6ce9ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff6c81509d0 0x7ff6c80c0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.377+0000 7ff6ce9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c8071820 con 0x7ff6c80c2390 2023-07-27T20:31:55.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.377+0000 7ff6ce9ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c80c2de0 con 0x7ff6c81509d0 2023-07-27T20:31:55.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.377+0000 7ff6ce9ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c8153540 con 0x7ff6c806ad20 2023-07-27T20:31:55.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.378+0000 7ff6ccf9c700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff6c81509d0 0x7ff6c80c0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.378+0000 7ff6ccf9c700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff6c81509d0 0x7ff6c80c0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.72:46944/0 (socket says 172.21.15.72:46944) 2023-07-27T20:31:55.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.378+0000 7ff6ccf9c700 1 -- 172.21.15.72:0/1398381139 learned_addr learned my addr 172.21.15.72:0/1398381139 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:55.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.378+0000 7ff6c77fe700 1 --2- 172.21.15.72:0/1398381139 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6c806ad20 0x7ff6c8153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.378+0000 7fb9e19ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb9dc153f50 0x7fb9dc1509d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.378+0000 7fb9e19ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9dc1543a0 con 0x7fb9dc0c2390 2023-07-27T20:31:55.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.378+0000 7fb9e19ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9dc0bffd0 con 0x7fb9dc06ad20 2023-07-27T20:31:55.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.378+0000 7fb9e19ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9dc071820 con 0x7fb9dc153f50 2023-07-27T20:31:55.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.378+0000 7fb9da7fc700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fb9dc06ad20 0x7fb9dc070a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.72:53638/0 (socket says 172.21.15.72:53638) 2023-07-27T20:31:55.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.378+0000 7fb9da7fc700 1 -- 172.21.15.72:0/3730777658 learned_addr learned my addr 172.21.15.72:0/3730777658 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:55.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.379+0000 7fb9db7fe700 1 --2- 172.21.15.72:0/3730777658 >> v2:172.21.15.173:3300/0 conn(0x7fb9dc153f50 0x7fb9dc1509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.382+0000 7ff6c7fff700 1 --2- 172.21.15.72:0/1398381139 >> v2:172.21.15.72:3300/0 conn(0x7ff6c80c2390 0x7ff6c8146aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.382+0000 7ff6ccf9c700 1 -- 172.21.15.72:0/1398381139 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6c806ad20 msgr2=0x7ff6c8153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:55.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.382+0000 7ff6ccf9c700 1 --2- 172.21.15.72:0/1398381139 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6c806ad20 0x7ff6c8153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.382+0000 7ff6ccf9c700 1 -- 172.21.15.72:0/1398381139 >> v2:172.21.15.72:3300/0 conn(0x7ff6c80c2390 msgr2=0x7ff6c8146aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:55.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.382+0000 7ff6ccf9c700 1 --2- 172.21.15.72:0/1398381139 >> v2:172.21.15.72:3300/0 conn(0x7ff6c80c2390 0x7ff6c8146aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.382+0000 7ff6ccf9c700 1 -- 172.21.15.72:0/1398381139 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c80c2820 con 0x7ff6c81509d0 2023-07-27T20:31:55.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.379+0000 7fb9d9ffb700 1 -- 172.21.15.72:0/3730777658 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2582058956 0 0) 0x7fb9dc0bffd0 con 0x7fb9dc06ad20 2023-07-27T20:31:55.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.379+0000 7fb9d9ffb700 1 -- 172.21.15.72:0/3730777658 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9c40035b0 con 0x7fb9dc06ad20 2023-07-27T20:31:55.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.380+0000 7fb9d9ffb700 1 -- 172.21.15.72:0/3730777658 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2865226181 0 0) 0x7fb9dc1543a0 con 0x7fb9dc0c2390 2023-07-27T20:31:55.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.380+0000 7fb9d9ffb700 1 -- 172.21.15.72:0/3730777658 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9dc0bffd0 con 0x7fb9dc0c2390 2023-07-27T20:31:55.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.380+0000 7fb9d9ffb700 1 -- 172.21.15.72:0/3730777658 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1980691170 0 0) 0x7fb9dc0bffd0 con 0x7fb9dc0c2390 2023-07-27T20:31:55.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.380+0000 7fb9d9ffb700 1 -- 172.21.15.72:0/3730777658 >> v2:172.21.15.173:3300/0 conn(0x7fb9dc153f50 msgr2=0x7fb9dc1509d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:55.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.380+0000 7fb9d9ffb700 1 --2- 172.21.15.72:0/3730777658 >> v2:172.21.15.173:3300/0 conn(0x7fb9dc153f50 0x7fb9dc1509d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.380+0000 7fb9d9ffb700 1 -- 172.21.15.72:0/3730777658 >> v1:172.21.15.173:6789/0 conn(0x7fb9dc06ad20 legacy=0x7fb9dc070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.380+0000 7fb9d9ffb700 1 -- 172.21.15.72:0/3730777658 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9dc0c2820 con 0x7fb9dc0c2390 2023-07-27T20:31:55.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.380+0000 7fb9d9ffb700 1 -- 172.21.15.72:0/3730777658 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7fb9d00015f0 con 0x7fb9dc0c2390 2023-07-27T20:31:55.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.380+0000 7fb9d9ffb700 1 -- 172.21.15.72:0/3730777658 >> v1:172.21.15.72:6789/0 conn(0x7fb9dc0c2390 legacy=0x7fb9dc0c0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.380+0000 7fb9d9ffb700 1 --2- 172.21.15.72:0/3730777658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9c4004bf0 0x7fb9c4004fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.380+0000 7fb9d9ffb700 1 --2- 172.21.15.72:0/3730777658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9c40037f0 0x7fb9c4003c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.380+0000 7fb9d9ffb700 1 --2- 172.21.15.72:0/3730777658 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9c40041b0 0x7fb9c401ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.380+0000 7fb9d9ffb700 1 -- 172.21.15.72:0/3730777658 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc071820 con 0x7fb9c4004bf0 2023-07-27T20:31:55.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.380+0000 7fb9d9ffb700 1 -- 172.21.15.72:0/3730777658 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c401d040 con 0x7fb9c40037f0 2023-07-27T20:31:55.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.380+0000 7fb9d9ffb700 1 -- 172.21.15.72:0/3730777658 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c401d200 con 0x7fb9c40041b0 2023-07-27T20:31:55.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.381+0000 7fb9daffd700 1 --2- 172.21.15.72:0/3730777658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9c4004bf0 0x7fb9c4004fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.382+0000 7fb9daffd700 1 -- 172.21.15.72:0/3730777658 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9c40041b0 msgr2=0x7fb9c401ca20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-27T20:31:55.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.382+0000 7fb9daffd700 1 --2- 172.21.15.72:0/3730777658 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9c40041b0 0x7fb9c401ca20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.382+0000 7fb9daffd700 1 -- 172.21.15.72:0/3730777658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9c40037f0 msgr2=0x7fb9c4003c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:55.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.382+0000 7fb9da7fc700 1 --2- 172.21.15.72:0/3730777658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9c40037f0 0x7fb9c4003c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.383+0000 7fb9daffd700 1 --2- 172.21.15.72:0/3730777658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9c40037f0 0x7fb9c4003c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.383+0000 7fb9daffd700 1 -- 172.21.15.72:0/3730777658 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9dc0c2820 con 0x7fb9c4004bf0 2023-07-27T20:31:55.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.383+0000 7fb9daffd700 1 --2- 172.21.15.72:0/3730777658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9c4004bf0 0x7fb9c4004fd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb9d000c190 tx=0x7fb9c4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9edd2c6119a7272f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:55.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.383+0000 7fb9da7fc700 1 --2- 172.21.15.72:0/3730777658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9c40037f0 0x7fb9c4003c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:31:55.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.384+0000 7fb9db7fe700 1 -- 172.21.15.72:0/3730777658 reap_dead start 2023-07-27T20:31:55.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.379+0000 7f50477ff700 1 Processor -- start 2023-07-27T20:31:55.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.379+0000 7f50477ff700 1 -- start start 2023-07-27T20:31:55.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.381+0000 7f50477ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f50400706b0 0x7f504015dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.381+0000 7f50477ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5040164240 0x7f504015e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.381+0000 7f50477ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5040070f30 con 0x7f50400c0100 2023-07-27T20:31:55.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.381+0000 7f50477ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5040161c30 con 0x7f5040164240 2023-07-27T20:31:55.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.381+0000 7f50477ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50401610b0 con 0x7f50400706b0 2023-07-27T20:31:55.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.382+0000 7f5044d9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5040164240 0x7f504015e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.382+0000 7f5044d9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5040164240 0x7f504015e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58560/0 (socket says 172.21.15.72:58560) 2023-07-27T20:31:55.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.382+0000 7f5044d9a700 1 -- 172.21.15.72:0/559899404 learned_addr learned my addr 172.21.15.72:0/559899404 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:55.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.383+0000 7ff6ccf9c700 1 --2- 172.21.15.72:0/1398381139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6c81509d0 0x7ff6c80c0450 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff6c806bd90 tx=0x7ff6c000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aeabf5697c4cad5b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:55.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.384+0000 7ff6c6ffd700 1 -- 172.21.15.72:0/1398381139 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c000e070 con 0x7ff6c81509d0 2023-07-27T20:31:55.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.384+0000 7ff6c6ffd700 1 -- 172.21.15.72:0/1398381139 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c000b910 con 0x7ff6c81509d0 2023-07-27T20:31:55.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.384+0000 7ff6c6ffd700 1 -- 172.21.15.72:0/1398381139 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c000bcc0 con 0x7ff6c81509d0 2023-07-27T20:31:55.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.384+0000 7fb9d9ffb700 1 -- 172.21.15.72:0/3730777658 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0007ac0 con 0x7fb9c4004bf0 2023-07-27T20:31:55.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.384+0000 7fb9d9ffb700 1 -- 172.21.15.72:0/3730777658 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d000cc50 con 0x7fb9c4004bf0 2023-07-27T20:31:55.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.384+0000 7fb9d9ffb700 1 -- 172.21.15.72:0/3730777658 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0012420 con 0x7fb9c4004bf0 2023-07-27T20:31:55.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.385+0000 7fb9e19ff700 1 -- 172.21.15.72:0/3730777658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9c4004bf0 msgr2=0x7fb9c4004fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.385+0000 7fb9e19ff700 1 --2- 172.21.15.72:0/3730777658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9c4004bf0 0x7fb9c4004fd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb9d000c190 tx=0x7fb9c4005880 comp rx=0 tx=0).stop 2023-07-27T20:31:55.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.384+0000 7fda92bff700 1 Processor -- start 2023-07-27T20:31:55.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.384+0000 7fda92bff700 1 -- start start 2023-07-27T20:31:55.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.385+0000 7ff6ce9ff700 1 -- 172.21.15.72:0/1398381139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6c81509d0 msgr2=0x7ff6c80c0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.385+0000 7ff6ce9ff700 1 --2- 172.21.15.72:0/1398381139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6c81509d0 0x7ff6c80c0450 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff6c806bd90 tx=0x7ff6c000b330 comp rx=0 tx=0).stop 2023-07-27T20:31:55.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.386+0000 7fb9e19ff700 1 -- 172.21.15.72:0/3730777658 shutdown_connections 2023-07-27T20:31:55.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.386+0000 7fb9e19ff700 1 --2- 172.21.15.72:0/3730777658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9c4004bf0 0x7fb9c4004fd0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.386+0000 7fb9e19ff700 1 -- 172.21.15.72:0/3730777658 >> 172.21.15.72:0/3730777658 conn(0x7fb9dc06a190 msgr2=0x7fb9dc06a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:55.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.384+0000 7f5037fff700 1 -- 172.21.15.72:0/559899404 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3905700608 0 0) 0x7f5040070f30 con 0x7f50400c0100 2023-07-27T20:31:55.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.382+0000 7f504559b700 1 --2- 172.21.15.72:0/559899404 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f50400706b0 0x7f504015dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.385+0000 7f5037fff700 1 -- 172.21.15.72:0/559899404 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f502c0057c0 con 0x7f50400c0100 2023-07-27T20:31:55.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.386+0000 7f5037fff700 1 -- 172.21.15.72:0/559899404 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 653204629 0 0) 0x7f502c0057c0 con 0x7f50400c0100 2023-07-27T20:31:55.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.386+0000 7f5037fff700 1 -- 172.21.15.72:0/559899404 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f50400706b0 msgr2=0x7f504015dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:55.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.386+0000 7f5037fff700 1 --2- 172.21.15.72:0/559899404 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f50400706b0 0x7f504015dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.386+0000 7f5037fff700 1 -- 172.21.15.72:0/559899404 >> v2:172.21.15.72:3300/0 conn(0x7f5040164240 msgr2=0x7f504015e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:55.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.386+0000 7f5037fff700 1 --2- 172.21.15.72:0/559899404 >> v2:172.21.15.72:3300/0 conn(0x7f5040164240 0x7f504015e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.386+0000 7f5037fff700 1 -- 172.21.15.72:0/559899404 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5040161390 con 0x7f50400c0100 2023-07-27T20:31:55.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.386+0000 7f5037fff700 1 -- 172.21.15.72:0/559899404 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f50380019f0 con 0x7f50400c0100 2023-07-27T20:31:55.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.386+0000 7f5037fff700 1 -- 172.21.15.72:0/559899404 >> v1:172.21.15.72:6789/0 conn(0x7f50400c0100 legacy=0x7f50400c0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.386+0000 7f5037fff700 1 --2- 172.21.15.72:0/559899404 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f502c005c10 0x7f502c006030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.386+0000 7f5037fff700 1 --2- 172.21.15.72:0/559899404 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f502c006a60 0x7f502c006ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.386+0000 7f5037fff700 1 --2- 172.21.15.72:0/559899404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f502c007420 0x7f502c00bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.386+0000 7f5037fff700 1 -- 172.21.15.72:0/559899404 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5040161c30 con 0x7f502c007420 2023-07-27T20:31:55.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.386+0000 7f5037fff700 1 -- 172.21.15.72:0/559899404 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50401610b0 con 0x7f502c005c10 2023-07-27T20:31:55.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.386+0000 7f5037fff700 1 -- 172.21.15.72:0/559899404 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f502c00c0d0 con 0x7f502c006a60 2023-07-27T20:31:55.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.387+0000 7fb9e19ff700 1 -- 172.21.15.72:0/3730777658 shutdown_connections 2023-07-27T20:31:55.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.387+0000 7fb9e19ff700 1 -- 172.21.15.72:0/3730777658 wait complete. 2023-07-27T20:31:55.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.387+0000 7fda92bff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fda8c153f50 0x7fda8c1509d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.387+0000 7fda92bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda8c1543a0 con 0x7fda8c06ad20 2023-07-27T20:31:55.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.387+0000 7fda92bff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda8c0bffd0 con 0x7fda8c0c2390 2023-07-27T20:31:55.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.387+0000 7f5045d9c700 1 --2- 172.21.15.72:0/559899404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f502c007420 0x7f502c00bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.387+0000 7fda92bff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda8c071820 con 0x7fda8c153f50 2023-07-27T20:31:55.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.388+0000 7fda8bfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fda8c06ad20 0x7fda8c0c0450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55464/0 (socket says 172.21.15.72:55464) 2023-07-27T20:31:55.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.388+0000 7fda8bfff700 1 -- 172.21.15.72:0/2987020848 learned_addr learned my addr 172.21.15.72:0/2987020848 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:55.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.388+0000 7fda9119c700 1 --2- 172.21.15.72:0/2987020848 >> v2:172.21.15.173:3300/0 conn(0x7fda8c153f50 0x7fda8c1509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.388+0000 7f5045d9c700 1 -- 172.21.15.72:0/559899404 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f502c006a60 msgr2=0x7f502c006ee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-27T20:31:55.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.388+0000 7f5045d9c700 1 --2- 172.21.15.72:0/559899404 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f502c006a60 0x7f502c006ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.388+0000 7f5045d9c700 1 -- 172.21.15.72:0/559899404 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f502c005c10 msgr2=0x7f502c006030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-27T20:31:55.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.388+0000 7f5045d9c700 1 --2- 172.21.15.72:0/559899404 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f502c005c10 0x7f502c006030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.388+0000 7f5045d9c700 1 -- 172.21.15.72:0/559899404 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5040161390 con 0x7f502c007420 2023-07-27T20:31:55.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.388+0000 7f5044d9a700 1 --2- 172.21.15.72:0/559899404 >> v2:172.21.15.72:3300/0 conn(0x7f5040164240 0x7f504015e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:31:55.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.388+0000 7f5045d9c700 1 --2- 172.21.15.72:0/559899404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f502c007420 0x7f502c00bab0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f503800a930 tx=0x7f502c0034d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5d25d96b4b720f0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:55.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.389+0000 7ff6ce9ff700 1 -- 172.21.15.72:0/1398381139 shutdown_connections 2023-07-27T20:31:55.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.389+0000 7ff6ce9ff700 1 --2- 172.21.15.72:0/1398381139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6c81509d0 0x7ff6c80c0450 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.389+0000 7ff6ce9ff700 1 --2- 172.21.15.72:0/1398381139 >> v2:172.21.15.72:3300/0 conn(0x7ff6c80c2390 0x7ff6c8146aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.389+0000 7ff6ce9ff700 1 --2- 172.21.15.72:0/1398381139 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6c806ad20 0x7ff6c8153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.389+0000 7ff6ce9ff700 1 -- 172.21.15.72:0/1398381139 >> 172.21.15.72:0/1398381139 conn(0x7ff6c806a190 msgr2=0x7ff6c806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:55.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.389+0000 7fda8b7fe700 1 -- 172.21.15.72:0/2987020848 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 639199461 0 0) 0x7fda8c0bffd0 con 0x7fda8c0c2390 2023-07-27T20:31:55.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.389+0000 7fda8b7fe700 1 -- 172.21.15.72:0/2987020848 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda740057c0 con 0x7fda8c0c2390 2023-07-27T20:31:55.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.389+0000 7fda9119c700 1 -- 172.21.15.72:0/2987020848 >> v1:172.21.15.173:6789/0 conn(0x7fda8c0c2390 legacy=0x7fda8c070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.389+0000 7fda9119c700 1 -- 172.21.15.72:0/2987020848 >> v1:172.21.15.72:6789/0 conn(0x7fda8c06ad20 legacy=0x7fda8c0c0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.389+0000 7fda9119c700 1 -- 172.21.15.72:0/2987020848 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda8c0c2820 con 0x7fda8c153f50 2023-07-27T20:31:55.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.389+0000 7fb9e19ff700 1 Processor -- start 2023-07-27T20:31:55.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.390+0000 7fda9119c700 1 --2- 172.21.15.72:0/2987020848 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda8c153f50 0x7fda8c1509d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fda84009d90 tx=0x7fda8400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c80c7472b3339e49 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:55.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.389+0000 7f5037fff700 1 -- 172.21.15.72:0/559899404 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5038012620 con 0x7f502c007420 2023-07-27T20:31:55.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.389+0000 7f5037fff700 1 -- 172.21.15.72:0/559899404 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5038012780 con 0x7f502c007420 2023-07-27T20:31:55.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.389+0000 7f5037fff700 1 -- 172.21.15.72:0/559899404 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5038012b30 con 0x7f502c007420 2023-07-27T20:31:55.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.390+0000 7f50477ff700 1 -- 172.21.15.72:0/559899404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f502c007420 msgr2=0x7f502c00bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.390+0000 7f50477ff700 1 --2- 172.21.15.72:0/559899404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f502c007420 0x7f502c00bab0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f503800a930 tx=0x7f502c0034d0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.390+0000 7f5045d9c700 1 -- 172.21.15.72:0/559899404 reap_dead start 2023-07-27T20:31:55.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.390+0000 7fb9e19ff700 1 -- start start 2023-07-27T20:31:55.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.390+0000 7fda8b7fe700 1 -- 172.21.15.72:0/2987020848 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8400e070 con 0x7fda8c153f50 2023-07-27T20:31:55.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.390+0000 7fda8b7fe700 1 -- 172.21.15.72:0/2987020848 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8400bb20 con 0x7fda8c153f50 2023-07-27T20:31:55.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.390+0000 7fda8b7fe700 1 -- 172.21.15.72:0/2987020848 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda84012430 con 0x7fda8c153f50 2023-07-27T20:31:55.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.390+0000 7f50477ff700 1 -- 172.21.15.72:0/559899404 shutdown_connections 2023-07-27T20:31:55.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.390+0000 7f50477ff700 1 -- 172.21.15.72:0/559899404 >> 172.21.15.72:0/559899404 conn(0x7f504006a190 msgr2=0x7f504006a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:55.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.391+0000 7fda92bff700 1 -- 172.21.15.72:0/2987020848 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda8c153f50 msgr2=0x7fda8c1509d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.391+0000 7fda92bff700 1 --2- 172.21.15.72:0/2987020848 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda8c153f50 0x7fda8c1509d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fda84009d90 tx=0x7fda8400b330 comp rx=0 tx=0).stop 2023-07-27T20:31:55.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.391+0000 7fda92bff700 1 -- 172.21.15.72:0/2987020848 shutdown_connections 2023-07-27T20:31:55.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.391+0000 7fda92bff700 1 --2- 172.21.15.72:0/2987020848 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda8c153f50 0x7fda8c1509d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.391+0000 7fda92bff700 1 -- 172.21.15.72:0/2987020848 >> 172.21.15.72:0/2987020848 conn(0x7fda8c06a190 msgr2=0x7fda8c06a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:55.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.391+0000 7fb9e19ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9c4004bf0 0x7fb9dc0aa8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.391+0000 7fb9e19ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9dc1531d0 0x7fb9dc0c5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.391+0000 7fb9e19ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9dc0c5670 0x7fb9dc0a8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.391+0000 7fb9e19ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc149080 con 0x7fb9c4004bf0 2023-07-27T20:31:55.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.391+0000 7fb9e19ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc149360 con 0x7fb9dc0c5670 2023-07-27T20:31:55.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.391+0000 7fb9e19ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc149640 con 0x7fb9dc1531d0 2023-07-27T20:31:55.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.392+0000 7fb9daffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9c4004bf0 0x7fb9dc0aa8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.392+0000 7fb9daffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9c4004bf0 0x7fb9dc0aa8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58584/0 (socket says 172.21.15.72:58584) 2023-07-27T20:31:55.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.392+0000 7fb9daffd700 1 -- 172.21.15.72:0/4293813967 learned_addr learned my addr 172.21.15.72:0/4293813967 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:55.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.392+0000 7fb9da7fc700 1 --2- 172.21.15.72:0/4293813967 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9dc1531d0 0x7fb9dc0c5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.392+0000 7fb9db7fe700 1 --2- 172.21.15.72:0/4293813967 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9dc0c5670 0x7fb9dc0a8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.393+0000 7fb9daffd700 1 -- 172.21.15.72:0/4293813967 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9dc1531d0 msgr2=0x7fb9dc0c5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.393+0000 7fb9daffd700 1 --2- 172.21.15.72:0/4293813967 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9dc1531d0 0x7fb9dc0c5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.393+0000 7fb9daffd700 1 -- 172.21.15.72:0/4293813967 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9dc0c5670 msgr2=0x7fb9dc0a8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.393+0000 7fb9daffd700 1 --2- 172.21.15.72:0/4293813967 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9dc0c5670 0x7fb9dc0a8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.392+0000 7fda92bff700 1 -- 172.21.15.72:0/2987020848 shutdown_connections 2023-07-27T20:31:55.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.393+0000 7fb9daffd700 1 -- 172.21.15.72:0/4293813967 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9dc149920 con 0x7fb9c4004bf0 2023-07-27T20:31:55.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.393+0000 7fb9db7fe700 1 --2- 172.21.15.72:0/4293813967 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9dc0c5670 0x7fb9dc0a8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:31:55.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.393+0000 7fb9daffd700 1 --2- 172.21.15.72:0/4293813967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9c4004bf0 0x7fb9dc0aa8f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0014040 tx=0x7fb9d00018b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:55.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.393+0000 7f50477ff700 1 -- 172.21.15.72:0/559899404 shutdown_connections 2023-07-27T20:31:55.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.393+0000 7f50477ff700 1 -- 172.21.15.72:0/559899404 wait complete. 2023-07-27T20:31:55.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.394+0000 7fb9c3fff700 1 -- 172.21.15.72:0/4293813967 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d00050c0 con 0x7fb9c4004bf0 2023-07-27T20:31:55.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.394+0000 7fb9c3fff700 1 -- 172.21.15.72:0/4293813967 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d0020070 con 0x7fb9c4004bf0 2023-07-27T20:31:55.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.394+0000 7fb9c3fff700 1 -- 172.21.15.72:0/4293813967 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0005440 con 0x7fb9c4004bf0 2023-07-27T20:31:55.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.392+0000 7fda92bff700 1 -- 172.21.15.72:0/2987020848 wait complete. 2023-07-27T20:31:55.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.395+0000 7fda92bff700 1 Processor -- start 2023-07-27T20:31:55.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.395+0000 7fb9e19ff700 1 -- 172.21.15.72:0/4293813967 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9dc0aae30 con 0x7fb9c4004bf0 2023-07-27T20:31:55.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.396+0000 7f50477ff700 1 Processor -- start 2023-07-27T20:31:55.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.396+0000 7f50477ff700 1 -- start start 2023-07-27T20:31:55.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.395+0000 7fb9e19ff700 1 -- 172.21.15.72:0/4293813967 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9dc0c6180 con 0x7fb9c4004bf0 2023-07-27T20:31:55.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.397+0000 7fb9e19ff700 1 -- 172.21.15.72:0/4293813967 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9dc074310 con 0x7fb9c4004bf0 2023-07-27T20:31:55.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.395+0000 7fda92bff700 1 -- start start 2023-07-27T20:31:55.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.397+0000 7fda92bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fda8c06ad20 0x7fda8c0c48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.397+0000 7fda92bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda8c153f50 0x7fda8c0a87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.397+0000 7fda92bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda8c0a8d30 0x7fda8c1f1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.397+0000 7fda92bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c0aa720 con 0x7fda8c0a8d30 2023-07-27T20:31:55.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.397+0000 7fda92bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c0ab280 con 0x7fda8c153f50 2023-07-27T20:31:55.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.397+0000 7fda92bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c0a9240 con 0x7fda8c06ad20 2023-07-27T20:31:55.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.398+0000 7fda9099b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fda8c06ad20 0x7fda8c0c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.398+0000 7fda9099b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fda8c06ad20 0x7fda8c0c48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.72:48050/0 (socket says 172.21.15.72:48050) 2023-07-27T20:31:55.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.398+0000 7fda9099b700 1 -- 172.21.15.72:0/454147254 learned_addr learned my addr 172.21.15.72:0/454147254 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:55.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.398+0000 7fda8bfff700 1 --2- 172.21.15.72:0/454147254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda8c153f50 0x7fda8c0a87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.398+0000 7fda9099b700 1 -- 172.21.15.72:0/454147254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda8c153f50 msgr2=0x7fda8c0a87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.398+0000 7fda9099b700 1 --2- 172.21.15.72:0/454147254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda8c153f50 0x7fda8c0a87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.398+0000 7fda9099b700 1 -- 172.21.15.72:0/454147254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda8c0a8d30 msgr2=0x7fda8c1f1080 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-27T20:31:55.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.398+0000 7fda9099b700 1 --2- 172.21.15.72:0/454147254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda8c0a8d30 0x7fda8c1f1080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.398+0000 7fda9099b700 1 -- 172.21.15.72:0/454147254 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda84009a70 con 0x7fda8c06ad20 2023-07-27T20:31:55.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.399+0000 7fda9099b700 1 --2- 172.21.15.72:0/454147254 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fda8c06ad20 0x7fda8c0c48e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fda7c00c520 tx=0x7fda7c00c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:55.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.398+0000 7f50477ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f502c007420 0x7f50401f9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.398+0000 7f50477ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f504015e020 0x7f50400aa400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.398+0000 7f50477ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50400aa940 0x7f504015cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.398+0000 7f50477ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50401f9a70 con 0x7f50400aa940 2023-07-27T20:31:55.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.398+0000 7f50477ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50400a9310 con 0x7f504015e020 2023-07-27T20:31:55.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.398+0000 7f50477ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50401f9440 con 0x7f502c007420 2023-07-27T20:31:55.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.398+0000 7f5044d9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f504015e020 0x7f50400aa400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.398+0000 7f5044d9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f504015e020 0x7f50400aa400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.72:47032/0 (socket says 172.21.15.72:47032) 2023-07-27T20:31:55.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.398+0000 7f5044d9a700 1 -- 172.21.15.72:0/2099707654 learned_addr learned my addr 172.21.15.72:0/2099707654 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:55.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.398+0000 7f504559b700 1 --2- 172.21.15.72:0/2099707654 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f502c007420 0x7f50401f9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.399+0000 7f5044d9a700 1 -- 172.21.15.72:0/2099707654 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f502c007420 msgr2=0x7f50401f9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.399+0000 7f5044d9a700 1 --2- 172.21.15.72:0/2099707654 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f502c007420 0x7f50401f9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.399+0000 7f5044d9a700 1 -- 172.21.15.72:0/2099707654 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50400aa940 msgr2=0x7f504015cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.399+0000 7f5044d9a700 1 --2- 172.21.15.72:0/2099707654 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50400aa940 0x7f504015cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.399+0000 7f5044d9a700 1 -- 172.21.15.72:0/2099707654 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5040159ec0 con 0x7f504015e020 2023-07-27T20:31:55.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.392+0000 7ff6ce9ff700 1 -- 172.21.15.72:0/1398381139 shutdown_connections 2023-07-27T20:31:55.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.392+0000 7ff6ce9ff700 1 -- 172.21.15.72:0/1398381139 wait complete. 2023-07-27T20:31:55.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.395+0000 7ff6ce9ff700 1 Processor -- start 2023-07-27T20:31:55.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.395+0000 7ff6ce9ff700 1 -- start start 2023-07-27T20:31:55.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.396+0000 7ff6ce9ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6c806ad20 0x7ff6c81495f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.396+0000 7ff6ce9ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6c81509d0 0x7ff6c814f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.396+0000 7ff6ce9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6c814f8f0 0x7ff6c8136dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.396+0000 7ff6ce9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c8149b30 con 0x7ff6c814f8f0 2023-07-27T20:31:55.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.396+0000 7ff6ce9ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c8134780 con 0x7ff6c806ad20 2023-07-27T20:31:55.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.396+0000 7ff6ce9ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c81339e0 con 0x7ff6c81509d0 2023-07-27T20:31:55.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.397+0000 7ff6c77fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6c81509d0 0x7ff6c814f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.398+0000 7ff6ccf9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6c814f8f0 0x7ff6c8136dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.398+0000 7ff6ccf9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6c814f8f0 0x7ff6c8136dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58598/0 (socket says 172.21.15.72:58598) 2023-07-27T20:31:55.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.398+0000 7ff6ccf9c700 1 -- 172.21.15.72:0/1185240496 learned_addr learned my addr 172.21.15.72:0/1185240496 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:55.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.398+0000 7ff6ccf9c700 1 -- 172.21.15.72:0/1185240496 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6c81509d0 msgr2=0x7ff6c814f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.398+0000 7ff6ccf9c700 1 --2- 172.21.15.72:0/1185240496 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6c81509d0 0x7ff6c814f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.398+0000 7ff6ccf9c700 1 -- 172.21.15.72:0/1185240496 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6c806ad20 msgr2=0x7ff6c81495f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-27T20:31:55.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.398+0000 7ff6ccf9c700 1 --2- 172.21.15.72:0/1185240496 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6c806ad20 0x7ff6c81495f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.398+0000 7ff6ccf9c700 1 -- 172.21.15.72:0/1185240496 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c0009b30 con 0x7ff6c814f8f0 2023-07-27T20:31:55.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.399+0000 7ff6ccf9c700 1 --2- 172.21.15.72:0/1185240496 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6c814f8f0 0x7ff6c8136dc0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8072640 tx=0x7ff6c0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:55.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.399+0000 7f5044d9a700 1 --2- 172.21.15.72:0/2099707654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f504015e020 0x7f50400aa400 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f503c0077e0 tx=0x7f503c007af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:55.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.401+0000 7f5035ffb700 1 -- 172.21.15.72:0/2099707654 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c00f040 con 0x7f504015e020 2023-07-27T20:31:55.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.401+0000 7f5035ffb700 1 -- 172.21.15.72:0/2099707654 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503c004020 con 0x7f504015e020 2023-07-27T20:31:55.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.401+0000 7f5035ffb700 1 -- 172.21.15.72:0/2099707654 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c0043d0 con 0x7f504015e020 2023-07-27T20:31:55.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.401+0000 7f50477ff700 1 -- 172.21.15.72:0/2099707654 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50400c4cd0 con 0x7f504015e020 2023-07-27T20:31:55.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.401+0000 7f50477ff700 1 -- 172.21.15.72:0/2099707654 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50401f9690 con 0x7f504015e020 2023-07-27T20:31:55.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.399+0000 7fda897fa700 1 -- 172.21.15.72:0/454147254 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7c0052d0 con 0x7fda8c06ad20 2023-07-27T20:31:55.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.399+0000 7fda897fa700 1 -- 172.21.15.72:0/454147254 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7c005430 con 0x7fda8c06ad20 2023-07-27T20:31:55.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.399+0000 7fda897fa700 1 -- 172.21.15.72:0/454147254 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7c0038a0 con 0x7fda8c06ad20 2023-07-27T20:31:55.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.401+0000 7fda92bff700 1 -- 172.21.15.72:0/454147254 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda8c0aa950 con 0x7fda8c06ad20 2023-07-27T20:31:55.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.402+0000 7fda92bff700 1 -- 172.21.15.72:0/454147254 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda8c0aaf10 con 0x7fda8c06ad20 2023-07-27T20:31:55.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.403+0000 7fda92bff700 1 -- 172.21.15.72:0/454147254 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda8c0c0ae0 con 0x7fda8c06ad20 2023-07-27T20:31:55.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.403+0000 7f251e3ff700 1 Processor -- start 2023-07-27T20:31:55.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.406+0000 7fda897fa700 1 -- 172.21.15.72:0/454147254 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fda7c003a00 con 0x7fda8c06ad20 2023-07-27T20:31:55.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.406+0000 7f50477ff700 1 -- 172.21.15.72:0/2099707654 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50401f9bb0 con 0x7f504015e020 2023-07-27T20:31:55.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.407+0000 7f5035ffb700 1 -- 172.21.15.72:0/2099707654 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f503c0036a0 con 0x7f504015e020 2023-07-27T20:31:55.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.407+0000 7fda897fa700 1 --2- 172.21.15.72:0/454147254 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fda7406b130 0x7fda7406d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.404+0000 7f251e3ff700 1 -- start start 2023-07-27T20:31:55.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.406+0000 7f251e3ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2518070a90 0x7f2518153f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.406+0000 7f251e3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25180712e0 con 0x7f25180c2390 2023-07-27T20:31:55.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.406+0000 7f251e3ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25180bffd0 con 0x7f2518070e70 2023-07-27T20:31:55.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.406+0000 7f251e3ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2518071820 con 0x7f2518070a90 2023-07-27T20:31:55.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.407+0000 7f251c99c700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f2518070e70 0x7f25180aa6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.72:53658/0 (socket says 172.21.15.72:53658) 2023-07-27T20:31:55.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.407+0000 7f251c99c700 1 -- 172.21.15.72:0/3876611733 learned_addr learned my addr 172.21.15.72:0/3876611733 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:55.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.407+0000 7fda897fa700 1 -- 172.21.15.72:0/454147254 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fda7c088ce0 con 0x7fda8c06ad20 2023-07-27T20:31:55.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.407+0000 7f2517fff700 1 --2- 172.21.15.72:0/3876611733 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2518070a90 0x7f2518153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.409+0000 7fda8bfff700 1 --2- 172.21.15.72:0/454147254 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fda7406b130 0x7fda7406d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.408+0000 7f5035ffb700 1 --2- 172.21.15.72:0/2099707654 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f502406adb0 0x7f502406d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.409+0000 7f5035ffb700 1 -- 172.21.15.72:0/2099707654 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f503c089550 con 0x7f504015e020 2023-07-27T20:31:55.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.408+0000 7f2517fff700 1 -- 172.21.15.72:0/3876611733 >> v1:172.21.15.173:6789/0 conn(0x7f2518070e70 legacy=0x7f25180aa6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.408+0000 7f2517fff700 1 -- 172.21.15.72:0/3876611733 >> v1:172.21.15.72:6789/0 conn(0x7f25180c2390 legacy=0x7f25180c0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.408+0000 7f2517fff700 1 -- 172.21.15.72:0/3876611733 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25180c2820 con 0x7f2518070a90 2023-07-27T20:31:55.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.409+0000 7f2517fff700 1 --2- 172.21.15.72:0/3876611733 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2518070a90 0x7f2518153f50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f250800d210 tx=0x7f250800d520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f18e3bee1bcbe6b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:55.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.407+0000 7ff6c4ff9700 1 -- 172.21.15.72:0/1185240496 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c0004250 con 0x7ff6c814f8f0 2023-07-27T20:31:55.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.407+0000 7ff6c4ff9700 1 -- 172.21.15.72:0/1185240496 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c00043b0 con 0x7ff6c814f8f0 2023-07-27T20:31:55.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.407+0000 7ff6c4ff9700 1 -- 172.21.15.72:0/1185240496 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c0004720 con 0x7ff6c814f8f0 2023-07-27T20:31:55.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.407+0000 7ff6ce9ff700 1 -- 172.21.15.72:0/1185240496 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c8133cc0 con 0x7ff6c814f8f0 2023-07-27T20:31:55.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.407+0000 7ff6ce9ff700 1 -- 172.21.15.72:0/1185240496 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c8134280 con 0x7ff6c814f8f0 2023-07-27T20:31:55.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.410+0000 7ff6ce9ff700 1 -- 172.21.15.72:0/1185240496 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a80052f0 con 0x7ff6c814f8f0 2023-07-27T20:31:55.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.410+0000 7f504559b700 1 --2- 172.21.15.72:0/2099707654 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f502406adb0 0x7f502406d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.408+0000 7fb9c3fff700 1 -- 172.21.15.72:0/4293813967 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb9d0022030 con 0x7fb9c4004bf0 2023-07-27T20:31:55.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.410+0000 7fb9c3fff700 1 --2- 172.21.15.72:0/4293813967 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb9c806ade0 0x7fb9c806d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.410+0000 7fb9c3fff700 1 -- 172.21.15.72:0/4293813967 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb9d008aad0 con 0x7fb9c4004bf0 2023-07-27T20:31:55.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.410+0000 7fb9c3fff700 1 -- 172.21.15.72:0/4293813967 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb9d0058ab0 con 0x7fb9c4004bf0 2023-07-27T20:31:55.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.410+0000 7eff97fff700 1 Processor -- start 2023-07-27T20:31:55.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.411+0000 7eff97fff700 1 -- start start 2023-07-27T20:31:55.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.413+0000 7fda897fa700 1 -- 172.21.15.72:0/454147254 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fda7c053a90 con 0x7fda8c06ad20 2023-07-27T20:31:55.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.413+0000 7eff97fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7eff9006b150 0x7eff900c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.413+0000 7eff97fff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7eff901549f0 0x7eff901514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.413+0000 7eff97fff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff9006b710 con 0x7eff900c4400 2023-07-27T20:31:55.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.413+0000 7eff97fff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff901545d0 con 0x7eff901549f0 2023-07-27T20:31:55.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.413+0000 7eff97fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff9006c860 con 0x7eff9006b150 2023-07-27T20:31:55.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.413+0000 7eff95d9b700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7eff900c4400 0x7eff900c4cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.72:53670/0 (socket says 172.21.15.72:53670) 2023-07-27T20:31:55.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.413+0000 7eff95d9b700 1 -- 172.21.15.72:0/3993860355 learned_addr learned my addr 172.21.15.72:0/3993860355 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:55.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.413+0000 7eff9559a700 1 --2- 172.21.15.72:0/3993860355 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7eff9006b150 0x7eff900c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.414+0000 7f76825ff700 1 Processor -- start 2023-07-27T20:31:55.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.413+0000 7eff9659c700 1 --2- 172.21.15.72:0/3993860355 >> v2:172.21.15.173:3300/0 conn(0x7eff901549f0 0x7eff901514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.413+0000 7f2516ffd700 1 -- 172.21.15.72:0/3876611733 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2508010070 con 0x7f2518070a90 2023-07-27T20:31:55.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.413+0000 7f2516ffd700 1 -- 172.21.15.72:0/3876611733 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f250800dcd0 con 0x7f2518070a90 2023-07-27T20:31:55.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.413+0000 7f2516ffd700 1 -- 172.21.15.72:0/3876611733 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2508007cc0 con 0x7f2518070a90 2023-07-27T20:31:55.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.414+0000 7f251e3ff700 1 -- 172.21.15.72:0/3876611733 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2518070a90 msgr2=0x7f2518153f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.414+0000 7f251e3ff700 1 --2- 172.21.15.72:0/3876611733 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2518070a90 0x7f2518153f50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f250800d210 tx=0x7f250800d520 comp rx=0 tx=0).stop 2023-07-27T20:31:55.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.414+0000 7f251e3ff700 1 -- 172.21.15.72:0/3876611733 shutdown_connections 2023-07-27T20:31:55.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.414+0000 7f251e3ff700 1 --2- 172.21.15.72:0/3876611733 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2518070a90 0x7f2518153f50 secure :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f250800d210 tx=0x7f250800d520 comp rx=0 tx=0).stop 2023-07-27T20:31:55.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.414+0000 7f251e3ff700 1 -- 172.21.15.72:0/3876611733 >> 172.21.15.72:0/3876611733 conn(0x7f251806a190 msgr2=0x7f251806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:55.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.415+0000 7f251e3ff700 1 -- 172.21.15.72:0/3876611733 shutdown_connections 2023-07-27T20:31:55.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.414+0000 7eff94d99700 1 -- 172.21.15.72:0/3993860355 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4183105804 0 0) 0x7eff9006b710 con 0x7eff900c4400 2023-07-27T20:31:55.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.414+0000 7eff94d99700 1 -- 172.21.15.72:0/3993860355 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff7c0035b0 con 0x7eff900c4400 2023-07-27T20:31:55.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.414+0000 7eff9659c700 1 -- 172.21.15.72:0/3993860355 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7eff9006b150 msgr2=0x7eff900c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:55.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.414+0000 7eff9659c700 1 --2- 172.21.15.72:0/3993860355 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7eff9006b150 0x7eff900c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.414+0000 7eff9659c700 1 -- 172.21.15.72:0/3993860355 >> v1:172.21.15.173:6789/0 conn(0x7eff900c4400 legacy=0x7eff900c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.414+0000 7eff9659c700 1 -- 172.21.15.72:0/3993860355 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff9006b9f0 con 0x7eff901549f0 2023-07-27T20:31:55.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.415+0000 7eff9659c700 1 --2- 172.21.15.72:0/3993860355 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff901549f0 0x7eff901514a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7eff88009d90 tx=0x7eff8800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5d23f51e530af85 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:55.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.415+0000 7eff94d99700 1 -- 172.21.15.72:0/3993860355 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8800e070 con 0x7eff901549f0 2023-07-27T20:31:55.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.415+0000 7eff94d99700 1 -- 172.21.15.72:0/3993860355 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8800bb20 con 0x7eff901549f0 2023-07-27T20:31:55.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.415+0000 7eff94d99700 1 -- 172.21.15.72:0/3993860355 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff88012430 con 0x7eff901549f0 2023-07-27T20:31:55.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.414+0000 7f76825ff700 1 -- start start 2023-07-27T20:31:55.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.415+0000 7f5035ffb700 1 -- 172.21.15.72:0/2099707654 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f50401f9bb0 con 0x7f504015e020 2023-07-27T20:31:55.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.416+0000 7f251e3ff700 1 -- 172.21.15.72:0/3876611733 wait complete. 2023-07-27T20:31:55.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.416+0000 7f76825ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f767c06b150 0x7f767c0c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.416+0000 7f76825ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f767c06b710 con 0x7f767c0c4400 2023-07-27T20:31:55.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.416+0000 7f76825ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f767c06b9f0 con 0x7f767c1549f0 2023-07-27T20:31:55.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.416+0000 7f76825ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f767c1545d0 con 0x7f767c06b150 2023-07-27T20:31:55.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.416+0000 7eff97fff700 1 -- 172.21.15.72:0/3993860355 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff901549f0 msgr2=0x7eff901514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.416+0000 7eff97fff700 1 --2- 172.21.15.72:0/3993860355 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff901549f0 0x7eff901514a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7eff88009d90 tx=0x7eff8800b330 comp rx=0 tx=0).stop 2023-07-27T20:31:55.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.416+0000 7eff97fff700 1 -- 172.21.15.72:0/3993860355 shutdown_connections 2023-07-27T20:31:55.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.416+0000 7eff97fff700 1 --2- 172.21.15.72:0/3993860355 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff901549f0 0x7eff901514a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.416+0000 7eff97fff700 1 --2- 172.21.15.72:0/3993860355 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7eff9006b150 0x7eff900c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.416+0000 7eff97fff700 1 -- 172.21.15.72:0/3993860355 >> 172.21.15.72:0/3993860355 conn(0x7eff900ab300 msgr2=0x7eff900ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:55.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.411+0000 7fb9da7fc700 1 --2- 172.21.15.72:0/4293813967 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb9c806ade0 0x7fb9c806d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.412+0000 7fb9da7fc700 1 --2- 172.21.15.72:0/4293813967 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb9c806ade0 0x7fb9c806d2a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc14da50 tx=0x7fb9cc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:55.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.417+0000 7f767b7fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f767c06b150 0x7f767c0c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.417+0000 7f767b7fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f767c06b150 0x7f767c0c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.72:48082/0 (socket says 172.21.15.72:48082) 2023-07-27T20:31:55.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.417+0000 7f767b7fe700 1 -- 172.21.15.72:0/2939626692 learned_addr learned my addr 172.21.15.72:0/2939626692 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:55.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.418+0000 7f767b7fe700 1 -- 172.21.15.72:0/2939626692 >> v1:172.21.15.173:6789/0 conn(0x7f767c1549f0 legacy=0x7f767c1514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:55.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.418+0000 7f767b7fe700 1 -- 172.21.15.72:0/2939626692 >> v1:172.21.15.72:6789/0 conn(0x7f767c0c4400 legacy=0x7f767c0c4cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-27T20:31:55.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.418+0000 7f767b7fe700 1 -- 172.21.15.72:0/2939626692 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f767c06bcd0 con 0x7f767c06b150 2023-07-27T20:31:55.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.418+0000 7f251e3ff700 1 Processor -- start 2023-07-27T20:31:55.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.418+0000 7f767b7fe700 1 --2- 172.21.15.72:0/2939626692 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f767c06b150 0x7f767c0c7710 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f766c009920 tx=0x7f766c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d85048f99cb6ebf server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:55.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.418+0000 7fda8bfff700 1 --2- 172.21.15.72:0/454147254 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fda7406b130 0x7fda7406d5f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fda8c0aa4a0 tx=0x7fda80009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:55.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.419+0000 7f251e3ff700 1 -- start start 2023-07-27T20:31:55.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.419+0000 7eff97fff700 1 -- 172.21.15.72:0/3993860355 shutdown_connections 2023-07-27T20:31:55.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.419+0000 7f767affd700 1 -- 172.21.15.72:0/2939626692 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c004230 con 0x7f767c06b150 2023-07-27T20:31:55.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.419+0000 7f767affd700 1 -- 172.21.15.72:0/2939626692 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766c004390 con 0x7f767c06b150 2023-07-27T20:31:55.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.419+0000 7f767affd700 1 -- 172.21.15.72:0/2939626692 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c009e70 con 0x7f767c06b150 2023-07-27T20:31:55.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.420+0000 7f251e3ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2518070e70 0x7f2518152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.420+0000 7f251e3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25180a9040 0x7f25181492b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.420+0000 7f251e3ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25181497f0 0x7f2518146ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.420+0000 7f251e3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25180a9720 con 0x7f25180a9040 2023-07-27T20:31:55.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.420+0000 7f251e3ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25181eefc0 con 0x7f25181497f0 2023-07-27T20:31:55.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.420+0000 7f251e3ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25180ab600 con 0x7f2518070e70 2023-07-27T20:31:55.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.420+0000 7f76825ff700 1 -- 172.21.15.72:0/2939626692 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f767c06b150 msgr2=0x7f767c0c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.420+0000 7f76825ff700 1 --2- 172.21.15.72:0/2939626692 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f767c06b150 0x7f767c0c7710 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f766c009920 tx=0x7f766c009c30 comp rx=0 tx=0).stop 2023-07-27T20:31:55.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.420+0000 7f76825ff700 1 -- 172.21.15.72:0/2939626692 shutdown_connections 2023-07-27T20:31:55.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.420+0000 7f76825ff700 1 --2- 172.21.15.72:0/2939626692 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f767c06b150 0x7f767c0c7710 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f766c009920 tx=0x7f766c009c30 comp rx=0 tx=0).stop 2023-07-27T20:31:55.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.420+0000 7f76825ff700 1 -- 172.21.15.72:0/2939626692 >> 172.21.15.72:0/2939626692 conn(0x7f767c0ab300 msgr2=0x7f767c0ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:55.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.421+0000 7f251c99c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25181497f0 0x7f2518146ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.421+0000 7f251c99c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25181497f0 0x7f2518146ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.72:47048/0 (socket says 172.21.15.72:47048) 2023-07-27T20:31:55.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.421+0000 7f251c99c700 1 -- 172.21.15.72:0/2116851855 learned_addr learned my addr 172.21.15.72:0/2116851855 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:55.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.421+0000 7f251c99c700 1 -- 172.21.15.72:0/2116851855 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2518070e70 msgr2=0x7f2518152520 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-27T20:31:55.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.421+0000 7f251c99c700 1 --2- 172.21.15.72:0/2116851855 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2518070e70 0x7f2518152520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.421+0000 7f251c99c700 1 -- 172.21.15.72:0/2116851855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25180a9040 msgr2=0x7f25181492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.421+0000 7f251c99c700 1 --2- 172.21.15.72:0/2116851855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25180a9040 0x7f25181492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.421+0000 7f251c99c700 1 -- 172.21.15.72:0/2116851855 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2508007910 con 0x7f25181497f0 2023-07-27T20:31:55.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.422+0000 7f504559b700 1 --2- 172.21.15.72:0/2099707654 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f502406adb0 0x7f502406d270 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5030005fd0 tx=0x7f503000d750 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:55.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.422+0000 7f251c99c700 1 --2- 172.21.15.72:0/2116851855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25181497f0 0x7f2518146ff0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f251000c420 tx=0x7f251000c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:55.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.422+0000 7ff6c4ff9700 1 -- 172.21.15.72:0/1185240496 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff6c002d430 con 0x7ff6c814f8f0 2023-07-27T20:31:55.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.422+0000 7f2514ff9700 1 -- 172.21.15.72:0/2116851855 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2510005d70 con 0x7f25181497f0 2023-07-27T20:31:55.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.422+0000 7f2514ff9700 1 -- 172.21.15.72:0/2116851855 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25100070d0 con 0x7f25181497f0 2023-07-27T20:31:55.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.422+0000 7f2514ff9700 1 -- 172.21.15.72:0/2116851855 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2510007460 con 0x7f25181497f0 2023-07-27T20:31:55.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.423+0000 7ff6c4ff9700 1 --2- 172.21.15.72:0/1185240496 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff6b406adb0 0x7ff6b406d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.423+0000 7ff6c4ff9700 1 -- 172.21.15.72:0/1185240496 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff6c008ac90 con 0x7ff6c814f8f0 2023-07-27T20:31:55.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.423+0000 7f251e3ff700 1 -- 172.21.15.72:0/2116851855 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25181ee3b0 con 0x7f25181497f0 2023-07-27T20:31:55.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.423+0000 7f251e3ff700 1 -- 172.21.15.72:0/2116851855 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25181ee970 con 0x7f25181497f0 2023-07-27T20:31:55.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.421+0000 7eff97fff700 1 -- 172.21.15.72:0/3993860355 wait complete. 2023-07-27T20:31:55.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.423+0000 7f76825ff700 1 -- 172.21.15.72:0/2939626692 shutdown_connections 2023-07-27T20:31:55.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.424+0000 7eff97fff700 1 Processor -- start 2023-07-27T20:31:55.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.424+0000 7ff6c7fff700 1 --2- 172.21.15.72:0/1185240496 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff6b406adb0 0x7ff6b406d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.424+0000 7f251e3ff700 1 -- 172.21.15.72:0/2116851855 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2518074310 con 0x7f25181497f0 2023-07-27T20:31:55.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.426+0000 7ff6c4ff9700 1 -- 172.21.15.72:0/1185240496 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff6c0055b70 con 0x7ff6c814f8f0 2023-07-27T20:31:55.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.426+0000 7ff6c7fff700 1 --2- 172.21.15.72:0/1185240496 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff6b406adb0 0x7ff6b406d270 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff6c80a99c0 tx=0x7ff6b8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:55.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.427+0000 7f76825ff700 1 -- 172.21.15.72:0/2939626692 wait complete. 2023-07-27T20:31:55.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.424+0000 7eff97fff700 1 -- start start 2023-07-27T20:31:55.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.426+0000 7eff97fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7eff900c4400 0x7eff9014e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.426+0000 7eff97fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff901549f0 0x7eff901ef440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.426+0000 7eff97fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff900bd460 0x7eff9014abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.426+0000 7eff97fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9014d5b0 con 0x7eff900bd460 2023-07-27T20:31:55.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.426+0000 7eff97fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff900c0980 con 0x7eff901549f0 2023-07-27T20:31:55.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.426+0000 7eff97fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff9014d820 con 0x7eff900c4400 2023-07-27T20:31:55.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.427+0000 7eff9559a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff901549f0 0x7eff901ef440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.427+0000 7eff9659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff900bd460 0x7eff9014abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.427+0000 7eff9659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff900bd460 0x7eff9014abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58614/0 (socket says 172.21.15.72:58614) 2023-07-27T20:31:55.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.427+0000 7eff9659c700 1 -- 172.21.15.72:0/1735409138 learned_addr learned my addr 172.21.15.72:0/1735409138 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:55.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.427+0000 7eff95d9b700 1 --2- 172.21.15.72:0/1735409138 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7eff900c4400 0x7eff9014e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.428+0000 7eff95d9b700 1 -- 172.21.15.72:0/1735409138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff901549f0 msgr2=0x7eff901ef440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.428+0000 7eff95d9b700 1 --2- 172.21.15.72:0/1735409138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff901549f0 0x7eff901ef440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.428+0000 7eff95d9b700 1 -- 172.21.15.72:0/1735409138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff900bd460 msgr2=0x7eff9014abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.428+0000 7eff95d9b700 1 --2- 172.21.15.72:0/1735409138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff900bd460 0x7eff9014abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.428+0000 7eff95d9b700 1 -- 172.21.15.72:0/1735409138 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff88009a70 con 0x7eff900c4400 2023-07-27T20:31:55.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.428+0000 7eff95d9b700 1 --2- 172.21.15.72:0/1735409138 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7eff900c4400 0x7eff9014e020 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7eff8c00c4e0 tx=0x7eff8c00c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:55.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.428+0000 7eff867fc700 1 -- 172.21.15.72:0/1735409138 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c005b70 con 0x7eff900c4400 2023-07-27T20:31:55.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.428+0000 7eff867fc700 1 -- 172.21.15.72:0/1735409138 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8c005cd0 con 0x7eff900c4400 2023-07-27T20:31:55.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.428+0000 7eff867fc700 1 -- 172.21.15.72:0/1735409138 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c0072d0 con 0x7eff900c4400 2023-07-27T20:31:55.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.429+0000 7eff97fff700 1 -- 172.21.15.72:0/1735409138 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff9014db00 con 0x7eff900c4400 2023-07-27T20:31:55.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.429+0000 7eff97fff700 1 -- 172.21.15.72:0/1735409138 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff901ef980 con 0x7eff900c4400 2023-07-27T20:31:55.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.429+0000 7eff9659c700 1 --2- 172.21.15.72:0/1735409138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff900bd460 0x7eff9014abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:31:55.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.430+0000 7f76825ff700 1 Processor -- start 2023-07-27T20:31:55.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.428+0000 7f2514ff9700 1 -- 172.21.15.72:0/2116851855 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f25100075c0 con 0x7f25181497f0 2023-07-27T20:31:55.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.430+0000 7f2514ff9700 1 --2- 172.21.15.72:0/2116851855 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f250406ace0 0x7f250406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.430+0000 7f2514ff9700 1 -- 172.21.15.72:0/2116851855 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2510088ff0 con 0x7f25181497f0 2023-07-27T20:31:55.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.430+0000 7eff9559a700 1 --2- 172.21.15.72:0/1735409138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff901549f0 0x7eff901ef440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:31:55.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.431+0000 7f2517fff700 1 --2- 172.21.15.72:0/2116851855 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f250406ace0 0x7f250406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.431+0000 7fbafcbff700 1 Processor -- start 2023-07-27T20:31:55.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.431+0000 7f76825ff700 1 -- start start 2023-07-27T20:31:55.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.431+0000 7f2514ff9700 1 -- 172.21.15.72:0/2116851855 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2510053e20 con 0x7f25181497f0 2023-07-27T20:31:55.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.431+0000 7fbafcbff700 1 -- start start 2023-07-27T20:31:55.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.432+0000 7f2517fff700 1 --2- 172.21.15.72:0/2116851855 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f250406ace0 0x7f250406d1a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f251806b170 tx=0x7f2508012000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:55.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.432+0000 7f76825ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f767c0c4400 0x7f767c14aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.432+0000 7f76825ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f767c1549f0 0x7f767c0aa560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.432+0000 7f76825ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f767c1ef620 0x7f767c1efad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.432+0000 7f76825ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767c149460 con 0x7f767c1549f0 2023-07-27T20:31:55.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.432+0000 7f76825ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767c153ae0 con 0x7f767c0c4400 2023-07-27T20:31:55.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.432+0000 7f76825ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f767c1ef120 con 0x7f767c1ef620 2023-07-27T20:31:55.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.433+0000 7f767b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f767c1549f0 0x7f767c0aa560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.433+0000 7f767b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f767c1549f0 0x7f767c0aa560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58616/0 (socket says 172.21.15.72:58616) 2023-07-27T20:31:55.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.433+0000 7f767b7fe700 1 -- 172.21.15.72:0/875528813 learned_addr learned my addr 172.21.15.72:0/875528813 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:55.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.434+0000 7f7680b9c700 1 --2- 172.21.15.72:0/875528813 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f767c1ef620 0x7f767c1efad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.434+0000 7f767b7fe700 1 -- 172.21.15.72:0/875528813 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f767c1ef620 msgr2=0x7f767c1efad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.434+0000 7f767b7fe700 1 --2- 172.21.15.72:0/875528813 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f767c1ef620 0x7f767c1efad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.434+0000 7f767b7fe700 1 -- 172.21.15.72:0/875528813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f767c0c4400 msgr2=0x7f767c14aa70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-27T20:31:55.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.434+0000 7f767b7fe700 1 --2- 172.21.15.72:0/875528813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f767c0c4400 0x7f767c14aa70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.434+0000 7f767b7fe700 1 -- 172.21.15.72:0/875528813 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f766c009550 con 0x7f767c1549f0 2023-07-27T20:31:55.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.432+0000 7eff97fff700 1 -- 172.21.15.72:0/1735409138 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff780052f0 con 0x7eff900c4400 2023-07-27T20:31:55.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.435+0000 7eff867fc700 1 -- 172.21.15.72:0/1735409138 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7eff8c007430 con 0x7eff900c4400 2023-07-27T20:31:55.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.435+0000 7f767b7fe700 1 --2- 172.21.15.72:0/875528813 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f767c1549f0 0x7f767c0aa560 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f766c009870 tx=0x7f766c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:55.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.435+0000 7f7678ff9700 1 -- 172.21.15.72:0/875528813 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c00be60 con 0x7f767c1549f0 2023-07-27T20:31:55.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.435+0000 7f7678ff9700 1 -- 172.21.15.72:0/875528813 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766c0036a0 con 0x7f767c1549f0 2023-07-27T20:31:55.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.435+0000 7f7678ff9700 1 -- 172.21.15.72:0/875528813 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c003a50 con 0x7f767c1549f0 2023-07-27T20:31:55.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.436+0000 7f76825ff700 1 -- 172.21.15.72:0/875528813 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f767c14a3b0 con 0x7f767c1549f0 2023-07-27T20:31:55.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.436+0000 7f76825ff700 1 -- 172.21.15.72:0/875528813 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f767c1496e0 con 0x7f767c1549f0 2023-07-27T20:31:55.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.435+0000 7fbafcbff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbaf8070a90 0x7fbaf8153f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.435+0000 7fbafcbff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbaf80c2390 0x7fbaf8070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.435+0000 7fbafcbff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbaf81509d0 0x7fbaf80c0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.435+0000 7fbafcbff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaf8071820 con 0x7fbaf81509d0 2023-07-27T20:31:55.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.435+0000 7fbafcbff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaf80c2de0 con 0x7fbaf80c2390 2023-07-27T20:31:55.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.435+0000 7fbafcbff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf8153540 con 0x7fbaf8070a90 2023-07-27T20:31:55.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.436+0000 7fbaeffff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbaf80c2390 0x7fbaf8070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.436+0000 7fbaeffff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbaf80c2390 0x7fbaf8070e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.72:47076/0 (socket says 172.21.15.72:47076) 2023-07-27T20:31:55.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.436+0000 7fbaeffff700 1 -- 172.21.15.72:0/1675128943 learned_addr learned my addr 172.21.15.72:0/1675128943 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:55.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.436+0000 7fbaeffff700 1 -- 172.21.15.72:0/1675128943 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbaf8070a90 msgr2=0x7fbaf8153f50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-27T20:31:55.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.436+0000 7fbaeffff700 1 --2- 172.21.15.72:0/1675128943 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbaf8070a90 0x7fbaf8153f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.436+0000 7fbaeffff700 1 -- 172.21.15.72:0/1675128943 >> v2:172.21.15.72:3300/0 conn(0x7fbaf81509d0 msgr2=0x7fbaf80c0450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-27T20:31:55.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.436+0000 7fbaeffff700 1 --2- 172.21.15.72:0/1675128943 >> v2:172.21.15.72:3300/0 conn(0x7fbaf81509d0 0x7fbaf80c0450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.436+0000 7fbaeffff700 1 -- 172.21.15.72:0/1675128943 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf80bffd0 con 0x7fbaf80c2390 2023-07-27T20:31:55.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.437+0000 7fbaeffff700 1 --2- 172.21.15.72:0/1675128943 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbaf80c2390 0x7fbaf8070e70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbaf806b250 tx=0x7fbae8008bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3f62b9a1d7bc203 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:55.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.436+0000 7eff867fc700 1 --2- 172.21.15.72:0/1735409138 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7eff7c06b160 0x7eff7c06d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.436+0000 7eff867fc700 1 -- 172.21.15.72:0/1735409138 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7eff8c0aa910 con 0x7eff900c4400 2023-07-27T20:31:55.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.437+0000 7eff9559a700 1 --2- 172.21.15.72:0/1735409138 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7eff7c06b160 0x7eff7c06d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.438+0000 7fbaf5d9b700 1 -- 172.21.15.72:0/1675128943 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae800b820 con 0x7fbaf80c2390 2023-07-27T20:31:55.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.438+0000 7fbaf5d9b700 1 -- 172.21.15.72:0/1675128943 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae800b980 con 0x7fbaf80c2390 2023-07-27T20:31:55.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.438+0000 7fbaf5d9b700 1 -- 172.21.15.72:0/1675128943 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae80126f0 con 0x7fbaf80c2390 2023-07-27T20:31:55.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.438+0000 7eff9559a700 1 --2- 172.21.15.72:0/1735409138 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7eff7c06b160 0x7eff7c06d620 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7eff90151f60 tx=0x7eff80009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:55.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.439+0000 7fbafcbff700 1 -- 172.21.15.72:0/1675128943 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbaf80c2390 msgr2=0x7fbaf8070e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.439+0000 7fbafcbff700 1 --2- 172.21.15.72:0/1675128943 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbaf80c2390 0x7fbaf8070e70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbaf806b250 tx=0x7fbae8008bd0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.439+0000 7fbafcbff700 1 -- 172.21.15.72:0/1675128943 shutdown_connections 2023-07-27T20:31:55.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.439+0000 7fbafcbff700 1 --2- 172.21.15.72:0/1675128943 >> v2:172.21.15.72:3300/0 conn(0x7fbaf81509d0 0x7fbaf80c0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.439+0000 7fbafcbff700 1 --2- 172.21.15.72:0/1675128943 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbaf8070a90 0x7fbaf8153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.439+0000 7fbafcbff700 1 --2- 172.21.15.72:0/1675128943 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbaf80c2390 0x7fbaf8070e70 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.439+0000 7fbafcbff700 1 -- 172.21.15.72:0/1675128943 >> 172.21.15.72:0/1675128943 conn(0x7fbaf806a190 msgr2=0x7fbaf806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:55.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.440+0000 7f7678ff9700 1 -- 172.21.15.72:0/875528813 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f766c022070 con 0x7f767c1549f0 2023-07-27T20:31:55.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.440+0000 7eff867fc700 1 -- 172.21.15.72:0/1735409138 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7eff8c0757f0 con 0x7eff900c4400 2023-07-27T20:31:55.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.441+0000 7f76825ff700 1 -- 172.21.15.72:0/875528813 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f767c1ef260 con 0x7f767c1549f0 2023-07-27T20:31:55.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.442+0000 7fbafcbff700 1 -- 172.21.15.72:0/1675128943 shutdown_connections 2023-07-27T20:31:55.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.442+0000 7fbafcbff700 1 -- 172.21.15.72:0/1675128943 wait complete. 2023-07-27T20:31:55.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.442+0000 7f7678ff9700 1 --2- 172.21.15.72:0/875528813 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f766806ade0 0x7f766806d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.442+0000 7f7678ff9700 1 -- 172.21.15.72:0/875528813 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f766c08b220 con 0x7f767c1549f0 2023-07-27T20:31:55.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.447+0000 7f767bfff700 1 --2- 172.21.15.72:0/875528813 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f766806ade0 0x7f766806d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.445+0000 7fbafcbff700 1 Processor -- start 2023-07-27T20:31:55.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.445+0000 7fbafcbff700 1 -- start start 2023-07-27T20:31:55.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.446+0000 7fbafcbff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbaf81509d0 0x7fbaf8141690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.446+0000 7fbafcbff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbaf81494b0 0x7fbaf813c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.446+0000 7fbafcbff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbaf80c4db0 0x7fbaf80a90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.446+0000 7fbafcbff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf8089800 con 0x7fbaf81494b0 2023-07-27T20:31:55.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.446+0000 7fbafcbff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf80ab2f0 con 0x7fbaf81509d0 2023-07-27T20:31:55.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.446+0000 7fbafcbff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf80aafc0 con 0x7fbaf80c4db0 2023-07-27T20:31:55.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.447+0000 7fbaf6d9d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbaf80c4db0 0x7fbaf80a90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.447+0000 7fbaf6d9d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbaf80c4db0 0x7fbaf80a90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.72:48108/0 (socket says 172.21.15.72:48108) 2023-07-27T20:31:55.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.447+0000 7fbaf6d9d700 1 -- 172.21.15.72:0/3381402371 learned_addr learned my addr 172.21.15.72:0/3381402371 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:55.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.447+0000 7fbaf659c700 1 --2- 172.21.15.72:0/3381402371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbaf81509d0 0x7fbaf8141690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.450+0000 7fbaf6d9d700 1 -- 172.21.15.72:0/3381402371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbaf81509d0 msgr2=0x7fbaf8141690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.450+0000 7fbaf6d9d700 1 --2- 172.21.15.72:0/3381402371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbaf81509d0 0x7fbaf8141690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.450+0000 7fbaf6d9d700 1 -- 172.21.15.72:0/3381402371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbaf81494b0 msgr2=0x7fbaf813c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.450+0000 7fbaf6d9d700 1 --2- 172.21.15.72:0/3381402371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbaf81494b0 0x7fbaf813c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.450+0000 7fbaf6d9d700 1 -- 172.21.15.72:0/3381402371 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae80085d0 con 0x7fbaf80c4db0 2023-07-27T20:31:55.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.450+0000 7fbaf6d9d700 1 --2- 172.21.15.72:0/3381402371 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbaf80c4db0 0x7fbaf80a90d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbaf000b970 tx=0x7fbaf000bc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:55.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.452+0000 7f767bfff700 1 --2- 172.21.15.72:0/875528813 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f766806ade0 0x7f766806d2a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7670009710 tx=0x7f7670006c60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:55.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.453+0000 7f7678ff9700 1 -- 172.21.15.72:0/875528813 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f766c056130 con 0x7f767c1549f0 2023-07-27T20:31:55.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.454+0000 7fbaeeffd700 1 -- 172.21.15.72:0/3381402371 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf000d8e0 con 0x7fbaf80c4db0 2023-07-27T20:31:55.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.454+0000 7fbaeeffd700 1 -- 172.21.15.72:0/3381402371 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf000da60 con 0x7fbaf80c4db0 2023-07-27T20:31:55.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.454+0000 7fbaeeffd700 1 -- 172.21.15.72:0/3381402371 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf000de50 con 0x7fbaf80c4db0 2023-07-27T20:31:55.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.454+0000 7fbafcbff700 1 -- 172.21.15.72:0/3381402371 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaf8089a50 con 0x7fbaf80c4db0 2023-07-27T20:31:55.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.454+0000 7fbafcbff700 1 -- 172.21.15.72:0/3381402371 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaf8141bd0 con 0x7fbaf80c4db0 2023-07-27T20:31:55.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.458+0000 7fbaeeffd700 1 -- 172.21.15.72:0/3381402371 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbaf0015420 con 0x7fbaf80c4db0 2023-07-27T20:31:55.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.459+0000 7fbaeeffd700 1 --2- 172.21.15.72:0/3381402371 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fbad806adb0 0x7fbad806d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:55.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.460+0000 7fbaeeffd700 1 -- 172.21.15.72:0/3381402371 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbaf0011070 con 0x7fbaf80c4db0 2023-07-27T20:31:55.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.461+0000 7fbaf659c700 1 --2- 172.21.15.72:0/3381402371 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fbad806adb0 0x7fbad806d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:55.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.461+0000 7fbaf659c700 1 --2- 172.21.15.72:0/3381402371 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fbad806adb0 0x7fbad806d270 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbaf806b1f0 tx=0x7fbae0009110 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:55.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.462+0000 7fbafcbff700 1 -- 172.21.15.72:0/3381402371 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaf80c1880 con 0x7fbaf80c4db0 2023-07-27T20:31:55.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.468+0000 7fbaeeffd700 1 -- 172.21.15.72:0/3381402371 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbaf004e310 con 0x7fbaf80c4db0 2023-07-27T20:31:55.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.859+0000 7fb9e19ff700 1 -- 172.21.15.72:0/4293813967 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb9dc0bf820 con 0x7fb9c4004bf0 2023-07-27T20:31:55.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.863+0000 7fb9c3fff700 1 -- 172.21.15.72:0/4293813967 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb9d0058d40 con 0x7fb9c4004bf0 2023-07-27T20:31:55.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.866+0000 7ff6ce9ff700 1 -- 172.21.15.72:0/1185240496 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff6a8005870 con 0x7ff6c814f8f0 2023-07-27T20:31:55.853 INFO:teuthology.orchestra.run.smithi072.stdout:55834574858 2023-07-27T20:31:55.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.867+0000 7ff6c4ff9700 1 -- 172.21.15.72:0/1185240496 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff6c0004880 con 0x7ff6c814f8f0 2023-07-27T20:31:55.855 INFO:teuthology.orchestra.run.smithi072.stdout:55834574858 2023-07-27T20:31:55.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.867+0000 7fb9e19ff700 1 -- 172.21.15.72:0/4293813967 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb9c806ade0 msgr2=0x7fb9c806d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.867+0000 7fb9e19ff700 1 --2- 172.21.15.72:0/4293813967 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb9c806ade0 0x7fb9c806d2a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc14da50 tx=0x7fb9cc009040 comp rx=0 tx=0).stop 2023-07-27T20:31:55.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.867+0000 7fb9e19ff700 1 -- 172.21.15.72:0/4293813967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9c4004bf0 msgr2=0x7fb9dc0aa8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.867+0000 7fb9e19ff700 1 --2- 172.21.15.72:0/4293813967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9c4004bf0 0x7fb9dc0aa8f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0014040 tx=0x7fb9d00018b0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.868+0000 7fb9e19ff700 1 -- 172.21.15.72:0/4293813967 shutdown_connections 2023-07-27T20:31:55.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.868+0000 7fb9e19ff700 1 --2- 172.21.15.72:0/4293813967 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9dc0c5670 0x7fb9dc0a8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.868+0000 7fb9e19ff700 1 --2- 172.21.15.72:0/4293813967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9c4004bf0 0x7fb9dc0aa8f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.868+0000 7fb9e19ff700 1 --2- 172.21.15.72:0/4293813967 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb9c806ade0 0x7fb9c806d2a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.868+0000 7fb9e19ff700 1 --2- 172.21.15.72:0/4293813967 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9dc1531d0 0x7fb9dc0c5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.868+0000 7fb9e19ff700 1 -- 172.21.15.72:0/4293813967 >> 172.21.15.72:0/4293813967 conn(0x7fb9dc06a190 msgr2=0x7fb9dc070a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:55.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.869+0000 7fb9e19ff700 1 -- 172.21.15.72:0/4293813967 shutdown_connections 2023-07-27T20:31:55.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.869+0000 7fb9e19ff700 1 -- 172.21.15.72:0/4293813967 wait complete. 2023-07-27T20:31:55.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.870+0000 7fda92bff700 1 -- 172.21.15.72:0/454147254 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fda8c074310 con 0x7fda8c06ad20 2023-07-27T20:31:55.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.870+0000 7fda897fa700 1 -- 172.21.15.72:0/454147254 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fda7c017020 con 0x7fda8c06ad20 2023-07-27T20:31:55.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.871+0000 7ff6ce9ff700 1 -- 172.21.15.72:0/1185240496 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff6b406adb0 msgr2=0x7ff6b406d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.871+0000 7ff6ce9ff700 1 --2- 172.21.15.72:0/1185240496 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff6b406adb0 0x7ff6b406d270 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff6c80a99c0 tx=0x7ff6b8008040 comp rx=0 tx=0).stop 2023-07-27T20:31:55.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.871+0000 7ff6ce9ff700 1 -- 172.21.15.72:0/1185240496 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6c814f8f0 msgr2=0x7ff6c8136dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.871+0000 7ff6ce9ff700 1 --2- 172.21.15.72:0/1185240496 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6c814f8f0 0x7ff6c8136dc0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8072640 tx=0x7ff6c0004ad0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.871+0000 7ff6ce9ff700 1 -- 172.21.15.72:0/1185240496 shutdown_connections 2023-07-27T20:31:55.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.871+0000 7ff6ce9ff700 1 --2- 172.21.15.72:0/1185240496 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6c814f8f0 0x7ff6c8136dc0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.871+0000 7ff6ce9ff700 1 --2- 172.21.15.72:0/1185240496 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6c806ad20 0x7ff6c81495f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.871+0000 7ff6ce9ff700 1 --2- 172.21.15.72:0/1185240496 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff6b406adb0 0x7ff6b406d270 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.871+0000 7ff6ce9ff700 1 --2- 172.21.15.72:0/1185240496 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6c81509d0 0x7ff6c814f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.871+0000 7ff6ce9ff700 1 -- 172.21.15.72:0/1185240496 >> 172.21.15.72:0/1185240496 conn(0x7ff6c806a190 msgr2=0x7ff6c8150050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:55.860 INFO:teuthology.orchestra.run.smithi072.stdout:55834574856 2023-07-27T20:31:55.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.873+0000 7f50477ff700 1 -- 172.21.15.72:0/2099707654 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f50401f9bb0 con 0x7f504015e020 2023-07-27T20:31:55.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.873+0000 7ff6ce9ff700 1 -- 172.21.15.72:0/1185240496 shutdown_connections 2023-07-27T20:31:55.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.873+0000 7ff6ce9ff700 1 -- 172.21.15.72:0/1185240496 wait complete. 2023-07-27T20:31:55.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.873+0000 7fda92bff700 1 -- 172.21.15.72:0/454147254 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fda7406b130 msgr2=0x7fda7406d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.873+0000 7fda92bff700 1 --2- 172.21.15.72:0/454147254 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fda7406b130 0x7fda7406d5f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fda8c0aa4a0 tx=0x7fda80009040 comp rx=0 tx=0).stop 2023-07-27T20:31:55.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.873+0000 7fda92bff700 1 -- 172.21.15.72:0/454147254 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fda8c06ad20 msgr2=0x7fda8c0c48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.873+0000 7fda92bff700 1 --2- 172.21.15.72:0/454147254 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fda8c06ad20 0x7fda8c0c48e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fda7c00c520 tx=0x7fda7c00c8e0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.874+0000 7fda92bff700 1 -- 172.21.15.72:0/454147254 shutdown_connections 2023-07-27T20:31:55.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.874+0000 7fda92bff700 1 --2- 172.21.15.72:0/454147254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda8c0a8d30 0x7fda8c1f1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.874+0000 7fda92bff700 1 --2- 172.21.15.72:0/454147254 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fda7406b130 0x7fda7406d5f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.874+0000 7fda92bff700 1 --2- 172.21.15.72:0/454147254 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fda8c06ad20 0x7fda8c0c48e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.874+0000 7fda92bff700 1 --2- 172.21.15.72:0/454147254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda8c153f50 0x7fda8c0a87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.874+0000 7fda92bff700 1 -- 172.21.15.72:0/454147254 >> 172.21.15.72:0/454147254 conn(0x7fda8c06a190 msgr2=0x7fda8c14f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:55.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.873+0000 7f5035ffb700 1 -- 172.21.15.72:0/2099707654 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f50401f9bb0 con 0x7f504015e020 2023-07-27T20:31:55.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.874+0000 7fda92bff700 1 -- 172.21.15.72:0/454147254 shutdown_connections 2023-07-27T20:31:55.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.874+0000 7fda92bff700 1 -- 172.21.15.72:0/454147254 wait complete. 2023-07-27T20:31:55.865 INFO:teuthology.orchestra.run.smithi072.stdout:55834574858 2023-07-27T20:31:55.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.878+0000 7f50477ff700 1 -- 172.21.15.72:0/2099707654 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f502406adb0 msgr2=0x7f502406d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.878+0000 7f50477ff700 1 --2- 172.21.15.72:0/2099707654 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f502406adb0 0x7f502406d270 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5030005fd0 tx=0x7f503000d750 comp rx=0 tx=0).stop 2023-07-27T20:31:55.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.878+0000 7f50477ff700 1 -- 172.21.15.72:0/2099707654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f504015e020 msgr2=0x7f50400aa400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.878+0000 7f50477ff700 1 --2- 172.21.15.72:0/2099707654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f504015e020 0x7f50400aa400 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f503c0077e0 tx=0x7f503c007af0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.884+0000 7f50477ff700 1 -- 172.21.15.72:0/2099707654 shutdown_connections 2023-07-27T20:31:55.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.884+0000 7f50477ff700 1 --2- 172.21.15.72:0/2099707654 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50400aa940 0x7f504015cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.884+0000 7f50477ff700 1 --2- 172.21.15.72:0/2099707654 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f502406adb0 0x7f502406d270 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.884+0000 7f50477ff700 1 --2- 172.21.15.72:0/2099707654 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f502c007420 0x7f50401f9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.884+0000 7f50477ff700 1 --2- 172.21.15.72:0/2099707654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f504015e020 0x7f50400aa400 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.884+0000 7f50477ff700 1 -- 172.21.15.72:0/2099707654 >> 172.21.15.72:0/2099707654 conn(0x7f504006a190 msgr2=0x7f50400c0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:55.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.884+0000 7f50477ff700 1 -- 172.21.15.72:0/2099707654 shutdown_connections 2023-07-27T20:31:55.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.884+0000 7f50477ff700 1 -- 172.21.15.72:0/2099707654 wait complete. 2023-07-27T20:31:55.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.883+0000 7eff97fff700 1 -- 172.21.15.72:0/1735409138 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7eff78005870 con 0x7eff900c4400 2023-07-27T20:31:55.879 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2023-07-27T20:31:55.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.890+0000 7f251e3ff700 1 -- 172.21.15.72:0/2116851855 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f25180c1880 con 0x7f25181497f0 2023-07-27T20:31:55.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.891+0000 7f2514ff9700 1 -- 172.21.15.72:0/2116851855 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f25180c1880 con 0x7f25181497f0 2023-07-27T20:31:55.880 INFO:teuthology.orchestra.run.smithi072.stdout:55834574858 2023-07-27T20:31:55.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.887+0000 7eff867fc700 1 -- 172.21.15.72:0/1735409138 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7eff8c078e10 con 0x7eff900c4400 2023-07-27T20:31:55.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.891+0000 7eff97fff700 1 -- 172.21.15.72:0/1735409138 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7eff7c06b160 msgr2=0x7eff7c06d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.891+0000 7eff97fff700 1 --2- 172.21.15.72:0/1735409138 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7eff7c06b160 0x7eff7c06d620 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7eff90151f60 tx=0x7eff80009210 comp rx=0 tx=0).stop 2023-07-27T20:31:55.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.891+0000 7eff97fff700 1 -- 172.21.15.72:0/1735409138 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7eff900c4400 msgr2=0x7eff9014e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.891+0000 7eff97fff700 1 --2- 172.21.15.72:0/1735409138 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7eff900c4400 0x7eff9014e020 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7eff8c00c4e0 tx=0x7eff8c00c7f0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.892+0000 7eff97fff700 1 -- 172.21.15.72:0/1735409138 shutdown_connections 2023-07-27T20:31:55.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.892+0000 7eff97fff700 1 --2- 172.21.15.72:0/1735409138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff900bd460 0x7eff9014abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.892+0000 7eff97fff700 1 --2- 172.21.15.72:0/1735409138 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7eff7c06b160 0x7eff7c06d620 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.892+0000 7eff97fff700 1 --2- 172.21.15.72:0/1735409138 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7eff900c4400 0x7eff9014e020 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.892+0000 7eff97fff700 1 --2- 172.21.15.72:0/1735409138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff901549f0 0x7eff901ef440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.892+0000 7eff97fff700 1 -- 172.21.15.72:0/1735409138 >> 172.21.15.72:0/1735409138 conn(0x7eff900ab300 msgr2=0x7eff900ab6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:55.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.892+0000 7eff97fff700 1 -- 172.21.15.72:0/1735409138 shutdown_connections 2023-07-27T20:31:55.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.892+0000 7eff97fff700 1 -- 172.21.15.72:0/1735409138 wait complete. 2023-07-27T20:31:55.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.896+0000 7f251e3ff700 1 -- 172.21.15.72:0/2116851855 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f250406ace0 msgr2=0x7f250406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.896+0000 7f251e3ff700 1 --2- 172.21.15.72:0/2116851855 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f250406ace0 0x7f250406d1a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f251806b170 tx=0x7f2508012000 comp rx=0 tx=0).stop 2023-07-27T20:31:55.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.896+0000 7f251e3ff700 1 -- 172.21.15.72:0/2116851855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25181497f0 msgr2=0x7f2518146ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.896+0000 7f251e3ff700 1 --2- 172.21.15.72:0/2116851855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25181497f0 0x7f2518146ff0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f251000c420 tx=0x7f251000c7e0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.896+0000 7f251e3ff700 1 -- 172.21.15.72:0/2116851855 shutdown_connections 2023-07-27T20:31:55.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.896+0000 7f251e3ff700 1 --2- 172.21.15.72:0/2116851855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25181497f0 0x7f2518146ff0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.896+0000 7f251e3ff700 1 --2- 172.21.15.72:0/2116851855 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f250406ace0 0x7f250406d1a0 secure :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f251806b170 tx=0x7f2508012000 comp rx=0 tx=0).stop 2023-07-27T20:31:55.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.896+0000 7f251e3ff700 1 --2- 172.21.15.72:0/2116851855 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2518070e70 0x7f2518152520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.896+0000 7f251e3ff700 1 --2- 172.21.15.72:0/2116851855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25180a9040 0x7f25181492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.896+0000 7f251e3ff700 1 -- 172.21.15.72:0/2116851855 >> 172.21.15.72:0/2116851855 conn(0x7f251806a190 msgr2=0x7f251814ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:55.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.897+0000 7f251e3ff700 1 -- 172.21.15.72:0/2116851855 shutdown_connections 2023-07-27T20:31:55.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.897+0000 7f251e3ff700 1 -- 172.21.15.72:0/2116851855 wait complete. 2023-07-27T20:31:55.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.899+0000 7f76825ff700 1 -- 172.21.15.72:0/875528813 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f767c074310 con 0x7f767c1549f0 2023-07-27T20:31:55.889 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574858 for osd.1 2023-07-27T20:31:55.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.901+0000 7f7678ff9700 1 -- 172.21.15.72:0/875528813 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f766c059750 con 0x7f767c1549f0 2023-07-27T20:31:55.889 INFO:teuthology.orchestra.run.smithi072.stdout:55834574858 2023-07-27T20:31:55.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.905+0000 7f76825ff700 1 -- 172.21.15.72:0/875528813 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f766806ade0 msgr2=0x7f766806d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.905+0000 7f76825ff700 1 --2- 172.21.15.72:0/875528813 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f766806ade0 0x7f766806d2a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7670009710 tx=0x7f7670006c60 comp rx=0 tx=0).stop 2023-07-27T20:31:55.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.906+0000 7f76825ff700 1 -- 172.21.15.72:0/875528813 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f767c1549f0 msgr2=0x7f767c0aa560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.906+0000 7f76825ff700 1 --2- 172.21.15.72:0/875528813 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f767c1549f0 0x7f767c0aa560 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f766c009870 tx=0x7f766c004750 comp rx=0 tx=0).stop 2023-07-27T20:31:55.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.906+0000 7fbafcbff700 1 -- 172.21.15.72:0/3381402371 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fbaf80ab4a0 con 0x7fbaf80c4db0 2023-07-27T20:31:55.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.906+0000 7fbaeeffd700 1 -- 172.21.15.72:0/3381402371 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbaf80ab4a0 con 0x7fbaf80c4db0 2023-07-27T20:31:55.894 INFO:teuthology.orchestra.run.smithi072.stdout:55834574858 2023-07-27T20:31:55.896 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574858 for osd.0 2023-07-27T20:31:55.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.909+0000 7fbafcbff700 1 -- 172.21.15.72:0/3381402371 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fbad806adb0 msgr2=0x7fbad806d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.909+0000 7fbafcbff700 1 --2- 172.21.15.72:0/3381402371 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fbad806adb0 0x7fbad806d270 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbaf806b1f0 tx=0x7fbae0009110 comp rx=0 tx=0).stop 2023-07-27T20:31:55.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.909+0000 7fbafcbff700 1 -- 172.21.15.72:0/3381402371 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbaf80c4db0 msgr2=0x7fbaf80a90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:55.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.909+0000 7fbafcbff700 1 --2- 172.21.15.72:0/3381402371 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbaf80c4db0 0x7fbaf80a90d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbaf000b970 tx=0x7fbaf000bc80 comp rx=0 tx=0).stop 2023-07-27T20:31:55.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.909+0000 7fbafcbff700 1 -- 172.21.15.72:0/3381402371 shutdown_connections 2023-07-27T20:31:55.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.909+0000 7fbafcbff700 1 --2- 172.21.15.72:0/3381402371 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fbad806adb0 0x7fbad806d270 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.909+0000 7fbafcbff700 1 --2- 172.21.15.72:0/3381402371 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbaf80c4db0 0x7fbaf80a90d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.909+0000 7fbafcbff700 1 --2- 172.21.15.72:0/3381402371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbaf81509d0 0x7fbaf8141690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.909+0000 7fbafcbff700 1 --2- 172.21.15.72:0/3381402371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbaf81494b0 0x7fbaf813c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.909+0000 7fbafcbff700 1 -- 172.21.15.72:0/3381402371 >> 172.21.15.72:0/3381402371 conn(0x7fbaf806a190 msgr2=0x7fbaf8152d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:55.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.909+0000 7f76825ff700 1 -- 172.21.15.72:0/875528813 shutdown_connections 2023-07-27T20:31:55.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.909+0000 7f76825ff700 1 --2- 172.21.15.72:0/875528813 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f766806ade0 0x7f766806d2a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.909+0000 7f76825ff700 1 --2- 172.21.15.72:0/875528813 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f767c1ef620 0x7f767c1efad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.909+0000 7f76825ff700 1 --2- 172.21.15.72:0/875528813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f767c0c4400 0x7f767c14aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.909+0000 7f76825ff700 1 --2- 172.21.15.72:0/875528813 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f767c1549f0 0x7f767c0aa560 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:55.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.909+0000 7f76825ff700 1 -- 172.21.15.72:0/875528813 >> 172.21.15.72:0/875528813 conn(0x7f767c0ab300 msgr2=0x7f767c14f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:55.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.910+0000 7fbafcbff700 1 -- 172.21.15.72:0/3381402371 shutdown_connections 2023-07-27T20:31:55.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.910+0000 7fbafcbff700 1 -- 172.21.15.72:0/3381402371 wait complete. 2023-07-27T20:31:55.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.910+0000 7f76825ff700 1 -- 172.21.15.72:0/875528813 shutdown_connections 2023-07-27T20:31:55.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:55.910+0000 7f76825ff700 1 -- 172.21.15.72:0/875528813 wait complete. 2023-07-27T20:31:55.905 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.4 2023-07-27T20:31:55.907 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574858 for osd.2 2023-07-27T20:31:55.908 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574858 for osd.5 2023-07-27T20:31:55.917 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.3 2023-07-27T20:31:55.921 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574858 for osd.6 2023-07-27T20:31:55.926 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574858 for osd.7 2023-07-27T20:31:56.890 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-27T20:31:56.897 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-27T20:31:56.906 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-27T20:31:56.907 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-27T20:31:56.909 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-27T20:31:56.918 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-27T20:31:56.922 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-27T20:31:56.928 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-27T20:31:57.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.222+0000 7f09b57ff700 1 Processor -- start 2023-07-27T20:31:57.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.222+0000 7f09b57ff700 1 -- start start 2023-07-27T20:31:57.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.224+0000 7f09b57ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f09b00c24c0 0x7f09b01556d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.224+0000 7f09b57ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09b00c1750 0x7f09b00c0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.224+0000 7f09b57ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f09b0155c10 0x7f09b00c0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.224+0000 7f09b57ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09b006d100 con 0x7f09b0155c10 2023-07-27T20:31:57.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.224+0000 7f09b57ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09b00bfd90 con 0x7f09b00c24c0 2023-07-27T20:31:57.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.224+0000 7f09b57ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b0158860 con 0x7f09b00c1750 2023-07-27T20:31:57.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.226+0000 7f09aeffd700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f09b00c24c0 0x7f09b01556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.226+0000 7f09af7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f09b0155c10 0x7f09b00c0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.226+0000 7f09af7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f09b0155c10 0x7f09b00c0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58638/0 (socket says 172.21.15.72:58638) 2023-07-27T20:31:57.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.226+0000 7f09af7fe700 1 -- 172.21.15.72:0/306094716 learned_addr learned my addr 172.21.15.72:0/306094716 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:57.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.227+0000 7f09af7fe700 1 -- 172.21.15.72:0/306094716 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09b00c1750 msgr2=0x7f09b00c0220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-27T20:31:57.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.227+0000 7f09af7fe700 1 --2- 172.21.15.72:0/306094716 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09b00c1750 0x7f09b00c0220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.227+0000 7f09af7fe700 1 -- 172.21.15.72:0/306094716 >> v2:172.21.15.173:3300/0 conn(0x7f09b00c24c0 msgr2=0x7f09b01556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:57.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.227+0000 7f09af7fe700 1 --2- 172.21.15.72:0/306094716 >> v2:172.21.15.173:3300/0 conn(0x7f09b00c24c0 0x7f09b01556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.227+0000 7f09af7fe700 1 -- 172.21.15.72:0/306094716 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b0158b40 con 0x7f09b0155c10 2023-07-27T20:31:57.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.228+0000 7f09af7fe700 1 --2- 172.21.15.72:0/306094716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09b0155c10 0x7f09b00c0760 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f09b006e9c0 tx=0x7f09a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e2e5fe9f47ee570 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:57.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.228+0000 7f09adffb700 1 -- 172.21.15.72:0/306094716 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a800e070 con 0x7f09b0155c10 2023-07-27T20:31:57.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.229+0000 7f09adffb700 1 -- 172.21.15.72:0/306094716 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a800b9c0 con 0x7f09b0155c10 2023-07-27T20:31:57.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.229+0000 7f09adffb700 1 -- 172.21.15.72:0/306094716 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a800bd70 con 0x7f09b0155c10 2023-07-27T20:31:57.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.230+0000 7f09b57ff700 1 -- 172.21.15.72:0/306094716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09b0155c10 msgr2=0x7f09b00c0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.230+0000 7f09b57ff700 1 --2- 172.21.15.72:0/306094716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09b0155c10 0x7f09b00c0760 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f09b006e9c0 tx=0x7f09a800b330 comp rx=0 tx=0).stop 2023-07-27T20:31:57.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.230+0000 7f09b57ff700 1 -- 172.21.15.72:0/306094716 shutdown_connections 2023-07-27T20:31:57.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.230+0000 7f09b57ff700 1 --2- 172.21.15.72:0/306094716 >> v2:172.21.15.173:3300/0 conn(0x7f09b00c24c0 0x7f09b01556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.230+0000 7f09b57ff700 1 --2- 172.21.15.72:0/306094716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09b0155c10 0x7f09b00c0760 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.230+0000 7f09b57ff700 1 --2- 172.21.15.72:0/306094716 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09b00c1750 0x7f09b00c0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.230+0000 7f09b57ff700 1 -- 172.21.15.72:0/306094716 >> 172.21.15.72:0/306094716 conn(0x7f09b006a190 msgr2=0x7f09b006a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:57.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.231+0000 7f09b57ff700 1 -- 172.21.15.72:0/306094716 shutdown_connections 2023-07-27T20:31:57.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.231+0000 7f09b57ff700 1 -- 172.21.15.72:0/306094716 wait complete. 2023-07-27T20:31:57.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.233+0000 7f09b57ff700 1 Processor -- start 2023-07-27T20:31:57.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.234+0000 7f09b57ff700 1 -- start start 2023-07-27T20:31:57.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.235+0000 7f09b57ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09b0155c10 0x7f09b01419e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.235+0000 7f09b57ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09b00c4b20 0x7f09b0137310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.235+0000 7f09b57ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09b0141f20 0x7f09b0137850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.235+0000 7f09b57ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b0151fb0 con 0x7f09b00c4b20 2023-07-27T20:31:57.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.235+0000 7f09b57ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b00c5070 con 0x7f09b0155c10 2023-07-27T20:31:57.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.235+0000 7f09b57ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b0152ac0 con 0x7f09b0141f20 2023-07-27T20:31:57.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.236+0000 7f09af7fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09b0141f20 0x7f09b0137850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.236+0000 7f09af7fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09b0141f20 0x7f09b0137850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.72:48110/0 (socket says 172.21.15.72:48110) 2023-07-27T20:31:57.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.236+0000 7f09af7fe700 1 -- 172.21.15.72:0/2134956407 learned_addr learned my addr 172.21.15.72:0/2134956407 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:57.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.236+0000 7f09aeffd700 1 --2- 172.21.15.72:0/2134956407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09b0155c10 0x7f09b01419e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.237+0000 7f09ae7fc700 1 --2- 172.21.15.72:0/2134956407 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09b00c4b20 0x7f09b0137310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.239+0000 7f09ae7fc700 1 -- 172.21.15.72:0/2134956407 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09b0141f20 msgr2=0x7f09b0137850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.239+0000 7f09ae7fc700 1 --2- 172.21.15.72:0/2134956407 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09b0141f20 0x7f09b0137850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.239+0000 7f09ae7fc700 1 -- 172.21.15.72:0/2134956407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09b0155c10 msgr2=0x7f09b01419e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.239+0000 7f09ae7fc700 1 --2- 172.21.15.72:0/2134956407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09b0155c10 0x7f09b01419e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.239+0000 7f09ae7fc700 1 -- 172.21.15.72:0/2134956407 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a8009b30 con 0x7f09b00c4b20 2023-07-27T20:31:57.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.240+0000 7f09ae7fc700 1 --2- 172.21.15.72:0/2134956407 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09b00c4b20 0x7f09b0137310 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f09b006cf50 tx=0x7f09a000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:57.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.241+0000 7f09977fe700 1 -- 172.21.15.72:0/2134956407 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a0011420 con 0x7f09b00c4b20 2023-07-27T20:31:57.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.241+0000 7f09977fe700 1 -- 172.21.15.72:0/2134956407 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a00115a0 con 0x7f09b00c4b20 2023-07-27T20:31:57.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.241+0000 7f09977fe700 1 -- 172.21.15.72:0/2134956407 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a0011950 con 0x7f09b00c4b20 2023-07-27T20:31:57.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.241+0000 7f09b57ff700 1 -- 172.21.15.72:0/2134956407 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09b0152500 con 0x7f09b00c4b20 2023-07-27T20:31:57.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.241+0000 7f09b57ff700 1 -- 172.21.15.72:0/2134956407 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b0139120 con 0x7f09b00c4b20 2023-07-27T20:31:57.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.244+0000 7f09b57ff700 1 -- 172.21.15.72:0/2134956407 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09900052f0 con 0x7f09b00c4b20 2023-07-27T20:31:57.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.259+0000 7f09977fe700 1 -- 172.21.15.72:0/2134956407 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f09a0011ab0 con 0x7f09b00c4b20 2023-07-27T20:31:57.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.261+0000 7f09977fe700 1 --2- 172.21.15.72:0/2134956407 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f099c06adb0 0x7f099c06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.261+0000 7f09977fe700 1 -- 172.21.15.72:0/2134956407 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f09a0089a40 con 0x7f09b00c4b20 2023-07-27T20:31:57.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.262+0000 7f09977fe700 1 -- 172.21.15.72:0/2134956407 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f09a00b53b0 con 0x7f09b00c4b20 2023-07-27T20:31:57.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.273+0000 7f09aeffd700 1 --2- 172.21.15.72:0/2134956407 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f099c06adb0 0x7f099c06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.293+0000 7f09aeffd700 1 --2- 172.21.15.72:0/2134956407 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f099c06adb0 0x7f099c06d270 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f09b015c870 tx=0x7f09a4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:57.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.307+0000 7feef2bff700 1 Processor -- start 2023-07-27T20:31:57.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.308+0000 7feef2bff700 1 -- start start 2023-07-27T20:31:57.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.310+0000 7feef2bff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7feeec06ad20 0x7feeec146aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.310+0000 7feef2bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feeec153f50 0x7feeec1509d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.310+0000 7feef2bff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeec154380 con 0x7feeec0c2390 2023-07-27T20:31:57.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.310+0000 7feef2bff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeec071820 con 0x7feeec06ad20 2023-07-27T20:31:57.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.310+0000 7feef2bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeec0c2de0 con 0x7feeec153f50 2023-07-27T20:31:57.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.310+0000 7fc63a1ff700 1 Processor -- start 2023-07-27T20:31:57.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.311+0000 7feef119c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feeec153f50 0x7feeec1509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.311+0000 7feef119c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feeec153f50 0x7feeec1509d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.72:48126/0 (socket says 172.21.15.72:48126) 2023-07-27T20:31:57.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.311+0000 7feef119c700 1 -- 172.21.15.72:0/983195864 learned_addr learned my addr 172.21.15.72:0/983195864 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:57.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.310+0000 7fc63a1ff700 1 -- start start 2023-07-27T20:31:57.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.312+0000 7feef119c700 1 -- 172.21.15.72:0/983195864 >> v2:172.21.15.173:3300/0 conn(0x7feeec06ad20 msgr2=0x7feeec146aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-27T20:31:57.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.312+0000 7feef119c700 1 --2- 172.21.15.72:0/983195864 >> v2:172.21.15.173:3300/0 conn(0x7feeec06ad20 0x7feeec146aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.312+0000 7feef119c700 1 -- 172.21.15.72:0/983195864 >> v1:172.21.15.173:6789/0 conn(0x7feeec0c2390 legacy=0x7feeec0c0450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-27T20:31:57.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.312+0000 7feef119c700 1 -- 172.21.15.72:0/983195864 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeec0c2820 con 0x7feeec153f50 2023-07-27T20:31:57.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.312+0000 7feef119c700 1 --2- 172.21.15.72:0/983195864 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feeec153f50 0x7feeec1509d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feee00098f0 tx=0x7feee0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1730ad871cde9776 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:57.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.312+0000 7fc63a1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc6340c2390 0x7fc634153f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.312+0000 7fc63a1ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6341509d0 0x7fc634070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.312+0000 7fc63a1ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6340bffd0 con 0x7fc63406ad20 2023-07-27T20:31:57.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.312+0000 7fc63a1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc634071820 con 0x7fc6340c2390 2023-07-27T20:31:57.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.312+0000 7fc63a1ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6340c2de0 con 0x7fc6341509d0 2023-07-27T20:31:57.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.313+0000 7fc632ffd700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fc63406ad20 0x7fc6340c0450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.72:53684/0 (socket says 172.21.15.72:53684) 2023-07-27T20:31:57.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.313+0000 7fc632ffd700 1 -- 172.21.15.72:0/4023295870 learned_addr learned my addr 172.21.15.72:0/4023295870 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:57.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.313+0000 7fc633fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6341509d0 0x7fc634070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.314+0000 7fc6327fc700 1 -- 172.21.15.72:0/4023295870 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2240124608 0 0) 0x7fc6340bffd0 con 0x7fc63406ad20 2023-07-27T20:31:57.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.314+0000 7fc6327fc700 1 -- 172.21.15.72:0/4023295870 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc61c0035b0 con 0x7fc63406ad20 2023-07-27T20:31:57.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.315+0000 7feeeb7fe700 1 -- 172.21.15.72:0/983195864 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee0004230 con 0x7feeec153f50 2023-07-27T20:31:57.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.315+0000 7feeeb7fe700 1 -- 172.21.15.72:0/983195864 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee0004390 con 0x7feeec153f50 2023-07-27T20:31:57.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.315+0000 7feeeb7fe700 1 -- 172.21.15.72:0/983195864 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee00036a0 con 0x7feeec153f50 2023-07-27T20:31:57.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.314+0000 7fc6327fc700 1 -- 172.21.15.72:0/4023295870 <== mon.1 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4017173607 0 0) 0x7fc61c0035b0 con 0x7fc63406ad20 2023-07-27T20:31:57.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.314+0000 7fc6327fc700 1 -- 172.21.15.72:0/4023295870 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6341509d0 msgr2=0x7fc634070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:57.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.314+0000 7fc6327fc700 1 --2- 172.21.15.72:0/4023295870 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6341509d0 0x7fc634070a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.314+0000 7fc6327fc700 1 -- 172.21.15.72:0/4023295870 >> v2:172.21.15.72:3300/0 conn(0x7fc6340c2390 msgr2=0x7fc634153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:57.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.314+0000 7fc6327fc700 1 --2- 172.21.15.72:0/4023295870 >> v2:172.21.15.72:3300/0 conn(0x7fc6340c2390 0x7fc634153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.314+0000 7fc6327fc700 1 -- 172.21.15.72:0/4023295870 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6340c2820 con 0x7fc63406ad20 2023-07-27T20:31:57.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.314+0000 7fc6327fc700 1 -- 172.21.15.72:0/4023295870 <== mon.1 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7fc62c0019f0 con 0x7fc63406ad20 2023-07-27T20:31:57.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.314+0000 7fc6327fc700 1 -- 172.21.15.72:0/4023295870 >> v1:172.21.15.173:6789/0 conn(0x7fc63406ad20 legacy=0x7fc6340c0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.314+0000 7fc6327fc700 1 --2- 172.21.15.72:0/4023295870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc61c003a30 0x7fc61c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.314+0000 7fc6327fc700 1 --2- 172.21.15.72:0/4023295870 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc61c004850 0x7fc61c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.314+0000 7fc6327fc700 1 --2- 172.21.15.72:0/4023295870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc61c005210 0x7fc61c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.314+0000 7fc6327fc700 1 -- 172.21.15.72:0/4023295870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc634071820 con 0x7fc61c003a30 2023-07-27T20:31:57.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.314+0000 7fc6327fc700 1 -- 172.21.15.72:0/4023295870 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c00c010 con 0x7fc61c005210 2023-07-27T20:31:57.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.314+0000 7fc6327fc700 1 -- 172.21.15.72:0/4023295870 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c00c1d0 con 0x7fc61c004850 2023-07-27T20:31:57.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.315+0000 7fc632ffd700 1 --2- 172.21.15.72:0/4023295870 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc61c004850 0x7fc61c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.315+0000 7fc633fff700 1 --2- 172.21.15.72:0/4023295870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc61c005210 0x7fc61c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.316+0000 7feef2bff700 1 -- 172.21.15.72:0/983195864 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feeec153f50 msgr2=0x7feeec1509d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.316+0000 7feef2bff700 1 --2- 172.21.15.72:0/983195864 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feeec153f50 0x7feeec1509d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feee00098f0 tx=0x7feee0009c00 comp rx=0 tx=0).stop 2023-07-27T20:31:57.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.316+0000 7fc632ffd700 1 -- 172.21.15.72:0/4023295870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc61c005210 msgr2=0x7fc61c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:57.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.316+0000 7fc632ffd700 1 --2- 172.21.15.72:0/4023295870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc61c005210 0x7fc61c00ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.316+0000 7fc632ffd700 1 -- 172.21.15.72:0/4023295870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc61c003a30 msgr2=0x7fc61c003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:57.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.316+0000 7fc632ffd700 1 --2- 172.21.15.72:0/4023295870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc61c003a30 0x7fc61c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.316+0000 7fc632ffd700 1 -- 172.21.15.72:0/4023295870 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6340c2820 con 0x7fc61c004850 2023-07-27T20:31:57.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.316+0000 7fc632ffd700 1 --2- 172.21.15.72:0/4023295870 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc61c004850 0x7fc61c004cd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc62c0013d0 tx=0x7fc61c005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a077ff1eca3f0c1b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:57.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.317+0000 7fc6327fc700 1 -- 172.21.15.72:0/4023295870 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c012600 con 0x7fc61c004850 2023-07-27T20:31:57.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.317+0000 7fc6327fc700 1 -- 172.21.15.72:0/4023295870 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62c012780 con 0x7fc61c004850 2023-07-27T20:31:57.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.317+0000 7fc6327fc700 1 -- 172.21.15.72:0/4023295870 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c012b30 con 0x7fc61c004850 2023-07-27T20:31:57.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.318+0000 7fc63a1ff700 1 -- 172.21.15.72:0/4023295870 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc61c004850 msgr2=0x7fc61c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.318+0000 7fc63a1ff700 1 --2- 172.21.15.72:0/4023295870 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc61c004850 0x7fc61c004cd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc62c0013d0 tx=0x7fc61c005880 comp rx=0 tx=0).stop 2023-07-27T20:31:57.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.318+0000 7fc633fff700 1 -- 172.21.15.72:0/4023295870 reap_dead start 2023-07-27T20:31:57.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.318+0000 7fc63a1ff700 1 -- 172.21.15.72:0/4023295870 shutdown_connections 2023-07-27T20:31:57.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.318+0000 7fc63a1ff700 1 -- 172.21.15.72:0/4023295870 >> 172.21.15.72:0/4023295870 conn(0x7fc63406a190 msgr2=0x7fc63406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:57.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.318+0000 7fc63a1ff700 1 -- 172.21.15.72:0/4023295870 shutdown_connections 2023-07-27T20:31:57.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.318+0000 7fc63a1ff700 1 -- 172.21.15.72:0/4023295870 wait complete. 2023-07-27T20:31:57.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.320+0000 7feef2bff700 1 -- 172.21.15.72:0/983195864 shutdown_connections 2023-07-27T20:31:57.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.320+0000 7feef2bff700 1 --2- 172.21.15.72:0/983195864 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feeec153f50 0x7feeec1509d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.320+0000 7feef2bff700 1 --2- 172.21.15.72:0/983195864 >> v2:172.21.15.173:3300/0 conn(0x7feeec06ad20 0x7feeec146aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.320+0000 7feef2bff700 1 -- 172.21.15.72:0/983195864 >> 172.21.15.72:0/983195864 conn(0x7feeec06a190 msgr2=0x7feeec06a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:57.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.321+0000 7fc63a1ff700 1 Processor -- start 2023-07-27T20:31:57.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.321+0000 7fc63a1ff700 1 -- start start 2023-07-27T20:31:57.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.323+0000 7fc63a1ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc61c004850 0x7fc6340c3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.323+0000 7fc63a1ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6340c5fc0 0x7fc634147cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.323+0000 7fc63a1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc634148230 0x7fc634133b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.323+0000 7fc63a1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6340c3cf0 con 0x7fc634148230 2023-07-27T20:31:57.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.323+0000 7fc63a1ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6341478a0 con 0x7fc6340c5fc0 2023-07-27T20:31:57.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.323+0000 7fc63a1ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6340c5bf0 con 0x7fc61c004850 2023-07-27T20:31:57.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.323+0000 7fc632ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6340c5fc0 0x7fc634147cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.323+0000 7fc632ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6340c5fc0 0x7fc634147cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.72:47118/0 (socket says 172.21.15.72:47118) 2023-07-27T20:31:57.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.323+0000 7fc632ffd700 1 -- 172.21.15.72:0/1773044052 learned_addr learned my addr 172.21.15.72:0/1773044052 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:57.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.324+0000 7fc6337fe700 1 --2- 172.21.15.72:0/1773044052 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc61c004850 0x7fc6340c3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.324+0000 7fc6337fe700 1 -- 172.21.15.72:0/1773044052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6340c5fc0 msgr2=0x7fc634147cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.324+0000 7fc6337fe700 1 --2- 172.21.15.72:0/1773044052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6340c5fc0 0x7fc634147cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.324+0000 7fc6337fe700 1 -- 172.21.15.72:0/1773044052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc634148230 msgr2=0x7fc634133b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.324+0000 7fc6337fe700 1 --2- 172.21.15.72:0/1773044052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc634148230 0x7fc634133b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.324+0000 7fc6337fe700 1 -- 172.21.15.72:0/1773044052 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc634146cf0 con 0x7fc61c004850 2023-07-27T20:31:57.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.325+0000 7fc6337fe700 1 --2- 172.21.15.72:0/1773044052 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc61c004850 0x7fc6340c3250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc62400b500 tx=0x7fc62400b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:57.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.325+0000 7fc61bfff700 1 -- 172.21.15.72:0/1773044052 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc624011830 con 0x7fc61c004850 2023-07-27T20:31:57.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.325+0000 7fc61bfff700 1 -- 172.21.15.72:0/1773044052 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc624011990 con 0x7fc61c004850 2023-07-27T20:31:57.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.325+0000 7fc61bfff700 1 -- 172.21.15.72:0/1773044052 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc624011d20 con 0x7fc61c004850 2023-07-27T20:31:57.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.326+0000 7fc63a1ff700 1 -- 172.21.15.72:0/1773044052 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6340aa920 con 0x7fc61c004850 2023-07-27T20:31:57.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.326+0000 7fc63a1ff700 1 -- 172.21.15.72:0/1773044052 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6340aaee0 con 0x7fc61c004850 2023-07-27T20:31:57.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.326+0000 7f78babff700 1 Processor -- start 2023-07-27T20:31:57.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.327+0000 7f78babff700 1 -- start start 2023-07-27T20:31:57.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.328+0000 7fc63a1ff700 1 -- 172.21.15.72:0/1773044052 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6340ab100 con 0x7fc61c004850 2023-07-27T20:31:57.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.329+0000 7f78babff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f78b40c2090 0x7f78b415b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.329+0000 7f78babff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78b415c8e0 con 0x7f78b40c18e0 2023-07-27T20:31:57.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.329+0000 7f78babff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78b415c040 con 0x7f78b4155ec0 2023-07-27T20:31:57.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.329+0000 7f78babff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78b415c320 con 0x7f78b40c2090 2023-07-27T20:31:57.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.330+0000 7f78b919c700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f78b4155ec0 0x7f78b40c03e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.72:53700/0 (socket says 172.21.15.72:53700) 2023-07-27T20:31:57.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.330+0000 7f78b919c700 1 -- 172.21.15.72:0/3824813791 learned_addr learned my addr 172.21.15.72:0/3824813791 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:57.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.330+0000 7fc61bfff700 1 -- 172.21.15.72:0/1773044052 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc62401a400 con 0x7fc61c004850 2023-07-27T20:31:57.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.330+0000 7f78b899b700 1 --2- 172.21.15.72:0/3824813791 >> v2:172.21.15.72:3300/0 conn(0x7f78b40c2090 0x7f78b415b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.322+0000 7feef2bff700 1 -- 172.21.15.72:0/983195864 shutdown_connections 2023-07-27T20:31:57.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.323+0000 7feef2bff700 1 -- 172.21.15.72:0/983195864 wait complete. 2023-07-27T20:31:57.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.325+0000 7feef2bff700 1 Processor -- start 2023-07-27T20:31:57.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.325+0000 7feef2bff700 1 -- start start 2023-07-27T20:31:57.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.327+0000 7feef2bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feeec06ad20 0x7feeec0aa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.327+0000 7feef2bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feeec153f50 0x7feeec0c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.327+0000 7feef2bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feeec1493b0 0x7feeec131120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.327+0000 7feef2bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeec14d200 con 0x7feeec06ad20 2023-07-27T20:31:57.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.327+0000 7feef2bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeec0aad20 con 0x7feeec1493b0 2023-07-27T20:31:57.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.327+0000 7feef2bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeec169630 con 0x7feeec153f50 2023-07-27T20:31:57.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.327+0000 7feeebfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feeec153f50 0x7feeec0c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.328+0000 7feeebfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feeec153f50 0x7feeec0c44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.72:48162/0 (socket says 172.21.15.72:48162) 2023-07-27T20:31:57.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.328+0000 7feeebfff700 1 -- 172.21.15.72:0/2028118449 learned_addr learned my addr 172.21.15.72:0/2028118449 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:57.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.328+0000 7feef119c700 1 --2- 172.21.15.72:0/2028118449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feeec1493b0 0x7feeec131120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.328+0000 7feef099b700 1 --2- 172.21.15.72:0/2028118449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feeec06ad20 0x7feeec0aa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.329+0000 7feeebfff700 1 -- 172.21.15.72:0/2028118449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feeec1493b0 msgr2=0x7feeec131120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.329+0000 7feeebfff700 1 --2- 172.21.15.72:0/2028118449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feeec1493b0 0x7feeec131120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.329+0000 7feeebfff700 1 -- 172.21.15.72:0/2028118449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feeec06ad20 msgr2=0x7feeec0aa7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.329+0000 7feeebfff700 1 --2- 172.21.15.72:0/2028118449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feeec06ad20 0x7feeec0aa7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.329+0000 7feeebfff700 1 -- 172.21.15.72:0/2028118449 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee0009550 con 0x7feeec153f50 2023-07-27T20:31:57.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.329+0000 7feeebfff700 1 --2- 172.21.15.72:0/2028118449 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feeec153f50 0x7feeec0c44d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7feee400ba50 tx=0x7feee400be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:57.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.330+0000 7f78b37fe700 1 -- 172.21.15.72:0/3824813791 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2090132996 0 0) 0x7f78b415c040 con 0x7f78b4155ec0 2023-07-27T20:31:57.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.331+0000 7f78b37fe700 1 -- 172.21.15.72:0/3824813791 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f789c0035b0 con 0x7f78b4155ec0 2023-07-27T20:31:57.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.331+0000 7f1becfff700 1 Processor -- start 2023-07-27T20:31:57.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.331+0000 7fc61bfff700 1 --2- 172.21.15.72:0/1773044052 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc62006adb0 0x7fc62006d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.331+0000 7fc61bfff700 1 -- 172.21.15.72:0/1773044052 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc624089650 con 0x7fc61c004850 2023-07-27T20:31:57.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.331+0000 7f78b899b700 1 -- 172.21.15.72:0/3824813791 >> v1:172.21.15.173:6789/0 conn(0x7f78b4155ec0 legacy=0x7f78b40c03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.331+0000 7f78b899b700 1 -- 172.21.15.72:0/3824813791 >> v1:172.21.15.72:6789/0 conn(0x7f78b40c18e0 legacy=0x7f78b41557b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.331+0000 7f78b899b700 1 -- 172.21.15.72:0/3824813791 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b415c600 con 0x7f78b40c2090 2023-07-27T20:31:57.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.332+0000 7f78b899b700 1 --2- 172.21.15.72:0/3824813791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78b40c2090 0x7f78b415b9b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f78a8009840 tx=0x7f78a8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d51605f9dd968aa server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:57.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.332+0000 7fc632ffd700 1 --2- 172.21.15.72:0/1773044052 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc62006adb0 0x7fc62006d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.332+0000 7f78b37fe700 1 -- 172.21.15.72:0/3824813791 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a8011830 con 0x7f78b40c2090 2023-07-27T20:31:57.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.332+0000 7f78b37fe700 1 -- 172.21.15.72:0/3824813791 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a8011990 con 0x7f78b40c2090 2023-07-27T20:31:57.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.332+0000 7f78b37fe700 1 -- 172.21.15.72:0/3824813791 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a8011d00 con 0x7f78b40c2090 2023-07-27T20:31:57.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.334+0000 7fc632ffd700 1 --2- 172.21.15.72:0/1773044052 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc62006adb0 0x7fc62006d270 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc6340c6400 tx=0x7fc62c009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:57.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.333+0000 7f78babff700 1 -- 172.21.15.72:0/3824813791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78b40c2090 msgr2=0x7f78b415b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.333+0000 7f78babff700 1 --2- 172.21.15.72:0/3824813791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78b40c2090 0x7f78b415b9b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f78a8009840 tx=0x7f78a8009b50 comp rx=0 tx=0).stop 2023-07-27T20:31:57.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.334+0000 7f78babff700 1 -- 172.21.15.72:0/3824813791 shutdown_connections 2023-07-27T20:31:57.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.334+0000 7f78babff700 1 --2- 172.21.15.72:0/3824813791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78b40c2090 0x7f78b415b9b0 secure :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f78a8009840 tx=0x7f78a8009b50 comp rx=0 tx=0).stop 2023-07-27T20:31:57.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.334+0000 7f78babff700 1 -- 172.21.15.72:0/3824813791 >> 172.21.15.72:0/3824813791 conn(0x7f78b406a190 msgr2=0x7f78b406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:57.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.334+0000 7f78babff700 1 -- 172.21.15.72:0/3824813791 shutdown_connections 2023-07-27T20:31:57.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.331+0000 7f1becfff700 1 -- start start 2023-07-27T20:31:57.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.333+0000 7f1becfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1be81559c0 0x7f1be8159950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.333+0000 7f1becfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1be806dd60 0x7f1be80c5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.333+0000 7f1becfff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1be80a9c50 con 0x7f1be80bfeb0 2023-07-27T20:31:57.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.333+0000 7f1becfff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1be80a8ae0 con 0x7f1be806dd60 2023-07-27T20:31:57.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.333+0000 7f1becfff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be8159e90 con 0x7f1be81559c0 2023-07-27T20:31:57.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.334+0000 7f1be5d9b700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f1be80bfeb0 0x7f1be8158e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.72:53704/0 (socket says 172.21.15.72:53704) 2023-07-27T20:31:57.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.334+0000 7f1be5d9b700 1 -- 172.21.15.72:0/2246425069 learned_addr learned my addr 172.21.15.72:0/2246425069 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:57.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.335+0000 7f1be659c700 1 --2- 172.21.15.72:0/2246425069 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1be81559c0 0x7f1be8159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.336+0000 7fc61bfff700 1 -- 172.21.15.72:0/1773044052 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc6340ab100 con 0x7fc61c004850 2023-07-27T20:31:57.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.336+0000 7f1be559a700 1 -- 172.21.15.72:0/2246425069 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2316711275 0 0) 0x7f1be80a9c50 con 0x7f1be80bfeb0 2023-07-27T20:31:57.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.336+0000 7f1be559a700 1 -- 172.21.15.72:0/2246425069 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bd00035b0 con 0x7f1be80bfeb0 2023-07-27T20:31:57.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.337+0000 7f1be6d9d700 1 --2- 172.21.15.72:0/2246425069 >> v2:172.21.15.72:3300/0 conn(0x7f1be806dd60 0x7f1be80c5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.334+0000 7f78babff700 1 -- 172.21.15.72:0/3824813791 wait complete. 2023-07-27T20:31:57.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.337+0000 7f78babff700 1 Processor -- start 2023-07-27T20:31:57.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.338+0000 7f1be6d9d700 1 -- 172.21.15.72:0/2246425069 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1be81559c0 msgr2=0x7f1be8159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:57.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.338+0000 7f1be6d9d700 1 --2- 172.21.15.72:0/2246425069 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1be81559c0 0x7f1be8159950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.338+0000 7f1be6d9d700 1 -- 172.21.15.72:0/2246425069 >> v1:172.21.15.173:6789/0 conn(0x7f1be80bfeb0 legacy=0x7f1be8158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.338+0000 7f1be6d9d700 1 -- 172.21.15.72:0/2246425069 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be806d8e0 con 0x7f1be806dd60 2023-07-27T20:31:57.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.338+0000 7f1be6d9d700 1 --2- 172.21.15.72:0/2246425069 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1be806dd60 0x7f1be80c5770 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc009840 tx=0x7f1bdc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e971d8e2bdaa39 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:57.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.333+0000 7feee97fa700 1 -- 172.21.15.72:0/2028118449 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee400cab0 con 0x7feeec153f50 2023-07-27T20:31:57.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.333+0000 7feee97fa700 1 -- 172.21.15.72:0/2028118449 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee400cc30 con 0x7feeec153f50 2023-07-27T20:31:57.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.333+0000 7feee97fa700 1 -- 172.21.15.72:0/2028118449 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee4014440 con 0x7feeec153f50 2023-07-27T20:31:57.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.333+0000 7feef2bff700 1 -- 172.21.15.72:0/2028118449 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeec169910 con 0x7feeec153f50 2023-07-27T20:31:57.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.333+0000 7feef2bff700 1 -- 172.21.15.72:0/2028118449 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeec0a9760 con 0x7feeec153f50 2023-07-27T20:31:57.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.337+0000 7f78babff700 1 -- start start 2023-07-27T20:31:57.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.339+0000 7f78babff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78b40c4280 0x7f78b40aaa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.339+0000 7f78babff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f78b4144870 0x7f78b4144cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.339+0000 7f78babff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78b41eecc0 0x7f78b41ef140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.339+0000 7f78babff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b40a8720 con 0x7f78b41eecc0 2023-07-27T20:31:57.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.339+0000 7f78babff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b40a9270 con 0x7f78b40c4280 2023-07-27T20:31:57.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.339+0000 7f78babff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b414f7e0 con 0x7f78b4144870 2023-07-27T20:31:57.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.339+0000 7f1be559a700 1 -- 172.21.15.72:0/2246425069 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc011830 con 0x7f1be806dd60 2023-07-27T20:31:57.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.339+0000 7f1be559a700 1 -- 172.21.15.72:0/2246425069 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bdc011990 con 0x7f1be806dd60 2023-07-27T20:31:57.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.339+0000 7f1be559a700 1 -- 172.21.15.72:0/2246425069 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc011d20 con 0x7f1be806dd60 2023-07-27T20:31:57.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.340+0000 7f1becfff700 1 -- 172.21.15.72:0/2246425069 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1be806dd60 msgr2=0x7f1be80c5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.340+0000 7f1becfff700 1 --2- 172.21.15.72:0/2246425069 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1be806dd60 0x7f1be80c5770 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc009840 tx=0x7f1bdc009b50 comp rx=0 tx=0).stop 2023-07-27T20:31:57.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.340+0000 7f1becfff700 1 -- 172.21.15.72:0/2246425069 shutdown_connections 2023-07-27T20:31:57.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.340+0000 7f1becfff700 1 --2- 172.21.15.72:0/2246425069 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1be806dd60 0x7f1be80c5770 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.340+0000 7f1becfff700 1 --2- 172.21.15.72:0/2246425069 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1be81559c0 0x7f1be8159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.340+0000 7f1becfff700 1 -- 172.21.15.72:0/2246425069 >> 172.21.15.72:0/2246425069 conn(0x7f1be80a7480 msgr2=0x7f1be80a7890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:57.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.342+0000 7f1becfff700 1 -- 172.21.15.72:0/2246425069 shutdown_connections 2023-07-27T20:31:57.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.341+0000 7fc9689ff700 1 Processor -- start 2023-07-27T20:31:57.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.342+0000 7fc9689ff700 1 -- start start 2023-07-27T20:31:57.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.342+0000 7feee97fa700 1 -- 172.21.15.72:0/2028118449 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feee401d3b0 con 0x7feeec153f50 2023-07-27T20:31:57.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.343+0000 7feef2bff700 1 -- 172.21.15.72:0/2028118449 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feecc0052f0 con 0x7feeec153f50 2023-07-27T20:31:57.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.344+0000 7feee97fa700 1 --2- 172.21.15.72:0/2028118449 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7feed806adb0 0x7feed806d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.344+0000 7fc9689ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc96406db30 0x7fc964089340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.344+0000 7fc9689ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc964165bb0 0x7fc9640c1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.344+0000 7fc9689ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc964089880 con 0x7fc964162420 2023-07-27T20:31:57.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.344+0000 7fc9689ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc96406e220 con 0x7fc964165bb0 2023-07-27T20:31:57.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.344+0000 7fc9689ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc964089d90 con 0x7fc96406db30 2023-07-27T20:31:57.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.344+0000 7feee97fa700 1 -- 172.21.15.72:0/2028118449 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7feee4089560 con 0x7feeec153f50 2023-07-27T20:31:57.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.343+0000 7f78b899b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78b40c4280 0x7f78b40aaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.343+0000 7f78b3fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f78b4144870 0x7f78b4144cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.343+0000 7f78b3fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f78b4144870 0x7f78b4144cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.72:48182/0 (socket says 172.21.15.72:48182) 2023-07-27T20:31:57.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.343+0000 7f78b3fff700 1 -- 172.21.15.72:0/1851431975 learned_addr learned my addr 172.21.15.72:0/1851431975 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:57.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.344+0000 7f78b919c700 1 --2- 172.21.15.72:0/1851431975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78b41eecc0 0x7f78b41ef140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.345+0000 7f78b919c700 1 -- 172.21.15.72:0/1851431975 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f78b4144870 msgr2=0x7f78b4144cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.345+0000 7f78b919c700 1 --2- 172.21.15.72:0/1851431975 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f78b4144870 0x7f78b4144cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.345+0000 7f78b919c700 1 -- 172.21.15.72:0/1851431975 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78b40c4280 msgr2=0x7f78b40aaa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.345+0000 7f78b919c700 1 --2- 172.21.15.72:0/1851431975 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78b40c4280 0x7f78b40aaa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.345+0000 7f78b919c700 1 -- 172.21.15.72:0/1851431975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a80094a0 con 0x7f78b41eecc0 2023-07-27T20:31:57.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.345+0000 7feef099b700 1 --2- 172.21.15.72:0/2028118449 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7feed806adb0 0x7feed806d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.345+0000 7f78b919c700 1 --2- 172.21.15.72:0/1851431975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78b41eecc0 0x7f78b41ef140 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f78ac00ca70 tx=0x7f78ac00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:57.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.342+0000 7f1becfff700 1 -- 172.21.15.72:0/2246425069 wait complete. 2023-07-27T20:31:57.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.345+0000 7f1becfff700 1 Processor -- start 2023-07-27T20:31:57.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.346+0000 7fc96259c700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fc964162420 0x7fc964168520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.72:53716/0 (socket says 172.21.15.72:53716) 2023-07-27T20:31:57.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.346+0000 7fc962d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc964165bb0 0x7fc9640c1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.346+0000 7fc96259c700 1 -- 172.21.15.72:0/324608312 learned_addr learned my addr 172.21.15.72:0/324608312 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:57.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.346+0000 7fc961d9b700 1 --2- 172.21.15.72:0/324608312 >> v2:172.21.15.173:3300/0 conn(0x7fc96406db30 0x7fc964089340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.346+0000 7f78b17fa700 1 -- 172.21.15.72:0/1851431975 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac00aa00 con 0x7f78b41eecc0 2023-07-27T20:31:57.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.346+0000 7f78b17fa700 1 -- 172.21.15.72:0/1851431975 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ac00ab60 con 0x7f78b41eecc0 2023-07-27T20:31:57.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.346+0000 7f78b17fa700 1 -- 172.21.15.72:0/1851431975 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac012400 con 0x7f78b41eecc0 2023-07-27T20:31:57.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.347+0000 7f78babff700 1 -- 172.21.15.72:0/1851431975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b4145230 con 0x7f78b41eecc0 2023-07-27T20:31:57.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.347+0000 7f78babff700 1 -- 172.21.15.72:0/1851431975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b40a8440 con 0x7f78b41eecc0 2023-07-27T20:31:57.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.348+0000 7feef099b700 1 --2- 172.21.15.72:0/2028118449 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7feed806adb0 0x7feed806d270 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7feedc009910 tx=0x7feedc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:57.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.346+0000 7f1becfff700 1 -- start start 2023-07-27T20:31:57.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.348+0000 7fc962d9d700 1 -- 172.21.15.72:0/324608312 >> v2:172.21.15.173:3300/0 conn(0x7fc96406db30 msgr2=0x7fc964089340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:57.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.348+0000 7fc962d9d700 1 --2- 172.21.15.72:0/324608312 >> v2:172.21.15.173:3300/0 conn(0x7fc96406db30 0x7fc964089340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.348+0000 7fc962d9d700 1 -- 172.21.15.72:0/324608312 >> v1:172.21.15.173:6789/0 conn(0x7fc964162420 legacy=0x7fc964168520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.348+0000 7fc962d9d700 1 -- 172.21.15.72:0/324608312 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc964089ab0 con 0x7fc964165bb0 2023-07-27T20:31:57.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.349+0000 7fc962d9d700 1 --2- 172.21.15.72:0/324608312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc964165bb0 0x7fc9640c1e20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc9640c28a0 tx=0x7fc95c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f1c90c97c5a4e7e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:57.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.349+0000 7fd8df1ff700 1 Processor -- start 2023-07-27T20:31:57.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.349+0000 7f78babff700 1 -- 172.21.15.72:0/1851431975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78b4070e70 con 0x7f78b41eecc0 2023-07-27T20:31:57.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.349+0000 7fd8df1ff700 1 -- start start 2023-07-27T20:31:57.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.350+0000 7f1becfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1be806dd60 0x7f1be8071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.350+0000 7f1becfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1be80bfeb0 0x7f1be80c3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.350+0000 7f1becfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1be81559c0 0x7f1be8157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.350+0000 7f1becfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be80c4370 con 0x7f1be80bfeb0 2023-07-27T20:31:57.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.350+0000 7f1becfff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be8071620 con 0x7f1be81559c0 2023-07-27T20:31:57.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.350+0000 7f1becfff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be8071ff0 con 0x7f1be806dd60 2023-07-27T20:31:57.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.351+0000 7f1be659c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1be806dd60 0x7f1be8071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.351+0000 7f1be659c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1be806dd60 0x7f1be8071ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.72:48196/0 (socket says 172.21.15.72:48196) 2023-07-27T20:31:57.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.351+0000 7f1be659c700 1 -- 172.21.15.72:0/3729962739 learned_addr learned my addr 172.21.15.72:0/3729962739 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:57.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.351+0000 7fd8df1ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd8d80c0210 0x7fd8d8158730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.351+0000 7fd8df1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8d806d100 con 0x7fd8d8158c70 2023-07-27T20:31:57.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.351+0000 7fd8df1ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8d8070990 con 0x7fd8d8155920 2023-07-27T20:31:57.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.351+0000 7fd8df1ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d81582e0 con 0x7fd8d80c0210 2023-07-27T20:31:57.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.351+0000 7f1be659c700 1 -- 172.21.15.72:0/3729962739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1be81559c0 msgr2=0x7f1be8157920 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-27T20:31:57.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.351+0000 7f1be659c700 1 --2- 172.21.15.72:0/3729962739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1be81559c0 0x7f1be8157920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.351+0000 7f1be659c700 1 -- 172.21.15.72:0/3729962739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1be80bfeb0 msgr2=0x7f1be80c3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.351+0000 7f1be659c700 1 --2- 172.21.15.72:0/3729962739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1be80bfeb0 0x7f1be80c3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.351+0000 7f1be659c700 1 -- 172.21.15.72:0/3729962739 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bdc0094a0 con 0x7f1be806dd60 2023-07-27T20:31:57.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.352+0000 7f1be659c700 1 --2- 172.21.15.72:0/3729962739 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1be806dd60 0x7f1be8071ab0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1be000d800 tx=0x7f1be000dbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:57.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.352+0000 7feee97fa700 1 -- 172.21.15.72:0/2028118449 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7feee4054320 con 0x7feeec153f50 2023-07-27T20:31:57.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.352+0000 7fd8dcf9b700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fd8d8155920 0x7fd8d80c1c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.72:53728/0 (socket says 172.21.15.72:53728) 2023-07-27T20:31:57.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.352+0000 7fd8dcf9b700 1 -- 172.21.15.72:0/506008580 learned_addr learned my addr 172.21.15.72:0/506008580 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:57.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.353+0000 7fd8cffff700 1 --2- 172.21.15.72:0/506008580 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd8d80c0210 0x7fd8d8158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.351+0000 7f78b17fa700 1 -- 172.21.15.72:0/1851431975 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f78ac01b3b0 con 0x7f78b41eecc0 2023-07-27T20:31:57.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.353+0000 7f78b17fa700 1 --2- 172.21.15.72:0/1851431975 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f78a006adb0 0x7f78a006d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.353+0000 7f78b17fa700 1 -- 172.21.15.72:0/1851431975 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f78ac089390 con 0x7f78b41eecc0 2023-07-27T20:31:57.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.353+0000 7fd8cffff700 1 -- 172.21.15.72:0/506008580 >> v1:172.21.15.173:6789/0 conn(0x7fd8d8155920 legacy=0x7fd8d80c1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.353+0000 7fd8cffff700 1 -- 172.21.15.72:0/506008580 >> v1:172.21.15.72:6789/0 conn(0x7fd8d8158c70 legacy=0x7fd8d8162c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:57.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.353+0000 7fd8cffff700 1 -- 172.21.15.72:0/506008580 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d80c2dc0 con 0x7fd8d80c0210 2023-07-27T20:31:57.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.353+0000 7f1bd6ffd700 1 -- 172.21.15.72:0/3729962739 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be00125f0 con 0x7f1be806dd60 2023-07-27T20:31:57.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.354+0000 7f1bd6ffd700 1 -- 172.21.15.72:0/3729962739 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be0012750 con 0x7f1be806dd60 2023-07-27T20:31:57.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.354+0000 7f1bd6ffd700 1 -- 172.21.15.72:0/3729962739 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be0012ae0 con 0x7f1be806dd60 2023-07-27T20:31:57.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.354+0000 7f1becfff700 1 -- 172.21.15.72:0/3729962739 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1be8146a50 con 0x7f1be806dd60 2023-07-27T20:31:57.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.354+0000 7f1becfff700 1 -- 172.21.15.72:0/3729962739 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be8147010 con 0x7f1be806dd60 2023-07-27T20:31:57.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.356+0000 7f78b899b700 1 --2- 172.21.15.72:0/1851431975 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f78a006adb0 0x7f78a006d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.356+0000 7f1becfff700 1 -- 172.21.15.72:0/3729962739 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1be80742a0 con 0x7f1be806dd60 2023-07-27T20:31:57.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.357+0000 7fc96159a700 1 -- 172.21.15.72:0/324608312 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c00e070 con 0x7fc964165bb0 2023-07-27T20:31:57.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.357+0000 7fc96159a700 1 -- 172.21.15.72:0/324608312 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95c00bb20 con 0x7fc964165bb0 2023-07-27T20:31:57.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.357+0000 7fc96159a700 1 -- 172.21.15.72:0/324608312 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c00be90 con 0x7fc964165bb0 2023-07-27T20:31:57.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.354+0000 7fd8cffff700 1 --2- 172.21.15.72:0/506008580 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd8d80c0210 0x7fd8d8158730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd8c80098a0 tx=0x7fd8c8009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3bcead5c0ca7b7b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:57.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.355+0000 7fd8cf7fe700 1 -- 172.21.15.72:0/506008580 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c8011830 con 0x7fd8d80c0210 2023-07-27T20:31:57.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.355+0000 7fd8cf7fe700 1 -- 172.21.15.72:0/506008580 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c8011990 con 0x7fd8d80c0210 2023-07-27T20:31:57.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.355+0000 7fd8cf7fe700 1 -- 172.21.15.72:0/506008580 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c8011d40 con 0x7fd8d80c0210 2023-07-27T20:31:57.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.356+0000 7fd8df1ff700 1 -- 172.21.15.72:0/506008580 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd8d80c0210 msgr2=0x7fd8d8158730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.356+0000 7fd8df1ff700 1 --2- 172.21.15.72:0/506008580 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd8d80c0210 0x7fd8d8158730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd8c80098a0 tx=0x7fd8c8009bb0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.356+0000 7fd8df1ff700 1 -- 172.21.15.72:0/506008580 shutdown_connections 2023-07-27T20:31:57.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.356+0000 7fd8df1ff700 1 --2- 172.21.15.72:0/506008580 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd8d80c0210 0x7fd8d8158730 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.356+0000 7fd8df1ff700 1 -- 172.21.15.72:0/506008580 >> 172.21.15.72:0/506008580 conn(0x7fd8d806a190 msgr2=0x7fd8d806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:57.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.357+0000 7fd8df1ff700 1 -- 172.21.15.72:0/506008580 shutdown_connections 2023-07-27T20:31:57.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.357+0000 7fd8df1ff700 1 -- 172.21.15.72:0/506008580 wait complete. 2023-07-27T20:31:57.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.358+0000 7fc9689ff700 1 -- 172.21.15.72:0/324608312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc964165bb0 msgr2=0x7fc9640c1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.358+0000 7fc9689ff700 1 --2- 172.21.15.72:0/324608312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc964165bb0 0x7fc9640c1e20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc9640c28a0 tx=0x7fc95c00b330 comp rx=0 tx=0).stop 2023-07-27T20:31:57.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.359+0000 7f78b899b700 1 --2- 172.21.15.72:0/1851431975 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f78a006adb0 0x7f78a006d270 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f78b406b220 tx=0x7f78a8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:57.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.359+0000 7fd8df1ff700 1 Processor -- start 2023-07-27T20:31:57.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.360+0000 7fd8df1ff700 1 -- start start 2023-07-27T20:31:57.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.361+0000 7fd8df1ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8d80c0210 0x7fd8d80c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.361+0000 7fd8df1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8d8155920 0x7fd8d80a8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.362+0000 7fd8df1ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd8d8158c70 0x7fd8d80a86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.362+0000 7fd8df1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d80aac50 con 0x7fd8d8155920 2023-07-27T20:31:57.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.362+0000 7fd8df1ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d81528c0 con 0x7fd8d80c0210 2023-07-27T20:31:57.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.362+0000 7fd8df1ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d8152ba0 con 0x7fd8d8158c70 2023-07-27T20:31:57.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.359+0000 7fc9689ff700 1 -- 172.21.15.72:0/324608312 shutdown_connections 2023-07-27T20:31:57.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.359+0000 7fc9689ff700 1 --2- 172.21.15.72:0/324608312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc964165bb0 0x7fc9640c1e20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.359+0000 7fc9689ff700 1 --2- 172.21.15.72:0/324608312 >> v2:172.21.15.173:3300/0 conn(0x7fc96406db30 0x7fc964089340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.359+0000 7fc9689ff700 1 -- 172.21.15.72:0/324608312 >> 172.21.15.72:0/324608312 conn(0x7fc96406a190 msgr2=0x7fc96406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:57.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.360+0000 7f1d3efff700 1 Processor -- start 2023-07-27T20:31:57.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.360+0000 7f1d3efff700 1 -- start start 2023-07-27T20:31:57.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.362+0000 7f1d3efff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1d38155ad0 0x7f1d380bfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.362+0000 7f1d3efff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1d380c0be0 0x7f1d38162c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.362+0000 7f1d3efff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d38071860 con 0x7f1d380c02d0 2023-07-27T20:31:57.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.362+0000 7f1d3efff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d38070ac0 con 0x7f1d380c0be0 2023-07-27T20:31:57.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.362+0000 7f1d3efff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d381583a0 con 0x7f1d38155ad0 2023-07-27T20:31:57.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.360+0000 7f1bd6ffd700 1 -- 172.21.15.72:0/3729962739 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1be0012c40 con 0x7f1be806dd60 2023-07-27T20:31:57.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.362+0000 7f1bd6ffd700 1 --2- 172.21.15.72:0/3729962739 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1bc806adb0 0x7f1bc806d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.363+0000 7f1bd6ffd700 1 -- 172.21.15.72:0/3729962739 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1be008a570 con 0x7f1be806dd60 2023-07-27T20:31:57.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.363+0000 7fd8dcf9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8d80c0210 0x7fd8d80c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.363+0000 7fd8dcf9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8d80c0210 0x7fd8d80c42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.72:47152/0 (socket says 172.21.15.72:47152) 2023-07-27T20:31:57.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.363+0000 7fd8dcf9b700 1 -- 172.21.15.72:0/1172261366 learned_addr learned my addr 172.21.15.72:0/1172261366 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:57.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.363+0000 7fd8dd79c700 1 --2- 172.21.15.72:0/1172261366 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd8d8158c70 0x7fd8d80a86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.362+0000 7fc9689ff700 1 -- 172.21.15.72:0/324608312 shutdown_connections 2023-07-27T20:31:57.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.363+0000 7fc9689ff700 1 -- 172.21.15.72:0/324608312 wait complete. 2023-07-27T20:31:57.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.363+0000 7f1d3cd9b700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1d38155ad0 0x7f1d380bfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.363+0000 7f1d3cd9b700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1d38155ad0 0x7f1d380bfd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.72:47162/0 (socket says 172.21.15.72:47162) 2023-07-27T20:31:57.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.363+0000 7f1d3cd9b700 1 -- 172.21.15.72:0/3028335051 learned_addr learned my addr 172.21.15.72:0/3028335051 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:57.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.363+0000 7f1d3d59c700 1 --2- 172.21.15.72:0/3028335051 >> v2:172.21.15.72:3300/0 conn(0x7f1d380c0be0 0x7f1d38162c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.363+0000 7fd8dcf9b700 1 -- 172.21.15.72:0/1172261366 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd8d8158c70 msgr2=0x7fd8d80a86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.363+0000 7fd8dcf9b700 1 --2- 172.21.15.72:0/1172261366 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd8d8158c70 0x7fd8d80a86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.363+0000 7fd8dcf9b700 1 -- 172.21.15.72:0/1172261366 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8d8155920 msgr2=0x7fd8d80a8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.363+0000 7fd8dcf9b700 1 --2- 172.21.15.72:0/1172261366 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8d8155920 0x7fd8d80a8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.363+0000 7fd8dcf9b700 1 -- 172.21.15.72:0/1172261366 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c80094a0 con 0x7fd8d80c0210 2023-07-27T20:31:57.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.364+0000 7fd8dcf9b700 1 --2- 172.21.15.72:0/1172261366 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8d80c0210 0x7fd8d80c42a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd8d400c520 tx=0x7fd8d400c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:57.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.364+0000 7f1d3cd9b700 1 -- 172.21.15.72:0/3028335051 >> v2:172.21.15.72:3300/0 conn(0x7f1d380c0be0 msgr2=0x7f1d38162c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:57.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.364+0000 7f1d3cd9b700 1 --2- 172.21.15.72:0/3028335051 >> v2:172.21.15.72:3300/0 conn(0x7f1d380c0be0 0x7f1d38162c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.364+0000 7f1d3cd9b700 1 -- 172.21.15.72:0/3028335051 >> v1:172.21.15.72:6789/0 conn(0x7f1d380c02d0 legacy=0x7f1d380c1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.364+0000 7f1d3cd9b700 1 -- 172.21.15.72:0/3028335051 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d380c1470 con 0x7f1d38155ad0 2023-07-27T20:31:57.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.364+0000 7fd8cd7fa700 1 -- 172.21.15.72:0/1172261366 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d4005d70 con 0x7fd8d80c0210 2023-07-27T20:31:57.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.364+0000 7fd8cd7fa700 1 -- 172.21.15.72:0/1172261366 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d40070d0 con 0x7fd8d80c0210 2023-07-27T20:31:57.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.364+0000 7fd8cd7fa700 1 -- 172.21.15.72:0/1172261366 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d4007440 con 0x7fd8d80c0210 2023-07-27T20:31:57.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.364+0000 7f1bd6ffd700 1 -- 172.21.15.72:0/3729962739 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1be0055310 con 0x7f1be806dd60 2023-07-27T20:31:57.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.365+0000 7f1d3cd9b700 1 --2- 172.21.15.72:0/3028335051 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d38155ad0 0x7f1d380bfd90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1d380c28c0 tx=0x7f1d2c009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa3102e946aace1d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:57.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.365+0000 7f78b17fa700 1 -- 172.21.15.72:0/1851431975 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f78ac0541c0 con 0x7f78b41eecc0 2023-07-27T20:31:57.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.365+0000 7f1be5d9b700 1 --2- 172.21.15.72:0/3729962739 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1bc806adb0 0x7f1bc806d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.364+0000 7fd8df1ff700 1 -- 172.21.15.72:0/1172261366 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d80c47e0 con 0x7fd8d80c0210 2023-07-27T20:31:57.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.366+0000 7fc9689ff700 1 Processor -- start 2023-07-27T20:31:57.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.364+0000 7fd8df1ff700 1 -- 172.21.15.72:0/1172261366 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d815c5f0 con 0x7fd8d80c0210 2023-07-27T20:31:57.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.367+0000 7fd8df1ff700 1 -- 172.21.15.72:0/1172261366 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8b80052f0 con 0x7fd8d80c0210 2023-07-27T20:31:57.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.367+0000 7f1be5d9b700 1 --2- 172.21.15.72:0/3729962739 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1bc806adb0 0x7f1bc806d270 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1be80c2520 tx=0x7f1bd80015f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:57.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.368+0000 7f1d377fe700 1 -- 172.21.15.72:0/3028335051 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c011830 con 0x7f1d38155ad0 2023-07-27T20:31:57.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.368+0000 7f1d377fe700 1 -- 172.21.15.72:0/3028335051 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2c011990 con 0x7f1d38155ad0 2023-07-27T20:31:57.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.368+0000 7f1d377fe700 1 -- 172.21.15.72:0/3028335051 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c011d20 con 0x7f1d38155ad0 2023-07-27T20:31:57.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.366+0000 7fc9689ff700 1 -- start start 2023-07-27T20:31:57.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.368+0000 7fc9689ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc96406db30 0x7fc964164060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.368+0000 7fc9689ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc964162420 0x7fc9640c4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.368+0000 7fc9689ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc964165bb0 0x7fc9641599c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.368+0000 7fc9689ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9641ffd40 con 0x7fc964165bb0 2023-07-27T20:31:57.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.369+0000 7fc9689ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9640c50e0 con 0x7fc96406db30 2023-07-27T20:31:57.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.369+0000 7fc9689ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9641fef80 con 0x7fc964162420 2023-07-27T20:31:57.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.368+0000 7fc961d9b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc964162420 0x7fc9640c4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.369+0000 7fc961d9b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc964162420 0x7fc9640c4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.72:48208/0 (socket says 172.21.15.72:48208) 2023-07-27T20:31:57.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.369+0000 7fc961d9b700 1 -- 172.21.15.72:0/1283059981 learned_addr learned my addr 172.21.15.72:0/1283059981 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:57.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.369+0000 7fc962d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc964165bb0 0x7fc9641599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.368+0000 7fc96259c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc96406db30 0x7fc964164060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.370+0000 7f1d3efff700 1 -- 172.21.15.72:0/3028335051 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d38155ad0 msgr2=0x7f1d380bfd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.370+0000 7f1d3efff700 1 --2- 172.21.15.72:0/3028335051 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d38155ad0 0x7f1d380bfd90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1d380c28c0 tx=0x7f1d2c009bd0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.370+0000 7fd8cd7fa700 1 -- 172.21.15.72:0/1172261366 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd8d40075a0 con 0x7fd8d80c0210 2023-07-27T20:31:57.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.371+0000 7fc962d9d700 1 -- 172.21.15.72:0/1283059981 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc964162420 msgr2=0x7fc9640c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.371+0000 7fc962d9d700 1 --2- 172.21.15.72:0/1283059981 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc964162420 0x7fc9640c4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.371+0000 7fc962d9d700 1 -- 172.21.15.72:0/1283059981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc96406db30 msgr2=0x7fc964164060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.371+0000 7fc962d9d700 1 --2- 172.21.15.72:0/1283059981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc96406db30 0x7fc964164060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.371+0000 7fc962d9d700 1 -- 172.21.15.72:0/1283059981 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc95c009a70 con 0x7fc964165bb0 2023-07-27T20:31:57.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.371+0000 7fc962d9d700 1 --2- 172.21.15.72:0/1283059981 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc964165bb0 0x7fc9641599c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc95c016000 tx=0x7fc95c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:57.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.372+0000 7fd8cd7fa700 1 --2- 172.21.15.72:0/1172261366 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd8c406adb0 0x7fd8c406d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.372+0000 7fd8cd7fa700 1 -- 172.21.15.72:0/1172261366 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd8d40893f0 con 0x7fd8d80c0210 2023-07-27T20:31:57.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.373+0000 7fc952ffd700 1 -- 172.21.15.72:0/1283059981 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c025400 con 0x7fc964165bb0 2023-07-27T20:31:57.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.373+0000 7fc952ffd700 1 -- 172.21.15.72:0/1283059981 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95c01f070 con 0x7fc964165bb0 2023-07-27T20:31:57.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.373+0000 7fc952ffd700 1 -- 172.21.15.72:0/1283059981 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c0257c0 con 0x7fc964165bb0 2023-07-27T20:31:57.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.373+0000 7fc9689ff700 1 -- 172.21.15.72:0/1283059981 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9641ff260 con 0x7fc964165bb0 2023-07-27T20:31:57.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.373+0000 7fc9689ff700 1 -- 172.21.15.72:0/1283059981 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9641ff820 con 0x7fc964165bb0 2023-07-27T20:31:57.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.373+0000 7fd8cffff700 1 --2- 172.21.15.72:0/1172261366 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd8c406adb0 0x7fd8c406d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.373+0000 7fd8cd7fa700 1 -- 172.21.15.72:0/1172261366 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd8d40542d0 con 0x7fd8d80c0210 2023-07-27T20:31:57.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.375+0000 7f1d3efff700 1 -- 172.21.15.72:0/3028335051 shutdown_connections 2023-07-27T20:31:57.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.375+0000 7f1d3efff700 1 --2- 172.21.15.72:0/3028335051 >> v2:172.21.15.72:3300/0 conn(0x7f1d380c0be0 0x7f1d38162c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.375+0000 7f1d3efff700 1 --2- 172.21.15.72:0/3028335051 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d38155ad0 0x7f1d380bfd90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.375+0000 7f1d3efff700 1 -- 172.21.15.72:0/3028335051 >> 172.21.15.72:0/3028335051 conn(0x7f1d3806a190 msgr2=0x7f1d3806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:57.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.376+0000 7fd8cffff700 1 --2- 172.21.15.72:0/1172261366 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd8c406adb0 0x7fd8c406d270 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd8c80098a0 tx=0x7fd8c8010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:57.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.377+0000 7fc952ffd700 1 -- 172.21.15.72:0/1283059981 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc95c02d3f0 con 0x7fc964165bb0 2023-07-27T20:31:57.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.378+0000 7fc9689ff700 1 -- 172.21.15.72:0/1283059981 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9480052f0 con 0x7fc964165bb0 2023-07-27T20:31:57.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.377+0000 7f1d3efff700 1 -- 172.21.15.72:0/3028335051 shutdown_connections 2023-07-27T20:31:57.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.379+0000 7fc952ffd700 1 --2- 172.21.15.72:0/1283059981 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc94406adb0 0x7fc94406d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.379+0000 7fc952ffd700 1 -- 172.21.15.72:0/1283059981 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc95c08aa20 con 0x7fc964165bb0 2023-07-27T20:31:57.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.382+0000 7fc96259c700 1 --2- 172.21.15.72:0/1283059981 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc94406adb0 0x7fc94406d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.377+0000 7f1d3efff700 1 -- 172.21.15.72:0/3028335051 wait complete. 2023-07-27T20:31:57.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.380+0000 7f1d3efff700 1 Processor -- start 2023-07-27T20:31:57.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.380+0000 7f1d3efff700 1 -- start start 2023-07-27T20:31:57.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.382+0000 7f1d3efff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d380c02d0 0x7f1d380aabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.382+0000 7f1d3efff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d380c0be0 0x7f1d381587e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.382+0000 7f1d3efff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d38155ad0 0x7f1d38200b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.382+0000 7f1d3efff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d382071c0 con 0x7f1d380c0be0 2023-07-27T20:31:57.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.382+0000 7f1d3efff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d380a8b90 con 0x7f1d380c02d0 2023-07-27T20:31:57.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.382+0000 7f1d3efff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d38206ee0 con 0x7f1d38155ad0 2023-07-27T20:31:57.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.383+0000 7f1d3d59c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d38155ad0 0x7f1d38200b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.383+0000 7f1d3d59c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d38155ad0 0x7f1d38200b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.72:48220/0 (socket says 172.21.15.72:48220) 2023-07-27T20:31:57.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.383+0000 7f1d3d59c700 1 -- 172.21.15.72:0/1794613922 learned_addr learned my addr 172.21.15.72:0/1794613922 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:57.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.383+0000 7f1d3cd9b700 1 --2- 172.21.15.72:0/1794613922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d380c02d0 0x7f1d380aabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.384+0000 7fc96259c700 1 --2- 172.21.15.72:0/1283059981 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc94406adb0 0x7fc94406d270 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc954005910 tx=0x7fc954009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:57.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.383+0000 7f1d3d59c700 1 -- 172.21.15.72:0/1794613922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d380c02d0 msgr2=0x7f1d380aabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.383+0000 7f1d3d59c700 1 --2- 172.21.15.72:0/1794613922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d380c02d0 0x7f1d380aabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.383+0000 7f1d3d59c700 1 -- 172.21.15.72:0/1794613922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d380c0be0 msgr2=0x7f1d381587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.383+0000 7f1d3d59c700 1 --2- 172.21.15.72:0/1794613922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d380c0be0 0x7f1d381587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.383+0000 7f1d3d59c700 1 -- 172.21.15.72:0/1794613922 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d2c009550 con 0x7f1d38155ad0 2023-07-27T20:31:57.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.384+0000 7f1d3d59c700 1 --2- 172.21.15.72:0/1794613922 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d38155ad0 0x7f1d38200b30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1d3000efc0 tx=0x7f1d3000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:57.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.384+0000 7f1d357fa700 1 -- 172.21.15.72:0/1794613922 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3000cd40 con 0x7f1d38155ad0 2023-07-27T20:31:57.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.384+0000 7f1d357fa700 1 -- 172.21.15.72:0/1794613922 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3000f040 con 0x7f1d38155ad0 2023-07-27T20:31:57.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.384+0000 7f1d357fa700 1 -- 172.21.15.72:0/1794613922 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d300146a0 con 0x7f1d38155ad0 2023-07-27T20:31:57.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.384+0000 7f1d3efff700 1 -- 172.21.15.72:0/1794613922 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d380a8540 con 0x7f1d38155ad0 2023-07-27T20:31:57.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.386+0000 7f1d3efff700 1 -- 172.21.15.72:0/1794613922 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d38158d20 con 0x7f1d38155ad0 2023-07-27T20:31:57.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.388+0000 7f1d357fa700 1 -- 172.21.15.72:0/1794613922 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1d30014800 con 0x7f1d38155ad0 2023-07-27T20:31:57.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.390+0000 7f1d357fa700 1 --2- 172.21.15.72:0/1794613922 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1d2406ad30 0x7f1d2406d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:57.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.391+0000 7f1d357fa700 1 -- 172.21.15.72:0/1794613922 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1d3005c190 con 0x7f1d38155ad0 2023-07-27T20:31:57.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.391+0000 7f1d3cd9b700 1 --2- 172.21.15.72:0/1794613922 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1d2406ad30 0x7f1d2406d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:57.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.392+0000 7f1d3efff700 1 -- 172.21.15.72:0/1794613922 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d380a83a0 con 0x7f1d38155ad0 2023-07-27T20:31:57.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.393+0000 7f1d3cd9b700 1 --2- 172.21.15.72:0/1794613922 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1d2406ad30 0x7f1d2406d1f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c009c10 tx=0x7f1d2c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:57.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.394+0000 7fc952ffd700 1 -- 172.21.15.72:0/1283059981 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc95c055940 con 0x7fc964165bb0 2023-07-27T20:31:57.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.398+0000 7f1d357fa700 1 -- 172.21.15.72:0/1794613922 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1d380a83a0 con 0x7f1d38155ad0 2023-07-27T20:31:57.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.701+0000 7f09b57ff700 1 -- 172.21.15.72:0/2134956407 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0990005870 con 0x7f09b00c4b20 2023-07-27T20:31:57.692 INFO:teuthology.orchestra.run.smithi072.stdout:55834574860 2023-07-27T20:31:57.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.702+0000 7f09977fe700 1 -- 172.21.15.72:0/2134956407 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f09a0054870 con 0x7f09b00c4b20 2023-07-27T20:31:57.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.707+0000 7f09b57ff700 1 -- 172.21.15.72:0/2134956407 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f099c06adb0 msgr2=0x7f099c06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.707+0000 7f09b57ff700 1 --2- 172.21.15.72:0/2134956407 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f099c06adb0 0x7f099c06d270 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f09b015c870 tx=0x7f09a4008040 comp rx=0 tx=0).stop 2023-07-27T20:31:57.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.707+0000 7f09b57ff700 1 -- 172.21.15.72:0/2134956407 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09b00c4b20 msgr2=0x7f09b0137310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.707+0000 7f09b57ff700 1 --2- 172.21.15.72:0/2134956407 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09b00c4b20 0x7f09b0137310 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f09b006cf50 tx=0x7f09a000b6c0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.712+0000 7f09b57ff700 1 -- 172.21.15.72:0/2134956407 shutdown_connections 2023-07-27T20:31:57.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.712+0000 7f09b57ff700 1 --2- 172.21.15.72:0/2134956407 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f099c06adb0 0x7f099c06d270 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.712+0000 7f09b57ff700 1 --2- 172.21.15.72:0/2134956407 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09b0141f20 0x7f09b0137850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.712+0000 7f09b57ff700 1 --2- 172.21.15.72:0/2134956407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09b0155c10 0x7f09b01419e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.712+0000 7f09b57ff700 1 --2- 172.21.15.72:0/2134956407 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09b00c4b20 0x7f09b0137310 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.712+0000 7f09b57ff700 1 -- 172.21.15.72:0/2134956407 >> 172.21.15.72:0/2134956407 conn(0x7f09b006a190 msgr2=0x7f09b0153820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:57.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.712+0000 7f09b57ff700 1 -- 172.21.15.72:0/2134956407 shutdown_connections 2023-07-27T20:31:57.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.712+0000 7f09b57ff700 1 -- 172.21.15.72:0/2134956407 wait complete. 2023-07-27T20:31:57.730 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.1 2023-07-27T20:31:57.730 DEBUG:teuthology.parallel:result is None 2023-07-27T20:31:57.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.777+0000 7fc63a1ff700 1 -- 172.21.15.72:0/1773044052 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fc634147a10 con 0x7fc61c004850 2023-07-27T20:31:57.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.778+0000 7fc61bfff700 1 -- 172.21.15.72:0/1773044052 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc634147a10 con 0x7fc61c004850 2023-07-27T20:31:57.766 INFO:teuthology.orchestra.run.smithi072.stdout:55834574858 2023-07-27T20:31:57.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.781+0000 7fc63a1ff700 1 -- 172.21.15.72:0/1773044052 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc62006adb0 msgr2=0x7fc62006d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.781+0000 7fc63a1ff700 1 --2- 172.21.15.72:0/1773044052 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc62006adb0 0x7fc62006d270 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc6340c6400 tx=0x7fc62c009030 comp rx=0 tx=0).stop 2023-07-27T20:31:57.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.781+0000 7fc63a1ff700 1 -- 172.21.15.72:0/1773044052 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc61c004850 msgr2=0x7fc6340c3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.781+0000 7fc63a1ff700 1 --2- 172.21.15.72:0/1773044052 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc61c004850 0x7fc6340c3250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc62400b500 tx=0x7fc62400b810 comp rx=0 tx=0).stop 2023-07-27T20:31:57.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.782+0000 7fc63a1ff700 1 -- 172.21.15.72:0/1773044052 shutdown_connections 2023-07-27T20:31:57.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.782+0000 7fc63a1ff700 1 --2- 172.21.15.72:0/1773044052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc634148230 0x7fc634133b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.782+0000 7fc63a1ff700 1 --2- 172.21.15.72:0/1773044052 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc62006adb0 0x7fc62006d270 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.782+0000 7fc63a1ff700 1 --2- 172.21.15.72:0/1773044052 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc61c004850 0x7fc6340c3250 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.782+0000 7fc63a1ff700 1 --2- 172.21.15.72:0/1773044052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6340c5fc0 0x7fc634147cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.782+0000 7fc63a1ff700 1 -- 172.21.15.72:0/1773044052 >> 172.21.15.72:0/1773044052 conn(0x7fc63406a190 msgr2=0x7fc63406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:57.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.782+0000 7fc63a1ff700 1 -- 172.21.15.72:0/1773044052 shutdown_connections 2023-07-27T20:31:57.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.782+0000 7fc63a1ff700 1 -- 172.21.15.72:0/1773044052 wait complete. 2023-07-27T20:31:57.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.788+0000 7fc9689ff700 1 -- 172.21.15.72:0/1283059981 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc9480055a0 con 0x7fc964165bb0 2023-07-27T20:31:57.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.789+0000 7fc952ffd700 1 -- 172.21.15.72:0/1283059981 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc95c021070 con 0x7fc964165bb0 2023-07-27T20:31:57.776 INFO:teuthology.orchestra.run.smithi072.stdout:55834574859 2023-07-27T20:31:57.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.791+0000 7fc9689ff700 1 -- 172.21.15.72:0/1283059981 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc94406adb0 msgr2=0x7fc94406d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.791+0000 7fc9689ff700 1 --2- 172.21.15.72:0/1283059981 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc94406adb0 0x7fc94406d270 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc954005910 tx=0x7fc954009040 comp rx=0 tx=0).stop 2023-07-27T20:31:57.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.791+0000 7fc9689ff700 1 -- 172.21.15.72:0/1283059981 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc964165bb0 msgr2=0x7fc9641599c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.791+0000 7fc9689ff700 1 --2- 172.21.15.72:0/1283059981 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc964165bb0 0x7fc9641599c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc95c016000 tx=0x7fc95c004ad0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.792+0000 7fc9689ff700 1 -- 172.21.15.72:0/1283059981 shutdown_connections 2023-07-27T20:31:57.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.792+0000 7fc9689ff700 1 --2- 172.21.15.72:0/1283059981 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc964165bb0 0x7fc9641599c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.792+0000 7fc9689ff700 1 --2- 172.21.15.72:0/1283059981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc96406db30 0x7fc964164060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.792+0000 7fc9689ff700 1 --2- 172.21.15.72:0/1283059981 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc94406adb0 0x7fc94406d270 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.792+0000 7fc9689ff700 1 --2- 172.21.15.72:0/1283059981 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc964162420 0x7fc9640c4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.792+0000 7fc9689ff700 1 -- 172.21.15.72:0/1283059981 >> 172.21.15.72:0/1283059981 conn(0x7fc96406a190 msgr2=0x7fc9640c0570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:57.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.792+0000 7fc9689ff700 1 -- 172.21.15.72:0/1283059981 shutdown_connections 2023-07-27T20:31:57.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.792+0000 7fc9689ff700 1 -- 172.21.15.72:0/1283059981 wait complete. 2023-07-27T20:31:57.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.798+0000 7feef2bff700 1 -- 172.21.15.72:0/2028118449 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7feecc0055a0 con 0x7feeec153f50 2023-07-27T20:31:57.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.799+0000 7feee97fa700 1 -- 172.21.15.72:0/2028118449 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feee4019020 con 0x7feeec153f50 2023-07-27T20:31:57.790 INFO:teuthology.orchestra.run.smithi072.stdout:55834574860 2023-07-27T20:31:57.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.803+0000 7feef2bff700 1 -- 172.21.15.72:0/2028118449 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7feed806adb0 msgr2=0x7feed806d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.803+0000 7feef2bff700 1 --2- 172.21.15.72:0/2028118449 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7feed806adb0 0x7feed806d270 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7feedc009910 tx=0x7feedc008040 comp rx=0 tx=0).stop 2023-07-27T20:31:57.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.803+0000 7feef2bff700 1 -- 172.21.15.72:0/2028118449 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feeec153f50 msgr2=0x7feeec0c44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.803+0000 7feef2bff700 1 --2- 172.21.15.72:0/2028118449 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feeec153f50 0x7feeec0c44d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7feee400ba50 tx=0x7feee400be10 comp rx=0 tx=0).stop 2023-07-27T20:31:57.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.803+0000 7feef2bff700 1 -- 172.21.15.72:0/2028118449 shutdown_connections 2023-07-27T20:31:57.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.803+0000 7feef2bff700 1 --2- 172.21.15.72:0/2028118449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feeec1493b0 0x7feeec131120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.803+0000 7feef2bff700 1 --2- 172.21.15.72:0/2028118449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feeec06ad20 0x7feeec0aa7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.803+0000 7feef2bff700 1 --2- 172.21.15.72:0/2028118449 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7feed806adb0 0x7feed806d270 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.803+0000 7feef2bff700 1 --2- 172.21.15.72:0/2028118449 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feeec153f50 0x7feeec0c44d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.803+0000 7feef2bff700 1 -- 172.21.15.72:0/2028118449 >> 172.21.15.72:0/2028118449 conn(0x7feeec06a190 msgr2=0x7feeec06d100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:57.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.804+0000 7feef2bff700 1 -- 172.21.15.72:0/2028118449 shutdown_connections 2023-07-27T20:31:57.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.804+0000 7feef2bff700 1 -- 172.21.15.72:0/2028118449 wait complete. 2023-07-27T20:31:57.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.804+0000 7f1becfff700 1 -- 172.21.15.72:0/3729962739 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1be806db40 con 0x7f1be806dd60 2023-07-27T20:31:57.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.804+0000 7f1bd6ffd700 1 -- 172.21.15.72:0/3729962739 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1be0058930 con 0x7f1be806dd60 2023-07-27T20:31:57.793 INFO:teuthology.orchestra.run.smithi072.stdout:55834574860 2023-07-27T20:31:57.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.809+0000 7f1becfff700 1 -- 172.21.15.72:0/3729962739 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1bc806adb0 msgr2=0x7f1bc806d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.809+0000 7f1becfff700 1 --2- 172.21.15.72:0/3729962739 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1bc806adb0 0x7f1bc806d270 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1be80c2520 tx=0x7f1bd80015f0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.809+0000 7f1becfff700 1 -- 172.21.15.72:0/3729962739 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1be806dd60 msgr2=0x7f1be8071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.809+0000 7f1becfff700 1 --2- 172.21.15.72:0/3729962739 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1be806dd60 0x7f1be8071ab0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1be000d800 tx=0x7f1be000dbc0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.809+0000 7f1becfff700 1 -- 172.21.15.72:0/3729962739 shutdown_connections 2023-07-27T20:31:57.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.809+0000 7f1becfff700 1 --2- 172.21.15.72:0/3729962739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1be81559c0 0x7f1be8157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.809+0000 7f1becfff700 1 --2- 172.21.15.72:0/3729962739 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1bc806adb0 0x7f1bc806d270 secure :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1be80c2520 tx=0x7f1bd80015f0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.809+0000 7f1becfff700 1 --2- 172.21.15.72:0/3729962739 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1be806dd60 0x7f1be8071ab0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.809+0000 7f1becfff700 1 --2- 172.21.15.72:0/3729962739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1be80bfeb0 0x7f1be80c3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.809+0000 7f1becfff700 1 -- 172.21.15.72:0/3729962739 >> 172.21.15.72:0/3729962739 conn(0x7f1be80a7480 msgr2=0x7f1be8163340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:57.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.810+0000 7f1becfff700 1 -- 172.21.15.72:0/3729962739 shutdown_connections 2023-07-27T20:31:57.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.810+0000 7f1becfff700 1 -- 172.21.15.72:0/3729962739 wait complete. 2023-07-27T20:31:57.801 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.4 2023-07-27T20:31:57.801 DEBUG:teuthology.parallel:result is None 2023-07-27T20:31:57.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.815+0000 7f78babff700 1 -- 172.21.15.72:0/1851431975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f78b4074310 con 0x7f78b41eecc0 2023-07-27T20:31:57.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.816+0000 7f78b17fa700 1 -- 172.21.15.72:0/1851431975 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f78ac001b00 con 0x7f78b41eecc0 2023-07-27T20:31:57.803 INFO:teuthology.orchestra.run.smithi072.stdout:55834574860 2023-07-27T20:31:57.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.816+0000 7fd8df1ff700 1 -- 172.21.15.72:0/1172261366 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fd8b8005870 con 0x7fd8d80c0210 2023-07-27T20:31:57.804 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.3 2023-07-27T20:31:57.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.817+0000 7fd8cd7fa700 1 -- 172.21.15.72:0/1172261366 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd8d4017020 con 0x7fd8d80c0210 2023-07-27T20:31:57.805 INFO:teuthology.orchestra.run.smithi072.stdout:55834574860 2023-07-27T20:31:57.805 DEBUG:teuthology.parallel:result is None 2023-07-27T20:31:57.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.820+0000 7f78babff700 1 -- 172.21.15.72:0/1851431975 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f78a006adb0 msgr2=0x7f78a006d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.820+0000 7f78babff700 1 --2- 172.21.15.72:0/1851431975 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f78a006adb0 0x7f78a006d270 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f78b406b220 tx=0x7f78a8008030 comp rx=0 tx=0).stop 2023-07-27T20:31:57.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.820+0000 7f78babff700 1 -- 172.21.15.72:0/1851431975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78b41eecc0 msgr2=0x7f78b41ef140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.820+0000 7f78babff700 1 --2- 172.21.15.72:0/1851431975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78b41eecc0 0x7f78b41ef140 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f78ac00ca70 tx=0x7f78ac00ce30 comp rx=0 tx=0).stop 2023-07-27T20:31:57.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.820+0000 7fd8df1ff700 1 -- 172.21.15.72:0/1172261366 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd8c406adb0 msgr2=0x7fd8c406d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.820+0000 7fd8df1ff700 1 --2- 172.21.15.72:0/1172261366 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd8c406adb0 0x7fd8c406d270 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd8c80098a0 tx=0x7fd8c8010000 comp rx=0 tx=0).stop 2023-07-27T20:31:57.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.820+0000 7fd8df1ff700 1 -- 172.21.15.72:0/1172261366 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8d80c0210 msgr2=0x7fd8d80c42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.820+0000 7fd8df1ff700 1 --2- 172.21.15.72:0/1172261366 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8d80c0210 0x7fd8d80c42a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd8d400c520 tx=0x7fd8d400c8e0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.820+0000 7fd8df1ff700 1 -- 172.21.15.72:0/1172261366 shutdown_connections 2023-07-27T20:31:57.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.820+0000 7fd8df1ff700 1 --2- 172.21.15.72:0/1172261366 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd8c406adb0 0x7fd8c406d270 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.820+0000 7fd8df1ff700 1 --2- 172.21.15.72:0/1172261366 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd8d8158c70 0x7fd8d80a86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.820+0000 7fd8df1ff700 1 --2- 172.21.15.72:0/1172261366 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8d80c0210 0x7fd8d80c42a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.820+0000 7fd8df1ff700 1 --2- 172.21.15.72:0/1172261366 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8d8155920 0x7fd8d80a8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.820+0000 7f78babff700 1 -- 172.21.15.72:0/1851431975 shutdown_connections 2023-07-27T20:31:57.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.820+0000 7f78babff700 1 --2- 172.21.15.72:0/1851431975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78b41eecc0 0x7f78b41ef140 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.820+0000 7f78babff700 1 --2- 172.21.15.72:0/1851431975 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78b40c4280 0x7f78b40aaa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.820+0000 7f78babff700 1 --2- 172.21.15.72:0/1851431975 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f78a006adb0 0x7f78a006d270 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.820+0000 7f78babff700 1 --2- 172.21.15.72:0/1851431975 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f78b4144870 0x7f78b4144cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.820+0000 7f78babff700 1 -- 172.21.15.72:0/1851431975 >> 172.21.15.72:0/1851431975 conn(0x7f78b406a190 msgr2=0x7f78b414bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:57.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.820+0000 7fd8df1ff700 1 -- 172.21.15.72:0/1172261366 >> 172.21.15.72:0/1172261366 conn(0x7fd8d806a190 msgr2=0x7fd8d81548a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:57.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.820+0000 7f78babff700 1 -- 172.21.15.72:0/1851431975 shutdown_connections 2023-07-27T20:31:57.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.820+0000 7f78babff700 1 -- 172.21.15.72:0/1851431975 wait complete. 2023-07-27T20:31:57.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.820+0000 7fd8df1ff700 1 -- 172.21.15.72:0/1172261366 shutdown_connections 2023-07-27T20:31:57.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.820+0000 7fd8df1ff700 1 -- 172.21.15.72:0/1172261366 wait complete. 2023-07-27T20:31:57.822 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.0 2023-07-27T20:31:57.822 DEBUG:teuthology.parallel:result is None 2023-07-27T20:31:57.829 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.6 2023-07-27T20:31:57.830 DEBUG:teuthology.parallel:result is None 2023-07-27T20:31:57.832 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.2 2023-07-27T20:31:57.832 DEBUG:teuthology.parallel:result is None 2023-07-27T20:31:57.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.845+0000 7f1d3efff700 1 -- 172.21.15.72:0/1794613922 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f1d380a83a0 con 0x7f1d38155ad0 2023-07-27T20:31:57.834 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.5 2023-07-27T20:31:57.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.846+0000 7f1d357fa700 1 -- 172.21.15.72:0/1794613922 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1d380a83a0 con 0x7f1d38155ad0 2023-07-27T20:31:57.834 INFO:teuthology.orchestra.run.smithi072.stdout:55834574860 2023-07-27T20:31:57.835 DEBUG:teuthology.parallel:result is None 2023-07-27T20:31:57.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.848+0000 7f1d3efff700 1 -- 172.21.15.72:0/1794613922 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1d2406ad30 msgr2=0x7f1d2406d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.848+0000 7f1d3efff700 1 --2- 172.21.15.72:0/1794613922 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1d2406ad30 0x7f1d2406d1f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c009c10 tx=0x7f1d2c008030 comp rx=0 tx=0).stop 2023-07-27T20:31:57.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.848+0000 7f1d3efff700 1 -- 172.21.15.72:0/1794613922 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d38155ad0 msgr2=0x7f1d38200b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:57.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.848+0000 7f1d3efff700 1 --2- 172.21.15.72:0/1794613922 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d38155ad0 0x7f1d38200b30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1d3000efc0 tx=0x7f1d3000c3a0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.849+0000 7f1d3efff700 1 -- 172.21.15.72:0/1794613922 shutdown_connections 2023-07-27T20:31:57.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.849+0000 7f1d3efff700 1 --2- 172.21.15.72:0/1794613922 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1d2406ad30 0x7f1d2406d1f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.849+0000 7f1d3efff700 1 --2- 172.21.15.72:0/1794613922 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d38155ad0 0x7f1d38200b30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.849+0000 7f1d3efff700 1 --2- 172.21.15.72:0/1794613922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d380c02d0 0x7f1d380aabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.849+0000 7f1d3efff700 1 --2- 172.21.15.72:0/1794613922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d380c0be0 0x7f1d381587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:57.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.849+0000 7f1d3efff700 1 -- 172.21.15.72:0/1794613922 >> 172.21.15.72:0/1794613922 conn(0x7f1d3806a190 msgr2=0x7f1d3806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:57.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.849+0000 7f1d3efff700 1 -- 172.21.15.72:0/1794613922 shutdown_connections 2023-07-27T20:31:57.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:57.849+0000 7f1d3efff700 1 -- 172.21.15.72:0/1794613922 wait complete. 2023-07-27T20:31:57.854 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.7 2023-07-27T20:31:57.855 DEBUG:teuthology.parallel:result is None 2023-07-27T20:31:57.855 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-27T20:31:57.855 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T20:31:58.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.104+0000 7f341b7ff700 1 Processor -- start 2023-07-27T20:31:58.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.104+0000 7f341b7ff700 1 -- start start 2023-07-27T20:31:58.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.105+0000 7f341b7ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3414139960 0x7f34140c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:58.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.105+0000 7f341b7ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f34141542e0 0x7f3414154710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:58.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.105+0000 7f341b7ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34140c1810 con 0x7f3414139f80 2023-07-27T20:31:58.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.105+0000 7f341b7ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34140c0ee0 con 0x7f34141542e0 2023-07-27T20:31:58.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.105+0000 7f341b7ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3414139d40 con 0x7f3414139960 2023-07-27T20:31:58.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.105+0000 7f3419d9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f34141542e0 0x7f3414154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:58.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.105+0000 7f3419d9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f34141542e0 0x7f3414154710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58794/0 (socket says 172.21.15.72:58794) 2023-07-27T20:31:58.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.105+0000 7f3418d9a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3414139f80 0x7f34140c1e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55504/0 (socket says 172.21.15.72:55504) 2023-07-27T20:31:58.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.105+0000 7f3419d9c700 1 -- 172.21.15.72:0/612402006 learned_addr learned my addr 172.21.15.72:0/612402006 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:58.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.106+0000 7f341959b700 1 --2- 172.21.15.72:0/612402006 >> v2:172.21.15.173:3300/0 conn(0x7f3414139960 0x7f34140c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:58.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.106+0000 7f3419d9c700 1 -- 172.21.15.72:0/612402006 >> v2:172.21.15.173:3300/0 conn(0x7f3414139960 msgr2=0x7f34140c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:58.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.106+0000 7f3419d9c700 1 --2- 172.21.15.72:0/612402006 >> v2:172.21.15.173:3300/0 conn(0x7f3414139960 0x7f34140c12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:58.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.106+0000 7f3419d9c700 1 -- 172.21.15.72:0/612402006 >> v1:172.21.15.72:6789/0 conn(0x7f3414139f80 legacy=0x7f34140c1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:58.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.106+0000 7f3419d9c700 1 -- 172.21.15.72:0/612402006 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3414151060 con 0x7f34141542e0 2023-07-27T20:31:58.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.106+0000 7f341959b700 1 --2- 172.21.15.72:0/612402006 >> v2:172.21.15.173:3300/0 conn(0x7f3414139960 0x7f34140c12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:31:58.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.106+0000 7f340bfff700 1 -- 172.21.15.72:0/612402006 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1719432167 0 0) 0x7f34140c1810 con 0x7f3414139f80 2023-07-27T20:31:58.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.106+0000 7f3419d9c700 1 --2- 172.21.15.72:0/612402006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34141542e0 0x7f3414154710 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f341406e840 tx=0x7f340c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc8864160aa7a30f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:58.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.106+0000 7f340bfff700 1 -- 172.21.15.72:0/612402006 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340c00e070 con 0x7f34141542e0 2023-07-27T20:31:58.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.106+0000 7f340bfff700 1 -- 172.21.15.72:0/612402006 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340c00b9c0 con 0x7f34141542e0 2023-07-27T20:31:58.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.106+0000 7f340bfff700 1 -- 172.21.15.72:0/612402006 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340c00bd70 con 0x7f34141542e0 2023-07-27T20:31:58.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.107+0000 7f341b7ff700 1 -- 172.21.15.72:0/612402006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34141542e0 msgr2=0x7f3414154710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:58.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.107+0000 7f341b7ff700 1 --2- 172.21.15.72:0/612402006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34141542e0 0x7f3414154710 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f341406e840 tx=0x7f340c00b330 comp rx=0 tx=0).stop 2023-07-27T20:31:58.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.107+0000 7f341b7ff700 1 -- 172.21.15.72:0/612402006 shutdown_connections 2023-07-27T20:31:58.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.107+0000 7f341b7ff700 1 --2- 172.21.15.72:0/612402006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34141542e0 0x7f3414154710 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:58.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.107+0000 7f341b7ff700 1 --2- 172.21.15.72:0/612402006 >> v2:172.21.15.173:3300/0 conn(0x7f3414139960 0x7f34140c12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:58.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.107+0000 7f341b7ff700 1 -- 172.21.15.72:0/612402006 >> 172.21.15.72:0/612402006 conn(0x7f341406a190 msgr2=0x7f341406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:58.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.107+0000 7f341b7ff700 1 -- 172.21.15.72:0/612402006 shutdown_connections 2023-07-27T20:31:58.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.107+0000 7f341b7ff700 1 -- 172.21.15.72:0/612402006 wait complete. 2023-07-27T20:31:58.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.109+0000 7f341b7ff700 1 Processor -- start 2023-07-27T20:31:58.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.109+0000 7f341b7ff700 1 -- start start 2023-07-27T20:31:58.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.109+0000 7f341b7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3414139960 0x7f3414131cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:58.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.109+0000 7f341b7ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3414139f80 0x7f34141de9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:58.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.110+0000 7f341b7ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f34141542e0 0x7f3414130b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:58.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.110+0000 7f341b7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34141ecf40 con 0x7f3414139960 2023-07-27T20:31:58.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.110+0000 7f341b7ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3414132200 con 0x7f3414139f80 2023-07-27T20:31:58.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.110+0000 7f341b7ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34141ec650 con 0x7f34141542e0 2023-07-27T20:31:58.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.110+0000 7f341959b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3414139960 0x7f3414131cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:58.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.110+0000 7f341959b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3414139960 0x7f3414131cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58806/0 (socket says 172.21.15.72:58806) 2023-07-27T20:31:58.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.110+0000 7f341959b700 1 -- 172.21.15.72:0/273558375 learned_addr learned my addr 172.21.15.72:0/273558375 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:58.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.110+0000 7f3418d9a700 1 --2- 172.21.15.72:0/273558375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3414139f80 0x7f34141de9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:58.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.110+0000 7f3419d9c700 1 --2- 172.21.15.72:0/273558375 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f34141542e0 0x7f3414130b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:58.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.110+0000 7f341959b700 1 -- 172.21.15.72:0/273558375 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f34141542e0 msgr2=0x7f3414130b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:58.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.110+0000 7f341959b700 1 --2- 172.21.15.72:0/273558375 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f34141542e0 0x7f3414130b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:58.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.110+0000 7f341959b700 1 -- 172.21.15.72:0/273558375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3414139f80 msgr2=0x7f34141de9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:58.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.110+0000 7f341959b700 1 --2- 172.21.15.72:0/273558375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3414139f80 0x7f34141de9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:58.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.110+0000 7f341959b700 1 -- 172.21.15.72:0/273558375 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f340c009b30 con 0x7f3414139960 2023-07-27T20:31:58.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.110+0000 7f3418d9a700 1 --2- 172.21.15.72:0/273558375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3414139f80 0x7f34141de9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:31:58.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.110+0000 7f341959b700 1 --2- 172.21.15.72:0/273558375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3414139960 0x7f3414131cc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f341000c7f0 tx=0x7f341000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:58.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.111+0000 7f3409ffb700 1 -- 172.21.15.72:0/273558375 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3410011800 con 0x7f3414139960 2023-07-27T20:31:58.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.111+0000 7f3409ffb700 1 -- 172.21.15.72:0/273558375 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3410011960 con 0x7f3414139960 2023-07-27T20:31:58.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.111+0000 7f341b7ff700 1 -- 172.21.15.72:0/273558375 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3414132490 con 0x7f3414139960 2023-07-27T20:31:58.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.111+0000 7f3409ffb700 1 -- 172.21.15.72:0/273558375 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3410011d10 con 0x7f3414139960 2023-07-27T20:31:58.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.111+0000 7f341b7ff700 1 -- 172.21.15.72:0/273558375 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34141ecbd0 con 0x7f3414139960 2023-07-27T20:31:58.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.112+0000 7f341b7ff700 1 -- 172.21.15.72:0/273558375 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3414074310 con 0x7f3414139960 2023-07-27T20:31:58.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.113+0000 7f3409ffb700 1 -- 172.21.15.72:0/273558375 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3410018360 con 0x7f3414139960 2023-07-27T20:31:58.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.113+0000 7f3409ffb700 1 --2- 172.21.15.72:0/273558375 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f33f806ad10 0x7f33f806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:58.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.114+0000 7f3409ffb700 1 -- 172.21.15.72:0/273558375 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f34100898c0 con 0x7f3414139960 2023-07-27T20:31:58.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.114+0000 7f3418d9a700 1 --2- 172.21.15.72:0/273558375 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f33f806ad10 0x7f33f806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:58.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.115+0000 7f3418d9a700 1 --2- 172.21.15.72:0/273558375 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f33f806ad10 0x7f33f806d1d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f34141e6c50 tx=0x7f3404009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:58.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.118+0000 7f3409ffb700 1 -- 172.21.15.72:0/273558375 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3410054550 con 0x7f3414139960 2023-07-27T20:31:58.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.308+0000 7f341b7ff700 1 -- 172.21.15.72:0/273558375 --> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3414151620 con 0x7f33f806ad10 2023-07-27T20:31:58.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.319+0000 7f3409ffb700 1 -- 172.21.15.72:0/273558375 <== mgr.4107 v2:172.21.15.173:6832/910681537 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367352 (secure 0 0 0) 0x7f3404001cc0 con 0x7f33f806ad10 2023-07-27T20:31:58.313 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:31:58.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.324+0000 7f341b7ff700 1 -- 172.21.15.72:0/273558375 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f33f806ad10 msgr2=0x7f33f806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:58.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.324+0000 7f341b7ff700 1 --2- 172.21.15.72:0/273558375 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f33f806ad10 0x7f33f806d1d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f34141e6c50 tx=0x7f3404009040 comp rx=0 tx=0).stop 2023-07-27T20:31:58.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.324+0000 7f341b7ff700 1 -- 172.21.15.72:0/273558375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3414139960 msgr2=0x7f3414131cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:58.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.324+0000 7f341b7ff700 1 --2- 172.21.15.72:0/273558375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3414139960 0x7f3414131cc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f341000c7f0 tx=0x7f341000cbb0 comp rx=0 tx=0).stop 2023-07-27T20:31:58.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.324+0000 7f341b7ff700 1 -- 172.21.15.72:0/273558375 shutdown_connections 2023-07-27T20:31:58.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.324+0000 7f341b7ff700 1 --2- 172.21.15.72:0/273558375 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f33f806ad10 0x7f33f806d1d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:58.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.324+0000 7f341b7ff700 1 --2- 172.21.15.72:0/273558375 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f34141542e0 0x7f3414130b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:58.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.324+0000 7f341b7ff700 1 --2- 172.21.15.72:0/273558375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3414139960 0x7f3414131cc0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:58.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.324+0000 7f341b7ff700 1 --2- 172.21.15.72:0/273558375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3414139f80 0x7f34141de9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:58.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.324+0000 7f341b7ff700 1 -- 172.21.15.72:0/273558375 >> 172.21.15.72:0/273558375 conn(0x7f341406a190 msgr2=0x7f341406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:58.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.324+0000 7f341b7ff700 1 -- 172.21.15.72:0/273558375 shutdown_connections 2023-07-27T20:31:58.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.324+0000 7f341b7ff700 1 -- 172.21.15.72:0/273558375 wait complete. 2023-07-27T20:31:58.319 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-07-27T20:31:58.330 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2023-07-27T20:31:56.532255+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219676,"kb_used_data":3496,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755044,"statfs":{"total":773094113280,"available":772869165056,"internally_reserved":0,"allocated":3579904,"data_stored":2149128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003320"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964347+0000","last_change":"2023-07-27T20:31:29.128137+0000","last_active":"2023-07-27T20:31:34.964347+0000","last_peered":"2023-07-27T20:31:34.964347+0000","last_clean":"2023-07-27T20:31:34.964347+0000","last_became_active":"2023-07-27T20:31:29.127840+0000","last_became_peered":"2023-07-27T20:31:29.127840+0000","last_unstale":"2023-07-27T20:31:34.964347+0000","last_undegraded":"2023-07-27T20:31:34.964347+0000","last_fullsized":"2023-07-27T20:31:34.964347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:59:36.649918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963365+0000","last_change":"2023-07-27T20:31:29.140868+0000","last_active":"2023-07-27T20:31:34.963365+0000","last_peered":"2023-07-27T20:31:34.963365+0000","last_clean":"2023-07-27T20:31:34.963365+0000","last_became_active":"2023-07-27T20:31:29.140592+0000","last_became_peered":"2023-07-27T20:31:29.140592+0000","last_unstale":"2023-07-27T20:31:34.963365+0000","last_undegraded":"2023-07-27T20:31:34.963365+0000","last_fullsized":"2023-07-27T20:31:34.963365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:48:10.867603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160140+0000","last_change":"2023-07-27T20:31:29.129303+0000","last_active":"2023-07-27T20:31:34.160140+0000","last_peered":"2023-07-27T20:31:34.160140+0000","last_clean":"2023-07-27T20:31:34.160140+0000","last_became_active":"2023-07-27T20:31:29.128569+0000","last_became_peered":"2023-07-27T20:31:29.128569+0000","last_unstale":"2023-07-27T20:31:34.160140+0000","last_undegraded":"2023-07-27T20:31:34.160140+0000","last_fullsized":"2023-07-27T20:31:34.160140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:10:18.495424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.962918+0000","last_change":"2023-07-27T20:31:29.134687+0000","last_active":"2023-07-27T20:31:34.962918+0000","last_peered":"2023-07-27T20:31:34.962918+0000","last_clean":"2023-07-27T20:31:34.962918+0000","last_became_active":"2023-07-27T20:31:29.134388+0000","last_became_peered":"2023-07-27T20:31:29.134388+0000","last_unstale":"2023-07-27T20:31:34.962918+0000","last_undegraded":"2023-07-27T20:31:34.962918+0000","last_fullsized":"2023-07-27T20:31:34.962918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:05:57.560432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158183+0000","last_change":"2023-07-27T20:31:29.127581+0000","last_active":"2023-07-27T20:31:34.158183+0000","last_peered":"2023-07-27T20:31:34.158183+0000","last_clean":"2023-07-27T20:31:34.158183+0000","last_became_active":"2023-07-27T20:31:29.127256+0000","last_became_peered":"2023-07-27T20:31:29.127256+0000","last_unstale":"2023-07-27T20:31:34.158183+0000","last_undegraded":"2023-07-27T20:31:34.158183+0000","last_fullsized":"2023-07-27T20:31:34.158183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:04:20.052228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158888+0000","last_change":"2023-07-27T20:31:29.130522+0000","last_active":"2023-07-27T20:31:34.158888+0000","last_peered":"2023-07-27T20:31:34.158888+0000","last_clean":"2023-07-27T20:31:34.158888+0000","last_became_active":"2023-07-27T20:31:29.129964+0000","last_became_peered":"2023-07-27T20:31:29.129964+0000","last_unstale":"2023-07-27T20:31:34.158888+0000","last_undegraded":"2023-07-27T20:31:34.158888+0000","last_fullsized":"2023-07-27T20:31:34.158888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:32:37.192663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159958+0000","last_change":"2023-07-27T20:31:29.138061+0000","last_active":"2023-07-27T20:31:34.159958+0000","last_peered":"2023-07-27T20:31:34.159958+0000","last_clean":"2023-07-27T20:31:34.159958+0000","last_became_active":"2023-07-27T20:31:29.137407+0000","last_became_peered":"2023-07-27T20:31:29.137407+0000","last_unstale":"2023-07-27T20:31:34.159958+0000","last_undegraded":"2023-07-27T20:31:34.159958+0000","last_fullsized":"2023-07-27T20:31:34.159958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:52:37.919677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.962665+0000","last_change":"2023-07-27T20:31:29.142667+0000","last_active":"2023-07-27T20:31:34.962665+0000","last_peered":"2023-07-27T20:31:34.962665+0000","last_clean":"2023-07-27T20:31:34.962665+0000","last_became_active":"2023-07-27T20:31:29.141164+0000","last_became_peered":"2023-07-27T20:31:29.141164+0000","last_unstale":"2023-07-27T20:31:34.962665+0000","last_undegraded":"2023-07-27T20:31:34.962665+0000","last_fullsized":"2023-07-27T20:31:34.962665+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:32:33.408454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157543+0000","last_change":"2023-07-27T20:31:29.129290+0000","last_active":"2023-07-27T20:31:34.157543+0000","last_peered":"2023-07-27T20:31:34.157543+0000","last_clean":"2023-07-27T20:31:34.157543+0000","last_became_active":"2023-07-27T20:31:29.127546+0000","last_became_peered":"2023-07-27T20:31:29.127546+0000","last_unstale":"2023-07-27T20:31:34.157543+0000","last_undegraded":"2023-07-27T20:31:34.157543+0000","last_fullsized":"2023-07-27T20:31:34.157543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:07:33.134307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963982+0000","last_change":"2023-07-27T20:31:29.146424+0000","last_active":"2023-07-27T20:31:34.963982+0000","last_peered":"2023-07-27T20:31:34.963982+0000","last_clean":"2023-07-27T20:31:34.963982+0000","last_became_active":"2023-07-27T20:31:29.146170+0000","last_became_peered":"2023-07-27T20:31:29.146170+0000","last_unstale":"2023-07-27T20:31:34.963982+0000","last_undegraded":"2023-07-27T20:31:34.963982+0000","last_fullsized":"2023-07-27T20:31:34.963982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:30:09.671437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160355+0000","last_change":"2023-07-27T20:31:29.137685+0000","last_active":"2023-07-27T20:31:34.160355+0000","last_peered":"2023-07-27T20:31:34.160355+0000","last_clean":"2023-07-27T20:31:34.160355+0000","last_became_active":"2023-07-27T20:31:29.130560+0000","last_became_peered":"2023-07-27T20:31:29.130560+0000","last_unstale":"2023-07-27T20:31:34.160355+0000","last_undegraded":"2023-07-27T20:31:34.160355+0000","last_fullsized":"2023-07-27T20:31:34.160355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:11:40.101545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963386+0000","last_change":"2023-07-27T20:31:29.134204+0000","last_active":"2023-07-27T20:31:34.963386+0000","last_peered":"2023-07-27T20:31:34.963386+0000","last_clean":"2023-07-27T20:31:34.963386+0000","last_became_active":"2023-07-27T20:31:29.133944+0000","last_became_peered":"2023-07-27T20:31:29.133944+0000","last_unstale":"2023-07-27T20:31:34.963386+0000","last_undegraded":"2023-07-27T20:31:34.963386+0000","last_fullsized":"2023-07-27T20:31:34.963386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:18:04.393407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964703+0000","last_change":"2023-07-27T20:31:29.126910+0000","last_active":"2023-07-27T20:31:34.964703+0000","last_peered":"2023-07-27T20:31:34.964703+0000","last_clean":"2023-07-27T20:31:34.964703+0000","last_became_active":"2023-07-27T20:31:29.126575+0000","last_became_peered":"2023-07-27T20:31:29.126575+0000","last_unstale":"2023-07-27T20:31:34.964703+0000","last_undegraded":"2023-07-27T20:31:34.964703+0000","last_fullsized":"2023-07-27T20:31:34.964703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:31:04.071892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.962855+0000","last_change":"2023-07-27T20:31:29.139957+0000","last_active":"2023-07-27T20:31:34.962855+0000","last_peered":"2023-07-27T20:31:34.962855+0000","last_clean":"2023-07-27T20:31:34.962855+0000","last_became_active":"2023-07-27T20:31:29.139623+0000","last_became_peered":"2023-07-27T20:31:29.139623+0000","last_unstale":"2023-07-27T20:31:34.962855+0000","last_undegraded":"2023-07-27T20:31:34.962855+0000","last_fullsized":"2023-07-27T20:31:34.962855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:22:49.467838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159607+0000","last_change":"2023-07-27T20:31:29.143739+0000","last_active":"2023-07-27T20:31:34.159607+0000","last_peered":"2023-07-27T20:31:34.159607+0000","last_clean":"2023-07-27T20:31:34.159607+0000","last_became_active":"2023-07-27T20:31:29.143337+0000","last_became_peered":"2023-07-27T20:31:29.143337+0000","last_unstale":"2023-07-27T20:31:34.159607+0000","last_undegraded":"2023-07-27T20:31:34.159607+0000","last_fullsized":"2023-07-27T20:31:34.159607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:24:57.182748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158603+0000","last_change":"2023-07-27T20:31:29.125242+0000","last_active":"2023-07-27T20:31:34.158603+0000","last_peered":"2023-07-27T20:31:34.158603+0000","last_clean":"2023-07-27T20:31:34.158603+0000","last_became_active":"2023-07-27T20:31:29.124967+0000","last_became_peered":"2023-07-27T20:31:29.124967+0000","last_unstale":"2023-07-27T20:31:34.158603+0000","last_undegraded":"2023-07-27T20:31:34.158603+0000","last_fullsized":"2023-07-27T20:31:34.158603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:31:04.269016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157859+0000","last_change":"2023-07-27T20:31:29.127644+0000","last_active":"2023-07-27T20:31:34.157859+0000","last_peered":"2023-07-27T20:31:34.157859+0000","last_clean":"2023-07-27T20:31:34.157859+0000","last_became_active":"2023-07-27T20:31:29.127277+0000","last_became_peered":"2023-07-27T20:31:29.127277+0000","last_unstale":"2023-07-27T20:31:34.157859+0000","last_undegraded":"2023-07-27T20:31:34.157859+0000","last_fullsized":"2023-07-27T20:31:34.157859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:38:08.459694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160497+0000","last_change":"2023-07-27T20:31:29.131333+0000","last_active":"2023-07-27T20:31:34.160497+0000","last_peered":"2023-07-27T20:31:34.160497+0000","last_clean":"2023-07-27T20:31:34.160497+0000","last_became_active":"2023-07-27T20:31:29.131016+0000","last_became_peered":"2023-07-27T20:31:29.131016+0000","last_unstale":"2023-07-27T20:31:34.160497+0000","last_undegraded":"2023-07-27T20:31:34.160497+0000","last_fullsized":"2023-07-27T20:31:34.160497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:22:01.318022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963957+0000","last_change":"2023-07-27T20:31:29.133266+0000","last_active":"2023-07-27T20:31:34.963957+0000","last_peered":"2023-07-27T20:31:34.963957+0000","last_clean":"2023-07-27T20:31:34.963957+0000","last_became_active":"2023-07-27T20:31:29.132915+0000","last_became_peered":"2023-07-27T20:31:29.132915+0000","last_unstale":"2023-07-27T20:31:34.963957+0000","last_undegraded":"2023-07-27T20:31:34.963957+0000","last_fullsized":"2023-07-27T20:31:34.963957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:56:38.159541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158925+0000","last_change":"2023-07-27T20:31:29.141130+0000","last_active":"2023-07-27T20:31:34.158925+0000","last_peered":"2023-07-27T20:31:34.158925+0000","last_clean":"2023-07-27T20:31:34.158925+0000","last_became_active":"2023-07-27T20:31:29.140883+0000","last_became_peered":"2023-07-27T20:31:29.140883+0000","last_unstale":"2023-07-27T20:31:34.158925+0000","last_undegraded":"2023-07-27T20:31:34.158925+0000","last_fullsized":"2023-07-27T20:31:34.158925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:08:14.703624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159167+0000","last_change":"2023-07-27T20:31:29.139144+0000","last_active":"2023-07-27T20:31:34.159167+0000","last_peered":"2023-07-27T20:31:34.159167+0000","last_clean":"2023-07-27T20:31:34.159167+0000","last_became_active":"2023-07-27T20:31:29.137774+0000","last_became_peered":"2023-07-27T20:31:29.137774+0000","last_unstale":"2023-07-27T20:31:34.159167+0000","last_undegraded":"2023-07-27T20:31:34.159167+0000","last_fullsized":"2023-07-27T20:31:34.159167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:21:00.439118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157696+0000","last_change":"2023-07-27T20:31:29.131957+0000","last_active":"2023-07-27T20:31:34.157696+0000","last_peered":"2023-07-27T20:31:34.157696+0000","last_clean":"2023-07-27T20:31:34.157696+0000","last_became_active":"2023-07-27T20:31:29.131512+0000","last_became_peered":"2023-07-27T20:31:29.131512+0000","last_unstale":"2023-07-27T20:31:34.157696+0000","last_undegraded":"2023-07-27T20:31:34.157696+0000","last_fullsized":"2023-07-27T20:31:34.157696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:41:18.405424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964757+0000","last_change":"2023-07-27T20:31:29.130648+0000","last_active":"2023-07-27T20:31:34.964757+0000","last_peered":"2023-07-27T20:31:34.964757+0000","last_clean":"2023-07-27T20:31:34.964757+0000","last_became_active":"2023-07-27T20:31:29.130145+0000","last_became_peered":"2023-07-27T20:31:29.130145+0000","last_unstale":"2023-07-27T20:31:34.964757+0000","last_undegraded":"2023-07-27T20:31:34.964757+0000","last_fullsized":"2023-07-27T20:31:34.964757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:25:53.220364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159388+0000","last_change":"2023-07-27T20:31:29.138599+0000","last_active":"2023-07-27T20:31:34.159388+0000","last_peered":"2023-07-27T20:31:34.159388+0000","last_clean":"2023-07-27T20:31:34.159388+0000","last_became_active":"2023-07-27T20:31:29.138323+0000","last_became_peered":"2023-07-27T20:31:29.138323+0000","last_unstale":"2023-07-27T20:31:34.159388+0000","last_undegraded":"2023-07-27T20:31:34.159388+0000","last_fullsized":"2023-07-27T20:31:34.159388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:03:16.615704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965611+0000","last_change":"2023-07-27T20:31:29.136600+0000","last_active":"2023-07-27T20:31:34.965611+0000","last_peered":"2023-07-27T20:31:34.965611+0000","last_clean":"2023-07-27T20:31:34.965611+0000","last_became_active":"2023-07-27T20:31:29.136316+0000","last_became_peered":"2023-07-27T20:31:29.136316+0000","last_unstale":"2023-07-27T20:31:34.965611+0000","last_undegraded":"2023-07-27T20:31:34.965611+0000","last_fullsized":"2023-07-27T20:31:34.965611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:46:44.091855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963642+0000","last_change":"2023-07-27T20:31:29.135116+0000","last_active":"2023-07-27T20:31:34.963642+0000","last_peered":"2023-07-27T20:31:34.963642+0000","last_clean":"2023-07-27T20:31:34.963642+0000","last_became_active":"2023-07-27T20:31:29.134786+0000","last_became_peered":"2023-07-27T20:31:29.134786+0000","last_unstale":"2023-07-27T20:31:34.963642+0000","last_undegraded":"2023-07-27T20:31:34.963642+0000","last_fullsized":"2023-07-27T20:31:34.963642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:21:00.439118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963660+0000","last_change":"2023-07-27T20:31:29.145388+0000","last_active":"2023-07-27T20:31:34.963660+0000","last_peered":"2023-07-27T20:31:34.963660+0000","last_clean":"2023-07-27T20:31:34.963660+0000","last_became_active":"2023-07-27T20:31:29.141813+0000","last_became_peered":"2023-07-27T20:31:29.141813+0000","last_unstale":"2023-07-27T20:31:34.963660+0000","last_undegraded":"2023-07-27T20:31:34.963660+0000","last_fullsized":"2023-07-27T20:31:34.963660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:52:37.919677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159610+0000","last_change":"2023-07-27T20:31:33.179641+0000","last_active":"2023-07-27T20:31:34.159610+0000","last_peered":"2023-07-27T20:31:34.159610+0000","last_clean":"2023-07-27T20:31:34.159610+0000","last_became_active":"2023-07-27T20:31:33.179219+0000","last_became_peered":"2023-07-27T20:31:33.179219+0000","last_unstale":"2023-07-27T20:31:34.159610+0000","last_undegraded":"2023-07-27T20:31:34.159610+0000","last_fullsized":"2023-07-27T20:31:34.159610+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:22:32.926771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158940+0000","last_change":"2023-07-27T20:31:28.123712+0000","last_active":"2023-07-27T20:31:34.158940+0000","last_peered":"2023-07-27T20:31:34.158940+0000","last_clean":"2023-07-27T20:31:34.158940+0000","last_became_active":"2023-07-27T20:31:28.123425+0000","last_became_peered":"2023-07-27T20:31:28.123425+0000","last_unstale":"2023-07-27T20:31:34.158940+0000","last_undegraded":"2023-07-27T20:31:34.158940+0000","last_fullsized":"2023-07-27T20:31:34.158940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:26:08.939256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964276+0000","last_change":"2023-07-27T20:31:29.130374+0000","last_active":"2023-07-27T20:31:34.964276+0000","last_peered":"2023-07-27T20:31:34.964276+0000","last_clean":"2023-07-27T20:31:34.964276+0000","last_became_active":"2023-07-27T20:31:29.130099+0000","last_became_peered":"2023-07-27T20:31:29.130099+0000","last_unstale":"2023-07-27T20:31:34.964276+0000","last_undegraded":"2023-07-27T20:31:34.964276+0000","last_fullsized":"2023-07-27T20:31:34.964276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:17:03.497602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963430+0000","last_change":"2023-07-27T20:31:33.178251+0000","last_active":"2023-07-27T20:31:34.963430+0000","last_peered":"2023-07-27T20:31:34.963430+0000","last_clean":"2023-07-27T20:31:34.963430+0000","last_became_active":"2023-07-27T20:31:33.177826+0000","last_became_peered":"2023-07-27T20:31:33.177826+0000","last_unstale":"2023-07-27T20:31:34.963430+0000","last_undegraded":"2023-07-27T20:31:34.963430+0000","last_fullsized":"2023-07-27T20:31:34.963430+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:59:12.877709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.962935+0000","last_change":"2023-07-27T20:31:28.123837+0000","last_active":"2023-07-27T20:31:34.962935+0000","last_peered":"2023-07-27T20:31:34.962935+0000","last_clean":"2023-07-27T20:31:34.962935+0000","last_became_active":"2023-07-27T20:31:28.123456+0000","last_became_peered":"2023-07-27T20:31:28.123456+0000","last_unstale":"2023-07-27T20:31:34.962935+0000","last_undegraded":"2023-07-27T20:31:34.962935+0000","last_fullsized":"2023-07-27T20:31:34.962935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:56:54.247350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158484+0000","last_change":"2023-07-27T20:31:29.141212+0000","last_active":"2023-07-27T20:31:34.158484+0000","last_peered":"2023-07-27T20:31:34.158484+0000","last_clean":"2023-07-27T20:31:34.158484+0000","last_became_active":"2023-07-27T20:31:29.140956+0000","last_became_peered":"2023-07-27T20:31:29.140956+0000","last_unstale":"2023-07-27T20:31:34.158484+0000","last_undegraded":"2023-07-27T20:31:34.158484+0000","last_fullsized":"2023-07-27T20:31:34.158484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:43:10.912905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158360+0000","last_change":"2023-07-27T20:31:33.182932+0000","last_active":"2023-07-27T20:31:34.158360+0000","last_peered":"2023-07-27T20:31:34.158360+0000","last_clean":"2023-07-27T20:31:34.158360+0000","last_became_active":"2023-07-27T20:31:33.182477+0000","last_became_peered":"2023-07-27T20:31:33.182477+0000","last_unstale":"2023-07-27T20:31:34.158360+0000","last_undegraded":"2023-07-27T20:31:34.158360+0000","last_fullsized":"2023-07-27T20:31:34.158360+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:25:57.270856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965391+0000","last_change":"2023-07-27T20:31:28.120846+0000","last_active":"2023-07-27T20:31:34.965391+0000","last_peered":"2023-07-27T20:31:34.965391+0000","last_clean":"2023-07-27T20:31:34.965391+0000","last_became_active":"2023-07-27T20:31:28.120544+0000","last_became_peered":"2023-07-27T20:31:28.120544+0000","last_unstale":"2023-07-27T20:31:34.965391+0000","last_undegraded":"2023-07-27T20:31:34.965391+0000","last_fullsized":"2023-07-27T20:31:34.965391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:17:24.488257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963834+0000","last_change":"2023-07-27T20:31:29.144062+0000","last_active":"2023-07-27T20:31:34.963834+0000","last_peered":"2023-07-27T20:31:34.963834+0000","last_clean":"2023-07-27T20:31:34.963834+0000","last_became_active":"2023-07-27T20:31:29.143781+0000","last_became_peered":"2023-07-27T20:31:29.143781+0000","last_unstale":"2023-07-27T20:31:34.963834+0000","last_undegraded":"2023-07-27T20:31:34.963834+0000","last_fullsized":"2023-07-27T20:31:34.963834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:17:24.376438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963333+0000","last_change":"2023-07-27T20:31:33.185760+0000","last_active":"2023-07-27T20:31:34.963333+0000","last_peered":"2023-07-27T20:31:34.963333+0000","last_clean":"2023-07-27T20:31:34.963333+0000","last_became_active":"2023-07-27T20:31:33.185326+0000","last_became_peered":"2023-07-27T20:31:33.185326+0000","last_unstale":"2023-07-27T20:31:34.963333+0000","last_undegraded":"2023-07-27T20:31:34.963333+0000","last_fullsized":"2023-07-27T20:31:34.963333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:13:18.283879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157795+0000","last_change":"2023-07-27T20:31:28.130352+0000","last_active":"2023-07-27T20:31:34.157795+0000","last_peered":"2023-07-27T20:31:34.157795+0000","last_clean":"2023-07-27T20:31:34.157795+0000","last_became_active":"2023-07-27T20:31:28.130107+0000","last_became_peered":"2023-07-27T20:31:28.130107+0000","last_unstale":"2023-07-27T20:31:34.157795+0000","last_undegraded":"2023-07-27T20:31:34.157795+0000","last_fullsized":"2023-07-27T20:31:34.157795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:32:39.371251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965281+0000","last_change":"2023-07-27T20:31:29.130936+0000","last_active":"2023-07-27T20:31:34.965281+0000","last_peered":"2023-07-27T20:31:34.965281+0000","last_clean":"2023-07-27T20:31:34.965281+0000","last_became_active":"2023-07-27T20:31:29.130687+0000","last_became_peered":"2023-07-27T20:31:29.130687+0000","last_unstale":"2023-07-27T20:31:34.965281+0000","last_undegraded":"2023-07-27T20:31:34.965281+0000","last_fullsized":"2023-07-27T20:31:34.965281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:26:00.598434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158984+0000","last_change":"2023-07-27T20:31:33.180364+0000","last_active":"2023-07-27T20:31:34.158984+0000","last_peered":"2023-07-27T20:31:34.158984+0000","last_clean":"2023-07-27T20:31:34.158984+0000","last_became_active":"2023-07-27T20:31:33.179972+0000","last_became_peered":"2023-07-27T20:31:33.179972+0000","last_unstale":"2023-07-27T20:31:34.158984+0000","last_undegraded":"2023-07-27T20:31:34.158984+0000","last_fullsized":"2023-07-27T20:31:34.158984+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:59:31.342576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963829+0000","last_change":"2023-07-27T20:31:28.127766+0000","last_active":"2023-07-27T20:31:34.963829+0000","last_peered":"2023-07-27T20:31:34.963829+0000","last_clean":"2023-07-27T20:31:34.963829+0000","last_became_active":"2023-07-27T20:31:28.127443+0000","last_became_peered":"2023-07-27T20:31:28.127443+0000","last_unstale":"2023-07-27T20:31:34.963829+0000","last_undegraded":"2023-07-27T20:31:34.963829+0000","last_fullsized":"2023-07-27T20:31:34.963829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:04:21.752471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964865+0000","last_change":"2023-07-27T20:31:29.144710+0000","last_active":"2023-07-27T20:31:34.964865+0000","last_peered":"2023-07-27T20:31:34.964865+0000","last_clean":"2023-07-27T20:31:34.964865+0000","last_became_active":"2023-07-27T20:31:29.142111+0000","last_became_peered":"2023-07-27T20:31:29.142111+0000","last_unstale":"2023-07-27T20:31:34.964865+0000","last_undegraded":"2023-07-27T20:31:34.964865+0000","last_fullsized":"2023-07-27T20:31:34.964865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:23:30.181522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963728+0000","last_change":"2023-07-27T20:31:33.183443+0000","last_active":"2023-07-27T20:31:34.963728+0000","last_peered":"2023-07-27T20:31:34.963728+0000","last_clean":"2023-07-27T20:31:34.963728+0000","last_became_active":"2023-07-27T20:31:33.183014+0000","last_became_peered":"2023-07-27T20:31:33.183014+0000","last_unstale":"2023-07-27T20:31:34.963728+0000","last_undegraded":"2023-07-27T20:31:34.963728+0000","last_fullsized":"2023-07-27T20:31:34.963728+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:41:22.455916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160506+0000","last_change":"2023-07-27T20:31:28.123550+0000","last_active":"2023-07-27T20:31:34.160506+0000","last_peered":"2023-07-27T20:31:34.160506+0000","last_clean":"2023-07-27T20:31:34.160506+0000","last_became_active":"2023-07-27T20:31:28.123257+0000","last_became_peered":"2023-07-27T20:31:28.123257+0000","last_unstale":"2023-07-27T20:31:34.160506+0000","last_undegraded":"2023-07-27T20:31:34.160506+0000","last_fullsized":"2023-07-27T20:31:34.160506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:32:39.371251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963506+0000","last_change":"2023-07-27T20:31:29.136453+0000","last_active":"2023-07-27T20:31:34.963506+0000","last_peered":"2023-07-27T20:31:34.963506+0000","last_clean":"2023-07-27T20:31:34.963506+0000","last_became_active":"2023-07-27T20:31:29.136266+0000","last_became_peered":"2023-07-27T20:31:29.136266+0000","last_unstale":"2023-07-27T20:31:34.963506+0000","last_undegraded":"2023-07-27T20:31:34.963506+0000","last_fullsized":"2023-07-27T20:31:34.963506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:59:27.292083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.962973+0000","last_change":"2023-07-27T20:31:33.184926+0000","last_active":"2023-07-27T20:31:34.962973+0000","last_peered":"2023-07-27T20:31:34.962973+0000","last_clean":"2023-07-27T20:31:34.962973+0000","last_became_active":"2023-07-27T20:31:33.184543+0000","last_became_peered":"2023-07-27T20:31:33.184543+0000","last_unstale":"2023-07-27T20:31:34.962973+0000","last_undegraded":"2023-07-27T20:31:34.962973+0000","last_fullsized":"2023-07-27T20:31:34.962973+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:14:53.290135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:47.846131+0000","last_change":"2023-07-27T20:31:28.109472+0000","last_active":"2023-07-27T20:31:47.846131+0000","last_peered":"2023-07-27T20:31:47.846131+0000","last_clean":"2023-07-27T20:31:47.846131+0000","last_became_active":"2023-07-27T20:31:28.108072+0000","last_became_peered":"2023-07-27T20:31:28.108072+0000","last_unstale":"2023-07-27T20:31:47.846131+0000","last_undegraded":"2023-07-27T20:31:47.846131+0000","last_fullsized":"2023-07-27T20:31:47.846131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:10:52.937708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159663+0000","last_change":"2023-07-27T20:31:29.140753+0000","last_active":"2023-07-27T20:31:34.159663+0000","last_peered":"2023-07-27T20:31:34.159663+0000","last_clean":"2023-07-27T20:31:34.159663+0000","last_became_active":"2023-07-27T20:31:29.140474+0000","last_became_peered":"2023-07-27T20:31:29.140474+0000","last_unstale":"2023-07-27T20:31:34.159663+0000","last_undegraded":"2023-07-27T20:31:34.159663+0000","last_fullsized":"2023-07-27T20:31:34.159663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:19:38.010331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963783+0000","last_change":"2023-07-27T20:31:33.183268+0000","last_active":"2023-07-27T20:31:34.963783+0000","last_peered":"2023-07-27T20:31:34.963783+0000","last_clean":"2023-07-27T20:31:34.963783+0000","last_became_active":"2023-07-27T20:31:33.182894+0000","last_became_peered":"2023-07-27T20:31:33.182894+0000","last_unstale":"2023-07-27T20:31:34.963783+0000","last_undegraded":"2023-07-27T20:31:34.963783+0000","last_fullsized":"2023-07-27T20:31:34.963783+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:07:37.184799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159042+0000","last_change":"2023-07-27T20:31:28.126200+0000","last_active":"2023-07-27T20:31:34.159042+0000","last_peered":"2023-07-27T20:31:34.159042+0000","last_clean":"2023-07-27T20:31:34.159042+0000","last_became_active":"2023-07-27T20:31:28.125867+0000","last_became_peered":"2023-07-27T20:31:28.125867+0000","last_unstale":"2023-07-27T20:31:34.159042+0000","last_undegraded":"2023-07-27T20:31:34.159042+0000","last_fullsized":"2023-07-27T20:31:34.159042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:59:02.266953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965069+0000","last_change":"2023-07-27T20:31:29.132793+0000","last_active":"2023-07-27T20:31:34.965069+0000","last_peered":"2023-07-27T20:31:34.965069+0000","last_clean":"2023-07-27T20:31:34.965069+0000","last_became_active":"2023-07-27T20:31:29.132532+0000","last_became_peered":"2023-07-27T20:31:29.132532+0000","last_unstale":"2023-07-27T20:31:34.965069+0000","last_undegraded":"2023-07-27T20:31:34.965069+0000","last_fullsized":"2023-07-27T20:31:34.965069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:08:38.076682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964916+0000","last_change":"2023-07-27T20:31:33.177965+0000","last_active":"2023-07-27T20:31:34.964916+0000","last_peered":"2023-07-27T20:31:34.964916+0000","last_clean":"2023-07-27T20:31:34.964916+0000","last_became_active":"2023-07-27T20:31:33.177476+0000","last_became_peered":"2023-07-27T20:31:33.177476+0000","last_unstale":"2023-07-27T20:31:34.964916+0000","last_undegraded":"2023-07-27T20:31:34.964916+0000","last_fullsized":"2023-07-27T20:31:34.964916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:00:33.711486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157385+0000","last_change":"2023-07-27T20:31:28.108577+0000","last_active":"2023-07-27T20:31:34.157385+0000","last_peered":"2023-07-27T20:31:34.157385+0000","last_clean":"2023-07-27T20:31:34.157385+0000","last_became_active":"2023-07-27T20:31:28.108279+0000","last_became_peered":"2023-07-27T20:31:28.108279+0000","last_unstale":"2023-07-27T20:31:34.157385+0000","last_undegraded":"2023-07-27T20:31:34.157385+0000","last_fullsized":"2023-07-27T20:31:34.157385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:29:56.003949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963523+0000","last_change":"2023-07-27T20:31:29.142170+0000","last_active":"2023-07-27T20:31:34.963523+0000","last_peered":"2023-07-27T20:31:34.963523+0000","last_clean":"2023-07-27T20:31:34.963523+0000","last_became_active":"2023-07-27T20:31:29.141464+0000","last_became_peered":"2023-07-27T20:31:29.141464+0000","last_unstale":"2023-07-27T20:31:34.963523+0000","last_undegraded":"2023-07-27T20:31:34.963523+0000","last_fullsized":"2023-07-27T20:31:34.963523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:29:57.010683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965238+0000","last_change":"2023-07-27T20:31:33.181354+0000","last_active":"2023-07-27T20:31:34.965238+0000","last_peered":"2023-07-27T20:31:34.965238+0000","last_clean":"2023-07-27T20:31:34.965238+0000","last_became_active":"2023-07-27T20:31:33.180937+0000","last_became_peered":"2023-07-27T20:31:33.180937+0000","last_unstale":"2023-07-27T20:31:34.965238+0000","last_undegraded":"2023-07-27T20:31:34.965238+0000","last_fullsized":"2023-07-27T20:31:34.965238+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:09:47.445321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159771+0000","last_change":"2023-07-27T20:31:28.126220+0000","last_active":"2023-07-27T20:31:34.159771+0000","last_peered":"2023-07-27T20:31:34.159771+0000","last_clean":"2023-07-27T20:31:34.159771+0000","last_became_active":"2023-07-27T20:31:28.125857+0000","last_became_peered":"2023-07-27T20:31:28.125857+0000","last_unstale":"2023-07-27T20:31:34.159771+0000","last_undegraded":"2023-07-27T20:31:34.159771+0000","last_fullsized":"2023-07-27T20:31:34.159771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:29:56.003949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157853+0000","last_change":"2023-07-27T20:31:29.128032+0000","last_active":"2023-07-27T20:31:34.157853+0000","last_peered":"2023-07-27T20:31:34.157853+0000","last_clean":"2023-07-27T20:31:34.157853+0000","last_became_active":"2023-07-27T20:31:29.127199+0000","last_became_peered":"2023-07-27T20:31:29.127199+0000","last_unstale":"2023-07-27T20:31:34.157853+0000","last_undegraded":"2023-07-27T20:31:34.157853+0000","last_fullsized":"2023-07-27T20:31:34.157853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:30:09.671437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963089+0000","last_change":"2023-07-27T20:31:33.190228+0000","last_active":"2023-07-27T20:31:34.963089+0000","last_peered":"2023-07-27T20:31:34.963089+0000","last_clean":"2023-07-27T20:31:34.963089+0000","last_became_active":"2023-07-27T20:31:33.188522+0000","last_became_peered":"2023-07-27T20:31:33.188522+0000","last_unstale":"2023-07-27T20:31:34.963089+0000","last_undegraded":"2023-07-27T20:31:34.963089+0000","last_fullsized":"2023-07-27T20:31:34.963089+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:13:45.447971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.962746+0000","last_change":"2023-07-27T20:31:28.119987+0000","last_active":"2023-07-27T20:31:34.962746+0000","last_peered":"2023-07-27T20:31:34.962746+0000","last_clean":"2023-07-27T20:31:34.962746+0000","last_became_active":"2023-07-27T20:31:28.119662+0000","last_became_peered":"2023-07-27T20:31:28.119662+0000","last_unstale":"2023-07-27T20:31:34.962746+0000","last_undegraded":"2023-07-27T20:31:34.962746+0000","last_fullsized":"2023-07-27T20:31:34.962746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:13:43.260178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965357+0000","last_change":"2023-07-27T20:31:29.138880+0000","last_active":"2023-07-27T20:31:34.965357+0000","last_peered":"2023-07-27T20:31:34.965357+0000","last_clean":"2023-07-27T20:31:34.965357+0000","last_became_active":"2023-07-27T20:31:29.138642+0000","last_became_peered":"2023-07-27T20:31:29.138642+0000","last_unstale":"2023-07-27T20:31:34.965357+0000","last_undegraded":"2023-07-27T20:31:34.965357+0000","last_fullsized":"2023-07-27T20:31:34.965357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:59:15.743619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160177+0000","last_change":"2023-07-27T20:31:33.184734+0000","last_active":"2023-07-27T20:31:34.160177+0000","last_peered":"2023-07-27T20:31:34.160177+0000","last_clean":"2023-07-27T20:31:34.160177+0000","last_became_active":"2023-07-27T20:31:33.183711+0000","last_became_peered":"2023-07-27T20:31:33.183711+0000","last_unstale":"2023-07-27T20:31:34.160177+0000","last_undegraded":"2023-07-27T20:31:34.160177+0000","last_fullsized":"2023-07-27T20:31:34.160177+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:07:37.184799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160260+0000","last_change":"2023-07-27T20:31:28.126412+0000","last_active":"2023-07-27T20:31:34.160260+0000","last_peered":"2023-07-27T20:31:34.160260+0000","last_clean":"2023-07-27T20:31:34.160260+0000","last_became_active":"2023-07-27T20:31:28.125276+0000","last_became_peered":"2023-07-27T20:31:28.125276+0000","last_unstale":"2023-07-27T20:31:34.160260+0000","last_undegraded":"2023-07-27T20:31:34.160260+0000","last_fullsized":"2023-07-27T20:31:34.160260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:04:21.752471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.962588+0000","last_change":"2023-07-27T20:31:29.141157+0000","last_active":"2023-07-27T20:31:34.962588+0000","last_peered":"2023-07-27T20:31:34.962588+0000","last_clean":"2023-07-27T20:31:34.962588+0000","last_became_active":"2023-07-27T20:31:29.140721+0000","last_became_peered":"2023-07-27T20:31:29.140721+0000","last_unstale":"2023-07-27T20:31:34.962588+0000","last_undegraded":"2023-07-27T20:31:34.962588+0000","last_fullsized":"2023-07-27T20:31:34.962588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:31:18.732492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.962761+0000","last_change":"2023-07-27T20:31:33.179053+0000","last_active":"2023-07-27T20:31:34.962761+0000","last_peered":"2023-07-27T20:31:34.962761+0000","last_clean":"2023-07-27T20:31:34.962761+0000","last_became_active":"2023-07-27T20:31:33.178636+0000","last_became_peered":"2023-07-27T20:31:33.178636+0000","last_unstale":"2023-07-27T20:31:34.962761+0000","last_undegraded":"2023-07-27T20:31:34.962761+0000","last_fullsized":"2023-07-27T20:31:34.962761+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:21:33.766448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160260+0000","last_change":"2023-07-27T20:31:28.122016+0000","last_active":"2023-07-27T20:31:34.160260+0000","last_peered":"2023-07-27T20:31:34.160260+0000","last_clean":"2023-07-27T20:31:34.160260+0000","last_became_active":"2023-07-27T20:31:28.121722+0000","last_became_peered":"2023-07-27T20:31:28.121722+0000","last_unstale":"2023-07-27T20:31:34.160260+0000","last_undegraded":"2023-07-27T20:31:34.160260+0000","last_fullsized":"2023-07-27T20:31:34.160260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:38:07.452960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159369+0000","last_change":"2023-07-27T20:31:29.126285+0000","last_active":"2023-07-27T20:31:34.159369+0000","last_peered":"2023-07-27T20:31:34.159369+0000","last_clean":"2023-07-27T20:31:34.159369+0000","last_became_active":"2023-07-27T20:31:29.126028+0000","last_became_peered":"2023-07-27T20:31:29.126028+0000","last_unstale":"2023-07-27T20:31:34.159369+0000","last_undegraded":"2023-07-27T20:31:34.159369+0000","last_fullsized":"2023-07-27T20:31:34.159369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:34:02.603036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964503+0000","last_change":"2023-07-27T20:31:33.192421+0000","last_active":"2023-07-27T20:31:34.964503+0000","last_peered":"2023-07-27T20:31:34.964503+0000","last_clean":"2023-07-27T20:31:34.964503+0000","last_became_active":"2023-07-27T20:31:33.188383+0000","last_became_peered":"2023-07-27T20:31:33.188383+0000","last_unstale":"2023-07-27T20:31:34.964503+0000","last_undegraded":"2023-07-27T20:31:34.964503+0000","last_fullsized":"2023-07-27T20:31:34.964503+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:19:59.171464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160661+0000","last_change":"2023-07-27T20:31:28.130299+0000","last_active":"2023-07-27T20:31:34.160661+0000","last_peered":"2023-07-27T20:31:34.160661+0000","last_clean":"2023-07-27T20:31:34.160661+0000","last_became_active":"2023-07-27T20:31:28.129986+0000","last_became_peered":"2023-07-27T20:31:28.129986+0000","last_unstale":"2023-07-27T20:31:34.160661+0000","last_undegraded":"2023-07-27T20:31:34.160661+0000","last_fullsized":"2023-07-27T20:31:34.160661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:02:56.272252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963299+0000","last_change":"2023-07-27T20:31:29.132566+0000","last_active":"2023-07-27T20:31:34.963299+0000","last_peered":"2023-07-27T20:31:34.963299+0000","last_clean":"2023-07-27T20:31:34.963299+0000","last_became_active":"2023-07-27T20:31:29.132163+0000","last_became_peered":"2023-07-27T20:31:29.132163+0000","last_unstale":"2023-07-27T20:31:34.963299+0000","last_undegraded":"2023-07-27T20:31:34.963299+0000","last_fullsized":"2023-07-27T20:31:34.963299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:39:29.240358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963259+0000","last_change":"2023-07-27T20:31:33.186162+0000","last_active":"2023-07-27T20:31:34.963259+0000","last_peered":"2023-07-27T20:31:34.963259+0000","last_clean":"2023-07-27T20:31:34.963259+0000","last_became_active":"2023-07-27T20:31:33.185738+0000","last_became_peered":"2023-07-27T20:31:33.185738+0000","last_unstale":"2023-07-27T20:31:34.963259+0000","last_undegraded":"2023-07-27T20:31:34.963259+0000","last_fullsized":"2023-07-27T20:31:34.963259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:59:46.029831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963161+0000","last_change":"2023-07-27T20:31:28.124073+0000","last_active":"2023-07-27T20:31:34.963161+0000","last_peered":"2023-07-27T20:31:34.963161+0000","last_clean":"2023-07-27T20:31:34.963161+0000","last_became_active":"2023-07-27T20:31:28.123661+0000","last_became_peered":"2023-07-27T20:31:28.123661+0000","last_unstale":"2023-07-27T20:31:34.963161+0000","last_undegraded":"2023-07-27T20:31:34.963161+0000","last_fullsized":"2023-07-27T20:31:34.963161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:20:59.432383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158518+0000","last_change":"2023-07-27T20:31:29.135207+0000","last_active":"2023-07-27T20:31:34.158518+0000","last_peered":"2023-07-27T20:31:34.158518+0000","last_clean":"2023-07-27T20:31:34.158518+0000","last_became_active":"2023-07-27T20:31:29.134951+0000","last_became_peered":"2023-07-27T20:31:29.134951+0000","last_unstale":"2023-07-27T20:31:34.158518+0000","last_undegraded":"2023-07-27T20:31:34.158518+0000","last_fullsized":"2023-07-27T20:31:34.158518+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:00:29.660993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964088+0000","last_change":"2023-07-27T20:31:33.192124+0000","last_active":"2023-07-27T20:31:34.964088+0000","last_peered":"2023-07-27T20:31:34.964088+0000","last_clean":"2023-07-27T20:31:34.964088+0000","last_became_active":"2023-07-27T20:31:33.187632+0000","last_became_peered":"2023-07-27T20:31:33.187632+0000","last_unstale":"2023-07-27T20:31:34.964088+0000","last_undegraded":"2023-07-27T20:31:34.964088+0000","last_fullsized":"2023-07-27T20:31:34.964088+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:07:10.295169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963580+0000","last_change":"2023-07-27T20:31:28.121108+0000","last_active":"2023-07-27T20:31:34.963580+0000","last_peered":"2023-07-27T20:31:34.963580+0000","last_clean":"2023-07-27T20:31:34.963580+0000","last_became_active":"2023-07-27T20:31:28.120493+0000","last_became_peered":"2023-07-27T20:31:28.120493+0000","last_unstale":"2023-07-27T20:31:34.963580+0000","last_undegraded":"2023-07-27T20:31:34.963580+0000","last_fullsized":"2023-07-27T20:31:34.963580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:01:29.799303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158619+0000","last_change":"2023-07-27T20:31:29.131480+0000","last_active":"2023-07-27T20:31:34.158619+0000","last_peered":"2023-07-27T20:31:34.158619+0000","last_clean":"2023-07-27T20:31:34.158619+0000","last_became_active":"2023-07-27T20:31:29.131095+0000","last_became_peered":"2023-07-27T20:31:29.131095+0000","last_unstale":"2023-07-27T20:31:34.158619+0000","last_undegraded":"2023-07-27T20:31:34.158619+0000","last_fullsized":"2023-07-27T20:31:34.158619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:34:08.272287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963660+0000","last_change":"2023-07-27T20:31:33.187021+0000","last_active":"2023-07-27T20:31:34.963660+0000","last_peered":"2023-07-27T20:31:34.963660+0000","last_clean":"2023-07-27T20:31:34.963660+0000","last_became_active":"2023-07-27T20:31:33.186607+0000","last_became_peered":"2023-07-27T20:31:33.186607+0000","last_unstale":"2023-07-27T20:31:34.963660+0000","last_undegraded":"2023-07-27T20:31:34.963660+0000","last_fullsized":"2023-07-27T20:31:34.963660+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:13:45.447971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963434+0000","last_change":"2023-07-27T20:31:28.127262+0000","last_active":"2023-07-27T20:31:34.963434+0000","last_peered":"2023-07-27T20:31:34.963434+0000","last_clean":"2023-07-27T20:31:34.963434+0000","last_became_active":"2023-07-27T20:31:28.126885+0000","last_became_peered":"2023-07-27T20:31:28.126885+0000","last_unstale":"2023-07-27T20:31:34.963434+0000","last_undegraded":"2023-07-27T20:31:34.963434+0000","last_fullsized":"2023-07-27T20:31:34.963434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:06:53.409694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160256+0000","last_change":"2023-07-27T20:31:29.129706+0000","last_active":"2023-07-27T20:31:34.160256+0000","last_peered":"2023-07-27T20:31:34.160256+0000","last_clean":"2023-07-27T20:31:34.160256+0000","last_became_active":"2023-07-27T20:31:29.129331+0000","last_became_peered":"2023-07-27T20:31:29.129331+0000","last_unstale":"2023-07-27T20:31:34.160256+0000","last_undegraded":"2023-07-27T20:31:34.160256+0000","last_fullsized":"2023-07-27T20:31:34.160256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:16:54.006335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964068+0000","last_change":"2023-07-27T20:31:33.189952+0000","last_active":"2023-07-27T20:31:34.964068+0000","last_peered":"2023-07-27T20:31:34.964068+0000","last_clean":"2023-07-27T20:31:34.964068+0000","last_became_active":"2023-07-27T20:31:33.188619+0000","last_became_peered":"2023-07-27T20:31:33.188619+0000","last_unstale":"2023-07-27T20:31:34.964068+0000","last_undegraded":"2023-07-27T20:31:34.964068+0000","last_fullsized":"2023-07-27T20:31:34.964068+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:03:01.329479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158999+0000","last_change":"2023-07-27T20:31:28.115944+0000","last_active":"2023-07-27T20:31:34.158999+0000","last_peered":"2023-07-27T20:31:34.158999+0000","last_clean":"2023-07-27T20:31:34.158999+0000","last_became_active":"2023-07-27T20:31:28.115533+0000","last_became_peered":"2023-07-27T20:31:28.115533+0000","last_unstale":"2023-07-27T20:31:34.158999+0000","last_undegraded":"2023-07-27T20:31:34.158999+0000","last_fullsized":"2023-07-27T20:31:34.158999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:08:41.229908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160623+0000","last_change":"2023-07-27T20:31:29.143123+0000","last_active":"2023-07-27T20:31:34.160623+0000","last_peered":"2023-07-27T20:31:34.160623+0000","last_clean":"2023-07-27T20:31:34.160623+0000","last_became_active":"2023-07-27T20:31:29.142870+0000","last_became_peered":"2023-07-27T20:31:29.142870+0000","last_unstale":"2023-07-27T20:31:34.160623+0000","last_undegraded":"2023-07-27T20:31:34.160623+0000","last_fullsized":"2023-07-27T20:31:34.160623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:38:22.765710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160570+0000","last_change":"2023-07-27T20:31:33.181739+0000","last_active":"2023-07-27T20:31:34.160570+0000","last_peered":"2023-07-27T20:31:34.160570+0000","last_clean":"2023-07-27T20:31:34.160570+0000","last_became_active":"2023-07-27T20:31:33.181198+0000","last_became_peered":"2023-07-27T20:31:33.181198+0000","last_unstale":"2023-07-27T20:31:34.160570+0000","last_undegraded":"2023-07-27T20:31:34.160570+0000","last_fullsized":"2023-07-27T20:31:34.160570+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:45:59.627493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965266+0000","last_change":"2023-07-27T20:31:28.120507+0000","last_active":"2023-07-27T20:31:34.965266+0000","last_peered":"2023-07-27T20:31:34.965266+0000","last_clean":"2023-07-27T20:31:34.965266+0000","last_became_active":"2023-07-27T20:31:28.120181+0000","last_became_peered":"2023-07-27T20:31:28.120181+0000","last_unstale":"2023-07-27T20:31:34.965266+0000","last_undegraded":"2023-07-27T20:31:34.965266+0000","last_fullsized":"2023-07-27T20:31:34.965266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:35:11.181105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965561+0000","last_change":"2023-07-27T20:31:29.128643+0000","last_active":"2023-07-27T20:31:34.965561+0000","last_peered":"2023-07-27T20:31:34.965561+0000","last_clean":"2023-07-27T20:31:34.965561+0000","last_became_active":"2023-07-27T20:31:29.128351+0000","last_became_peered":"2023-07-27T20:31:29.128351+0000","last_unstale":"2023-07-27T20:31:34.965561+0000","last_undegraded":"2023-07-27T20:31:34.965561+0000","last_fullsized":"2023-07-27T20:31:34.965561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:52:37.919677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157930+0000","last_change":"2023-07-27T20:31:33.185100+0000","last_active":"2023-07-27T20:31:34.157930+0000","last_peered":"2023-07-27T20:31:34.157930+0000","last_clean":"2023-07-27T20:31:34.157930+0000","last_became_active":"2023-07-27T20:31:33.184683+0000","last_became_peered":"2023-07-27T20:31:33.184683+0000","last_unstale":"2023-07-27T20:31:34.157930+0000","last_undegraded":"2023-07-27T20:31:34.157930+0000","last_fullsized":"2023-07-27T20:31:34.157930+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:03:01.329479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963884+0000","last_change":"2023-07-27T20:31:22.848698+0000","last_active":"2023-07-27T20:31:34.963884+0000","last_peered":"2023-07-27T20:31:34.963884+0000","last_clean":"2023-07-27T20:31:34.963884+0000","last_became_active":"2023-07-27T20:31:22.848346+0000","last_became_peered":"2023-07-27T20:31:22.848346+0000","last_unstale":"2023-07-27T20:31:34.963884+0000","last_undegraded":"2023-07-27T20:31:34.963884+0000","last_fullsized":"2023-07-27T20:31:34.963884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:48:04.598381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963400+0000","last_change":"2023-07-27T20:31:28.127873+0000","last_active":"2023-07-27T20:31:34.963400+0000","last_peered":"2023-07-27T20:31:34.963400+0000","last_clean":"2023-07-27T20:31:34.963400+0000","last_became_active":"2023-07-27T20:31:28.127528+0000","last_became_peered":"2023-07-27T20:31:28.127528+0000","last_unstale":"2023-07-27T20:31:34.963400+0000","last_undegraded":"2023-07-27T20:31:34.963400+0000","last_fullsized":"2023-07-27T20:31:34.963400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:11:16.759020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963300+0000","last_change":"2023-07-27T20:31:29.141185+0000","last_active":"2023-07-27T20:31:34.963300+0000","last_peered":"2023-07-27T20:31:34.963300+0000","last_clean":"2023-07-27T20:31:34.963300+0000","last_became_active":"2023-07-27T20:31:29.140892+0000","last_became_peered":"2023-07-27T20:31:29.140892+0000","last_unstale":"2023-07-27T20:31:34.963300+0000","last_undegraded":"2023-07-27T20:31:34.963300+0000","last_fullsized":"2023-07-27T20:31:34.963300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:32:33.408454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157575+0000","last_change":"2023-07-27T20:31:33.181796+0000","last_active":"2023-07-27T20:31:34.157575+0000","last_peered":"2023-07-27T20:31:34.157575+0000","last_clean":"2023-07-27T20:31:34.157575+0000","last_became_active":"2023-07-27T20:31:33.181416+0000","last_became_peered":"2023-07-27T20:31:33.181416+0000","last_unstale":"2023-07-27T20:31:34.157575+0000","last_undegraded":"2023-07-27T20:31:34.157575+0000","last_fullsized":"2023-07-27T20:31:34.157575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:52:41.970170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963001+0000","last_change":"2023-07-27T20:31:22.849178+0000","last_active":"2023-07-27T20:31:34.963001+0000","last_peered":"2023-07-27T20:31:34.963001+0000","last_clean":"2023-07-27T20:31:34.963001+0000","last_became_active":"2023-07-27T20:31:22.848856+0000","last_became_peered":"2023-07-27T20:31:22.848856+0000","last_unstale":"2023-07-27T20:31:34.963001+0000","last_undegraded":"2023-07-27T20:31:34.963001+0000","last_fullsized":"2023-07-27T20:31:34.963001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:59:21.022861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159361+0000","last_change":"2023-07-27T20:31:28.121194+0000","last_active":"2023-07-27T20:31:34.159361+0000","last_peered":"2023-07-27T20:31:34.159361+0000","last_clean":"2023-07-27T20:31:34.159361+0000","last_became_active":"2023-07-27T20:31:28.120865+0000","last_became_peered":"2023-07-27T20:31:28.120865+0000","last_unstale":"2023-07-27T20:31:34.159361+0000","last_undegraded":"2023-07-27T20:31:34.159361+0000","last_fullsized":"2023-07-27T20:31:34.159361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:12:37.554428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963780+0000","last_change":"2023-07-27T20:31:29.127748+0000","last_active":"2023-07-27T20:31:34.963780+0000","last_peered":"2023-07-27T20:31:34.963780+0000","last_clean":"2023-07-27T20:31:34.963780+0000","last_became_active":"2023-07-27T20:31:29.127213+0000","last_became_peered":"2023-07-27T20:31:29.127213+0000","last_unstale":"2023-07-27T20:31:34.963780+0000","last_undegraded":"2023-07-27T20:31:34.963780+0000","last_fullsized":"2023-07-27T20:31:34.963780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:59:03.273688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964666+0000","last_change":"2023-07-27T20:31:33.193059+0000","last_active":"2023-07-27T20:31:34.964666+0000","last_peered":"2023-07-27T20:31:34.964666+0000","last_clean":"2023-07-27T20:31:34.964666+0000","last_became_active":"2023-07-27T20:31:33.192317+0000","last_became_peered":"2023-07-27T20:31:33.192317+0000","last_unstale":"2023-07-27T20:31:34.964666+0000","last_undegraded":"2023-07-27T20:31:34.964666+0000","last_fullsized":"2023-07-27T20:31:34.964666+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:22:24.070420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964167+0000","last_change":"2023-07-27T20:31:22.959811+0000","last_active":"2023-07-27T20:31:34.964167+0000","last_peered":"2023-07-27T20:31:34.964167+0000","last_clean":"2023-07-27T20:31:34.964167+0000","last_became_active":"2023-07-27T20:31:22.959449+0000","last_became_peered":"2023-07-27T20:31:22.959449+0000","last_unstale":"2023-07-27T20:31:34.964167+0000","last_undegraded":"2023-07-27T20:31:34.964167+0000","last_fullsized":"2023-07-27T20:31:34.964167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:39:22.049301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.962890+0000","last_change":"2023-07-27T20:31:28.112790+0000","last_active":"2023-07-27T20:31:34.962890+0000","last_peered":"2023-07-27T20:31:34.962890+0000","last_clean":"2023-07-27T20:31:34.962890+0000","last_became_active":"2023-07-27T20:31:28.112486+0000","last_became_peered":"2023-07-27T20:31:28.112486+0000","last_unstale":"2023-07-27T20:31:34.962890+0000","last_undegraded":"2023-07-27T20:31:34.962890+0000","last_fullsized":"2023-07-27T20:31:34.962890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:06:07.656544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965439+0000","last_change":"2023-07-27T20:31:29.150778+0000","last_active":"2023-07-27T20:31:34.965439+0000","last_peered":"2023-07-27T20:31:34.965439+0000","last_clean":"2023-07-27T20:31:34.965439+0000","last_became_active":"2023-07-27T20:31:29.150479+0000","last_became_peered":"2023-07-27T20:31:29.150479+0000","last_unstale":"2023-07-27T20:31:34.965439+0000","last_undegraded":"2023-07-27T20:31:34.965439+0000","last_fullsized":"2023-07-27T20:31:34.965439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:29:57.010683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160099+0000","last_change":"2023-07-27T20:31:33.175158+0000","last_active":"2023-07-27T20:31:34.160099+0000","last_peered":"2023-07-27T20:31:34.160099+0000","last_clean":"2023-07-27T20:31:34.160099+0000","last_became_active":"2023-07-27T20:31:33.174727+0000","last_became_peered":"2023-07-27T20:31:33.174727+0000","last_unstale":"2023-07-27T20:31:34.160099+0000","last_undegraded":"2023-07-27T20:31:34.160099+0000","last_fullsized":"2023-07-27T20:31:34.160099+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:46:48.142348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963380+0000","last_change":"2023-07-27T20:31:22.847766+0000","last_active":"2023-07-27T20:31:34.963380+0000","last_peered":"2023-07-27T20:31:34.963380+0000","last_clean":"2023-07-27T20:31:34.963380+0000","last_became_active":"2023-07-27T20:31:22.847396+0000","last_became_peered":"2023-07-27T20:31:22.847396+0000","last_unstale":"2023-07-27T20:31:34.963380+0000","last_undegraded":"2023-07-27T20:31:34.963380+0000","last_fullsized":"2023-07-27T20:31:34.963380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:24:50.913525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":181,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159241+0000","last_change":"2023-07-27T20:31:15.812727+0000","last_active":"2023-07-27T20:31:34.159241+0000","last_peered":"2023-07-27T20:31:34.159241+0000","last_clean":"2023-07-27T20:31:34.159241+0000","last_became_active":"2023-07-27T20:31:15.811803+0000","last_became_peered":"2023-07-27T20:31:15.811803+0000","last_unstale":"2023-07-27T20:31:34.159241+0000","last_undegraded":"2023-07-27T20:31:34.159241+0000","last_fullsized":"2023-07-27T20:31:34.159241+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:14.789257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:14.789257+0000","last_clean_scrub_stamp":"2023-07-27T20:31:14.789257+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:13:28.096429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963324+0000","last_change":"2023-07-27T20:31:28.128776+0000","last_active":"2023-07-27T20:31:34.963324+0000","last_peered":"2023-07-27T20:31:34.963324+0000","last_clean":"2023-07-27T20:31:34.963324+0000","last_became_active":"2023-07-27T20:31:28.128519+0000","last_became_peered":"2023-07-27T20:31:28.128519+0000","last_unstale":"2023-07-27T20:31:34.963324+0000","last_undegraded":"2023-07-27T20:31:34.963324+0000","last_fullsized":"2023-07-27T20:31:34.963324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:02:56.272252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963298+0000","last_change":"2023-07-27T20:31:29.144327+0000","last_active":"2023-07-27T20:31:34.963298+0000","last_peered":"2023-07-27T20:31:34.963298+0000","last_clean":"2023-07-27T20:31:34.963298+0000","last_became_active":"2023-07-27T20:31:29.143987+0000","last_became_peered":"2023-07-27T20:31:29.143987+0000","last_unstale":"2023-07-27T20:31:34.963298+0000","last_undegraded":"2023-07-27T20:31:34.963298+0000","last_fullsized":"2023-07-27T20:31:34.963298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:09:04.213951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963855+0000","last_change":"2023-07-27T20:31:33.185843+0000","last_active":"2023-07-27T20:31:34.963855+0000","last_peered":"2023-07-27T20:31:34.963855+0000","last_clean":"2023-07-27T20:31:34.963855+0000","last_became_active":"2023-07-27T20:31:33.185433+0000","last_became_peered":"2023-07-27T20:31:33.185433+0000","last_unstale":"2023-07-27T20:31:34.963855+0000","last_undegraded":"2023-07-27T20:31:34.963855+0000","last_fullsized":"2023-07-27T20:31:34.963855+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:32:44.428479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159531+0000","last_change":"2023-07-27T20:31:22.848181+0000","last_active":"2023-07-27T20:31:34.159531+0000","last_peered":"2023-07-27T20:31:34.159531+0000","last_clean":"2023-07-27T20:31:34.159531+0000","last_became_active":"2023-07-27T20:31:22.847865+0000","last_became_peered":"2023-07-27T20:31:22.847865+0000","last_unstale":"2023-07-27T20:31:34.159531+0000","last_undegraded":"2023-07-27T20:31:34.159531+0000","last_fullsized":"2023-07-27T20:31:34.159531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:48:04.598381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157019+0000","last_change":"2023-07-27T20:31:28.126023+0000","last_active":"2023-07-27T20:31:34.157019+0000","last_peered":"2023-07-27T20:31:34.157019+0000","last_clean":"2023-07-27T20:31:34.157019+0000","last_became_active":"2023-07-27T20:31:28.125763+0000","last_became_peered":"2023-07-27T20:31:28.125763+0000","last_unstale":"2023-07-27T20:31:34.157019+0000","last_undegraded":"2023-07-27T20:31:34.157019+0000","last_fullsized":"2023-07-27T20:31:34.157019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:11:16.759020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157525+0000","last_change":"2023-07-27T20:31:29.134648+0000","last_active":"2023-07-27T20:31:34.157525+0000","last_peered":"2023-07-27T20:31:34.157525+0000","last_clean":"2023-07-27T20:31:34.157525+0000","last_became_active":"2023-07-27T20:31:29.133686+0000","last_became_peered":"2023-07-27T20:31:29.133686+0000","last_unstale":"2023-07-27T20:31:34.157525+0000","last_undegraded":"2023-07-27T20:31:34.157525+0000","last_fullsized":"2023-07-27T20:31:34.157525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:46:44.091855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963906+0000","last_change":"2023-07-27T20:31:33.173136+0000","last_active":"2023-07-27T20:31:34.963906+0000","last_peered":"2023-07-27T20:31:34.963906+0000","last_clean":"2023-07-27T20:31:34.963906+0000","last_became_active":"2023-07-27T20:31:33.171872+0000","last_became_peered":"2023-07-27T20:31:33.171872+0000","last_unstale":"2023-07-27T20:31:34.963906+0000","last_undegraded":"2023-07-27T20:31:34.963906+0000","last_fullsized":"2023-07-27T20:31:34.963906+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:54:08.677930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160575+0000","last_change":"2023-07-27T20:31:22.848025+0000","last_active":"2023-07-27T20:31:34.160575+0000","last_peered":"2023-07-27T20:31:34.160575+0000","last_clean":"2023-07-27T20:31:34.160575+0000","last_became_active":"2023-07-27T20:31:22.847603+0000","last_became_peered":"2023-07-27T20:31:22.847603+0000","last_unstale":"2023-07-27T20:31:34.160575+0000","last_undegraded":"2023-07-27T20:31:34.160575+0000","last_fullsized":"2023-07-27T20:31:34.160575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:30:03.402215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964111+0000","last_change":"2023-07-27T20:31:28.113523+0000","last_active":"2023-07-27T20:31:34.964111+0000","last_peered":"2023-07-27T20:31:34.964111+0000","last_clean":"2023-07-27T20:31:34.964111+0000","last_became_active":"2023-07-27T20:31:28.113279+0000","last_became_peered":"2023-07-27T20:31:28.113279+0000","last_unstale":"2023-07-27T20:31:34.964111+0000","last_undegraded":"2023-07-27T20:31:34.964111+0000","last_fullsized":"2023-07-27T20:31:34.964111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:11:16.759020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158082+0000","last_change":"2023-07-27T20:31:29.142859+0000","last_active":"2023-07-27T20:31:34.158082+0000","last_peered":"2023-07-27T20:31:34.158082+0000","last_clean":"2023-07-27T20:31:34.158082+0000","last_became_active":"2023-07-27T20:31:29.142567+0000","last_became_peered":"2023-07-27T20:31:29.142567+0000","last_unstale":"2023-07-27T20:31:34.158082+0000","last_undegraded":"2023-07-27T20:31:34.158082+0000","last_fullsized":"2023-07-27T20:31:34.158082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:17:03.497602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159475+0000","last_change":"2023-07-27T20:31:33.178764+0000","last_active":"2023-07-27T20:31:34.159475+0000","last_peered":"2023-07-27T20:31:34.159475+0000","last_clean":"2023-07-27T20:31:34.159475+0000","last_became_active":"2023-07-27T20:31:33.178284+0000","last_became_peered":"2023-07-27T20:31:33.178284+0000","last_unstale":"2023-07-27T20:31:34.159475+0000","last_undegraded":"2023-07-27T20:31:34.159475+0000","last_fullsized":"2023-07-27T20:31:34.159475+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:37:30.584016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965462+0000","last_change":"2023-07-27T20:31:28.120924+0000","last_active":"2023-07-27T20:31:34.965462+0000","last_peered":"2023-07-27T20:31:34.965462+0000","last_clean":"2023-07-27T20:31:34.965462+0000","last_became_active":"2023-07-27T20:31:28.120646+0000","last_became_peered":"2023-07-27T20:31:28.120646+0000","last_unstale":"2023-07-27T20:31:34.965462+0000","last_undegraded":"2023-07-27T20:31:34.965462+0000","last_fullsized":"2023-07-27T20:31:34.965462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:53:34.775079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963414+0000","last_change":"2023-07-27T20:31:22.845641+0000","last_active":"2023-07-27T20:31:34.963414+0000","last_peered":"2023-07-27T20:31:34.963414+0000","last_clean":"2023-07-27T20:31:34.963414+0000","last_became_active":"2023-07-27T20:31:22.845368+0000","last_became_peered":"2023-07-27T20:31:22.845368+0000","last_unstale":"2023-07-27T20:31:34.963414+0000","last_undegraded":"2023-07-27T20:31:34.963414+0000","last_fullsized":"2023-07-27T20:31:34.963414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:22:43.198616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965145+0000","last_change":"2023-07-27T20:31:29.144935+0000","last_active":"2023-07-27T20:31:34.965145+0000","last_peered":"2023-07-27T20:31:34.965145+0000","last_clean":"2023-07-27T20:31:34.965145+0000","last_became_active":"2023-07-27T20:31:29.144500+0000","last_became_peered":"2023-07-27T20:31:29.144500+0000","last_unstale":"2023-07-27T20:31:34.965145+0000","last_undegraded":"2023-07-27T20:31:34.965145+0000","last_fullsized":"2023-07-27T20:31:34.965145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:43:50.810308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964904+0000","last_change":"2023-07-27T20:31:33.178800+0000","last_active":"2023-07-27T20:31:34.964904+0000","last_peered":"2023-07-27T20:31:34.964904+0000","last_clean":"2023-07-27T20:31:34.964904+0000","last_became_active":"2023-07-27T20:31:33.178392+0000","last_became_peered":"2023-07-27T20:31:33.178392+0000","last_unstale":"2023-07-27T20:31:34.964904+0000","last_undegraded":"2023-07-27T20:31:34.964904+0000","last_fullsized":"2023-07-27T20:31:34.964904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:43:14.963398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963516+0000","last_change":"2023-07-27T20:31:22.846540+0000","last_active":"2023-07-27T20:31:34.963516+0000","last_peered":"2023-07-27T20:31:34.963516+0000","last_clean":"2023-07-27T20:31:34.963516+0000","last_became_active":"2023-07-27T20:31:22.846128+0000","last_became_peered":"2023-07-27T20:31:22.846128+0000","last_unstale":"2023-07-27T20:31:34.963516+0000","last_undegraded":"2023-07-27T20:31:34.963516+0000","last_fullsized":"2023-07-27T20:31:34.963516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:43:06.660613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157642+0000","last_change":"2023-07-27T20:31:28.113438+0000","last_active":"2023-07-27T20:31:34.157642+0000","last_peered":"2023-07-27T20:31:34.157642+0000","last_clean":"2023-07-27T20:31:34.157642+0000","last_became_active":"2023-07-27T20:31:28.113146+0000","last_became_peered":"2023-07-27T20:31:28.113146+0000","last_unstale":"2023-07-27T20:31:34.157642+0000","last_undegraded":"2023-07-27T20:31:34.157642+0000","last_fullsized":"2023-07-27T20:31:34.157642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:04:21.752471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159254+0000","last_change":"2023-07-27T20:31:29.141507+0000","last_active":"2023-07-27T20:31:34.159254+0000","last_peered":"2023-07-27T20:31:34.159254+0000","last_clean":"2023-07-27T20:31:34.159254+0000","last_became_active":"2023-07-27T20:31:29.141217+0000","last_became_peered":"2023-07-27T20:31:29.141217+0000","last_unstale":"2023-07-27T20:31:34.159254+0000","last_undegraded":"2023-07-27T20:31:34.159254+0000","last_fullsized":"2023-07-27T20:31:34.159254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:07:23.817773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963812+0000","last_change":"2023-07-27T20:31:33.184984+0000","last_active":"2023-07-27T20:31:34.963812+0000","last_peered":"2023-07-27T20:31:34.963812+0000","last_clean":"2023-07-27T20:31:34.963812+0000","last_became_active":"2023-07-27T20:31:33.184413+0000","last_became_peered":"2023-07-27T20:31:33.184413+0000","last_unstale":"2023-07-27T20:31:34.963812+0000","last_undegraded":"2023-07-27T20:31:34.963812+0000","last_fullsized":"2023-07-27T20:31:34.963812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:03:20.666196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157892+0000","last_change":"2023-07-27T20:31:28.122480+0000","last_active":"2023-07-27T20:31:34.157892+0000","last_peered":"2023-07-27T20:31:34.157892+0000","last_clean":"2023-07-27T20:31:34.157892+0000","last_became_active":"2023-07-27T20:31:28.121841+0000","last_became_peered":"2023-07-27T20:31:28.121841+0000","last_unstale":"2023-07-27T20:31:34.157892+0000","last_undegraded":"2023-07-27T20:31:34.157892+0000","last_fullsized":"2023-07-27T20:31:34.157892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:01:29.799303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963780+0000","last_change":"2023-07-27T20:31:29.129723+0000","last_active":"2023-07-27T20:31:34.963780+0000","last_peered":"2023-07-27T20:31:34.963780+0000","last_clean":"2023-07-27T20:31:34.963780+0000","last_became_active":"2023-07-27T20:31:29.129256+0000","last_became_peered":"2023-07-27T20:31:29.129256+0000","last_unstale":"2023-07-27T20:31:34.963780+0000","last_undegraded":"2023-07-27T20:31:34.963780+0000","last_fullsized":"2023-07-27T20:31:34.963780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:40:12.799013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159801+0000","last_change":"2023-07-27T20:31:33.182234+0000","last_active":"2023-07-27T20:31:34.159801+0000","last_peered":"2023-07-27T20:31:34.159801+0000","last_clean":"2023-07-27T20:31:34.159801+0000","last_became_active":"2023-07-27T20:31:33.181660+0000","last_became_peered":"2023-07-27T20:31:33.181660+0000","last_unstale":"2023-07-27T20:31:34.159801+0000","last_undegraded":"2023-07-27T20:31:34.159801+0000","last_fullsized":"2023-07-27T20:31:34.159801+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:11:21.816247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963312+0000","last_change":"2023-07-27T20:31:28.127766+0000","last_active":"2023-07-27T20:31:34.963312+0000","last_peered":"2023-07-27T20:31:34.963312+0000","last_clean":"2023-07-27T20:31:34.963312+0000","last_became_active":"2023-07-27T20:31:28.127414+0000","last_became_peered":"2023-07-27T20:31:28.127414+0000","last_unstale":"2023-07-27T20:31:34.963312+0000","last_undegraded":"2023-07-27T20:31:34.963312+0000","last_fullsized":"2023-07-27T20:31:34.963312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:03:15.608969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159150+0000","last_change":"2023-07-27T20:31:29.129596+0000","last_active":"2023-07-27T20:31:34.159150+0000","last_peered":"2023-07-27T20:31:34.159150+0000","last_clean":"2023-07-27T20:31:34.159150+0000","last_became_active":"2023-07-27T20:31:29.129291+0000","last_became_peered":"2023-07-27T20:31:29.129291+0000","last_unstale":"2023-07-27T20:31:34.159150+0000","last_undegraded":"2023-07-27T20:31:34.159150+0000","last_fullsized":"2023-07-27T20:31:34.159150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:27:22.233669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963655+0000","last_change":"2023-07-27T20:31:33.178602+0000","last_active":"2023-07-27T20:31:34.963655+0000","last_peered":"2023-07-27T20:31:34.963655+0000","last_clean":"2023-07-27T20:31:34.963655+0000","last_became_active":"2023-07-27T20:31:33.178225+0000","last_became_peered":"2023-07-27T20:31:33.178225+0000","last_unstale":"2023-07-27T20:31:34.963655+0000","last_undegraded":"2023-07-27T20:31:34.963655+0000","last_fullsized":"2023-07-27T20:31:34.963655+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:46:48.142348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963262+0000","last_change":"2023-07-27T20:31:28.127934+0000","last_active":"2023-07-27T20:31:34.963262+0000","last_peered":"2023-07-27T20:31:34.963262+0000","last_clean":"2023-07-27T20:31:34.963262+0000","last_became_active":"2023-07-27T20:31:28.127614+0000","last_became_peered":"2023-07-27T20:31:28.127614+0000","last_unstale":"2023-07-27T20:31:34.963262+0000","last_undegraded":"2023-07-27T20:31:34.963262+0000","last_fullsized":"2023-07-27T20:31:34.963262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:59:02.266953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158703+0000","last_change":"2023-07-27T20:31:29.129192+0000","last_active":"2023-07-27T20:31:34.158703+0000","last_peered":"2023-07-27T20:31:34.158703+0000","last_clean":"2023-07-27T20:31:34.158703+0000","last_became_active":"2023-07-27T20:31:29.128942+0000","last_became_peered":"2023-07-27T20:31:29.128942+0000","last_unstale":"2023-07-27T20:31:34.158703+0000","last_undegraded":"2023-07-27T20:31:34.158703+0000","last_fullsized":"2023-07-27T20:31:34.158703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:47:04.874275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158302+0000","last_change":"2023-07-27T20:31:33.181755+0000","last_active":"2023-07-27T20:31:34.158302+0000","last_peered":"2023-07-27T20:31:34.158302+0000","last_clean":"2023-07-27T20:31:34.158302+0000","last_became_active":"2023-07-27T20:31:33.181272+0000","last_became_peered":"2023-07-27T20:31:33.181272+0000","last_unstale":"2023-07-27T20:31:34.158302+0000","last_undegraded":"2023-07-27T20:31:34.158302+0000","last_fullsized":"2023-07-27T20:31:34.158302+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:17:29.545484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964561+0000","last_change":"2023-07-27T20:31:28.120798+0000","last_active":"2023-07-27T20:31:34.964561+0000","last_peered":"2023-07-27T20:31:34.964561+0000","last_clean":"2023-07-27T20:31:34.964561+0000","last_became_active":"2023-07-27T20:31:28.120445+0000","last_became_peered":"2023-07-27T20:31:28.120445+0000","last_unstale":"2023-07-27T20:31:34.964561+0000","last_undegraded":"2023-07-27T20:31:34.964561+0000","last_fullsized":"2023-07-27T20:31:34.964561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:04:19.045494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964977+0000","last_change":"2023-07-27T20:31:29.133577+0000","last_active":"2023-07-27T20:31:34.964977+0000","last_peered":"2023-07-27T20:31:34.964977+0000","last_clean":"2023-07-27T20:31:34.964977+0000","last_became_active":"2023-07-27T20:31:29.133170+0000","last_became_peered":"2023-07-27T20:31:29.133170+0000","last_unstale":"2023-07-27T20:31:34.964977+0000","last_undegraded":"2023-07-27T20:31:34.964977+0000","last_fullsized":"2023-07-27T20:31:34.964977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:58:10.754493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963156+0000","last_change":"2023-07-27T20:31:33.185023+0000","last_active":"2023-07-27T20:31:34.963156+0000","last_peered":"2023-07-27T20:31:34.963156+0000","last_clean":"2023-07-27T20:31:34.963156+0000","last_became_active":"2023-07-27T20:31:33.184664+0000","last_became_peered":"2023-07-27T20:31:33.184664+0000","last_unstale":"2023-07-27T20:31:34.963156+0000","last_undegraded":"2023-07-27T20:31:34.963156+0000","last_fullsized":"2023-07-27T20:31:34.963156+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:31:22.782985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158280+0000","last_change":"2023-07-27T20:31:28.130218+0000","last_active":"2023-07-27T20:31:34.158280+0000","last_peered":"2023-07-27T20:31:34.158280+0000","last_clean":"2023-07-27T20:31:34.158280+0000","last_became_active":"2023-07-27T20:31:28.129985+0000","last_became_peered":"2023-07-27T20:31:28.129985+0000","last_unstale":"2023-07-27T20:31:34.158280+0000","last_undegraded":"2023-07-27T20:31:34.158280+0000","last_fullsized":"2023-07-27T20:31:34.158280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:23:29.174787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158489+0000","last_change":"2023-07-27T20:31:29.134396+0000","last_active":"2023-07-27T20:31:34.158489+0000","last_peered":"2023-07-27T20:31:34.158489+0000","last_clean":"2023-07-27T20:31:34.158489+0000","last_became_active":"2023-07-27T20:31:29.134100+0000","last_became_peered":"2023-07-27T20:31:29.134100+0000","last_unstale":"2023-07-27T20:31:34.158489+0000","last_undegraded":"2023-07-27T20:31:34.158489+0000","last_fullsized":"2023-07-27T20:31:34.158489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:53:35.781814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963026+0000","last_change":"2023-07-27T20:31:29.131991+0000","last_active":"2023-07-27T20:31:34.963026+0000","last_peered":"2023-07-27T20:31:34.963026+0000","last_clean":"2023-07-27T20:31:34.963026+0000","last_became_active":"2023-07-27T20:31:29.131669+0000","last_became_peered":"2023-07-27T20:31:29.131669+0000","last_unstale":"2023-07-27T20:31:34.963026+0000","last_undegraded":"2023-07-27T20:31:34.963026+0000","last_fullsized":"2023-07-27T20:31:34.963026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:57:21.999388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965148+0000","last_change":"2023-07-27T20:31:29.130808+0000","last_active":"2023-07-27T20:31:34.965148+0000","last_peered":"2023-07-27T20:31:34.965148+0000","last_clean":"2023-07-27T20:31:34.965148+0000","last_became_active":"2023-07-27T20:31:29.130489+0000","last_became_peered":"2023-07-27T20:31:29.130489+0000","last_unstale":"2023-07-27T20:31:34.965148+0000","last_undegraded":"2023-07-27T20:31:34.965148+0000","last_fullsized":"2023-07-27T20:31:34.965148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:58:01.396658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159103+0000","last_change":"2023-07-27T20:31:29.135952+0000","last_active":"2023-07-27T20:31:34.159103+0000","last_peered":"2023-07-27T20:31:34.159103+0000","last_clean":"2023-07-27T20:31:34.159103+0000","last_became_active":"2023-07-27T20:31:29.135040+0000","last_became_peered":"2023-07-27T20:31:29.135040+0000","last_unstale":"2023-07-27T20:31:34.159103+0000","last_undegraded":"2023-07-27T20:31:34.159103+0000","last_fullsized":"2023-07-27T20:31:34.159103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:41:09.372503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963458+0000","last_change":"2023-07-27T20:31:29.148526+0000","last_active":"2023-07-27T20:31:34.963458+0000","last_peered":"2023-07-27T20:31:34.963458+0000","last_clean":"2023-07-27T20:31:34.963458+0000","last_became_active":"2023-07-27T20:31:29.148256+0000","last_became_peered":"2023-07-27T20:31:29.148256+0000","last_unstale":"2023-07-27T20:31:34.963458+0000","last_undegraded":"2023-07-27T20:31:34.963458+0000","last_fullsized":"2023-07-27T20:31:34.963458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:38:08.459694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963994+0000","last_change":"2023-07-27T20:31:29.129400+0000","last_active":"2023-07-27T20:31:34.963994+0000","last_peered":"2023-07-27T20:31:34.963994+0000","last_clean":"2023-07-27T20:31:34.963994+0000","last_became_active":"2023-07-27T20:31:29.129138+0000","last_became_peered":"2023-07-27T20:31:29.129138+0000","last_unstale":"2023-07-27T20:31:34.963994+0000","last_undegraded":"2023-07-27T20:31:34.963994+0000","last_fullsized":"2023-07-27T20:31:34.963994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:24:57.182748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":913408,"data_stored":714279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]}]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":888832,"data_stored":710851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":294912,"data_stored":119991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":123751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":120553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T20:31:58.338 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T20:31:58.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.578+0000 7f49819ff700 1 Processor -- start 2023-07-27T20:31:58.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.578+0000 7f49819ff700 1 -- start start 2023-07-27T20:31:58.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.579+0000 7f49819ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f497c0c4400 0x7f497c0c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:58.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.579+0000 7f49819ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f497c06b150 0x7f497c0c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:58.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.579+0000 7f49819ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f497c0c5230 con 0x7f497c1549f0 2023-07-27T20:31:58.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.579+0000 7f49819ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f497c1545d0 con 0x7f497c06b150 2023-07-27T20:31:58.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.579+0000 7f49819ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f497c06c860 con 0x7f497c0c4400 2023-07-27T20:31:58.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.579+0000 7f497a7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f497c06b150 0x7f497c0c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:58.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.579+0000 7f497b7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f497c1549f0 0x7f497c1514a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55512/0 (socket says 172.21.15.72:55512) 2023-07-27T20:31:58.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.579+0000 7f497b7fe700 1 -- 172.21.15.72:0/2519504076 learned_addr learned my addr 172.21.15.72:0/2519504076 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:58.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.579+0000 7f497affd700 1 --2- 172.21.15.72:0/2519504076 >> v2:172.21.15.173:3300/0 conn(0x7f497c0c4400 0x7f497c0c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:58.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.580+0000 7f497a7fc700 1 -- 172.21.15.72:0/2519504076 >> v2:172.21.15.173:3300/0 conn(0x7f497c0c4400 msgr2=0x7f497c0c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:58.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.580+0000 7f497a7fc700 1 --2- 172.21.15.72:0/2519504076 >> v2:172.21.15.173:3300/0 conn(0x7f497c0c4400 0x7f497c0c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:58.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.580+0000 7f497a7fc700 1 -- 172.21.15.72:0/2519504076 >> v1:172.21.15.72:6789/0 conn(0x7f497c1549f0 legacy=0x7f497c1514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:58.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.580+0000 7f497a7fc700 1 -- 172.21.15.72:0/2519504076 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f497c06b710 con 0x7f497c06b150 2023-07-27T20:31:58.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.580+0000 7f4979ffb700 1 -- 172.21.15.72:0/2519504076 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1979104636 0 0) 0x7f497c0c5230 con 0x7f497c1549f0 2023-07-27T20:31:58.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.580+0000 7f497a7fc700 1 --2- 172.21.15.72:0/2519504076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f497c06b150 0x7f497c0c4cf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f497c08b040 tx=0x7f4970009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c1024a3df6cef08 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:58.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.580+0000 7f4979ffb700 1 -- 172.21.15.72:0/2519504076 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4970011830 con 0x7f497c06b150 2023-07-27T20:31:58.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.580+0000 7f4979ffb700 1 -- 172.21.15.72:0/2519504076 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4970011990 con 0x7f497c06b150 2023-07-27T20:31:58.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.580+0000 7f4979ffb700 1 -- 172.21.15.72:0/2519504076 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4970011d20 con 0x7f497c06b150 2023-07-27T20:31:58.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.581+0000 7f49819ff700 1 -- 172.21.15.72:0/2519504076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f497c06b150 msgr2=0x7f497c0c4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:58.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.581+0000 7f49819ff700 1 --2- 172.21.15.72:0/2519504076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f497c06b150 0x7f497c0c4cf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f497c08b040 tx=0x7f4970009b20 comp rx=0 tx=0).stop 2023-07-27T20:31:58.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.581+0000 7f49819ff700 1 -- 172.21.15.72:0/2519504076 shutdown_connections 2023-07-27T20:31:58.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.581+0000 7f49819ff700 1 --2- 172.21.15.72:0/2519504076 >> v2:172.21.15.173:3300/0 conn(0x7f497c0c4400 0x7f497c0c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:58.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.581+0000 7f49819ff700 1 --2- 172.21.15.72:0/2519504076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f497c06b150 0x7f497c0c4cf0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:58.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.581+0000 7f49819ff700 1 -- 172.21.15.72:0/2519504076 >> 172.21.15.72:0/2519504076 conn(0x7f497c0ab300 msgr2=0x7f497c0ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:58.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.581+0000 7f49819ff700 1 -- 172.21.15.72:0/2519504076 shutdown_connections 2023-07-27T20:31:58.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.581+0000 7f49819ff700 1 -- 172.21.15.72:0/2519504076 wait complete. 2023-07-27T20:31:58.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.583+0000 7f49819ff700 1 Processor -- start 2023-07-27T20:31:58.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.583+0000 7f49819ff700 1 -- start start 2023-07-27T20:31:58.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.584+0000 7f49819ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f497c06b150 0x7f497c147be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:58.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.584+0000 7f49819ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f497c0c4400 0x7f497c0c33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:58.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.584+0000 7f49819ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f497c1549f0 0x7f497c151270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:58.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.584+0000 7f49819ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497c1ecbe0 con 0x7f497c0c4400 2023-07-27T20:31:58.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.584+0000 7f49819ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497c14ebb0 con 0x7f497c1549f0 2023-07-27T20:31:58.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.584+0000 7f49819ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f497c1e9b70 con 0x7f497c06b150 2023-07-27T20:31:58.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.584+0000 7f497a7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f497c0c4400 0x7f497c0c33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:58.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.584+0000 7f497a7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f497c0c4400 0x7f497c0c33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58822/0 (socket says 172.21.15.72:58822) 2023-07-27T20:31:58.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.584+0000 7f497a7fc700 1 -- 172.21.15.72:0/1827215489 learned_addr learned my addr 172.21.15.72:0/1827215489 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:58.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.584+0000 7f497b7fe700 1 --2- 172.21.15.72:0/1827215489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f497c1549f0 0x7f497c151270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:58.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.584+0000 7f497affd700 1 --2- 172.21.15.72:0/1827215489 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f497c06b150 0x7f497c147be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:58.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.584+0000 7f497a7fc700 1 -- 172.21.15.72:0/1827215489 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f497c06b150 msgr2=0x7f497c147be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:58.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.584+0000 7f497a7fc700 1 --2- 172.21.15.72:0/1827215489 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f497c06b150 0x7f497c147be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:58.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.584+0000 7f497a7fc700 1 -- 172.21.15.72:0/1827215489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f497c1549f0 msgr2=0x7f497c151270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:58.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.584+0000 7f497a7fc700 1 --2- 172.21.15.72:0/1827215489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f497c1549f0 0x7f497c151270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:58.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.584+0000 7f497a7fc700 1 -- 172.21.15.72:0/1827215489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49700094a0 con 0x7f497c0c4400 2023-07-27T20:31:58.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.585+0000 7f497a7fc700 1 --2- 172.21.15.72:0/1827215489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f497c0c4400 0x7f497c0c33e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4970014040 tx=0x7f4970004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:58.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.585+0000 7f4963fff700 1 -- 172.21.15.72:0/1827215489 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49700038a0 con 0x7f497c0c4400 2023-07-27T20:31:58.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.585+0000 7f4963fff700 1 -- 172.21.15.72:0/1827215489 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497001e070 con 0x7f497c0c4400 2023-07-27T20:31:58.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.585+0000 7f4963fff700 1 -- 172.21.15.72:0/1827215489 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4970003c20 con 0x7f497c0c4400 2023-07-27T20:31:58.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.585+0000 7f49819ff700 1 -- 172.21.15.72:0/1827215489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f497c1e9e50 con 0x7f497c0c4400 2023-07-27T20:31:58.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.585+0000 7f49819ff700 1 -- 172.21.15.72:0/1827215489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f497c1ea410 con 0x7f497c0c4400 2023-07-27T20:31:58.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.586+0000 7f49819ff700 1 -- 172.21.15.72:0/1827215489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f497c1ecd50 con 0x7f497c0c4400 2023-07-27T20:31:58.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.587+0000 7f4963fff700 1 -- 172.21.15.72:0/1827215489 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f497002d450 con 0x7f497c0c4400 2023-07-27T20:31:58.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.588+0000 7f4963fff700 1 --2- 172.21.15.72:0/1827215489 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f496806ace0 0x7f496806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:58.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.588+0000 7f4963fff700 1 -- 172.21.15.72:0/1827215489 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f497008a6c0 con 0x7f497c0c4400 2023-07-27T20:31:58.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.588+0000 7f497affd700 1 --2- 172.21.15.72:0/1827215489 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f496806ace0 0x7f496806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:58.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.589+0000 7f497affd700 1 --2- 172.21.15.72:0/1827215489 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f496806ace0 0x7f496806d1a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f497c0af450 tx=0x7f496c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:58.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.592+0000 7f4963fff700 1 -- 172.21.15.72:0/1827215489 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4970055510 con 0x7f497c0c4400 2023-07-27T20:31:58.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.783+0000 7f49819ff700 1 -- 172.21.15.72:0/1827215489 --> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f497c06bcd0 con 0x7f496806ace0 2023-07-27T20:31:58.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.794+0000 7f4963fff700 1 -- 172.21.15.72:0/1827215489 <== mgr.4107 v2:172.21.15.173:6832/910681537 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367351 (secure 0 0 0) 0x7f496c011750 con 0x7f496806ace0 2023-07-27T20:31:58.786 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:31:58.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.799+0000 7f49819ff700 1 -- 172.21.15.72:0/1827215489 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f496806ace0 msgr2=0x7f496806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:58.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.799+0000 7f49819ff700 1 --2- 172.21.15.72:0/1827215489 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f496806ace0 0x7f496806d1a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f497c0af450 tx=0x7f496c008040 comp rx=0 tx=0).stop 2023-07-27T20:31:58.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.799+0000 7f49819ff700 1 -- 172.21.15.72:0/1827215489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f497c0c4400 msgr2=0x7f497c0c33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:58.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.799+0000 7f49819ff700 1 --2- 172.21.15.72:0/1827215489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f497c0c4400 0x7f497c0c33e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4970014040 tx=0x7f4970004750 comp rx=0 tx=0).stop 2023-07-27T20:31:58.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.799+0000 7f49819ff700 1 -- 172.21.15.72:0/1827215489 shutdown_connections 2023-07-27T20:31:58.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.799+0000 7f49819ff700 1 --2- 172.21.15.72:0/1827215489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f497c1549f0 0x7f497c151270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:58.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.799+0000 7f49819ff700 1 --2- 172.21.15.72:0/1827215489 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f496806ace0 0x7f496806d1a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:58.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.799+0000 7f49819ff700 1 --2- 172.21.15.72:0/1827215489 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f497c06b150 0x7f497c147be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:58.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.799+0000 7f49819ff700 1 --2- 172.21.15.72:0/1827215489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f497c0c4400 0x7f497c0c33e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:58.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.799+0000 7f49819ff700 1 -- 172.21.15.72:0/1827215489 >> 172.21.15.72:0/1827215489 conn(0x7f497c0ab300 msgr2=0x7f497c150920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:58.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.800+0000 7f49819ff700 1 -- 172.21.15.72:0/1827215489 shutdown_connections 2023-07-27T20:31:58.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:58.800+0000 7f49819ff700 1 -- 172.21.15.72:0/1827215489 wait complete. 2023-07-27T20:31:58.790 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-07-27T20:31:58.805 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2023-07-27T20:31:58.533163+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219676,"kb_used_data":3496,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755044,"statfs":{"total":773094113280,"available":772869165056,"internally_reserved":0,"allocated":3579904,"data_stored":2149128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003820"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964347+0000","last_change":"2023-07-27T20:31:29.128137+0000","last_active":"2023-07-27T20:31:34.964347+0000","last_peered":"2023-07-27T20:31:34.964347+0000","last_clean":"2023-07-27T20:31:34.964347+0000","last_became_active":"2023-07-27T20:31:29.127840+0000","last_became_peered":"2023-07-27T20:31:29.127840+0000","last_unstale":"2023-07-27T20:31:34.964347+0000","last_undegraded":"2023-07-27T20:31:34.964347+0000","last_fullsized":"2023-07-27T20:31:34.964347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:59:36.649918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963365+0000","last_change":"2023-07-27T20:31:29.140868+0000","last_active":"2023-07-27T20:31:34.963365+0000","last_peered":"2023-07-27T20:31:34.963365+0000","last_clean":"2023-07-27T20:31:34.963365+0000","last_became_active":"2023-07-27T20:31:29.140592+0000","last_became_peered":"2023-07-27T20:31:29.140592+0000","last_unstale":"2023-07-27T20:31:34.963365+0000","last_undegraded":"2023-07-27T20:31:34.963365+0000","last_fullsized":"2023-07-27T20:31:34.963365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:48:10.867603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160140+0000","last_change":"2023-07-27T20:31:29.129303+0000","last_active":"2023-07-27T20:31:34.160140+0000","last_peered":"2023-07-27T20:31:34.160140+0000","last_clean":"2023-07-27T20:31:34.160140+0000","last_became_active":"2023-07-27T20:31:29.128569+0000","last_became_peered":"2023-07-27T20:31:29.128569+0000","last_unstale":"2023-07-27T20:31:34.160140+0000","last_undegraded":"2023-07-27T20:31:34.160140+0000","last_fullsized":"2023-07-27T20:31:34.160140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:10:18.495424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.962918+0000","last_change":"2023-07-27T20:31:29.134687+0000","last_active":"2023-07-27T20:31:34.962918+0000","last_peered":"2023-07-27T20:31:34.962918+0000","last_clean":"2023-07-27T20:31:34.962918+0000","last_became_active":"2023-07-27T20:31:29.134388+0000","last_became_peered":"2023-07-27T20:31:29.134388+0000","last_unstale":"2023-07-27T20:31:34.962918+0000","last_undegraded":"2023-07-27T20:31:34.962918+0000","last_fullsized":"2023-07-27T20:31:34.962918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:05:57.560432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158183+0000","last_change":"2023-07-27T20:31:29.127581+0000","last_active":"2023-07-27T20:31:34.158183+0000","last_peered":"2023-07-27T20:31:34.158183+0000","last_clean":"2023-07-27T20:31:34.158183+0000","last_became_active":"2023-07-27T20:31:29.127256+0000","last_became_peered":"2023-07-27T20:31:29.127256+0000","last_unstale":"2023-07-27T20:31:34.158183+0000","last_undegraded":"2023-07-27T20:31:34.158183+0000","last_fullsized":"2023-07-27T20:31:34.158183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:04:20.052228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158888+0000","last_change":"2023-07-27T20:31:29.130522+0000","last_active":"2023-07-27T20:31:34.158888+0000","last_peered":"2023-07-27T20:31:34.158888+0000","last_clean":"2023-07-27T20:31:34.158888+0000","last_became_active":"2023-07-27T20:31:29.129964+0000","last_became_peered":"2023-07-27T20:31:29.129964+0000","last_unstale":"2023-07-27T20:31:34.158888+0000","last_undegraded":"2023-07-27T20:31:34.158888+0000","last_fullsized":"2023-07-27T20:31:34.158888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:32:37.192663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159958+0000","last_change":"2023-07-27T20:31:29.138061+0000","last_active":"2023-07-27T20:31:34.159958+0000","last_peered":"2023-07-27T20:31:34.159958+0000","last_clean":"2023-07-27T20:31:34.159958+0000","last_became_active":"2023-07-27T20:31:29.137407+0000","last_became_peered":"2023-07-27T20:31:29.137407+0000","last_unstale":"2023-07-27T20:31:34.159958+0000","last_undegraded":"2023-07-27T20:31:34.159958+0000","last_fullsized":"2023-07-27T20:31:34.159958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:52:37.919677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.962665+0000","last_change":"2023-07-27T20:31:29.142667+0000","last_active":"2023-07-27T20:31:34.962665+0000","last_peered":"2023-07-27T20:31:34.962665+0000","last_clean":"2023-07-27T20:31:34.962665+0000","last_became_active":"2023-07-27T20:31:29.141164+0000","last_became_peered":"2023-07-27T20:31:29.141164+0000","last_unstale":"2023-07-27T20:31:34.962665+0000","last_undegraded":"2023-07-27T20:31:34.962665+0000","last_fullsized":"2023-07-27T20:31:34.962665+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:32:33.408454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157543+0000","last_change":"2023-07-27T20:31:29.129290+0000","last_active":"2023-07-27T20:31:34.157543+0000","last_peered":"2023-07-27T20:31:34.157543+0000","last_clean":"2023-07-27T20:31:34.157543+0000","last_became_active":"2023-07-27T20:31:29.127546+0000","last_became_peered":"2023-07-27T20:31:29.127546+0000","last_unstale":"2023-07-27T20:31:34.157543+0000","last_undegraded":"2023-07-27T20:31:34.157543+0000","last_fullsized":"2023-07-27T20:31:34.157543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:07:33.134307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963982+0000","last_change":"2023-07-27T20:31:29.146424+0000","last_active":"2023-07-27T20:31:34.963982+0000","last_peered":"2023-07-27T20:31:34.963982+0000","last_clean":"2023-07-27T20:31:34.963982+0000","last_became_active":"2023-07-27T20:31:29.146170+0000","last_became_peered":"2023-07-27T20:31:29.146170+0000","last_unstale":"2023-07-27T20:31:34.963982+0000","last_undegraded":"2023-07-27T20:31:34.963982+0000","last_fullsized":"2023-07-27T20:31:34.963982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:30:09.671437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160355+0000","last_change":"2023-07-27T20:31:29.137685+0000","last_active":"2023-07-27T20:31:34.160355+0000","last_peered":"2023-07-27T20:31:34.160355+0000","last_clean":"2023-07-27T20:31:34.160355+0000","last_became_active":"2023-07-27T20:31:29.130560+0000","last_became_peered":"2023-07-27T20:31:29.130560+0000","last_unstale":"2023-07-27T20:31:34.160355+0000","last_undegraded":"2023-07-27T20:31:34.160355+0000","last_fullsized":"2023-07-27T20:31:34.160355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:11:40.101545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963386+0000","last_change":"2023-07-27T20:31:29.134204+0000","last_active":"2023-07-27T20:31:34.963386+0000","last_peered":"2023-07-27T20:31:34.963386+0000","last_clean":"2023-07-27T20:31:34.963386+0000","last_became_active":"2023-07-27T20:31:29.133944+0000","last_became_peered":"2023-07-27T20:31:29.133944+0000","last_unstale":"2023-07-27T20:31:34.963386+0000","last_undegraded":"2023-07-27T20:31:34.963386+0000","last_fullsized":"2023-07-27T20:31:34.963386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:18:04.393407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964703+0000","last_change":"2023-07-27T20:31:29.126910+0000","last_active":"2023-07-27T20:31:34.964703+0000","last_peered":"2023-07-27T20:31:34.964703+0000","last_clean":"2023-07-27T20:31:34.964703+0000","last_became_active":"2023-07-27T20:31:29.126575+0000","last_became_peered":"2023-07-27T20:31:29.126575+0000","last_unstale":"2023-07-27T20:31:34.964703+0000","last_undegraded":"2023-07-27T20:31:34.964703+0000","last_fullsized":"2023-07-27T20:31:34.964703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:31:04.071892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.962855+0000","last_change":"2023-07-27T20:31:29.139957+0000","last_active":"2023-07-27T20:31:34.962855+0000","last_peered":"2023-07-27T20:31:34.962855+0000","last_clean":"2023-07-27T20:31:34.962855+0000","last_became_active":"2023-07-27T20:31:29.139623+0000","last_became_peered":"2023-07-27T20:31:29.139623+0000","last_unstale":"2023-07-27T20:31:34.962855+0000","last_undegraded":"2023-07-27T20:31:34.962855+0000","last_fullsized":"2023-07-27T20:31:34.962855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:22:49.467838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159607+0000","last_change":"2023-07-27T20:31:29.143739+0000","last_active":"2023-07-27T20:31:34.159607+0000","last_peered":"2023-07-27T20:31:34.159607+0000","last_clean":"2023-07-27T20:31:34.159607+0000","last_became_active":"2023-07-27T20:31:29.143337+0000","last_became_peered":"2023-07-27T20:31:29.143337+0000","last_unstale":"2023-07-27T20:31:34.159607+0000","last_undegraded":"2023-07-27T20:31:34.159607+0000","last_fullsized":"2023-07-27T20:31:34.159607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:24:57.182748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158603+0000","last_change":"2023-07-27T20:31:29.125242+0000","last_active":"2023-07-27T20:31:34.158603+0000","last_peered":"2023-07-27T20:31:34.158603+0000","last_clean":"2023-07-27T20:31:34.158603+0000","last_became_active":"2023-07-27T20:31:29.124967+0000","last_became_peered":"2023-07-27T20:31:29.124967+0000","last_unstale":"2023-07-27T20:31:34.158603+0000","last_undegraded":"2023-07-27T20:31:34.158603+0000","last_fullsized":"2023-07-27T20:31:34.158603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:31:04.269016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157859+0000","last_change":"2023-07-27T20:31:29.127644+0000","last_active":"2023-07-27T20:31:34.157859+0000","last_peered":"2023-07-27T20:31:34.157859+0000","last_clean":"2023-07-27T20:31:34.157859+0000","last_became_active":"2023-07-27T20:31:29.127277+0000","last_became_peered":"2023-07-27T20:31:29.127277+0000","last_unstale":"2023-07-27T20:31:34.157859+0000","last_undegraded":"2023-07-27T20:31:34.157859+0000","last_fullsized":"2023-07-27T20:31:34.157859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:38:08.459694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160497+0000","last_change":"2023-07-27T20:31:29.131333+0000","last_active":"2023-07-27T20:31:34.160497+0000","last_peered":"2023-07-27T20:31:34.160497+0000","last_clean":"2023-07-27T20:31:34.160497+0000","last_became_active":"2023-07-27T20:31:29.131016+0000","last_became_peered":"2023-07-27T20:31:29.131016+0000","last_unstale":"2023-07-27T20:31:34.160497+0000","last_undegraded":"2023-07-27T20:31:34.160497+0000","last_fullsized":"2023-07-27T20:31:34.160497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:22:01.318022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963957+0000","last_change":"2023-07-27T20:31:29.133266+0000","last_active":"2023-07-27T20:31:34.963957+0000","last_peered":"2023-07-27T20:31:34.963957+0000","last_clean":"2023-07-27T20:31:34.963957+0000","last_became_active":"2023-07-27T20:31:29.132915+0000","last_became_peered":"2023-07-27T20:31:29.132915+0000","last_unstale":"2023-07-27T20:31:34.963957+0000","last_undegraded":"2023-07-27T20:31:34.963957+0000","last_fullsized":"2023-07-27T20:31:34.963957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:56:38.159541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158925+0000","last_change":"2023-07-27T20:31:29.141130+0000","last_active":"2023-07-27T20:31:34.158925+0000","last_peered":"2023-07-27T20:31:34.158925+0000","last_clean":"2023-07-27T20:31:34.158925+0000","last_became_active":"2023-07-27T20:31:29.140883+0000","last_became_peered":"2023-07-27T20:31:29.140883+0000","last_unstale":"2023-07-27T20:31:34.158925+0000","last_undegraded":"2023-07-27T20:31:34.158925+0000","last_fullsized":"2023-07-27T20:31:34.158925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:08:14.703624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159167+0000","last_change":"2023-07-27T20:31:29.139144+0000","last_active":"2023-07-27T20:31:34.159167+0000","last_peered":"2023-07-27T20:31:34.159167+0000","last_clean":"2023-07-27T20:31:34.159167+0000","last_became_active":"2023-07-27T20:31:29.137774+0000","last_became_peered":"2023-07-27T20:31:29.137774+0000","last_unstale":"2023-07-27T20:31:34.159167+0000","last_undegraded":"2023-07-27T20:31:34.159167+0000","last_fullsized":"2023-07-27T20:31:34.159167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:21:00.439118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157696+0000","last_change":"2023-07-27T20:31:29.131957+0000","last_active":"2023-07-27T20:31:34.157696+0000","last_peered":"2023-07-27T20:31:34.157696+0000","last_clean":"2023-07-27T20:31:34.157696+0000","last_became_active":"2023-07-27T20:31:29.131512+0000","last_became_peered":"2023-07-27T20:31:29.131512+0000","last_unstale":"2023-07-27T20:31:34.157696+0000","last_undegraded":"2023-07-27T20:31:34.157696+0000","last_fullsized":"2023-07-27T20:31:34.157696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:41:18.405424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964757+0000","last_change":"2023-07-27T20:31:29.130648+0000","last_active":"2023-07-27T20:31:34.964757+0000","last_peered":"2023-07-27T20:31:34.964757+0000","last_clean":"2023-07-27T20:31:34.964757+0000","last_became_active":"2023-07-27T20:31:29.130145+0000","last_became_peered":"2023-07-27T20:31:29.130145+0000","last_unstale":"2023-07-27T20:31:34.964757+0000","last_undegraded":"2023-07-27T20:31:34.964757+0000","last_fullsized":"2023-07-27T20:31:34.964757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:25:53.220364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159388+0000","last_change":"2023-07-27T20:31:29.138599+0000","last_active":"2023-07-27T20:31:34.159388+0000","last_peered":"2023-07-27T20:31:34.159388+0000","last_clean":"2023-07-27T20:31:34.159388+0000","last_became_active":"2023-07-27T20:31:29.138323+0000","last_became_peered":"2023-07-27T20:31:29.138323+0000","last_unstale":"2023-07-27T20:31:34.159388+0000","last_undegraded":"2023-07-27T20:31:34.159388+0000","last_fullsized":"2023-07-27T20:31:34.159388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:03:16.615704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965611+0000","last_change":"2023-07-27T20:31:29.136600+0000","last_active":"2023-07-27T20:31:34.965611+0000","last_peered":"2023-07-27T20:31:34.965611+0000","last_clean":"2023-07-27T20:31:34.965611+0000","last_became_active":"2023-07-27T20:31:29.136316+0000","last_became_peered":"2023-07-27T20:31:29.136316+0000","last_unstale":"2023-07-27T20:31:34.965611+0000","last_undegraded":"2023-07-27T20:31:34.965611+0000","last_fullsized":"2023-07-27T20:31:34.965611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:46:44.091855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963642+0000","last_change":"2023-07-27T20:31:29.135116+0000","last_active":"2023-07-27T20:31:34.963642+0000","last_peered":"2023-07-27T20:31:34.963642+0000","last_clean":"2023-07-27T20:31:34.963642+0000","last_became_active":"2023-07-27T20:31:29.134786+0000","last_became_peered":"2023-07-27T20:31:29.134786+0000","last_unstale":"2023-07-27T20:31:34.963642+0000","last_undegraded":"2023-07-27T20:31:34.963642+0000","last_fullsized":"2023-07-27T20:31:34.963642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:21:00.439118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963660+0000","last_change":"2023-07-27T20:31:29.145388+0000","last_active":"2023-07-27T20:31:34.963660+0000","last_peered":"2023-07-27T20:31:34.963660+0000","last_clean":"2023-07-27T20:31:34.963660+0000","last_became_active":"2023-07-27T20:31:29.141813+0000","last_became_peered":"2023-07-27T20:31:29.141813+0000","last_unstale":"2023-07-27T20:31:34.963660+0000","last_undegraded":"2023-07-27T20:31:34.963660+0000","last_fullsized":"2023-07-27T20:31:34.963660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:52:37.919677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159610+0000","last_change":"2023-07-27T20:31:33.179641+0000","last_active":"2023-07-27T20:31:34.159610+0000","last_peered":"2023-07-27T20:31:34.159610+0000","last_clean":"2023-07-27T20:31:34.159610+0000","last_became_active":"2023-07-27T20:31:33.179219+0000","last_became_peered":"2023-07-27T20:31:33.179219+0000","last_unstale":"2023-07-27T20:31:34.159610+0000","last_undegraded":"2023-07-27T20:31:34.159610+0000","last_fullsized":"2023-07-27T20:31:34.159610+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:22:32.926771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158940+0000","last_change":"2023-07-27T20:31:28.123712+0000","last_active":"2023-07-27T20:31:34.158940+0000","last_peered":"2023-07-27T20:31:34.158940+0000","last_clean":"2023-07-27T20:31:34.158940+0000","last_became_active":"2023-07-27T20:31:28.123425+0000","last_became_peered":"2023-07-27T20:31:28.123425+0000","last_unstale":"2023-07-27T20:31:34.158940+0000","last_undegraded":"2023-07-27T20:31:34.158940+0000","last_fullsized":"2023-07-27T20:31:34.158940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:26:08.939256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964276+0000","last_change":"2023-07-27T20:31:29.130374+0000","last_active":"2023-07-27T20:31:34.964276+0000","last_peered":"2023-07-27T20:31:34.964276+0000","last_clean":"2023-07-27T20:31:34.964276+0000","last_became_active":"2023-07-27T20:31:29.130099+0000","last_became_peered":"2023-07-27T20:31:29.130099+0000","last_unstale":"2023-07-27T20:31:34.964276+0000","last_undegraded":"2023-07-27T20:31:34.964276+0000","last_fullsized":"2023-07-27T20:31:34.964276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:17:03.497602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963430+0000","last_change":"2023-07-27T20:31:33.178251+0000","last_active":"2023-07-27T20:31:34.963430+0000","last_peered":"2023-07-27T20:31:34.963430+0000","last_clean":"2023-07-27T20:31:34.963430+0000","last_became_active":"2023-07-27T20:31:33.177826+0000","last_became_peered":"2023-07-27T20:31:33.177826+0000","last_unstale":"2023-07-27T20:31:34.963430+0000","last_undegraded":"2023-07-27T20:31:34.963430+0000","last_fullsized":"2023-07-27T20:31:34.963430+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:59:12.877709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.962935+0000","last_change":"2023-07-27T20:31:28.123837+0000","last_active":"2023-07-27T20:31:34.962935+0000","last_peered":"2023-07-27T20:31:34.962935+0000","last_clean":"2023-07-27T20:31:34.962935+0000","last_became_active":"2023-07-27T20:31:28.123456+0000","last_became_peered":"2023-07-27T20:31:28.123456+0000","last_unstale":"2023-07-27T20:31:34.962935+0000","last_undegraded":"2023-07-27T20:31:34.962935+0000","last_fullsized":"2023-07-27T20:31:34.962935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:56:54.247350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158484+0000","last_change":"2023-07-27T20:31:29.141212+0000","last_active":"2023-07-27T20:31:34.158484+0000","last_peered":"2023-07-27T20:31:34.158484+0000","last_clean":"2023-07-27T20:31:34.158484+0000","last_became_active":"2023-07-27T20:31:29.140956+0000","last_became_peered":"2023-07-27T20:31:29.140956+0000","last_unstale":"2023-07-27T20:31:34.158484+0000","last_undegraded":"2023-07-27T20:31:34.158484+0000","last_fullsized":"2023-07-27T20:31:34.158484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:43:10.912905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158360+0000","last_change":"2023-07-27T20:31:33.182932+0000","last_active":"2023-07-27T20:31:34.158360+0000","last_peered":"2023-07-27T20:31:34.158360+0000","last_clean":"2023-07-27T20:31:34.158360+0000","last_became_active":"2023-07-27T20:31:33.182477+0000","last_became_peered":"2023-07-27T20:31:33.182477+0000","last_unstale":"2023-07-27T20:31:34.158360+0000","last_undegraded":"2023-07-27T20:31:34.158360+0000","last_fullsized":"2023-07-27T20:31:34.158360+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:25:57.270856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965391+0000","last_change":"2023-07-27T20:31:28.120846+0000","last_active":"2023-07-27T20:31:34.965391+0000","last_peered":"2023-07-27T20:31:34.965391+0000","last_clean":"2023-07-27T20:31:34.965391+0000","last_became_active":"2023-07-27T20:31:28.120544+0000","last_became_peered":"2023-07-27T20:31:28.120544+0000","last_unstale":"2023-07-27T20:31:34.965391+0000","last_undegraded":"2023-07-27T20:31:34.965391+0000","last_fullsized":"2023-07-27T20:31:34.965391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:17:24.488257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963834+0000","last_change":"2023-07-27T20:31:29.144062+0000","last_active":"2023-07-27T20:31:34.963834+0000","last_peered":"2023-07-27T20:31:34.963834+0000","last_clean":"2023-07-27T20:31:34.963834+0000","last_became_active":"2023-07-27T20:31:29.143781+0000","last_became_peered":"2023-07-27T20:31:29.143781+0000","last_unstale":"2023-07-27T20:31:34.963834+0000","last_undegraded":"2023-07-27T20:31:34.963834+0000","last_fullsized":"2023-07-27T20:31:34.963834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:17:24.376438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963333+0000","last_change":"2023-07-27T20:31:33.185760+0000","last_active":"2023-07-27T20:31:34.963333+0000","last_peered":"2023-07-27T20:31:34.963333+0000","last_clean":"2023-07-27T20:31:34.963333+0000","last_became_active":"2023-07-27T20:31:33.185326+0000","last_became_peered":"2023-07-27T20:31:33.185326+0000","last_unstale":"2023-07-27T20:31:34.963333+0000","last_undegraded":"2023-07-27T20:31:34.963333+0000","last_fullsized":"2023-07-27T20:31:34.963333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:13:18.283879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157795+0000","last_change":"2023-07-27T20:31:28.130352+0000","last_active":"2023-07-27T20:31:34.157795+0000","last_peered":"2023-07-27T20:31:34.157795+0000","last_clean":"2023-07-27T20:31:34.157795+0000","last_became_active":"2023-07-27T20:31:28.130107+0000","last_became_peered":"2023-07-27T20:31:28.130107+0000","last_unstale":"2023-07-27T20:31:34.157795+0000","last_undegraded":"2023-07-27T20:31:34.157795+0000","last_fullsized":"2023-07-27T20:31:34.157795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:32:39.371251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965281+0000","last_change":"2023-07-27T20:31:29.130936+0000","last_active":"2023-07-27T20:31:34.965281+0000","last_peered":"2023-07-27T20:31:34.965281+0000","last_clean":"2023-07-27T20:31:34.965281+0000","last_became_active":"2023-07-27T20:31:29.130687+0000","last_became_peered":"2023-07-27T20:31:29.130687+0000","last_unstale":"2023-07-27T20:31:34.965281+0000","last_undegraded":"2023-07-27T20:31:34.965281+0000","last_fullsized":"2023-07-27T20:31:34.965281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:26:00.598434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158984+0000","last_change":"2023-07-27T20:31:33.180364+0000","last_active":"2023-07-27T20:31:34.158984+0000","last_peered":"2023-07-27T20:31:34.158984+0000","last_clean":"2023-07-27T20:31:34.158984+0000","last_became_active":"2023-07-27T20:31:33.179972+0000","last_became_peered":"2023-07-27T20:31:33.179972+0000","last_unstale":"2023-07-27T20:31:34.158984+0000","last_undegraded":"2023-07-27T20:31:34.158984+0000","last_fullsized":"2023-07-27T20:31:34.158984+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:59:31.342576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963829+0000","last_change":"2023-07-27T20:31:28.127766+0000","last_active":"2023-07-27T20:31:34.963829+0000","last_peered":"2023-07-27T20:31:34.963829+0000","last_clean":"2023-07-27T20:31:34.963829+0000","last_became_active":"2023-07-27T20:31:28.127443+0000","last_became_peered":"2023-07-27T20:31:28.127443+0000","last_unstale":"2023-07-27T20:31:34.963829+0000","last_undegraded":"2023-07-27T20:31:34.963829+0000","last_fullsized":"2023-07-27T20:31:34.963829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:04:21.752471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964865+0000","last_change":"2023-07-27T20:31:29.144710+0000","last_active":"2023-07-27T20:31:34.964865+0000","last_peered":"2023-07-27T20:31:34.964865+0000","last_clean":"2023-07-27T20:31:34.964865+0000","last_became_active":"2023-07-27T20:31:29.142111+0000","last_became_peered":"2023-07-27T20:31:29.142111+0000","last_unstale":"2023-07-27T20:31:34.964865+0000","last_undegraded":"2023-07-27T20:31:34.964865+0000","last_fullsized":"2023-07-27T20:31:34.964865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:23:30.181522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963728+0000","last_change":"2023-07-27T20:31:33.183443+0000","last_active":"2023-07-27T20:31:34.963728+0000","last_peered":"2023-07-27T20:31:34.963728+0000","last_clean":"2023-07-27T20:31:34.963728+0000","last_became_active":"2023-07-27T20:31:33.183014+0000","last_became_peered":"2023-07-27T20:31:33.183014+0000","last_unstale":"2023-07-27T20:31:34.963728+0000","last_undegraded":"2023-07-27T20:31:34.963728+0000","last_fullsized":"2023-07-27T20:31:34.963728+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:41:22.455916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160506+0000","last_change":"2023-07-27T20:31:28.123550+0000","last_active":"2023-07-27T20:31:34.160506+0000","last_peered":"2023-07-27T20:31:34.160506+0000","last_clean":"2023-07-27T20:31:34.160506+0000","last_became_active":"2023-07-27T20:31:28.123257+0000","last_became_peered":"2023-07-27T20:31:28.123257+0000","last_unstale":"2023-07-27T20:31:34.160506+0000","last_undegraded":"2023-07-27T20:31:34.160506+0000","last_fullsized":"2023-07-27T20:31:34.160506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:32:39.371251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963506+0000","last_change":"2023-07-27T20:31:29.136453+0000","last_active":"2023-07-27T20:31:34.963506+0000","last_peered":"2023-07-27T20:31:34.963506+0000","last_clean":"2023-07-27T20:31:34.963506+0000","last_became_active":"2023-07-27T20:31:29.136266+0000","last_became_peered":"2023-07-27T20:31:29.136266+0000","last_unstale":"2023-07-27T20:31:34.963506+0000","last_undegraded":"2023-07-27T20:31:34.963506+0000","last_fullsized":"2023-07-27T20:31:34.963506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:59:27.292083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.962973+0000","last_change":"2023-07-27T20:31:33.184926+0000","last_active":"2023-07-27T20:31:34.962973+0000","last_peered":"2023-07-27T20:31:34.962973+0000","last_clean":"2023-07-27T20:31:34.962973+0000","last_became_active":"2023-07-27T20:31:33.184543+0000","last_became_peered":"2023-07-27T20:31:33.184543+0000","last_unstale":"2023-07-27T20:31:34.962973+0000","last_undegraded":"2023-07-27T20:31:34.962973+0000","last_fullsized":"2023-07-27T20:31:34.962973+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:14:53.290135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:47.846131+0000","last_change":"2023-07-27T20:31:28.109472+0000","last_active":"2023-07-27T20:31:47.846131+0000","last_peered":"2023-07-27T20:31:47.846131+0000","last_clean":"2023-07-27T20:31:47.846131+0000","last_became_active":"2023-07-27T20:31:28.108072+0000","last_became_peered":"2023-07-27T20:31:28.108072+0000","last_unstale":"2023-07-27T20:31:47.846131+0000","last_undegraded":"2023-07-27T20:31:47.846131+0000","last_fullsized":"2023-07-27T20:31:47.846131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:10:52.937708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159663+0000","last_change":"2023-07-27T20:31:29.140753+0000","last_active":"2023-07-27T20:31:34.159663+0000","last_peered":"2023-07-27T20:31:34.159663+0000","last_clean":"2023-07-27T20:31:34.159663+0000","last_became_active":"2023-07-27T20:31:29.140474+0000","last_became_peered":"2023-07-27T20:31:29.140474+0000","last_unstale":"2023-07-27T20:31:34.159663+0000","last_undegraded":"2023-07-27T20:31:34.159663+0000","last_fullsized":"2023-07-27T20:31:34.159663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:19:38.010331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963783+0000","last_change":"2023-07-27T20:31:33.183268+0000","last_active":"2023-07-27T20:31:34.963783+0000","last_peered":"2023-07-27T20:31:34.963783+0000","last_clean":"2023-07-27T20:31:34.963783+0000","last_became_active":"2023-07-27T20:31:33.182894+0000","last_became_peered":"2023-07-27T20:31:33.182894+0000","last_unstale":"2023-07-27T20:31:34.963783+0000","last_undegraded":"2023-07-27T20:31:34.963783+0000","last_fullsized":"2023-07-27T20:31:34.963783+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:07:37.184799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159042+0000","last_change":"2023-07-27T20:31:28.126200+0000","last_active":"2023-07-27T20:31:34.159042+0000","last_peered":"2023-07-27T20:31:34.159042+0000","last_clean":"2023-07-27T20:31:34.159042+0000","last_became_active":"2023-07-27T20:31:28.125867+0000","last_became_peered":"2023-07-27T20:31:28.125867+0000","last_unstale":"2023-07-27T20:31:34.159042+0000","last_undegraded":"2023-07-27T20:31:34.159042+0000","last_fullsized":"2023-07-27T20:31:34.159042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:59:02.266953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965069+0000","last_change":"2023-07-27T20:31:29.132793+0000","last_active":"2023-07-27T20:31:34.965069+0000","last_peered":"2023-07-27T20:31:34.965069+0000","last_clean":"2023-07-27T20:31:34.965069+0000","last_became_active":"2023-07-27T20:31:29.132532+0000","last_became_peered":"2023-07-27T20:31:29.132532+0000","last_unstale":"2023-07-27T20:31:34.965069+0000","last_undegraded":"2023-07-27T20:31:34.965069+0000","last_fullsized":"2023-07-27T20:31:34.965069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:08:38.076682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964916+0000","last_change":"2023-07-27T20:31:33.177965+0000","last_active":"2023-07-27T20:31:34.964916+0000","last_peered":"2023-07-27T20:31:34.964916+0000","last_clean":"2023-07-27T20:31:34.964916+0000","last_became_active":"2023-07-27T20:31:33.177476+0000","last_became_peered":"2023-07-27T20:31:33.177476+0000","last_unstale":"2023-07-27T20:31:34.964916+0000","last_undegraded":"2023-07-27T20:31:34.964916+0000","last_fullsized":"2023-07-27T20:31:34.964916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:00:33.711486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157385+0000","last_change":"2023-07-27T20:31:28.108577+0000","last_active":"2023-07-27T20:31:34.157385+0000","last_peered":"2023-07-27T20:31:34.157385+0000","last_clean":"2023-07-27T20:31:34.157385+0000","last_became_active":"2023-07-27T20:31:28.108279+0000","last_became_peered":"2023-07-27T20:31:28.108279+0000","last_unstale":"2023-07-27T20:31:34.157385+0000","last_undegraded":"2023-07-27T20:31:34.157385+0000","last_fullsized":"2023-07-27T20:31:34.157385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:29:56.003949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963523+0000","last_change":"2023-07-27T20:31:29.142170+0000","last_active":"2023-07-27T20:31:34.963523+0000","last_peered":"2023-07-27T20:31:34.963523+0000","last_clean":"2023-07-27T20:31:34.963523+0000","last_became_active":"2023-07-27T20:31:29.141464+0000","last_became_peered":"2023-07-27T20:31:29.141464+0000","last_unstale":"2023-07-27T20:31:34.963523+0000","last_undegraded":"2023-07-27T20:31:34.963523+0000","last_fullsized":"2023-07-27T20:31:34.963523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:29:57.010683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965238+0000","last_change":"2023-07-27T20:31:33.181354+0000","last_active":"2023-07-27T20:31:34.965238+0000","last_peered":"2023-07-27T20:31:34.965238+0000","last_clean":"2023-07-27T20:31:34.965238+0000","last_became_active":"2023-07-27T20:31:33.180937+0000","last_became_peered":"2023-07-27T20:31:33.180937+0000","last_unstale":"2023-07-27T20:31:34.965238+0000","last_undegraded":"2023-07-27T20:31:34.965238+0000","last_fullsized":"2023-07-27T20:31:34.965238+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:09:47.445321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159771+0000","last_change":"2023-07-27T20:31:28.126220+0000","last_active":"2023-07-27T20:31:34.159771+0000","last_peered":"2023-07-27T20:31:34.159771+0000","last_clean":"2023-07-27T20:31:34.159771+0000","last_became_active":"2023-07-27T20:31:28.125857+0000","last_became_peered":"2023-07-27T20:31:28.125857+0000","last_unstale":"2023-07-27T20:31:34.159771+0000","last_undegraded":"2023-07-27T20:31:34.159771+0000","last_fullsized":"2023-07-27T20:31:34.159771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:29:56.003949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157853+0000","last_change":"2023-07-27T20:31:29.128032+0000","last_active":"2023-07-27T20:31:34.157853+0000","last_peered":"2023-07-27T20:31:34.157853+0000","last_clean":"2023-07-27T20:31:34.157853+0000","last_became_active":"2023-07-27T20:31:29.127199+0000","last_became_peered":"2023-07-27T20:31:29.127199+0000","last_unstale":"2023-07-27T20:31:34.157853+0000","last_undegraded":"2023-07-27T20:31:34.157853+0000","last_fullsized":"2023-07-27T20:31:34.157853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:30:09.671437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963089+0000","last_change":"2023-07-27T20:31:33.190228+0000","last_active":"2023-07-27T20:31:34.963089+0000","last_peered":"2023-07-27T20:31:34.963089+0000","last_clean":"2023-07-27T20:31:34.963089+0000","last_became_active":"2023-07-27T20:31:33.188522+0000","last_became_peered":"2023-07-27T20:31:33.188522+0000","last_unstale":"2023-07-27T20:31:34.963089+0000","last_undegraded":"2023-07-27T20:31:34.963089+0000","last_fullsized":"2023-07-27T20:31:34.963089+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:13:45.447971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.962746+0000","last_change":"2023-07-27T20:31:28.119987+0000","last_active":"2023-07-27T20:31:34.962746+0000","last_peered":"2023-07-27T20:31:34.962746+0000","last_clean":"2023-07-27T20:31:34.962746+0000","last_became_active":"2023-07-27T20:31:28.119662+0000","last_became_peered":"2023-07-27T20:31:28.119662+0000","last_unstale":"2023-07-27T20:31:34.962746+0000","last_undegraded":"2023-07-27T20:31:34.962746+0000","last_fullsized":"2023-07-27T20:31:34.962746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:13:43.260178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965357+0000","last_change":"2023-07-27T20:31:29.138880+0000","last_active":"2023-07-27T20:31:34.965357+0000","last_peered":"2023-07-27T20:31:34.965357+0000","last_clean":"2023-07-27T20:31:34.965357+0000","last_became_active":"2023-07-27T20:31:29.138642+0000","last_became_peered":"2023-07-27T20:31:29.138642+0000","last_unstale":"2023-07-27T20:31:34.965357+0000","last_undegraded":"2023-07-27T20:31:34.965357+0000","last_fullsized":"2023-07-27T20:31:34.965357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:59:15.743619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160177+0000","last_change":"2023-07-27T20:31:33.184734+0000","last_active":"2023-07-27T20:31:34.160177+0000","last_peered":"2023-07-27T20:31:34.160177+0000","last_clean":"2023-07-27T20:31:34.160177+0000","last_became_active":"2023-07-27T20:31:33.183711+0000","last_became_peered":"2023-07-27T20:31:33.183711+0000","last_unstale":"2023-07-27T20:31:34.160177+0000","last_undegraded":"2023-07-27T20:31:34.160177+0000","last_fullsized":"2023-07-27T20:31:34.160177+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:07:37.184799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160260+0000","last_change":"2023-07-27T20:31:28.126412+0000","last_active":"2023-07-27T20:31:34.160260+0000","last_peered":"2023-07-27T20:31:34.160260+0000","last_clean":"2023-07-27T20:31:34.160260+0000","last_became_active":"2023-07-27T20:31:28.125276+0000","last_became_peered":"2023-07-27T20:31:28.125276+0000","last_unstale":"2023-07-27T20:31:34.160260+0000","last_undegraded":"2023-07-27T20:31:34.160260+0000","last_fullsized":"2023-07-27T20:31:34.160260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:04:21.752471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.962588+0000","last_change":"2023-07-27T20:31:29.141157+0000","last_active":"2023-07-27T20:31:34.962588+0000","last_peered":"2023-07-27T20:31:34.962588+0000","last_clean":"2023-07-27T20:31:34.962588+0000","last_became_active":"2023-07-27T20:31:29.140721+0000","last_became_peered":"2023-07-27T20:31:29.140721+0000","last_unstale":"2023-07-27T20:31:34.962588+0000","last_undegraded":"2023-07-27T20:31:34.962588+0000","last_fullsized":"2023-07-27T20:31:34.962588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:31:18.732492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.962761+0000","last_change":"2023-07-27T20:31:33.179053+0000","last_active":"2023-07-27T20:31:34.962761+0000","last_peered":"2023-07-27T20:31:34.962761+0000","last_clean":"2023-07-27T20:31:34.962761+0000","last_became_active":"2023-07-27T20:31:33.178636+0000","last_became_peered":"2023-07-27T20:31:33.178636+0000","last_unstale":"2023-07-27T20:31:34.962761+0000","last_undegraded":"2023-07-27T20:31:34.962761+0000","last_fullsized":"2023-07-27T20:31:34.962761+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:21:33.766448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160260+0000","last_change":"2023-07-27T20:31:28.122016+0000","last_active":"2023-07-27T20:31:34.160260+0000","last_peered":"2023-07-27T20:31:34.160260+0000","last_clean":"2023-07-27T20:31:34.160260+0000","last_became_active":"2023-07-27T20:31:28.121722+0000","last_became_peered":"2023-07-27T20:31:28.121722+0000","last_unstale":"2023-07-27T20:31:34.160260+0000","last_undegraded":"2023-07-27T20:31:34.160260+0000","last_fullsized":"2023-07-27T20:31:34.160260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:38:07.452960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159369+0000","last_change":"2023-07-27T20:31:29.126285+0000","last_active":"2023-07-27T20:31:34.159369+0000","last_peered":"2023-07-27T20:31:34.159369+0000","last_clean":"2023-07-27T20:31:34.159369+0000","last_became_active":"2023-07-27T20:31:29.126028+0000","last_became_peered":"2023-07-27T20:31:29.126028+0000","last_unstale":"2023-07-27T20:31:34.159369+0000","last_undegraded":"2023-07-27T20:31:34.159369+0000","last_fullsized":"2023-07-27T20:31:34.159369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:34:02.603036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964503+0000","last_change":"2023-07-27T20:31:33.192421+0000","last_active":"2023-07-27T20:31:34.964503+0000","last_peered":"2023-07-27T20:31:34.964503+0000","last_clean":"2023-07-27T20:31:34.964503+0000","last_became_active":"2023-07-27T20:31:33.188383+0000","last_became_peered":"2023-07-27T20:31:33.188383+0000","last_unstale":"2023-07-27T20:31:34.964503+0000","last_undegraded":"2023-07-27T20:31:34.964503+0000","last_fullsized":"2023-07-27T20:31:34.964503+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:19:59.171464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160661+0000","last_change":"2023-07-27T20:31:28.130299+0000","last_active":"2023-07-27T20:31:34.160661+0000","last_peered":"2023-07-27T20:31:34.160661+0000","last_clean":"2023-07-27T20:31:34.160661+0000","last_became_active":"2023-07-27T20:31:28.129986+0000","last_became_peered":"2023-07-27T20:31:28.129986+0000","last_unstale":"2023-07-27T20:31:34.160661+0000","last_undegraded":"2023-07-27T20:31:34.160661+0000","last_fullsized":"2023-07-27T20:31:34.160661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:02:56.272252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963299+0000","last_change":"2023-07-27T20:31:29.132566+0000","last_active":"2023-07-27T20:31:34.963299+0000","last_peered":"2023-07-27T20:31:34.963299+0000","last_clean":"2023-07-27T20:31:34.963299+0000","last_became_active":"2023-07-27T20:31:29.132163+0000","last_became_peered":"2023-07-27T20:31:29.132163+0000","last_unstale":"2023-07-27T20:31:34.963299+0000","last_undegraded":"2023-07-27T20:31:34.963299+0000","last_fullsized":"2023-07-27T20:31:34.963299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:39:29.240358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963259+0000","last_change":"2023-07-27T20:31:33.186162+0000","last_active":"2023-07-27T20:31:34.963259+0000","last_peered":"2023-07-27T20:31:34.963259+0000","last_clean":"2023-07-27T20:31:34.963259+0000","last_became_active":"2023-07-27T20:31:33.185738+0000","last_became_peered":"2023-07-27T20:31:33.185738+0000","last_unstale":"2023-07-27T20:31:34.963259+0000","last_undegraded":"2023-07-27T20:31:34.963259+0000","last_fullsized":"2023-07-27T20:31:34.963259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:59:46.029831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963161+0000","last_change":"2023-07-27T20:31:28.124073+0000","last_active":"2023-07-27T20:31:34.963161+0000","last_peered":"2023-07-27T20:31:34.963161+0000","last_clean":"2023-07-27T20:31:34.963161+0000","last_became_active":"2023-07-27T20:31:28.123661+0000","last_became_peered":"2023-07-27T20:31:28.123661+0000","last_unstale":"2023-07-27T20:31:34.963161+0000","last_undegraded":"2023-07-27T20:31:34.963161+0000","last_fullsized":"2023-07-27T20:31:34.963161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:20:59.432383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158518+0000","last_change":"2023-07-27T20:31:29.135207+0000","last_active":"2023-07-27T20:31:34.158518+0000","last_peered":"2023-07-27T20:31:34.158518+0000","last_clean":"2023-07-27T20:31:34.158518+0000","last_became_active":"2023-07-27T20:31:29.134951+0000","last_became_peered":"2023-07-27T20:31:29.134951+0000","last_unstale":"2023-07-27T20:31:34.158518+0000","last_undegraded":"2023-07-27T20:31:34.158518+0000","last_fullsized":"2023-07-27T20:31:34.158518+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:00:29.660993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964088+0000","last_change":"2023-07-27T20:31:33.192124+0000","last_active":"2023-07-27T20:31:34.964088+0000","last_peered":"2023-07-27T20:31:34.964088+0000","last_clean":"2023-07-27T20:31:34.964088+0000","last_became_active":"2023-07-27T20:31:33.187632+0000","last_became_peered":"2023-07-27T20:31:33.187632+0000","last_unstale":"2023-07-27T20:31:34.964088+0000","last_undegraded":"2023-07-27T20:31:34.964088+0000","last_fullsized":"2023-07-27T20:31:34.964088+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:07:10.295169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963580+0000","last_change":"2023-07-27T20:31:28.121108+0000","last_active":"2023-07-27T20:31:34.963580+0000","last_peered":"2023-07-27T20:31:34.963580+0000","last_clean":"2023-07-27T20:31:34.963580+0000","last_became_active":"2023-07-27T20:31:28.120493+0000","last_became_peered":"2023-07-27T20:31:28.120493+0000","last_unstale":"2023-07-27T20:31:34.963580+0000","last_undegraded":"2023-07-27T20:31:34.963580+0000","last_fullsized":"2023-07-27T20:31:34.963580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:01:29.799303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158619+0000","last_change":"2023-07-27T20:31:29.131480+0000","last_active":"2023-07-27T20:31:34.158619+0000","last_peered":"2023-07-27T20:31:34.158619+0000","last_clean":"2023-07-27T20:31:34.158619+0000","last_became_active":"2023-07-27T20:31:29.131095+0000","last_became_peered":"2023-07-27T20:31:29.131095+0000","last_unstale":"2023-07-27T20:31:34.158619+0000","last_undegraded":"2023-07-27T20:31:34.158619+0000","last_fullsized":"2023-07-27T20:31:34.158619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:34:08.272287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963660+0000","last_change":"2023-07-27T20:31:33.187021+0000","last_active":"2023-07-27T20:31:34.963660+0000","last_peered":"2023-07-27T20:31:34.963660+0000","last_clean":"2023-07-27T20:31:34.963660+0000","last_became_active":"2023-07-27T20:31:33.186607+0000","last_became_peered":"2023-07-27T20:31:33.186607+0000","last_unstale":"2023-07-27T20:31:34.963660+0000","last_undegraded":"2023-07-27T20:31:34.963660+0000","last_fullsized":"2023-07-27T20:31:34.963660+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:13:45.447971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963434+0000","last_change":"2023-07-27T20:31:28.127262+0000","last_active":"2023-07-27T20:31:34.963434+0000","last_peered":"2023-07-27T20:31:34.963434+0000","last_clean":"2023-07-27T20:31:34.963434+0000","last_became_active":"2023-07-27T20:31:28.126885+0000","last_became_peered":"2023-07-27T20:31:28.126885+0000","last_unstale":"2023-07-27T20:31:34.963434+0000","last_undegraded":"2023-07-27T20:31:34.963434+0000","last_fullsized":"2023-07-27T20:31:34.963434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:06:53.409694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160256+0000","last_change":"2023-07-27T20:31:29.129706+0000","last_active":"2023-07-27T20:31:34.160256+0000","last_peered":"2023-07-27T20:31:34.160256+0000","last_clean":"2023-07-27T20:31:34.160256+0000","last_became_active":"2023-07-27T20:31:29.129331+0000","last_became_peered":"2023-07-27T20:31:29.129331+0000","last_unstale":"2023-07-27T20:31:34.160256+0000","last_undegraded":"2023-07-27T20:31:34.160256+0000","last_fullsized":"2023-07-27T20:31:34.160256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:16:54.006335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964068+0000","last_change":"2023-07-27T20:31:33.189952+0000","last_active":"2023-07-27T20:31:34.964068+0000","last_peered":"2023-07-27T20:31:34.964068+0000","last_clean":"2023-07-27T20:31:34.964068+0000","last_became_active":"2023-07-27T20:31:33.188619+0000","last_became_peered":"2023-07-27T20:31:33.188619+0000","last_unstale":"2023-07-27T20:31:34.964068+0000","last_undegraded":"2023-07-27T20:31:34.964068+0000","last_fullsized":"2023-07-27T20:31:34.964068+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:03:01.329479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158999+0000","last_change":"2023-07-27T20:31:28.115944+0000","last_active":"2023-07-27T20:31:34.158999+0000","last_peered":"2023-07-27T20:31:34.158999+0000","last_clean":"2023-07-27T20:31:34.158999+0000","last_became_active":"2023-07-27T20:31:28.115533+0000","last_became_peered":"2023-07-27T20:31:28.115533+0000","last_unstale":"2023-07-27T20:31:34.158999+0000","last_undegraded":"2023-07-27T20:31:34.158999+0000","last_fullsized":"2023-07-27T20:31:34.158999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:08:41.229908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160623+0000","last_change":"2023-07-27T20:31:29.143123+0000","last_active":"2023-07-27T20:31:34.160623+0000","last_peered":"2023-07-27T20:31:34.160623+0000","last_clean":"2023-07-27T20:31:34.160623+0000","last_became_active":"2023-07-27T20:31:29.142870+0000","last_became_peered":"2023-07-27T20:31:29.142870+0000","last_unstale":"2023-07-27T20:31:34.160623+0000","last_undegraded":"2023-07-27T20:31:34.160623+0000","last_fullsized":"2023-07-27T20:31:34.160623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:38:22.765710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160570+0000","last_change":"2023-07-27T20:31:33.181739+0000","last_active":"2023-07-27T20:31:34.160570+0000","last_peered":"2023-07-27T20:31:34.160570+0000","last_clean":"2023-07-27T20:31:34.160570+0000","last_became_active":"2023-07-27T20:31:33.181198+0000","last_became_peered":"2023-07-27T20:31:33.181198+0000","last_unstale":"2023-07-27T20:31:34.160570+0000","last_undegraded":"2023-07-27T20:31:34.160570+0000","last_fullsized":"2023-07-27T20:31:34.160570+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:45:59.627493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965266+0000","last_change":"2023-07-27T20:31:28.120507+0000","last_active":"2023-07-27T20:31:34.965266+0000","last_peered":"2023-07-27T20:31:34.965266+0000","last_clean":"2023-07-27T20:31:34.965266+0000","last_became_active":"2023-07-27T20:31:28.120181+0000","last_became_peered":"2023-07-27T20:31:28.120181+0000","last_unstale":"2023-07-27T20:31:34.965266+0000","last_undegraded":"2023-07-27T20:31:34.965266+0000","last_fullsized":"2023-07-27T20:31:34.965266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:35:11.181105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965561+0000","last_change":"2023-07-27T20:31:29.128643+0000","last_active":"2023-07-27T20:31:34.965561+0000","last_peered":"2023-07-27T20:31:34.965561+0000","last_clean":"2023-07-27T20:31:34.965561+0000","last_became_active":"2023-07-27T20:31:29.128351+0000","last_became_peered":"2023-07-27T20:31:29.128351+0000","last_unstale":"2023-07-27T20:31:34.965561+0000","last_undegraded":"2023-07-27T20:31:34.965561+0000","last_fullsized":"2023-07-27T20:31:34.965561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:52:37.919677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157930+0000","last_change":"2023-07-27T20:31:33.185100+0000","last_active":"2023-07-27T20:31:34.157930+0000","last_peered":"2023-07-27T20:31:34.157930+0000","last_clean":"2023-07-27T20:31:34.157930+0000","last_became_active":"2023-07-27T20:31:33.184683+0000","last_became_peered":"2023-07-27T20:31:33.184683+0000","last_unstale":"2023-07-27T20:31:34.157930+0000","last_undegraded":"2023-07-27T20:31:34.157930+0000","last_fullsized":"2023-07-27T20:31:34.157930+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:03:01.329479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963884+0000","last_change":"2023-07-27T20:31:22.848698+0000","last_active":"2023-07-27T20:31:34.963884+0000","last_peered":"2023-07-27T20:31:34.963884+0000","last_clean":"2023-07-27T20:31:34.963884+0000","last_became_active":"2023-07-27T20:31:22.848346+0000","last_became_peered":"2023-07-27T20:31:22.848346+0000","last_unstale":"2023-07-27T20:31:34.963884+0000","last_undegraded":"2023-07-27T20:31:34.963884+0000","last_fullsized":"2023-07-27T20:31:34.963884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:48:04.598381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963400+0000","last_change":"2023-07-27T20:31:28.127873+0000","last_active":"2023-07-27T20:31:34.963400+0000","last_peered":"2023-07-27T20:31:34.963400+0000","last_clean":"2023-07-27T20:31:34.963400+0000","last_became_active":"2023-07-27T20:31:28.127528+0000","last_became_peered":"2023-07-27T20:31:28.127528+0000","last_unstale":"2023-07-27T20:31:34.963400+0000","last_undegraded":"2023-07-27T20:31:34.963400+0000","last_fullsized":"2023-07-27T20:31:34.963400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:11:16.759020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963300+0000","last_change":"2023-07-27T20:31:29.141185+0000","last_active":"2023-07-27T20:31:34.963300+0000","last_peered":"2023-07-27T20:31:34.963300+0000","last_clean":"2023-07-27T20:31:34.963300+0000","last_became_active":"2023-07-27T20:31:29.140892+0000","last_became_peered":"2023-07-27T20:31:29.140892+0000","last_unstale":"2023-07-27T20:31:34.963300+0000","last_undegraded":"2023-07-27T20:31:34.963300+0000","last_fullsized":"2023-07-27T20:31:34.963300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:32:33.408454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157575+0000","last_change":"2023-07-27T20:31:33.181796+0000","last_active":"2023-07-27T20:31:34.157575+0000","last_peered":"2023-07-27T20:31:34.157575+0000","last_clean":"2023-07-27T20:31:34.157575+0000","last_became_active":"2023-07-27T20:31:33.181416+0000","last_became_peered":"2023-07-27T20:31:33.181416+0000","last_unstale":"2023-07-27T20:31:34.157575+0000","last_undegraded":"2023-07-27T20:31:34.157575+0000","last_fullsized":"2023-07-27T20:31:34.157575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:52:41.970170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963001+0000","last_change":"2023-07-27T20:31:22.849178+0000","last_active":"2023-07-27T20:31:34.963001+0000","last_peered":"2023-07-27T20:31:34.963001+0000","last_clean":"2023-07-27T20:31:34.963001+0000","last_became_active":"2023-07-27T20:31:22.848856+0000","last_became_peered":"2023-07-27T20:31:22.848856+0000","last_unstale":"2023-07-27T20:31:34.963001+0000","last_undegraded":"2023-07-27T20:31:34.963001+0000","last_fullsized":"2023-07-27T20:31:34.963001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:59:21.022861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159361+0000","last_change":"2023-07-27T20:31:28.121194+0000","last_active":"2023-07-27T20:31:34.159361+0000","last_peered":"2023-07-27T20:31:34.159361+0000","last_clean":"2023-07-27T20:31:34.159361+0000","last_became_active":"2023-07-27T20:31:28.120865+0000","last_became_peered":"2023-07-27T20:31:28.120865+0000","last_unstale":"2023-07-27T20:31:34.159361+0000","last_undegraded":"2023-07-27T20:31:34.159361+0000","last_fullsized":"2023-07-27T20:31:34.159361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:12:37.554428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963780+0000","last_change":"2023-07-27T20:31:29.127748+0000","last_active":"2023-07-27T20:31:34.963780+0000","last_peered":"2023-07-27T20:31:34.963780+0000","last_clean":"2023-07-27T20:31:34.963780+0000","last_became_active":"2023-07-27T20:31:29.127213+0000","last_became_peered":"2023-07-27T20:31:29.127213+0000","last_unstale":"2023-07-27T20:31:34.963780+0000","last_undegraded":"2023-07-27T20:31:34.963780+0000","last_fullsized":"2023-07-27T20:31:34.963780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:59:03.273688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964666+0000","last_change":"2023-07-27T20:31:33.193059+0000","last_active":"2023-07-27T20:31:34.964666+0000","last_peered":"2023-07-27T20:31:34.964666+0000","last_clean":"2023-07-27T20:31:34.964666+0000","last_became_active":"2023-07-27T20:31:33.192317+0000","last_became_peered":"2023-07-27T20:31:33.192317+0000","last_unstale":"2023-07-27T20:31:34.964666+0000","last_undegraded":"2023-07-27T20:31:34.964666+0000","last_fullsized":"2023-07-27T20:31:34.964666+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:22:24.070420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964167+0000","last_change":"2023-07-27T20:31:22.959811+0000","last_active":"2023-07-27T20:31:34.964167+0000","last_peered":"2023-07-27T20:31:34.964167+0000","last_clean":"2023-07-27T20:31:34.964167+0000","last_became_active":"2023-07-27T20:31:22.959449+0000","last_became_peered":"2023-07-27T20:31:22.959449+0000","last_unstale":"2023-07-27T20:31:34.964167+0000","last_undegraded":"2023-07-27T20:31:34.964167+0000","last_fullsized":"2023-07-27T20:31:34.964167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:39:22.049301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.962890+0000","last_change":"2023-07-27T20:31:28.112790+0000","last_active":"2023-07-27T20:31:34.962890+0000","last_peered":"2023-07-27T20:31:34.962890+0000","last_clean":"2023-07-27T20:31:34.962890+0000","last_became_active":"2023-07-27T20:31:28.112486+0000","last_became_peered":"2023-07-27T20:31:28.112486+0000","last_unstale":"2023-07-27T20:31:34.962890+0000","last_undegraded":"2023-07-27T20:31:34.962890+0000","last_fullsized":"2023-07-27T20:31:34.962890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:06:07.656544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965439+0000","last_change":"2023-07-27T20:31:29.150778+0000","last_active":"2023-07-27T20:31:34.965439+0000","last_peered":"2023-07-27T20:31:34.965439+0000","last_clean":"2023-07-27T20:31:34.965439+0000","last_became_active":"2023-07-27T20:31:29.150479+0000","last_became_peered":"2023-07-27T20:31:29.150479+0000","last_unstale":"2023-07-27T20:31:34.965439+0000","last_undegraded":"2023-07-27T20:31:34.965439+0000","last_fullsized":"2023-07-27T20:31:34.965439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:29:57.010683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160099+0000","last_change":"2023-07-27T20:31:33.175158+0000","last_active":"2023-07-27T20:31:34.160099+0000","last_peered":"2023-07-27T20:31:34.160099+0000","last_clean":"2023-07-27T20:31:34.160099+0000","last_became_active":"2023-07-27T20:31:33.174727+0000","last_became_peered":"2023-07-27T20:31:33.174727+0000","last_unstale":"2023-07-27T20:31:34.160099+0000","last_undegraded":"2023-07-27T20:31:34.160099+0000","last_fullsized":"2023-07-27T20:31:34.160099+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:46:48.142348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963380+0000","last_change":"2023-07-27T20:31:22.847766+0000","last_active":"2023-07-27T20:31:34.963380+0000","last_peered":"2023-07-27T20:31:34.963380+0000","last_clean":"2023-07-27T20:31:34.963380+0000","last_became_active":"2023-07-27T20:31:22.847396+0000","last_became_peered":"2023-07-27T20:31:22.847396+0000","last_unstale":"2023-07-27T20:31:34.963380+0000","last_undegraded":"2023-07-27T20:31:34.963380+0000","last_fullsized":"2023-07-27T20:31:34.963380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:24:50.913525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":181,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159241+0000","last_change":"2023-07-27T20:31:15.812727+0000","last_active":"2023-07-27T20:31:34.159241+0000","last_peered":"2023-07-27T20:31:34.159241+0000","last_clean":"2023-07-27T20:31:34.159241+0000","last_became_active":"2023-07-27T20:31:15.811803+0000","last_became_peered":"2023-07-27T20:31:15.811803+0000","last_unstale":"2023-07-27T20:31:34.159241+0000","last_undegraded":"2023-07-27T20:31:34.159241+0000","last_fullsized":"2023-07-27T20:31:34.159241+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:14.789257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:14.789257+0000","last_clean_scrub_stamp":"2023-07-27T20:31:14.789257+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:13:28.096429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963324+0000","last_change":"2023-07-27T20:31:28.128776+0000","last_active":"2023-07-27T20:31:34.963324+0000","last_peered":"2023-07-27T20:31:34.963324+0000","last_clean":"2023-07-27T20:31:34.963324+0000","last_became_active":"2023-07-27T20:31:28.128519+0000","last_became_peered":"2023-07-27T20:31:28.128519+0000","last_unstale":"2023-07-27T20:31:34.963324+0000","last_undegraded":"2023-07-27T20:31:34.963324+0000","last_fullsized":"2023-07-27T20:31:34.963324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:02:56.272252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963298+0000","last_change":"2023-07-27T20:31:29.144327+0000","last_active":"2023-07-27T20:31:34.963298+0000","last_peered":"2023-07-27T20:31:34.963298+0000","last_clean":"2023-07-27T20:31:34.963298+0000","last_became_active":"2023-07-27T20:31:29.143987+0000","last_became_peered":"2023-07-27T20:31:29.143987+0000","last_unstale":"2023-07-27T20:31:34.963298+0000","last_undegraded":"2023-07-27T20:31:34.963298+0000","last_fullsized":"2023-07-27T20:31:34.963298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:09:04.213951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963855+0000","last_change":"2023-07-27T20:31:33.185843+0000","last_active":"2023-07-27T20:31:34.963855+0000","last_peered":"2023-07-27T20:31:34.963855+0000","last_clean":"2023-07-27T20:31:34.963855+0000","last_became_active":"2023-07-27T20:31:33.185433+0000","last_became_peered":"2023-07-27T20:31:33.185433+0000","last_unstale":"2023-07-27T20:31:34.963855+0000","last_undegraded":"2023-07-27T20:31:34.963855+0000","last_fullsized":"2023-07-27T20:31:34.963855+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:32:44.428479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159531+0000","last_change":"2023-07-27T20:31:22.848181+0000","last_active":"2023-07-27T20:31:34.159531+0000","last_peered":"2023-07-27T20:31:34.159531+0000","last_clean":"2023-07-27T20:31:34.159531+0000","last_became_active":"2023-07-27T20:31:22.847865+0000","last_became_peered":"2023-07-27T20:31:22.847865+0000","last_unstale":"2023-07-27T20:31:34.159531+0000","last_undegraded":"2023-07-27T20:31:34.159531+0000","last_fullsized":"2023-07-27T20:31:34.159531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:48:04.598381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157019+0000","last_change":"2023-07-27T20:31:28.126023+0000","last_active":"2023-07-27T20:31:34.157019+0000","last_peered":"2023-07-27T20:31:34.157019+0000","last_clean":"2023-07-27T20:31:34.157019+0000","last_became_active":"2023-07-27T20:31:28.125763+0000","last_became_peered":"2023-07-27T20:31:28.125763+0000","last_unstale":"2023-07-27T20:31:34.157019+0000","last_undegraded":"2023-07-27T20:31:34.157019+0000","last_fullsized":"2023-07-27T20:31:34.157019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:11:16.759020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157525+0000","last_change":"2023-07-27T20:31:29.134648+0000","last_active":"2023-07-27T20:31:34.157525+0000","last_peered":"2023-07-27T20:31:34.157525+0000","last_clean":"2023-07-27T20:31:34.157525+0000","last_became_active":"2023-07-27T20:31:29.133686+0000","last_became_peered":"2023-07-27T20:31:29.133686+0000","last_unstale":"2023-07-27T20:31:34.157525+0000","last_undegraded":"2023-07-27T20:31:34.157525+0000","last_fullsized":"2023-07-27T20:31:34.157525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:46:44.091855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963906+0000","last_change":"2023-07-27T20:31:33.173136+0000","last_active":"2023-07-27T20:31:34.963906+0000","last_peered":"2023-07-27T20:31:34.963906+0000","last_clean":"2023-07-27T20:31:34.963906+0000","last_became_active":"2023-07-27T20:31:33.171872+0000","last_became_peered":"2023-07-27T20:31:33.171872+0000","last_unstale":"2023-07-27T20:31:34.963906+0000","last_undegraded":"2023-07-27T20:31:34.963906+0000","last_fullsized":"2023-07-27T20:31:34.963906+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:54:08.677930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.160575+0000","last_change":"2023-07-27T20:31:22.848025+0000","last_active":"2023-07-27T20:31:34.160575+0000","last_peered":"2023-07-27T20:31:34.160575+0000","last_clean":"2023-07-27T20:31:34.160575+0000","last_became_active":"2023-07-27T20:31:22.847603+0000","last_became_peered":"2023-07-27T20:31:22.847603+0000","last_unstale":"2023-07-27T20:31:34.160575+0000","last_undegraded":"2023-07-27T20:31:34.160575+0000","last_fullsized":"2023-07-27T20:31:34.160575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:30:03.402215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964111+0000","last_change":"2023-07-27T20:31:28.113523+0000","last_active":"2023-07-27T20:31:34.964111+0000","last_peered":"2023-07-27T20:31:34.964111+0000","last_clean":"2023-07-27T20:31:34.964111+0000","last_became_active":"2023-07-27T20:31:28.113279+0000","last_became_peered":"2023-07-27T20:31:28.113279+0000","last_unstale":"2023-07-27T20:31:34.964111+0000","last_undegraded":"2023-07-27T20:31:34.964111+0000","last_fullsized":"2023-07-27T20:31:34.964111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:11:16.759020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158082+0000","last_change":"2023-07-27T20:31:29.142859+0000","last_active":"2023-07-27T20:31:34.158082+0000","last_peered":"2023-07-27T20:31:34.158082+0000","last_clean":"2023-07-27T20:31:34.158082+0000","last_became_active":"2023-07-27T20:31:29.142567+0000","last_became_peered":"2023-07-27T20:31:29.142567+0000","last_unstale":"2023-07-27T20:31:34.158082+0000","last_undegraded":"2023-07-27T20:31:34.158082+0000","last_fullsized":"2023-07-27T20:31:34.158082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:17:03.497602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159475+0000","last_change":"2023-07-27T20:31:33.178764+0000","last_active":"2023-07-27T20:31:34.159475+0000","last_peered":"2023-07-27T20:31:34.159475+0000","last_clean":"2023-07-27T20:31:34.159475+0000","last_became_active":"2023-07-27T20:31:33.178284+0000","last_became_peered":"2023-07-27T20:31:33.178284+0000","last_unstale":"2023-07-27T20:31:34.159475+0000","last_undegraded":"2023-07-27T20:31:34.159475+0000","last_fullsized":"2023-07-27T20:31:34.159475+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:37:30.584016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965462+0000","last_change":"2023-07-27T20:31:28.120924+0000","last_active":"2023-07-27T20:31:34.965462+0000","last_peered":"2023-07-27T20:31:34.965462+0000","last_clean":"2023-07-27T20:31:34.965462+0000","last_became_active":"2023-07-27T20:31:28.120646+0000","last_became_peered":"2023-07-27T20:31:28.120646+0000","last_unstale":"2023-07-27T20:31:34.965462+0000","last_undegraded":"2023-07-27T20:31:34.965462+0000","last_fullsized":"2023-07-27T20:31:34.965462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:53:34.775079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963414+0000","last_change":"2023-07-27T20:31:22.845641+0000","last_active":"2023-07-27T20:31:34.963414+0000","last_peered":"2023-07-27T20:31:34.963414+0000","last_clean":"2023-07-27T20:31:34.963414+0000","last_became_active":"2023-07-27T20:31:22.845368+0000","last_became_peered":"2023-07-27T20:31:22.845368+0000","last_unstale":"2023-07-27T20:31:34.963414+0000","last_undegraded":"2023-07-27T20:31:34.963414+0000","last_fullsized":"2023-07-27T20:31:34.963414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:22:43.198616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965145+0000","last_change":"2023-07-27T20:31:29.144935+0000","last_active":"2023-07-27T20:31:34.965145+0000","last_peered":"2023-07-27T20:31:34.965145+0000","last_clean":"2023-07-27T20:31:34.965145+0000","last_became_active":"2023-07-27T20:31:29.144500+0000","last_became_peered":"2023-07-27T20:31:29.144500+0000","last_unstale":"2023-07-27T20:31:34.965145+0000","last_undegraded":"2023-07-27T20:31:34.965145+0000","last_fullsized":"2023-07-27T20:31:34.965145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:43:50.810308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964904+0000","last_change":"2023-07-27T20:31:33.178800+0000","last_active":"2023-07-27T20:31:34.964904+0000","last_peered":"2023-07-27T20:31:34.964904+0000","last_clean":"2023-07-27T20:31:34.964904+0000","last_became_active":"2023-07-27T20:31:33.178392+0000","last_became_peered":"2023-07-27T20:31:33.178392+0000","last_unstale":"2023-07-27T20:31:34.964904+0000","last_undegraded":"2023-07-27T20:31:34.964904+0000","last_fullsized":"2023-07-27T20:31:34.964904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:43:14.963398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963516+0000","last_change":"2023-07-27T20:31:22.846540+0000","last_active":"2023-07-27T20:31:34.963516+0000","last_peered":"2023-07-27T20:31:34.963516+0000","last_clean":"2023-07-27T20:31:34.963516+0000","last_became_active":"2023-07-27T20:31:22.846128+0000","last_became_peered":"2023-07-27T20:31:22.846128+0000","last_unstale":"2023-07-27T20:31:34.963516+0000","last_undegraded":"2023-07-27T20:31:34.963516+0000","last_fullsized":"2023-07-27T20:31:34.963516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:43:06.660613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157642+0000","last_change":"2023-07-27T20:31:28.113438+0000","last_active":"2023-07-27T20:31:34.157642+0000","last_peered":"2023-07-27T20:31:34.157642+0000","last_clean":"2023-07-27T20:31:34.157642+0000","last_became_active":"2023-07-27T20:31:28.113146+0000","last_became_peered":"2023-07-27T20:31:28.113146+0000","last_unstale":"2023-07-27T20:31:34.157642+0000","last_undegraded":"2023-07-27T20:31:34.157642+0000","last_fullsized":"2023-07-27T20:31:34.157642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:04:21.752471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159254+0000","last_change":"2023-07-27T20:31:29.141507+0000","last_active":"2023-07-27T20:31:34.159254+0000","last_peered":"2023-07-27T20:31:34.159254+0000","last_clean":"2023-07-27T20:31:34.159254+0000","last_became_active":"2023-07-27T20:31:29.141217+0000","last_became_peered":"2023-07-27T20:31:29.141217+0000","last_unstale":"2023-07-27T20:31:34.159254+0000","last_undegraded":"2023-07-27T20:31:34.159254+0000","last_fullsized":"2023-07-27T20:31:34.159254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:07:23.817773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963812+0000","last_change":"2023-07-27T20:31:33.184984+0000","last_active":"2023-07-27T20:31:34.963812+0000","last_peered":"2023-07-27T20:31:34.963812+0000","last_clean":"2023-07-27T20:31:34.963812+0000","last_became_active":"2023-07-27T20:31:33.184413+0000","last_became_peered":"2023-07-27T20:31:33.184413+0000","last_unstale":"2023-07-27T20:31:34.963812+0000","last_undegraded":"2023-07-27T20:31:34.963812+0000","last_fullsized":"2023-07-27T20:31:34.963812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:03:20.666196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.157892+0000","last_change":"2023-07-27T20:31:28.122480+0000","last_active":"2023-07-27T20:31:34.157892+0000","last_peered":"2023-07-27T20:31:34.157892+0000","last_clean":"2023-07-27T20:31:34.157892+0000","last_became_active":"2023-07-27T20:31:28.121841+0000","last_became_peered":"2023-07-27T20:31:28.121841+0000","last_unstale":"2023-07-27T20:31:34.157892+0000","last_undegraded":"2023-07-27T20:31:34.157892+0000","last_fullsized":"2023-07-27T20:31:34.157892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:01:29.799303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963780+0000","last_change":"2023-07-27T20:31:29.129723+0000","last_active":"2023-07-27T20:31:34.963780+0000","last_peered":"2023-07-27T20:31:34.963780+0000","last_clean":"2023-07-27T20:31:34.963780+0000","last_became_active":"2023-07-27T20:31:29.129256+0000","last_became_peered":"2023-07-27T20:31:29.129256+0000","last_unstale":"2023-07-27T20:31:34.963780+0000","last_undegraded":"2023-07-27T20:31:34.963780+0000","last_fullsized":"2023-07-27T20:31:34.963780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:40:12.799013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159801+0000","last_change":"2023-07-27T20:31:33.182234+0000","last_active":"2023-07-27T20:31:34.159801+0000","last_peered":"2023-07-27T20:31:34.159801+0000","last_clean":"2023-07-27T20:31:34.159801+0000","last_became_active":"2023-07-27T20:31:33.181660+0000","last_became_peered":"2023-07-27T20:31:33.181660+0000","last_unstale":"2023-07-27T20:31:34.159801+0000","last_undegraded":"2023-07-27T20:31:34.159801+0000","last_fullsized":"2023-07-27T20:31:34.159801+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:11:21.816247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963312+0000","last_change":"2023-07-27T20:31:28.127766+0000","last_active":"2023-07-27T20:31:34.963312+0000","last_peered":"2023-07-27T20:31:34.963312+0000","last_clean":"2023-07-27T20:31:34.963312+0000","last_became_active":"2023-07-27T20:31:28.127414+0000","last_became_peered":"2023-07-27T20:31:28.127414+0000","last_unstale":"2023-07-27T20:31:34.963312+0000","last_undegraded":"2023-07-27T20:31:34.963312+0000","last_fullsized":"2023-07-27T20:31:34.963312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:03:15.608969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159150+0000","last_change":"2023-07-27T20:31:29.129596+0000","last_active":"2023-07-27T20:31:34.159150+0000","last_peered":"2023-07-27T20:31:34.159150+0000","last_clean":"2023-07-27T20:31:34.159150+0000","last_became_active":"2023-07-27T20:31:29.129291+0000","last_became_peered":"2023-07-27T20:31:29.129291+0000","last_unstale":"2023-07-27T20:31:34.159150+0000","last_undegraded":"2023-07-27T20:31:34.159150+0000","last_fullsized":"2023-07-27T20:31:34.159150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:27:22.233669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963655+0000","last_change":"2023-07-27T20:31:33.178602+0000","last_active":"2023-07-27T20:31:34.963655+0000","last_peered":"2023-07-27T20:31:34.963655+0000","last_clean":"2023-07-27T20:31:34.963655+0000","last_became_active":"2023-07-27T20:31:33.178225+0000","last_became_peered":"2023-07-27T20:31:33.178225+0000","last_unstale":"2023-07-27T20:31:34.963655+0000","last_undegraded":"2023-07-27T20:31:34.963655+0000","last_fullsized":"2023-07-27T20:31:34.963655+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:46:48.142348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963262+0000","last_change":"2023-07-27T20:31:28.127934+0000","last_active":"2023-07-27T20:31:34.963262+0000","last_peered":"2023-07-27T20:31:34.963262+0000","last_clean":"2023-07-27T20:31:34.963262+0000","last_became_active":"2023-07-27T20:31:28.127614+0000","last_became_peered":"2023-07-27T20:31:28.127614+0000","last_unstale":"2023-07-27T20:31:34.963262+0000","last_undegraded":"2023-07-27T20:31:34.963262+0000","last_fullsized":"2023-07-27T20:31:34.963262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:59:02.266953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158703+0000","last_change":"2023-07-27T20:31:29.129192+0000","last_active":"2023-07-27T20:31:34.158703+0000","last_peered":"2023-07-27T20:31:34.158703+0000","last_clean":"2023-07-27T20:31:34.158703+0000","last_became_active":"2023-07-27T20:31:29.128942+0000","last_became_peered":"2023-07-27T20:31:29.128942+0000","last_unstale":"2023-07-27T20:31:34.158703+0000","last_undegraded":"2023-07-27T20:31:34.158703+0000","last_fullsized":"2023-07-27T20:31:34.158703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:47:04.874275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158302+0000","last_change":"2023-07-27T20:31:33.181755+0000","last_active":"2023-07-27T20:31:34.158302+0000","last_peered":"2023-07-27T20:31:34.158302+0000","last_clean":"2023-07-27T20:31:34.158302+0000","last_became_active":"2023-07-27T20:31:33.181272+0000","last_became_peered":"2023-07-27T20:31:33.181272+0000","last_unstale":"2023-07-27T20:31:34.158302+0000","last_undegraded":"2023-07-27T20:31:34.158302+0000","last_fullsized":"2023-07-27T20:31:34.158302+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:17:29.545484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964561+0000","last_change":"2023-07-27T20:31:28.120798+0000","last_active":"2023-07-27T20:31:34.964561+0000","last_peered":"2023-07-27T20:31:34.964561+0000","last_clean":"2023-07-27T20:31:34.964561+0000","last_became_active":"2023-07-27T20:31:28.120445+0000","last_became_peered":"2023-07-27T20:31:28.120445+0000","last_unstale":"2023-07-27T20:31:34.964561+0000","last_undegraded":"2023-07-27T20:31:34.964561+0000","last_fullsized":"2023-07-27T20:31:34.964561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:04:19.045494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.964977+0000","last_change":"2023-07-27T20:31:29.133577+0000","last_active":"2023-07-27T20:31:34.964977+0000","last_peered":"2023-07-27T20:31:34.964977+0000","last_clean":"2023-07-27T20:31:34.964977+0000","last_became_active":"2023-07-27T20:31:29.133170+0000","last_became_peered":"2023-07-27T20:31:29.133170+0000","last_unstale":"2023-07-27T20:31:34.964977+0000","last_undegraded":"2023-07-27T20:31:34.964977+0000","last_fullsized":"2023-07-27T20:31:34.964977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:58:10.754493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963156+0000","last_change":"2023-07-27T20:31:33.185023+0000","last_active":"2023-07-27T20:31:34.963156+0000","last_peered":"2023-07-27T20:31:34.963156+0000","last_clean":"2023-07-27T20:31:34.963156+0000","last_became_active":"2023-07-27T20:31:33.184664+0000","last_became_peered":"2023-07-27T20:31:33.184664+0000","last_unstale":"2023-07-27T20:31:34.963156+0000","last_undegraded":"2023-07-27T20:31:34.963156+0000","last_fullsized":"2023-07-27T20:31:34.963156+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:32.140800+0000","last_clean_scrub_stamp":"2023-07-27T20:31:32.140800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:31:22.782985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158280+0000","last_change":"2023-07-27T20:31:28.130218+0000","last_active":"2023-07-27T20:31:34.158280+0000","last_peered":"2023-07-27T20:31:34.158280+0000","last_clean":"2023-07-27T20:31:34.158280+0000","last_became_active":"2023-07-27T20:31:28.129985+0000","last_became_peered":"2023-07-27T20:31:28.129985+0000","last_unstale":"2023-07-27T20:31:34.158280+0000","last_undegraded":"2023-07-27T20:31:34.158280+0000","last_fullsized":"2023-07-27T20:31:34.158280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:27.083573+0000","last_clean_scrub_stamp":"2023-07-27T20:31:27.083573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:23:29.174787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.158489+0000","last_change":"2023-07-27T20:31:29.134396+0000","last_active":"2023-07-27T20:31:34.158489+0000","last_peered":"2023-07-27T20:31:34.158489+0000","last_clean":"2023-07-27T20:31:34.158489+0000","last_became_active":"2023-07-27T20:31:29.134100+0000","last_became_peered":"2023-07-27T20:31:29.134100+0000","last_unstale":"2023-07-27T20:31:34.158489+0000","last_undegraded":"2023-07-27T20:31:34.158489+0000","last_fullsized":"2023-07-27T20:31:34.158489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:53:35.781814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963026+0000","last_change":"2023-07-27T20:31:29.131991+0000","last_active":"2023-07-27T20:31:34.963026+0000","last_peered":"2023-07-27T20:31:34.963026+0000","last_clean":"2023-07-27T20:31:34.963026+0000","last_became_active":"2023-07-27T20:31:29.131669+0000","last_became_peered":"2023-07-27T20:31:29.131669+0000","last_unstale":"2023-07-27T20:31:34.963026+0000","last_undegraded":"2023-07-27T20:31:34.963026+0000","last_fullsized":"2023-07-27T20:31:34.963026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:57:21.999388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.965148+0000","last_change":"2023-07-27T20:31:29.130808+0000","last_active":"2023-07-27T20:31:34.965148+0000","last_peered":"2023-07-27T20:31:34.965148+0000","last_clean":"2023-07-27T20:31:34.965148+0000","last_became_active":"2023-07-27T20:31:29.130489+0000","last_became_peered":"2023-07-27T20:31:29.130489+0000","last_unstale":"2023-07-27T20:31:34.965148+0000","last_undegraded":"2023-07-27T20:31:34.965148+0000","last_fullsized":"2023-07-27T20:31:34.965148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:58:01.396658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.159103+0000","last_change":"2023-07-27T20:31:29.135952+0000","last_active":"2023-07-27T20:31:34.159103+0000","last_peered":"2023-07-27T20:31:34.159103+0000","last_clean":"2023-07-27T20:31:34.159103+0000","last_became_active":"2023-07-27T20:31:29.135040+0000","last_became_peered":"2023-07-27T20:31:29.135040+0000","last_unstale":"2023-07-27T20:31:34.159103+0000","last_undegraded":"2023-07-27T20:31:34.159103+0000","last_fullsized":"2023-07-27T20:31:34.159103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:41:09.372503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963458+0000","last_change":"2023-07-27T20:31:29.148526+0000","last_active":"2023-07-27T20:31:34.963458+0000","last_peered":"2023-07-27T20:31:34.963458+0000","last_clean":"2023-07-27T20:31:34.963458+0000","last_became_active":"2023-07-27T20:31:29.148256+0000","last_became_peered":"2023-07-27T20:31:29.148256+0000","last_unstale":"2023-07-27T20:31:34.963458+0000","last_undegraded":"2023-07-27T20:31:34.963458+0000","last_fullsized":"2023-07-27T20:31:34.963458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:38:08.459694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-27T20:31:34.963994+0000","last_change":"2023-07-27T20:31:29.129400+0000","last_active":"2023-07-27T20:31:34.963994+0000","last_peered":"2023-07-27T20:31:34.963994+0000","last_clean":"2023-07-27T20:31:34.963994+0000","last_became_active":"2023-07-27T20:31:29.129138+0000","last_became_peered":"2023-07-27T20:31:29.129138+0000","last_unstale":"2023-07-27T20:31:34.963994+0000","last_undegraded":"2023-07-27T20:31:34.963994+0000","last_fullsized":"2023-07-27T20:31:34.963994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:28.090307+0000","last_clean_scrub_stamp":"2023-07-27T20:31:28.090307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:24:57.182748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":913408,"data_stored":714279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]}]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":888832,"data_stored":710851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":294912,"data_stored":119991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":123751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":120553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T20:31:58.813 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-27T20:31:58.813 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-07-27T20:31:58.813 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-07-27T20:31:58.814 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-07-27T20:31:59.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.052+0000 7f52c1bff700 1 Processor -- start 2023-07-27T20:31:59.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.052+0000 7f52c1bff700 1 -- start start 2023-07-27T20:31:59.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.054+0000 7f52c1bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f52bc14e120 0x7f52bc150c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:59.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.054+0000 7f52c1bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f52bc0713c0 0x7f52bc06d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:59.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.054+0000 7f52c1bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52bc0718e0 con 0x7f52bc06d740 2023-07-27T20:31:59.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.054+0000 7f52c1bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52bc071bc0 con 0x7f52bc0713c0 2023-07-27T20:31:59.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.054+0000 7f52c1bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc071ea0 con 0x7f52bc14e120 2023-07-27T20:31:59.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.054+0000 7f52b3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f52bc0713c0 0x7f52bc06d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:59.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.054+0000 7f52b3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f52bc0713c0 0x7f52bc06d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58824/0 (socket says 172.21.15.72:58824) 2023-07-27T20:31:59.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.054+0000 7f52b3fff700 1 -- 172.21.15.72:0/1852626198 learned_addr learned my addr 172.21.15.72:0/1852626198 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:59.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.054+0000 7f52bbfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f52bc06d740 0x7f52bc0c02e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55526/0 (socket says 172.21.15.72:55526) 2023-07-27T20:31:59.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.054+0000 7f52bb7fe700 1 --2- 172.21.15.72:0/1852626198 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f52bc14e120 0x7f52bc150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:59.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.054+0000 7f52b3fff700 1 -- 172.21.15.72:0/1852626198 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f52bc14e120 msgr2=0x7f52bc150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:59.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.054+0000 7f52b3fff700 1 --2- 172.21.15.72:0/1852626198 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f52bc14e120 0x7f52bc150c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:59.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.054+0000 7f52baffd700 1 -- 172.21.15.72:0/1852626198 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3101155508 0 0) 0x7f52bc0718e0 con 0x7f52bc06d740 2023-07-27T20:31:59.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.054+0000 7f52b3fff700 1 -- 172.21.15.72:0/1852626198 >> v1:172.21.15.72:6789/0 conn(0x7f52bc06d740 legacy=0x7f52bc0c02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:59.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.054+0000 7f52b3fff700 1 -- 172.21.15.72:0/1852626198 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52bc072180 con 0x7f52bc0713c0 2023-07-27T20:31:59.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.055+0000 7f52b3fff700 1 --2- 172.21.15.72:0/1852626198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52bc0713c0 0x7f52bc06d200 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f52a40098f0 tx=0x7f52a4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f549d37b2e9321f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:59.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.055+0000 7f52baffd700 1 -- 172.21.15.72:0/1852626198 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a400f8a0 con 0x7f52bc0713c0 2023-07-27T20:31:59.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.055+0000 7f52baffd700 1 -- 172.21.15.72:0/1852626198 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a400fa00 con 0x7f52bc0713c0 2023-07-27T20:31:59.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.055+0000 7f52baffd700 1 -- 172.21.15.72:0/1852626198 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a400fd90 con 0x7f52bc0713c0 2023-07-27T20:31:59.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.055+0000 7f52c1bff700 1 -- 172.21.15.72:0/1852626198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52bc0713c0 msgr2=0x7f52bc06d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:59.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.055+0000 7f52c1bff700 1 --2- 172.21.15.72:0/1852626198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52bc0713c0 0x7f52bc06d200 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f52a40098f0 tx=0x7f52a4009c00 comp rx=0 tx=0).stop 2023-07-27T20:31:59.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.056+0000 7f52c1bff700 1 -- 172.21.15.72:0/1852626198 shutdown_connections 2023-07-27T20:31:59.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.056+0000 7f52c1bff700 1 --2- 172.21.15.72:0/1852626198 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f52bc14e120 0x7f52bc150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:59.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.056+0000 7f52c1bff700 1 --2- 172.21.15.72:0/1852626198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52bc0713c0 0x7f52bc06d200 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:59.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.056+0000 7f52c1bff700 1 -- 172.21.15.72:0/1852626198 >> 172.21.15.72:0/1852626198 conn(0x7f52bc0a7b40 msgr2=0x7f52bc06a190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:59.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.056+0000 7f52c1bff700 1 -- 172.21.15.72:0/1852626198 shutdown_connections 2023-07-27T20:31:59.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.056+0000 7f52c1bff700 1 -- 172.21.15.72:0/1852626198 wait complete. 2023-07-27T20:31:59.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.057+0000 7f52c1bff700 1 Processor -- start 2023-07-27T20:31:59.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.057+0000 7f52c1bff700 1 -- start start 2023-07-27T20:31:59.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.058+0000 7f52c1bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52bc06d740 0x7f52bc153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:59.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.058+0000 7f52c1bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f52bc0713c0 0x7f52bc150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:59.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.058+0000 7f52c1bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52bc14e120 0x7f52bc147180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:59.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.058+0000 7f52c1bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc0c60a0 con 0x7f52bc06d740 2023-07-27T20:31:59.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.058+0000 7f52c1bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc1e6f20 con 0x7f52bc14e120 2023-07-27T20:31:59.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.058+0000 7f52c1bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc1ed640 con 0x7f52bc0713c0 2023-07-27T20:31:59.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.059+0000 7f52bb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52bc06d740 0x7f52bc153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:59.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.059+0000 7f52bb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52bc06d740 0x7f52bc153f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58838/0 (socket says 172.21.15.72:58838) 2023-07-27T20:31:59.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.059+0000 7f52bb7fe700 1 -- 172.21.15.72:0/4107426681 learned_addr learned my addr 172.21.15.72:0/4107426681 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:59.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.059+0000 7f52bb7fe700 1 -- 172.21.15.72:0/4107426681 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f52bc0713c0 msgr2=0x7f52bc150ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:59.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.059+0000 7f52bb7fe700 1 --2- 172.21.15.72:0/4107426681 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f52bc0713c0 0x7f52bc150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:59.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.059+0000 7f52bb7fe700 1 -- 172.21.15.72:0/4107426681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52bc14e120 msgr2=0x7f52bc147180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:59.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.059+0000 7f52bb7fe700 1 --2- 172.21.15.72:0/4107426681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52bc14e120 0x7f52bc147180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:59.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.059+0000 7f52bb7fe700 1 -- 172.21.15.72:0/4107426681 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a4009550 con 0x7f52bc06d740 2023-07-27T20:31:59.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.059+0000 7f52bb7fe700 1 --2- 172.21.15.72:0/4107426681 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52bc06d740 0x7f52bc153f20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f52ac00e8a0 tx=0x7f52ac00ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:59.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.059+0000 7f52b8ff9700 1 -- 172.21.15.72:0/4107426681 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ac009590 con 0x7f52bc06d740 2023-07-27T20:31:59.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.059+0000 7f52b8ff9700 1 -- 172.21.15.72:0/4107426681 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ac00eea0 con 0x7f52bc06d740 2023-07-27T20:31:59.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.059+0000 7f52c1bff700 1 -- 172.21.15.72:0/4107426681 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52bc1ed920 con 0x7f52bc06d740 2023-07-27T20:31:59.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.059+0000 7f52b8ff9700 1 -- 172.21.15.72:0/4107426681 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ac00c9f0 con 0x7f52bc06d740 2023-07-27T20:31:59.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.060+0000 7f52c1bff700 1 -- 172.21.15.72:0/4107426681 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52bc1ead10 con 0x7f52bc06d740 2023-07-27T20:31:59.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.061+0000 7f52c1bff700 1 -- 172.21.15.72:0/4107426681 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52bc04e470 con 0x7f52bc06d740 2023-07-27T20:31:59.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.061+0000 7f52b8ff9700 1 -- 172.21.15.72:0/4107426681 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f52ac00cb50 con 0x7f52bc06d740 2023-07-27T20:31:59.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.062+0000 7f52b8ff9700 1 --2- 172.21.15.72:0/4107426681 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f529c06ace0 0x7f529c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:59.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.062+0000 7f52b8ff9700 1 -- 172.21.15.72:0/4107426681 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f52ac0897e0 con 0x7f52bc06d740 2023-07-27T20:31:59.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.063+0000 7f52b3fff700 1 --2- 172.21.15.72:0/4107426681 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f529c06ace0 0x7f529c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:59.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.063+0000 7f52b3fff700 1 --2- 172.21.15.72:0/4107426681 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f529c06ace0 0x7f529c06d1a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f52bc0c6530 tx=0x7f52a4012000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:59.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.067+0000 7f52b8ff9700 1 -- 172.21.15.72:0/4107426681 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f52ac057f00 con 0x7f52bc06d740 2023-07-27T20:31:59.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.303+0000 7f52c1bff700 1 -- 172.21.15.72:0/4107426681 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f52bc0bacf0 con 0x7f52bc06d740 2023-07-27T20:31:59.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.303+0000 7f52b8ff9700 1 -- 172.21.15.72:0/4107426681 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f52ac057a90 con 0x7f52bc06d740 2023-07-27T20:31:59.291 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:31:59.291 INFO:teuthology.orchestra.run.smithi072.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-07-27T20:31:59.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.306+0000 7f52c1bff700 1 -- 172.21.15.72:0/4107426681 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f529c06ace0 msgr2=0x7f529c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:59.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.306+0000 7f52c1bff700 1 --2- 172.21.15.72:0/4107426681 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f529c06ace0 0x7f529c06d1a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f52bc0c6530 tx=0x7f52a4012000 comp rx=0 tx=0).stop 2023-07-27T20:31:59.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.306+0000 7f52c1bff700 1 -- 172.21.15.72:0/4107426681 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52bc06d740 msgr2=0x7f52bc153f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:59.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.306+0000 7f52c1bff700 1 --2- 172.21.15.72:0/4107426681 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52bc06d740 0x7f52bc153f20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f52ac00e8a0 tx=0x7f52ac00ec60 comp rx=0 tx=0).stop 2023-07-27T20:31:59.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.306+0000 7f52c1bff700 1 -- 172.21.15.72:0/4107426681 shutdown_connections 2023-07-27T20:31:59.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.306+0000 7f52c1bff700 1 --2- 172.21.15.72:0/4107426681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52bc14e120 0x7f52bc147180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:59.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.306+0000 7f52c1bff700 1 --2- 172.21.15.72:0/4107426681 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52bc06d740 0x7f52bc153f20 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:59.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.306+0000 7f52c1bff700 1 --2- 172.21.15.72:0/4107426681 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f529c06ace0 0x7f529c06d1a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:59.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.306+0000 7f52c1bff700 1 --2- 172.21.15.72:0/4107426681 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f52bc0713c0 0x7f52bc150ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:59.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.306+0000 7f52c1bff700 1 -- 172.21.15.72:0/4107426681 >> 172.21.15.72:0/4107426681 conn(0x7f52bc0a7b40 msgr2=0x7f52bc0bb210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:59.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.306+0000 7f52c1bff700 1 -- 172.21.15.72:0/4107426681 shutdown_connections 2023-07-27T20:31:59.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.306+0000 7f52c1bff700 1 -- 172.21.15.72:0/4107426681 wait complete. 2023-07-27T20:31:59.312 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-07-27T20:31:59.313 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:31:59.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.521+0000 7fca5bdff700 1 Processor -- start 2023-07-27T20:31:59.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.521+0000 7fca5bdff700 1 -- start start 2023-07-27T20:31:59.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.522+0000 7fca5bdff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fca5413b2c0 0x7fca540aa420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:59.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.522+0000 7fca5bdff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fca540a83a0 0x7fca540a8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:59.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.522+0000 7fca5bdff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca54155600 con 0x7fca540bfd90 2023-07-27T20:31:59.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.522+0000 7fca5bdff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca540a9620 con 0x7fca540a83a0 2023-07-27T20:31:59.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.522+0000 7fca5bdff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca54155320 con 0x7fca5413b2c0 2023-07-27T20:31:59.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.522+0000 7fca5939a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fca540bfd90 0x7fca540aa960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55536/0 (socket says 172.21.15.72:55536) 2023-07-27T20:31:59.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.522+0000 7fca5939a700 1 -- 172.21.15.72:0/3758899929 learned_addr learned my addr 172.21.15.72:0/3758899929 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:59.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.522+0000 7fca5a39c700 1 --2- 172.21.15.72:0/3758899929 >> v2:172.21.15.72:3300/0 conn(0x7fca540a83a0 0x7fca540a8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:59.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.523+0000 7fca59b9b700 1 --2- 172.21.15.72:0/3758899929 >> v2:172.21.15.173:3300/0 conn(0x7fca5413b2c0 0x7fca540aa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:59.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.523+0000 7fca58b99700 1 -- 172.21.15.72:0/3758899929 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2480244143 0 0) 0x7fca54155600 con 0x7fca540bfd90 2023-07-27T20:31:59.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.523+0000 7fca5a39c700 1 -- 172.21.15.72:0/3758899929 >> v2:172.21.15.173:3300/0 conn(0x7fca5413b2c0 msgr2=0x7fca540aa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:31:59.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.523+0000 7fca5a39c700 1 --2- 172.21.15.72:0/3758899929 >> v2:172.21.15.173:3300/0 conn(0x7fca5413b2c0 0x7fca540aa420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:59.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.523+0000 7fca5a39c700 1 -- 172.21.15.72:0/3758899929 >> v1:172.21.15.72:6789/0 conn(0x7fca540bfd90 legacy=0x7fca540aa960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:59.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.523+0000 7fca5a39c700 1 -- 172.21.15.72:0/3758899929 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca54151e40 con 0x7fca540a83a0 2023-07-27T20:31:59.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.523+0000 7fca5a39c700 1 --2- 172.21.15.72:0/3758899929 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca540a83a0 0x7fca540a8810 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fca540c64a0 tx=0x7fca4c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e46e3276ebb0f633 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:59.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.523+0000 7fca58b99700 1 -- 172.21.15.72:0/3758899929 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4c00e070 con 0x7fca540a83a0 2023-07-27T20:31:59.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.523+0000 7fca58b99700 1 -- 172.21.15.72:0/3758899929 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4c00bbd0 con 0x7fca540a83a0 2023-07-27T20:31:59.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.523+0000 7fca58b99700 1 -- 172.21.15.72:0/3758899929 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4c012430 con 0x7fca540a83a0 2023-07-27T20:31:59.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.524+0000 7fca5bdff700 1 -- 172.21.15.72:0/3758899929 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca540a83a0 msgr2=0x7fca540a8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:59.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.524+0000 7fca5bdff700 1 --2- 172.21.15.72:0/3758899929 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca540a83a0 0x7fca540a8810 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fca540c64a0 tx=0x7fca4c00b330 comp rx=0 tx=0).stop 2023-07-27T20:31:59.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.524+0000 7fca5bdff700 1 -- 172.21.15.72:0/3758899929 shutdown_connections 2023-07-27T20:31:59.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.524+0000 7fca5bdff700 1 --2- 172.21.15.72:0/3758899929 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca540a83a0 0x7fca540a8810 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:59.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.524+0000 7fca5bdff700 1 --2- 172.21.15.72:0/3758899929 >> v2:172.21.15.173:3300/0 conn(0x7fca5413b2c0 0x7fca540aa420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:59.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.524+0000 7fca5bdff700 1 -- 172.21.15.72:0/3758899929 >> 172.21.15.72:0/3758899929 conn(0x7fca5406a190 msgr2=0x7fca5406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:59.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.524+0000 7fca5bdff700 1 -- 172.21.15.72:0/3758899929 shutdown_connections 2023-07-27T20:31:59.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.524+0000 7fca5bdff700 1 -- 172.21.15.72:0/3758899929 wait complete. 2023-07-27T20:31:59.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.526+0000 7fca5bdff700 1 Processor -- start 2023-07-27T20:31:59.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.526+0000 7fca5bdff700 1 -- start start 2023-07-27T20:31:59.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.527+0000 7fca5bdff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca540a83a0 0x7fca540c1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:59.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.527+0000 7fca5bdff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca540bfd90 0x7fca541e9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:59.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.527+0000 7fca5bdff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca5413b2c0 0x7fca541ea180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:59.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.527+0000 7fca5bdff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca541ea6c0 con 0x7fca540bfd90 2023-07-27T20:31:59.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.527+0000 7fca5bdff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca541deda0 con 0x7fca5413b2c0 2023-07-27T20:31:59.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.527+0000 7fca5bdff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca541e97b0 con 0x7fca540a83a0 2023-07-27T20:31:59.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.527+0000 7fca5939a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca540bfd90 0x7fca541e9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:59.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.527+0000 7fca5939a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca540bfd90 0x7fca541e9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58858/0 (socket says 172.21.15.72:58858) 2023-07-27T20:31:59.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.527+0000 7fca5939a700 1 -- 172.21.15.72:0/1469129124 learned_addr learned my addr 172.21.15.72:0/1469129124 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:59.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.527+0000 7fca5a39c700 1 --2- 172.21.15.72:0/1469129124 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca5413b2c0 0x7fca541ea180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:59.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.527+0000 7fca59b9b700 1 --2- 172.21.15.72:0/1469129124 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca540a83a0 0x7fca540c1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:59.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.527+0000 7fca5939a700 1 -- 172.21.15.72:0/1469129124 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca540a83a0 msgr2=0x7fca540c1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:59.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.527+0000 7fca5939a700 1 --2- 172.21.15.72:0/1469129124 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca540a83a0 0x7fca540c1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:59.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.527+0000 7fca5939a700 1 -- 172.21.15.72:0/1469129124 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca5413b2c0 msgr2=0x7fca541ea180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:59.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.527+0000 7fca5939a700 1 --2- 172.21.15.72:0/1469129124 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca5413b2c0 0x7fca541ea180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:59.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.527+0000 7fca5939a700 1 -- 172.21.15.72:0/1469129124 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca4c009a70 con 0x7fca540bfd90 2023-07-27T20:31:59.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.528+0000 7fca5939a700 1 --2- 172.21.15.72:0/1469129124 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca540bfd90 0x7fca541e9c40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fca4400c570 tx=0x7fca4400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:59.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.528+0000 7fca4a7fc700 1 -- 172.21.15.72:0/1469129124 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca44004c80 con 0x7fca540bfd90 2023-07-27T20:31:59.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.528+0000 7fca4a7fc700 1 -- 172.21.15.72:0/1469129124 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca44004de0 con 0x7fca540bfd90 2023-07-27T20:31:59.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.528+0000 7fca5bdff700 1 -- 172.21.15.72:0/1469129124 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca540bacc0 con 0x7fca540bfd90 2023-07-27T20:31:59.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.528+0000 7fca4a7fc700 1 -- 172.21.15.72:0/1469129124 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca44007310 con 0x7fca540bfd90 2023-07-27T20:31:59.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.528+0000 7fca5bdff700 1 -- 172.21.15.72:0/1469129124 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca540c2500 con 0x7fca540bfd90 2023-07-27T20:31:59.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.529+0000 7fca5bdff700 1 -- 172.21.15.72:0/1469129124 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca541e9960 con 0x7fca540bfd90 2023-07-27T20:31:59.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.530+0000 7fca4a7fc700 1 -- 172.21.15.72:0/1469129124 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fca44007470 con 0x7fca540bfd90 2023-07-27T20:31:59.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.531+0000 7fca4a7fc700 1 --2- 172.21.15.72:0/1469129124 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fca3806ace0 0x7fca3806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:59.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.531+0000 7fca4a7fc700 1 -- 172.21.15.72:0/1469129124 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fca44089350 con 0x7fca540bfd90 2023-07-27T20:31:59.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.532+0000 7fca59b9b700 1 --2- 172.21.15.72:0/1469129124 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fca3806ace0 0x7fca3806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:59.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.532+0000 7fca59b9b700 1 --2- 172.21.15.72:0/1469129124 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fca3806ace0 0x7fca3806d1a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fca50006b20 tx=0x7fca50008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:59.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.535+0000 7fca4a7fc700 1 -- 172.21.15.72:0/1469129124 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fca541e9960 con 0x7fca540bfd90 2023-07-27T20:31:59.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.731+0000 7fca5bdff700 1 -- 172.21.15.72:0/1469129124 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca541e9920 con 0x7fca540bfd90 2023-07-27T20:31:59.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.732+0000 7fca4a7fc700 1 -- 172.21.15.72:0/1469129124 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20120 (secure 0 0 0) 0x7fca44054260 con 0x7fca540bfd90 2023-07-27T20:31:59.720 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:31:59.721 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:31:33.647304+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:31:27.020951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T20:31:27.566022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-27T20:31:31.182401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:31:59.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.735+0000 7fca5bdff700 1 -- 172.21.15.72:0/1469129124 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fca3806ace0 msgr2=0x7fca3806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:59.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.735+0000 7fca5bdff700 1 --2- 172.21.15.72:0/1469129124 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fca3806ace0 0x7fca3806d1a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fca50006b20 tx=0x7fca50008040 comp rx=0 tx=0).stop 2023-07-27T20:31:59.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.735+0000 7fca5bdff700 1 -- 172.21.15.72:0/1469129124 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca540bfd90 msgr2=0x7fca541e9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:59.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.735+0000 7fca5bdff700 1 --2- 172.21.15.72:0/1469129124 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca540bfd90 0x7fca541e9c40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fca4400c570 tx=0x7fca4400c880 comp rx=0 tx=0).stop 2023-07-27T20:31:59.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.735+0000 7fca5bdff700 1 -- 172.21.15.72:0/1469129124 shutdown_connections 2023-07-27T20:31:59.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.735+0000 7fca5bdff700 1 --2- 172.21.15.72:0/1469129124 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca5413b2c0 0x7fca541ea180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:59.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.735+0000 7fca5bdff700 1 --2- 172.21.15.72:0/1469129124 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fca3806ace0 0x7fca3806d1a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:59.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.735+0000 7fca5bdff700 1 --2- 172.21.15.72:0/1469129124 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca540a83a0 0x7fca540c1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:59.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.735+0000 7fca5bdff700 1 --2- 172.21.15.72:0/1469129124 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca540bfd90 0x7fca541e9c40 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:59.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.735+0000 7fca5bdff700 1 -- 172.21.15.72:0/1469129124 >> 172.21.15.72:0/1469129124 conn(0x7fca5406a190 msgr2=0x7fca54155830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:59.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.735+0000 7fca5bdff700 1 -- 172.21.15.72:0/1469129124 shutdown_connections 2023-07-27T20:31:59.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.735+0000 7fca5bdff700 1 -- 172.21.15.72:0/1469129124 wait complete. 2023-07-27T20:31:59.741 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-27T20:31:14.581785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T20:31:21.077941+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T20:31:27.020951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T20:31:27.566022+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-27T20:31:31.182401+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-27T20:31:59.742 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-27T20:31:59.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.952+0000 7f1298dff700 1 Processor -- start 2023-07-27T20:31:59.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.952+0000 7f1298dff700 1 -- start start 2023-07-27T20:31:59.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.953+0000 7f1298dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1294158100 0x7f12940a8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:59.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.953+0000 7f1298dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1294158520 con 0x7f12940a86c0 2023-07-27T20:31:59.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.953+0000 7f1298dff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1294071700 con 0x7f1294071190 2023-07-27T20:31:59.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.953+0000 7f1298dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12940c3e30 con 0x7f1294158100 2023-07-27T20:31:59.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.953+0000 7f129259c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f12940a86c0 0x7f1294154a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52022/0 (socket says 172.21.15.72:52022) 2023-07-27T20:31:59.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.953+0000 7f129259c700 1 -- 172.21.15.72:0/2680031091 learned_addr learned my addr 172.21.15.72:0/2680031091 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:31:59.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.953+0000 7f1292d9d700 1 --2- 172.21.15.72:0/2680031091 >> v2:172.21.15.72:3300/0 conn(0x7f1294158100 0x7f12940a8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:59.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.954+0000 7f1291d9b700 1 -- 172.21.15.72:0/2680031091 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 356787367 0 0) 0x7f1294158520 con 0x7f12940a86c0 2023-07-27T20:31:59.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.954+0000 7f1291d9b700 1 -- 172.21.15.72:0/2680031091 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12800035b0 con 0x7f12940a86c0 2023-07-27T20:31:59.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.954+0000 7f1292d9d700 1 -- 172.21.15.72:0/2680031091 >> v1:172.21.15.173:6789/0 conn(0x7f1294071190 legacy=0x7f129406b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:59.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.954+0000 7f1291d9b700 1 -- 172.21.15.72:0/2680031091 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3840152622 0 0) 0x7f1294071700 con 0x7f1294071190 2023-07-27T20:31:59.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.954+0000 7f1292d9d700 1 -- 172.21.15.72:0/2680031091 >> v1:172.21.15.72:6789/0 conn(0x7f12940a86c0 legacy=0x7f1294154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:59.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.954+0000 7f1292d9d700 1 -- 172.21.15.72:0/2680031091 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12940719e0 con 0x7f1294158100 2023-07-27T20:31:59.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.954+0000 7f1292d9d700 1 --2- 172.21.15.72:0/2680031091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1294158100 0x7f12940a8aa0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f128c009d90 tx=0x7f128c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b4c616559ec6bad server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:59.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.954+0000 7f1291d9b700 1 -- 172.21.15.72:0/2680031091 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c00e070 con 0x7f1294158100 2023-07-27T20:31:59.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.954+0000 7f1291d9b700 1 -- 172.21.15.72:0/2680031091 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128c00bb20 con 0x7f1294158100 2023-07-27T20:31:59.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.954+0000 7f1291d9b700 1 -- 172.21.15.72:0/2680031091 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c00be90 con 0x7f1294158100 2023-07-27T20:31:59.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.955+0000 7f1298dff700 1 -- 172.21.15.72:0/2680031091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1294158100 msgr2=0x7f12940a8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:59.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.955+0000 7f1298dff700 1 --2- 172.21.15.72:0/2680031091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1294158100 0x7f12940a8aa0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f128c009d90 tx=0x7f128c00b330 comp rx=0 tx=0).stop 2023-07-27T20:31:59.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.955+0000 7f1298dff700 1 -- 172.21.15.72:0/2680031091 shutdown_connections 2023-07-27T20:31:59.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.955+0000 7f1298dff700 1 --2- 172.21.15.72:0/2680031091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1294158100 0x7f12940a8aa0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:59.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.955+0000 7f1298dff700 1 -- 172.21.15.72:0/2680031091 >> 172.21.15.72:0/2680031091 conn(0x7f12940c2fd0 msgr2=0x7f12940c33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:31:59.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.955+0000 7f1298dff700 1 -- 172.21.15.72:0/2680031091 shutdown_connections 2023-07-27T20:31:59.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.955+0000 7f1298dff700 1 -- 172.21.15.72:0/2680031091 wait complete. 2023-07-27T20:31:59.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.956+0000 7f1298dff700 1 Processor -- start 2023-07-27T20:31:59.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.957+0000 7f1298dff700 1 -- start start 2023-07-27T20:31:59.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.957+0000 7f1298dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1294071190 0x7f12940bb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:59.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.958+0000 7f1298dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12940a86c0 0x7f12940ba2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:59.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.958+0000 7f1298dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1294158100 0x7f12941de700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:59.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.958+0000 7f1298dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1294157450 con 0x7f12940a86c0 2023-07-27T20:31:59.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.958+0000 7f1298dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12940bc6a0 con 0x7f1294158100 2023-07-27T20:31:59.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.958+0000 7f1298dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1294157170 con 0x7f1294071190 2023-07-27T20:31:59.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.958+0000 7f128bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12940a86c0 0x7f12940ba2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:59.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.958+0000 7f128bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12940a86c0 0x7f12940ba2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46266/0 (socket says 172.21.15.72:46266) 2023-07-27T20:31:59.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.958+0000 7f128bfff700 1 -- 172.21.15.72:0/1543018896 learned_addr learned my addr 172.21.15.72:0/1543018896 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:31:59.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.958+0000 7f129259c700 1 --2- 172.21.15.72:0/1543018896 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1294071190 0x7f12940bb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:59.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.958+0000 7f1292d9d700 1 --2- 172.21.15.72:0/1543018896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1294158100 0x7f12941de700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:59.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.958+0000 7f128bfff700 1 -- 172.21.15.72:0/1543018896 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1294071190 msgr2=0x7f12940bb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:59.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.958+0000 7f128bfff700 1 --2- 172.21.15.72:0/1543018896 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1294071190 0x7f12940bb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:59.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.958+0000 7f128bfff700 1 -- 172.21.15.72:0/1543018896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1294158100 msgr2=0x7f12941de700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:31:59.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.958+0000 7f128bfff700 1 --2- 172.21.15.72:0/1543018896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1294158100 0x7f12941de700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:31:59.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.958+0000 7f128bfff700 1 -- 172.21.15.72:0/1543018896 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128c009a70 con 0x7f12940a86c0 2023-07-27T20:31:59.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.958+0000 7f129259c700 1 --2- 172.21.15.72:0/1543018896 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1294071190 0x7f12940bb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:31:59.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.958+0000 7f128bfff700 1 --2- 172.21.15.72:0/1543018896 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12940a86c0 0x7f12940ba2f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f127c00c500 tx=0x7f127c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:59.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.959+0000 7f128affd700 1 -- 172.21.15.72:0/1543018896 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127c0054e0 con 0x7f12940a86c0 2023-07-27T20:31:59.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.959+0000 7f128affd700 1 -- 172.21.15.72:0/1543018896 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127c003680 con 0x7f12940a86c0 2023-07-27T20:31:59.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.959+0000 7f1298dff700 1 -- 172.21.15.72:0/1543018896 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12940bc050 con 0x7f12940a86c0 2023-07-27T20:31:59.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.959+0000 7f128affd700 1 -- 172.21.15.72:0/1543018896 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127c003a30 con 0x7f12940a86c0 2023-07-27T20:31:59.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.959+0000 7f1298dff700 1 -- 172.21.15.72:0/1543018896 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12940ba830 con 0x7f12940a86c0 2023-07-27T20:31:59.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.960+0000 7f1298dff700 1 -- 172.21.15.72:0/1543018896 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12940bbe90 con 0x7f12940a86c0 2023-07-27T20:31:59.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.961+0000 7f128affd700 1 -- 172.21.15.72:0/1543018896 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f127c003b90 con 0x7f12940a86c0 2023-07-27T20:31:59.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.961+0000 7f128affd700 1 --2- 172.21.15.72:0/1543018896 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f127406ace0 0x7f127406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:31:59.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.962+0000 7f128affd700 1 -- 172.21.15.72:0/1543018896 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f127c088c20 con 0x7f12940a86c0 2023-07-27T20:31:59.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.962+0000 7f129259c700 1 --2- 172.21.15.72:0/1543018896 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f127406ace0 0x7f127406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:31:59.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.963+0000 7f129259c700 1 --2- 172.21.15.72:0/1543018896 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f127406ace0 0x7f127406d1a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1284005910 tx=0x7f1284009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:31:59.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:31:59.966+0000 7f128affd700 1 -- 172.21.15.72:0/1543018896 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f127c0539d0 con 0x7f12940a86c0 2023-07-27T20:32:00.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.160+0000 7f1298dff700 1 -- 172.21.15.72:0/1543018896 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f12940bc810 con 0x7f12940a86c0 2023-07-27T20:32:00.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.161+0000 7f128affd700 1 -- 172.21.15.72:0/1543018896 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f127c0170a0 con 0x7f12940a86c0 2023-07-27T20:32:00.149 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-27T20:32:00.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.163+0000 7f1298dff700 1 -- 172.21.15.72:0/1543018896 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f127406ace0 msgr2=0x7f127406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:00.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.163+0000 7f1298dff700 1 --2- 172.21.15.72:0/1543018896 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f127406ace0 0x7f127406d1a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1284005910 tx=0x7f1284009040 comp rx=0 tx=0).stop 2023-07-27T20:32:00.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.163+0000 7f1298dff700 1 -- 172.21.15.72:0/1543018896 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12940a86c0 msgr2=0x7f12940ba2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:00.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.163+0000 7f1298dff700 1 --2- 172.21.15.72:0/1543018896 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12940a86c0 0x7f12940ba2f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f127c00c500 tx=0x7f127c00c810 comp rx=0 tx=0).stop 2023-07-27T20:32:00.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.164+0000 7f1298dff700 1 -- 172.21.15.72:0/1543018896 shutdown_connections 2023-07-27T20:32:00.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.164+0000 7f1298dff700 1 --2- 172.21.15.72:0/1543018896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1294158100 0x7f12941de700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:00.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.164+0000 7f1298dff700 1 --2- 172.21.15.72:0/1543018896 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f127406ace0 0x7f127406d1a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:00.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.164+0000 7f1298dff700 1 --2- 172.21.15.72:0/1543018896 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1294071190 0x7f12940bb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:00.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.164+0000 7f1298dff700 1 --2- 172.21.15.72:0/1543018896 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12940a86c0 0x7f12940ba2f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:00.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.164+0000 7f1298dff700 1 -- 172.21.15.72:0/1543018896 >> 172.21.15.72:0/1543018896 conn(0x7f12940c2fd0 msgr2=0x7f12940c33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:00.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.164+0000 7f1298dff700 1 -- 172.21.15.72:0/1543018896 shutdown_connections 2023-07-27T20:32:00.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.164+0000 7f1298dff700 1 -- 172.21.15.72:0/1543018896 wait complete. 2023-07-27T20:32:00.169 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T20:32:00.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.388+0000 7f18a23ff700 1 Processor -- start 2023-07-27T20:32:00.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.388+0000 7f18a23ff700 1 -- start start 2023-07-27T20:32:00.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.389+0000 7f18a23ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f189c06d5d0 0x7f189c06da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:00.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.389+0000 7f18a23ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f189c06ce10 con 0x7f189c06e140 2023-07-27T20:32:00.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.389+0000 7f18a23ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f189c152680 con 0x7f189c13b150 2023-07-27T20:32:00.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.389+0000 7f18a23ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f189c06df40 con 0x7f189c06d5d0 2023-07-27T20:32:00.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.390+0000 7f189b7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f189c06e140 0x7f189c0ba310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52034/0 (socket says 172.21.15.72:52034) 2023-07-27T20:32:00.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.390+0000 7f189b7fe700 1 -- 172.21.15.72:0/3294562364 learned_addr learned my addr 172.21.15.72:0/3294562364 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:00.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.390+0000 7f18a099c700 1 --2- 172.21.15.72:0/3294562364 >> v2:172.21.15.173:3300/0 conn(0x7f189c06d5d0 0x7f189c06da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:00.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.390+0000 7f189affd700 1 -- 172.21.15.72:0/3294562364 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 794113382 0 0) 0x7f189c06ce10 con 0x7f189c06e140 2023-07-27T20:32:00.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.390+0000 7f189affd700 1 -- 172.21.15.72:0/3294562364 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18840035b0 con 0x7f189c06e140 2023-07-27T20:32:00.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.390+0000 7f189affd700 1 -- 172.21.15.72:0/3294562364 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3754870668 0 0) 0x7f18840035b0 con 0x7f189c06e140 2023-07-27T20:32:00.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.390+0000 7f189affd700 1 -- 172.21.15.72:0/3294562364 >> v2:172.21.15.173:3300/0 conn(0x7f189c06d5d0 msgr2=0x7f189c06da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:00.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.390+0000 7f189affd700 1 --2- 172.21.15.72:0/3294562364 >> v2:172.21.15.173:3300/0 conn(0x7f189c06d5d0 0x7f189c06da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:00.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.390+0000 7f189affd700 1 -- 172.21.15.72:0/3294562364 >> v1:172.21.15.173:6789/0 conn(0x7f189c13b150 legacy=0x7f189c151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:00.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.390+0000 7f189affd700 1 -- 172.21.15.72:0/3294562364 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f189c152960 con 0x7f189c06e140 2023-07-27T20:32:00.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.390+0000 7f189affd700 1 -- 172.21.15.72:0/3294562364 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f1890001670 con 0x7f189c06e140 2023-07-27T20:32:00.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.390+0000 7f189affd700 1 -- 172.21.15.72:0/3294562364 >> v1:172.21.15.72:6789/0 conn(0x7f189c06e140 legacy=0x7f189c0ba310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:00.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.390+0000 7f189affd700 1 --2- 172.21.15.72:0/3294562364 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1884003a00 0x7f1884003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:00.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.390+0000 7f189affd700 1 --2- 172.21.15.72:0/3294562364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1884004850 0x7f1884004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:00.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.390+0000 7f189affd700 1 --2- 172.21.15.72:0/3294562364 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1884005210 0x7f188400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:00.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.391+0000 7f189affd700 1 -- 172.21.15.72:0/3294562364 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189c06df40 con 0x7f1884004850 2023-07-27T20:32:00.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.391+0000 7f189affd700 1 -- 172.21.15.72:0/3294562364 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188400c1b0 con 0x7f1884005210 2023-07-27T20:32:00.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.391+0000 7f189affd700 1 -- 172.21.15.72:0/3294562364 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f188400c370 con 0x7f1884003a00 2023-07-27T20:32:00.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.391+0000 7f189b7fe700 1 --2- 172.21.15.72:0/3294562364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1884004850 0x7f1884004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:00.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.391+0000 7f18a099c700 1 --2- 172.21.15.72:0/3294562364 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1884005210 0x7f188400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:00.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.391+0000 7f189bfff700 1 --2- 172.21.15.72:0/3294562364 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1884003a00 0x7f1884003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:00.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.391+0000 7f189b7fe700 1 -- 172.21.15.72:0/3294562364 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1884003a00 msgr2=0x7f1884003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:00.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.391+0000 7f189b7fe700 1 --2- 172.21.15.72:0/3294562364 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1884003a00 0x7f1884003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:00.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.391+0000 7f189b7fe700 1 -- 172.21.15.72:0/3294562364 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1884005210 msgr2=0x7f188400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:00.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.391+0000 7f189b7fe700 1 --2- 172.21.15.72:0/3294562364 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1884005210 0x7f188400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:00.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.391+0000 7f189b7fe700 1 -- 172.21.15.72:0/3294562364 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18840035b0 con 0x7f1884004850 2023-07-27T20:32:00.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.391+0000 7f18a099c700 1 -- 172.21.15.72:0/3294562364 reap_dead start 2023-07-27T20:32:00.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.391+0000 7f189bfff700 1 --2- 172.21.15.72:0/3294562364 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1884003a00 0x7f1884003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:00.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.391+0000 7f189b7fe700 1 --2- 172.21.15.72:0/3294562364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1884004850 0x7f1884004cd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f189000c240 tx=0x7f1884005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b8201cb5a80fb60 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:00.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.392+0000 7f189affd700 1 -- 172.21.15.72:0/3294562364 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1890007c10 con 0x7f1884004850 2023-07-27T20:32:00.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.392+0000 7f189affd700 1 -- 172.21.15.72:0/3294562364 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189000cd80 con 0x7f1884004850 2023-07-27T20:32:00.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.392+0000 7f189affd700 1 -- 172.21.15.72:0/3294562364 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1890005ba0 con 0x7f1884004850 2023-07-27T20:32:00.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.392+0000 7f18a23ff700 1 -- 172.21.15.72:0/3294562364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1884004850 msgr2=0x7f1884004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:00.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.392+0000 7f18a23ff700 1 --2- 172.21.15.72:0/3294562364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1884004850 0x7f1884004cd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f189000c240 tx=0x7f1884005880 comp rx=0 tx=0).stop 2023-07-27T20:32:00.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.392+0000 7f18a23ff700 1 -- 172.21.15.72:0/3294562364 shutdown_connections 2023-07-27T20:32:00.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.392+0000 7f18a23ff700 1 --2- 172.21.15.72:0/3294562364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1884004850 0x7f1884004cd0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:00.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.392+0000 7f18a23ff700 1 -- 172.21.15.72:0/3294562364 >> 172.21.15.72:0/3294562364 conn(0x7f189c06a190 msgr2=0x7f189c06a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:00.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.392+0000 7f18a23ff700 1 -- 172.21.15.72:0/3294562364 shutdown_connections 2023-07-27T20:32:00.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.392+0000 7f18a23ff700 1 -- 172.21.15.72:0/3294562364 wait complete. 2023-07-27T20:32:00.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.394+0000 7f18a23ff700 1 Processor -- start 2023-07-27T20:32:00.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.394+0000 7f18a23ff700 1 -- start start 2023-07-27T20:32:00.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.395+0000 7f18a23ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1884004850 0x7f189c1eadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:00.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.395+0000 7f18a23ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f189c1eb330 0x7f189c1e9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:00.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.395+0000 7f18a23ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f189c1e9660 0x7f189c0a9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:00.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.395+0000 7f18a23ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189c153370 con 0x7f1884004850 2023-07-27T20:32:00.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.395+0000 7f18a23ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189c153650 con 0x7f189c1eb330 2023-07-27T20:32:00.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.395+0000 7f18a23ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f189c1e8c00 con 0x7f189c1e9660 2023-07-27T20:32:00.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.395+0000 7f189bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1884004850 0x7f189c1eadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:00.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.395+0000 7f189bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1884004850 0x7f189c1eadf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46274/0 (socket says 172.21.15.72:46274) 2023-07-27T20:32:00.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.395+0000 7f189bfff700 1 -- 172.21.15.72:0/4216317490 learned_addr learned my addr 172.21.15.72:0/4216317490 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:00.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.396+0000 7f189b7fe700 1 --2- 172.21.15.72:0/4216317490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f189c1eb330 0x7f189c1e9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:00.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.396+0000 7f18a099c700 1 --2- 172.21.15.72:0/4216317490 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f189c1e9660 0x7f189c0a9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:00.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.396+0000 7f189bfff700 1 -- 172.21.15.72:0/4216317490 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f189c1e9660 msgr2=0x7f189c0a9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:00.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.396+0000 7f189bfff700 1 --2- 172.21.15.72:0/4216317490 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f189c1e9660 0x7f189c0a9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:00.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.396+0000 7f189bfff700 1 -- 172.21.15.72:0/4216317490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f189c1eb330 msgr2=0x7f189c1e9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:00.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.396+0000 7f189bfff700 1 --2- 172.21.15.72:0/4216317490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f189c1eb330 0x7f189c1e9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:00.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.396+0000 7f189bfff700 1 -- 172.21.15.72:0/4216317490 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f189c14bde0 con 0x7f1884004850 2023-07-27T20:32:00.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.396+0000 7f189bfff700 1 --2- 172.21.15.72:0/4216317490 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1884004850 0x7f189c1eadf0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f188c00e460 tx=0x7f188c00e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:00.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.396+0000 7f1898ff9700 1 -- 172.21.15.72:0/4216317490 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c0052e0 con 0x7f1884004850 2023-07-27T20:32:00.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.396+0000 7f1898ff9700 1 -- 172.21.15.72:0/4216317490 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188c005440 con 0x7f1884004850 2023-07-27T20:32:00.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.396+0000 7f18a23ff700 1 -- 172.21.15.72:0/4216317490 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f189c1eb7b0 con 0x7f1884004850 2023-07-27T20:32:00.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.396+0000 7f1898ff9700 1 -- 172.21.15.72:0/4216317490 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c0038c0 con 0x7f1884004850 2023-07-27T20:32:00.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.396+0000 7f18a23ff700 1 -- 172.21.15.72:0/4216317490 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f189c1e9cd0 con 0x7f1884004850 2023-07-27T20:32:00.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.397+0000 7f18a23ff700 1 -- 172.21.15.72:0/4216317490 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f189c1e8d70 con 0x7f1884004850 2023-07-27T20:32:00.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.398+0000 7f1898ff9700 1 -- 172.21.15.72:0/4216317490 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f188c003a20 con 0x7f1884004850 2023-07-27T20:32:00.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.400+0000 7f1898ff9700 1 --2- 172.21.15.72:0/4216317490 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f188806ace0 0x7f188806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:00.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.400+0000 7f1898ff9700 1 -- 172.21.15.72:0/4216317490 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f188c088e30 con 0x7f1884004850 2023-07-27T20:32:00.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.400+0000 7f189b7fe700 1 --2- 172.21.15.72:0/4216317490 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f188806ace0 0x7f188806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:00.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.401+0000 7f189b7fe700 1 --2- 172.21.15.72:0/4216317490 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f188806ace0 0x7f188806d1a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1890015040 tx=0x7f1890007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:00.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.404+0000 7f1898ff9700 1 -- 172.21.15.72:0/4216317490 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f188c053c90 con 0x7f1884004850 2023-07-27T20:32:00.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.599+0000 7f18a23ff700 1 -- 172.21.15.72:0/4216317490 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f189c1534b0 con 0x7f1884004850 2023-07-27T20:32:00.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.599+0000 7f1898ff9700 1 -- 172.21.15.72:0/4216317490 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f189c1534b0 con 0x7f1884004850 2023-07-27T20:32:00.589 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-27T20:32:00.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.601+0000 7f18a23ff700 1 -- 172.21.15.72:0/4216317490 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f188806ace0 msgr2=0x7f188806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:00.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.601+0000 7f18a23ff700 1 --2- 172.21.15.72:0/4216317490 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f188806ace0 0x7f188806d1a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1890015040 tx=0x7f1890007000 comp rx=0 tx=0).stop 2023-07-27T20:32:00.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.601+0000 7f18a23ff700 1 -- 172.21.15.72:0/4216317490 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1884004850 msgr2=0x7f189c1eadf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:00.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.601+0000 7f18a23ff700 1 --2- 172.21.15.72:0/4216317490 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1884004850 0x7f189c1eadf0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f188c00e460 tx=0x7f188c00e820 comp rx=0 tx=0).stop 2023-07-27T20:32:00.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.602+0000 7f18a23ff700 1 -- 172.21.15.72:0/4216317490 shutdown_connections 2023-07-27T20:32:00.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.602+0000 7f18a23ff700 1 --2- 172.21.15.72:0/4216317490 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f188806ace0 0x7f188806d1a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:00.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.602+0000 7f18a23ff700 1 --2- 172.21.15.72:0/4216317490 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f189c1e9660 0x7f189c0a9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:00.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.602+0000 7f18a23ff700 1 --2- 172.21.15.72:0/4216317490 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1884004850 0x7f189c1eadf0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:00.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.602+0000 7f18a23ff700 1 --2- 172.21.15.72:0/4216317490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f189c1eb330 0x7f189c1e9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:00.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.602+0000 7f18a23ff700 1 -- 172.21.15.72:0/4216317490 >> 172.21.15.72:0/4216317490 conn(0x7f189c06a190 msgr2=0x7f189c0c4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:00.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.602+0000 7f18a23ff700 1 -- 172.21.15.72:0/4216317490 shutdown_connections 2023-07-27T20:32:00.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.602+0000 7f18a23ff700 1 -- 172.21.15.72:0/4216317490 wait complete. 2023-07-27T20:32:00.608 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T20:32:00.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.818+0000 7f677c3ff700 1 Processor -- start 2023-07-27T20:32:00.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.818+0000 7f677c3ff700 1 -- start start 2023-07-27T20:32:00.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.820+0000 7f677c3ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f67740c12f0 0x7f67741516c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:00.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.820+0000 7f677c3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6774154f50 con 0x7f67741475a0 2023-07-27T20:32:00.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.820+0000 7f677c3ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6774154340 con 0x7f67740716f0 2023-07-27T20:32:00.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.820+0000 7f677c3ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6774151c00 con 0x7f67740c12f0 2023-07-27T20:32:00.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.820+0000 7f677a19b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f67741475a0 0x7f67740c1d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52042/0 (socket says 172.21.15.72:52042) 2023-07-27T20:32:00.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.820+0000 7f677a19b700 1 -- 172.21.15.72:0/1753949030 learned_addr learned my addr 172.21.15.72:0/1753949030 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:00.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.820+0000 7f677999a700 1 --2- 172.21.15.72:0/1753949030 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f67740c12f0 0x7f67741516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:00.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.821+0000 7f6779199700 1 -- 172.21.15.72:0/1753949030 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3914548327 0 0) 0x7f6774154f50 con 0x7f67741475a0 2023-07-27T20:32:00.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.821+0000 7f6779199700 1 -- 172.21.15.72:0/1753949030 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67600057c0 con 0x7f67741475a0 2023-07-27T20:32:00.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.821+0000 7f6779199700 1 -- 172.21.15.72:0/1753949030 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3871702580 0 0) 0x7f6774154340 con 0x7f67740716f0 2023-07-27T20:32:00.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.821+0000 7f6779199700 1 -- 172.21.15.72:0/1753949030 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6774154f50 con 0x7f67740716f0 2023-07-27T20:32:00.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.821+0000 7f677999a700 1 -- 172.21.15.72:0/1753949030 >> v1:172.21.15.173:6789/0 conn(0x7f67740716f0 legacy=0x7f6774071b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:00.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.821+0000 7f677999a700 1 -- 172.21.15.72:0/1753949030 >> v1:172.21.15.72:6789/0 conn(0x7f67741475a0 legacy=0x7f67740c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:00.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.821+0000 7f677999a700 1 -- 172.21.15.72:0/1753949030 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6774154620 con 0x7f67740c12f0 2023-07-27T20:32:00.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.821+0000 7f677999a700 1 --2- 172.21.15.72:0/1753949030 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f67740c12f0 0x7f67741516c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6764009870 tx=0x7f6764009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=432a68c91de27098 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:00.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.821+0000 7f6779199700 1 -- 172.21.15.72:0/1753949030 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6764011830 con 0x7f67740c12f0 2023-07-27T20:32:00.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.821+0000 7f6779199700 1 -- 172.21.15.72:0/1753949030 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6764011990 con 0x7f67740c12f0 2023-07-27T20:32:00.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.821+0000 7f6779199700 1 -- 172.21.15.72:0/1753949030 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6764011d20 con 0x7f67740c12f0 2023-07-27T20:32:00.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.822+0000 7f677c3ff700 1 -- 172.21.15.72:0/1753949030 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f67740c12f0 msgr2=0x7f67741516c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:00.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.822+0000 7f677c3ff700 1 --2- 172.21.15.72:0/1753949030 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f67740c12f0 0x7f67741516c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6764009870 tx=0x7f6764009b80 comp rx=0 tx=0).stop 2023-07-27T20:32:00.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.822+0000 7f677c3ff700 1 -- 172.21.15.72:0/1753949030 shutdown_connections 2023-07-27T20:32:00.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.822+0000 7f677c3ff700 1 --2- 172.21.15.72:0/1753949030 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f67740c12f0 0x7f67741516c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:00.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.822+0000 7f677c3ff700 1 -- 172.21.15.72:0/1753949030 >> 172.21.15.72:0/1753949030 conn(0x7f677406a190 msgr2=0x7f677406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:00.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.822+0000 7f677c3ff700 1 -- 172.21.15.72:0/1753949030 shutdown_connections 2023-07-27T20:32:00.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.822+0000 7f677c3ff700 1 -- 172.21.15.72:0/1753949030 wait complete. 2023-07-27T20:32:00.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.824+0000 7f677c3ff700 1 Processor -- start 2023-07-27T20:32:00.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.824+0000 7f677c3ff700 1 -- start start 2023-07-27T20:32:00.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.825+0000 7f677c3ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f67740716f0 0x7f67740c4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:00.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.825+0000 7f677c3ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67740c12f0 0x7f67740ba310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:00.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.825+0000 7f677c3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67741475a0 0x7f67741ed560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:00.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.825+0000 7f677c3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67741ed140 con 0x7f67741475a0 2023-07-27T20:32:00.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.825+0000 7f677c3ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67741540a0 con 0x7f67740c12f0 2023-07-27T20:32:00.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.825+0000 7f677c3ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67740ba850 con 0x7f67740716f0 2023-07-27T20:32:00.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.825+0000 7f677a99c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67741475a0 0x7f67741ed560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:00.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.825+0000 7f677a99c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67741475a0 0x7f67741ed560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46278/0 (socket says 172.21.15.72:46278) 2023-07-27T20:32:00.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.825+0000 7f677a99c700 1 -- 172.21.15.72:0/2515155791 learned_addr learned my addr 172.21.15.72:0/2515155791 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:00.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.825+0000 7f677999a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67740c12f0 0x7f67740ba310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:00.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.825+0000 7f677a19b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f67740716f0 0x7f67740c4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:00.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.825+0000 7f677a99c700 1 -- 172.21.15.72:0/2515155791 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f67740716f0 msgr2=0x7f67740c4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:00.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.825+0000 7f677a99c700 1 --2- 172.21.15.72:0/2515155791 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f67740716f0 0x7f67740c4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:00.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.825+0000 7f677a99c700 1 -- 172.21.15.72:0/2515155791 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67740c12f0 msgr2=0x7f67740ba310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:00.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.825+0000 7f677a99c700 1 --2- 172.21.15.72:0/2515155791 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67740c12f0 0x7f67740ba310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:00.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.825+0000 7f677a99c700 1 -- 172.21.15.72:0/2515155791 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67640094a0 con 0x7f67741475a0 2023-07-27T20:32:00.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.826+0000 7f677a99c700 1 --2- 172.21.15.72:0/2515155791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67741475a0 0x7f67741ed560 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f676c00cbc0 tx=0x7f676c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:00.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.826+0000 7f676affd700 1 -- 172.21.15.72:0/2515155791 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c003c00 con 0x7f67741475a0 2023-07-27T20:32:00.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.826+0000 7f676affd700 1 -- 172.21.15.72:0/2515155791 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676c003d60 con 0x7f67741475a0 2023-07-27T20:32:00.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.826+0000 7f677c3ff700 1 -- 172.21.15.72:0/2515155791 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67741edaa0 con 0x7f67741475a0 2023-07-27T20:32:00.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.826+0000 7f676affd700 1 -- 172.21.15.72:0/2515155791 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c00aaa0 con 0x7f67741475a0 2023-07-27T20:32:00.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.826+0000 7f677c3ff700 1 -- 172.21.15.72:0/2515155791 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6774153dc0 con 0x7f67741475a0 2023-07-27T20:32:00.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.827+0000 7f677c3ff700 1 -- 172.21.15.72:0/2515155791 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67741ed280 con 0x7f67741475a0 2023-07-27T20:32:00.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.828+0000 7f676affd700 1 -- 172.21.15.72:0/2515155791 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f676c00ac00 con 0x7f67741475a0 2023-07-27T20:32:00.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.829+0000 7f676affd700 1 --2- 172.21.15.72:0/2515155791 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f675806ace0 0x7f675806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:00.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.830+0000 7f676affd700 1 -- 172.21.15.72:0/2515155791 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f676c089740 con 0x7f67741475a0 2023-07-27T20:32:00.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.830+0000 7f677a19b700 1 --2- 172.21.15.72:0/2515155791 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f675806ace0 0x7f675806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:00.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.830+0000 7f677a19b700 1 --2- 172.21.15.72:0/2515155791 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f675806ace0 0x7f675806d1a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6770007fd0 tx=0x7f6770007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:00.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:00.834+0000 7f676affd700 1 -- 172.21.15.72:0/2515155791 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f67741ed280 con 0x7f67741475a0 2023-07-27T20:32:01.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.026+0000 7f677c3ff700 1 -- 172.21.15.72:0/2515155791 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f67741ed280 con 0x7f67741475a0 2023-07-27T20:32:01.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.027+0000 7f676affd700 1 -- 172.21.15.72:0/2515155791 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f67741ed280 con 0x7f67741475a0 2023-07-27T20:32:01.016 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:32:01.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.029+0000 7f677c3ff700 1 -- 172.21.15.72:0/2515155791 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f675806ace0 msgr2=0x7f675806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:01.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.029+0000 7f677c3ff700 1 --2- 172.21.15.72:0/2515155791 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f675806ace0 0x7f675806d1a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6770007fd0 tx=0x7f6770007dc0 comp rx=0 tx=0).stop 2023-07-27T20:32:01.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.029+0000 7f677c3ff700 1 -- 172.21.15.72:0/2515155791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67741475a0 msgr2=0x7f67741ed560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:01.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.029+0000 7f677c3ff700 1 --2- 172.21.15.72:0/2515155791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67741475a0 0x7f67741ed560 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f676c00cbc0 tx=0x7f676c00ced0 comp rx=0 tx=0).stop 2023-07-27T20:32:01.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.029+0000 7f677c3ff700 1 -- 172.21.15.72:0/2515155791 shutdown_connections 2023-07-27T20:32:01.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.029+0000 7f677c3ff700 1 --2- 172.21.15.72:0/2515155791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67741475a0 0x7f67741ed560 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:01.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.029+0000 7f677c3ff700 1 --2- 172.21.15.72:0/2515155791 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f675806ace0 0x7f675806d1a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:01.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.029+0000 7f677c3ff700 1 --2- 172.21.15.72:0/2515155791 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f67740716f0 0x7f67740c4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:01.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.029+0000 7f677c3ff700 1 --2- 172.21.15.72:0/2515155791 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67740c12f0 0x7f67740ba310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:01.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.029+0000 7f677c3ff700 1 -- 172.21.15.72:0/2515155791 >> 172.21.15.72:0/2515155791 conn(0x7f677406a190 msgr2=0x7f67741ded10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:01.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.029+0000 7f677c3ff700 1 -- 172.21.15.72:0/2515155791 shutdown_connections 2023-07-27T20:32:01.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.029+0000 7f677c3ff700 1 -- 172.21.15.72:0/2515155791 wait complete. 2023-07-27T20:32:01.035 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T20:32:01.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.248+0000 7f8b56dff700 1 Processor -- start 2023-07-27T20:32:01.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.248+0000 7f8b56dff700 1 -- start start 2023-07-27T20:32:01.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.249+0000 7f8b56dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b500c7740 0x7f8b500c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:01.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.249+0000 7f8b56dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b500c7c50 con 0x7f8b5014aab0 2023-07-27T20:32:01.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.249+0000 7f8b56dff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b5006bd40 con 0x7f8b500c4700 2023-07-27T20:32:01.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.249+0000 7f8b56dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b500c62f0 con 0x7f8b500c7740 2023-07-27T20:32:01.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.250+0000 7f8b54b9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8b5014aab0 0x7f8b50154b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52044/0 (socket says 172.21.15.72:52044) 2023-07-27T20:32:01.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.250+0000 7f8b54b9b700 1 -- 172.21.15.72:0/3945642843 learned_addr learned my addr 172.21.15.72:0/3945642843 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:01.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.250+0000 7f8b4ffff700 1 --2- 172.21.15.72:0/3945642843 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b500c7740 0x7f8b500c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:01.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.250+0000 7f8b4f7fe700 1 -- 172.21.15.72:0/3945642843 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3802497122 0 0) 0x7f8b500c7c50 con 0x7f8b5014aab0 2023-07-27T20:32:01.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.250+0000 7f8b4f7fe700 1 -- 172.21.15.72:0/3945642843 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b400035b0 con 0x7f8b5014aab0 2023-07-27T20:32:01.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.250+0000 7f8b4f7fe700 1 -- 172.21.15.72:0/3945642843 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1947004730 0 0) 0x7f8b5006bd40 con 0x7f8b500c4700 2023-07-27T20:32:01.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.250+0000 7f8b4f7fe700 1 -- 172.21.15.72:0/3945642843 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b500c7c50 con 0x7f8b500c4700 2023-07-27T20:32:01.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.250+0000 7f8b4f7fe700 1 -- 172.21.15.72:0/3945642843 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2300054515 0 0) 0x7f8b400035b0 con 0x7f8b5014aab0 2023-07-27T20:32:01.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.250+0000 7f8b4f7fe700 1 -- 172.21.15.72:0/3945642843 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b500c7740 msgr2=0x7f8b500c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:01.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.250+0000 7f8b4f7fe700 1 --2- 172.21.15.72:0/3945642843 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b500c7740 0x7f8b500c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:01.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.250+0000 7f8b4f7fe700 1 -- 172.21.15.72:0/3945642843 >> v1:172.21.15.173:6789/0 conn(0x7f8b500c4700 legacy=0x7f8b5006c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:01.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.250+0000 7f8b4f7fe700 1 -- 172.21.15.72:0/3945642843 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b5006d200 con 0x7f8b5014aab0 2023-07-27T20:32:01.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.250+0000 7f8b4f7fe700 1 -- 172.21.15.72:0/3945642843 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f8b44001670 con 0x7f8b5014aab0 2023-07-27T20:32:01.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.250+0000 7f8b4f7fe700 1 -- 172.21.15.72:0/3945642843 >> v1:172.21.15.72:6789/0 conn(0x7f8b5014aab0 legacy=0x7f8b50154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:01.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.250+0000 7f8b4f7fe700 1 --2- 172.21.15.72:0/3945642843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b40003bc0 0x7f8b40003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:01.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.250+0000 7f8b4f7fe700 1 --2- 172.21.15.72:0/3945642843 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b40004850 0x7f8b40004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:01.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.250+0000 7f8b4f7fe700 1 --2- 172.21.15.72:0/3945642843 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b500c7740 0x7f8b40005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:01.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.250+0000 7f8b4f7fe700 1 -- 172.21.15.72:0/3945642843 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b500c62f0 con 0x7f8b40003bc0 2023-07-27T20:32:01.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.250+0000 7f8b4f7fe700 1 -- 172.21.15.72:0/3945642843 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4000bac0 con 0x7f8b40004850 2023-07-27T20:32:01.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.251+0000 7f8b4f7fe700 1 -- 172.21.15.72:0/3945642843 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4000bc50 con 0x7f8b500c7740 2023-07-27T20:32:01.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.251+0000 7f8b54b9b700 1 --2- 172.21.15.72:0/3945642843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b40003bc0 0x7f8b40003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:01.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.251+0000 7f8b4ffff700 1 --2- 172.21.15.72:0/3945642843 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b40004850 0x7f8b40004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:01.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.251+0000 7f8b5539c700 1 --2- 172.21.15.72:0/3945642843 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b500c7740 0x7f8b40005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:01.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.251+0000 7f8b54b9b700 1 -- 172.21.15.72:0/3945642843 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b500c7740 msgr2=0x7f8b40005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:01.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.251+0000 7f8b54b9b700 1 --2- 172.21.15.72:0/3945642843 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b500c7740 0x7f8b40005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:01.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.251+0000 7f8b54b9b700 1 -- 172.21.15.72:0/3945642843 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b40004850 msgr2=0x7f8b40004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:01.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.251+0000 7f8b54b9b700 1 --2- 172.21.15.72:0/3945642843 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b40004850 0x7f8b40004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:01.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.251+0000 7f8b54b9b700 1 -- 172.21.15.72:0/3945642843 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b400035b0 con 0x7f8b40003bc0 2023-07-27T20:32:01.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.251+0000 7f8b5539c700 1 --2- 172.21.15.72:0/3945642843 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b500c7740 0x7f8b40005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:01.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.251+0000 7f8b54b9b700 1 --2- 172.21.15.72:0/3945642843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b40003bc0 0x7f8b40003fc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8b4400c210 tx=0x7f8b40005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d100af9dc41dc33 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:01.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.251+0000 7f8b4f7fe700 1 -- 172.21.15.72:0/3945642843 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4400cd10 con 0x7f8b40003bc0 2023-07-27T20:32:01.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.252+0000 7f8b4f7fe700 1 -- 172.21.15.72:0/3945642843 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4400ce70 con 0x7f8b40003bc0 2023-07-27T20:32:01.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.252+0000 7f8b4f7fe700 1 -- 172.21.15.72:0/3945642843 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b44005b80 con 0x7f8b40003bc0 2023-07-27T20:32:01.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.252+0000 7f8b56dff700 1 -- 172.21.15.72:0/3945642843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b40003bc0 msgr2=0x7f8b40003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:01.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.252+0000 7f8b56dff700 1 --2- 172.21.15.72:0/3945642843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b40003bc0 0x7f8b40003fc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8b4400c210 tx=0x7f8b40005880 comp rx=0 tx=0).stop 2023-07-27T20:32:01.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.252+0000 7f8b5539c700 1 -- 172.21.15.72:0/3945642843 reap_dead start 2023-07-27T20:32:01.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.252+0000 7f8b56dff700 1 -- 172.21.15.72:0/3945642843 shutdown_connections 2023-07-27T20:32:01.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.252+0000 7f8b56dff700 1 -- 172.21.15.72:0/3945642843 >> 172.21.15.72:0/3945642843 conn(0x7f8b500ab3f0 msgr2=0x7f8b500ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:01.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.252+0000 7f8b56dff700 1 -- 172.21.15.72:0/3945642843 shutdown_connections 2023-07-27T20:32:01.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.252+0000 7f8b56dff700 1 -- 172.21.15.72:0/3945642843 wait complete. 2023-07-27T20:32:01.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.254+0000 7f8b56dff700 1 Processor -- start 2023-07-27T20:32:01.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.254+0000 7f8b56dff700 1 -- start start 2023-07-27T20:32:01.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.255+0000 7f8b56dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b40003bc0 0x7f8b500c2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:01.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.255+0000 7f8b56dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b50151e10 0x7f8b501459a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:01.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.255+0000 7f8b56dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b500bccc0 0x7f8b50145ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:01.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.255+0000 7f8b56dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b500bf2a0 con 0x7f8b50151e10 2023-07-27T20:32:01.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.255+0000 7f8b56dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b50146420 con 0x7f8b40003bc0 2023-07-27T20:32:01.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.255+0000 7f8b56dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b500c0240 con 0x7f8b500bccc0 2023-07-27T20:32:01.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.255+0000 7f8b4ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b50151e10 0x7f8b501459a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:01.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.255+0000 7f8b4ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b50151e10 0x7f8b501459a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46300/0 (socket says 172.21.15.72:46300) 2023-07-27T20:32:01.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.255+0000 7f8b4ffff700 1 -- 172.21.15.72:0/1302876882 learned_addr learned my addr 172.21.15.72:0/1302876882 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:01.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.255+0000 7f8b54b9b700 1 --2- 172.21.15.72:0/1302876882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b40003bc0 0x7f8b500c2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:01.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.255+0000 7f8b5539c700 1 --2- 172.21.15.72:0/1302876882 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b500bccc0 0x7f8b50145ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:01.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.255+0000 7f8b4ffff700 1 -- 172.21.15.72:0/1302876882 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b500bccc0 msgr2=0x7f8b50145ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:01.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.255+0000 7f8b4ffff700 1 --2- 172.21.15.72:0/1302876882 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b500bccc0 0x7f8b50145ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:01.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.255+0000 7f8b4ffff700 1 -- 172.21.15.72:0/1302876882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b40003bc0 msgr2=0x7f8b500c2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:01.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.255+0000 7f8b4ffff700 1 --2- 172.21.15.72:0/1302876882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b40003bc0 0x7f8b500c2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:01.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.256+0000 7f8b4ffff700 1 -- 172.21.15.72:0/1302876882 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b500c0520 con 0x7f8b50151e10 2023-07-27T20:32:01.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.256+0000 7f8b54b9b700 1 --2- 172.21.15.72:0/1302876882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b40003bc0 0x7f8b500c2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:01.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.256+0000 7f8b4ffff700 1 --2- 172.21.15.72:0/1302876882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b50151e10 0x7f8b501459a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c0119c0 tx=0x7f8b3c011d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:01.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.256+0000 7f8b4d7fa700 1 -- 172.21.15.72:0/1302876882 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c00f940 con 0x7f8b50151e10 2023-07-27T20:32:01.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.256+0000 7f8b4d7fa700 1 -- 172.21.15.72:0/1302876882 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3c00faa0 con 0x7f8b50151e10 2023-07-27T20:32:01.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.256+0000 7f8b4d7fa700 1 -- 172.21.15.72:0/1302876882 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c00fe50 con 0x7f8b50151e10 2023-07-27T20:32:01.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.256+0000 7f8b56dff700 1 -- 172.21.15.72:0/1302876882 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b50156d20 con 0x7f8b50151e10 2023-07-27T20:32:01.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.256+0000 7f8b56dff700 1 -- 172.21.15.72:0/1302876882 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b501572e0 con 0x7f8b50151e10 2023-07-27T20:32:01.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.257+0000 7f8b56dff700 1 -- 172.21.15.72:0/1302876882 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b5004e470 con 0x7f8b50151e10 2023-07-27T20:32:01.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.258+0000 7f8b4d7fa700 1 -- 172.21.15.72:0/1302876882 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8b3c014440 con 0x7f8b50151e10 2023-07-27T20:32:01.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.259+0000 7f8b4d7fa700 1 --2- 172.21.15.72:0/1302876882 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8b3406ace0 0x7f8b3406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:01.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.259+0000 7f8b4d7fa700 1 -- 172.21.15.72:0/1302876882 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8b3c089f80 con 0x7f8b50151e10 2023-07-27T20:32:01.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.260+0000 7f8b54b9b700 1 --2- 172.21.15.72:0/1302876882 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8b3406ace0 0x7f8b3406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:01.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.260+0000 7f8b54b9b700 1 --2- 172.21.15.72:0/1302876882 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8b3406ace0 0x7f8b3406d1a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8b440018b0 tx=0x7f8b44007f90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:01.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.264+0000 7f8b4d7fa700 1 -- 172.21.15.72:0/1302876882 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8b3c058730 con 0x7f8b50151e10 2023-07-27T20:32:01.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.458+0000 7f8b56dff700 1 -- 172.21.15.72:0/1302876882 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8b5014e4a0 con 0x7f8b50151e10 2023-07-27T20:32:01.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.458+0000 7f8b4d7fa700 1 -- 172.21.15.72:0/1302876882 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8b3c0582c0 con 0x7f8b50151e10 2023-07-27T20:32:01.447 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-27T20:32:01.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.461+0000 7f8b56dff700 1 -- 172.21.15.72:0/1302876882 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8b3406ace0 msgr2=0x7f8b3406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:01.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.461+0000 7f8b56dff700 1 --2- 172.21.15.72:0/1302876882 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8b3406ace0 0x7f8b3406d1a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8b440018b0 tx=0x7f8b44007f90 comp rx=0 tx=0).stop 2023-07-27T20:32:01.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.461+0000 7f8b56dff700 1 -- 172.21.15.72:0/1302876882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b50151e10 msgr2=0x7f8b501459a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:01.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.461+0000 7f8b56dff700 1 --2- 172.21.15.72:0/1302876882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b50151e10 0x7f8b501459a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c0119c0 tx=0x7f8b3c011d80 comp rx=0 tx=0).stop 2023-07-27T20:32:01.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.461+0000 7f8b56dff700 1 -- 172.21.15.72:0/1302876882 shutdown_connections 2023-07-27T20:32:01.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.461+0000 7f8b56dff700 1 --2- 172.21.15.72:0/1302876882 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8b3406ace0 0x7f8b3406d1a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:01.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.461+0000 7f8b56dff700 1 --2- 172.21.15.72:0/1302876882 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b500bccc0 0x7f8b50145ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:01.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.461+0000 7f8b56dff700 1 --2- 172.21.15.72:0/1302876882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b40003bc0 0x7f8b500c2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:01.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.461+0000 7f8b56dff700 1 --2- 172.21.15.72:0/1302876882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b50151e10 0x7f8b501459a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:01.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.461+0000 7f8b56dff700 1 -- 172.21.15.72:0/1302876882 >> 172.21.15.72:0/1302876882 conn(0x7f8b500ab3f0 msgr2=0x7f8b500c7de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:01.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.461+0000 7f8b56dff700 1 -- 172.21.15.72:0/1302876882 shutdown_connections 2023-07-27T20:32:01.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.461+0000 7f8b56dff700 1 -- 172.21.15.72:0/1302876882 wait complete. 2023-07-27T20:32:01.467 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-27T20:32:01.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.678+0000 7f17c79ff700 1 Processor -- start 2023-07-27T20:32:01.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.678+0000 7f17c79ff700 1 -- start start 2023-07-27T20:32:01.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.679+0000 7f17c79ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f17c01475a0 0x7f17c01516c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:01.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.679+0000 7f17c79ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c0154f50 con 0x7f17c00c12f0 2023-07-27T20:32:01.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.679+0000 7f17c79ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c0154340 con 0x7f17c00716f0 2023-07-27T20:32:01.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.679+0000 7f17c79ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c0151c00 con 0x7f17c01475a0 2023-07-27T20:32:01.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.679+0000 7f17c579b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f17c01475a0 0x7f17c01516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:01.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.679+0000 7f17c579b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f17c01475a0 0x7f17c01516c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46310/0 (socket says 172.21.15.72:46310) 2023-07-27T20:32:01.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.679+0000 7f17c579b700 1 -- 172.21.15.72:0/1128486847 learned_addr learned my addr 172.21.15.72:0/1128486847 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:01.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.679+0000 7f17c4f9a700 1 --1- 172.21.15.72:0/1128486847 >> v1:172.21.15.72:6789/0 conn(0x7f17c00c12f0 0x7f17c00c1d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52048/0 (socket says 172.21.15.72:52048) 2023-07-27T20:32:01.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.680+0000 7f17c579b700 1 -- 172.21.15.72:0/1128486847 >> v1:172.21.15.173:6789/0 conn(0x7f17c00716f0 legacy=0x7f17c0071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:01.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.680+0000 7f17c579b700 1 -- 172.21.15.72:0/1128486847 >> v1:172.21.15.72:6789/0 conn(0x7f17c00c12f0 legacy=0x7f17c00c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:01.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.680+0000 7f17c579b700 1 -- 172.21.15.72:0/1128486847 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c0154620 con 0x7f17c01475a0 2023-07-27T20:32:01.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.680+0000 7f17c579b700 1 --2- 172.21.15.72:0/1128486847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17c01475a0 0x7f17c01516c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f17bc0098f0 tx=0x7f17bc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b417872098f576d0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:01.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.680+0000 7f17b7fff700 1 -- 172.21.15.72:0/1128486847 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc004230 con 0x7f17c01475a0 2023-07-27T20:32:01.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.680+0000 7f17b7fff700 1 -- 172.21.15.72:0/1128486847 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17bc004390 con 0x7f17c01475a0 2023-07-27T20:32:01.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.680+0000 7f17b7fff700 1 -- 172.21.15.72:0/1128486847 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc0036a0 con 0x7f17c01475a0 2023-07-27T20:32:01.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.681+0000 7f17c79ff700 1 -- 172.21.15.72:0/1128486847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17c01475a0 msgr2=0x7f17c01516c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:01.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.681+0000 7f17c79ff700 1 --2- 172.21.15.72:0/1128486847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17c01475a0 0x7f17c01516c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f17bc0098f0 tx=0x7f17bc009c00 comp rx=0 tx=0).stop 2023-07-27T20:32:01.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.681+0000 7f17c79ff700 1 -- 172.21.15.72:0/1128486847 shutdown_connections 2023-07-27T20:32:01.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.681+0000 7f17c79ff700 1 --2- 172.21.15.72:0/1128486847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17c01475a0 0x7f17c01516c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:01.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.681+0000 7f17c79ff700 1 -- 172.21.15.72:0/1128486847 >> 172.21.15.72:0/1128486847 conn(0x7f17c006a190 msgr2=0x7f17c006a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:01.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.681+0000 7f17c79ff700 1 -- 172.21.15.72:0/1128486847 shutdown_connections 2023-07-27T20:32:01.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.681+0000 7f17c79ff700 1 -- 172.21.15.72:0/1128486847 wait complete. 2023-07-27T20:32:01.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.683+0000 7f17c79ff700 1 Processor -- start 2023-07-27T20:32:01.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.683+0000 7f17c79ff700 1 -- start start 2023-07-27T20:32:01.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.683+0000 7f17c79ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17c00716f0 0x7f17c0151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:01.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.684+0000 7f17c79ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17c00c12f0 0x7f17c01515b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:01.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.684+0000 7f17c79ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f17c01475a0 0x7f17c01ed1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:01.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.684+0000 7f17c79ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c01e75d0 con 0x7f17c00716f0 2023-07-27T20:32:01.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.684+0000 7f17c79ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c0152910 con 0x7f17c00c12f0 2023-07-27T20:32:01.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.684+0000 7f17c79ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c0152bf0 con 0x7f17c01475a0 2023-07-27T20:32:01.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.684+0000 7f17c579b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17c00716f0 0x7f17c0151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:01.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.684+0000 7f17c579b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17c00716f0 0x7f17c0151070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46314/0 (socket says 172.21.15.72:46314) 2023-07-27T20:32:01.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.684+0000 7f17c579b700 1 -- 172.21.15.72:0/137952094 learned_addr learned my addr 172.21.15.72:0/137952094 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:01.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.684+0000 7f17c5f9c700 1 --2- 172.21.15.72:0/137952094 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f17c01475a0 0x7f17c01ed1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:01.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.684+0000 7f17c4f9a700 1 --2- 172.21.15.72:0/137952094 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17c00c12f0 0x7f17c01515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:01.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.684+0000 7f17c579b700 1 -- 172.21.15.72:0/137952094 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f17c01475a0 msgr2=0x7f17c01ed1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:01.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.684+0000 7f17c579b700 1 --2- 172.21.15.72:0/137952094 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f17c01475a0 0x7f17c01ed1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:01.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.684+0000 7f17c579b700 1 -- 172.21.15.72:0/137952094 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17c00c12f0 msgr2=0x7f17c01515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:01.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.684+0000 7f17c579b700 1 --2- 172.21.15.72:0/137952094 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17c00c12f0 0x7f17c01515b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:01.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.684+0000 7f17c579b700 1 -- 172.21.15.72:0/137952094 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17bc009550 con 0x7f17c00716f0 2023-07-27T20:32:01.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.684+0000 7f17c4f9a700 1 --2- 172.21.15.72:0/137952094 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17c00c12f0 0x7f17c01515b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:01.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.684+0000 7f17c5f9c700 1 --2- 172.21.15.72:0/137952094 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f17c01475a0 0x7f17c01ed1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:01.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.684+0000 7f17c579b700 1 --2- 172.21.15.72:0/137952094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17c00716f0 0x7f17c0151070 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f17c00c2b90 tx=0x7f17bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:01.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.685+0000 7f17b5ffb700 1 -- 172.21.15.72:0/137952094 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc003dc0 con 0x7f17c00716f0 2023-07-27T20:32:01.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.685+0000 7f17b5ffb700 1 -- 172.21.15.72:0/137952094 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17bc01f070 con 0x7f17c00716f0 2023-07-27T20:32:01.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.685+0000 7f17c79ff700 1 -- 172.21.15.72:0/137952094 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c0152ed0 con 0x7f17c00716f0 2023-07-27T20:32:01.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.685+0000 7f17b5ffb700 1 -- 172.21.15.72:0/137952094 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc00b8a0 con 0x7f17c00716f0 2023-07-27T20:32:01.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.685+0000 7f17c79ff700 1 -- 172.21.15.72:0/137952094 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c0153490 con 0x7f17c00716f0 2023-07-27T20:32:01.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.686+0000 7f17c79ff700 1 -- 172.21.15.72:0/137952094 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c004e470 con 0x7f17c00716f0 2023-07-27T20:32:01.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.687+0000 7f17b5ffb700 1 -- 172.21.15.72:0/137952094 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f17bc021030 con 0x7f17c00716f0 2023-07-27T20:32:01.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.687+0000 7f17b5ffb700 1 --2- 172.21.15.72:0/137952094 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f17a406ace0 0x7f17a406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:01.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.688+0000 7f17b5ffb700 1 -- 172.21.15.72:0/137952094 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f17bc08af10 con 0x7f17c00716f0 2023-07-27T20:32:01.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.688+0000 7f17c4f9a700 1 --2- 172.21.15.72:0/137952094 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f17a406ace0 0x7f17a406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:01.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.689+0000 7f17c4f9a700 1 --2- 172.21.15.72:0/137952094 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f17a406ace0 0x7f17a406d1a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f17c014b200 tx=0x7f17b0007df0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:01.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.691+0000 7f17b5ffb700 1 -- 172.21.15.72:0/137952094 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f17bc055cc0 con 0x7f17c00716f0 2023-07-27T20:32:01.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.885+0000 7f17c79ff700 1 -- 172.21.15.72:0/137952094 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f17c004e470 con 0x7f17c00716f0 2023-07-27T20:32:01.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.885+0000 7f17b5ffb700 1 -- 172.21.15.72:0/137952094 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f17bc0592e0 con 0x7f17c00716f0 2023-07-27T20:32:01.874 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:32:01.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.888+0000 7f17c79ff700 1 -- 172.21.15.72:0/137952094 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f17a406ace0 msgr2=0x7f17a406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:01.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.888+0000 7f17c79ff700 1 --2- 172.21.15.72:0/137952094 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f17a406ace0 0x7f17a406d1a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f17c014b200 tx=0x7f17b0007df0 comp rx=0 tx=0).stop 2023-07-27T20:32:01.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.888+0000 7f17c79ff700 1 -- 172.21.15.72:0/137952094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17c00716f0 msgr2=0x7f17c0151070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:01.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.888+0000 7f17c79ff700 1 --2- 172.21.15.72:0/137952094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17c00716f0 0x7f17c0151070 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f17c00c2b90 tx=0x7f17bc004750 comp rx=0 tx=0).stop 2023-07-27T20:32:01.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.888+0000 7f17c79ff700 1 -- 172.21.15.72:0/137952094 shutdown_connections 2023-07-27T20:32:01.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.888+0000 7f17c79ff700 1 --2- 172.21.15.72:0/137952094 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f17a406ace0 0x7f17a406d1a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:01.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.888+0000 7f17c79ff700 1 --2- 172.21.15.72:0/137952094 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f17c01475a0 0x7f17c01ed1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:01.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.888+0000 7f17c79ff700 1 --2- 172.21.15.72:0/137952094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17c00716f0 0x7f17c0151070 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:01.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.888+0000 7f17c79ff700 1 --2- 172.21.15.72:0/137952094 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17c00c12f0 0x7f17c01515b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:01.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.888+0000 7f17c79ff700 1 -- 172.21.15.72:0/137952094 >> 172.21.15.72:0/137952094 conn(0x7f17c006a190 msgr2=0x7f17c0145420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:01.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.888+0000 7f17c79ff700 1 -- 172.21.15.72:0/137952094 shutdown_connections 2023-07-27T20:32:01.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:01.888+0000 7f17c79ff700 1 -- 172.21.15.72:0/137952094 wait complete. 2023-07-27T20:32:01.895 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T20:32:02.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.102+0000 7f3ce65ff700 1 Processor -- start 2023-07-27T20:32:02.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.102+0000 7f3ce65ff700 1 -- start start 2023-07-27T20:32:02.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.103+0000 7f3ce65ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3ce00c12d0 0x7f3ce01549f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:02.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.103+0000 7f3ce65ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ce0139d40 con 0x7f3ce0139f80 2023-07-27T20:32:02.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.103+0000 7f3ce65ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ce0151060 con 0x7f3ce0139960 2023-07-27T20:32:02.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.103+0000 7f3ce65ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ce00c0ee0 con 0x7f3ce00c12d0 2023-07-27T20:32:02.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.103+0000 7f3cdf7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3ce0139f80 0x7f3ce01542e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52060/0 (socket says 172.21.15.72:52060) 2023-07-27T20:32:02.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.104+0000 7f3cdf7fe700 1 -- 172.21.15.72:0/2107522398 learned_addr learned my addr 172.21.15.72:0/2107522398 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:02.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.104+0000 7f3ce4b9c700 1 --2- 172.21.15.72:0/2107522398 >> v2:172.21.15.72:3300/0 conn(0x7f3ce00c12d0 0x7f3ce01549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:02.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.104+0000 7f3ce4b9c700 1 -- 172.21.15.72:0/2107522398 >> v1:172.21.15.173:6789/0 conn(0x7f3ce0139960 legacy=0x7f3ce00c1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:02.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.104+0000 7f3ce4b9c700 1 -- 172.21.15.72:0/2107522398 >> v1:172.21.15.72:6789/0 conn(0x7f3ce0139f80 legacy=0x7f3ce01542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:02.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.104+0000 7f3ce4b9c700 1 -- 172.21.15.72:0/2107522398 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce0151340 con 0x7f3ce00c12d0 2023-07-27T20:32:02.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.104+0000 7f3ce4b9c700 1 --2- 172.21.15.72:0/2107522398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ce00c12d0 0x7f3ce01549f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8009d90 tx=0x7f3cd800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d9a0d51035a0515 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:02.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.104+0000 7f3cdeffd700 1 -- 172.21.15.72:0/2107522398 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd800e070 con 0x7f3ce00c12d0 2023-07-27T20:32:02.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.105+0000 7f3cdeffd700 1 -- 172.21.15.72:0/2107522398 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd800bbd0 con 0x7f3ce00c12d0 2023-07-27T20:32:02.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.105+0000 7f3cdeffd700 1 -- 172.21.15.72:0/2107522398 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8012430 con 0x7f3ce00c12d0 2023-07-27T20:32:02.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.105+0000 7f3ce65ff700 1 -- 172.21.15.72:0/2107522398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ce00c12d0 msgr2=0x7f3ce01549f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:02.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.105+0000 7f3ce65ff700 1 --2- 172.21.15.72:0/2107522398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ce00c12d0 0x7f3ce01549f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8009d90 tx=0x7f3cd800b330 comp rx=0 tx=0).stop 2023-07-27T20:32:02.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.105+0000 7f3ce65ff700 1 -- 172.21.15.72:0/2107522398 shutdown_connections 2023-07-27T20:32:02.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.105+0000 7f3ce65ff700 1 --2- 172.21.15.72:0/2107522398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ce00c12d0 0x7f3ce01549f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:02.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.105+0000 7f3ce65ff700 1 -- 172.21.15.72:0/2107522398 >> 172.21.15.72:0/2107522398 conn(0x7f3ce006a190 msgr2=0x7f3ce006a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:02.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.105+0000 7f3ce65ff700 1 -- 172.21.15.72:0/2107522398 shutdown_connections 2023-07-27T20:32:02.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.105+0000 7f3ce65ff700 1 -- 172.21.15.72:0/2107522398 wait complete. 2023-07-27T20:32:02.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.107+0000 7f3ce65ff700 1 Processor -- start 2023-07-27T20:32:02.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.107+0000 7f3ce65ff700 1 -- start start 2023-07-27T20:32:02.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.108+0000 7f3ce65ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ce00c12d0 0x7f3ce00a95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:02.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.108+0000 7f3ce65ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ce0139960 0x7f3ce01e9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:02.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.108+0000 7f3ce65ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ce0139f80 0x7f3ce01e9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:02.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.108+0000 7f3ce65ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce00aa160 con 0x7f3ce0139f80 2023-07-27T20:32:02.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.108+0000 7f3ce65ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce01dd5d0 con 0x7f3ce00c12d0 2023-07-27T20:32:02.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.108+0000 7f3ce65ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce0131ad0 con 0x7f3ce0139960 2023-07-27T20:32:02.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.108+0000 7f3ce4b9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ce0139f80 0x7f3ce01e9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:02.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.108+0000 7f3ce4b9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ce0139f80 0x7f3ce01e9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46334/0 (socket says 172.21.15.72:46334) 2023-07-27T20:32:02.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.108+0000 7f3ce4b9c700 1 -- 172.21.15.72:0/515308506 learned_addr learned my addr 172.21.15.72:0/515308506 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:02.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.108+0000 7f3cdffff700 1 --2- 172.21.15.72:0/515308506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ce00c12d0 0x7f3ce00a95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:02.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.108+0000 7f3cdf7fe700 1 --2- 172.21.15.72:0/515308506 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ce0139960 0x7f3ce01e9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:02.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.109+0000 7f3ce4b9c700 1 -- 172.21.15.72:0/515308506 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ce0139960 msgr2=0x7f3ce01e9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:02.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.109+0000 7f3ce4b9c700 1 --2- 172.21.15.72:0/515308506 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ce0139960 0x7f3ce01e9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:02.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.109+0000 7f3ce4b9c700 1 -- 172.21.15.72:0/515308506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ce00c12d0 msgr2=0x7f3ce00a95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:02.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.109+0000 7f3ce4b9c700 1 --2- 172.21.15.72:0/515308506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ce00c12d0 0x7f3ce00a95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:02.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.109+0000 7f3ce4b9c700 1 -- 172.21.15.72:0/515308506 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd8009a70 con 0x7f3ce0139f80 2023-07-27T20:32:02.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.109+0000 7f3cdffff700 1 --2- 172.21.15.72:0/515308506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ce00c12d0 0x7f3ce00a95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:02.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.109+0000 7f3ce4b9c700 1 --2- 172.21.15.72:0/515308506 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ce0139f80 0x7f3ce01e9b90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8014040 tx=0x7f3cd8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:02.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.109+0000 7f3cdcff9700 1 -- 172.21.15.72:0/515308506 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8012dd0 con 0x7f3ce0139f80 2023-07-27T20:32:02.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.109+0000 7f3cdcff9700 1 -- 172.21.15.72:0/515308506 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd8020070 con 0x7f3ce0139f80 2023-07-27T20:32:02.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.109+0000 7f3ce65ff700 1 -- 172.21.15.72:0/515308506 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ce01ddf80 con 0x7f3ce0139f80 2023-07-27T20:32:02.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.109+0000 7f3cdcff9700 1 -- 172.21.15.72:0/515308506 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8004280 con 0x7f3ce0139f80 2023-07-27T20:32:02.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.109+0000 7f3ce65ff700 1 -- 172.21.15.72:0/515308506 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce00a9b20 con 0x7f3ce0139f80 2023-07-27T20:32:02.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.110+0000 7f3ce65ff700 1 -- 172.21.15.72:0/515308506 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce01dd740 con 0x7f3ce0139f80 2023-07-27T20:32:02.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.111+0000 7f3cdcff9700 1 -- 172.21.15.72:0/515308506 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3cd80043e0 con 0x7f3ce0139f80 2023-07-27T20:32:02.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.113+0000 7f3cdcff9700 1 --2- 172.21.15.72:0/515308506 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3ccc06ace0 0x7f3ccc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:02.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.113+0000 7f3cdcff9700 1 -- 172.21.15.72:0/515308506 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3cd8022070 con 0x7f3ce0139f80 2023-07-27T20:32:02.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.113+0000 7f3cdffff700 1 --2- 172.21.15.72:0/515308506 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3ccc06ace0 0x7f3ccc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:02.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.114+0000 7f3cdffff700 1 --2- 172.21.15.72:0/515308506 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3ccc06ace0 0x7f3ccc06d1a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0000f60 tx=0x7f3cd0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:02.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.117+0000 7f3cdcff9700 1 -- 172.21.15.72:0/515308506 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3ce01dd740 con 0x7f3ce0139f80 2023-07-27T20:32:02.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.352+0000 7f3ce65ff700 1 -- 172.21.15.72:0/515308506 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ce01dd740 con 0x7f3ce0139f80 2023-07-27T20:32:02.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.352+0000 7f3cdcff9700 1 -- 172.21.15.72:0/515308506 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f3ce01dd740 con 0x7f3ce0139f80 2023-07-27T20:32:02.341 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:32:02.341 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/1913374698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1913374698},{"type":"v1","addr":"172.21.15.72:6834","nonce":1913374698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/3260445560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":3260445560},{"type":"v1","addr":"172.21.15.72:6835","nonce":3260445560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1305837931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1305837931},{"type":"v1","addr":"172.21.15.173:6837","nonce":1305837931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T20:31:28.592113+0000","modified":"2023-07-27T20:31:51.217923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6835/516740687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":516740687},{"type":"v1","addr":"172.21.15.173:6835","nonce":516740687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-27T20:32:02.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.354+0000 7f3ce65ff700 1 -- 172.21.15.72:0/515308506 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3ccc06ace0 msgr2=0x7f3ccc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:02.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.355+0000 7f3ce65ff700 1 --2- 172.21.15.72:0/515308506 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3ccc06ace0 0x7f3ccc06d1a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0000f60 tx=0x7f3cd0009040 comp rx=0 tx=0).stop 2023-07-27T20:32:02.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.355+0000 7f3ce65ff700 1 -- 172.21.15.72:0/515308506 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ce0139f80 msgr2=0x7f3ce01e9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:02.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.355+0000 7f3ce65ff700 1 --2- 172.21.15.72:0/515308506 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ce0139f80 0x7f3ce01e9b90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8014040 tx=0x7f3cd8004ad0 comp rx=0 tx=0).stop 2023-07-27T20:32:02.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.355+0000 7f3ce65ff700 1 -- 172.21.15.72:0/515308506 shutdown_connections 2023-07-27T20:32:02.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.355+0000 7f3ce65ff700 1 --2- 172.21.15.72:0/515308506 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ce0139f80 0x7f3ce01e9b90 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:02.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.355+0000 7f3ce65ff700 1 --2- 172.21.15.72:0/515308506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ce00c12d0 0x7f3ce00a95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:02.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.355+0000 7f3ce65ff700 1 --2- 172.21.15.72:0/515308506 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3ccc06ace0 0x7f3ccc06d1a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:02.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.355+0000 7f3ce65ff700 1 --2- 172.21.15.72:0/515308506 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ce0139960 0x7f3ce01e9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:02.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.355+0000 7f3ce65ff700 1 -- 172.21.15.72:0/515308506 >> 172.21.15.72:0/515308506 conn(0x7f3ce006a190 msgr2=0x7f3ce0070e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:02.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.355+0000 7f3ce65ff700 1 -- 172.21.15.72:0/515308506 shutdown_connections 2023-07-27T20:32:02.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.355+0000 7f3ce65ff700 1 -- 172.21.15.72:0/515308506 wait complete. 2023-07-27T20:32:02.345 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 9 2023-07-27T20:32:02.361 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:32:02.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.569+0000 7f540dbff700 1 Processor -- start 2023-07-27T20:32:02.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.569+0000 7f540dbff700 1 -- start start 2023-07-27T20:32:02.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.570+0000 7f540dbff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f540806b150 0x7f54080c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:02.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.571+0000 7f540dbff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f54081549f0 0x7f54081514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:02.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.571+0000 7f540dbff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f540806b710 con 0x7f54080c4400 2023-07-27T20:32:02.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.571+0000 7f540dbff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54081545d0 con 0x7f540806b150 2023-07-27T20:32:02.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.571+0000 7f540dbff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f540806c860 con 0x7f54081549f0 2023-07-27T20:32:02.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.571+0000 7f5406ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f540806b150 0x7f54080c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:02.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.571+0000 7f5406ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f540806b150 0x7f54080c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46350/0 (socket says 172.21.15.72:46350) 2023-07-27T20:32:02.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.571+0000 7f5406ffd700 1 -- 172.21.15.72:0/3639574842 learned_addr learned my addr 172.21.15.72:0/3639574842 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:02.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.571+0000 7f5407fff700 1 --2- 172.21.15.72:0/3639574842 >> v2:172.21.15.173:3300/0 conn(0x7f54081549f0 0x7f54081514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:02.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.571+0000 7f5406ffd700 1 -- 172.21.15.72:0/3639574842 >> v2:172.21.15.173:3300/0 conn(0x7f54081549f0 msgr2=0x7f54081514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:02.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.571+0000 7f5406ffd700 1 --2- 172.21.15.72:0/3639574842 >> v2:172.21.15.173:3300/0 conn(0x7f54081549f0 0x7f54081514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:02.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.571+0000 7f5406ffd700 1 -- 172.21.15.72:0/3639574842 >> v1:172.21.15.173:6789/0 conn(0x7f54080c4400 legacy=0x7f54080c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:02.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.571+0000 7f5406ffd700 1 -- 172.21.15.72:0/3639574842 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540806b9f0 con 0x7f540806b150 2023-07-27T20:32:02.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.572+0000 7f5406ffd700 1 --2- 172.21.15.72:0/3639574842 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f540806b150 0x7f54080c7710 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f54080af950 tx=0x7f53fc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9270d9e6144c604 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:02.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.572+0000 7f54067fc700 1 -- 172.21.15.72:0/3639574842 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc00b870 con 0x7f540806b150 2023-07-27T20:32:02.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.572+0000 7f54067fc700 1 -- 172.21.15.72:0/3639574842 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53fc00b9d0 con 0x7f540806b150 2023-07-27T20:32:02.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.572+0000 7f54067fc700 1 -- 172.21.15.72:0/3639574842 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc00bd60 con 0x7f540806b150 2023-07-27T20:32:02.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.572+0000 7f540dbff700 1 -- 172.21.15.72:0/3639574842 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f540806b150 msgr2=0x7f54080c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:02.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.572+0000 7f540dbff700 1 --2- 172.21.15.72:0/3639574842 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f540806b150 0x7f54080c7710 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f54080af950 tx=0x7f53fc009bd0 comp rx=0 tx=0).stop 2023-07-27T20:32:02.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.573+0000 7f540dbff700 1 -- 172.21.15.72:0/3639574842 shutdown_connections 2023-07-27T20:32:02.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.573+0000 7f540dbff700 1 --2- 172.21.15.72:0/3639574842 >> v2:172.21.15.173:3300/0 conn(0x7f54081549f0 0x7f54081514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:02.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.573+0000 7f540dbff700 1 --2- 172.21.15.72:0/3639574842 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f540806b150 0x7f54080c7710 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:02.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.573+0000 7f540dbff700 1 -- 172.21.15.72:0/3639574842 >> 172.21.15.72:0/3639574842 conn(0x7f54080ab300 msgr2=0x7f54080ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:02.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.573+0000 7f540dbff700 1 -- 172.21.15.72:0/3639574842 shutdown_connections 2023-07-27T20:32:02.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.573+0000 7f540dbff700 1 -- 172.21.15.72:0/3639574842 wait complete. 2023-07-27T20:32:02.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.574+0000 7f540dbff700 1 Processor -- start 2023-07-27T20:32:02.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.574+0000 7f540dbff700 1 -- start start 2023-07-27T20:32:02.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.575+0000 7f540dbff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f540806b150 0x7f54080c7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:02.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.575+0000 7f540dbff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54080c4400 0x7f5408145ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:02.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.575+0000 7f540dbff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54081549f0 0x7f54081461e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:02.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.575+0000 7f540dbff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54080adb30 con 0x7f54081549f0 2023-07-27T20:32:02.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.575+0000 7f540dbff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54080ade10 con 0x7f540806b150 2023-07-27T20:32:02.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.575+0000 7f540dbff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54080ae0f0 con 0x7f54080c4400 2023-07-27T20:32:02.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.575+0000 7f5407fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54081549f0 0x7f54081461e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:02.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.576+0000 7f5407fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54081549f0 0x7f54081461e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46362/0 (socket says 172.21.15.72:46362) 2023-07-27T20:32:02.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.576+0000 7f5407fff700 1 -- 172.21.15.72:0/3931373861 learned_addr learned my addr 172.21.15.72:0/3931373861 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:02.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.576+0000 7f5406ffd700 1 --2- 172.21.15.72:0/3931373861 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54080c4400 0x7f5408145ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:02.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.576+0000 7f54077fe700 1 --2- 172.21.15.72:0/3931373861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f540806b150 0x7f54080c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:02.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.576+0000 7f5407fff700 1 -- 172.21.15.72:0/3931373861 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54080c4400 msgr2=0x7f5408145ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:02.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.576+0000 7f5407fff700 1 --2- 172.21.15.72:0/3931373861 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54080c4400 0x7f5408145ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:02.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.576+0000 7f5407fff700 1 -- 172.21.15.72:0/3931373861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f540806b150 msgr2=0x7f54080c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:02.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.576+0000 7f5407fff700 1 --2- 172.21.15.72:0/3931373861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f540806b150 0x7f54080c7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:02.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.576+0000 7f5407fff700 1 -- 172.21.15.72:0/3931373861 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53fc009550 con 0x7f54081549f0 2023-07-27T20:32:02.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.576+0000 7f54077fe700 1 --2- 172.21.15.72:0/3931373861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f540806b150 0x7f54080c7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:32:02.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.576+0000 7f5407fff700 1 --2- 172.21.15.72:0/3931373861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54081549f0 0x7f54081461e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5400007e60 tx=0x7f540000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:02.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.576+0000 7f53effff700 1 -- 172.21.15.72:0/3931373861 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540000ede0 con 0x7f54081549f0 2023-07-27T20:32:02.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.576+0000 7f53effff700 1 -- 172.21.15.72:0/3931373861 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5400014420 con 0x7f54081549f0 2023-07-27T20:32:02.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.576+0000 7f53effff700 1 -- 172.21.15.72:0/3931373861 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54000147d0 con 0x7f54081549f0 2023-07-27T20:32:02.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.576+0000 7f540dbff700 1 -- 172.21.15.72:0/3931373861 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54080c7ad0 con 0x7f54081549f0 2023-07-27T20:32:02.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.577+0000 7f540dbff700 1 -- 172.21.15.72:0/3931373861 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5408146720 con 0x7f54081549f0 2023-07-27T20:32:02.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.577+0000 7f540dbff700 1 -- 172.21.15.72:0/3931373861 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5408074310 con 0x7f54081549f0 2023-07-27T20:32:02.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.578+0000 7f53effff700 1 -- 172.21.15.72:0/3931373861 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5400014930 con 0x7f54081549f0 2023-07-27T20:32:02.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.580+0000 7f53effff700 1 --2- 172.21.15.72:0/3931373861 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f53f406ad10 0x7f53f406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:02.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.580+0000 7f53effff700 1 -- 172.21.15.72:0/3931373861 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5400089fa0 con 0x7f54081549f0 2023-07-27T20:32:02.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.580+0000 7f54077fe700 1 --2- 172.21.15.72:0/3931373861 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f53f406ad10 0x7f53f406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:02.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.581+0000 7f54077fe700 1 --2- 172.21.15.72:0/3931373861 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f53f406ad10 0x7f53f406d1d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f53f8000f60 tx=0x7f53f8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:02.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.584+0000 7f53effff700 1 -- 172.21.15.72:0/3931373861 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5400054d70 con 0x7f54081549f0 2023-07-27T20:32:02.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.781+0000 7f540dbff700 1 -- 172.21.15.72:0/3931373861 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54080adc70 con 0x7f54081549f0 2023-07-27T20:32:02.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.783+0000 7f53effff700 1 -- 172.21.15.72:0/3931373861 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20120 (secure 0 0 0) 0x7f54080adc70 con 0x7f54081549f0 2023-07-27T20:32:02.772 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:32:02.772 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:31:33.647304+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:31:27.020951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T20:31:27.566022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-27T20:31:31.182401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:32:02.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.785+0000 7f540dbff700 1 -- 172.21.15.72:0/3931373861 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f53f406ad10 msgr2=0x7f53f406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:02.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.785+0000 7f540dbff700 1 --2- 172.21.15.72:0/3931373861 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f53f406ad10 0x7f53f406d1d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f53f8000f60 tx=0x7f53f8009040 comp rx=0 tx=0).stop 2023-07-27T20:32:02.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.785+0000 7f540dbff700 1 -- 172.21.15.72:0/3931373861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54081549f0 msgr2=0x7f54081461e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:02.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.785+0000 7f540dbff700 1 --2- 172.21.15.72:0/3931373861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54081549f0 0x7f54081461e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5400007e60 tx=0x7f540000e3c0 comp rx=0 tx=0).stop 2023-07-27T20:32:02.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.785+0000 7f540dbff700 1 -- 172.21.15.72:0/3931373861 shutdown_connections 2023-07-27T20:32:02.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.785+0000 7f540dbff700 1 --2- 172.21.15.72:0/3931373861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54081549f0 0x7f54081461e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:02.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.785+0000 7f540dbff700 1 --2- 172.21.15.72:0/3931373861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f540806b150 0x7f54080c7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:02.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.785+0000 7f540dbff700 1 --2- 172.21.15.72:0/3931373861 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f53f406ad10 0x7f53f406d1d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:02.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.785+0000 7f540dbff700 1 --2- 172.21.15.72:0/3931373861 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54080c4400 0x7f5408145ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:02.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.785+0000 7f540dbff700 1 -- 172.21.15.72:0/3931373861 >> 172.21.15.72:0/3931373861 conn(0x7f54080ab300 msgr2=0x7f5408151270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:02.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.785+0000 7f540dbff700 1 -- 172.21.15.72:0/3931373861 shutdown_connections 2023-07-27T20:32:02.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:02.785+0000 7f540dbff700 1 -- 172.21.15.72:0/3931373861 wait complete. 2023-07-27T20:32:02.792 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-27T20:31:14.581785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T20:31:21.077941+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T20:31:27.020951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T20:31:27.566022+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-27T20:31:31.182401+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-27T20:32:02.793 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-27T20:32:02.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.003+0000 7fcc851ff700 1 Processor -- start 2023-07-27T20:32:02.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.004+0000 7fcc851ff700 1 -- start start 2023-07-27T20:32:02.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.005+0000 7fcc851ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcc8014aab0 0x7fcc80154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:02.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.005+0000 7fcc851ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc800c7c50 con 0x7fcc800c7740 2023-07-27T20:32:02.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.005+0000 7fcc851ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc8006bd40 con 0x7fcc8006c1d0 2023-07-27T20:32:02.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.005+0000 7fcc851ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc800c62f0 con 0x7fcc8014aab0 2023-07-27T20:32:02.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.005+0000 7fcc77fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fcc800c7740 0x7fcc800c41c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52076/0 (socket says 172.21.15.72:52076) 2023-07-27T20:32:02.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.005+0000 7fcc77fff700 1 -- 172.21.15.72:0/411492529 learned_addr learned my addr 172.21.15.72:0/411492529 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:02.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.005+0000 7fcc7ed9d700 1 --2- 172.21.15.72:0/411492529 >> v2:172.21.15.173:3300/0 conn(0x7fcc8014aab0 0x7fcc80154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:02.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.005+0000 7fcc7e59c700 1 -- 172.21.15.72:0/411492529 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3330925500 0 0) 0x7fcc800c7c50 con 0x7fcc800c7740 2023-07-27T20:32:02.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.006+0000 7fcc7e59c700 1 -- 172.21.15.72:0/411492529 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc6c0035b0 con 0x7fcc800c7740 2023-07-27T20:32:02.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.006+0000 7fcc7ed9d700 1 -- 172.21.15.72:0/411492529 >> v1:172.21.15.173:6789/0 conn(0x7fcc8006c1d0 legacy=0x7fcc8006c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:02.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.006+0000 7fcc7ed9d700 1 -- 172.21.15.72:0/411492529 >> v1:172.21.15.72:6789/0 conn(0x7fcc800c7740 legacy=0x7fcc800c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:02.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.006+0000 7fcc7ed9d700 1 -- 172.21.15.72:0/411492529 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc8006cd00 con 0x7fcc8014aab0 2023-07-27T20:32:02.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.006+0000 7fcc7ed9d700 1 --2- 172.21.15.72:0/411492529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc8014aab0 0x7fcc80154b10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcc70009840 tx=0x7fcc70009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f15c58ca063a9e4 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:02.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.006+0000 7fcc7e59c700 1 -- 172.21.15.72:0/411492529 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc70011830 con 0x7fcc8014aab0 2023-07-27T20:32:02.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.006+0000 7fcc7e59c700 1 -- 172.21.15.72:0/411492529 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc70011990 con 0x7fcc8014aab0 2023-07-27T20:32:02.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.006+0000 7fcc7e59c700 1 -- 172.21.15.72:0/411492529 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc70011d20 con 0x7fcc8014aab0 2023-07-27T20:32:02.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.007+0000 7fcc851ff700 1 -- 172.21.15.72:0/411492529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc8014aab0 msgr2=0x7fcc80154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:02.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.007+0000 7fcc851ff700 1 --2- 172.21.15.72:0/411492529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc8014aab0 0x7fcc80154b10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcc70009840 tx=0x7fcc70009b50 comp rx=0 tx=0).stop 2023-07-27T20:32:02.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.007+0000 7fcc851ff700 1 -- 172.21.15.72:0/411492529 shutdown_connections 2023-07-27T20:32:02.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.007+0000 7fcc851ff700 1 --2- 172.21.15.72:0/411492529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc8014aab0 0x7fcc80154b10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:02.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.007+0000 7fcc851ff700 1 -- 172.21.15.72:0/411492529 >> 172.21.15.72:0/411492529 conn(0x7fcc800ab3f0 msgr2=0x7fcc800ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:02.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.007+0000 7fcc851ff700 1 -- 172.21.15.72:0/411492529 shutdown_connections 2023-07-27T20:32:02.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.007+0000 7fcc851ff700 1 -- 172.21.15.72:0/411492529 wait complete. 2023-07-27T20:32:02.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.009+0000 7fcc851ff700 1 Processor -- start 2023-07-27T20:32:02.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.009+0000 7fcc851ff700 1 -- start start 2023-07-27T20:32:03.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.010+0000 7fcc851ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc8006c1d0 0x7fcc801e98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:03.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.010+0000 7fcc851ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcc800c7740 0x7fcc80155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:03.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.010+0000 7fcc851ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc8014aab0 0x7fcc80157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:03.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.010+0000 7fcc851ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc801567e0 con 0x7fcc8014aab0 2023-07-27T20:32:03.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.010+0000 7fcc851ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8014dfc0 con 0x7fcc8006c1d0 2023-07-27T20:32:03.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.010+0000 7fcc851ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc80155b60 con 0x7fcc800c7740 2023-07-27T20:32:03.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.010+0000 7fcc7f59e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc8014aab0 0x7fcc80157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:03.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.010+0000 7fcc7ed9d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc8006c1d0 0x7fcc801e98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:03.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.010+0000 7fcc7f59e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc8014aab0 0x7fcc80157c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46370/0 (socket says 172.21.15.72:46370) 2023-07-27T20:32:03.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.010+0000 7fcc7f59e700 1 -- 172.21.15.72:0/2957985959 learned_addr learned my addr 172.21.15.72:0/2957985959 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:03.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.010+0000 7fcc77fff700 1 --2- 172.21.15.72:0/2957985959 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcc800c7740 0x7fcc80155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:03.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.010+0000 7fcc7f59e700 1 -- 172.21.15.72:0/2957985959 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcc800c7740 msgr2=0x7fcc80155460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:03.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.010+0000 7fcc7f59e700 1 --2- 172.21.15.72:0/2957985959 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcc800c7740 0x7fcc80155460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:03.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.010+0000 7fcc7f59e700 1 -- 172.21.15.72:0/2957985959 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc8006c1d0 msgr2=0x7fcc801e98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:03.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.010+0000 7fcc7f59e700 1 --2- 172.21.15.72:0/2957985959 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc8006c1d0 0x7fcc801e98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:03.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.010+0000 7fcc7f59e700 1 -- 172.21.15.72:0/2957985959 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc700094a0 con 0x7fcc8014aab0 2023-07-27T20:32:03.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.010+0000 7fcc7ed9d700 1 --2- 172.21.15.72:0/2957985959 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc8006c1d0 0x7fcc801e98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:32:03.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.011+0000 7fcc7f59e700 1 --2- 172.21.15.72:0/2957985959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc8014aab0 0x7fcc80157c80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcc7800cc50 tx=0x7fcc7800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:03.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.011+0000 7fcc777fe700 1 -- 172.21.15.72:0/2957985959 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc78003c00 con 0x7fcc8014aab0 2023-07-27T20:32:03.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.011+0000 7fcc777fe700 1 -- 172.21.15.72:0/2957985959 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc78003d60 con 0x7fcc8014aab0 2023-07-27T20:32:03.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.011+0000 7fcc777fe700 1 -- 172.21.15.72:0/2957985959 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7800aab0 con 0x7fcc8014aab0 2023-07-27T20:32:03.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.011+0000 7fcc851ff700 1 -- 172.21.15.72:0/2957985959 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc80155e40 con 0x7fcc8014aab0 2023-07-27T20:32:03.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.011+0000 7fcc851ff700 1 -- 172.21.15.72:0/2957985959 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc80156400 con 0x7fcc8014aab0 2023-07-27T20:32:03.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.012+0000 7fcc851ff700 1 -- 172.21.15.72:0/2957985959 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc80156920 con 0x7fcc8014aab0 2023-07-27T20:32:03.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.013+0000 7fcc777fe700 1 -- 172.21.15.72:0/2957985959 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcc7800ac10 con 0x7fcc8014aab0 2023-07-27T20:32:03.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.014+0000 7fcc777fe700 1 --2- 172.21.15.72:0/2957985959 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcc6006ace0 0x7fcc6006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:03.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.014+0000 7fcc777fe700 1 -- 172.21.15.72:0/2957985959 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcc78089710 con 0x7fcc8014aab0 2023-07-27T20:32:03.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.014+0000 7fcc7ed9d700 1 --2- 172.21.15.72:0/2957985959 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcc6006ace0 0x7fcc6006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:03.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.015+0000 7fcc7ed9d700 1 --2- 172.21.15.72:0/2957985959 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcc6006ace0 0x7fcc6006d1a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcc700090b0 tx=0x7fcc7001c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:03.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.018+0000 7fcc777fe700 1 -- 172.21.15.72:0/2957985959 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcc80156920 con 0x7fcc8014aab0 2023-07-27T20:32:03.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.209+0000 7fcc851ff700 1 -- 172.21.15.72:0/2957985959 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcc80156920 con 0x7fcc8014aab0 2023-07-27T20:32:03.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.210+0000 7fcc777fe700 1 -- 172.21.15.72:0/2957985959 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcc80156920 con 0x7fcc8014aab0 2023-07-27T20:32:03.199 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-27T20:32:03.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.212+0000 7fcc851ff700 1 -- 172.21.15.72:0/2957985959 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcc6006ace0 msgr2=0x7fcc6006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:03.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.212+0000 7fcc851ff700 1 --2- 172.21.15.72:0/2957985959 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcc6006ace0 0x7fcc6006d1a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcc700090b0 tx=0x7fcc7001c040 comp rx=0 tx=0).stop 2023-07-27T20:32:03.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.212+0000 7fcc851ff700 1 -- 172.21.15.72:0/2957985959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc8014aab0 msgr2=0x7fcc80157c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:03.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.212+0000 7fcc851ff700 1 --2- 172.21.15.72:0/2957985959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc8014aab0 0x7fcc80157c80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcc7800cc50 tx=0x7fcc7800cf60 comp rx=0 tx=0).stop 2023-07-27T20:32:03.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.212+0000 7fcc851ff700 1 -- 172.21.15.72:0/2957985959 shutdown_connections 2023-07-27T20:32:03.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.212+0000 7fcc851ff700 1 --2- 172.21.15.72:0/2957985959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc8014aab0 0x7fcc80157c80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:03.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.212+0000 7fcc851ff700 1 --2- 172.21.15.72:0/2957985959 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc8006c1d0 0x7fcc801e98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:03.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.212+0000 7fcc851ff700 1 --2- 172.21.15.72:0/2957985959 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcc6006ace0 0x7fcc6006d1a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:03.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.212+0000 7fcc851ff700 1 --2- 172.21.15.72:0/2957985959 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcc800c7740 0x7fcc80155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:03.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.212+0000 7fcc851ff700 1 -- 172.21.15.72:0/2957985959 >> 172.21.15.72:0/2957985959 conn(0x7fcc800ab3f0 msgr2=0x7fcc80148b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:03.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.212+0000 7fcc851ff700 1 -- 172.21.15.72:0/2957985959 shutdown_connections 2023-07-27T20:32:03.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.212+0000 7fcc851ff700 1 -- 172.21.15.72:0/2957985959 wait complete. 2023-07-27T20:32:03.218 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T20:32:03.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.432+0000 7f8454dff700 1 Processor -- start 2023-07-27T20:32:03.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.432+0000 7f8454dff700 1 -- start start 2023-07-27T20:32:03.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.433+0000 7f8454dff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f84500c7740 0x7f84500c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:03.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.433+0000 7f8454dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f84500c4700 0x7f845006c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:03.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.433+0000 7f8454dff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84500c7c50 con 0x7f845014aab0 2023-07-27T20:32:03.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.433+0000 7f8454dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f845006bd40 con 0x7f84500c4700 2023-07-27T20:32:03.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.433+0000 7f8454dff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84500c62f0 con 0x7f84500c7740 2023-07-27T20:32:03.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.433+0000 7f844ed9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f84500c4700 0x7f845006c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:03.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.433+0000 7f844ed9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f84500c4700 0x7f845006c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46384/0 (socket says 172.21.15.72:46384) 2023-07-27T20:32:03.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.433+0000 7f844ed9d700 1 -- 172.21.15.72:0/63289081 learned_addr learned my addr 172.21.15.72:0/63289081 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:03.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.433+0000 7f844dd9b700 1 --2- 172.21.15.72:0/63289081 >> v2:172.21.15.173:3300/0 conn(0x7f84500c7740 0x7f84500c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:03.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.434+0000 7f844ed9d700 1 -- 172.21.15.72:0/63289081 >> v2:172.21.15.173:3300/0 conn(0x7f84500c7740 msgr2=0x7f84500c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:03.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.434+0000 7f844ed9d700 1 --2- 172.21.15.72:0/63289081 >> v2:172.21.15.173:3300/0 conn(0x7f84500c7740 0x7f84500c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:03.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.434+0000 7f844ed9d700 1 -- 172.21.15.72:0/63289081 >> v1:172.21.15.173:6789/0 conn(0x7f845014aab0 legacy=0x7f8450154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:03.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.434+0000 7f844ed9d700 1 -- 172.21.15.72:0/63289081 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845006d200 con 0x7f84500c4700 2023-07-27T20:32:03.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.434+0000 7f844ed9d700 1 --2- 172.21.15.72:0/63289081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84500c4700 0x7f845006c1d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f84500a9090 tx=0x7f844800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f3338e4bb03174 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:03.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.434+0000 7f844d59a700 1 -- 172.21.15.72:0/63289081 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844800e070 con 0x7f84500c4700 2023-07-27T20:32:03.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.434+0000 7f844d59a700 1 -- 172.21.15.72:0/63289081 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844800b910 con 0x7f84500c4700 2023-07-27T20:32:03.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.434+0000 7f844d59a700 1 -- 172.21.15.72:0/63289081 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844800bcc0 con 0x7f84500c4700 2023-07-27T20:32:03.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.435+0000 7f8454dff700 1 -- 172.21.15.72:0/63289081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84500c4700 msgr2=0x7f845006c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:03.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.435+0000 7f8454dff700 1 --2- 172.21.15.72:0/63289081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84500c4700 0x7f845006c1d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f84500a9090 tx=0x7f844800b330 comp rx=0 tx=0).stop 2023-07-27T20:32:03.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.435+0000 7f8454dff700 1 -- 172.21.15.72:0/63289081 shutdown_connections 2023-07-27T20:32:03.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.435+0000 7f8454dff700 1 --2- 172.21.15.72:0/63289081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84500c4700 0x7f845006c1d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:03.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.435+0000 7f8454dff700 1 --2- 172.21.15.72:0/63289081 >> v2:172.21.15.173:3300/0 conn(0x7f84500c7740 0x7f84500c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:03.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.435+0000 7f8454dff700 1 -- 172.21.15.72:0/63289081 >> 172.21.15.72:0/63289081 conn(0x7f84500ab3f0 msgr2=0x7f84500ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:03.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.435+0000 7f8454dff700 1 -- 172.21.15.72:0/63289081 shutdown_connections 2023-07-27T20:32:03.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.435+0000 7f8454dff700 1 -- 172.21.15.72:0/63289081 wait complete. 2023-07-27T20:32:03.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.437+0000 7f8454dff700 1 Processor -- start 2023-07-27T20:32:03.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.437+0000 7f8454dff700 1 -- start start 2023-07-27T20:32:03.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.438+0000 7f8454dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84500c4700 0x7f84501ed1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:03.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.438+0000 7f8454dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84500c7740 0x7f8450147c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:03.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.438+0000 7f8454dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f845014aab0 0x7f8450148180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:03.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.438+0000 7f8454dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845014f250 con 0x7f84500c4700 2023-07-27T20:32:03.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.438+0000 7f8454dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845014ec20 con 0x7f845014aab0 2023-07-27T20:32:03.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.438+0000 7f8454dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84501ed9e0 con 0x7f84500c7740 2023-07-27T20:32:03.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.438+0000 7f844e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84500c4700 0x7f84501ed1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:03.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.438+0000 7f844e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84500c4700 0x7f84501ed1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46398/0 (socket says 172.21.15.72:46398) 2023-07-27T20:32:03.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.438+0000 7f844e59c700 1 -- 172.21.15.72:0/4094823170 learned_addr learned my addr 172.21.15.72:0/4094823170 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:03.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.438+0000 7f844dd9b700 1 --2- 172.21.15.72:0/4094823170 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84500c7740 0x7f8450147c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:03.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.438+0000 7f844ed9d700 1 --2- 172.21.15.72:0/4094823170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f845014aab0 0x7f8450148180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:03.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.438+0000 7f844e59c700 1 -- 172.21.15.72:0/4094823170 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84500c7740 msgr2=0x7f8450147c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:03.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.438+0000 7f844e59c700 1 --2- 172.21.15.72:0/4094823170 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84500c7740 0x7f8450147c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:03.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.438+0000 7f844e59c700 1 -- 172.21.15.72:0/4094823170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f845014aab0 msgr2=0x7f8450148180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:03.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.438+0000 7f844e59c700 1 --2- 172.21.15.72:0/4094823170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f845014aab0 0x7f8450148180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:03.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.438+0000 7f844e59c700 1 -- 172.21.15.72:0/4094823170 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8448009b30 con 0x7f84500c4700 2023-07-27T20:32:03.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.439+0000 7f844e59c700 1 --2- 172.21.15.72:0/4094823170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84500c4700 0x7f84501ed1a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f844000c450 tx=0x7f844000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:03.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.439+0000 7f843effd700 1 -- 172.21.15.72:0/4094823170 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84400052d0 con 0x7f84500c4700 2023-07-27T20:32:03.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.439+0000 7f843effd700 1 -- 172.21.15.72:0/4094823170 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8440005430 con 0x7f84500c4700 2023-07-27T20:32:03.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.439+0000 7f843effd700 1 -- 172.21.15.72:0/4094823170 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84400038c0 con 0x7f84500c4700 2023-07-27T20:32:03.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.439+0000 7f8454dff700 1 -- 172.21.15.72:0/4094823170 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84501edcc0 con 0x7f84500c4700 2023-07-27T20:32:03.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.439+0000 7f8454dff700 1 -- 172.21.15.72:0/4094823170 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84501ed6e0 con 0x7f84500c4700 2023-07-27T20:32:03.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.440+0000 7f8454dff700 1 -- 172.21.15.72:0/4094823170 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f845014f390 con 0x7f84500c4700 2023-07-27T20:32:03.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.441+0000 7f843effd700 1 -- 172.21.15.72:0/4094823170 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8440003a20 con 0x7f84500c4700 2023-07-27T20:32:03.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.442+0000 7f843effd700 1 --2- 172.21.15.72:0/4094823170 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f843006ace0 0x7f843006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:03.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.442+0000 7f843effd700 1 -- 172.21.15.72:0/4094823170 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8440088a80 con 0x7f84500c4700 2023-07-27T20:32:03.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.442+0000 7f844dd9b700 1 --2- 172.21.15.72:0/4094823170 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f843006ace0 0x7f843006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:03.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.443+0000 7f844dd9b700 1 --2- 172.21.15.72:0/4094823170 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f843006ace0 0x7f843006d1a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f845014e430 tx=0x7f8444009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:03.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.446+0000 7f843effd700 1 -- 172.21.15.72:0/4094823170 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8440053830 con 0x7f84500c4700 2023-07-27T20:32:03.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.638+0000 7f8454dff700 1 -- 172.21.15.72:0/4094823170 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f845004e470 con 0x7f84500c4700 2023-07-27T20:32:03.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.638+0000 7f843effd700 1 -- 172.21.15.72:0/4094823170 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f844000ce60 con 0x7f84500c4700 2023-07-27T20:32:03.627 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-27T20:32:03.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.641+0000 7f8454dff700 1 -- 172.21.15.72:0/4094823170 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f843006ace0 msgr2=0x7f843006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:03.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.641+0000 7f8454dff700 1 --2- 172.21.15.72:0/4094823170 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f843006ace0 0x7f843006d1a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f845014e430 tx=0x7f8444009210 comp rx=0 tx=0).stop 2023-07-27T20:32:03.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.641+0000 7f8454dff700 1 -- 172.21.15.72:0/4094823170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84500c4700 msgr2=0x7f84501ed1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:03.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.641+0000 7f8454dff700 1 --2- 172.21.15.72:0/4094823170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84500c4700 0x7f84501ed1a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f844000c450 tx=0x7f844000c760 comp rx=0 tx=0).stop 2023-07-27T20:32:03.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.641+0000 7f8454dff700 1 -- 172.21.15.72:0/4094823170 shutdown_connections 2023-07-27T20:32:03.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.641+0000 7f8454dff700 1 --2- 172.21.15.72:0/4094823170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f845014aab0 0x7f8450148180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:03.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.641+0000 7f8454dff700 1 --2- 172.21.15.72:0/4094823170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84500c4700 0x7f84501ed1a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:03.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.641+0000 7f8454dff700 1 --2- 172.21.15.72:0/4094823170 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f843006ace0 0x7f843006d1a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:03.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.641+0000 7f8454dff700 1 --2- 172.21.15.72:0/4094823170 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84500c7740 0x7f8450147c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:03.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.641+0000 7f8454dff700 1 -- 172.21.15.72:0/4094823170 >> 172.21.15.72:0/4094823170 conn(0x7f84500ab3f0 msgr2=0x7f8450151c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:03.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.641+0000 7f8454dff700 1 -- 172.21.15.72:0/4094823170 shutdown_connections 2023-07-27T20:32:03.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.641+0000 7f8454dff700 1 -- 172.21.15.72:0/4094823170 wait complete. 2023-07-27T20:32:03.647 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T20:32:03.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.856+0000 7fceef3ff700 1 Processor -- start 2023-07-27T20:32:03.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.856+0000 7fceef3ff700 1 -- start start 2023-07-27T20:32:03.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.857+0000 7fceef3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcee80c7740 0x7fcee80c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:03.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.857+0000 7fceef3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcee80c7c50 con 0x7fcee814aab0 2023-07-27T20:32:03.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.858+0000 7fceef3ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcee806bd40 con 0x7fcee80c4700 2023-07-27T20:32:03.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.858+0000 7fceef3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcee80c62f0 con 0x7fcee80c7740 2023-07-27T20:32:03.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.858+0000 7fceec99a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcee80c7740 0x7fcee80c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:03.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.858+0000 7fceed19b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fcee814aab0 0x7fcee8154b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52092/0 (socket says 172.21.15.72:52092) 2023-07-27T20:32:03.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.858+0000 7fceed19b700 1 -- 172.21.15.72:0/2657100499 learned_addr learned my addr 172.21.15.72:0/2657100499 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:03.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.858+0000 7fcedffff700 1 -- 172.21.15.72:0/2657100499 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 87702520 0 0) 0x7fcee80c7c50 con 0x7fcee814aab0 2023-07-27T20:32:03.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.858+0000 7fcedffff700 1 -- 172.21.15.72:0/2657100499 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fced40035b0 con 0x7fcee814aab0 2023-07-27T20:32:03.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.858+0000 7fceec99a700 1 -- 172.21.15.72:0/2657100499 >> v1:172.21.15.173:6789/0 conn(0x7fcee80c4700 legacy=0x7fcee806c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:03.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.858+0000 7fceec99a700 1 -- 172.21.15.72:0/2657100499 >> v1:172.21.15.72:6789/0 conn(0x7fcee814aab0 legacy=0x7fcee8154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:03.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.858+0000 7fceec99a700 1 -- 172.21.15.72:0/2657100499 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee806d200 con 0x7fcee80c7740 2023-07-27T20:32:03.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.859+0000 7fceec99a700 1 --2- 172.21.15.72:0/2657100499 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcee80c7740 0x7fcee80c41c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fced8009840 tx=0x7fced8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf56f3854dc2868c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:03.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.859+0000 7fcedffff700 1 -- 172.21.15.72:0/2657100499 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced8011830 con 0x7fcee80c7740 2023-07-27T20:32:03.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.859+0000 7fcedffff700 1 -- 172.21.15.72:0/2657100499 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced8011990 con 0x7fcee80c7740 2023-07-27T20:32:03.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.859+0000 7fcedffff700 1 -- 172.21.15.72:0/2657100499 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced8011d20 con 0x7fcee80c7740 2023-07-27T20:32:03.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.859+0000 7fceef3ff700 1 -- 172.21.15.72:0/2657100499 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcee80c7740 msgr2=0x7fcee80c41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:03.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.859+0000 7fceef3ff700 1 --2- 172.21.15.72:0/2657100499 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcee80c7740 0x7fcee80c41c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fced8009840 tx=0x7fced8009b50 comp rx=0 tx=0).stop 2023-07-27T20:32:03.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.859+0000 7fceef3ff700 1 -- 172.21.15.72:0/2657100499 shutdown_connections 2023-07-27T20:32:03.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.859+0000 7fceef3ff700 1 --2- 172.21.15.72:0/2657100499 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcee80c7740 0x7fcee80c41c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:03.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.859+0000 7fceef3ff700 1 -- 172.21.15.72:0/2657100499 >> 172.21.15.72:0/2657100499 conn(0x7fcee80ab3f0 msgr2=0x7fcee80ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:03.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.859+0000 7fceef3ff700 1 -- 172.21.15.72:0/2657100499 shutdown_connections 2023-07-27T20:32:03.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.859+0000 7fceef3ff700 1 -- 172.21.15.72:0/2657100499 wait complete. 2023-07-27T20:32:03.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.861+0000 7fceef3ff700 1 Processor -- start 2023-07-27T20:32:03.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.861+0000 7fceef3ff700 1 -- start start 2023-07-27T20:32:03.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.862+0000 7fceef3ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcee80c4700 0x7fcee81ece00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:03.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.862+0000 7fceef3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcee80c7740 0x7fcee8148ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:03.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.862+0000 7fceef3ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcee814aab0 0x7fcee8148ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:03.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.862+0000 7fceef3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee8149530 con 0x7fcee80c7740 2023-07-27T20:32:03.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.862+0000 7fceef3ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee81eaa90 con 0x7fcee80c4700 2023-07-27T20:32:03.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.862+0000 7fceef3ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee81eb330 con 0x7fcee814aab0 2023-07-27T20:32:03.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.862+0000 7fceec99a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcee80c7740 0x7fcee8148ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:03.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.862+0000 7fceec99a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcee80c7740 0x7fcee8148ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46410/0 (socket says 172.21.15.72:46410) 2023-07-27T20:32:03.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.862+0000 7fceec99a700 1 -- 172.21.15.72:0/2314215851 learned_addr learned my addr 172.21.15.72:0/2314215851 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:03.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.863+0000 7fceec99a700 1 -- 172.21.15.72:0/2314215851 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcee814aab0 msgr2=0x7fcee8148ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:03.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.863+0000 7fceed19b700 1 --2- 172.21.15.72:0/2314215851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcee80c4700 0x7fcee81ece00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:03.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.863+0000 7fceec99a700 1 --2- 172.21.15.72:0/2314215851 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcee814aab0 0x7fcee8148ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:03.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.863+0000 7fceec99a700 1 -- 172.21.15.72:0/2314215851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcee80c4700 msgr2=0x7fcee81ece00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:03.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.863+0000 7fceec99a700 1 --2- 172.21.15.72:0/2314215851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcee80c4700 0x7fcee81ece00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:03.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.863+0000 7fceec99a700 1 -- 172.21.15.72:0/2314215851 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced80094a0 con 0x7fcee80c7740 2023-07-27T20:32:03.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.863+0000 7fceed19b700 1 --2- 172.21.15.72:0/2314215851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcee80c4700 0x7fcee81ece00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:32:03.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.863+0000 7fceec99a700 1 --2- 172.21.15.72:0/2314215851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcee80c7740 0x7fcee8148ab0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fced80090b0 tx=0x7fced8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:03.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.863+0000 7fceddffb700 1 -- 172.21.15.72:0/2314215851 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced80038a0 con 0x7fcee80c7740 2023-07-27T20:32:03.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.863+0000 7fceddffb700 1 -- 172.21.15.72:0/2314215851 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced801f070 con 0x7fcee80c7740 2023-07-27T20:32:03.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.863+0000 7fceddffb700 1 -- 172.21.15.72:0/2314215851 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced8003c40 con 0x7fcee80c7740 2023-07-27T20:32:03.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.863+0000 7fceef3ff700 1 -- 172.21.15.72:0/2314215851 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcee81ed910 con 0x7fcee80c7740 2023-07-27T20:32:03.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.863+0000 7fceef3ff700 1 -- 172.21.15.72:0/2314215851 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcee81eafc0 con 0x7fcee80c7740 2023-07-27T20:32:03.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.864+0000 7fceef3ff700 1 -- 172.21.15.72:0/2314215851 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcee804e470 con 0x7fcee80c7740 2023-07-27T20:32:03.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.865+0000 7fceddffb700 1 -- 172.21.15.72:0/2314215851 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fced8026480 con 0x7fcee80c7740 2023-07-27T20:32:03.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.866+0000 7fceddffb700 1 --2- 172.21.15.72:0/2314215851 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcecc06ace0 0x7fcecc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:03.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.866+0000 7fceddffb700 1 -- 172.21.15.72:0/2314215851 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fced8021070 con 0x7fcee80c7740 2023-07-27T20:32:03.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.866+0000 7fceed19b700 1 --2- 172.21.15.72:0/2314215851 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcecc06ace0 0x7fcecc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:03.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.867+0000 7fceed19b700 1 --2- 172.21.15.72:0/2314215851 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcecc06ace0 0x7fcecc06d1a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcee40011e0 tx=0x7fcee4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:03.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:03.870+0000 7fceddffb700 1 -- 172.21.15.72:0/2314215851 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fced8055e60 con 0x7fcee80c7740 2023-07-27T20:32:04.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.065+0000 7fceef3ff700 1 -- 172.21.15.72:0/2314215851 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcee81eb470 con 0x7fcee80c7740 2023-07-27T20:32:04.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.065+0000 7fceddffb700 1 -- 172.21.15.72:0/2314215851 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fced8059480 con 0x7fcee80c7740 2023-07-27T20:32:04.054 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:32:04.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.067+0000 7fceef3ff700 1 -- 172.21.15.72:0/2314215851 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcecc06ace0 msgr2=0x7fcecc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:04.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.067+0000 7fceef3ff700 1 --2- 172.21.15.72:0/2314215851 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcecc06ace0 0x7fcecc06d1a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcee40011e0 tx=0x7fcee4009040 comp rx=0 tx=0).stop 2023-07-27T20:32:04.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.067+0000 7fceef3ff700 1 -- 172.21.15.72:0/2314215851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcee80c7740 msgr2=0x7fcee8148ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:04.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.067+0000 7fceef3ff700 1 --2- 172.21.15.72:0/2314215851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcee80c7740 0x7fcee8148ab0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fced80090b0 tx=0x7fced8004750 comp rx=0 tx=0).stop 2023-07-27T20:32:04.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.067+0000 7fceef3ff700 1 -- 172.21.15.72:0/2314215851 shutdown_connections 2023-07-27T20:32:04.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.067+0000 7fceef3ff700 1 --2- 172.21.15.72:0/2314215851 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcecc06ace0 0x7fcecc06d1a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:04.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.067+0000 7fceef3ff700 1 --2- 172.21.15.72:0/2314215851 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcee814aab0 0x7fcee8148ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:04.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.067+0000 7fceef3ff700 1 --2- 172.21.15.72:0/2314215851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcee80c4700 0x7fcee81ece00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:04.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.067+0000 7fceef3ff700 1 --2- 172.21.15.72:0/2314215851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcee80c7740 0x7fcee8148ab0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:04.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.067+0000 7fceef3ff700 1 -- 172.21.15.72:0/2314215851 >> 172.21.15.72:0/2314215851 conn(0x7fcee80ab3f0 msgr2=0x7fcee8153fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:04.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.068+0000 7fceef3ff700 1 -- 172.21.15.72:0/2314215851 shutdown_connections 2023-07-27T20:32:04.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.068+0000 7fceef3ff700 1 -- 172.21.15.72:0/2314215851 wait complete. 2023-07-27T20:32:04.074 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T20:32:04.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.284+0000 7f0d25bff700 1 Processor -- start 2023-07-27T20:32:04.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.284+0000 7f0d25bff700 1 -- start start 2023-07-27T20:32:04.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.285+0000 7f0d25bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0d2006e140 0x7f0d200ba310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:04.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.285+0000 7f0d25bff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0d200ba850 0x7f0d2006d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:04.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.285+0000 7f0d25bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d2006ce10 con 0x7f0d2013b150 2023-07-27T20:32:04.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.285+0000 7f0d25bff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d20152680 con 0x7f0d200ba850 2023-07-27T20:32:04.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.285+0000 7f0d25bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d20152960 con 0x7f0d2006e140 2023-07-27T20:32:04.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.285+0000 7f0d1f7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0d2013b150 0x7f0d20151dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52102/0 (socket says 172.21.15.72:52102) 2023-07-27T20:32:04.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.285+0000 7f0d1f7fe700 1 -- 172.21.15.72:0/1416264443 learned_addr learned my addr 172.21.15.72:0/1416264443 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:04.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.285+0000 7f0d1ffff700 1 --2- 172.21.15.72:0/1416264443 >> v2:172.21.15.173:3300/0 conn(0x7f0d200ba850 0x7f0d2006d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:04.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.285+0000 7f0d17fff700 1 --2- 172.21.15.72:0/1416264443 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0d2006e140 0x7f0d200ba310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:04.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.286+0000 7f0d1effd700 1 -- 172.21.15.72:0/1416264443 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 925202962 0 0) 0x7f0d2006ce10 con 0x7f0d2013b150 2023-07-27T20:32:04.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.286+0000 7f0d1effd700 1 -- 172.21.15.72:0/1416264443 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d0c0035b0 con 0x7f0d2013b150 2023-07-27T20:32:04.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.286+0000 7f0d1ffff700 1 -- 172.21.15.72:0/1416264443 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0d2006e140 msgr2=0x7f0d200ba310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:04.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.286+0000 7f0d1ffff700 1 --2- 172.21.15.72:0/1416264443 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0d2006e140 0x7f0d200ba310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:04.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.286+0000 7f0d1ffff700 1 -- 172.21.15.72:0/1416264443 >> v1:172.21.15.72:6789/0 conn(0x7f0d2013b150 legacy=0x7f0d20151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:04.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.286+0000 7f0d1ffff700 1 -- 172.21.15.72:0/1416264443 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d20152c40 con 0x7f0d200ba850 2023-07-27T20:32:04.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.286+0000 7f0d17fff700 1 --2- 172.21.15.72:0/1416264443 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0d2006e140 0x7f0d200ba310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:32:04.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.286+0000 7f0d1ffff700 1 --2- 172.21.15.72:0/1416264443 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d200ba850 0x7f0d2006d5d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0d18009d90 tx=0x7f0d1800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f06a82307f6c3c43 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:04.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.287+0000 7f0d1effd700 1 -- 172.21.15.72:0/1416264443 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1800e070 con 0x7f0d200ba850 2023-07-27T20:32:04.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.287+0000 7f0d1effd700 1 -- 172.21.15.72:0/1416264443 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1800bb20 con 0x7f0d200ba850 2023-07-27T20:32:04.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.287+0000 7f0d1effd700 1 -- 172.21.15.72:0/1416264443 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d18012430 con 0x7f0d200ba850 2023-07-27T20:32:04.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.287+0000 7f0d25bff700 1 -- 172.21.15.72:0/1416264443 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d200ba850 msgr2=0x7f0d2006d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:04.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.287+0000 7f0d25bff700 1 --2- 172.21.15.72:0/1416264443 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d200ba850 0x7f0d2006d5d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0d18009d90 tx=0x7f0d1800b330 comp rx=0 tx=0).stop 2023-07-27T20:32:04.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.287+0000 7f0d25bff700 1 -- 172.21.15.72:0/1416264443 shutdown_connections 2023-07-27T20:32:04.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.287+0000 7f0d25bff700 1 --2- 172.21.15.72:0/1416264443 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d200ba850 0x7f0d2006d5d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:04.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.287+0000 7f0d25bff700 1 --2- 172.21.15.72:0/1416264443 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0d2006e140 0x7f0d200ba310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:04.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.287+0000 7f0d25bff700 1 -- 172.21.15.72:0/1416264443 >> 172.21.15.72:0/1416264443 conn(0x7f0d2006a190 msgr2=0x7f0d2006a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:04.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.287+0000 7f0d25bff700 1 -- 172.21.15.72:0/1416264443 shutdown_connections 2023-07-27T20:32:04.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.287+0000 7f0d25bff700 1 -- 172.21.15.72:0/1416264443 wait complete. 2023-07-27T20:32:04.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.289+0000 7f0d25bff700 1 Processor -- start 2023-07-27T20:32:04.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.289+0000 7f0d25bff700 1 -- start start 2023-07-27T20:32:04.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.290+0000 7f0d25bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d2006e140 0x7f0d201e9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:04.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.290+0000 7f0d25bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0d200ba850 0x7f0d200c3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:04.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.290+0000 7f0d25bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d2013b150 0x7f0d201e6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:04.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.290+0000 7f0d25bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2014e6c0 con 0x7f0d2013b150 2023-07-27T20:32:04.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.290+0000 7f0d25bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2014e9a0 con 0x7f0d2006e140 2023-07-27T20:32:04.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.290+0000 7f0d25bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2014ec80 con 0x7f0d200ba850 2023-07-27T20:32:04.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.290+0000 7f0d1ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d2013b150 0x7f0d201e6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:04.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.290+0000 7f0d1ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d2013b150 0x7f0d201e6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46422/0 (socket says 172.21.15.72:46422) 2023-07-27T20:32:04.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.290+0000 7f0d1ffff700 1 -- 172.21.15.72:0/2695464844 learned_addr learned my addr 172.21.15.72:0/2695464844 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:04.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.290+0000 7f0d1f7fe700 1 --2- 172.21.15.72:0/2695464844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d2006e140 0x7f0d201e9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:04.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.290+0000 7f0d17fff700 1 --2- 172.21.15.72:0/2695464844 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0d200ba850 0x7f0d200c3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:04.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.291+0000 7f0d1ffff700 1 -- 172.21.15.72:0/2695464844 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0d200ba850 msgr2=0x7f0d200c3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:04.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.291+0000 7f0d1ffff700 1 --2- 172.21.15.72:0/2695464844 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0d200ba850 0x7f0d200c3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:04.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.291+0000 7f0d1ffff700 1 -- 172.21.15.72:0/2695464844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d2006e140 msgr2=0x7f0d201e9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:04.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.291+0000 7f0d1ffff700 1 --2- 172.21.15.72:0/2695464844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d2006e140 0x7f0d201e9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:04.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.291+0000 7f0d1ffff700 1 -- 172.21.15.72:0/2695464844 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d080094a0 con 0x7f0d2013b150 2023-07-27T20:32:04.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.291+0000 7f0d17fff700 1 --2- 172.21.15.72:0/2695464844 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0d200ba850 0x7f0d200c3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:04.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.291+0000 7f0d1ffff700 1 --2- 172.21.15.72:0/2695464844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d2013b150 0x7f0d201e6660 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0d18014040 tx=0x7f0d18004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:04.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.291+0000 7f0d1cff9700 1 -- 172.21.15.72:0/2695464844 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d180129f0 con 0x7f0d2013b150 2023-07-27T20:32:04.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.291+0000 7f0d1cff9700 1 -- 172.21.15.72:0/2695464844 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d18020070 con 0x7f0d2013b150 2023-07-27T20:32:04.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.291+0000 7f0d25bff700 1 -- 172.21.15.72:0/2695464844 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d18009a70 con 0x7f0d2013b150 2023-07-27T20:32:04.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.291+0000 7f0d1cff9700 1 -- 172.21.15.72:0/2695464844 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d18012db0 con 0x7f0d2013b150 2023-07-27T20:32:04.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.291+0000 7f0d25bff700 1 -- 172.21.15.72:0/2695464844 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d2014f240 con 0x7f0d2013b150 2023-07-27T20:32:04.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.292+0000 7f0d25bff700 1 -- 172.21.15.72:0/2695464844 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d2014f460 con 0x7f0d2013b150 2023-07-27T20:32:04.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.293+0000 7f0d1cff9700 1 -- 172.21.15.72:0/2695464844 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0d18004040 con 0x7f0d2013b150 2023-07-27T20:32:04.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.294+0000 7f0d1cff9700 1 --2- 172.21.15.72:0/2695464844 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0d0006ad10 0x7f0d0006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:04.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.294+0000 7f0d1cff9700 1 -- 172.21.15.72:0/2695464844 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0d18022070 con 0x7f0d2013b150 2023-07-27T20:32:04.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.295+0000 7f0d1f7fe700 1 --2- 172.21.15.72:0/2695464844 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0d0006ad10 0x7f0d0006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:04.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.295+0000 7f0d1f7fe700 1 --2- 172.21.15.72:0/2695464844 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0d0006ad10 0x7f0d0006d1d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0d10007fd0 tx=0x7f0d10007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:04.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.298+0000 7f0d1cff9700 1 -- 172.21.15.72:0/2695464844 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0d18056530 con 0x7f0d2013b150 2023-07-27T20:32:04.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.493+0000 7f0d25bff700 1 -- 172.21.15.72:0/2695464844 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0d2004e470 con 0x7f0d2013b150 2023-07-27T20:32:04.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.494+0000 7f0d1cff9700 1 -- 172.21.15.72:0/2695464844 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0d18059b50 con 0x7f0d2013b150 2023-07-27T20:32:04.482 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-27T20:32:04.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.496+0000 7f0d25bff700 1 -- 172.21.15.72:0/2695464844 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0d0006ad10 msgr2=0x7f0d0006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:04.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.496+0000 7f0d25bff700 1 --2- 172.21.15.72:0/2695464844 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0d0006ad10 0x7f0d0006d1d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0d10007fd0 tx=0x7f0d10007dc0 comp rx=0 tx=0).stop 2023-07-27T20:32:04.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.496+0000 7f0d25bff700 1 -- 172.21.15.72:0/2695464844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d2013b150 msgr2=0x7f0d201e6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:04.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.496+0000 7f0d25bff700 1 --2- 172.21.15.72:0/2695464844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d2013b150 0x7f0d201e6660 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0d18014040 tx=0x7f0d18004ad0 comp rx=0 tx=0).stop 2023-07-27T20:32:04.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.496+0000 7f0d25bff700 1 -- 172.21.15.72:0/2695464844 shutdown_connections 2023-07-27T20:32:04.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.496+0000 7f0d25bff700 1 --2- 172.21.15.72:0/2695464844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d2013b150 0x7f0d201e6660 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:04.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.496+0000 7f0d25bff700 1 --2- 172.21.15.72:0/2695464844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d2006e140 0x7f0d201e9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:04.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.496+0000 7f0d25bff700 1 --2- 172.21.15.72:0/2695464844 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0d0006ad10 0x7f0d0006d1d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:04.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.496+0000 7f0d25bff700 1 --2- 172.21.15.72:0/2695464844 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0d200ba850 0x7f0d200c3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:04.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.496+0000 7f0d25bff700 1 -- 172.21.15.72:0/2695464844 >> 172.21.15.72:0/2695464844 conn(0x7f0d2006a190 msgr2=0x7f0d201510c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:04.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.496+0000 7f0d25bff700 1 -- 172.21.15.72:0/2695464844 shutdown_connections 2023-07-27T20:32:04.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.496+0000 7f0d25bff700 1 -- 172.21.15.72:0/2695464844 wait complete. 2023-07-27T20:32:04.502 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-27T20:32:04.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.711+0000 7fa4447ff700 1 Processor -- start 2023-07-27T20:32:04.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.711+0000 7fa4447ff700 1 -- start start 2023-07-27T20:32:04.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.712+0000 7fa4447ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa43c0a86c0 0x7fa43c158100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:04.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.712+0000 7fa4447ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa43c0a8aa0 0x7fa43c06b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:04.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.712+0000 7fa4447ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa43c0a8ec0 con 0x7fa43c071190 2023-07-27T20:32:04.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.712+0000 7fa4447ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa43c0c3e30 con 0x7fa43c0a8aa0 2023-07-27T20:32:04.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.712+0000 7fa4447ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa43c0c2ca0 con 0x7fa43c0a86c0 2023-07-27T20:32:04.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.713+0000 7fa442d9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa43c0a8aa0 0x7fa43c06b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:04.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.713+0000 7fa442d9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa43c0a8aa0 0x7fa43c06b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46430/0 (socket says 172.21.15.72:46430) 2023-07-27T20:32:04.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.713+0000 7fa442d9c700 1 -- 172.21.15.72:0/1145283775 learned_addr learned my addr 172.21.15.72:0/1145283775 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:04.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.713+0000 7fa44259b700 1 --2- 172.21.15.72:0/1145283775 >> v2:172.21.15.173:3300/0 conn(0x7fa43c0a86c0 0x7fa43c158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:04.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.713+0000 7fa442d9c700 1 -- 172.21.15.72:0/1145283775 >> v2:172.21.15.173:3300/0 conn(0x7fa43c0a86c0 msgr2=0x7fa43c158100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:04.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.713+0000 7fa442d9c700 1 --2- 172.21.15.72:0/1145283775 >> v2:172.21.15.173:3300/0 conn(0x7fa43c0a86c0 0x7fa43c158100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:04.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.713+0000 7fa442d9c700 1 -- 172.21.15.72:0/1145283775 >> v1:172.21.15.173:6789/0 conn(0x7fa43c071190 legacy=0x7fa43c154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:04.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.713+0000 7fa442d9c700 1 -- 172.21.15.72:0/1145283775 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43c071700 con 0x7fa43c0a8aa0 2023-07-27T20:32:04.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.713+0000 7fa442d9c700 1 --2- 172.21.15.72:0/1145283775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa43c0a8aa0 0x7fa43c06b2b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa43c06fb10 tx=0x7fa43400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af04b5248010cac4 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:04.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.713+0000 7fa441599700 1 -- 172.21.15.72:0/1145283775 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43400e070 con 0x7fa43c0a8aa0 2023-07-27T20:32:04.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.714+0000 7fa441599700 1 -- 172.21.15.72:0/1145283775 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43400b910 con 0x7fa43c0a8aa0 2023-07-27T20:32:04.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.714+0000 7fa441599700 1 -- 172.21.15.72:0/1145283775 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43400bcc0 con 0x7fa43c0a8aa0 2023-07-27T20:32:04.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.714+0000 7fa4447ff700 1 -- 172.21.15.72:0/1145283775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa43c0a8aa0 msgr2=0x7fa43c06b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:04.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.714+0000 7fa4447ff700 1 --2- 172.21.15.72:0/1145283775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa43c0a8aa0 0x7fa43c06b2b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa43c06fb10 tx=0x7fa43400b330 comp rx=0 tx=0).stop 2023-07-27T20:32:04.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.714+0000 7fa4447ff700 1 -- 172.21.15.72:0/1145283775 shutdown_connections 2023-07-27T20:32:04.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.714+0000 7fa4447ff700 1 --2- 172.21.15.72:0/1145283775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa43c0a8aa0 0x7fa43c06b2b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:04.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.714+0000 7fa4447ff700 1 --2- 172.21.15.72:0/1145283775 >> v2:172.21.15.173:3300/0 conn(0x7fa43c0a86c0 0x7fa43c158100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:04.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.714+0000 7fa4447ff700 1 -- 172.21.15.72:0/1145283775 >> 172.21.15.72:0/1145283775 conn(0x7fa43c0c2fd0 msgr2=0x7fa43c0c33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:04.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.714+0000 7fa4447ff700 1 -- 172.21.15.72:0/1145283775 shutdown_connections 2023-07-27T20:32:04.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.714+0000 7fa4447ff700 1 -- 172.21.15.72:0/1145283775 wait complete. 2023-07-27T20:32:04.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.716+0000 7fa4447ff700 1 Processor -- start 2023-07-27T20:32:04.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.716+0000 7fa4447ff700 1 -- start start 2023-07-27T20:32:04.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.717+0000 7fa4447ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa43c071190 0x7fa43c155380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:04.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.717+0000 7fa4447ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa43c0a86c0 0x7fa43c1558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:04.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.717+0000 7fa4447ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa43c0a8aa0 0x7fa43c146310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:04.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.717+0000 7fa4447ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c14e0d0 con 0x7fa43c0a8aa0 2023-07-27T20:32:04.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.717+0000 7fa4447ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c14d8e0 con 0x7fa43c0a86c0 2023-07-27T20:32:04.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.717+0000 7fa4447ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c14dbc0 con 0x7fa43c071190 2023-07-27T20:32:04.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.717+0000 7fa442d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa43c0a8aa0 0x7fa43c146310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:04.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.717+0000 7fa442d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa43c0a8aa0 0x7fa43c146310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46434/0 (socket says 172.21.15.72:46434) 2023-07-27T20:32:04.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.717+0000 7fa442d9c700 1 -- 172.21.15.72:0/1029802407 learned_addr learned my addr 172.21.15.72:0/1029802407 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:04.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.717+0000 7fa44259b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa43c071190 0x7fa43c155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:04.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.717+0000 7fa441d9a700 1 --2- 172.21.15.72:0/1029802407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa43c0a86c0 0x7fa43c1558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:04.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.717+0000 7fa442d9c700 1 -- 172.21.15.72:0/1029802407 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa43c071190 msgr2=0x7fa43c155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:04.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.717+0000 7fa442d9c700 1 --2- 172.21.15.72:0/1029802407 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa43c071190 0x7fa43c155380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:04.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.717+0000 7fa442d9c700 1 -- 172.21.15.72:0/1029802407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa43c0a86c0 msgr2=0x7fa43c1558c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:04.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.717+0000 7fa442d9c700 1 --2- 172.21.15.72:0/1029802407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa43c0a86c0 0x7fa43c1558c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:04.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.717+0000 7fa442d9c700 1 -- 172.21.15.72:0/1029802407 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa434009b30 con 0x7fa43c0a8aa0 2023-07-27T20:32:04.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.718+0000 7fa442d9c700 1 --2- 172.21.15.72:0/1029802407 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa43c0a8aa0 0x7fa43c146310 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa43c06f3b0 tx=0x7fa434004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:04.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.718+0000 7fa432ffd700 1 -- 172.21.15.72:0/1029802407 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa434004880 con 0x7fa43c0a8aa0 2023-07-27T20:32:04.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.718+0000 7fa432ffd700 1 -- 172.21.15.72:0/1029802407 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4340099b0 con 0x7fa43c0a8aa0 2023-07-27T20:32:04.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.718+0000 7fa4447ff700 1 -- 172.21.15.72:0/1029802407 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa43c14fd00 con 0x7fa43c0a8aa0 2023-07-27T20:32:04.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.718+0000 7fa432ffd700 1 -- 172.21.15.72:0/1029802407 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43401c680 con 0x7fa43c0a8aa0 2023-07-27T20:32:04.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.718+0000 7fa4447ff700 1 -- 172.21.15.72:0/1029802407 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa43c157070 con 0x7fa43c0a8aa0 2023-07-27T20:32:04.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.719+0000 7fa4447ff700 1 -- 172.21.15.72:0/1029802407 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa43c150220 con 0x7fa43c0a8aa0 2023-07-27T20:32:04.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.720+0000 7fa432ffd700 1 -- 172.21.15.72:0/1029802407 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa43401c7e0 con 0x7fa43c0a8aa0 2023-07-27T20:32:04.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.721+0000 7fa432ffd700 1 --2- 172.21.15.72:0/1029802407 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa42006ace0 0x7fa42006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:04.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.721+0000 7fa432ffd700 1 -- 172.21.15.72:0/1029802407 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa43408b080 con 0x7fa43c0a8aa0 2023-07-27T20:32:04.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.722+0000 7fa44259b700 1 --2- 172.21.15.72:0/1029802407 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa42006ace0 0x7fa42006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:04.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.722+0000 7fa44259b700 1 --2- 172.21.15.72:0/1029802407 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa42006ace0 0x7fa42006d1a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa43c0c0950 tx=0x7fa438009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:04.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.726+0000 7fa432ffd700 1 -- 172.21.15.72:0/1029802407 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa4340bd310 con 0x7fa43c0a8aa0 2023-07-27T20:32:04.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.919+0000 7fa4447ff700 1 -- 172.21.15.72:0/1029802407 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa43c04e470 con 0x7fa43c0a8aa0 2023-07-27T20:32:04.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.920+0000 7fa432ffd700 1 -- 172.21.15.72:0/1029802407 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa43c150220 con 0x7fa43c0a8aa0 2023-07-27T20:32:04.909 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:32:04.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.922+0000 7fa4447ff700 1 -- 172.21.15.72:0/1029802407 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa42006ace0 msgr2=0x7fa42006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:04.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.922+0000 7fa4447ff700 1 --2- 172.21.15.72:0/1029802407 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa42006ace0 0x7fa42006d1a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa43c0c0950 tx=0x7fa438009210 comp rx=0 tx=0).stop 2023-07-27T20:32:04.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.922+0000 7fa4447ff700 1 -- 172.21.15.72:0/1029802407 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa43c0a8aa0 msgr2=0x7fa43c146310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:04.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.922+0000 7fa4447ff700 1 --2- 172.21.15.72:0/1029802407 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa43c0a8aa0 0x7fa43c146310 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa43c06f3b0 tx=0x7fa434004ad0 comp rx=0 tx=0).stop 2023-07-27T20:32:04.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.922+0000 7fa4447ff700 1 -- 172.21.15.72:0/1029802407 shutdown_connections 2023-07-27T20:32:04.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.922+0000 7fa4447ff700 1 --2- 172.21.15.72:0/1029802407 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa43c0a8aa0 0x7fa43c146310 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:04.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.922+0000 7fa4447ff700 1 --2- 172.21.15.72:0/1029802407 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa42006ace0 0x7fa42006d1a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:04.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.922+0000 7fa4447ff700 1 --2- 172.21.15.72:0/1029802407 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa43c071190 0x7fa43c155380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:04.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.922+0000 7fa4447ff700 1 --2- 172.21.15.72:0/1029802407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa43c0a86c0 0x7fa43c1558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:04.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.922+0000 7fa4447ff700 1 -- 172.21.15.72:0/1029802407 >> 172.21.15.72:0/1029802407 conn(0x7fa43c0c2fd0 msgr2=0x7fa43c153000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:04.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.922+0000 7fa4447ff700 1 -- 172.21.15.72:0/1029802407 shutdown_connections 2023-07-27T20:32:04.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:04.922+0000 7fa4447ff700 1 -- 172.21.15.72:0/1029802407 wait complete. 2023-07-27T20:32:04.928 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T20:32:05.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.136+0000 7f84221ff700 1 Processor -- start 2023-07-27T20:32:05.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.136+0000 7f84221ff700 1 -- start start 2023-07-27T20:32:05.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.137+0000 7f84221ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f841c0bfd90 0x7f841c0aab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:05.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.137+0000 7f84221ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f841c0a83a0 0x7f841c0a8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:05.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.137+0000 7f84221ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f841c155600 con 0x7f841c13b2c0 2023-07-27T20:32:05.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.137+0000 7f84221ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f841c0a9620 con 0x7f841c0a83a0 2023-07-27T20:32:05.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.137+0000 7f84221ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f841c155320 con 0x7f841c0bfd90 2023-07-27T20:32:05.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.137+0000 7f841bfff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f841c0a83a0 0x7f841c0a8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:05.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.137+0000 7f841affd700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f841c0bfd90 0x7f841c0aab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:05.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.137+0000 7f841bfff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f841c0a83a0 0x7f841c0a8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.72:60458/0 (socket says 172.21.15.72:60458) 2023-07-27T20:32:05.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.137+0000 7f841bfff700 1 -- 172.21.15.72:0/1398265100 learned_addr learned my addr 172.21.15.72:0/1398265100 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:05.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.137+0000 7f841b7fe700 1 --1- 172.21.15.72:0/1398265100 >> v1:172.21.15.173:6789/0 conn(0x7f841c13b2c0 0x7f841c0aa420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.72:52378/0 (socket says 172.21.15.72:52378) 2023-07-27T20:32:05.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.138+0000 7f841affd700 1 -- 172.21.15.72:0/1398265100 >> v2:172.21.15.173:3300/0 conn(0x7f841c0a83a0 msgr2=0x7f841c0a8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:05.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.138+0000 7f841affd700 1 --2- 172.21.15.72:0/1398265100 >> v2:172.21.15.173:3300/0 conn(0x7f841c0a83a0 0x7f841c0a8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:05.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.138+0000 7f841affd700 1 -- 172.21.15.72:0/1398265100 >> v1:172.21.15.173:6789/0 conn(0x7f841c13b2c0 legacy=0x7f841c0aa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:05.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.138+0000 7f841affd700 1 -- 172.21.15.72:0/1398265100 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f841c151e40 con 0x7f841c0bfd90 2023-07-27T20:32:05.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.138+0000 7f841bfff700 1 --2- 172.21.15.72:0/1398265100 >> v2:172.21.15.173:3300/0 conn(0x7f841c0a83a0 0x7f841c0a8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:32:05.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.138+0000 7f841affd700 1 --2- 172.21.15.72:0/1398265100 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f841c0bfd90 0x7f841c0aab30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8410009840 tx=0x7f8410009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15b439927f8ef3c3 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:05.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.138+0000 7f841a7fc700 1 -- 172.21.15.72:0/1398265100 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8410011830 con 0x7f841c0bfd90 2023-07-27T20:32:05.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.138+0000 7f841a7fc700 1 -- 172.21.15.72:0/1398265100 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8410011990 con 0x7f841c0bfd90 2023-07-27T20:32:05.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.138+0000 7f841a7fc700 1 -- 172.21.15.72:0/1398265100 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8410011d20 con 0x7f841c0bfd90 2023-07-27T20:32:05.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.139+0000 7f84221ff700 1 -- 172.21.15.72:0/1398265100 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f841c0bfd90 msgr2=0x7f841c0aab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:05.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.139+0000 7f84221ff700 1 --2- 172.21.15.72:0/1398265100 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f841c0bfd90 0x7f841c0aab30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8410009840 tx=0x7f8410009b50 comp rx=0 tx=0).stop 2023-07-27T20:32:05.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.139+0000 7f84221ff700 1 -- 172.21.15.72:0/1398265100 shutdown_connections 2023-07-27T20:32:05.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.139+0000 7f84221ff700 1 --2- 172.21.15.72:0/1398265100 >> v2:172.21.15.173:3300/0 conn(0x7f841c0a83a0 0x7f841c0a8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:05.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.139+0000 7f84221ff700 1 --2- 172.21.15.72:0/1398265100 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f841c0bfd90 0x7f841c0aab30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:05.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.139+0000 7f84221ff700 1 -- 172.21.15.72:0/1398265100 >> 172.21.15.72:0/1398265100 conn(0x7f841c06a190 msgr2=0x7f841c06a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:05.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.139+0000 7f84221ff700 1 -- 172.21.15.72:0/1398265100 shutdown_connections 2023-07-27T20:32:05.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.139+0000 7f84221ff700 1 -- 172.21.15.72:0/1398265100 wait complete. 2023-07-27T20:32:05.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.141+0000 7f84221ff700 1 Processor -- start 2023-07-27T20:32:05.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.141+0000 7f84221ff700 1 -- start start 2023-07-27T20:32:05.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.142+0000 7f84221ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f841c0a83a0 0x7f841c071470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:05.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.142+0000 7f84221ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f841c0bfd90 0x7f841c0c2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:05.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.142+0000 7f84221ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f841c13b2c0 0x7f841c1ecaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:05.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.142+0000 7f84221ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841c1513c0 con 0x7f841c0a83a0 2023-07-27T20:32:05.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.142+0000 7f84221ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841c1542e0 con 0x7f841c13b2c0 2023-07-27T20:32:05.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.142+0000 7f84221ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f841c137fd0 con 0x7f841c0bfd90 2023-07-27T20:32:05.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.142+0000 7f841b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f841c0a83a0 0x7f841c071470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:05.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.142+0000 7f841b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f841c0a83a0 0x7f841c071470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46450/0 (socket says 172.21.15.72:46450) 2023-07-27T20:32:05.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.142+0000 7f841b7fe700 1 -- 172.21.15.72:0/4007072262 learned_addr learned my addr 172.21.15.72:0/4007072262 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:05.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.142+0000 7f841bfff700 1 --2- 172.21.15.72:0/4007072262 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f841c13b2c0 0x7f841c1ecaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:05.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.142+0000 7f841affd700 1 --2- 172.21.15.72:0/4007072262 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f841c0bfd90 0x7f841c0c2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:05.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.142+0000 7f841b7fe700 1 -- 172.21.15.72:0/4007072262 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f841c0bfd90 msgr2=0x7f841c0c2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:05.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.142+0000 7f841b7fe700 1 --2- 172.21.15.72:0/4007072262 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f841c0bfd90 0x7f841c0c2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:05.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.142+0000 7f841b7fe700 1 -- 172.21.15.72:0/4007072262 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f841c13b2c0 msgr2=0x7f841c1ecaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:05.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.142+0000 7f841b7fe700 1 --2- 172.21.15.72:0/4007072262 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f841c13b2c0 0x7f841c1ecaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:05.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.143+0000 7f841b7fe700 1 -- 172.21.15.72:0/4007072262 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8414009b30 con 0x7f841c0a83a0 2023-07-27T20:32:05.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.143+0000 7f841bfff700 1 --2- 172.21.15.72:0/4007072262 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f841c13b2c0 0x7f841c1ecaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:32:05.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.143+0000 7f841affd700 1 --2- 172.21.15.72:0/4007072262 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f841c0bfd90 0x7f841c0c2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:32:05.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.143+0000 7f841b7fe700 1 --2- 172.21.15.72:0/4007072262 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f841c0a83a0 0x7f841c071470 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f840c00c500 tx=0x7f840c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:05.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.143+0000 7f8403fff700 1 -- 172.21.15.72:0/4007072262 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840c005cb0 con 0x7f841c0a83a0 2023-07-27T20:32:05.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.143+0000 7f8403fff700 1 -- 172.21.15.72:0/4007072262 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f840c005e10 con 0x7f841c0a83a0 2023-07-27T20:32:05.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.143+0000 7f8403fff700 1 -- 172.21.15.72:0/4007072262 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840c0072d0 con 0x7f841c0a83a0 2023-07-27T20:32:05.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.143+0000 7f84221ff700 1 -- 172.21.15.72:0/4007072262 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84100094a0 con 0x7f841c0a83a0 2023-07-27T20:32:05.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.143+0000 7f84221ff700 1 -- 172.21.15.72:0/4007072262 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f841c137a30 con 0x7f841c0a83a0 2023-07-27T20:32:05.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.144+0000 7f84221ff700 1 -- 172.21.15.72:0/4007072262 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f841c074310 con 0x7f841c0a83a0 2023-07-27T20:32:05.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.145+0000 7f8403fff700 1 -- 172.21.15.72:0/4007072262 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f840c007430 con 0x7f841c0a83a0 2023-07-27T20:32:05.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.146+0000 7f8403fff700 1 --2- 172.21.15.72:0/4007072262 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f840806ace0 0x7f840806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:05.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.146+0000 7f8403fff700 1 -- 172.21.15.72:0/4007072262 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f840c088a00 con 0x7f841c0a83a0 2023-07-27T20:32:05.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.147+0000 7f841affd700 1 --2- 172.21.15.72:0/4007072262 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f840806ace0 0x7f840806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:05.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.147+0000 7f841affd700 1 --2- 172.21.15.72:0/4007072262 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f840806ace0 0x7f840806d1a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f841c0c01b0 tx=0x7f8410008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:05.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.150+0000 7f8403fff700 1 -- 172.21.15.72:0/4007072262 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f840c053900 con 0x7f841c0a83a0 2023-07-27T20:32:05.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.395+0000 7f84221ff700 1 -- 172.21.15.72:0/4007072262 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f841c06aa30 con 0x7f841c0a83a0 2023-07-27T20:32:05.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.396+0000 7f8403fff700 1 -- 172.21.15.72:0/4007072262 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f840c056f20 con 0x7f841c0a83a0 2023-07-27T20:32:05.385 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:32:05.386 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/1913374698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1913374698},{"type":"v1","addr":"172.21.15.72:6834","nonce":1913374698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/3260445560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":3260445560},{"type":"v1","addr":"172.21.15.72:6835","nonce":3260445560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1305837931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1305837931},{"type":"v1","addr":"172.21.15.173:6837","nonce":1305837931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T20:31:28.592113+0000","modified":"2023-07-27T20:31:51.217923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6835/516740687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":516740687},{"type":"v1","addr":"172.21.15.173:6835","nonce":516740687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-27T20:32:05.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.398+0000 7f84221ff700 1 -- 172.21.15.72:0/4007072262 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f840806ace0 msgr2=0x7f840806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:05.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.398+0000 7f84221ff700 1 --2- 172.21.15.72:0/4007072262 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f840806ace0 0x7f840806d1a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f841c0c01b0 tx=0x7f8410008030 comp rx=0 tx=0).stop 2023-07-27T20:32:05.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.398+0000 7f84221ff700 1 -- 172.21.15.72:0/4007072262 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f841c0a83a0 msgr2=0x7f841c071470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:05.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.398+0000 7f84221ff700 1 --2- 172.21.15.72:0/4007072262 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f841c0a83a0 0x7f841c071470 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f840c00c500 tx=0x7f840c00c8c0 comp rx=0 tx=0).stop 2023-07-27T20:32:05.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.398+0000 7f84221ff700 1 -- 172.21.15.72:0/4007072262 shutdown_connections 2023-07-27T20:32:05.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.398+0000 7f84221ff700 1 --2- 172.21.15.72:0/4007072262 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f841c13b2c0 0x7f841c1ecaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:05.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.398+0000 7f84221ff700 1 --2- 172.21.15.72:0/4007072262 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f841c0a83a0 0x7f841c071470 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:05.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.398+0000 7f84221ff700 1 --2- 172.21.15.72:0/4007072262 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f840806ace0 0x7f840806d1a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:05.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.398+0000 7f84221ff700 1 --2- 172.21.15.72:0/4007072262 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f841c0bfd90 0x7f841c0c2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:05.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.398+0000 7f84221ff700 1 -- 172.21.15.72:0/4007072262 >> 172.21.15.72:0/4007072262 conn(0x7f841c06a190 msgr2=0x7f841c0aa630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:05.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.398+0000 7f84221ff700 1 -- 172.21.15.72:0/4007072262 shutdown_connections 2023-07-27T20:32:05.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.398+0000 7f84221ff700 1 -- 172.21.15.72:0/4007072262 wait complete. 2023-07-27T20:32:05.391 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 9 2023-07-27T20:32:05.405 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:32:05.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.610+0000 7f0bf63ff700 1 Processor -- start 2023-07-27T20:32:05.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.610+0000 7f0bf63ff700 1 -- start start 2023-07-27T20:32:05.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.612+0000 7f0bf63ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0bf006b150 0x7f0bf00c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:05.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.612+0000 7f0bf63ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0bf01549f0 0x7f0bf01514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:05.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.612+0000 7f0bf63ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bf006b710 con 0x7f0bf00c4400 2023-07-27T20:32:05.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.612+0000 7f0bf63ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bf01545d0 con 0x7f0bf01549f0 2023-07-27T20:32:05.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.612+0000 7f0bf63ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf006c860 con 0x7f0bf006b150 2023-07-27T20:32:05.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.612+0000 7f0bf499c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0bf01549f0 0x7f0bf01514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:05.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.612+0000 7f0bf499c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0bf01549f0 0x7f0bf01514a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46458/0 (socket says 172.21.15.72:46458) 2023-07-27T20:32:05.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.612+0000 7f0bf499c700 1 -- 172.21.15.72:0/3183287086 learned_addr learned my addr 172.21.15.72:0/3183287086 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:05.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.612+0000 7f0bef7fe700 1 --2- 172.21.15.72:0/3183287086 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0bf006b150 0x7f0bf00c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:05.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.612+0000 7f0bf499c700 1 -- 172.21.15.72:0/3183287086 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0bf006b150 msgr2=0x7f0bf00c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:05.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.612+0000 7f0bf499c700 1 --2- 172.21.15.72:0/3183287086 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0bf006b150 0x7f0bf00c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:05.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.612+0000 7f0bf499c700 1 -- 172.21.15.72:0/3183287086 >> v1:172.21.15.173:6789/0 conn(0x7f0bf00c4400 legacy=0x7f0bf00c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:05.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.612+0000 7f0bf499c700 1 -- 172.21.15.72:0/3183287086 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf006b9f0 con 0x7f0bf01549f0 2023-07-27T20:32:05.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.612+0000 7f0bef7fe700 1 --2- 172.21.15.72:0/3183287086 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0bf006b150 0x7f0bf00c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:32:05.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.613+0000 7f0bf499c700 1 --2- 172.21.15.72:0/3183287086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bf01549f0 0x7f0bf01514a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0be8009e50 tx=0x7f0be800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5194503279ea6060 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:05.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.613+0000 7f0beeffd700 1 -- 172.21.15.72:0/3183287086 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be800e070 con 0x7f0bf01549f0 2023-07-27T20:32:05.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.613+0000 7f0beeffd700 1 -- 172.21.15.72:0/3183287086 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be800b9c0 con 0x7f0bf01549f0 2023-07-27T20:32:05.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.613+0000 7f0beeffd700 1 -- 172.21.15.72:0/3183287086 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be800bd70 con 0x7f0bf01549f0 2023-07-27T20:32:05.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.613+0000 7f0bf63ff700 1 -- 172.21.15.72:0/3183287086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bf01549f0 msgr2=0x7f0bf01514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:05.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.613+0000 7f0bf63ff700 1 --2- 172.21.15.72:0/3183287086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bf01549f0 0x7f0bf01514a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0be8009e50 tx=0x7f0be800b330 comp rx=0 tx=0).stop 2023-07-27T20:32:05.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.614+0000 7f0bf63ff700 1 -- 172.21.15.72:0/3183287086 shutdown_connections 2023-07-27T20:32:05.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.614+0000 7f0bf63ff700 1 --2- 172.21.15.72:0/3183287086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bf01549f0 0x7f0bf01514a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:05.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.614+0000 7f0bf63ff700 1 --2- 172.21.15.72:0/3183287086 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0bf006b150 0x7f0bf00c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:05.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.614+0000 7f0bf63ff700 1 -- 172.21.15.72:0/3183287086 >> 172.21.15.72:0/3183287086 conn(0x7f0bf00ab300 msgr2=0x7f0bf00ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:05.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.614+0000 7f0bf63ff700 1 -- 172.21.15.72:0/3183287086 shutdown_connections 2023-07-27T20:32:05.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.614+0000 7f0bf63ff700 1 -- 172.21.15.72:0/3183287086 wait complete. 2023-07-27T20:32:05.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.616+0000 7f0bf63ff700 1 Processor -- start 2023-07-27T20:32:05.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.616+0000 7f0bf63ff700 1 -- start start 2023-07-27T20:32:05.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.617+0000 7f0bf63ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0bf006b150 0x7f0bf014c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:05.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.617+0000 7f0bf63ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0bf00c4400 0x7f0bf00ae470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:05.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.617+0000 7f0bf63ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bf01549f0 0x7f0bf00bd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:05.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.617+0000 7f0bf63ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf014cd50 con 0x7f0bf01549f0 2023-07-27T20:32:05.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.617+0000 7f0bf63ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf014c380 con 0x7f0bf006b150 2023-07-27T20:32:05.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.617+0000 7f0bf63ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf014ba50 con 0x7f0bf00c4400 2023-07-27T20:32:05.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.618+0000 7f0bf499c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bf01549f0 0x7f0bf00bd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:05.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.618+0000 7f0bf499c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bf01549f0 0x7f0bf00bd340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46470/0 (socket says 172.21.15.72:46470) 2023-07-27T20:32:05.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.618+0000 7f0bf499c700 1 -- 172.21.15.72:0/3747590476 learned_addr learned my addr 172.21.15.72:0/3747590476 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:05.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.618+0000 7f0bef7fe700 1 --2- 172.21.15.72:0/3747590476 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0bf00c4400 0x7f0bf00ae470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:05.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.618+0000 7f0beffff700 1 --2- 172.21.15.72:0/3747590476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0bf006b150 0x7f0bf014c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:05.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.618+0000 7f0bf499c700 1 -- 172.21.15.72:0/3747590476 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0bf00c4400 msgr2=0x7f0bf00ae470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:05.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.618+0000 7f0bf499c700 1 --2- 172.21.15.72:0/3747590476 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0bf00c4400 0x7f0bf00ae470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:05.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.618+0000 7f0bf499c700 1 -- 172.21.15.72:0/3747590476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0bf006b150 msgr2=0x7f0bf014c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:05.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.618+0000 7f0bf499c700 1 --2- 172.21.15.72:0/3747590476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0bf006b150 0x7f0bf014c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:05.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.618+0000 7f0bf499c700 1 -- 172.21.15.72:0/3747590476 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be8009b30 con 0x7f0bf01549f0 2023-07-27T20:32:05.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.618+0000 7f0bf499c700 1 --2- 172.21.15.72:0/3747590476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bf01549f0 0x7f0bf00bd340 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0be800b730 tx=0x7f0be8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:05.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.619+0000 7f0becff9700 1 -- 172.21.15.72:0/3747590476 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be8004830 con 0x7f0bf01549f0 2023-07-27T20:32:05.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.619+0000 7f0becff9700 1 -- 172.21.15.72:0/3747590476 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be80092e0 con 0x7f0bf01549f0 2023-07-27T20:32:05.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.619+0000 7f0bf63ff700 1 -- 172.21.15.72:0/3747590476 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bf014bd30 con 0x7f0bf01549f0 2023-07-27T20:32:05.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.619+0000 7f0becff9700 1 -- 172.21.15.72:0/3747590476 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be801b670 con 0x7f0bf01549f0 2023-07-27T20:32:05.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.619+0000 7f0bf63ff700 1 -- 172.21.15.72:0/3747590476 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf00ae9b0 con 0x7f0bf01549f0 2023-07-27T20:32:05.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.620+0000 7f0bf63ff700 1 -- 172.21.15.72:0/3747590476 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bf0074310 con 0x7f0bf01549f0 2023-07-27T20:32:05.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.621+0000 7f0becff9700 1 -- 172.21.15.72:0/3747590476 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0be801b7d0 con 0x7f0bf01549f0 2023-07-27T20:32:05.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.622+0000 7f0becff9700 1 --2- 172.21.15.72:0/3747590476 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0bdc06ace0 0x7f0bdc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:05.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.622+0000 7f0becff9700 1 -- 172.21.15.72:0/3747590476 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0be808aff0 con 0x7f0bf01549f0 2023-07-27T20:32:05.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.622+0000 7f0beffff700 1 --2- 172.21.15.72:0/3747590476 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0bdc06ace0 0x7f0bdc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:05.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.623+0000 7f0beffff700 1 --2- 172.21.15.72:0/3747590476 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0bdc06ace0 0x7f0bdc06d1a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0be0007fd0 tx=0x7f0be0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:05.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.626+0000 7f0becff9700 1 -- 172.21.15.72:0/3747590476 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0be80bd310 con 0x7f0bf01549f0 2023-07-27T20:32:05.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.818+0000 7f0bf63ff700 1 -- 172.21.15.72:0/3747590476 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0bf00c5db0 con 0x7f0bf01549f0 2023-07-27T20:32:05.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.819+0000 7f0becff9700 1 -- 172.21.15.72:0/3747590476 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20120 (secure 0 0 0) 0x7f0be8055de0 con 0x7f0bf01549f0 2023-07-27T20:32:05.809 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:32:05.809 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:31:33.647304+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:31:27.020951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T20:31:27.566022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-27T20:31:31.182401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:32:05.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.822+0000 7f0bf63ff700 1 -- 172.21.15.72:0/3747590476 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0bdc06ace0 msgr2=0x7f0bdc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:05.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.822+0000 7f0bf63ff700 1 --2- 172.21.15.72:0/3747590476 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0bdc06ace0 0x7f0bdc06d1a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0be0007fd0 tx=0x7f0be0009040 comp rx=0 tx=0).stop 2023-07-27T20:32:05.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.822+0000 7f0bf63ff700 1 -- 172.21.15.72:0/3747590476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bf01549f0 msgr2=0x7f0bf00bd340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:05.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.822+0000 7f0bf63ff700 1 --2- 172.21.15.72:0/3747590476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bf01549f0 0x7f0bf00bd340 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0be800b730 tx=0x7f0be8004ad0 comp rx=0 tx=0).stop 2023-07-27T20:32:05.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.822+0000 7f0bf63ff700 1 -- 172.21.15.72:0/3747590476 shutdown_connections 2023-07-27T20:32:05.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.822+0000 7f0bf63ff700 1 --2- 172.21.15.72:0/3747590476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bf01549f0 0x7f0bf00bd340 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:05.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.822+0000 7f0bf63ff700 1 --2- 172.21.15.72:0/3747590476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0bf006b150 0x7f0bf014c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:05.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.822+0000 7f0bf63ff700 1 --2- 172.21.15.72:0/3747590476 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0bdc06ace0 0x7f0bdc06d1a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:05.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.822+0000 7f0bf63ff700 1 --2- 172.21.15.72:0/3747590476 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0bf00c4400 0x7f0bf00ae470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:05.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.822+0000 7f0bf63ff700 1 -- 172.21.15.72:0/3747590476 >> 172.21.15.72:0/3747590476 conn(0x7f0bf00ab300 msgr2=0x7f0bf01538e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:05.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.822+0000 7f0bf63ff700 1 -- 172.21.15.72:0/3747590476 shutdown_connections 2023-07-27T20:32:05.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:05.822+0000 7f0bf63ff700 1 -- 172.21.15.72:0/3747590476 wait complete. 2023-07-27T20:32:05.829 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T20:32:06.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.038+0000 7f842e3ff700 1 Processor -- start 2023-07-27T20:32:06.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.038+0000 7f842e3ff700 1 -- start start 2023-07-27T20:32:06.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.040+0000 7f842e3ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f84280c7710 0x7f84281514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:06.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.040+0000 7f842e3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8428155100 con 0x7f842806b150 2023-07-27T20:32:06.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.040+0000 7f842e3ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84280c7af0 con 0x7f84280c4400 2023-07-27T20:32:06.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.040+0000 7f842e3ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84281545d0 con 0x7f84280c7710 2023-07-27T20:32:06.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.040+0000 7f84277fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f842806b150 0x7f84281549f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52118/0 (socket says 172.21.15.72:52118) 2023-07-27T20:32:06.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.040+0000 7f84277fe700 1 -- 172.21.15.72:0/1321086914 learned_addr learned my addr 172.21.15.72:0/1321086914 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:06.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.040+0000 7f842c99c700 1 --2- 172.21.15.72:0/1321086914 >> v2:172.21.15.173:3300/0 conn(0x7f84280c7710 0x7f84281514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:06.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.041+0000 7f8426ffd700 1 -- 172.21.15.72:0/1321086914 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2265379764 0 0) 0x7f8428155100 con 0x7f842806b150 2023-07-27T20:32:06.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.041+0000 7f8426ffd700 1 -- 172.21.15.72:0/1321086914 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84100035b0 con 0x7f842806b150 2023-07-27T20:32:06.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.041+0000 7f842c99c700 1 -- 172.21.15.72:0/1321086914 >> v1:172.21.15.173:6789/0 conn(0x7f84280c4400 legacy=0x7f84280c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:06.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.041+0000 7f842c99c700 1 -- 172.21.15.72:0/1321086914 >> v1:172.21.15.72:6789/0 conn(0x7f842806b150 legacy=0x7f84281549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:06.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.041+0000 7f842c99c700 1 -- 172.21.15.72:0/1321086914 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f842806b710 con 0x7f84280c7710 2023-07-27T20:32:06.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.041+0000 7f842c99c700 1 --2- 172.21.15.72:0/1321086914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84280c7710 0x7f84281514a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8420009d90 tx=0x7f842000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36bcd1f27204830b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:06.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.041+0000 7f8426ffd700 1 -- 172.21.15.72:0/1321086914 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842000e070 con 0x7f84280c7710 2023-07-27T20:32:06.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.042+0000 7f8426ffd700 1 -- 172.21.15.72:0/1321086914 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842000bb20 con 0x7f84280c7710 2023-07-27T20:32:06.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.042+0000 7f8426ffd700 1 -- 172.21.15.72:0/1321086914 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8420012430 con 0x7f84280c7710 2023-07-27T20:32:06.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.042+0000 7f842e3ff700 1 -- 172.21.15.72:0/1321086914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84280c7710 msgr2=0x7f84281514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:06.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.042+0000 7f842e3ff700 1 --2- 172.21.15.72:0/1321086914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84280c7710 0x7f84281514a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8420009d90 tx=0x7f842000b330 comp rx=0 tx=0).stop 2023-07-27T20:32:06.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.042+0000 7f842e3ff700 1 -- 172.21.15.72:0/1321086914 shutdown_connections 2023-07-27T20:32:06.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.042+0000 7f842e3ff700 1 --2- 172.21.15.72:0/1321086914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84280c7710 0x7f84281514a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.042+0000 7f842e3ff700 1 -- 172.21.15.72:0/1321086914 >> 172.21.15.72:0/1321086914 conn(0x7f84280ab300 msgr2=0x7f84280ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:06.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.042+0000 7f842e3ff700 1 -- 172.21.15.72:0/1321086914 shutdown_connections 2023-07-27T20:32:06.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.042+0000 7f842e3ff700 1 -- 172.21.15.72:0/1321086914 wait complete. 2023-07-27T20:32:06.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.044+0000 7f842e3ff700 1 Processor -- start 2023-07-27T20:32:06.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.044+0000 7f842e3ff700 1 -- start start 2023-07-27T20:32:06.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.045+0000 7f842e3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f842806b150 0x7f8428151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:06.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.045+0000 7f842e3ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84280c4400 0x7f84280aa810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:06.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.045+0000 7f842e3ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84280c7710 0x7f84280aad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:06.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.045+0000 7f842e3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84281de430 con 0x7f842806b150 2023-07-27T20:32:06.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.045+0000 7f842e3ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8428146790 con 0x7f84280c4400 2023-07-27T20:32:06.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.045+0000 7f842e3ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84281ddf00 con 0x7f84280c7710 2023-07-27T20:32:06.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.045+0000 7f8427fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f842806b150 0x7f8428151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:06.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.045+0000 7f8427fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f842806b150 0x7f8428151a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46472/0 (socket says 172.21.15.72:46472) 2023-07-27T20:32:06.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.045+0000 7f8427fff700 1 -- 172.21.15.72:0/1598928134 learned_addr learned my addr 172.21.15.72:0/1598928134 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:06.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.045+0000 7f84277fe700 1 --2- 172.21.15.72:0/1598928134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84280c4400 0x7f84280aa810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:06.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.045+0000 7f842c99c700 1 --2- 172.21.15.72:0/1598928134 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84280c7710 0x7f84280aad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:06.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.045+0000 7f8427fff700 1 -- 172.21.15.72:0/1598928134 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84280c7710 msgr2=0x7f84280aad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:06.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.045+0000 7f8427fff700 1 --2- 172.21.15.72:0/1598928134 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84280c7710 0x7f84280aad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.045+0000 7f8427fff700 1 -- 172.21.15.72:0/1598928134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84280c4400 msgr2=0x7f84280aa810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:06.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.045+0000 7f8427fff700 1 --2- 172.21.15.72:0/1598928134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84280c4400 0x7f84280aa810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.045+0000 7f8427fff700 1 -- 172.21.15.72:0/1598928134 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8420009a70 con 0x7f842806b150 2023-07-27T20:32:06.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.045+0000 7f842c99c700 1 --2- 172.21.15.72:0/1598928134 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84280c7710 0x7f84280aad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:06.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.046+0000 7f8427fff700 1 --2- 172.21.15.72:0/1598928134 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f842806b150 0x7f8428151a20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f841800c510 tx=0x7f841800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:06.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.046+0000 7f8424ff9700 1 -- 172.21.15.72:0/1598928134 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84180052d0 con 0x7f842806b150 2023-07-27T20:32:06.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.046+0000 7f8424ff9700 1 -- 172.21.15.72:0/1598928134 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8418005430 con 0x7f842806b150 2023-07-27T20:32:06.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.046+0000 7f8424ff9700 1 -- 172.21.15.72:0/1598928134 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84180038c0 con 0x7f842806b150 2023-07-27T20:32:06.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.046+0000 7f842e3ff700 1 -- 172.21.15.72:0/1598928134 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84281de150 con 0x7f842806b150 2023-07-27T20:32:06.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.046+0000 7f842e3ff700 1 -- 172.21.15.72:0/1598928134 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8428145b10 con 0x7f842806b150 2023-07-27T20:32:06.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.047+0000 7f842e3ff700 1 -- 172.21.15.72:0/1598928134 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8428145690 con 0x7f842806b150 2023-07-27T20:32:06.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.048+0000 7f8424ff9700 1 -- 172.21.15.72:0/1598928134 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8418003a20 con 0x7f842806b150 2023-07-27T20:32:06.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.049+0000 7f8424ff9700 1 --2- 172.21.15.72:0/1598928134 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f841406ace0 0x7f841406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:06.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.049+0000 7f8424ff9700 1 -- 172.21.15.72:0/1598928134 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8418088b70 con 0x7f842806b150 2023-07-27T20:32:06.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.049+0000 7f84277fe700 1 --2- 172.21.15.72:0/1598928134 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f841406ace0 0x7f841406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:06.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.050+0000 7f84277fe700 1 --2- 172.21.15.72:0/1598928134 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f841406ace0 0x7f841406d1a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f84280c5cb0 tx=0x7f841c007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:06.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.053+0000 7f8424ff9700 1 -- 172.21.15.72:0/1598928134 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8428145690 con 0x7f842806b150 2023-07-27T20:32:06.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.289+0000 7f842e3ff700 1 -- 172.21.15.72:0/1598928134 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8428145690 con 0x7f842806b150 2023-07-27T20:32:06.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.290+0000 7f8424ff9700 1 -- 172.21.15.72:0/1598928134 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f8428145690 con 0x7f842806b150 2023-07-27T20:32:06.279 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:32:06.279 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/1913374698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1913374698},{"type":"v1","addr":"172.21.15.72:6834","nonce":1913374698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/3260445560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":3260445560},{"type":"v1","addr":"172.21.15.72:6835","nonce":3260445560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1305837931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1305837931},{"type":"v1","addr":"172.21.15.173:6837","nonce":1305837931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T20:31:28.592113+0000","modified":"2023-07-27T20:31:51.217923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6835/516740687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":516740687},{"type":"v1","addr":"172.21.15.173:6835","nonce":516740687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-27T20:32:06.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.292+0000 7f842e3ff700 1 -- 172.21.15.72:0/1598928134 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f841406ace0 msgr2=0x7f841406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:06.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.292+0000 7f842e3ff700 1 --2- 172.21.15.72:0/1598928134 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f841406ace0 0x7f841406d1a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f84280c5cb0 tx=0x7f841c007dc0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.292+0000 7f842e3ff700 1 -- 172.21.15.72:0/1598928134 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f842806b150 msgr2=0x7f8428151a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:06.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.292+0000 7f842e3ff700 1 --2- 172.21.15.72:0/1598928134 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f842806b150 0x7f8428151a20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f841800c510 tx=0x7f841800c820 comp rx=0 tx=0).stop 2023-07-27T20:32:06.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.292+0000 7f842e3ff700 1 -- 172.21.15.72:0/1598928134 shutdown_connections 2023-07-27T20:32:06.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.292+0000 7f842e3ff700 1 --2- 172.21.15.72:0/1598928134 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f841406ace0 0x7f841406d1a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.292+0000 7f842e3ff700 1 --2- 172.21.15.72:0/1598928134 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84280c7710 0x7f84280aad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.292+0000 7f842e3ff700 1 --2- 172.21.15.72:0/1598928134 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f842806b150 0x7f8428151a20 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.292+0000 7f842e3ff700 1 --2- 172.21.15.72:0/1598928134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84280c4400 0x7f84280aa810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.292+0000 7f842e3ff700 1 -- 172.21.15.72:0/1598928134 >> 172.21.15.72:0/1598928134 conn(0x7f84280ab300 msgr2=0x7f84281536b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:06.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.292+0000 7f842e3ff700 1 -- 172.21.15.72:0/1598928134 shutdown_connections 2023-07-27T20:32:06.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.292+0000 7f842e3ff700 1 -- 172.21.15.72:0/1598928134 wait complete. 2023-07-27T20:32:06.283 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 9 2023-07-27T20:32:06.701 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-27T20:31:28.592113+0000', 'modified': '2023-07-27T20:31:51.217923+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4267}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4267': {'gid': 4267, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.173:6835/516740687', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6834', 'nonce': 516740687}, {'type': 'v1', 'addr': '172.21.15.173:6835', 'nonce': 516740687}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-27T20:32:06.702 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-27T20:32:06.702 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-07-27T20:32:06.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.911+0000 7f36fb7ff700 1 Processor -- start 2023-07-27T20:32:06.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.911+0000 7f36fb7ff700 1 -- start start 2023-07-27T20:32:06.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.912+0000 7f36fb7ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f36f406b520 0x7f36f40a8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:06.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.912+0000 7f36fb7ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f36f406ef00 0x7f36f406b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:06.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.912+0000 7f36fb7ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36f406e270 con 0x7f36f4158000 2023-07-27T20:32:06.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.912+0000 7f36fb7ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f40c1850 con 0x7f36f406b520 2023-07-27T20:32:06.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.912+0000 7f36fb7ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f406e7a0 con 0x7f36f406ef00 2023-07-27T20:32:06.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.913+0000 7f36f959b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f36f406b520 0x7f36f40a8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:06.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.913+0000 7f36f9d9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f36f4158000 0x7f36f4154000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52124/0 (socket says 172.21.15.72:52124) 2023-07-27T20:32:06.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.913+0000 7f36f9d9c700 1 -- 172.21.15.72:0/4107354455 learned_addr learned my addr 172.21.15.72:0/4107354455 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:06.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.913+0000 7f36f8d9a700 1 --2- 172.21.15.72:0/4107354455 >> v2:172.21.15.173:3300/0 conn(0x7f36f406ef00 0x7f36f406b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:06.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.913+0000 7f36f959b700 1 -- 172.21.15.72:0/4107354455 >> v2:172.21.15.173:3300/0 conn(0x7f36f406ef00 msgr2=0x7f36f406b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:06.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.913+0000 7f36f959b700 1 --2- 172.21.15.72:0/4107354455 >> v2:172.21.15.173:3300/0 conn(0x7f36f406ef00 0x7f36f406b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.913+0000 7f36f959b700 1 -- 172.21.15.72:0/4107354455 >> v1:172.21.15.72:6789/0 conn(0x7f36f4158000 legacy=0x7f36f4154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:06.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.913+0000 7f36f959b700 1 -- 172.21.15.72:0/4107354455 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f40c2dd0 con 0x7f36f406b520 2023-07-27T20:32:06.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.913+0000 7f36ebfff700 1 -- 172.21.15.72:0/4107354455 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 450986238 0 0) 0x7f36f406e270 con 0x7f36f4158000 2023-07-27T20:32:06.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.914+0000 7f36f959b700 1 --2- 172.21.15.72:0/4107354455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36f406b520 0x7f36f40a8de0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f36f406b230 tx=0x7f36f0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d80c49c2bd5ad20 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:06.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.914+0000 7f36ebfff700 1 -- 172.21.15.72:0/4107354455 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f0011830 con 0x7f36f406b520 2023-07-27T20:32:06.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.914+0000 7f36ebfff700 1 -- 172.21.15.72:0/4107354455 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f0011990 con 0x7f36f406b520 2023-07-27T20:32:06.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.914+0000 7f36ebfff700 1 -- 172.21.15.72:0/4107354455 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f0011d20 con 0x7f36f406b520 2023-07-27T20:32:06.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.914+0000 7f36fb7ff700 1 -- 172.21.15.72:0/4107354455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36f406b520 msgr2=0x7f36f40a8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:06.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.914+0000 7f36fb7ff700 1 --2- 172.21.15.72:0/4107354455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36f406b520 0x7f36f40a8de0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f36f406b230 tx=0x7f36f0009b20 comp rx=0 tx=0).stop 2023-07-27T20:32:06.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.914+0000 7f36fb7ff700 1 -- 172.21.15.72:0/4107354455 shutdown_connections 2023-07-27T20:32:06.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.914+0000 7f36fb7ff700 1 --2- 172.21.15.72:0/4107354455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36f406b520 0x7f36f40a8de0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.914+0000 7f36fb7ff700 1 --2- 172.21.15.72:0/4107354455 >> v2:172.21.15.173:3300/0 conn(0x7f36f406ef00 0x7f36f406b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.914+0000 7f36fb7ff700 1 -- 172.21.15.72:0/4107354455 >> 172.21.15.72:0/4107354455 conn(0x7f36f40c6800 msgr2=0x7f36f40c6c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:06.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.914+0000 7f36fb7ff700 1 -- 172.21.15.72:0/4107354455 shutdown_connections 2023-07-27T20:32:06.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.914+0000 7f36fb7ff700 1 -- 172.21.15.72:0/4107354455 wait complete. 2023-07-27T20:32:06.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.916+0000 7f36fb7ff700 1 Processor -- start 2023-07-27T20:32:06.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.916+0000 7f36fb7ff700 1 -- start start 2023-07-27T20:32:06.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.917+0000 7f36fb7ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f36f406b520 0x7f36f40a7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:06.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.917+0000 7f36fb7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36f406ef00 0x7f36f4149de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:06.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.917+0000 7f36fb7ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36f4158000 0x7f36f414a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:06.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.917+0000 7f36fb7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f41e98e0 con 0x7f36f406ef00 2023-07-27T20:32:06.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.917+0000 7f36fb7ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f414e670 con 0x7f36f4158000 2023-07-27T20:32:06.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.917+0000 7f36fb7ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f41518e0 con 0x7f36f406b520 2023-07-27T20:32:06.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.917+0000 7f36f8d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36f406ef00 0x7f36f4149de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:06.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.917+0000 7f36f8d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36f406ef00 0x7f36f4149de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46490/0 (socket says 172.21.15.72:46490) 2023-07-27T20:32:06.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.917+0000 7f36f8d9a700 1 -- 172.21.15.72:0/536430570 learned_addr learned my addr 172.21.15.72:0/536430570 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:06.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.918+0000 7f36f959b700 1 --2- 172.21.15.72:0/536430570 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f36f406b520 0x7f36f40a7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:06.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.918+0000 7f36f9d9c700 1 --2- 172.21.15.72:0/536430570 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36f4158000 0x7f36f414a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:06.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.918+0000 7f36f8d9a700 1 -- 172.21.15.72:0/536430570 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f36f406b520 msgr2=0x7f36f40a7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:06.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.918+0000 7f36f8d9a700 1 --2- 172.21.15.72:0/536430570 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f36f406b520 0x7f36f40a7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.918+0000 7f36f8d9a700 1 -- 172.21.15.72:0/536430570 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36f4158000 msgr2=0x7f36f414a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:06.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.918+0000 7f36f8d9a700 1 --2- 172.21.15.72:0/536430570 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36f4158000 0x7f36f414a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.918+0000 7f36f8d9a700 1 -- 172.21.15.72:0/536430570 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f00094a0 con 0x7f36f406ef00 2023-07-27T20:32:06.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.918+0000 7f36f8d9a700 1 --2- 172.21.15.72:0/536430570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36f406ef00 0x7f36f4149de0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f36e400e9b0 tx=0x7f36e400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:06.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.918+0000 7f36e9ffb700 1 -- 172.21.15.72:0/536430570 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e4009710 con 0x7f36f406ef00 2023-07-27T20:32:06.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.918+0000 7f36e9ffb700 1 -- 172.21.15.72:0/536430570 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e400c850 con 0x7f36f406ef00 2023-07-27T20:32:06.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.918+0000 7f36fb7ff700 1 -- 172.21.15.72:0/536430570 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f41edb20 con 0x7f36f406ef00 2023-07-27T20:32:06.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.918+0000 7f36e9ffb700 1 -- 172.21.15.72:0/536430570 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e400cc00 con 0x7f36f406ef00 2023-07-27T20:32:06.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.919+0000 7f36fb7ff700 1 -- 172.21.15.72:0/536430570 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f40a8340 con 0x7f36f406ef00 2023-07-27T20:32:06.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.920+0000 7f36e9ffb700 1 -- 172.21.15.72:0/536430570 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f36e400cd60 con 0x7f36f406ef00 2023-07-27T20:32:06.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.921+0000 7f36e9ffb700 1 --2- 172.21.15.72:0/536430570 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f36d806ace0 0x7f36d806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:06.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.921+0000 7f36e9ffb700 1 -- 172.21.15.72:0/536430570 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f36e4089940 con 0x7f36f406ef00 2023-07-27T20:32:06.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.922+0000 7f36f959b700 1 --2- 172.21.15.72:0/536430570 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f36d806ace0 0x7f36d806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:06.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.923+0000 7f36f959b700 1 --2- 172.21.15.72:0/536430570 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f36d806ace0 0x7f36d806d1a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f36f00090b0 tx=0x7f36f0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:06.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.923+0000 7f370f12fb80 1 Processor -- start 2023-07-27T20:32:06.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.923+0000 7f370f12fb80 1 -- start start 2023-07-27T20:32:06.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.924+0000 7f370f12fb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564b51fb2d20 0x564b51f96280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:06.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.924+0000 7f370f12fb80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x564b51fb3100 0x564b51f8fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:06.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.924+0000 7f370f12fb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b51fb3580 0x564b51f902f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:06.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.924+0000 7f370f12fb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b51f09ab0 con 0x564b51fb2d20 2023-07-27T20:32:06.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.924+0000 7f370f12fb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b51eee440 con 0x564b51fb3580 2023-07-27T20:32:06.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.924+0000 7f370f12fb80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b51eebba0 con 0x564b51fb3100 2023-07-27T20:32:06.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.924+0000 7f36f959b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564b51fb2d20 0x564b51f96280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:06.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.924+0000 7f36f959b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564b51fb2d20 0x564b51f96280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46492/0 (socket says 172.21.15.72:46492) 2023-07-27T20:32:06.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.924+0000 7f36f959b700 1 -- 172.21.15.72:0/2218002832 learned_addr learned my addr 172.21.15.72:0/2218002832 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:06.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.925+0000 7f36f8d9a700 1 --2- 172.21.15.72:0/2218002832 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x564b51fb3100 0x564b51f8fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:06.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.925+0000 7f36f9d9c700 1 --2- 172.21.15.72:0/2218002832 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b51fb3580 0x564b51f902f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:06.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.925+0000 7f36f959b700 1 -- 172.21.15.72:0/2218002832 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x564b51fb3100 msgr2=0x564b51f8fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:06.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.925+0000 7f36f959b700 1 --2- 172.21.15.72:0/2218002832 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x564b51fb3100 0x564b51f8fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.925+0000 7f36f959b700 1 -- 172.21.15.72:0/2218002832 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b51fb3580 msgr2=0x564b51f902f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:06.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.925+0000 7f36f959b700 1 --2- 172.21.15.72:0/2218002832 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b51fb3580 0x564b51f902f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.925+0000 7f36f959b700 1 -- 172.21.15.72:0/2218002832 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b51cda790 con 0x564b51fb2d20 2023-07-27T20:32:06.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.925+0000 7f36f959b700 1 --2- 172.21.15.72:0/2218002832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564b51fb2d20 0x564b51f96280 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f36f0011ce0 tx=0x7f36f0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=973030325c9a2cb9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:06.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.925+0000 7f36deffd700 1 -- 172.21.15.72:0/2218002832 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f002b070 con 0x564b51fb2d20 2023-07-27T20:32:06.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.925+0000 7f36deffd700 1 -- 172.21.15.72:0/2218002832 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f00036a0 con 0x564b51fb2d20 2023-07-27T20:32:06.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.925+0000 7f36deffd700 1 -- 172.21.15.72:0/2218002832 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f001f070 con 0x564b51fb2d20 2023-07-27T20:32:06.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.926+0000 7f370f12fb80 1 -- 172.21.15.72:0/2218002832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564b51fb2d20 msgr2=0x564b51f96280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:06.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.926+0000 7f370f12fb80 1 --2- 172.21.15.72:0/2218002832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564b51fb2d20 0x564b51f96280 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f36f0011ce0 tx=0x7f36f0010000 comp rx=0 tx=0).stop 2023-07-27T20:32:06.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.926+0000 7f370f12fb80 1 -- 172.21.15.72:0/2218002832 shutdown_connections 2023-07-27T20:32:06.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.926+0000 7f370f12fb80 1 --2- 172.21.15.72:0/2218002832 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b51fb3580 0x564b51f902f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.926+0000 7f370f12fb80 1 --2- 172.21.15.72:0/2218002832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564b51fb2d20 0x564b51f96280 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.926+0000 7f370f12fb80 1 --2- 172.21.15.72:0/2218002832 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x564b51fb3100 0x564b51f8fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.926+0000 7f370f12fb80 1 -- 172.21.15.72:0/2218002832 >> 172.21.15.72:0/2218002832 conn(0x564b51ef53a0 msgr2=0x564b51f92ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:06.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.926+0000 7f370f12fb80 1 -- 172.21.15.72:0/2218002832 shutdown_connections 2023-07-27T20:32:06.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.926+0000 7f370f12fb80 1 -- 172.21.15.72:0/2218002832 wait complete. 2023-07-27T20:32:06.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.927+0000 7f370f12fb80 1 -- start start 2023-07-27T20:32:06.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.927+0000 7f370f12fb80 1 Processor -- start 2023-07-27T20:32:06.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.928+0000 7f370f12fb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b51fb2d20 0x564b51fd19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:06.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.928+0000 7f370f12fb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564b51fb3100 0x564b51fab850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:06.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.928+0000 7f370f12fb80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x564b51fb3580 0x564b51fd4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:06.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.928+0000 7f370f12fb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b51ee7490 con 0x564b51fb3100 2023-07-27T20:32:06.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.928+0000 7f370f12fb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b51ea45b0 con 0x564b51fb2d20 2023-07-27T20:32:06.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.928+0000 7f370f12fb80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b51e8a910 con 0x564b51fb3580 2023-07-27T20:32:06.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.928+0000 7f370f12fb80 10 client.0 _ll_register_callbacks cb 0x564b51ce3a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-27T20:32:06.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.928+0000 7f36f8d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564b51fb3100 0x564b51fab850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:06.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.928+0000 7f36f8d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564b51fb3100 0x564b51fab850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46502/0 (socket says 172.21.15.72:46502) 2023-07-27T20:32:06.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.928+0000 7f36f8d9a700 1 -- 172.21.15.72:0/1985094478 learned_addr learned my addr 172.21.15.72:0/1985094478 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:06.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.928+0000 7f36f959b700 1 --2- 172.21.15.72:0/1985094478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b51fb2d20 0x564b51fd19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:06.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.928+0000 7f36f9d9c700 1 --2- 172.21.15.72:0/1985094478 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x564b51fb3580 0x564b51fd4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:06.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.929+0000 7f36f8d9a700 1 -- 172.21.15.72:0/1985094478 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x564b51fb3580 msgr2=0x564b51fd4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:06.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.929+0000 7f36f8d9a700 1 --2- 172.21.15.72:0/1985094478 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x564b51fb3580 0x564b51fd4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.929+0000 7f36f8d9a700 1 -- 172.21.15.72:0/1985094478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b51fb2d20 msgr2=0x564b51fd19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:06.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.929+0000 7f36f8d9a700 1 --2- 172.21.15.72:0/1985094478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b51fb2d20 0x564b51fd19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.929+0000 7f36f8d9a700 1 -- 172.21.15.72:0/1985094478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f40c2dd0 con 0x564b51fb3100 2023-07-27T20:32:06.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.929+0000 7f36f8d9a700 1 --2- 172.21.15.72:0/1985094478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564b51fb3100 0x564b51fab850 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f36e4058030 tx=0x7f36e40607d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d07a1552bebf51 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:06.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.929+0000 7f36d3fff700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-07-27T20:32:06.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.929+0000 7f36d3fff700 1 -- 172.21.15.72:0/1985094478 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e40603f0 con 0x564b51fb3100 2023-07-27T20:32:06.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.929+0000 7f36d3fff700 1 -- 172.21.15.72:0/1985094478 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f36e4054120 con 0x564b51fb3100 2023-07-27T20:32:06.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.929+0000 7f370f12fb80 1 -- 172.21.15.72:0/1985094478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564b51f87d80 con 0x564b51fb3100 2023-07-27T20:32:06.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.929+0000 7f36d3fff700 1 -- 172.21.15.72:0/1985094478 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36e40542e0 con 0x564b51fb3100 2023-07-27T20:32:06.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.929+0000 7f370f12fb80 10 client.4851 fetch_fsmap learned FSMap version 9 2023-07-27T20:32:06.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.929+0000 7f370f12fb80 1 -- 172.21.15.72:0/1985094478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x564b51dc70a0 con 0x564b51fb3100 2023-07-27T20:32:06.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.929+0000 7f36d3fff700 1 -- 172.21.15.72:0/1985094478 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e4085020 con 0x564b51fb3100 2023-07-27T20:32:06.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.930+0000 7f36d3fff700 1 -- 172.21.15.72:0/1985094478 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f36e4081b50 con 0x564b51fb3100 2023-07-27T20:32:06.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.930+0000 7f370f12fb80 10 client.4851 fetch_fsmap finished waiting for FSMap version 9 2023-07-27T20:32:06.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.930+0000 7f370f12fb80 10 client.4851 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-27T20:32:06.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.930+0000 7f370f12fb80 20 client.4851 populate_metadata read hostname 'smithi072' 2023-07-27T20:32:06.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.930+0000 7f370f12fb80 1 --2- 172.21.15.72:0/1985094478 >> [v2:172.21.15.173:6834/516740687,v1:172.21.15.173:6835/516740687] conn(0x564b51fceef0 0x564b51fcf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:06.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.930+0000 7f370f12fb80 4 client.4851 mds_command: new command op to 4267 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-27T20:32:06.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.930+0000 7f370f12fb80 1 -- 172.21.15.72:0/1985094478 --> [v2:172.21.15.173:6834/516740687,v1:172.21.15.173:6835/516740687] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564b51f64b50 con 0x564b51fceef0 2023-07-27T20:32:06.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.930+0000 7f36f959b700 1 --2- 172.21.15.72:0/1985094478 >> [v2:172.21.15.173:6834/516740687,v1:172.21.15.173:6835/516740687] conn(0x564b51fceef0 0x564b51fcf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:06.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.931+0000 7f36f959b700 1 --2- 172.21.15.72:0/1985094478 >> [v2:172.21.15.173:6834/516740687,v1:172.21.15.173:6835/516740687] conn(0x564b51fceef0 0x564b51fcf2d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91124963cad9c342 server_cookie=bd78120db5f53196 in_seq=0 out_seq=0 2023-07-27T20:32:06.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.931+0000 7f36d3fff700 10 client.4851 ms_handle_connect on v2:172.21.15.173:6834/516740687 2023-07-27T20:32:06.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.931+0000 7f36d3fff700 1 -- 172.21.15.72:0/1985094478 <== mds.0 v2:172.21.15.173:6834/516740687 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x564b51f64b50 con 0x564b51fceef0 2023-07-27T20:32:06.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.931+0000 7f36d3fff700 10 client.4851 handle_command_reply: tid=0 2023-07-27T20:32:06.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.931+0000 7f370f12fb80 1 client.4851 shutdown 2023-07-27T20:32:06.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.932+0000 7f370f12fb80 1 -- 172.21.15.72:0/1985094478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564b51fb3100 msgr2=0x564b51fab850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:06.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.932+0000 7f370f12fb80 1 --2- 172.21.15.72:0/1985094478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564b51fb3100 0x564b51fab850 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f36e4058030 tx=0x7f36e40607d0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.932+0000 7f370f12fb80 1 -- 172.21.15.72:0/1985094478 shutdown_connections 2023-07-27T20:32:06.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.932+0000 7f370f12fb80 1 --2- 172.21.15.72:0/1985094478 >> [v2:172.21.15.173:6834/516740687,v1:172.21.15.173:6835/516740687] conn(0x564b51fceef0 0x564b51fcf2d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.932+0000 7f370f12fb80 1 --2- 172.21.15.72:0/1985094478 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x564b51fb3580 0x564b51fd4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.932+0000 7f370f12fb80 1 --2- 172.21.15.72:0/1985094478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b51fb2d20 0x564b51fd19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.932+0000 7f36d3fff700 0 client.4851 ms_handle_reset on v2:172.21.15.173:6834/516740687 2023-07-27T20:32:06.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.932+0000 7f370f12fb80 1 --2- 172.21.15.72:0/1985094478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564b51fb3100 0x564b51fab850 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.932+0000 7f370f12fb80 1 -- 172.21.15.72:0/1985094478 >> 172.21.15.72:0/1985094478 conn(0x564b51ef53a0 msgr2=0x564b51f8f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:06.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.932+0000 7f370f12fb80 1 -- 172.21.15.72:0/1985094478 shutdown_connections 2023-07-27T20:32:06.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.932+0000 7f370f12fb80 1 -- 172.21.15.72:0/1985094478 wait complete. 2023-07-27T20:32:06.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.932+0000 7f370f12fb80 20 client.4851 trim_cache size 0 max 16384 2023-07-27T20:32:06.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.949+0000 7f370f12fb80 1 Processor -- start 2023-07-27T20:32:06.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.949+0000 7f370f12fb80 1 -- start start 2023-07-27T20:32:06.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.950+0000 7f370f12fb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564b51fb2d20 0x564b51fcf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:06.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.950+0000 7f370f12fb80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x564b51fb3100 0x564b51fd4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:06.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.950+0000 7f370f12fb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b51fb3580 0x564b51fd4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:06.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.950+0000 7f370f12fb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b51cdb390 con 0x564b51fb2d20 2023-07-27T20:32:06.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.950+0000 7f370f12fb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b51fd0200 con 0x564b51fb3580 2023-07-27T20:32:06.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.950+0000 7f370f12fb80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b51f91440 con 0x564b51fb3100 2023-07-27T20:32:06.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.950+0000 7f36f959b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564b51fb2d20 0x564b51fcf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:06.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.950+0000 7f36f959b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564b51fb2d20 0x564b51fcf2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46518/0 (socket says 172.21.15.72:46518) 2023-07-27T20:32:06.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.950+0000 7f36f959b700 1 -- 172.21.15.72:0/2264958676 learned_addr learned my addr 172.21.15.72:0/2264958676 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:06.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.951+0000 7f36f8d9a700 1 --2- 172.21.15.72:0/2264958676 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x564b51fb3100 0x564b51fd4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:06.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.951+0000 7f36f9d9c700 1 --2- 172.21.15.72:0/2264958676 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b51fb3580 0x564b51fd4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:06.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.951+0000 7f36f959b700 1 -- 172.21.15.72:0/2264958676 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x564b51fb3100 msgr2=0x564b51fd4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:06.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.951+0000 7f36f959b700 1 --2- 172.21.15.72:0/2264958676 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x564b51fb3100 0x564b51fd4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.951+0000 7f36f959b700 1 -- 172.21.15.72:0/2264958676 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b51fb3580 msgr2=0x564b51fd4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:06.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.951+0000 7f36f959b700 1 --2- 172.21.15.72:0/2264958676 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b51fb3580 0x564b51fd4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.951+0000 7f36f959b700 1 -- 172.21.15.72:0/2264958676 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b51eacb10 con 0x564b51fb2d20 2023-07-27T20:32:06.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.951+0000 7f36f9d9c700 1 --2- 172.21.15.72:0/2264958676 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b51fb3580 0x564b51fd4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:06.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.951+0000 7f36f959b700 1 --2- 172.21.15.72:0/2264958676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564b51fb2d20 0x564b51fcf2d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f36f00117a0 tx=0x7f36f001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52fc40b9920afdd7 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:06.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.951+0000 7f36df7fe700 1 -- 172.21.15.72:0/2264958676 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f002b040 con 0x564b51fb2d20 2023-07-27T20:32:06.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.951+0000 7f36df7fe700 1 -- 172.21.15.72:0/2264958676 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f003e180 con 0x564b51fb2d20 2023-07-27T20:32:06.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.951+0000 7f36df7fe700 1 -- 172.21.15.72:0/2264958676 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f003e4f0 con 0x564b51fb2d20 2023-07-27T20:32:06.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.952+0000 7f370f12fb80 1 -- 172.21.15.72:0/2264958676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564b51fb2d20 msgr2=0x564b51fcf2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:06.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.952+0000 7f370f12fb80 1 --2- 172.21.15.72:0/2264958676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564b51fb2d20 0x564b51fcf2d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f36f00117a0 tx=0x7f36f001f000 comp rx=0 tx=0).stop 2023-07-27T20:32:06.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.952+0000 7f370f12fb80 1 -- 172.21.15.72:0/2264958676 shutdown_connections 2023-07-27T20:32:06.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.952+0000 7f370f12fb80 1 --2- 172.21.15.72:0/2264958676 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b51fb3580 0x564b51fd4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.952+0000 7f370f12fb80 1 --2- 172.21.15.72:0/2264958676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564b51fb2d20 0x564b51fcf2d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.952+0000 7f370f12fb80 1 --2- 172.21.15.72:0/2264958676 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x564b51fb3100 0x564b51fd4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.952+0000 7f370f12fb80 1 -- 172.21.15.72:0/2264958676 >> 172.21.15.72:0/2264958676 conn(0x564b51ef53a0 msgr2=0x564b51fab660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:06.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.952+0000 7f370f12fb80 1 -- 172.21.15.72:0/2264958676 shutdown_connections 2023-07-27T20:32:06.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.952+0000 7f370f12fb80 1 -- 172.21.15.72:0/2264958676 wait complete. 2023-07-27T20:32:06.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.953+0000 7f370f12fb80 1 -- start start 2023-07-27T20:32:06.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.953+0000 7f370f12fb80 1 Processor -- start 2023-07-27T20:32:06.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.954+0000 7f370f12fb80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x564b51fb2d20 0x564b51fb44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:06.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.954+0000 7f370f12fb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b51fb3100 0x564b51fdd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:06.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.954+0000 7f370f12fb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564b51fb3580 0x564b5203ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:06.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.954+0000 7f370f12fb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b51fba210 con 0x564b51fb3580 2023-07-27T20:32:06.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.954+0000 7f370f12fb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b51fddf90 con 0x564b51fb3100 2023-07-27T20:32:06.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.954+0000 7f370f12fb80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b51fcbcf0 con 0x564b51fb2d20 2023-07-27T20:32:06.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.954+0000 7f370f12fb80 10 client.0 _ll_register_callbacks cb 0x564b51ce3a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-27T20:32:06.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.954+0000 7f36f9d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564b51fb3580 0x564b5203ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:06.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.954+0000 7f36f9d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564b51fb3580 0x564b5203ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46534/0 (socket says 172.21.15.72:46534) 2023-07-27T20:32:06.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.954+0000 7f36f9d9c700 1 -- 172.21.15.72:0/3395950434 learned_addr learned my addr 172.21.15.72:0/3395950434 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:06.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.954+0000 7f36f959b700 1 --2- 172.21.15.72:0/3395950434 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x564b51fb2d20 0x564b51fb44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:06.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.954+0000 7f36f8d9a700 1 --2- 172.21.15.72:0/3395950434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b51fb3100 0x564b51fdd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:06.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.954+0000 7f36f9d9c700 1 -- 172.21.15.72:0/3395950434 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x564b51fb2d20 msgr2=0x564b51fb44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:06.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.954+0000 7f36f9d9c700 1 --2- 172.21.15.72:0/3395950434 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x564b51fb2d20 0x564b51fb44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.954+0000 7f36f9d9c700 1 -- 172.21.15.72:0/3395950434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b51fb3100 msgr2=0x564b51fdd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:06.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.954+0000 7f36f9d9c700 1 --2- 172.21.15.72:0/3395950434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b51fb3100 0x564b51fdd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.954+0000 7f36f9d9c700 1 -- 172.21.15.72:0/3395950434 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564b51cda790 con 0x564b51fb3580 2023-07-27T20:32:06.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.955+0000 7f36f9d9c700 1 --2- 172.21.15.72:0/3395950434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564b51fb3580 0x564b5203ad20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f36ec007af0 tx=0x7f36ec0166a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef91579a9fdb2a08 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:06.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.955+0000 7f36d3fff700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-07-27T20:32:06.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.955+0000 7f36d3fff700 1 -- 172.21.15.72:0/3395950434 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec016e50 con 0x564b51fb3580 2023-07-27T20:32:06.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.955+0000 7f36d3fff700 1 -- 172.21.15.72:0/3395950434 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f36ec020470 con 0x564b51fb3580 2023-07-27T20:32:06.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.955+0000 7f370f12fb80 1 -- 172.21.15.72:0/3395950434 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f36f00036a0 con 0x564b51fb3580 2023-07-27T20:32:06.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.955+0000 7f36d3fff700 1 -- 172.21.15.72:0/3395950434 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36ec020630 con 0x564b51fb3580 2023-07-27T20:32:06.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.955+0000 7f370f12fb80 10 client.4857 fetch_fsmap learned FSMap version 9 2023-07-27T20:32:06.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.955+0000 7f370f12fb80 1 -- 172.21.15.72:0/3395950434 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x564b51d3b1d0 con 0x564b51fb3580 2023-07-27T20:32:06.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.955+0000 7f36d3fff700 1 -- 172.21.15.72:0/3395950434 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f00036a0 con 0x564b51fb3580 2023-07-27T20:32:06.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.955+0000 7f36d3fff700 1 -- 172.21.15.72:0/3395950434 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f36ec020790 con 0x564b51fb3580 2023-07-27T20:32:06.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.955+0000 7f370f12fb80 10 client.4857 fetch_fsmap finished waiting for FSMap version 9 2023-07-27T20:32:06.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.955+0000 7f370f12fb80 10 client.4857 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-27T20:32:06.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.955+0000 7f370f12fb80 20 client.4857 populate_metadata read hostname 'smithi072' 2023-07-27T20:32:06.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.955+0000 7f370f12fb80 1 --2- 172.21.15.72:0/3395950434 >> [v2:172.21.15.173:6834/516740687,v1:172.21.15.173:6835/516740687] conn(0x564b5203b4f0 0x564b520345c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:06.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.956+0000 7f370f12fb80 4 client.4857 mds_command: new command op to 4267 tid=0[{"prefix": "status"}] 2023-07-27T20:32:06.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.956+0000 7f370f12fb80 1 -- 172.21.15.72:0/3395950434 --> [v2:172.21.15.173:6834/516740687,v1:172.21.15.173:6835/516740687] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564b51ee05d0 con 0x564b5203b4f0 2023-07-27T20:32:06.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.956+0000 7f36f959b700 1 --2- 172.21.15.72:0/3395950434 >> [v2:172.21.15.173:6834/516740687,v1:172.21.15.173:6835/516740687] conn(0x564b5203b4f0 0x564b520345c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:06.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.956+0000 7f36f959b700 1 --2- 172.21.15.72:0/3395950434 >> [v2:172.21.15.173:6834/516740687,v1:172.21.15.173:6835/516740687] conn(0x564b5203b4f0 0x564b520345c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cc2dd4bc793a430 server_cookie=80f35850cc8b0895 in_seq=0 out_seq=0 2023-07-27T20:32:06.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.956+0000 7f36d3fff700 10 client.4857 ms_handle_connect on v2:172.21.15.173:6834/516740687 2023-07-27T20:32:06.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.957+0000 7f36d3fff700 1 -- 172.21.15.72:0/3395950434 <== mds.0 v2:172.21.15.173:6834/516740687 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x564b51ee05d0 con 0x564b5203b4f0 2023-07-27T20:32:06.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.957+0000 7f36d3fff700 10 client.4857 handle_command_reply: tid=0 2023-07-27T20:32:06.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.957+0000 7f370f12fb80 1 client.4857 shutdown 2023-07-27T20:32:06.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.957+0000 7f370f12fb80 1 -- 172.21.15.72:0/3395950434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564b51fb3580 msgr2=0x564b5203ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:06.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.957+0000 7f370f12fb80 1 --2- 172.21.15.72:0/3395950434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564b51fb3580 0x564b5203ad20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f36ec007af0 tx=0x7f36ec0166a0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.957+0000 7f370f12fb80 1 -- 172.21.15.72:0/3395950434 shutdown_connections 2023-07-27T20:32:06.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.957+0000 7f370f12fb80 1 --2- 172.21.15.72:0/3395950434 >> [v2:172.21.15.173:6834/516740687,v1:172.21.15.173:6835/516740687] conn(0x564b5203b4f0 0x564b520345c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.957+0000 7f370f12fb80 1 --2- 172.21.15.72:0/3395950434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564b51fb3580 0x564b5203ad20 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.957+0000 7f370f12fb80 1 --2- 172.21.15.72:0/3395950434 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x564b51fb2d20 0x564b51fb44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.957+0000 7f36d3fff700 0 client.4857 ms_handle_reset on v2:172.21.15.173:6834/516740687 2023-07-27T20:32:06.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.957+0000 7f370f12fb80 1 --2- 172.21.15.72:0/3395950434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564b51fb3100 0x564b51fdd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.957+0000 7f370f12fb80 1 -- 172.21.15.72:0/3395950434 >> 172.21.15.72:0/3395950434 conn(0x564b51ef53a0 msgr2=0x564b51fab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:06.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.957+0000 7f370f12fb80 1 -- 172.21.15.72:0/3395950434 shutdown_connections 2023-07-27T20:32:06.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.957+0000 7f370f12fb80 1 -- 172.21.15.72:0/3395950434 wait complete. 2023-07-27T20:32:06.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.957+0000 7f370f12fb80 20 client.4857 trim_cache size 0 max 16384 2023-07-27T20:32:06.954 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-07-27T20:32:06.954 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "173d349e-573f-4bc7-9f3a-2e1b4345c501", 2023-07-27T20:32:06.954 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 0, 2023-07-27T20:32:06.954 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4267, 2023-07-27T20:32:06.955 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2023-07-27T20:32:06.955 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2023-07-27T20:32:06.955 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2023-07-27T20:32:06.955 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 37.850783049999997, 2023-07-27T20:32:06.955 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 9, 2023-07-27T20:32:06.955 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 27, 2023-07-27T20:32:06.955 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 27, 2023-07-27T20:32:06.955 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 43.923953071 2023-07-27T20:32:06.956 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-07-27T20:32:06.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.958+0000 7f36fb7ff700 1 -- 172.21.15.72:0/536430570 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f36d806ace0 msgr2=0x7f36d806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:06.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.958+0000 7f36fb7ff700 1 --2- 172.21.15.72:0/536430570 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f36d806ace0 0x7f36d806d1a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f36f00090b0 tx=0x7f36f0008030 comp rx=0 tx=0).stop 2023-07-27T20:32:06.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.958+0000 7f36fb7ff700 1 -- 172.21.15.72:0/536430570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36f406ef00 msgr2=0x7f36f4149de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:06.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.958+0000 7f36fb7ff700 1 --2- 172.21.15.72:0/536430570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36f406ef00 0x7f36f4149de0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f36e400e9b0 tx=0x7f36e400ed70 comp rx=0 tx=0).stop 2023-07-27T20:32:06.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.958+0000 7f36fb7ff700 1 -- 172.21.15.72:0/536430570 shutdown_connections 2023-07-27T20:32:06.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.958+0000 7f36fb7ff700 1 --2- 172.21.15.72:0/536430570 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36f4158000 0x7f36f414a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.958+0000 7f36fb7ff700 1 --2- 172.21.15.72:0/536430570 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f36d806ace0 0x7f36d806d1a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.958+0000 7f36fb7ff700 1 --2- 172.21.15.72:0/536430570 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f36f406b520 0x7f36f40a7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.958+0000 7f36fb7ff700 1 --2- 172.21.15.72:0/536430570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36f406ef00 0x7f36f4149de0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:06.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.958+0000 7f36fb7ff700 1 -- 172.21.15.72:0/536430570 >> 172.21.15.72:0/536430570 conn(0x7f36f40c6800 msgr2=0x7f36f4071180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:06.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.958+0000 7f36fb7ff700 1 -- 172.21.15.72:0/536430570 shutdown_connections 2023-07-27T20:32:06.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:06.958+0000 7f36fb7ff700 1 -- 172.21.15.72:0/536430570 wait complete. 2023-07-27T20:32:06.964 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-07-27T20:32:06.973 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-07-27T20:32:06.974 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2023-07-27T20:32:06.974 INFO:tasks.ceph_fuse:client.0 config is {} 2023-07-27T20:32:06.974 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-27T20:32:06.975 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-27T20:32:06.975 INFO:tasks.ceph_fuse:client.1 config is {} 2023-07-27T20:32:06.975 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-27T20:32:06.975 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-27T20:32:06.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:32:06.976 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-07-27T20:32:07.022 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-07-27T20:32:07.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:32:07.024 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-07-27T20:32:07.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:32:07.136 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link delete ceph-brx 2023-07-27T20:32:07.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:32:07.240 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list 2023-07-27T20:32:07.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:32:07.293 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link delete ceph-brx 2023-07-27T20:32:07.369 INFO:teuthology.orchestra.run.smithi173.stderr:Cannot find device "ceph-brx" 2023-07-27T20:32:07.372 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-27T20:32:07.372 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-07-27T20:32:07.373 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-27T20:32:07.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.581+0000 7f8b697ff700 1 Processor -- start 2023-07-27T20:32:07.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.581+0000 7f8b697ff700 1 -- start start 2023-07-27T20:32:07.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.582+0000 7f8b697ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8b6406ef00 0x7f8b640a8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:07.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.582+0000 7f8b697ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b6406b900 0x7f8b64154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:07.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.582+0000 7f8b697ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b6406bd90 con 0x7f8b6406b520 2023-07-27T20:32:07.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.582+0000 7f8b697ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b640c1850 con 0x7f8b6406ef00 2023-07-27T20:32:07.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.582+0000 7f8b697ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6406e270 con 0x7f8b6406b900 2023-07-27T20:32:07.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.582+0000 7f8b62ffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8b6406b520 0x7f8b64158000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52132/0 (socket says 172.21.15.72:52132) 2023-07-27T20:32:07.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.582+0000 7f8b62ffd700 1 -- 172.21.15.72:0/1592355552 learned_addr learned my addr 172.21.15.72:0/1592355552 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:07.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.582+0000 7f8b627fc700 1 --2- 172.21.15.72:0/1592355552 >> v2:172.21.15.173:3300/0 conn(0x7f8b6406ef00 0x7f8b640a8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:07.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.582+0000 7f8b637fe700 1 --2- 172.21.15.72:0/1592355552 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b6406b900 0x7f8b64154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:07.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.583+0000 7f8b61ffb700 1 -- 172.21.15.72:0/1592355552 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2969776067 0 0) 0x7f8b54001110 con 0x7f8b6406b520 2023-07-27T20:32:07.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.583+0000 7f8b61ffb700 1 -- 172.21.15.72:0/1592355552 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b4c0035b0 con 0x7f8b6406b520 2023-07-27T20:32:07.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.583+0000 7f8b637fe700 1 -- 172.21.15.72:0/1592355552 >> v2:172.21.15.173:3300/0 conn(0x7f8b6406ef00 msgr2=0x7f8b640a8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:07.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.583+0000 7f8b637fe700 1 --2- 172.21.15.72:0/1592355552 >> v2:172.21.15.173:3300/0 conn(0x7f8b6406ef00 0x7f8b640a8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:07.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.583+0000 7f8b637fe700 1 -- 172.21.15.72:0/1592355552 >> v1:172.21.15.72:6789/0 conn(0x7f8b6406b520 legacy=0x7f8b64158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:07.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.583+0000 7f8b637fe700 1 -- 172.21.15.72:0/1592355552 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b6406e7a0 con 0x7f8b6406b900 2023-07-27T20:32:07.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.583+0000 7f8b627fc700 1 --2- 172.21.15.72:0/1592355552 >> v2:172.21.15.173:3300/0 conn(0x7f8b6406ef00 0x7f8b640a8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:32:07.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.583+0000 7f8b637fe700 1 --2- 172.21.15.72:0/1592355552 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b6406b900 0x7f8b64154000 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c009d90 tx=0x7f8b5c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a4d192f6e2eefa3 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:07.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.583+0000 7f8b61ffb700 1 -- 172.21.15.72:0/1592355552 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c00e070 con 0x7f8b6406b900 2023-07-27T20:32:07.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.583+0000 7f8b61ffb700 1 -- 172.21.15.72:0/1592355552 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5c00bb20 con 0x7f8b6406b900 2023-07-27T20:32:07.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.583+0000 7f8b61ffb700 1 -- 172.21.15.72:0/1592355552 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c012430 con 0x7f8b6406b900 2023-07-27T20:32:07.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.584+0000 7f8b697ff700 1 -- 172.21.15.72:0/1592355552 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b6406b900 msgr2=0x7f8b64154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:07.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.584+0000 7f8b697ff700 1 --2- 172.21.15.72:0/1592355552 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b6406b900 0x7f8b64154000 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c009d90 tx=0x7f8b5c00b330 comp rx=0 tx=0).stop 2023-07-27T20:32:07.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.584+0000 7f8b697ff700 1 -- 172.21.15.72:0/1592355552 shutdown_connections 2023-07-27T20:32:07.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.584+0000 7f8b697ff700 1 --2- 172.21.15.72:0/1592355552 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b6406b900 0x7f8b64154000 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:07.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.584+0000 7f8b697ff700 1 --2- 172.21.15.72:0/1592355552 >> v2:172.21.15.173:3300/0 conn(0x7f8b6406ef00 0x7f8b640a8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:07.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.584+0000 7f8b697ff700 1 -- 172.21.15.72:0/1592355552 >> 172.21.15.72:0/1592355552 conn(0x7f8b640c6800 msgr2=0x7f8b640c6c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:07.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.584+0000 7f8b697ff700 1 -- 172.21.15.72:0/1592355552 shutdown_connections 2023-07-27T20:32:07.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.584+0000 7f8b697ff700 1 -- 172.21.15.72:0/1592355552 wait complete. 2023-07-27T20:32:07.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.586+0000 7f8b697ff700 1 Processor -- start 2023-07-27T20:32:07.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.586+0000 7f8b697ff700 1 -- start start 2023-07-27T20:32:07.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.587+0000 7f8b697ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b6406b520 0x7f8b64151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:07.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.587+0000 7f8b697ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b6406b900 0x7f8b6414e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:07.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.587+0000 7f8b697ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b6406ef00 0x7f8b640abba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:07.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.587+0000 7f8b697ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6414d840 con 0x7f8b6406ef00 2023-07-27T20:32:07.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.587+0000 7f8b697ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6414db00 con 0x7f8b6406b900 2023-07-27T20:32:07.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.587+0000 7f8b697ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b640aac00 con 0x7f8b6406b520 2023-07-27T20:32:07.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.587+0000 7f8b627fc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b6406b900 0x7f8b6414e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:07.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.587+0000 7f8b637fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b6406ef00 0x7f8b640abba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:07.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.587+0000 7f8b62ffd700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b6406b520 0x7f8b64151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:07.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.587+0000 7f8b627fc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b6406b900 0x7f8b6414e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.72:60560/0 (socket says 172.21.15.72:60560) 2023-07-27T20:32:07.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.587+0000 7f8b627fc700 1 -- 172.21.15.72:0/3449613457 learned_addr learned my addr 172.21.15.72:0/3449613457 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:07.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.587+0000 7f8b637fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b6406ef00 0x7f8b640abba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46546/0 (socket says 172.21.15.72:46546) 2023-07-27T20:32:07.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.587+0000 7f8b627fc700 1 -- 172.21.15.72:0/3449613457 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b6406b520 msgr2=0x7f8b64151620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:07.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.587+0000 7f8b627fc700 1 --2- 172.21.15.72:0/3449613457 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b6406b520 0x7f8b64151620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:07.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.587+0000 7f8b627fc700 1 -- 172.21.15.72:0/3449613457 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b6406ef00 msgr2=0x7f8b640abba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:07.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.587+0000 7f8b627fc700 1 --2- 172.21.15.72:0/3449613457 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b6406ef00 0x7f8b640abba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:07.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.587+0000 7f8b627fc700 1 -- 172.21.15.72:0/3449613457 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b580094a0 con 0x7f8b6406b900 2023-07-27T20:32:07.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.587+0000 7f8b637fe700 1 --2- 172.21.15.72:0/3449613457 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b6406ef00 0x7f8b640abba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:32:07.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.588+0000 7f8b627fc700 1 --2- 172.21.15.72:0/3449613457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b6406b900 0x7f8b6414e930 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8b5800e9b0 tx=0x7f8b5800ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:07.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.588+0000 7f8b4b7fe700 1 -- 172.21.15.72:0/3449613457 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5800ee50 con 0x7f8b6406b900 2023-07-27T20:32:07.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.588+0000 7f8b4b7fe700 1 -- 172.21.15.72:0/3449613457 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5800c850 con 0x7f8b6406b900 2023-07-27T20:32:07.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.588+0000 7f8b4b7fe700 1 -- 172.21.15.72:0/3449613457 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5800cc00 con 0x7f8b6406b900 2023-07-27T20:32:07.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.588+0000 7f8b697ff700 1 -- 172.21.15.72:0/3449613457 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b5c009a70 con 0x7f8b6406b900 2023-07-27T20:32:07.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.588+0000 7f8b697ff700 1 -- 172.21.15.72:0/3449613457 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b640ab1c0 con 0x7f8b6406b900 2023-07-27T20:32:07.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.589+0000 7f8b697ff700 1 -- 172.21.15.72:0/3449613457 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b64074310 con 0x7f8b6406b900 2023-07-27T20:32:07.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.590+0000 7f8b4b7fe700 1 -- 172.21.15.72:0/3449613457 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8b58013470 con 0x7f8b6406b900 2023-07-27T20:32:07.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.591+0000 7f8b4b7fe700 1 --2- 172.21.15.72:0/3449613457 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8b5006ace0 0x7f8b5006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:07.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.591+0000 7f8b4b7fe700 1 -- 172.21.15.72:0/3449613457 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8b58089410 con 0x7f8b6406b900 2023-07-27T20:32:07.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.591+0000 7f8b62ffd700 1 --2- 172.21.15.72:0/3449613457 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8b5006ace0 0x7f8b5006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:07.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.592+0000 7f8b62ffd700 1 --2- 172.21.15.72:0/3449613457 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8b5006ace0 0x7f8b5006d1a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8b54007fd0 tx=0x7f8b54007c40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:07.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.596+0000 7f8b4b7fe700 1 -- 172.21.15.72:0/3449613457 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8b58057c50 con 0x7f8b6406b900 2023-07-27T20:32:07.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.833+0000 7f8b697ff700 1 -- 172.21.15.72:0/3449613457 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8b640c07f0 con 0x7f8b6406b900 2023-07-27T20:32:07.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.834+0000 7f8b4b7fe700 1 -- 172.21.15.72:0/3449613457 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f8b580577e0 con 0x7f8b6406b900 2023-07-27T20:32:07.822 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-27T20:32:07.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.836+0000 7f8b697ff700 1 -- 172.21.15.72:0/3449613457 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8b5006ace0 msgr2=0x7f8b5006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:07.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.836+0000 7f8b697ff700 1 --2- 172.21.15.72:0/3449613457 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8b5006ace0 0x7f8b5006d1a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8b54007fd0 tx=0x7f8b54007c40 comp rx=0 tx=0).stop 2023-07-27T20:32:07.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.836+0000 7f8b697ff700 1 -- 172.21.15.72:0/3449613457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b6406b900 msgr2=0x7f8b6414e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:07.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.836+0000 7f8b697ff700 1 --2- 172.21.15.72:0/3449613457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b6406b900 0x7f8b6414e930 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8b5800e9b0 tx=0x7f8b5800ecc0 comp rx=0 tx=0).stop 2023-07-27T20:32:07.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.836+0000 7f8b697ff700 1 -- 172.21.15.72:0/3449613457 shutdown_connections 2023-07-27T20:32:07.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.836+0000 7f8b697ff700 1 --2- 172.21.15.72:0/3449613457 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b6406ef00 0x7f8b640abba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:07.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.836+0000 7f8b697ff700 1 --2- 172.21.15.72:0/3449613457 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8b5006ace0 0x7f8b5006d1a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:07.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.836+0000 7f8b697ff700 1 --2- 172.21.15.72:0/3449613457 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b6406b520 0x7f8b64151620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:07.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.836+0000 7f8b697ff700 1 --2- 172.21.15.72:0/3449613457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b6406b900 0x7f8b6414e930 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:07.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.836+0000 7f8b697ff700 1 -- 172.21.15.72:0/3449613457 >> 172.21.15.72:0/3449613457 conn(0x7f8b640c6800 msgr2=0x7f8b64154ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:07.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.836+0000 7f8b697ff700 1 -- 172.21.15.72:0/3449613457 shutdown_connections 2023-07-27T20:32:07.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:07.836+0000 7f8b697ff700 1 -- 172.21.15.72:0/3449613457 wait complete. 2023-07-27T20:32:07.842 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-27T20:32:07.842 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T20:32:07.843 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2023-07-27T20:32:07.843 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-27T20:32:07.843 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-27T20:32:07.843 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-27T20:32:07.843 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-27T20:32:07.843 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-27T20:32:07.844 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-27T20:32:07.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:32:07.844 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2023-07-27T20:32:07.891 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T20:32:07.891 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T20:32:07.892 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T20:32:07.892 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:32:07.892 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-07-27T20:32:07.892 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:32:07.892 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T20:32:07.892 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2023-07-27T20:32:07.893 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f0 2023-07-27T20:32:07.893 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T20:32:07.893 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2023-07-27T20:32:07.893 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f1 2023-07-27T20:32:07.893 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T20:32:07.893 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2023-07-27T20:32:07.893 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T20:32:07.894 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2023-07-27T20:32:07.894 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T20:32:07.894 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 39956sec preferred_lft 39956sec 2023-07-27T20:32:07.894 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2023-07-27T20:32:07.894 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:32:07.895 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-27T20:32:07.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:32:07.897 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-07-27T20:32:07.897 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-07-27T20:32:07.898 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add name ceph-brx type bridge 2023-07-27T20:32:07.898 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr flush dev ceph-brx 2023-07-27T20:32:07.899 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set ceph-brx up 2023-07-27T20:32:07.899 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-27T20:32:07.900 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-07-27T20:32:08.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:32:08.100 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T20:32:08.170 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-07-27T20:32:08.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:32:08.173 DEBUG:teuthology.orchestra.run.smithi072:> route 2023-07-27T20:32:08.222 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2023-07-27T20:32:08.223 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T20:32:08.223 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T20:32:08.223 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T20:32:08.223 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T20:32:08.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:32:08.224 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-07-27T20:32:08.225 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-07-27T20:32:08.225 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T20:32:08.225 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T20:32:08.225 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T20:32:08.226 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-07-27T20:32:08.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:32:08.395 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-07-27T20:32:08.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:32:08.443 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list-id 2023-07-27T20:32:08.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:32:08.531 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-07-27T20:32:08.532 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-07-27T20:32:08.532 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-27T20:32:08.533 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-07-27T20:32:08.533 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-07-27T20:32:08.676 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-07-27T20:32:08.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:32:08.677 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-07-27T20:32:08.677 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-07-27T20:32:08.678 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-07-27T20:32:08.678 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-27T20:32:08.679 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-07-27T20:32:08.679 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-07-27T20:32:08.679 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-07-27T20:32:08.680 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-07-27T20:32:08.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:32:08.917 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-07-27T20:32:08.918 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-07-27T20:32:08.918 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2023-07-27T20:32:08.918 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set dev brx.0 master ceph-brx 2023-07-27T20:32:08.919 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-07-27T20:32:09.089 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-07-27T20:32:09.089 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-27T20:32:09.089 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-27T20:32:09.137 INFO:teuthology.orchestra.run.smithi072.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-27T20:32:09.137 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-27T20:32:09.138 DEBUG:teuthology.orchestra.run.smithi072:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-27T20:32:09.182 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-07-27T20:32:09.294 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-27T20:32:09.295 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-27T20:32:09.363 INFO:teuthology.orchestra.run.smithi072.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-27T20:32:09.365 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-27T20:32:09.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:32:09.366 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-07-27T20:32:09.416 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-27T20:32:09.417 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-07-27T20:32:09.421 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-07-27T20:32:09.492 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-27T20:32:09.492 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-27T20:32:09.564 INFO:teuthology.orchestra.run.smithi072.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-27T20:32:09.567 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-27T20:32:09.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:32:09.568 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-07-27T20:32:09.593 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:2023-07-27T20:32:09.604+0000 7fd878f2e5c0 -1 init, newargv = 0x55ba603296e0 newargc=15 2023-07-27T20:32:09.593 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:ceph-fuse[153270]: starting ceph client 2023-07-27T20:32:09.601 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:ceph-fuse[153270]: starting fuse 2023-07-27T20:32:09.617 INFO:teuthology.orchestra.run.smithi072.stdout:44 2023-07-27T20:32:09.617 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2023-07-27T20:32:09.617 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-27T20:32:09.618 DEBUG:teuthology.orchestra.run.smithi072:> import glob 2023-07-27T20:32:09.618 DEBUG:teuthology.orchestra.run.smithi072:> import re 2023-07-27T20:32:09.618 DEBUG:teuthology.orchestra.run.smithi072:> import os 2023-07-27T20:32:09.618 DEBUG:teuthology.orchestra.run.smithi072:> import subprocess 2023-07-27T20:32:09.619 DEBUG:teuthology.orchestra.run.smithi072:> 2023-07-27T20:32:09.619 DEBUG:teuthology.orchestra.run.smithi072:> def _find_admin_socket(client_name): 2023-07-27T20:32:09.619 DEBUG:teuthology.orchestra.run.smithi072:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-07-27T20:32:09.619 DEBUG:teuthology.orchestra.run.smithi072:> files = glob.glob(asok_path) 2023-07-27T20:32:09.619 DEBUG:teuthology.orchestra.run.smithi072:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-07-27T20:32:09.620 DEBUG:teuthology.orchestra.run.smithi072:> 2023-07-27T20:32:09.620 DEBUG:teuthology.orchestra.run.smithi072:> # Given a non-glob path, it better be there 2023-07-27T20:32:09.620 DEBUG:teuthology.orchestra.run.smithi072:> if "*" not in asok_path: 2023-07-27T20:32:09.621 DEBUG:teuthology.orchestra.run.smithi072:> assert(len(files) == 1) 2023-07-27T20:32:09.621 DEBUG:teuthology.orchestra.run.smithi072:> return files[0] 2023-07-27T20:32:09.621 DEBUG:teuthology.orchestra.run.smithi072:> 2023-07-27T20:32:09.621 DEBUG:teuthology.orchestra.run.smithi072:> for f in files: 2023-07-27T20:32:09.622 DEBUG:teuthology.orchestra.run.smithi072:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-27T20:32:09.622 DEBUG:teuthology.orchestra.run.smithi072:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-27T20:32:09.622 DEBUG:teuthology.orchestra.run.smithi072:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-27T20:32:09.622 DEBUG:teuthology.orchestra.run.smithi072:> contents = proc_f.read() 2023-07-27T20:32:09.623 DEBUG:teuthology.orchestra.run.smithi072:> if mountpoint in contents: 2023-07-27T20:32:09.623 DEBUG:teuthology.orchestra.run.smithi072:> return f 2023-07-27T20:32:09.623 DEBUG:teuthology.orchestra.run.smithi072:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-27T20:32:09.623 DEBUG:teuthology.orchestra.run.smithi072:> 2023-07-27T20:32:09.624 DEBUG:teuthology.orchestra.run.smithi072:> print(_find_admin_socket("client.0")) 2023-07-27T20:32:09.624 DEBUG:teuthology.orchestra.run.smithi072:> ' 2023-07-27T20:32:09.800 INFO:teuthology.orchestra.run.smithi072.stdout:/var/run/ceph/ceph-client.0.153270.asok 2023-07-27T20:32:09.977 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.153270.asok 2023-07-27T20:32:09.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:32:09.978 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.153270.asok status 2023-07-27T20:32:10.202 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-07-27T20:32:10.203 INFO:teuthology.orchestra.run.smithi072.stdout: "metadata": { 2023-07-27T20:32:10.203 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_sha1": "a5d48e8c688c2543997a98b8acbae2ce9635578c", 2023-07-27T20:32:10.203 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_version": "ceph version 18.0.0-5128-ga5d48e8c (a5d48e8c688c2543997a98b8acbae2ce9635578c) reef (dev)", 2023-07-27T20:32:10.203 INFO:teuthology.orchestra.run.smithi072.stdout: "entity_id": "0", 2023-07-27T20:32:10.203 INFO:teuthology.orchestra.run.smithi072.stdout: "hostname": "smithi072", 2023-07-27T20:32:10.204 INFO:teuthology.orchestra.run.smithi072.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-07-27T20:32:10.204 INFO:teuthology.orchestra.run.smithi072.stdout: "pid": "153270", 2023-07-27T20:32:10.204 INFO:teuthology.orchestra.run.smithi072.stdout: "root": "/" 2023-07-27T20:32:10.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:32:10.204 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_count": 0, 2023-07-27T20:32:10.205 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_pinned_count": 0, 2023-07-27T20:32:10.205 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4869, 2023-07-27T20:32:10.205 INFO:teuthology.orchestra.run.smithi072.stdout: "inst": { 2023-07-27T20:32:10.205 INFO:teuthology.orchestra.run.smithi072.stdout: "name": { 2023-07-27T20:32:10.205 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "client", 2023-07-27T20:32:10.206 INFO:teuthology.orchestra.run.smithi072.stdout: "num": 4869 2023-07-27T20:32:10.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:32:10.206 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2023-07-27T20:32:10.206 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-07-27T20:32:10.206 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "192.168.0.1:0", 2023-07-27T20:32:10.206 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 1403040964 2023-07-27T20:32:10.206 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:32:10.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:32:10.207 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2023-07-27T20:32:10.207 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-07-27T20:32:10.207 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "192.168.0.1:0", 2023-07-27T20:32:10.207 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 1403040964 2023-07-27T20:32:10.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:32:10.207 INFO:teuthology.orchestra.run.smithi072.stdout: "inst_str": "client.4869 192.168.0.1:0/1403040964", 2023-07-27T20:32:10.208 INFO:teuthology.orchestra.run.smithi072.stdout: "addr_str": "192.168.0.1:0/1403040964", 2023-07-27T20:32:10.208 INFO:teuthology.orchestra.run.smithi072.stdout: "inode_count": 1, 2023-07-27T20:32:10.208 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_epoch": 9, 2023-07-27T20:32:10.208 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch": 28, 2023-07-27T20:32:10.208 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch_barrier": 0, 2023-07-27T20:32:10.208 INFO:teuthology.orchestra.run.smithi072.stdout: "blocklisted": false, 2023-07-27T20:32:10.208 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs" 2023-07-27T20:32:10.208 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-07-27T20:32:10.217 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-27T20:32:10.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.426+0000 7fddddfff700 1 Processor -- start 2023-07-27T20:32:10.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.426+0000 7fddddfff700 1 -- start start 2023-07-27T20:32:10.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.427+0000 7fddddfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fddd80c1930 0x7fddd80aad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:10.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.427+0000 7fddddfff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd8070080 con 0x7fddd81504b0 2023-07-27T20:32:10.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.427+0000 7fddddfff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd80ab330 con 0x7fddd814da10 2023-07-27T20:32:10.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.427+0000 7fddddfff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd80702d0 con 0x7fddd80c1930 2023-07-27T20:32:10.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.427+0000 7fddd6ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fddd80c1930 0x7fddd80aad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:10.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.427+0000 7fddd7fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fddd81504b0 0x7fddd8150960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39662/0 (socket says 172.21.15.72:39662) 2023-07-27T20:32:10.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.427+0000 7fddd7fff700 1 -- 172.21.15.72:0/3044179247 learned_addr learned my addr 172.21.15.72:0/3044179247 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:10.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.428+0000 7fddd6ffd700 1 -- 172.21.15.72:0/3044179247 >> v1:172.21.15.173:6789/0 conn(0x7fddd814da10 legacy=0x7fddd806d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:10.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.428+0000 7fddd6ffd700 1 -- 172.21.15.72:0/3044179247 >> v1:172.21.15.72:6789/0 conn(0x7fddd81504b0 legacy=0x7fddd8150960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:10.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.428+0000 7fddd6ffd700 1 -- 172.21.15.72:0/3044179247 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd80705b0 con 0x7fddd80c1930 2023-07-27T20:32:10.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.428+0000 7fddd67fc700 1 -- 172.21.15.72:0/3044179247 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3977575179 0 0) 0x7fddd8070080 con 0x7fddd81504b0 2023-07-27T20:32:10.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.428+0000 7fddd6ffd700 1 --2- 172.21.15.72:0/3044179247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddd80c1930 0x7fddd80aad50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fddcc009840 tx=0x7fddcc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d938ff68f536264 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:10.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.428+0000 7fddd67fc700 1 -- 172.21.15.72:0/3044179247 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc004230 con 0x7fddd80c1930 2023-07-27T20:32:10.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.428+0000 7fddd67fc700 1 -- 172.21.15.72:0/3044179247 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddcc004390 con 0x7fddd80c1930 2023-07-27T20:32:10.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.428+0000 7fddd67fc700 1 -- 172.21.15.72:0/3044179247 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc0036a0 con 0x7fddd80c1930 2023-07-27T20:32:10.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.429+0000 7fddddfff700 1 -- 172.21.15.72:0/3044179247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddd80c1930 msgr2=0x7fddd80aad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:10.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.429+0000 7fddddfff700 1 --2- 172.21.15.72:0/3044179247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddd80c1930 0x7fddd80aad50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fddcc009840 tx=0x7fddcc009b50 comp rx=0 tx=0).stop 2023-07-27T20:32:10.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.429+0000 7fddddfff700 1 -- 172.21.15.72:0/3044179247 shutdown_connections 2023-07-27T20:32:10.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.429+0000 7fddddfff700 1 --2- 172.21.15.72:0/3044179247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddd80c1930 0x7fddd80aad50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:10.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.429+0000 7fddddfff700 1 -- 172.21.15.72:0/3044179247 >> 172.21.15.72:0/3044179247 conn(0x7fddd806a190 msgr2=0x7fddd806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:10.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.429+0000 7fddddfff700 1 -- 172.21.15.72:0/3044179247 shutdown_connections 2023-07-27T20:32:10.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.429+0000 7fddddfff700 1 -- 172.21.15.72:0/3044179247 wait complete. 2023-07-27T20:32:10.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.431+0000 7fddddfff700 1 Processor -- start 2023-07-27T20:32:10.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.431+0000 7fddddfff700 1 -- start start 2023-07-27T20:32:10.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.432+0000 7fddddfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fddd80c1930 0x7fddd81dc400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:10.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.432+0000 7fddddfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddd814da10 0x7fddd8144c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:10.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.432+0000 7fddddfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddd81504b0 0x7fddd8148cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:10.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.432+0000 7fddddfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd81e7d00 con 0x7fddd814da10 2023-07-27T20:32:10.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.432+0000 7fddddfff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd81db5f0 con 0x7fddd81504b0 2023-07-27T20:32:10.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.432+0000 7fddddfff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd81e7ee0 con 0x7fddd80c1930 2023-07-27T20:32:10.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.432+0000 7fddd6ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddd814da10 0x7fddd8144c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:10.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.432+0000 7fddd6ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddd814da10 0x7fddd8144c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44070/0 (socket says 172.21.15.72:44070) 2023-07-27T20:32:10.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.432+0000 7fddd6ffd700 1 -- 172.21.15.72:0/2609700955 learned_addr learned my addr 172.21.15.72:0/2609700955 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:10.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.432+0000 7fddd77fe700 1 --2- 172.21.15.72:0/2609700955 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fddd80c1930 0x7fddd81dc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:10.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.432+0000 7fddd7fff700 1 --2- 172.21.15.72:0/2609700955 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddd81504b0 0x7fddd8148cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:10.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.432+0000 7fddd6ffd700 1 -- 172.21.15.72:0/2609700955 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fddd80c1930 msgr2=0x7fddd81dc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:10.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.432+0000 7fddd6ffd700 1 --2- 172.21.15.72:0/2609700955 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fddd80c1930 0x7fddd81dc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:10.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.432+0000 7fddd6ffd700 1 -- 172.21.15.72:0/2609700955 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddd81504b0 msgr2=0x7fddd8148cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:10.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.432+0000 7fddd6ffd700 1 --2- 172.21.15.72:0/2609700955 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddd81504b0 0x7fddd8148cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:10.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.432+0000 7fddd6ffd700 1 -- 172.21.15.72:0/2609700955 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddcc0094a0 con 0x7fddd814da10 2023-07-27T20:32:10.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.432+0000 7fddd77fe700 1 --2- 172.21.15.72:0/2609700955 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fddd80c1930 0x7fddd81dc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:10.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.432+0000 7fddd6ffd700 1 --2- 172.21.15.72:0/2609700955 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddd814da10 0x7fddd8144c10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fddcc0090b0 tx=0x7fddcc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:10.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.433+0000 7fddbffff700 1 -- 172.21.15.72:0/2609700955 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc011630 con 0x7fddd814da10 2023-07-27T20:32:10.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.433+0000 7fddbffff700 1 -- 172.21.15.72:0/2609700955 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddcc011790 con 0x7fddd814da10 2023-07-27T20:32:10.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.433+0000 7fddddfff700 1 -- 172.21.15.72:0/2609700955 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd8154460 con 0x7fddd814da10 2023-07-27T20:32:10.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.433+0000 7fddbffff700 1 -- 172.21.15.72:0/2609700955 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc011b40 con 0x7fddd814da10 2023-07-27T20:32:10.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.433+0000 7fddddfff700 1 -- 172.21.15.72:0/2609700955 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd81e81c0 con 0x7fddd814da10 2023-07-27T20:32:10.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.434+0000 7fddddfff700 1 -- 172.21.15.72:0/2609700955 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd80c1300 con 0x7fddd814da10 2023-07-27T20:32:10.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.435+0000 7fddbffff700 1 -- 172.21.15.72:0/2609700955 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fddcc011ca0 con 0x7fddd814da10 2023-07-27T20:32:10.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.436+0000 7fddbffff700 1 --2- 172.21.15.72:0/2609700955 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fddc406ace0 0x7fddc406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:10.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.436+0000 7fddbffff700 1 -- 172.21.15.72:0/2609700955 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fddcc08b0d0 con 0x7fddd814da10 2023-07-27T20:32:10.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.436+0000 7fddd77fe700 1 --2- 172.21.15.72:0/2609700955 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fddc406ace0 0x7fddc406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:10.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.437+0000 7fddd77fe700 1 --2- 172.21.15.72:0/2609700955 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fddc406ace0 0x7fddc406d1a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fddc8009930 tx=0x7fddc8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:10.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.440+0000 7fddbffff700 1 -- 172.21.15.72:0/2609700955 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fddcc0bd310 con 0x7fddd814da10 2023-07-27T20:32:10.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.680+0000 7fddddfff700 1 -- 172.21.15.72:0/2609700955 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fddd81d9ae0 con 0x7fddd814da10 2023-07-27T20:32:10.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.681+0000 7fddbffff700 1 -- 172.21.15.72:0/2609700955 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fddcc055e40 con 0x7fddd814da10 2023-07-27T20:32:10.669 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-27T20:32:10.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.683+0000 7fddddfff700 1 -- 172.21.15.72:0/2609700955 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fddc406ace0 msgr2=0x7fddc406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:10.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.683+0000 7fddddfff700 1 --2- 172.21.15.72:0/2609700955 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fddc406ace0 0x7fddc406d1a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fddc8009930 tx=0x7fddc8008040 comp rx=0 tx=0).stop 2023-07-27T20:32:10.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.683+0000 7fddddfff700 1 -- 172.21.15.72:0/2609700955 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddd814da10 msgr2=0x7fddd8144c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:10.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.683+0000 7fddddfff700 1 --2- 172.21.15.72:0/2609700955 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddd814da10 0x7fddd8144c10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fddcc0090b0 tx=0x7fddcc0047c0 comp rx=0 tx=0).stop 2023-07-27T20:32:10.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.683+0000 7fddddfff700 1 -- 172.21.15.72:0/2609700955 shutdown_connections 2023-07-27T20:32:10.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.683+0000 7fddddfff700 1 --2- 172.21.15.72:0/2609700955 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddd81504b0 0x7fddd8148cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:10.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.683+0000 7fddddfff700 1 --2- 172.21.15.72:0/2609700955 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fddc406ace0 0x7fddc406d1a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:10.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.683+0000 7fddddfff700 1 --2- 172.21.15.72:0/2609700955 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fddd80c1930 0x7fddd81dc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:10.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.683+0000 7fddddfff700 1 --2- 172.21.15.72:0/2609700955 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddd814da10 0x7fddd8144c10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:10.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.683+0000 7fddddfff700 1 -- 172.21.15.72:0/2609700955 >> 172.21.15.72:0/2609700955 conn(0x7fddd806a190 msgr2=0x7fddd80c06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:10.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.683+0000 7fddddfff700 1 -- 172.21.15.72:0/2609700955 shutdown_connections 2023-07-27T20:32:10.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:10.683+0000 7fddddfff700 1 -- 172.21.15.72:0/2609700955 wait complete. 2023-07-27T20:32:10.689 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-27T20:32:10.690 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T20:32:10.690 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi173.front.sepia.ceph.com 2023-07-27T20:32:10.690 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-27T20:32:10.690 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-27T20:32:10.691 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-27T20:32:10.691 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-27T20:32:10.691 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-27T20:32:10.691 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-27T20:32:10.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:32:10.692 DEBUG:teuthology.orchestra.run.smithi173:> ip addr 2023-07-27T20:32:10.743 INFO:teuthology.orchestra.run.smithi173.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T20:32:10.743 INFO:teuthology.orchestra.run.smithi173.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T20:32:10.743 INFO:teuthology.orchestra.run.smithi173.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T20:32:10.744 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:32:10.744 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 ::1/128 scope host 2023-07-27T20:32:10.744 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:32:10.744 INFO:teuthology.orchestra.run.smithi173.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T20:32:10.744 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6a brd ff:ff:ff:ff:ff:ff 2023-07-27T20:32:10.744 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f0 2023-07-27T20:32:10.745 INFO:teuthology.orchestra.run.smithi173.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T20:32:10.745 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6b brd ff:ff:ff:ff:ff:ff 2023-07-27T20:32:10.745 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f1 2023-07-27T20:32:10.745 INFO:teuthology.orchestra.run.smithi173.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T20:32:10.745 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:58 brd ff:ff:ff:ff:ff:ff 2023-07-27T20:32:10.745 INFO:teuthology.orchestra.run.smithi173.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T20:32:10.745 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:59 brd ff:ff:ff:ff:ff:ff 2023-07-27T20:32:10.745 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.21.15.173/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T20:32:10.746 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft 39985sec preferred_lft 39985sec 2023-07-27T20:32:10.746 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::ec4:7aff:fe88:7259/64 scope link 2023-07-27T20:32:10.746 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:32:10.747 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-27T20:32:10.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:32:10.747 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2023-07-27T20:32:10.748 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2023-07-27T20:32:10.748 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link add name ceph-brx type bridge 2023-07-27T20:32:10.748 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip addr flush dev ceph-brx 2023-07-27T20:32:10.749 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set ceph-brx up 2023-07-27T20:32:10.749 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-27T20:32:10.749 DEBUG:teuthology.orchestra.run.smithi173:> ') 2023-07-27T20:32:11.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:32:11.191 DEBUG:teuthology.orchestra.run.smithi173:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T20:32:11.297 INFO:teuthology.orchestra.run.smithi173.stdout:1 2023-07-27T20:32:11.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:32:11.301 DEBUG:teuthology.orchestra.run.smithi173:> route 2023-07-27T20:32:11.381 INFO:teuthology.orchestra.run.smithi173.stdout:Kernel IP routing table 2023-07-27T20:32:11.382 INFO:teuthology.orchestra.run.smithi173.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T20:32:11.382 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T20:32:11.382 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T20:32:11.382 INFO:teuthology.orchestra.run.smithi173.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T20:32:11.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:32:11.383 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2023-07-27T20:32:11.384 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2023-07-27T20:32:11.384 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T20:32:11.385 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T20:32:11.385 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T20:32:11.385 DEBUG:teuthology.orchestra.run.smithi173:> ') 2023-07-27T20:32:12.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:32:12.132 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list 2023-07-27T20:32:12.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:32:12.179 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list-id 2023-07-27T20:32:12.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:32:12.226 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2023-07-27T20:32:12.226 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2023-07-27T20:32:12.226 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-27T20:32:12.227 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-07-27T20:32:12.227 DEBUG:teuthology.orchestra.run.smithi173:> ') 2023-07-27T20:32:12.407 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-07-27T20:32:12.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:32:12.408 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2023-07-27T20:32:12.409 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2023-07-27T20:32:12.410 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-07-27T20:32:12.410 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-27T20:32:12.411 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-07-27T20:32:12.411 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-07-27T20:32:12.412 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-07-27T20:32:12.412 DEBUG:teuthology.orchestra.run.smithi173:> ') 2023-07-27T20:32:12.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:32:12.691 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2023-07-27T20:32:12.691 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2023-07-27T20:32:12.691 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set brx.0 up 2023-07-27T20:32:12.691 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set dev brx.0 master ceph-brx 2023-07-27T20:32:12.692 DEBUG:teuthology.orchestra.run.smithi173:> ') 2023-07-27T20:32:12.863 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-07-27T20:32:12.863 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-27T20:32:12.864 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-27T20:32:12.909 INFO:teuthology.orchestra.run.smithi173.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-27T20:32:12.910 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-27T20:32:12.910 DEBUG:teuthology.orchestra.run.smithi173:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-27T20:32:12.994 DEBUG:teuthology.orchestra.run.smithi173:> sudo modprobe fuse 2023-07-27T20:32:13.113 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-27T20:32:13.113 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-27T20:32:13.184 INFO:teuthology.orchestra.run.smithi173.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-27T20:32:13.186 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-27T20:32:13.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:32:13.187 DEBUG:teuthology.orchestra.run.smithi173:> ls /sys/fs/fuse/connections 2023-07-27T20:32:13.233 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-27T20:32:13.233 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-07-27T20:32:13.277 DEBUG:teuthology.orchestra.run.smithi173:> sudo modprobe fuse 2023-07-27T20:32:13.350 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-27T20:32:13.350 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-27T20:32:13.418 INFO:teuthology.orchestra.run.smithi173.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-27T20:32:13.421 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-27T20:32:13.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:32:13.422 DEBUG:teuthology.orchestra.run.smithi173:> ls /sys/fs/fuse/connections 2023-07-27T20:32:13.447 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi173.stderr:2023-07-27T20:32:13.460+0000 7f76762245c0 -1 init, newargv = 0x555d6f598af0 newargc=15 2023-07-27T20:32:13.447 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi173.stderr:ceph-fuse[148077]: starting ceph client 2023-07-27T20:32:13.456 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi173.stderr:ceph-fuse[148077]: starting fuse 2023-07-27T20:32:13.471 INFO:teuthology.orchestra.run.smithi173.stdout:43 2023-07-27T20:32:13.472 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-07-27T20:32:13.472 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-27T20:32:13.472 DEBUG:teuthology.orchestra.run.smithi173:> import glob 2023-07-27T20:32:13.473 DEBUG:teuthology.orchestra.run.smithi173:> import re 2023-07-27T20:32:13.473 DEBUG:teuthology.orchestra.run.smithi173:> import os 2023-07-27T20:32:13.474 DEBUG:teuthology.orchestra.run.smithi173:> import subprocess 2023-07-27T20:32:13.474 DEBUG:teuthology.orchestra.run.smithi173:> 2023-07-27T20:32:13.474 DEBUG:teuthology.orchestra.run.smithi173:> def _find_admin_socket(client_name): 2023-07-27T20:32:13.474 DEBUG:teuthology.orchestra.run.smithi173:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-07-27T20:32:13.474 DEBUG:teuthology.orchestra.run.smithi173:> files = glob.glob(asok_path) 2023-07-27T20:32:13.475 DEBUG:teuthology.orchestra.run.smithi173:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-07-27T20:32:13.475 DEBUG:teuthology.orchestra.run.smithi173:> 2023-07-27T20:32:13.475 DEBUG:teuthology.orchestra.run.smithi173:> # Given a non-glob path, it better be there 2023-07-27T20:32:13.476 DEBUG:teuthology.orchestra.run.smithi173:> if "*" not in asok_path: 2023-07-27T20:32:13.476 DEBUG:teuthology.orchestra.run.smithi173:> assert(len(files) == 1) 2023-07-27T20:32:13.476 DEBUG:teuthology.orchestra.run.smithi173:> return files[0] 2023-07-27T20:32:13.477 DEBUG:teuthology.orchestra.run.smithi173:> 2023-07-27T20:32:13.477 DEBUG:teuthology.orchestra.run.smithi173:> for f in files: 2023-07-27T20:32:13.477 DEBUG:teuthology.orchestra.run.smithi173:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-27T20:32:13.477 DEBUG:teuthology.orchestra.run.smithi173:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-27T20:32:13.477 DEBUG:teuthology.orchestra.run.smithi173:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-27T20:32:13.478 DEBUG:teuthology.orchestra.run.smithi173:> contents = proc_f.read() 2023-07-27T20:32:13.478 DEBUG:teuthology.orchestra.run.smithi173:> if mountpoint in contents: 2023-07-27T20:32:13.478 DEBUG:teuthology.orchestra.run.smithi173:> return f 2023-07-27T20:32:13.478 DEBUG:teuthology.orchestra.run.smithi173:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-27T20:32:13.479 DEBUG:teuthology.orchestra.run.smithi173:> 2023-07-27T20:32:13.479 DEBUG:teuthology.orchestra.run.smithi173:> print(_find_admin_socket("client.1")) 2023-07-27T20:32:13.479 DEBUG:teuthology.orchestra.run.smithi173:> ' 2023-07-27T20:32:13.655 INFO:teuthology.orchestra.run.smithi173.stdout:/var/run/ceph/ceph-client.1.148077.asok 2023-07-27T20:32:13.833 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.148077.asok 2023-07-27T20:32:13.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:32:13.833 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.148077.asok status 2023-07-27T20:32:14.058 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2023-07-27T20:32:14.058 INFO:teuthology.orchestra.run.smithi173.stdout: "metadata": { 2023-07-27T20:32:14.059 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_sha1": "a5d48e8c688c2543997a98b8acbae2ce9635578c", 2023-07-27T20:32:14.059 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_version": "ceph version 18.0.0-5128-ga5d48e8c (a5d48e8c688c2543997a98b8acbae2ce9635578c) reef (dev)", 2023-07-27T20:32:14.059 INFO:teuthology.orchestra.run.smithi173.stdout: "entity_id": "1", 2023-07-27T20:32:14.059 INFO:teuthology.orchestra.run.smithi173.stdout: "hostname": "smithi173", 2023-07-27T20:32:14.059 INFO:teuthology.orchestra.run.smithi173.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-07-27T20:32:14.059 INFO:teuthology.orchestra.run.smithi173.stdout: "pid": "148077", 2023-07-27T20:32:14.059 INFO:teuthology.orchestra.run.smithi173.stdout: "root": "/" 2023-07-27T20:32:14.060 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-07-27T20:32:14.060 INFO:teuthology.orchestra.run.smithi173.stdout: "dentry_count": 0, 2023-07-27T20:32:14.060 INFO:teuthology.orchestra.run.smithi173.stdout: "dentry_pinned_count": 0, 2023-07-27T20:32:14.060 INFO:teuthology.orchestra.run.smithi173.stdout: "id": 4825, 2023-07-27T20:32:14.060 INFO:teuthology.orchestra.run.smithi173.stdout: "inst": { 2023-07-27T20:32:14.060 INFO:teuthology.orchestra.run.smithi173.stdout: "name": { 2023-07-27T20:32:14.060 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "client", 2023-07-27T20:32:14.061 INFO:teuthology.orchestra.run.smithi173.stdout: "num": 4825 2023-07-27T20:32:14.061 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-07-27T20:32:14.061 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": { 2023-07-27T20:32:14.061 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "v1", 2023-07-27T20:32:14.061 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": "192.168.0.1:0", 2023-07-27T20:32:14.061 INFO:teuthology.orchestra.run.smithi173.stdout: "nonce": 738844141 2023-07-27T20:32:14.061 INFO:teuthology.orchestra.run.smithi173.stdout: } 2023-07-27T20:32:14.061 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-07-27T20:32:14.062 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": { 2023-07-27T20:32:14.062 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "v1", 2023-07-27T20:32:14.062 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": "192.168.0.1:0", 2023-07-27T20:32:14.063 INFO:teuthology.orchestra.run.smithi173.stdout: "nonce": 738844141 2023-07-27T20:32:14.063 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-07-27T20:32:14.063 INFO:teuthology.orchestra.run.smithi173.stdout: "inst_str": "client.4825 192.168.0.1:0/738844141", 2023-07-27T20:32:14.063 INFO:teuthology.orchestra.run.smithi173.stdout: "addr_str": "192.168.0.1:0/738844141", 2023-07-27T20:32:14.063 INFO:teuthology.orchestra.run.smithi173.stdout: "inode_count": 1, 2023-07-27T20:32:14.063 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_epoch": 9, 2023-07-27T20:32:14.063 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_epoch": 29, 2023-07-27T20:32:14.063 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_epoch_barrier": 0, 2023-07-27T20:32:14.064 INFO:teuthology.orchestra.run.smithi173.stdout: "blocklisted": false, 2023-07-27T20:32:14.064 INFO:teuthology.orchestra.run.smithi173.stdout: "fs_name": "cephfs" 2023-07-27T20:32:14.064 INFO:teuthology.orchestra.run.smithi173.stdout:} 2023-07-27T20:32:14.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:32:14.072 DEBUG:teuthology.orchestra.run.smithi072:> stat --file-system '--printf=%T 2023-07-27T20:32:14.073 DEBUG:teuthology.orchestra.run.smithi072:> ' -- /home/ubuntu/cephtest/mnt.0 2023-07-27T20:32:14.125 INFO:teuthology.orchestra.run.smithi072.stdout:fuseblk 2023-07-27T20:32:14.125 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-07-27T20:32:14.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:32:14.126 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-27T20:32:14.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:32:14.199 DEBUG:teuthology.orchestra.run.smithi173:> stat --file-system '--printf=%T 2023-07-27T20:32:14.199 DEBUG:teuthology.orchestra.run.smithi173:> ' -- /home/ubuntu/cephtest/mnt.1 2023-07-27T20:32:14.246 INFO:teuthology.orchestra.run.smithi173.stdout:fuseblk 2023-07-27T20:32:14.246 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-07-27T20:32:14.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:32:14.247 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-27T20:32:14.317 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-07-27T20:32:14.356 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:32:14.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.567+0000 7ff9d55ff700 1 Processor -- start 2023-07-27T20:32:14.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.567+0000 7ff9d55ff700 1 -- start start 2023-07-27T20:32:14.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.568+0000 7ff9d55ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff9d006b150 0x7ff9d00c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:14.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.568+0000 7ff9d55ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff9d01549f0 0x7ff9d01514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:14.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.568+0000 7ff9d55ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d006b710 con 0x7ff9d00c4400 2023-07-27T20:32:14.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.568+0000 7ff9d55ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9d01545d0 con 0x7ff9d01549f0 2023-07-27T20:32:14.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.568+0000 7ff9d55ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d006c860 con 0x7ff9d006b150 2023-07-27T20:32:14.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.569+0000 7ff9ce7fc700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff9d006b150 0x7ff9d00c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:14.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.569+0000 7ff9ceffd700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7ff9d00c4400 0x7ff9d00c4cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.72:46432/0 (socket says 172.21.15.72:46432) 2023-07-27T20:32:14.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.569+0000 7ff9ceffd700 1 -- 172.21.15.72:0/3471335857 learned_addr learned my addr 172.21.15.72:0/3471335857 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:14.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.569+0000 7ff9cf7fe700 1 --2- 172.21.15.72:0/3471335857 >> v2:172.21.15.173:3300/0 conn(0x7ff9d01549f0 0x7ff9d01514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:14.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.569+0000 7ff9cdffb700 1 -- 172.21.15.72:0/3471335857 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1615437448 0 0) 0x7ff9d006b710 con 0x7ff9d00c4400 2023-07-27T20:32:14.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.569+0000 7ff9cdffb700 1 -- 172.21.15.72:0/3471335857 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9b80035b0 con 0x7ff9d00c4400 2023-07-27T20:32:14.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.569+0000 7ff9ce7fc700 1 -- 172.21.15.72:0/3471335857 >> v2:172.21.15.173:3300/0 conn(0x7ff9d01549f0 msgr2=0x7ff9d01514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:14.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.569+0000 7ff9ce7fc700 1 --2- 172.21.15.72:0/3471335857 >> v2:172.21.15.173:3300/0 conn(0x7ff9d01549f0 0x7ff9d01514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:14.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.569+0000 7ff9ce7fc700 1 -- 172.21.15.72:0/3471335857 >> v1:172.21.15.173:6789/0 conn(0x7ff9d00c4400 legacy=0x7ff9d00c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:14.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.569+0000 7ff9ce7fc700 1 -- 172.21.15.72:0/3471335857 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d006b9f0 con 0x7ff9d006b150 2023-07-27T20:32:14.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.569+0000 7ff9cf7fe700 1 --2- 172.21.15.72:0/3471335857 >> v2:172.21.15.173:3300/0 conn(0x7ff9d01549f0 0x7ff9d01514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:32:14.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.570+0000 7ff9ce7fc700 1 --2- 172.21.15.72:0/3471335857 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff9d006b150 0x7ff9d00c7710 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4009840 tx=0x7ff9c4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=710c71378b89dcbf server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:14.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.570+0000 7ff9cdffb700 1 -- 172.21.15.72:0/3471335857 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4011830 con 0x7ff9d006b150 2023-07-27T20:32:14.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.570+0000 7ff9cdffb700 1 -- 172.21.15.72:0/3471335857 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c4011990 con 0x7ff9d006b150 2023-07-27T20:32:14.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.570+0000 7ff9cdffb700 1 -- 172.21.15.72:0/3471335857 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4011d20 con 0x7ff9d006b150 2023-07-27T20:32:14.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.570+0000 7ff9d55ff700 1 -- 172.21.15.72:0/3471335857 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff9d006b150 msgr2=0x7ff9d00c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:14.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.570+0000 7ff9d55ff700 1 --2- 172.21.15.72:0/3471335857 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff9d006b150 0x7ff9d00c7710 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4009840 tx=0x7ff9c4009b50 comp rx=0 tx=0).stop 2023-07-27T20:32:14.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.571+0000 7ff9d55ff700 1 -- 172.21.15.72:0/3471335857 shutdown_connections 2023-07-27T20:32:14.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.571+0000 7ff9d55ff700 1 --2- 172.21.15.72:0/3471335857 >> v2:172.21.15.173:3300/0 conn(0x7ff9d01549f0 0x7ff9d01514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:14.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.571+0000 7ff9d55ff700 1 --2- 172.21.15.72:0/3471335857 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff9d006b150 0x7ff9d00c7710 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:14.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.571+0000 7ff9d55ff700 1 -- 172.21.15.72:0/3471335857 >> 172.21.15.72:0/3471335857 conn(0x7ff9d00ab300 msgr2=0x7ff9d00ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:14.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.571+0000 7ff9d55ff700 1 -- 172.21.15.72:0/3471335857 shutdown_connections 2023-07-27T20:32:14.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.571+0000 7ff9d55ff700 1 -- 172.21.15.72:0/3471335857 wait complete. 2023-07-27T20:32:14.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.572+0000 7ff9d55ff700 1 Processor -- start 2023-07-27T20:32:14.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.572+0000 7ff9d55ff700 1 -- start start 2023-07-27T20:32:14.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.573+0000 7ff9d55ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9d006b150 0x7ff9d01da570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:14.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.573+0000 7ff9d55ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff9d00c4400 0x7ff9d01e9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:14.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.573+0000 7ff9d55ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9d01549f0 0x7ff9d01ea270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:14.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.573+0000 7ff9d55ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d00a94c0 con 0x7ff9d01549f0 2023-07-27T20:32:14.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.573+0000 7ff9d55ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d01e9640 con 0x7ff9d006b150 2023-07-27T20:32:14.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.573+0000 7ff9d55ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d01db2b0 con 0x7ff9d00c4400 2023-07-27T20:32:14.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.574+0000 7ff9cf7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9d01549f0 0x7ff9d01ea270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:14.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.574+0000 7ff9cf7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9d01549f0 0x7ff9d01ea270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44082/0 (socket says 172.21.15.72:44082) 2023-07-27T20:32:14.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.574+0000 7ff9cf7fe700 1 -- 172.21.15.72:0/781680292 learned_addr learned my addr 172.21.15.72:0/781680292 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:14.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.574+0000 7ff9ce7fc700 1 --2- 172.21.15.72:0/781680292 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff9d00c4400 0x7ff9d01e9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:14.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.574+0000 7ff9ceffd700 1 --2- 172.21.15.72:0/781680292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9d006b150 0x7ff9d01da570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:14.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.574+0000 7ff9cf7fe700 1 -- 172.21.15.72:0/781680292 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff9d00c4400 msgr2=0x7ff9d01e9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:14.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.574+0000 7ff9cf7fe700 1 --2- 172.21.15.72:0/781680292 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff9d00c4400 0x7ff9d01e9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:14.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.574+0000 7ff9cf7fe700 1 -- 172.21.15.72:0/781680292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9d006b150 msgr2=0x7ff9d01da570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:14.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.574+0000 7ff9cf7fe700 1 --2- 172.21.15.72:0/781680292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9d006b150 0x7ff9d01da570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:14.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.574+0000 7ff9cf7fe700 1 -- 172.21.15.72:0/781680292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c8009a70 con 0x7ff9d01549f0 2023-07-27T20:32:14.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.574+0000 7ff9ceffd700 1 --2- 172.21.15.72:0/781680292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9d006b150 0x7ff9d01da570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:14.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.574+0000 7ff9cf7fe700 1 --2- 172.21.15.72:0/781680292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9d01549f0 0x7ff9d01ea270 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8009e60 tx=0x7ff9c800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:14.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.575+0000 7ff9b77fe700 1 -- 172.21.15.72:0/781680292 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8009cd0 con 0x7ff9d01549f0 2023-07-27T20:32:14.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.575+0000 7ff9b77fe700 1 -- 172.21.15.72:0/781680292 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c800f040 con 0x7ff9d01549f0 2023-07-27T20:32:14.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.575+0000 7ff9b77fe700 1 -- 172.21.15.72:0/781680292 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c800cd60 con 0x7ff9d01549f0 2023-07-27T20:32:14.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.575+0000 7ff9d55ff700 1 -- 172.21.15.72:0/781680292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c40094a0 con 0x7ff9d01549f0 2023-07-27T20:32:14.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.575+0000 7ff9d55ff700 1 -- 172.21.15.72:0/781680292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d00a96d0 con 0x7ff9d01549f0 2023-07-27T20:32:14.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.576+0000 7ff9d55ff700 1 -- 172.21.15.72:0/781680292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d01e9a30 con 0x7ff9d01549f0 2023-07-27T20:32:14.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.577+0000 7ff9b77fe700 1 -- 172.21.15.72:0/781680292 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff9c8014480 con 0x7ff9d01549f0 2023-07-27T20:32:14.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.577+0000 7ff9b77fe700 1 --2- 172.21.15.72:0/781680292 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff9bc06ace0 0x7ff9bc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:14.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.577+0000 7ff9b77fe700 1 -- 172.21.15.72:0/781680292 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff9c8089e00 con 0x7ff9d01549f0 2023-07-27T20:32:14.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.578+0000 7ff9ceffd700 1 --2- 172.21.15.72:0/781680292 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff9bc06ace0 0x7ff9bc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:14.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.578+0000 7ff9ceffd700 1 --2- 172.21.15.72:0/781680292 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff9bc06ace0 0x7ff9bc06d1a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff9c00011e0 tx=0x7ff9c0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:14.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.582+0000 7ff9b77fe700 1 -- 172.21.15.72:0/781680292 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff9c8054b70 con 0x7ff9d01549f0 2023-07-27T20:32:14.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.780+0000 7ff9d55ff700 1 -- 172.21.15.72:0/781680292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9d004e470 con 0x7ff9d01549f0 2023-07-27T20:32:14.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.781+0000 7ff9b77fe700 1 -- 172.21.15.72:0/781680292 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20215 (secure 0 0 0) 0x7ff9c8058190 con 0x7ff9d01549f0 2023-07-27T20:32:14.770 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:32:14.770 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":29,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:32:10.402254+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:31:27.020951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T20:31:27.566022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-27T20:31:31.182401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:32:14.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.783+0000 7ff9d55ff700 1 -- 172.21.15.72:0/781680292 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff9bc06ace0 msgr2=0x7ff9bc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:14.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.783+0000 7ff9d55ff700 1 --2- 172.21.15.72:0/781680292 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff9bc06ace0 0x7ff9bc06d1a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff9c00011e0 tx=0x7ff9c0009040 comp rx=0 tx=0).stop 2023-07-27T20:32:14.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.783+0000 7ff9d55ff700 1 -- 172.21.15.72:0/781680292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9d01549f0 msgr2=0x7ff9d01ea270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:14.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.783+0000 7ff9d55ff700 1 --2- 172.21.15.72:0/781680292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9d01549f0 0x7ff9d01ea270 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8009e60 tx=0x7ff9c800c3a0 comp rx=0 tx=0).stop 2023-07-27T20:32:14.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.783+0000 7ff9d55ff700 1 -- 172.21.15.72:0/781680292 shutdown_connections 2023-07-27T20:32:14.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.783+0000 7ff9d55ff700 1 --2- 172.21.15.72:0/781680292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9d01549f0 0x7ff9d01ea270 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:14.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.783+0000 7ff9d55ff700 1 --2- 172.21.15.72:0/781680292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9d006b150 0x7ff9d01da570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:14.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.783+0000 7ff9d55ff700 1 --2- 172.21.15.72:0/781680292 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff9bc06ace0 0x7ff9bc06d1a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:14.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.783+0000 7ff9d55ff700 1 --2- 172.21.15.72:0/781680292 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff9d00c4400 0x7ff9d01e9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:14.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.783+0000 7ff9d55ff700 1 -- 172.21.15.72:0/781680292 >> 172.21.15.72:0/781680292 conn(0x7ff9d00ab300 msgr2=0x7ff9d0151270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:14.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.784+0000 7ff9d55ff700 1 -- 172.21.15.72:0/781680292 shutdown_connections 2023-07-27T20:32:14.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:14.784+0000 7ff9d55ff700 1 -- 172.21.15.72:0/781680292 wait complete. 2023-07-27T20:32:14.790 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-27T20:31:14.581785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T20:31:21.077941+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T20:31:27.020951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T20:31:27.566022+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-27T20:31:31.182401+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-27T20:32:14.791 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-27T20:32:14.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.001+0000 7f98f89ff700 1 Processor -- start 2023-07-27T20:32:14.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.001+0000 7f98f89ff700 1 -- start start 2023-07-27T20:32:14.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.002+0000 7f98f89ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f98f40c12f0 0x7f98f41516c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:14.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.002+0000 7f98f89ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f98f40716f0 0x7f98f4071b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:14.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.002+0000 7f98f89ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98f4154f50 con 0x7f98f41475a0 2023-07-27T20:32:14.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.002+0000 7f98f89ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98f4151c00 con 0x7f98f40716f0 2023-07-27T20:32:14.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.002+0000 7f98f89ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f4154340 con 0x7f98f40c12f0 2023-07-27T20:32:14.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.002+0000 7f98f2d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f98f40716f0 0x7f98f4071b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:14.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.002+0000 7f98f259c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f98f41475a0 0x7f98f40c1d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39668/0 (socket says 172.21.15.72:39668) 2023-07-27T20:32:14.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.002+0000 7f98f259c700 1 -- 172.21.15.72:0/822767010 learned_addr learned my addr 172.21.15.72:0/822767010 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:14.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.003+0000 7f98f1d9b700 1 --2- 172.21.15.72:0/822767010 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f98f40c12f0 0x7f98f41516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:14.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.003+0000 7f98f2d9d700 1 -- 172.21.15.72:0/822767010 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f98f40c12f0 msgr2=0x7f98f41516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:14.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.003+0000 7f98f2d9d700 1 --2- 172.21.15.72:0/822767010 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f98f40c12f0 0x7f98f41516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:14.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.003+0000 7f98f2d9d700 1 -- 172.21.15.72:0/822767010 >> v1:172.21.15.72:6789/0 conn(0x7f98f41475a0 legacy=0x7f98f40c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:14.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.003+0000 7f98f2d9d700 1 -- 172.21.15.72:0/822767010 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f4154620 con 0x7f98f40716f0 2023-07-27T20:32:14.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.003+0000 7f98f1d9b700 1 --2- 172.21.15.72:0/822767010 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f98f40c12f0 0x7f98f41516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:14.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.003+0000 7f98f159a700 1 -- 172.21.15.72:0/822767010 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 801062943 0 0) 0x7f98f4154f50 con 0x7f98f41475a0 2023-07-27T20:32:14.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.003+0000 7f98f2d9d700 1 --2- 172.21.15.72:0/822767010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98f40716f0 0x7f98f4071b60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f98ec009d90 tx=0x7f98ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa6e32a7a7cb65d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:14.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.003+0000 7f98f159a700 1 -- 172.21.15.72:0/822767010 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ec00e070 con 0x7f98f40716f0 2023-07-27T20:32:14.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.003+0000 7f98f159a700 1 -- 172.21.15.72:0/822767010 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ec00bbd0 con 0x7f98f40716f0 2023-07-27T20:32:14.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.003+0000 7f98f159a700 1 -- 172.21.15.72:0/822767010 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ec012430 con 0x7f98f40716f0 2023-07-27T20:32:14.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.004+0000 7f98f89ff700 1 -- 172.21.15.72:0/822767010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98f40716f0 msgr2=0x7f98f4071b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:14.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.004+0000 7f98f89ff700 1 --2- 172.21.15.72:0/822767010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98f40716f0 0x7f98f4071b60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f98ec009d90 tx=0x7f98ec00b330 comp rx=0 tx=0).stop 2023-07-27T20:32:14.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.004+0000 7f98f89ff700 1 -- 172.21.15.72:0/822767010 shutdown_connections 2023-07-27T20:32:14.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.004+0000 7f98f89ff700 1 --2- 172.21.15.72:0/822767010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98f40716f0 0x7f98f4071b60 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:14.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.004+0000 7f98f89ff700 1 --2- 172.21.15.72:0/822767010 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f98f40c12f0 0x7f98f41516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:14.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.004+0000 7f98f89ff700 1 -- 172.21.15.72:0/822767010 >> 172.21.15.72:0/822767010 conn(0x7f98f406a190 msgr2=0x7f98f406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:14.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.004+0000 7f98f89ff700 1 -- 172.21.15.72:0/822767010 shutdown_connections 2023-07-27T20:32:14.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.004+0000 7f98f89ff700 1 -- 172.21.15.72:0/822767010 wait complete. 2023-07-27T20:32:14.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.006+0000 7f98f89ff700 1 Processor -- start 2023-07-27T20:32:14.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.006+0000 7f98f89ff700 1 -- start start 2023-07-27T20:32:14.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.007+0000 7f98f89ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98f40716f0 0x7f98f40c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:14.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.007+0000 7f98f89ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98f40c12f0 0x7f98f4144270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:14.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.007+0000 7f98f89ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f98f41475a0 0x7f98f41e95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:14.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.007+0000 7f98f89ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f40ab750 con 0x7f98f40716f0 2023-07-27T20:32:14.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.007+0000 7f98f89ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f41e9130 con 0x7f98f40c12f0 2023-07-27T20:32:14.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.007+0000 7f98f89ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f40c5190 con 0x7f98f41475a0 2023-07-27T20:32:14.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.007+0000 7f98f259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98f40716f0 0x7f98f40c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:14.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.007+0000 7f98f259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98f40716f0 0x7f98f40c42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44108/0 (socket says 172.21.15.72:44108) 2023-07-27T20:32:14.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.007+0000 7f98f259c700 1 -- 172.21.15.72:0/617904972 learned_addr learned my addr 172.21.15.72:0/617904972 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:14.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.007+0000 7f98f2d9d700 1 --2- 172.21.15.72:0/617904972 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f98f41475a0 0x7f98f41e95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:14.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.007+0000 7f98f1d9b700 1 --2- 172.21.15.72:0/617904972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98f40c12f0 0x7f98f4144270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:14.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.007+0000 7f98f259c700 1 -- 172.21.15.72:0/617904972 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f98f41475a0 msgr2=0x7f98f41e95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:14.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.007+0000 7f98f259c700 1 --2- 172.21.15.72:0/617904972 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f98f41475a0 0x7f98f41e95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:14.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.007+0000 7f98f259c700 1 -- 172.21.15.72:0/617904972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98f40c12f0 msgr2=0x7f98f4144270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:15.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.007+0000 7f98f259c700 1 --2- 172.21.15.72:0/617904972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98f40c12f0 0x7f98f4144270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:15.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.007+0000 7f98f259c700 1 -- 172.21.15.72:0/617904972 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ec009a70 con 0x7f98f40716f0 2023-07-27T20:32:15.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.008+0000 7f98f259c700 1 --2- 172.21.15.72:0/617904972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98f40716f0 0x7f98f40c42c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f98e400c550 tx=0x7f98e400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:15.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.008+0000 7f98e2ffd700 1 -- 172.21.15.72:0/617904972 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e4004c80 con 0x7f98f40716f0 2023-07-27T20:32:15.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.008+0000 7f98e2ffd700 1 -- 172.21.15.72:0/617904972 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e4004e00 con 0x7f98f40716f0 2023-07-27T20:32:15.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.008+0000 7f98f89ff700 1 -- 172.21.15.72:0/617904972 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98f4150190 con 0x7f98f40716f0 2023-07-27T20:32:15.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.008+0000 7f98e2ffd700 1 -- 172.21.15.72:0/617904972 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e4007310 con 0x7f98f40716f0 2023-07-27T20:32:15.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.008+0000 7f98f89ff700 1 -- 172.21.15.72:0/617904972 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f4150750 con 0x7f98f40716f0 2023-07-27T20:32:15.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.009+0000 7f98f89ff700 1 -- 172.21.15.72:0/617904972 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98f41e9410 con 0x7f98f40716f0 2023-07-27T20:32:15.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.010+0000 7f98e2ffd700 1 -- 172.21.15.72:0/617904972 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f98e4007470 con 0x7f98f40716f0 2023-07-27T20:32:15.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.011+0000 7f98e2ffd700 1 --2- 172.21.15.72:0/617904972 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f98d406ace0 0x7f98d406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:15.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.011+0000 7f98e2ffd700 1 -- 172.21.15.72:0/617904972 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f98e40894d0 con 0x7f98f40716f0 2023-07-27T20:32:15.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.011+0000 7f98f1d9b700 1 --2- 172.21.15.72:0/617904972 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f98d406ace0 0x7f98d406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:15.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.012+0000 7f98f1d9b700 1 --2- 172.21.15.72:0/617904972 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f98d406ace0 0x7f98d406d1a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f98f414fe50 tx=0x7f98e8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:15.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.015+0000 7f98e2ffd700 1 -- 172.21.15.72:0/617904972 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f98e4054240 con 0x7f98f40716f0 2023-07-27T20:32:15.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.207+0000 7f98f89ff700 1 -- 172.21.15.72:0/617904972 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f98f4150970 con 0x7f98f40716f0 2023-07-27T20:32:15.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.207+0000 7f98e2ffd700 1 -- 172.21.15.72:0/617904972 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f98e4057860 con 0x7f98f40716f0 2023-07-27T20:32:15.196 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-27T20:32:15.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.209+0000 7f98f89ff700 1 -- 172.21.15.72:0/617904972 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f98d406ace0 msgr2=0x7f98d406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:15.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.209+0000 7f98f89ff700 1 --2- 172.21.15.72:0/617904972 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f98d406ace0 0x7f98d406d1a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f98f414fe50 tx=0x7f98e8008040 comp rx=0 tx=0).stop 2023-07-27T20:32:15.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.209+0000 7f98f89ff700 1 -- 172.21.15.72:0/617904972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98f40716f0 msgr2=0x7f98f40c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:15.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.209+0000 7f98f89ff700 1 --2- 172.21.15.72:0/617904972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98f40716f0 0x7f98f40c42c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f98e400c550 tx=0x7f98e400c910 comp rx=0 tx=0).stop 2023-07-27T20:32:15.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.209+0000 7f98f89ff700 1 -- 172.21.15.72:0/617904972 shutdown_connections 2023-07-27T20:32:15.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.209+0000 7f98f89ff700 1 --2- 172.21.15.72:0/617904972 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f98d406ace0 0x7f98d406d1a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:15.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.209+0000 7f98f89ff700 1 --2- 172.21.15.72:0/617904972 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f98f41475a0 0x7f98f41e95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:15.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.209+0000 7f98f89ff700 1 --2- 172.21.15.72:0/617904972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98f40716f0 0x7f98f40c42c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:15.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.209+0000 7f98f89ff700 1 --2- 172.21.15.72:0/617904972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98f40c12f0 0x7f98f4144270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:15.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.209+0000 7f98f89ff700 1 -- 172.21.15.72:0/617904972 >> 172.21.15.72:0/617904972 conn(0x7f98f406a190 msgr2=0x7f98f41dc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:15.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.209+0000 7f98f89ff700 1 -- 172.21.15.72:0/617904972 shutdown_connections 2023-07-27T20:32:15.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.209+0000 7f98f89ff700 1 -- 172.21.15.72:0/617904972 wait complete. 2023-07-27T20:32:15.216 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T20:32:15.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.426+0000 7f476a1ff700 1 Processor -- start 2023-07-27T20:32:15.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.426+0000 7f476a1ff700 1 -- start start 2023-07-27T20:32:15.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.427+0000 7f476a1ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f47641475a0 0x7f47641516c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:15.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.427+0000 7f476a1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f47640c12f0 0x7f47640c1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:15.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.427+0000 7f476a1ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4764154f50 con 0x7f47640c2240 2023-07-27T20:32:15.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.427+0000 7f476a1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4764151c00 con 0x7f47640c12f0 2023-07-27T20:32:15.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.427+0000 7f476a1ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4764154340 con 0x7f47641475a0 2023-07-27T20:32:15.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.428+0000 7f4762ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f47640c12f0 0x7f47640c1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:15.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.428+0000 7f4762ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f47640c12f0 0x7f47640c1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44120/0 (socket says 172.21.15.72:44120) 2023-07-27T20:32:15.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.428+0000 7f4762ffd700 1 -- 172.21.15.72:0/716795469 learned_addr learned my addr 172.21.15.72:0/716795469 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:15.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.428+0000 7f4762ffd700 1 -- 172.21.15.72:0/716795469 >> v2:172.21.15.173:3300/0 conn(0x7f47641475a0 msgr2=0x7f47641516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:15.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.428+0000 7f4762ffd700 1 --2- 172.21.15.72:0/716795469 >> v2:172.21.15.173:3300/0 conn(0x7f47641475a0 0x7f47641516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:15.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.428+0000 7f4762ffd700 1 -- 172.21.15.72:0/716795469 >> v1:172.21.15.173:6789/0 conn(0x7f47640c2240 legacy=0x7f47640716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:15.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.428+0000 7f4762ffd700 1 -- 172.21.15.72:0/716795469 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4764154620 con 0x7f47640c12f0 2023-07-27T20:32:15.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.428+0000 7f4762ffd700 1 --2- 172.21.15.72:0/716795469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47640c12f0 0x7f47640c1d00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f47640c2b60 tx=0x7f4758009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1669ba0a94fd73c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:15.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.428+0000 7f47627fc700 1 -- 172.21.15.72:0/716795469 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4758004230 con 0x7f47640c12f0 2023-07-27T20:32:15.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.429+0000 7f47627fc700 1 -- 172.21.15.72:0/716795469 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4758004390 con 0x7f47640c12f0 2023-07-27T20:32:15.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.429+0000 7f47627fc700 1 -- 172.21.15.72:0/716795469 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47580036a0 con 0x7f47640c12f0 2023-07-27T20:32:15.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.429+0000 7f476a1ff700 1 -- 172.21.15.72:0/716795469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47640c12f0 msgr2=0x7f47640c1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:15.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.429+0000 7f476a1ff700 1 --2- 172.21.15.72:0/716795469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47640c12f0 0x7f47640c1d00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f47640c2b60 tx=0x7f4758009bd0 comp rx=0 tx=0).stop 2023-07-27T20:32:15.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.429+0000 7f476a1ff700 1 -- 172.21.15.72:0/716795469 shutdown_connections 2023-07-27T20:32:15.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.429+0000 7f476a1ff700 1 --2- 172.21.15.72:0/716795469 >> v2:172.21.15.173:3300/0 conn(0x7f47641475a0 0x7f47641516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:15.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.429+0000 7f476a1ff700 1 --2- 172.21.15.72:0/716795469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47640c12f0 0x7f47640c1d00 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:15.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.429+0000 7f476a1ff700 1 -- 172.21.15.72:0/716795469 >> 172.21.15.72:0/716795469 conn(0x7f476406a190 msgr2=0x7f476406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:15.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.429+0000 7f476a1ff700 1 -- 172.21.15.72:0/716795469 shutdown_connections 2023-07-27T20:32:15.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.429+0000 7f476a1ff700 1 -- 172.21.15.72:0/716795469 wait complete. 2023-07-27T20:32:15.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.431+0000 7f476a1ff700 1 Processor -- start 2023-07-27T20:32:15.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.431+0000 7f476a1ff700 1 -- start start 2023-07-27T20:32:15.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.432+0000 7f476a1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47640c12f0 0x7f4764152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:15.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.432+0000 7f476a1ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47640c2240 0x7f4764143630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:15.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.432+0000 7f476a1ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f47641475a0 0x7f476413fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:15.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.432+0000 7f476a1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4764152c90 con 0x7f47640c12f0 2023-07-27T20:32:15.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.432+0000 7f476a1ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47641536e0 con 0x7f47640c2240 2023-07-27T20:32:15.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.432+0000 7f476a1ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47641539c0 con 0x7f47641475a0 2023-07-27T20:32:15.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.432+0000 7f47637fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47640c12f0 0x7f4764152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:15.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.432+0000 7f47637fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47640c12f0 0x7f4764152750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44128/0 (socket says 172.21.15.72:44128) 2023-07-27T20:32:15.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.432+0000 7f47637fe700 1 -- 172.21.15.72:0/1895618397 learned_addr learned my addr 172.21.15.72:0/1895618397 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:15.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.433+0000 7f47637fe700 1 -- 172.21.15.72:0/1895618397 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f47641475a0 msgr2=0x7f476413fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:15.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.433+0000 7f47637fe700 1 --2- 172.21.15.72:0/1895618397 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f47641475a0 0x7f476413fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:15.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.433+0000 7f47637fe700 1 -- 172.21.15.72:0/1895618397 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47640c2240 msgr2=0x7f4764143630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:15.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.433+0000 7f47637fe700 1 --2- 172.21.15.72:0/1895618397 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47640c2240 0x7f4764143630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:15.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.433+0000 7f47637fe700 1 -- 172.21.15.72:0/1895618397 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4758009550 con 0x7f47640c12f0 2023-07-27T20:32:15.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.433+0000 7f47637fe700 1 --2- 172.21.15.72:0/1895618397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47640c12f0 0x7f4764152750 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f475400b4a0 tx=0x7f475400b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:15.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.433+0000 7f474bfff700 1 -- 172.21.15.72:0/1895618397 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4754011830 con 0x7f47640c12f0 2023-07-27T20:32:15.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.433+0000 7f474bfff700 1 -- 172.21.15.72:0/1895618397 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4754011990 con 0x7f47640c12f0 2023-07-27T20:32:15.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.433+0000 7f474bfff700 1 -- 172.21.15.72:0/1895618397 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4754011d40 con 0x7f47640c12f0 2023-07-27T20:32:15.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.433+0000 7f476a1ff700 1 -- 172.21.15.72:0/1895618397 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4764153ca0 con 0x7f47640c12f0 2023-07-27T20:32:15.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.433+0000 7f476a1ff700 1 -- 172.21.15.72:0/1895618397 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4764143b70 con 0x7f47640c12f0 2023-07-27T20:32:15.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.434+0000 7f476a1ff700 1 -- 172.21.15.72:0/1895618397 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f476404e470 con 0x7f47640c12f0 2023-07-27T20:32:15.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.435+0000 7f474bfff700 1 -- 172.21.15.72:0/1895618397 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f475401a400 con 0x7f47640c12f0 2023-07-27T20:32:15.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.436+0000 7f474bfff700 1 --2- 172.21.15.72:0/1895618397 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f475006ace0 0x7f475006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:15.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.436+0000 7f474bfff700 1 -- 172.21.15.72:0/1895618397 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4754089920 con 0x7f47640c12f0 2023-07-27T20:32:15.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.436+0000 7f4762ffd700 1 --2- 172.21.15.72:0/1895618397 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f475006ace0 0x7f475006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:15.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.437+0000 7f4762ffd700 1 --2- 172.21.15.72:0/1895618397 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f475006ace0 0x7f475006d1a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f47640c6230 tx=0x7f4758010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:15.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.440+0000 7f474bfff700 1 -- 172.21.15.72:0/1895618397 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4754054610 con 0x7f47640c12f0 2023-07-27T20:32:15.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.633+0000 7f476a1ff700 1 -- 172.21.15.72:0/1895618397 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f47641548d0 con 0x7f47640c12f0 2023-07-27T20:32:15.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.634+0000 7f474bfff700 1 -- 172.21.15.72:0/1895618397 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4754057c30 con 0x7f47640c12f0 2023-07-27T20:32:15.623 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-27T20:32:15.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.636+0000 7f476a1ff700 1 -- 172.21.15.72:0/1895618397 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f475006ace0 msgr2=0x7f475006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:15.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.636+0000 7f476a1ff700 1 --2- 172.21.15.72:0/1895618397 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f475006ace0 0x7f475006d1a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f47640c6230 tx=0x7f4758010000 comp rx=0 tx=0).stop 2023-07-27T20:32:15.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.636+0000 7f476a1ff700 1 -- 172.21.15.72:0/1895618397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47640c12f0 msgr2=0x7f4764152750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:15.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.636+0000 7f476a1ff700 1 --2- 172.21.15.72:0/1895618397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47640c12f0 0x7f4764152750 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f475400b4a0 tx=0x7f475400b860 comp rx=0 tx=0).stop 2023-07-27T20:32:15.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.636+0000 7f476a1ff700 1 -- 172.21.15.72:0/1895618397 shutdown_connections 2023-07-27T20:32:15.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.636+0000 7f476a1ff700 1 --2- 172.21.15.72:0/1895618397 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f475006ace0 0x7f475006d1a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:15.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.636+0000 7f476a1ff700 1 --2- 172.21.15.72:0/1895618397 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f47641475a0 0x7f476413fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:15.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.636+0000 7f476a1ff700 1 --2- 172.21.15.72:0/1895618397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47640c12f0 0x7f4764152750 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:15.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.636+0000 7f476a1ff700 1 --2- 172.21.15.72:0/1895618397 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47640c2240 0x7f4764143630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:15.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.636+0000 7f476a1ff700 1 -- 172.21.15.72:0/1895618397 >> 172.21.15.72:0/1895618397 conn(0x7f476406a190 msgr2=0x7f47640bba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:15.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.636+0000 7f476a1ff700 1 -- 172.21.15.72:0/1895618397 shutdown_connections 2023-07-27T20:32:15.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.636+0000 7f476a1ff700 1 -- 172.21.15.72:0/1895618397 wait complete. 2023-07-27T20:32:15.642 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T20:32:15.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.852+0000 7fa60f3ff700 1 Processor -- start 2023-07-27T20:32:15.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.852+0000 7fa60f3ff700 1 -- start start 2023-07-27T20:32:15.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.853+0000 7fa60f3ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa60806ffc0 0x7fa6080c6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:15.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.853+0000 7fa60f3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa60806d1c0 con 0x7fa6080c6c50 2023-07-27T20:32:15.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.853+0000 7fa60f3ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa608155070 con 0x7fa6080c77c0 2023-07-27T20:32:15.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.854+0000 7fa60f3ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa60806ce90 con 0x7fa60806ffc0 2023-07-27T20:32:15.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.854+0000 7fa60d99c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa6080c6c50 0x7fa6080c3e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39674/0 (socket says 172.21.15.72:39674) 2023-07-27T20:32:15.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.854+0000 7fa60d99c700 1 -- 172.21.15.72:0/4090074475 learned_addr learned my addr 172.21.15.72:0/4090074475 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:15.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.854+0000 7fa60c99a700 1 --2- 172.21.15.72:0/4090074475 >> v2:172.21.15.173:3300/0 conn(0x7fa60806ffc0 0x7fa6080c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:15.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.854+0000 7fa5fffff700 1 -- 172.21.15.72:0/4090074475 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1988916614 0 0) 0x7fa60806d1c0 con 0x7fa6080c6c50 2023-07-27T20:32:15.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.854+0000 7fa5fffff700 1 -- 172.21.15.72:0/4090074475 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5f40035b0 con 0x7fa6080c6c50 2023-07-27T20:32:15.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.854+0000 7fa5fffff700 1 -- 172.21.15.72:0/4090074475 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 74872659 0 0) 0x7fa608155070 con 0x7fa6080c77c0 2023-07-27T20:32:15.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.854+0000 7fa5fffff700 1 -- 172.21.15.72:0/4090074475 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa60806d1c0 con 0x7fa6080c77c0 2023-07-27T20:32:15.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.854+0000 7fa5fffff700 1 -- 172.21.15.72:0/4090074475 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4261029413 0 0) 0x7fa5f40035b0 con 0x7fa6080c6c50 2023-07-27T20:32:15.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.854+0000 7fa5fffff700 1 -- 172.21.15.72:0/4090074475 >> v2:172.21.15.173:3300/0 conn(0x7fa60806ffc0 msgr2=0x7fa6080c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:15.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.854+0000 7fa5fffff700 1 --2- 172.21.15.72:0/4090074475 >> v2:172.21.15.173:3300/0 conn(0x7fa60806ffc0 0x7fa6080c6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:15.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.854+0000 7fa5fffff700 1 -- 172.21.15.72:0/4090074475 >> v1:172.21.15.173:6789/0 conn(0x7fa6080c77c0 legacy=0x7fa608151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:15.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.854+0000 7fa5fffff700 1 -- 172.21.15.72:0/4090074475 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa608154d90 con 0x7fa6080c6c50 2023-07-27T20:32:15.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.854+0000 7fa5fffff700 1 -- 172.21.15.72:0/4090074475 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7fa6000019f0 con 0x7fa6080c6c50 2023-07-27T20:32:15.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.855+0000 7fa5fffff700 1 -- 172.21.15.72:0/4090074475 >> v1:172.21.15.72:6789/0 conn(0x7fa6080c6c50 legacy=0x7fa6080c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:15.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.855+0000 7fa5fffff700 1 --2- 172.21.15.72:0/4090074475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5f4003b90 0x7fa5f4003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:15.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.855+0000 7fa5fffff700 1 --2- 172.21.15.72:0/4090074475 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5f4004850 0x7fa5f4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:15.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.855+0000 7fa5fffff700 1 --2- 172.21.15.72:0/4090074475 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5f4005280 0x7fa5f400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:15.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.855+0000 7fa5fffff700 1 -- 172.21.15.72:0/4090074475 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60806ce90 con 0x7fa5f4005280 2023-07-27T20:32:15.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.855+0000 7fa5fffff700 1 -- 172.21.15.72:0/4090074475 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f400c1e0 con 0x7fa5f4003b90 2023-07-27T20:32:15.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.855+0000 7fa5fffff700 1 -- 172.21.15.72:0/4090074475 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f400c3a0 con 0x7fa5f4004850 2023-07-27T20:32:15.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.855+0000 7fa60d99c700 1 --2- 172.21.15.72:0/4090074475 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5f4005280 0x7fa5f400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:15.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.855+0000 7fa60d19b700 1 --2- 172.21.15.72:0/4090074475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5f4003b90 0x7fa5f4003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:15.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.855+0000 7fa60c99a700 1 --2- 172.21.15.72:0/4090074475 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5f4004850 0x7fa5f4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:15.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.855+0000 7fa60d99c700 1 -- 172.21.15.72:0/4090074475 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5f4004850 msgr2=0x7fa5f4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:15.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.855+0000 7fa60d99c700 1 --2- 172.21.15.72:0/4090074475 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5f4004850 0x7fa5f4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:15.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.855+0000 7fa60d99c700 1 -- 172.21.15.72:0/4090074475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5f4003b90 msgr2=0x7fa5f4003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:15.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.855+0000 7fa60d99c700 1 --2- 172.21.15.72:0/4090074475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5f4003b90 0x7fa5f4003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:15.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.855+0000 7fa60d99c700 1 -- 172.21.15.72:0/4090074475 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f40035b0 con 0x7fa5f4005280 2023-07-27T20:32:15.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.855+0000 7fa60d99c700 1 -- 172.21.15.72:0/4090074475 reap_dead start 2023-07-27T20:32:15.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.856+0000 7fa60d99c700 1 --2- 172.21.15.72:0/4090074475 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5f4005280 0x7fa5f400ba10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa60000a7b0 tx=0x7fa5f4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=568436e92a52bb57 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:15.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.856+0000 7fa5fffff700 1 -- 172.21.15.72:0/4090074475 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa600012600 con 0x7fa5f4005280 2023-07-27T20:32:15.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.856+0000 7fa5fffff700 1 -- 172.21.15.72:0/4090074475 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6000127a0 con 0x7fa5f4005280 2023-07-27T20:32:15.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.856+0000 7fa5fffff700 1 -- 172.21.15.72:0/4090074475 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa600012b50 con 0x7fa5f4005280 2023-07-27T20:32:15.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.856+0000 7fa60f3ff700 1 -- 172.21.15.72:0/4090074475 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5f4005280 msgr2=0x7fa5f400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:15.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.856+0000 7fa60f3ff700 1 --2- 172.21.15.72:0/4090074475 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5f4005280 0x7fa5f400ba10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa60000a7b0 tx=0x7fa5f4005880 comp rx=0 tx=0).stop 2023-07-27T20:32:15.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.856+0000 7fa60f3ff700 1 -- 172.21.15.72:0/4090074475 shutdown_connections 2023-07-27T20:32:15.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.856+0000 7fa60f3ff700 1 --2- 172.21.15.72:0/4090074475 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5f4005280 0x7fa5f400ba10 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:15.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.856+0000 7fa60f3ff700 1 -- 172.21.15.72:0/4090074475 >> 172.21.15.72:0/4090074475 conn(0x7fa60806a190 msgr2=0x7fa60806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:15.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.856+0000 7fa60f3ff700 1 -- 172.21.15.72:0/4090074475 shutdown_connections 2023-07-27T20:32:15.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.856+0000 7fa60f3ff700 1 -- 172.21.15.72:0/4090074475 wait complete. 2023-07-27T20:32:15.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.858+0000 7fa60f3ff700 1 Processor -- start 2023-07-27T20:32:15.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.858+0000 7fa60f3ff700 1 -- start start 2023-07-27T20:32:15.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.859+0000 7fa60f3ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5f4005280 0x7fa6080acce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:15.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.859+0000 7fa60f3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6080be8d0 0x7fa6080bc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:15.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.859+0000 7fa60f3ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6080ad680 0x7fa6080bc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:15.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.859+0000 7fa60f3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6080c0d90 con 0x7fa6080be8d0 2023-07-27T20:32:15.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.859+0000 7fa60f3ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6080bedc0 con 0x7fa6080ad680 2023-07-27T20:32:15.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.859+0000 7fa60f3ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6080bbd40 con 0x7fa5f4005280 2023-07-27T20:32:15.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.859+0000 7fa60c99a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6080be8d0 0x7fa6080bc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:15.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.859+0000 7fa60c99a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6080be8d0 0x7fa6080bc1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44152/0 (socket says 172.21.15.72:44152) 2023-07-27T20:32:15.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.859+0000 7fa60c99a700 1 -- 172.21.15.72:0/2614003877 learned_addr learned my addr 172.21.15.72:0/2614003877 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:15.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.859+0000 7fa60d99c700 1 --2- 172.21.15.72:0/2614003877 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6080ad680 0x7fa6080bc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:15.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.859+0000 7fa60d19b700 1 --2- 172.21.15.72:0/2614003877 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5f4005280 0x7fa6080acce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:15.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.860+0000 7fa60c99a700 1 -- 172.21.15.72:0/2614003877 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5f4005280 msgr2=0x7fa6080acce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:15.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.860+0000 7fa60c99a700 1 --2- 172.21.15.72:0/2614003877 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5f4005280 0x7fa6080acce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:15.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.860+0000 7fa60c99a700 1 -- 172.21.15.72:0/2614003877 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6080ad680 msgr2=0x7fa6080bc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:15.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.860+0000 7fa60c99a700 1 --2- 172.21.15.72:0/2614003877 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6080ad680 0x7fa6080bc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:15.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.860+0000 7fa60c99a700 1 -- 172.21.15.72:0/2614003877 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6081ea510 con 0x7fa6080be8d0 2023-07-27T20:32:15.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.860+0000 7fa60c99a700 1 --2- 172.21.15.72:0/2614003877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6080be8d0 0x7fa6080bc1d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8011940 tx=0x7fa5f8011c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:15.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.860+0000 7fa5fdffb700 1 -- 172.21.15.72:0/2614003877 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f8011e90 con 0x7fa6080be8d0 2023-07-27T20:32:15.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.860+0000 7fa5fdffb700 1 -- 172.21.15.72:0/2614003877 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f8004240 con 0x7fa6080be8d0 2023-07-27T20:32:15.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.860+0000 7fa5fdffb700 1 -- 172.21.15.72:0/2614003877 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f800f730 con 0x7fa6080be8d0 2023-07-27T20:32:15.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.860+0000 7fa60f3ff700 1 -- 172.21.15.72:0/2614003877 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6080bd930 con 0x7fa6080be8d0 2023-07-27T20:32:15.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.860+0000 7fa60f3ff700 1 -- 172.21.15.72:0/2614003877 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6080bdef0 con 0x7fa6080be8d0 2023-07-27T20:32:15.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.861+0000 7fa60f3ff700 1 -- 172.21.15.72:0/2614003877 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa60804e470 con 0x7fa6080be8d0 2023-07-27T20:32:15.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.862+0000 7fa5fdffb700 1 -- 172.21.15.72:0/2614003877 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa5f800f890 con 0x7fa6080be8d0 2023-07-27T20:32:15.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.863+0000 7fa5fdffb700 1 --2- 172.21.15.72:0/2614003877 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa5ec06ace0 0x7fa5ec06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:15.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.863+0000 7fa5fdffb700 1 -- 172.21.15.72:0/2614003877 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa5f8089f80 con 0x7fa6080be8d0 2023-07-27T20:32:15.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.864+0000 7fa60d19b700 1 --2- 172.21.15.72:0/2614003877 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa5ec06ace0 0x7fa5ec06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:15.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.864+0000 7fa60d19b700 1 --2- 172.21.15.72:0/2614003877 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa5ec06ace0 0x7fa5ec06d1a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa6040010e0 tx=0x7fa604009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:15.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:15.869+0000 7fa5fdffb700 1 -- 172.21.15.72:0/2614003877 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa5f80bc310 con 0x7fa6080be8d0 2023-07-27T20:32:16.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.061+0000 7fa60f3ff700 1 -- 172.21.15.72:0/2614003877 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa60806fda0 con 0x7fa6080be8d0 2023-07-27T20:32:16.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.061+0000 7fa5fdffb700 1 -- 172.21.15.72:0/2614003877 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa5f8054d90 con 0x7fa6080be8d0 2023-07-27T20:32:16.050 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:32:16.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.064+0000 7fa60f3ff700 1 -- 172.21.15.72:0/2614003877 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa5ec06ace0 msgr2=0x7fa5ec06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:16.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.064+0000 7fa60f3ff700 1 --2- 172.21.15.72:0/2614003877 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa5ec06ace0 0x7fa5ec06d1a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa6040010e0 tx=0x7fa604009040 comp rx=0 tx=0).stop 2023-07-27T20:32:16.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.064+0000 7fa60f3ff700 1 -- 172.21.15.72:0/2614003877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6080be8d0 msgr2=0x7fa6080bc1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:16.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.064+0000 7fa60f3ff700 1 --2- 172.21.15.72:0/2614003877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6080be8d0 0x7fa6080bc1d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8011940 tx=0x7fa5f8011c50 comp rx=0 tx=0).stop 2023-07-27T20:32:16.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.064+0000 7fa60f3ff700 1 -- 172.21.15.72:0/2614003877 shutdown_connections 2023-07-27T20:32:16.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.064+0000 7fa60f3ff700 1 --2- 172.21.15.72:0/2614003877 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6080ad680 0x7fa6080bc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:16.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.064+0000 7fa60f3ff700 1 --2- 172.21.15.72:0/2614003877 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa5ec06ace0 0x7fa5ec06d1a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:16.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.064+0000 7fa60f3ff700 1 --2- 172.21.15.72:0/2614003877 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5f4005280 0x7fa6080acce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:16.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.064+0000 7fa60f3ff700 1 --2- 172.21.15.72:0/2614003877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6080be8d0 0x7fa6080bc1d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:16.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.064+0000 7fa60f3ff700 1 -- 172.21.15.72:0/2614003877 >> 172.21.15.72:0/2614003877 conn(0x7fa60806a190 msgr2=0x7fa6080a9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:16.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.064+0000 7fa60f3ff700 1 -- 172.21.15.72:0/2614003877 shutdown_connections 2023-07-27T20:32:16.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.064+0000 7fa60f3ff700 1 -- 172.21.15.72:0/2614003877 wait complete. 2023-07-27T20:32:16.070 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T20:32:16.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.281+0000 7fdf2d9ff700 1 Processor -- start 2023-07-27T20:32:16.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.281+0000 7fdf2d9ff700 1 -- start start 2023-07-27T20:32:16.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.281+0000 7fdf2d9ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf2814aab0 0x7fdf28154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:16.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.281+0000 7fdf2d9ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fdf2806c1d0 0x7fdf2806c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:16.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.281+0000 7fdf2d9ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf280c7c50 con 0x7fdf280c7740 2023-07-27T20:32:16.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.281+0000 7fdf2d9ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf2806bd40 con 0x7fdf2806c1d0 2023-07-27T20:32:16.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.281+0000 7fdf2d9ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf280c62f0 con 0x7fdf2814aab0 2023-07-27T20:32:16.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.282+0000 7fdf26ffd700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf2814aab0 0x7fdf28154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:16.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.282+0000 7fdf277fe700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fdf2806c1d0 0x7fdf2806c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:16.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.282+0000 7fdf267fc700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fdf280c7740 0x7fdf280c41c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.72:46452/0 (socket says 172.21.15.72:46452) 2023-07-27T20:32:16.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.282+0000 7fdf267fc700 1 -- 172.21.15.72:0/1028071120 learned_addr learned my addr 172.21.15.72:0/1028071120 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:16.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.282+0000 7fdf26ffd700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf2814aab0 0x7fdf28154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.72:43916/0 (socket says 172.21.15.72:43916) 2023-07-27T20:32:16.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.282+0000 7fdf26ffd700 1 -- 172.21.15.72:0/1028071120 >> v2:172.21.15.173:3300/0 conn(0x7fdf2806c1d0 msgr2=0x7fdf2806c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:16.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.282+0000 7fdf26ffd700 1 --2- 172.21.15.72:0/1028071120 >> v2:172.21.15.173:3300/0 conn(0x7fdf2806c1d0 0x7fdf2806c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:16.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.282+0000 7fdf26ffd700 1 -- 172.21.15.72:0/1028071120 >> v1:172.21.15.173:6789/0 conn(0x7fdf280c7740 legacy=0x7fdf280c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:16.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.282+0000 7fdf26ffd700 1 -- 172.21.15.72:0/1028071120 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf28155050 con 0x7fdf2814aab0 2023-07-27T20:32:16.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.282+0000 7fdf277fe700 1 --2- 172.21.15.72:0/1028071120 >> v2:172.21.15.173:3300/0 conn(0x7fdf2806c1d0 0x7fdf2806c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:32:16.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.283+0000 7fdf26ffd700 1 --2- 172.21.15.72:0/1028071120 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf2814aab0 0x7fdf28154b10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdf18009840 tx=0x7fdf18009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17c234243ed21a13 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:16.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.283+0000 7fdf25ffb700 1 -- 172.21.15.72:0/1028071120 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf18011830 con 0x7fdf2814aab0 2023-07-27T20:32:16.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.283+0000 7fdf25ffb700 1 -- 172.21.15.72:0/1028071120 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf18011990 con 0x7fdf2814aab0 2023-07-27T20:32:16.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.283+0000 7fdf25ffb700 1 -- 172.21.15.72:0/1028071120 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf18011d20 con 0x7fdf2814aab0 2023-07-27T20:32:16.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.283+0000 7fdf2d9ff700 1 -- 172.21.15.72:0/1028071120 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf2814aab0 msgr2=0x7fdf28154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:16.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.283+0000 7fdf2d9ff700 1 --2- 172.21.15.72:0/1028071120 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf2814aab0 0x7fdf28154b10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdf18009840 tx=0x7fdf18009b50 comp rx=0 tx=0).stop 2023-07-27T20:32:16.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.283+0000 7fdf2d9ff700 1 -- 172.21.15.72:0/1028071120 shutdown_connections 2023-07-27T20:32:16.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.283+0000 7fdf2d9ff700 1 --2- 172.21.15.72:0/1028071120 >> v2:172.21.15.173:3300/0 conn(0x7fdf2806c1d0 0x7fdf2806c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:16.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.283+0000 7fdf2d9ff700 1 --2- 172.21.15.72:0/1028071120 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf2814aab0 0x7fdf28154b10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:16.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.283+0000 7fdf2d9ff700 1 -- 172.21.15.72:0/1028071120 >> 172.21.15.72:0/1028071120 conn(0x7fdf280ab3f0 msgr2=0x7fdf280ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:16.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.284+0000 7fdf2d9ff700 1 -- 172.21.15.72:0/1028071120 shutdown_connections 2023-07-27T20:32:16.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.284+0000 7fdf2d9ff700 1 -- 172.21.15.72:0/1028071120 wait complete. 2023-07-27T20:32:16.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.286+0000 7fdf2d9ff700 1 Processor -- start 2023-07-27T20:32:16.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.286+0000 7fdf2d9ff700 1 -- start start 2023-07-27T20:32:16.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.287+0000 7fdf2d9ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf2806c1d0 0x7fdf28148f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:16.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.287+0000 7fdf2d9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf280c7740 0x7fdf2814ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:16.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.287+0000 7fdf2d9ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf2814aab0 0x7fdf281ed010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:16.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.287+0000 7fdf2d9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf280bd420 con 0x7fdf280c7740 2023-07-27T20:32:16.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.287+0000 7fdf2d9ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf28149490 con 0x7fdf2806c1d0 2023-07-27T20:32:16.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.287+0000 7fdf2d9ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf281edb50 con 0x7fdf2814aab0 2023-07-27T20:32:16.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.288+0000 7fdf267fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf280c7740 0x7fdf2814ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:16.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.288+0000 7fdf267fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf280c7740 0x7fdf2814ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44164/0 (socket says 172.21.15.72:44164) 2023-07-27T20:32:16.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.288+0000 7fdf267fc700 1 -- 172.21.15.72:0/619622399 learned_addr learned my addr 172.21.15.72:0/619622399 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:16.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.288+0000 7fdf26ffd700 1 --2- 172.21.15.72:0/619622399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf2806c1d0 0x7fdf28148f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:16.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.288+0000 7fdf277fe700 1 --2- 172.21.15.72:0/619622399 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf2814aab0 0x7fdf281ed010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:16.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.288+0000 7fdf267fc700 1 -- 172.21.15.72:0/619622399 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf2814aab0 msgr2=0x7fdf281ed010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:16.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.288+0000 7fdf267fc700 1 --2- 172.21.15.72:0/619622399 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf2814aab0 0x7fdf281ed010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:16.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.288+0000 7fdf267fc700 1 -- 172.21.15.72:0/619622399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf2806c1d0 msgr2=0x7fdf28148f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:16.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.288+0000 7fdf267fc700 1 --2- 172.21.15.72:0/619622399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf2806c1d0 0x7fdf28148f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:16.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.288+0000 7fdf267fc700 1 -- 172.21.15.72:0/619622399 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf20009a70 con 0x7fdf280c7740 2023-07-27T20:32:16.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.288+0000 7fdf267fc700 1 --2- 172.21.15.72:0/619622399 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf280c7740 0x7fdf2814ff20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c00c500 tx=0x7fdf1c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:16.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.288+0000 7fdf0ffff700 1 -- 172.21.15.72:0/619622399 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c005d70 con 0x7fdf280c7740 2023-07-27T20:32:16.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.288+0000 7fdf0ffff700 1 -- 172.21.15.72:0/619622399 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1c0070d0 con 0x7fdf280c7740 2023-07-27T20:32:16.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.288+0000 7fdf0ffff700 1 -- 172.21.15.72:0/619622399 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c007440 con 0x7fdf280c7740 2023-07-27T20:32:16.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.289+0000 7fdf2d9ff700 1 -- 172.21.15.72:0/619622399 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf180094a0 con 0x7fdf280c7740 2023-07-27T20:32:16.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.289+0000 7fdf2d9ff700 1 -- 172.21.15.72:0/619622399 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf2814c8f0 con 0x7fdf280c7740 2023-07-27T20:32:16.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.290+0000 7fdf2d9ff700 1 -- 172.21.15.72:0/619622399 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf2804e470 con 0x7fdf280c7740 2023-07-27T20:32:16.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.291+0000 7fdf0ffff700 1 -- 172.21.15.72:0/619622399 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdf1c0075a0 con 0x7fdf280c7740 2023-07-27T20:32:16.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.292+0000 7fdf0ffff700 1 --2- 172.21.15.72:0/619622399 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fdf1406ace0 0x7fdf1406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:16.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.292+0000 7fdf0ffff700 1 -- 172.21.15.72:0/619622399 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdf1c088ad0 con 0x7fdf280c7740 2023-07-27T20:32:16.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.292+0000 7fdf26ffd700 1 --2- 172.21.15.72:0/619622399 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fdf1406ace0 0x7fdf1406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:16.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.293+0000 7fdf26ffd700 1 --2- 172.21.15.72:0/619622399 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fdf1406ace0 0x7fdf1406d1a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdf18000c00 tx=0x7fdf18008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:16.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.297+0000 7fdf0ffff700 1 -- 172.21.15.72:0/619622399 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdf1c0538f0 con 0x7fdf280c7740 2023-07-27T20:32:16.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.490+0000 7fdf2d9ff700 1 -- 172.21.15.72:0/619622399 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdf2806cf00 con 0x7fdf280c7740 2023-07-27T20:32:16.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.491+0000 7fdf0ffff700 1 -- 172.21.15.72:0/619622399 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdf1c056f10 con 0x7fdf280c7740 2023-07-27T20:32:16.479 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-27T20:32:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.493+0000 7fdf2d9ff700 1 -- 172.21.15.72:0/619622399 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fdf1406ace0 msgr2=0x7fdf1406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.493+0000 7fdf2d9ff700 1 --2- 172.21.15.72:0/619622399 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fdf1406ace0 0x7fdf1406d1a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdf18000c00 tx=0x7fdf18008030 comp rx=0 tx=0).stop 2023-07-27T20:32:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.493+0000 7fdf2d9ff700 1 -- 172.21.15.72:0/619622399 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf280c7740 msgr2=0x7fdf2814ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.493+0000 7fdf2d9ff700 1 --2- 172.21.15.72:0/619622399 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf280c7740 0x7fdf2814ff20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c00c500 tx=0x7fdf1c00c810 comp rx=0 tx=0).stop 2023-07-27T20:32:16.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.493+0000 7fdf2d9ff700 1 -- 172.21.15.72:0/619622399 shutdown_connections 2023-07-27T20:32:16.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.493+0000 7fdf2d9ff700 1 --2- 172.21.15.72:0/619622399 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fdf1406ace0 0x7fdf1406d1a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:16.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.493+0000 7fdf2d9ff700 1 --2- 172.21.15.72:0/619622399 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf2814aab0 0x7fdf281ed010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:16.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.493+0000 7fdf2d9ff700 1 --2- 172.21.15.72:0/619622399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf2806c1d0 0x7fdf28148f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:16.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.493+0000 7fdf2d9ff700 1 --2- 172.21.15.72:0/619622399 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf280c7740 0x7fdf2814ff20 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:16.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.493+0000 7fdf2d9ff700 1 -- 172.21.15.72:0/619622399 >> 172.21.15.72:0/619622399 conn(0x7fdf280ab3f0 msgr2=0x7fdf28152320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:16.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.493+0000 7fdf2d9ff700 1 -- 172.21.15.72:0/619622399 shutdown_connections 2023-07-27T20:32:16.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.494+0000 7fdf2d9ff700 1 -- 172.21.15.72:0/619622399 wait complete. 2023-07-27T20:32:16.500 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-27T20:32:16.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.711+0000 7f835a3ff700 1 Processor -- start 2023-07-27T20:32:16.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.711+0000 7f835a3ff700 1 -- start start 2023-07-27T20:32:16.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.712+0000 7f835a3ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f835406ffc0 0x7f83540c6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:16.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.712+0000 7f835a3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f835406d1c0 con 0x7f83540c77c0 2023-07-27T20:32:16.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.712+0000 7f835a3ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8354155070 con 0x7f83540c6c50 2023-07-27T20:32:16.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.712+0000 7f835a3ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f835406ce90 con 0x7f835406ffc0 2023-07-27T20:32:16.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.713+0000 7f8353fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f83540c77c0 0x7f8354151210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39690/0 (socket says 172.21.15.72:39690) 2023-07-27T20:32:16.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.713+0000 7f8353fff700 1 -- 172.21.15.72:0/1618129780 learned_addr learned my addr 172.21.15.72:0/1618129780 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:16.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.713+0000 7f83537fe700 1 --2- 172.21.15.72:0/1618129780 >> v2:172.21.15.173:3300/0 conn(0x7f835406ffc0 0x7f83540c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:16.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.713+0000 7f8352ffd700 1 -- 172.21.15.72:0/1618129780 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 66470584 0 0) 0x7f835406d1c0 con 0x7f83540c77c0 2023-07-27T20:32:16.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.713+0000 7f8352ffd700 1 -- 172.21.15.72:0/1618129780 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f833c0035b0 con 0x7f83540c77c0 2023-07-27T20:32:16.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.713+0000 7f8352ffd700 1 -- 172.21.15.72:0/1618129780 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1780705781 0 0) 0x7f833c0035b0 con 0x7f83540c77c0 2023-07-27T20:32:16.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.713+0000 7f8352ffd700 1 -- 172.21.15.72:0/1618129780 >> v2:172.21.15.173:3300/0 conn(0x7f835406ffc0 msgr2=0x7f83540c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:16.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.713+0000 7f8352ffd700 1 --2- 172.21.15.72:0/1618129780 >> v2:172.21.15.173:3300/0 conn(0x7f835406ffc0 0x7f83540c6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:16.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.713+0000 7f8352ffd700 1 -- 172.21.15.72:0/1618129780 >> v1:172.21.15.173:6789/0 conn(0x7f83540c6c50 legacy=0x7f83540c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:16.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.713+0000 7f8352ffd700 1 -- 172.21.15.72:0/1618129780 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8354154d90 con 0x7f83540c77c0 2023-07-27T20:32:16.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.713+0000 7f8352ffd700 1 -- 172.21.15.72:0/1618129780 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f8344001670 con 0x7f83540c77c0 2023-07-27T20:32:16.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.713+0000 7f8352ffd700 1 -- 172.21.15.72:0/1618129780 >> v1:172.21.15.72:6789/0 conn(0x7f83540c77c0 legacy=0x7f8354151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:16.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.714+0000 7f8352ffd700 1 --2- 172.21.15.72:0/1618129780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f833c003a00 0x7f833c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:16.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.714+0000 7f8352ffd700 1 --2- 172.21.15.72:0/1618129780 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f833c004850 0x7f833c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:16.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.714+0000 7f8352ffd700 1 --2- 172.21.15.72:0/1618129780 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f833c005330 0x7f833c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:16.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.714+0000 7f8352ffd700 1 -- 172.21.15.72:0/1618129780 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835406ce90 con 0x7f833c004850 2023-07-27T20:32:16.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.714+0000 7f8352ffd700 1 -- 172.21.15.72:0/1618129780 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833c00c200 con 0x7f833c003a00 2023-07-27T20:32:16.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.714+0000 7f8352ffd700 1 -- 172.21.15.72:0/1618129780 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f833c00c3c0 con 0x7f833c005330 2023-07-27T20:32:16.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.714+0000 7f83537fe700 1 --2- 172.21.15.72:0/1618129780 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f833c004850 0x7f833c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:16.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.714+0000 7f8353fff700 1 --2- 172.21.15.72:0/1618129780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f833c003a00 0x7f833c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:16.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.714+0000 7f835899c700 1 --2- 172.21.15.72:0/1618129780 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f833c005330 0x7f833c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:16.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.714+0000 7f83537fe700 1 -- 172.21.15.72:0/1618129780 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f833c005330 msgr2=0x7f833c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:16.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.714+0000 7f83537fe700 1 --2- 172.21.15.72:0/1618129780 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f833c005330 0x7f833c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:16.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.714+0000 7f83537fe700 1 -- 172.21.15.72:0/1618129780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f833c003a00 msgr2=0x7f833c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:16.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.714+0000 7f83537fe700 1 --2- 172.21.15.72:0/1618129780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f833c003a00 0x7f833c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:16.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.714+0000 7f83537fe700 1 -- 172.21.15.72:0/1618129780 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f833c0035b0 con 0x7f833c004850 2023-07-27T20:32:16.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.714+0000 7f835899c700 1 --2- 172.21.15.72:0/1618129780 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f833c005330 0x7f833c00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:16.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.714+0000 7f8353fff700 1 --2- 172.21.15.72:0/1618129780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f833c003a00 0x7f833c003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:16.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.714+0000 7f835899c700 1 -- 172.21.15.72:0/1618129780 reap_dead start 2023-07-27T20:32:16.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.714+0000 7f83537fe700 1 --2- 172.21.15.72:0/1618129780 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f833c004850 0x7f833c004cd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8354070400 tx=0x7f833c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e449ac4db09f9d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:16.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.715+0000 7f8352ffd700 1 -- 172.21.15.72:0/1618129780 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834800e6c0 con 0x7f833c004850 2023-07-27T20:32:16.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.715+0000 7f8352ffd700 1 -- 172.21.15.72:0/1618129780 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834800e820 con 0x7f833c004850 2023-07-27T20:32:16.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.715+0000 7f8352ffd700 1 -- 172.21.15.72:0/1618129780 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834800ebb0 con 0x7f833c004850 2023-07-27T20:32:16.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.715+0000 7f835a3ff700 1 -- 172.21.15.72:0/1618129780 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f833c004850 msgr2=0x7f833c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:16.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.715+0000 7f835a3ff700 1 --2- 172.21.15.72:0/1618129780 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f833c004850 0x7f833c004cd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8354070400 tx=0x7f833c005880 comp rx=0 tx=0).stop 2023-07-27T20:32:16.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.715+0000 7f835a3ff700 1 -- 172.21.15.72:0/1618129780 shutdown_connections 2023-07-27T20:32:16.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.715+0000 7f835a3ff700 1 --2- 172.21.15.72:0/1618129780 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f833c004850 0x7f833c004cd0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:16.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.715+0000 7f835a3ff700 1 -- 172.21.15.72:0/1618129780 >> 172.21.15.72:0/1618129780 conn(0x7f835406a190 msgr2=0x7f835406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:16.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.715+0000 7f835a3ff700 1 -- 172.21.15.72:0/1618129780 shutdown_connections 2023-07-27T20:32:16.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.715+0000 7f835a3ff700 1 -- 172.21.15.72:0/1618129780 wait complete. 2023-07-27T20:32:16.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.717+0000 7f835a3ff700 1 Processor -- start 2023-07-27T20:32:16.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.717+0000 7f835a3ff700 1 -- start start 2023-07-27T20:32:16.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.718+0000 7f835a3ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f833c004850 0x7f835414d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:16.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.718+0000 7f835a3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83540a88f0 0x7f83541ecf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:16.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.718+0000 7f835a3ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f83541ed8d0 0x7f83541eac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:16.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.718+0000 7f835a3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83540aa730 con 0x7f83540a88f0 2023-07-27T20:32:16.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.718+0000 7f835a3ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83540a75e0 con 0x7f833c004850 2023-07-27T20:32:16.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.718+0000 7f835a3ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f835414da30 con 0x7f83541ed8d0 2023-07-27T20:32:16.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.719+0000 7f83537fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83540a88f0 0x7f83541ecf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:16.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.719+0000 7f83537fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83540a88f0 0x7f83541ecf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44178/0 (socket says 172.21.15.72:44178) 2023-07-27T20:32:16.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.719+0000 7f83537fe700 1 -- 172.21.15.72:0/411895359 learned_addr learned my addr 172.21.15.72:0/411895359 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:16.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.719+0000 7f8353fff700 1 --2- 172.21.15.72:0/411895359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f833c004850 0x7f835414d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:16.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.719+0000 7f835899c700 1 --2- 172.21.15.72:0/411895359 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f83541ed8d0 0x7f83541eac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:16.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.719+0000 7f83537fe700 1 -- 172.21.15.72:0/411895359 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f83541ed8d0 msgr2=0x7f83541eac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:16.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.719+0000 7f83537fe700 1 --2- 172.21.15.72:0/411895359 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f83541ed8d0 0x7f83541eac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:16.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.719+0000 7f83537fe700 1 -- 172.21.15.72:0/411895359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f833c004850 msgr2=0x7f835414d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:16.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.719+0000 7f83537fe700 1 --2- 172.21.15.72:0/411895359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f833c004850 0x7f835414d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:16.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.719+0000 7f83537fe700 1 -- 172.21.15.72:0/411895359 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83540aa940 con 0x7f83540a88f0 2023-07-27T20:32:16.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.719+0000 7f83537fe700 1 --2- 172.21.15.72:0/411895359 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83540a88f0 0x7f83541ecf80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f834800e4b0 tx=0x7f83480047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:16.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.720+0000 7f8350ff9700 1 -- 172.21.15.72:0/411895359 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834800e6c0 con 0x7f83540a88f0 2023-07-27T20:32:16.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.720+0000 7f8350ff9700 1 -- 172.21.15.72:0/411895359 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8348003ad0 con 0x7f83540a88f0 2023-07-27T20:32:16.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.720+0000 7f835a3ff700 1 -- 172.21.15.72:0/411895359 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83541ed4c0 con 0x7f83540a88f0 2023-07-27T20:32:16.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.720+0000 7f8350ff9700 1 -- 172.21.15.72:0/411895359 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8348006e60 con 0x7f83540a88f0 2023-07-27T20:32:16.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.720+0000 7f835a3ff700 1 -- 172.21.15.72:0/411895359 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83541eb150 con 0x7f83540a88f0 2023-07-27T20:32:16.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.721+0000 7f835a3ff700 1 -- 172.21.15.72:0/411895359 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f835404e470 con 0x7f83540a88f0 2023-07-27T20:32:16.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.722+0000 7f8350ff9700 1 -- 172.21.15.72:0/411895359 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8348013470 con 0x7f83540a88f0 2023-07-27T20:32:16.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.722+0000 7f8350ff9700 1 --2- 172.21.15.72:0/411895359 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f834006ace0 0x7f834006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:16.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.723+0000 7f8350ff9700 1 -- 172.21.15.72:0/411895359 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f834808b060 con 0x7f83540a88f0 2023-07-27T20:32:16.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.723+0000 7f8353fff700 1 --2- 172.21.15.72:0/411895359 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f834006ace0 0x7f834006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:16.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.724+0000 7f8353fff700 1 --2- 172.21.15.72:0/411895359 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f834006ace0 0x7f834006d1a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8344001030 tx=0x7f8344009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:16.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.727+0000 7f8350ff9700 1 -- 172.21.15.72:0/411895359 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f83480bd310 con 0x7f83540a88f0 2023-07-27T20:32:16.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.924+0000 7f835a3ff700 1 -- 172.21.15.72:0/411895359 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f835406fda0 con 0x7f83540a88f0 2023-07-27T20:32:16.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.924+0000 7f8350ff9700 1 -- 172.21.15.72:0/411895359 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8348055dd0 con 0x7f83540a88f0 2023-07-27T20:32:16.913 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:32:16.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.927+0000 7f835a3ff700 1 -- 172.21.15.72:0/411895359 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f834006ace0 msgr2=0x7f834006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:16.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.927+0000 7f835a3ff700 1 --2- 172.21.15.72:0/411895359 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f834006ace0 0x7f834006d1a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8344001030 tx=0x7f8344009040 comp rx=0 tx=0).stop 2023-07-27T20:32:16.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.927+0000 7f835a3ff700 1 -- 172.21.15.72:0/411895359 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83540a88f0 msgr2=0x7f83541ecf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:16.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.927+0000 7f835a3ff700 1 --2- 172.21.15.72:0/411895359 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83540a88f0 0x7f83541ecf80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f834800e4b0 tx=0x7f83480047c0 comp rx=0 tx=0).stop 2023-07-27T20:32:16.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.927+0000 7f835a3ff700 1 -- 172.21.15.72:0/411895359 shutdown_connections 2023-07-27T20:32:16.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.927+0000 7f835a3ff700 1 --2- 172.21.15.72:0/411895359 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f834006ace0 0x7f834006d1a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:16.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.927+0000 7f835a3ff700 1 --2- 172.21.15.72:0/411895359 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f83541ed8d0 0x7f83541eac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:16.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.927+0000 7f835a3ff700 1 --2- 172.21.15.72:0/411895359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f833c004850 0x7f835414d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:16.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.927+0000 7f835a3ff700 1 --2- 172.21.15.72:0/411895359 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83540a88f0 0x7f83541ecf80 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:16.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.927+0000 7f835a3ff700 1 -- 172.21.15.72:0/411895359 >> 172.21.15.72:0/411895359 conn(0x7f835406a190 msgr2=0x7f83540c3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:16.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.927+0000 7f835a3ff700 1 -- 172.21.15.72:0/411895359 shutdown_connections 2023-07-27T20:32:16.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:16.927+0000 7f835a3ff700 1 -- 172.21.15.72:0/411895359 wait complete. 2023-07-27T20:32:16.932 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:32:17.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.145+0000 7f61e099d700 1 Processor -- start 2023-07-27T20:32:17.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.145+0000 7f61e099d700 1 -- start start 2023-07-27T20:32:17.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.146+0000 7f61e099d700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f61dc151530 0x7f61dc0c4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:17.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.146+0000 7f61e099d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61dc0c54c0 0x7f61dc1549f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:17.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.146+0000 7f61e099d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61dc0c5920 con 0x7f61dc0c75a0 2023-07-27T20:32:17.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.146+0000 7f61e099d700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61dc154560 con 0x7f61dc151530 2023-07-27T20:32:17.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.146+0000 7f61e099d700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc151910 con 0x7f61dc0c54c0 2023-07-27T20:32:17.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.146+0000 7f61dbfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f61dc0c75a0 0x7f61dc06aff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39700/0 (socket says 172.21.15.72:39700) 2023-07-27T20:32:17.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.146+0000 7f61dbfff700 1 -- 172.21.15.72:0/1355447204 learned_addr learned my addr 172.21.15.72:0/1355447204 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:17.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.146+0000 7f61daffd700 1 --2- 172.21.15.72:0/1355447204 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61dc0c54c0 0x7f61dc1549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:17.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.146+0000 7f61db7fe700 1 --2- 172.21.15.72:0/1355447204 >> v2:172.21.15.173:3300/0 conn(0x7f61dc151530 0x7f61dc0c4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:17.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.147+0000 7f61da7fc700 1 -- 172.21.15.72:0/1355447204 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2535201140 0 0) 0x7f61dc0c5920 con 0x7f61dc0c75a0 2023-07-27T20:32:17.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.147+0000 7f61da7fc700 1 -- 172.21.15.72:0/1355447204 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61c40035b0 con 0x7f61dc0c75a0 2023-07-27T20:32:17.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.147+0000 7f61daffd700 1 -- 172.21.15.72:0/1355447204 >> v2:172.21.15.173:3300/0 conn(0x7f61dc151530 msgr2=0x7f61dc0c4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:17.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.147+0000 7f61daffd700 1 --2- 172.21.15.72:0/1355447204 >> v2:172.21.15.173:3300/0 conn(0x7f61dc151530 0x7f61dc0c4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:17.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.147+0000 7f61daffd700 1 -- 172.21.15.72:0/1355447204 >> v1:172.21.15.72:6789/0 conn(0x7f61dc0c75a0 legacy=0x7f61dc06aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:17.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.147+0000 7f61daffd700 1 -- 172.21.15.72:0/1355447204 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61dc06bcc0 con 0x7f61dc0c54c0 2023-07-27T20:32:17.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.147+0000 7f61db7fe700 1 --2- 172.21.15.72:0/1355447204 >> v2:172.21.15.173:3300/0 conn(0x7f61dc151530 0x7f61dc0c4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:32:17.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.147+0000 7f61daffd700 1 --2- 172.21.15.72:0/1355447204 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61dc0c54c0 0x7f61dc1549f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f61d0009840 tx=0x7f61d0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3252945ccdf852f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:17.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.147+0000 7f61da7fc700 1 -- 172.21.15.72:0/1355447204 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d0011830 con 0x7f61dc0c54c0 2023-07-27T20:32:17.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.148+0000 7f61da7fc700 1 -- 172.21.15.72:0/1355447204 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d0011990 con 0x7f61dc0c54c0 2023-07-27T20:32:17.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.148+0000 7f61da7fc700 1 -- 172.21.15.72:0/1355447204 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d0011d20 con 0x7f61dc0c54c0 2023-07-27T20:32:17.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.148+0000 7f61e099d700 1 -- 172.21.15.72:0/1355447204 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61dc0c54c0 msgr2=0x7f61dc1549f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:17.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.148+0000 7f61e099d700 1 --2- 172.21.15.72:0/1355447204 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61dc0c54c0 0x7f61dc1549f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f61d0009840 tx=0x7f61d0009b50 comp rx=0 tx=0).stop 2023-07-27T20:32:17.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.148+0000 7f61e099d700 1 -- 172.21.15.72:0/1355447204 shutdown_connections 2023-07-27T20:32:17.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.148+0000 7f61e099d700 1 --2- 172.21.15.72:0/1355447204 >> v2:172.21.15.173:3300/0 conn(0x7f61dc151530 0x7f61dc0c4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:17.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.148+0000 7f61e099d700 1 --2- 172.21.15.72:0/1355447204 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61dc0c54c0 0x7f61dc1549f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:17.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.148+0000 7f61e099d700 1 -- 172.21.15.72:0/1355447204 >> 172.21.15.72:0/1355447204 conn(0x7f61dc0c96a0 msgr2=0x7f61dc0c9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:17.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.148+0000 7f61e099d700 1 -- 172.21.15.72:0/1355447204 shutdown_connections 2023-07-27T20:32:17.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.148+0000 7f61e099d700 1 -- 172.21.15.72:0/1355447204 wait complete. 2023-07-27T20:32:17.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.150+0000 7f61e099d700 1 Processor -- start 2023-07-27T20:32:17.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.151+0000 7f61e099d700 1 -- start start 2023-07-27T20:32:17.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.152+0000 7f61e099d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61dc0c54c0 0x7f61dc0aa440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:17.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.152+0000 7f61e099d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61dc0c75a0 0x7f61dc0bf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:17.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.152+0000 7f61e099d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61dc151530 0x7f61dc0bfc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:17.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.152+0000 7f61e099d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc14a080 con 0x7f61dc0c54c0 2023-07-27T20:32:17.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.152+0000 7f61e099d700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc1ed3b0 con 0x7f61dc151530 2023-07-27T20:32:17.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.152+0000 7f61e099d700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc1ed8a0 con 0x7f61dc0c75a0 2023-07-27T20:32:17.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.152+0000 7f61db7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61dc0c54c0 0x7f61dc0aa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:17.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.152+0000 7f61db7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61dc0c54c0 0x7f61dc0aa440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44182/0 (socket says 172.21.15.72:44182) 2023-07-27T20:32:17.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.152+0000 7f61db7fe700 1 -- 172.21.15.72:0/293186373 learned_addr learned my addr 172.21.15.72:0/293186373 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:17.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.153+0000 7f61dbfff700 1 --2- 172.21.15.72:0/293186373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61dc151530 0x7f61dc0bfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:17.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.153+0000 7f61daffd700 1 --2- 172.21.15.72:0/293186373 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61dc0c75a0 0x7f61dc0bf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:17.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.153+0000 7f61db7fe700 1 -- 172.21.15.72:0/293186373 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61dc0c75a0 msgr2=0x7f61dc0bf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:17.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.153+0000 7f61db7fe700 1 --2- 172.21.15.72:0/293186373 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61dc0c75a0 0x7f61dc0bf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:17.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.153+0000 7f61db7fe700 1 -- 172.21.15.72:0/293186373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61dc151530 msgr2=0x7f61dc0bfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:17.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.153+0000 7f61db7fe700 1 --2- 172.21.15.72:0/293186373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61dc151530 0x7f61dc0bfc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:17.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.153+0000 7f61db7fe700 1 -- 172.21.15.72:0/293186373 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61cc0094a0 con 0x7f61dc0c54c0 2023-07-27T20:32:17.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.153+0000 7f61daffd700 1 --2- 172.21.15.72:0/293186373 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61dc0c75a0 0x7f61dc0bf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:32:17.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.153+0000 7f61dbfff700 1 --2- 172.21.15.72:0/293186373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61dc151530 0x7f61dc0bfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:32:17.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.153+0000 7f61db7fe700 1 --2- 172.21.15.72:0/293186373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61dc0c54c0 0x7f61dc0aa440 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f61cc00ebe0 tx=0x7f61cc009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:17.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.153+0000 7f61c3fff700 1 -- 172.21.15.72:0/293186373 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61cc00c8b0 con 0x7f61dc0c54c0 2023-07-27T20:32:17.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.153+0000 7f61c3fff700 1 -- 172.21.15.72:0/293186373 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61cc00ca10 con 0x7f61dc0c54c0 2023-07-27T20:32:17.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.153+0000 7f61c3fff700 1 -- 172.21.15.72:0/293186373 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61cc00cda0 con 0x7f61dc0c54c0 2023-07-27T20:32:17.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.153+0000 7f61e099d700 1 -- 172.21.15.72:0/293186373 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d00094a0 con 0x7f61dc0c54c0 2023-07-27T20:32:17.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.153+0000 7f61e099d700 1 -- 172.21.15.72:0/293186373 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61dc1ed5c0 con 0x7f61dc0c54c0 2023-07-27T20:32:17.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.154+0000 7f61e099d700 1 -- 172.21.15.72:0/293186373 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61dc04ecc0 con 0x7f61dc0c54c0 2023-07-27T20:32:17.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.155+0000 7f61c3fff700 1 -- 172.21.15.72:0/293186373 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f61cc013470 con 0x7f61dc0c54c0 2023-07-27T20:32:17.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.156+0000 7f61c3fff700 1 --2- 172.21.15.72:0/293186373 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f61c806ace0 0x7f61c806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:17.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.156+0000 7f61c3fff700 1 -- 172.21.15.72:0/293186373 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f61cc089870 con 0x7f61dc0c54c0 2023-07-27T20:32:17.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.156+0000 7f61daffd700 1 --2- 172.21.15.72:0/293186373 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f61c806ace0 0x7f61c806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:17.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.157+0000 7f61daffd700 1 --2- 172.21.15.72:0/293186373 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f61c806ace0 0x7f61c806d1a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f61dc0c39c0 tx=0x7f61d0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:17.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.160+0000 7f61c3fff700 1 -- 172.21.15.72:0/293186373 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f61cc054680 con 0x7f61dc0c54c0 2023-07-27T20:32:17.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.357+0000 7f61e099d700 1 -- 172.21.15.72:0/293186373 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61dc0c5e00 con 0x7f61dc0c54c0 2023-07-27T20:32:17.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.358+0000 7f61c3fff700 1 -- 172.21.15.72:0/293186373 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20215 (secure 0 0 0) 0x7f61cc057ca0 con 0x7f61dc0c54c0 2023-07-27T20:32:17.346 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:32:17.346 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":29,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:32:10.402254+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:31:27.020951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T20:31:27.566022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-27T20:31:31.182401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:32:17.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.361+0000 7f61e099d700 1 -- 172.21.15.72:0/293186373 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f61c806ace0 msgr2=0x7f61c806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:17.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.361+0000 7f61e099d700 1 --2- 172.21.15.72:0/293186373 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f61c806ace0 0x7f61c806d1a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f61dc0c39c0 tx=0x7f61d0008030 comp rx=0 tx=0).stop 2023-07-27T20:32:17.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.361+0000 7f61e099d700 1 -- 172.21.15.72:0/293186373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61dc0c54c0 msgr2=0x7f61dc0aa440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:17.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.361+0000 7f61e099d700 1 --2- 172.21.15.72:0/293186373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61dc0c54c0 0x7f61dc0aa440 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f61cc00ebe0 tx=0x7f61cc009e20 comp rx=0 tx=0).stop 2023-07-27T20:32:17.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.361+0000 7f61e099d700 1 -- 172.21.15.72:0/293186373 shutdown_connections 2023-07-27T20:32:17.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.361+0000 7f61e099d700 1 --2- 172.21.15.72:0/293186373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61dc151530 0x7f61dc0bfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:17.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.361+0000 7f61e099d700 1 --2- 172.21.15.72:0/293186373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61dc0c54c0 0x7f61dc0aa440 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:17.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.361+0000 7f61e099d700 1 --2- 172.21.15.72:0/293186373 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f61c806ace0 0x7f61c806d1a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:17.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.361+0000 7f61e099d700 1 --2- 172.21.15.72:0/293186373 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61dc0c75a0 0x7f61dc0bf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:17.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.361+0000 7f61e099d700 1 -- 172.21.15.72:0/293186373 >> 172.21.15.72:0/293186373 conn(0x7f61dc0c96a0 msgr2=0x7f61dc151d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:17.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.361+0000 7f61e099d700 1 -- 172.21.15.72:0/293186373 shutdown_connections 2023-07-27T20:32:17.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.361+0000 7f61e099d700 1 -- 172.21.15.72:0/293186373 wait complete. 2023-07-27T20:32:17.366 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-27T20:31:14.581785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T20:31:21.077941+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T20:31:27.020951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T20:31:27.566022+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-27T20:31:31.182401+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-27T20:32:17.367 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-27T20:32:17.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.577+0000 7fdf663ff700 1 Processor -- start 2023-07-27T20:32:17.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.577+0000 7fdf663ff700 1 -- start start 2023-07-27T20:32:17.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.578+0000 7fdf663ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf6014aab0 0x7fdf60154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:17.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.578+0000 7fdf663ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fdf6006c1d0 0x7fdf6006c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:17.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.578+0000 7fdf663ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf600c7c50 con 0x7fdf600c7740 2023-07-27T20:32:17.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.578+0000 7fdf663ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf6006bd40 con 0x7fdf6006c1d0 2023-07-27T20:32:17.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.578+0000 7fdf663ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf600c62f0 con 0x7fdf6014aab0 2023-07-27T20:32:17.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.579+0000 7fdf5ffff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf6014aab0 0x7fdf60154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:17.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.579+0000 7fdf5ffff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf6014aab0 0x7fdf60154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.72:43988/0 (socket says 172.21.15.72:43988) 2023-07-27T20:32:17.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.579+0000 7fdf5ffff700 1 -- 172.21.15.72:0/681576658 learned_addr learned my addr 172.21.15.72:0/681576658 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:17.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.579+0000 7fdf6499c700 1 --2- 172.21.15.72:0/681576658 >> v2:172.21.15.173:3300/0 conn(0x7fdf6006c1d0 0x7fdf6006c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:17.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.579+0000 7fdf5f7fe700 1 --1- 172.21.15.72:0/681576658 >> v1:172.21.15.173:6789/0 conn(0x7fdf600c7740 0x7fdf600c41c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.72:46476/0 (socket says 172.21.15.72:46476) 2023-07-27T20:32:17.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.579+0000 7fdf5effd700 1 -- 172.21.15.72:0/681576658 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2836957715 0 0) 0x7fdf600c7c50 con 0x7fdf600c7740 2023-07-27T20:32:17.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.579+0000 7fdf5ffff700 1 -- 172.21.15.72:0/681576658 >> v2:172.21.15.173:3300/0 conn(0x7fdf6006c1d0 msgr2=0x7fdf6006c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:17.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.579+0000 7fdf5ffff700 1 --2- 172.21.15.72:0/681576658 >> v2:172.21.15.173:3300/0 conn(0x7fdf6006c1d0 0x7fdf6006c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:17.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.579+0000 7fdf5ffff700 1 -- 172.21.15.72:0/681576658 >> v1:172.21.15.173:6789/0 conn(0x7fdf600c7740 legacy=0x7fdf600c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:17.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.579+0000 7fdf5ffff700 1 -- 172.21.15.72:0/681576658 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf60155050 con 0x7fdf6014aab0 2023-07-27T20:32:17.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.580+0000 7fdf5ffff700 1 --2- 172.21.15.72:0/681576658 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf6014aab0 0x7fdf60154b10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdf500098f0 tx=0x7fdf50009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bb175e990a4591e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:17.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.580+0000 7fdf5effd700 1 -- 172.21.15.72:0/681576658 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf50011830 con 0x7fdf6014aab0 2023-07-27T20:32:17.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.580+0000 7fdf5effd700 1 -- 172.21.15.72:0/681576658 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf50011990 con 0x7fdf6014aab0 2023-07-27T20:32:17.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.580+0000 7fdf5effd700 1 -- 172.21.15.72:0/681576658 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf50011d20 con 0x7fdf6014aab0 2023-07-27T20:32:17.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.580+0000 7fdf663ff700 1 -- 172.21.15.72:0/681576658 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf6014aab0 msgr2=0x7fdf60154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:17.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.580+0000 7fdf663ff700 1 --2- 172.21.15.72:0/681576658 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf6014aab0 0x7fdf60154b10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdf500098f0 tx=0x7fdf50009c00 comp rx=0 tx=0).stop 2023-07-27T20:32:17.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.580+0000 7fdf663ff700 1 -- 172.21.15.72:0/681576658 shutdown_connections 2023-07-27T20:32:17.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.580+0000 7fdf663ff700 1 --2- 172.21.15.72:0/681576658 >> v2:172.21.15.173:3300/0 conn(0x7fdf6006c1d0 0x7fdf6006c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:17.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.580+0000 7fdf663ff700 1 --2- 172.21.15.72:0/681576658 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf6014aab0 0x7fdf60154b10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:17.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.580+0000 7fdf663ff700 1 -- 172.21.15.72:0/681576658 >> 172.21.15.72:0/681576658 conn(0x7fdf600ab3f0 msgr2=0x7fdf600ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:17.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.581+0000 7fdf663ff700 1 -- 172.21.15.72:0/681576658 shutdown_connections 2023-07-27T20:32:17.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.581+0000 7fdf663ff700 1 -- 172.21.15.72:0/681576658 wait complete. 2023-07-27T20:32:17.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.582+0000 7fdf663ff700 1 Processor -- start 2023-07-27T20:32:17.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.582+0000 7fdf663ff700 1 -- start start 2023-07-27T20:32:17.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.583+0000 7fdf663ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf6006c1d0 0x7fdf600c0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:17.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.583+0000 7fdf663ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf600c7740 0x7fdf601e9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:17.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.583+0000 7fdf663ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf6014aab0 0x7fdf600c2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:17.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.583+0000 7fdf663ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf600c1ef0 con 0x7fdf6014aab0 2023-07-27T20:32:17.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.583+0000 7fdf663ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf601e9270 con 0x7fdf600c7740 2023-07-27T20:32:17.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.583+0000 7fdf663ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf601ea1c0 con 0x7fdf6006c1d0 2023-07-27T20:32:17.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.583+0000 7fdf6499c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf6014aab0 0x7fdf600c2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:17.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.584+0000 7fdf6499c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf6014aab0 0x7fdf600c2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44198/0 (socket says 172.21.15.72:44198) 2023-07-27T20:32:17.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.584+0000 7fdf6499c700 1 -- 172.21.15.72:0/2151538117 learned_addr learned my addr 172.21.15.72:0/2151538117 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:17.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.584+0000 7fdf5ffff700 1 --2- 172.21.15.72:0/2151538117 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf6006c1d0 0x7fdf600c0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:17.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.584+0000 7fdf5f7fe700 1 --2- 172.21.15.72:0/2151538117 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf600c7740 0x7fdf601e9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:17.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.584+0000 7fdf6499c700 1 -- 172.21.15.72:0/2151538117 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf6006c1d0 msgr2=0x7fdf600c0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:17.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.584+0000 7fdf6499c700 1 --2- 172.21.15.72:0/2151538117 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf6006c1d0 0x7fdf600c0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:17.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.584+0000 7fdf6499c700 1 -- 172.21.15.72:0/2151538117 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf600c7740 msgr2=0x7fdf601e9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:17.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.584+0000 7fdf6499c700 1 --2- 172.21.15.72:0/2151538117 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf600c7740 0x7fdf601e9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:17.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.584+0000 7fdf6499c700 1 -- 172.21.15.72:0/2151538117 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf50009550 con 0x7fdf6014aab0 2023-07-27T20:32:17.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.584+0000 7fdf6499c700 1 --2- 172.21.15.72:0/2151538117 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf6014aab0 0x7fdf600c2ff0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fdf5800efc0 tx=0x7fdf5800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:17.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.584+0000 7fdf5cff9700 1 -- 172.21.15.72:0/2151538117 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf58009ea0 con 0x7fdf6014aab0 2023-07-27T20:32:17.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.584+0000 7fdf5cff9700 1 -- 172.21.15.72:0/2151538117 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf5800f040 con 0x7fdf6014aab0 2023-07-27T20:32:17.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.584+0000 7fdf5cff9700 1 -- 172.21.15.72:0/2151538117 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5800ced0 con 0x7fdf6014aab0 2023-07-27T20:32:17.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.584+0000 7fdf663ff700 1 -- 172.21.15.72:0/2151538117 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf600c1240 con 0x7fdf6014aab0 2023-07-27T20:32:17.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.585+0000 7fdf663ff700 1 -- 172.21.15.72:0/2151538117 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf601e9480 con 0x7fdf6014aab0 2023-07-27T20:32:17.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.585+0000 7fdf663ff700 1 -- 172.21.15.72:0/2151538117 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf600c1760 con 0x7fdf6014aab0 2023-07-27T20:32:17.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.586+0000 7fdf5cff9700 1 -- 172.21.15.72:0/2151538117 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdf58014480 con 0x7fdf6014aab0 2023-07-27T20:32:17.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.587+0000 7fdf5cff9700 1 --2- 172.21.15.72:0/2151538117 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fdf4c06ace0 0x7fdf4c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:17.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.587+0000 7fdf5cff9700 1 -- 172.21.15.72:0/2151538117 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdf58089fe0 con 0x7fdf6014aab0 2023-07-27T20:32:17.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.588+0000 7fdf5ffff700 1 --2- 172.21.15.72:0/2151538117 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fdf4c06ace0 0x7fdf4c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:17.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.588+0000 7fdf5ffff700 1 --2- 172.21.15.72:0/2151538117 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fdf4c06ace0 0x7fdf4c06d1a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdf50014040 tx=0x7fdf50008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:17.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.591+0000 7fdf5cff9700 1 -- 172.21.15.72:0/2151538117 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdf600c1760 con 0x7fdf6014aab0 2023-07-27T20:32:17.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.788+0000 7fdf663ff700 1 -- 172.21.15.72:0/2151538117 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdf600c1760 con 0x7fdf6014aab0 2023-07-27T20:32:17.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.788+0000 7fdf5cff9700 1 -- 172.21.15.72:0/2151538117 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdf600c1760 con 0x7fdf6014aab0 2023-07-27T20:32:17.776 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-27T20:32:17.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.791+0000 7fdf663ff700 1 -- 172.21.15.72:0/2151538117 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fdf4c06ace0 msgr2=0x7fdf4c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:17.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.791+0000 7fdf663ff700 1 --2- 172.21.15.72:0/2151538117 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fdf4c06ace0 0x7fdf4c06d1a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdf50014040 tx=0x7fdf50008030 comp rx=0 tx=0).stop 2023-07-27T20:32:17.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.791+0000 7fdf663ff700 1 -- 172.21.15.72:0/2151538117 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf6014aab0 msgr2=0x7fdf600c2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:17.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.791+0000 7fdf663ff700 1 --2- 172.21.15.72:0/2151538117 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf6014aab0 0x7fdf600c2ff0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fdf5800efc0 tx=0x7fdf5800c3a0 comp rx=0 tx=0).stop 2023-07-27T20:32:17.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.791+0000 7fdf663ff700 1 -- 172.21.15.72:0/2151538117 shutdown_connections 2023-07-27T20:32:17.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.791+0000 7fdf663ff700 1 --2- 172.21.15.72:0/2151538117 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf6014aab0 0x7fdf600c2ff0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:17.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.791+0000 7fdf663ff700 1 --2- 172.21.15.72:0/2151538117 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fdf4c06ace0 0x7fdf4c06d1a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:17.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.791+0000 7fdf663ff700 1 --2- 172.21.15.72:0/2151538117 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf6006c1d0 0x7fdf600c0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:17.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.791+0000 7fdf663ff700 1 --2- 172.21.15.72:0/2151538117 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf600c7740 0x7fdf601e9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:17.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.791+0000 7fdf663ff700 1 -- 172.21.15.72:0/2151538117 >> 172.21.15.72:0/2151538117 conn(0x7fdf600ab3f0 msgr2=0x7fdf60149700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:17.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.791+0000 7fdf663ff700 1 -- 172.21.15.72:0/2151538117 shutdown_connections 2023-07-27T20:32:17.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:17.791+0000 7fdf663ff700 1 -- 172.21.15.72:0/2151538117 wait complete. 2023-07-27T20:32:17.796 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T20:32:17.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.007+0000 7f3bfdfff700 1 Processor -- start 2023-07-27T20:32:17.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.008+0000 7f3bfdfff700 1 -- start start 2023-07-27T20:32:17.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.009+0000 7f3bfdfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3bf806c1d0 0x7f3bf806c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:17.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.009+0000 7f3bfdfff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf80c7c50 con 0x7f3bf814aab0 2023-07-27T20:32:17.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.009+0000 7f3bfdfff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf806bd40 con 0x7f3bf80c7740 2023-07-27T20:32:17.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.009+0000 7f3bfdfff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf80c62f0 con 0x7f3bf806c1d0 2023-07-27T20:32:17.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.009+0000 7f3bf77fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3bf814aab0 0x7f3bf8154b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39718/0 (socket says 172.21.15.72:39718) 2023-07-27T20:32:17.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.009+0000 7f3bf77fe700 1 -- 172.21.15.72:0/608278739 learned_addr learned my addr 172.21.15.72:0/608278739 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:17.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.009+0000 7f3bf7fff700 1 --2- 172.21.15.72:0/608278739 >> v2:172.21.15.72:3300/0 conn(0x7f3bf806c1d0 0x7f3bf806c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:17.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.009+0000 7f3bf6ffd700 1 -- 172.21.15.72:0/608278739 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2181421276 0 0) 0x7f3bf80c7c50 con 0x7f3bf814aab0 2023-07-27T20:32:17.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.009+0000 7f3bf7fff700 1 -- 172.21.15.72:0/608278739 >> v1:172.21.15.173:6789/0 conn(0x7f3bf80c7740 legacy=0x7f3bf80c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:17.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.009+0000 7f3bf7fff700 1 -- 172.21.15.72:0/608278739 >> v1:172.21.15.72:6789/0 conn(0x7f3bf814aab0 legacy=0x7f3bf8154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:17.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.009+0000 7f3bf7fff700 1 -- 172.21.15.72:0/608278739 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf806d200 con 0x7f3bf806c1d0 2023-07-27T20:32:17.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.010+0000 7f3bf7fff700 1 --2- 172.21.15.72:0/608278739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bf806c1d0 0x7f3bf806c5f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0009d90 tx=0x7f3bf000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=692e2e5e0915354e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:17.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.010+0000 7f3bf6ffd700 1 -- 172.21.15.72:0/608278739 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf000e070 con 0x7f3bf806c1d0 2023-07-27T20:32:17.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.010+0000 7f3bf6ffd700 1 -- 172.21.15.72:0/608278739 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf000bbd0 con 0x7f3bf806c1d0 2023-07-27T20:32:17.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.010+0000 7f3bf6ffd700 1 -- 172.21.15.72:0/608278739 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0012430 con 0x7f3bf806c1d0 2023-07-27T20:32:17.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.010+0000 7f3bfdfff700 1 -- 172.21.15.72:0/608278739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bf806c1d0 msgr2=0x7f3bf806c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:17.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.010+0000 7f3bfdfff700 1 --2- 172.21.15.72:0/608278739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bf806c1d0 0x7f3bf806c5f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0009d90 tx=0x7f3bf000b330 comp rx=0 tx=0).stop 2023-07-27T20:32:18.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.010+0000 7f3bfdfff700 1 -- 172.21.15.72:0/608278739 shutdown_connections 2023-07-27T20:32:18.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.010+0000 7f3bfdfff700 1 --2- 172.21.15.72:0/608278739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bf806c1d0 0x7f3bf806c5f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:18.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.010+0000 7f3bfdfff700 1 -- 172.21.15.72:0/608278739 >> 172.21.15.72:0/608278739 conn(0x7f3bf80ab3f0 msgr2=0x7f3bf80ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:18.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.011+0000 7f3bfdfff700 1 -- 172.21.15.72:0/608278739 shutdown_connections 2023-07-27T20:32:18.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.011+0000 7f3bfdfff700 1 -- 172.21.15.72:0/608278739 wait complete. 2023-07-27T20:32:18.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.012+0000 7f3bfdfff700 1 Processor -- start 2023-07-27T20:32:18.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.012+0000 7f3bfdfff700 1 -- start start 2023-07-27T20:32:18.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.013+0000 7f3bfdfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bf806c1d0 0x7f3bf80bfe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:18.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.013+0000 7f3bfdfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bf80c7740 0x7f3bf8151310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:18.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.013+0000 7f3bfdfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3bf814aab0 0x7f3bf8148a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:18.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.013+0000 7f3bfdfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf814f780 con 0x7f3bf806c1d0 2023-07-27T20:32:18.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.013+0000 7f3bfdfff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf814e730 con 0x7f3bf80c7740 2023-07-27T20:32:18.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.013+0000 7f3bfdfff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf814e980 con 0x7f3bf814aab0 2023-07-27T20:32:18.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.013+0000 7f3bf77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bf806c1d0 0x7f3bf80bfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:18.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.013+0000 7f3bf77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bf806c1d0 0x7f3bf80bfe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44208/0 (socket says 172.21.15.72:44208) 2023-07-27T20:32:18.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.013+0000 7f3bf77fe700 1 -- 172.21.15.72:0/2766073710 learned_addr learned my addr 172.21.15.72:0/2766073710 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:18.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.014+0000 7f3beffff700 1 --2- 172.21.15.72:0/2766073710 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bf80c7740 0x7f3bf8151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:18.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.014+0000 7f3bf77fe700 1 -- 172.21.15.72:0/2766073710 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3bf814aab0 msgr2=0x7f3bf8148a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:18.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.014+0000 7f3bf77fe700 1 --2- 172.21.15.72:0/2766073710 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3bf814aab0 0x7f3bf8148a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:18.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.014+0000 7f3bf77fe700 1 -- 172.21.15.72:0/2766073710 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bf80c7740 msgr2=0x7f3bf8151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:18.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.014+0000 7f3bf77fe700 1 --2- 172.21.15.72:0/2766073710 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bf80c7740 0x7f3bf8151310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:18.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.014+0000 7f3bf77fe700 1 -- 172.21.15.72:0/2766073710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf0009a70 con 0x7f3bf806c1d0 2023-07-27T20:32:18.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.014+0000 7f3beffff700 1 --2- 172.21.15.72:0/2766073710 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bf80c7740 0x7f3bf8151310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:32:18.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.014+0000 7f3bf77fe700 1 --2- 172.21.15.72:0/2766073710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bf806c1d0 0x7f3bf80bfe10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3be800c550 tx=0x7f3be800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:18.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.014+0000 7f3bf4ff9700 1 -- 172.21.15.72:0/2766073710 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be8004c80 con 0x7f3bf806c1d0 2023-07-27T20:32:18.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.014+0000 7f3bf4ff9700 1 -- 172.21.15.72:0/2766073710 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be8004de0 con 0x7f3bf806c1d0 2023-07-27T20:32:18.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.014+0000 7f3bfdfff700 1 -- 172.21.15.72:0/2766073710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf814ec60 con 0x7f3bf806c1d0 2023-07-27T20:32:18.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.014+0000 7f3bf4ff9700 1 -- 172.21.15.72:0/2766073710 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be8007310 con 0x7f3bf806c1d0 2023-07-27T20:32:18.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.014+0000 7f3bfdfff700 1 -- 172.21.15.72:0/2766073710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf814f220 con 0x7f3bf806c1d0 2023-07-27T20:32:18.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.015+0000 7f3bfdfff700 1 -- 172.21.15.72:0/2766073710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf80be4c0 con 0x7f3bf806c1d0 2023-07-27T20:32:18.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.016+0000 7f3bf4ff9700 1 -- 172.21.15.72:0/2766073710 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3be8007470 con 0x7f3bf806c1d0 2023-07-27T20:32:18.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.017+0000 7f3bf4ff9700 1 --2- 172.21.15.72:0/2766073710 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3bd806ace0 0x7f3bd806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:18.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.017+0000 7f3bf4ff9700 1 -- 172.21.15.72:0/2766073710 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3be8089490 con 0x7f3bf806c1d0 2023-07-27T20:32:18.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.018+0000 7f3beffff700 1 --2- 172.21.15.72:0/2766073710 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3bd806ace0 0x7f3bd806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:18.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.018+0000 7f3beffff700 1 --2- 172.21.15.72:0/2766073710 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3bd806ace0 0x7f3bd806d1a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3bf814e690 tx=0x7f3be0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:18.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.021+0000 7f3bf4ff9700 1 -- 172.21.15.72:0/2766073710 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3bf80be4c0 con 0x7f3bf806c1d0 2023-07-27T20:32:18.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.217+0000 7f3bfdfff700 1 -- 172.21.15.72:0/2766073710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3bf80be4c0 con 0x7f3bf806c1d0 2023-07-27T20:32:18.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.217+0000 7f3bf4ff9700 1 -- 172.21.15.72:0/2766073710 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3be8054200 con 0x7f3bf806c1d0 2023-07-27T20:32:18.205 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-27T20:32:18.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.219+0000 7f3bfdfff700 1 -- 172.21.15.72:0/2766073710 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3bd806ace0 msgr2=0x7f3bd806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:18.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.219+0000 7f3bfdfff700 1 --2- 172.21.15.72:0/2766073710 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3bd806ace0 0x7f3bd806d1a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3bf814e690 tx=0x7f3be0009040 comp rx=0 tx=0).stop 2023-07-27T20:32:18.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.219+0000 7f3bfdfff700 1 -- 172.21.15.72:0/2766073710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bf806c1d0 msgr2=0x7f3bf80bfe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:18.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.219+0000 7f3bfdfff700 1 --2- 172.21.15.72:0/2766073710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bf806c1d0 0x7f3bf80bfe10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3be800c550 tx=0x7f3be800c910 comp rx=0 tx=0).stop 2023-07-27T20:32:18.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.220+0000 7f3bfdfff700 1 -- 172.21.15.72:0/2766073710 shutdown_connections 2023-07-27T20:32:18.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.220+0000 7f3bfdfff700 1 --2- 172.21.15.72:0/2766073710 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3bd806ace0 0x7f3bd806d1a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:18.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.220+0000 7f3bfdfff700 1 --2- 172.21.15.72:0/2766073710 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3bf814aab0 0x7f3bf8148a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:18.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.220+0000 7f3bfdfff700 1 --2- 172.21.15.72:0/2766073710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bf806c1d0 0x7f3bf80bfe10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:18.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.220+0000 7f3bfdfff700 1 --2- 172.21.15.72:0/2766073710 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bf80c7740 0x7f3bf8151310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:18.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.220+0000 7f3bfdfff700 1 -- 172.21.15.72:0/2766073710 >> 172.21.15.72:0/2766073710 conn(0x7f3bf80ab3f0 msgr2=0x7f3bf8149e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:18.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.220+0000 7f3bfdfff700 1 -- 172.21.15.72:0/2766073710 shutdown_connections 2023-07-27T20:32:18.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.220+0000 7f3bfdfff700 1 -- 172.21.15.72:0/2766073710 wait complete. 2023-07-27T20:32:18.225 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T20:32:18.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.435+0000 7f49139ff700 1 Processor -- start 2023-07-27T20:32:18.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.435+0000 7f49139ff700 1 -- start start 2023-07-27T20:32:18.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.436+0000 7f49139ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f490c14aab0 0x7f490c154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:18.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.436+0000 7f49139ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f490c0c7740 0x7f490c0c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:18.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.436+0000 7f49139ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f490c0c7c50 con 0x7f490c0c4700 2023-07-27T20:32:18.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.436+0000 7f49139ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f490c06bd40 con 0x7f490c14aab0 2023-07-27T20:32:18.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.436+0000 7f49139ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f490c0c62f0 con 0x7f490c0c7740 2023-07-27T20:32:18.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.437+0000 7f4910f9a700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f490c0c7740 0x7f490c0c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:18.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.437+0000 7f491179b700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f490c14aab0 0x7f490c154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:18.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.437+0000 7f4911f9c700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f490c0c4700 0x7f490c06c1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.72:46498/0 (socket says 172.21.15.72:46498) 2023-07-27T20:32:18.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.437+0000 7f4911f9c700 1 -- 172.21.15.72:0/3276529473 learned_addr learned my addr 172.21.15.72:0/3276529473 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:18.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.437+0000 7f491179b700 1 -- 172.21.15.72:0/3276529473 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f490c0c7740 msgr2=0x7f490c0c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:18.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.437+0000 7f491179b700 1 --2- 172.21.15.72:0/3276529473 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f490c0c7740 0x7f490c0c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:18.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.437+0000 7f4903fff700 1 -- 172.21.15.72:0/3276529473 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4289007389 0 0) 0x7f490c0c7c50 con 0x7f490c0c4700 2023-07-27T20:32:18.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.437+0000 7f491179b700 1 -- 172.21.15.72:0/3276529473 >> v1:172.21.15.173:6789/0 conn(0x7f490c0c4700 legacy=0x7f490c06c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:18.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.437+0000 7f491179b700 1 -- 172.21.15.72:0/3276529473 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f490c155050 con 0x7f490c14aab0 2023-07-27T20:32:18.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.438+0000 7f491179b700 1 --2- 172.21.15.72:0/3276529473 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f490c14aab0 0x7f490c154b10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4908009840 tx=0x7f4908009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86592fc8793dbecf server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:18.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.438+0000 7f4903fff700 1 -- 172.21.15.72:0/3276529473 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4908011830 con 0x7f490c14aab0 2023-07-27T20:32:18.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.438+0000 7f4903fff700 1 -- 172.21.15.72:0/3276529473 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4908011990 con 0x7f490c14aab0 2023-07-27T20:32:18.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.438+0000 7f4903fff700 1 -- 172.21.15.72:0/3276529473 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4908011d20 con 0x7f490c14aab0 2023-07-27T20:32:18.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.438+0000 7f49139ff700 1 -- 172.21.15.72:0/3276529473 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f490c14aab0 msgr2=0x7f490c154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:18.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.438+0000 7f49139ff700 1 --2- 172.21.15.72:0/3276529473 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f490c14aab0 0x7f490c154b10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4908009840 tx=0x7f4908009b50 comp rx=0 tx=0).stop 2023-07-27T20:32:18.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.439+0000 7f49139ff700 1 -- 172.21.15.72:0/3276529473 shutdown_connections 2023-07-27T20:32:18.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.439+0000 7f49139ff700 1 --2- 172.21.15.72:0/3276529473 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f490c14aab0 0x7f490c154b10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:18.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.439+0000 7f49139ff700 1 --2- 172.21.15.72:0/3276529473 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f490c0c7740 0x7f490c0c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:18.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.439+0000 7f49139ff700 1 -- 172.21.15.72:0/3276529473 >> 172.21.15.72:0/3276529473 conn(0x7f490c0ab3f0 msgr2=0x7f490c0ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:18.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.439+0000 7f49139ff700 1 -- 172.21.15.72:0/3276529473 shutdown_connections 2023-07-27T20:32:18.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.439+0000 7f49139ff700 1 -- 172.21.15.72:0/3276529473 wait complete. 2023-07-27T20:32:18.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.440+0000 7f49139ff700 1 Processor -- start 2023-07-27T20:32:18.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.440+0000 7f49139ff700 1 -- start start 2023-07-27T20:32:18.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.441+0000 7f49139ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f490c0c4700 0x7f490c0c01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:18.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.441+0000 7f49139ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f490c0c7740 0x7f490c0bcc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:18.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.441+0000 7f49139ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f490c14aab0 0x7f490c156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:18.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.441+0000 7f49139ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490c0bda10 con 0x7f490c0c4700 2023-07-27T20:32:18.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.441+0000 7f49139ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490c0c0710 con 0x7f490c14aab0 2023-07-27T20:32:18.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.441+0000 7f49139ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f490c0bd150 con 0x7f490c0c7740 2023-07-27T20:32:18.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.442+0000 7f491179b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f490c0c4700 0x7f490c0c01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:18.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.442+0000 7f491179b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f490c0c4700 0x7f490c0c01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44214/0 (socket says 172.21.15.72:44214) 2023-07-27T20:32:18.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.442+0000 7f491179b700 1 -- 172.21.15.72:0/2325391601 learned_addr learned my addr 172.21.15.72:0/2325391601 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:18.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.442+0000 7f4911f9c700 1 --2- 172.21.15.72:0/2325391601 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f490c14aab0 0x7f490c156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:18.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.442+0000 7f4910f9a700 1 --2- 172.21.15.72:0/2325391601 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f490c0c7740 0x7f490c0bcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:18.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.442+0000 7f491179b700 1 -- 172.21.15.72:0/2325391601 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f490c0c7740 msgr2=0x7f490c0bcc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:18.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.442+0000 7f491179b700 1 --2- 172.21.15.72:0/2325391601 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f490c0c7740 0x7f490c0bcc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:18.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.442+0000 7f491179b700 1 -- 172.21.15.72:0/2325391601 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f490c14aab0 msgr2=0x7f490c156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:18.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.442+0000 7f491179b700 1 --2- 172.21.15.72:0/2325391601 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f490c14aab0 0x7f490c156e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:18.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.442+0000 7f491179b700 1 -- 172.21.15.72:0/2325391601 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49080094a0 con 0x7f490c0c4700 2023-07-27T20:32:18.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.442+0000 7f491179b700 1 --2- 172.21.15.72:0/2325391601 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f490c0c4700 0x7f490c0c01d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4908009b90 tx=0x7f4908004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:18.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.442+0000 7f4901ffb700 1 -- 172.21.15.72:0/2325391601 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49080038a0 con 0x7f490c0c4700 2023-07-27T20:32:18.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.442+0000 7f4901ffb700 1 -- 172.21.15.72:0/2325391601 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f490801e070 con 0x7f490c0c4700 2023-07-27T20:32:18.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.442+0000 7f49139ff700 1 -- 172.21.15.72:0/2325391601 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f490c1ea110 con 0x7f490c0c4700 2023-07-27T20:32:18.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.443+0000 7f4901ffb700 1 -- 172.21.15.72:0/2325391601 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4908003c40 con 0x7f490c0c4700 2023-07-27T20:32:18.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.443+0000 7f49139ff700 1 -- 172.21.15.72:0/2325391601 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f490c156020 con 0x7f490c0c4700 2023-07-27T20:32:18.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.444+0000 7f49139ff700 1 -- 172.21.15.72:0/2325391601 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f490c04e470 con 0x7f490c0c4700 2023-07-27T20:32:18.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.444+0000 7f4901ffb700 1 -- 172.21.15.72:0/2325391601 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f490802d450 con 0x7f490c0c4700 2023-07-27T20:32:18.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.445+0000 7f4901ffb700 1 --2- 172.21.15.72:0/2325391601 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f48f006ace0 0x7f48f006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:18.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.445+0000 7f4901ffb700 1 -- 172.21.15.72:0/2325391601 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f490808a720 con 0x7f490c0c4700 2023-07-27T20:32:18.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.446+0000 7f4910f9a700 1 --2- 172.21.15.72:0/2325391601 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f48f006ace0 0x7f48f006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:18.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.446+0000 7f4910f9a700 1 --2- 172.21.15.72:0/2325391601 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f48f006ace0 0x7f48f006d1a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f490c0a9c70 tx=0x7f48fc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:18.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.450+0000 7f4901ffb700 1 -- 172.21.15.72:0/2325391601 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4908055530 con 0x7f490c0c4700 2023-07-27T20:32:18.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.646+0000 7f49139ff700 1 -- 172.21.15.72:0/2325391601 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f490c06cf00 con 0x7f490c0c4700 2023-07-27T20:32:18.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.646+0000 7f4901ffb700 1 -- 172.21.15.72:0/2325391601 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4908058b50 con 0x7f490c0c4700 2023-07-27T20:32:18.634 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:32:18.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.648+0000 7f49139ff700 1 -- 172.21.15.72:0/2325391601 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f48f006ace0 msgr2=0x7f48f006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:18.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.648+0000 7f49139ff700 1 --2- 172.21.15.72:0/2325391601 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f48f006ace0 0x7f48f006d1a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f490c0a9c70 tx=0x7f48fc008040 comp rx=0 tx=0).stop 2023-07-27T20:32:18.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.648+0000 7f49139ff700 1 -- 172.21.15.72:0/2325391601 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f490c0c4700 msgr2=0x7f490c0c01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:18.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.648+0000 7f49139ff700 1 --2- 172.21.15.72:0/2325391601 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f490c0c4700 0x7f490c0c01d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4908009b90 tx=0x7f4908004750 comp rx=0 tx=0).stop 2023-07-27T20:32:18.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.648+0000 7f49139ff700 1 -- 172.21.15.72:0/2325391601 shutdown_connections 2023-07-27T20:32:18.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.648+0000 7f49139ff700 1 --2- 172.21.15.72:0/2325391601 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f490c14aab0 0x7f490c156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:18.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.648+0000 7f49139ff700 1 --2- 172.21.15.72:0/2325391601 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f490c0c4700 0x7f490c0c01d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:18.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.648+0000 7f49139ff700 1 --2- 172.21.15.72:0/2325391601 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f48f006ace0 0x7f48f006d1a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:18.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.648+0000 7f49139ff700 1 --2- 172.21.15.72:0/2325391601 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f490c0c7740 0x7f490c0bcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:18.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.648+0000 7f49139ff700 1 -- 172.21.15.72:0/2325391601 >> 172.21.15.72:0/2325391601 conn(0x7f490c0ab3f0 msgr2=0x7f490c1524e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:18.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.649+0000 7f49139ff700 1 -- 172.21.15.72:0/2325391601 shutdown_connections 2023-07-27T20:32:18.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.649+0000 7f49139ff700 1 -- 172.21.15.72:0/2325391601 wait complete. 2023-07-27T20:32:18.653 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T20:32:18.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.866+0000 7f476a9ff700 1 Processor -- start 2023-07-27T20:32:18.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.867+0000 7f476a9ff700 1 -- start start 2023-07-27T20:32:18.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.868+0000 7f476a9ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f476406e140 0x7f47640ba310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:18.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.868+0000 7f476a9ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f47640ba850 0x7f476406d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:18.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.868+0000 7f476a9ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f476406ce10 con 0x7f476413b150 2023-07-27T20:32:18.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.868+0000 7f476a9ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4764152680 con 0x7f47640ba850 2023-07-27T20:32:18.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.868+0000 7f476a9ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4764152960 con 0x7f476406e140 2023-07-27T20:32:18.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.868+0000 7f47637fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f476406e140 0x7f47640ba310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:18.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.868+0000 7f4768f9c700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f47640ba850 0x7f476406d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:18.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.868+0000 7f4763fff700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f476413b150 0x7f4764151dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.72:46510/0 (socket says 172.21.15.72:46510) 2023-07-27T20:32:18.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.869+0000 7f47637fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f476406e140 0x7f47640ba310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.72:44026/0 (socket says 172.21.15.72:44026) 2023-07-27T20:32:18.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.869+0000 7f4763fff700 1 -- 172.21.15.72:0/2620201658 learned_addr learned my addr 172.21.15.72:0/2620201658 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:18.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.869+0000 7f4762ffd700 1 -- 172.21.15.72:0/2620201658 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2281424262 0 0) 0x7f476406ce10 con 0x7f476413b150 2023-07-27T20:32:18.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.869+0000 7f4762ffd700 1 -- 172.21.15.72:0/2620201658 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f474c0035b0 con 0x7f476413b150 2023-07-27T20:32:18.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.869+0000 7f47637fe700 1 -- 172.21.15.72:0/2620201658 >> v2:172.21.15.173:3300/0 conn(0x7f47640ba850 msgr2=0x7f476406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:18.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.869+0000 7f47637fe700 1 --2- 172.21.15.72:0/2620201658 >> v2:172.21.15.173:3300/0 conn(0x7f47640ba850 0x7f476406d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:18.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.869+0000 7f47637fe700 1 -- 172.21.15.72:0/2620201658 >> v1:172.21.15.173:6789/0 conn(0x7f476413b150 legacy=0x7f4764151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:18.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.869+0000 7f47637fe700 1 -- 172.21.15.72:0/2620201658 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4764152c40 con 0x7f476406e140 2023-07-27T20:32:18.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.869+0000 7f4768f9c700 1 --2- 172.21.15.72:0/2620201658 >> v2:172.21.15.173:3300/0 conn(0x7f47640ba850 0x7f476406d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:32:18.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.869+0000 7f47637fe700 1 --2- 172.21.15.72:0/2620201658 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f476406e140 0x7f47640ba310 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4758009840 tx=0x7f4758009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f099e1f04b34c1a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:18.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.870+0000 7f4762ffd700 1 -- 172.21.15.72:0/2620201658 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4758011830 con 0x7f476406e140 2023-07-27T20:32:18.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.870+0000 7f4762ffd700 1 -- 172.21.15.72:0/2620201658 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4758011990 con 0x7f476406e140 2023-07-27T20:32:18.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.870+0000 7f4762ffd700 1 -- 172.21.15.72:0/2620201658 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4758011d00 con 0x7f476406e140 2023-07-27T20:32:18.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.870+0000 7f476a9ff700 1 -- 172.21.15.72:0/2620201658 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f476406e140 msgr2=0x7f47640ba310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:18.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.870+0000 7f476a9ff700 1 --2- 172.21.15.72:0/2620201658 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f476406e140 0x7f47640ba310 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4758009840 tx=0x7f4758009b50 comp rx=0 tx=0).stop 2023-07-27T20:32:18.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.870+0000 7f476a9ff700 1 -- 172.21.15.72:0/2620201658 shutdown_connections 2023-07-27T20:32:18.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.870+0000 7f476a9ff700 1 --2- 172.21.15.72:0/2620201658 >> v2:172.21.15.173:3300/0 conn(0x7f47640ba850 0x7f476406d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:18.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.870+0000 7f476a9ff700 1 --2- 172.21.15.72:0/2620201658 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f476406e140 0x7f47640ba310 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:18.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.870+0000 7f476a9ff700 1 -- 172.21.15.72:0/2620201658 >> 172.21.15.72:0/2620201658 conn(0x7f476406a190 msgr2=0x7f476406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:18.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.870+0000 7f476a9ff700 1 -- 172.21.15.72:0/2620201658 shutdown_connections 2023-07-27T20:32:18.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.870+0000 7f476a9ff700 1 -- 172.21.15.72:0/2620201658 wait complete. 2023-07-27T20:32:18.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.872+0000 7f476a9ff700 1 Processor -- start 2023-07-27T20:32:18.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.872+0000 7f476a9ff700 1 -- start start 2023-07-27T20:32:18.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.873+0000 7f476a9ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f476406e140 0x7f47640ab100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:18.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.873+0000 7f476a9ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f47640ba850 0x7f47641ea6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:18.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.873+0000 7f476a9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f476413b150 0x7f47640aa1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:18.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.873+0000 7f476a9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47641eb1c0 con 0x7f476413b150 2023-07-27T20:32:18.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.873+0000 7f476a9ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47640c56a0 con 0x7f476406e140 2023-07-27T20:32:18.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.873+0000 7f476a9ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47641eaee0 con 0x7f47640ba850 2023-07-27T20:32:18.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.873+0000 7f4768f9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f476413b150 0x7f47640aa1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:18.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.873+0000 7f4768f9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f476413b150 0x7f47640aa1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44226/0 (socket says 172.21.15.72:44226) 2023-07-27T20:32:18.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.873+0000 7f4768f9c700 1 -- 172.21.15.72:0/3693270317 learned_addr learned my addr 172.21.15.72:0/3693270317 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:18.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.874+0000 7f4763fff700 1 --2- 172.21.15.72:0/3693270317 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f476406e140 0x7f47640ab100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:18.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.874+0000 7f47637fe700 1 --2- 172.21.15.72:0/3693270317 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f47640ba850 0x7f47641ea6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:18.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.874+0000 7f4768f9c700 1 -- 172.21.15.72:0/3693270317 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f47640ba850 msgr2=0x7f47641ea6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:18.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.874+0000 7f4768f9c700 1 --2- 172.21.15.72:0/3693270317 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f47640ba850 0x7f47641ea6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:18.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.874+0000 7f4768f9c700 1 -- 172.21.15.72:0/3693270317 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f476406e140 msgr2=0x7f47640ab100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:18.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.874+0000 7f4768f9c700 1 --2- 172.21.15.72:0/3693270317 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f476406e140 0x7f47640ab100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:18.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.874+0000 7f4768f9c700 1 -- 172.21.15.72:0/3693270317 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f475c009a70 con 0x7f476413b150 2023-07-27T20:32:18.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.874+0000 7f4763fff700 1 --2- 172.21.15.72:0/3693270317 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f476406e140 0x7f47640ab100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:18.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.874+0000 7f4768f9c700 1 --2- 172.21.15.72:0/3693270317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f476413b150 0x7f47640aa1d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f475c00efc0 tx=0x7f475c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:18.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.874+0000 7f4760ff9700 1 -- 172.21.15.72:0/3693270317 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c009cd0 con 0x7f476413b150 2023-07-27T20:32:18.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.874+0000 7f4760ff9700 1 -- 172.21.15.72:0/3693270317 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475c00f040 con 0x7f476413b150 2023-07-27T20:32:18.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.874+0000 7f476a9ff700 1 -- 172.21.15.72:0/3693270317 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47580094a0 con 0x7f476413b150 2023-07-27T20:32:18.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.874+0000 7f4760ff9700 1 -- 172.21.15.72:0/3693270317 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c00cd60 con 0x7f476413b150 2023-07-27T20:32:18.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.874+0000 7f476a9ff700 1 -- 172.21.15.72:0/3693270317 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47640c5330 con 0x7f476413b150 2023-07-27T20:32:18.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.875+0000 7f476a9ff700 1 -- 172.21.15.72:0/3693270317 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47640c4eb0 con 0x7f476413b150 2023-07-27T20:32:18.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.876+0000 7f4760ff9700 1 -- 172.21.15.72:0/3693270317 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f475c014480 con 0x7f476413b150 2023-07-27T20:32:18.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.878+0000 7f4760ff9700 1 --2- 172.21.15.72:0/3693270317 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f475006ace0 0x7f475006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:18.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.878+0000 7f4760ff9700 1 -- 172.21.15.72:0/3693270317 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f475c089e10 con 0x7f476413b150 2023-07-27T20:32:18.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.878+0000 7f4763fff700 1 --2- 172.21.15.72:0/3693270317 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f475006ace0 0x7f475006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:18.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.879+0000 7f4763fff700 1 --2- 172.21.15.72:0/3693270317 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f475006ace0 0x7f475006d1a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4754005910 tx=0x7f4754009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:18.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:18.882+0000 7f4760ff9700 1 -- 172.21.15.72:0/3693270317 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f47640c4eb0 con 0x7f476413b150 2023-07-27T20:32:19.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.082+0000 7f476a9ff700 1 -- 172.21.15.72:0/3693270317 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f47640c39f0 con 0x7f476413b150 2023-07-27T20:32:19.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.082+0000 7f4760ff9700 1 -- 172.21.15.72:0/3693270317 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f47640c39f0 con 0x7f476413b150 2023-07-27T20:32:19.070 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-27T20:32:19.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.085+0000 7f476a9ff700 1 -- 172.21.15.72:0/3693270317 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f475006ace0 msgr2=0x7f475006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:19.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.085+0000 7f476a9ff700 1 --2- 172.21.15.72:0/3693270317 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f475006ace0 0x7f475006d1a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4754005910 tx=0x7f4754009040 comp rx=0 tx=0).stop 2023-07-27T20:32:19.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.085+0000 7f476a9ff700 1 -- 172.21.15.72:0/3693270317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f476413b150 msgr2=0x7f47640aa1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:19.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.085+0000 7f476a9ff700 1 --2- 172.21.15.72:0/3693270317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f476413b150 0x7f47640aa1d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f475c00efc0 tx=0x7f475c00c3a0 comp rx=0 tx=0).stop 2023-07-27T20:32:19.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.085+0000 7f476a9ff700 1 -- 172.21.15.72:0/3693270317 shutdown_connections 2023-07-27T20:32:19.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.085+0000 7f476a9ff700 1 --2- 172.21.15.72:0/3693270317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f476413b150 0x7f47640aa1d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:19.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.085+0000 7f476a9ff700 1 --2- 172.21.15.72:0/3693270317 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f476406e140 0x7f47640ab100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:19.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.085+0000 7f476a9ff700 1 --2- 172.21.15.72:0/3693270317 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f475006ace0 0x7f475006d1a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:19.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.085+0000 7f476a9ff700 1 --2- 172.21.15.72:0/3693270317 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f47640ba850 0x7f47641ea6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:19.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.085+0000 7f476a9ff700 1 -- 172.21.15.72:0/3693270317 >> 172.21.15.72:0/3693270317 conn(0x7f476406a190 msgr2=0x7f476406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:19.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.085+0000 7f476a9ff700 1 -- 172.21.15.72:0/3693270317 shutdown_connections 2023-07-27T20:32:19.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.085+0000 7f476a9ff700 1 -- 172.21.15.72:0/3693270317 wait complete. 2023-07-27T20:32:19.090 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-27T20:32:19.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.302+0000 7fa7569ff700 1 Processor -- start 2023-07-27T20:32:19.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.302+0000 7fa7569ff700 1 -- start start 2023-07-27T20:32:19.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.303+0000 7fa7569ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa75014aab0 0x7fa750154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:19.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.303+0000 7fa7569ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7500c7c50 con 0x7fa75006c1d0 2023-07-27T20:32:19.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.303+0000 7fa7569ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa75006bd40 con 0x7fa7500c7740 2023-07-27T20:32:19.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.303+0000 7fa7569ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75006cd50 con 0x7fa75014aab0 2023-07-27T20:32:19.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.303+0000 7fa754f9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa75006c1d0 0x7fa75006c640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39722/0 (socket says 172.21.15.72:39722) 2023-07-27T20:32:19.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.303+0000 7fa754f9c700 1 -- 172.21.15.72:0/3466573751 learned_addr learned my addr 172.21.15.72:0/3466573751 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:19.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.303+0000 7fa74ffff700 1 --2- 172.21.15.72:0/3466573751 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa75014aab0 0x7fa750154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:19.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.303+0000 7fa74effd700 1 -- 172.21.15.72:0/3466573751 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2440832214 0 0) 0x7fa7500c7c50 con 0x7fa75006c1d0 2023-07-27T20:32:19.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.304+0000 7fa74effd700 1 -- 172.21.15.72:0/3466573751 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7380035b0 con 0x7fa75006c1d0 2023-07-27T20:32:19.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.304+0000 7fa74effd700 1 -- 172.21.15.72:0/3466573751 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2907665205 0 0) 0x7fa75006bd40 con 0x7fa7500c7740 2023-07-27T20:32:19.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.304+0000 7fa74effd700 1 -- 172.21.15.72:0/3466573751 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7500c7c50 con 0x7fa7500c7740 2023-07-27T20:32:19.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.304+0000 7fa74effd700 1 -- 172.21.15.72:0/3466573751 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1794778077 0 0) 0x7fa7380035b0 con 0x7fa75006c1d0 2023-07-27T20:32:19.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.304+0000 7fa74effd700 1 -- 172.21.15.72:0/3466573751 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa75014aab0 msgr2=0x7fa750154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:19.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.304+0000 7fa74effd700 1 --2- 172.21.15.72:0/3466573751 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa75014aab0 0x7fa750154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:19.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.304+0000 7fa74effd700 1 -- 172.21.15.72:0/3466573751 >> v1:172.21.15.173:6789/0 conn(0x7fa7500c7740 legacy=0x7fa7500c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:19.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.304+0000 7fa74effd700 1 -- 172.21.15.72:0/3466573751 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7500c62f0 con 0x7fa75006c1d0 2023-07-27T20:32:19.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.304+0000 7fa74effd700 1 -- 172.21.15.72:0/3466573751 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7fa748001970 con 0x7fa75006c1d0 2023-07-27T20:32:19.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.304+0000 7fa74ffff700 1 --2- 172.21.15.72:0/3466573751 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa75014aab0 0x7fa750154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:32:19.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.304+0000 7fa74effd700 1 -- 172.21.15.72:0/3466573751 >> v1:172.21.15.72:6789/0 conn(0x7fa75006c1d0 legacy=0x7fa75006c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:19.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.304+0000 7fa74effd700 1 --2- 172.21.15.72:0/3466573751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa738003bc0 0x7fa738003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:19.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.304+0000 7fa74effd700 1 --2- 172.21.15.72:0/3466573751 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa75014aab0 0x7fa738004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:19.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.304+0000 7fa74effd700 1 --2- 172.21.15.72:0/3466573751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa738004d90 0x7fa738005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:19.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.304+0000 7fa74effd700 1 -- 172.21.15.72:0/3466573751 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75006cd50 con 0x7fa738004d90 2023-07-27T20:32:19.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.304+0000 7fa74effd700 1 -- 172.21.15.72:0/3466573751 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73800bac0 con 0x7fa738003bc0 2023-07-27T20:32:19.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.304+0000 7fa74effd700 1 -- 172.21.15.72:0/3466573751 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73800bc80 con 0x7fa75014aab0 2023-07-27T20:32:19.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.304+0000 7fa754f9c700 1 --2- 172.21.15.72:0/3466573751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa738004d90 0x7fa738005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:19.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.304+0000 7fa74ffff700 1 --2- 172.21.15.72:0/3466573751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa738003bc0 0x7fa738003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:19.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.304+0000 7fa74f7fe700 1 --2- 172.21.15.72:0/3466573751 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa75014aab0 0x7fa738004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:19.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.305+0000 7fa754f9c700 1 -- 172.21.15.72:0/3466573751 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa75014aab0 msgr2=0x7fa738004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:19.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.305+0000 7fa754f9c700 1 --2- 172.21.15.72:0/3466573751 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa75014aab0 0x7fa738004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:19.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.305+0000 7fa754f9c700 1 -- 172.21.15.72:0/3466573751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa738003bc0 msgr2=0x7fa738003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:19.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.305+0000 7fa754f9c700 1 --2- 172.21.15.72:0/3466573751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa738003bc0 0x7fa738003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:19.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.305+0000 7fa754f9c700 1 -- 172.21.15.72:0/3466573751 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7400094a0 con 0x7fa738004d90 2023-07-27T20:32:19.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.305+0000 7fa754f9c700 1 --2- 172.21.15.72:0/3466573751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa738004d90 0x7fa738005210 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa74800a680 tx=0x7fa738005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29aabc6ce9c6ec8c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:19.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.305+0000 7fa74effd700 1 -- 172.21.15.72:0/3466573751 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7480072d0 con 0x7fa738004d90 2023-07-27T20:32:19.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.305+0000 7fa74effd700 1 -- 172.21.15.72:0/3466573751 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa748007450 con 0x7fa738004d90 2023-07-27T20:32:19.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.305+0000 7fa74effd700 1 -- 172.21.15.72:0/3466573751 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa748007800 con 0x7fa738004d90 2023-07-27T20:32:19.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.306+0000 7fa7569ff700 1 -- 172.21.15.72:0/3466573751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa738004d90 msgr2=0x7fa738005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:19.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.306+0000 7fa7569ff700 1 --2- 172.21.15.72:0/3466573751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa738004d90 0x7fa738005210 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa74800a680 tx=0x7fa738005880 comp rx=0 tx=0).stop 2023-07-27T20:32:19.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.306+0000 7fa754f9c700 1 -- 172.21.15.72:0/3466573751 reap_dead start 2023-07-27T20:32:19.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.306+0000 7fa7569ff700 1 -- 172.21.15.72:0/3466573751 shutdown_connections 2023-07-27T20:32:19.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.306+0000 7fa7569ff700 1 -- 172.21.15.72:0/3466573751 >> 172.21.15.72:0/3466573751 conn(0x7fa7500ab3f0 msgr2=0x7fa7500ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:19.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.306+0000 7fa7569ff700 1 -- 172.21.15.72:0/3466573751 shutdown_connections 2023-07-27T20:32:19.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.306+0000 7fa7569ff700 1 -- 172.21.15.72:0/3466573751 wait complete. 2023-07-27T20:32:19.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.308+0000 7fa7569ff700 1 Processor -- start 2023-07-27T20:32:19.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.308+0000 7fa7569ff700 1 -- start start 2023-07-27T20:32:19.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.308+0000 7fa7569ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa738004d90 0x7fa750151640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:19.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.309+0000 7fa7569ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa750148df0 0x7fa7500bdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:19.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.309+0000 7fa7569ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7500be3f0 0x7fa750150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:19.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.309+0000 7fa7569ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa750148c20 con 0x7fa750148df0 2023-07-27T20:32:19.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.309+0000 7fa7569ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7501579e0 con 0x7fa7500be3f0 2023-07-27T20:32:19.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.309+0000 7fa7569ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa750157e70 con 0x7fa738004d90 2023-07-27T20:32:19.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.309+0000 7fa74f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa750148df0 0x7fa7500bdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:19.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.309+0000 7fa74f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa750148df0 0x7fa7500bdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44256/0 (socket says 172.21.15.72:44256) 2023-07-27T20:32:19.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.309+0000 7fa74f7fe700 1 -- 172.21.15.72:0/3705571826 learned_addr learned my addr 172.21.15.72:0/3705571826 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:19.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.309+0000 7fa74ffff700 1 --2- 172.21.15.72:0/3705571826 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa738004d90 0x7fa750151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:19.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.309+0000 7fa754f9c700 1 --2- 172.21.15.72:0/3705571826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7500be3f0 0x7fa750150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:19.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.309+0000 7fa74f7fe700 1 -- 172.21.15.72:0/3705571826 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa738004d90 msgr2=0x7fa750151640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:19.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.309+0000 7fa74f7fe700 1 --2- 172.21.15.72:0/3705571826 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa738004d90 0x7fa750151640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:19.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.309+0000 7fa74f7fe700 1 -- 172.21.15.72:0/3705571826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7500be3f0 msgr2=0x7fa750150300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:19.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.309+0000 7fa74f7fe700 1 --2- 172.21.15.72:0/3705571826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7500be3f0 0x7fa750150300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:19.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.309+0000 7fa74f7fe700 1 -- 172.21.15.72:0/3705571826 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7501570b0 con 0x7fa750148df0 2023-07-27T20:32:19.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.309+0000 7fa74f7fe700 1 --2- 172.21.15.72:0/3705571826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa750148df0 0x7fa7500bdeb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa74400f7f0 tx=0x7fa74400fbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:19.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.310+0000 7fa74cff9700 1 -- 172.21.15.72:0/3705571826 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa744005320 con 0x7fa750148df0 2023-07-27T20:32:19.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.310+0000 7fa74cff9700 1 -- 172.21.15.72:0/3705571826 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa744005480 con 0x7fa750148df0 2023-07-27T20:32:19.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.310+0000 7fa74cff9700 1 -- 172.21.15.72:0/3705571826 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa744006aa0 con 0x7fa750148df0 2023-07-27T20:32:19.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.310+0000 7fa7569ff700 1 -- 172.21.15.72:0/3705571826 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa750157390 con 0x7fa750148df0 2023-07-27T20:32:19.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.310+0000 7fa7569ff700 1 -- 172.21.15.72:0/3705571826 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa75014ecf0 con 0x7fa750148df0 2023-07-27T20:32:19.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.311+0000 7fa7569ff700 1 -- 172.21.15.72:0/3705571826 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa750157b50 con 0x7fa750148df0 2023-07-27T20:32:19.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.312+0000 7fa74cff9700 1 -- 172.21.15.72:0/3705571826 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa744006c00 con 0x7fa750148df0 2023-07-27T20:32:19.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.313+0000 7fa74cff9700 1 --2- 172.21.15.72:0/3705571826 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa73c06ace0 0x7fa73c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:19.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.313+0000 7fa74cff9700 1 -- 172.21.15.72:0/3705571826 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa744088d70 con 0x7fa750148df0 2023-07-27T20:32:19.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.313+0000 7fa74ffff700 1 --2- 172.21.15.72:0/3705571826 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa73c06ace0 0x7fa73c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:19.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.314+0000 7fa74ffff700 1 --2- 172.21.15.72:0/3705571826 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa73c06ace0 0x7fa73c06d1a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa740009d30 tx=0x7fa740008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:19.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.317+0000 7fa74cff9700 1 -- 172.21.15.72:0/3705571826 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa744053b80 con 0x7fa750148df0 2023-07-27T20:32:19.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.510+0000 7fa7569ff700 1 -- 172.21.15.72:0/3705571826 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa75004e470 con 0x7fa750148df0 2023-07-27T20:32:19.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.511+0000 7fa74cff9700 1 -- 172.21.15.72:0/3705571826 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa7440571a0 con 0x7fa750148df0 2023-07-27T20:32:19.499 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:32:19.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.513+0000 7fa7569ff700 1 -- 172.21.15.72:0/3705571826 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa73c06ace0 msgr2=0x7fa73c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:19.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.513+0000 7fa7569ff700 1 --2- 172.21.15.72:0/3705571826 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa73c06ace0 0x7fa73c06d1a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa740009d30 tx=0x7fa740008040 comp rx=0 tx=0).stop 2023-07-27T20:32:19.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.513+0000 7fa7569ff700 1 -- 172.21.15.72:0/3705571826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa750148df0 msgr2=0x7fa7500bdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:19.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.513+0000 7fa7569ff700 1 --2- 172.21.15.72:0/3705571826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa750148df0 0x7fa7500bdeb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa74400f7f0 tx=0x7fa74400fbb0 comp rx=0 tx=0).stop 2023-07-27T20:32:19.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.513+0000 7fa7569ff700 1 -- 172.21.15.72:0/3705571826 shutdown_connections 2023-07-27T20:32:19.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.513+0000 7fa7569ff700 1 --2- 172.21.15.72:0/3705571826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7500be3f0 0x7fa750150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:19.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.513+0000 7fa7569ff700 1 --2- 172.21.15.72:0/3705571826 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa73c06ace0 0x7fa73c06d1a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:19.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.513+0000 7fa7569ff700 1 --2- 172.21.15.72:0/3705571826 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa738004d90 0x7fa750151640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:19.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.513+0000 7fa7569ff700 1 --2- 172.21.15.72:0/3705571826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa750148df0 0x7fa7500bdeb0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:19.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.513+0000 7fa7569ff700 1 -- 172.21.15.72:0/3705571826 >> 172.21.15.72:0/3705571826 conn(0x7fa7500ab3f0 msgr2=0x7fa7500c86f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:19.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.513+0000 7fa7569ff700 1 -- 172.21.15.72:0/3705571826 shutdown_connections 2023-07-27T20:32:19.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.513+0000 7fa7569ff700 1 -- 172.21.15.72:0/3705571826 wait complete. 2023-07-27T20:32:19.519 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:32:19.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.728+0000 7f33191ff700 1 Processor -- start 2023-07-27T20:32:19.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.728+0000 7f33191ff700 1 -- start start 2023-07-27T20:32:19.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.729+0000 7f33191ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f33140c4400 0x7f33140c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:19.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.729+0000 7f33191ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f331406b710 con 0x7f33141549f0 2023-07-27T20:32:19.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.729+0000 7f33191ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f331406b9f0 con 0x7f331406b150 2023-07-27T20:32:19.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.729+0000 7f33191ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33141545d0 con 0x7f33140c4400 2023-07-27T20:32:19.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.729+0000 7f331359e700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f33141549f0 0x7f33141514a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39734/0 (socket says 172.21.15.72:39734) 2023-07-27T20:32:19.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.729+0000 7f331359e700 1 -- 172.21.15.72:0/1412231255 learned_addr learned my addr 172.21.15.72:0/1412231255 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:19.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.729+0000 7f3312d9d700 1 --2- 172.21.15.72:0/1412231255 >> v2:172.21.15.173:3300/0 conn(0x7f33140c4400 0x7f33140c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:19.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.730+0000 7f3311d9b700 1 -- 172.21.15.72:0/1412231255 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3713097436 0 0) 0x7f331406b710 con 0x7f33141549f0 2023-07-27T20:32:19.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.730+0000 7f3311d9b700 1 -- 172.21.15.72:0/1412231255 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32fc0035b0 con 0x7f33141549f0 2023-07-27T20:32:19.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.730+0000 7f3311d9b700 1 -- 172.21.15.72:0/1412231255 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2524252800 0 0) 0x7f32fc0035b0 con 0x7f33141549f0 2023-07-27T20:32:19.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.730+0000 7f3311d9b700 1 -- 172.21.15.72:0/1412231255 >> v2:172.21.15.173:3300/0 conn(0x7f33140c4400 msgr2=0x7f33140c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:19.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.730+0000 7f3311d9b700 1 --2- 172.21.15.72:0/1412231255 >> v2:172.21.15.173:3300/0 conn(0x7f33140c4400 0x7f33140c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:19.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.730+0000 7f3311d9b700 1 -- 172.21.15.72:0/1412231255 >> v1:172.21.15.173:6789/0 conn(0x7f331406b150 legacy=0x7f33140c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:19.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.730+0000 7f3311d9b700 1 -- 172.21.15.72:0/1412231255 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f331406bcd0 con 0x7f33141549f0 2023-07-27T20:32:19.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.730+0000 7f3311d9b700 1 -- 172.21.15.72:0/1412231255 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f330c0019f0 con 0x7f33141549f0 2023-07-27T20:32:19.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.730+0000 7f3311d9b700 1 -- 172.21.15.72:0/1412231255 >> v1:172.21.15.72:6789/0 conn(0x7f33141549f0 legacy=0x7f33141514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:19.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.730+0000 7f3311d9b700 1 --2- 172.21.15.72:0/1412231255 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f32fc003a50 0x7f32fc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:19.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.730+0000 7f3311d9b700 1 --2- 172.21.15.72:0/1412231255 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32fc004850 0x7f32fc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:19.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.730+0000 7f3311d9b700 1 --2- 172.21.15.72:0/1412231255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32fc005330 0x7f32fc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:19.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.730+0000 7f3311d9b700 1 -- 172.21.15.72:0/1412231255 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33141545d0 con 0x7f32fc004850 2023-07-27T20:32:19.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.730+0000 7f3311d9b700 1 -- 172.21.15.72:0/1412231255 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc00c230 con 0x7f32fc005330 2023-07-27T20:32:19.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.730+0000 7f3311d9b700 1 -- 172.21.15.72:0/1412231255 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc00c3f0 con 0x7f32fc003a50 2023-07-27T20:32:19.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.730+0000 7f331259c700 1 --2- 172.21.15.72:0/1412231255 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32fc004850 0x7f32fc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:19.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.730+0000 7f3312d9d700 1 --2- 172.21.15.72:0/1412231255 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f32fc003a50 0x7f32fc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:19.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.731+0000 7f331359e700 1 --2- 172.21.15.72:0/1412231255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32fc005330 0x7f32fc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:19.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.731+0000 7f331359e700 1 -- 172.21.15.72:0/1412231255 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f32fc003a50 msgr2=0x7f32fc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:19.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.731+0000 7f331359e700 1 --2- 172.21.15.72:0/1412231255 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f32fc003a50 0x7f32fc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:19.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.731+0000 7f331359e700 1 -- 172.21.15.72:0/1412231255 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32fc004850 msgr2=0x7f32fc004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:19.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.731+0000 7f331359e700 1 --2- 172.21.15.72:0/1412231255 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32fc004850 0x7f32fc004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:19.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.731+0000 7f331359e700 1 -- 172.21.15.72:0/1412231255 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32fc0035b0 con 0x7f32fc005330 2023-07-27T20:32:19.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.731+0000 7f331259c700 1 --2- 172.21.15.72:0/1412231255 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32fc004850 0x7f32fc004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:32:19.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.731+0000 7f3312d9d700 1 --2- 172.21.15.72:0/1412231255 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f32fc003a50 0x7f32fc003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:32:19.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.731+0000 7f331359e700 1 -- 172.21.15.72:0/1412231255 reap_dead start 2023-07-27T20:32:19.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.731+0000 7f331359e700 1 --2- 172.21.15.72:0/1412231255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32fc005330 0x7f32fc00ba10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f330c00a750 tx=0x7f32fc005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8398ced93c2fee6 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:19.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.731+0000 7f3311d9b700 1 -- 172.21.15.72:0/1412231255 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c00a210 con 0x7f32fc005330 2023-07-27T20:32:19.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.731+0000 7f3311d9b700 1 -- 172.21.15.72:0/1412231255 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330c007310 con 0x7f32fc005330 2023-07-27T20:32:19.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.731+0000 7f3311d9b700 1 -- 172.21.15.72:0/1412231255 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c0076c0 con 0x7f32fc005330 2023-07-27T20:32:19.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.732+0000 7f33191ff700 1 -- 172.21.15.72:0/1412231255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32fc005330 msgr2=0x7f32fc00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:19.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.732+0000 7f33191ff700 1 --2- 172.21.15.72:0/1412231255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32fc005330 0x7f32fc00ba10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f330c00a750 tx=0x7f32fc005880 comp rx=0 tx=0).stop 2023-07-27T20:32:19.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.732+0000 7f33191ff700 1 -- 172.21.15.72:0/1412231255 shutdown_connections 2023-07-27T20:32:19.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.732+0000 7f33191ff700 1 --2- 172.21.15.72:0/1412231255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32fc005330 0x7f32fc00ba10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:19.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.732+0000 7f33191ff700 1 -- 172.21.15.72:0/1412231255 >> 172.21.15.72:0/1412231255 conn(0x7f33140ab300 msgr2=0x7f33140ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:19.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.732+0000 7f33191ff700 1 -- 172.21.15.72:0/1412231255 shutdown_connections 2023-07-27T20:32:19.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.732+0000 7f33191ff700 1 -- 172.21.15.72:0/1412231255 wait complete. 2023-07-27T20:32:19.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.734+0000 7f33191ff700 1 Processor -- start 2023-07-27T20:32:19.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.734+0000 7f33191ff700 1 -- start start 2023-07-27T20:32:19.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.735+0000 7f33191ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32fc005330 0x7f331414cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:19.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.735+0000 7f33191ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33140c12d0 0x7f33140c33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:19.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.735+0000 7f33191ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f33140c3920 0x7f33141ec920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:19.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.735+0000 7f33191ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33140c20c0 con 0x7f32fc005330 2023-07-27T20:32:19.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.735+0000 7f33191ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33140c2fc0 con 0x7f33140c12d0 2023-07-27T20:32:19.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.735+0000 7f33191ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33140acc00 con 0x7f33140c3920 2023-07-27T20:32:19.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.735+0000 7f3312d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32fc005330 0x7f331414cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:19.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.735+0000 7f3312d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32fc005330 0x7f331414cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44272/0 (socket says 172.21.15.72:44272) 2023-07-27T20:32:19.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.735+0000 7f3312d9d700 1 -- 172.21.15.72:0/4063292280 learned_addr learned my addr 172.21.15.72:0/4063292280 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:19.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.735+0000 7f331359e700 1 --2- 172.21.15.72:0/4063292280 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f33140c3920 0x7f33141ec920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:19.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.735+0000 7f331259c700 1 --2- 172.21.15.72:0/4063292280 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33140c12d0 0x7f33140c33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:19.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.735+0000 7f3312d9d700 1 -- 172.21.15.72:0/4063292280 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f33140c3920 msgr2=0x7f33141ec920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:19.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.735+0000 7f3312d9d700 1 --2- 172.21.15.72:0/4063292280 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f33140c3920 0x7f33141ec920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:19.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.735+0000 7f3312d9d700 1 -- 172.21.15.72:0/4063292280 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33140c12d0 msgr2=0x7f33140c33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:19.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.735+0000 7f3312d9d700 1 --2- 172.21.15.72:0/4063292280 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33140c12d0 0x7f33140c33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:19.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.735+0000 7f3312d9d700 1 -- 172.21.15.72:0/4063292280 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33140c0c50 con 0x7f32fc005330 2023-07-27T20:32:19.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.736+0000 7f3312d9d700 1 --2- 172.21.15.72:0/4063292280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32fc005330 0x7f331414cea0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3304011d00 tx=0x7f330400f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:19.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.736+0000 7f32fb7fe700 1 -- 172.21.15.72:0/4063292280 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330400fb30 con 0x7f32fc005330 2023-07-27T20:32:19.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.736+0000 7f32fb7fe700 1 -- 172.21.15.72:0/4063292280 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330400fc90 con 0x7f32fc005330 2023-07-27T20:32:19.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.736+0000 7f32fb7fe700 1 -- 172.21.15.72:0/4063292280 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3304004020 con 0x7f32fc005330 2023-07-27T20:32:19.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.736+0000 7f33191ff700 1 -- 172.21.15.72:0/4063292280 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33140ad730 con 0x7f32fc005330 2023-07-27T20:32:19.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.736+0000 7f33191ff700 1 -- 172.21.15.72:0/4063292280 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33140adcf0 con 0x7f32fc005330 2023-07-27T20:32:19.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.737+0000 7f33191ff700 1 -- 172.21.15.72:0/4063292280 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3314074310 con 0x7f32fc005330 2023-07-27T20:32:19.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.738+0000 7f32fb7fe700 1 -- 172.21.15.72:0/4063292280 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3304004180 con 0x7f32fc005330 2023-07-27T20:32:19.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.739+0000 7f32fb7fe700 1 --2- 172.21.15.72:0/4063292280 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f330006ace0 0x7f330006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:19.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.739+0000 7f32fb7fe700 1 -- 172.21.15.72:0/4063292280 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3304089cd0 con 0x7f32fc005330 2023-07-27T20:32:19.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.739+0000 7f331259c700 1 --2- 172.21.15.72:0/4063292280 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f330006ace0 0x7f330006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:19.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.740+0000 7f331259c700 1 --2- 172.21.15.72:0/4063292280 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f330006ace0 0x7f330006d1a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3308007fd0 tx=0x7f3308009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:19.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.743+0000 7f32fb7fe700 1 -- 172.21.15.72:0/4063292280 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3304058570 con 0x7f32fc005330 2023-07-27T20:32:19.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.936+0000 7f33191ff700 1 -- 172.21.15.72:0/4063292280 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33140c3230 con 0x7f32fc005330 2023-07-27T20:32:19.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.937+0000 7f32fb7fe700 1 -- 172.21.15.72:0/4063292280 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20215 (secure 0 0 0) 0x7f3304075f10 con 0x7f32fc005330 2023-07-27T20:32:19.925 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:32:19.925 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":29,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:32:10.402254+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:31:27.020951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T20:31:27.566022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-27T20:31:31.182401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:32:19.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.939+0000 7f33191ff700 1 -- 172.21.15.72:0/4063292280 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f330006ace0 msgr2=0x7f330006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:19.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.939+0000 7f33191ff700 1 --2- 172.21.15.72:0/4063292280 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f330006ace0 0x7f330006d1a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3308007fd0 tx=0x7f3308009040 comp rx=0 tx=0).stop 2023-07-27T20:32:19.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.939+0000 7f33191ff700 1 -- 172.21.15.72:0/4063292280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32fc005330 msgr2=0x7f331414cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:19.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.939+0000 7f33191ff700 1 --2- 172.21.15.72:0/4063292280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32fc005330 0x7f331414cea0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3304011d00 tx=0x7f330400f520 comp rx=0 tx=0).stop 2023-07-27T20:32:19.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.939+0000 7f33191ff700 1 -- 172.21.15.72:0/4063292280 shutdown_connections 2023-07-27T20:32:19.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.939+0000 7f33191ff700 1 --2- 172.21.15.72:0/4063292280 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f330006ace0 0x7f330006d1a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:19.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.939+0000 7f33191ff700 1 --2- 172.21.15.72:0/4063292280 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f33140c3920 0x7f33141ec920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:19.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.939+0000 7f33191ff700 1 --2- 172.21.15.72:0/4063292280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32fc005330 0x7f331414cea0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:19.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.939+0000 7f33191ff700 1 --2- 172.21.15.72:0/4063292280 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33140c12d0 0x7f33140c33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:19.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.939+0000 7f33191ff700 1 -- 172.21.15.72:0/4063292280 >> 172.21.15.72:0/4063292280 conn(0x7f33140ab300 msgr2=0x7f3314150a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:19.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.939+0000 7f33191ff700 1 -- 172.21.15.72:0/4063292280 shutdown_connections 2023-07-27T20:32:19.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:19.939+0000 7f33191ff700 1 -- 172.21.15.72:0/4063292280 wait complete. 2023-07-27T20:32:19.945 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-27T20:31:14.581785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T20:31:21.077941+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T20:31:27.020951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T20:31:27.566022+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-27T20:31:31.182401+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-27T20:32:19.946 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-27T20:32:20.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.157+0000 7fc82b3ff700 1 Processor -- start 2023-07-27T20:32:20.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.158+0000 7fc82b3ff700 1 -- start start 2023-07-27T20:32:20.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.159+0000 7fc82b3ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc8241475a0 0x7fc8241516c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:20.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.159+0000 7fc82b3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc8240716f0 0x7fc824071b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:20.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.159+0000 7fc82b3ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc824154f50 con 0x7fc8240c12f0 2023-07-27T20:32:20.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.159+0000 7fc82b3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc824151c00 con 0x7fc8240716f0 2023-07-27T20:32:20.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.159+0000 7fc82b3ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc824154340 con 0x7fc8241475a0 2023-07-27T20:32:20.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.159+0000 7fc82999c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc8240716f0 0x7fc824071b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:20.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.159+0000 7fc82899a700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fc8240c12f0 0x7fc8240c1d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.72:39634/0 (socket says 172.21.15.72:39634) 2023-07-27T20:32:20.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.159+0000 7fc82899a700 1 -- 172.21.15.72:0/68267572 learned_addr learned my addr 172.21.15.72:0/68267572 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:20.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.159+0000 7fc82919b700 1 --2- 172.21.15.72:0/68267572 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc8241475a0 0x7fc8241516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:20.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.160+0000 7fc82999c700 1 -- 172.21.15.72:0/68267572 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc8241475a0 msgr2=0x7fc8241516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:20.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.160+0000 7fc82999c700 1 --2- 172.21.15.72:0/68267572 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc8241475a0 0x7fc8241516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:20.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.160+0000 7fc81bfff700 1 -- 172.21.15.72:0/68267572 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1193037268 0 0) 0x7fc824154f50 con 0x7fc8240c12f0 2023-07-27T20:32:20.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.160+0000 7fc82999c700 1 -- 172.21.15.72:0/68267572 >> v1:172.21.15.173:6789/0 conn(0x7fc8240c12f0 legacy=0x7fc8240c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:20.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.160+0000 7fc82999c700 1 -- 172.21.15.72:0/68267572 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc824154620 con 0x7fc8240716f0 2023-07-27T20:32:20.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.160+0000 7fc82999c700 1 --2- 172.21.15.72:0/68267572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8240716f0 0x7fc824071b60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc81c009d90 tx=0x7fc81c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b06b0d00c69c0771 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:20.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.160+0000 7fc81bfff700 1 -- 172.21.15.72:0/68267572 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c00e070 con 0x7fc8240716f0 2023-07-27T20:32:20.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.160+0000 7fc81bfff700 1 -- 172.21.15.72:0/68267572 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81c00bb20 con 0x7fc8240716f0 2023-07-27T20:32:20.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.160+0000 7fc81bfff700 1 -- 172.21.15.72:0/68267572 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c012430 con 0x7fc8240716f0 2023-07-27T20:32:20.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.161+0000 7fc82b3ff700 1 -- 172.21.15.72:0/68267572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8240716f0 msgr2=0x7fc824071b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:20.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.161+0000 7fc82b3ff700 1 --2- 172.21.15.72:0/68267572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8240716f0 0x7fc824071b60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc81c009d90 tx=0x7fc81c00b330 comp rx=0 tx=0).stop 2023-07-27T20:32:20.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.161+0000 7fc82b3ff700 1 -- 172.21.15.72:0/68267572 shutdown_connections 2023-07-27T20:32:20.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.161+0000 7fc82b3ff700 1 --2- 172.21.15.72:0/68267572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8240716f0 0x7fc824071b60 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:20.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.161+0000 7fc82b3ff700 1 --2- 172.21.15.72:0/68267572 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc8241475a0 0x7fc8241516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:20.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.161+0000 7fc82b3ff700 1 -- 172.21.15.72:0/68267572 >> 172.21.15.72:0/68267572 conn(0x7fc82406a190 msgr2=0x7fc82406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:20.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.161+0000 7fc82b3ff700 1 -- 172.21.15.72:0/68267572 shutdown_connections 2023-07-27T20:32:20.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.161+0000 7fc82b3ff700 1 -- 172.21.15.72:0/68267572 wait complete. 2023-07-27T20:32:20.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.162+0000 7fc82b3ff700 1 Processor -- start 2023-07-27T20:32:20.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.162+0000 7fc82b3ff700 1 -- start start 2023-07-27T20:32:20.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.163+0000 7fc82b3ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8240716f0 0x7fc8240c4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:20.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.163+0000 7fc82b3ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc8240c12f0 0x7fc8241537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:20.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.163+0000 7fc82b3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8241475a0 0x7fc8241ed2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:20.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.163+0000 7fc82b3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82415b430 con 0x7fc8241475a0 2023-07-27T20:32:20.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.163+0000 7fc82b3ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8240c3130 con 0x7fc8240716f0 2023-07-27T20:32:20.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.163+0000 7fc82b3ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8240c3410 con 0x7fc8240c12f0 2023-07-27T20:32:20.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.164+0000 7fc82999c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8241475a0 0x7fc8241ed2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:20.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.164+0000 7fc82999c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8241475a0 0x7fc8241ed2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40918/0 (socket says 172.21.15.72:40918) 2023-07-27T20:32:20.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.164+0000 7fc82999c700 1 -- 172.21.15.72:0/2583209588 learned_addr learned my addr 172.21.15.72:0/2583209588 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:20.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.164+0000 7fc82919b700 1 --2- 172.21.15.72:0/2583209588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8240716f0 0x7fc8240c4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:20.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.164+0000 7fc82899a700 1 --2- 172.21.15.72:0/2583209588 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc8240c12f0 0x7fc8241537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:20.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.164+0000 7fc82999c700 1 -- 172.21.15.72:0/2583209588 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc8240c12f0 msgr2=0x7fc8241537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:20.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.164+0000 7fc82999c700 1 --2- 172.21.15.72:0/2583209588 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc8240c12f0 0x7fc8241537d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:20.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.164+0000 7fc82999c700 1 -- 172.21.15.72:0/2583209588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8240716f0 msgr2=0x7fc8240c4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:20.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.164+0000 7fc82999c700 1 --2- 172.21.15.72:0/2583209588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8240716f0 0x7fc8240c4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:20.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.164+0000 7fc82999c700 1 -- 172.21.15.72:0/2583209588 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81c009a70 con 0x7fc8241475a0 2023-07-27T20:32:20.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.164+0000 7fc82899a700 1 --2- 172.21.15.72:0/2583209588 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc8240c12f0 0x7fc8241537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:20.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.164+0000 7fc82999c700 1 --2- 172.21.15.72:0/2583209588 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8241475a0 0x7fc8241ed2e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc8240c2b90 tx=0x7fc81c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:20.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.165+0000 7fc819ffb700 1 -- 172.21.15.72:0/2583209588 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c012430 con 0x7fc8241475a0 2023-07-27T20:32:20.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.165+0000 7fc819ffb700 1 -- 172.21.15.72:0/2583209588 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81c020070 con 0x7fc8241475a0 2023-07-27T20:32:20.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.165+0000 7fc82b3ff700 1 -- 172.21.15.72:0/2583209588 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8241ecde0 con 0x7fc8241475a0 2023-07-27T20:32:20.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.165+0000 7fc819ffb700 1 -- 172.21.15.72:0/2583209588 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c004280 con 0x7fc8241475a0 2023-07-27T20:32:20.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.165+0000 7fc82b3ff700 1 -- 172.21.15.72:0/2583209588 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc82415c060 con 0x7fc8241475a0 2023-07-27T20:32:20.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.166+0000 7fc82b3ff700 1 -- 172.21.15.72:0/2583209588 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc824145940 con 0x7fc8241475a0 2023-07-27T20:32:20.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.167+0000 7fc819ffb700 1 -- 172.21.15.72:0/2583209588 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc81c0043e0 con 0x7fc8241475a0 2023-07-27T20:32:20.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.167+0000 7fc819ffb700 1 --2- 172.21.15.72:0/2583209588 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc80806ace0 0x7fc80806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:20.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.168+0000 7fc819ffb700 1 -- 172.21.15.72:0/2583209588 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc81c022070 con 0x7fc8241475a0 2023-07-27T20:32:20.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.168+0000 7fc82919b700 1 --2- 172.21.15.72:0/2583209588 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc80806ace0 0x7fc80806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:20.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.169+0000 7fc82919b700 1 --2- 172.21.15.72:0/2583209588 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc80806ace0 0x7fc80806d1a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc820009b40 tx=0x7fc820009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:20.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.172+0000 7fc819ffb700 1 -- 172.21.15.72:0/2583209588 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc81c0565e0 con 0x7fc8241475a0 2023-07-27T20:32:20.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.365+0000 7fc82b3ff700 1 -- 172.21.15.72:0/2583209588 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc82404e470 con 0x7fc8241475a0 2023-07-27T20:32:20.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.365+0000 7fc819ffb700 1 -- 172.21.15.72:0/2583209588 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc81c059c00 con 0x7fc8241475a0 2023-07-27T20:32:20.353 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-27T20:32:20.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.368+0000 7fc82b3ff700 1 -- 172.21.15.72:0/2583209588 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc80806ace0 msgr2=0x7fc80806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:20.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.368+0000 7fc82b3ff700 1 --2- 172.21.15.72:0/2583209588 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc80806ace0 0x7fc80806d1a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc820009b40 tx=0x7fc820009210 comp rx=0 tx=0).stop 2023-07-27T20:32:20.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.368+0000 7fc82b3ff700 1 -- 172.21.15.72:0/2583209588 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8241475a0 msgr2=0x7fc8241ed2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:20.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.368+0000 7fc82b3ff700 1 --2- 172.21.15.72:0/2583209588 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8241475a0 0x7fc8241ed2e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc8240c2b90 tx=0x7fc81c004ad0 comp rx=0 tx=0).stop 2023-07-27T20:32:20.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.368+0000 7fc82b3ff700 1 -- 172.21.15.72:0/2583209588 shutdown_connections 2023-07-27T20:32:20.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.368+0000 7fc82b3ff700 1 --2- 172.21.15.72:0/2583209588 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8241475a0 0x7fc8241ed2e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:20.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.368+0000 7fc82b3ff700 1 --2- 172.21.15.72:0/2583209588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8240716f0 0x7fc8240c4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:20.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.368+0000 7fc82b3ff700 1 --2- 172.21.15.72:0/2583209588 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc80806ace0 0x7fc80806d1a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:20.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.368+0000 7fc82b3ff700 1 --2- 172.21.15.72:0/2583209588 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc8240c12f0 0x7fc8241537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:20.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.368+0000 7fc82b3ff700 1 -- 172.21.15.72:0/2583209588 >> 172.21.15.72:0/2583209588 conn(0x7fc82406a190 msgr2=0x7fc8240c5430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:20.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.368+0000 7fc82b3ff700 1 -- 172.21.15.72:0/2583209588 shutdown_connections 2023-07-27T20:32:20.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.368+0000 7fc82b3ff700 1 -- 172.21.15.72:0/2583209588 wait complete. 2023-07-27T20:32:20.373 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T20:32:20.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.584+0000 7f6c6d3ff700 1 Processor -- start 2023-07-27T20:32:20.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.584+0000 7f6c6d3ff700 1 -- start start 2023-07-27T20:32:20.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.585+0000 7f6c6d3ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6c6806c1d0 0x7f6c6806c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:20.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.585+0000 7f6c6d3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c680c7c50 con 0x7f6c680c7740 2023-07-27T20:32:20.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.585+0000 7f6c6d3ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c6806bd40 con 0x7f6c6814aab0 2023-07-27T20:32:20.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.585+0000 7f6c6d3ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c680c62f0 con 0x7f6c6806c1d0 2023-07-27T20:32:20.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.585+0000 7f6c667fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6c680c7740 0x7f6c680c41c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47428/0 (socket says 172.21.15.72:47428) 2023-07-27T20:32:20.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.585+0000 7f6c667fc700 1 -- 172.21.15.72:0/2130147243 learned_addr learned my addr 172.21.15.72:0/2130147243 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:20.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.586+0000 7f6c677fe700 1 --2- 172.21.15.72:0/2130147243 >> v2:172.21.15.173:3300/0 conn(0x7f6c6806c1d0 0x7f6c6806c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:20.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.586+0000 7f6c65ffb700 1 -- 172.21.15.72:0/2130147243 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2712493179 0 0) 0x7f6c680c7c50 con 0x7f6c680c7740 2023-07-27T20:32:20.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.586+0000 7f6c65ffb700 1 -- 172.21.15.72:0/2130147243 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c500035b0 con 0x7f6c680c7740 2023-07-27T20:32:20.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.586+0000 7f6c677fe700 1 -- 172.21.15.72:0/2130147243 >> v1:172.21.15.173:6789/0 conn(0x7f6c6814aab0 legacy=0x7f6c68154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:20.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.586+0000 7f6c677fe700 1 -- 172.21.15.72:0/2130147243 >> v1:172.21.15.72:6789/0 conn(0x7f6c680c7740 legacy=0x7f6c680c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:20.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.586+0000 7f6c677fe700 1 -- 172.21.15.72:0/2130147243 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c6806d200 con 0x7f6c6806c1d0 2023-07-27T20:32:20.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.586+0000 7f6c677fe700 1 --2- 172.21.15.72:0/2130147243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c6806c1d0 0x7f6c6806c5f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6c60009d90 tx=0x7f6c6000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4676cc8328ff75be server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:20.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.587+0000 7f6c65ffb700 1 -- 172.21.15.72:0/2130147243 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6000e070 con 0x7f6c6806c1d0 2023-07-27T20:32:20.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.587+0000 7f6c65ffb700 1 -- 172.21.15.72:0/2130147243 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6000bb20 con 0x7f6c6806c1d0 2023-07-27T20:32:20.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.587+0000 7f6c65ffb700 1 -- 172.21.15.72:0/2130147243 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c60012430 con 0x7f6c6806c1d0 2023-07-27T20:32:20.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.587+0000 7f6c6d3ff700 1 -- 172.21.15.72:0/2130147243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c6806c1d0 msgr2=0x7f6c6806c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:20.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.587+0000 7f6c6d3ff700 1 --2- 172.21.15.72:0/2130147243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c6806c1d0 0x7f6c6806c5f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6c60009d90 tx=0x7f6c6000b330 comp rx=0 tx=0).stop 2023-07-27T20:32:20.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.587+0000 7f6c6d3ff700 1 -- 172.21.15.72:0/2130147243 shutdown_connections 2023-07-27T20:32:20.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.587+0000 7f6c6d3ff700 1 --2- 172.21.15.72:0/2130147243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c6806c1d0 0x7f6c6806c5f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:20.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.587+0000 7f6c6d3ff700 1 -- 172.21.15.72:0/2130147243 >> 172.21.15.72:0/2130147243 conn(0x7f6c680ab3f0 msgr2=0x7f6c680ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:20.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.587+0000 7f6c6d3ff700 1 -- 172.21.15.72:0/2130147243 shutdown_connections 2023-07-27T20:32:20.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.587+0000 7f6c6d3ff700 1 -- 172.21.15.72:0/2130147243 wait complete. 2023-07-27T20:32:20.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.589+0000 7f6c6d3ff700 1 Processor -- start 2023-07-27T20:32:20.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.589+0000 7f6c6d3ff700 1 -- start start 2023-07-27T20:32:20.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.590+0000 7f6c6d3ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c6806c1d0 0x7f6c681e6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:20.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.590+0000 7f6c6d3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c680c7740 0x7f6c680be440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:20.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.590+0000 7f6c6d3ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6c6814aab0 0x7f6c681e9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:20.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.590+0000 7f6c6d3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c681e99d0 con 0x7f6c680c7740 2023-07-27T20:32:20.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.590+0000 7f6c6d3ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6814dee0 con 0x7f6c6806c1d0 2023-07-27T20:32:20.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.590+0000 7f6c6d3ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c681e7490 con 0x7f6c6814aab0 2023-07-27T20:32:20.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.590+0000 7f6c667fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c680c7740 0x7f6c680be440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:20.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.590+0000 7f6c667fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c680c7740 0x7f6c680be440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40922/0 (socket says 172.21.15.72:40922) 2023-07-27T20:32:20.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.590+0000 7f6c667fc700 1 -- 172.21.15.72:0/722080232 learned_addr learned my addr 172.21.15.72:0/722080232 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:20.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.590+0000 7f6c66ffd700 1 --2- 172.21.15.72:0/722080232 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c6806c1d0 0x7f6c681e6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:20.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.590+0000 7f6c677fe700 1 --2- 172.21.15.72:0/722080232 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6c6814aab0 0x7f6c681e9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:20.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.591+0000 7f6c667fc700 1 -- 172.21.15.72:0/722080232 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6c6814aab0 msgr2=0x7f6c681e9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:20.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.591+0000 7f6c667fc700 1 --2- 172.21.15.72:0/722080232 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6c6814aab0 0x7f6c681e9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:20.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.591+0000 7f6c667fc700 1 -- 172.21.15.72:0/722080232 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c6806c1d0 msgr2=0x7f6c681e6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:20.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.591+0000 7f6c667fc700 1 --2- 172.21.15.72:0/722080232 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c6806c1d0 0x7f6c681e6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:20.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.591+0000 7f6c667fc700 1 -- 172.21.15.72:0/722080232 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c60009a70 con 0x7f6c680c7740 2023-07-27T20:32:20.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.591+0000 7f6c66ffd700 1 --2- 172.21.15.72:0/722080232 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c6806c1d0 0x7f6c681e6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:20.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.591+0000 7f6c667fc700 1 --2- 172.21.15.72:0/722080232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c680c7740 0x7f6c680be440 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c00c700 tx=0x7f6c5c00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:20.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.591+0000 7f6c4f7fe700 1 -- 172.21.15.72:0/722080232 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c005d70 con 0x7f6c680c7740 2023-07-27T20:32:20.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.591+0000 7f6c4f7fe700 1 -- 172.21.15.72:0/722080232 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5c0070d0 con 0x7f6c680c7740 2023-07-27T20:32:20.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.591+0000 7f6c4f7fe700 1 -- 172.21.15.72:0/722080232 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c007460 con 0x7f6c680c7740 2023-07-27T20:32:20.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.591+0000 7f6c6d3ff700 1 -- 172.21.15.72:0/722080232 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c6814e130 con 0x7f6c680c7740 2023-07-27T20:32:20.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.591+0000 7f6c6d3ff700 1 -- 172.21.15.72:0/722080232 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c6814b210 con 0x7f6c680c7740 2023-07-27T20:32:20.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.592+0000 7f6c6d3ff700 1 -- 172.21.15.72:0/722080232 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c6804e470 con 0x7f6c680c7740 2023-07-27T20:32:20.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.593+0000 7f6c4f7fe700 1 -- 172.21.15.72:0/722080232 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6c5c0075c0 con 0x7f6c680c7740 2023-07-27T20:32:20.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.594+0000 7f6c4f7fe700 1 --2- 172.21.15.72:0/722080232 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f6c5406ace0 0x7f6c5406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:20.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.594+0000 7f6c4f7fe700 1 -- 172.21.15.72:0/722080232 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6c5c088e60 con 0x7f6c680c7740 2023-07-27T20:32:20.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.594+0000 7f6c66ffd700 1 --2- 172.21.15.72:0/722080232 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f6c5406ace0 0x7f6c5406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:20.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.595+0000 7f6c66ffd700 1 --2- 172.21.15.72:0/722080232 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f6c5406ace0 0x7f6c5406d1a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6c58000f60 tx=0x7f6c58009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:20.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.598+0000 7f6c4f7fe700 1 -- 172.21.15.72:0/722080232 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6c5c053b50 con 0x7f6c680c7740 2023-07-27T20:32:20.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.790+0000 7f6c6d3ff700 1 -- 172.21.15.72:0/722080232 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6c6806cf00 con 0x7f6c680c7740 2023-07-27T20:32:20.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.791+0000 7f6c4f7fe700 1 -- 172.21.15.72:0/722080232 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6c5c057170 con 0x7f6c680c7740 2023-07-27T20:32:20.779 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-27T20:32:20.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.793+0000 7f6c6d3ff700 1 -- 172.21.15.72:0/722080232 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f6c5406ace0 msgr2=0x7f6c5406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:20.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.793+0000 7f6c6d3ff700 1 --2- 172.21.15.72:0/722080232 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f6c5406ace0 0x7f6c5406d1a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6c58000f60 tx=0x7f6c58009040 comp rx=0 tx=0).stop 2023-07-27T20:32:20.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.793+0000 7f6c6d3ff700 1 -- 172.21.15.72:0/722080232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c680c7740 msgr2=0x7f6c680be440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:20.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.793+0000 7f6c6d3ff700 1 --2- 172.21.15.72:0/722080232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c680c7740 0x7f6c680be440 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c00c700 tx=0x7f6c5c00cac0 comp rx=0 tx=0).stop 2023-07-27T20:32:20.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.793+0000 7f6c6d3ff700 1 -- 172.21.15.72:0/722080232 shutdown_connections 2023-07-27T20:32:20.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.793+0000 7f6c6d3ff700 1 --2- 172.21.15.72:0/722080232 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f6c5406ace0 0x7f6c5406d1a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:20.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.793+0000 7f6c6d3ff700 1 --2- 172.21.15.72:0/722080232 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6c6814aab0 0x7f6c681e9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:20.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.793+0000 7f6c6d3ff700 1 --2- 172.21.15.72:0/722080232 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c6806c1d0 0x7f6c681e6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:20.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.793+0000 7f6c6d3ff700 1 --2- 172.21.15.72:0/722080232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c680c7740 0x7f6c680be440 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:20.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.793+0000 7f6c6d3ff700 1 -- 172.21.15.72:0/722080232 >> 172.21.15.72:0/722080232 conn(0x7f6c680ab3f0 msgr2=0x7f6c68153ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:20.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.793+0000 7f6c6d3ff700 1 -- 172.21.15.72:0/722080232 shutdown_connections 2023-07-27T20:32:20.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:20.793+0000 7f6c6d3ff700 1 -- 172.21.15.72:0/722080232 wait complete. 2023-07-27T20:32:20.798 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T20:32:20.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.008+0000 7ffbd37ff700 1 Processor -- start 2023-07-27T20:32:20.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.008+0000 7ffbd37ff700 1 -- start start 2023-07-27T20:32:20.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.010+0000 7ffbd37ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffbcc06e140 0x7ffbcc0ba310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:20.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.010+0000 7ffbd37ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbcc06ce10 con 0x7ffbcc0ba850 2023-07-27T20:32:20.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.010+0000 7ffbd37ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbcc152680 con 0x7ffbcc13b150 2023-07-27T20:32:20.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.010+0000 7ffbd37ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc152960 con 0x7ffbcc06e140 2023-07-27T20:32:20.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.010+0000 7ffbd1d9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ffbcc0ba850 0x7ffbcc06d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47440/0 (socket says 172.21.15.72:47440) 2023-07-27T20:32:20.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.010+0000 7ffbd1d9c700 1 -- 172.21.15.72:0/1549252119 learned_addr learned my addr 172.21.15.72:0/1549252119 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:20.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.010+0000 7ffbd0d9a700 1 --2- 172.21.15.72:0/1549252119 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffbcc06e140 0x7ffbcc0ba310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:21.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.010+0000 7ffbc3fff700 1 -- 172.21.15.72:0/1549252119 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3413028435 0 0) 0x7ffbcc06ce10 con 0x7ffbcc0ba850 2023-07-27T20:32:21.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.010+0000 7ffbc3fff700 1 -- 172.21.15.72:0/1549252119 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbb80035b0 con 0x7ffbcc0ba850 2023-07-27T20:32:21.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.011+0000 7ffbc3fff700 1 -- 172.21.15.72:0/1549252119 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2330661297 0 0) 0x7ffbcc152680 con 0x7ffbcc13b150 2023-07-27T20:32:21.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.011+0000 7ffbc3fff700 1 -- 172.21.15.72:0/1549252119 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbcc06ce10 con 0x7ffbcc13b150 2023-07-27T20:32:21.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.011+0000 7ffbd0d9a700 1 -- 172.21.15.72:0/1549252119 >> v1:172.21.15.173:6789/0 conn(0x7ffbcc13b150 legacy=0x7ffbcc151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:21.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.011+0000 7ffbd0d9a700 1 -- 172.21.15.72:0/1549252119 >> v1:172.21.15.72:6789/0 conn(0x7ffbcc0ba850 legacy=0x7ffbcc06d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:21.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.011+0000 7ffbd0d9a700 1 -- 172.21.15.72:0/1549252119 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbcc152c40 con 0x7ffbcc06e140 2023-07-27T20:32:21.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.011+0000 7ffbd0d9a700 1 --2- 172.21.15.72:0/1549252119 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffbcc06e140 0x7ffbcc0ba310 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc009870 tx=0x7ffbbc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f93909443a5831f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:21.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.011+0000 7ffbc3fff700 1 -- 172.21.15.72:0/1549252119 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc011830 con 0x7ffbcc06e140 2023-07-27T20:32:21.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.011+0000 7ffbc3fff700 1 -- 172.21.15.72:0/1549252119 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbbc011990 con 0x7ffbcc06e140 2023-07-27T20:32:21.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.011+0000 7ffbc3fff700 1 -- 172.21.15.72:0/1549252119 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc011d00 con 0x7ffbcc06e140 2023-07-27T20:32:21.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.012+0000 7ffbd37ff700 1 -- 172.21.15.72:0/1549252119 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffbcc06e140 msgr2=0x7ffbcc0ba310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:21.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.012+0000 7ffbd37ff700 1 --2- 172.21.15.72:0/1549252119 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffbcc06e140 0x7ffbcc0ba310 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc009870 tx=0x7ffbbc009b80 comp rx=0 tx=0).stop 2023-07-27T20:32:21.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.012+0000 7ffbd37ff700 1 -- 172.21.15.72:0/1549252119 shutdown_connections 2023-07-27T20:32:21.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.012+0000 7ffbd37ff700 1 --2- 172.21.15.72:0/1549252119 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffbcc06e140 0x7ffbcc0ba310 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:21.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.012+0000 7ffbd37ff700 1 -- 172.21.15.72:0/1549252119 >> 172.21.15.72:0/1549252119 conn(0x7ffbcc06a190 msgr2=0x7ffbcc06a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:21.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.012+0000 7ffbd37ff700 1 -- 172.21.15.72:0/1549252119 shutdown_connections 2023-07-27T20:32:21.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.012+0000 7ffbd37ff700 1 -- 172.21.15.72:0/1549252119 wait complete. 2023-07-27T20:32:21.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.014+0000 7ffbd37ff700 1 Processor -- start 2023-07-27T20:32:21.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.014+0000 7ffbd37ff700 1 -- start start 2023-07-27T20:32:21.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.015+0000 7ffbd37ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbcc06e140 0x7ffbcc0bd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:21.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.015+0000 7ffbd37ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffbcc0ba850 0x7ffbcc1ece80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:21.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.015+0000 7ffbd37ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffbcc13b150 0x7ffbcc136e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:21.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.015+0000 7ffbd37ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc137e90 con 0x7ffbcc06e140 2023-07-27T20:32:21.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.015+0000 7ffbd37ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc0bd870 con 0x7ffbcc13b150 2023-07-27T20:32:21.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.015+0000 7ffbd37ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc137bf0 con 0x7ffbcc0ba850 2023-07-27T20:32:21.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.015+0000 7ffbd159b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbcc06e140 0x7ffbcc0bd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:21.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.015+0000 7ffbd159b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbcc06e140 0x7ffbcc0bd330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40928/0 (socket says 172.21.15.72:40928) 2023-07-27T20:32:21.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.015+0000 7ffbd159b700 1 -- 172.21.15.72:0/2634263248 learned_addr learned my addr 172.21.15.72:0/2634263248 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:21.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.015+0000 7ffbd0d9a700 1 --2- 172.21.15.72:0/2634263248 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffbcc0ba850 0x7ffbcc1ece80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:21.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.015+0000 7ffbd1d9c700 1 --2- 172.21.15.72:0/2634263248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffbcc13b150 0x7ffbcc136e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:21.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.015+0000 7ffbd159b700 1 -- 172.21.15.72:0/2634263248 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffbcc0ba850 msgr2=0x7ffbcc1ece80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:21.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.015+0000 7ffbd159b700 1 --2- 172.21.15.72:0/2634263248 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffbcc0ba850 0x7ffbcc1ece80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:21.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.015+0000 7ffbd159b700 1 -- 172.21.15.72:0/2634263248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffbcc13b150 msgr2=0x7ffbcc136e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:21.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.015+0000 7ffbd159b700 1 --2- 172.21.15.72:0/2634263248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffbcc13b150 0x7ffbcc136e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:21.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.015+0000 7ffbd159b700 1 -- 172.21.15.72:0/2634263248 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbbc0094a0 con 0x7ffbcc06e140 2023-07-27T20:32:21.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.016+0000 7ffbd159b700 1 --2- 172.21.15.72:0/2634263248 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbcc06e140 0x7ffbcc0bd330 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800c450 tx=0x7ffbc800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:21.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.016+0000 7ffbc1ffb700 1 -- 172.21.15.72:0/2634263248 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc80052d0 con 0x7ffbcc06e140 2023-07-27T20:32:21.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.016+0000 7ffbc1ffb700 1 -- 172.21.15.72:0/2634263248 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc8005430 con 0x7ffbcc06e140 2023-07-27T20:32:21.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.016+0000 7ffbd37ff700 1 -- 172.21.15.72:0/2634263248 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbcc1dcab0 con 0x7ffbcc06e140 2023-07-27T20:32:21.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.016+0000 7ffbc1ffb700 1 -- 172.21.15.72:0/2634263248 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc80038c0 con 0x7ffbcc06e140 2023-07-27T20:32:21.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.016+0000 7ffbd37ff700 1 -- 172.21.15.72:0/2634263248 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbcc1edaa0 con 0x7ffbcc06e140 2023-07-27T20:32:21.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.017+0000 7ffbd37ff700 1 -- 172.21.15.72:0/2634263248 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbcc04e470 con 0x7ffbcc06e140 2023-07-27T20:32:21.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.018+0000 7ffbc1ffb700 1 -- 172.21.15.72:0/2634263248 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffbc8003a20 con 0x7ffbcc06e140 2023-07-27T20:32:21.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.019+0000 7ffbc1ffb700 1 --2- 172.21.15.72:0/2634263248 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ffbb006ace0 0x7ffbb006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:21.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.019+0000 7ffbc1ffb700 1 -- 172.21.15.72:0/2634263248 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ffbc8088aa0 con 0x7ffbcc06e140 2023-07-27T20:32:21.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.019+0000 7ffbd0d9a700 1 --2- 172.21.15.72:0/2634263248 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ffbb006ace0 0x7ffbb006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:21.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.020+0000 7ffbd0d9a700 1 --2- 172.21.15.72:0/2634263248 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ffbb006ace0 0x7ffbb006d1a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc0090b0 tx=0x7ffbbc01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:21.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.023+0000 7ffbc1ffb700 1 -- 172.21.15.72:0/2634263248 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ffbc80538b0 con 0x7ffbcc06e140 2023-07-27T20:32:21.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.224+0000 7ffbd37ff700 1 -- 172.21.15.72:0/2634263248 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffbcc1dcc40 con 0x7ffbcc06e140 2023-07-27T20:32:21.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.224+0000 7ffbc1ffb700 1 -- 172.21.15.72:0/2634263248 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffbc8056ed0 con 0x7ffbcc06e140 2023-07-27T20:32:21.212 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:32:21.213 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:32:21.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.227+0000 7ffbd37ff700 1 -- 172.21.15.72:0/2634263248 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ffbb006ace0 msgr2=0x7ffbb006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:21.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.227+0000 7ffbd37ff700 1 --2- 172.21.15.72:0/2634263248 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ffbb006ace0 0x7ffbb006d1a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc0090b0 tx=0x7ffbbc01c040 comp rx=0 tx=0).stop 2023-07-27T20:32:21.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.227+0000 7ffbd37ff700 1 -- 172.21.15.72:0/2634263248 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbcc06e140 msgr2=0x7ffbcc0bd330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:21.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.227+0000 7ffbd37ff700 1 --2- 172.21.15.72:0/2634263248 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbcc06e140 0x7ffbcc0bd330 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800c450 tx=0x7ffbc800c760 comp rx=0 tx=0).stop 2023-07-27T20:32:21.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.227+0000 7ffbd37ff700 1 -- 172.21.15.72:0/2634263248 shutdown_connections 2023-07-27T20:32:21.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.227+0000 7ffbd37ff700 1 --2- 172.21.15.72:0/2634263248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffbcc13b150 0x7ffbcc136e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:21.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.227+0000 7ffbd37ff700 1 --2- 172.21.15.72:0/2634263248 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbcc06e140 0x7ffbcc0bd330 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:21.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.227+0000 7ffbd37ff700 1 --2- 172.21.15.72:0/2634263248 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ffbb006ace0 0x7ffbb006d1a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:21.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.227+0000 7ffbd37ff700 1 --2- 172.21.15.72:0/2634263248 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffbcc0ba850 0x7ffbcc1ece80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:21.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.227+0000 7ffbd37ff700 1 -- 172.21.15.72:0/2634263248 >> 172.21.15.72:0/2634263248 conn(0x7ffbcc06a190 msgr2=0x7ffbcc1e06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:21.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.227+0000 7ffbd37ff700 1 -- 172.21.15.72:0/2634263248 shutdown_connections 2023-07-27T20:32:21.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.227+0000 7ffbd37ff700 1 -- 172.21.15.72:0/2634263248 wait complete. 2023-07-27T20:32:21.221 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:32:21.234 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T20:32:21.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.488+0000 7ffaca7ff700 1 Processor -- start 2023-07-27T20:32:21.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.488+0000 7ffaca7ff700 1 -- start start 2023-07-27T20:32:21.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.489+0000 7ffaca7ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffac414aab0 0x7ffac4154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:21.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.489+0000 7ffaca7ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffac406c1d0 0x7ffac406c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:21.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.489+0000 7ffaca7ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffac40c7c50 con 0x7ffac40c7740 2023-07-27T20:32:21.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.489+0000 7ffaca7ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffac406bd40 con 0x7ffac414aab0 2023-07-27T20:32:21.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.489+0000 7ffaca7ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac40c62f0 con 0x7ffac406c1d0 2023-07-27T20:32:21.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.489+0000 7ffac3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffac414aab0 0x7ffac4154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:21.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.490+0000 7ffac3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffac414aab0 0x7ffac4154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40942/0 (socket says 172.21.15.72:40942) 2023-07-27T20:32:21.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.490+0000 7ffac3fff700 1 -- 172.21.15.72:0/2488103523 learned_addr learned my addr 172.21.15.72:0/2488103523 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:21.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.490+0000 7ffac3fff700 1 -- 172.21.15.72:0/2488103523 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffac406c1d0 msgr2=0x7ffac406c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:21.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.490+0000 7ffac3fff700 1 --2- 172.21.15.72:0/2488103523 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffac406c1d0 0x7ffac406c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:21.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.490+0000 7ffac3fff700 1 -- 172.21.15.72:0/2488103523 >> v1:172.21.15.173:6789/0 conn(0x7ffac40c7740 legacy=0x7ffac40c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:21.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.490+0000 7ffac3fff700 1 -- 172.21.15.72:0/2488103523 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac4155050 con 0x7ffac414aab0 2023-07-27T20:32:21.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.490+0000 7ffac3fff700 1 --2- 172.21.15.72:0/2488103523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffac414aab0 0x7ffac4154b10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ffab40098f0 tx=0x7ffab4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57b90a1b0baa1d62 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:21.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.490+0000 7ffac2ffd700 1 -- 172.21.15.72:0/2488103523 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab4004230 con 0x7ffac414aab0 2023-07-27T20:32:21.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.490+0000 7ffac2ffd700 1 -- 172.21.15.72:0/2488103523 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab4004390 con 0x7ffac414aab0 2023-07-27T20:32:21.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.490+0000 7ffac2ffd700 1 -- 172.21.15.72:0/2488103523 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab40036a0 con 0x7ffac414aab0 2023-07-27T20:32:21.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.491+0000 7ffaca7ff700 1 -- 172.21.15.72:0/2488103523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffac414aab0 msgr2=0x7ffac4154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:21.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.491+0000 7ffaca7ff700 1 --2- 172.21.15.72:0/2488103523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffac414aab0 0x7ffac4154b10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ffab40098f0 tx=0x7ffab4009c00 comp rx=0 tx=0).stop 2023-07-27T20:32:21.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.491+0000 7ffaca7ff700 1 -- 172.21.15.72:0/2488103523 shutdown_connections 2023-07-27T20:32:21.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.491+0000 7ffaca7ff700 1 --2- 172.21.15.72:0/2488103523 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffac406c1d0 0x7ffac406c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:21.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.491+0000 7ffaca7ff700 1 --2- 172.21.15.72:0/2488103523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffac414aab0 0x7ffac4154b10 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:21.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.491+0000 7ffaca7ff700 1 -- 172.21.15.72:0/2488103523 >> 172.21.15.72:0/2488103523 conn(0x7ffac40ab3f0 msgr2=0x7ffac40ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:21.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.491+0000 7ffaca7ff700 1 -- 172.21.15.72:0/2488103523 shutdown_connections 2023-07-27T20:32:21.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.491+0000 7ffaca7ff700 1 -- 172.21.15.72:0/2488103523 wait complete. 2023-07-27T20:32:21.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.493+0000 7ffaca7ff700 1 Processor -- start 2023-07-27T20:32:21.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.493+0000 7ffaca7ff700 1 -- start start 2023-07-27T20:32:21.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.494+0000 7ffaca7ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffac406c1d0 0x7ffac4148b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:21.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.494+0000 7ffaca7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffac40c7740 0x7ffac41ed120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:21.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.494+0000 7ffaca7ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffac414aab0 0x7ffac41e9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:21.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.494+0000 7ffaca7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac41568e0 con 0x7ffac40c7740 2023-07-27T20:32:21.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.494+0000 7ffaca7ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac4157bd0 con 0x7ffac414aab0 2023-07-27T20:32:21.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.494+0000 7ffaca7ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac4157eb0 con 0x7ffac406c1d0 2023-07-27T20:32:21.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.494+0000 7ffac37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffac40c7740 0x7ffac41ed120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:21.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.494+0000 7ffac37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffac40c7740 0x7ffac41ed120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40954/0 (socket says 172.21.15.72:40954) 2023-07-27T20:32:21.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.494+0000 7ffac37fe700 1 -- 172.21.15.72:0/3425148476 learned_addr learned my addr 172.21.15.72:0/3425148476 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:21.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.494+0000 7ffac3fff700 1 --2- 172.21.15.72:0/3425148476 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffac406c1d0 0x7ffac4148b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:21.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.494+0000 7ffac37fe700 1 -- 172.21.15.72:0/3425148476 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffac406c1d0 msgr2=0x7ffac4148b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:21.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.494+0000 7ffac8d9c700 1 --2- 172.21.15.72:0/3425148476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffac414aab0 0x7ffac41e9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:21.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.494+0000 7ffac37fe700 1 --2- 172.21.15.72:0/3425148476 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffac406c1d0 0x7ffac4148b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:21.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.494+0000 7ffac37fe700 1 -- 172.21.15.72:0/3425148476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffac414aab0 msgr2=0x7ffac41e9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:21.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.494+0000 7ffac37fe700 1 --2- 172.21.15.72:0/3425148476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffac414aab0 0x7ffac41e9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:21.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.494+0000 7ffac37fe700 1 -- 172.21.15.72:0/3425148476 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab4009550 con 0x7ffac40c7740 2023-07-27T20:32:21.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.494+0000 7ffac3fff700 1 --2- 172.21.15.72:0/3425148476 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffac406c1d0 0x7ffac4148b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:32:21.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.494+0000 7ffac8d9c700 1 --2- 172.21.15.72:0/3425148476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffac414aab0 0x7ffac41e9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:32:21.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.495+0000 7ffac37fe700 1 --2- 172.21.15.72:0/3425148476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffac40c7740 0x7ffac41ed120 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ffab800c4a0 tx=0x7ffab800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:21.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.495+0000 7ffac0ff9700 1 -- 172.21.15.72:0/3425148476 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab80054e0 con 0x7ffac40c7740 2023-07-27T20:32:21.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.495+0000 7ffac0ff9700 1 -- 172.21.15.72:0/3425148476 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab8003680 con 0x7ffac40c7740 2023-07-27T20:32:21.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.495+0000 7ffac0ff9700 1 -- 172.21.15.72:0/3425148476 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab8003a30 con 0x7ffac40c7740 2023-07-27T20:32:21.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.495+0000 7ffaca7ff700 1 -- 172.21.15.72:0/3425148476 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac4158190 con 0x7ffac40c7740 2023-07-27T20:32:21.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.495+0000 7ffaca7ff700 1 -- 172.21.15.72:0/3425148476 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffac4149070 con 0x7ffac40c7740 2023-07-27T20:32:21.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.496+0000 7ffaca7ff700 1 -- 172.21.15.72:0/3425148476 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffac404e470 con 0x7ffac40c7740 2023-07-27T20:32:21.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.497+0000 7ffac0ff9700 1 -- 172.21.15.72:0/3425148476 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffab8003b90 con 0x7ffac40c7740 2023-07-27T20:32:21.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.498+0000 7ffac0ff9700 1 --2- 172.21.15.72:0/3425148476 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ffab006ace0 0x7ffab006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:21.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.498+0000 7ffac0ff9700 1 -- 172.21.15.72:0/3425148476 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ffab80888e0 con 0x7ffac40c7740 2023-07-27T20:32:21.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.499+0000 7ffac3fff700 1 --2- 172.21.15.72:0/3425148476 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ffab006ace0 0x7ffab006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:21.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.499+0000 7ffac3fff700 1 --2- 172.21.15.72:0/3425148476 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ffab006ace0 0x7ffab006d1a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ffab4009c40 tx=0x7ffab4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:21.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.503+0000 7ffac0ff9700 1 -- 172.21.15.72:0/3425148476 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ffab80535c0 con 0x7ffac40c7740 2023-07-27T20:32:21.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.697+0000 7ffaca7ff700 1 -- 172.21.15.72:0/3425148476 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffac406cf00 con 0x7ffac40c7740 2023-07-27T20:32:21.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.698+0000 7ffac0ff9700 1 -- 172.21.15.72:0/3425148476 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffab8056be0 con 0x7ffac40c7740 2023-07-27T20:32:21.685 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-27T20:32:21.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.700+0000 7ffaca7ff700 1 -- 172.21.15.72:0/3425148476 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ffab006ace0 msgr2=0x7ffab006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:21.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.700+0000 7ffaca7ff700 1 --2- 172.21.15.72:0/3425148476 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ffab006ace0 0x7ffab006d1a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ffab4009c40 tx=0x7ffab4008030 comp rx=0 tx=0).stop 2023-07-27T20:32:21.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.700+0000 7ffaca7ff700 1 -- 172.21.15.72:0/3425148476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffac40c7740 msgr2=0x7ffac41ed120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:21.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.700+0000 7ffaca7ff700 1 --2- 172.21.15.72:0/3425148476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffac40c7740 0x7ffac41ed120 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ffab800c4a0 tx=0x7ffab800c860 comp rx=0 tx=0).stop 2023-07-27T20:32:21.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.700+0000 7ffaca7ff700 1 -- 172.21.15.72:0/3425148476 shutdown_connections 2023-07-27T20:32:21.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.700+0000 7ffaca7ff700 1 --2- 172.21.15.72:0/3425148476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffac414aab0 0x7ffac41e9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:21.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.700+0000 7ffaca7ff700 1 --2- 172.21.15.72:0/3425148476 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ffab006ace0 0x7ffab006d1a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:21.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.700+0000 7ffaca7ff700 1 --2- 172.21.15.72:0/3425148476 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffac406c1d0 0x7ffac4148b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:21.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.700+0000 7ffaca7ff700 1 --2- 172.21.15.72:0/3425148476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffac40c7740 0x7ffac41ed120 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:21.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.700+0000 7ffaca7ff700 1 -- 172.21.15.72:0/3425148476 >> 172.21.15.72:0/3425148476 conn(0x7ffac40ab3f0 msgr2=0x7ffac406c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:21.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.700+0000 7ffaca7ff700 1 -- 172.21.15.72:0/3425148476 shutdown_connections 2023-07-27T20:32:21.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.700+0000 7ffaca7ff700 1 -- 172.21.15.72:0/3425148476 wait complete. 2023-07-27T20:32:21.705 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-27T20:32:21.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.915+0000 7f29fb9ff700 1 Processor -- start 2023-07-27T20:32:21.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.916+0000 7f29fb9ff700 1 -- start start 2023-07-27T20:32:21.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.917+0000 7f29fb9ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f29f414aab0 0x7f29f4154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:21.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.917+0000 7f29fb9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29f40c7c50 con 0x7f29f406c1d0 2023-07-27T20:32:21.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.917+0000 7f29fb9ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29f406bd40 con 0x7f29f40c7740 2023-07-27T20:32:21.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.917+0000 7f29fb9ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29f40c62f0 con 0x7f29f414aab0 2023-07-27T20:32:21.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.917+0000 7f29f9f9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f29f406c1d0 0x7f29f406c5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47446/0 (socket says 172.21.15.72:47446) 2023-07-27T20:32:21.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.917+0000 7f29f9f9c700 1 -- 172.21.15.72:0/627404270 learned_addr learned my addr 172.21.15.72:0/627404270 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:21.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.917+0000 7f29f979b700 1 --2- 172.21.15.72:0/627404270 >> v2:172.21.15.173:3300/0 conn(0x7f29f414aab0 0x7f29f4154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:21.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.917+0000 7f29ebfff700 1 -- 172.21.15.72:0/627404270 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 901315636 0 0) 0x7f29f40c7c50 con 0x7f29f406c1d0 2023-07-27T20:32:21.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.918+0000 7f29ebfff700 1 -- 172.21.15.72:0/627404270 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29e00035b0 con 0x7f29f406c1d0 2023-07-27T20:32:21.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.918+0000 7f29ebfff700 1 -- 172.21.15.72:0/627404270 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1096616210 0 0) 0x7f29e00035b0 con 0x7f29f406c1d0 2023-07-27T20:32:21.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.918+0000 7f29ebfff700 1 -- 172.21.15.72:0/627404270 >> v2:172.21.15.173:3300/0 conn(0x7f29f414aab0 msgr2=0x7f29f4154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:21.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.918+0000 7f29ebfff700 1 --2- 172.21.15.72:0/627404270 >> v2:172.21.15.173:3300/0 conn(0x7f29f414aab0 0x7f29f4154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:21.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.918+0000 7f29ebfff700 1 -- 172.21.15.72:0/627404270 >> v1:172.21.15.173:6789/0 conn(0x7f29f40c7740 legacy=0x7f29f40c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:21.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.918+0000 7f29ebfff700 1 -- 172.21.15.72:0/627404270 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f406cd00 con 0x7f29f406c1d0 2023-07-27T20:32:21.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.918+0000 7f29ebfff700 1 -- 172.21.15.72:0/627404270 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f29ec0019f0 con 0x7f29f406c1d0 2023-07-27T20:32:21.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.918+0000 7f29ebfff700 1 -- 172.21.15.72:0/627404270 >> v1:172.21.15.72:6789/0 conn(0x7f29f406c1d0 legacy=0x7f29f406c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:21.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.918+0000 7f29ebfff700 1 --2- 172.21.15.72:0/627404270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29e0003a00 0x7f29e0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:21.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.918+0000 7f29ebfff700 1 --2- 172.21.15.72:0/627404270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29e0004850 0x7f29e0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:21.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.918+0000 7f29ebfff700 1 --2- 172.21.15.72:0/627404270 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f29e0005210 0x7f29e000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:21.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.918+0000 7f29ebfff700 1 -- 172.21.15.72:0/627404270 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f40c62f0 con 0x7f29e0003a00 2023-07-27T20:32:21.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.918+0000 7f29ebfff700 1 -- 172.21.15.72:0/627404270 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e000c060 con 0x7f29e0004850 2023-07-27T20:32:21.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.918+0000 7f29ebfff700 1 -- 172.21.15.72:0/627404270 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e000c220 con 0x7f29e0005210 2023-07-27T20:32:21.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.918+0000 7f29f979b700 1 --2- 172.21.15.72:0/627404270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29e0003a00 0x7f29e0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:21.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.918+0000 7f29f8f9a700 1 --2- 172.21.15.72:0/627404270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29e0004850 0x7f29e0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:21.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.918+0000 7f29f9f9c700 1 --2- 172.21.15.72:0/627404270 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f29e0005210 0x7f29e000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:21.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.919+0000 7f29f979b700 1 -- 172.21.15.72:0/627404270 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f29e0005210 msgr2=0x7f29e000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:21.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.919+0000 7f29f979b700 1 --2- 172.21.15.72:0/627404270 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f29e0005210 0x7f29e000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:21.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.919+0000 7f29f979b700 1 -- 172.21.15.72:0/627404270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29e0004850 msgr2=0x7f29e0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:21.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.919+0000 7f29f979b700 1 --2- 172.21.15.72:0/627404270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29e0004850 0x7f29e0004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:21.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.919+0000 7f29f979b700 1 -- 172.21.15.72:0/627404270 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e00035b0 con 0x7f29e0003a00 2023-07-27T20:32:21.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.919+0000 7f29f9f9c700 1 -- 172.21.15.72:0/627404270 reap_dead start 2023-07-27T20:32:21.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.919+0000 7f29f979b700 1 --2- 172.21.15.72:0/627404270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29e0003a00 0x7f29e0003de0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f29f0009b60 tx=0x7f29e0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9557de4c22298ab3 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:21.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.919+0000 7f29ebfff700 1 -- 172.21.15.72:0/627404270 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f000e6c0 con 0x7f29e0003a00 2023-07-27T20:32:21.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.919+0000 7f29ebfff700 1 -- 172.21.15.72:0/627404270 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f000e820 con 0x7f29e0003a00 2023-07-27T20:32:21.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.919+0000 7f29ebfff700 1 -- 172.21.15.72:0/627404270 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f000ebb0 con 0x7f29e0003a00 2023-07-27T20:32:21.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.920+0000 7f29fb9ff700 1 -- 172.21.15.72:0/627404270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29e0003a00 msgr2=0x7f29e0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:21.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.920+0000 7f29fb9ff700 1 --2- 172.21.15.72:0/627404270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29e0003a00 0x7f29e0003de0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f29f0009b60 tx=0x7f29e0005880 comp rx=0 tx=0).stop 2023-07-27T20:32:21.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.920+0000 7f29fb9ff700 1 -- 172.21.15.72:0/627404270 shutdown_connections 2023-07-27T20:32:21.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.920+0000 7f29fb9ff700 1 --2- 172.21.15.72:0/627404270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29e0003a00 0x7f29e0003de0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:21.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.920+0000 7f29fb9ff700 1 -- 172.21.15.72:0/627404270 >> 172.21.15.72:0/627404270 conn(0x7f29f40ab3f0 msgr2=0x7f29f40ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:21.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.920+0000 7f29fb9ff700 1 -- 172.21.15.72:0/627404270 shutdown_connections 2023-07-27T20:32:21.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.920+0000 7f29fb9ff700 1 -- 172.21.15.72:0/627404270 wait complete. 2023-07-27T20:32:21.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.922+0000 7f29fb9ff700 1 Processor -- start 2023-07-27T20:32:21.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.922+0000 7f29fb9ff700 1 -- start start 2023-07-27T20:32:21.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.924+0000 7f29fb9ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29e0003a00 0x7f29f4157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:21.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.924+0000 7f29fb9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29f40adf10 0x7f29f4158240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:21.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.924+0000 7f29fb9ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f29f41ec870 0x7f29f41ecd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:21.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.924+0000 7f29fb9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f40ae4b0 con 0x7f29f40adf10 2023-07-27T20:32:21.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.924+0000 7f29fb9ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f40ae790 con 0x7f29e0003a00 2023-07-27T20:32:21.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.924+0000 7f29fb9ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29f40aea70 con 0x7f29f41ec870 2023-07-27T20:32:21.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.924+0000 7f29f8f9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29f40adf10 0x7f29f4158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:21.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.924+0000 7f29f8f9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29f40adf10 0x7f29f4158240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40964/0 (socket says 172.21.15.72:40964) 2023-07-27T20:32:21.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.924+0000 7f29f8f9a700 1 -- 172.21.15.72:0/1735293734 learned_addr learned my addr 172.21.15.72:0/1735293734 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:21.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.924+0000 7f29f979b700 1 --2- 172.21.15.72:0/1735293734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29e0003a00 0x7f29f4157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:21.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.924+0000 7f29f9f9c700 1 --2- 172.21.15.72:0/1735293734 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f29f41ec870 0x7f29f41ecd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:21.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.924+0000 7f29f8f9a700 1 -- 172.21.15.72:0/1735293734 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f29f41ec870 msgr2=0x7f29f41ecd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:21.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.924+0000 7f29f8f9a700 1 --2- 172.21.15.72:0/1735293734 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f29f41ec870 0x7f29f41ecd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:21.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.924+0000 7f29f8f9a700 1 -- 172.21.15.72:0/1735293734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29e0003a00 msgr2=0x7f29f4157d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:21.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.924+0000 7f29f8f9a700 1 --2- 172.21.15.72:0/1735293734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29e0003a00 0x7f29f4157d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:21.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.924+0000 7f29f8f9a700 1 -- 172.21.15.72:0/1735293734 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f40aed50 con 0x7f29f40adf10 2023-07-27T20:32:21.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.924+0000 7f29f8f9a700 1 --2- 172.21.15.72:0/1735293734 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29f40adf10 0x7f29f4158240 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f29e400f770 tx=0x7f29e400fa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:21.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.925+0000 7f29e9ffb700 1 -- 172.21.15.72:0/1735293734 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e40052e0 con 0x7f29f40adf10 2023-07-27T20:32:21.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.925+0000 7f29e9ffb700 1 -- 172.21.15.72:0/1735293734 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e4005480 con 0x7f29f40adf10 2023-07-27T20:32:21.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.925+0000 7f29fb9ff700 1 -- 172.21.15.72:0/1735293734 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f41ea590 con 0x7f29f40adf10 2023-07-27T20:32:21.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.925+0000 7f29e9ffb700 1 -- 172.21.15.72:0/1735293734 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e40038c0 con 0x7f29f40adf10 2023-07-27T20:32:21.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.925+0000 7f29fb9ff700 1 -- 172.21.15.72:0/1735293734 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f41ed240 con 0x7f29f40adf10 2023-07-27T20:32:21.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.926+0000 7f29fb9ff700 1 -- 172.21.15.72:0/1735293734 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f41ea7d0 con 0x7f29f40adf10 2023-07-27T20:32:21.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.927+0000 7f29e9ffb700 1 -- 172.21.15.72:0/1735293734 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f29e4003a20 con 0x7f29f40adf10 2023-07-27T20:32:21.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.928+0000 7f29e9ffb700 1 --2- 172.21.15.72:0/1735293734 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f29d806ace0 0x7f29d806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:21.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.928+0000 7f29e9ffb700 1 -- 172.21.15.72:0/1735293734 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f29e4089380 con 0x7f29f40adf10 2023-07-27T20:32:21.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.929+0000 7f29f979b700 1 --2- 172.21.15.72:0/1735293734 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f29d806ace0 0x7f29d806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:21.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.929+0000 7f29f979b700 1 --2- 172.21.15.72:0/1735293734 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f29d806ace0 0x7f29d806d1a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f29f00090b0 tx=0x7f29f001e040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:21.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:21.933+0000 7f29e9ffb700 1 -- 172.21.15.72:0/1735293734 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f29f41ea7d0 con 0x7f29f40adf10 2023-07-27T20:32:22.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.129+0000 7f29fb9ff700 1 -- 172.21.15.72:0/1735293734 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f29f41ea780 con 0x7f29f40adf10 2023-07-27T20:32:22.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.130+0000 7f29e9ffb700 1 -- 172.21.15.72:0/1735293734 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f29e4054190 con 0x7f29f40adf10 2023-07-27T20:32:22.117 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:32:22.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.132+0000 7f29fb9ff700 1 -- 172.21.15.72:0/1735293734 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f29d806ace0 msgr2=0x7f29d806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:22.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.132+0000 7f29fb9ff700 1 --2- 172.21.15.72:0/1735293734 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f29d806ace0 0x7f29d806d1a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f29f00090b0 tx=0x7f29f001e040 comp rx=0 tx=0).stop 2023-07-27T20:32:22.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.132+0000 7f29fb9ff700 1 -- 172.21.15.72:0/1735293734 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29f40adf10 msgr2=0x7f29f4158240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:22.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.132+0000 7f29fb9ff700 1 --2- 172.21.15.72:0/1735293734 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29f40adf10 0x7f29f4158240 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f29e400f770 tx=0x7f29e400fa80 comp rx=0 tx=0).stop 2023-07-27T20:32:22.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.132+0000 7f29fb9ff700 1 -- 172.21.15.72:0/1735293734 shutdown_connections 2023-07-27T20:32:22.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.132+0000 7f29fb9ff700 1 --2- 172.21.15.72:0/1735293734 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f29d806ace0 0x7f29d806d1a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:22.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.132+0000 7f29fb9ff700 1 --2- 172.21.15.72:0/1735293734 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f29f41ec870 0x7f29f41ecd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:22.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.132+0000 7f29fb9ff700 1 --2- 172.21.15.72:0/1735293734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29e0003a00 0x7f29f4157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:22.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.132+0000 7f29fb9ff700 1 --2- 172.21.15.72:0/1735293734 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29f40adf10 0x7f29f4158240 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:22.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.132+0000 7f29fb9ff700 1 -- 172.21.15.72:0/1735293734 >> 172.21.15.72:0/1735293734 conn(0x7f29f40ab3f0 msgr2=0x7f29f40c7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:22.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.132+0000 7f29fb9ff700 1 -- 172.21.15.72:0/1735293734 shutdown_connections 2023-07-27T20:32:22.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.132+0000 7f29fb9ff700 1 -- 172.21.15.72:0/1735293734 wait complete. 2023-07-27T20:32:22.137 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:32:22.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.346+0000 7f2c9f9ff700 1 Processor -- start 2023-07-27T20:32:22.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.346+0000 7f2c9f9ff700 1 -- start start 2023-07-27T20:32:22.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.348+0000 7f2c9f9ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2c98139f80 0x7f2c980c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:22.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.348+0000 7f2c9f9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c980c1810 con 0x7f2c981542e0 2023-07-27T20:32:22.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.348+0000 7f2c9f9ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c98139d40 con 0x7f2c98139960 2023-07-27T20:32:22.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.348+0000 7f2c9f9ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c980c0ee0 con 0x7f2c98139f80 2023-07-27T20:32:22.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.348+0000 7f2c9df9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2c981542e0 0x7f2c98154710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47460/0 (socket says 172.21.15.72:47460) 2023-07-27T20:32:22.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.348+0000 7f2c9df9c700 1 -- 172.21.15.72:0/2175464109 learned_addr learned my addr 172.21.15.72:0/2175464109 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:22.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.348+0000 7f2c9cf9a700 1 --2- 172.21.15.72:0/2175464109 >> v2:172.21.15.173:3300/0 conn(0x7f2c98139f80 0x7f2c980c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:22.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.348+0000 7f2c8ffff700 1 -- 172.21.15.72:0/2175464109 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2746605315 0 0) 0x7f2c980c1810 con 0x7f2c981542e0 2023-07-27T20:32:22.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.348+0000 7f2c8ffff700 1 -- 172.21.15.72:0/2175464109 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c840057c0 con 0x7f2c981542e0 2023-07-27T20:32:22.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.348+0000 7f2c8ffff700 1 -- 172.21.15.72:0/2175464109 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 447047104 0 0) 0x7f2c98139d40 con 0x7f2c98139960 2023-07-27T20:32:22.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.348+0000 7f2c8ffff700 1 -- 172.21.15.72:0/2175464109 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c980c1810 con 0x7f2c98139960 2023-07-27T20:32:22.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.349+0000 7f2c9cf9a700 1 -- 172.21.15.72:0/2175464109 >> v1:172.21.15.173:6789/0 conn(0x7f2c98139960 legacy=0x7f2c980c1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:22.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.349+0000 7f2c9cf9a700 1 -- 172.21.15.72:0/2175464109 >> v1:172.21.15.72:6789/0 conn(0x7f2c981542e0 legacy=0x7f2c98154710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:22.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.349+0000 7f2c9cf9a700 1 -- 172.21.15.72:0/2175464109 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c98151060 con 0x7f2c98139f80 2023-07-27T20:32:22.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.349+0000 7f2c9cf9a700 1 --2- 172.21.15.72:0/2175464109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c98139f80 0x7f2c980c12d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2c88009840 tx=0x7f2c88009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b4f8e0a1aafd2cc server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:22.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.349+0000 7f2c8ffff700 1 -- 172.21.15.72:0/2175464109 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c88011830 con 0x7f2c98139f80 2023-07-27T20:32:22.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.349+0000 7f2c8ffff700 1 -- 172.21.15.72:0/2175464109 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c88011990 con 0x7f2c98139f80 2023-07-27T20:32:22.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.349+0000 7f2c8ffff700 1 -- 172.21.15.72:0/2175464109 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c88011d20 con 0x7f2c98139f80 2023-07-27T20:32:22.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.350+0000 7f2c9f9ff700 1 -- 172.21.15.72:0/2175464109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c98139f80 msgr2=0x7f2c980c12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:22.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.350+0000 7f2c9f9ff700 1 --2- 172.21.15.72:0/2175464109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c98139f80 0x7f2c980c12d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2c88009840 tx=0x7f2c88009b50 comp rx=0 tx=0).stop 2023-07-27T20:32:22.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.350+0000 7f2c9f9ff700 1 -- 172.21.15.72:0/2175464109 shutdown_connections 2023-07-27T20:32:22.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.350+0000 7f2c9f9ff700 1 --2- 172.21.15.72:0/2175464109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c98139f80 0x7f2c980c12d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:22.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.350+0000 7f2c9f9ff700 1 -- 172.21.15.72:0/2175464109 >> 172.21.15.72:0/2175464109 conn(0x7f2c9806a190 msgr2=0x7f2c9806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:22.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.350+0000 7f2c9f9ff700 1 -- 172.21.15.72:0/2175464109 shutdown_connections 2023-07-27T20:32:22.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.350+0000 7f2c9f9ff700 1 -- 172.21.15.72:0/2175464109 wait complete. 2023-07-27T20:32:22.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.351+0000 7f2c9f9ff700 1 Processor -- start 2023-07-27T20:32:22.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.352+0000 7f2c9f9ff700 1 -- start start 2023-07-27T20:32:22.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.352+0000 7f2c9f9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c98139960 0x7f2c98152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:22.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.352+0000 7f2c9f9ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2c98139f80 0x7f2c980a9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:22.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.353+0000 7f2c9f9ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c981542e0 0x7f2c9814ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:22.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.353+0000 7f2c9f9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c98153500 con 0x7f2c98139960 2023-07-27T20:32:22.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.353+0000 7f2c9f9ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c98153770 con 0x7f2c981542e0 2023-07-27T20:32:22.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.353+0000 7f2c9f9ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c98153a50 con 0x7f2c98139f80 2023-07-27T20:32:22.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.353+0000 7f2c9d79b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c98139960 0x7f2c98152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:22.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.353+0000 7f2c9d79b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c98139960 0x7f2c98152fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40972/0 (socket says 172.21.15.72:40972) 2023-07-27T20:32:22.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.353+0000 7f2c9d79b700 1 -- 172.21.15.72:0/1488243417 learned_addr learned my addr 172.21.15.72:0/1488243417 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:22.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.353+0000 7f2c9d79b700 1 -- 172.21.15.72:0/1488243417 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2c98139f80 msgr2=0x7f2c980a9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:22.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.353+0000 7f2c9d79b700 1 --2- 172.21.15.72:0/1488243417 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2c98139f80 0x7f2c980a9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:22.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.353+0000 7f2c9d79b700 1 -- 172.21.15.72:0/1488243417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c981542e0 msgr2=0x7f2c9814ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:22.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.353+0000 7f2c9d79b700 1 --2- 172.21.15.72:0/1488243417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c981542e0 0x7f2c9814ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:22.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.353+0000 7f2c9d79b700 1 -- 172.21.15.72:0/1488243417 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c880094a0 con 0x7f2c98139960 2023-07-27T20:32:22.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.353+0000 7f2c9d79b700 1 --2- 172.21.15.72:0/1488243417 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c98139960 0x7f2c98152fc0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2c9400c500 tx=0x7f2c9400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:22.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.354+0000 7f2c8dffb700 1 -- 172.21.15.72:0/1488243417 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c940052d0 con 0x7f2c98139960 2023-07-27T20:32:22.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.354+0000 7f2c8dffb700 1 -- 172.21.15.72:0/1488243417 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c94005450 con 0x7f2c98139960 2023-07-27T20:32:22.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.354+0000 7f2c8dffb700 1 -- 172.21.15.72:0/1488243417 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c940038c0 con 0x7f2c98139960 2023-07-27T20:32:22.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.354+0000 7f2c9f9ff700 1 -- 172.21.15.72:0/1488243417 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c9814ef70 con 0x7f2c98139960 2023-07-27T20:32:22.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.354+0000 7f2c9f9ff700 1 -- 172.21.15.72:0/1488243417 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c9814f530 con 0x7f2c98139960 2023-07-27T20:32:22.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.355+0000 7f2c9f9ff700 1 -- 172.21.15.72:0/1488243417 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c98074310 con 0x7f2c98139960 2023-07-27T20:32:22.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.356+0000 7f2c8dffb700 1 -- 172.21.15.72:0/1488243417 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2c94003a20 con 0x7f2c98139960 2023-07-27T20:32:22.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.356+0000 7f2c8dffb700 1 --2- 172.21.15.72:0/1488243417 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f2c7c06ad10 0x7f2c7c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:22.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.357+0000 7f2c8dffb700 1 -- 172.21.15.72:0/1488243417 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2c94088c80 con 0x7f2c98139960 2023-07-27T20:32:22.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.357+0000 7f2c9cf9a700 1 --2- 172.21.15.72:0/1488243417 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f2c7c06ad10 0x7f2c7c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:22.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.358+0000 7f2c9cf9a700 1 --2- 172.21.15.72:0/1488243417 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f2c7c06ad10 0x7f2c7c06d1d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2c88009840 tx=0x7f2c88010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:22.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.361+0000 7f2c8dffb700 1 -- 172.21.15.72:0/1488243417 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2c940539f0 con 0x7f2c98139960 2023-07-27T20:32:22.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.553+0000 7f2c9f9ff700 1 -- 172.21.15.72:0/1488243417 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c980bf570 con 0x7f2c98139960 2023-07-27T20:32:22.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.555+0000 7f2c8dffb700 1 -- 172.21.15.72:0/1488243417 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20215 (secure 0 0 0) 0x7f2c94057010 con 0x7f2c98139960 2023-07-27T20:32:22.544 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:32:22.544 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":29,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:32:10.402254+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:31:27.020951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T20:31:27.566022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-27T20:31:31.182401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:32:22.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.557+0000 7f2c9f9ff700 1 -- 172.21.15.72:0/1488243417 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f2c7c06ad10 msgr2=0x7f2c7c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:22.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.557+0000 7f2c9f9ff700 1 --2- 172.21.15.72:0/1488243417 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f2c7c06ad10 0x7f2c7c06d1d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2c88009840 tx=0x7f2c88010000 comp rx=0 tx=0).stop 2023-07-27T20:32:22.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.557+0000 7f2c9f9ff700 1 -- 172.21.15.72:0/1488243417 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c98139960 msgr2=0x7f2c98152fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:22.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.557+0000 7f2c9f9ff700 1 --2- 172.21.15.72:0/1488243417 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c98139960 0x7f2c98152fc0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2c9400c500 tx=0x7f2c9400c8c0 comp rx=0 tx=0).stop 2023-07-27T20:32:22.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.557+0000 7f2c9f9ff700 1 -- 172.21.15.72:0/1488243417 shutdown_connections 2023-07-27T20:32:22.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.557+0000 7f2c9f9ff700 1 --2- 172.21.15.72:0/1488243417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c981542e0 0x7f2c9814ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:22.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.557+0000 7f2c9f9ff700 1 --2- 172.21.15.72:0/1488243417 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c98139960 0x7f2c98152fc0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:22.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.557+0000 7f2c9f9ff700 1 --2- 172.21.15.72:0/1488243417 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f2c7c06ad10 0x7f2c7c06d1d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:22.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.557+0000 7f2c9f9ff700 1 --2- 172.21.15.72:0/1488243417 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2c98139f80 0x7f2c980a9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:22.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.557+0000 7f2c9f9ff700 1 -- 172.21.15.72:0/1488243417 >> 172.21.15.72:0/1488243417 conn(0x7f2c9806a190 msgr2=0x7f2c98136650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:22.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.558+0000 7f2c9f9ff700 1 -- 172.21.15.72:0/1488243417 shutdown_connections 2023-07-27T20:32:22.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.558+0000 7f2c9f9ff700 1 -- 172.21.15.72:0/1488243417 wait complete. 2023-07-27T20:32:22.564 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-27T20:31:14.581785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T20:31:21.077941+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T20:31:27.020951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T20:31:27.566022+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-27T20:31:31.182401+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-27T20:32:22.565 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-27T20:32:22.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.776+0000 7f3956dff700 1 Processor -- start 2023-07-27T20:32:22.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.776+0000 7f3956dff700 1 -- start start 2023-07-27T20:32:22.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.777+0000 7f3956dff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f39500c12f0 0x7f39501516c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:22.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.777+0000 7f3956dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3950154f50 con 0x7f39500716f0 2023-07-27T20:32:22.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.777+0000 7f3956dff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3950154340 con 0x7f39501475a0 2023-07-27T20:32:22.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.778+0000 7f3956dff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3950151c00 con 0x7f39500c12f0 2023-07-27T20:32:22.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.778+0000 7f395539c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f39500716f0 0x7f3950071b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47470/0 (socket says 172.21.15.72:47470) 2023-07-27T20:32:22.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.778+0000 7f395539c700 1 -- 172.21.15.72:0/4043441108 learned_addr learned my addr 172.21.15.72:0/4043441108 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:22.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.778+0000 7f394ffff700 1 --2- 172.21.15.72:0/4043441108 >> v2:172.21.15.173:3300/0 conn(0x7f39500c12f0 0x7f39501516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:22.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.778+0000 7f394f7fe700 1 -- 172.21.15.72:0/4043441108 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 859889681 0 0) 0x7f3950154f50 con 0x7f39500716f0 2023-07-27T20:32:22.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.778+0000 7f394f7fe700 1 -- 172.21.15.72:0/4043441108 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39400035b0 con 0x7f39500716f0 2023-07-27T20:32:22.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.778+0000 7f394f7fe700 1 -- 172.21.15.72:0/4043441108 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 689356342 0 0) 0x7f3950154340 con 0x7f39501475a0 2023-07-27T20:32:22.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.778+0000 7f394f7fe700 1 -- 172.21.15.72:0/4043441108 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3950154f50 con 0x7f39501475a0 2023-07-27T20:32:22.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.778+0000 7f394f7fe700 1 -- 172.21.15.72:0/4043441108 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1957448392 0 0) 0x7f39400035b0 con 0x7f39500716f0 2023-07-27T20:32:22.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.778+0000 7f394f7fe700 1 -- 172.21.15.72:0/4043441108 >> v2:172.21.15.173:3300/0 conn(0x7f39500c12f0 msgr2=0x7f39501516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:22.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.778+0000 7f394f7fe700 1 --2- 172.21.15.72:0/4043441108 >> v2:172.21.15.173:3300/0 conn(0x7f39500c12f0 0x7f39501516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:22.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.778+0000 7f394f7fe700 1 -- 172.21.15.72:0/4043441108 >> v1:172.21.15.173:6789/0 conn(0x7f39501475a0 legacy=0x7f39500c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:22.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.779+0000 7f394f7fe700 1 -- 172.21.15.72:0/4043441108 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3950154620 con 0x7f39500716f0 2023-07-27T20:32:22.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.779+0000 7f394f7fe700 1 -- 172.21.15.72:0/4043441108 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f39480019f0 con 0x7f39500716f0 2023-07-27T20:32:22.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.779+0000 7f394f7fe700 1 -- 172.21.15.72:0/4043441108 >> v1:172.21.15.72:6789/0 conn(0x7f39500716f0 legacy=0x7f3950071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:22.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.779+0000 7f394f7fe700 1 --2- 172.21.15.72:0/4043441108 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3940003b90 0x7f3940003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:22.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.779+0000 7f394f7fe700 1 --2- 172.21.15.72:0/4043441108 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3940004850 0x7f3940004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:22.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.779+0000 7f394f7fe700 1 --2- 172.21.15.72:0/4043441108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3940005210 0x7f394000dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:22.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.779+0000 7f394f7fe700 1 -- 172.21.15.72:0/4043441108 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3950151c00 con 0x7f3940005210 2023-07-27T20:32:22.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.779+0000 7f394f7fe700 1 -- 172.21.15.72:0/4043441108 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394000e2a0 con 0x7f3940004850 2023-07-27T20:32:22.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.779+0000 7f394f7fe700 1 -- 172.21.15.72:0/4043441108 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394000e460 con 0x7f3940003b90 2023-07-27T20:32:22.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.779+0000 7f395539c700 1 --2- 172.21.15.72:0/4043441108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3940005210 0x7f394000dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:22.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.779+0000 7f3954b9b700 1 --2- 172.21.15.72:0/4043441108 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3940003b90 0x7f3940003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:22.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.779+0000 7f394ffff700 1 --2- 172.21.15.72:0/4043441108 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3940004850 0x7f3940004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:22.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.779+0000 7f395539c700 1 -- 172.21.15.72:0/4043441108 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3940003b90 msgr2=0x7f3940003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:22.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.779+0000 7f395539c700 1 --2- 172.21.15.72:0/4043441108 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3940003b90 0x7f3940003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:22.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.779+0000 7f395539c700 1 -- 172.21.15.72:0/4043441108 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3940004850 msgr2=0x7f3940004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:22.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.779+0000 7f395539c700 1 --2- 172.21.15.72:0/4043441108 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3940004850 0x7f3940004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:22.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.779+0000 7f395539c700 1 -- 172.21.15.72:0/4043441108 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39400035b0 con 0x7f3940005210 2023-07-27T20:32:22.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.779+0000 7f395539c700 1 -- 172.21.15.72:0/4043441108 reap_dead start 2023-07-27T20:32:22.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.780+0000 7f395539c700 1 --2- 172.21.15.72:0/4043441108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3940005210 0x7f394000dc20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f394800a7a0 tx=0x7f3940005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbb4fead20a7d882 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:22.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.780+0000 7f394f7fe700 1 -- 172.21.15.72:0/4043441108 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3948012600 con 0x7f3940005210 2023-07-27T20:32:22.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.780+0000 7f394f7fe700 1 -- 172.21.15.72:0/4043441108 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3948012780 con 0x7f3940005210 2023-07-27T20:32:22.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.780+0000 7f394f7fe700 1 -- 172.21.15.72:0/4043441108 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3948012b30 con 0x7f3940005210 2023-07-27T20:32:22.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.780+0000 7f3956dff700 1 -- 172.21.15.72:0/4043441108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3940005210 msgr2=0x7f394000dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:22.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.780+0000 7f3956dff700 1 --2- 172.21.15.72:0/4043441108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3940005210 0x7f394000dc20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f394800a7a0 tx=0x7f3940005880 comp rx=0 tx=0).stop 2023-07-27T20:32:22.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.780+0000 7f3956dff700 1 -- 172.21.15.72:0/4043441108 shutdown_connections 2023-07-27T20:32:22.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.780+0000 7f3956dff700 1 --2- 172.21.15.72:0/4043441108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3940005210 0x7f394000dc20 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:22.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.780+0000 7f3956dff700 1 -- 172.21.15.72:0/4043441108 >> 172.21.15.72:0/4043441108 conn(0x7f395006a190 msgr2=0x7f395006a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:22.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.780+0000 7f3956dff700 1 -- 172.21.15.72:0/4043441108 shutdown_connections 2023-07-27T20:32:22.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.781+0000 7f3956dff700 1 -- 172.21.15.72:0/4043441108 wait complete. 2023-07-27T20:32:22.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.782+0000 7f3956dff700 1 Processor -- start 2023-07-27T20:32:22.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.782+0000 7f3956dff700 1 -- start start 2023-07-27T20:32:22.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.783+0000 7f3956dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3940005210 0x7f3950142c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:22.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.783+0000 7f3956dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f39500a8190 0x7f3950140690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:22.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.783+0000 7f3956dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3950140bd0 0x7f39500c3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:22.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.783+0000 7f3956dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39500c30a0 con 0x7f3940005210 2023-07-27T20:32:22.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.783+0000 7f3956dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39500c4dc0 con 0x7f3950140bd0 2023-07-27T20:32:22.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.783+0000 7f3956dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39501ea1c0 con 0x7f39500a8190 2023-07-27T20:32:22.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.783+0000 7f3954b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3940005210 0x7f3950142c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:22.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.783+0000 7f3954b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3940005210 0x7f3950142c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40988/0 (socket says 172.21.15.72:40988) 2023-07-27T20:32:22.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.783+0000 7f3954b9b700 1 -- 172.21.15.72:0/4123525470 learned_addr learned my addr 172.21.15.72:0/4123525470 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:22.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.784+0000 7f395539c700 1 --2- 172.21.15.72:0/4123525470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3950140bd0 0x7f39500c3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:22.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.784+0000 7f394ffff700 1 --2- 172.21.15.72:0/4123525470 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f39500a8190 0x7f3950140690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:22.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.784+0000 7f3954b9b700 1 -- 172.21.15.72:0/4123525470 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f39500a8190 msgr2=0x7f3950140690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:22.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.784+0000 7f3954b9b700 1 --2- 172.21.15.72:0/4123525470 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f39500a8190 0x7f3950140690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:22.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.784+0000 7f3954b9b700 1 -- 172.21.15.72:0/4123525470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3950140bd0 msgr2=0x7f39500c3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:22.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.784+0000 7f3954b9b700 1 --2- 172.21.15.72:0/4123525470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3950140bd0 0x7f39500c3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:22.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.784+0000 7f3954b9b700 1 -- 172.21.15.72:0/4123525470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39501ea4a0 con 0x7f3940005210 2023-07-27T20:32:22.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.784+0000 7f394ffff700 1 --2- 172.21.15.72:0/4123525470 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f39500a8190 0x7f3950140690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:32:22.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.784+0000 7f3954b9b700 1 --2- 172.21.15.72:0/4123525470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3940005210 0x7f3950142c00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f394400f770 tx=0x7f394400fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:22.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.784+0000 7f394d7fa700 1 -- 172.21.15.72:0/4123525470 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3944005320 con 0x7f3940005210 2023-07-27T20:32:22.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.784+0000 7f394d7fa700 1 -- 172.21.15.72:0/4123525470 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39440054a0 con 0x7f3940005210 2023-07-27T20:32:22.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.784+0000 7f394d7fa700 1 -- 172.21.15.72:0/4123525470 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3944006aa0 con 0x7f3940005210 2023-07-27T20:32:22.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.784+0000 7f3956dff700 1 -- 172.21.15.72:0/4123525470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3950143140 con 0x7f3940005210 2023-07-27T20:32:22.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.784+0000 7f3956dff700 1 -- 172.21.15.72:0/4123525470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3950143560 con 0x7f3940005210 2023-07-27T20:32:22.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.785+0000 7f3956dff700 1 -- 172.21.15.72:0/4123525470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39501ea020 con 0x7f3940005210 2023-07-27T20:32:22.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.786+0000 7f394d7fa700 1 -- 172.21.15.72:0/4123525470 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3944006c00 con 0x7f3940005210 2023-07-27T20:32:22.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.788+0000 7f394d7fa700 1 --2- 172.21.15.72:0/4123525470 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f393406ad10 0x7f393406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:22.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.788+0000 7f394d7fa700 1 -- 172.21.15.72:0/4123525470 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3944088d80 con 0x7f3940005210 2023-07-27T20:32:22.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.789+0000 7f394ffff700 1 --2- 172.21.15.72:0/4123525470 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f393406ad10 0x7f393406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:22.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.789+0000 7f394ffff700 1 --2- 172.21.15.72:0/4123525470 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f393406ad10 0x7f393406d1d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f393c009470 tx=0x7f393c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:22.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.792+0000 7f394d7fa700 1 -- 172.21.15.72:0/4123525470 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f39501ea020 con 0x7f3940005210 2023-07-27T20:32:22.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.989+0000 7f3956dff700 1 -- 172.21.15.72:0/4123525470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f39501ea020 con 0x7f3940005210 2023-07-27T20:32:22.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.989+0000 7f394d7fa700 1 -- 172.21.15.72:0/4123525470 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f39501ea020 con 0x7f3940005210 2023-07-27T20:32:22.977 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-27T20:32:22.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.992+0000 7f3956dff700 1 -- 172.21.15.72:0/4123525470 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f393406ad10 msgr2=0x7f393406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:22.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.992+0000 7f3956dff700 1 --2- 172.21.15.72:0/4123525470 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f393406ad10 0x7f393406d1d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f393c009470 tx=0x7f393c008040 comp rx=0 tx=0).stop 2023-07-27T20:32:22.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.992+0000 7f3956dff700 1 -- 172.21.15.72:0/4123525470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3940005210 msgr2=0x7f3950142c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:22.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.992+0000 7f3956dff700 1 --2- 172.21.15.72:0/4123525470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3940005210 0x7f3950142c00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f394400f770 tx=0x7f394400fb30 comp rx=0 tx=0).stop 2023-07-27T20:32:22.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.992+0000 7f3956dff700 1 -- 172.21.15.72:0/4123525470 shutdown_connections 2023-07-27T20:32:22.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.992+0000 7f3956dff700 1 --2- 172.21.15.72:0/4123525470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3950140bd0 0x7f39500c3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:22.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.992+0000 7f3956dff700 1 --2- 172.21.15.72:0/4123525470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3940005210 0x7f3950142c00 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:22.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.992+0000 7f3956dff700 1 --2- 172.21.15.72:0/4123525470 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f393406ad10 0x7f393406d1d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:22.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.992+0000 7f3956dff700 1 --2- 172.21.15.72:0/4123525470 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f39500a8190 0x7f3950140690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:22.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.992+0000 7f3956dff700 1 -- 172.21.15.72:0/4123525470 >> 172.21.15.72:0/4123525470 conn(0x7f395006a190 msgr2=0x7f3950145fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:22.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.992+0000 7f3956dff700 1 -- 172.21.15.72:0/4123525470 shutdown_connections 2023-07-27T20:32:22.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:22.992+0000 7f3956dff700 1 -- 172.21.15.72:0/4123525470 wait complete. 2023-07-27T20:32:22.997 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T20:32:23.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.208+0000 7f7b81fff700 1 Processor -- start 2023-07-27T20:32:23.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.208+0000 7f7b81fff700 1 -- start start 2023-07-27T20:32:23.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.209+0000 7f7b81fff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7b7c14aab0 0x7f7b7c154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:23.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.209+0000 7f7b81fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7b7c06c1d0 0x7f7b7c06c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:23.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.209+0000 7f7b81fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b7c0c7c50 con 0x7f7b7c0c7740 2023-07-27T20:32:23.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.210+0000 7f7b81fff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b7c06bd40 con 0x7f7b7c14aab0 2023-07-27T20:32:23.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.210+0000 7f7b81fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c0c62f0 con 0x7f7b7c06c1d0 2023-07-27T20:32:23.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.210+0000 7f7b73fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7b7c0c7740 0x7f7b7c0c41c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47484/0 (socket says 172.21.15.72:47484) 2023-07-27T20:32:23.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.210+0000 7f7b73fff700 1 -- 172.21.15.72:0/1378528300 learned_addr learned my addr 172.21.15.72:0/1378528300 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:23.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.210+0000 7f7b7b7fe700 1 --2- 172.21.15.72:0/1378528300 >> v2:172.21.15.173:3300/0 conn(0x7f7b7c14aab0 0x7f7b7c154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:23.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.210+0000 7f7b7bfff700 1 --2- 172.21.15.72:0/1378528300 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7b7c06c1d0 0x7f7b7c06c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:23.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.210+0000 7f7b7affd700 1 -- 172.21.15.72:0/1378528300 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2955069299 0 0) 0x7f7b7c0c7c50 con 0x7f7b7c0c7740 2023-07-27T20:32:23.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.210+0000 7f7b7affd700 1 -- 172.21.15.72:0/1378528300 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b680035b0 con 0x7f7b7c0c7740 2023-07-27T20:32:23.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.210+0000 7f7b7affd700 1 -- 172.21.15.72:0/1378528300 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2357780699 0 0) 0x7f7b680035b0 con 0x7f7b7c0c7740 2023-07-27T20:32:23.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.210+0000 7f7b7affd700 1 -- 172.21.15.72:0/1378528300 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7b7c06c1d0 msgr2=0x7f7b7c06c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:23.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.210+0000 7f7b7affd700 1 --2- 172.21.15.72:0/1378528300 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7b7c06c1d0 0x7f7b7c06c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:23.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.210+0000 7f7b7affd700 1 -- 172.21.15.72:0/1378528300 >> v2:172.21.15.173:3300/0 conn(0x7f7b7c14aab0 msgr2=0x7f7b7c154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:23.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.210+0000 7f7b7affd700 1 --2- 172.21.15.72:0/1378528300 >> v2:172.21.15.173:3300/0 conn(0x7f7b7c14aab0 0x7f7b7c154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:23.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.210+0000 7f7b7affd700 1 -- 172.21.15.72:0/1378528300 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b7c155050 con 0x7f7b7c0c7740 2023-07-27T20:32:23.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.210+0000 7f7b7affd700 1 -- 172.21.15.72:0/1378528300 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f7b64001670 con 0x7f7b7c0c7740 2023-07-27T20:32:23.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.211+0000 7f7b7affd700 1 -- 172.21.15.72:0/1378528300 >> v1:172.21.15.72:6789/0 conn(0x7f7b7c0c7740 legacy=0x7f7b7c0c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:23.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.211+0000 7f7b7affd700 1 --2- 172.21.15.72:0/1378528300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b68003a00 0x7f7b68003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:23.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.211+0000 7f7b7affd700 1 --2- 172.21.15.72:0/1378528300 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b68004850 0x7f7b68004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:23.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.211+0000 7f7b7affd700 1 --2- 172.21.15.72:0/1378528300 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7b7c06c1d0 0x7f7b68005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:23.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.211+0000 7f7b7affd700 1 -- 172.21.15.72:0/1378528300 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c06bd40 con 0x7f7b68004850 2023-07-27T20:32:23.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.211+0000 7f7b7affd700 1 -- 172.21.15.72:0/1378528300 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c0c62f0 con 0x7f7b68003a00 2023-07-27T20:32:23.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.211+0000 7f7b7affd700 1 -- 172.21.15.72:0/1378528300 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6800ba10 con 0x7f7b7c06c1d0 2023-07-27T20:32:23.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.211+0000 7f7b73fff700 1 --2- 172.21.15.72:0/1378528300 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b68004850 0x7f7b68004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:23.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.211+0000 7f7b7b7fe700 1 --2- 172.21.15.72:0/1378528300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b68003a00 0x7f7b68003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:23.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.211+0000 7f7b7bfff700 1 --2- 172.21.15.72:0/1378528300 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7b7c06c1d0 0x7f7b68005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:23.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.211+0000 7f7b73fff700 1 -- 172.21.15.72:0/1378528300 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7b7c06c1d0 msgr2=0x7f7b68005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:23.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.211+0000 7f7b73fff700 1 --2- 172.21.15.72:0/1378528300 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7b7c06c1d0 0x7f7b68005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:23.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.211+0000 7f7b73fff700 1 -- 172.21.15.72:0/1378528300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b68003a00 msgr2=0x7f7b68003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:23.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.211+0000 7f7b73fff700 1 --2- 172.21.15.72:0/1378528300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b68003a00 0x7f7b68003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:23.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.211+0000 7f7b73fff700 1 -- 172.21.15.72:0/1378528300 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b680035b0 con 0x7f7b68004850 2023-07-27T20:32:23.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.212+0000 7f7b73fff700 1 --2- 172.21.15.72:0/1378528300 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b68004850 0x7f7b68004cd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7b6400c240 tx=0x7f7b68005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10be6031424175a3 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:23.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.212+0000 7f7b7affd700 1 -- 172.21.15.72:0/1378528300 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6400cde0 con 0x7f7b68004850 2023-07-27T20:32:23.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.212+0000 7f7b7affd700 1 -- 172.21.15.72:0/1378528300 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b64007ba0 con 0x7f7b68004850 2023-07-27T20:32:23.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.212+0000 7f7b7affd700 1 -- 172.21.15.72:0/1378528300 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b64005ba0 con 0x7f7b68004850 2023-07-27T20:32:23.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.212+0000 7f7b81fff700 1 -- 172.21.15.72:0/1378528300 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b68004850 msgr2=0x7f7b68004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:23.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.212+0000 7f7b81fff700 1 --2- 172.21.15.72:0/1378528300 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b68004850 0x7f7b68004cd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7b6400c240 tx=0x7f7b68005880 comp rx=0 tx=0).stop 2023-07-27T20:32:23.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.212+0000 7f7b7bfff700 1 -- 172.21.15.72:0/1378528300 reap_dead start 2023-07-27T20:32:23.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.212+0000 7f7b81fff700 1 -- 172.21.15.72:0/1378528300 shutdown_connections 2023-07-27T20:32:23.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.212+0000 7f7b81fff700 1 -- 172.21.15.72:0/1378528300 >> 172.21.15.72:0/1378528300 conn(0x7f7b7c0ab3f0 msgr2=0x7f7b7c0ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:23.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.213+0000 7f7b81fff700 1 -- 172.21.15.72:0/1378528300 shutdown_connections 2023-07-27T20:32:23.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.213+0000 7f7b81fff700 1 -- 172.21.15.72:0/1378528300 wait complete. 2023-07-27T20:32:23.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.215+0000 7f7b81fff700 1 Processor -- start 2023-07-27T20:32:23.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.215+0000 7f7b81fff700 1 -- start start 2023-07-27T20:32:23.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.216+0000 7f7b81fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b68004850 0x7f7b7c1ecb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:23.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.216+0000 7f7b81fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7b7c14e730 0x7f7b7c157c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:23.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.216+0000 7f7b81fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b7c14f7d0 0x7f7b7c158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:23.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.216+0000 7f7b81fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c1ed610 con 0x7f7b7c14f7d0 2023-07-27T20:32:23.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.216+0000 7f7b81fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c1586d0 con 0x7f7b68004850 2023-07-27T20:32:23.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.216+0000 7f7b81fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c1513b0 con 0x7f7b7c14e730 2023-07-27T20:32:23.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.217+0000 7f7b7bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b7c14f7d0 0x7f7b7c158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:23.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.217+0000 7f7b7b7fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b68004850 0x7f7b7c1ecb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:23.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.217+0000 7f7b7b7fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b68004850 0x7f7b7c1ecb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.72:55018/0 (socket says 172.21.15.72:55018) 2023-07-27T20:32:23.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.217+0000 7f7b7b7fe700 1 -- 172.21.15.72:0/2120069234 learned_addr learned my addr 172.21.15.72:0/2120069234 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:23.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.217+0000 7f7b73fff700 1 --2- 172.21.15.72:0/2120069234 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7b7c14e730 0x7f7b7c157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:23.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.217+0000 7f7b7bfff700 1 -- 172.21.15.72:0/2120069234 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7b7c14e730 msgr2=0x7f7b7c157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:23.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.217+0000 7f7b7bfff700 1 --2- 172.21.15.72:0/2120069234 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7b7c14e730 0x7f7b7c157c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:23.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.217+0000 7f7b7bfff700 1 -- 172.21.15.72:0/2120069234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b68004850 msgr2=0x7f7b7c1ecb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:23.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.217+0000 7f7b7bfff700 1 --2- 172.21.15.72:0/2120069234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b68004850 0x7f7b7c1ecb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:23.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.217+0000 7f7b7bfff700 1 -- 172.21.15.72:0/2120069234 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b7c150a80 con 0x7f7b7c14f7d0 2023-07-27T20:32:23.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.217+0000 7f7b7bfff700 1 --2- 172.21.15.72:0/2120069234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b7c14f7d0 0x7f7b7c158190 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c06d480 tx=0x7f7b74011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:23.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.217+0000 7f7b78ff9700 1 -- 172.21.15.72:0/2120069234 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7400e040 con 0x7f7b7c14f7d0 2023-07-27T20:32:23.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.217+0000 7f7b78ff9700 1 -- 172.21.15.72:0/2120069234 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b7400f040 con 0x7f7b7c14f7d0 2023-07-27T20:32:23.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.217+0000 7f7b78ff9700 1 -- 172.21.15.72:0/2120069234 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7400fc40 con 0x7f7b7c14f7d0 2023-07-27T20:32:23.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.217+0000 7f7b81fff700 1 -- 172.21.15.72:0/2120069234 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b7c150d60 con 0x7f7b7c14f7d0 2023-07-27T20:32:23.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.218+0000 7f7b81fff700 1 -- 172.21.15.72:0/2120069234 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b7c0a9800 con 0x7f7b7c14f7d0 2023-07-27T20:32:23.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.219+0000 7f7b81fff700 1 -- 172.21.15.72:0/2120069234 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b7c151540 con 0x7f7b7c14f7d0 2023-07-27T20:32:23.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.220+0000 7f7b78ff9700 1 -- 172.21.15.72:0/2120069234 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7b74015430 con 0x7f7b7c14f7d0 2023-07-27T20:32:23.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.221+0000 7f7b78ff9700 1 --2- 172.21.15.72:0/2120069234 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f7b5c06ad10 0x7f7b5c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:23.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.221+0000 7f7b78ff9700 1 -- 172.21.15.72:0/2120069234 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7b74089de0 con 0x7f7b7c14f7d0 2023-07-27T20:32:23.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.222+0000 7f7b7b7fe700 1 --2- 172.21.15.72:0/2120069234 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f7b5c06ad10 0x7f7b5c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:23.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.222+0000 7f7b7b7fe700 1 --2- 172.21.15.72:0/2120069234 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f7b5c06ad10 0x7f7b5c06d1d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c009d70 tx=0x7f7b6c009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:23.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.225+0000 7f7b78ff9700 1 -- 172.21.15.72:0/2120069234 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7b740585e0 con 0x7f7b7c14f7d0 2023-07-27T20:32:23.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.419+0000 7f7b81fff700 1 -- 172.21.15.72:0/2120069234 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7b7c04e470 con 0x7f7b7c14f7d0 2023-07-27T20:32:23.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.420+0000 7f7b78ff9700 1 -- 172.21.15.72:0/2120069234 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7b74058170 con 0x7f7b7c14f7d0 2023-07-27T20:32:23.407 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-27T20:32:23.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.422+0000 7f7b81fff700 1 -- 172.21.15.72:0/2120069234 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f7b5c06ad10 msgr2=0x7f7b5c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:23.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.422+0000 7f7b81fff700 1 --2- 172.21.15.72:0/2120069234 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f7b5c06ad10 0x7f7b5c06d1d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c009d70 tx=0x7f7b6c009210 comp rx=0 tx=0).stop 2023-07-27T20:32:23.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.422+0000 7f7b81fff700 1 -- 172.21.15.72:0/2120069234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b7c14f7d0 msgr2=0x7f7b7c158190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:23.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.422+0000 7f7b81fff700 1 --2- 172.21.15.72:0/2120069234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b7c14f7d0 0x7f7b7c158190 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c06d480 tx=0x7f7b74011ed0 comp rx=0 tx=0).stop 2023-07-27T20:32:23.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.422+0000 7f7b81fff700 1 -- 172.21.15.72:0/2120069234 shutdown_connections 2023-07-27T20:32:23.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.422+0000 7f7b81fff700 1 --2- 172.21.15.72:0/2120069234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b7c14f7d0 0x7f7b7c158190 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:23.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.422+0000 7f7b81fff700 1 --2- 172.21.15.72:0/2120069234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b68004850 0x7f7b7c1ecb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:23.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.422+0000 7f7b81fff700 1 --2- 172.21.15.72:0/2120069234 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f7b5c06ad10 0x7f7b5c06d1d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:23.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.422+0000 7f7b81fff700 1 --2- 172.21.15.72:0/2120069234 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7b7c14e730 0x7f7b7c157c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:23.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.422+0000 7f7b81fff700 1 -- 172.21.15.72:0/2120069234 >> 172.21.15.72:0/2120069234 conn(0x7f7b7c0ab3f0 msgr2=0x7f7b7c152210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:23.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.422+0000 7f7b81fff700 1 -- 172.21.15.72:0/2120069234 shutdown_connections 2023-07-27T20:32:23.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.422+0000 7f7b81fff700 1 -- 172.21.15.72:0/2120069234 wait complete. 2023-07-27T20:32:23.427 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T20:32:23.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.637+0000 7fe86bfff700 1 Processor -- start 2023-07-27T20:32:23.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.637+0000 7fe86bfff700 1 -- start start 2023-07-27T20:32:23.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.638+0000 7fe86bfff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe8640c7740 0x7fe8640c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:23.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.638+0000 7fe86bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe8640c4700 0x7fe86406c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:23.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.638+0000 7fe86bfff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8640c7c50 con 0x7fe86414aab0 2023-07-27T20:32:23.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.638+0000 7fe86bfff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe86406bd40 con 0x7fe8640c4700 2023-07-27T20:32:23.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.638+0000 7fe86bfff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8640c62f0 con 0x7fe8640c7740 2023-07-27T20:32:23.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.638+0000 7fe869d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe86414aab0 0x7fe864154b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47486/0 (socket says 172.21.15.72:47486) 2023-07-27T20:32:23.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.638+0000 7fe869d9b700 1 -- 172.21.15.72:0/4029803314 learned_addr learned my addr 172.21.15.72:0/4029803314 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:23.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.638+0000 7fe86a59c700 1 --2- 172.21.15.72:0/4029803314 >> v2:172.21.15.72:3300/0 conn(0x7fe8640c4700 0x7fe86406c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:23.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.639+0000 7fe86959a700 1 --2- 172.21.15.72:0/4029803314 >> v2:172.21.15.173:3300/0 conn(0x7fe8640c7740 0x7fe8640c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:23.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.639+0000 7fe868d99700 1 -- 172.21.15.72:0/4029803314 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1179380889 0 0) 0x7fe8640c7c50 con 0x7fe86414aab0 2023-07-27T20:32:23.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.639+0000 7fe868d99700 1 -- 172.21.15.72:0/4029803314 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8500035b0 con 0x7fe86414aab0 2023-07-27T20:32:23.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.639+0000 7fe86a59c700 1 -- 172.21.15.72:0/4029803314 >> v2:172.21.15.173:3300/0 conn(0x7fe8640c7740 msgr2=0x7fe8640c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:23.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.639+0000 7fe86a59c700 1 --2- 172.21.15.72:0/4029803314 >> v2:172.21.15.173:3300/0 conn(0x7fe8640c7740 0x7fe8640c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:23.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.639+0000 7fe86a59c700 1 -- 172.21.15.72:0/4029803314 >> v1:172.21.15.72:6789/0 conn(0x7fe86414aab0 legacy=0x7fe864154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:23.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.639+0000 7fe86a59c700 1 -- 172.21.15.72:0/4029803314 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe86406d200 con 0x7fe8640c4700 2023-07-27T20:32:23.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.639+0000 7fe86a59c700 1 --2- 172.21.15.72:0/4029803314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8640c4700 0x7fe86406c1d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe8640a9090 tx=0x7fe85c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea499c79645d2a14 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:23.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.639+0000 7fe868d99700 1 -- 172.21.15.72:0/4029803314 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85c00e070 con 0x7fe8640c4700 2023-07-27T20:32:23.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.639+0000 7fe868d99700 1 -- 172.21.15.72:0/4029803314 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85c00bb20 con 0x7fe8640c4700 2023-07-27T20:32:23.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.639+0000 7fe868d99700 1 -- 172.21.15.72:0/4029803314 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85c012430 con 0x7fe8640c4700 2023-07-27T20:32:23.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.640+0000 7fe86bfff700 1 -- 172.21.15.72:0/4029803314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8640c4700 msgr2=0x7fe86406c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:23.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.640+0000 7fe86bfff700 1 --2- 172.21.15.72:0/4029803314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8640c4700 0x7fe86406c1d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe8640a9090 tx=0x7fe85c00b330 comp rx=0 tx=0).stop 2023-07-27T20:32:23.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.640+0000 7fe86bfff700 1 -- 172.21.15.72:0/4029803314 shutdown_connections 2023-07-27T20:32:23.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.640+0000 7fe86bfff700 1 --2- 172.21.15.72:0/4029803314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8640c4700 0x7fe86406c1d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:23.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.640+0000 7fe86bfff700 1 --2- 172.21.15.72:0/4029803314 >> v2:172.21.15.173:3300/0 conn(0x7fe8640c7740 0x7fe8640c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:23.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.640+0000 7fe86bfff700 1 -- 172.21.15.72:0/4029803314 >> 172.21.15.72:0/4029803314 conn(0x7fe8640ab3f0 msgr2=0x7fe8640ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:23.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.640+0000 7fe86bfff700 1 -- 172.21.15.72:0/4029803314 shutdown_connections 2023-07-27T20:32:23.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.640+0000 7fe86bfff700 1 -- 172.21.15.72:0/4029803314 wait complete. 2023-07-27T20:32:23.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.642+0000 7fe86bfff700 1 Processor -- start 2023-07-27T20:32:23.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.642+0000 7fe86bfff700 1 -- start start 2023-07-27T20:32:23.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.643+0000 7fe86bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8640c4700 0x7fe86414e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:23.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.643+0000 7fe86bfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe8640c7740 0x7fe8640a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:23.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.643+0000 7fe86bfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe86414aab0 0x7fe864150740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:23.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.643+0000 7fe86bfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe864151640 con 0x7fe8640c4700 2023-07-27T20:32:23.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.643+0000 7fe86bfff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8640bf8b0 con 0x7fe86414aab0 2023-07-27T20:32:23.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.643+0000 7fe86bfff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8641e9fd0 con 0x7fe8640c7740 2023-07-27T20:32:23.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.643+0000 7fe869d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8640c4700 0x7fe86414e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:23.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.643+0000 7fe869d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8640c4700 0x7fe86414e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41022/0 (socket says 172.21.15.72:41022) 2023-07-27T20:32:23.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.643+0000 7fe869d9b700 1 -- 172.21.15.72:0/2509002647 learned_addr learned my addr 172.21.15.72:0/2509002647 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:23.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.643+0000 7fe86a59c700 1 --2- 172.21.15.72:0/2509002647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe86414aab0 0x7fe864150740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:23.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.643+0000 7fe86959a700 1 --2- 172.21.15.72:0/2509002647 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe8640c7740 0x7fe8640a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:23.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.643+0000 7fe869d9b700 1 -- 172.21.15.72:0/2509002647 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe8640c7740 msgr2=0x7fe8640a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:23.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.643+0000 7fe869d9b700 1 --2- 172.21.15.72:0/2509002647 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe8640c7740 0x7fe8640a94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:23.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.643+0000 7fe869d9b700 1 -- 172.21.15.72:0/2509002647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe86414aab0 msgr2=0x7fe864150740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:23.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.643+0000 7fe869d9b700 1 --2- 172.21.15.72:0/2509002647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe86414aab0 0x7fe864150740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:23.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.643+0000 7fe869d9b700 1 -- 172.21.15.72:0/2509002647 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe85c009a70 con 0x7fe8640c4700 2023-07-27T20:32:23.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.643+0000 7fe869d9b700 1 --2- 172.21.15.72:0/2509002647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8640c4700 0x7fe86414e870 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe860001eb0 tx=0x7fe86000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:23.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.644+0000 7fe85a7fc700 1 -- 172.21.15.72:0/2509002647 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe860005d70 con 0x7fe8640c4700 2023-07-27T20:32:23.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.644+0000 7fe85a7fc700 1 -- 172.21.15.72:0/2509002647 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8600070d0 con 0x7fe8640c4700 2023-07-27T20:32:23.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.644+0000 7fe85a7fc700 1 -- 172.21.15.72:0/2509002647 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe860007460 con 0x7fe8640c4700 2023-07-27T20:32:23.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.644+0000 7fe86bfff700 1 -- 172.21.15.72:0/2509002647 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8641ea2b0 con 0x7fe8640c4700 2023-07-27T20:32:23.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.644+0000 7fe86bfff700 1 -- 172.21.15.72:0/2509002647 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8641580c0 con 0x7fe8640c4700 2023-07-27T20:32:23.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.645+0000 7fe86bfff700 1 -- 172.21.15.72:0/2509002647 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe86404e470 con 0x7fe8640c4700 2023-07-27T20:32:23.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.646+0000 7fe85a7fc700 1 -- 172.21.15.72:0/2509002647 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe8600075c0 con 0x7fe8640c4700 2023-07-27T20:32:23.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.647+0000 7fe85a7fc700 1 --2- 172.21.15.72:0/2509002647 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe84806ace0 0x7fe84806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:23.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.647+0000 7fe85a7fc700 1 -- 172.21.15.72:0/2509002647 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe860088d80 con 0x7fe8640c4700 2023-07-27T20:32:23.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.647+0000 7fe86959a700 1 --2- 172.21.15.72:0/2509002647 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe84806ace0 0x7fe84806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:23.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.648+0000 7fe86959a700 1 --2- 172.21.15.72:0/2509002647 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe84806ace0 0x7fe84806d1a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe86406caf0 tx=0x7fe854008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:23.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.651+0000 7fe85a7fc700 1 -- 172.21.15.72:0/2509002647 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe860053af0 con 0x7fe8640c4700 2023-07-27T20:32:23.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.841+0000 7fe86bfff700 1 -- 172.21.15.72:0/2509002647 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe86406cf00 con 0x7fe8640c4700 2023-07-27T20:32:23.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.842+0000 7fe85a7fc700 1 -- 172.21.15.72:0/2509002647 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe860057110 con 0x7fe8640c4700 2023-07-27T20:32:23.830 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:32:23.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.844+0000 7fe86bfff700 1 -- 172.21.15.72:0/2509002647 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe84806ace0 msgr2=0x7fe84806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:23.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.844+0000 7fe86bfff700 1 --2- 172.21.15.72:0/2509002647 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe84806ace0 0x7fe84806d1a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe86406caf0 tx=0x7fe854008040 comp rx=0 tx=0).stop 2023-07-27T20:32:23.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.844+0000 7fe86bfff700 1 -- 172.21.15.72:0/2509002647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8640c4700 msgr2=0x7fe86414e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:23.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.844+0000 7fe86bfff700 1 --2- 172.21.15.72:0/2509002647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8640c4700 0x7fe86414e870 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe860001eb0 tx=0x7fe86000c860 comp rx=0 tx=0).stop 2023-07-27T20:32:23.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.844+0000 7fe86bfff700 1 -- 172.21.15.72:0/2509002647 shutdown_connections 2023-07-27T20:32:23.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.844+0000 7fe86bfff700 1 --2- 172.21.15.72:0/2509002647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe86414aab0 0x7fe864150740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:23.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.844+0000 7fe86bfff700 1 --2- 172.21.15.72:0/2509002647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8640c4700 0x7fe86414e870 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:23.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.844+0000 7fe86bfff700 1 --2- 172.21.15.72:0/2509002647 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe84806ace0 0x7fe84806d1a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:23.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.844+0000 7fe86bfff700 1 --2- 172.21.15.72:0/2509002647 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe8640c7740 0x7fe8640a94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:23.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.844+0000 7fe86bfff700 1 -- 172.21.15.72:0/2509002647 >> 172.21.15.72:0/2509002647 conn(0x7fe8640ab3f0 msgr2=0x7fe8641531b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:23.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.844+0000 7fe86bfff700 1 -- 172.21.15.72:0/2509002647 shutdown_connections 2023-07-27T20:32:23.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:23.844+0000 7fe86bfff700 1 -- 172.21.15.72:0/2509002647 wait complete. 2023-07-27T20:32:23.849 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T20:32:24.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.061+0000 7fa55e9ff700 1 Processor -- start 2023-07-27T20:32:24.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.061+0000 7fa55e9ff700 1 -- start start 2023-07-27T20:32:24.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.062+0000 7fa55e9ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa5580c77c0 0x7fa558151210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:24.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.062+0000 7fa55e9ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa55806ffc0 0x7fa558151750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:24.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.062+0000 7fa55e9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa55806d1c0 con 0x7fa5580c6710 2023-07-27T20:32:24.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.062+0000 7fa55e9ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa558155070 con 0x7fa5580c77c0 2023-07-27T20:32:24.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.062+0000 7fa55e9ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55806ce90 con 0x7fa55806ffc0 2023-07-27T20:32:24.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.062+0000 7fa55cf9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa5580c6710 0x7fa5580c6ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47494/0 (socket says 172.21.15.72:47494) 2023-07-27T20:32:24.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.062+0000 7fa55cf9c700 1 -- 172.21.15.72:0/2245123310 learned_addr learned my addr 172.21.15.72:0/2245123310 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:24.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.062+0000 7fa557fff700 1 --2- 172.21.15.72:0/2245123310 >> v2:172.21.15.173:3300/0 conn(0x7fa5580c77c0 0x7fa558151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:24.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.063+0000 7fa5577fe700 1 --2- 172.21.15.72:0/2245123310 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa55806ffc0 0x7fa558151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:24.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.063+0000 7fa556ffd700 1 -- 172.21.15.72:0/2245123310 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2554307341 0 0) 0x7fa55806d1c0 con 0x7fa5580c6710 2023-07-27T20:32:24.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.063+0000 7fa556ffd700 1 -- 172.21.15.72:0/2245123310 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5400035b0 con 0x7fa5580c6710 2023-07-27T20:32:24.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.063+0000 7fa557fff700 1 -- 172.21.15.72:0/2245123310 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa55806ffc0 msgr2=0x7fa558151750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:24.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.063+0000 7fa557fff700 1 --2- 172.21.15.72:0/2245123310 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa55806ffc0 0x7fa558151750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:24.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.063+0000 7fa557fff700 1 -- 172.21.15.72:0/2245123310 >> v1:172.21.15.72:6789/0 conn(0x7fa5580c6710 legacy=0x7fa5580c6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:24.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.063+0000 7fa557fff700 1 -- 172.21.15.72:0/2245123310 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa558154d90 con 0x7fa5580c77c0 2023-07-27T20:32:24.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.063+0000 7fa557fff700 1 --2- 172.21.15.72:0/2245123310 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5580c77c0 0x7fa558151210 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa548009840 tx=0x7fa548009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcae2332665c76f3 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:24.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.063+0000 7fa556ffd700 1 -- 172.21.15.72:0/2245123310 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa548011830 con 0x7fa5580c77c0 2023-07-27T20:32:24.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.064+0000 7fa556ffd700 1 -- 172.21.15.72:0/2245123310 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa548011990 con 0x7fa5580c77c0 2023-07-27T20:32:24.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.064+0000 7fa556ffd700 1 -- 172.21.15.72:0/2245123310 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa548011d20 con 0x7fa5580c77c0 2023-07-27T20:32:24.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.064+0000 7fa55e9ff700 1 -- 172.21.15.72:0/2245123310 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5580c77c0 msgr2=0x7fa558151210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:24.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.064+0000 7fa55e9ff700 1 --2- 172.21.15.72:0/2245123310 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5580c77c0 0x7fa558151210 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa548009840 tx=0x7fa548009b50 comp rx=0 tx=0).stop 2023-07-27T20:32:24.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.064+0000 7fa55e9ff700 1 -- 172.21.15.72:0/2245123310 shutdown_connections 2023-07-27T20:32:24.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.064+0000 7fa55e9ff700 1 --2- 172.21.15.72:0/2245123310 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5580c77c0 0x7fa558151210 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:24.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.064+0000 7fa55e9ff700 1 --2- 172.21.15.72:0/2245123310 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa55806ffc0 0x7fa558151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:24.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.064+0000 7fa55e9ff700 1 -- 172.21.15.72:0/2245123310 >> 172.21.15.72:0/2245123310 conn(0x7fa55806a190 msgr2=0x7fa55806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:24.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.064+0000 7fa55e9ff700 1 -- 172.21.15.72:0/2245123310 shutdown_connections 2023-07-27T20:32:24.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.064+0000 7fa55e9ff700 1 -- 172.21.15.72:0/2245123310 wait complete. 2023-07-27T20:32:24.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.066+0000 7fa55e9ff700 1 Processor -- start 2023-07-27T20:32:24.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.067+0000 7fa55e9ff700 1 -- start start 2023-07-27T20:32:24.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.068+0000 7fa55e9ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa55806ffc0 0x7fa55814efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:24.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.068+0000 7fa55e9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5580c6710 0x7fa5580be8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:24.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.068+0000 7fa55e9ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5580c77c0 0x7fa5580bee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:24.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.068+0000 7fa55e9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55814fcb0 con 0x7fa5580c6710 2023-07-27T20:32:24.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.068+0000 7fa55e9ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5580bc4b0 con 0x7fa55806ffc0 2023-07-27T20:32:24.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.068+0000 7fa55e9ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5581ed500 con 0x7fa5580c77c0 2023-07-27T20:32:24.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.068+0000 7fa5577fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5580c6710 0x7fa5580be8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:24.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.068+0000 7fa5577fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5580c6710 0x7fa5580be8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41038/0 (socket says 172.21.15.72:41038) 2023-07-27T20:32:24.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.068+0000 7fa5577fe700 1 -- 172.21.15.72:0/996596143 learned_addr learned my addr 172.21.15.72:0/996596143 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:24.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.068+0000 7fa557fff700 1 --2- 172.21.15.72:0/996596143 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa55806ffc0 0x7fa55814efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:24.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.068+0000 7fa55cf9c700 1 --2- 172.21.15.72:0/996596143 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5580c77c0 0x7fa5580bee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:24.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.068+0000 7fa5577fe700 1 -- 172.21.15.72:0/996596143 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5580c77c0 msgr2=0x7fa5580bee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:24.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.068+0000 7fa5577fe700 1 --2- 172.21.15.72:0/996596143 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5580c77c0 0x7fa5580bee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:24.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.068+0000 7fa5577fe700 1 -- 172.21.15.72:0/996596143 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa55806ffc0 msgr2=0x7fa55814efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:24.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.068+0000 7fa5577fe700 1 --2- 172.21.15.72:0/996596143 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa55806ffc0 0x7fa55814efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:24.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.068+0000 7fa5577fe700 1 -- 172.21.15.72:0/996596143 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5480094a0 con 0x7fa5580c6710 2023-07-27T20:32:24.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.069+0000 7fa5577fe700 1 --2- 172.21.15.72:0/996596143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5580c6710 0x7fa5580be8d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa54c00e980 tx=0x7fa54c00ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:24.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.069+0000 7fa554ff9700 1 -- 172.21.15.72:0/996596143 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c009710 con 0x7fa5580c6710 2023-07-27T20:32:24.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.069+0000 7fa554ff9700 1 -- 172.21.15.72:0/996596143 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54c00c690 con 0x7fa5580c6710 2023-07-27T20:32:24.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.069+0000 7fa55e9ff700 1 -- 172.21.15.72:0/996596143 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5580bf480 con 0x7fa5580c6710 2023-07-27T20:32:24.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.069+0000 7fa554ff9700 1 -- 172.21.15.72:0/996596143 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c00ca40 con 0x7fa5580c6710 2023-07-27T20:32:24.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.069+0000 7fa55e9ff700 1 -- 172.21.15.72:0/996596143 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5581ed1b0 con 0x7fa5580c6710 2023-07-27T20:32:24.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.070+0000 7fa55e9ff700 1 -- 172.21.15.72:0/996596143 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa55804e470 con 0x7fa5580c6710 2023-07-27T20:32:24.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.071+0000 7fa554ff9700 1 -- 172.21.15.72:0/996596143 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa54c00cba0 con 0x7fa5580c6710 2023-07-27T20:32:24.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.072+0000 7fa554ff9700 1 --2- 172.21.15.72:0/996596143 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa54406ace0 0x7fa54406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:24.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.072+0000 7fa554ff9700 1 -- 172.21.15.72:0/996596143 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa54c089700 con 0x7fa5580c6710 2023-07-27T20:32:24.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.073+0000 7fa557fff700 1 --2- 172.21.15.72:0/996596143 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa54406ace0 0x7fa54406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:24.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.073+0000 7fa557fff700 1 --2- 172.21.15.72:0/996596143 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa54406ace0 0x7fa54406d1a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa548000c00 tx=0x7fa54801c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:24.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.077+0000 7fa554ff9700 1 -- 172.21.15.72:0/996596143 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa54c054510 con 0x7fa5580c6710 2023-07-27T20:32:24.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.271+0000 7fa55e9ff700 1 -- 172.21.15.72:0/996596143 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa5580c7260 con 0x7fa5580c6710 2023-07-27T20:32:24.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.271+0000 7fa554ff9700 1 -- 172.21.15.72:0/996596143 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa54c057b30 con 0x7fa5580c6710 2023-07-27T20:32:24.259 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-27T20:32:24.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.274+0000 7fa55e9ff700 1 -- 172.21.15.72:0/996596143 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa54406ace0 msgr2=0x7fa54406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:24.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.274+0000 7fa55e9ff700 1 --2- 172.21.15.72:0/996596143 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa54406ace0 0x7fa54406d1a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa548000c00 tx=0x7fa54801c040 comp rx=0 tx=0).stop 2023-07-27T20:32:24.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.274+0000 7fa55e9ff700 1 -- 172.21.15.72:0/996596143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5580c6710 msgr2=0x7fa5580be8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:24.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.274+0000 7fa55e9ff700 1 --2- 172.21.15.72:0/996596143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5580c6710 0x7fa5580be8d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa54c00e980 tx=0x7fa54c00ec90 comp rx=0 tx=0).stop 2023-07-27T20:32:24.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.274+0000 7fa55e9ff700 1 -- 172.21.15.72:0/996596143 shutdown_connections 2023-07-27T20:32:24.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.274+0000 7fa55e9ff700 1 --2- 172.21.15.72:0/996596143 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa54406ace0 0x7fa54406d1a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:24.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.274+0000 7fa55e9ff700 1 --2- 172.21.15.72:0/996596143 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5580c77c0 0x7fa5580bee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:24.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.274+0000 7fa55e9ff700 1 --2- 172.21.15.72:0/996596143 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa55806ffc0 0x7fa55814efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:24.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.274+0000 7fa55e9ff700 1 --2- 172.21.15.72:0/996596143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5580c6710 0x7fa5580be8d0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:24.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.274+0000 7fa55e9ff700 1 -- 172.21.15.72:0/996596143 >> 172.21.15.72:0/996596143 conn(0x7fa55806a190 msgr2=0x7fa55806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:24.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.274+0000 7fa55e9ff700 1 -- 172.21.15.72:0/996596143 shutdown_connections 2023-07-27T20:32:24.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.274+0000 7fa55e9ff700 1 -- 172.21.15.72:0/996596143 wait complete. 2023-07-27T20:32:24.279 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-27T20:32:24.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.491+0000 7f1664dff700 1 Processor -- start 2023-07-27T20:32:24.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.492+0000 7f1664dff700 1 -- start start 2023-07-27T20:32:24.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.493+0000 7f1664dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f166014aab0 0x7f1660154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:24.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.493+0000 7f1664dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f16600c7740 0x7f16600c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:24.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.493+0000 7f1664dff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f16600c4700 0x7f166006c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:24.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.493+0000 7f1664dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16600c7c50 con 0x7f166014aab0 2023-07-27T20:32:24.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.493+0000 7f1664dff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f166006bd40 con 0x7f16600c4700 2023-07-27T20:32:24.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.493+0000 7f1664dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16600c62f0 con 0x7f16600c7740 2023-07-27T20:32:24.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.493+0000 7f165e59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f166014aab0 0x7f1660154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:24.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.493+0000 7f165e59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f166014aab0 0x7f1660154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41052/0 (socket says 172.21.15.72:41052) 2023-07-27T20:32:24.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.493+0000 7f165e59c700 1 -- 172.21.15.72:0/4179382346 learned_addr learned my addr 172.21.15.72:0/4179382346 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:24.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.493+0000 7f165ed9d700 1 --2- 172.21.15.72:0/4179382346 >> v2:172.21.15.173:3300/0 conn(0x7f16600c4700 0x7f166006c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:24.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.493+0000 7f1657fff700 1 --2- 172.21.15.72:0/4179382346 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f16600c7740 0x7f16600c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:24.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.493+0000 7f165e59c700 1 -- 172.21.15.72:0/4179382346 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f16600c7740 msgr2=0x7f16600c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:24.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.493+0000 7f165e59c700 1 --2- 172.21.15.72:0/4179382346 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f16600c7740 0x7f16600c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:24.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.494+0000 7f165e59c700 1 -- 172.21.15.72:0/4179382346 >> v2:172.21.15.173:3300/0 conn(0x7f16600c4700 msgr2=0x7f166006c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:24.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.494+0000 7f165e59c700 1 --2- 172.21.15.72:0/4179382346 >> v2:172.21.15.173:3300/0 conn(0x7f16600c4700 0x7f166006c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:24.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.494+0000 7f165e59c700 1 -- 172.21.15.72:0/4179382346 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1660155050 con 0x7f166014aab0 2023-07-27T20:32:24.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.494+0000 7f1657fff700 1 --2- 172.21.15.72:0/4179382346 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f16600c7740 0x7f16600c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:24.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.494+0000 7f165e59c700 1 --2- 172.21.15.72:0/4179382346 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f166014aab0 0x7f1660154b10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f16600c9720 tx=0x7f1650009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76baf0d0fb465172 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:24.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.494+0000 7f165dd9b700 1 -- 172.21.15.72:0/4179382346 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1650011830 con 0x7f166014aab0 2023-07-27T20:32:24.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.494+0000 7f165dd9b700 1 -- 172.21.15.72:0/4179382346 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1650011990 con 0x7f166014aab0 2023-07-27T20:32:24.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.494+0000 7f165dd9b700 1 -- 172.21.15.72:0/4179382346 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1650011d20 con 0x7f166014aab0 2023-07-27T20:32:24.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.495+0000 7f1664dff700 1 -- 172.21.15.72:0/4179382346 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f166014aab0 msgr2=0x7f1660154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:24.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.495+0000 7f1664dff700 1 --2- 172.21.15.72:0/4179382346 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f166014aab0 0x7f1660154b10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f16600c9720 tx=0x7f1650009bd0 comp rx=0 tx=0).stop 2023-07-27T20:32:24.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.495+0000 7f1664dff700 1 -- 172.21.15.72:0/4179382346 shutdown_connections 2023-07-27T20:32:24.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.495+0000 7f1664dff700 1 --2- 172.21.15.72:0/4179382346 >> v2:172.21.15.173:3300/0 conn(0x7f16600c4700 0x7f166006c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:24.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.495+0000 7f1664dff700 1 --2- 172.21.15.72:0/4179382346 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f166014aab0 0x7f1660154b10 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:24.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.495+0000 7f1664dff700 1 --2- 172.21.15.72:0/4179382346 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f16600c7740 0x7f16600c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:24.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.495+0000 7f1664dff700 1 -- 172.21.15.72:0/4179382346 >> 172.21.15.72:0/4179382346 conn(0x7f16600ab3f0 msgr2=0x7f16600ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:24.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.495+0000 7f1664dff700 1 -- 172.21.15.72:0/4179382346 shutdown_connections 2023-07-27T20:32:24.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.495+0000 7f1664dff700 1 -- 172.21.15.72:0/4179382346 wait complete. 2023-07-27T20:32:24.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.496+0000 7f1664dff700 1 Processor -- start 2023-07-27T20:32:24.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.497+0000 7f1664dff700 1 -- start start 2023-07-27T20:32:24.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.497+0000 7f1664dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16600c4700 0x7f16601e9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:24.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.497+0000 7f1664dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16600c7740 0x7f1660151310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:24.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.497+0000 7f1664dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f166014aab0 0x7f16601eac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:24.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.497+0000 7f1664dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f166014f8c0 con 0x7f16600c7740 2023-07-27T20:32:24.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.497+0000 7f1664dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f166014ecb0 con 0x7f16600c4700 2023-07-27T20:32:24.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.497+0000 7f1664dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f166014ef90 con 0x7f166014aab0 2023-07-27T20:32:24.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.498+0000 7f1657fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16600c7740 0x7f1660151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:24.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.498+0000 7f1657fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16600c7740 0x7f1660151310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41058/0 (socket says 172.21.15.72:41058) 2023-07-27T20:32:24.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.498+0000 7f1657fff700 1 -- 172.21.15.72:0/3418647741 learned_addr learned my addr 172.21.15.72:0/3418647741 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:24.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.498+0000 7f165e59c700 1 --2- 172.21.15.72:0/3418647741 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16600c4700 0x7f16601e9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:24.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.498+0000 7f165ed9d700 1 --2- 172.21.15.72:0/3418647741 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f166014aab0 0x7f16601eac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:24.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.498+0000 7f1657fff700 1 -- 172.21.15.72:0/3418647741 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f166014aab0 msgr2=0x7f16601eac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:24.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.498+0000 7f1657fff700 1 --2- 172.21.15.72:0/3418647741 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f166014aab0 0x7f16601eac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:24.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.498+0000 7f1657fff700 1 -- 172.21.15.72:0/3418647741 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16600c4700 msgr2=0x7f16601e9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:24.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.498+0000 7f1657fff700 1 --2- 172.21.15.72:0/3418647741 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16600c4700 0x7f16601e9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:24.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.498+0000 7f1657fff700 1 -- 172.21.15.72:0/3418647741 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1650009550 con 0x7f16600c7740 2023-07-27T20:32:24.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.498+0000 7f165e59c700 1 --2- 172.21.15.72:0/3418647741 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16600c4700 0x7f16601e9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:24.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.498+0000 7f1657fff700 1 --2- 172.21.15.72:0/3418647741 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16600c7740 0x7f1660151310 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f164800e810 tx=0x7f164800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:24.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.499+0000 7f1656ffd700 1 -- 172.21.15.72:0/3418647741 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1648013610 con 0x7f16600c7740 2023-07-27T20:32:24.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.499+0000 7f1656ffd700 1 -- 172.21.15.72:0/3418647741 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1648013770 con 0x7f16600c7740 2023-07-27T20:32:24.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.499+0000 7f1664dff700 1 -- 172.21.15.72:0/3418647741 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f166014f270 con 0x7f16600c7740 2023-07-27T20:32:24.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.499+0000 7f1656ffd700 1 -- 172.21.15.72:0/3418647741 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1648013b20 con 0x7f16600c7740 2023-07-27T20:32:24.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.499+0000 7f1664dff700 1 -- 172.21.15.72:0/3418647741 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1660151850 con 0x7f16600c7740 2023-07-27T20:32:24.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.500+0000 7f1664dff700 1 -- 172.21.15.72:0/3418647741 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f166014fa70 con 0x7f16600c7740 2023-07-27T20:32:24.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.500+0000 7f1656ffd700 1 -- 172.21.15.72:0/3418647741 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1648013c80 con 0x7f16600c7740 2023-07-27T20:32:24.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.501+0000 7f1656ffd700 1 --2- 172.21.15.72:0/3418647741 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f164006ace0 0x7f164006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:24.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.501+0000 7f1656ffd700 1 -- 172.21.15.72:0/3418647741 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1648089470 con 0x7f16600c7740 2023-07-27T20:32:24.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.502+0000 7f165e59c700 1 --2- 172.21.15.72:0/3418647741 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f164006ace0 0x7f164006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:24.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.503+0000 7f165e59c700 1 --2- 172.21.15.72:0/3418647741 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f164006ace0 0x7f164006d1a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1650014040 tx=0x7f1650008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:24.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.505+0000 7f1656ffd700 1 -- 172.21.15.72:0/3418647741 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f166014fa70 con 0x7f16600c7740 2023-07-27T20:32:24.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.703+0000 7f1664dff700 1 -- 172.21.15.72:0/3418647741 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f166004e470 con 0x7f16600c7740 2023-07-27T20:32:24.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.703+0000 7f1656ffd700 1 -- 172.21.15.72:0/3418647741 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1648054150 con 0x7f16600c7740 2023-07-27T20:32:24.691 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:32:24.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.705+0000 7f1664dff700 1 -- 172.21.15.72:0/3418647741 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f164006ace0 msgr2=0x7f164006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:24.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.705+0000 7f1664dff700 1 --2- 172.21.15.72:0/3418647741 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f164006ace0 0x7f164006d1a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1650014040 tx=0x7f1650008030 comp rx=0 tx=0).stop 2023-07-27T20:32:24.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.705+0000 7f1664dff700 1 -- 172.21.15.72:0/3418647741 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16600c7740 msgr2=0x7f1660151310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:24.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.705+0000 7f1664dff700 1 --2- 172.21.15.72:0/3418647741 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16600c7740 0x7f1660151310 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f164800e810 tx=0x7f164800ebd0 comp rx=0 tx=0).stop 2023-07-27T20:32:24.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.705+0000 7f1664dff700 1 -- 172.21.15.72:0/3418647741 shutdown_connections 2023-07-27T20:32:24.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.705+0000 7f1664dff700 1 --2- 172.21.15.72:0/3418647741 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f164006ace0 0x7f164006d1a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:24.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.705+0000 7f1664dff700 1 --2- 172.21.15.72:0/3418647741 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f166014aab0 0x7f16601eac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:24.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.705+0000 7f1664dff700 1 --2- 172.21.15.72:0/3418647741 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16600c4700 0x7f16601e9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:24.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.705+0000 7f1664dff700 1 --2- 172.21.15.72:0/3418647741 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16600c7740 0x7f1660151310 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:24.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.705+0000 7f1664dff700 1 -- 172.21.15.72:0/3418647741 >> 172.21.15.72:0/3418647741 conn(0x7f16600ab3f0 msgr2=0x7f1660152630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:24.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.706+0000 7f1664dff700 1 -- 172.21.15.72:0/3418647741 shutdown_connections 2023-07-27T20:32:24.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.706+0000 7f1664dff700 1 -- 172.21.15.72:0/3418647741 wait complete. 2023-07-27T20:32:24.757 INFO:tasks.cephfs_test_runner:Starting test: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2023-07-27T20:32:24.758 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2023-07-27T20:32:24.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.967+0000 7f5e83dff700 1 Processor -- start 2023-07-27T20:32:24.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.968+0000 7f5e83dff700 1 -- start start 2023-07-27T20:32:24.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.969+0000 7f5e83dff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f5e7c06ef00 0x7f5e7c0a8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:24.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.969+0000 7f5e83dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e7c06bd90 con 0x7f5e7c06b520 2023-07-27T20:32:24.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.969+0000 7f5e83dff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e7c06e270 con 0x7f5e7c06b900 2023-07-27T20:32:24.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.969+0000 7f5e83dff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e7c0c1850 con 0x7f5e7c06ef00 2023-07-27T20:32:24.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.969+0000 7f5e81b9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5e7c06b520 0x7f5e7c158000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47502/0 (socket says 172.21.15.72:47502) 2023-07-27T20:32:24.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.969+0000 7f5e81b9b700 1 -- 172.21.15.72:0/2601857946 learned_addr learned my addr 172.21.15.72:0/2601857946 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:24.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.969+0000 7f5e80b99700 1 -- 172.21.15.72:0/2601857946 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1963775076 0 0) 0x7f5e78001110 con 0x7f5e7c06b520 2023-07-27T20:32:24.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.969+0000 7f5e80b99700 1 -- 172.21.15.72:0/2601857946 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e680035b0 con 0x7f5e7c06b520 2023-07-27T20:32:24.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.969+0000 7f5e8139a700 1 --2- 172.21.15.72:0/2601857946 >> v2:172.21.15.173:3300/0 conn(0x7f5e7c06ef00 0x7f5e7c0a8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:24.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.970+0000 7f5e80b99700 1 -- 172.21.15.72:0/2601857946 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4124661058 0 0) 0x7f5e680035b0 con 0x7f5e7c06b520 2023-07-27T20:32:24.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.970+0000 7f5e80b99700 1 -- 172.21.15.72:0/2601857946 >> v2:172.21.15.173:3300/0 conn(0x7f5e7c06ef00 msgr2=0x7f5e7c0a8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:24.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.970+0000 7f5e80b99700 1 --2- 172.21.15.72:0/2601857946 >> v2:172.21.15.173:3300/0 conn(0x7f5e7c06ef00 0x7f5e7c0a8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:24.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.970+0000 7f5e80b99700 1 -- 172.21.15.72:0/2601857946 >> v1:172.21.15.173:6789/0 conn(0x7f5e7c06b900 legacy=0x7f5e7c154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:24.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.970+0000 7f5e80b99700 1 -- 172.21.15.72:0/2601857946 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e7c06e7a0 con 0x7f5e7c06b520 2023-07-27T20:32:24.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.970+0000 7f5e80b99700 1 -- 172.21.15.72:0/2601857946 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f5e78001800 con 0x7f5e7c06b520 2023-07-27T20:32:24.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.970+0000 7f5e80b99700 1 -- 172.21.15.72:0/2601857946 >> v1:172.21.15.72:6789/0 conn(0x7f5e7c06b520 legacy=0x7f5e7c158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:24.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.970+0000 7f5e80b99700 1 --2- 172.21.15.72:0/2601857946 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5e68003a00 0x7f5e68003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:24.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.970+0000 7f5e80b99700 1 --2- 172.21.15.72:0/2601857946 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e68004850 0x7f5e68004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:24.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.970+0000 7f5e80b99700 1 --2- 172.21.15.72:0/2601857946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e68005210 0x7f5e6800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:24.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.970+0000 7f5e80b99700 1 -- 172.21.15.72:0/2601857946 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c0c1850 con 0x7f5e68005210 2023-07-27T20:32:24.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.970+0000 7f5e80b99700 1 -- 172.21.15.72:0/2601857946 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6800c160 con 0x7f5e68004850 2023-07-27T20:32:24.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.970+0000 7f5e80b99700 1 -- 172.21.15.72:0/2601857946 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6800c320 con 0x7f5e68003a00 2023-07-27T20:32:24.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.970+0000 7f5e8239c700 1 --2- 172.21.15.72:0/2601857946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e68005210 0x7f5e6800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:24.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.970+0000 7f5e81b9b700 1 --2- 172.21.15.72:0/2601857946 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5e68003a00 0x7f5e68003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:24.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.970+0000 7f5e8139a700 1 --2- 172.21.15.72:0/2601857946 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e68004850 0x7f5e68004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:24.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.971+0000 7f5e8239c700 1 -- 172.21.15.72:0/2601857946 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5e68003a00 msgr2=0x7f5e68003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:24.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.971+0000 7f5e8239c700 1 --2- 172.21.15.72:0/2601857946 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5e68003a00 0x7f5e68003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:24.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.971+0000 7f5e8239c700 1 -- 172.21.15.72:0/2601857946 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e68004850 msgr2=0x7f5e68004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:24.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.971+0000 7f5e8239c700 1 --2- 172.21.15.72:0/2601857946 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e68004850 0x7f5e68004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:24.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.971+0000 7f5e8239c700 1 -- 172.21.15.72:0/2601857946 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e680035b0 con 0x7f5e68005210 2023-07-27T20:32:24.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.971+0000 7f5e8239c700 1 -- 172.21.15.72:0/2601857946 reap_dead start 2023-07-27T20:32:24.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.971+0000 7f5e8239c700 1 --2- 172.21.15.72:0/2601857946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e68005210 0x7f5e6800ba10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5e7400c190 tx=0x7f5e68005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e769dd0990b980c1 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:24.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.971+0000 7f5e80b99700 1 -- 172.21.15.72:0/2601857946 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e74001db0 con 0x7f5e68005210 2023-07-27T20:32:24.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.971+0000 7f5e80b99700 1 -- 172.21.15.72:0/2601857946 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7400ccf0 con 0x7f5e68005210 2023-07-27T20:32:24.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.971+0000 7f5e80b99700 1 -- 172.21.15.72:0/2601857946 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e74003c40 con 0x7f5e68005210 2023-07-27T20:32:24.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.971+0000 7f5e83dff700 1 -- 172.21.15.72:0/2601857946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e68005210 msgr2=0x7f5e6800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:24.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.971+0000 7f5e83dff700 1 --2- 172.21.15.72:0/2601857946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e68005210 0x7f5e6800ba10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5e7400c190 tx=0x7f5e68005880 comp rx=0 tx=0).stop 2023-07-27T20:32:24.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.972+0000 7f5e83dff700 1 -- 172.21.15.72:0/2601857946 shutdown_connections 2023-07-27T20:32:24.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.972+0000 7f5e83dff700 1 --2- 172.21.15.72:0/2601857946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e68005210 0x7f5e6800ba10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:24.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.972+0000 7f5e83dff700 1 -- 172.21.15.72:0/2601857946 >> 172.21.15.72:0/2601857946 conn(0x7f5e7c0c6800 msgr2=0x7f5e7c0c6c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:24.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.972+0000 7f5e83dff700 1 -- 172.21.15.72:0/2601857946 shutdown_connections 2023-07-27T20:32:24.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.972+0000 7f5e83dff700 1 -- 172.21.15.72:0/2601857946 wait complete. 2023-07-27T20:32:24.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.973+0000 7f5e83dff700 1 Processor -- start 2023-07-27T20:32:24.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.974+0000 7f5e83dff700 1 -- start start 2023-07-27T20:32:24.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.974+0000 7f5e83dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e68005210 0x7f5e7c0c31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:24.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.974+0000 7f5e83dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e7c1545d0 0x7f5e7c1ed560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:24.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.974+0000 7f5e83dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5e7c151e30 0x7f5e7c1dd640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:24.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.974+0000 7f5e83dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c1ed0d0 con 0x7f5e7c1545d0 2023-07-27T20:32:24.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.974+0000 7f5e83dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c1dfd20 con 0x7f5e68005210 2023-07-27T20:32:24.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.975+0000 7f5e83dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c1e0000 con 0x7f5e7c151e30 2023-07-27T20:32:24.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.975+0000 7f5e8139a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e7c1545d0 0x7f5e7c1ed560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:24.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.975+0000 7f5e8139a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e7c1545d0 0x7f5e7c1ed560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41072/0 (socket says 172.21.15.72:41072) 2023-07-27T20:32:24.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.975+0000 7f5e8139a700 1 -- 172.21.15.72:0/1129089998 learned_addr learned my addr 172.21.15.72:0/1129089998 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:24.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.975+0000 7f5e81b9b700 1 --2- 172.21.15.72:0/1129089998 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e68005210 0x7f5e7c0c31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:24.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.975+0000 7f5e8239c700 1 --2- 172.21.15.72:0/1129089998 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5e7c151e30 0x7f5e7c1dd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:24.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.975+0000 7f5e8139a700 1 -- 172.21.15.72:0/1129089998 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5e7c151e30 msgr2=0x7f5e7c1dd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:24.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.975+0000 7f5e8139a700 1 --2- 172.21.15.72:0/1129089998 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5e7c151e30 0x7f5e7c1dd640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:24.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.975+0000 7f5e8139a700 1 -- 172.21.15.72:0/1129089998 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e68005210 msgr2=0x7f5e7c0c31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:24.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.975+0000 7f5e8139a700 1 --2- 172.21.15.72:0/1129089998 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e68005210 0x7f5e7c0c31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:24.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.975+0000 7f5e8139a700 1 -- 172.21.15.72:0/1129089998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e7c1e02e0 con 0x7f5e7c1545d0 2023-07-27T20:32:24.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.975+0000 7f5e81b9b700 1 --2- 172.21.15.72:0/1129089998 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e68005210 0x7f5e7c0c31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:24.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.975+0000 7f5e8139a700 1 --2- 172.21.15.72:0/1129089998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e7c1545d0 0x7f5e7c1ed560 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c0115d0 tx=0x7f5e6c011990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:24.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.976+0000 7f5e727fc700 1 -- 172.21.15.72:0/1129089998 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c00c070 con 0x7f5e7c1545d0 2023-07-27T20:32:24.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.976+0000 7f5e727fc700 1 -- 172.21.15.72:0/1129089998 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6c015930 con 0x7f5e7c1545d0 2023-07-27T20:32:24.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.976+0000 7f5e83dff700 1 -- 172.21.15.72:0/1129089998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e7c0c3700 con 0x7f5e7c1545d0 2023-07-27T20:32:24.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.976+0000 7f5e727fc700 1 -- 172.21.15.72:0/1129089998 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c015cc0 con 0x7f5e7c1545d0 2023-07-27T20:32:24.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.976+0000 7f5e83dff700 1 -- 172.21.15.72:0/1129089998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e7c0c3d80 con 0x7f5e7c1545d0 2023-07-27T20:32:24.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.977+0000 7f5e83dff700 1 -- 172.21.15.72:0/1129089998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e7c074310 con 0x7f5e7c1545d0 2023-07-27T20:32:24.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.977+0000 7f5e727fc700 1 -- 172.21.15.72:0/1129089998 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5e6c013400 con 0x7f5e7c1545d0 2023-07-27T20:32:24.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.979+0000 7f5e727fc700 1 --2- 172.21.15.72:0/1129089998 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5e6006ace0 0x7f5e6006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:24.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.979+0000 7f5e727fc700 1 -- 172.21.15.72:0/1129089998 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5e6c089880 con 0x7f5e7c1545d0 2023-07-27T20:32:24.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.979+0000 7f5e81b9b700 1 --2- 172.21.15.72:0/1129089998 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5e6006ace0 0x7f5e6006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:24.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.980+0000 7f5e81b9b700 1 --2- 172.21.15.72:0/1129089998 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5e6006ace0 0x7f5e6006d1a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5e78007fd0 tx=0x7f5e78009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:24.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:24.983+0000 7f5e727fc700 1 -- 172.21.15.72:0/1129089998 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5e6c054600 con 0x7f5e7c1545d0 2023-07-27T20:32:25.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.261+0000 7f5e83dff700 1 -- 172.21.15.72:0/1129089998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7f5e7c0c3d80 con 0x7f5e7c1545d0 2023-07-27T20:32:25.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.639+0000 7f5e727fc700 1 -- 172.21.15.72:0/1129089998 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v78) v1 ==== 162+0+0 (secure 0 0 0) 0x7f5e7c0c3d80 con 0x7f5e7c1545d0 2023-07-27T20:32:25.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.641+0000 7f5e83dff700 1 -- 172.21.15.72:0/1129089998 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5e6006ace0 msgr2=0x7f5e6006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:25.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.641+0000 7f5e83dff700 1 --2- 172.21.15.72:0/1129089998 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5e6006ace0 0x7f5e6006d1a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5e78007fd0 tx=0x7f5e78009040 comp rx=0 tx=0).stop 2023-07-27T20:32:25.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.641+0000 7f5e83dff700 1 -- 172.21.15.72:0/1129089998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e7c1545d0 msgr2=0x7f5e7c1ed560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:25.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.641+0000 7f5e83dff700 1 --2- 172.21.15.72:0/1129089998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e7c1545d0 0x7f5e7c1ed560 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c0115d0 tx=0x7f5e6c011990 comp rx=0 tx=0).stop 2023-07-27T20:32:25.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.641+0000 7f5e83dff700 1 -- 172.21.15.72:0/1129089998 shutdown_connections 2023-07-27T20:32:25.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.641+0000 7f5e83dff700 1 --2- 172.21.15.72:0/1129089998 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5e6006ace0 0x7f5e6006d1a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:25.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.641+0000 7f5e83dff700 1 --2- 172.21.15.72:0/1129089998 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5e7c151e30 0x7f5e7c1dd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:25.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.641+0000 7f5e83dff700 1 --2- 172.21.15.72:0/1129089998 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e68005210 0x7f5e7c0c31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:25.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.641+0000 7f5e83dff700 1 --2- 172.21.15.72:0/1129089998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e7c1545d0 0x7f5e7c1ed560 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:25.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.641+0000 7f5e83dff700 1 -- 172.21.15.72:0/1129089998 >> 172.21.15.72:0/1129089998 conn(0x7f5e7c0c6800 msgr2=0x7f5e7c0c6be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:25.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.641+0000 7f5e83dff700 1 -- 172.21.15.72:0/1129089998 shutdown_connections 2023-07-27T20:32:25.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.641+0000 7f5e83dff700 1 -- 172.21.15.72:0/1129089998 wait complete. 2023-07-27T20:32:25.648 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:32:25.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.857+0000 7f69ab7ff700 1 Processor -- start 2023-07-27T20:32:25.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.857+0000 7f69ab7ff700 1 -- start start 2023-07-27T20:32:25.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.858+0000 7f69ab7ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f69a40a8de0 0x7f69a406b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:25.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.858+0000 7f69ab7ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69a406e270 con 0x7f69a406ef00 2023-07-27T20:32:25.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.858+0000 7f69ab7ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69a406e7a0 con 0x7f69a406b520 2023-07-27T20:32:25.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.858+0000 7f69ab7ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69a40c1850 con 0x7f69a40a8de0 2023-07-27T20:32:25.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.859+0000 7f69a8d9a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f69a406ef00 0x7f69a4154000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47514/0 (socket says 172.21.15.72:47514) 2023-07-27T20:32:25.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.859+0000 7f69a8d9a700 1 -- 172.21.15.72:0/2124031800 learned_addr learned my addr 172.21.15.72:0/2124031800 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:25.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.859+0000 7f69a9d9c700 1 --2- 172.21.15.72:0/2124031800 >> v2:172.21.15.173:3300/0 conn(0x7f69a40a8de0 0x7f69a406b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:25.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.859+0000 7f699bfff700 1 -- 172.21.15.72:0/2124031800 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4166692318 0 0) 0x7f69a406e270 con 0x7f69a406ef00 2023-07-27T20:32:25.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.859+0000 7f699bfff700 1 -- 172.21.15.72:0/2124031800 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69900035b0 con 0x7f69a406ef00 2023-07-27T20:32:25.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.859+0000 7f699bfff700 1 -- 172.21.15.72:0/2124031800 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2486122721 0 0) 0x7f69a406e7a0 con 0x7f69a406b520 2023-07-27T20:32:25.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.859+0000 7f699bfff700 1 -- 172.21.15.72:0/2124031800 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69a406e270 con 0x7f69a406b520 2023-07-27T20:32:25.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.859+0000 7f699bfff700 1 -- 172.21.15.72:0/2124031800 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2673546732 0 0) 0x7f69900035b0 con 0x7f69a406ef00 2023-07-27T20:32:25.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.859+0000 7f699bfff700 1 -- 172.21.15.72:0/2124031800 >> v2:172.21.15.173:3300/0 conn(0x7f69a40a8de0 msgr2=0x7f69a406b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:25.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.859+0000 7f699bfff700 1 --2- 172.21.15.72:0/2124031800 >> v2:172.21.15.173:3300/0 conn(0x7f69a40a8de0 0x7f69a406b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:25.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.859+0000 7f699bfff700 1 -- 172.21.15.72:0/2124031800 >> v1:172.21.15.173:6789/0 conn(0x7f69a406b520 legacy=0x7f69a4158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:25.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.859+0000 7f699bfff700 1 -- 172.21.15.72:0/2124031800 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a40c2dd0 con 0x7f69a406ef00 2023-07-27T20:32:25.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.859+0000 7f699bfff700 1 -- 172.21.15.72:0/2124031800 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f6994001670 con 0x7f69a406ef00 2023-07-27T20:32:25.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.859+0000 7f699bfff700 1 -- 172.21.15.72:0/2124031800 >> v1:172.21.15.72:6789/0 conn(0x7f69a406ef00 legacy=0x7f69a4154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:25.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.859+0000 7f699bfff700 1 --2- 172.21.15.72:0/2124031800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6990003be0 0x7f6990003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:25.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.860+0000 7f699bfff700 1 --2- 172.21.15.72:0/2124031800 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6990004850 0x7f6990004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:25.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.860+0000 7f699bfff700 1 --2- 172.21.15.72:0/2124031800 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6990005210 0x7f699000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:25.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.860+0000 7f699bfff700 1 -- 172.21.15.72:0/2124031800 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a40c1850 con 0x7f6990003be0 2023-07-27T20:32:25.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.860+0000 7f699bfff700 1 -- 172.21.15.72:0/2124031800 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699000c0e0 con 0x7f6990005210 2023-07-27T20:32:25.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.860+0000 7f699bfff700 1 -- 172.21.15.72:0/2124031800 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f699000c2a0 con 0x7f6990004850 2023-07-27T20:32:25.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.860+0000 7f69a959b700 1 --2- 172.21.15.72:0/2124031800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6990003be0 0x7f6990003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:25.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.860+0000 7f69a8d9a700 1 --2- 172.21.15.72:0/2124031800 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6990004850 0x7f6990004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:25.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.860+0000 7f69a9d9c700 1 --2- 172.21.15.72:0/2124031800 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6990005210 0x7f699000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:25.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.860+0000 7f69a959b700 1 -- 172.21.15.72:0/2124031800 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6990004850 msgr2=0x7f6990004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:25.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.860+0000 7f69a959b700 1 --2- 172.21.15.72:0/2124031800 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6990004850 0x7f6990004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:25.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.860+0000 7f69a959b700 1 -- 172.21.15.72:0/2124031800 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6990005210 msgr2=0x7f699000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:25.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.860+0000 7f69a959b700 1 --2- 172.21.15.72:0/2124031800 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6990005210 0x7f699000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:25.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.860+0000 7f69a959b700 1 -- 172.21.15.72:0/2124031800 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69900035b0 con 0x7f6990003be0 2023-07-27T20:32:25.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.860+0000 7f69a8d9a700 1 --2- 172.21.15.72:0/2124031800 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6990004850 0x7f6990004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:25.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.860+0000 7f69a9d9c700 1 --2- 172.21.15.72:0/2124031800 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6990005210 0x7f699000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:25.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.860+0000 7f69a9d9c700 1 -- 172.21.15.72:0/2124031800 reap_dead start 2023-07-27T20:32:25.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.860+0000 7f69a959b700 1 --2- 172.21.15.72:0/2124031800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6990003be0 0x7f6990003fe0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f69a0001940 tx=0x7f6990005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ed1a1ca2e64cbe5 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:25.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.861+0000 7f699bfff700 1 -- 172.21.15.72:0/2124031800 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a0001430 con 0x7f6990003be0 2023-07-27T20:32:25.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.861+0000 7f699bfff700 1 -- 172.21.15.72:0/2124031800 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69a0001d70 con 0x7f6990003be0 2023-07-27T20:32:25.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.861+0000 7f699bfff700 1 -- 172.21.15.72:0/2124031800 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a0005510 con 0x7f6990003be0 2023-07-27T20:32:25.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.861+0000 7f69ab7ff700 1 -- 172.21.15.72:0/2124031800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6990003be0 msgr2=0x7f6990003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:25.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.861+0000 7f69ab7ff700 1 --2- 172.21.15.72:0/2124031800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6990003be0 0x7f6990003fe0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f69a0001940 tx=0x7f6990005880 comp rx=0 tx=0).stop 2023-07-27T20:32:25.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.861+0000 7f69ab7ff700 1 -- 172.21.15.72:0/2124031800 shutdown_connections 2023-07-27T20:32:25.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.861+0000 7f69ab7ff700 1 --2- 172.21.15.72:0/2124031800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6990003be0 0x7f6990003fe0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:25.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.861+0000 7f69ab7ff700 1 -- 172.21.15.72:0/2124031800 >> 172.21.15.72:0/2124031800 conn(0x7f69a40c6800 msgr2=0x7f69a40c6c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:25.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.861+0000 7f69ab7ff700 1 -- 172.21.15.72:0/2124031800 shutdown_connections 2023-07-27T20:32:25.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.861+0000 7f69ab7ff700 1 -- 172.21.15.72:0/2124031800 wait complete. 2023-07-27T20:32:25.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.863+0000 7f69ab7ff700 1 Processor -- start 2023-07-27T20:32:25.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.863+0000 7f69ab7ff700 1 -- start start 2023-07-27T20:32:25.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.864+0000 7f69ab7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6990003be0 0x7f69a4071870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:25.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.864+0000 7f69ab7ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f69a41eda70 0x7f69a40a6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:25.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.864+0000 7f69ab7ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69a40a74b0 0x7f69a414a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:25.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.864+0000 7f69ab7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a40ab620 con 0x7f6990003be0 2023-07-27T20:32:25.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.864+0000 7f69ab7ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a40abc00 con 0x7f69a40a74b0 2023-07-27T20:32:25.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.864+0000 7f69ab7ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69a41edf00 con 0x7f69a41eda70 2023-07-27T20:32:25.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.864+0000 7f69a959b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6990003be0 0x7f69a4071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:25.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.864+0000 7f69a959b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6990003be0 0x7f69a4071870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41086/0 (socket says 172.21.15.72:41086) 2023-07-27T20:32:25.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.864+0000 7f69a959b700 1 -- 172.21.15.72:0/552797824 learned_addr learned my addr 172.21.15.72:0/552797824 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:25.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.864+0000 7f69a959b700 1 -- 172.21.15.72:0/552797824 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f69a41eda70 msgr2=0x7f69a40a6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:25.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.864+0000 7f69a959b700 1 --2- 172.21.15.72:0/552797824 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f69a41eda70 0x7f69a40a6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:25.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.864+0000 7f69a959b700 1 -- 172.21.15.72:0/552797824 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69a40a74b0 msgr2=0x7f69a414a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:25.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.864+0000 7f69a959b700 1 --2- 172.21.15.72:0/552797824 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69a40a74b0 0x7f69a414a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:25.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.865+0000 7f69a959b700 1 -- 172.21.15.72:0/552797824 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a40a8040 con 0x7f6990003be0 2023-07-27T20:32:25.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.865+0000 7f69a959b700 1 --2- 172.21.15.72:0/552797824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6990003be0 0x7f69a4071870 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f69900047d0 tx=0x7f69a00012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:25.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.865+0000 7f6999ffb700 1 -- 172.21.15.72:0/552797824 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a0006a70 con 0x7f6990003be0 2023-07-27T20:32:25.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.865+0000 7f6999ffb700 1 -- 172.21.15.72:0/552797824 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69a0006bd0 con 0x7f6990003be0 2023-07-27T20:32:25.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.865+0000 7f69ab7ff700 1 -- 172.21.15.72:0/552797824 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69a40a8320 con 0x7f6990003be0 2023-07-27T20:32:25.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.865+0000 7f6999ffb700 1 -- 172.21.15.72:0/552797824 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a0007040 con 0x7f6990003be0 2023-07-27T20:32:25.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.865+0000 7f69ab7ff700 1 -- 172.21.15.72:0/552797824 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69a4071db0 con 0x7f6990003be0 2023-07-27T20:32:25.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.866+0000 7f69ab7ff700 1 -- 172.21.15.72:0/552797824 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69a4151ad0 con 0x7f6990003be0 2023-07-27T20:32:25.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.867+0000 7f6999ffb700 1 -- 172.21.15.72:0/552797824 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f69a00071a0 con 0x7f6990003be0 2023-07-27T20:32:25.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.868+0000 7f6999ffb700 1 --2- 172.21.15.72:0/552797824 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f698806ace0 0x7f698806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:25.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.868+0000 7f6999ffb700 1 -- 172.21.15.72:0/552797824 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f69a008a610 con 0x7f6990003be0 2023-07-27T20:32:25.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.868+0000 7f69a8d9a700 1 --2- 172.21.15.72:0/552797824 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f698806ace0 0x7f698806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:25.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.869+0000 7f69a8d9a700 1 --2- 172.21.15.72:0/552797824 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f698806ace0 0x7f698806d1a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6994001200 tx=0x7f6994001110 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:25.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:25.872+0000 7f6999ffb700 1 -- 172.21.15.72:0/552797824 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f69a00554a0 con 0x7f6990003be0 2023-07-27T20:32:26.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.067+0000 7f69ab7ff700 1 -- 172.21.15.72:0/552797824 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69a40a8560 con 0x7f6990003be0 2023-07-27T20:32:26.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.068+0000 7f6999ffb700 1 -- 172.21.15.72:0/552797824 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20215 (secure 0 0 0) 0x7f69a40a8560 con 0x7f6990003be0 2023-07-27T20:32:26.056 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:32:26.056 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":29,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:32:10.402254+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:31:27.020951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T20:31:27.566022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-27T20:31:31.182401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:32:26.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.070+0000 7f69ab7ff700 1 -- 172.21.15.72:0/552797824 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f698806ace0 msgr2=0x7f698806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:26.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.070+0000 7f69ab7ff700 1 --2- 172.21.15.72:0/552797824 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f698806ace0 0x7f698806d1a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6994001200 tx=0x7f6994001110 comp rx=0 tx=0).stop 2023-07-27T20:32:26.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.070+0000 7f69ab7ff700 1 -- 172.21.15.72:0/552797824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6990003be0 msgr2=0x7f69a4071870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:26.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.070+0000 7f69ab7ff700 1 --2- 172.21.15.72:0/552797824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6990003be0 0x7f69a4071870 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f69900047d0 tx=0x7f69a00012d0 comp rx=0 tx=0).stop 2023-07-27T20:32:26.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.071+0000 7f69ab7ff700 1 -- 172.21.15.72:0/552797824 shutdown_connections 2023-07-27T20:32:26.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.071+0000 7f69ab7ff700 1 --2- 172.21.15.72:0/552797824 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69a40a74b0 0x7f69a414a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:26.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.071+0000 7f69ab7ff700 1 --2- 172.21.15.72:0/552797824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6990003be0 0x7f69a4071870 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:26.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.071+0000 7f69ab7ff700 1 --2- 172.21.15.72:0/552797824 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f698806ace0 0x7f698806d1a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:26.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.071+0000 7f69ab7ff700 1 --2- 172.21.15.72:0/552797824 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f69a41eda70 0x7f69a40a6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:26.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.071+0000 7f69ab7ff700 1 -- 172.21.15.72:0/552797824 >> 172.21.15.72:0/552797824 conn(0x7f69a40c6800 msgr2=0x7f69a4155ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:26.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.071+0000 7f69ab7ff700 1 -- 172.21.15.72:0/552797824 shutdown_connections 2023-07-27T20:32:26.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.071+0000 7f69ab7ff700 1 -- 172.21.15.72:0/552797824 wait complete. 2023-07-27T20:32:26.076 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-27T20:31:14.581785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T20:31:21.077941+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T20:31:27.020951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T20:31:27.566022+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-27T20:31:31.182401+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-27T20:32:26.077 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-27T20:32:26.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.288+0000 7fbc8a7ff700 1 Processor -- start 2023-07-27T20:32:26.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.288+0000 7fbc8a7ff700 1 -- start start 2023-07-27T20:32:26.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.289+0000 7fbc8a7ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbc841475a0 0x7fbc841516c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:26.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.289+0000 7fbc8a7ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbc840716f0 0x7fbc84071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:26.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.289+0000 7fbc8a7ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc84154f50 con 0x7fbc840c12f0 2023-07-27T20:32:26.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.289+0000 7fbc8a7ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc84151c00 con 0x7fbc841475a0 2023-07-27T20:32:26.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.289+0000 7fbc8a7ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc84154340 con 0x7fbc840716f0 2023-07-27T20:32:26.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.289+0000 7fbc83fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbc841475a0 0x7fbc841516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:26.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.289+0000 7fbc83fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbc841475a0 0x7fbc841516c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41090/0 (socket says 172.21.15.72:41090) 2023-07-27T20:32:26.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.289+0000 7fbc83fff700 1 -- 172.21.15.72:0/2379922513 learned_addr learned my addr 172.21.15.72:0/2379922513 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:26.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.290+0000 7fbc88d9c700 1 --2- 172.21.15.72:0/2379922513 >> v2:172.21.15.173:3300/0 conn(0x7fbc840716f0 0x7fbc84071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:26.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.290+0000 7fbc83fff700 1 -- 172.21.15.72:0/2379922513 >> v2:172.21.15.173:3300/0 conn(0x7fbc840716f0 msgr2=0x7fbc84071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:26.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.290+0000 7fbc83fff700 1 --2- 172.21.15.72:0/2379922513 >> v2:172.21.15.173:3300/0 conn(0x7fbc840716f0 0x7fbc84071b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:26.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.290+0000 7fbc83fff700 1 -- 172.21.15.72:0/2379922513 >> v1:172.21.15.72:6789/0 conn(0x7fbc840c12f0 legacy=0x7fbc840c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:26.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.290+0000 7fbc83fff700 1 -- 172.21.15.72:0/2379922513 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc84154620 con 0x7fbc841475a0 2023-07-27T20:32:26.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.290+0000 7fbc83fff700 1 --2- 172.21.15.72:0/2379922513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc841475a0 0x7fbc841516c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fbc840c1780 tx=0x7fbc74009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df6c4eaf819602e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:26.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.290+0000 7fbc82ffd700 1 -- 172.21.15.72:0/2379922513 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7400f8a0 con 0x7fbc841475a0 2023-07-27T20:32:26.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.290+0000 7fbc82ffd700 1 -- 172.21.15.72:0/2379922513 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7400fa00 con 0x7fbc841475a0 2023-07-27T20:32:26.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.290+0000 7fbc82ffd700 1 -- 172.21.15.72:0/2379922513 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7400fd90 con 0x7fbc841475a0 2023-07-27T20:32:26.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.291+0000 7fbc8a7ff700 1 -- 172.21.15.72:0/2379922513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc841475a0 msgr2=0x7fbc841516c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:26.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.291+0000 7fbc8a7ff700 1 --2- 172.21.15.72:0/2379922513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc841475a0 0x7fbc841516c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fbc840c1780 tx=0x7fbc74009bd0 comp rx=0 tx=0).stop 2023-07-27T20:32:26.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.291+0000 7fbc8a7ff700 1 -- 172.21.15.72:0/2379922513 shutdown_connections 2023-07-27T20:32:26.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.291+0000 7fbc8a7ff700 1 --2- 172.21.15.72:0/2379922513 >> v2:172.21.15.173:3300/0 conn(0x7fbc840716f0 0x7fbc84071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:26.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.291+0000 7fbc8a7ff700 1 --2- 172.21.15.72:0/2379922513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc841475a0 0x7fbc841516c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:26.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.291+0000 7fbc8a7ff700 1 -- 172.21.15.72:0/2379922513 >> 172.21.15.72:0/2379922513 conn(0x7fbc8406a190 msgr2=0x7fbc8406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:26.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.291+0000 7fbc8a7ff700 1 -- 172.21.15.72:0/2379922513 shutdown_connections 2023-07-27T20:32:26.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.291+0000 7fbc8a7ff700 1 -- 172.21.15.72:0/2379922513 wait complete. 2023-07-27T20:32:26.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.293+0000 7fbc8a7ff700 1 Processor -- start 2023-07-27T20:32:26.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.293+0000 7fbc8a7ff700 1 -- start start 2023-07-27T20:32:26.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.294+0000 7fbc8a7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc840716f0 0x7fbc840bb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:26.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.294+0000 7fbc8a7ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbc840c12f0 0x7fbc8413f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:26.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.294+0000 7fbc8a7ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc841475a0 0x7fbc8413f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:26.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.294+0000 7fbc8a7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc84153f60 con 0x7fbc840716f0 2023-07-27T20:32:26.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.294+0000 7fbc8a7ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc84153190 con 0x7fbc841475a0 2023-07-27T20:32:26.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.294+0000 7fbc8a7ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc84140290 con 0x7fbc840c12f0 2023-07-27T20:32:26.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.294+0000 7fbc83fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc840716f0 0x7fbc840bb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:26.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.294+0000 7fbc83fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc840716f0 0x7fbc840bb620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41100/0 (socket says 172.21.15.72:41100) 2023-07-27T20:32:26.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.294+0000 7fbc83fff700 1 -- 172.21.15.72:0/4129438432 learned_addr learned my addr 172.21.15.72:0/4129438432 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:26.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.294+0000 7fbc88d9c700 1 --2- 172.21.15.72:0/4129438432 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc841475a0 0x7fbc8413f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:26.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.294+0000 7fbc837fe700 1 --2- 172.21.15.72:0/4129438432 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbc840c12f0 0x7fbc8413f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:26.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.294+0000 7fbc83fff700 1 -- 172.21.15.72:0/4129438432 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbc840c12f0 msgr2=0x7fbc8413f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:26.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.294+0000 7fbc83fff700 1 --2- 172.21.15.72:0/4129438432 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbc840c12f0 0x7fbc8413f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:26.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.294+0000 7fbc83fff700 1 -- 172.21.15.72:0/4129438432 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc841475a0 msgr2=0x7fbc8413f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:26.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.294+0000 7fbc83fff700 1 --2- 172.21.15.72:0/4129438432 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc841475a0 0x7fbc8413f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:26.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.294+0000 7fbc83fff700 1 -- 172.21.15.72:0/4129438432 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc74009550 con 0x7fbc840716f0 2023-07-27T20:32:26.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.295+0000 7fbc83fff700 1 --2- 172.21.15.72:0/4129438432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc840716f0 0x7fbc840bb620 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fbc74009c10 tx=0x7fbc74004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:26.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.295+0000 7fbc80ff9700 1 -- 172.21.15.72:0/4129438432 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc74010e10 con 0x7fbc840716f0 2023-07-27T20:32:26.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.295+0000 7fbc80ff9700 1 -- 172.21.15.72:0/4129438432 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc74004070 con 0x7fbc840716f0 2023-07-27T20:32:26.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.295+0000 7fbc8a7ff700 1 -- 172.21.15.72:0/4129438432 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc84153b80 con 0x7fbc840716f0 2023-07-27T20:32:26.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.295+0000 7fbc80ff9700 1 -- 172.21.15.72:0/4129438432 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc74004420 con 0x7fbc840716f0 2023-07-27T20:32:26.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.295+0000 7fbc8a7ff700 1 -- 172.21.15.72:0/4129438432 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc84153620 con 0x7fbc840716f0 2023-07-27T20:32:26.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.296+0000 7fbc8a7ff700 1 -- 172.21.15.72:0/4129438432 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc8404e470 con 0x7fbc840716f0 2023-07-27T20:32:26.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.297+0000 7fbc80ff9700 1 -- 172.21.15.72:0/4129438432 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbc740036a0 con 0x7fbc840716f0 2023-07-27T20:32:26.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.298+0000 7fbc80ff9700 1 --2- 172.21.15.72:0/4129438432 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fbc7006ace0 0x7fbc7006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:26.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.298+0000 7fbc80ff9700 1 -- 172.21.15.72:0/4129438432 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbc7408b090 con 0x7fbc840716f0 2023-07-27T20:32:26.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.298+0000 7fbc837fe700 1 --2- 172.21.15.72:0/4129438432 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fbc7006ace0 0x7fbc7006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:26.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.299+0000 7fbc837fe700 1 --2- 172.21.15.72:0/4129438432 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fbc7006ace0 0x7fbc7006d1a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbc8414ab60 tx=0x7fbc78009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:26.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.302+0000 7fbc80ff9700 1 -- 172.21.15.72:0/4129438432 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbc74055ea0 con 0x7fbc840716f0 2023-07-27T20:32:26.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.499+0000 7fbc8a7ff700 1 -- 172.21.15.72:0/4129438432 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbc84146dc0 con 0x7fbc840716f0 2023-07-27T20:32:26.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.499+0000 7fbc80ff9700 1 -- 172.21.15.72:0/4129438432 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbc740594c0 con 0x7fbc840716f0 2023-07-27T20:32:26.487 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-27T20:32:26.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.501+0000 7fbc8a7ff700 1 -- 172.21.15.72:0/4129438432 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fbc7006ace0 msgr2=0x7fbc7006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:26.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.501+0000 7fbc8a7ff700 1 --2- 172.21.15.72:0/4129438432 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fbc7006ace0 0x7fbc7006d1a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbc8414ab60 tx=0x7fbc78009040 comp rx=0 tx=0).stop 2023-07-27T20:32:26.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.501+0000 7fbc8a7ff700 1 -- 172.21.15.72:0/4129438432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc840716f0 msgr2=0x7fbc840bb620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:26.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.501+0000 7fbc8a7ff700 1 --2- 172.21.15.72:0/4129438432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc840716f0 0x7fbc840bb620 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fbc74009c10 tx=0x7fbc74004750 comp rx=0 tx=0).stop 2023-07-27T20:32:26.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.501+0000 7fbc8a7ff700 1 -- 172.21.15.72:0/4129438432 shutdown_connections 2023-07-27T20:32:26.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.501+0000 7fbc8a7ff700 1 --2- 172.21.15.72:0/4129438432 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc841475a0 0x7fbc8413f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:26.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.501+0000 7fbc8a7ff700 1 --2- 172.21.15.72:0/4129438432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc840716f0 0x7fbc840bb620 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:26.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.501+0000 7fbc8a7ff700 1 --2- 172.21.15.72:0/4129438432 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fbc7006ace0 0x7fbc7006d1a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:26.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.501+0000 7fbc8a7ff700 1 --2- 172.21.15.72:0/4129438432 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbc840c12f0 0x7fbc8413f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:26.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.501+0000 7fbc8a7ff700 1 -- 172.21.15.72:0/4129438432 >> 172.21.15.72:0/4129438432 conn(0x7fbc8406a190 msgr2=0x7fbc84146340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:26.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.502+0000 7fbc8a7ff700 1 -- 172.21.15.72:0/4129438432 shutdown_connections 2023-07-27T20:32:26.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.502+0000 7fbc8a7ff700 1 -- 172.21.15.72:0/4129438432 wait complete. 2023-07-27T20:32:26.507 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T20:32:26.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.718+0000 7feb9c5ff700 1 Processor -- start 2023-07-27T20:32:26.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.719+0000 7feb9c5ff700 1 -- start start 2023-07-27T20:32:26.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.720+0000 7feb9c5ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7feb940c77c0 0x7feb94151210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:26.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.720+0000 7feb9c5ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb94151750 0x7feb940c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:26.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.720+0000 7feb9c5ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb9406d1c0 con 0x7feb9406ffc0 2023-07-27T20:32:26.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.720+0000 7feb9c5ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb94155070 con 0x7feb940c77c0 2023-07-27T20:32:26.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.720+0000 7feb9c5ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb940c7360 con 0x7feb94151750 2023-07-27T20:32:26.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.720+0000 7feb99b9a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7feb9406ffc0 0x7feb940c6710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47520/0 (socket says 172.21.15.72:47520) 2023-07-27T20:32:26.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.720+0000 7feb99b9a700 1 -- 172.21.15.72:0/3497731958 learned_addr learned my addr 172.21.15.72:0/3497731958 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:26.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.720+0000 7feb9ab9c700 1 --2- 172.21.15.72:0/3497731958 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb94151750 0x7feb940c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:26.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.720+0000 7feb9a39b700 1 --2- 172.21.15.72:0/3497731958 >> v2:172.21.15.173:3300/0 conn(0x7feb940c77c0 0x7feb94151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:26.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.720+0000 7feb99399700 1 -- 172.21.15.72:0/3497731958 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3683583354 0 0) 0x7feb9406d1c0 con 0x7feb9406ffc0 2023-07-27T20:32:26.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.720+0000 7feb99399700 1 -- 172.21.15.72:0/3497731958 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb800035b0 con 0x7feb9406ffc0 2023-07-27T20:32:26.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.721+0000 7feb99399700 1 -- 172.21.15.72:0/3497731958 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 103863586 0 0) 0x7feb800035b0 con 0x7feb9406ffc0 2023-07-27T20:32:26.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.721+0000 7feb99399700 1 -- 172.21.15.72:0/3497731958 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb94151750 msgr2=0x7feb940c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:26.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.721+0000 7feb99399700 1 --2- 172.21.15.72:0/3497731958 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb94151750 0x7feb940c6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:26.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.721+0000 7feb99399700 1 -- 172.21.15.72:0/3497731958 >> v2:172.21.15.173:3300/0 conn(0x7feb940c77c0 msgr2=0x7feb94151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:26.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.721+0000 7feb99399700 1 --2- 172.21.15.72:0/3497731958 >> v2:172.21.15.173:3300/0 conn(0x7feb940c77c0 0x7feb94151210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:26.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.721+0000 7feb99399700 1 -- 172.21.15.72:0/3497731958 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9406ce90 con 0x7feb9406ffc0 2023-07-27T20:32:26.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.721+0000 7feb99399700 1 -- 172.21.15.72:0/3497731958 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7feb84001670 con 0x7feb9406ffc0 2023-07-27T20:32:26.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.721+0000 7feb99399700 1 -- 172.21.15.72:0/3497731958 >> v1:172.21.15.72:6789/0 conn(0x7feb9406ffc0 legacy=0x7feb940c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:26.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.721+0000 7feb99399700 1 --2- 172.21.15.72:0/3497731958 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb80003a00 0x7feb80003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:26.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.721+0000 7feb99399700 1 --2- 172.21.15.72:0/3497731958 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb94151750 0x7feb80004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:26.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.721+0000 7feb99399700 1 --2- 172.21.15.72:0/3497731958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb80004d90 0x7feb80005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:26.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.721+0000 7feb99399700 1 -- 172.21.15.72:0/3497731958 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb94155070 con 0x7feb80004d90 2023-07-27T20:32:26.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.721+0000 7feb99399700 1 -- 172.21.15.72:0/3497731958 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb940c7360 con 0x7feb80003a00 2023-07-27T20:32:26.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.721+0000 7feb99399700 1 -- 172.21.15.72:0/3497731958 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8000bb10 con 0x7feb94151750 2023-07-27T20:32:26.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.721+0000 7feb9ab9c700 1 --2- 172.21.15.72:0/3497731958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb80004d90 0x7feb80005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:26.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.721+0000 7feb9a39b700 1 --2- 172.21.15.72:0/3497731958 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb80003a00 0x7feb80003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:26.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.721+0000 7feb99b9a700 1 --2- 172.21.15.72:0/3497731958 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb94151750 0x7feb80004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:26.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.721+0000 7feb9ab9c700 1 -- 172.21.15.72:0/3497731958 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb94151750 msgr2=0x7feb80004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:26.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.721+0000 7feb9ab9c700 1 --2- 172.21.15.72:0/3497731958 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb94151750 0x7feb80004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:26.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.721+0000 7feb9ab9c700 1 -- 172.21.15.72:0/3497731958 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb80003a00 msgr2=0x7feb80003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:26.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.721+0000 7feb9ab9c700 1 --2- 172.21.15.72:0/3497731958 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb80003a00 0x7feb80003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:26.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.721+0000 7feb9ab9c700 1 -- 172.21.15.72:0/3497731958 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb800035b0 con 0x7feb80004d90 2023-07-27T20:32:26.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.722+0000 7feb9ab9c700 1 --2- 172.21.15.72:0/3497731958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb80004d90 0x7feb80005210 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7feb8c009fc0 tx=0x7feb80005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a333a6749b1e6fc5 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:26.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.722+0000 7feb99399700 1 -- 172.21.15.72:0/3497731958 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c00ec30 con 0x7feb80004d90 2023-07-27T20:32:26.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.722+0000 7feb99399700 1 -- 172.21.15.72:0/3497731958 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8c00f040 con 0x7feb80004d90 2023-07-27T20:32:26.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.722+0000 7feb99399700 1 -- 172.21.15.72:0/3497731958 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c014480 con 0x7feb80004d90 2023-07-27T20:32:26.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.722+0000 7feb9c5ff700 1 -- 172.21.15.72:0/3497731958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb80004d90 msgr2=0x7feb80005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:26.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.722+0000 7feb9c5ff700 1 --2- 172.21.15.72:0/3497731958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb80004d90 0x7feb80005210 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7feb8c009fc0 tx=0x7feb80005880 comp rx=0 tx=0).stop 2023-07-27T20:32:26.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.722+0000 7feb9ab9c700 1 -- 172.21.15.72:0/3497731958 reap_dead start 2023-07-27T20:32:26.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.722+0000 7feb9c5ff700 1 -- 172.21.15.72:0/3497731958 shutdown_connections 2023-07-27T20:32:26.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.722+0000 7feb9c5ff700 1 -- 172.21.15.72:0/3497731958 >> 172.21.15.72:0/3497731958 conn(0x7feb9406a190 msgr2=0x7feb9406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:26.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.723+0000 7feb9c5ff700 1 -- 172.21.15.72:0/3497731958 shutdown_connections 2023-07-27T20:32:26.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.723+0000 7feb9c5ff700 1 -- 172.21.15.72:0/3497731958 wait complete. 2023-07-27T20:32:26.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.724+0000 7feb9c5ff700 1 Processor -- start 2023-07-27T20:32:26.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.724+0000 7feb9c5ff700 1 -- start start 2023-07-27T20:32:26.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.725+0000 7feb9c5ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb80004d90 0x7feb941ece80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:26.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.725+0000 7feb9c5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb940be3d0 0x7feb941ed3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:26.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.725+0000 7feb9c5ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb94158200 0x7feb9414cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:26.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.725+0000 7feb9c5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb94157f00 con 0x7feb940be3d0 2023-07-27T20:32:26.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.725+0000 7feb9c5ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb940bbf20 con 0x7feb94158200 2023-07-27T20:32:26.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.725+0000 7feb9c5ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb941ed900 con 0x7feb80004d90 2023-07-27T20:32:26.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.725+0000 7feb99b9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb940be3d0 0x7feb941ed3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:26.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.725+0000 7feb99b9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb940be3d0 0x7feb941ed3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41114/0 (socket says 172.21.15.72:41114) 2023-07-27T20:32:26.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.725+0000 7feb99b9a700 1 -- 172.21.15.72:0/1031670356 learned_addr learned my addr 172.21.15.72:0/1031670356 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:26.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.726+0000 7feb9a39b700 1 --2- 172.21.15.72:0/1031670356 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb80004d90 0x7feb941ece80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:26.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.726+0000 7feb9ab9c700 1 --2- 172.21.15.72:0/1031670356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb94158200 0x7feb9414cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:26.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.726+0000 7feb99b9a700 1 -- 172.21.15.72:0/1031670356 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb80004d90 msgr2=0x7feb941ece80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:26.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.726+0000 7feb99b9a700 1 --2- 172.21.15.72:0/1031670356 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb80004d90 0x7feb941ece80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:26.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.726+0000 7feb99b9a700 1 -- 172.21.15.72:0/1031670356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb94158200 msgr2=0x7feb9414cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:26.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.726+0000 7feb99b9a700 1 --2- 172.21.15.72:0/1031670356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb94158200 0x7feb9414cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:26.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.726+0000 7feb99b9a700 1 -- 172.21.15.72:0/1031670356 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb941edb70 con 0x7feb940be3d0 2023-07-27T20:32:26.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.726+0000 7feb9a39b700 1 --2- 172.21.15.72:0/1031670356 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb80004d90 0x7feb941ece80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:26.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.726+0000 7feb99b9a700 1 --2- 172.21.15.72:0/1031670356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb940be3d0 0x7feb941ed3c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7feb8400e7b0 tx=0x7feb8400eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:26.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.726+0000 7feb8affd700 1 -- 172.21.15.72:0/1031670356 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb84012590 con 0x7feb940be3d0 2023-07-27T20:32:26.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.726+0000 7feb8affd700 1 -- 172.21.15.72:0/1031670356 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb840126f0 con 0x7feb940be3d0 2023-07-27T20:32:26.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.726+0000 7feb9c5ff700 1 -- 172.21.15.72:0/1031670356 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb9414dd00 con 0x7feb940be3d0 2023-07-27T20:32:26.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.726+0000 7feb8affd700 1 -- 172.21.15.72:0/1031670356 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb84012a80 con 0x7feb940be3d0 2023-07-27T20:32:26.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.726+0000 7feb9c5ff700 1 -- 172.21.15.72:0/1031670356 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb940c7e10 con 0x7feb940be3d0 2023-07-27T20:32:26.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.728+0000 7feb9c5ff700 1 -- 172.21.15.72:0/1031670356 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb940bc090 con 0x7feb940be3d0 2023-07-27T20:32:26.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.728+0000 7feb8affd700 1 -- 172.21.15.72:0/1031670356 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feb84012be0 con 0x7feb940be3d0 2023-07-27T20:32:26.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.729+0000 7feb8affd700 1 --2- 172.21.15.72:0/1031670356 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7feb7806ace0 0x7feb7806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:26.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.729+0000 7feb8affd700 1 -- 172.21.15.72:0/1031670356 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7feb840894a0 con 0x7feb940be3d0 2023-07-27T20:32:26.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.730+0000 7feb9a39b700 1 --2- 172.21.15.72:0/1031670356 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7feb7806ace0 0x7feb7806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:26.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.731+0000 7feb9a39b700 1 --2- 172.21.15.72:0/1031670356 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7feb7806ace0 0x7feb7806d1a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7feb90009bf0 tx=0x7feb90008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:26.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.734+0000 7feb8affd700 1 -- 172.21.15.72:0/1031670356 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7feb940bc090 con 0x7feb940be3d0 2023-07-27T20:32:26.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.929+0000 7feb9c5ff700 1 -- 172.21.15.72:0/1031670356 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7feb940bc090 con 0x7feb940be3d0 2023-07-27T20:32:26.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.929+0000 7feb8affd700 1 -- 172.21.15.72:0/1031670356 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7feb940bc090 con 0x7feb940be3d0 2023-07-27T20:32:26.917 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-27T20:32:26.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.932+0000 7feb9c5ff700 1 -- 172.21.15.72:0/1031670356 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7feb7806ace0 msgr2=0x7feb7806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:26.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.932+0000 7feb9c5ff700 1 --2- 172.21.15.72:0/1031670356 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7feb7806ace0 0x7feb7806d1a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7feb90009bf0 tx=0x7feb90008040 comp rx=0 tx=0).stop 2023-07-27T20:32:26.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.932+0000 7feb9c5ff700 1 -- 172.21.15.72:0/1031670356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb940be3d0 msgr2=0x7feb941ed3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:26.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.932+0000 7feb9c5ff700 1 --2- 172.21.15.72:0/1031670356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb940be3d0 0x7feb941ed3c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7feb8400e7b0 tx=0x7feb8400eb70 comp rx=0 tx=0).stop 2023-07-27T20:32:26.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.932+0000 7feb9c5ff700 1 -- 172.21.15.72:0/1031670356 shutdown_connections 2023-07-27T20:32:26.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.932+0000 7feb9c5ff700 1 --2- 172.21.15.72:0/1031670356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb94158200 0x7feb9414cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:26.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.932+0000 7feb9c5ff700 1 --2- 172.21.15.72:0/1031670356 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7feb7806ace0 0x7feb7806d1a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:26.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.932+0000 7feb9c5ff700 1 --2- 172.21.15.72:0/1031670356 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb80004d90 0x7feb941ece80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:26.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.932+0000 7feb9c5ff700 1 --2- 172.21.15.72:0/1031670356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb940be3d0 0x7feb941ed3c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:26.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.932+0000 7feb9c5ff700 1 -- 172.21.15.72:0/1031670356 >> 172.21.15.72:0/1031670356 conn(0x7feb9406a190 msgr2=0x7feb940c5600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:26.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.932+0000 7feb9c5ff700 1 -- 172.21.15.72:0/1031670356 shutdown_connections 2023-07-27T20:32:26.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:26.932+0000 7feb9c5ff700 1 -- 172.21.15.72:0/1031670356 wait complete. 2023-07-27T20:32:26.937 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T20:32:27.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.149+0000 7f68c1fff700 1 Processor -- start 2023-07-27T20:32:27.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.150+0000 7f68c1fff700 1 -- start start 2023-07-27T20:32:27.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.151+0000 7f68c1fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f68bc0c0f80 0x7f68bc153a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:27.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.151+0000 7f68c1fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f68bc153f80 0x7f68bc15ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:27.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.151+0000 7f68c1fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68bc0baf20 con 0x7f68bc14db30 2023-07-27T20:32:27.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.151+0000 7f68c1fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68bc0bbd40 con 0x7f68bc153f80 2023-07-27T20:32:27.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.151+0000 7f68c1fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc0baa00 con 0x7f68bc0c0f80 2023-07-27T20:32:27.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.151+0000 7f68bb7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f68bc14db30 0x7f68bc0bb2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47524/0 (socket says 172.21.15.72:47524) 2023-07-27T20:32:27.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.151+0000 7f68bb7fe700 1 -- 172.21.15.72:0/3534306376 learned_addr learned my addr 172.21.15.72:0/3534306376 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:27.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.151+0000 7f68bbfff700 1 --2- 172.21.15.72:0/3534306376 >> v2:172.21.15.72:3300/0 conn(0x7f68bc153f80 0x7f68bc15ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:27.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.151+0000 7f68baffd700 1 --2- 172.21.15.72:0/3534306376 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f68bc0c0f80 0x7f68bc153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:27.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.152+0000 7f68ba7fc700 1 -- 172.21.15.72:0/3534306376 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2911864311 0 0) 0x7f68bc0baf20 con 0x7f68bc14db30 2023-07-27T20:32:27.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.152+0000 7f68ba7fc700 1 -- 172.21.15.72:0/3534306376 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68a40035b0 con 0x7f68bc14db30 2023-07-27T20:32:27.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.152+0000 7f68bbfff700 1 -- 172.21.15.72:0/3534306376 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f68bc0c0f80 msgr2=0x7f68bc153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:27.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.152+0000 7f68bbfff700 1 --2- 172.21.15.72:0/3534306376 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f68bc0c0f80 0x7f68bc153a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:27.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.152+0000 7f68bbfff700 1 -- 172.21.15.72:0/3534306376 >> v1:172.21.15.72:6789/0 conn(0x7f68bc14db30 legacy=0x7f68bc0bb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:27.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.152+0000 7f68bbfff700 1 -- 172.21.15.72:0/3534306376 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68bc14df10 con 0x7f68bc153f80 2023-07-27T20:32:27.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.152+0000 7f68bbfff700 1 --2- 172.21.15.72:0/3534306376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68bc153f80 0x7f68bc15ad70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f68b4009d90 tx=0x7f68b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15299cc1e93eed70 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:27.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.152+0000 7f68ba7fc700 1 -- 172.21.15.72:0/3534306376 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b400e070 con 0x7f68bc153f80 2023-07-27T20:32:27.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.152+0000 7f68ba7fc700 1 -- 172.21.15.72:0/3534306376 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b400bb20 con 0x7f68bc153f80 2023-07-27T20:32:27.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.152+0000 7f68ba7fc700 1 -- 172.21.15.72:0/3534306376 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b4012430 con 0x7f68bc153f80 2023-07-27T20:32:27.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.153+0000 7f68c1fff700 1 -- 172.21.15.72:0/3534306376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68bc153f80 msgr2=0x7f68bc15ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:27.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.153+0000 7f68c1fff700 1 --2- 172.21.15.72:0/3534306376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68bc153f80 0x7f68bc15ad70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f68b4009d90 tx=0x7f68b400b330 comp rx=0 tx=0).stop 2023-07-27T20:32:27.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.153+0000 7f68c1fff700 1 -- 172.21.15.72:0/3534306376 shutdown_connections 2023-07-27T20:32:27.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.153+0000 7f68c1fff700 1 --2- 172.21.15.72:0/3534306376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68bc153f80 0x7f68bc15ad70 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:27.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.153+0000 7f68c1fff700 1 --2- 172.21.15.72:0/3534306376 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f68bc0c0f80 0x7f68bc153a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:27.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.153+0000 7f68c1fff700 1 -- 172.21.15.72:0/3534306376 >> 172.21.15.72:0/3534306376 conn(0x7f68bc06a190 msgr2=0x7f68bc06a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:27.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.153+0000 7f68c1fff700 1 -- 172.21.15.72:0/3534306376 shutdown_connections 2023-07-27T20:32:27.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.153+0000 7f68c1fff700 1 -- 172.21.15.72:0/3534306376 wait complete. 2023-07-27T20:32:27.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.155+0000 7f68c1fff700 1 Processor -- start 2023-07-27T20:32:27.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.155+0000 7f68c1fff700 1 -- start start 2023-07-27T20:32:27.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.156+0000 7f68c1fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68bc0c0f80 0x7f68bc0a8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:27.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.156+0000 7f68c1fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f68bc14db30 0x7f68bc0c3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:27.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.156+0000 7f68c1fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68bc153f80 0x7f68bc13ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:27.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.157+0000 7f68c1fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc1e9fc0 con 0x7f68bc153f80 2023-07-27T20:32:27.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.157+0000 7f68c1fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc1ea4f0 con 0x7f68bc0c0f80 2023-07-27T20:32:27.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.157+0000 7f68c1fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc1ea210 con 0x7f68bc14db30 2023-07-27T20:32:27.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.157+0000 7f68bbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68bc153f80 0x7f68bc13ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:27.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.157+0000 7f68bbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68bc153f80 0x7f68bc13ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41124/0 (socket says 172.21.15.72:41124) 2023-07-27T20:32:27.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.157+0000 7f68bbfff700 1 -- 172.21.15.72:0/3043815477 learned_addr learned my addr 172.21.15.72:0/3043815477 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:27.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.157+0000 7f68baffd700 1 --2- 172.21.15.72:0/3043815477 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f68bc14db30 0x7f68bc0c3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:27.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.157+0000 7f68bb7fe700 1 --2- 172.21.15.72:0/3043815477 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68bc0c0f80 0x7f68bc0a8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:27.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.157+0000 7f68bbfff700 1 -- 172.21.15.72:0/3043815477 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f68bc14db30 msgr2=0x7f68bc0c3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:27.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.157+0000 7f68bbfff700 1 --2- 172.21.15.72:0/3043815477 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f68bc14db30 0x7f68bc0c3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:27.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.157+0000 7f68bbfff700 1 -- 172.21.15.72:0/3043815477 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68bc0c0f80 msgr2=0x7f68bc0a8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:27.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.157+0000 7f68bbfff700 1 --2- 172.21.15.72:0/3043815477 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68bc0c0f80 0x7f68bc0a8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:27.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.157+0000 7f68bbfff700 1 -- 172.21.15.72:0/3043815477 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b4009a70 con 0x7f68bc153f80 2023-07-27T20:32:27.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.157+0000 7f68baffd700 1 --2- 172.21.15.72:0/3043815477 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f68bc14db30 0x7f68bc0c3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:27.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.157+0000 7f68bbfff700 1 --2- 172.21.15.72:0/3043815477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68bc153f80 0x7f68bc13ac00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f68b4014040 tx=0x7f68b4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:27.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.158+0000 7f68a3fff700 1 -- 172.21.15.72:0/3043815477 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b4012a90 con 0x7f68bc153f80 2023-07-27T20:32:27.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.158+0000 7f68a3fff700 1 -- 172.21.15.72:0/3043815477 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b4020070 con 0x7f68bc153f80 2023-07-27T20:32:27.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.158+0000 7f68a3fff700 1 -- 172.21.15.72:0/3043815477 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b4012e50 con 0x7f68bc153f80 2023-07-27T20:32:27.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.158+0000 7f68c1fff700 1 -- 172.21.15.72:0/3043815477 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68bc0aa1d0 con 0x7f68bc153f80 2023-07-27T20:32:27.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.158+0000 7f68c1fff700 1 -- 172.21.15.72:0/3043815477 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68bc0aa790 con 0x7f68bc153f80 2023-07-27T20:32:27.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.159+0000 7f68c1fff700 1 -- 172.21.15.72:0/3043815477 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68bc0aa010 con 0x7f68bc153f80 2023-07-27T20:32:27.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.160+0000 7f68a3fff700 1 -- 172.21.15.72:0/3043815477 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f68b4004040 con 0x7f68bc153f80 2023-07-27T20:32:27.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.161+0000 7f68a3fff700 1 --2- 172.21.15.72:0/3043815477 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f68a806ace0 0x7f68a806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:27.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.161+0000 7f68a3fff700 1 -- 172.21.15.72:0/3043815477 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f68b4022070 con 0x7f68bc153f80 2023-07-27T20:32:27.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.161+0000 7f68bb7fe700 1 --2- 172.21.15.72:0/3043815477 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f68a806ace0 0x7f68a806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:27.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.162+0000 7f68bb7fe700 1 --2- 172.21.15.72:0/3043815477 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f68a806ace0 0x7f68a806d1a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f68ac0011e0 tx=0x7f68ac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:27.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.165+0000 7f68a3fff700 1 -- 172.21.15.72:0/3043815477 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f68b4059da0 con 0x7f68bc153f80 2023-07-27T20:32:27.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.361+0000 7f68c1fff700 1 -- 172.21.15.72:0/3043815477 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f68bc04e470 con 0x7f68bc153f80 2023-07-27T20:32:27.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.362+0000 7f68a3fff700 1 -- 172.21.15.72:0/3043815477 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f68b4059930 con 0x7f68bc153f80 2023-07-27T20:32:27.350 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:32:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.364+0000 7f68c1fff700 1 -- 172.21.15.72:0/3043815477 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f68a806ace0 msgr2=0x7f68a806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.364+0000 7f68c1fff700 1 --2- 172.21.15.72:0/3043815477 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f68a806ace0 0x7f68a806d1a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f68ac0011e0 tx=0x7f68ac009040 comp rx=0 tx=0).stop 2023-07-27T20:32:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.364+0000 7f68c1fff700 1 -- 172.21.15.72:0/3043815477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68bc153f80 msgr2=0x7f68bc13ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.364+0000 7f68c1fff700 1 --2- 172.21.15.72:0/3043815477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68bc153f80 0x7f68bc13ac00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f68b4014040 tx=0x7f68b4004ad0 comp rx=0 tx=0).stop 2023-07-27T20:32:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.364+0000 7f68c1fff700 1 -- 172.21.15.72:0/3043815477 shutdown_connections 2023-07-27T20:32:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.364+0000 7f68c1fff700 1 --2- 172.21.15.72:0/3043815477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68bc153f80 0x7f68bc13ac00 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:27.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.364+0000 7f68c1fff700 1 --2- 172.21.15.72:0/3043815477 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68bc0c0f80 0x7f68bc0a8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:27.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.364+0000 7f68c1fff700 1 --2- 172.21.15.72:0/3043815477 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f68a806ace0 0x7f68a806d1a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:27.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.364+0000 7f68c1fff700 1 --2- 172.21.15.72:0/3043815477 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f68bc14db30 0x7f68bc0c3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:27.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.364+0000 7f68c1fff700 1 -- 172.21.15.72:0/3043815477 >> 172.21.15.72:0/3043815477 conn(0x7f68bc06a190 msgr2=0x7f68bc0bb2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:27.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.364+0000 7f68c1fff700 1 -- 172.21.15.72:0/3043815477 shutdown_connections 2023-07-27T20:32:27.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.364+0000 7f68c1fff700 1 -- 172.21.15.72:0/3043815477 wait complete. 2023-07-27T20:32:27.369 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T20:32:27.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.580+0000 7fd977fff700 1 Processor -- start 2023-07-27T20:32:27.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.580+0000 7fd977fff700 1 -- start start 2023-07-27T20:32:27.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.582+0000 7fd977fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd9701516c0 0x7fd970071e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:27.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.582+0000 7fd977fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd970154f50 con 0x7fd9700c12f0 2023-07-27T20:32:27.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.582+0000 7fd977fff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd970154340 con 0x7fd9701475a0 2023-07-27T20:32:27.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.582+0000 7fd977fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd970154620 con 0x7fd9701516c0 2023-07-27T20:32:27.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.582+0000 7fd97559a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd9700c12f0 0x7fd9700716f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47536/0 (socket says 172.21.15.72:47536) 2023-07-27T20:32:27.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.582+0000 7fd97559a700 1 -- 172.21.15.72:0/4036904554 learned_addr learned my addr 172.21.15.72:0/4036904554 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:27.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.582+0000 7fd97659c700 1 --2- 172.21.15.72:0/4036904554 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd9701516c0 0x7fd970071e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:27.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.582+0000 7fd974d99700 1 -- 172.21.15.72:0/4036904554 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3942431917 0 0) 0x7fd970154f50 con 0x7fd9700c12f0 2023-07-27T20:32:27.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.583+0000 7fd974d99700 1 -- 172.21.15.72:0/4036904554 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd95c0035b0 con 0x7fd9700c12f0 2023-07-27T20:32:27.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.583+0000 7fd974d99700 1 -- 172.21.15.72:0/4036904554 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3980603987 0 0) 0x7fd970154340 con 0x7fd9701475a0 2023-07-27T20:32:27.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.583+0000 7fd974d99700 1 -- 172.21.15.72:0/4036904554 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd970154f50 con 0x7fd9701475a0 2023-07-27T20:32:27.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.583+0000 7fd97659c700 1 -- 172.21.15.72:0/4036904554 >> v1:172.21.15.173:6789/0 conn(0x7fd9701475a0 legacy=0x7fd9700c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:27.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.583+0000 7fd97659c700 1 -- 172.21.15.72:0/4036904554 >> v1:172.21.15.72:6789/0 conn(0x7fd9700c12f0 legacy=0x7fd9700716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:27.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.583+0000 7fd97659c700 1 -- 172.21.15.72:0/4036904554 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd970154900 con 0x7fd9701516c0 2023-07-27T20:32:27.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.583+0000 7fd97659c700 1 --2- 172.21.15.72:0/4036904554 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd9701516c0 0x7fd970071e00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd968009dc0 tx=0x7fd96800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccbfe55ae1d93fd1 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:27.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.583+0000 7fd974d99700 1 -- 172.21.15.72:0/4036904554 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96800e070 con 0x7fd9701516c0 2023-07-27T20:32:27.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.583+0000 7fd974d99700 1 -- 172.21.15.72:0/4036904554 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96800bb20 con 0x7fd9701516c0 2023-07-27T20:32:27.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.583+0000 7fd974d99700 1 -- 172.21.15.72:0/4036904554 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd968012430 con 0x7fd9701516c0 2023-07-27T20:32:27.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.584+0000 7fd977fff700 1 -- 172.21.15.72:0/4036904554 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd9701516c0 msgr2=0x7fd970071e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:27.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.584+0000 7fd977fff700 1 --2- 172.21.15.72:0/4036904554 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd9701516c0 0x7fd970071e00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd968009dc0 tx=0x7fd96800b330 comp rx=0 tx=0).stop 2023-07-27T20:32:27.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.584+0000 7fd977fff700 1 -- 172.21.15.72:0/4036904554 shutdown_connections 2023-07-27T20:32:27.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.584+0000 7fd977fff700 1 --2- 172.21.15.72:0/4036904554 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd9701516c0 0x7fd970071e00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:27.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.584+0000 7fd977fff700 1 -- 172.21.15.72:0/4036904554 >> 172.21.15.72:0/4036904554 conn(0x7fd97006a190 msgr2=0x7fd97006a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:27.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.584+0000 7fd977fff700 1 -- 172.21.15.72:0/4036904554 shutdown_connections 2023-07-27T20:32:27.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.584+0000 7fd977fff700 1 -- 172.21.15.72:0/4036904554 wait complete. 2023-07-27T20:32:27.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.586+0000 7fd977fff700 1 Processor -- start 2023-07-27T20:32:27.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.586+0000 7fd977fff700 1 -- start start 2023-07-27T20:32:27.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.587+0000 7fd977fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9700c12f0 0x7fd97014e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:27.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.587+0000 7fd977fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd9701475a0 0x7fd9701ec8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:27.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.587+0000 7fd977fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9701516c0 0x7fd970140830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:27.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.587+0000 7fd977fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd970143ae0 con 0x7fd9700c12f0 2023-07-27T20:32:27.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.587+0000 7fd977fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9701e6fe0 con 0x7fd9701516c0 2023-07-27T20:32:27.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.587+0000 7fd977fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd970143800 con 0x7fd9701475a0 2023-07-27T20:32:27.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.587+0000 7fd975d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9700c12f0 0x7fd97014e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:27.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.587+0000 7fd975d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9700c12f0 0x7fd97014e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41128/0 (socket says 172.21.15.72:41128) 2023-07-27T20:32:27.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.587+0000 7fd975d9b700 1 -- 172.21.15.72:0/1946757613 learned_addr learned my addr 172.21.15.72:0/1946757613 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:27.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.587+0000 7fd97659c700 1 --2- 172.21.15.72:0/1946757613 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9701516c0 0x7fd970140830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:27.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.587+0000 7fd97559a700 1 --2- 172.21.15.72:0/1946757613 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd9701475a0 0x7fd9701ec8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:27.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.587+0000 7fd975d9b700 1 -- 172.21.15.72:0/1946757613 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd9701475a0 msgr2=0x7fd9701ec8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:27.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.587+0000 7fd975d9b700 1 --2- 172.21.15.72:0/1946757613 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd9701475a0 0x7fd9701ec8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:27.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.587+0000 7fd975d9b700 1 -- 172.21.15.72:0/1946757613 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9701516c0 msgr2=0x7fd970140830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:27.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.587+0000 7fd975d9b700 1 --2- 172.21.15.72:0/1946757613 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9701516c0 0x7fd970140830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:27.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.587+0000 7fd975d9b700 1 -- 172.21.15.72:0/1946757613 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd968009a70 con 0x7fd9700c12f0 2023-07-27T20:32:27.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.587+0000 7fd97659c700 1 --2- 172.21.15.72:0/1946757613 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9701516c0 0x7fd970140830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:32:27.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.587+0000 7fd97559a700 1 --2- 172.21.15.72:0/1946757613 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd9701475a0 0x7fd9701ec8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:32:27.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.588+0000 7fd975d9b700 1 --2- 172.21.15.72:0/1946757613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9700c12f0 0x7fd97014e120 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd96c00c520 tx=0x7fd96c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:27.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.588+0000 7fd9667fc700 1 -- 172.21.15.72:0/1946757613 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96c0052d0 con 0x7fd9700c12f0 2023-07-27T20:32:27.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.588+0000 7fd9667fc700 1 -- 172.21.15.72:0/1946757613 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96c005430 con 0x7fd9700c12f0 2023-07-27T20:32:27.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.588+0000 7fd977fff700 1 -- 172.21.15.72:0/1946757613 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd97014d920 con 0x7fd9700c12f0 2023-07-27T20:32:27.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.588+0000 7fd9667fc700 1 -- 172.21.15.72:0/1946757613 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96c0038c0 con 0x7fd9700c12f0 2023-07-27T20:32:27.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.588+0000 7fd977fff700 1 -- 172.21.15.72:0/1946757613 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd970153bc0 con 0x7fd9700c12f0 2023-07-27T20:32:27.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.589+0000 7fd977fff700 1 -- 172.21.15.72:0/1946757613 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd97014d780 con 0x7fd9700c12f0 2023-07-27T20:32:27.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.590+0000 7fd9667fc700 1 -- 172.21.15.72:0/1946757613 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd96c003a20 con 0x7fd9700c12f0 2023-07-27T20:32:27.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.591+0000 7fd9667fc700 1 --2- 172.21.15.72:0/1946757613 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd95406ace0 0x7fd95406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:27.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.591+0000 7fd9667fc700 1 -- 172.21.15.72:0/1946757613 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd96c088d80 con 0x7fd9700c12f0 2023-07-27T20:32:27.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.591+0000 7fd97559a700 1 --2- 172.21.15.72:0/1946757613 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd95406ace0 0x7fd95406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:27.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.592+0000 7fd97559a700 1 --2- 172.21.15.72:0/1946757613 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd95406ace0 0x7fd95406d1a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd9700ab450 tx=0x7fd960009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:27.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.595+0000 7fd9667fc700 1 -- 172.21.15.72:0/1946757613 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd97014d780 con 0x7fd9700c12f0 2023-07-27T20:32:27.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.789+0000 7fd977fff700 1 -- 172.21.15.72:0/1946757613 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd97014d780 con 0x7fd9700c12f0 2023-07-27T20:32:27.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.790+0000 7fd9667fc700 1 -- 172.21.15.72:0/1946757613 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd96c017020 con 0x7fd9700c12f0 2023-07-27T20:32:27.778 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-27T20:32:27.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.792+0000 7fd977fff700 1 -- 172.21.15.72:0/1946757613 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd95406ace0 msgr2=0x7fd95406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:27.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.792+0000 7fd977fff700 1 --2- 172.21.15.72:0/1946757613 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd95406ace0 0x7fd95406d1a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd9700ab450 tx=0x7fd960009040 comp rx=0 tx=0).stop 2023-07-27T20:32:27.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.792+0000 7fd977fff700 1 -- 172.21.15.72:0/1946757613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9700c12f0 msgr2=0x7fd97014e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:27.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.792+0000 7fd977fff700 1 --2- 172.21.15.72:0/1946757613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9700c12f0 0x7fd97014e120 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd96c00c520 tx=0x7fd96c00c8e0 comp rx=0 tx=0).stop 2023-07-27T20:32:27.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.793+0000 7fd977fff700 1 -- 172.21.15.72:0/1946757613 shutdown_connections 2023-07-27T20:32:27.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.793+0000 7fd977fff700 1 --2- 172.21.15.72:0/1946757613 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9701516c0 0x7fd970140830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:27.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.793+0000 7fd977fff700 1 --2- 172.21.15.72:0/1946757613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9700c12f0 0x7fd97014e120 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:27.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.793+0000 7fd977fff700 1 --2- 172.21.15.72:0/1946757613 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd95406ace0 0x7fd95406d1a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:27.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.793+0000 7fd977fff700 1 --2- 172.21.15.72:0/1946757613 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd9701475a0 0x7fd9701ec8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:27.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.793+0000 7fd977fff700 1 -- 172.21.15.72:0/1946757613 >> 172.21.15.72:0/1946757613 conn(0x7fd97006a190 msgr2=0x7fd9701501f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:27.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.793+0000 7fd977fff700 1 -- 172.21.15.72:0/1946757613 shutdown_connections 2023-07-27T20:32:27.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:27.793+0000 7fd977fff700 1 -- 172.21.15.72:0/1946757613 wait complete. 2023-07-27T20:32:27.798 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-27T20:32:27.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.009+0000 7fb542dff700 1 Processor -- start 2023-07-27T20:32:27.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.009+0000 7fb542dff700 1 -- start start 2023-07-27T20:32:27.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.010+0000 7fb542dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb53c0c12f0 0x7fb53c1516c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:27.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.010+0000 7fb542dff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb53c0716f0 0x7fb53c071b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:27.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.010+0000 7fb542dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb53c154f50 con 0x7fb53c1475a0 2023-07-27T20:32:27.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.010+0000 7fb542dff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb53c151c00 con 0x7fb53c0716f0 2023-07-27T20:32:27.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.010+0000 7fb542dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c154340 con 0x7fb53c0c12f0 2023-07-27T20:32:27.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.010+0000 7fb540b9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb53c1475a0 0x7fb53c0c1d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47550/0 (socket says 172.21.15.72:47550) 2023-07-27T20:32:27.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.010+0000 7fb540b9b700 1 -- 172.21.15.72:0/1858601974 learned_addr learned my addr 172.21.15.72:0/1858601974 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:28.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.011+0000 7fb53bfff700 1 --2- 172.21.15.72:0/1858601974 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb53c0c12f0 0x7fb53c1516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:28.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.011+0000 7fb54139c700 1 --2- 172.21.15.72:0/1858601974 >> v2:172.21.15.173:3300/0 conn(0x7fb53c0716f0 0x7fb53c071b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:28.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.011+0000 7fb53b7fe700 1 -- 172.21.15.72:0/1858601974 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3840885305 0 0) 0x7fb53c154f50 con 0x7fb53c1475a0 2023-07-27T20:32:28.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.011+0000 7fb53b7fe700 1 -- 172.21.15.72:0/1858601974 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb52c0035b0 con 0x7fb53c1475a0 2023-07-27T20:32:28.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.011+0000 7fb53b7fe700 1 -- 172.21.15.72:0/1858601974 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 874068499 0 0) 0x7fb52c0035b0 con 0x7fb53c1475a0 2023-07-27T20:32:28.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.011+0000 7fb53b7fe700 1 -- 172.21.15.72:0/1858601974 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb53c0c12f0 msgr2=0x7fb53c1516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:28.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.011+0000 7fb53b7fe700 1 --2- 172.21.15.72:0/1858601974 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb53c0c12f0 0x7fb53c1516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:28.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.011+0000 7fb53b7fe700 1 -- 172.21.15.72:0/1858601974 >> v2:172.21.15.173:3300/0 conn(0x7fb53c0716f0 msgr2=0x7fb53c071b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:28.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.011+0000 7fb53b7fe700 1 --2- 172.21.15.72:0/1858601974 >> v2:172.21.15.173:3300/0 conn(0x7fb53c0716f0 0x7fb53c071b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:28.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.011+0000 7fb53b7fe700 1 -- 172.21.15.72:0/1858601974 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb53c154620 con 0x7fb53c1475a0 2023-07-27T20:32:28.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.011+0000 7fb53b7fe700 1 -- 172.21.15.72:0/1858601974 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7fb530001670 con 0x7fb53c1475a0 2023-07-27T20:32:28.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.011+0000 7fb54139c700 1 --2- 172.21.15.72:0/1858601974 >> v2:172.21.15.173:3300/0 conn(0x7fb53c0716f0 0x7fb53c071b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:32:28.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.011+0000 7fb53b7fe700 1 -- 172.21.15.72:0/1858601974 >> v1:172.21.15.72:6789/0 conn(0x7fb53c1475a0 legacy=0x7fb53c0c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:28.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.011+0000 7fb53b7fe700 1 --2- 172.21.15.72:0/1858601974 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb52c003a00 0x7fb52c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:28.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.011+0000 7fb53b7fe700 1 --2- 172.21.15.72:0/1858601974 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb53c0c12f0 0x7fb52c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:28.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.011+0000 7fb53b7fe700 1 --2- 172.21.15.72:0/1858601974 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb52c004d90 0x7fb52c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:28.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.011+0000 7fb53b7fe700 1 -- 172.21.15.72:0/1858601974 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c151c00 con 0x7fb52c003a00 2023-07-27T20:32:28.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.011+0000 7fb53b7fe700 1 -- 172.21.15.72:0/1858601974 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c154340 con 0x7fb52c004d90 2023-07-27T20:32:28.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.011+0000 7fb53b7fe700 1 -- 172.21.15.72:0/1858601974 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb52c00dc20 con 0x7fb53c0c12f0 2023-07-27T20:32:28.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.011+0000 7fb540b9b700 1 --2- 172.21.15.72:0/1858601974 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb52c003a00 0x7fb52c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:28.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.012+0000 7fb53bfff700 1 --2- 172.21.15.72:0/1858601974 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb53c0c12f0 0x7fb52c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:28.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.012+0000 7fb54139c700 1 --2- 172.21.15.72:0/1858601974 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb52c004d90 0x7fb52c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:28.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.012+0000 7fb540b9b700 1 -- 172.21.15.72:0/1858601974 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb53c0c12f0 msgr2=0x7fb52c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:28.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.012+0000 7fb540b9b700 1 --2- 172.21.15.72:0/1858601974 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb53c0c12f0 0x7fb52c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:28.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.012+0000 7fb540b9b700 1 -- 172.21.15.72:0/1858601974 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb52c004d90 msgr2=0x7fb52c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:28.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.012+0000 7fb540b9b700 1 --2- 172.21.15.72:0/1858601974 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb52c004d90 0x7fb52c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:28.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.012+0000 7fb540b9b700 1 -- 172.21.15.72:0/1858601974 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb52c0035b0 con 0x7fb52c003a00 2023-07-27T20:32:28.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.012+0000 7fb540b9b700 1 --2- 172.21.15.72:0/1858601974 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb52c003a00 0x7fb52c003e20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb53000c350 tx=0x7fb52c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5da18ab8bab02b1e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:28.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.012+0000 7fb53b7fe700 1 -- 172.21.15.72:0/1858601974 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53000ce50 con 0x7fb52c003a00 2023-07-27T20:32:28.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.012+0000 7fb53b7fe700 1 -- 172.21.15.72:0/1858601974 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb530005960 con 0x7fb52c003a00 2023-07-27T20:32:28.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.012+0000 7fb53b7fe700 1 -- 172.21.15.72:0/1858601974 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb530005d10 con 0x7fb52c003a00 2023-07-27T20:32:28.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.013+0000 7fb542dff700 1 -- 172.21.15.72:0/1858601974 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb52c003a00 msgr2=0x7fb52c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:28.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.013+0000 7fb542dff700 1 --2- 172.21.15.72:0/1858601974 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb52c003a00 0x7fb52c003e20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb53000c350 tx=0x7fb52c005880 comp rx=0 tx=0).stop 2023-07-27T20:32:28.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.013+0000 7fb54139c700 1 -- 172.21.15.72:0/1858601974 reap_dead start 2023-07-27T20:32:28.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.013+0000 7fb542dff700 1 -- 172.21.15.72:0/1858601974 shutdown_connections 2023-07-27T20:32:28.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.013+0000 7fb542dff700 1 -- 172.21.15.72:0/1858601974 >> 172.21.15.72:0/1858601974 conn(0x7fb53c06a190 msgr2=0x7fb53c06a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:28.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.013+0000 7fb542dff700 1 -- 172.21.15.72:0/1858601974 shutdown_connections 2023-07-27T20:32:28.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.013+0000 7fb542dff700 1 -- 172.21.15.72:0/1858601974 wait complete. 2023-07-27T20:32:28.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.015+0000 7fb542dff700 1 Processor -- start 2023-07-27T20:32:28.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.015+0000 7fb542dff700 1 -- start start 2023-07-27T20:32:28.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.016+0000 7fb542dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb52c003a00 0x7fb53c0bb770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:28.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.016+0000 7fb542dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb53c0bff20 0x7fb53c13ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:28.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.016+0000 7fb542dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb53c13f230 0x7fb53c1da600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:28.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.016+0000 7fb542dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c0bbcb0 con 0x7fb52c003a00 2023-07-27T20:32:28.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.016+0000 7fb542dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c1438c0 con 0x7fb53c13f230 2023-07-27T20:32:28.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.016+0000 7fb542dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c0bb440 con 0x7fb53c0bff20 2023-07-27T20:32:28.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.016+0000 7fb540b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb52c003a00 0x7fb53c0bb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:28.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.016+0000 7fb540b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb52c003a00 0x7fb53c0bb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41140/0 (socket says 172.21.15.72:41140) 2023-07-27T20:32:28.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.016+0000 7fb540b9b700 1 -- 172.21.15.72:0/4048831587 learned_addr learned my addr 172.21.15.72:0/4048831587 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:28.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.016+0000 7fb540b9b700 1 -- 172.21.15.72:0/4048831587 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb53c0bff20 msgr2=0x7fb53c13ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:28.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.016+0000 7fb540b9b700 1 --2- 172.21.15.72:0/4048831587 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb53c0bff20 0x7fb53c13ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:28.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.016+0000 7fb540b9b700 1 -- 172.21.15.72:0/4048831587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb53c13f230 msgr2=0x7fb53c1da600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:28.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.016+0000 7fb540b9b700 1 --2- 172.21.15.72:0/4048831587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb53c13f230 0x7fb53c1da600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:28.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.016+0000 7fb540b9b700 1 -- 172.21.15.72:0/4048831587 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb53c13f6b0 con 0x7fb52c003a00 2023-07-27T20:32:28.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.016+0000 7fb540b9b700 1 --2- 172.21.15.72:0/4048831587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb52c003a00 0x7fb53c0bb770 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb530008fd0 tx=0x7fb530001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:28.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.017+0000 7fb5397fa700 1 -- 172.21.15.72:0/4048831587 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb530001680 con 0x7fb52c003a00 2023-07-27T20:32:28.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.017+0000 7fb5397fa700 1 -- 172.21.15.72:0/4048831587 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb530004a80 con 0x7fb52c003a00 2023-07-27T20:32:28.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.017+0000 7fb542dff700 1 -- 172.21.15.72:0/4048831587 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb53c142680 con 0x7fb52c003a00 2023-07-27T20:32:28.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.017+0000 7fb5397fa700 1 -- 172.21.15.72:0/4048831587 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb530004e30 con 0x7fb52c003a00 2023-07-27T20:32:28.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.017+0000 7fb542dff700 1 -- 172.21.15.72:0/4048831587 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb53c0badf0 con 0x7fb52c003a00 2023-07-27T20:32:28.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.018+0000 7fb542dff700 1 -- 172.21.15.72:0/4048831587 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb53c1da450 con 0x7fb52c003a00 2023-07-27T20:32:28.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.019+0000 7fb5397fa700 1 -- 172.21.15.72:0/4048831587 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb5300070d0 con 0x7fb52c003a00 2023-07-27T20:32:28.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.020+0000 7fb5397fa700 1 --2- 172.21.15.72:0/4048831587 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb52006ace0 0x7fb52006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:28.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.020+0000 7fb5397fa700 1 -- 172.21.15.72:0/4048831587 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb53008ad90 con 0x7fb52c003a00 2023-07-27T20:32:28.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.020+0000 7fb53bfff700 1 --2- 172.21.15.72:0/4048831587 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb52006ace0 0x7fb52006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:28.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.021+0000 7fb53bfff700 1 --2- 172.21.15.72:0/4048831587 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb52006ace0 0x7fb52006d1a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb53c0bc4b0 tx=0x7fb528008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:28.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.024+0000 7fb5397fa700 1 -- 172.21.15.72:0/4048831587 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb530055c20 con 0x7fb52c003a00 2023-07-27T20:32:28.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.216+0000 7fb542dff700 1 -- 172.21.15.72:0/4048831587 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb53c04e470 con 0x7fb52c003a00 2023-07-27T20:32:28.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.217+0000 7fb5397fa700 1 -- 172.21.15.72:0/4048831587 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb530007da0 con 0x7fb52c003a00 2023-07-27T20:32:28.205 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:32:28.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.219+0000 7fb542dff700 1 -- 172.21.15.72:0/4048831587 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb52006ace0 msgr2=0x7fb52006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:28.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.219+0000 7fb542dff700 1 --2- 172.21.15.72:0/4048831587 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb52006ace0 0x7fb52006d1a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb53c0bc4b0 tx=0x7fb528008040 comp rx=0 tx=0).stop 2023-07-27T20:32:28.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.219+0000 7fb542dff700 1 -- 172.21.15.72:0/4048831587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb52c003a00 msgr2=0x7fb53c0bb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:28.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.219+0000 7fb542dff700 1 --2- 172.21.15.72:0/4048831587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb52c003a00 0x7fb53c0bb770 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb530008fd0 tx=0x7fb530001a00 comp rx=0 tx=0).stop 2023-07-27T20:32:28.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.219+0000 7fb542dff700 1 -- 172.21.15.72:0/4048831587 shutdown_connections 2023-07-27T20:32:28.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.219+0000 7fb542dff700 1 --2- 172.21.15.72:0/4048831587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb53c13f230 0x7fb53c1da600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:28.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.219+0000 7fb542dff700 1 --2- 172.21.15.72:0/4048831587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb52c003a00 0x7fb53c0bb770 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:28.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.219+0000 7fb542dff700 1 --2- 172.21.15.72:0/4048831587 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb52006ace0 0x7fb52006d1a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:28.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.219+0000 7fb542dff700 1 --2- 172.21.15.72:0/4048831587 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb53c0bff20 0x7fb53c13ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:28.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.219+0000 7fb542dff700 1 -- 172.21.15.72:0/4048831587 >> 172.21.15.72:0/4048831587 conn(0x7fb53c06a190 msgr2=0x7fb53c06a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:28.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.219+0000 7fb542dff700 1 -- 172.21.15.72:0/4048831587 shutdown_connections 2023-07-27T20:32:28.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.219+0000 7fb542dff700 1 -- 172.21.15.72:0/4048831587 wait complete. 2023-07-27T20:32:28.225 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-27T20:32:28.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.437+0000 7f8a25dff700 1 Processor -- start 2023-07-27T20:32:28.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.438+0000 7f8a25dff700 1 -- start start 2023-07-27T20:32:28.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.439+0000 7f8a25dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8a2014aab0 0x7f8a20154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:28.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.439+0000 7f8a25dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a200c7c50 con 0x7f8a2006c1d0 2023-07-27T20:32:28.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.439+0000 7f8a25dff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a2006bd40 con 0x7f8a200c7740 2023-07-27T20:32:28.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.439+0000 7f8a25dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a200c62f0 con 0x7f8a2014aab0 2023-07-27T20:32:28.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.439+0000 7f8a1f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8a2014aab0 0x7f8a20154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:28.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.439+0000 7f8a1f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8a2014aab0 0x7f8a20154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41144/0 (socket says 172.21.15.72:41144) 2023-07-27T20:32:28.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.439+0000 7f8a1f7fe700 1 -- 172.21.15.72:0/2928260820 learned_addr learned my addr 172.21.15.72:0/2928260820 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:28.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.439+0000 7f8a1ffff700 1 --1- 172.21.15.72:0/2928260820 >> v1:172.21.15.72:6789/0 conn(0x7f8a2006c1d0 0x7f8a2006c5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47556/0 (socket says 172.21.15.72:47556) 2023-07-27T20:32:28.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.439+0000 7f8a1f7fe700 1 -- 172.21.15.72:0/2928260820 >> v1:172.21.15.173:6789/0 conn(0x7f8a200c7740 legacy=0x7f8a200c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:28.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.439+0000 7f8a1f7fe700 1 -- 172.21.15.72:0/2928260820 >> v1:172.21.15.72:6789/0 conn(0x7f8a2006c1d0 legacy=0x7f8a2006c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:28.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.439+0000 7f8a1f7fe700 1 -- 172.21.15.72:0/2928260820 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a2006cd00 con 0x7f8a2014aab0 2023-07-27T20:32:28.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.439+0000 7f8a1effd700 1 -- 172.21.15.72:0/2928260820 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3626325704 0 0) 0x7f8a200c7c50 con 0x7f8a2006c1d0 2023-07-27T20:32:28.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.440+0000 7f8a1f7fe700 1 --2- 172.21.15.72:0/2928260820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a2014aab0 0x7f8a20154b10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8a100098f0 tx=0x7f8a10009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10b37f88ae29a0e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:28.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.440+0000 7f8a1effd700 1 -- 172.21.15.72:0/2928260820 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a10004230 con 0x7f8a2014aab0 2023-07-27T20:32:28.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.440+0000 7f8a1effd700 1 -- 172.21.15.72:0/2928260820 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a10004390 con 0x7f8a2014aab0 2023-07-27T20:32:28.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.440+0000 7f8a1effd700 1 -- 172.21.15.72:0/2928260820 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a100036a0 con 0x7f8a2014aab0 2023-07-27T20:32:28.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.440+0000 7f8a25dff700 1 -- 172.21.15.72:0/2928260820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a2014aab0 msgr2=0x7f8a20154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:28.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.440+0000 7f8a25dff700 1 --2- 172.21.15.72:0/2928260820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a2014aab0 0x7f8a20154b10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8a100098f0 tx=0x7f8a10009c00 comp rx=0 tx=0).stop 2023-07-27T20:32:28.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.440+0000 7f8a25dff700 1 -- 172.21.15.72:0/2928260820 shutdown_connections 2023-07-27T20:32:28.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.440+0000 7f8a25dff700 1 --2- 172.21.15.72:0/2928260820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a2014aab0 0x7f8a20154b10 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:28.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.440+0000 7f8a25dff700 1 -- 172.21.15.72:0/2928260820 >> 172.21.15.72:0/2928260820 conn(0x7f8a200ab3f0 msgr2=0x7f8a200ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:28.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.441+0000 7f8a25dff700 1 -- 172.21.15.72:0/2928260820 shutdown_connections 2023-07-27T20:32:28.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.441+0000 7f8a25dff700 1 -- 172.21.15.72:0/2928260820 wait complete. 2023-07-27T20:32:28.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.442+0000 7f8a25dff700 1 Processor -- start 2023-07-27T20:32:28.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.442+0000 7f8a25dff700 1 -- start start 2023-07-27T20:32:28.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.443+0000 7f8a25dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a2006c1d0 0x7f8a201ea850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:28.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.443+0000 7f8a25dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a200c7740 0x7f8a200c3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:28.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.443+0000 7f8a25dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8a2014aab0 0x7f8a200c0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:28.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.443+0000 7f8a25dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a200c29f0 con 0x7f8a200c7740 2023-07-27T20:32:28.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.443+0000 7f8a25dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a200c8eb0 con 0x7f8a2006c1d0 2023-07-27T20:32:28.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.443+0000 7f8a25dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a200c0e50 con 0x7f8a2014aab0 2023-07-27T20:32:28.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.443+0000 7f8a17fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a200c7740 0x7f8a200c3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:28.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.444+0000 7f8a17fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a200c7740 0x7f8a200c3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41146/0 (socket says 172.21.15.72:41146) 2023-07-27T20:32:28.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.444+0000 7f8a17fff700 1 -- 172.21.15.72:0/3985690045 learned_addr learned my addr 172.21.15.72:0/3985690045 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:28.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.444+0000 7f8a1ffff700 1 --2- 172.21.15.72:0/3985690045 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8a2014aab0 0x7f8a200c0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:28.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.444+0000 7f8a1f7fe700 1 --2- 172.21.15.72:0/3985690045 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a2006c1d0 0x7f8a201ea850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:28.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.444+0000 7f8a17fff700 1 -- 172.21.15.72:0/3985690045 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8a2014aab0 msgr2=0x7f8a200c0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:28.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.444+0000 7f8a17fff700 1 --2- 172.21.15.72:0/3985690045 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8a2014aab0 0x7f8a200c0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:28.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.444+0000 7f8a17fff700 1 -- 172.21.15.72:0/3985690045 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a2006c1d0 msgr2=0x7f8a201ea850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:28.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.444+0000 7f8a17fff700 1 --2- 172.21.15.72:0/3985690045 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a2006c1d0 0x7f8a201ea850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:28.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.444+0000 7f8a17fff700 1 -- 172.21.15.72:0/3985690045 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a10009550 con 0x7f8a200c7740 2023-07-27T20:32:28.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.444+0000 7f8a17fff700 1 --2- 172.21.15.72:0/3985690045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a200c7740 0x7f8a200c3520 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8a0800c4d0 tx=0x7f8a0800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:28.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.444+0000 7f8a1cff9700 1 -- 172.21.15.72:0/3985690045 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a080054e0 con 0x7f8a200c7740 2023-07-27T20:32:28.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.444+0000 7f8a1cff9700 1 -- 172.21.15.72:0/3985690045 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a08003680 con 0x7f8a200c7740 2023-07-27T20:32:28.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.444+0000 7f8a25dff700 1 -- 172.21.15.72:0/3985690045 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a201ea3c0 con 0x7f8a200c7740 2023-07-27T20:32:28.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.444+0000 7f8a1cff9700 1 -- 172.21.15.72:0/3985690045 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a08003a30 con 0x7f8a200c7740 2023-07-27T20:32:28.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.445+0000 7f8a25dff700 1 -- 172.21.15.72:0/3985690045 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a200c1360 con 0x7f8a200c7740 2023-07-27T20:32:28.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.446+0000 7f8a25dff700 1 -- 172.21.15.72:0/3985690045 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a2004e470 con 0x7f8a200c7740 2023-07-27T20:32:28.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.447+0000 7f8a1cff9700 1 -- 172.21.15.72:0/3985690045 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8a08003b90 con 0x7f8a200c7740 2023-07-27T20:32:28.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.447+0000 7f8a1cff9700 1 --2- 172.21.15.72:0/3985690045 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8a0006ace0 0x7f8a0006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:28.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.447+0000 7f8a1cff9700 1 -- 172.21.15.72:0/3985690045 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8a080888a0 con 0x7f8a200c7740 2023-07-27T20:32:28.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.448+0000 7f8a1f7fe700 1 --2- 172.21.15.72:0/3985690045 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8a0006ace0 0x7f8a0006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:28.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.449+0000 7f8a1f7fe700 1 --2- 172.21.15.72:0/3985690045 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8a0006ace0 0x7f8a0006d1a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8a10009130 tx=0x7f8a10008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:28.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.452+0000 7f8a1cff9700 1 -- 172.21.15.72:0/3985690045 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8a08053620 con 0x7f8a200c7740 2023-07-27T20:32:28.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.649+0000 7f8a25dff700 1 -- 172.21.15.72:0/3985690045 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f8a2006cf00 con 0x7f8a200c7740 2023-07-27T20:32:28.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.652+0000 7f8a1cff9700 1 -- 172.21.15.72:0/3985690045 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8a08056c40 con 0x7f8a200c7740 2023-07-27T20:32:28.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.654+0000 7f8a25dff700 1 -- 172.21.15.72:0/3985690045 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8a0006ace0 msgr2=0x7f8a0006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:28.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.654+0000 7f8a25dff700 1 --2- 172.21.15.72:0/3985690045 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8a0006ace0 0x7f8a0006d1a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8a10009130 tx=0x7f8a10008030 comp rx=0 tx=0).stop 2023-07-27T20:32:28.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.654+0000 7f8a25dff700 1 -- 172.21.15.72:0/3985690045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a200c7740 msgr2=0x7f8a200c3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:28.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.654+0000 7f8a25dff700 1 --2- 172.21.15.72:0/3985690045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a200c7740 0x7f8a200c3520 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8a0800c4d0 tx=0x7f8a0800c890 comp rx=0 tx=0).stop 2023-07-27T20:32:28.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.655+0000 7f8a25dff700 1 -- 172.21.15.72:0/3985690045 shutdown_connections 2023-07-27T20:32:28.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.655+0000 7f8a25dff700 1 --2- 172.21.15.72:0/3985690045 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8a0006ace0 0x7f8a0006d1a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:28.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.655+0000 7f8a25dff700 1 --2- 172.21.15.72:0/3985690045 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8a2014aab0 0x7f8a200c0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:28.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.655+0000 7f8a25dff700 1 --2- 172.21.15.72:0/3985690045 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a2006c1d0 0x7f8a201ea850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:28.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.655+0000 7f8a25dff700 1 --2- 172.21.15.72:0/3985690045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a200c7740 0x7f8a200c3520 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:28.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.655+0000 7f8a25dff700 1 -- 172.21.15.72:0/3985690045 >> 172.21.15.72:0/3985690045 conn(0x7f8a200ab3f0 msgr2=0x7f8a200c40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:28.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.655+0000 7f8a25dff700 1 -- 172.21.15.72:0/3985690045 shutdown_connections 2023-07-27T20:32:28.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:28.655+0000 7f8a25dff700 1 -- 172.21.15.72:0/3985690045 wait complete. 2023-07-27T20:32:28.662 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-27T20:32:28.663 DEBUG:teuthology.orchestra.run.smithi072:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T20:32:28.764 DEBUG:teuthology.orchestra.run.smithi173:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T20:32:28.875 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-27T20:32:28.875 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-27T20:32:28.876 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-27T20:32:28.922 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-27T20:32:28.922 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-27T20:32:29.008 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:32:29.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.261+0000 7ff869bff700 1 Processor -- start 2023-07-27T20:32:29.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.261+0000 7ff869bff700 1 -- start start 2023-07-27T20:32:29.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.262+0000 7ff869bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff864139f80 0x7ff8640c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:29.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.262+0000 7ff869bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8640c1810 con 0x7ff8641542e0 2023-07-27T20:32:29.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.262+0000 7ff869bff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff864139d40 con 0x7ff864139960 2023-07-27T20:32:29.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.262+0000 7ff869bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8640c0ee0 con 0x7ff864139f80 2023-07-27T20:32:29.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.263+0000 7ff863fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff8641542e0 0x7ff864154730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47564/0 (socket says 172.21.15.72:47564) 2023-07-27T20:32:29.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.263+0000 7ff863fff700 1 -- 172.21.15.72:0/2971619692 learned_addr learned my addr 172.21.15.72:0/2971619692 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:29.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.263+0000 7ff862ffd700 1 --2- 172.21.15.72:0/2971619692 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff864139f80 0x7ff8640c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:29.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.263+0000 7ff8627fc700 1 -- 172.21.15.72:0/2971619692 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4037336810 0 0) 0x7ff8640c1810 con 0x7ff8641542e0 2023-07-27T20:32:29.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.263+0000 7ff8627fc700 1 -- 172.21.15.72:0/2971619692 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff84c0035b0 con 0x7ff8641542e0 2023-07-27T20:32:29.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.263+0000 7ff8627fc700 1 -- 172.21.15.72:0/2971619692 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 75392181 0 0) 0x7ff864139d40 con 0x7ff864139960 2023-07-27T20:32:29.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.263+0000 7ff8627fc700 1 -- 172.21.15.72:0/2971619692 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8640c1810 con 0x7ff864139960 2023-07-27T20:32:29.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.263+0000 7ff8627fc700 1 -- 172.21.15.72:0/2971619692 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4238295893 0 0) 0x7ff84c0035b0 con 0x7ff8641542e0 2023-07-27T20:32:29.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.263+0000 7ff8627fc700 1 -- 172.21.15.72:0/2971619692 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff864139f80 msgr2=0x7ff8640c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:29.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.263+0000 7ff8627fc700 1 --2- 172.21.15.72:0/2971619692 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff864139f80 0x7ff8640c12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:29.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.263+0000 7ff8627fc700 1 -- 172.21.15.72:0/2971619692 >> v1:172.21.15.173:6789/0 conn(0x7ff864139960 legacy=0x7ff8640c1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:29.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.263+0000 7ff8627fc700 1 -- 172.21.15.72:0/2971619692 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff864151060 con 0x7ff8641542e0 2023-07-27T20:32:29.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.263+0000 7ff8627fc700 1 -- 172.21.15.72:0/2971619692 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7ff85c0019f0 con 0x7ff8641542e0 2023-07-27T20:32:29.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.263+0000 7ff862ffd700 1 --2- 172.21.15.72:0/2971619692 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff864139f80 0x7ff8640c12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:32:29.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.264+0000 7ff8627fc700 1 -- 172.21.15.72:0/2971619692 >> v1:172.21.15.72:6789/0 conn(0x7ff8641542e0 legacy=0x7ff864154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:29.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.264+0000 7ff8627fc700 1 --2- 172.21.15.72:0/2971619692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff84c003bc0 0x7ff84c003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:29.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.264+0000 7ff8627fc700 1 --2- 172.21.15.72:0/2971619692 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff84c004850 0x7ff84c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:29.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.264+0000 7ff8627fc700 1 --2- 172.21.15.72:0/2971619692 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff864139f80 0x7ff84c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:29.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.264+0000 7ff8627fc700 1 -- 172.21.15.72:0/2971619692 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8640c0ee0 con 0x7ff84c004850 2023-07-27T20:32:29.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.264+0000 7ff8627fc700 1 -- 172.21.15.72:0/2971619692 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c00bb50 con 0x7ff84c003bc0 2023-07-27T20:32:29.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.264+0000 7ff8627fc700 1 -- 172.21.15.72:0/2971619692 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c00bd10 con 0x7ff864139f80 2023-07-27T20:32:29.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.264+0000 7ff862ffd700 1 --2- 172.21.15.72:0/2971619692 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff84c004850 0x7ff84c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:29.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.264+0000 7ff8637fe700 1 --2- 172.21.15.72:0/2971619692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff84c003bc0 0x7ff84c003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:29.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.264+0000 7ff863fff700 1 --2- 172.21.15.72:0/2971619692 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff864139f80 0x7ff84c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:29.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.264+0000 7ff862ffd700 1 -- 172.21.15.72:0/2971619692 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff864139f80 msgr2=0x7ff84c005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:29.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.264+0000 7ff862ffd700 1 --2- 172.21.15.72:0/2971619692 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff864139f80 0x7ff84c005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:29.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.264+0000 7ff862ffd700 1 -- 172.21.15.72:0/2971619692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff84c003bc0 msgr2=0x7ff84c003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:29.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.264+0000 7ff862ffd700 1 --2- 172.21.15.72:0/2971619692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff84c003bc0 0x7ff84c003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:29.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.264+0000 7ff862ffd700 1 -- 172.21.15.72:0/2971619692 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8580094a0 con 0x7ff84c004850 2023-07-27T20:32:29.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.264+0000 7ff8637fe700 1 --2- 172.21.15.72:0/2971619692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff84c003bc0 0x7ff84c003fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:29.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.264+0000 7ff862ffd700 1 --2- 172.21.15.72:0/2971619692 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff84c004850 0x7ff84c004cd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff8580098c0 tx=0x7ff84c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec8d66c4bcb47ef server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:29.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.265+0000 7ff8627fc700 1 -- 172.21.15.72:0/2971619692 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff858009e50 con 0x7ff84c004850 2023-07-27T20:32:29.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.265+0000 7ff8627fc700 1 -- 172.21.15.72:0/2971619692 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85800e9a0 con 0x7ff84c004850 2023-07-27T20:32:29.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.265+0000 7ff8627fc700 1 -- 172.21.15.72:0/2971619692 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85800ed30 con 0x7ff84c004850 2023-07-27T20:32:29.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.265+0000 7ff869bff700 1 -- 172.21.15.72:0/2971619692 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff84c004850 msgr2=0x7ff84c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:29.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.265+0000 7ff869bff700 1 --2- 172.21.15.72:0/2971619692 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff84c004850 0x7ff84c004cd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff8580098c0 tx=0x7ff84c005880 comp rx=0 tx=0).stop 2023-07-27T20:32:29.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.265+0000 7ff863fff700 1 -- 172.21.15.72:0/2971619692 reap_dead start 2023-07-27T20:32:29.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.265+0000 7ff869bff700 1 -- 172.21.15.72:0/2971619692 shutdown_connections 2023-07-27T20:32:29.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.265+0000 7ff869bff700 1 -- 172.21.15.72:0/2971619692 >> 172.21.15.72:0/2971619692 conn(0x7ff86406a190 msgr2=0x7ff86406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:29.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.265+0000 7ff869bff700 1 -- 172.21.15.72:0/2971619692 shutdown_connections 2023-07-27T20:32:29.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.265+0000 7ff869bff700 1 -- 172.21.15.72:0/2971619692 wait complete. 2023-07-27T20:32:29.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.267+0000 7ff869bff700 1 Processor -- start 2023-07-27T20:32:29.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.267+0000 7ff869bff700 1 -- start start 2023-07-27T20:32:29.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.268+0000 7ff869bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff84c004850 0x7ff8640be990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:29.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.268+0000 7ff869bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8641dcf90 0x7ff86414db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:29.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.268+0000 7ff869bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff86414e090 0x7ff8641ed3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:29.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.268+0000 7ff869bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8641da4d0 con 0x7ff8641dcf90 2023-07-27T20:32:29.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.268+0000 7ff869bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8641da7b0 con 0x7ff84c004850 2023-07-27T20:32:29.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.268+0000 7ff869bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8641daa90 con 0x7ff86414e090 2023-07-27T20:32:29.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.268+0000 7ff862ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8641dcf90 0x7ff86414db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:29.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.268+0000 7ff862ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8641dcf90 0x7ff86414db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41172/0 (socket says 172.21.15.72:41172) 2023-07-27T20:32:29.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.268+0000 7ff862ffd700 1 -- 172.21.15.72:0/1176712462 learned_addr learned my addr 172.21.15.72:0/1176712462 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:29.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.269+0000 7ff8637fe700 1 --2- 172.21.15.72:0/1176712462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff84c004850 0x7ff8640be990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:29.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.269+0000 7ff863fff700 1 --2- 172.21.15.72:0/1176712462 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff86414e090 0x7ff8641ed3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:29.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.269+0000 7ff862ffd700 1 -- 172.21.15.72:0/1176712462 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff86414e090 msgr2=0x7ff8641ed3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:29.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.269+0000 7ff862ffd700 1 --2- 172.21.15.72:0/1176712462 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff86414e090 0x7ff8641ed3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:29.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.269+0000 7ff862ffd700 1 -- 172.21.15.72:0/1176712462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff84c004850 msgr2=0x7ff8640be990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:29.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.269+0000 7ff862ffd700 1 --2- 172.21.15.72:0/1176712462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff84c004850 0x7ff8640be990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:29.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.269+0000 7ff862ffd700 1 -- 172.21.15.72:0/1176712462 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8641dad70 con 0x7ff8641dcf90 2023-07-27T20:32:29.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.269+0000 7ff862ffd700 1 --2- 172.21.15.72:0/1176712462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8641dcf90 0x7ff86414db50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff8580090b0 tx=0x7ff8580047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:29.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.269+0000 7ff84bfff700 1 -- 172.21.15.72:0/1176712462 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff858003ab0 con 0x7ff8641dcf90 2023-07-27T20:32:29.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.269+0000 7ff84bfff700 1 -- 172.21.15.72:0/1176712462 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff858003c30 con 0x7ff8641dcf90 2023-07-27T20:32:29.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.269+0000 7ff84bfff700 1 -- 172.21.15.72:0/1176712462 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff858009e50 con 0x7ff8641dcf90 2023-07-27T20:32:29.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.269+0000 7ff869bff700 1 -- 172.21.15.72:0/1176712462 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8640beed0 con 0x7ff8641dcf90 2023-07-27T20:32:29.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.269+0000 7ff869bff700 1 -- 172.21.15.72:0/1176712462 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff86414e540 con 0x7ff8641dcf90 2023-07-27T20:32:29.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.270+0000 7ff869bff700 1 -- 172.21.15.72:0/1176712462 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8641dc960 con 0x7ff8641dcf90 2023-07-27T20:32:29.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.271+0000 7ff84bfff700 1 -- 172.21.15.72:0/1176712462 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff858019440 con 0x7ff8641dcf90 2023-07-27T20:32:29.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.272+0000 7ff84bfff700 1 --2- 172.21.15.72:0/1176712462 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff85006ace0 0x7ff85006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:29.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.272+0000 7ff84bfff700 1 -- 172.21.15.72:0/1176712462 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff85808a5d0 con 0x7ff8641dcf90 2023-07-27T20:32:29.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.273+0000 7ff8637fe700 1 --2- 172.21.15.72:0/1176712462 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff85006ace0 0x7ff85006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:29.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.273+0000 7ff8637fe700 1 --2- 172.21.15.72:0/1176712462 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff85006ace0 0x7ff85006d1a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff854005530 tx=0x7ff854009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:29.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.276+0000 7ff84bfff700 1 -- 172.21.15.72:0/1176712462 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff8641dc960 con 0x7ff8641dcf90 2023-07-27T20:32:29.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.475+0000 7ff869bff700 1 -- 172.21.15.72:0/1176712462 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8641dc960 con 0x7ff8641dcf90 2023-07-27T20:32:29.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.476+0000 7ff84bfff700 1 -- 172.21.15.72:0/1176712462 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20215 (secure 0 0 0) 0x7ff8641dc960 con 0x7ff8641dcf90 2023-07-27T20:32:29.464 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:32:29.464 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":29,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:32:10.402254+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:31:27.020951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T20:31:27.566022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-27T20:31:31.182401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:32:29.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.478+0000 7ff869bff700 1 -- 172.21.15.72:0/1176712462 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff85006ace0 msgr2=0x7ff85006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:29.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.478+0000 7ff869bff700 1 --2- 172.21.15.72:0/1176712462 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff85006ace0 0x7ff85006d1a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff854005530 tx=0x7ff854009040 comp rx=0 tx=0).stop 2023-07-27T20:32:29.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.478+0000 7ff869bff700 1 -- 172.21.15.72:0/1176712462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8641dcf90 msgr2=0x7ff86414db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:29.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.478+0000 7ff869bff700 1 --2- 172.21.15.72:0/1176712462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8641dcf90 0x7ff86414db50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff8580090b0 tx=0x7ff8580047c0 comp rx=0 tx=0).stop 2023-07-27T20:32:29.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.478+0000 7ff869bff700 1 -- 172.21.15.72:0/1176712462 shutdown_connections 2023-07-27T20:32:29.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.478+0000 7ff869bff700 1 --2- 172.21.15.72:0/1176712462 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff85006ace0 0x7ff85006d1a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:29.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.478+0000 7ff869bff700 1 --2- 172.21.15.72:0/1176712462 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff86414e090 0x7ff8641ed3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:29.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.478+0000 7ff869bff700 1 --2- 172.21.15.72:0/1176712462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff84c004850 0x7ff8640be990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:29.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.478+0000 7ff869bff700 1 --2- 172.21.15.72:0/1176712462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8641dcf90 0x7ff86414db50 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:29.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.478+0000 7ff869bff700 1 -- 172.21.15.72:0/1176712462 >> 172.21.15.72:0/1176712462 conn(0x7ff86406a190 msgr2=0x7ff8641315f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:29.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.478+0000 7ff869bff700 1 -- 172.21.15.72:0/1176712462 shutdown_connections 2023-07-27T20:32:29.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.478+0000 7ff869bff700 1 -- 172.21.15.72:0/1176712462 wait complete. 2023-07-27T20:32:29.484 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-27T20:31:14.581785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T20:31:21.077941+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T20:31:27.020951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T20:31:27.566022+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-27T20:31:31.182401+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-27T20:32:29.485 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-27T20:32:29.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.697+0000 7f1a5b9ff700 1 Processor -- start 2023-07-27T20:32:29.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.698+0000 7f1a5b9ff700 1 -- start start 2023-07-27T20:32:29.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.699+0000 7f1a5b9ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a5406c1d0 0x7f1a5406c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:29.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.699+0000 7f1a5b9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a540c7c50 con 0x7f1a540c7740 2023-07-27T20:32:29.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.699+0000 7f1a5b9ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a5406bd40 con 0x7f1a5414aab0 2023-07-27T20:32:29.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.699+0000 7f1a5b9ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a540c62f0 con 0x7f1a5406c1d0 2023-07-27T20:32:29.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.699+0000 7f1a58f9a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1a540c7740 0x7f1a540c41c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47580/0 (socket says 172.21.15.72:47580) 2023-07-27T20:32:29.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.699+0000 7f1a58f9a700 1 -- 172.21.15.72:0/766585964 learned_addr learned my addr 172.21.15.72:0/766585964 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:29.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.699+0000 7f1a4bfff700 1 -- 172.21.15.72:0/766585964 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2326306436 0 0) 0x7f1a540c7c50 con 0x7f1a540c7740 2023-07-27T20:32:29.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.699+0000 7f1a4bfff700 1 -- 172.21.15.72:0/766585964 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a400035b0 con 0x7f1a540c7740 2023-07-27T20:32:29.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.699+0000 7f1a59f9c700 1 --2- 172.21.15.72:0/766585964 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a5406c1d0 0x7f1a5406c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:29.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.700+0000 7f1a4bfff700 1 -- 172.21.15.72:0/766585964 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3615089128 0 0) 0x7f1a400035b0 con 0x7f1a540c7740 2023-07-27T20:32:29.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.700+0000 7f1a4bfff700 1 -- 172.21.15.72:0/766585964 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a5406c1d0 msgr2=0x7f1a5406c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:29.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.700+0000 7f1a4bfff700 1 --2- 172.21.15.72:0/766585964 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a5406c1d0 0x7f1a5406c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:29.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.700+0000 7f1a4bfff700 1 -- 172.21.15.72:0/766585964 >> v1:172.21.15.173:6789/0 conn(0x7f1a5414aab0 legacy=0x7f1a54154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:29.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.700+0000 7f1a4bfff700 1 -- 172.21.15.72:0/766585964 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5406d200 con 0x7f1a540c7740 2023-07-27T20:32:29.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.700+0000 7f1a4bfff700 1 -- 172.21.15.72:0/766585964 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f1a44001670 con 0x7f1a540c7740 2023-07-27T20:32:29.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.700+0000 7f1a4bfff700 1 -- 172.21.15.72:0/766585964 >> v1:172.21.15.72:6789/0 conn(0x7f1a540c7740 legacy=0x7f1a540c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:29.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.700+0000 7f1a4bfff700 1 --2- 172.21.15.72:0/766585964 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a40003a30 0x7f1a40003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:29.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.700+0000 7f1a4bfff700 1 --2- 172.21.15.72:0/766585964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a40004850 0x7f1a40004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:29.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.700+0000 7f1a4bfff700 1 --2- 172.21.15.72:0/766585964 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a5406c1d0 0x7f1a40005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:29.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.700+0000 7f1a4bfff700 1 -- 172.21.15.72:0/766585964 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a540c62f0 con 0x7f1a40004850 2023-07-27T20:32:29.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.700+0000 7f1a4bfff700 1 -- 172.21.15.72:0/766585964 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4000bac0 con 0x7f1a40003a30 2023-07-27T20:32:29.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.700+0000 7f1a4bfff700 1 -- 172.21.15.72:0/766585964 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4000bc80 con 0x7f1a5406c1d0 2023-07-27T20:32:29.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.700+0000 7f1a58f9a700 1 --2- 172.21.15.72:0/766585964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a40004850 0x7f1a40004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:29.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.700+0000 7f1a59f9c700 1 --2- 172.21.15.72:0/766585964 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a5406c1d0 0x7f1a40005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:29.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.700+0000 7f1a5979b700 1 --2- 172.21.15.72:0/766585964 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a40003a30 0x7f1a40003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:29.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.701+0000 7f1a58f9a700 1 -- 172.21.15.72:0/766585964 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a5406c1d0 msgr2=0x7f1a40005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:29.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.701+0000 7f1a58f9a700 1 --2- 172.21.15.72:0/766585964 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a5406c1d0 0x7f1a40005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:29.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.701+0000 7f1a58f9a700 1 -- 172.21.15.72:0/766585964 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a40003a30 msgr2=0x7f1a40003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:29.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.701+0000 7f1a58f9a700 1 --2- 172.21.15.72:0/766585964 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a40003a30 0x7f1a40003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:29.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.701+0000 7f1a58f9a700 1 -- 172.21.15.72:0/766585964 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a400035b0 con 0x7f1a40004850 2023-07-27T20:32:29.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.701+0000 7f1a58f9a700 1 --2- 172.21.15.72:0/766585964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a40004850 0x7f1a40004cd0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1a44001eb0 tx=0x7f1a40005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57cc6301f7c0053c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:29.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.701+0000 7f1a4bfff700 1 -- 172.21.15.72:0/766585964 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a44007c10 con 0x7f1a40004850 2023-07-27T20:32:29.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.701+0000 7f1a4bfff700 1 -- 172.21.15.72:0/766585964 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4400cd80 con 0x7f1a40004850 2023-07-27T20:32:29.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.701+0000 7f1a4bfff700 1 -- 172.21.15.72:0/766585964 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a44005ba0 con 0x7f1a40004850 2023-07-27T20:32:29.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.702+0000 7f1a5b9ff700 1 -- 172.21.15.72:0/766585964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a40004850 msgr2=0x7f1a40004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:29.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.702+0000 7f1a5b9ff700 1 --2- 172.21.15.72:0/766585964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a40004850 0x7f1a40004cd0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1a44001eb0 tx=0x7f1a40005880 comp rx=0 tx=0).stop 2023-07-27T20:32:29.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.702+0000 7f1a59f9c700 1 -- 172.21.15.72:0/766585964 reap_dead start 2023-07-27T20:32:29.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.702+0000 7f1a5b9ff700 1 -- 172.21.15.72:0/766585964 shutdown_connections 2023-07-27T20:32:29.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.702+0000 7f1a5b9ff700 1 -- 172.21.15.72:0/766585964 >> 172.21.15.72:0/766585964 conn(0x7f1a540ab3f0 msgr2=0x7f1a540ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:29.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.702+0000 7f1a5b9ff700 1 -- 172.21.15.72:0/766585964 shutdown_connections 2023-07-27T20:32:29.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.702+0000 7f1a5b9ff700 1 -- 172.21.15.72:0/766585964 wait complete. 2023-07-27T20:32:29.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.704+0000 7f1a5b9ff700 1 Processor -- start 2023-07-27T20:32:29.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.704+0000 7f1a5b9ff700 1 -- start start 2023-07-27T20:32:29.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.705+0000 7f1a5b9ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a40004850 0x7f1a541ece70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:29.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.705+0000 7f1a5b9ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a540c2c70 0x7f1a541ed3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:29.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.705+0000 7f1a5b9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a541474c0 0x7f1a54147950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:29.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.705+0000 7f1a5b9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a54157a90 con 0x7f1a541474c0 2023-07-27T20:32:29.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.705+0000 7f1a5b9ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a540c06d0 con 0x7f1a540c2c70 2023-07-27T20:32:29.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.705+0000 7f1a5b9ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a541ed9d0 con 0x7f1a40004850 2023-07-27T20:32:29.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.705+0000 7f1a59f9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a541474c0 0x7f1a54147950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:29.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.705+0000 7f1a59f9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a541474c0 0x7f1a54147950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41192/0 (socket says 172.21.15.72:41192) 2023-07-27T20:32:29.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.705+0000 7f1a59f9c700 1 -- 172.21.15.72:0/2210131960 learned_addr learned my addr 172.21.15.72:0/2210131960 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:29.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.705+0000 7f1a5979b700 1 --2- 172.21.15.72:0/2210131960 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a40004850 0x7f1a541ece70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:29.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.705+0000 7f1a58f9a700 1 --2- 172.21.15.72:0/2210131960 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a540c2c70 0x7f1a541ed3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:29.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.705+0000 7f1a59f9c700 1 -- 172.21.15.72:0/2210131960 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a40004850 msgr2=0x7f1a541ece70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:29.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.705+0000 7f1a59f9c700 1 --2- 172.21.15.72:0/2210131960 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a40004850 0x7f1a541ece70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:29.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.705+0000 7f1a59f9c700 1 -- 172.21.15.72:0/2210131960 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a540c2c70 msgr2=0x7f1a541ed3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:29.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.705+0000 7f1a59f9c700 1 --2- 172.21.15.72:0/2210131960 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a540c2c70 0x7f1a541ed3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:29.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.705+0000 7f1a59f9c700 1 -- 172.21.15.72:0/2210131960 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a541eadd0 con 0x7f1a541474c0 2023-07-27T20:32:29.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.706+0000 7f1a59f9c700 1 --2- 172.21.15.72:0/2210131960 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a541474c0 0x7f1a54147950 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1a5408b790 tx=0x7f1a4c011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:29.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.706+0000 7f1a49ffb700 1 -- 172.21.15.72:0/2210131960 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c00e040 con 0x7f1a541474c0 2023-07-27T20:32:29.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.706+0000 7f1a49ffb700 1 -- 172.21.15.72:0/2210131960 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4c00f040 con 0x7f1a541474c0 2023-07-27T20:32:29.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.706+0000 7f1a5b9ff700 1 -- 172.21.15.72:0/2210131960 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a541eb0b0 con 0x7f1a541474c0 2023-07-27T20:32:29.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.706+0000 7f1a49ffb700 1 -- 172.21.15.72:0/2210131960 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c00fde0 con 0x7f1a541474c0 2023-07-27T20:32:29.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.706+0000 7f1a5b9ff700 1 -- 172.21.15.72:0/2210131960 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a540c8da0 con 0x7f1a541474c0 2023-07-27T20:32:29.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.707+0000 7f1a5b9ff700 1 -- 172.21.15.72:0/2210131960 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a541eb2a0 con 0x7f1a541474c0 2023-07-27T20:32:29.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.708+0000 7f1a49ffb700 1 -- 172.21.15.72:0/2210131960 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1a4c022460 con 0x7f1a541474c0 2023-07-27T20:32:29.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.709+0000 7f1a49ffb700 1 --2- 172.21.15.72:0/2210131960 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1a3806ad10 0x7f1a3806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:29.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.709+0000 7f1a49ffb700 1 -- 172.21.15.72:0/2210131960 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1a4c089bd0 con 0x7f1a541474c0 2023-07-27T20:32:29.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.709+0000 7f1a5979b700 1 --2- 172.21.15.72:0/2210131960 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1a3806ad10 0x7f1a3806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:29.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.710+0000 7f1a5979b700 1 --2- 172.21.15.72:0/2210131960 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1a3806ad10 0x7f1a3806d1d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1a50007fd0 tx=0x7f1a50009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:29.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.713+0000 7f1a49ffb700 1 -- 172.21.15.72:0/2210131960 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1a4c054950 con 0x7f1a541474c0 2023-07-27T20:32:29.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.906+0000 7f1a5b9ff700 1 -- 172.21.15.72:0/2210131960 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1a5404e470 con 0x7f1a541474c0 2023-07-27T20:32:29.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.907+0000 7f1a49ffb700 1 -- 172.21.15.72:0/2210131960 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1a4c057f70 con 0x7f1a541474c0 2023-07-27T20:32:29.895 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-27T20:32:29.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.909+0000 7f1a5b9ff700 1 -- 172.21.15.72:0/2210131960 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1a3806ad10 msgr2=0x7f1a3806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:29.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.909+0000 7f1a5b9ff700 1 --2- 172.21.15.72:0/2210131960 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1a3806ad10 0x7f1a3806d1d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1a50007fd0 tx=0x7f1a50009040 comp rx=0 tx=0).stop 2023-07-27T20:32:29.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.909+0000 7f1a5b9ff700 1 -- 172.21.15.72:0/2210131960 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a541474c0 msgr2=0x7f1a54147950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:29.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.909+0000 7f1a5b9ff700 1 --2- 172.21.15.72:0/2210131960 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a541474c0 0x7f1a54147950 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1a5408b790 tx=0x7f1a4c011f60 comp rx=0 tx=0).stop 2023-07-27T20:32:29.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.909+0000 7f1a5b9ff700 1 -- 172.21.15.72:0/2210131960 shutdown_connections 2023-07-27T20:32:29.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.909+0000 7f1a5b9ff700 1 --2- 172.21.15.72:0/2210131960 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a541474c0 0x7f1a54147950 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:29.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.909+0000 7f1a5b9ff700 1 --2- 172.21.15.72:0/2210131960 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1a3806ad10 0x7f1a3806d1d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:29.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.909+0000 7f1a5b9ff700 1 --2- 172.21.15.72:0/2210131960 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a40004850 0x7f1a541ece70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:29.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.909+0000 7f1a5b9ff700 1 --2- 172.21.15.72:0/2210131960 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a540c2c70 0x7f1a541ed3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:29.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.909+0000 7f1a5b9ff700 1 -- 172.21.15.72:0/2210131960 >> 172.21.15.72:0/2210131960 conn(0x7f1a540ab3f0 msgr2=0x7f1a54153c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:29.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.909+0000 7f1a5b9ff700 1 -- 172.21.15.72:0/2210131960 shutdown_connections 2023-07-27T20:32:29.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:29.909+0000 7f1a5b9ff700 1 -- 172.21.15.72:0/2210131960 wait complete. 2023-07-27T20:32:29.915 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T20:32:30.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.126+0000 7f88b59ff700 1 Processor -- start 2023-07-27T20:32:30.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.126+0000 7f88b59ff700 1 -- start start 2023-07-27T20:32:30.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.127+0000 7f88b59ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88b00c77c0 0x7f88b0151210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:30.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.127+0000 7f88b59ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f88b006ffc0 0x7f88b0151750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:30.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.127+0000 7f88b59ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b006d1c0 con 0x7f88b00c6710 2023-07-27T20:32:30.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.127+0000 7f88b59ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88b0155070 con 0x7f88b006ffc0 2023-07-27T20:32:30.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.127+0000 7f88b59ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b006ce90 con 0x7f88b00c77c0 2023-07-27T20:32:30.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.127+0000 7f88af7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f88b00c6710 0x7f88b00c6bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58960/0 (socket says 172.21.15.72:58960) 2023-07-27T20:32:30.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.127+0000 7f88af7fe700 1 -- 172.21.15.72:0/4247159059 learned_addr learned my addr 172.21.15.72:0/4247159059 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:30.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.127+0000 7f88aeffd700 1 --2- 172.21.15.72:0/4247159059 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88b00c77c0 0x7f88b0151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:30.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.127+0000 7f88a7fff700 1 --2- 172.21.15.72:0/4247159059 >> v2:172.21.15.173:3300/0 conn(0x7f88b006ffc0 0x7f88b0151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:30.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.127+0000 7f88ae7fc700 1 -- 172.21.15.72:0/4247159059 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 838974688 0 0) 0x7f88b006d1c0 con 0x7f88b00c6710 2023-07-27T20:32:30.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.127+0000 7f88ae7fc700 1 -- 172.21.15.72:0/4247159059 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f889c0035b0 con 0x7f88b00c6710 2023-07-27T20:32:30.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.128+0000 7f88ae7fc700 1 -- 172.21.15.72:0/4247159059 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2204894497 0 0) 0x7f889c0035b0 con 0x7f88b00c6710 2023-07-27T20:32:30.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.128+0000 7f88ae7fc700 1 -- 172.21.15.72:0/4247159059 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88b00c77c0 msgr2=0x7f88b0151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:30.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.128+0000 7f88ae7fc700 1 --2- 172.21.15.72:0/4247159059 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88b00c77c0 0x7f88b0151210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:30.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.128+0000 7f88ae7fc700 1 -- 172.21.15.72:0/4247159059 >> v2:172.21.15.173:3300/0 conn(0x7f88b006ffc0 msgr2=0x7f88b0151750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:30.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.128+0000 7f88ae7fc700 1 --2- 172.21.15.72:0/4247159059 >> v2:172.21.15.173:3300/0 conn(0x7f88b006ffc0 0x7f88b0151750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:30.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.128+0000 7f88ae7fc700 1 -- 172.21.15.72:0/4247159059 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b0154d90 con 0x7f88b00c6710 2023-07-27T20:32:30.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.128+0000 7f88ae7fc700 1 -- 172.21.15.72:0/4247159059 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f88a80019f0 con 0x7f88b00c6710 2023-07-27T20:32:30.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.128+0000 7f88ae7fc700 1 -- 172.21.15.72:0/4247159059 >> v1:172.21.15.72:6789/0 conn(0x7f88b00c6710 legacy=0x7f88b00c6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:30.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.128+0000 7f88ae7fc700 1 --2- 172.21.15.72:0/4247159059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f889c003a00 0x7f889c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:30.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.128+0000 7f88ae7fc700 1 --2- 172.21.15.72:0/4247159059 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f889c004850 0x7f889c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:30.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.128+0000 7f88ae7fc700 1 --2- 172.21.15.72:0/4247159059 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88b00c77c0 0x7f889c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:30.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.128+0000 7f88ae7fc700 1 -- 172.21.15.72:0/4247159059 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b0155070 con 0x7f889c004850 2023-07-27T20:32:30.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.128+0000 7f88ae7fc700 1 -- 172.21.15.72:0/4247159059 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b006ce90 con 0x7f889c003a00 2023-07-27T20:32:30.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.128+0000 7f88ae7fc700 1 -- 172.21.15.72:0/4247159059 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f889c00ba90 con 0x7f88b00c77c0 2023-07-27T20:32:30.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.128+0000 7f88a7fff700 1 --2- 172.21.15.72:0/4247159059 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f889c004850 0x7f889c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:30.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.128+0000 7f88af7fe700 1 --2- 172.21.15.72:0/4247159059 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88b00c77c0 0x7f889c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:30.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.128+0000 7f88aeffd700 1 --2- 172.21.15.72:0/4247159059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f889c003a00 0x7f889c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:30.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.129+0000 7f88a7fff700 1 -- 172.21.15.72:0/4247159059 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88b00c77c0 msgr2=0x7f889c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:30.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.129+0000 7f88a7fff700 1 --2- 172.21.15.72:0/4247159059 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88b00c77c0 0x7f889c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:30.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.129+0000 7f88a7fff700 1 -- 172.21.15.72:0/4247159059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f889c003a00 msgr2=0x7f889c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:30.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.129+0000 7f88a7fff700 1 --2- 172.21.15.72:0/4247159059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f889c003a00 0x7f889c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:30.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.129+0000 7f88a7fff700 1 -- 172.21.15.72:0/4247159059 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f889c0035b0 con 0x7f889c004850 2023-07-27T20:32:30.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.129+0000 7f88aeffd700 1 --2- 172.21.15.72:0/4247159059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f889c003a00 0x7f889c003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:30.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.129+0000 7f88a7fff700 1 --2- 172.21.15.72:0/4247159059 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f889c004850 0x7f889c004cd0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8898009b30 tx=0x7f889c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea8f47831f06779a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:30.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.129+0000 7f88ae7fc700 1 -- 172.21.15.72:0/4247159059 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889800e6c0 con 0x7f889c004850 2023-07-27T20:32:30.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.129+0000 7f88ae7fc700 1 -- 172.21.15.72:0/4247159059 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889800e820 con 0x7f889c004850 2023-07-27T20:32:30.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.129+0000 7f88ae7fc700 1 -- 172.21.15.72:0/4247159059 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889800eb90 con 0x7f889c004850 2023-07-27T20:32:30.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.130+0000 7f88b59ff700 1 -- 172.21.15.72:0/4247159059 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f889c004850 msgr2=0x7f889c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:30.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.130+0000 7f88b59ff700 1 --2- 172.21.15.72:0/4247159059 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f889c004850 0x7f889c004cd0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8898009b30 tx=0x7f889c005880 comp rx=0 tx=0).stop 2023-07-27T20:32:30.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.130+0000 7f88af7fe700 1 -- 172.21.15.72:0/4247159059 reap_dead start 2023-07-27T20:32:30.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.130+0000 7f88b59ff700 1 -- 172.21.15.72:0/4247159059 shutdown_connections 2023-07-27T20:32:30.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.130+0000 7f88b59ff700 1 -- 172.21.15.72:0/4247159059 >> 172.21.15.72:0/4247159059 conn(0x7f88b006a190 msgr2=0x7f88b006a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:30.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.130+0000 7f88b59ff700 1 -- 172.21.15.72:0/4247159059 shutdown_connections 2023-07-27T20:32:30.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.130+0000 7f88b59ff700 1 -- 172.21.15.72:0/4247159059 wait complete. 2023-07-27T20:32:30.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.131+0000 7f88b59ff700 1 Processor -- start 2023-07-27T20:32:30.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.132+0000 7f88b59ff700 1 -- start start 2023-07-27T20:32:30.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.132+0000 7f88b59ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f889c004850 0x7f88b01ecff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:30.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.132+0000 7f88b59ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88b01ed530 0x7f88b014ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:30.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.132+0000 7f88b59ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88b014dc90 0x7f88b014d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:30.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.132+0000 7f88b59ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b00ac910 con 0x7f889c004850 2023-07-27T20:32:30.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.132+0000 7f88b59ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b014d770 con 0x7f88b014dc90 2023-07-27T20:32:30.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.132+0000 7f88b59ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b01583d0 con 0x7f88b01ed530 2023-07-27T20:32:30.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.133+0000 7f88aeffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f889c004850 0x7f88b01ecff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:30.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.133+0000 7f88aeffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f889c004850 0x7f88b01ecff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56824/0 (socket says 172.21.15.72:56824) 2023-07-27T20:32:30.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.133+0000 7f88aeffd700 1 -- 172.21.15.72:0/1932760801 learned_addr learned my addr 172.21.15.72:0/1932760801 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:30.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.133+0000 7f88aeffd700 1 -- 172.21.15.72:0/1932760801 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88b01ed530 msgr2=0x7f88b014ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:30.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.133+0000 7f88aeffd700 1 --2- 172.21.15.72:0/1932760801 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88b01ed530 0x7f88b014ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:30.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.133+0000 7f88aeffd700 1 -- 172.21.15.72:0/1932760801 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88b014dc90 msgr2=0x7f88b014d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:30.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.133+0000 7f88aeffd700 1 --2- 172.21.15.72:0/1932760801 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88b014dc90 0x7f88b014d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:30.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.133+0000 7f88aeffd700 1 -- 172.21.15.72:0/1932760801 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b00aa7d0 con 0x7f889c004850 2023-07-27T20:32:30.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.133+0000 7f88aeffd700 1 --2- 172.21.15.72:0/1932760801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f889c004850 0x7f88b01ecff0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f88a0010880 tx=0x7f88a0010c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:30.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.133+0000 7f88acff9700 1 -- 172.21.15.72:0/1932760801 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a0010e80 con 0x7f889c004850 2023-07-27T20:32:30.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.133+0000 7f88acff9700 1 -- 172.21.15.72:0/1932760801 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a0004020 con 0x7f889c004850 2023-07-27T20:32:30.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.133+0000 7f88b59ff700 1 -- 172.21.15.72:0/1932760801 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88b01ed9c0 con 0x7f889c004850 2023-07-27T20:32:30.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.134+0000 7f88acff9700 1 -- 172.21.15.72:0/1932760801 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a00043b0 con 0x7f889c004850 2023-07-27T20:32:30.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.134+0000 7f88b59ff700 1 -- 172.21.15.72:0/1932760801 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b00c4d30 con 0x7f889c004850 2023-07-27T20:32:30.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.135+0000 7f88b59ff700 1 -- 172.21.15.72:0/1932760801 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88b004e470 con 0x7f889c004850 2023-07-27T20:32:30.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.135+0000 7f88acff9700 1 -- 172.21.15.72:0/1932760801 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f88a000e850 con 0x7f889c004850 2023-07-27T20:32:30.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.136+0000 7f88acff9700 1 --2- 172.21.15.72:0/1932760801 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f889006ad10 0x7f889006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:30.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.136+0000 7f88acff9700 1 -- 172.21.15.72:0/1932760801 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f88a0089950 con 0x7f889c004850 2023-07-27T20:32:30.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.137+0000 7f88a7fff700 1 --2- 172.21.15.72:0/1932760801 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f889006ad10 0x7f889006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:30.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.137+0000 7f88a7fff700 1 --2- 172.21.15.72:0/1932760801 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f889006ad10 0x7f889006d1d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f88b014db60 tx=0x7f8898013000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:30.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.140+0000 7f88acff9700 1 -- 172.21.15.72:0/1932760801 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f88a00546c0 con 0x7f889c004850 2023-07-27T20:32:30.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.337+0000 7f88b59ff700 1 -- 172.21.15.72:0/1932760801 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f88b00aa960 con 0x7f889c004850 2023-07-27T20:32:30.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.337+0000 7f88acff9700 1 -- 172.21.15.72:0/1932760801 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f88a0057ce0 con 0x7f889c004850 2023-07-27T20:32:30.325 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-27T20:32:30.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.339+0000 7f88b59ff700 1 -- 172.21.15.72:0/1932760801 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f889006ad10 msgr2=0x7f889006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:30.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.339+0000 7f88b59ff700 1 --2- 172.21.15.72:0/1932760801 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f889006ad10 0x7f889006d1d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f88b014db60 tx=0x7f8898013000 comp rx=0 tx=0).stop 2023-07-27T20:32:30.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.339+0000 7f88b59ff700 1 -- 172.21.15.72:0/1932760801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f889c004850 msgr2=0x7f88b01ecff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:30.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.339+0000 7f88b59ff700 1 --2- 172.21.15.72:0/1932760801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f889c004850 0x7f88b01ecff0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f88a0010880 tx=0x7f88a0010c40 comp rx=0 tx=0).stop 2023-07-27T20:32:30.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.340+0000 7f88b59ff700 1 -- 172.21.15.72:0/1932760801 shutdown_connections 2023-07-27T20:32:30.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.340+0000 7f88b59ff700 1 --2- 172.21.15.72:0/1932760801 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88b014dc90 0x7f88b014d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:30.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.340+0000 7f88b59ff700 1 --2- 172.21.15.72:0/1932760801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f889c004850 0x7f88b01ecff0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:30.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.340+0000 7f88b59ff700 1 --2- 172.21.15.72:0/1932760801 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f889006ad10 0x7f889006d1d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:30.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.340+0000 7f88b59ff700 1 --2- 172.21.15.72:0/1932760801 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88b01ed530 0x7f88b014ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:30.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.340+0000 7f88b59ff700 1 -- 172.21.15.72:0/1932760801 >> 172.21.15.72:0/1932760801 conn(0x7f88b006a190 msgr2=0x7f88b00c5600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:30.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.340+0000 7f88b59ff700 1 -- 172.21.15.72:0/1932760801 shutdown_connections 2023-07-27T20:32:30.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.340+0000 7f88b59ff700 1 -- 172.21.15.72:0/1932760801 wait complete. 2023-07-27T20:32:30.345 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T20:32:30.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.555+0000 7f61b4fff700 1 Processor -- start 2023-07-27T20:32:30.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.556+0000 7f61b4fff700 1 -- start start 2023-07-27T20:32:30.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.557+0000 7f61b4fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61b014aab0 0x7f61b0154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:30.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.557+0000 7f61b4fff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f61b006c1d0 0x7f61b006c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:30.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.557+0000 7f61b4fff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61b00c7c50 con 0x7f61b00c7740 2023-07-27T20:32:30.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.557+0000 7f61b4fff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61b006bd40 con 0x7f61b006c1d0 2023-07-27T20:32:30.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.557+0000 7f61b4fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b00c62f0 con 0x7f61b014aab0 2023-07-27T20:32:30.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.557+0000 7f61ae59c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61b014aab0 0x7f61b0154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:30.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.557+0000 7f61aed9d700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f61b006c1d0 0x7f61b006c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:30.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.557+0000 7f61a7fff700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f61b00c7740 0x7f61b00c41c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.72:59136/0 (socket says 172.21.15.72:59136) 2023-07-27T20:32:30.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.557+0000 7f61a7fff700 1 -- 172.21.15.72:0/3959452678 learned_addr learned my addr 172.21.15.72:0/3959452678 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:30.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.558+0000 7f61add9b700 1 -- 172.21.15.72:0/3959452678 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 202165086 0 0) 0x7f61b00c7c50 con 0x7f61b00c7740 2023-07-27T20:32:30.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.558+0000 7f61ae59c700 1 -- 172.21.15.72:0/3959452678 >> v2:172.21.15.173:3300/0 conn(0x7f61b006c1d0 msgr2=0x7f61b006c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:30.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.558+0000 7f61ae59c700 1 --2- 172.21.15.72:0/3959452678 >> v2:172.21.15.173:3300/0 conn(0x7f61b006c1d0 0x7f61b006c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:30.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.558+0000 7f61ae59c700 1 -- 172.21.15.72:0/3959452678 >> v1:172.21.15.173:6789/0 conn(0x7f61b00c7740 legacy=0x7f61b00c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:30.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.558+0000 7f61ae59c700 1 -- 172.21.15.72:0/3959452678 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b0155050 con 0x7f61b014aab0 2023-07-27T20:32:30.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.558+0000 7f61ae59c700 1 --2- 172.21.15.72:0/3959452678 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61b014aab0 0x7f61b0154b10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f61a0009840 tx=0x7f61a0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdad62c18daaa1d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:30.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.558+0000 7f61add9b700 1 -- 172.21.15.72:0/3959452678 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a0011830 con 0x7f61b014aab0 2023-07-27T20:32:30.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.558+0000 7f61add9b700 1 -- 172.21.15.72:0/3959452678 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a0011990 con 0x7f61b014aab0 2023-07-27T20:32:30.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.558+0000 7f61add9b700 1 -- 172.21.15.72:0/3959452678 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a0011d20 con 0x7f61b014aab0 2023-07-27T20:32:30.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.559+0000 7f61b4fff700 1 -- 172.21.15.72:0/3959452678 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61b014aab0 msgr2=0x7f61b0154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:30.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.559+0000 7f61b4fff700 1 --2- 172.21.15.72:0/3959452678 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61b014aab0 0x7f61b0154b10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f61a0009840 tx=0x7f61a0009b50 comp rx=0 tx=0).stop 2023-07-27T20:32:30.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.559+0000 7f61b4fff700 1 -- 172.21.15.72:0/3959452678 shutdown_connections 2023-07-27T20:32:30.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.559+0000 7f61b4fff700 1 --2- 172.21.15.72:0/3959452678 >> v2:172.21.15.173:3300/0 conn(0x7f61b006c1d0 0x7f61b006c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:30.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.559+0000 7f61b4fff700 1 --2- 172.21.15.72:0/3959452678 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61b014aab0 0x7f61b0154b10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:30.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.559+0000 7f61b4fff700 1 -- 172.21.15.72:0/3959452678 >> 172.21.15.72:0/3959452678 conn(0x7f61b00ab3f0 msgr2=0x7f61b00ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:30.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.559+0000 7f61b4fff700 1 -- 172.21.15.72:0/3959452678 shutdown_connections 2023-07-27T20:32:30.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.559+0000 7f61b4fff700 1 -- 172.21.15.72:0/3959452678 wait complete. 2023-07-27T20:32:30.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.561+0000 7f61b4fff700 1 Processor -- start 2023-07-27T20:32:30.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.561+0000 7f61b4fff700 1 -- start start 2023-07-27T20:32:30.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.561+0000 7f61b4fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61b006c1d0 0x7f61b00c0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:30.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.561+0000 7f61b4fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61b00c7740 0x7f61b01e9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:30.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.562+0000 7f61b4fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61b014aab0 0x7f61b00c2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:30.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.562+0000 7f61b4fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b00c1ef0 con 0x7f61b006c1d0 2023-07-27T20:32:30.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.562+0000 7f61b4fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b01e9270 con 0x7f61b00c7740 2023-07-27T20:32:30.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.562+0000 7f61b4fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b01ea1c0 con 0x7f61b014aab0 2023-07-27T20:32:30.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.562+0000 7f61ae59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61b006c1d0 0x7f61b00c0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:30.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.562+0000 7f61ae59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61b006c1d0 0x7f61b00c0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56838/0 (socket says 172.21.15.72:56838) 2023-07-27T20:32:30.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.562+0000 7f61ae59c700 1 -- 172.21.15.72:0/878134595 learned_addr learned my addr 172.21.15.72:0/878134595 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:30.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.562+0000 7f61a7fff700 1 --2- 172.21.15.72:0/878134595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61b00c7740 0x7f61b01e9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:30.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.562+0000 7f61aed9d700 1 --2- 172.21.15.72:0/878134595 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61b014aab0 0x7f61b00c2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:30.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.562+0000 7f61ae59c700 1 -- 172.21.15.72:0/878134595 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61b014aab0 msgr2=0x7f61b00c2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:30.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.562+0000 7f61ae59c700 1 --2- 172.21.15.72:0/878134595 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61b014aab0 0x7f61b00c2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:30.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.562+0000 7f61ae59c700 1 -- 172.21.15.72:0/878134595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61b00c7740 msgr2=0x7f61b01e9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:30.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.562+0000 7f61ae59c700 1 --2- 172.21.15.72:0/878134595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61b00c7740 0x7f61b01e9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:30.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.562+0000 7f61ae59c700 1 -- 172.21.15.72:0/878134595 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a00094a0 con 0x7f61b006c1d0 2023-07-27T20:32:30.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.563+0000 7f61ae59c700 1 --2- 172.21.15.72:0/878134595 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61b006c1d0 0x7f61b00c0bb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f61a0009fd0 tx=0x7f61a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:30.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.563+0000 7f61a6ffd700 1 -- 172.21.15.72:0/878134595 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a00036a0 con 0x7f61b006c1d0 2023-07-27T20:32:30.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.563+0000 7f61a6ffd700 1 -- 172.21.15.72:0/878134595 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a001f070 con 0x7f61b006c1d0 2023-07-27T20:32:30.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.563+0000 7f61b4fff700 1 -- 172.21.15.72:0/878134595 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61b00c1240 con 0x7f61b006c1d0 2023-07-27T20:32:30.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.563+0000 7f61a6ffd700 1 -- 172.21.15.72:0/878134595 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a0003a60 con 0x7f61b006c1d0 2023-07-27T20:32:30.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.563+0000 7f61b4fff700 1 -- 172.21.15.72:0/878134595 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61b01e9480 con 0x7f61b006c1d0 2023-07-27T20:32:30.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.564+0000 7f61b4fff700 1 -- 172.21.15.72:0/878134595 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61b00c1760 con 0x7f61b006c1d0 2023-07-27T20:32:30.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.565+0000 7f61a6ffd700 1 -- 172.21.15.72:0/878134595 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f61a0003bc0 con 0x7f61b006c1d0 2023-07-27T20:32:30.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.566+0000 7f61a6ffd700 1 --2- 172.21.15.72:0/878134595 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f619006ace0 0x7f619006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:30.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.566+0000 7f61a6ffd700 1 -- 172.21.15.72:0/878134595 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f61a0021070 con 0x7f61b006c1d0 2023-07-27T20:32:30.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.567+0000 7f61a7fff700 1 --2- 172.21.15.72:0/878134595 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f619006ace0 0x7f619006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:30.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.567+0000 7f61a7fff700 1 --2- 172.21.15.72:0/878134595 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f619006ace0 0x7f619006d1a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f61b00bc970 tx=0x7f6198007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:30.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.571+0000 7f61a6ffd700 1 -- 172.21.15.72:0/878134595 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f61b00c1760 con 0x7f61b006c1d0 2023-07-27T20:32:30.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.767+0000 7f61b4fff700 1 -- 172.21.15.72:0/878134595 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f61b00c1760 con 0x7f61b006c1d0 2023-07-27T20:32:30.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.768+0000 7f61a6ffd700 1 -- 172.21.15.72:0/878134595 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f61a0015020 con 0x7f61b006c1d0 2023-07-27T20:32:30.755 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:32:30.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.770+0000 7f61b4fff700 1 -- 172.21.15.72:0/878134595 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f619006ace0 msgr2=0x7f619006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:30.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.770+0000 7f61b4fff700 1 --2- 172.21.15.72:0/878134595 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f619006ace0 0x7f619006d1a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f61b00bc970 tx=0x7f6198007de0 comp rx=0 tx=0).stop 2023-07-27T20:32:30.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.770+0000 7f61b4fff700 1 -- 172.21.15.72:0/878134595 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61b006c1d0 msgr2=0x7f61b00c0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:30.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.770+0000 7f61b4fff700 1 --2- 172.21.15.72:0/878134595 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61b006c1d0 0x7f61b00c0bb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f61a0009fd0 tx=0x7f61a0004750 comp rx=0 tx=0).stop 2023-07-27T20:32:30.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.770+0000 7f61b4fff700 1 -- 172.21.15.72:0/878134595 shutdown_connections 2023-07-27T20:32:30.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.770+0000 7f61b4fff700 1 --2- 172.21.15.72:0/878134595 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f619006ace0 0x7f619006d1a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:30.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.770+0000 7f61b4fff700 1 --2- 172.21.15.72:0/878134595 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61b014aab0 0x7f61b00c2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:30.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.770+0000 7f61b4fff700 1 --2- 172.21.15.72:0/878134595 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61b006c1d0 0x7f61b00c0bb0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:30.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.770+0000 7f61b4fff700 1 --2- 172.21.15.72:0/878134595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61b00c7740 0x7f61b01e9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:30.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.770+0000 7f61b4fff700 1 -- 172.21.15.72:0/878134595 >> 172.21.15.72:0/878134595 conn(0x7f61b00ab3f0 msgr2=0x7f61b0149700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:30.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.770+0000 7f61b4fff700 1 -- 172.21.15.72:0/878134595 shutdown_connections 2023-07-27T20:32:30.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.770+0000 7f61b4fff700 1 -- 172.21.15.72:0/878134595 wait complete. 2023-07-27T20:32:30.776 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T20:32:30.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.987+0000 7fcf2d5ff700 1 Processor -- start 2023-07-27T20:32:30.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.987+0000 7fcf2d5ff700 1 -- start start 2023-07-27T20:32:30.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.988+0000 7fcf2d5ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcf2814aab0 0x7fcf28154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:30.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.988+0000 7fcf2d5ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf280c7740 0x7fcf280c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:30.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.988+0000 7fcf2d5ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf280c7c50 con 0x7fcf280c4700 2023-07-27T20:32:30.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.988+0000 7fcf2d5ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf2806bd40 con 0x7fcf2814aab0 2023-07-27T20:32:30.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.988+0000 7fcf2d5ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf280c62f0 con 0x7fcf280c7740 2023-07-27T20:32:30.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.988+0000 7fcf277fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fcf280c4700 0x7fcf2806c1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58962/0 (socket says 172.21.15.72:58962) 2023-07-27T20:32:30.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.988+0000 7fcf277fe700 1 -- 172.21.15.72:0/3569934003 learned_addr learned my addr 172.21.15.72:0/3569934003 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:30.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.988+0000 7fcf25ffb700 1 -- 172.21.15.72:0/3569934003 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3059602709 0 0) 0x7fcf280c7c50 con 0x7fcf280c4700 2023-07-27T20:32:30.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.988+0000 7fcf25ffb700 1 -- 172.21.15.72:0/3569934003 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf100035b0 con 0x7fcf280c4700 2023-07-27T20:32:30.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.988+0000 7fcf26ffd700 1 --2- 172.21.15.72:0/3569934003 >> v2:172.21.15.173:3300/0 conn(0x7fcf2814aab0 0x7fcf28154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:30.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.989+0000 7fcf267fc700 1 --2- 172.21.15.72:0/3569934003 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf280c7740 0x7fcf280c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:30.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.989+0000 7fcf25ffb700 1 -- 172.21.15.72:0/3569934003 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1507170130 0 0) 0x7fcf100035b0 con 0x7fcf280c4700 2023-07-27T20:32:30.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.989+0000 7fcf25ffb700 1 -- 172.21.15.72:0/3569934003 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf280c7740 msgr2=0x7fcf280c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:30.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.989+0000 7fcf25ffb700 1 --2- 172.21.15.72:0/3569934003 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf280c7740 0x7fcf280c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:30.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.989+0000 7fcf25ffb700 1 -- 172.21.15.72:0/3569934003 >> v2:172.21.15.173:3300/0 conn(0x7fcf2814aab0 msgr2=0x7fcf28154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:30.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.989+0000 7fcf25ffb700 1 --2- 172.21.15.72:0/3569934003 >> v2:172.21.15.173:3300/0 conn(0x7fcf2814aab0 0x7fcf28154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:30.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.989+0000 7fcf25ffb700 1 -- 172.21.15.72:0/3569934003 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf28155050 con 0x7fcf280c4700 2023-07-27T20:32:30.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.989+0000 7fcf25ffb700 1 -- 172.21.15.72:0/3569934003 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7fcf200019f0 con 0x7fcf280c4700 2023-07-27T20:32:30.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.989+0000 7fcf25ffb700 1 -- 172.21.15.72:0/3569934003 >> v1:172.21.15.72:6789/0 conn(0x7fcf280c4700 legacy=0x7fcf2806c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:30.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.989+0000 7fcf25ffb700 1 --2- 172.21.15.72:0/3569934003 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf10003a00 0x7fcf10003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:30.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.989+0000 7fcf25ffb700 1 --2- 172.21.15.72:0/3569934003 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf280c7740 0x7fcf10004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:30.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.989+0000 7fcf25ffb700 1 --2- 172.21.15.72:0/3569934003 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf10004d90 0x7fcf10005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:30.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.989+0000 7fcf25ffb700 1 -- 172.21.15.72:0/3569934003 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2806bd40 con 0x7fcf10003a00 2023-07-27T20:32:30.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.989+0000 7fcf25ffb700 1 -- 172.21.15.72:0/3569934003 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf280c62f0 con 0x7fcf10004d90 2023-07-27T20:32:30.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.989+0000 7fcf25ffb700 1 -- 172.21.15.72:0/3569934003 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1000ba10 con 0x7fcf280c7740 2023-07-27T20:32:30.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.989+0000 7fcf26ffd700 1 --2- 172.21.15.72:0/3569934003 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf10003a00 0x7fcf10003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:30.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.989+0000 7fcf267fc700 1 --2- 172.21.15.72:0/3569934003 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf280c7740 0x7fcf10004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:30.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.989+0000 7fcf277fe700 1 --2- 172.21.15.72:0/3569934003 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf10004d90 0x7fcf10005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:30.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.990+0000 7fcf26ffd700 1 -- 172.21.15.72:0/3569934003 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf280c7740 msgr2=0x7fcf10004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:30.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.990+0000 7fcf26ffd700 1 --2- 172.21.15.72:0/3569934003 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf280c7740 0x7fcf10004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:30.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.990+0000 7fcf26ffd700 1 -- 172.21.15.72:0/3569934003 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf10004d90 msgr2=0x7fcf10005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:30.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.990+0000 7fcf26ffd700 1 --2- 172.21.15.72:0/3569934003 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf10004d90 0x7fcf10005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:30.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.990+0000 7fcf26ffd700 1 -- 172.21.15.72:0/3569934003 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf100035b0 con 0x7fcf10003a00 2023-07-27T20:32:30.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.990+0000 7fcf277fe700 1 --2- 172.21.15.72:0/3569934003 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf10004d90 0x7fcf10005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:32:30.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.990+0000 7fcf26ffd700 1 --2- 172.21.15.72:0/3569934003 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf10003a00 0x7fcf10003e20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcf18009b60 tx=0x7fcf10005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=582fee1284afa9e7 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:30.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.990+0000 7fcf25ffb700 1 -- 172.21.15.72:0/3569934003 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1800e6c0 con 0x7fcf10003a00 2023-07-27T20:32:30.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.990+0000 7fcf25ffb700 1 -- 172.21.15.72:0/3569934003 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1800e820 con 0x7fcf10003a00 2023-07-27T20:32:30.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.990+0000 7fcf25ffb700 1 -- 172.21.15.72:0/3569934003 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1800eb90 con 0x7fcf10003a00 2023-07-27T20:32:30.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.991+0000 7fcf2d5ff700 1 -- 172.21.15.72:0/3569934003 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf10003a00 msgr2=0x7fcf10003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:30.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.991+0000 7fcf2d5ff700 1 --2- 172.21.15.72:0/3569934003 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf10003a00 0x7fcf10003e20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcf18009b60 tx=0x7fcf10005880 comp rx=0 tx=0).stop 2023-07-27T20:32:30.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.991+0000 7fcf277fe700 1 -- 172.21.15.72:0/3569934003 reap_dead start 2023-07-27T20:32:30.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.991+0000 7fcf2d5ff700 1 -- 172.21.15.72:0/3569934003 shutdown_connections 2023-07-27T20:32:30.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.991+0000 7fcf2d5ff700 1 -- 172.21.15.72:0/3569934003 >> 172.21.15.72:0/3569934003 conn(0x7fcf280ab3f0 msgr2=0x7fcf280ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:30.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.991+0000 7fcf2d5ff700 1 -- 172.21.15.72:0/3569934003 shutdown_connections 2023-07-27T20:32:30.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.991+0000 7fcf2d5ff700 1 -- 172.21.15.72:0/3569934003 wait complete. 2023-07-27T20:32:30.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.992+0000 7fcf2d5ff700 1 Processor -- start 2023-07-27T20:32:30.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.993+0000 7fcf2d5ff700 1 -- start start 2023-07-27T20:32:30.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.993+0000 7fcf2d5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf10003a00 0x7fcf28157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:30.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.994+0000 7fcf2d5ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf281ea5b0 0x7fcf280aa520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:30.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.994+0000 7fcf2d5ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf28158350 0x7fcf280be730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:30.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.994+0000 7fcf2d5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf280c2110 con 0x7fcf10003a00 2023-07-27T20:32:30.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.994+0000 7fcf2d5ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf280bf4f0 con 0x7fcf281ea5b0 2023-07-27T20:32:30.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.994+0000 7fcf2d5ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf280bf980 con 0x7fcf28158350 2023-07-27T20:32:30.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.994+0000 7fcf26ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf10003a00 0x7fcf28157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:30.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.994+0000 7fcf26ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf10003a00 0x7fcf28157d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56870/0 (socket says 172.21.15.72:56870) 2023-07-27T20:32:30.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.994+0000 7fcf26ffd700 1 -- 172.21.15.72:0/2663225845 learned_addr learned my addr 172.21.15.72:0/2663225845 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:30.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.994+0000 7fcf277fe700 1 --2- 172.21.15.72:0/2663225845 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf28158350 0x7fcf280be730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:30.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.994+0000 7fcf267fc700 1 --2- 172.21.15.72:0/2663225845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf281ea5b0 0x7fcf280aa520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:30.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.994+0000 7fcf26ffd700 1 -- 172.21.15.72:0/2663225845 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf28158350 msgr2=0x7fcf280be730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:30.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.994+0000 7fcf26ffd700 1 --2- 172.21.15.72:0/2663225845 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf28158350 0x7fcf280be730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:30.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.994+0000 7fcf26ffd700 1 -- 172.21.15.72:0/2663225845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf281ea5b0 msgr2=0x7fcf280aa520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:30.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.994+0000 7fcf26ffd700 1 --2- 172.21.15.72:0/2663225845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf281ea5b0 0x7fcf280aa520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:30.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.994+0000 7fcf26ffd700 1 -- 172.21.15.72:0/2663225845 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf281eaa40 con 0x7fcf10003a00 2023-07-27T20:32:30.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.994+0000 7fcf26ffd700 1 --2- 172.21.15.72:0/2663225845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf10003a00 0x7fcf28157d20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fcf100046e0 tx=0x7fcf180047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:30.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.995+0000 7fcf0f7fe700 1 -- 172.21.15.72:0/2663225845 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1800e6c0 con 0x7fcf10003a00 2023-07-27T20:32:30.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.995+0000 7fcf0f7fe700 1 -- 172.21.15.72:0/2663225845 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf18003ab0 con 0x7fcf10003a00 2023-07-27T20:32:30.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.995+0000 7fcf0f7fe700 1 -- 172.21.15.72:0/2663225845 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf18003e60 con 0x7fcf10003a00 2023-07-27T20:32:30.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.995+0000 7fcf2d5ff700 1 -- 172.21.15.72:0/2663225845 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf280c3330 con 0x7fcf10003a00 2023-07-27T20:32:30.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.995+0000 7fcf2d5ff700 1 -- 172.21.15.72:0/2663225845 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf280aaa60 con 0x7fcf10003a00 2023-07-27T20:32:30.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.996+0000 7fcf2d5ff700 1 -- 172.21.15.72:0/2663225845 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf280c3850 con 0x7fcf10003a00 2023-07-27T20:32:30.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.997+0000 7fcf0f7fe700 1 -- 172.21.15.72:0/2663225845 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcf18013470 con 0x7fcf10003a00 2023-07-27T20:32:30.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.997+0000 7fcf0f7fe700 1 --2- 172.21.15.72:0/2663225845 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcf1406ace0 0x7fcf1406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:30.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.998+0000 7fcf0f7fe700 1 -- 172.21.15.72:0/2663225845 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcf1808b0a0 con 0x7fcf10003a00 2023-07-27T20:32:30.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.998+0000 7fcf267fc700 1 --2- 172.21.15.72:0/2663225845 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcf1406ace0 0x7fcf1406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:30.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:30.999+0000 7fcf267fc700 1 --2- 172.21.15.72:0/2663225845 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcf1406ace0 0x7fcf1406d1a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcf28158770 tx=0x7fcf1c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:30.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.002+0000 7fcf0f7fe700 1 -- 172.21.15.72:0/2663225845 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcf280c3850 con 0x7fcf10003a00 2023-07-27T20:32:31.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.196+0000 7fcf2d5ff700 1 -- 172.21.15.72:0/2663225845 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcf280c3850 con 0x7fcf10003a00 2023-07-27T20:32:31.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.197+0000 7fcf0f7fe700 1 -- 172.21.15.72:0/2663225845 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcf280c3850 con 0x7fcf10003a00 2023-07-27T20:32:31.185 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-27T20:32:31.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.199+0000 7fcf2d5ff700 1 -- 172.21.15.72:0/2663225845 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcf1406ace0 msgr2=0x7fcf1406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:31.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.199+0000 7fcf2d5ff700 1 --2- 172.21.15.72:0/2663225845 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcf1406ace0 0x7fcf1406d1a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcf28158770 tx=0x7fcf1c008040 comp rx=0 tx=0).stop 2023-07-27T20:32:31.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.199+0000 7fcf2d5ff700 1 -- 172.21.15.72:0/2663225845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf10003a00 msgr2=0x7fcf28157d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:31.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.199+0000 7fcf2d5ff700 1 --2- 172.21.15.72:0/2663225845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf10003a00 0x7fcf28157d20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fcf100046e0 tx=0x7fcf180047c0 comp rx=0 tx=0).stop 2023-07-27T20:32:31.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.199+0000 7fcf2d5ff700 1 -- 172.21.15.72:0/2663225845 shutdown_connections 2023-07-27T20:32:31.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.199+0000 7fcf2d5ff700 1 --2- 172.21.15.72:0/2663225845 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcf1406ace0 0x7fcf1406d1a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:31.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.199+0000 7fcf2d5ff700 1 --2- 172.21.15.72:0/2663225845 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf28158350 0x7fcf280be730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:31.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.199+0000 7fcf2d5ff700 1 --2- 172.21.15.72:0/2663225845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf10003a00 0x7fcf28157d20 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:31.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.199+0000 7fcf2d5ff700 1 --2- 172.21.15.72:0/2663225845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf281ea5b0 0x7fcf280aa520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:31.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.199+0000 7fcf2d5ff700 1 -- 172.21.15.72:0/2663225845 >> 172.21.15.72:0/2663225845 conn(0x7fcf280ab3f0 msgr2=0x7fcf28149ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:31.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.199+0000 7fcf2d5ff700 1 -- 172.21.15.72:0/2663225845 shutdown_connections 2023-07-27T20:32:31.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.199+0000 7fcf2d5ff700 1 -- 172.21.15.72:0/2663225845 wait complete. 2023-07-27T20:32:31.205 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-27T20:32:31.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.416+0000 7f44ecbff700 1 Processor -- start 2023-07-27T20:32:31.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.416+0000 7f44ecbff700 1 -- start start 2023-07-27T20:32:31.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.417+0000 7f44ecbff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f44e80c7740 0x7f44e80c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:31.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.417+0000 7f44ecbff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44e80c7c50 con 0x7f44e80c4700 2023-07-27T20:32:31.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.417+0000 7f44ecbff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44e806bd40 con 0x7f44e814aab0 2023-07-27T20:32:31.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.417+0000 7f44ecbff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e80c62f0 con 0x7f44e80c7740 2023-07-27T20:32:31.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.418+0000 7f44e6d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f44e80c4700 0x7f44e806c1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58974/0 (socket says 172.21.15.72:58974) 2023-07-27T20:32:31.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.418+0000 7f44e6d9d700 1 -- 172.21.15.72:0/1498919487 learned_addr learned my addr 172.21.15.72:0/1498919487 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:31.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.418+0000 7f44dffff700 1 --2- 172.21.15.72:0/1498919487 >> v2:172.21.15.173:3300/0 conn(0x7f44e80c7740 0x7f44e80c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:31.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.418+0000 7f44e5d9b700 1 -- 172.21.15.72:0/1498919487 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1545602396 0 0) 0x7f44e80c7c50 con 0x7f44e80c4700 2023-07-27T20:32:31.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.418+0000 7f44e5d9b700 1 -- 172.21.15.72:0/1498919487 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44d40035b0 con 0x7f44e80c4700 2023-07-27T20:32:31.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.418+0000 7f44e5d9b700 1 -- 172.21.15.72:0/1498919487 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3451160776 0 0) 0x7f44e806bd40 con 0x7f44e814aab0 2023-07-27T20:32:31.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.418+0000 7f44e5d9b700 1 -- 172.21.15.72:0/1498919487 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44e80c7c50 con 0x7f44e814aab0 2023-07-27T20:32:31.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.418+0000 7f44e5d9b700 1 -- 172.21.15.72:0/1498919487 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 686571077 0 0) 0x7f44d40035b0 con 0x7f44e80c4700 2023-07-27T20:32:31.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.418+0000 7f44e5d9b700 1 -- 172.21.15.72:0/1498919487 >> v2:172.21.15.173:3300/0 conn(0x7f44e80c7740 msgr2=0x7f44e80c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:31.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.418+0000 7f44e5d9b700 1 --2- 172.21.15.72:0/1498919487 >> v2:172.21.15.173:3300/0 conn(0x7f44e80c7740 0x7f44e80c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:31.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.418+0000 7f44e5d9b700 1 -- 172.21.15.72:0/1498919487 >> v1:172.21.15.173:6789/0 conn(0x7f44e814aab0 legacy=0x7f44e8154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:31.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.418+0000 7f44e5d9b700 1 -- 172.21.15.72:0/1498919487 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e806d200 con 0x7f44e80c4700 2023-07-27T20:32:31.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.418+0000 7f44e5d9b700 1 -- 172.21.15.72:0/1498919487 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f44e00019f0 con 0x7f44e80c4700 2023-07-27T20:32:31.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.418+0000 7f44e5d9b700 1 -- 172.21.15.72:0/1498919487 >> v1:172.21.15.72:6789/0 conn(0x7f44e80c4700 legacy=0x7f44e806c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:31.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.419+0000 7f44e5d9b700 1 --2- 172.21.15.72:0/1498919487 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44d4003be0 0x7f44d4003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:31.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.419+0000 7f44e5d9b700 1 --2- 172.21.15.72:0/1498919487 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44d4004850 0x7f44d4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:31.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.419+0000 7f44e5d9b700 1 --2- 172.21.15.72:0/1498919487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44d4005210 0x7f44d400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:31.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.419+0000 7f44e5d9b700 1 -- 172.21.15.72:0/1498919487 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e80c62f0 con 0x7f44d4005210 2023-07-27T20:32:31.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.419+0000 7f44e5d9b700 1 -- 172.21.15.72:0/1498919487 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d400c0e0 con 0x7f44d4003be0 2023-07-27T20:32:31.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.419+0000 7f44e5d9b700 1 -- 172.21.15.72:0/1498919487 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d400c2a0 con 0x7f44d4004850 2023-07-27T20:32:31.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.419+0000 7f44e6d9d700 1 --2- 172.21.15.72:0/1498919487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44d4005210 0x7f44d400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:31.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.419+0000 7f44dffff700 1 --2- 172.21.15.72:0/1498919487 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44d4004850 0x7f44d4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:31.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.419+0000 7f44e659c700 1 --2- 172.21.15.72:0/1498919487 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44d4003be0 0x7f44d4003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:31.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.419+0000 7f44e6d9d700 1 -- 172.21.15.72:0/1498919487 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44d4004850 msgr2=0x7f44d4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:31.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.419+0000 7f44e6d9d700 1 --2- 172.21.15.72:0/1498919487 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44d4004850 0x7f44d4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:31.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.419+0000 7f44e6d9d700 1 -- 172.21.15.72:0/1498919487 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44d4003be0 msgr2=0x7f44d4003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:31.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.419+0000 7f44e6d9d700 1 --2- 172.21.15.72:0/1498919487 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44d4003be0 0x7f44d4003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:31.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.419+0000 7f44e6d9d700 1 -- 172.21.15.72:0/1498919487 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d40035b0 con 0x7f44d4005210 2023-07-27T20:32:31.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.419+0000 7f44e6d9d700 1 -- 172.21.15.72:0/1498919487 reap_dead start 2023-07-27T20:32:31.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.420+0000 7f44e6d9d700 1 --2- 172.21.15.72:0/1498919487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44d4005210 0x7f44d400ba10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f44e000a6d0 tx=0x7f44d4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26d8737f7dac4c80 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:31.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.420+0000 7f44e5d9b700 1 -- 172.21.15.72:0/1498919487 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e00072d0 con 0x7f44d4005210 2023-07-27T20:32:31.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.420+0000 7f44e5d9b700 1 -- 172.21.15.72:0/1498919487 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e0007470 con 0x7f44d4005210 2023-07-27T20:32:31.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.420+0000 7f44e5d9b700 1 -- 172.21.15.72:0/1498919487 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e0007820 con 0x7f44d4005210 2023-07-27T20:32:31.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.420+0000 7f44ecbff700 1 -- 172.21.15.72:0/1498919487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44d4005210 msgr2=0x7f44d400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:31.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.420+0000 7f44ecbff700 1 --2- 172.21.15.72:0/1498919487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44d4005210 0x7f44d400ba10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f44e000a6d0 tx=0x7f44d4005880 comp rx=0 tx=0).stop 2023-07-27T20:32:31.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.420+0000 7f44ecbff700 1 -- 172.21.15.72:0/1498919487 shutdown_connections 2023-07-27T20:32:31.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.420+0000 7f44ecbff700 1 --2- 172.21.15.72:0/1498919487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44d4005210 0x7f44d400ba10 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:31.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.420+0000 7f44ecbff700 1 -- 172.21.15.72:0/1498919487 >> 172.21.15.72:0/1498919487 conn(0x7f44e80ab3f0 msgr2=0x7f44e80ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:31.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.420+0000 7f44ecbff700 1 -- 172.21.15.72:0/1498919487 shutdown_connections 2023-07-27T20:32:31.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.420+0000 7f44ecbff700 1 -- 172.21.15.72:0/1498919487 wait complete. 2023-07-27T20:32:31.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.422+0000 7f44ecbff700 1 Processor -- start 2023-07-27T20:32:31.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.422+0000 7f44ecbff700 1 -- start start 2023-07-27T20:32:31.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.423+0000 7f44ecbff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44d4005210 0x7f44e814d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:31.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.423+0000 7f44ecbff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44e814f8b0 0x7f44e814c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:31.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.423+0000 7f44ecbff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44e814cf00 0x7f44e8147bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:31.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.423+0000 7f44ecbff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e8148e00 con 0x7f44e814cf00 2023-07-27T20:32:31.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.423+0000 7f44ecbff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e8148910 con 0x7f44d4005210 2023-07-27T20:32:31.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.423+0000 7f44ecbff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e81ea720 con 0x7f44e814f8b0 2023-07-27T20:32:31.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.423+0000 7f44e6d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44e814cf00 0x7f44e8147bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:31.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.423+0000 7f44e6d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44e814cf00 0x7f44e8147bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56900/0 (socket says 172.21.15.72:56900) 2023-07-27T20:32:31.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.423+0000 7f44e6d9d700 1 -- 172.21.15.72:0/875826030 learned_addr learned my addr 172.21.15.72:0/875826030 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:31.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.424+0000 7f44e6d9d700 1 -- 172.21.15.72:0/875826030 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44e814f8b0 msgr2=0x7f44e814c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:31.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.424+0000 7f44e6d9d700 1 --2- 172.21.15.72:0/875826030 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44e814f8b0 0x7f44e814c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:31.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.424+0000 7f44e6d9d700 1 -- 172.21.15.72:0/875826030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44d4005210 msgr2=0x7f44e814d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:31.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.424+0000 7f44e6d9d700 1 --2- 172.21.15.72:0/875826030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44d4005210 0x7f44e814d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:31.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.424+0000 7f44e6d9d700 1 -- 172.21.15.72:0/875826030 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e8153bf0 con 0x7f44e814cf00 2023-07-27T20:32:31.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.424+0000 7f44e6d9d700 1 --2- 172.21.15.72:0/875826030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44e814cf00 0x7f44e8147bd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f44e808ba30 tx=0x7f44e80c6e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:31.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.424+0000 7f44deffd700 1 -- 172.21.15.72:0/875826030 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e001d610 con 0x7f44e814cf00 2023-07-27T20:32:31.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.424+0000 7f44deffd700 1 -- 172.21.15.72:0/875826030 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e001d770 con 0x7f44e814cf00 2023-07-27T20:32:31.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.424+0000 7f44deffd700 1 -- 172.21.15.72:0/875826030 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e001db20 con 0x7f44e814cf00 2023-07-27T20:32:31.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.424+0000 7f44ecbff700 1 -- 172.21.15.72:0/875826030 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44e81eab70 con 0x7f44e814cf00 2023-07-27T20:32:31.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.424+0000 7f44ecbff700 1 -- 172.21.15.72:0/875826030 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e8148b20 con 0x7f44e814cf00 2023-07-27T20:32:31.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.425+0000 7f44ecbff700 1 -- 172.21.15.72:0/875826030 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44e81ea9c0 con 0x7f44e814cf00 2023-07-27T20:32:31.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.426+0000 7f44deffd700 1 -- 172.21.15.72:0/875826030 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f44e001a030 con 0x7f44e814cf00 2023-07-27T20:32:31.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.427+0000 7f44deffd700 1 --2- 172.21.15.72:0/875826030 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f44c806ace0 0x7f44c806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:31.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.427+0000 7f44deffd700 1 -- 172.21.15.72:0/875826030 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f44e008ae50 con 0x7f44e814cf00 2023-07-27T20:32:31.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.428+0000 7f44e659c700 1 --2- 172.21.15.72:0/875826030 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f44c806ace0 0x7f44c806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:31.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.429+0000 7f44e659c700 1 --2- 172.21.15.72:0/875826030 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f44c806ace0 0x7f44c806d1a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f44e8151360 tx=0x7f44d8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:31.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.432+0000 7f44deffd700 1 -- 172.21.15.72:0/875826030 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f44e0055ce0 con 0x7f44e814cf00 2023-07-27T20:32:31.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.626+0000 7f44ecbff700 1 -- 172.21.15.72:0/875826030 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f44e804e470 con 0x7f44e814cf00 2023-07-27T20:32:31.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.626+0000 7f44deffd700 1 -- 172.21.15.72:0/875826030 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f44e0059300 con 0x7f44e814cf00 2023-07-27T20:32:31.614 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:32:31.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.629+0000 7f44ecbff700 1 -- 172.21.15.72:0/875826030 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f44c806ace0 msgr2=0x7f44c806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:31.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.629+0000 7f44ecbff700 1 --2- 172.21.15.72:0/875826030 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f44c806ace0 0x7f44c806d1a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f44e8151360 tx=0x7f44d8009040 comp rx=0 tx=0).stop 2023-07-27T20:32:31.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.629+0000 7f44ecbff700 1 -- 172.21.15.72:0/875826030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44e814cf00 msgr2=0x7f44e8147bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:31.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.629+0000 7f44ecbff700 1 --2- 172.21.15.72:0/875826030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44e814cf00 0x7f44e8147bd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f44e808ba30 tx=0x7f44e80c6e00 comp rx=0 tx=0).stop 2023-07-27T20:32:31.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.629+0000 7f44ecbff700 1 -- 172.21.15.72:0/875826030 shutdown_connections 2023-07-27T20:32:31.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.629+0000 7f44ecbff700 1 --2- 172.21.15.72:0/875826030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44e814cf00 0x7f44e8147bd0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:31.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.629+0000 7f44ecbff700 1 --2- 172.21.15.72:0/875826030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44d4005210 0x7f44e814d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:31.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.629+0000 7f44ecbff700 1 --2- 172.21.15.72:0/875826030 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f44c806ace0 0x7f44c806d1a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:31.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.629+0000 7f44ecbff700 1 --2- 172.21.15.72:0/875826030 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44e814f8b0 0x7f44e814c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:31.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.629+0000 7f44ecbff700 1 -- 172.21.15.72:0/875826030 >> 172.21.15.72:0/875826030 conn(0x7f44e80ab3f0 msgr2=0x7f44e80a9610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:31.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.629+0000 7f44ecbff700 1 -- 172.21.15.72:0/875826030 shutdown_connections 2023-07-27T20:32:31.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.629+0000 7f44ecbff700 1 -- 172.21.15.72:0/875826030 wait complete. 2023-07-27T20:32:31.635 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-27T20:32:31.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.845+0000 7f3caa7ff700 1 Processor -- start 2023-07-27T20:32:31.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.845+0000 7f3caa7ff700 1 -- start start 2023-07-27T20:32:31.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.846+0000 7f3caa7ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ca413b2c0 0x7f3ca40aa420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:31.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.846+0000 7f3caa7ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3ca40a83a0 0x7f3ca40a8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:31.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.846+0000 7f3caa7ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ca4155600 con 0x7f3ca40bfd90 2023-07-27T20:32:31.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.846+0000 7f3caa7ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ca40a9620 con 0x7f3ca40a83a0 2023-07-27T20:32:31.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.846+0000 7f3caa7ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca4155320 con 0x7f3ca413b2c0 2023-07-27T20:32:31.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.847+0000 7f3ca37fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3ca40bfd90 0x7f3ca40aa960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58976/0 (socket says 172.21.15.72:58976) 2023-07-27T20:32:31.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.847+0000 7f3ca37fe700 1 -- 172.21.15.72:0/3682448039 learned_addr learned my addr 172.21.15.72:0/3682448039 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:31.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.847+0000 7f3ca3fff700 1 --2- 172.21.15.72:0/3682448039 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ca413b2c0 0x7f3ca40aa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:31.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.847+0000 7f3ca8d9c700 1 --2- 172.21.15.72:0/3682448039 >> v2:172.21.15.173:3300/0 conn(0x7f3ca40a83a0 0x7f3ca40a8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:31.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.847+0000 7f3ca2ffd700 1 -- 172.21.15.72:0/3682448039 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1522622756 0 0) 0x7f3ca4155600 con 0x7f3ca40bfd90 2023-07-27T20:32:31.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.847+0000 7f3ca2ffd700 1 -- 172.21.15.72:0/3682448039 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c8c0035b0 con 0x7f3ca40bfd90 2023-07-27T20:32:31.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.847+0000 7f3ca2ffd700 1 -- 172.21.15.72:0/3682448039 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3174854815 0 0) 0x7f3c8c0035b0 con 0x7f3ca40bfd90 2023-07-27T20:32:31.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.847+0000 7f3ca8d9c700 1 -- 172.21.15.72:0/3682448039 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ca413b2c0 msgr2=0x7f3ca40aa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:31.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.847+0000 7f3ca8d9c700 1 --2- 172.21.15.72:0/3682448039 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ca413b2c0 0x7f3ca40aa420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:31.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.847+0000 7f3ca8d9c700 1 -- 172.21.15.72:0/3682448039 >> v1:172.21.15.72:6789/0 conn(0x7f3ca40bfd90 legacy=0x7f3ca40aa960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:31.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.847+0000 7f3ca8d9c700 1 -- 172.21.15.72:0/3682448039 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca4151e40 con 0x7f3ca40a83a0 2023-07-27T20:32:31.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.848+0000 7f3ca8d9c700 1 --2- 172.21.15.72:0/3682448039 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ca40a83a0 0x7f3ca40a8820 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c009d90 tx=0x7f3c9c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4121235548a9fef9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:31.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.848+0000 7f3ca2ffd700 1 -- 172.21.15.72:0/3682448039 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c00e070 con 0x7f3ca40a83a0 2023-07-27T20:32:31.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.848+0000 7f3ca2ffd700 1 -- 172.21.15.72:0/3682448039 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c9c003a20 con 0x7f3ca40a83a0 2023-07-27T20:32:31.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.848+0000 7f3ca2ffd700 1 -- 172.21.15.72:0/3682448039 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c98001670 con 0x7f3ca40a83a0 2023-07-27T20:32:31.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.849+0000 7f3caa7ff700 1 -- 172.21.15.72:0/3682448039 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ca40a83a0 msgr2=0x7f3ca40a8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:31.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.849+0000 7f3caa7ff700 1 --2- 172.21.15.72:0/3682448039 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ca40a83a0 0x7f3ca40a8820 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c009d90 tx=0x7f3c9c00b330 comp rx=0 tx=0).stop 2023-07-27T20:32:31.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.849+0000 7f3caa7ff700 1 -- 172.21.15.72:0/3682448039 shutdown_connections 2023-07-27T20:32:31.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.849+0000 7f3caa7ff700 1 --2- 172.21.15.72:0/3682448039 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ca40a83a0 0x7f3ca40a8820 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:31.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.849+0000 7f3caa7ff700 1 --2- 172.21.15.72:0/3682448039 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ca413b2c0 0x7f3ca40aa420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:31.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.849+0000 7f3caa7ff700 1 -- 172.21.15.72:0/3682448039 >> 172.21.15.72:0/3682448039 conn(0x7f3ca406a190 msgr2=0x7f3ca406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:31.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.849+0000 7f3caa7ff700 1 -- 172.21.15.72:0/3682448039 shutdown_connections 2023-07-27T20:32:31.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.849+0000 7f3caa7ff700 1 -- 172.21.15.72:0/3682448039 wait complete. 2023-07-27T20:32:31.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.851+0000 7f3caa7ff700 1 Processor -- start 2023-07-27T20:32:31.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.851+0000 7f3caa7ff700 1 -- start start 2023-07-27T20:32:31.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.852+0000 7f3caa7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ca40a83a0 0x7f3ca40c0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:31.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.852+0000 7f3caa7ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ca40bfd90 0x7f3ca40be990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:31.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.852+0000 7f3caa7ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ca413b2c0 0x7f3ca4151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:31.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.852+0000 7f3caa7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca41ede70 con 0x7f3ca40a83a0 2023-07-27T20:32:31.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.852+0000 7f3caa7ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca41df1e0 con 0x7f3ca40bfd90 2023-07-27T20:32:31.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.852+0000 7f3caa7ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca40c0520 con 0x7f3ca413b2c0 2023-07-27T20:32:31.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.852+0000 7f3ca3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ca40a83a0 0x7f3ca40c0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:31.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.852+0000 7f3ca3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ca40a83a0 0x7f3ca40c0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56904/0 (socket says 172.21.15.72:56904) 2023-07-27T20:32:31.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.852+0000 7f3ca3fff700 1 -- 172.21.15.72:0/3095450267 learned_addr learned my addr 172.21.15.72:0/3095450267 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:31.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.852+0000 7f3ca8d9c700 1 --2- 172.21.15.72:0/3095450267 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ca413b2c0 0x7f3ca4151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:31.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.852+0000 7f3ca37fe700 1 --2- 172.21.15.72:0/3095450267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ca40bfd90 0x7f3ca40be990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:31.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.852+0000 7f3ca3fff700 1 -- 172.21.15.72:0/3095450267 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ca413b2c0 msgr2=0x7f3ca4151580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:31.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.852+0000 7f3ca3fff700 1 --2- 172.21.15.72:0/3095450267 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ca413b2c0 0x7f3ca4151580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:31.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.852+0000 7f3ca3fff700 1 -- 172.21.15.72:0/3095450267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ca40bfd90 msgr2=0x7f3ca40be990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:31.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.852+0000 7f3ca3fff700 1 --2- 172.21.15.72:0/3095450267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ca40bfd90 0x7f3ca40be990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:31.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.852+0000 7f3ca3fff700 1 -- 172.21.15.72:0/3095450267 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c9c009a70 con 0x7f3ca40a83a0 2023-07-27T20:32:31.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.853+0000 7f3ca3fff700 1 --2- 172.21.15.72:0/3095450267 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ca40a83a0 0x7f3ca40c0a10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3c9400e870 tx=0x7f3c9400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:31.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.853+0000 7f3ca0ff9700 1 -- 172.21.15.72:0/3095450267 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c94009590 con 0x7f3ca40a83a0 2023-07-27T20:32:31.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.853+0000 7f3ca0ff9700 1 -- 172.21.15.72:0/3095450267 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c9400ee70 con 0x7f3ca40a83a0 2023-07-27T20:32:31.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.853+0000 7f3ca0ff9700 1 -- 172.21.15.72:0/3095450267 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9400ca50 con 0x7f3ca40a83a0 2023-07-27T20:32:31.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.853+0000 7f3caa7ff700 1 -- 172.21.15.72:0/3095450267 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ca40c26d0 con 0x7f3ca40a83a0 2023-07-27T20:32:31.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.853+0000 7f3caa7ff700 1 -- 172.21.15.72:0/3095450267 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ca40beed0 con 0x7f3ca40a83a0 2023-07-27T20:32:31.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.854+0000 7f3caa7ff700 1 -- 172.21.15.72:0/3095450267 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ca40c0860 con 0x7f3ca40a83a0 2023-07-27T20:32:31.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.855+0000 7f3ca0ff9700 1 -- 172.21.15.72:0/3095450267 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3c9400cbb0 con 0x7f3ca40a83a0 2023-07-27T20:32:31.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.856+0000 7f3ca0ff9700 1 --2- 172.21.15.72:0/3095450267 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3c9006ace0 0x7f3c9006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:31.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.856+0000 7f3ca0ff9700 1 -- 172.21.15.72:0/3095450267 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3c940897b0 con 0x7f3ca40a83a0 2023-07-27T20:32:31.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.856+0000 7f3ca37fe700 1 --2- 172.21.15.72:0/3095450267 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3c9006ace0 0x7f3c9006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:31.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.857+0000 7f3ca37fe700 1 --2- 172.21.15.72:0/3095450267 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3c9006ace0 0x7f3c9006d1a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3ca41550d0 tx=0x7f3c98001550 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:31.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:31.860+0000 7f3ca0ff9700 1 -- 172.21.15.72:0/3095450267 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3c94057f20 con 0x7f3ca40a83a0 2023-07-27T20:32:32.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.069+0000 7f3caa7ff700 1 -- 172.21.15.72:0/3095450267 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3ca406c140 con 0x7f3ca40a83a0 2023-07-27T20:32:32.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.070+0000 7f3ca0ff9700 1 -- 172.21.15.72:0/3095450267 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3c9400ce60 con 0x7f3ca40a83a0 2023-07-27T20:32:32.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.072+0000 7f3caa7ff700 1 -- 172.21.15.72:0/3095450267 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3c9006ace0 msgr2=0x7f3c9006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:32.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.072+0000 7f3caa7ff700 1 --2- 172.21.15.72:0/3095450267 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3c9006ace0 0x7f3c9006d1a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3ca41550d0 tx=0x7f3c98001550 comp rx=0 tx=0).stop 2023-07-27T20:32:32.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.072+0000 7f3caa7ff700 1 -- 172.21.15.72:0/3095450267 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ca40a83a0 msgr2=0x7f3ca40c0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:32.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.072+0000 7f3caa7ff700 1 --2- 172.21.15.72:0/3095450267 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ca40a83a0 0x7f3ca40c0a10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3c9400e870 tx=0x7f3c9400ec30 comp rx=0 tx=0).stop 2023-07-27T20:32:32.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.072+0000 7f3caa7ff700 1 -- 172.21.15.72:0/3095450267 shutdown_connections 2023-07-27T20:32:32.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.072+0000 7f3caa7ff700 1 --2- 172.21.15.72:0/3095450267 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3c9006ace0 0x7f3c9006d1a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:32.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.072+0000 7f3caa7ff700 1 --2- 172.21.15.72:0/3095450267 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ca413b2c0 0x7f3ca4151580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:32.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.072+0000 7f3caa7ff700 1 --2- 172.21.15.72:0/3095450267 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ca40a83a0 0x7f3ca40c0a10 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:32.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.072+0000 7f3caa7ff700 1 --2- 172.21.15.72:0/3095450267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ca40bfd90 0x7f3ca40be990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:32.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.072+0000 7f3caa7ff700 1 -- 172.21.15.72:0/3095450267 >> 172.21.15.72:0/3095450267 conn(0x7f3ca406a190 msgr2=0x7f3ca413a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:32.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.072+0000 7f3caa7ff700 1 -- 172.21.15.72:0/3095450267 shutdown_connections 2023-07-27T20:32:32.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.072+0000 7f3caa7ff700 1 -- 172.21.15.72:0/3095450267 wait complete. 2023-07-27T20:32:32.062 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-07-27T20:32:32.078 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-27T20:32:32.079 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-27T20:32:32.126 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:32:32.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.375+0000 7f7ab23ff700 1 Processor -- start 2023-07-27T20:32:32.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.376+0000 7f7ab23ff700 1 -- start start 2023-07-27T20:32:32.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.377+0000 7f7ab23ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7aac06b150 0x7f7aac0c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:32.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.377+0000 7f7ab23ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7aac1549f0 0x7f7aac1514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:32.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.377+0000 7f7ab23ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aac06b710 con 0x7f7aac0c4400 2023-07-27T20:32:32.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.377+0000 7f7ab23ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aac1545d0 con 0x7f7aac06b150 2023-07-27T20:32:32.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.377+0000 7f7ab23ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aac06c860 con 0x7f7aac1549f0 2023-07-27T20:32:32.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.378+0000 7f7aabfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7aac0c4400 0x7f7aac0c4cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58980/0 (socket says 172.21.15.72:58980) 2023-07-27T20:32:32.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.378+0000 7f7aabfff700 1 -- 172.21.15.72:0/3965822120 learned_addr learned my addr 172.21.15.72:0/3965822120 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:32.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.378+0000 7f7aab7fe700 1 --2- 172.21.15.72:0/3965822120 >> v2:172.21.15.72:3300/0 conn(0x7f7aac06b150 0x7f7aac0c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:32.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.378+0000 7f7aaaffd700 1 -- 172.21.15.72:0/3965822120 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 297238814 0 0) 0x7f7aac06b710 con 0x7f7aac0c4400 2023-07-27T20:32:32.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.378+0000 7f7aaaffd700 1 -- 172.21.15.72:0/3965822120 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a940035b0 con 0x7f7aac0c4400 2023-07-27T20:32:32.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.378+0000 7f7ab099c700 1 --2- 172.21.15.72:0/3965822120 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7aac1549f0 0x7f7aac1514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:32.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.378+0000 7f7aab7fe700 1 -- 172.21.15.72:0/3965822120 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7aac1549f0 msgr2=0x7f7aac1514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:32.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.378+0000 7f7aab7fe700 1 --2- 172.21.15.72:0/3965822120 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7aac1549f0 0x7f7aac1514a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:32.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.378+0000 7f7aab7fe700 1 -- 172.21.15.72:0/3965822120 >> v1:172.21.15.72:6789/0 conn(0x7f7aac0c4400 legacy=0x7f7aac0c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:32.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.378+0000 7f7aab7fe700 1 -- 172.21.15.72:0/3965822120 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aac06b9f0 con 0x7f7aac06b150 2023-07-27T20:32:32.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.378+0000 7f7aab7fe700 1 --2- 172.21.15.72:0/3965822120 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aac06b150 0x7f7aac0c7710 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0009840 tx=0x7f7aa0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b82cf7e8bfdeae76 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:32.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.379+0000 7f7aaaffd700 1 -- 172.21.15.72:0/3965822120 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa0011830 con 0x7f7aac06b150 2023-07-27T20:32:32.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.379+0000 7f7aaaffd700 1 -- 172.21.15.72:0/3965822120 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa0011990 con 0x7f7aac06b150 2023-07-27T20:32:32.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.379+0000 7f7aaaffd700 1 -- 172.21.15.72:0/3965822120 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa0011d20 con 0x7f7aac06b150 2023-07-27T20:32:32.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.379+0000 7f7ab23ff700 1 -- 172.21.15.72:0/3965822120 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aac06b150 msgr2=0x7f7aac0c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:32.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.379+0000 7f7ab23ff700 1 --2- 172.21.15.72:0/3965822120 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aac06b150 0x7f7aac0c7710 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0009840 tx=0x7f7aa0009b50 comp rx=0 tx=0).stop 2023-07-27T20:32:32.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.379+0000 7f7ab23ff700 1 -- 172.21.15.72:0/3965822120 shutdown_connections 2023-07-27T20:32:32.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.379+0000 7f7ab23ff700 1 --2- 172.21.15.72:0/3965822120 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7aac1549f0 0x7f7aac1514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:32.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.379+0000 7f7ab23ff700 1 --2- 172.21.15.72:0/3965822120 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aac06b150 0x7f7aac0c7710 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:32.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.379+0000 7f7ab23ff700 1 -- 172.21.15.72:0/3965822120 >> 172.21.15.72:0/3965822120 conn(0x7f7aac0ab300 msgr2=0x7f7aac0ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:32.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.379+0000 7f7ab23ff700 1 -- 172.21.15.72:0/3965822120 shutdown_connections 2023-07-27T20:32:32.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.379+0000 7f7ab23ff700 1 -- 172.21.15.72:0/3965822120 wait complete. 2023-07-27T20:32:32.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.381+0000 7f7ab23ff700 1 Processor -- start 2023-07-27T20:32:32.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.382+0000 7f7ab23ff700 1 -- start start 2023-07-27T20:32:32.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.383+0000 7f7ab23ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aac06b150 0x7f7aac1da760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:32.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.383+0000 7f7ab23ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7aac0c4400 0x7f7aac0aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:32.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.383+0000 7f7ab23ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7aac1549f0 0x7f7aac0af060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:32.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.383+0000 7f7ab23ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aac0aa470 con 0x7f7aac06b150 2023-07-27T20:32:32.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.383+0000 7f7ab23ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aac0a9170 con 0x7f7aac0c4400 2023-07-27T20:32:32.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.383+0000 7f7ab23ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aac0a96f0 con 0x7f7aac1549f0 2023-07-27T20:32:32.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.383+0000 7f7aabfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aac06b150 0x7f7aac1da760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:32.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.383+0000 7f7aabfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aac06b150 0x7f7aac1da760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56928/0 (socket says 172.21.15.72:56928) 2023-07-27T20:32:32.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.383+0000 7f7aabfff700 1 -- 172.21.15.72:0/2600820867 learned_addr learned my addr 172.21.15.72:0/2600820867 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:32.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.383+0000 7f7aab7fe700 1 --2- 172.21.15.72:0/2600820867 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7aac0c4400 0x7f7aac0aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:32.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.383+0000 7f7ab099c700 1 --2- 172.21.15.72:0/2600820867 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7aac1549f0 0x7f7aac0af060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:32.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.383+0000 7f7aabfff700 1 -- 172.21.15.72:0/2600820867 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7aac1549f0 msgr2=0x7f7aac0af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:32.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.383+0000 7f7aabfff700 1 --2- 172.21.15.72:0/2600820867 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7aac1549f0 0x7f7aac0af060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:32.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.383+0000 7f7aabfff700 1 -- 172.21.15.72:0/2600820867 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7aac0c4400 msgr2=0x7f7aac0aeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:32.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.383+0000 7f7aabfff700 1 --2- 172.21.15.72:0/2600820867 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7aac0c4400 0x7f7aac0aeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:32.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.383+0000 7f7aabfff700 1 -- 172.21.15.72:0/2600820867 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa00094a0 con 0x7f7aac06b150 2023-07-27T20:32:32.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.383+0000 7f7aab7fe700 1 --2- 172.21.15.72:0/2600820867 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7aac0c4400 0x7f7aac0aeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:32:32.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.383+0000 7f7ab099c700 1 --2- 172.21.15.72:0/2600820867 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7aac1549f0 0x7f7aac0af060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:32:32.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.384+0000 7f7aabfff700 1 --2- 172.21.15.72:0/2600820867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aac06b150 0x7f7aac1da760 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c00c700 tx=0x7f7a9c00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:32.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.384+0000 7f7aa8ff9700 1 -- 172.21.15.72:0/2600820867 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c005d70 con 0x7f7aac06b150 2023-07-27T20:32:32.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.384+0000 7f7aa8ff9700 1 -- 172.21.15.72:0/2600820867 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a9c0070d0 con 0x7f7aac06b150 2023-07-27T20:32:32.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.384+0000 7f7ab23ff700 1 -- 172.21.15.72:0/2600820867 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aac1dbc90 con 0x7f7aac06b150 2023-07-27T20:32:32.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.384+0000 7f7aa8ff9700 1 -- 172.21.15.72:0/2600820867 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c007460 con 0x7f7aac06b150 2023-07-27T20:32:32.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.384+0000 7f7ab23ff700 1 -- 172.21.15.72:0/2600820867 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aac0a9380 con 0x7f7aac06b150 2023-07-27T20:32:32.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.385+0000 7f7ab23ff700 1 -- 172.21.15.72:0/2600820867 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aac14ed10 con 0x7f7aac06b150 2023-07-27T20:32:32.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.386+0000 7f7aa8ff9700 1 -- 172.21.15.72:0/2600820867 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7a9c0075c0 con 0x7f7aac06b150 2023-07-27T20:32:32.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.387+0000 7f7aa8ff9700 1 --2- 172.21.15.72:0/2600820867 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f7a9806ace0 0x7f7a9806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:32.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.387+0000 7f7aa8ff9700 1 -- 172.21.15.72:0/2600820867 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7a9c088e20 con 0x7f7aac06b150 2023-07-27T20:32:32.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.387+0000 7f7aab7fe700 1 --2- 172.21.15.72:0/2600820867 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f7a9806ace0 0x7f7a9806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:32.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.388+0000 7f7aab7fe700 1 --2- 172.21.15.72:0/2600820867 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f7a9806ace0 0x7f7a9806d1a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7aac1e7230 tx=0x7f7aa0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:32.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.391+0000 7f7aa8ff9700 1 -- 172.21.15.72:0/2600820867 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7a9c053b10 con 0x7f7aac06b150 2023-07-27T20:32:32.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.586+0000 7f7ab23ff700 1 -- 172.21.15.72:0/2600820867 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7aac0a9540 con 0x7f7aac06b150 2023-07-27T20:32:32.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.587+0000 7f7aa8ff9700 1 -- 172.21.15.72:0/2600820867 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20215 (secure 0 0 0) 0x7f7a9c057130 con 0x7f7aac06b150 2023-07-27T20:32:32.575 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:32:32.576 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":29,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:32:10.402254+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:31:27.020951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T20:31:27.566022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-27T20:31:31.182401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:32:32.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.590+0000 7f7ab23ff700 1 -- 172.21.15.72:0/2600820867 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f7a9806ace0 msgr2=0x7f7a9806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:32.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.590+0000 7f7ab23ff700 1 --2- 172.21.15.72:0/2600820867 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f7a9806ace0 0x7f7a9806d1a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7aac1e7230 tx=0x7f7aa0008030 comp rx=0 tx=0).stop 2023-07-27T20:32:32.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.590+0000 7f7ab23ff700 1 -- 172.21.15.72:0/2600820867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aac06b150 msgr2=0x7f7aac1da760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:32.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.590+0000 7f7ab23ff700 1 --2- 172.21.15.72:0/2600820867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aac06b150 0x7f7aac1da760 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c00c700 tx=0x7f7a9c00cac0 comp rx=0 tx=0).stop 2023-07-27T20:32:32.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.590+0000 7f7ab23ff700 1 -- 172.21.15.72:0/2600820867 shutdown_connections 2023-07-27T20:32:32.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.590+0000 7f7ab23ff700 1 --2- 172.21.15.72:0/2600820867 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f7a9806ace0 0x7f7a9806d1a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:32.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.590+0000 7f7ab23ff700 1 --2- 172.21.15.72:0/2600820867 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7aac1549f0 0x7f7aac0af060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:32.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.590+0000 7f7ab23ff700 1 --2- 172.21.15.72:0/2600820867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aac06b150 0x7f7aac1da760 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:32.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.590+0000 7f7ab23ff700 1 --2- 172.21.15.72:0/2600820867 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7aac0c4400 0x7f7aac0aeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:32.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.590+0000 7f7ab23ff700 1 -- 172.21.15.72:0/2600820867 >> 172.21.15.72:0/2600820867 conn(0x7f7aac0ab300 msgr2=0x7f7aac1de6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:32.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.590+0000 7f7ab23ff700 1 -- 172.21.15.72:0/2600820867 shutdown_connections 2023-07-27T20:32:32.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.590+0000 7f7ab23ff700 1 -- 172.21.15.72:0/2600820867 wait complete. 2023-07-27T20:32:32.596 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-27T20:31:14.581785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T20:31:21.077941+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T20:31:27.020951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T20:31:27.566022+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-27T20:31:31.182401+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-27T20:32:32.598 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-27T20:32:32.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.811+0000 7f9b8bfff700 1 Processor -- start 2023-07-27T20:32:32.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.811+0000 7f9b8bfff700 1 -- start start 2023-07-27T20:32:32.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.812+0000 7f9b8bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9b8414aab0 0x7f9b84154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:32.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.813+0000 7f9b8bfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9b840c7740 0x7f9b840c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:32.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.813+0000 7f9b8bfff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9b840c4700 0x7f9b8406c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:32.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.813+0000 7f9b8bfff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b840c7c50 con 0x7f9b8414aab0 2023-07-27T20:32:32.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.813+0000 7f9b8bfff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b8406bd40 con 0x7f9b840c4700 2023-07-27T20:32:32.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.813+0000 7f9b8bfff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b840c62f0 con 0x7f9b840c7740 2023-07-27T20:32:32.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.813+0000 7f9b89d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9b8414aab0 0x7f9b84154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:32.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.813+0000 7f9b89d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9b8414aab0 0x7f9b84154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56938/0 (socket says 172.21.15.72:56938) 2023-07-27T20:32:32.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.813+0000 7f9b89d9b700 1 -- 172.21.15.72:0/2007939194 learned_addr learned my addr 172.21.15.72:0/2007939194 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:32.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.813+0000 7f9b8959a700 1 --2- 172.21.15.72:0/2007939194 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9b840c7740 0x7f9b840c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:32.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.813+0000 7f9b8a59c700 1 --2- 172.21.15.72:0/2007939194 >> v2:172.21.15.173:3300/0 conn(0x7f9b840c4700 0x7f9b8406c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:32.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.813+0000 7f9b89d9b700 1 -- 172.21.15.72:0/2007939194 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9b840c7740 msgr2=0x7f9b840c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:32.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.813+0000 7f9b89d9b700 1 --2- 172.21.15.72:0/2007939194 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9b840c7740 0x7f9b840c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:32.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.813+0000 7f9b89d9b700 1 -- 172.21.15.72:0/2007939194 >> v2:172.21.15.173:3300/0 conn(0x7f9b840c4700 msgr2=0x7f9b8406c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:32.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.813+0000 7f9b89d9b700 1 --2- 172.21.15.72:0/2007939194 >> v2:172.21.15.173:3300/0 conn(0x7f9b840c4700 0x7f9b8406c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:32.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.813+0000 7f9b89d9b700 1 -- 172.21.15.72:0/2007939194 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b84155050 con 0x7f9b8414aab0 2023-07-27T20:32:32.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.813+0000 7f9b8a59c700 1 --2- 172.21.15.72:0/2007939194 >> v2:172.21.15.173:3300/0 conn(0x7f9b840c4700 0x7f9b8406c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:32:32.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.814+0000 7f9b89d9b700 1 --2- 172.21.15.72:0/2007939194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b8414aab0 0x7f9b84154b10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9b840c9720 tx=0x7f9b80009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bba9015fba94674 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:32.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.814+0000 7f9b88d99700 1 -- 172.21.15.72:0/2007939194 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8000b870 con 0x7f9b8414aab0 2023-07-27T20:32:32.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.814+0000 7f9b88d99700 1 -- 172.21.15.72:0/2007939194 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8000b9d0 con 0x7f9b8414aab0 2023-07-27T20:32:32.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.814+0000 7f9b88d99700 1 -- 172.21.15.72:0/2007939194 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8000bd60 con 0x7f9b8414aab0 2023-07-27T20:32:32.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.814+0000 7f9b8bfff700 1 -- 172.21.15.72:0/2007939194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b8414aab0 msgr2=0x7f9b84154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:32.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.814+0000 7f9b8bfff700 1 --2- 172.21.15.72:0/2007939194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b8414aab0 0x7f9b84154b10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9b840c9720 tx=0x7f9b80009bd0 comp rx=0 tx=0).stop 2023-07-27T20:32:32.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.814+0000 7f9b8bfff700 1 -- 172.21.15.72:0/2007939194 shutdown_connections 2023-07-27T20:32:32.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.814+0000 7f9b8bfff700 1 --2- 172.21.15.72:0/2007939194 >> v2:172.21.15.173:3300/0 conn(0x7f9b840c4700 0x7f9b8406c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:32.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.814+0000 7f9b8bfff700 1 --2- 172.21.15.72:0/2007939194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b8414aab0 0x7f9b84154b10 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:32.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.814+0000 7f9b8bfff700 1 --2- 172.21.15.72:0/2007939194 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9b840c7740 0x7f9b840c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:32.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.814+0000 7f9b8bfff700 1 -- 172.21.15.72:0/2007939194 >> 172.21.15.72:0/2007939194 conn(0x7f9b840ab3f0 msgr2=0x7f9b840ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:32.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.814+0000 7f9b8bfff700 1 -- 172.21.15.72:0/2007939194 shutdown_connections 2023-07-27T20:32:32.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.814+0000 7f9b8bfff700 1 -- 172.21.15.72:0/2007939194 wait complete. 2023-07-27T20:32:32.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.816+0000 7f9b8bfff700 1 Processor -- start 2023-07-27T20:32:32.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.816+0000 7f9b8bfff700 1 -- start start 2023-07-27T20:32:32.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.817+0000 7f9b8bfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b840c4700 0x7f9b8414a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:32.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.817+0000 7f9b8bfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9b840c7740 0x7f9b840bdf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:32.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.817+0000 7f9b8bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b8414aab0 0x7f9b840be480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:32.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.817+0000 7f9b8bfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b840bdb90 con 0x7f9b8414aab0 2023-07-27T20:32:32.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.817+0000 7f9b8bfff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b84151390 con 0x7f9b840c4700 2023-07-27T20:32:32.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.817+0000 7f9b8bfff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b840c1b00 con 0x7f9b840c7740 2023-07-27T20:32:32.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.817+0000 7f9b8a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b8414aab0 0x7f9b840be480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:32.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.817+0000 7f9b8a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b8414aab0 0x7f9b840be480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56942/0 (socket says 172.21.15.72:56942) 2023-07-27T20:32:32.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.817+0000 7f9b8a59c700 1 -- 172.21.15.72:0/2324424035 learned_addr learned my addr 172.21.15.72:0/2324424035 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:32.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.817+0000 7f9b89d9b700 1 --2- 172.21.15.72:0/2324424035 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b840c4700 0x7f9b8414a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:32.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.817+0000 7f9b8959a700 1 --2- 172.21.15.72:0/2324424035 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9b840c7740 0x7f9b840bdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:32.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.818+0000 7f9b8a59c700 1 -- 172.21.15.72:0/2324424035 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9b840c7740 msgr2=0x7f9b840bdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:32.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.818+0000 7f9b8a59c700 1 --2- 172.21.15.72:0/2324424035 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9b840c7740 0x7f9b840bdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:32.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.818+0000 7f9b8a59c700 1 -- 172.21.15.72:0/2324424035 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b840c4700 msgr2=0x7f9b8414a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:32.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.818+0000 7f9b8a59c700 1 --2- 172.21.15.72:0/2324424035 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b840c4700 0x7f9b8414a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:32.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.818+0000 7f9b8a59c700 1 -- 172.21.15.72:0/2324424035 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b80009550 con 0x7f9b8414aab0 2023-07-27T20:32:32.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.818+0000 7f9b8959a700 1 --2- 172.21.15.72:0/2324424035 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9b840c7740 0x7f9b840bdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:32.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.818+0000 7f9b8a59c700 1 --2- 172.21.15.72:0/2324424035 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b8414aab0 0x7f9b840be480 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c00cef0 tx=0x7f9b7c00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:32.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.818+0000 7f9b7a7fc700 1 -- 172.21.15.72:0/2324424035 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c00acd0 con 0x7f9b8414aab0 2023-07-27T20:32:32.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.818+0000 7f9b7a7fc700 1 -- 172.21.15.72:0/2324424035 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7c00ae30 con 0x7f9b8414aab0 2023-07-27T20:32:32.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.818+0000 7f9b8bfff700 1 -- 172.21.15.72:0/2324424035 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b840c1de0 con 0x7f9b8414aab0 2023-07-27T20:32:32.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.818+0000 7f9b7a7fc700 1 -- 172.21.15.72:0/2324424035 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c015680 con 0x7f9b8414aab0 2023-07-27T20:32:32.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.818+0000 7f9b8bfff700 1 -- 172.21.15.72:0/2324424035 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b840c23a0 con 0x7f9b8414aab0 2023-07-27T20:32:32.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.819+0000 7f9b8bfff700 1 -- 172.21.15.72:0/2324424035 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b8404e470 con 0x7f9b8414aab0 2023-07-27T20:32:32.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.820+0000 7f9b7a7fc700 1 -- 172.21.15.72:0/2324424035 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9b7c00d430 con 0x7f9b8414aab0 2023-07-27T20:32:32.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.821+0000 7f9b7a7fc700 1 --2- 172.21.15.72:0/2324424035 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9b6806ace0 0x7f9b6806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:32.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.821+0000 7f9b7a7fc700 1 -- 172.21.15.72:0/2324424035 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9b7c089cf0 con 0x7f9b8414aab0 2023-07-27T20:32:32.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.822+0000 7f9b89d9b700 1 --2- 172.21.15.72:0/2324424035 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9b6806ace0 0x7f9b6806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:32.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.822+0000 7f9b89d9b700 1 --2- 172.21.15.72:0/2324424035 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9b6806ace0 0x7f9b6806d1a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9b80014040 tx=0x7f9b80008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:32.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:32.825+0000 7f9b7a7fc700 1 -- 172.21.15.72:0/2324424035 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9b7c0549d0 con 0x7f9b8414aab0 2023-07-27T20:32:33.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.016+0000 7f9b8bfff700 1 -- 172.21.15.72:0/2324424035 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9b8406cf00 con 0x7f9b8414aab0 2023-07-27T20:32:33.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.017+0000 7f9b7a7fc700 1 -- 172.21.15.72:0/2324424035 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9b7c01a0a0 con 0x7f9b8414aab0 2023-07-27T20:32:33.005 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-27T20:32:33.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.019+0000 7f9b8bfff700 1 -- 172.21.15.72:0/2324424035 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9b6806ace0 msgr2=0x7f9b6806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:33.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.019+0000 7f9b8bfff700 1 --2- 172.21.15.72:0/2324424035 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9b6806ace0 0x7f9b6806d1a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9b80014040 tx=0x7f9b80008030 comp rx=0 tx=0).stop 2023-07-27T20:32:33.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.019+0000 7f9b8bfff700 1 -- 172.21.15.72:0/2324424035 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b8414aab0 msgr2=0x7f9b840be480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:33.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.019+0000 7f9b8bfff700 1 --2- 172.21.15.72:0/2324424035 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b8414aab0 0x7f9b840be480 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c00cef0 tx=0x7f9b7c00cf20 comp rx=0 tx=0).stop 2023-07-27T20:32:33.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.019+0000 7f9b8bfff700 1 -- 172.21.15.72:0/2324424035 shutdown_connections 2023-07-27T20:32:33.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.019+0000 7f9b8bfff700 1 --2- 172.21.15.72:0/2324424035 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b8414aab0 0x7f9b840be480 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:33.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.019+0000 7f9b8bfff700 1 --2- 172.21.15.72:0/2324424035 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b840c4700 0x7f9b8414a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:33.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.019+0000 7f9b8bfff700 1 --2- 172.21.15.72:0/2324424035 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9b6806ace0 0x7f9b6806d1a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:33.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.019+0000 7f9b8bfff700 1 --2- 172.21.15.72:0/2324424035 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9b840c7740 0x7f9b840bdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:33.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.019+0000 7f9b8bfff700 1 -- 172.21.15.72:0/2324424035 >> 172.21.15.72:0/2324424035 conn(0x7f9b840ab3f0 msgr2=0x7f9b840c7de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:33.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.019+0000 7f9b8bfff700 1 -- 172.21.15.72:0/2324424035 shutdown_connections 2023-07-27T20:32:33.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.019+0000 7f9b8bfff700 1 -- 172.21.15.72:0/2324424035 wait complete. 2023-07-27T20:32:33.024 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T20:32:33.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.239+0000 7f09e01ff700 1 Processor -- start 2023-07-27T20:32:33.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.239+0000 7f09e01ff700 1 -- start start 2023-07-27T20:32:33.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.240+0000 7f09e01ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09d81516c0 0x7f09d8071e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:33.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.240+0000 7f09e01ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09d8154f50 con 0x7f09d81475a0 2023-07-27T20:32:33.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.240+0000 7f09e01ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09d8154340 con 0x7f09d80c12f0 2023-07-27T20:32:33.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.240+0000 7f09e01ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d8154620 con 0x7f09d81516c0 2023-07-27T20:32:33.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.241+0000 7f09ddf9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f09d81475a0 0x7f09d80c1d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58994/0 (socket says 172.21.15.72:58994) 2023-07-27T20:32:33.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.241+0000 7f09ddf9b700 1 -- 172.21.15.72:0/3094331884 learned_addr learned my addr 172.21.15.72:0/3094331884 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:33.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.241+0000 7f09de79c700 1 --2- 172.21.15.72:0/3094331884 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09d81516c0 0x7f09d8071e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:33.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.241+0000 7f09dcf99700 1 -- 172.21.15.72:0/3094331884 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 392204649 0 0) 0x7f09d8154f50 con 0x7f09d81475a0 2023-07-27T20:32:33.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.241+0000 7f09dcf99700 1 -- 172.21.15.72:0/3094331884 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09c40057c0 con 0x7f09d81475a0 2023-07-27T20:32:33.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.241+0000 7f09dcf99700 1 -- 172.21.15.72:0/3094331884 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3578003818 0 0) 0x7f09d8154340 con 0x7f09d80c12f0 2023-07-27T20:32:33.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.241+0000 7f09dcf99700 1 -- 172.21.15.72:0/3094331884 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09d8154f50 con 0x7f09d80c12f0 2023-07-27T20:32:33.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.241+0000 7f09dcf99700 1 -- 172.21.15.72:0/3094331884 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3594378560 0 0) 0x7f09c40057c0 con 0x7f09d81475a0 2023-07-27T20:32:33.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.241+0000 7f09dcf99700 1 -- 172.21.15.72:0/3094331884 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09d81516c0 msgr2=0x7f09d8071e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:33.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.241+0000 7f09dcf99700 1 --2- 172.21.15.72:0/3094331884 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09d81516c0 0x7f09d8071e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:33.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.241+0000 7f09dcf99700 1 -- 172.21.15.72:0/3094331884 >> v1:172.21.15.173:6789/0 conn(0x7f09d80c12f0 legacy=0x7f09d80716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:33.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.241+0000 7f09dcf99700 1 -- 172.21.15.72:0/3094331884 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d8154900 con 0x7f09d81475a0 2023-07-27T20:32:33.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.241+0000 7f09dcf99700 1 -- 172.21.15.72:0/3094331884 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f09d4001670 con 0x7f09d81475a0 2023-07-27T20:32:33.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.241+0000 7f09dcf99700 1 -- 172.21.15.72:0/3094331884 >> v1:172.21.15.72:6789/0 conn(0x7f09d81475a0 legacy=0x7f09d80c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:33.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.242+0000 7f09dcf99700 1 --2- 172.21.15.72:0/3094331884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09c4005dd0 0x7f09c40061d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:33.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.242+0000 7f09dcf99700 1 --2- 172.21.15.72:0/3094331884 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09d81516c0 0x7f09c4006a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:33.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.242+0000 7f09dcf99700 1 --2- 172.21.15.72:0/3094331884 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09c4006fa0 0x7f09c4007420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:33.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.242+0000 7f09dcf99700 1 -- 172.21.15.72:0/3094331884 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d8154620 con 0x7f09c4005dd0 2023-07-27T20:32:33.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.242+0000 7f09dcf99700 1 -- 172.21.15.72:0/3094331884 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c400dcd0 con 0x7f09c4006fa0 2023-07-27T20:32:33.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.242+0000 7f09dcf99700 1 -- 172.21.15.72:0/3094331884 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c400de40 con 0x7f09d81516c0 2023-07-27T20:32:33.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.242+0000 7f09ddf9b700 1 --2- 172.21.15.72:0/3094331884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09c4005dd0 0x7f09c40061d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:33.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.242+0000 7f09de79c700 1 --2- 172.21.15.72:0/3094331884 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09c4006fa0 0x7f09c4007420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:33.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.242+0000 7f09dd79a700 1 --2- 172.21.15.72:0/3094331884 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09d81516c0 0x7f09c4006a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:33.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.242+0000 7f09ddf9b700 1 -- 172.21.15.72:0/3094331884 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09d81516c0 msgr2=0x7f09c4006a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:33.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.242+0000 7f09ddf9b700 1 --2- 172.21.15.72:0/3094331884 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09d81516c0 0x7f09c4006a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:33.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.242+0000 7f09ddf9b700 1 -- 172.21.15.72:0/3094331884 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09c4006fa0 msgr2=0x7f09c4007420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:33.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.242+0000 7f09ddf9b700 1 --2- 172.21.15.72:0/3094331884 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09c4006fa0 0x7f09c4007420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:33.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.242+0000 7f09ddf9b700 1 -- 172.21.15.72:0/3094331884 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c40057c0 con 0x7f09c4005dd0 2023-07-27T20:32:33.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.242+0000 7f09de79c700 1 --2- 172.21.15.72:0/3094331884 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09c4006fa0 0x7f09c4007420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:33.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.242+0000 7f09ddf9b700 1 --2- 172.21.15.72:0/3094331884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09c4005dd0 0x7f09c40061d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f09d400c210 tx=0x7f09c4007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11294a99971c7020 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:33.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.243+0000 7f09dcf99700 1 -- 172.21.15.72:0/3094331884 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d400cdb0 con 0x7f09c4005dd0 2023-07-27T20:32:33.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.243+0000 7f09dcf99700 1 -- 172.21.15.72:0/3094331884 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d4001af0 con 0x7f09c4005dd0 2023-07-27T20:32:33.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.243+0000 7f09dcf99700 1 -- 172.21.15.72:0/3094331884 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d4005ba0 con 0x7f09c4005dd0 2023-07-27T20:32:33.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.243+0000 7f09e01ff700 1 -- 172.21.15.72:0/3094331884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09c4005dd0 msgr2=0x7f09c40061d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:33.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.243+0000 7f09e01ff700 1 --2- 172.21.15.72:0/3094331884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09c4005dd0 0x7f09c40061d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f09d400c210 tx=0x7f09c4007a90 comp rx=0 tx=0).stop 2023-07-27T20:32:33.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.243+0000 7f09de79c700 1 -- 172.21.15.72:0/3094331884 reap_dead start 2023-07-27T20:32:33.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.243+0000 7f09e01ff700 1 -- 172.21.15.72:0/3094331884 shutdown_connections 2023-07-27T20:32:33.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.243+0000 7f09e01ff700 1 -- 172.21.15.72:0/3094331884 >> 172.21.15.72:0/3094331884 conn(0x7f09d806a190 msgr2=0x7f09d806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:33.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.243+0000 7f09e01ff700 1 -- 172.21.15.72:0/3094331884 shutdown_connections 2023-07-27T20:32:33.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.243+0000 7f09e01ff700 1 -- 172.21.15.72:0/3094331884 wait complete. 2023-07-27T20:32:33.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.245+0000 7f09e01ff700 1 Processor -- start 2023-07-27T20:32:33.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.245+0000 7f09e01ff700 1 -- start start 2023-07-27T20:32:33.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.246+0000 7f09e01ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09c4005dd0 0x7f09d80c4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:33.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.246+0000 7f09e01ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09d8150c80 0x7f09d8144850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:33.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.246+0000 7f09e01ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09d80bf310 0x7f09d8144d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:33.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.246+0000 7f09e01ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d80bca80 con 0x7f09d80bf310 2023-07-27T20:32:33.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.246+0000 7f09e01ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d80bd780 con 0x7f09c4005dd0 2023-07-27T20:32:33.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.246+0000 7f09e01ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d806d0c0 con 0x7f09d8150c80 2023-07-27T20:32:33.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.246+0000 7f09de79c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09d80bf310 0x7f09d8144d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:33.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.246+0000 7f09de79c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09d80bf310 0x7f09d8144d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56960/0 (socket says 172.21.15.72:56960) 2023-07-27T20:32:33.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.246+0000 7f09de79c700 1 -- 172.21.15.72:0/879477013 learned_addr learned my addr 172.21.15.72:0/879477013 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:33.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.247+0000 7f09dd79a700 1 --2- 172.21.15.72:0/879477013 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09d8150c80 0x7f09d8144850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:33.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.247+0000 7f09ddf9b700 1 --2- 172.21.15.72:0/879477013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09c4005dd0 0x7f09d80c4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:33.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.247+0000 7f09de79c700 1 -- 172.21.15.72:0/879477013 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09d8150c80 msgr2=0x7f09d8144850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:33.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.247+0000 7f09de79c700 1 --2- 172.21.15.72:0/879477013 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09d8150c80 0x7f09d8144850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:33.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.247+0000 7f09de79c700 1 -- 172.21.15.72:0/879477013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09c4005dd0 msgr2=0x7f09d80c4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:33.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.247+0000 7f09de79c700 1 --2- 172.21.15.72:0/879477013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09c4005dd0 0x7f09d80c4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:33.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.247+0000 7f09de79c700 1 -- 172.21.15.72:0/879477013 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d80bd060 con 0x7f09d80bf310 2023-07-27T20:32:33.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.247+0000 7f09de79c700 1 --2- 172.21.15.72:0/879477013 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09d80bf310 0x7f09d8144d90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f09d806b1b0 tx=0x7f09d00104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:33.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.247+0000 7f09ce7fc700 1 -- 172.21.15.72:0/879477013 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d000e050 con 0x7f09d80bf310 2023-07-27T20:32:33.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.247+0000 7f09ce7fc700 1 -- 172.21.15.72:0/879477013 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d000f040 con 0x7f09d80bf310 2023-07-27T20:32:33.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.247+0000 7f09e01ff700 1 -- 172.21.15.72:0/879477013 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09d80bd340 con 0x7f09d80bf310 2023-07-27T20:32:33.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.247+0000 7f09ce7fc700 1 -- 172.21.15.72:0/879477013 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d0003a20 con 0x7f09d80bf310 2023-07-27T20:32:33.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.247+0000 7f09e01ff700 1 -- 172.21.15.72:0/879477013 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09d80c4ed0 con 0x7f09d80bf310 2023-07-27T20:32:33.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.249+0000 7f09e01ff700 1 -- 172.21.15.72:0/879477013 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09d80bc500 con 0x7f09d80bf310 2023-07-27T20:32:33.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.249+0000 7f09ce7fc700 1 -- 172.21.15.72:0/879477013 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f09d0003b80 con 0x7f09d80bf310 2023-07-27T20:32:33.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.250+0000 7f09ce7fc700 1 --2- 172.21.15.72:0/879477013 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f09bc06ace0 0x7f09bc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:33.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.250+0000 7f09ce7fc700 1 -- 172.21.15.72:0/879477013 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f09d0089f70 con 0x7f09d80bf310 2023-07-27T20:32:33.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.251+0000 7f09ddf9b700 1 --2- 172.21.15.72:0/879477013 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f09bc06ace0 0x7f09bc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:33.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.251+0000 7f09ddf9b700 1 --2- 172.21.15.72:0/879477013 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f09bc06ace0 0x7f09bc06d1a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f09d4015040 tx=0x7f09d400a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:33.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.254+0000 7f09ce7fc700 1 -- 172.21.15.72:0/879477013 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f09d80bc500 con 0x7f09d80bf310 2023-07-27T20:32:33.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.449+0000 7f09e01ff700 1 -- 172.21.15.72:0/879477013 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f09d80bcbc0 con 0x7f09d80bf310 2023-07-27T20:32:33.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.449+0000 7f09ce7fc700 1 -- 172.21.15.72:0/879477013 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f09d80bcbc0 con 0x7f09d80bf310 2023-07-27T20:32:33.437 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-27T20:32:33.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.452+0000 7f09e01ff700 1 -- 172.21.15.72:0/879477013 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f09bc06ace0 msgr2=0x7f09bc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:33.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.452+0000 7f09e01ff700 1 --2- 172.21.15.72:0/879477013 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f09bc06ace0 0x7f09bc06d1a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f09d4015040 tx=0x7f09d400a000 comp rx=0 tx=0).stop 2023-07-27T20:32:33.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.452+0000 7f09e01ff700 1 -- 172.21.15.72:0/879477013 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09d80bf310 msgr2=0x7f09d8144d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:33.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.452+0000 7f09e01ff700 1 --2- 172.21.15.72:0/879477013 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09d80bf310 0x7f09d8144d90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f09d806b1b0 tx=0x7f09d00104a0 comp rx=0 tx=0).stop 2023-07-27T20:32:33.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.452+0000 7f09e01ff700 1 -- 172.21.15.72:0/879477013 shutdown_connections 2023-07-27T20:32:33.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.452+0000 7f09e01ff700 1 --2- 172.21.15.72:0/879477013 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09d80bf310 0x7f09d8144d90 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:33.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.452+0000 7f09e01ff700 1 --2- 172.21.15.72:0/879477013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09c4005dd0 0x7f09d80c4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:33.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.452+0000 7f09e01ff700 1 --2- 172.21.15.72:0/879477013 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f09bc06ace0 0x7f09bc06d1a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:33.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.452+0000 7f09e01ff700 1 --2- 172.21.15.72:0/879477013 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09d8150c80 0x7f09d8144850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:33.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.452+0000 7f09e01ff700 1 -- 172.21.15.72:0/879477013 >> 172.21.15.72:0/879477013 conn(0x7f09d806a190 msgr2=0x7f09d80716f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:33.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.452+0000 7f09e01ff700 1 -- 172.21.15.72:0/879477013 shutdown_connections 2023-07-27T20:32:33.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.452+0000 7f09e01ff700 1 -- 172.21.15.72:0/879477013 wait complete. 2023-07-27T20:32:33.457 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T20:32:33.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.667+0000 7f87777ff700 1 Processor -- start 2023-07-27T20:32:33.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.668+0000 7f87777ff700 1 -- start start 2023-07-27T20:32:33.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.669+0000 7f87777ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87701475a0 0x7f87701516c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:33.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.669+0000 7f87777ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f87700c12f0 0x7f87700c1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:33.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.669+0000 7f87777ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f87700c2240 0x7f87700716f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:33.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.669+0000 7f87777ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8770151c00 con 0x7f87700c12f0 2023-07-27T20:32:33.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.669+0000 7f87777ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8770154f50 con 0x7f87700c2240 2023-07-27T20:32:33.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.669+0000 7f87777ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8770154340 con 0x7f87701475a0 2023-07-27T20:32:33.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.669+0000 7f8774d9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f87700c12f0 0x7f87700c1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:33.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.669+0000 7f8774d9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f87700c12f0 0x7f87700c1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56974/0 (socket says 172.21.15.72:56974) 2023-07-27T20:32:33.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.669+0000 7f8774d9a700 1 -- 172.21.15.72:0/821627664 learned_addr learned my addr 172.21.15.72:0/821627664 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:33.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.669+0000 7f8775d9c700 1 --2- 172.21.15.72:0/821627664 >> v2:172.21.15.173:3300/0 conn(0x7f87700c2240 0x7f87700716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:33.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.669+0000 7f877559b700 1 --2- 172.21.15.72:0/821627664 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87701475a0 0x7f87701516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:33.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.669+0000 7f8774d9a700 1 -- 172.21.15.72:0/821627664 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87701475a0 msgr2=0x7f87701516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:33.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.670+0000 7f8774d9a700 1 --2- 172.21.15.72:0/821627664 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87701475a0 0x7f87701516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:33.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.670+0000 7f8774d9a700 1 -- 172.21.15.72:0/821627664 >> v2:172.21.15.173:3300/0 conn(0x7f87700c2240 msgr2=0x7f87700716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:33.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.670+0000 7f8774d9a700 1 --2- 172.21.15.72:0/821627664 >> v2:172.21.15.173:3300/0 conn(0x7f87700c2240 0x7f87700716f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:33.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.670+0000 7f8774d9a700 1 -- 172.21.15.72:0/821627664 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8770154620 con 0x7f87700c12f0 2023-07-27T20:32:33.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.670+0000 7f8774d9a700 1 --2- 172.21.15.72:0/821627664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87700c12f0 0x7f87700c1d00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f877006e620 tx=0x7f8760009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54766ed884f63151 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:33.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.670+0000 7f8767fff700 1 -- 172.21.15.72:0/821627664 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8760011830 con 0x7f87700c12f0 2023-07-27T20:32:33.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.670+0000 7f8767fff700 1 -- 172.21.15.72:0/821627664 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8760011990 con 0x7f87700c12f0 2023-07-27T20:32:33.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.670+0000 7f8767fff700 1 -- 172.21.15.72:0/821627664 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8760011d20 con 0x7f87700c12f0 2023-07-27T20:32:33.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.670+0000 7f87777ff700 1 -- 172.21.15.72:0/821627664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87700c12f0 msgr2=0x7f87700c1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:33.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.670+0000 7f87777ff700 1 --2- 172.21.15.72:0/821627664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87700c12f0 0x7f87700c1d00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f877006e620 tx=0x7f8760009bd0 comp rx=0 tx=0).stop 2023-07-27T20:32:33.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.671+0000 7f87777ff700 1 -- 172.21.15.72:0/821627664 shutdown_connections 2023-07-27T20:32:33.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.671+0000 7f87777ff700 1 --2- 172.21.15.72:0/821627664 >> v2:172.21.15.173:3300/0 conn(0x7f87700c2240 0x7f87700716f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:33.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.671+0000 7f87777ff700 1 --2- 172.21.15.72:0/821627664 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87701475a0 0x7f87701516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:33.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.671+0000 7f87777ff700 1 --2- 172.21.15.72:0/821627664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87700c12f0 0x7f87700c1d00 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:33.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.671+0000 7f87777ff700 1 -- 172.21.15.72:0/821627664 >> 172.21.15.72:0/821627664 conn(0x7f877006a190 msgr2=0x7f877006a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:33.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.671+0000 7f87777ff700 1 -- 172.21.15.72:0/821627664 shutdown_connections 2023-07-27T20:32:33.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.671+0000 7f87777ff700 1 -- 172.21.15.72:0/821627664 wait complete. 2023-07-27T20:32:33.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.672+0000 7f87777ff700 1 Processor -- start 2023-07-27T20:32:33.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.673+0000 7f87777ff700 1 -- start start 2023-07-27T20:32:33.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.673+0000 7f87777ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87700c12f0 0x7f87701ecf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:33.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.673+0000 7f87777ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87700c2240 0x7f87701ed9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:33.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.673+0000 7f87777ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87701475a0 0x7f87700bdf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:33.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.673+0000 7f87777ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87700bcb20 con 0x7f87701475a0 2023-07-27T20:32:33.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.673+0000 7f87777ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87700becd0 con 0x7f87700c2240 2023-07-27T20:32:33.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.673+0000 7f87777ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87700bf520 con 0x7f87700c12f0 2023-07-27T20:32:33.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.674+0000 7f8775d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87701475a0 0x7f87700bdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:33.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.674+0000 7f8775d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87701475a0 0x7f87700bdf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56988/0 (socket says 172.21.15.72:56988) 2023-07-27T20:32:33.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.674+0000 7f8775d9c700 1 -- 172.21.15.72:0/483225235 learned_addr learned my addr 172.21.15.72:0/483225235 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:33.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.674+0000 7f877559b700 1 --2- 172.21.15.72:0/483225235 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87700c12f0 0x7f87701ecf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:33.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.674+0000 7f8774d9a700 1 --2- 172.21.15.72:0/483225235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87700c2240 0x7f87701ed9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:33.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.674+0000 7f8775d9c700 1 -- 172.21.15.72:0/483225235 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87700c12f0 msgr2=0x7f87701ecf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:33.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.674+0000 7f8775d9c700 1 --2- 172.21.15.72:0/483225235 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87700c12f0 0x7f87701ecf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:33.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.674+0000 7f8775d9c700 1 -- 172.21.15.72:0/483225235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87700c2240 msgr2=0x7f87701ed9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:33.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.674+0000 7f8775d9c700 1 --2- 172.21.15.72:0/483225235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87700c2240 0x7f87701ed9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:33.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.674+0000 7f8775d9c700 1 -- 172.21.15.72:0/483225235 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8760009550 con 0x7f87701475a0 2023-07-27T20:32:33.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.674+0000 7f8775d9c700 1 --2- 172.21.15.72:0/483225235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87701475a0 0x7f87700bdf70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f876800e830 tx=0x7f876800eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:33.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.677+0000 7f8765ffb700 1 -- 172.21.15.72:0/483225235 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87680095b0 con 0x7f87701475a0 2023-07-27T20:32:33.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.677+0000 7f8765ffb700 1 -- 172.21.15.72:0/483225235 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8768013680 con 0x7f87701475a0 2023-07-27T20:32:33.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.677+0000 7f87777ff700 1 -- 172.21.15.72:0/483225235 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87701edef0 con 0x7f87701475a0 2023-07-27T20:32:33.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.677+0000 7f8765ffb700 1 -- 172.21.15.72:0/483225235 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8768013a10 con 0x7f87701475a0 2023-07-27T20:32:33.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.677+0000 7f87777ff700 1 -- 172.21.15.72:0/483225235 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87701417a0 con 0x7f87701475a0 2023-07-27T20:32:33.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.678+0000 7f87777ff700 1 -- 172.21.15.72:0/483225235 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87701450d0 con 0x7f87701475a0 2023-07-27T20:32:33.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.679+0000 7f8765ffb700 1 -- 172.21.15.72:0/483225235 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8768013b70 con 0x7f87701475a0 2023-07-27T20:32:33.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.680+0000 7f8765ffb700 1 --2- 172.21.15.72:0/483225235 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f875406ace0 0x7f875406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:33.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.680+0000 7f8765ffb700 1 -- 172.21.15.72:0/483225235 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8768089420 con 0x7f87701475a0 2023-07-27T20:32:33.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.680+0000 7f877559b700 1 --2- 172.21.15.72:0/483225235 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f875406ace0 0x7f875406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:33.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.681+0000 7f877559b700 1 --2- 172.21.15.72:0/483225235 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f875406ace0 0x7f875406d1a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f876c011340 tx=0x7f876c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:33.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.684+0000 7f8765ffb700 1 -- 172.21.15.72:0/483225235 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8768057c20 con 0x7f87701475a0 2023-07-27T20:32:33.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.873+0000 7f87777ff700 1 -- 172.21.15.72:0/483225235 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8770142900 con 0x7f87701475a0 2023-07-27T20:32:33.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.874+0000 7f8765ffb700 1 -- 172.21.15.72:0/483225235 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f87680577b0 con 0x7f87701475a0 2023-07-27T20:32:33.862 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:32:33.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.876+0000 7f87777ff700 1 -- 172.21.15.72:0/483225235 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f875406ace0 msgr2=0x7f875406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:33.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.876+0000 7f87777ff700 1 --2- 172.21.15.72:0/483225235 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f875406ace0 0x7f875406d1a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f876c011340 tx=0x7f876c00b040 comp rx=0 tx=0).stop 2023-07-27T20:32:33.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.876+0000 7f87777ff700 1 -- 172.21.15.72:0/483225235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87701475a0 msgr2=0x7f87700bdf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:33.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.876+0000 7f87777ff700 1 --2- 172.21.15.72:0/483225235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87701475a0 0x7f87700bdf70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f876800e830 tx=0x7f876800eb40 comp rx=0 tx=0).stop 2023-07-27T20:32:33.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.876+0000 7f87777ff700 1 -- 172.21.15.72:0/483225235 shutdown_connections 2023-07-27T20:32:33.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.876+0000 7f87777ff700 1 --2- 172.21.15.72:0/483225235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87701475a0 0x7f87700bdf70 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:33.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.876+0000 7f87777ff700 1 --2- 172.21.15.72:0/483225235 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f875406ace0 0x7f875406d1a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:33.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.876+0000 7f87777ff700 1 --2- 172.21.15.72:0/483225235 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87700c12f0 0x7f87701ecf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:33.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.876+0000 7f87777ff700 1 --2- 172.21.15.72:0/483225235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87700c2240 0x7f87701ed9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:33.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.876+0000 7f87777ff700 1 -- 172.21.15.72:0/483225235 >> 172.21.15.72:0/483225235 conn(0x7f877006a190 msgr2=0x7f8770144300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:33.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.876+0000 7f87777ff700 1 -- 172.21.15.72:0/483225235 shutdown_connections 2023-07-27T20:32:33.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:33.876+0000 7f87777ff700 1 -- 172.21.15.72:0/483225235 wait complete. 2023-07-27T20:32:33.881 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T20:32:34.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.091+0000 7fdb683ff700 1 Processor -- start 2023-07-27T20:32:34.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.091+0000 7fdb683ff700 1 -- start start 2023-07-27T20:32:34.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.092+0000 7fdb683ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdb600c77c0 0x7fdb60151210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:34.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.092+0000 7fdb683ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdb60151750 0x7fdb600c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:34.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.092+0000 7fdb683ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb6006d1c0 con 0x7fdb6006ffc0 2023-07-27T20:32:34.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.092+0000 7fdb683ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb60155070 con 0x7fdb600c77c0 2023-07-27T20:32:34.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.092+0000 7fdb683ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb600c7360 con 0x7fdb60151750 2023-07-27T20:32:34.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.092+0000 7fdb6619b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdb600c77c0 0x7fdb60151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:34.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.092+0000 7fdb6619b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdb600c77c0 0x7fdb60151210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56992/0 (socket says 172.21.15.72:56992) 2023-07-27T20:32:34.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.092+0000 7fdb6619b700 1 -- 172.21.15.72:0/1219459511 learned_addr learned my addr 172.21.15.72:0/1219459511 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:34.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.092+0000 7fdb6699c700 1 --2- 172.21.15.72:0/1219459511 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdb60151750 0x7fdb600c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:34.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.093+0000 7fdb6619b700 1 -- 172.21.15.72:0/1219459511 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdb60151750 msgr2=0x7fdb600c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:34.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.093+0000 7fdb6619b700 1 --2- 172.21.15.72:0/1219459511 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdb60151750 0x7fdb600c6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:34.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.093+0000 7fdb6619b700 1 -- 172.21.15.72:0/1219459511 >> v1:172.21.15.173:6789/0 conn(0x7fdb6006ffc0 legacy=0x7fdb600c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:34.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.093+0000 7fdb6619b700 1 -- 172.21.15.72:0/1219459511 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb6006ce90 con 0x7fdb600c77c0 2023-07-27T20:32:34.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.093+0000 7fdb6619b700 1 --2- 172.21.15.72:0/1219459511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb600c77c0 0x7fdb60151210 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c0098f0 tx=0x7fdb5c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=248bb3098d004608 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:34.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.093+0000 7fdb65199700 1 -- 172.21.15.72:0/1219459511 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c011830 con 0x7fdb600c77c0 2023-07-27T20:32:34.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.093+0000 7fdb65199700 1 -- 172.21.15.72:0/1219459511 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5c011990 con 0x7fdb600c77c0 2023-07-27T20:32:34.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.093+0000 7fdb65199700 1 -- 172.21.15.72:0/1219459511 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c011d20 con 0x7fdb600c77c0 2023-07-27T20:32:34.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.094+0000 7fdb683ff700 1 -- 172.21.15.72:0/1219459511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb600c77c0 msgr2=0x7fdb60151210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:34.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.094+0000 7fdb683ff700 1 --2- 172.21.15.72:0/1219459511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb600c77c0 0x7fdb60151210 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c0098f0 tx=0x7fdb5c009c00 comp rx=0 tx=0).stop 2023-07-27T20:32:34.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.094+0000 7fdb683ff700 1 -- 172.21.15.72:0/1219459511 shutdown_connections 2023-07-27T20:32:34.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.094+0000 7fdb683ff700 1 --2- 172.21.15.72:0/1219459511 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdb60151750 0x7fdb600c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:34.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.094+0000 7fdb683ff700 1 --2- 172.21.15.72:0/1219459511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb600c77c0 0x7fdb60151210 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:34.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.094+0000 7fdb683ff700 1 -- 172.21.15.72:0/1219459511 >> 172.21.15.72:0/1219459511 conn(0x7fdb6006a190 msgr2=0x7fdb6006a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:34.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.094+0000 7fdb683ff700 1 -- 172.21.15.72:0/1219459511 shutdown_connections 2023-07-27T20:32:34.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.094+0000 7fdb683ff700 1 -- 172.21.15.72:0/1219459511 wait complete. 2023-07-27T20:32:34.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.096+0000 7fdb683ff700 1 Processor -- start 2023-07-27T20:32:34.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.096+0000 7fdb683ff700 1 -- start start 2023-07-27T20:32:34.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.096+0000 7fdb683ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb6006ffc0 0x7fdb600aa480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:34.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.097+0000 7fdb683ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdb600c77c0 0x7fdb600bd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:34.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.097+0000 7fdb683ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb60151750 0x7fdb601ecde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:34.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.097+0000 7fdb683ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb600bcd60 con 0x7fdb6006ffc0 2023-07-27T20:32:34.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.097+0000 7fdb683ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb60158410 con 0x7fdb60151750 2023-07-27T20:32:34.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.097+0000 7fdb683ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb601ed620 con 0x7fdb600c77c0 2023-07-27T20:32:34.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.097+0000 7fdb6619b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb6006ffc0 0x7fdb600aa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:34.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.097+0000 7fdb6619b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb6006ffc0 0x7fdb600aa480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57008/0 (socket says 172.21.15.72:57008) 2023-07-27T20:32:34.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.097+0000 7fdb6619b700 1 -- 172.21.15.72:0/2580721345 learned_addr learned my addr 172.21.15.72:0/2580721345 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:34.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.097+0000 7fdb6619b700 1 -- 172.21.15.72:0/2580721345 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdb600c77c0 msgr2=0x7fdb600bd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:34.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.097+0000 7fdb6619b700 1 --2- 172.21.15.72:0/2580721345 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdb600c77c0 0x7fdb600bd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:34.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.097+0000 7fdb6619b700 1 -- 172.21.15.72:0/2580721345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb60151750 msgr2=0x7fdb601ecde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:34.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.097+0000 7fdb6699c700 1 --2- 172.21.15.72:0/2580721345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb60151750 0x7fdb601ecde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:34.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.097+0000 7fdb6619b700 1 --2- 172.21.15.72:0/2580721345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb60151750 0x7fdb601ecde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:34.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.097+0000 7fdb6619b700 1 -- 172.21.15.72:0/2580721345 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb5c009550 con 0x7fdb6006ffc0 2023-07-27T20:32:34.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.097+0000 7fdb6619b700 1 --2- 172.21.15.72:0/2580721345 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb6006ffc0 0x7fdb600aa480 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c000c00 tx=0x7fdb5c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:34.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.098+0000 7fdb56ffd700 1 -- 172.21.15.72:0/2580721345 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c0038a0 con 0x7fdb6006ffc0 2023-07-27T20:32:34.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.098+0000 7fdb56ffd700 1 -- 172.21.15.72:0/2580721345 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5c003a00 con 0x7fdb6006ffc0 2023-07-27T20:32:34.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.098+0000 7fdb56ffd700 1 -- 172.21.15.72:0/2580721345 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c003d90 con 0x7fdb6006ffc0 2023-07-27T20:32:34.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.098+0000 7fdb683ff700 1 -- 172.21.15.72:0/2580721345 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb601ed900 con 0x7fdb6006ffc0 2023-07-27T20:32:34.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.098+0000 7fdb683ff700 1 -- 172.21.15.72:0/2580721345 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb600bd2c0 con 0x7fdb6006ffc0 2023-07-27T20:32:34.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.099+0000 7fdb683ff700 1 -- 172.21.15.72:0/2580721345 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb60154a40 con 0x7fdb6006ffc0 2023-07-27T20:32:34.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.100+0000 7fdb56ffd700 1 -- 172.21.15.72:0/2580721345 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdb5c021070 con 0x7fdb6006ffc0 2023-07-27T20:32:34.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.101+0000 7fdb56ffd700 1 --2- 172.21.15.72:0/2580721345 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fdb4406ace0 0x7fdb4406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:34.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.101+0000 7fdb56ffd700 1 -- 172.21.15.72:0/2580721345 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdb5c08add0 con 0x7fdb6006ffc0 2023-07-27T20:32:34.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.101+0000 7fdb6599a700 1 --2- 172.21.15.72:0/2580721345 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fdb4406ace0 0x7fdb4406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:34.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.102+0000 7fdb6599a700 1 --2- 172.21.15.72:0/2580721345 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fdb4406ace0 0x7fdb4406d1a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdb50000f60 tx=0x7fdb50007a40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:34.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.105+0000 7fdb56ffd700 1 -- 172.21.15.72:0/2580721345 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdb60154a40 con 0x7fdb6006ffc0 2023-07-27T20:32:34.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.296+0000 7fdb683ff700 1 -- 172.21.15.72:0/2580721345 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdb60154a40 con 0x7fdb6006ffc0 2023-07-27T20:32:34.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.297+0000 7fdb56ffd700 1 -- 172.21.15.72:0/2580721345 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdb5c029020 con 0x7fdb6006ffc0 2023-07-27T20:32:34.285 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-27T20:32:34.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.299+0000 7fdb683ff700 1 -- 172.21.15.72:0/2580721345 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fdb4406ace0 msgr2=0x7fdb4406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:34.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.299+0000 7fdb683ff700 1 --2- 172.21.15.72:0/2580721345 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fdb4406ace0 0x7fdb4406d1a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdb50000f60 tx=0x7fdb50007a40 comp rx=0 tx=0).stop 2023-07-27T20:32:34.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.299+0000 7fdb683ff700 1 -- 172.21.15.72:0/2580721345 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb6006ffc0 msgr2=0x7fdb600aa480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:34.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.299+0000 7fdb683ff700 1 --2- 172.21.15.72:0/2580721345 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb6006ffc0 0x7fdb600aa480 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c000c00 tx=0x7fdb5c004750 comp rx=0 tx=0).stop 2023-07-27T20:32:34.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.299+0000 7fdb683ff700 1 -- 172.21.15.72:0/2580721345 shutdown_connections 2023-07-27T20:32:34.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.299+0000 7fdb683ff700 1 --2- 172.21.15.72:0/2580721345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb60151750 0x7fdb601ecde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:34.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.299+0000 7fdb683ff700 1 --2- 172.21.15.72:0/2580721345 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb6006ffc0 0x7fdb600aa480 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:34.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.299+0000 7fdb683ff700 1 --2- 172.21.15.72:0/2580721345 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fdb4406ace0 0x7fdb4406d1a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:34.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.299+0000 7fdb683ff700 1 --2- 172.21.15.72:0/2580721345 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdb600c77c0 0x7fdb600bd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:34.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.299+0000 7fdb683ff700 1 -- 172.21.15.72:0/2580721345 >> 172.21.15.72:0/2580721345 conn(0x7fdb6006a190 msgr2=0x7fdb600c3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:34.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.299+0000 7fdb683ff700 1 -- 172.21.15.72:0/2580721345 shutdown_connections 2023-07-27T20:32:34.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.299+0000 7fdb683ff700 1 -- 172.21.15.72:0/2580721345 wait complete. 2023-07-27T20:32:34.305 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-27T20:32:34.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.516+0000 7f05e73ff700 1 Processor -- start 2023-07-27T20:32:34.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.517+0000 7f05e73ff700 1 -- start start 2023-07-27T20:32:34.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.518+0000 7f05e73ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f05e00c7740 0x7f05e00c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:34.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.518+0000 7f05e73ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05e00c4700 0x7f05e006c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:34.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.518+0000 7f05e73ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05e00c7c50 con 0x7f05e014aab0 2023-07-27T20:32:34.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.518+0000 7f05e73ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e006bd40 con 0x7f05e00c7740 2023-07-27T20:32:34.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.518+0000 7f05e73ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e00c62f0 con 0x7f05e00c4700 2023-07-27T20:32:34.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.518+0000 7f05e519b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f05e014aab0 0x7f05e0154b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59010/0 (socket says 172.21.15.72:59010) 2023-07-27T20:32:34.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.518+0000 7f05e519b700 1 -- 172.21.15.72:0/3016230077 learned_addr learned my addr 172.21.15.72:0/3016230077 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:34.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.518+0000 7f05e499a700 1 --2- 172.21.15.72:0/3016230077 >> v2:172.21.15.173:3300/0 conn(0x7f05e00c7740 0x7f05e00c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:34.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.518+0000 7f05e599c700 1 --2- 172.21.15.72:0/3016230077 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05e00c4700 0x7f05e006c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:34.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.518+0000 7f05d7fff700 1 -- 172.21.15.72:0/3016230077 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 555728039 0 0) 0x7f05e00c7c50 con 0x7f05e014aab0 2023-07-27T20:32:34.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.518+0000 7f05d7fff700 1 -- 172.21.15.72:0/3016230077 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05cc0035b0 con 0x7f05e014aab0 2023-07-27T20:32:34.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.519+0000 7f05e499a700 1 -- 172.21.15.72:0/3016230077 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05e00c4700 msgr2=0x7f05e006c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:34.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.519+0000 7f05e499a700 1 --2- 172.21.15.72:0/3016230077 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05e00c4700 0x7f05e006c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:34.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.519+0000 7f05e499a700 1 -- 172.21.15.72:0/3016230077 >> v1:172.21.15.72:6789/0 conn(0x7f05e014aab0 legacy=0x7f05e0154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:34.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.519+0000 7f05e499a700 1 -- 172.21.15.72:0/3016230077 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e006d200 con 0x7f05e00c7740 2023-07-27T20:32:34.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.519+0000 7f05e499a700 1 --2- 172.21.15.72:0/3016230077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05e00c7740 0x7f05e00c41c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f05d0009840 tx=0x7f05d0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67b24cedb6e977c3 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:34.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.519+0000 7f05d7fff700 1 -- 172.21.15.72:0/3016230077 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d0011830 con 0x7f05e00c7740 2023-07-27T20:32:34.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.519+0000 7f05d7fff700 1 -- 172.21.15.72:0/3016230077 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d0011990 con 0x7f05e00c7740 2023-07-27T20:32:34.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.519+0000 7f05d7fff700 1 -- 172.21.15.72:0/3016230077 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d0011d00 con 0x7f05e00c7740 2023-07-27T20:32:34.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.520+0000 7f05e73ff700 1 -- 172.21.15.72:0/3016230077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05e00c7740 msgr2=0x7f05e00c41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:34.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.520+0000 7f05e73ff700 1 --2- 172.21.15.72:0/3016230077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05e00c7740 0x7f05e00c41c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f05d0009840 tx=0x7f05d0009b50 comp rx=0 tx=0).stop 2023-07-27T20:32:34.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.520+0000 7f05e73ff700 1 -- 172.21.15.72:0/3016230077 shutdown_connections 2023-07-27T20:32:34.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.520+0000 7f05e73ff700 1 --2- 172.21.15.72:0/3016230077 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05e00c4700 0x7f05e006c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:34.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.520+0000 7f05e73ff700 1 --2- 172.21.15.72:0/3016230077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05e00c7740 0x7f05e00c41c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:34.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.520+0000 7f05e73ff700 1 -- 172.21.15.72:0/3016230077 >> 172.21.15.72:0/3016230077 conn(0x7f05e00ab3f0 msgr2=0x7f05e00ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:34.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.520+0000 7f05e73ff700 1 -- 172.21.15.72:0/3016230077 shutdown_connections 2023-07-27T20:32:34.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.520+0000 7f05e73ff700 1 -- 172.21.15.72:0/3016230077 wait complete. 2023-07-27T20:32:34.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.522+0000 7f05e73ff700 1 Processor -- start 2023-07-27T20:32:34.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.522+0000 7f05e73ff700 1 -- start start 2023-07-27T20:32:34.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.523+0000 7f05e73ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05e00c4700 0x7f05e0157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:34.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.523+0000 7f05e73ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05e00c7740 0x7f05e00bd710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:34.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.524+0000 7f05e73ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05e014aab0 0x7f05e00bf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:34.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.524+0000 7f05e73ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e01535a0 con 0x7f05e00c7740 2023-07-27T20:32:34.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.524+0000 7f05e73ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e01ed120 con 0x7f05e014aab0 2023-07-27T20:32:34.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.524+0000 7f05e73ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e00be240 con 0x7f05e00c4700 2023-07-27T20:32:34.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.524+0000 7f05e499a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05e00c7740 0x7f05e00bd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:34.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.524+0000 7f05e499a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05e00c7740 0x7f05e00bd710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57020/0 (socket says 172.21.15.72:57020) 2023-07-27T20:32:34.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.524+0000 7f05e499a700 1 -- 172.21.15.72:0/4035377148 learned_addr learned my addr 172.21.15.72:0/4035377148 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:34.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.524+0000 7f05e499a700 1 -- 172.21.15.72:0/4035377148 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05e00c4700 msgr2=0x7f05e0157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:34.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.524+0000 7f05e519b700 1 --2- 172.21.15.72:0/4035377148 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05e00c4700 0x7f05e0157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:34.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.524+0000 7f05e599c700 1 --2- 172.21.15.72:0/4035377148 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05e014aab0 0x7f05e00bf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:34.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.524+0000 7f05e499a700 1 --2- 172.21.15.72:0/4035377148 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05e00c4700 0x7f05e0157380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:34.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.524+0000 7f05e499a700 1 -- 172.21.15.72:0/4035377148 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05e014aab0 msgr2=0x7f05e00bf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:34.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.524+0000 7f05e499a700 1 --2- 172.21.15.72:0/4035377148 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05e014aab0 0x7f05e00bf6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:34.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.524+0000 7f05e499a700 1 -- 172.21.15.72:0/4035377148 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d00094a0 con 0x7f05e00c7740 2023-07-27T20:32:34.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.524+0000 7f05e599c700 1 --2- 172.21.15.72:0/4035377148 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05e014aab0 0x7f05e00bf6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:32:34.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.524+0000 7f05e519b700 1 --2- 172.21.15.72:0/4035377148 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05e00c4700 0x7f05e0157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:32:34.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.524+0000 7f05e499a700 1 --2- 172.21.15.72:0/4035377148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05e00c7740 0x7f05e00bd710 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f05d0000c00 tx=0x7f05d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:34.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.525+0000 7f05d5ffb700 1 -- 172.21.15.72:0/4035377148 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d00045d0 con 0x7f05e00c7740 2023-07-27T20:32:34.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.525+0000 7f05d5ffb700 1 -- 172.21.15.72:0/4035377148 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d001f070 con 0x7f05e00c7740 2023-07-27T20:32:34.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.525+0000 7f05d5ffb700 1 -- 172.21.15.72:0/4035377148 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d00038a0 con 0x7f05e00c7740 2023-07-27T20:32:34.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.525+0000 7f05e73ff700 1 -- 172.21.15.72:0/4035377148 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05e00bdf60 con 0x7f05e00c7740 2023-07-27T20:32:34.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.525+0000 7f05e73ff700 1 -- 172.21.15.72:0/4035377148 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e01ecdb0 con 0x7f05e00c7740 2023-07-27T20:32:34.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.526+0000 7f05e73ff700 1 -- 172.21.15.72:0/4035377148 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05e01ec930 con 0x7f05e00c7740 2023-07-27T20:32:34.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.527+0000 7f05d5ffb700 1 -- 172.21.15.72:0/4035377148 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f05d0003a00 con 0x7f05e00c7740 2023-07-27T20:32:34.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.527+0000 7f05d5ffb700 1 --2- 172.21.15.72:0/4035377148 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f05c406ace0 0x7f05c406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:34.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.528+0000 7f05d5ffb700 1 -- 172.21.15.72:0/4035377148 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f05d0021070 con 0x7f05e00c7740 2023-07-27T20:32:34.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.528+0000 7f05e519b700 1 --2- 172.21.15.72:0/4035377148 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f05c406ace0 0x7f05c406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:34.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.529+0000 7f05e519b700 1 --2- 172.21.15.72:0/4035377148 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f05c406ace0 0x7f05c406d1a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f05dc005910 tx=0x7f05dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:34.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.532+0000 7f05d5ffb700 1 -- 172.21.15.72:0/4035377148 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f05e01ec930 con 0x7f05e00c7740 2023-07-27T20:32:34.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.729+0000 7f05e73ff700 1 -- 172.21.15.72:0/4035377148 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f05e01ed2d0 con 0x7f05e00c7740 2023-07-27T20:32:34.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.730+0000 7f05d5ffb700 1 -- 172.21.15.72:0/4035377148 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f05e01ed2d0 con 0x7f05e00c7740 2023-07-27T20:32:34.717 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:32:34.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.732+0000 7f05e73ff700 1 -- 172.21.15.72:0/4035377148 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f05c406ace0 msgr2=0x7f05c406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:34.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.732+0000 7f05e73ff700 1 --2- 172.21.15.72:0/4035377148 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f05c406ace0 0x7f05c406d1a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f05dc005910 tx=0x7f05dc009040 comp rx=0 tx=0).stop 2023-07-27T20:32:34.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.732+0000 7f05e73ff700 1 -- 172.21.15.72:0/4035377148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05e00c7740 msgr2=0x7f05e00bd710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:34.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.732+0000 7f05e73ff700 1 --2- 172.21.15.72:0/4035377148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05e00c7740 0x7f05e00bd710 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f05d0000c00 tx=0x7f05d0004750 comp rx=0 tx=0).stop 2023-07-27T20:32:34.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.732+0000 7f05e73ff700 1 -- 172.21.15.72:0/4035377148 shutdown_connections 2023-07-27T20:32:34.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.732+0000 7f05e73ff700 1 --2- 172.21.15.72:0/4035377148 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05e014aab0 0x7f05e00bf6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:34.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.732+0000 7f05e73ff700 1 --2- 172.21.15.72:0/4035377148 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f05c406ace0 0x7f05c406d1a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:34.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.732+0000 7f05e73ff700 1 --2- 172.21.15.72:0/4035377148 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05e00c4700 0x7f05e0157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:34.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.732+0000 7f05e73ff700 1 --2- 172.21.15.72:0/4035377148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05e00c7740 0x7f05e00bd710 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:34.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.732+0000 7f05e73ff700 1 -- 172.21.15.72:0/4035377148 >> 172.21.15.72:0/4035377148 conn(0x7f05e00ab3f0 msgr2=0x7f05e01def50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:34.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.732+0000 7f05e73ff700 1 -- 172.21.15.72:0/4035377148 shutdown_connections 2023-07-27T20:32:34.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.732+0000 7f05e73ff700 1 -- 172.21.15.72:0/4035377148 wait complete. 2023-07-27T20:32:34.737 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-27T20:32:34.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.946+0000 7f73b5dff700 1 Processor -- start 2023-07-27T20:32:34.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.946+0000 7f73b5dff700 1 -- start start 2023-07-27T20:32:34.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.948+0000 7f73b5dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f73b013b2c0 0x7f73b00aa420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:34.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.948+0000 7f73b5dff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f73b00a83a0 0x7f73b00a8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:34.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.948+0000 7f73b5dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73b0155600 con 0x7f73b00bfd90 2023-07-27T20:32:34.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.948+0000 7f73b5dff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73b00a9620 con 0x7f73b00a83a0 2023-07-27T20:32:34.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.948+0000 7f73b5dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73b0155320 con 0x7f73b013b2c0 2023-07-27T20:32:34.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.948+0000 7f73a7fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f73b00bfd90 0x7f73b00aa960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59026/0 (socket says 172.21.15.72:59026) 2023-07-27T20:32:34.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.948+0000 7f73a7fff700 1 -- 172.21.15.72:0/2642964844 learned_addr learned my addr 172.21.15.72:0/2642964844 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:34.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.948+0000 7f73affff700 1 --2- 172.21.15.72:0/2642964844 >> v2:172.21.15.173:3300/0 conn(0x7f73b00a83a0 0x7f73b00a8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:34.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.948+0000 7f73af7fe700 1 --2- 172.21.15.72:0/2642964844 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f73b013b2c0 0x7f73b00aa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:34.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.948+0000 7f73aeffd700 1 -- 172.21.15.72:0/2642964844 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2568638341 0 0) 0x7f73b0155600 con 0x7f73b00bfd90 2023-07-27T20:32:34.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.948+0000 7f73aeffd700 1 -- 172.21.15.72:0/2642964844 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f739c0035b0 con 0x7f73b00bfd90 2023-07-27T20:32:34.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.949+0000 7f73aeffd700 1 -- 172.21.15.72:0/2642964844 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1872799639 0 0) 0x7f739c0035b0 con 0x7f73b00bfd90 2023-07-27T20:32:34.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.949+0000 7f73aeffd700 1 -- 172.21.15.72:0/2642964844 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f73b013b2c0 msgr2=0x7f73b00aa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:34.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.949+0000 7f73aeffd700 1 --2- 172.21.15.72:0/2642964844 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f73b013b2c0 0x7f73b00aa420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:34.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.949+0000 7f73aeffd700 1 -- 172.21.15.72:0/2642964844 >> v2:172.21.15.173:3300/0 conn(0x7f73b00a83a0 msgr2=0x7f73b00a8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:34.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.949+0000 7f73aeffd700 1 --2- 172.21.15.72:0/2642964844 >> v2:172.21.15.173:3300/0 conn(0x7f73b00a83a0 0x7f73b00a8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:34.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.949+0000 7f73aeffd700 1 -- 172.21.15.72:0/2642964844 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b0151e40 con 0x7f73b00bfd90 2023-07-27T20:32:34.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.949+0000 7f73aeffd700 1 -- 172.21.15.72:0/2642964844 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f7398001670 con 0x7f73b00bfd90 2023-07-27T20:32:34.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.949+0000 7f73aeffd700 1 -- 172.21.15.72:0/2642964844 >> v1:172.21.15.72:6789/0 conn(0x7f73b00bfd90 legacy=0x7f73b00aa960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:34.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.949+0000 7f73aeffd700 1 --2- 172.21.15.72:0/2642964844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f739c003a00 0x7f739c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:34.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.949+0000 7f73aeffd700 1 --2- 172.21.15.72:0/2642964844 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f73b013b2c0 0x7f739c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:34.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.949+0000 7f73aeffd700 1 --2- 172.21.15.72:0/2642964844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f739c004d90 0x7f739c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:34.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.949+0000 7f73aeffd700 1 -- 172.21.15.72:0/2642964844 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b00a9620 con 0x7f739c004d90 2023-07-27T20:32:34.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.949+0000 7f73aeffd700 1 -- 172.21.15.72:0/2642964844 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b0155320 con 0x7f739c003a00 2023-07-27T20:32:34.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.949+0000 7f73aeffd700 1 -- 172.21.15.72:0/2642964844 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f739c00ba10 con 0x7f73b013b2c0 2023-07-27T20:32:34.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.949+0000 7f73affff700 1 --2- 172.21.15.72:0/2642964844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f739c004d90 0x7f739c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:34.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.949+0000 7f73af7fe700 1 --2- 172.21.15.72:0/2642964844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f739c003a00 0x7f739c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:34.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.949+0000 7f73a7fff700 1 --2- 172.21.15.72:0/2642964844 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f73b013b2c0 0x7f739c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:34.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.950+0000 7f73affff700 1 -- 172.21.15.72:0/2642964844 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f73b013b2c0 msgr2=0x7f739c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:34.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.950+0000 7f73affff700 1 --2- 172.21.15.72:0/2642964844 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f73b013b2c0 0x7f739c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:34.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.950+0000 7f73affff700 1 -- 172.21.15.72:0/2642964844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f739c003a00 msgr2=0x7f739c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:34.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.950+0000 7f73affff700 1 --2- 172.21.15.72:0/2642964844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f739c003a00 0x7f739c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:34.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.950+0000 7f73affff700 1 -- 172.21.15.72:0/2642964844 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f739c0035b0 con 0x7f739c004d90 2023-07-27T20:32:34.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.950+0000 7f73affff700 1 --2- 172.21.15.72:0/2642964844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f739c004d90 0x7f739c005210 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f73a8009fc0 tx=0x7f739c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=928ad888e8f31476 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:34.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.950+0000 7f73aeffd700 1 -- 172.21.15.72:0/2642964844 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a800ec30 con 0x7f739c004d90 2023-07-27T20:32:34.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.950+0000 7f73aeffd700 1 -- 172.21.15.72:0/2642964844 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a800f040 con 0x7f739c004d90 2023-07-27T20:32:34.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.950+0000 7f73aeffd700 1 -- 172.21.15.72:0/2642964844 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a8014480 con 0x7f739c004d90 2023-07-27T20:32:34.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.951+0000 7f73b5dff700 1 -- 172.21.15.72:0/2642964844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f739c004d90 msgr2=0x7f739c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:34.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.951+0000 7f73b5dff700 1 --2- 172.21.15.72:0/2642964844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f739c004d90 0x7f739c005210 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f73a8009fc0 tx=0x7f739c005880 comp rx=0 tx=0).stop 2023-07-27T20:32:34.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.951+0000 7f73affff700 1 -- 172.21.15.72:0/2642964844 reap_dead start 2023-07-27T20:32:34.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.951+0000 7f73b5dff700 1 -- 172.21.15.72:0/2642964844 shutdown_connections 2023-07-27T20:32:34.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.951+0000 7f73b5dff700 1 -- 172.21.15.72:0/2642964844 >> 172.21.15.72:0/2642964844 conn(0x7f73b006a190 msgr2=0x7f73b006a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:34.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.951+0000 7f73b5dff700 1 -- 172.21.15.72:0/2642964844 shutdown_connections 2023-07-27T20:32:34.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.951+0000 7f73b5dff700 1 -- 172.21.15.72:0/2642964844 wait complete. 2023-07-27T20:32:34.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.952+0000 7f73b5dff700 1 Processor -- start 2023-07-27T20:32:34.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.953+0000 7f73b5dff700 1 -- start start 2023-07-27T20:32:34.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.953+0000 7f73b5dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f739c004d90 0x7f73b00c2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:34.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.953+0000 7f73b5dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73b0130e20 0x7f73b01312a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:34.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.953+0000 7f73b5dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73b01eaf40 0x7f73b01eb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:34.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.953+0000 7f73b5dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b00c4bf0 con 0x7f73b0130e20 2023-07-27T20:32:34.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.953+0000 7f73b5dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b01ebc30 con 0x7f73b01eaf40 2023-07-27T20:32:34.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.953+0000 7f73b5dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73b0132ae0 con 0x7f739c004d90 2023-07-27T20:32:34.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.954+0000 7f73a7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73b0130e20 0x7f73b01312a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:34.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.954+0000 7f73a7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73b0130e20 0x7f73b01312a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57042/0 (socket says 172.21.15.72:57042) 2023-07-27T20:32:34.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.954+0000 7f73a7fff700 1 -- 172.21.15.72:0/406104592 learned_addr learned my addr 172.21.15.72:0/406104592 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:34.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.954+0000 7f73af7fe700 1 --2- 172.21.15.72:0/406104592 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f739c004d90 0x7f73b00c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:34.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.954+0000 7f73affff700 1 --2- 172.21.15.72:0/406104592 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73b01eaf40 0x7f73b01eb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:34.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.954+0000 7f73a7fff700 1 -- 172.21.15.72:0/406104592 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f739c004d90 msgr2=0x7f73b00c2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:34.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.954+0000 7f73a7fff700 1 --2- 172.21.15.72:0/406104592 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f739c004d90 0x7f73b00c2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:34.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.954+0000 7f73a7fff700 1 -- 172.21.15.72:0/406104592 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73b01eaf40 msgr2=0x7f73b01eb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:34.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.954+0000 7f73a7fff700 1 --2- 172.21.15.72:0/406104592 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73b01eaf40 0x7f73b01eb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:34.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.954+0000 7f73a7fff700 1 -- 172.21.15.72:0/406104592 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b0132300 con 0x7f73b0130e20 2023-07-27T20:32:34.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.954+0000 7f73a7fff700 1 --2- 172.21.15.72:0/406104592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73b0130e20 0x7f73b01312a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7398007310 tx=0x7f7398007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:34.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.955+0000 7f73acff9700 1 -- 172.21.15.72:0/406104592 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7398012560 con 0x7f73b0130e20 2023-07-27T20:32:34.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.955+0000 7f73acff9700 1 -- 172.21.15.72:0/406104592 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73980126c0 con 0x7f73b0130e20 2023-07-27T20:32:34.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.955+0000 7f73acff9700 1 -- 172.21.15.72:0/406104592 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7398012a70 con 0x7f73b0130e20 2023-07-27T20:32:34.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.955+0000 7f73b5dff700 1 -- 172.21.15.72:0/406104592 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73b01335d0 con 0x7f73b0130e20 2023-07-27T20:32:34.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.955+0000 7f73b5dff700 1 -- 172.21.15.72:0/406104592 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73b01325c0 con 0x7f73b0130e20 2023-07-27T20:32:34.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.956+0000 7f73b5dff700 1 -- 172.21.15.72:0/406104592 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73b0074310 con 0x7f73b0130e20 2023-07-27T20:32:34.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.957+0000 7f73acff9700 1 -- 172.21.15.72:0/406104592 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7398012bd0 con 0x7f73b0130e20 2023-07-27T20:32:34.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.958+0000 7f73acff9700 1 --2- 172.21.15.72:0/406104592 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f739006ad10 0x7f739006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:34.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.958+0000 7f73acff9700 1 -- 172.21.15.72:0/406104592 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7398089610 con 0x7f73b0130e20 2023-07-27T20:32:34.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.958+0000 7f73af7fe700 1 --2- 172.21.15.72:0/406104592 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f739006ad10 0x7f739006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:34.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.959+0000 7f73af7fe700 1 --2- 172.21.15.72:0/406104592 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f739006ad10 0x7f739006d1d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f73a0009c60 tx=0x7f73a0009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:34.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:34.962+0000 7f73acff9700 1 -- 172.21.15.72:0/406104592 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7398057e10 con 0x7f73b0130e20 2023-07-27T20:32:35.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.172+0000 7f73b5dff700 1 -- 172.21.15.72:0/406104592 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f73b01317e0 con 0x7f73b0130e20 2023-07-27T20:32:35.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.172+0000 7f73acff9700 1 -- 172.21.15.72:0/406104592 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f73980579a0 con 0x7f73b0130e20 2023-07-27T20:32:35.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.174+0000 7f73b5dff700 1 -- 172.21.15.72:0/406104592 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f739006ad10 msgr2=0x7f739006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:35.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.174+0000 7f73b5dff700 1 --2- 172.21.15.72:0/406104592 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f739006ad10 0x7f739006d1d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f73a0009c60 tx=0x7f73a0009210 comp rx=0 tx=0).stop 2023-07-27T20:32:35.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.174+0000 7f73b5dff700 1 -- 172.21.15.72:0/406104592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73b0130e20 msgr2=0x7f73b01312a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:35.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.174+0000 7f73b5dff700 1 --2- 172.21.15.72:0/406104592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73b0130e20 0x7f73b01312a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7398007310 tx=0x7f7398007620 comp rx=0 tx=0).stop 2023-07-27T20:32:35.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.174+0000 7f73b5dff700 1 -- 172.21.15.72:0/406104592 shutdown_connections 2023-07-27T20:32:35.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.174+0000 7f73b5dff700 1 --2- 172.21.15.72:0/406104592 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73b01eaf40 0x7f73b01eb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:35.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.174+0000 7f73b5dff700 1 --2- 172.21.15.72:0/406104592 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f739006ad10 0x7f739006d1d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:35.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.174+0000 7f73b5dff700 1 --2- 172.21.15.72:0/406104592 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f739c004d90 0x7f73b00c2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:35.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.174+0000 7f73b5dff700 1 --2- 172.21.15.72:0/406104592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73b0130e20 0x7f73b01312a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:35.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.174+0000 7f73b5dff700 1 -- 172.21.15.72:0/406104592 >> 172.21.15.72:0/406104592 conn(0x7f73b006a190 msgr2=0x7f73b006a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:35.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.175+0000 7f73b5dff700 1 -- 172.21.15.72:0/406104592 shutdown_connections 2023-07-27T20:32:35.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.175+0000 7f73b5dff700 1 -- 172.21.15.72:0/406104592 wait complete. 2023-07-27T20:32:35.166 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-07-27T20:32:35.180 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi072.front.sepia.ceph.com... 2023-07-27T20:32:35.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:32:35.181 DEBUG:teuthology.orchestra.run.smithi072:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-07-27T20:32:35.249 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T20:32:35.250 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2023-07-27T20:32:35.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:32:35.251 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-27T20:32:35.297 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-07-27T20:32:35.298 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-27T20:32:35.350 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-07-27T20:32:35.351 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-27T20:32:35.400 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:32:35.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.607+0000 7f0a8d7ff700 1 Processor -- start 2023-07-27T20:32:35.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.607+0000 7f0a8d7ff700 1 -- start start 2023-07-27T20:32:35.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.608+0000 7f0a8d7ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0a8806b520 0x7f0a880a8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:35.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.608+0000 7f0a8d7ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0a8806b900 0x7f0a88154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:35.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.609+0000 7f0a8d7ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a8806bd90 con 0x7f0a8806ef00 2023-07-27T20:32:35.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.609+0000 7f0a8d7ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a880c1850 con 0x7f0a8806b520 2023-07-27T20:32:35.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.609+0000 7f0a8d7ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a8806e270 con 0x7f0a8806b900 2023-07-27T20:32:35.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.609+0000 7f0a86ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0a8806b520 0x7f0a880a8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:35.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.609+0000 7f0a86ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0a8806b520 0x7f0a880a8de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57044/0 (socket says 172.21.15.72:57044) 2023-07-27T20:32:35.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.609+0000 7f0a86ffd700 1 -- 172.21.15.72:0/671036810 learned_addr learned my addr 172.21.15.72:0/671036810 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:35.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.609+0000 7f0a877fe700 1 --2- 172.21.15.72:0/671036810 >> v2:172.21.15.173:3300/0 conn(0x7f0a8806b900 0x7f0a88154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:35.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.609+0000 7f0a86ffd700 1 -- 172.21.15.72:0/671036810 >> v2:172.21.15.173:3300/0 conn(0x7f0a8806b900 msgr2=0x7f0a88154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:35.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.609+0000 7f0a86ffd700 1 --2- 172.21.15.72:0/671036810 >> v2:172.21.15.173:3300/0 conn(0x7f0a8806b900 0x7f0a88154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:35.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.609+0000 7f0a86ffd700 1 -- 172.21.15.72:0/671036810 >> v1:172.21.15.173:6789/0 conn(0x7f0a8806ef00 legacy=0x7f0a88158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:35.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.609+0000 7f0a86ffd700 1 -- 172.21.15.72:0/671036810 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8806e7a0 con 0x7f0a8806b520 2023-07-27T20:32:35.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.609+0000 7f0a877fe700 1 --2- 172.21.15.72:0/671036810 >> v2:172.21.15.173:3300/0 conn(0x7f0a8806b900 0x7f0a88154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:32:35.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.610+0000 7f0a86ffd700 1 --2- 172.21.15.72:0/671036810 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a8806b520 0x7f0a880a8de0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0a880c0a80 tx=0x7f0a78009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a5c89db794c8f3c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:35.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.610+0000 7f0a867fc700 1 -- 172.21.15.72:0/671036810 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a78004230 con 0x7f0a8806b520 2023-07-27T20:32:35.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.610+0000 7f0a867fc700 1 -- 172.21.15.72:0/671036810 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a78004390 con 0x7f0a8806b520 2023-07-27T20:32:35.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.610+0000 7f0a867fc700 1 -- 172.21.15.72:0/671036810 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a780036a0 con 0x7f0a8806b520 2023-07-27T20:32:35.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.610+0000 7f0a8d7ff700 1 -- 172.21.15.72:0/671036810 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a8806b520 msgr2=0x7f0a880a8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:35.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.610+0000 7f0a8d7ff700 1 --2- 172.21.15.72:0/671036810 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a8806b520 0x7f0a880a8de0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0a880c0a80 tx=0x7f0a78009bd0 comp rx=0 tx=0).stop 2023-07-27T20:32:35.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.610+0000 7f0a8d7ff700 1 -- 172.21.15.72:0/671036810 shutdown_connections 2023-07-27T20:32:35.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.610+0000 7f0a8d7ff700 1 --2- 172.21.15.72:0/671036810 >> v2:172.21.15.173:3300/0 conn(0x7f0a8806b900 0x7f0a88154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:35.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.610+0000 7f0a8d7ff700 1 --2- 172.21.15.72:0/671036810 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a8806b520 0x7f0a880a8de0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:35.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.610+0000 7f0a8d7ff700 1 -- 172.21.15.72:0/671036810 >> 172.21.15.72:0/671036810 conn(0x7f0a880c6800 msgr2=0x7f0a880c6c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:35.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.610+0000 7f0a8d7ff700 1 -- 172.21.15.72:0/671036810 shutdown_connections 2023-07-27T20:32:35.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.610+0000 7f0a8d7ff700 1 -- 172.21.15.72:0/671036810 wait complete. 2023-07-27T20:32:35.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.612+0000 7f0a8d7ff700 1 Processor -- start 2023-07-27T20:32:35.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.612+0000 7f0a8d7ff700 1 -- start start 2023-07-27T20:32:35.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.613+0000 7f0a8d7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a8806b520 0x7f0a880aa730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:35.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.613+0000 7f0a8d7ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0a8806b900 0x7f0a881e6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:35.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.613+0000 7f0a8d7ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a8806ef00 0x7f0a881ecbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:35.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.613+0000 7f0a8d7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a880ac6f0 con 0x7f0a8806b520 2023-07-27T20:32:35.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.613+0000 7f0a8d7ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a881516c0 con 0x7f0a8806ef00 2023-07-27T20:32:35.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.613+0000 7f0a8d7ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a880a9d40 con 0x7f0a8806b900 2023-07-27T20:32:35.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.613+0000 7f0a86ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a8806b520 0x7f0a880aa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:35.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.613+0000 7f0a86ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a8806b520 0x7f0a880aa730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57052/0 (socket says 172.21.15.72:57052) 2023-07-27T20:32:35.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.613+0000 7f0a86ffd700 1 -- 172.21.15.72:0/1006577283 learned_addr learned my addr 172.21.15.72:0/1006577283 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:35.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.613+0000 7f0a877fe700 1 --2- 172.21.15.72:0/1006577283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a8806ef00 0x7f0a881ecbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:35.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.613+0000 7f0a7ffff700 1 --2- 172.21.15.72:0/1006577283 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0a8806b900 0x7f0a881e6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:35.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.614+0000 7f0a86ffd700 1 -- 172.21.15.72:0/1006577283 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0a8806b900 msgr2=0x7f0a881e6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:35.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.614+0000 7f0a86ffd700 1 --2- 172.21.15.72:0/1006577283 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0a8806b900 0x7f0a881e6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:35.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.614+0000 7f0a86ffd700 1 -- 172.21.15.72:0/1006577283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a8806ef00 msgr2=0x7f0a881ecbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:35.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.614+0000 7f0a86ffd700 1 --2- 172.21.15.72:0/1006577283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a8806ef00 0x7f0a881ecbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:35.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.614+0000 7f0a86ffd700 1 -- 172.21.15.72:0/1006577283 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a78009550 con 0x7f0a8806b520 2023-07-27T20:32:35.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.614+0000 7f0a86ffd700 1 --2- 172.21.15.72:0/1006577283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a8806b520 0x7f0a880aa730 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0a880bf970 tx=0x7f0a78004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:35.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.614+0000 7f0a7f7fe700 1 -- 172.21.15.72:0/1006577283 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a78003dc0 con 0x7f0a8806b520 2023-07-27T20:32:35.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.614+0000 7f0a7f7fe700 1 -- 172.21.15.72:0/1006577283 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7801f070 con 0x7f0a8806b520 2023-07-27T20:32:35.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.614+0000 7f0a8d7ff700 1 -- 172.21.15.72:0/1006577283 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a880aac70 con 0x7f0a8806b520 2023-07-27T20:32:35.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.614+0000 7f0a7f7fe700 1 -- 172.21.15.72:0/1006577283 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a78011870 con 0x7f0a8806b520 2023-07-27T20:32:35.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.614+0000 7f0a8d7ff700 1 -- 172.21.15.72:0/1006577283 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a880ac130 con 0x7f0a8806b520 2023-07-27T20:32:35.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.615+0000 7f0a8d7ff700 1 -- 172.21.15.72:0/1006577283 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a88074310 con 0x7f0a8806b520 2023-07-27T20:32:35.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.616+0000 7f0a7f7fe700 1 -- 172.21.15.72:0/1006577283 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0a78021030 con 0x7f0a8806b520 2023-07-27T20:32:35.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.617+0000 7f0a7f7fe700 1 --2- 172.21.15.72:0/1006577283 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0a6806ace0 0x7f0a6806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:35.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.617+0000 7f0a7f7fe700 1 -- 172.21.15.72:0/1006577283 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0a7808ad80 con 0x7f0a8806b520 2023-07-27T20:32:35.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.618+0000 7f0a7ffff700 1 --2- 172.21.15.72:0/1006577283 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0a6806ace0 0x7f0a6806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:35.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.618+0000 7f0a7ffff700 1 --2- 172.21.15.72:0/1006577283 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0a6806ace0 0x7f0a6806d1a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0a880ab030 tx=0x7f0a70008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:35.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.621+0000 7f0a7f7fe700 1 -- 172.21.15.72:0/1006577283 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0a78055af0 con 0x7f0a8806b520 2023-07-27T20:32:35.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.818+0000 7f0a8d7ff700 1 -- 172.21.15.72:0/1006577283 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a8806bd90 con 0x7f0a8806b520 2023-07-27T20:32:35.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.820+0000 7f0a7f7fe700 1 -- 172.21.15.72:0/1006577283 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20215 (secure 0 0 0) 0x7f0a8806bd90 con 0x7f0a8806b520 2023-07-27T20:32:35.807 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:32:35.808 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":29,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:32:10.402254+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:31:27.020951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T20:31:27.566022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-27T20:31:31.182401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:32:35.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.822+0000 7f0a8d7ff700 1 -- 172.21.15.72:0/1006577283 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0a6806ace0 msgr2=0x7f0a6806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:35.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.822+0000 7f0a8d7ff700 1 --2- 172.21.15.72:0/1006577283 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0a6806ace0 0x7f0a6806d1a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0a880ab030 tx=0x7f0a70008040 comp rx=0 tx=0).stop 2023-07-27T20:32:35.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.822+0000 7f0a8d7ff700 1 -- 172.21.15.72:0/1006577283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a8806b520 msgr2=0x7f0a880aa730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:35.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.822+0000 7f0a8d7ff700 1 --2- 172.21.15.72:0/1006577283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a8806b520 0x7f0a880aa730 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0a880bf970 tx=0x7f0a78004750 comp rx=0 tx=0).stop 2023-07-27T20:32:35.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.822+0000 7f0a8d7ff700 1 -- 172.21.15.72:0/1006577283 shutdown_connections 2023-07-27T20:32:35.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.822+0000 7f0a8d7ff700 1 --2- 172.21.15.72:0/1006577283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a8806ef00 0x7f0a881ecbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:35.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.822+0000 7f0a8d7ff700 1 --2- 172.21.15.72:0/1006577283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a8806b520 0x7f0a880aa730 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:35.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.822+0000 7f0a8d7ff700 1 --2- 172.21.15.72:0/1006577283 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0a6806ace0 0x7f0a6806d1a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:35.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.822+0000 7f0a8d7ff700 1 --2- 172.21.15.72:0/1006577283 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0a8806b900 0x7f0a881e6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:35.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.822+0000 7f0a8d7ff700 1 -- 172.21.15.72:0/1006577283 >> 172.21.15.72:0/1006577283 conn(0x7f0a880c6800 msgr2=0x7f0a880c2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:35.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.822+0000 7f0a8d7ff700 1 -- 172.21.15.72:0/1006577283 shutdown_connections 2023-07-27T20:32:35.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:35.822+0000 7f0a8d7ff700 1 -- 172.21.15.72:0/1006577283 wait complete. 2023-07-27T20:32:35.828 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-27T20:31:14.581785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T20:31:21.077941+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T20:31:27.020951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T20:31:27.566022+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-27T20:31:31.182401+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-27T20:32:35.829 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-27T20:32:36.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.040+0000 7f28c49ff700 1 Processor -- start 2023-07-27T20:32:36.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.040+0000 7f28c49ff700 1 -- start start 2023-07-27T20:32:36.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.041+0000 7f28c49ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f28c014aab0 0x7f28c0154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:36.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.041+0000 7f28c49ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f28c00c7740 0x7f28c00c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:36.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.041+0000 7f28c49ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28c00c7c50 con 0x7f28c00c4700 2023-07-27T20:32:36.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.041+0000 7f28c49ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28c006bd40 con 0x7f28c00c7740 2023-07-27T20:32:36.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.041+0000 7f28c49ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28c00c62f0 con 0x7f28c014aab0 2023-07-27T20:32:36.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.041+0000 7f28bdd9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f28c00c7740 0x7f28c00c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:36.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.041+0000 7f28bdd9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f28c00c7740 0x7f28c00c41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57056/0 (socket says 172.21.15.72:57056) 2023-07-27T20:32:36.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.041+0000 7f28bdd9b700 1 -- 172.21.15.72:0/1299755574 learned_addr learned my addr 172.21.15.72:0/1299755574 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:36.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.042+0000 7f28be59c700 1 --2- 172.21.15.72:0/1299755574 >> v2:172.21.15.173:3300/0 conn(0x7f28c014aab0 0x7f28c0154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:36.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.042+0000 7f28bdd9b700 1 -- 172.21.15.72:0/1299755574 >> v2:172.21.15.173:3300/0 conn(0x7f28c014aab0 msgr2=0x7f28c0154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:36.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.042+0000 7f28bdd9b700 1 --2- 172.21.15.72:0/1299755574 >> v2:172.21.15.173:3300/0 conn(0x7f28c014aab0 0x7f28c0154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:36.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.042+0000 7f28bdd9b700 1 -- 172.21.15.72:0/1299755574 >> v1:172.21.15.72:6789/0 conn(0x7f28c00c4700 legacy=0x7f28c006c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:36.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.042+0000 7f28bdd9b700 1 -- 172.21.15.72:0/1299755574 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c0155050 con 0x7f28c00c7740 2023-07-27T20:32:36.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.042+0000 7f28bd59a700 1 -- 172.21.15.72:0/1299755574 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3719028253 0 0) 0x7f28c00c7c50 con 0x7f28c00c4700 2023-07-27T20:32:36.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.042+0000 7f28bdd9b700 1 --2- 172.21.15.72:0/1299755574 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28c00c7740 0x7f28c00c41c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f28c006ad20 tx=0x7f28b4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=300b265e17dbe5c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:36.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.042+0000 7f28bd59a700 1 -- 172.21.15.72:0/1299755574 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b400b870 con 0x7f28c00c7740 2023-07-27T20:32:36.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.042+0000 7f28bd59a700 1 -- 172.21.15.72:0/1299755574 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b400b9d0 con 0x7f28c00c7740 2023-07-27T20:32:36.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.042+0000 7f28bd59a700 1 -- 172.21.15.72:0/1299755574 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b400bd60 con 0x7f28c00c7740 2023-07-27T20:32:36.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.043+0000 7f28c49ff700 1 -- 172.21.15.72:0/1299755574 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28c00c7740 msgr2=0x7f28c00c41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:36.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.043+0000 7f28c49ff700 1 --2- 172.21.15.72:0/1299755574 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28c00c7740 0x7f28c00c41c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f28c006ad20 tx=0x7f28b4009bd0 comp rx=0 tx=0).stop 2023-07-27T20:32:36.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.043+0000 7f28c49ff700 1 -- 172.21.15.72:0/1299755574 shutdown_connections 2023-07-27T20:32:36.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.043+0000 7f28c49ff700 1 --2- 172.21.15.72:0/1299755574 >> v2:172.21.15.173:3300/0 conn(0x7f28c014aab0 0x7f28c0154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:36.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.043+0000 7f28c49ff700 1 --2- 172.21.15.72:0/1299755574 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28c00c7740 0x7f28c00c41c0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:36.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.043+0000 7f28c49ff700 1 -- 172.21.15.72:0/1299755574 >> 172.21.15.72:0/1299755574 conn(0x7f28c00ab3f0 msgr2=0x7f28c00ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:36.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.043+0000 7f28c49ff700 1 -- 172.21.15.72:0/1299755574 shutdown_connections 2023-07-27T20:32:36.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.043+0000 7f28c49ff700 1 -- 172.21.15.72:0/1299755574 wait complete. 2023-07-27T20:32:36.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.045+0000 7f28c49ff700 1 Processor -- start 2023-07-27T20:32:36.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.045+0000 7f28c49ff700 1 -- start start 2023-07-27T20:32:36.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.046+0000 7f28c49ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f28c00c4700 0x7f28c01ea210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:36.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.046+0000 7f28c49ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28c00c7740 0x7f28c01ed710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:36.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.046+0000 7f28c49ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f28c014aab0 0x7f28c00c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:36.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.046+0000 7f28c49ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c01ea750 con 0x7f28c00c7740 2023-07-27T20:32:36.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.046+0000 7f28c49ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c01edc50 con 0x7f28c014aab0 2023-07-27T20:32:36.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.046+0000 7f28c49ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c01e9750 con 0x7f28c00c4700 2023-07-27T20:32:36.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.046+0000 7f28bdd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28c00c7740 0x7f28c01ed710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:36.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.046+0000 7f28bdd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28c00c7740 0x7f28c01ed710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57064/0 (socket says 172.21.15.72:57064) 2023-07-27T20:32:36.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.046+0000 7f28be59c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f28c00c4700 0x7f28c01ea210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:36.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.046+0000 7f28bdd9b700 1 -- 172.21.15.72:0/1526876191 learned_addr learned my addr 172.21.15.72:0/1526876191 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:36.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.046+0000 7f28bed9d700 1 --2- 172.21.15.72:0/1526876191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f28c014aab0 0x7f28c00c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:36.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.046+0000 7f28bdd9b700 1 -- 172.21.15.72:0/1526876191 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f28c00c4700 msgr2=0x7f28c01ea210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:36.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.046+0000 7f28bdd9b700 1 --2- 172.21.15.72:0/1526876191 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f28c00c4700 0x7f28c01ea210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:36.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.046+0000 7f28bdd9b700 1 -- 172.21.15.72:0/1526876191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f28c014aab0 msgr2=0x7f28c00c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:36.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.046+0000 7f28bdd9b700 1 --2- 172.21.15.72:0/1526876191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f28c014aab0 0x7f28c00c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:36.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.046+0000 7f28bdd9b700 1 -- 172.21.15.72:0/1526876191 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b4009550 con 0x7f28c00c7740 2023-07-27T20:32:36.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.046+0000 7f28bed9d700 1 --2- 172.21.15.72:0/1526876191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f28c014aab0 0x7f28c00c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:36.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.047+0000 7f28bdd9b700 1 --2- 172.21.15.72:0/1526876191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28c00c7740 0x7f28c01ed710 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f28b4009c10 tx=0x7f28b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:36.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.047+0000 7f28aeffd700 1 -- 172.21.15.72:0/1526876191 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b4004250 con 0x7f28c00c7740 2023-07-27T20:32:36.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.047+0000 7f28aeffd700 1 -- 172.21.15.72:0/1526876191 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b401f070 con 0x7f28c00c7740 2023-07-27T20:32:36.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.047+0000 7f28c49ff700 1 -- 172.21.15.72:0/1526876191 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28c014d160 con 0x7f28c00c7740 2023-07-27T20:32:36.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.047+0000 7f28aeffd700 1 -- 172.21.15.72:0/1526876191 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b40045d0 con 0x7f28c00c7740 2023-07-27T20:32:36.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.047+0000 7f28c49ff700 1 -- 172.21.15.72:0/1526876191 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c014d720 con 0x7f28c00c7740 2023-07-27T20:32:36.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.048+0000 7f28c49ff700 1 -- 172.21.15.72:0/1526876191 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c004e470 con 0x7f28c00c7740 2023-07-27T20:32:36.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.049+0000 7f28aeffd700 1 -- 172.21.15.72:0/1526876191 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f28b4021030 con 0x7f28c00c7740 2023-07-27T20:32:36.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.050+0000 7f28aeffd700 1 --2- 172.21.15.72:0/1526876191 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f28a006ace0 0x7f28a006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:36.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.050+0000 7f28aeffd700 1 -- 172.21.15.72:0/1526876191 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f28b408ab20 con 0x7f28c00c7740 2023-07-27T20:32:36.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.050+0000 7f28be59c700 1 --2- 172.21.15.72:0/1526876191 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f28a006ace0 0x7f28a006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:36.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.051+0000 7f28be59c700 1 --2- 172.21.15.72:0/1526876191 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f28a006ace0 0x7f28a006d1a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f28b0006b20 tx=0x7f28b0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:36.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.054+0000 7f28aeffd700 1 -- 172.21.15.72:0/1526876191 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f28b4055890 con 0x7f28c00c7740 2023-07-27T20:32:36.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.249+0000 7f28c49ff700 1 -- 172.21.15.72:0/1526876191 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f28c006cf00 con 0x7f28c00c7740 2023-07-27T20:32:36.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.249+0000 7f28aeffd700 1 -- 172.21.15.72:0/1526876191 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f28b4058eb0 con 0x7f28c00c7740 2023-07-27T20:32:36.237 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-27T20:32:36.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.251+0000 7f28c49ff700 1 -- 172.21.15.72:0/1526876191 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f28a006ace0 msgr2=0x7f28a006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:36.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.251+0000 7f28c49ff700 1 --2- 172.21.15.72:0/1526876191 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f28a006ace0 0x7f28a006d1a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f28b0006b20 tx=0x7f28b0008040 comp rx=0 tx=0).stop 2023-07-27T20:32:36.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.251+0000 7f28c49ff700 1 -- 172.21.15.72:0/1526876191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28c00c7740 msgr2=0x7f28c01ed710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:36.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.251+0000 7f28c49ff700 1 --2- 172.21.15.72:0/1526876191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28c00c7740 0x7f28c01ed710 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f28b4009c10 tx=0x7f28b4004750 comp rx=0 tx=0).stop 2023-07-27T20:32:36.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.252+0000 7f28c49ff700 1 -- 172.21.15.72:0/1526876191 shutdown_connections 2023-07-27T20:32:36.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.252+0000 7f28c49ff700 1 --2- 172.21.15.72:0/1526876191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f28c014aab0 0x7f28c00c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:36.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.252+0000 7f28c49ff700 1 --2- 172.21.15.72:0/1526876191 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f28a006ace0 0x7f28a006d1a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:36.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.252+0000 7f28c49ff700 1 --2- 172.21.15.72:0/1526876191 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f28c00c4700 0x7f28c01ea210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:36.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.252+0000 7f28c49ff700 1 --2- 172.21.15.72:0/1526876191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28c00c7740 0x7f28c01ed710 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:36.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.252+0000 7f28c49ff700 1 -- 172.21.15.72:0/1526876191 >> 172.21.15.72:0/1526876191 conn(0x7f28c00ab3f0 msgr2=0x7f28c0152600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:36.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.252+0000 7f28c49ff700 1 -- 172.21.15.72:0/1526876191 shutdown_connections 2023-07-27T20:32:36.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.252+0000 7f28c49ff700 1 -- 172.21.15.72:0/1526876191 wait complete. 2023-07-27T20:32:36.257 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T20:32:36.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.467+0000 7f44ef1ff700 1 Processor -- start 2023-07-27T20:32:36.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.467+0000 7f44ef1ff700 1 -- start start 2023-07-27T20:32:36.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.469+0000 7f44ef1ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44e81475a0 0x7f44e81516c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:36.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.469+0000 7f44ef1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f44e80c12f0 0x7f44e80c1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:36.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.469+0000 7f44ef1ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f44e80c2240 0x7f44e80716f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:36.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.469+0000 7f44ef1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e8151c00 con 0x7f44e80c12f0 2023-07-27T20:32:36.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.469+0000 7f44ef1ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e8154f50 con 0x7f44e80c2240 2023-07-27T20:32:36.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.469+0000 7f44ef1ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e8154340 con 0x7f44e81475a0 2023-07-27T20:32:36.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.469+0000 7f44e7fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f44e80c12f0 0x7f44e80c1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:36.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.469+0000 7f44e7fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f44e80c12f0 0x7f44e80c1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57078/0 (socket says 172.21.15.72:57078) 2023-07-27T20:32:36.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.469+0000 7f44e7fff700 1 -- 172.21.15.72:0/77089964 learned_addr learned my addr 172.21.15.72:0/77089964 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:36.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.469+0000 7f44ed79c700 1 --2- 172.21.15.72:0/77089964 >> v2:172.21.15.173:3300/0 conn(0x7f44e80c2240 0x7f44e80716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:36.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.469+0000 7f44ecf9b700 1 --2- 172.21.15.72:0/77089964 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44e81475a0 0x7f44e81516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:36.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.469+0000 7f44e7fff700 1 -- 172.21.15.72:0/77089964 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44e81475a0 msgr2=0x7f44e81516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:36.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.469+0000 7f44e7fff700 1 --2- 172.21.15.72:0/77089964 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44e81475a0 0x7f44e81516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:36.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.469+0000 7f44e7fff700 1 -- 172.21.15.72:0/77089964 >> v2:172.21.15.173:3300/0 conn(0x7f44e80c2240 msgr2=0x7f44e80716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:36.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.469+0000 7f44e7fff700 1 --2- 172.21.15.72:0/77089964 >> v2:172.21.15.173:3300/0 conn(0x7f44e80c2240 0x7f44e80716f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:36.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.469+0000 7f44e7fff700 1 -- 172.21.15.72:0/77089964 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e8154620 con 0x7f44e80c12f0 2023-07-27T20:32:36.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.469+0000 7f44ed79c700 1 --2- 172.21.15.72:0/77089964 >> v2:172.21.15.173:3300/0 conn(0x7f44e80c2240 0x7f44e80716f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:32:36.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.469+0000 7f44ecf9b700 1 --2- 172.21.15.72:0/77089964 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44e81475a0 0x7f44e81516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:32:36.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.470+0000 7f44e7fff700 1 --2- 172.21.15.72:0/77089964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44e80c12f0 0x7f44e80c1d00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f44e806e620 tx=0x7f44d4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824b1cb9996b8b50 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:36.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.470+0000 7f44e77fe700 1 -- 172.21.15.72:0/77089964 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d400b870 con 0x7f44e80c12f0 2023-07-27T20:32:36.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.470+0000 7f44e77fe700 1 -- 172.21.15.72:0/77089964 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d400b9d0 con 0x7f44e80c12f0 2023-07-27T20:32:36.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.470+0000 7f44e77fe700 1 -- 172.21.15.72:0/77089964 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d400bd60 con 0x7f44e80c12f0 2023-07-27T20:32:36.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.470+0000 7f44ef1ff700 1 -- 172.21.15.72:0/77089964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44e80c12f0 msgr2=0x7f44e80c1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:36.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.470+0000 7f44ef1ff700 1 --2- 172.21.15.72:0/77089964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44e80c12f0 0x7f44e80c1d00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f44e806e620 tx=0x7f44d4009bd0 comp rx=0 tx=0).stop 2023-07-27T20:32:36.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.471+0000 7f44ef1ff700 1 -- 172.21.15.72:0/77089964 shutdown_connections 2023-07-27T20:32:36.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.471+0000 7f44ef1ff700 1 --2- 172.21.15.72:0/77089964 >> v2:172.21.15.173:3300/0 conn(0x7f44e80c2240 0x7f44e80716f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:36.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.471+0000 7f44ef1ff700 1 --2- 172.21.15.72:0/77089964 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44e81475a0 0x7f44e81516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:36.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.471+0000 7f44ef1ff700 1 --2- 172.21.15.72:0/77089964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44e80c12f0 0x7f44e80c1d00 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:36.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.471+0000 7f44ef1ff700 1 -- 172.21.15.72:0/77089964 >> 172.21.15.72:0/77089964 conn(0x7f44e806a190 msgr2=0x7f44e806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:36.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.471+0000 7f44ef1ff700 1 -- 172.21.15.72:0/77089964 shutdown_connections 2023-07-27T20:32:36.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.471+0000 7f44ef1ff700 1 -- 172.21.15.72:0/77089964 wait complete. 2023-07-27T20:32:36.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.472+0000 7f44ef1ff700 1 Processor -- start 2023-07-27T20:32:36.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.472+0000 7f44ef1ff700 1 -- start start 2023-07-27T20:32:36.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.473+0000 7f44ef1ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44e80c12f0 0x7f44e80bc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:36.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.473+0000 7f44ef1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44e80c2240 0x7f44e8150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:36.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.473+0000 7f44ef1ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44e81475a0 0x7f44e80bea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:36.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.473+0000 7f44ef1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e813fff0 con 0x7f44e80c2240 2023-07-27T20:32:36.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.473+0000 7f44ef1ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e80bcf10 con 0x7f44e81475a0 2023-07-27T20:32:36.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.473+0000 7f44ef1ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e8151820 con 0x7f44e80c12f0 2023-07-27T20:32:36.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.474+0000 7f44e7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44e80c2240 0x7f44e8150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:36.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.474+0000 7f44e7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44e80c2240 0x7f44e8150390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57086/0 (socket says 172.21.15.72:57086) 2023-07-27T20:32:36.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.474+0000 7f44e7fff700 1 -- 172.21.15.72:0/2761182105 learned_addr learned my addr 172.21.15.72:0/2761182105 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:36.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.474+0000 7f44ed79c700 1 --2- 172.21.15.72:0/2761182105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44e81475a0 0x7f44e80bea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:36.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.474+0000 7f44ecf9b700 1 --2- 172.21.15.72:0/2761182105 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44e80c12f0 0x7f44e80bc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:36.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.474+0000 7f44e7fff700 1 -- 172.21.15.72:0/2761182105 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44e80c12f0 msgr2=0x7f44e80bc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:36.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.474+0000 7f44e7fff700 1 --2- 172.21.15.72:0/2761182105 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44e80c12f0 0x7f44e80bc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:36.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.474+0000 7f44e7fff700 1 -- 172.21.15.72:0/2761182105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44e81475a0 msgr2=0x7f44e80bea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:36.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.474+0000 7f44e7fff700 1 --2- 172.21.15.72:0/2761182105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44e81475a0 0x7f44e80bea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:36.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.474+0000 7f44e7fff700 1 -- 172.21.15.72:0/2761182105 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d4009550 con 0x7f44e80c2240 2023-07-27T20:32:36.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.474+0000 7f44ed79c700 1 --2- 172.21.15.72:0/2761182105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44e81475a0 0x7f44e80bea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:36.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.474+0000 7f44e7fff700 1 --2- 172.21.15.72:0/2761182105 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44e80c2240 0x7f44e8150390 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f44d4014040 tx=0x7f44d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:36.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.474+0000 7f44e57fa700 1 -- 172.21.15.72:0/2761182105 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d4004520 con 0x7f44e80c2240 2023-07-27T20:32:36.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.475+0000 7f44e57fa700 1 -- 172.21.15.72:0/2761182105 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d401e070 con 0x7f44e80c2240 2023-07-27T20:32:36.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.475+0000 7f44ef1ff700 1 -- 172.21.15.72:0/2761182105 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44e80bca40 con 0x7f44e80c2240 2023-07-27T20:32:36.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.475+0000 7f44e57fa700 1 -- 172.21.15.72:0/2761182105 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d40038e0 con 0x7f44e80c2240 2023-07-27T20:32:36.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.475+0000 7f44ef1ff700 1 -- 172.21.15.72:0/2761182105 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e81508d0 con 0x7f44e80c2240 2023-07-27T20:32:36.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.476+0000 7f44ef1ff700 1 -- 172.21.15.72:0/2761182105 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44e804e470 con 0x7f44e80c2240 2023-07-27T20:32:36.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.476+0000 7f44e57fa700 1 -- 172.21.15.72:0/2761182105 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f44d4003a40 con 0x7f44e80c2240 2023-07-27T20:32:36.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.478+0000 7f44e57fa700 1 --2- 172.21.15.72:0/2761182105 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f44cc06ace0 0x7f44cc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:36.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.478+0000 7f44e57fa700 1 -- 172.21.15.72:0/2761182105 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f44d4020070 con 0x7f44e80c2240 2023-07-27T20:32:36.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.479+0000 7f44ecf9b700 1 --2- 172.21.15.72:0/2761182105 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f44cc06ace0 0x7f44cc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:36.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.479+0000 7f44ecf9b700 1 --2- 172.21.15.72:0/2761182105 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f44cc06ace0 0x7f44cc06d1a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f44dc006fd0 tx=0x7f44dc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:36.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.483+0000 7f44e57fa700 1 -- 172.21.15.72:0/2761182105 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f44d4055c30 con 0x7f44e80c2240 2023-07-27T20:32:36.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.675+0000 7f44ef1ff700 1 -- 172.21.15.72:0/2761182105 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f44e81515f0 con 0x7f44e80c2240 2023-07-27T20:32:36.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.675+0000 7f44e57fa700 1 -- 172.21.15.72:0/2761182105 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f44d40150a0 con 0x7f44e80c2240 2023-07-27T20:32:36.664 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-27T20:32:36.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.678+0000 7f44ef1ff700 1 -- 172.21.15.72:0/2761182105 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f44cc06ace0 msgr2=0x7f44cc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:36.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.678+0000 7f44ef1ff700 1 --2- 172.21.15.72:0/2761182105 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f44cc06ace0 0x7f44cc06d1a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f44dc006fd0 tx=0x7f44dc008040 comp rx=0 tx=0).stop 2023-07-27T20:32:36.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.678+0000 7f44ef1ff700 1 -- 172.21.15.72:0/2761182105 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44e80c2240 msgr2=0x7f44e8150390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:36.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.678+0000 7f44ef1ff700 1 --2- 172.21.15.72:0/2761182105 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44e80c2240 0x7f44e8150390 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f44d4014040 tx=0x7f44d4004750 comp rx=0 tx=0).stop 2023-07-27T20:32:36.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.678+0000 7f44ef1ff700 1 -- 172.21.15.72:0/2761182105 shutdown_connections 2023-07-27T20:32:36.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.678+0000 7f44ef1ff700 1 --2- 172.21.15.72:0/2761182105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44e81475a0 0x7f44e80bea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:36.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.678+0000 7f44ef1ff700 1 --2- 172.21.15.72:0/2761182105 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f44cc06ace0 0x7f44cc06d1a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:36.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.678+0000 7f44ef1ff700 1 --2- 172.21.15.72:0/2761182105 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44e80c12f0 0x7f44e80bc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:36.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.678+0000 7f44ef1ff700 1 --2- 172.21.15.72:0/2761182105 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44e80c2240 0x7f44e8150390 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:36.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.678+0000 7f44ef1ff700 1 -- 172.21.15.72:0/2761182105 >> 172.21.15.72:0/2761182105 conn(0x7f44e806a190 msgr2=0x7f44e80c5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:36.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.678+0000 7f44ef1ff700 1 -- 172.21.15.72:0/2761182105 shutdown_connections 2023-07-27T20:32:36.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.678+0000 7f44ef1ff700 1 -- 172.21.15.72:0/2761182105 wait complete. 2023-07-27T20:32:36.684 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T20:32:36.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.895+0000 7f61a11ff700 1 Processor -- start 2023-07-27T20:32:36.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.895+0000 7f61a11ff700 1 -- start start 2023-07-27T20:32:36.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.896+0000 7f61a11ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f619c0bbf20 0x7f619c06a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:36.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.896+0000 7f61a11ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f619c0c0760 con 0x7f619c06af00 2023-07-27T20:32:36.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.896+0000 7f61a11ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f619c1581f0 con 0x7f619c0c38d0 2023-07-27T20:32:36.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.896+0000 7f61a11ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f619c0a52e0 con 0x7f619c0bbf20 2023-07-27T20:32:36.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.896+0000 7f619b59e700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f619c06af00 0x7f619c15e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59048/0 (socket says 172.21.15.72:59048) 2023-07-27T20:32:36.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.896+0000 7f619b59e700 1 -- 172.21.15.72:0/1442475221 learned_addr learned my addr 172.21.15.72:0/1442475221 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:36.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.897+0000 7f6199d9b700 1 -- 172.21.15.72:0/1442475221 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2363140738 0 0) 0x7f619c0c0760 con 0x7f619c06af00 2023-07-27T20:32:36.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.897+0000 7f6199d9b700 1 -- 172.21.15.72:0/1442475221 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61840035b0 con 0x7f619c06af00 2023-07-27T20:32:36.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.897+0000 7f619ad9d700 1 --2- 172.21.15.72:0/1442475221 >> v2:172.21.15.173:3300/0 conn(0x7f619c0bbf20 0x7f619c06a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:36.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.897+0000 7f6199d9b700 1 -- 172.21.15.72:0/1442475221 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3461102424 0 0) 0x7f61840035b0 con 0x7f619c06af00 2023-07-27T20:32:36.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.897+0000 7f6199d9b700 1 -- 172.21.15.72:0/1442475221 >> v2:172.21.15.173:3300/0 conn(0x7f619c0bbf20 msgr2=0x7f619c06a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:36.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.897+0000 7f6199d9b700 1 --2- 172.21.15.72:0/1442475221 >> v2:172.21.15.173:3300/0 conn(0x7f619c0bbf20 0x7f619c06a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:36.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.897+0000 7f6199d9b700 1 -- 172.21.15.72:0/1442475221 >> v1:172.21.15.173:6789/0 conn(0x7f619c0c38d0 legacy=0x7f619c154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:36.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.897+0000 7f6199d9b700 1 -- 172.21.15.72:0/1442475221 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f619c0c03f0 con 0x7f619c06af00 2023-07-27T20:32:36.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.897+0000 7f6199d9b700 1 -- 172.21.15.72:0/1442475221 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f61940019f0 con 0x7f619c06af00 2023-07-27T20:32:36.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.897+0000 7f6199d9b700 1 -- 172.21.15.72:0/1442475221 >> v1:172.21.15.72:6789/0 conn(0x7f619c06af00 legacy=0x7f619c15e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:36.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.897+0000 7f6199d9b700 1 --2- 172.21.15.72:0/1442475221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6184003a50 0x7f6184003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:36.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.897+0000 7f6199d9b700 1 --2- 172.21.15.72:0/1442475221 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6184004850 0x7f6184004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:36.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.897+0000 7f6199d9b700 1 --2- 172.21.15.72:0/1442475221 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6184005210 0x7f618400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:36.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.897+0000 7f6199d9b700 1 -- 172.21.15.72:0/1442475221 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f619c0a52e0 con 0x7f6184005210 2023-07-27T20:32:36.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.897+0000 7f6199d9b700 1 -- 172.21.15.72:0/1442475221 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618400c110 con 0x7f6184003a50 2023-07-27T20:32:36.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.897+0000 7f6199d9b700 1 -- 172.21.15.72:0/1442475221 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f618400c2d0 con 0x7f6184004850 2023-07-27T20:32:36.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.898+0000 7f619b59e700 1 --2- 172.21.15.72:0/1442475221 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6184005210 0x7f618400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:36.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.898+0000 7f619a59c700 1 --2- 172.21.15.72:0/1442475221 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6184004850 0x7f6184004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:36.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.898+0000 7f619ad9d700 1 --2- 172.21.15.72:0/1442475221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6184003a50 0x7f6184003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:36.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.898+0000 7f619b59e700 1 -- 172.21.15.72:0/1442475221 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6184004850 msgr2=0x7f6184004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:36.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.898+0000 7f619b59e700 1 --2- 172.21.15.72:0/1442475221 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6184004850 0x7f6184004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:36.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.898+0000 7f619b59e700 1 -- 172.21.15.72:0/1442475221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6184003a50 msgr2=0x7f6184003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:36.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.898+0000 7f619b59e700 1 --2- 172.21.15.72:0/1442475221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6184003a50 0x7f6184003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:36.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.898+0000 7f619b59e700 1 -- 172.21.15.72:0/1442475221 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61840035b0 con 0x7f6184005210 2023-07-27T20:32:36.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.898+0000 7f619b59e700 1 -- 172.21.15.72:0/1442475221 reap_dead start 2023-07-27T20:32:36.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.898+0000 7f619b59e700 1 --2- 172.21.15.72:0/1442475221 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6184005210 0x7f618400ba10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f619400a760 tx=0x7f6184005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a088f5f8fd77f530 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:36.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.898+0000 7f6199d9b700 1 -- 172.21.15.72:0/1442475221 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619400a250 con 0x7f6184005210 2023-07-27T20:32:36.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.899+0000 7f6199d9b700 1 -- 172.21.15.72:0/1442475221 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61940072d0 con 0x7f6184005210 2023-07-27T20:32:36.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.899+0000 7f6199d9b700 1 -- 172.21.15.72:0/1442475221 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6194007680 con 0x7f6184005210 2023-07-27T20:32:36.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.899+0000 7f61a11ff700 1 -- 172.21.15.72:0/1442475221 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6184005210 msgr2=0x7f618400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:36.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.899+0000 7f61a11ff700 1 --2- 172.21.15.72:0/1442475221 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6184005210 0x7f618400ba10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f619400a760 tx=0x7f6184005880 comp rx=0 tx=0).stop 2023-07-27T20:32:36.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.899+0000 7f61a11ff700 1 -- 172.21.15.72:0/1442475221 shutdown_connections 2023-07-27T20:32:36.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.899+0000 7f61a11ff700 1 --2- 172.21.15.72:0/1442475221 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6184005210 0x7f618400ba10 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:36.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.899+0000 7f61a11ff700 1 -- 172.21.15.72:0/1442475221 >> 172.21.15.72:0/1442475221 conn(0x7f619c0c59d0 msgr2=0x7f619c0c5de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:36.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.899+0000 7f61a11ff700 1 -- 172.21.15.72:0/1442475221 shutdown_connections 2023-07-27T20:32:36.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.899+0000 7f61a11ff700 1 -- 172.21.15.72:0/1442475221 wait complete. 2023-07-27T20:32:36.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.901+0000 7f61a11ff700 1 Processor -- start 2023-07-27T20:32:36.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.901+0000 7f61a11ff700 1 -- start start 2023-07-27T20:32:36.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.902+0000 7f61a11ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6184005210 0x7f619c0ab630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:36.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.902+0000 7f61a11ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f619c0bdff0 0x7f619c0a9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:36.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.902+0000 7f61a11ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f619c0a9970 0x7f619c0a8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:36.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.902+0000 7f61a11ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f619c0ab180 con 0x7f619c0bdff0 2023-07-27T20:32:36.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.902+0000 7f61a11ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f619c0bebd0 con 0x7f619c0a9970 2023-07-27T20:32:36.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.902+0000 7f61a11ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f619c0be6a0 con 0x7f6184005210 2023-07-27T20:32:36.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.902+0000 7f619a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f619c0bdff0 0x7f619c0a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:36.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.902+0000 7f619a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f619c0bdff0 0x7f619c0a9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57100/0 (socket says 172.21.15.72:57100) 2023-07-27T20:32:36.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.902+0000 7f619a59c700 1 -- 172.21.15.72:0/1740316930 learned_addr learned my addr 172.21.15.72:0/1740316930 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:36.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.902+0000 7f619b59e700 1 --2- 172.21.15.72:0/1740316930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f619c0a9970 0x7f619c0a8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:36.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.902+0000 7f619ad9d700 1 --2- 172.21.15.72:0/1740316930 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6184005210 0x7f619c0ab630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:36.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.903+0000 7f619a59c700 1 -- 172.21.15.72:0/1740316930 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6184005210 msgr2=0x7f619c0ab630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:36.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.903+0000 7f619a59c700 1 --2- 172.21.15.72:0/1740316930 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6184005210 0x7f619c0ab630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:36.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.903+0000 7f619a59c700 1 -- 172.21.15.72:0/1740316930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f619c0a9970 msgr2=0x7f619c0a8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:36.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.903+0000 7f619a59c700 1 --2- 172.21.15.72:0/1740316930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f619c0a9970 0x7f619c0a8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:36.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.903+0000 7f619a59c700 1 -- 172.21.15.72:0/1740316930 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f619c0bee70 con 0x7f619c0bdff0 2023-07-27T20:32:36.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.903+0000 7f619a59c700 1 --2- 172.21.15.72:0/1740316930 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f619c0bdff0 0x7f619c0a9430 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f619000f820 tx=0x7f619000fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:36.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.903+0000 7f61837fe700 1 -- 172.21.15.72:0/1740316930 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61900052e0 con 0x7f619c0bdff0 2023-07-27T20:32:36.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.903+0000 7f61837fe700 1 -- 172.21.15.72:0/1740316930 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6190005440 con 0x7f619c0bdff0 2023-07-27T20:32:36.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.903+0000 7f61a11ff700 1 -- 172.21.15.72:0/1740316930 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f619c0bf150 con 0x7f619c0bdff0 2023-07-27T20:32:36.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.903+0000 7f61837fe700 1 -- 172.21.15.72:0/1740316930 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61900038a0 con 0x7f619c0bdff0 2023-07-27T20:32:36.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.903+0000 7f61a11ff700 1 -- 172.21.15.72:0/1740316930 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f619c071ee0 con 0x7f619c0bdff0 2023-07-27T20:32:36.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.904+0000 7f61a11ff700 1 -- 172.21.15.72:0/1740316930 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f619c0bf360 con 0x7f619c0bdff0 2023-07-27T20:32:36.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.905+0000 7f61837fe700 1 -- 172.21.15.72:0/1740316930 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6190003a00 con 0x7f619c0bdff0 2023-07-27T20:32:36.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.907+0000 7f61837fe700 1 --2- 172.21.15.72:0/1740316930 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f618806ace0 0x7f618806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:36.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.907+0000 7f61837fe700 1 -- 172.21.15.72:0/1740316930 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f61900893c0 con 0x7f619c0bdff0 2023-07-27T20:32:36.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.907+0000 7f619ad9d700 1 --2- 172.21.15.72:0/1740316930 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f618806ace0 0x7f618806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:36.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.908+0000 7f619ad9d700 1 --2- 172.21.15.72:0/1740316930 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f618806ace0 0x7f618806d1a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f619c149af0 tx=0x7f618c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:36.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:36.911+0000 7f61837fe700 1 -- 172.21.15.72:0/1740316930 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f61900541d0 con 0x7f619c0bdff0 2023-07-27T20:32:37.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.107+0000 7f61a11ff700 1 -- 172.21.15.72:0/1740316930 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f619c0ab2c0 con 0x7f619c0bdff0 2023-07-27T20:32:37.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.107+0000 7f61837fe700 1 -- 172.21.15.72:0/1740316930 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f619c0ab2c0 con 0x7f619c0bdff0 2023-07-27T20:32:37.095 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:32:37.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.110+0000 7f61a11ff700 1 -- 172.21.15.72:0/1740316930 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f618806ace0 msgr2=0x7f618806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:37.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.110+0000 7f61a11ff700 1 --2- 172.21.15.72:0/1740316930 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f618806ace0 0x7f618806d1a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f619c149af0 tx=0x7f618c008040 comp rx=0 tx=0).stop 2023-07-27T20:32:37.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.110+0000 7f61a11ff700 1 -- 172.21.15.72:0/1740316930 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f619c0bdff0 msgr2=0x7f619c0a9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:37.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.110+0000 7f61a11ff700 1 --2- 172.21.15.72:0/1740316930 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f619c0bdff0 0x7f619c0a9430 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f619000f820 tx=0x7f619000fb30 comp rx=0 tx=0).stop 2023-07-27T20:32:37.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.110+0000 7f61a11ff700 1 -- 172.21.15.72:0/1740316930 shutdown_connections 2023-07-27T20:32:37.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.110+0000 7f61a11ff700 1 --2- 172.21.15.72:0/1740316930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f619c0a9970 0x7f619c0a8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:37.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.110+0000 7f61a11ff700 1 --2- 172.21.15.72:0/1740316930 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f618806ace0 0x7f618806d1a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:37.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.110+0000 7f61a11ff700 1 --2- 172.21.15.72:0/1740316930 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6184005210 0x7f619c0ab630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:37.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.110+0000 7f61a11ff700 1 --2- 172.21.15.72:0/1740316930 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f619c0bdff0 0x7f619c0a9430 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:37.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.110+0000 7f61a11ff700 1 -- 172.21.15.72:0/1740316930 >> 172.21.15.72:0/1740316930 conn(0x7f619c0c59d0 msgr2=0x7f619c0c23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:37.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.110+0000 7f61a11ff700 1 -- 172.21.15.72:0/1740316930 shutdown_connections 2023-07-27T20:32:37.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.110+0000 7f61a11ff700 1 -- 172.21.15.72:0/1740316930 wait complete. 2023-07-27T20:32:37.115 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T20:32:37.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.330+0000 7f5f75bff700 1 Processor -- start 2023-07-27T20:32:37.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.330+0000 7f5f75bff700 1 -- start start 2023-07-27T20:32:37.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.331+0000 7f5f75bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5f7014aab0 0x7f5f70154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:37.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.331+0000 7f5f75bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f700c7c50 con 0x7f5f7006c1d0 2023-07-27T20:32:37.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.331+0000 7f5f75bff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f7006bd40 con 0x7f5f700c7740 2023-07-27T20:32:37.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.331+0000 7f5f75bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7006cd50 con 0x7f5f7014aab0 2023-07-27T20:32:37.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.331+0000 7f5f6ffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5f7006c1d0 0x7f5f7006c640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59050/0 (socket says 172.21.15.72:59050) 2023-07-27T20:32:37.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.331+0000 7f5f6ffff700 1 -- 172.21.15.72:0/2979118726 learned_addr learned my addr 172.21.15.72:0/2979118726 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:37.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.332+0000 7f5f6e7fc700 1 -- 172.21.15.72:0/2979118726 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 862814207 0 0) 0x7f5f700c7c50 con 0x7f5f7006c1d0 2023-07-27T20:32:37.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.332+0000 7f5f6e7fc700 1 -- 172.21.15.72:0/2979118726 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f580035b0 con 0x7f5f7006c1d0 2023-07-27T20:32:37.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.332+0000 7f5f6f7fe700 1 --2- 172.21.15.72:0/2979118726 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5f7014aab0 0x7f5f70154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:37.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.332+0000 7f5f6e7fc700 1 -- 172.21.15.72:0/2979118726 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2304877506 0 0) 0x7f5f580035b0 con 0x7f5f7006c1d0 2023-07-27T20:32:37.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.332+0000 7f5f6e7fc700 1 -- 172.21.15.72:0/2979118726 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5f7014aab0 msgr2=0x7f5f70154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:37.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.332+0000 7f5f6e7fc700 1 --2- 172.21.15.72:0/2979118726 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5f7014aab0 0x7f5f70154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:37.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.332+0000 7f5f6e7fc700 1 -- 172.21.15.72:0/2979118726 >> v1:172.21.15.173:6789/0 conn(0x7f5f700c7740 legacy=0x7f5f700c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:37.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.332+0000 7f5f6e7fc700 1 -- 172.21.15.72:0/2979118726 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f700c62f0 con 0x7f5f7006c1d0 2023-07-27T20:32:37.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.332+0000 7f5f6e7fc700 1 -- 172.21.15.72:0/2979118726 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f5f680019f0 con 0x7f5f7006c1d0 2023-07-27T20:32:37.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.332+0000 7f5f6e7fc700 1 -- 172.21.15.72:0/2979118726 >> v1:172.21.15.72:6789/0 conn(0x7f5f7006c1d0 legacy=0x7f5f7006c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:37.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.332+0000 7f5f6e7fc700 1 --2- 172.21.15.72:0/2979118726 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5f7014aab0 0x7f5f58003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:37.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.332+0000 7f5f6e7fc700 1 --2- 172.21.15.72:0/2979118726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f580040b0 0x7f5f58004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:37.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.332+0000 7f5f6e7fc700 1 --2- 172.21.15.72:0/2979118726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f58004d90 0x7f5f58005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:37.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.332+0000 7f5f6e7fc700 1 -- 172.21.15.72:0/2979118726 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7006cd50 con 0x7f5f580040b0 2023-07-27T20:32:37.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.332+0000 7f5f6e7fc700 1 -- 172.21.15.72:0/2979118726 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5800bc50 con 0x7f5f58004d90 2023-07-27T20:32:37.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.332+0000 7f5f6e7fc700 1 -- 172.21.15.72:0/2979118726 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5800be10 con 0x7f5f7014aab0 2023-07-27T20:32:37.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.333+0000 7f5f6effd700 1 --2- 172.21.15.72:0/2979118726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f580040b0 0x7f5f58004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:37.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.333+0000 7f5f6f7fe700 1 --2- 172.21.15.72:0/2979118726 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5f7014aab0 0x7f5f58003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:37.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.333+0000 7f5f6ffff700 1 --2- 172.21.15.72:0/2979118726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f58004d90 0x7f5f58005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:37.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.333+0000 7f5f6effd700 1 -- 172.21.15.72:0/2979118726 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5f7014aab0 msgr2=0x7f5f58003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:37.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.333+0000 7f5f6effd700 1 --2- 172.21.15.72:0/2979118726 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5f7014aab0 0x7f5f58003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:37.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.333+0000 7f5f6effd700 1 -- 172.21.15.72:0/2979118726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f58004d90 msgr2=0x7f5f58005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:37.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.333+0000 7f5f6effd700 1 --2- 172.21.15.72:0/2979118726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f58004d90 0x7f5f58005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:37.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.333+0000 7f5f6effd700 1 -- 172.21.15.72:0/2979118726 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f580035b0 con 0x7f5f580040b0 2023-07-27T20:32:37.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.333+0000 7f5f6effd700 1 --2- 172.21.15.72:0/2979118726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f580040b0 0x7f5f58004850 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5f700c7ba0 tx=0x7f5f58005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7e741665f53d97e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:37.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.333+0000 7f5f6e7fc700 1 -- 172.21.15.72:0/2979118726 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f640052d0 con 0x7f5f580040b0 2023-07-27T20:32:37.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.333+0000 7f5f6e7fc700 1 -- 172.21.15.72:0/2979118726 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f64005470 con 0x7f5f580040b0 2023-07-27T20:32:37.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.333+0000 7f5f6e7fc700 1 -- 172.21.15.72:0/2979118726 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f640038c0 con 0x7f5f580040b0 2023-07-27T20:32:37.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.334+0000 7f5f75bff700 1 -- 172.21.15.72:0/2979118726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f580040b0 msgr2=0x7f5f58004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:37.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.334+0000 7f5f75bff700 1 --2- 172.21.15.72:0/2979118726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f580040b0 0x7f5f58004850 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5f700c7ba0 tx=0x7f5f58005880 comp rx=0 tx=0).stop 2023-07-27T20:32:37.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.334+0000 7f5f6ffff700 1 -- 172.21.15.72:0/2979118726 reap_dead start 2023-07-27T20:32:37.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.334+0000 7f5f75bff700 1 -- 172.21.15.72:0/2979118726 shutdown_connections 2023-07-27T20:32:37.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.334+0000 7f5f75bff700 1 -- 172.21.15.72:0/2979118726 >> 172.21.15.72:0/2979118726 conn(0x7f5f700ab3f0 msgr2=0x7f5f700ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:37.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.334+0000 7f5f75bff700 1 -- 172.21.15.72:0/2979118726 shutdown_connections 2023-07-27T20:32:37.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.334+0000 7f5f75bff700 1 -- 172.21.15.72:0/2979118726 wait complete. 2023-07-27T20:32:37.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.336+0000 7f5f75bff700 1 Processor -- start 2023-07-27T20:32:37.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.336+0000 7f5f75bff700 1 -- start start 2023-07-27T20:32:37.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.337+0000 7f5f75bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5f580040b0 0x7f5f70151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:37.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.337+0000 7f5f75bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f700ad070 0x7f5f700ad4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:37.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.337+0000 7f5f75bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f701e9930 0x7f5f701e9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:37.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.337+0000 7f5f75bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7014f580 con 0x7f5f700ad070 2023-07-27T20:32:37.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.337+0000 7f5f75bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7014e730 con 0x7f5f701e9930 2023-07-27T20:32:37.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.337+0000 7f5f75bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f701e7120 con 0x7f5f580040b0 2023-07-27T20:32:37.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.337+0000 7f5f6effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f700ad070 0x7f5f700ad4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:37.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.337+0000 7f5f6effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f700ad070 0x7f5f700ad4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57116/0 (socket says 172.21.15.72:57116) 2023-07-27T20:32:37.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.337+0000 7f5f6effd700 1 -- 172.21.15.72:0/1803437779 learned_addr learned my addr 172.21.15.72:0/1803437779 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:37.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.337+0000 7f5f6f7fe700 1 --2- 172.21.15.72:0/1803437779 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5f580040b0 0x7f5f70151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:37.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.337+0000 7f5f6ffff700 1 --2- 172.21.15.72:0/1803437779 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f701e9930 0x7f5f701e9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:37.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.337+0000 7f5f6effd700 1 -- 172.21.15.72:0/1803437779 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5f580040b0 msgr2=0x7f5f70151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:37.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.337+0000 7f5f6effd700 1 --2- 172.21.15.72:0/1803437779 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5f580040b0 0x7f5f70151560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:37.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.337+0000 7f5f6effd700 1 -- 172.21.15.72:0/1803437779 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f701e9930 msgr2=0x7f5f701e9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:37.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.337+0000 7f5f6effd700 1 --2- 172.21.15.72:0/1803437779 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f701e9930 0x7f5f701e9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:37.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.337+0000 7f5f6effd700 1 -- 172.21.15.72:0/1803437779 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f701e9430 con 0x7f5f700ad070 2023-07-27T20:32:37.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.338+0000 7f5f6effd700 1 --2- 172.21.15.72:0/1803437779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f700ad070 0x7f5f700ad4f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5f64000c00 tx=0x7f5f64001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:37.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.338+0000 7f5f57fff700 1 -- 172.21.15.72:0/1803437779 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f64007240 con 0x7f5f700ad070 2023-07-27T20:32:37.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.338+0000 7f5f57fff700 1 -- 172.21.15.72:0/1803437779 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f640073a0 con 0x7f5f700ad070 2023-07-27T20:32:37.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.338+0000 7f5f57fff700 1 -- 172.21.15.72:0/1803437779 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f64007730 con 0x7f5f700ad070 2023-07-27T20:32:37.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.338+0000 7f5f75bff700 1 -- 172.21.15.72:0/1803437779 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f700add70 con 0x7f5f700ad070 2023-07-27T20:32:37.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.338+0000 7f5f75bff700 1 -- 172.21.15.72:0/1803437779 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f7014ec20 con 0x7f5f700ad070 2023-07-27T20:32:37.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.339+0000 7f5f75bff700 1 -- 172.21.15.72:0/1803437779 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f7014edb0 con 0x7f5f700ad070 2023-07-27T20:32:37.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.340+0000 7f5f57fff700 1 -- 172.21.15.72:0/1803437779 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5f64003680 con 0x7f5f700ad070 2023-07-27T20:32:37.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.341+0000 7f5f57fff700 1 --2- 172.21.15.72:0/1803437779 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5f5c06ace0 0x7f5f5c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:37.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.341+0000 7f5f57fff700 1 -- 172.21.15.72:0/1803437779 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5f6408a290 con 0x7f5f700ad070 2023-07-27T20:32:37.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.341+0000 7f5f6f7fe700 1 --2- 172.21.15.72:0/1803437779 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5f5c06ace0 0x7f5f5c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:37.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.342+0000 7f5f6f7fe700 1 --2- 172.21.15.72:0/1803437779 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5f5c06ace0 0x7f5f5c06d1a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5f60009950 tx=0x7f5f60008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:37.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.345+0000 7f5f57fff700 1 -- 172.21.15.72:0/1803437779 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5f64055120 con 0x7f5f700ad070 2023-07-27T20:32:37.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.539+0000 7f5f75bff700 1 -- 172.21.15.72:0/1803437779 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5f7004e470 con 0x7f5f700ad070 2023-07-27T20:32:37.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.540+0000 7f5f57fff700 1 -- 172.21.15.72:0/1803437779 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5f64058740 con 0x7f5f700ad070 2023-07-27T20:32:37.527 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-27T20:32:37.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.542+0000 7f5f75bff700 1 -- 172.21.15.72:0/1803437779 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5f5c06ace0 msgr2=0x7f5f5c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:37.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.542+0000 7f5f75bff700 1 --2- 172.21.15.72:0/1803437779 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5f5c06ace0 0x7f5f5c06d1a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5f60009950 tx=0x7f5f60008040 comp rx=0 tx=0).stop 2023-07-27T20:32:37.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.542+0000 7f5f75bff700 1 -- 172.21.15.72:0/1803437779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f700ad070 msgr2=0x7f5f700ad4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:37.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.542+0000 7f5f75bff700 1 --2- 172.21.15.72:0/1803437779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f700ad070 0x7f5f700ad4f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5f64000c00 tx=0x7f5f64001120 comp rx=0 tx=0).stop 2023-07-27T20:32:37.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.542+0000 7f5f75bff700 1 -- 172.21.15.72:0/1803437779 shutdown_connections 2023-07-27T20:32:37.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.542+0000 7f5f75bff700 1 --2- 172.21.15.72:0/1803437779 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f701e9930 0x7f5f701e9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:37.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.543+0000 7f5f75bff700 1 --2- 172.21.15.72:0/1803437779 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5f5c06ace0 0x7f5f5c06d1a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:37.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.543+0000 7f5f75bff700 1 --2- 172.21.15.72:0/1803437779 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5f580040b0 0x7f5f70151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:37.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.543+0000 7f5f75bff700 1 --2- 172.21.15.72:0/1803437779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f700ad070 0x7f5f700ad4f0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:37.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.543+0000 7f5f75bff700 1 -- 172.21.15.72:0/1803437779 >> 172.21.15.72:0/1803437779 conn(0x7f5f700ab3f0 msgr2=0x7f5f700c40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:37.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.543+0000 7f5f75bff700 1 -- 172.21.15.72:0/1803437779 shutdown_connections 2023-07-27T20:32:37.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.543+0000 7f5f75bff700 1 -- 172.21.15.72:0/1803437779 wait complete. 2023-07-27T20:32:37.548 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-27T20:32:37.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.758+0000 7f90571ff700 1 Processor -- start 2023-07-27T20:32:37.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.758+0000 7f90571ff700 1 -- start start 2023-07-27T20:32:37.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.759+0000 7f90571ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f905006d5d0 0x7f905006da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:37.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.759+0000 7f90571ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f905006ce10 con 0x7f905006e140 2023-07-27T20:32:37.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.759+0000 7f90571ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9050152680 con 0x7f905013b150 2023-07-27T20:32:37.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.759+0000 7f90571ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f905006df40 con 0x7f905006d5d0 2023-07-27T20:32:37.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.760+0000 7f9047fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f905006e140 0x7f90500ba310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59066/0 (socket says 172.21.15.72:59066) 2023-07-27T20:32:37.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.760+0000 7f9047fff700 1 -- 172.21.15.72:0/2100965792 learned_addr learned my addr 172.21.15.72:0/2100965792 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:37.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.760+0000 7f90477fe700 1 -- 172.21.15.72:0/2100965792 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3313319919 0 0) 0x7f905006ce10 con 0x7f905006e140 2023-07-27T20:32:37.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.760+0000 7f90477fe700 1 -- 172.21.15.72:0/2100965792 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90380035b0 con 0x7f905006e140 2023-07-27T20:32:37.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.760+0000 7f905579c700 1 --2- 172.21.15.72:0/2100965792 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f905006d5d0 0x7f905006da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:37.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.760+0000 7f90477fe700 1 -- 172.21.15.72:0/2100965792 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2937827757 0 0) 0x7f90380035b0 con 0x7f905006e140 2023-07-27T20:32:37.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.760+0000 7f90477fe700 1 -- 172.21.15.72:0/2100965792 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f905006d5d0 msgr2=0x7f905006da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:37.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.760+0000 7f90477fe700 1 --2- 172.21.15.72:0/2100965792 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f905006d5d0 0x7f905006da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:37.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.760+0000 7f90477fe700 1 -- 172.21.15.72:0/2100965792 >> v1:172.21.15.173:6789/0 conn(0x7f905013b150 legacy=0x7f9050151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:37.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.760+0000 7f90477fe700 1 -- 172.21.15.72:0/2100965792 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9050152960 con 0x7f905006e140 2023-07-27T20:32:37.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.760+0000 7f90477fe700 1 -- 172.21.15.72:0/2100965792 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f9040001670 con 0x7f905006e140 2023-07-27T20:32:37.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.760+0000 7f90477fe700 1 -- 172.21.15.72:0/2100965792 >> v1:172.21.15.72:6789/0 conn(0x7f905006e140 legacy=0x7f90500ba310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:37.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.760+0000 7f90477fe700 1 --2- 172.21.15.72:0/2100965792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9038003a30 0x7f9038003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:37.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.760+0000 7f90477fe700 1 --2- 172.21.15.72:0/2100965792 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f905006d5d0 0x7f9038004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:37.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.760+0000 7f90477fe700 1 --2- 172.21.15.72:0/2100965792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9038004d90 0x7f9038005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:37.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.761+0000 7f90477fe700 1 -- 172.21.15.72:0/2100965792 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f905006df40 con 0x7f9038004d90 2023-07-27T20:32:37.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.761+0000 7f90477fe700 1 -- 172.21.15.72:0/2100965792 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903800bba0 con 0x7f9038003a30 2023-07-27T20:32:37.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.761+0000 7f90477fe700 1 -- 172.21.15.72:0/2100965792 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f903800bd60 con 0x7f905006d5d0 2023-07-27T20:32:37.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.761+0000 7f905579c700 1 --2- 172.21.15.72:0/2100965792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9038004d90 0x7f9038005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:37.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.761+0000 7f9054f9b700 1 --2- 172.21.15.72:0/2100965792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9038003a30 0x7f9038003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:37.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.761+0000 7f9047fff700 1 --2- 172.21.15.72:0/2100965792 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f905006d5d0 0x7f9038004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:37.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.761+0000 7f905579c700 1 -- 172.21.15.72:0/2100965792 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f905006d5d0 msgr2=0x7f9038004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:37.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.761+0000 7f905579c700 1 --2- 172.21.15.72:0/2100965792 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f905006d5d0 0x7f9038004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:37.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.761+0000 7f905579c700 1 -- 172.21.15.72:0/2100965792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9038003a30 msgr2=0x7f9038003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:37.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.761+0000 7f905579c700 1 --2- 172.21.15.72:0/2100965792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9038003a30 0x7f9038003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:37.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.761+0000 7f905579c700 1 -- 172.21.15.72:0/2100965792 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90380035b0 con 0x7f9038004d90 2023-07-27T20:32:37.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.761+0000 7f905579c700 1 --2- 172.21.15.72:0/2100965792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9038004d90 0x7f9038005210 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9048009fc0 tx=0x7f9038005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf315f0727e9720a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:37.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.762+0000 7f90477fe700 1 -- 172.21.15.72:0/2100965792 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904800ec30 con 0x7f9038004d90 2023-07-27T20:32:37.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.762+0000 7f90477fe700 1 -- 172.21.15.72:0/2100965792 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904800f040 con 0x7f9038004d90 2023-07-27T20:32:37.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.762+0000 7f90477fe700 1 -- 172.21.15.72:0/2100965792 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9048014480 con 0x7f9038004d90 2023-07-27T20:32:37.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.762+0000 7f90571ff700 1 -- 172.21.15.72:0/2100965792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9038004d90 msgr2=0x7f9038005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:37.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.762+0000 7f90571ff700 1 --2- 172.21.15.72:0/2100965792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9038004d90 0x7f9038005210 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9048009fc0 tx=0x7f9038005880 comp rx=0 tx=0).stop 2023-07-27T20:32:37.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.762+0000 7f905579c700 1 -- 172.21.15.72:0/2100965792 reap_dead start 2023-07-27T20:32:37.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.762+0000 7f90571ff700 1 -- 172.21.15.72:0/2100965792 shutdown_connections 2023-07-27T20:32:37.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.762+0000 7f90571ff700 1 -- 172.21.15.72:0/2100965792 >> 172.21.15.72:0/2100965792 conn(0x7f905006a190 msgr2=0x7f905006a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:37.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.762+0000 7f90571ff700 1 -- 172.21.15.72:0/2100965792 shutdown_connections 2023-07-27T20:32:37.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.762+0000 7f90571ff700 1 -- 172.21.15.72:0/2100965792 wait complete. 2023-07-27T20:32:37.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.764+0000 7f90571ff700 1 Processor -- start 2023-07-27T20:32:37.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.764+0000 7f90571ff700 1 -- start start 2023-07-27T20:32:37.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.765+0000 7f90571ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9050150bf0 0x7f90500a89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:37.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.765+0000 7f90571ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90500a8f30 0x7f9050133990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:37.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.765+0000 7f90571ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90501530b0 0x7f9050133ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:37.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.765+0000 7f90571ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90500a8230 con 0x7f90501530b0 2023-07-27T20:32:37.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.765+0000 7f90571ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9050155c80 con 0x7f90500a8f30 2023-07-27T20:32:37.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.765+0000 7f90571ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9050155f60 con 0x7f9050150bf0 2023-07-27T20:32:37.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.765+0000 7f905579c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90501530b0 0x7f9050133ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:37.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.765+0000 7f905579c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90501530b0 0x7f9050133ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57124/0 (socket says 172.21.15.72:57124) 2023-07-27T20:32:37.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.765+0000 7f905579c700 1 -- 172.21.15.72:0/3974612845 learned_addr learned my addr 172.21.15.72:0/3974612845 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:37.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.766+0000 7f9047fff700 1 --2- 172.21.15.72:0/3974612845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90500a8f30 0x7f9050133990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:37.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.766+0000 7f9054f9b700 1 --2- 172.21.15.72:0/3974612845 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9050150bf0 0x7f90500a89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:37.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.766+0000 7f905579c700 1 -- 172.21.15.72:0/3974612845 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9050150bf0 msgr2=0x7f90500a89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:37.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.766+0000 7f905579c700 1 --2- 172.21.15.72:0/3974612845 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9050150bf0 0x7f90500a89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:37.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.766+0000 7f905579c700 1 -- 172.21.15.72:0/3974612845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90500a8f30 msgr2=0x7f9050133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:37.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.766+0000 7f905579c700 1 --2- 172.21.15.72:0/3974612845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90500a8f30 0x7f9050133990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:37.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.766+0000 7f905579c700 1 -- 172.21.15.72:0/3974612845 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90500a84d0 con 0x7f90501530b0 2023-07-27T20:32:37.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.766+0000 7f905579c700 1 --2- 172.21.15.72:0/3974612845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90501530b0 0x7f9050133ed0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9048016000 tx=0x7f9048009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:37.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.766+0000 7f90457fa700 1 -- 172.21.15.72:0/3974612845 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9048007000 con 0x7f90501530b0 2023-07-27T20:32:37.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.766+0000 7f90457fa700 1 -- 172.21.15.72:0/3974612845 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9048015b30 con 0x7f90501530b0 2023-07-27T20:32:37.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.766+0000 7f90571ff700 1 -- 172.21.15.72:0/3974612845 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9050156240 con 0x7f90501530b0 2023-07-27T20:32:37.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.766+0000 7f90457fa700 1 -- 172.21.15.72:0/3974612845 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904801d420 con 0x7f90501530b0 2023-07-27T20:32:37.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.766+0000 7f90571ff700 1 -- 172.21.15.72:0/3974612845 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90501559f0 con 0x7f90501530b0 2023-07-27T20:32:37.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.768+0000 7f90571ff700 1 -- 172.21.15.72:0/3974612845 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f905004e470 con 0x7f90501530b0 2023-07-27T20:32:37.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.768+0000 7f90457fa700 1 -- 172.21.15.72:0/3974612845 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f904801d580 con 0x7f90501530b0 2023-07-27T20:32:37.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.769+0000 7f90457fa700 1 --2- 172.21.15.72:0/3974612845 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f903c06ace0 0x7f903c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:37.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.769+0000 7f90457fa700 1 -- 172.21.15.72:0/3974612845 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f904808afe0 con 0x7f90501530b0 2023-07-27T20:32:37.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.770+0000 7f9054f9b700 1 --2- 172.21.15.72:0/3974612845 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f903c06ace0 0x7f903c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:37.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.770+0000 7f9054f9b700 1 --2- 172.21.15.72:0/3974612845 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f903c06ace0 0x7f903c06d1a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f904c007fd0 tx=0x7f904c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:37.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.773+0000 7f90457fa700 1 -- 172.21.15.72:0/3974612845 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9048055e70 con 0x7f90501530b0 2023-07-27T20:32:37.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.965+0000 7f90571ff700 1 -- 172.21.15.72:0/3974612845 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f90500ab1c0 con 0x7f90501530b0 2023-07-27T20:32:37.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.965+0000 7f90457fa700 1 -- 172.21.15.72:0/3974612845 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9048059490 con 0x7f90501530b0 2023-07-27T20:32:37.953 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:32:37.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.967+0000 7f90571ff700 1 -- 172.21.15.72:0/3974612845 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f903c06ace0 msgr2=0x7f903c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:37.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.967+0000 7f90571ff700 1 --2- 172.21.15.72:0/3974612845 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f903c06ace0 0x7f903c06d1a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f904c007fd0 tx=0x7f904c009040 comp rx=0 tx=0).stop 2023-07-27T20:32:37.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.967+0000 7f90571ff700 1 -- 172.21.15.72:0/3974612845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90501530b0 msgr2=0x7f9050133ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:37.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.967+0000 7f90571ff700 1 --2- 172.21.15.72:0/3974612845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90501530b0 0x7f9050133ed0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9048016000 tx=0x7f9048009750 comp rx=0 tx=0).stop 2023-07-27T20:32:37.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.968+0000 7f90571ff700 1 -- 172.21.15.72:0/3974612845 shutdown_connections 2023-07-27T20:32:37.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.968+0000 7f90571ff700 1 --2- 172.21.15.72:0/3974612845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90501530b0 0x7f9050133ed0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:37.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.968+0000 7f90571ff700 1 --2- 172.21.15.72:0/3974612845 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f903c06ace0 0x7f903c06d1a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:37.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.968+0000 7f90571ff700 1 --2- 172.21.15.72:0/3974612845 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9050150bf0 0x7f90500a89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:37.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.968+0000 7f90571ff700 1 --2- 172.21.15.72:0/3974612845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90500a8f30 0x7f9050133990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:37.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.968+0000 7f90571ff700 1 -- 172.21.15.72:0/3974612845 >> 172.21.15.72:0/3974612845 conn(0x7f905006a190 msgr2=0x7f90500bffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:37.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.968+0000 7f90571ff700 1 -- 172.21.15.72:0/3974612845 shutdown_connections 2023-07-27T20:32:37.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:37.968+0000 7f90571ff700 1 -- 172.21.15.72:0/3974612845 wait complete. 2023-07-27T20:32:37.973 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-27T20:32:38.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.185+0000 7f37f0dff700 1 Processor -- start 2023-07-27T20:32:38.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.185+0000 7f37f0dff700 1 -- start start 2023-07-27T20:32:38.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.186+0000 7f37f0dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f37ec0c6ea0 0x7f37ec0c1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:38.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.186+0000 7f37f0dff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f37ec0c3960 0x7f37ec0a9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:38.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.186+0000 7f37f0dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37ec070a30 con 0x7f37ec0a96d0 2023-07-27T20:32:38.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.186+0000 7f37f0dff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37ec0c3e80 con 0x7f37ec0c3960 2023-07-27T20:32:38.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.186+0000 7f37f0dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37ec0c2b50 con 0x7f37ec0c6ea0 2023-07-27T20:32:38.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.186+0000 7f37ead9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f37ec0a96d0 0x7f37ec150e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59070/0 (socket says 172.21.15.72:59070) 2023-07-27T20:32:38.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.186+0000 7f37ead9d700 1 -- 172.21.15.72:0/37234368 learned_addr learned my addr 172.21.15.72:0/37234368 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:38.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.186+0000 7f37ea59c700 1 --2- 172.21.15.72:0/37234368 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f37ec0c6ea0 0x7f37ec0c1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:38.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.186+0000 7f37e3fff700 1 --2- 172.21.15.72:0/37234368 >> v2:172.21.15.173:3300/0 conn(0x7f37ec0c3960 0x7f37ec0a9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:38.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.186+0000 7f37e9d9b700 1 -- 172.21.15.72:0/37234368 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3186538293 0 0) 0x7f37ec070a30 con 0x7f37ec0a96d0 2023-07-27T20:32:38.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.187+0000 7f37e9d9b700 1 -- 172.21.15.72:0/37234368 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37d80035b0 con 0x7f37ec0a96d0 2023-07-27T20:32:38.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.187+0000 7f37e9d9b700 1 -- 172.21.15.72:0/37234368 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3087789315 0 0) 0x7f37d80035b0 con 0x7f37ec0a96d0 2023-07-27T20:32:38.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.187+0000 7f37e9d9b700 1 -- 172.21.15.72:0/37234368 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f37ec0c6ea0 msgr2=0x7f37ec0c1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:38.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.187+0000 7f37e9d9b700 1 --2- 172.21.15.72:0/37234368 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f37ec0c6ea0 0x7f37ec0c1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:38.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.187+0000 7f37e9d9b700 1 -- 172.21.15.72:0/37234368 >> v2:172.21.15.173:3300/0 conn(0x7f37ec0c3960 msgr2=0x7f37ec0a9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:38.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.187+0000 7f37e9d9b700 1 --2- 172.21.15.72:0/37234368 >> v2:172.21.15.173:3300/0 conn(0x7f37ec0c3960 0x7f37ec0a9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:38.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.187+0000 7f37e9d9b700 1 -- 172.21.15.72:0/37234368 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37ec070700 con 0x7f37ec0a96d0 2023-07-27T20:32:38.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.187+0000 7f37e9d9b700 1 -- 172.21.15.72:0/37234368 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f37e40019f0 con 0x7f37ec0a96d0 2023-07-27T20:32:38.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.187+0000 7f37e9d9b700 1 -- 172.21.15.72:0/37234368 >> v1:172.21.15.72:6789/0 conn(0x7f37ec0a96d0 legacy=0x7f37ec150e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:38.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.187+0000 7f37e9d9b700 1 --2- 172.21.15.72:0/37234368 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f37ec0c6ea0 0x7f37d8003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:38.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.187+0000 7f37e9d9b700 1 --2- 172.21.15.72:0/37234368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37d8004000 0x7f37d8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:38.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.187+0000 7f37e9d9b700 1 --2- 172.21.15.72:0/37234368 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37d8004d90 0x7f37d8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:38.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.187+0000 7f37e9d9b700 1 -- 172.21.15.72:0/37234368 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37ec0c3e80 con 0x7f37d8004000 2023-07-27T20:32:38.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.187+0000 7f37e9d9b700 1 -- 172.21.15.72:0/37234368 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d800ba40 con 0x7f37d8004d90 2023-07-27T20:32:38.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.187+0000 7f37e9d9b700 1 -- 172.21.15.72:0/37234368 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37d800bc00 con 0x7f37ec0c6ea0 2023-07-27T20:32:38.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.187+0000 7f37e3fff700 1 --2- 172.21.15.72:0/37234368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37d8004000 0x7f37d8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:38.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.187+0000 7f37ea59c700 1 --2- 172.21.15.72:0/37234368 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f37ec0c6ea0 0x7f37d8003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:38.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.187+0000 7f37ead9d700 1 --2- 172.21.15.72:0/37234368 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37d8004d90 0x7f37d8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:38.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.188+0000 7f37e3fff700 1 -- 172.21.15.72:0/37234368 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f37ec0c6ea0 msgr2=0x7f37d8003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:38.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.188+0000 7f37e3fff700 1 --2- 172.21.15.72:0/37234368 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f37ec0c6ea0 0x7f37d8003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:38.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.188+0000 7f37e3fff700 1 -- 172.21.15.72:0/37234368 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37d8004d90 msgr2=0x7f37d8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:38.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.188+0000 7f37e3fff700 1 --2- 172.21.15.72:0/37234368 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37d8004d90 0x7f37d8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:38.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.188+0000 7f37e3fff700 1 -- 172.21.15.72:0/37234368 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d80035b0 con 0x7f37d8004000 2023-07-27T20:32:38.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.188+0000 7f37ead9d700 1 --2- 172.21.15.72:0/37234368 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37d8004d90 0x7f37d8005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:38.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.188+0000 7f37e3fff700 1 --2- 172.21.15.72:0/37234368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37d8004000 0x7f37d8004850 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f37d4009b60 tx=0x7f37d8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d71a2b4891ba0996 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:38.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.188+0000 7f37e9d9b700 1 -- 172.21.15.72:0/37234368 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d400e6c0 con 0x7f37d8004000 2023-07-27T20:32:38.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.188+0000 7f37e9d9b700 1 -- 172.21.15.72:0/37234368 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d400e820 con 0x7f37d8004000 2023-07-27T20:32:38.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.188+0000 7f37e9d9b700 1 -- 172.21.15.72:0/37234368 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d400eb90 con 0x7f37d8004000 2023-07-27T20:32:38.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.189+0000 7f37f0dff700 1 -- 172.21.15.72:0/37234368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37d8004000 msgr2=0x7f37d8004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:38.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.189+0000 7f37f0dff700 1 --2- 172.21.15.72:0/37234368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37d8004000 0x7f37d8004850 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f37d4009b60 tx=0x7f37d8005880 comp rx=0 tx=0).stop 2023-07-27T20:32:38.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.189+0000 7f37ead9d700 1 -- 172.21.15.72:0/37234368 reap_dead start 2023-07-27T20:32:38.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.189+0000 7f37f0dff700 1 -- 172.21.15.72:0/37234368 shutdown_connections 2023-07-27T20:32:38.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.189+0000 7f37f0dff700 1 -- 172.21.15.72:0/37234368 >> 172.21.15.72:0/37234368 conn(0x7f37ec06a7c0 msgr2=0x7f37ec0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:38.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.189+0000 7f37f0dff700 1 -- 172.21.15.72:0/37234368 shutdown_connections 2023-07-27T20:32:38.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.189+0000 7f37f0dff700 1 -- 172.21.15.72:0/37234368 wait complete. 2023-07-27T20:32:38.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.191+0000 7f37f0dff700 1 Processor -- start 2023-07-27T20:32:38.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.191+0000 7f37f0dff700 1 -- start start 2023-07-27T20:32:38.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.192+0000 7f37f0dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37d8004000 0x7f37ec1ed280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:38.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.192+0000 7f37f0dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37ec0a8820 0x7f37ec0c0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:38.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.192+0000 7f37f0dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f37ec0c0d80 0x7f37ec0bb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:38.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.192+0000 7f37f0dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37ec0bc4d0 con 0x7f37d8004000 2023-07-27T20:32:38.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.192+0000 7f37f0dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37ec06c300 con 0x7f37ec0a8820 2023-07-27T20:32:38.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.192+0000 7f37f0dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37ec0bb0d0 con 0x7f37ec0c0d80 2023-07-27T20:32:38.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.192+0000 7f37ea59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37d8004000 0x7f37ec1ed280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:38.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.192+0000 7f37ea59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37d8004000 0x7f37ec1ed280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57134/0 (socket says 172.21.15.72:57134) 2023-07-27T20:32:38.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.192+0000 7f37ea59c700 1 -- 172.21.15.72:0/3975726296 learned_addr learned my addr 172.21.15.72:0/3975726296 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:38.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.192+0000 7f37e3fff700 1 --2- 172.21.15.72:0/3975726296 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37ec0a8820 0x7f37ec0c0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:38.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.192+0000 7f37ead9d700 1 --2- 172.21.15.72:0/3975726296 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f37ec0c0d80 0x7f37ec0bb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:38.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.192+0000 7f37ea59c700 1 -- 172.21.15.72:0/3975726296 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f37ec0c0d80 msgr2=0x7f37ec0bb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:38.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.192+0000 7f37ea59c700 1 --2- 172.21.15.72:0/3975726296 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f37ec0c0d80 0x7f37ec0bb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:38.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.192+0000 7f37ea59c700 1 -- 172.21.15.72:0/3975726296 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37ec0a8820 msgr2=0x7f37ec0c0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:38.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.192+0000 7f37ea59c700 1 --2- 172.21.15.72:0/3975726296 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37ec0a8820 0x7f37ec0c0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:38.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.192+0000 7f37ea59c700 1 -- 172.21.15.72:0/3975726296 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37ec157aa0 con 0x7f37d8004000 2023-07-27T20:32:38.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.192+0000 7f37ea59c700 1 --2- 172.21.15.72:0/3975726296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37d8004000 0x7f37ec1ed280 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f37dc011aa0 tx=0x7f37dc011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:38.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.193+0000 7f37e2ffd700 1 -- 172.21.15.72:0/3975726296 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37dc00f920 con 0x7f37d8004000 2023-07-27T20:32:38.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.193+0000 7f37e2ffd700 1 -- 172.21.15.72:0/3975726296 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37dc00fa80 con 0x7f37d8004000 2023-07-27T20:32:38.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.193+0000 7f37e2ffd700 1 -- 172.21.15.72:0/3975726296 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37dc00fe30 con 0x7f37d8004000 2023-07-27T20:32:38.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.193+0000 7f37f0dff700 1 -- 172.21.15.72:0/3975726296 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37ec1ed7c0 con 0x7f37d8004000 2023-07-27T20:32:38.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.193+0000 7f37f0dff700 1 -- 172.21.15.72:0/3975726296 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37ec158020 con 0x7f37d8004000 2023-07-27T20:32:38.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.194+0000 7f37f0dff700 1 -- 172.21.15.72:0/3975726296 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37ec0bb3b0 con 0x7f37d8004000 2023-07-27T20:32:38.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.195+0000 7f37e2ffd700 1 -- 172.21.15.72:0/3975726296 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f37dc014440 con 0x7f37d8004000 2023-07-27T20:32:38.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.196+0000 7f37e2ffd700 1 --2- 172.21.15.72:0/3975726296 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f37cc06acb0 0x7f37cc06d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:38.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.196+0000 7f37e2ffd700 1 -- 172.21.15.72:0/3975726296 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f37dc089f60 con 0x7f37d8004000 2023-07-27T20:32:38.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.196+0000 7f37e3fff700 1 --2- 172.21.15.72:0/3975726296 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f37cc06acb0 0x7f37cc06d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:38.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.197+0000 7f37e3fff700 1 --2- 172.21.15.72:0/3975726296 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f37cc06acb0 0x7f37cc06d170 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f37d40090b0 tx=0x7f37d4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:38.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.200+0000 7f37e2ffd700 1 -- 172.21.15.72:0/3975726296 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f37dc054db0 con 0x7f37d8004000 2023-07-27T20:32:38.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.409+0000 7f37f0dff700 1 -- 172.21.15.72:0/3975726296 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f37ec074310 con 0x7f37d8004000 2023-07-27T20:32:38.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.409+0000 7f37e2ffd700 1 -- 172.21.15.72:0/3975726296 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f37dc022080 con 0x7f37d8004000 2023-07-27T20:32:38.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.412+0000 7f37f0dff700 1 -- 172.21.15.72:0/3975726296 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f37cc06acb0 msgr2=0x7f37cc06d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:38.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.412+0000 7f37f0dff700 1 --2- 172.21.15.72:0/3975726296 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f37cc06acb0 0x7f37cc06d170 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f37d40090b0 tx=0x7f37d4008030 comp rx=0 tx=0).stop 2023-07-27T20:32:38.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.412+0000 7f37f0dff700 1 -- 172.21.15.72:0/3975726296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37d8004000 msgr2=0x7f37ec1ed280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:38.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.412+0000 7f37f0dff700 1 --2- 172.21.15.72:0/3975726296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37d8004000 0x7f37ec1ed280 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f37dc011aa0 tx=0x7f37dc011e60 comp rx=0 tx=0).stop 2023-07-27T20:32:38.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.412+0000 7f37f0dff700 1 -- 172.21.15.72:0/3975726296 shutdown_connections 2023-07-27T20:32:38.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.412+0000 7f37f0dff700 1 --2- 172.21.15.72:0/3975726296 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f37cc06acb0 0x7f37cc06d170 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:38.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.412+0000 7f37f0dff700 1 --2- 172.21.15.72:0/3975726296 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f37ec0c0d80 0x7f37ec0bb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:38.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.412+0000 7f37f0dff700 1 --2- 172.21.15.72:0/3975726296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37d8004000 0x7f37ec1ed280 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:38.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.412+0000 7f37f0dff700 1 --2- 172.21.15.72:0/3975726296 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37ec0a8820 0x7f37ec0c0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:38.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.412+0000 7f37f0dff700 1 -- 172.21.15.72:0/3975726296 >> 172.21.15.72:0/3975726296 conn(0x7f37ec06a7c0 msgr2=0x7f37ec0c4040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:38.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.412+0000 7f37f0dff700 1 -- 172.21.15.72:0/3975726296 shutdown_connections 2023-07-27T20:32:38.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.412+0000 7f37f0dff700 1 -- 172.21.15.72:0/3975726296 wait complete. 2023-07-27T20:32:38.401 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-07-27T20:32:38.417 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-07-27T20:32:38.417 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-27T20:32:38.469 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:32:38.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.678+0000 7fe92ffff700 1 Processor -- start 2023-07-27T20:32:38.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.678+0000 7fe92ffff700 1 -- start start 2023-07-27T20:32:38.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.679+0000 7fe92ffff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe92806b150 0x7fe9280c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:38.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.679+0000 7fe92ffff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe9281549f0 0x7fe9281514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:38.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.680+0000 7fe92ffff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe92806b710 con 0x7fe9280c4400 2023-07-27T20:32:38.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.680+0000 7fe92ffff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9281545d0 con 0x7fe9281549f0 2023-07-27T20:32:38.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.680+0000 7fe92ffff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe92806c860 con 0x7fe92806b150 2023-07-27T20:32:38.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.680+0000 7fe92dd9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe9280c4400 0x7fe9280c4cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59082/0 (socket says 172.21.15.72:59082) 2023-07-27T20:32:38.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.680+0000 7fe92dd9b700 1 -- 172.21.15.72:0/666539804 learned_addr learned my addr 172.21.15.72:0/666539804 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:38.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.680+0000 7fe92d59a700 1 --2- 172.21.15.72:0/666539804 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe92806b150 0x7fe9280c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:38.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.680+0000 7fe92e59c700 1 --2- 172.21.15.72:0/666539804 >> v2:172.21.15.173:3300/0 conn(0x7fe9281549f0 0x7fe9281514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:38.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.680+0000 7fe92cd99700 1 -- 172.21.15.72:0/666539804 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2399828560 0 0) 0x7fe92806b710 con 0x7fe9280c4400 2023-07-27T20:32:38.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.680+0000 7fe92cd99700 1 -- 172.21.15.72:0/666539804 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9140035b0 con 0x7fe9280c4400 2023-07-27T20:32:38.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.681+0000 7fe92d59a700 1 -- 172.21.15.72:0/666539804 >> v2:172.21.15.173:3300/0 conn(0x7fe9281549f0 msgr2=0x7fe9281514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:38.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.681+0000 7fe92d59a700 1 --2- 172.21.15.72:0/666539804 >> v2:172.21.15.173:3300/0 conn(0x7fe9281549f0 0x7fe9281514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:38.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.681+0000 7fe92d59a700 1 -- 172.21.15.72:0/666539804 >> v1:172.21.15.72:6789/0 conn(0x7fe9280c4400 legacy=0x7fe9280c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:38.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.681+0000 7fe92cd99700 1 -- 172.21.15.72:0/666539804 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 861087912 0 0) 0x7fe9140035b0 con 0x7fe9280c4400 2023-07-27T20:32:38.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.681+0000 7fe92d59a700 1 -- 172.21.15.72:0/666539804 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92806b9f0 con 0x7fe92806b150 2023-07-27T20:32:38.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.681+0000 7fe92e59c700 1 --2- 172.21.15.72:0/666539804 >> v2:172.21.15.173:3300/0 conn(0x7fe9281549f0 0x7fe9281514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:32:38.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.681+0000 7fe92d59a700 1 --2- 172.21.15.72:0/666539804 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe92806b150 0x7fe9280c7710 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe918009840 tx=0x7fe918009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=670547097ae2172a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:38.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.681+0000 7fe92cd99700 1 -- 172.21.15.72:0/666539804 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe918011830 con 0x7fe92806b150 2023-07-27T20:32:38.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.681+0000 7fe92cd99700 1 -- 172.21.15.72:0/666539804 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe918011990 con 0x7fe92806b150 2023-07-27T20:32:38.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.681+0000 7fe92cd99700 1 -- 172.21.15.72:0/666539804 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe918011d20 con 0x7fe92806b150 2023-07-27T20:32:38.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.682+0000 7fe92ffff700 1 -- 172.21.15.72:0/666539804 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe92806b150 msgr2=0x7fe9280c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:38.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.682+0000 7fe92ffff700 1 --2- 172.21.15.72:0/666539804 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe92806b150 0x7fe9280c7710 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe918009840 tx=0x7fe918009b50 comp rx=0 tx=0).stop 2023-07-27T20:32:38.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.682+0000 7fe92ffff700 1 -- 172.21.15.72:0/666539804 shutdown_connections 2023-07-27T20:32:38.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.682+0000 7fe92ffff700 1 --2- 172.21.15.72:0/666539804 >> v2:172.21.15.173:3300/0 conn(0x7fe9281549f0 0x7fe9281514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:38.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.682+0000 7fe92ffff700 1 --2- 172.21.15.72:0/666539804 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe92806b150 0x7fe9280c7710 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:38.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.682+0000 7fe92ffff700 1 -- 172.21.15.72:0/666539804 >> 172.21.15.72:0/666539804 conn(0x7fe9280ab300 msgr2=0x7fe9280ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:38.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.682+0000 7fe92ffff700 1 -- 172.21.15.72:0/666539804 shutdown_connections 2023-07-27T20:32:38.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.682+0000 7fe92ffff700 1 -- 172.21.15.72:0/666539804 wait complete. 2023-07-27T20:32:38.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.683+0000 7fe92ffff700 1 Processor -- start 2023-07-27T20:32:38.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.684+0000 7fe92ffff700 1 -- start start 2023-07-27T20:32:38.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.684+0000 7fe92ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe92806b150 0x7fe9281de8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:38.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.684+0000 7fe92ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9280c4400 0x7fe928147a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:38.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.685+0000 7fe92ffff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe9281549f0 0x7fe928147fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:38.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.685+0000 7fe92ffff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9281484f0 con 0x7fe92806b150 2023-07-27T20:32:38.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.685+0000 7fe92ffff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92814f170 con 0x7fe9280c4400 2023-07-27T20:32:38.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.685+0000 7fe92ffff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9281e9710 con 0x7fe9281549f0 2023-07-27T20:32:38.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.685+0000 7fe92dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe92806b150 0x7fe9281de8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:38.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.685+0000 7fe92dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe92806b150 0x7fe9281de8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57146/0 (socket says 172.21.15.72:57146) 2023-07-27T20:32:38.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.685+0000 7fe92dd9b700 1 -- 172.21.15.72:0/3439472040 learned_addr learned my addr 172.21.15.72:0/3439472040 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:38.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.685+0000 7fe92dd9b700 1 -- 172.21.15.72:0/3439472040 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe9281549f0 msgr2=0x7fe928147fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:38.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.685+0000 7fe92dd9b700 1 --2- 172.21.15.72:0/3439472040 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe9281549f0 0x7fe928147fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:38.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.685+0000 7fe92dd9b700 1 -- 172.21.15.72:0/3439472040 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9280c4400 msgr2=0x7fe928147a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:38.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.685+0000 7fe92d59a700 1 --2- 172.21.15.72:0/3439472040 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9280c4400 0x7fe928147a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:38.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.685+0000 7fe92dd9b700 1 --2- 172.21.15.72:0/3439472040 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9280c4400 0x7fe928147a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:38.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.685+0000 7fe92dd9b700 1 -- 172.21.15.72:0/3439472040 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe920009a70 con 0x7fe92806b150 2023-07-27T20:32:38.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.685+0000 7fe92dd9b700 1 --2- 172.21.15.72:0/3439472040 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe92806b150 0x7fe9281de8a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe92400c700 tx=0x7fe92400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:38.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.686+0000 7fe91e7fc700 1 -- 172.21.15.72:0/3439472040 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe924005d70 con 0x7fe92806b150 2023-07-27T20:32:38.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.686+0000 7fe91e7fc700 1 -- 172.21.15.72:0/3439472040 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9240070d0 con 0x7fe92806b150 2023-07-27T20:32:38.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.686+0000 7fe91e7fc700 1 -- 172.21.15.72:0/3439472040 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe924007460 con 0x7fe92806b150 2023-07-27T20:32:38.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.686+0000 7fe92ffff700 1 -- 172.21.15.72:0/3439472040 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9180094a0 con 0x7fe92806b150 2023-07-27T20:32:38.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.686+0000 7fe92ffff700 1 -- 172.21.15.72:0/3439472040 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9281e9cd0 con 0x7fe92806b150 2023-07-27T20:32:38.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.687+0000 7fe92ffff700 1 -- 172.21.15.72:0/3439472040 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe928074310 con 0x7fe92806b150 2023-07-27T20:32:38.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.688+0000 7fe91e7fc700 1 -- 172.21.15.72:0/3439472040 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe9240075c0 con 0x7fe92806b150 2023-07-27T20:32:38.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.689+0000 7fe91e7fc700 1 --2- 172.21.15.72:0/3439472040 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe90c06ace0 0x7fe90c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:38.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.689+0000 7fe91e7fc700 1 -- 172.21.15.72:0/3439472040 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe924088e50 con 0x7fe92806b150 2023-07-27T20:32:38.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.690+0000 7fe92d59a700 1 --2- 172.21.15.72:0/3439472040 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe90c06ace0 0x7fe90c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:38.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.690+0000 7fe92d59a700 1 --2- 172.21.15.72:0/3439472040 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe90c06ace0 0x7fe90c06d1a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe9281535b0 tx=0x7fe91801c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:38.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.693+0000 7fe91e7fc700 1 -- 172.21.15.72:0/3439472040 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe924053bc0 con 0x7fe92806b150 2023-07-27T20:32:38.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.888+0000 7fe92ffff700 1 -- 172.21.15.72:0/3439472040 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9280c7120 con 0x7fe92806b150 2023-07-27T20:32:38.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.890+0000 7fe91e7fc700 1 -- 172.21.15.72:0/3439472040 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20215 (secure 0 0 0) 0x7fe924017090 con 0x7fe92806b150 2023-07-27T20:32:38.878 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:32:38.878 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":29,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:32:10.402254+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:31:27.020951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T20:31:27.566022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-27T20:31:31.182401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:32:38.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.892+0000 7fe92ffff700 1 -- 172.21.15.72:0/3439472040 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe90c06ace0 msgr2=0x7fe90c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:38.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.892+0000 7fe92ffff700 1 --2- 172.21.15.72:0/3439472040 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe90c06ace0 0x7fe90c06d1a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe9281535b0 tx=0x7fe91801c040 comp rx=0 tx=0).stop 2023-07-27T20:32:38.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.892+0000 7fe92ffff700 1 -- 172.21.15.72:0/3439472040 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe92806b150 msgr2=0x7fe9281de8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:38.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.892+0000 7fe92ffff700 1 --2- 172.21.15.72:0/3439472040 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe92806b150 0x7fe9281de8a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe92400c700 tx=0x7fe92400cac0 comp rx=0 tx=0).stop 2023-07-27T20:32:38.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.892+0000 7fe92ffff700 1 -- 172.21.15.72:0/3439472040 shutdown_connections 2023-07-27T20:32:38.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.892+0000 7fe92ffff700 1 --2- 172.21.15.72:0/3439472040 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe90c06ace0 0x7fe90c06d1a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:38.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.892+0000 7fe92ffff700 1 --2- 172.21.15.72:0/3439472040 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe9281549f0 0x7fe928147fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:38.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.892+0000 7fe92ffff700 1 --2- 172.21.15.72:0/3439472040 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe92806b150 0x7fe9281de8a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:38.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.892+0000 7fe92ffff700 1 --2- 172.21.15.72:0/3439472040 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9280c4400 0x7fe928147a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:38.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.892+0000 7fe92ffff700 1 -- 172.21.15.72:0/3439472040 >> 172.21.15.72:0/3439472040 conn(0x7fe9280ab300 msgr2=0x7fe928149dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:38.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.892+0000 7fe92ffff700 1 -- 172.21.15.72:0/3439472040 shutdown_connections 2023-07-27T20:32:38.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:38.892+0000 7fe92ffff700 1 -- 172.21.15.72:0/3439472040 wait complete. 2023-07-27T20:32:38.898 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-27T20:31:14.581785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T20:31:21.077941+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T20:31:27.020951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T20:31:27.566022+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-27T20:31:31.182401+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-27T20:32:38.899 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-27T20:32:39.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.111+0000 7f4f94dff700 1 Processor -- start 2023-07-27T20:32:39.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.111+0000 7f4f94dff700 1 -- start start 2023-07-27T20:32:39.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.112+0000 7f4f94dff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4f9014aab0 0x7f4f90154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:39.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.112+0000 7f4f94dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4f900c7740 0x7f4f900c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:39.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.112+0000 7f4f94dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f900c7c50 con 0x7f4f900c4700 2023-07-27T20:32:39.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.112+0000 7f4f94dff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f9006bd40 con 0x7f4f9014aab0 2023-07-27T20:32:39.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.112+0000 7f4f94dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f900c62f0 con 0x7f4f900c7740 2023-07-27T20:32:39.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.112+0000 7f4f8ed9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4f900c4700 0x7f4f9006c1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59092/0 (socket says 172.21.15.72:59092) 2023-07-27T20:32:39.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.112+0000 7f4f8ed9d700 1 -- 172.21.15.72:0/3741282153 learned_addr learned my addr 172.21.15.72:0/3741282153 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:39.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.112+0000 7f4f8e59c700 1 --2- 172.21.15.72:0/3741282153 >> v2:172.21.15.173:3300/0 conn(0x7f4f9014aab0 0x7f4f90154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:39.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.112+0000 7f4f8dd9b700 1 --2- 172.21.15.72:0/3741282153 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4f900c7740 0x7f4f900c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:39.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.113+0000 7f4f8d59a700 1 -- 172.21.15.72:0/3741282153 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 928744124 0 0) 0x7f4f900c7c50 con 0x7f4f900c4700 2023-07-27T20:32:39.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.113+0000 7f4f8d59a700 1 -- 172.21.15.72:0/3741282153 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f780035b0 con 0x7f4f900c4700 2023-07-27T20:32:39.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.113+0000 7f4f8e59c700 1 -- 172.21.15.72:0/3741282153 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4f900c7740 msgr2=0x7f4f900c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:39.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.113+0000 7f4f8e59c700 1 --2- 172.21.15.72:0/3741282153 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4f900c7740 0x7f4f900c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:39.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.113+0000 7f4f8e59c700 1 -- 172.21.15.72:0/3741282153 >> v1:172.21.15.72:6789/0 conn(0x7f4f900c4700 legacy=0x7f4f9006c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:39.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.113+0000 7f4f8e59c700 1 -- 172.21.15.72:0/3741282153 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f90155050 con 0x7f4f9014aab0 2023-07-27T20:32:39.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.113+0000 7f4f8dd9b700 1 --2- 172.21.15.72:0/3741282153 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4f900c7740 0x7f4f900c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:32:39.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.113+0000 7f4f8e59c700 1 --2- 172.21.15.72:0/3741282153 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f9014aab0 0x7f4f90154b10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4f80009840 tx=0x7f4f80009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dc7e85c67b2eda0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:39.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.114+0000 7f4f8d59a700 1 -- 172.21.15.72:0/3741282153 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f80011830 con 0x7f4f9014aab0 2023-07-27T20:32:39.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.114+0000 7f4f8d59a700 1 -- 172.21.15.72:0/3741282153 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f80011990 con 0x7f4f9014aab0 2023-07-27T20:32:39.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.114+0000 7f4f8d59a700 1 -- 172.21.15.72:0/3741282153 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f80011d00 con 0x7f4f9014aab0 2023-07-27T20:32:39.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.115+0000 7f4f94dff700 1 -- 172.21.15.72:0/3741282153 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f9014aab0 msgr2=0x7f4f90154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:39.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.115+0000 7f4f94dff700 1 --2- 172.21.15.72:0/3741282153 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f9014aab0 0x7f4f90154b10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4f80009840 tx=0x7f4f80009b50 comp rx=0 tx=0).stop 2023-07-27T20:32:39.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.115+0000 7f4f94dff700 1 -- 172.21.15.72:0/3741282153 shutdown_connections 2023-07-27T20:32:39.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.115+0000 7f4f94dff700 1 --2- 172.21.15.72:0/3741282153 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f9014aab0 0x7f4f90154b10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:39.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.115+0000 7f4f94dff700 1 --2- 172.21.15.72:0/3741282153 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4f900c7740 0x7f4f900c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:39.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.115+0000 7f4f94dff700 1 -- 172.21.15.72:0/3741282153 >> 172.21.15.72:0/3741282153 conn(0x7f4f900ab3f0 msgr2=0x7f4f900ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:39.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.115+0000 7f4f94dff700 1 -- 172.21.15.72:0/3741282153 shutdown_connections 2023-07-27T20:32:39.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.115+0000 7f4f94dff700 1 -- 172.21.15.72:0/3741282153 wait complete. 2023-07-27T20:32:39.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.116+0000 7f4f94dff700 1 Processor -- start 2023-07-27T20:32:39.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.117+0000 7f4f94dff700 1 -- start start 2023-07-27T20:32:39.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.117+0000 7f4f94dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4f900c4700 0x7f4f901475e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:39.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.117+0000 7f4f94dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f900c7740 0x7f4f900c0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:39.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.117+0000 7f4f94dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f9014aab0 0x7f4f900c2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:39.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.117+0000 7f4f94dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f900c20e0 con 0x7f4f900c7740 2023-07-27T20:32:39.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.117+0000 7f4f94dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f900c1280 con 0x7f4f9014aab0 2023-07-27T20:32:39.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.117+0000 7f4f94dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f900c1560 con 0x7f4f900c4700 2023-07-27T20:32:39.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.118+0000 7f4f8dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f900c7740 0x7f4f900c0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:39.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.118+0000 7f4f8dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f900c7740 0x7f4f900c0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57154/0 (socket says 172.21.15.72:57154) 2023-07-27T20:32:39.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.118+0000 7f4f8dd9b700 1 -- 172.21.15.72:0/2949089116 learned_addr learned my addr 172.21.15.72:0/2949089116 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:39.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.118+0000 7f4f8dd9b700 1 -- 172.21.15.72:0/2949089116 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4f900c4700 msgr2=0x7f4f901475e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:39.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.118+0000 7f4f8dd9b700 1 --2- 172.21.15.72:0/2949089116 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4f900c4700 0x7f4f901475e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:39.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.118+0000 7f4f8dd9b700 1 -- 172.21.15.72:0/2949089116 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f9014aab0 msgr2=0x7f4f900c2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:39.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.118+0000 7f4f8dd9b700 1 --2- 172.21.15.72:0/2949089116 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f9014aab0 0x7f4f900c2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:39.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.118+0000 7f4f8dd9b700 1 -- 172.21.15.72:0/2949089116 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f840094a0 con 0x7f4f900c7740 2023-07-27T20:32:39.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.118+0000 7f4f8dd9b700 1 --2- 172.21.15.72:0/2949089116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f900c7740 0x7f4f900c0910 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4f8400ebb0 tx=0x7f4f8400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:39.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.118+0000 7f4f7effd700 1 -- 172.21.15.72:0/2949089116 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8400c910 con 0x7f4f900c7740 2023-07-27T20:32:39.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.118+0000 7f4f7effd700 1 -- 172.21.15.72:0/2949089116 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8400ca70 con 0x7f4f900c7740 2023-07-27T20:32:39.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.118+0000 7f4f7effd700 1 -- 172.21.15.72:0/2949089116 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8400ce00 con 0x7f4f900c7740 2023-07-27T20:32:39.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.119+0000 7f4f94dff700 1 -- 172.21.15.72:0/2949089116 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f800094a0 con 0x7f4f900c7740 2023-07-27T20:32:39.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.119+0000 7f4f94dff700 1 -- 172.21.15.72:0/2949089116 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f90147b20 con 0x7f4f900c7740 2023-07-27T20:32:39.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.120+0000 7f4f94dff700 1 -- 172.21.15.72:0/2949089116 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f9006b4d0 con 0x7f4f900c7740 2023-07-27T20:32:39.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.120+0000 7f4f7effd700 1 -- 172.21.15.72:0/2949089116 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4f84013470 con 0x7f4f900c7740 2023-07-27T20:32:39.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.121+0000 7f4f7effd700 1 --2- 172.21.15.72:0/2949089116 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4f7006ad30 0x7f4f7006d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:39.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.121+0000 7f4f7effd700 1 -- 172.21.15.72:0/2949089116 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4f840898d0 con 0x7f4f900c7740 2023-07-27T20:32:39.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.122+0000 7f4f8e59c700 1 --2- 172.21.15.72:0/2949089116 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4f7006ad30 0x7f4f7006d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:39.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.122+0000 7f4f8e59c700 1 --2- 172.21.15.72:0/2949089116 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4f7006ad30 0x7f4f7006d1f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4f800090b0 tx=0x7f4f80010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:39.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.126+0000 7f4f7effd700 1 -- 172.21.15.72:0/2949089116 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4f840546c0 con 0x7f4f900c7740 2023-07-27T20:32:39.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.317+0000 7f4f94dff700 1 -- 172.21.15.72:0/2949089116 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4f9004e470 con 0x7f4f900c7740 2023-07-27T20:32:39.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.317+0000 7f4f7effd700 1 -- 172.21.15.72:0/2949089116 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4f84057ce0 con 0x7f4f900c7740 2023-07-27T20:32:39.305 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-27T20:32:39.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.320+0000 7f4f94dff700 1 -- 172.21.15.72:0/2949089116 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4f7006ad30 msgr2=0x7f4f7006d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:39.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.320+0000 7f4f94dff700 1 --2- 172.21.15.72:0/2949089116 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4f7006ad30 0x7f4f7006d1f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4f800090b0 tx=0x7f4f80010000 comp rx=0 tx=0).stop 2023-07-27T20:32:39.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.320+0000 7f4f94dff700 1 -- 172.21.15.72:0/2949089116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f900c7740 msgr2=0x7f4f900c0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:39.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.320+0000 7f4f94dff700 1 --2- 172.21.15.72:0/2949089116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f900c7740 0x7f4f900c0910 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4f8400ebb0 tx=0x7f4f8400ef70 comp rx=0 tx=0).stop 2023-07-27T20:32:39.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.320+0000 7f4f94dff700 1 -- 172.21.15.72:0/2949089116 shutdown_connections 2023-07-27T20:32:39.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.320+0000 7f4f94dff700 1 --2- 172.21.15.72:0/2949089116 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f9014aab0 0x7f4f900c2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:39.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.320+0000 7f4f94dff700 1 --2- 172.21.15.72:0/2949089116 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4f7006ad30 0x7f4f7006d1f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:39.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.320+0000 7f4f94dff700 1 --2- 172.21.15.72:0/2949089116 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4f900c4700 0x7f4f901475e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:39.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.320+0000 7f4f94dff700 1 --2- 172.21.15.72:0/2949089116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f900c7740 0x7f4f900c0910 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:39.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.320+0000 7f4f94dff700 1 -- 172.21.15.72:0/2949089116 >> 172.21.15.72:0/2949089116 conn(0x7f4f900ab3f0 msgr2=0x7f4f90152730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:39.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.320+0000 7f4f94dff700 1 -- 172.21.15.72:0/2949089116 shutdown_connections 2023-07-27T20:32:39.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.320+0000 7f4f94dff700 1 -- 172.21.15.72:0/2949089116 wait complete. 2023-07-27T20:32:39.325 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T20:32:39.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.536+0000 7f2bd47ff700 1 Processor -- start 2023-07-27T20:32:39.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.536+0000 7f2bd47ff700 1 -- start start 2023-07-27T20:32:39.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.537+0000 7f2bd47ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2bcc06e140 0x7f2bcc0ba310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:39.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.537+0000 7f2bd47ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2bcc0ba850 0x7f2bcc06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:39.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.537+0000 7f2bd47ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bcc06ce10 con 0x7f2bcc13b150 2023-07-27T20:32:39.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.537+0000 7f2bd47ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bcc152680 con 0x7f2bcc06e140 2023-07-27T20:32:39.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.537+0000 7f2bd47ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bcc152960 con 0x7f2bcc0ba850 2023-07-27T20:32:39.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.537+0000 7f2bd1d9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2bcc06e140 0x7f2bcc0ba310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:39.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.537+0000 7f2bd1d9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2bcc06e140 0x7f2bcc0ba310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57170/0 (socket says 172.21.15.72:57170) 2023-07-27T20:32:39.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.537+0000 7f2bd1d9a700 1 -- 172.21.15.72:0/539712086 learned_addr learned my addr 172.21.15.72:0/539712086 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:39.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.538+0000 7f2bd2d9c700 1 --2- 172.21.15.72:0/539712086 >> v2:172.21.15.173:3300/0 conn(0x7f2bcc0ba850 0x7f2bcc06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:39.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.538+0000 7f2bd1d9a700 1 -- 172.21.15.72:0/539712086 >> v2:172.21.15.173:3300/0 conn(0x7f2bcc0ba850 msgr2=0x7f2bcc06d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:39.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.538+0000 7f2bd1d9a700 1 --2- 172.21.15.72:0/539712086 >> v2:172.21.15.173:3300/0 conn(0x7f2bcc0ba850 0x7f2bcc06d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:39.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.538+0000 7f2bd1d9a700 1 -- 172.21.15.72:0/539712086 >> v1:172.21.15.173:6789/0 conn(0x7f2bcc13b150 legacy=0x7f2bcc151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:39.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.538+0000 7f2bd1d9a700 1 -- 172.21.15.72:0/539712086 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bcc152c40 con 0x7f2bcc06e140 2023-07-27T20:32:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.538+0000 7f2bd1d9a700 1 --2- 172.21.15.72:0/539712086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bcc06e140 0x7f2bcc0ba310 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc06e5a0 tx=0x7f2bbc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b0aeb496799c26 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.538+0000 7f2bd1599700 1 -- 172.21.15.72:0/539712086 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc004230 con 0x7f2bcc06e140 2023-07-27T20:32:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.538+0000 7f2bd1599700 1 -- 172.21.15.72:0/539712086 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bbc004390 con 0x7f2bcc06e140 2023-07-27T20:32:39.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.538+0000 7f2bd1599700 1 -- 172.21.15.72:0/539712086 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc0036a0 con 0x7f2bcc06e140 2023-07-27T20:32:39.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.539+0000 7f2bd47ff700 1 -- 172.21.15.72:0/539712086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bcc06e140 msgr2=0x7f2bcc0ba310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:39.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.539+0000 7f2bd47ff700 1 --2- 172.21.15.72:0/539712086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bcc06e140 0x7f2bcc0ba310 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc06e5a0 tx=0x7f2bbc009bd0 comp rx=0 tx=0).stop 2023-07-27T20:32:39.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.539+0000 7f2bd47ff700 1 -- 172.21.15.72:0/539712086 shutdown_connections 2023-07-27T20:32:39.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.539+0000 7f2bd47ff700 1 --2- 172.21.15.72:0/539712086 >> v2:172.21.15.173:3300/0 conn(0x7f2bcc0ba850 0x7f2bcc06d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:39.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.539+0000 7f2bd47ff700 1 --2- 172.21.15.72:0/539712086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bcc06e140 0x7f2bcc0ba310 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:39.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.539+0000 7f2bd47ff700 1 -- 172.21.15.72:0/539712086 >> 172.21.15.72:0/539712086 conn(0x7f2bcc06a190 msgr2=0x7f2bcc06a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:39.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.539+0000 7f2bd47ff700 1 -- 172.21.15.72:0/539712086 shutdown_connections 2023-07-27T20:32:39.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.539+0000 7f2bd47ff700 1 -- 172.21.15.72:0/539712086 wait complete. 2023-07-27T20:32:39.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.541+0000 7f2bd47ff700 1 Processor -- start 2023-07-27T20:32:39.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.541+0000 7f2bd47ff700 1 -- start start 2023-07-27T20:32:39.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.542+0000 7f2bd47ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bcc06e140 0x7f2bcc1e8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:39.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.542+0000 7f2bd47ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2bcc0ba850 0x7f2bcc1eaf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:39.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.542+0000 7f2bd47ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2bcc13b150 0x7f2bcc1eb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:39.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.542+0000 7f2bd47ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bcc14e930 con 0x7f2bcc06e140 2023-07-27T20:32:39.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.542+0000 7f2bd47ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bcc0c4040 con 0x7f2bcc13b150 2023-07-27T20:32:39.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.542+0000 7f2bd47ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bcc1eb9c0 con 0x7f2bcc0ba850 2023-07-27T20:32:39.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.542+0000 7f2bd259b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bcc06e140 0x7f2bcc1e8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:39.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.542+0000 7f2bd259b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bcc06e140 0x7f2bcc1e8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57180/0 (socket says 172.21.15.72:57180) 2023-07-27T20:32:39.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.542+0000 7f2bd259b700 1 -- 172.21.15.72:0/3986925524 learned_addr learned my addr 172.21.15.72:0/3986925524 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:39.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.542+0000 7f2bd2d9c700 1 --2- 172.21.15.72:0/3986925524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2bcc13b150 0x7f2bcc1eb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:39.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.542+0000 7f2bd259b700 1 -- 172.21.15.72:0/3986925524 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2bcc0ba850 msgr2=0x7f2bcc1eaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:39.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.542+0000 7f2bd1d9a700 1 --2- 172.21.15.72:0/3986925524 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2bcc0ba850 0x7f2bcc1eaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:39.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.542+0000 7f2bd259b700 1 --2- 172.21.15.72:0/3986925524 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2bcc0ba850 0x7f2bcc1eaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:39.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.542+0000 7f2bd259b700 1 -- 172.21.15.72:0/3986925524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2bcc13b150 msgr2=0x7f2bcc1eb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:39.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.542+0000 7f2bd259b700 1 --2- 172.21.15.72:0/3986925524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2bcc13b150 0x7f2bcc1eb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:39.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.542+0000 7f2bd259b700 1 -- 172.21.15.72:0/3986925524 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bbc009550 con 0x7f2bcc06e140 2023-07-27T20:32:39.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.542+0000 7f2bd2d9c700 1 --2- 172.21.15.72:0/3986925524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2bcc13b150 0x7f2bcc1eb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:39.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.542+0000 7f2bd1d9a700 1 --2- 172.21.15.72:0/3986925524 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2bcc0ba850 0x7f2bcc1eaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:32:39.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.543+0000 7f2bd259b700 1 --2- 172.21.15.72:0/3986925524 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bcc06e140 0x7f2bcc1e8bd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2bc800b4a0 tx=0x7f2bc800b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:39.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.543+0000 7f2bc2ffd700 1 -- 172.21.15.72:0/3986925524 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc8011830 con 0x7f2bcc06e140 2023-07-27T20:32:39.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.543+0000 7f2bc2ffd700 1 -- 172.21.15.72:0/3986925524 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc8011990 con 0x7f2bcc06e140 2023-07-27T20:32:39.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.543+0000 7f2bd47ff700 1 -- 172.21.15.72:0/3986925524 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bcc0c5e30 con 0x7f2bcc06e140 2023-07-27T20:32:39.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.543+0000 7f2bc2ffd700 1 -- 172.21.15.72:0/3986925524 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc8011d40 con 0x7f2bcc06e140 2023-07-27T20:32:39.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.543+0000 7f2bd47ff700 1 -- 172.21.15.72:0/3986925524 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bcc0c39f0 con 0x7f2bcc06e140 2023-07-27T20:32:39.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.544+0000 7f2bd47ff700 1 -- 172.21.15.72:0/3986925524 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bcc0ba310 con 0x7f2bcc06e140 2023-07-27T20:32:39.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.545+0000 7f2bc2ffd700 1 -- 172.21.15.72:0/3986925524 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2bc801a400 con 0x7f2bcc06e140 2023-07-27T20:32:39.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.546+0000 7f2bc2ffd700 1 --2- 172.21.15.72:0/3986925524 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f2bb006ace0 0x7f2bb006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:39.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.546+0000 7f2bc2ffd700 1 -- 172.21.15.72:0/3986925524 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2bc80894a0 con 0x7f2bcc06e140 2023-07-27T20:32:39.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.546+0000 7f2bd1d9a700 1 --2- 172.21.15.72:0/3986925524 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f2bb006ace0 0x7f2bb006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:39.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.547+0000 7f2bd1d9a700 1 --2- 172.21.15.72:0/3986925524 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f2bb006ace0 0x7f2bb006d1a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc14f960 tx=0x7f2bbc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:39.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.550+0000 7f2bc2ffd700 1 -- 172.21.15.72:0/3986925524 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2bc80542b0 con 0x7f2bcc06e140 2023-07-27T20:32:39.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.742+0000 7f2bd47ff700 1 -- 172.21.15.72:0/3986925524 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2bcc04e470 con 0x7f2bcc06e140 2023-07-27T20:32:39.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.742+0000 7f2bc2ffd700 1 -- 172.21.15.72:0/3986925524 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2bc80578d0 con 0x7f2bcc06e140 2023-07-27T20:32:39.730 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-27T20:32:39.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.745+0000 7f2bd47ff700 1 -- 172.21.15.72:0/3986925524 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f2bb006ace0 msgr2=0x7f2bb006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:39.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.745+0000 7f2bd47ff700 1 --2- 172.21.15.72:0/3986925524 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f2bb006ace0 0x7f2bb006d1a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc14f960 tx=0x7f2bbc008030 comp rx=0 tx=0).stop 2023-07-27T20:32:39.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.745+0000 7f2bd47ff700 1 -- 172.21.15.72:0/3986925524 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bcc06e140 msgr2=0x7f2bcc1e8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:39.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.745+0000 7f2bd47ff700 1 --2- 172.21.15.72:0/3986925524 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bcc06e140 0x7f2bcc1e8bd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2bc800b4a0 tx=0x7f2bc800b860 comp rx=0 tx=0).stop 2023-07-27T20:32:39.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.745+0000 7f2bd47ff700 1 -- 172.21.15.72:0/3986925524 shutdown_connections 2023-07-27T20:32:39.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.745+0000 7f2bd47ff700 1 --2- 172.21.15.72:0/3986925524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2bcc13b150 0x7f2bcc1eb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:39.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.745+0000 7f2bd47ff700 1 --2- 172.21.15.72:0/3986925524 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bcc06e140 0x7f2bcc1e8bd0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:39.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.745+0000 7f2bd47ff700 1 --2- 172.21.15.72:0/3986925524 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f2bb006ace0 0x7f2bb006d1a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:39.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.745+0000 7f2bd47ff700 1 --2- 172.21.15.72:0/3986925524 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2bcc0ba850 0x7f2bcc1eaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:39.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.745+0000 7f2bd47ff700 1 -- 172.21.15.72:0/3986925524 >> 172.21.15.72:0/3986925524 conn(0x7f2bcc06a190 msgr2=0x7f2bcc14fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:39.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.745+0000 7f2bd47ff700 1 -- 172.21.15.72:0/3986925524 shutdown_connections 2023-07-27T20:32:39.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.745+0000 7f2bd47ff700 1 -- 172.21.15.72:0/3986925524 wait complete. 2023-07-27T20:32:39.750 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T20:32:39.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.959+0000 7fd74dfff700 1 Processor -- start 2023-07-27T20:32:39.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.960+0000 7fd74dfff700 1 -- start start 2023-07-27T20:32:39.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.961+0000 7fd74dfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd74814aab0 0x7fd748154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:39.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.961+0000 7fd74dfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd74806c1d0 0x7fd74806c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:39.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.961+0000 7fd74dfff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7480c7c50 con 0x7fd7480c7740 2023-07-27T20:32:39.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.961+0000 7fd74dfff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd74806bd40 con 0x7fd74814aab0 2023-07-27T20:32:39.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.961+0000 7fd74dfff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7480c62f0 con 0x7fd74806c1d0 2023-07-27T20:32:39.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.962+0000 7fd7477fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd74814aab0 0x7fd748154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:39.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.962+0000 7fd7477fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd74814aab0 0x7fd748154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54820/0 (socket says 172.21.15.72:54820) 2023-07-27T20:32:39.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.962+0000 7fd7477fe700 1 -- 172.21.15.72:0/1892458985 learned_addr learned my addr 172.21.15.72:0/1892458985 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:39.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.962+0000 7fd747fff700 1 --2- 172.21.15.72:0/1892458985 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd74806c1d0 0x7fd74806c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:39.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.962+0000 7fd7477fe700 1 -- 172.21.15.72:0/1892458985 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd74806c1d0 msgr2=0x7fd74806c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:39.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.962+0000 7fd7477fe700 1 --2- 172.21.15.72:0/1892458985 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd74806c1d0 0x7fd74806c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:39.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.962+0000 7fd7477fe700 1 -- 172.21.15.72:0/1892458985 >> v1:172.21.15.173:6789/0 conn(0x7fd7480c7740 legacy=0x7fd7480c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:39.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.962+0000 7fd7477fe700 1 -- 172.21.15.72:0/1892458985 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd748155050 con 0x7fd74814aab0 2023-07-27T20:32:39.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.962+0000 7fd7477fe700 1 --2- 172.21.15.72:0/1892458985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd74814aab0 0x7fd748154b10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd7380098f0 tx=0x7fd738009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=706262a2d51a13 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:39.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.963+0000 7fd7467fc700 1 -- 172.21.15.72:0/1892458985 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73800b8a0 con 0x7fd74814aab0 2023-07-27T20:32:39.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.963+0000 7fd7467fc700 1 -- 172.21.15.72:0/1892458985 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd73800ba00 con 0x7fd74814aab0 2023-07-27T20:32:39.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.963+0000 7fd7467fc700 1 -- 172.21.15.72:0/1892458985 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73800bd90 con 0x7fd74814aab0 2023-07-27T20:32:39.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.963+0000 7fd74dfff700 1 -- 172.21.15.72:0/1892458985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd74814aab0 msgr2=0x7fd748154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:39.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.963+0000 7fd74dfff700 1 --2- 172.21.15.72:0/1892458985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd74814aab0 0x7fd748154b10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd7380098f0 tx=0x7fd738009c00 comp rx=0 tx=0).stop 2023-07-27T20:32:39.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.963+0000 7fd74dfff700 1 -- 172.21.15.72:0/1892458985 shutdown_connections 2023-07-27T20:32:39.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.963+0000 7fd74dfff700 1 --2- 172.21.15.72:0/1892458985 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd74806c1d0 0x7fd74806c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:39.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.963+0000 7fd74dfff700 1 --2- 172.21.15.72:0/1892458985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd74814aab0 0x7fd748154b10 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:39.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.963+0000 7fd74dfff700 1 -- 172.21.15.72:0/1892458985 >> 172.21.15.72:0/1892458985 conn(0x7fd7480ab3f0 msgr2=0x7fd7480ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:39.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.963+0000 7fd74dfff700 1 -- 172.21.15.72:0/1892458985 shutdown_connections 2023-07-27T20:32:39.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.963+0000 7fd74dfff700 1 -- 172.21.15.72:0/1892458985 wait complete. 2023-07-27T20:32:39.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.965+0000 7fd74dfff700 1 Processor -- start 2023-07-27T20:32:39.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.965+0000 7fd74dfff700 1 -- start start 2023-07-27T20:32:39.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.966+0000 7fd74dfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd74806c1d0 0x7fd748148cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:39.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.966+0000 7fd74dfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7480c7740 0x7fd748144c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:39.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.966+0000 7fd74dfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd74814aab0 0x7fd748145150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:39.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.966+0000 7fd74dfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd748157250 con 0x7fd74806c1d0 2023-07-27T20:32:39.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.966+0000 7fd74dfff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7481ede30 con 0x7fd7480c7740 2023-07-27T20:32:39.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.966+0000 7fd74dfff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd748156920 con 0x7fd74814aab0 2023-07-27T20:32:39.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.966+0000 7fd7477fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd74806c1d0 0x7fd748148cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:39.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.966+0000 7fd7477fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd74806c1d0 0x7fd748148cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54822/0 (socket says 172.21.15.72:54822) 2023-07-27T20:32:39.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.966+0000 7fd7477fe700 1 -- 172.21.15.72:0/3319488605 learned_addr learned my addr 172.21.15.72:0/3319488605 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:39.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.966+0000 7fd747fff700 1 --2- 172.21.15.72:0/3319488605 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd74814aab0 0x7fd748145150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:39.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.966+0000 7fd746ffd700 1 --2- 172.21.15.72:0/3319488605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7480c7740 0x7fd748144c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:39.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.966+0000 7fd7477fe700 1 -- 172.21.15.72:0/3319488605 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd74814aab0 msgr2=0x7fd748145150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:39.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.966+0000 7fd7477fe700 1 --2- 172.21.15.72:0/3319488605 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd74814aab0 0x7fd748145150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:39.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.966+0000 7fd7477fe700 1 -- 172.21.15.72:0/3319488605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7480c7740 msgr2=0x7fd748144c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:39.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.966+0000 7fd7477fe700 1 --2- 172.21.15.72:0/3319488605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7480c7740 0x7fd748144c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:39.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.966+0000 7fd7477fe700 1 -- 172.21.15.72:0/3319488605 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd738009550 con 0x7fd74806c1d0 2023-07-27T20:32:39.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.966+0000 7fd746ffd700 1 --2- 172.21.15.72:0/3319488605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7480c7740 0x7fd748144c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:32:39.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.967+0000 7fd7477fe700 1 --2- 172.21.15.72:0/3319488605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd74806c1d0 0x7fd748148cc0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd738009c40 tx=0x7fd738004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:39.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.967+0000 7fd72ffff700 1 -- 172.21.15.72:0/3319488605 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7380036a0 con 0x7fd74806c1d0 2023-07-27T20:32:39.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.967+0000 7fd72ffff700 1 -- 172.21.15.72:0/3319488605 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd73801e070 con 0x7fd74806c1d0 2023-07-27T20:32:39.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.967+0000 7fd74dfff700 1 -- 172.21.15.72:0/3319488605 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd748156c00 con 0x7fd74806c1d0 2023-07-27T20:32:39.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.967+0000 7fd72ffff700 1 -- 172.21.15.72:0/3319488605 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd738003a60 con 0x7fd74806c1d0 2023-07-27T20:32:39.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.967+0000 7fd74dfff700 1 -- 172.21.15.72:0/3319488605 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd748149200 con 0x7fd74806c1d0 2023-07-27T20:32:39.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.968+0000 7fd74dfff700 1 -- 172.21.15.72:0/3319488605 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd74804e470 con 0x7fd74806c1d0 2023-07-27T20:32:39.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.969+0000 7fd72ffff700 1 -- 172.21.15.72:0/3319488605 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd738003bc0 con 0x7fd74806c1d0 2023-07-27T20:32:39.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.970+0000 7fd72ffff700 1 --2- 172.21.15.72:0/3319488605 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd73406ace0 0x7fd73406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:39.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.970+0000 7fd72ffff700 1 -- 172.21.15.72:0/3319488605 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd738020070 con 0x7fd74806c1d0 2023-07-27T20:32:39.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.970+0000 7fd746ffd700 1 --2- 172.21.15.72:0/3319488605 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd73406ace0 0x7fd73406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:39.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.971+0000 7fd746ffd700 1 --2- 172.21.15.72:0/3319488605 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd73406ace0 0x7fd73406d1a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd7481e7800 tx=0x7fd73c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:39.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:39.974+0000 7fd72ffff700 1 -- 172.21.15.72:0/3319488605 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd738055a50 con 0x7fd74806c1d0 2023-07-27T20:32:40.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.172+0000 7fd74dfff700 1 -- 172.21.15.72:0/3319488605 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd74806cf00 con 0x7fd74806c1d0 2023-07-27T20:32:40.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.172+0000 7fd72ffff700 1 -- 172.21.15.72:0/3319488605 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd738059070 con 0x7fd74806c1d0 2023-07-27T20:32:40.160 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:32:40.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.175+0000 7fd74dfff700 1 -- 172.21.15.72:0/3319488605 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd73406ace0 msgr2=0x7fd73406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:40.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.175+0000 7fd74dfff700 1 --2- 172.21.15.72:0/3319488605 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd73406ace0 0x7fd73406d1a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd7481e7800 tx=0x7fd73c009040 comp rx=0 tx=0).stop 2023-07-27T20:32:40.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.175+0000 7fd74dfff700 1 -- 172.21.15.72:0/3319488605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd74806c1d0 msgr2=0x7fd748148cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:40.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.175+0000 7fd74dfff700 1 --2- 172.21.15.72:0/3319488605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd74806c1d0 0x7fd748148cc0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd738009c40 tx=0x7fd738004750 comp rx=0 tx=0).stop 2023-07-27T20:32:40.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.175+0000 7fd74dfff700 1 -- 172.21.15.72:0/3319488605 shutdown_connections 2023-07-27T20:32:40.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.175+0000 7fd74dfff700 1 --2- 172.21.15.72:0/3319488605 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd73406ace0 0x7fd73406d1a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:40.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.175+0000 7fd74dfff700 1 --2- 172.21.15.72:0/3319488605 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd74814aab0 0x7fd748145150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:40.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.175+0000 7fd74dfff700 1 --2- 172.21.15.72:0/3319488605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd74806c1d0 0x7fd748148cc0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:40.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.175+0000 7fd74dfff700 1 --2- 172.21.15.72:0/3319488605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7480c7740 0x7fd748144c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:40.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.175+0000 7fd74dfff700 1 -- 172.21.15.72:0/3319488605 >> 172.21.15.72:0/3319488605 conn(0x7fd7480ab3f0 msgr2=0x7fd7480aacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:40.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.175+0000 7fd74dfff700 1 -- 172.21.15.72:0/3319488605 shutdown_connections 2023-07-27T20:32:40.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.175+0000 7fd74dfff700 1 -- 172.21.15.72:0/3319488605 wait complete. 2023-07-27T20:32:40.180 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T20:32:40.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.392+0000 7f0fd57ff700 1 Processor -- start 2023-07-27T20:32:40.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.392+0000 7f0fd57ff700 1 -- start start 2023-07-27T20:32:40.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.394+0000 7f0fd57ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0fd01475a0 0x7f0fd01516c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:40.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.394+0000 7f0fd57ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0fd00c12f0 0x7f0fd00c1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:40.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.394+0000 7f0fd57ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fd00c2240 0x7f0fd00716f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:40.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.394+0000 7f0fd57ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fd0151c00 con 0x7f0fd01475a0 2023-07-27T20:32:40.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.394+0000 7f0fd57ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fd0154f50 con 0x7f0fd00c12f0 2023-07-27T20:32:40.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.394+0000 7f0fd57ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd0154340 con 0x7f0fd00c2240 2023-07-27T20:32:40.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.394+0000 7f0fceffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0fd01475a0 0x7f0fd01516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:40.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.394+0000 7f0fceffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0fd01475a0 0x7f0fd01516c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54828/0 (socket says 172.21.15.72:54828) 2023-07-27T20:32:40.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.394+0000 7f0fceffd700 1 -- 172.21.15.72:0/2433263691 learned_addr learned my addr 172.21.15.72:0/2433263691 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:40.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.394+0000 7f0fc7fff700 1 --2- 172.21.15.72:0/2433263691 >> v2:172.21.15.173:3300/0 conn(0x7f0fd00c12f0 0x7f0fd00c1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:40.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.394+0000 7f0fceffd700 1 -- 172.21.15.72:0/2433263691 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fd00c2240 msgr2=0x7f0fd00716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:40.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.394+0000 7f0fcf7fe700 1 --2- 172.21.15.72:0/2433263691 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fd00c2240 0x7f0fd00716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:40.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.394+0000 7f0fceffd700 1 --2- 172.21.15.72:0/2433263691 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fd00c2240 0x7f0fd00716f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:40.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.394+0000 7f0fceffd700 1 -- 172.21.15.72:0/2433263691 >> v2:172.21.15.173:3300/0 conn(0x7f0fd00c12f0 msgr2=0x7f0fd00c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:40.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.394+0000 7f0fceffd700 1 --2- 172.21.15.72:0/2433263691 >> v2:172.21.15.173:3300/0 conn(0x7f0fd00c12f0 0x7f0fd00c1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:40.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.394+0000 7f0fceffd700 1 -- 172.21.15.72:0/2433263691 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd0154620 con 0x7f0fd01475a0 2023-07-27T20:32:40.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.394+0000 7f0fc7fff700 1 --2- 172.21.15.72:0/2433263691 >> v2:172.21.15.173:3300/0 conn(0x7f0fd00c12f0 0x7f0fd00c1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:32:40.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.394+0000 7f0fcf7fe700 1 --2- 172.21.15.72:0/2433263691 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fd00c2240 0x7f0fd00716f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:32:40.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.395+0000 7f0fceffd700 1 --2- 172.21.15.72:0/2433263691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fd01475a0 0x7f0fd01516c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0fd014e780 tx=0x7f0fc0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa98c2289b86ee0a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:40.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.395+0000 7f0fce7fc700 1 -- 172.21.15.72:0/2433263691 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc000b870 con 0x7f0fd01475a0 2023-07-27T20:32:40.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.395+0000 7f0fce7fc700 1 -- 172.21.15.72:0/2433263691 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc000b9d0 con 0x7f0fd01475a0 2023-07-27T20:32:40.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.395+0000 7f0fce7fc700 1 -- 172.21.15.72:0/2433263691 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc000bd60 con 0x7f0fd01475a0 2023-07-27T20:32:40.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.395+0000 7f0fd57ff700 1 -- 172.21.15.72:0/2433263691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fd01475a0 msgr2=0x7f0fd01516c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:40.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.395+0000 7f0fd57ff700 1 --2- 172.21.15.72:0/2433263691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fd01475a0 0x7f0fd01516c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0fd014e780 tx=0x7f0fc0009bd0 comp rx=0 tx=0).stop 2023-07-27T20:32:40.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.395+0000 7f0fd57ff700 1 -- 172.21.15.72:0/2433263691 shutdown_connections 2023-07-27T20:32:40.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.395+0000 7f0fd57ff700 1 --2- 172.21.15.72:0/2433263691 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fd00c2240 0x7f0fd00716f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:40.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.395+0000 7f0fd57ff700 1 --2- 172.21.15.72:0/2433263691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fd01475a0 0x7f0fd01516c0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:40.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.395+0000 7f0fd57ff700 1 --2- 172.21.15.72:0/2433263691 >> v2:172.21.15.173:3300/0 conn(0x7f0fd00c12f0 0x7f0fd00c1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:40.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.396+0000 7f0fd57ff700 1 -- 172.21.15.72:0/2433263691 >> 172.21.15.72:0/2433263691 conn(0x7f0fd006a190 msgr2=0x7f0fd006a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:40.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.396+0000 7f0fd57ff700 1 -- 172.21.15.72:0/2433263691 shutdown_connections 2023-07-27T20:32:40.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.396+0000 7f0fd57ff700 1 -- 172.21.15.72:0/2433263691 wait complete. 2023-07-27T20:32:40.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.397+0000 7f0fd57ff700 1 Processor -- start 2023-07-27T20:32:40.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.397+0000 7f0fd57ff700 1 -- start start 2023-07-27T20:32:40.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.398+0000 7f0fd57ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fd00c12f0 0x7f0fd00c4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:40.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.398+0000 7f0fd57ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fd00c2240 0x7f0fd00a8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:40.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.398+0000 7f0fd57ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fd01475a0 0x7f0fd00a8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:40.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.398+0000 7f0fd57ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd0152080 con 0x7f0fd00c2240 2023-07-27T20:32:40.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.398+0000 7f0fd57ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd0151da0 con 0x7f0fd00c12f0 2023-07-27T20:32:40.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.398+0000 7f0fd57ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd0152d60 con 0x7f0fd01475a0 2023-07-27T20:32:40.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.398+0000 7f0fc7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fd00c2240 0x7f0fd00a8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:40.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.398+0000 7f0fc7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fd00c2240 0x7f0fd00a8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54840/0 (socket says 172.21.15.72:54840) 2023-07-27T20:32:40.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.398+0000 7f0fc7fff700 1 -- 172.21.15.72:0/3532731430 learned_addr learned my addr 172.21.15.72:0/3532731430 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:40.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.399+0000 7f0fceffd700 1 --2- 172.21.15.72:0/3532731430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fd00c12f0 0x7f0fd00c4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:40.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.399+0000 7f0fc7fff700 1 -- 172.21.15.72:0/3532731430 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fd01475a0 msgr2=0x7f0fd00a8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:40.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.399+0000 7f0fc7fff700 1 --2- 172.21.15.72:0/3532731430 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fd01475a0 0x7f0fd00a8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:40.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.399+0000 7f0fc7fff700 1 -- 172.21.15.72:0/3532731430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fd00c12f0 msgr2=0x7f0fd00c4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:40.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.399+0000 7f0fc7fff700 1 --2- 172.21.15.72:0/3532731430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fd00c12f0 0x7f0fd00c4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:40.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.399+0000 7f0fc7fff700 1 -- 172.21.15.72:0/3532731430 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc0009550 con 0x7f0fd00c2240 2023-07-27T20:32:40.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.399+0000 7f0fc7fff700 1 --2- 172.21.15.72:0/3532731430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fd00c2240 0x7f0fd00a8300 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0fb800c7f0 tx=0x7f0fb800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:40.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.399+0000 7f0fc77fe700 1 -- 172.21.15.72:0/3532731430 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb8011800 con 0x7f0fd00c2240 2023-07-27T20:32:40.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.399+0000 7f0fc77fe700 1 -- 172.21.15.72:0/3532731430 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb8011960 con 0x7f0fd00c2240 2023-07-27T20:32:40.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.399+0000 7f0fd57ff700 1 -- 172.21.15.72:0/3532731430 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fd0153040 con 0x7f0fd00c2240 2023-07-27T20:32:40.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.399+0000 7f0fc77fe700 1 -- 172.21.15.72:0/3532731430 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb8011d10 con 0x7f0fd00c2240 2023-07-27T20:32:40.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.400+0000 7f0fd57ff700 1 -- 172.21.15.72:0/3532731430 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fd006e3a0 con 0x7f0fd00c2240 2023-07-27T20:32:40.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.400+0000 7f0fd57ff700 1 -- 172.21.15.72:0/3532731430 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fd004e470 con 0x7f0fd00c2240 2023-07-27T20:32:40.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.401+0000 7f0fc77fe700 1 -- 172.21.15.72:0/3532731430 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0fb8018360 con 0x7f0fd00c2240 2023-07-27T20:32:40.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.402+0000 7f0fc77fe700 1 --2- 172.21.15.72:0/3532731430 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0fb006ace0 0x7f0fb006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:40.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.402+0000 7f0fc77fe700 1 -- 172.21.15.72:0/3532731430 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0fb80897f0 con 0x7f0fd00c2240 2023-07-27T20:32:40.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.403+0000 7f0fceffd700 1 --2- 172.21.15.72:0/3532731430 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0fb006ace0 0x7f0fb006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:40.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.403+0000 7f0fceffd700 1 --2- 172.21.15.72:0/3532731430 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0fb006ace0 0x7f0fb006d1a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0009c10 tx=0x7f0fc0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:40.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.406+0000 7f0fc77fe700 1 -- 172.21.15.72:0/3532731430 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0fb8057ff0 con 0x7f0fd00c2240 2023-07-27T20:32:40.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.601+0000 7f0fd57ff700 1 -- 172.21.15.72:0/3532731430 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0fd00c10d0 con 0x7f0fd00c2240 2023-07-27T20:32:40.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.602+0000 7f0fc77fe700 1 -- 172.21.15.72:0/3532731430 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0fb8057b80 con 0x7f0fd00c2240 2023-07-27T20:32:40.589 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-27T20:32:40.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.604+0000 7f0fd57ff700 1 -- 172.21.15.72:0/3532731430 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0fb006ace0 msgr2=0x7f0fb006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:40.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.604+0000 7f0fd57ff700 1 --2- 172.21.15.72:0/3532731430 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0fb006ace0 0x7f0fb006d1a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0009c10 tx=0x7f0fc0008030 comp rx=0 tx=0).stop 2023-07-27T20:32:40.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.604+0000 7f0fd57ff700 1 -- 172.21.15.72:0/3532731430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fd00c2240 msgr2=0x7f0fd00a8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:40.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.604+0000 7f0fd57ff700 1 --2- 172.21.15.72:0/3532731430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fd00c2240 0x7f0fd00a8300 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0fb800c7f0 tx=0x7f0fb800cbb0 comp rx=0 tx=0).stop 2023-07-27T20:32:40.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.604+0000 7f0fd57ff700 1 -- 172.21.15.72:0/3532731430 shutdown_connections 2023-07-27T20:32:40.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.604+0000 7f0fd57ff700 1 --2- 172.21.15.72:0/3532731430 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0fb006ace0 0x7f0fb006d1a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:40.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.604+0000 7f0fd57ff700 1 --2- 172.21.15.72:0/3532731430 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fd01475a0 0x7f0fd00a8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:40.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.604+0000 7f0fd57ff700 1 --2- 172.21.15.72:0/3532731430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fd00c12f0 0x7f0fd00c4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:40.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.604+0000 7f0fd57ff700 1 --2- 172.21.15.72:0/3532731430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fd00c2240 0x7f0fd00a8300 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:40.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.604+0000 7f0fd57ff700 1 -- 172.21.15.72:0/3532731430 >> 172.21.15.72:0/3532731430 conn(0x7f0fd006a190 msgr2=0x7f0fd01599a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:40.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.604+0000 7f0fd57ff700 1 -- 172.21.15.72:0/3532731430 shutdown_connections 2023-07-27T20:32:40.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.604+0000 7f0fd57ff700 1 -- 172.21.15.72:0/3532731430 wait complete. 2023-07-27T20:32:40.610 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-27T20:32:40.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.821+0000 7febfddff700 1 Processor -- start 2023-07-27T20:32:40.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.821+0000 7febfddff700 1 -- start start 2023-07-27T20:32:40.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.822+0000 7febfddff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7febf814aab0 0x7febf8154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:40.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.822+0000 7febfddff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7febf80c7740 0x7febf80c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:40.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.822+0000 7febfddff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febf80c7c50 con 0x7febf80c4700 2023-07-27T20:32:40.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.822+0000 7febfddff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febf806bd40 con 0x7febf80c7740 2023-07-27T20:32:40.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.822+0000 7febfddff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf80c62f0 con 0x7febf814aab0 2023-07-27T20:32:40.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.822+0000 7febf6ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7febf80c7740 0x7febf80c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:40.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.822+0000 7febf7fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7febf80c4700 0x7febf806c1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58632/0 (socket says 172.21.15.72:58632) 2023-07-27T20:32:40.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.822+0000 7febf7fff700 1 -- 172.21.15.72:0/249839730 learned_addr learned my addr 172.21.15.72:0/249839730 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:40.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.822+0000 7febf6ffd700 1 --2- 172.21.15.72:0/249839730 >> v2:172.21.15.72:3300/0 conn(0x7febf80c7740 0x7febf80c41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54856/0 (socket says 172.21.15.72:54856) 2023-07-27T20:32:40.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.822+0000 7febf77fe700 1 --2- 172.21.15.72:0/249839730 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7febf814aab0 0x7febf8154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:40.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.823+0000 7febf6ffd700 1 -- 172.21.15.72:0/249839730 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7febf814aab0 msgr2=0x7febf8154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:40.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.823+0000 7febf6ffd700 1 --2- 172.21.15.72:0/249839730 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7febf814aab0 0x7febf8154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:40.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.823+0000 7febf6ffd700 1 -- 172.21.15.72:0/249839730 >> v1:172.21.15.72:6789/0 conn(0x7febf80c4700 legacy=0x7febf806c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:40.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.823+0000 7febf6ffd700 1 -- 172.21.15.72:0/249839730 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf8155050 con 0x7febf80c7740 2023-07-27T20:32:40.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.823+0000 7febf67fc700 1 -- 172.21.15.72:0/249839730 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3526519749 0 0) 0x7febf80c7c50 con 0x7febf80c4700 2023-07-27T20:32:40.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.823+0000 7febf6ffd700 1 --2- 172.21.15.72:0/249839730 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febf80c7740 0x7febf80c41c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7febec009840 tx=0x7febec009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d6d1ef6b89b4d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:40.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.823+0000 7febf67fc700 1 -- 172.21.15.72:0/249839730 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec011830 con 0x7febf80c7740 2023-07-27T20:32:40.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.823+0000 7febf67fc700 1 -- 172.21.15.72:0/249839730 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febec011990 con 0x7febf80c7740 2023-07-27T20:32:40.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.823+0000 7febf67fc700 1 -- 172.21.15.72:0/249839730 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec011d20 con 0x7febf80c7740 2023-07-27T20:32:40.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.824+0000 7febfddff700 1 -- 172.21.15.72:0/249839730 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febf80c7740 msgr2=0x7febf80c41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:40.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.824+0000 7febfddff700 1 --2- 172.21.15.72:0/249839730 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febf80c7740 0x7febf80c41c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7febec009840 tx=0x7febec009b50 comp rx=0 tx=0).stop 2023-07-27T20:32:40.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.824+0000 7febfddff700 1 -- 172.21.15.72:0/249839730 shutdown_connections 2023-07-27T20:32:40.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.824+0000 7febfddff700 1 --2- 172.21.15.72:0/249839730 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7febf814aab0 0x7febf8154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:40.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.824+0000 7febfddff700 1 --2- 172.21.15.72:0/249839730 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febf80c7740 0x7febf80c41c0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:40.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.824+0000 7febfddff700 1 -- 172.21.15.72:0/249839730 >> 172.21.15.72:0/249839730 conn(0x7febf80ab3f0 msgr2=0x7febf80ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:40.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.824+0000 7febfddff700 1 -- 172.21.15.72:0/249839730 shutdown_connections 2023-07-27T20:32:40.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.824+0000 7febfddff700 1 -- 172.21.15.72:0/249839730 wait complete. 2023-07-27T20:32:40.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.826+0000 7febfddff700 1 Processor -- start 2023-07-27T20:32:40.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.826+0000 7febfddff700 1 -- start start 2023-07-27T20:32:40.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.826+0000 7febfddff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7febf80c4700 0x7febf80bd420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:40.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.826+0000 7febfddff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febf80c7740 0x7febf81ea160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:40.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.827+0000 7febfddff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7febf814aab0 0x7febf80bfe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:40.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.827+0000 7febfddff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf80bde00 con 0x7febf80c7740 2023-07-27T20:32:40.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.827+0000 7febfddff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf81ea6a0 con 0x7febf814aab0 2023-07-27T20:32:40.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.827+0000 7febfddff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf8147480 con 0x7febf80c4700 2023-07-27T20:32:40.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.827+0000 7febf6ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febf80c7740 0x7febf81ea160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:40.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.827+0000 7febf6ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febf80c7740 0x7febf81ea160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54864/0 (socket says 172.21.15.72:54864) 2023-07-27T20:32:40.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.827+0000 7febf6ffd700 1 -- 172.21.15.72:0/1945069356 learned_addr learned my addr 172.21.15.72:0/1945069356 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:40.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.827+0000 7febf77fe700 1 --2- 172.21.15.72:0/1945069356 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7febf80c4700 0x7febf80bd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:40.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.827+0000 7febf7fff700 1 --2- 172.21.15.72:0/1945069356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7febf814aab0 0x7febf80bfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:40.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.827+0000 7febf6ffd700 1 -- 172.21.15.72:0/1945069356 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7febf80c4700 msgr2=0x7febf80bd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:40.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.827+0000 7febf6ffd700 1 --2- 172.21.15.72:0/1945069356 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7febf80c4700 0x7febf80bd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:40.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.827+0000 7febf6ffd700 1 -- 172.21.15.72:0/1945069356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7febf814aab0 msgr2=0x7febf80bfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:40.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.827+0000 7febf6ffd700 1 --2- 172.21.15.72:0/1945069356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7febf814aab0 0x7febf80bfe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:40.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.827+0000 7febf6ffd700 1 -- 172.21.15.72:0/1945069356 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febec0094a0 con 0x7febf80c7740 2023-07-27T20:32:40.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.827+0000 7febf7fff700 1 --2- 172.21.15.72:0/1945069356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7febf814aab0 0x7febf80bfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:40.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.827+0000 7febf6ffd700 1 --2- 172.21.15.72:0/1945069356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febf80c7740 0x7febf81ea160 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7febec0090b0 tx=0x7febec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:40.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.828+0000 7febdffff700 1 -- 172.21.15.72:0/1945069356 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec0036a0 con 0x7febf80c7740 2023-07-27T20:32:40.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.828+0000 7febdffff700 1 -- 172.21.15.72:0/1945069356 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febec01f070 con 0x7febf80c7740 2023-07-27T20:32:40.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.828+0000 7febfddff700 1 -- 172.21.15.72:0/1945069356 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febf80be9a0 con 0x7febf80c7740 2023-07-27T20:32:40.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.828+0000 7febdffff700 1 -- 172.21.15.72:0/1945069356 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec003a40 con 0x7febf80c7740 2023-07-27T20:32:40.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.828+0000 7febfddff700 1 -- 172.21.15.72:0/1945069356 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf80be350 con 0x7febf80c7740 2023-07-27T20:32:40.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.829+0000 7febfddff700 1 -- 172.21.15.72:0/1945069356 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febf80be1b0 con 0x7febf80c7740 2023-07-27T20:32:40.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.830+0000 7febdffff700 1 -- 172.21.15.72:0/1945069356 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7febec003ba0 con 0x7febf80c7740 2023-07-27T20:32:40.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.830+0000 7febdffff700 1 --2- 172.21.15.72:0/1945069356 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7febe406ace0 0x7febe406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:40.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.831+0000 7febdffff700 1 -- 172.21.15.72:0/1945069356 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7febec021070 con 0x7febf80c7740 2023-07-27T20:32:40.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.831+0000 7febf77fe700 1 --2- 172.21.15.72:0/1945069356 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7febe406ace0 0x7febe406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:40.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.832+0000 7febf77fe700 1 --2- 172.21.15.72:0/1945069356 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7febe406ace0 0x7febe406d1a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7febe8009b40 tx=0x7febe8009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:40.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:40.835+0000 7febdffff700 1 -- 172.21.15.72:0/1945069356 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7febf80be1b0 con 0x7febf80c7740 2023-07-27T20:32:41.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.027+0000 7febfddff700 1 -- 172.21.15.72:0/1945069356 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7febf80be1b0 con 0x7febf80c7740 2023-07-27T20:32:41.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.028+0000 7febdffff700 1 -- 172.21.15.72:0/1945069356 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7febf80be1b0 con 0x7febf80c7740 2023-07-27T20:32:41.015 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:32:41.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.030+0000 7febfddff700 1 -- 172.21.15.72:0/1945069356 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7febe406ace0 msgr2=0x7febe406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:41.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.030+0000 7febfddff700 1 --2- 172.21.15.72:0/1945069356 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7febe406ace0 0x7febe406d1a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7febe8009b40 tx=0x7febe8009210 comp rx=0 tx=0).stop 2023-07-27T20:32:41.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.030+0000 7febfddff700 1 -- 172.21.15.72:0/1945069356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febf80c7740 msgr2=0x7febf81ea160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:41.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.030+0000 7febfddff700 1 --2- 172.21.15.72:0/1945069356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febf80c7740 0x7febf81ea160 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7febec0090b0 tx=0x7febec004750 comp rx=0 tx=0).stop 2023-07-27T20:32:41.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.030+0000 7febfddff700 1 -- 172.21.15.72:0/1945069356 shutdown_connections 2023-07-27T20:32:41.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.030+0000 7febfddff700 1 --2- 172.21.15.72:0/1945069356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7febf814aab0 0x7febf80bfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:41.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.030+0000 7febfddff700 1 --2- 172.21.15.72:0/1945069356 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7febe406ace0 0x7febe406d1a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:41.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.030+0000 7febfddff700 1 --2- 172.21.15.72:0/1945069356 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7febf80c4700 0x7febf80bd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:41.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.030+0000 7febfddff700 1 --2- 172.21.15.72:0/1945069356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febf80c7740 0x7febf81ea160 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:41.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.030+0000 7febfddff700 1 -- 172.21.15.72:0/1945069356 >> 172.21.15.72:0/1945069356 conn(0x7febf80ab3f0 msgr2=0x7febf80c7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:41.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.030+0000 7febfddff700 1 -- 172.21.15.72:0/1945069356 shutdown_connections 2023-07-27T20:32:41.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.030+0000 7febfddff700 1 -- 172.21.15.72:0/1945069356 wait complete. 2023-07-27T20:32:41.036 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-27T20:32:41.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.248+0000 7f7bfc1ff700 1 Processor -- start 2023-07-27T20:32:41.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.248+0000 7f7bfc1ff700 1 -- start start 2023-07-27T20:32:41.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.249+0000 7f7bfc1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7bf40c7710 0x7f7bf41514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:41.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.249+0000 7f7bfc1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bf4155100 con 0x7f7bf406b150 2023-07-27T20:32:41.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.249+0000 7f7bfc1ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bf40c7af0 con 0x7f7bf40c4400 2023-07-27T20:32:41.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.249+0000 7f7bfc1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf41545d0 con 0x7f7bf40c7710 2023-07-27T20:32:41.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.249+0000 7f7bf979a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7bf406b150 0x7f7bf41549f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58636/0 (socket says 172.21.15.72:58636) 2023-07-27T20:32:41.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.249+0000 7f7bf979a700 1 -- 172.21.15.72:0/2064362516 learned_addr learned my addr 172.21.15.72:0/2064362516 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:41.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.249+0000 7f7bfa79c700 1 --2- 172.21.15.72:0/2064362516 >> v2:172.21.15.72:3300/0 conn(0x7f7bf40c7710 0x7f7bf41514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:41.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.250+0000 7f7bf8f99700 1 -- 172.21.15.72:0/2064362516 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2847274097 0 0) 0x7f7bf4155100 con 0x7f7bf406b150 2023-07-27T20:32:41.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.250+0000 7f7bf8f99700 1 -- 172.21.15.72:0/2064362516 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7be00035b0 con 0x7f7bf406b150 2023-07-27T20:32:41.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.250+0000 7f7bfa79c700 1 -- 172.21.15.72:0/2064362516 >> v1:172.21.15.173:6789/0 conn(0x7f7bf40c4400 legacy=0x7f7bf40c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:41.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.250+0000 7f7bfa79c700 1 -- 172.21.15.72:0/2064362516 >> v1:172.21.15.72:6789/0 conn(0x7f7bf406b150 legacy=0x7f7bf41549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:41.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.250+0000 7f7bfa79c700 1 -- 172.21.15.72:0/2064362516 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf406b710 con 0x7f7bf40c7710 2023-07-27T20:32:41.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.250+0000 7f7bfa79c700 1 --2- 172.21.15.72:0/2064362516 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bf40c7710 0x7f7bf41514a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7bec009d90 tx=0x7f7bec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=400d0368ac82be01 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:41.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.250+0000 7f7bf8f99700 1 -- 172.21.15.72:0/2064362516 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bec00e070 con 0x7f7bf40c7710 2023-07-27T20:32:41.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.250+0000 7f7bf8f99700 1 -- 172.21.15.72:0/2064362516 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bec00bb20 con 0x7f7bf40c7710 2023-07-27T20:32:41.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.250+0000 7f7bf8f99700 1 -- 172.21.15.72:0/2064362516 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bec012430 con 0x7f7bf40c7710 2023-07-27T20:32:41.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.251+0000 7f7bfc1ff700 1 -- 172.21.15.72:0/2064362516 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bf40c7710 msgr2=0x7f7bf41514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:41.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.251+0000 7f7bfc1ff700 1 --2- 172.21.15.72:0/2064362516 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bf40c7710 0x7f7bf41514a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7bec009d90 tx=0x7f7bec00b330 comp rx=0 tx=0).stop 2023-07-27T20:32:41.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.251+0000 7f7bfc1ff700 1 -- 172.21.15.72:0/2064362516 shutdown_connections 2023-07-27T20:32:41.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.251+0000 7f7bfc1ff700 1 --2- 172.21.15.72:0/2064362516 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bf40c7710 0x7f7bf41514a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:41.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.251+0000 7f7bfc1ff700 1 -- 172.21.15.72:0/2064362516 >> 172.21.15.72:0/2064362516 conn(0x7f7bf40ab300 msgr2=0x7f7bf40ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:41.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.251+0000 7f7bfc1ff700 1 -- 172.21.15.72:0/2064362516 shutdown_connections 2023-07-27T20:32:41.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.251+0000 7f7bfc1ff700 1 -- 172.21.15.72:0/2064362516 wait complete. 2023-07-27T20:32:41.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.252+0000 7f7bfc1ff700 1 Processor -- start 2023-07-27T20:32:41.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.253+0000 7f7bfc1ff700 1 -- start start 2023-07-27T20:32:41.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.253+0000 7f7bfc1ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7bf406b150 0x7f7bf4148120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:41.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.253+0000 7f7bfc1ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7bf40c4400 0x7f7bf41e9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:41.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.253+0000 7f7bfc1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bf40c7710 0x7f7bf40ae660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:41.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.253+0000 7f7bfc1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf41dddc0 con 0x7f7bf40c7710 2023-07-27T20:32:41.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.253+0000 7f7bfc1ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf41de0a0 con 0x7f7bf406b150 2023-07-27T20:32:41.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.253+0000 7f7bfc1ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf41de380 con 0x7f7bf40c4400 2023-07-27T20:32:41.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.254+0000 7f7bfa79c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bf40c7710 0x7f7bf40ae660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:41.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.254+0000 7f7bfa79c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bf40c7710 0x7f7bf40ae660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54894/0 (socket says 172.21.15.72:54894) 2023-07-27T20:32:41.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.254+0000 7f7bfa79c700 1 -- 172.21.15.72:0/446276444 learned_addr learned my addr 172.21.15.72:0/446276444 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:41.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.254+0000 7f7bf9f9b700 1 --2- 172.21.15.72:0/446276444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7bf406b150 0x7f7bf4148120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:41.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.254+0000 7f7bf979a700 1 --2- 172.21.15.72:0/446276444 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7bf40c4400 0x7f7bf41e9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:41.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.254+0000 7f7bfa79c700 1 -- 172.21.15.72:0/446276444 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7bf40c4400 msgr2=0x7f7bf41e9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:41.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.254+0000 7f7bfa79c700 1 --2- 172.21.15.72:0/446276444 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7bf40c4400 0x7f7bf41e9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:41.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.254+0000 7f7bfa79c700 1 -- 172.21.15.72:0/446276444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7bf406b150 msgr2=0x7f7bf4148120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:41.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.254+0000 7f7bfa79c700 1 --2- 172.21.15.72:0/446276444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7bf406b150 0x7f7bf4148120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:41.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.254+0000 7f7bfa79c700 1 -- 172.21.15.72:0/446276444 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bec009a70 con 0x7f7bf40c7710 2023-07-27T20:32:41.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.255+0000 7f7bfa79c700 1 --2- 172.21.15.72:0/446276444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bf40c7710 0x7f7bf40ae660 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7bf408b450 tx=0x7f7bec004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:41.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.255+0000 7f7bea7fc700 1 -- 172.21.15.72:0/446276444 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bec012430 con 0x7f7bf40c7710 2023-07-27T20:32:41.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.255+0000 7f7bea7fc700 1 -- 172.21.15.72:0/446276444 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bec020070 con 0x7f7bf40c7710 2023-07-27T20:32:41.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.255+0000 7f7bfc1ff700 1 -- 172.21.15.72:0/446276444 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf41e9560 con 0x7f7bf40c7710 2023-07-27T20:32:41.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.255+0000 7f7bea7fc700 1 -- 172.21.15.72:0/446276444 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bec004280 con 0x7f7bf40c7710 2023-07-27T20:32:41.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.255+0000 7f7bfc1ff700 1 -- 172.21.15.72:0/446276444 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf41e9210 con 0x7f7bf40c7710 2023-07-27T20:32:41.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.256+0000 7f7bfc1ff700 1 -- 172.21.15.72:0/446276444 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bf41e9750 con 0x7f7bf40c7710 2023-07-27T20:32:41.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.257+0000 7f7bea7fc700 1 -- 172.21.15.72:0/446276444 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7bec0043e0 con 0x7f7bf40c7710 2023-07-27T20:32:41.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.258+0000 7f7bea7fc700 1 --2- 172.21.15.72:0/446276444 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f7bd806ace0 0x7f7bd806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:41.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.259+0000 7f7bea7fc700 1 -- 172.21.15.72:0/446276444 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7bec022070 con 0x7f7bf40c7710 2023-07-27T20:32:41.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.259+0000 7f7bf9f9b700 1 --2- 172.21.15.72:0/446276444 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f7bd806ace0 0x7f7bd806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:41.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.260+0000 7f7bf9f9b700 1 --2- 172.21.15.72:0/446276444 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f7bd806ace0 0x7f7bd806d1a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7bf0007fd0 tx=0x7f7bf0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:41.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.263+0000 7f7bea7fc700 1 -- 172.21.15.72:0/446276444 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7bec0565c0 con 0x7f7bf40c7710 2023-07-27T20:32:41.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.469+0000 7f7bfc1ff700 1 -- 172.21.15.72:0/446276444 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7bf4074310 con 0x7f7bf40c7710 2023-07-27T20:32:41.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.470+0000 7f7bea7fc700 1 -- 172.21.15.72:0/446276444 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7bec059be0 con 0x7f7bf40c7710 2023-07-27T20:32:41.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.472+0000 7f7bfc1ff700 1 -- 172.21.15.72:0/446276444 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f7bd806ace0 msgr2=0x7f7bd806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:41.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.472+0000 7f7bfc1ff700 1 --2- 172.21.15.72:0/446276444 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f7bd806ace0 0x7f7bd806d1a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7bf0007fd0 tx=0x7f7bf0009040 comp rx=0 tx=0).stop 2023-07-27T20:32:41.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.472+0000 7f7bfc1ff700 1 -- 172.21.15.72:0/446276444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bf40c7710 msgr2=0x7f7bf40ae660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:41.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.472+0000 7f7bfc1ff700 1 --2- 172.21.15.72:0/446276444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bf40c7710 0x7f7bf40ae660 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7bf408b450 tx=0x7f7bec004ad0 comp rx=0 tx=0).stop 2023-07-27T20:32:41.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.472+0000 7f7bfc1ff700 1 -- 172.21.15.72:0/446276444 shutdown_connections 2023-07-27T20:32:41.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.472+0000 7f7bfc1ff700 1 --2- 172.21.15.72:0/446276444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bf40c7710 0x7f7bf40ae660 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:41.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.472+0000 7f7bfc1ff700 1 --2- 172.21.15.72:0/446276444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7bf406b150 0x7f7bf4148120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:41.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.472+0000 7f7bfc1ff700 1 --2- 172.21.15.72:0/446276444 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f7bd806ace0 0x7f7bd806d1a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:41.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.472+0000 7f7bfc1ff700 1 --2- 172.21.15.72:0/446276444 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7bf40c4400 0x7f7bf41e9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:41.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.472+0000 7f7bfc1ff700 1 -- 172.21.15.72:0/446276444 >> 172.21.15.72:0/446276444 conn(0x7f7bf40ab300 msgr2=0x7f7bf4149de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:41.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.472+0000 7f7bfc1ff700 1 -- 172.21.15.72:0/446276444 shutdown_connections 2023-07-27T20:32:41.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.472+0000 7f7bfc1ff700 1 -- 172.21.15.72:0/446276444 wait complete. 2023-07-27T20:32:41.462 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-07-27T20:32:41.477 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi173.front.sepia.ceph.com... 2023-07-27T20:32:41.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:32:41.478 DEBUG:teuthology.orchestra.run.smithi173:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-07-27T20:32:41.557 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T20:32:41.557 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi173.front.sepia.ceph.com 2023-07-27T20:32:41.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:32:41.558 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-27T20:32:41.659 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-07-27T20:32:41.659 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T20:32:41.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.866+0000 7f23961ff700 1 Processor -- start 2023-07-27T20:32:41.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.866+0000 7f23961ff700 1 -- start start 2023-07-27T20:32:41.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.867+0000 7f23961ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f23900aab30 0x7f23900a8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:41.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.868+0000 7f23961ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2390155600 con 0x7f239013b2c0 2023-07-27T20:32:41.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.868+0000 7f23961ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2390155320 con 0x7f23900bfd90 2023-07-27T20:32:41.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.868+0000 7f23961ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23900a9620 con 0x7f23900aab30 2023-07-27T20:32:41.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.868+0000 7f238f7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f239013b2c0 0x7f23900aa420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58642/0 (socket says 172.21.15.72:58642) 2023-07-27T20:32:41.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.868+0000 7f238f7fe700 1 -- 172.21.15.72:0/399409307 learned_addr learned my addr 172.21.15.72:0/399409307 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:41.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.868+0000 7f238ffff700 1 --2- 172.21.15.72:0/399409307 >> v2:172.21.15.173:3300/0 conn(0x7f23900aab30 0x7f23900a8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:41.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.868+0000 7f238effd700 1 -- 172.21.15.72:0/399409307 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3098063775 0 0) 0x7f2390155600 con 0x7f239013b2c0 2023-07-27T20:32:41.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.868+0000 7f238effd700 1 -- 172.21.15.72:0/399409307 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f237c0035b0 con 0x7f239013b2c0 2023-07-27T20:32:41.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.868+0000 7f238effd700 1 -- 172.21.15.72:0/399409307 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4047301190 0 0) 0x7f237c0035b0 con 0x7f239013b2c0 2023-07-27T20:32:41.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.868+0000 7f238effd700 1 -- 172.21.15.72:0/399409307 >> v2:172.21.15.173:3300/0 conn(0x7f23900aab30 msgr2=0x7f23900a8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:41.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.868+0000 7f238effd700 1 --2- 172.21.15.72:0/399409307 >> v2:172.21.15.173:3300/0 conn(0x7f23900aab30 0x7f23900a8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:41.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.868+0000 7f238effd700 1 -- 172.21.15.72:0/399409307 >> v1:172.21.15.173:6789/0 conn(0x7f23900bfd90 legacy=0x7f23900a83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:41.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.868+0000 7f238effd700 1 -- 172.21.15.72:0/399409307 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2390151e40 con 0x7f239013b2c0 2023-07-27T20:32:41.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.868+0000 7f238effd700 1 -- 172.21.15.72:0/399409307 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f2380001670 con 0x7f239013b2c0 2023-07-27T20:32:41.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.869+0000 7f238effd700 1 -- 172.21.15.72:0/399409307 >> v1:172.21.15.72:6789/0 conn(0x7f239013b2c0 legacy=0x7f23900aa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:41.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.869+0000 7f238effd700 1 --2- 172.21.15.72:0/399409307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f237c003a00 0x7f237c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:41.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.869+0000 7f238effd700 1 --2- 172.21.15.72:0/399409307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f237c004400 0x7f237c0048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:41.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.869+0000 7f238effd700 1 --2- 172.21.15.72:0/399409307 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f237c0050d0 0x7f237c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:41.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.869+0000 7f238effd700 1 -- 172.21.15.72:0/399409307 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23900a9620 con 0x7f237c004400 2023-07-27T20:32:41.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.869+0000 7f238effd700 1 -- 172.21.15.72:0/399409307 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237c00c030 con 0x7f237c003a00 2023-07-27T20:32:41.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.869+0000 7f238effd700 1 -- 172.21.15.72:0/399409307 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f237c00c1f0 con 0x7f237c0050d0 2023-07-27T20:32:41.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.869+0000 7f2387fff700 1 --2- 172.21.15.72:0/399409307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f237c004400 0x7f237c0048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:41.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.869+0000 7f238f7fe700 1 --2- 172.21.15.72:0/399409307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f237c003a00 0x7f237c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:41.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.869+0000 7f238ffff700 1 --2- 172.21.15.72:0/399409307 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f237c0050d0 0x7f237c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:41.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.869+0000 7f2387fff700 1 -- 172.21.15.72:0/399409307 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f237c0050d0 msgr2=0x7f237c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:41.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.869+0000 7f2387fff700 1 --2- 172.21.15.72:0/399409307 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f237c0050d0 0x7f237c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:41.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.869+0000 7f2387fff700 1 -- 172.21.15.72:0/399409307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f237c003a00 msgr2=0x7f237c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:41.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.869+0000 7f2387fff700 1 --2- 172.21.15.72:0/399409307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f237c003a00 0x7f237c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:41.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.869+0000 7f2387fff700 1 -- 172.21.15.72:0/399409307 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f237c0035b0 con 0x7f237c004400 2023-07-27T20:32:41.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.869+0000 7f238ffff700 1 --2- 172.21.15.72:0/399409307 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f237c0050d0 0x7f237c00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:41.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.869+0000 7f238ffff700 1 -- 172.21.15.72:0/399409307 reap_dead start 2023-07-27T20:32:41.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.870+0000 7f2387fff700 1 --2- 172.21.15.72:0/399409307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f237c004400 0x7f237c0048d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f23900c01b0 tx=0x7f237c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=517ac79961a2990c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:41.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.870+0000 7f238effd700 1 -- 172.21.15.72:0/399409307 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23780052d0 con 0x7f237c004400 2023-07-27T20:32:41.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.870+0000 7f238effd700 1 -- 172.21.15.72:0/399409307 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2378005430 con 0x7f237c004400 2023-07-27T20:32:41.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.870+0000 7f238effd700 1 -- 172.21.15.72:0/399409307 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23780038a0 con 0x7f237c004400 2023-07-27T20:32:41.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.870+0000 7f23961ff700 1 -- 172.21.15.72:0/399409307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f237c004400 msgr2=0x7f237c0048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:41.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.870+0000 7f23961ff700 1 --2- 172.21.15.72:0/399409307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f237c004400 0x7f237c0048d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f23900c01b0 tx=0x7f237c005880 comp rx=0 tx=0).stop 2023-07-27T20:32:41.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.870+0000 7f23961ff700 1 -- 172.21.15.72:0/399409307 shutdown_connections 2023-07-27T20:32:41.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.870+0000 7f23961ff700 1 --2- 172.21.15.72:0/399409307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f237c004400 0x7f237c0048d0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:41.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.870+0000 7f23961ff700 1 -- 172.21.15.72:0/399409307 >> 172.21.15.72:0/399409307 conn(0x7f239006a190 msgr2=0x7f239006a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:41.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.870+0000 7f23961ff700 1 -- 172.21.15.72:0/399409307 shutdown_connections 2023-07-27T20:32:41.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.871+0000 7f23961ff700 1 -- 172.21.15.72:0/399409307 wait complete. 2023-07-27T20:32:41.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.872+0000 7f23961ff700 1 Processor -- start 2023-07-27T20:32:41.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.872+0000 7f23961ff700 1 -- start start 2023-07-27T20:32:41.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.873+0000 7f23961ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f237c004400 0x7f2390153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:41.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.873+0000 7f23961ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23900bf130 0x7f23900bd000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:41.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.873+0000 7f23961ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23900bd540 0x7f23900ba5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:41.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.873+0000 7f23961ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23900be8f0 con 0x7f237c004400 2023-07-27T20:32:41.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.873+0000 7f23961ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239014ee40 con 0x7f23900bd540 2023-07-27T20:32:41.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.873+0000 7f23961ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23901eb170 con 0x7f23900bf130 2023-07-27T20:32:41.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.873+0000 7f238f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f237c004400 0x7f2390153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:41.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.873+0000 7f238f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f237c004400 0x7f2390153e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54900/0 (socket says 172.21.15.72:54900) 2023-07-27T20:32:41.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.873+0000 7f238f7fe700 1 -- 172.21.15.72:0/1912324652 learned_addr learned my addr 172.21.15.72:0/1912324652 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:41.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.874+0000 7f2387fff700 1 --2- 172.21.15.72:0/1912324652 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23900bf130 0x7f23900bd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:41.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.874+0000 7f238ffff700 1 --2- 172.21.15.72:0/1912324652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23900bd540 0x7f23900ba5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:41.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.874+0000 7f238f7fe700 1 -- 172.21.15.72:0/1912324652 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23900bf130 msgr2=0x7f23900bd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:41.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.874+0000 7f238f7fe700 1 --2- 172.21.15.72:0/1912324652 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23900bf130 0x7f23900bd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:41.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.874+0000 7f238f7fe700 1 -- 172.21.15.72:0/1912324652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23900bd540 msgr2=0x7f23900ba5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:41.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.874+0000 7f238f7fe700 1 --2- 172.21.15.72:0/1912324652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23900bd540 0x7f23900ba5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:41.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.874+0000 7f238f7fe700 1 -- 172.21.15.72:0/1912324652 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f239014e7f0 con 0x7f237c004400 2023-07-27T20:32:41.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.874+0000 7f2387fff700 1 --2- 172.21.15.72:0/1912324652 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23900bf130 0x7f23900bd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:41.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.874+0000 7f238f7fe700 1 --2- 172.21.15.72:0/1912324652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f237c004400 0x7f2390153e30 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f23800017a0 tx=0x7f2380007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:41.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.874+0000 7f238cff9700 1 -- 172.21.15.72:0/1912324652 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238000f6c0 con 0x7f237c004400 2023-07-27T20:32:41.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.874+0000 7f238cff9700 1 -- 172.21.15.72:0/1912324652 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238000f820 con 0x7f237c004400 2023-07-27T20:32:41.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.874+0000 7f23961ff700 1 -- 172.21.15.72:0/1912324652 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f239014ead0 con 0x7f237c004400 2023-07-27T20:32:41.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.874+0000 7f238cff9700 1 -- 172.21.15.72:0/1912324652 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238000fb90 con 0x7f237c004400 2023-07-27T20:32:41.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.874+0000 7f23961ff700 1 -- 172.21.15.72:0/1912324652 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2390154370 con 0x7f237c004400 2023-07-27T20:32:41.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.875+0000 7f23961ff700 1 -- 172.21.15.72:0/1912324652 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2390074310 con 0x7f237c004400 2023-07-27T20:32:41.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.876+0000 7f238cff9700 1 -- 172.21.15.72:0/1912324652 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f238000fcf0 con 0x7f237c004400 2023-07-27T20:32:41.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.877+0000 7f238cff9700 1 --2- 172.21.15.72:0/1912324652 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f237006ace0 0x7f237006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:41.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.877+0000 7f238cff9700 1 -- 172.21.15.72:0/1912324652 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f23800898f0 con 0x7f237c004400 2023-07-27T20:32:41.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.878+0000 7f2387fff700 1 --2- 172.21.15.72:0/1912324652 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f237006ace0 0x7f237006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:41.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.878+0000 7f2387fff700 1 --2- 172.21.15.72:0/1912324652 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f237006ace0 0x7f237006d1a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2378015040 tx=0x7f2378005000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:41.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:41.881+0000 7f238cff9700 1 -- 172.21.15.72:0/1912324652 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f23800545d0 con 0x7f237c004400 2023-07-27T20:32:42.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.128+0000 7f23961ff700 1 -- 172.21.15.72:0/1912324652 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f239006e3b0 con 0x7f237c004400 2023-07-27T20:32:42.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.128+0000 7f238cff9700 1 -- 172.21.15.72:0/1912324652 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f2380057bf0 con 0x7f237c004400 2023-07-27T20:32:42.116 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:32:42.117 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/1913374698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1913374698},{"type":"v1","addr":"172.21.15.72:6834","nonce":1913374698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/3260445560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":3260445560},{"type":"v1","addr":"172.21.15.72:6835","nonce":3260445560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1305837931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1305837931},{"type":"v1","addr":"172.21.15.173:6837","nonce":1305837931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T20:31:28.592113+0000","modified":"2023-07-27T20:31:51.217923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6835/516740687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":516740687},{"type":"v1","addr":"172.21.15.173:6835","nonce":516740687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-27T20:32:42.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.130+0000 7f23961ff700 1 -- 172.21.15.72:0/1912324652 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f237006ace0 msgr2=0x7f237006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:42.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.130+0000 7f23961ff700 1 --2- 172.21.15.72:0/1912324652 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f237006ace0 0x7f237006d1a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2378015040 tx=0x7f2378005000 comp rx=0 tx=0).stop 2023-07-27T20:32:42.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.130+0000 7f23961ff700 1 -- 172.21.15.72:0/1912324652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f237c004400 msgr2=0x7f2390153e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:42.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.130+0000 7f23961ff700 1 --2- 172.21.15.72:0/1912324652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f237c004400 0x7f2390153e30 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f23800017a0 tx=0x7f2380007620 comp rx=0 tx=0).stop 2023-07-27T20:32:42.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.130+0000 7f23961ff700 1 -- 172.21.15.72:0/1912324652 shutdown_connections 2023-07-27T20:32:42.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.130+0000 7f23961ff700 1 --2- 172.21.15.72:0/1912324652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23900bd540 0x7f23900ba5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:42.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.130+0000 7f23961ff700 1 --2- 172.21.15.72:0/1912324652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f237c004400 0x7f2390153e30 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:42.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.130+0000 7f23961ff700 1 --2- 172.21.15.72:0/1912324652 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f237006ace0 0x7f237006d1a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:42.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.131+0000 7f23961ff700 1 --2- 172.21.15.72:0/1912324652 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23900bf130 0x7f23900bd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:42.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.131+0000 7f23961ff700 1 -- 172.21.15.72:0/1912324652 >> 172.21.15.72:0/1912324652 conn(0x7f239006a190 msgr2=0x7f2390155790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:42.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.131+0000 7f23961ff700 1 -- 172.21.15.72:0/1912324652 shutdown_connections 2023-07-27T20:32:42.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.131+0000 7f23961ff700 1 -- 172.21.15.72:0/1912324652 wait complete. 2023-07-27T20:32:42.122 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 9 2023-07-27T20:32:42.136 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:32:42.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.344+0000 7f4860fff700 1 Processor -- start 2023-07-27T20:32:42.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.344+0000 7f4860fff700 1 -- start start 2023-07-27T20:32:42.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.345+0000 7f4860fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f485c13b2c0 0x7f485c0aa420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:42.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.345+0000 7f4860fff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f485c0a83a0 0x7f485c0a8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:42.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.345+0000 7f4860fff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f485c155600 con 0x7f485c0bfd90 2023-07-27T20:32:42.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.345+0000 7f4860fff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f485c0a9620 con 0x7f485c0a83a0 2023-07-27T20:32:42.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.345+0000 7f4860fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f485c155320 con 0x7f485c13b2c0 2023-07-27T20:32:42.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.346+0000 7f485ad9d700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f485c0a83a0 0x7f485c0a8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:42.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.346+0000 7f485a59c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f485c13b2c0 0x7f485c0aa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:42.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.346+0000 7f485ad9d700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f485c0a83a0 0x7f485c0a8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.72:56298/0 (socket says 172.21.15.72:56298) 2023-07-27T20:32:42.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.346+0000 7f485ad9d700 1 -- 172.21.15.72:0/3542117208 learned_addr learned my addr 172.21.15.72:0/3542117208 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:42.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.346+0000 7f4859d9b700 1 --1- 172.21.15.72:0/3542117208 >> v1:172.21.15.173:6789/0 conn(0x7f485c0bfd90 0x7f485c0aa960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.72:43218/0 (socket says 172.21.15.72:43218) 2023-07-27T20:32:42.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.346+0000 7f485ad9d700 1 -- 172.21.15.72:0/3542117208 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f485c13b2c0 msgr2=0x7f485c0aa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:42.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.346+0000 7f485ad9d700 1 --2- 172.21.15.72:0/3542117208 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f485c13b2c0 0x7f485c0aa420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:42.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.346+0000 7f485ad9d700 1 -- 172.21.15.72:0/3542117208 >> v1:172.21.15.173:6789/0 conn(0x7f485c0bfd90 legacy=0x7f485c0aa960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:42.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.346+0000 7f485ad9d700 1 -- 172.21.15.72:0/3542117208 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f485c151e40 con 0x7f485c0a83a0 2023-07-27T20:32:42.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.347+0000 7f485ad9d700 1 --2- 172.21.15.72:0/3542117208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f485c0a83a0 0x7f485c0a8820 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4854009e50 tx=0x7f485400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46280a1f44c21885 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:42.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.347+0000 7f485959a700 1 -- 172.21.15.72:0/3542117208 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485400e070 con 0x7f485c0a83a0 2023-07-27T20:32:42.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.347+0000 7f485959a700 1 -- 172.21.15.72:0/3542117208 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485400b910 con 0x7f485c0a83a0 2023-07-27T20:32:42.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.347+0000 7f485959a700 1 -- 172.21.15.72:0/3542117208 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485400bcc0 con 0x7f485c0a83a0 2023-07-27T20:32:42.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.348+0000 7f4860fff700 1 -- 172.21.15.72:0/3542117208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f485c0a83a0 msgr2=0x7f485c0a8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:42.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.348+0000 7f4860fff700 1 --2- 172.21.15.72:0/3542117208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f485c0a83a0 0x7f485c0a8820 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4854009e50 tx=0x7f485400b330 comp rx=0 tx=0).stop 2023-07-27T20:32:42.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.348+0000 7f4860fff700 1 -- 172.21.15.72:0/3542117208 shutdown_connections 2023-07-27T20:32:42.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.348+0000 7f4860fff700 1 --2- 172.21.15.72:0/3542117208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f485c0a83a0 0x7f485c0a8820 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:42.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.348+0000 7f4860fff700 1 --2- 172.21.15.72:0/3542117208 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f485c13b2c0 0x7f485c0aa420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:42.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.348+0000 7f4860fff700 1 -- 172.21.15.72:0/3542117208 >> 172.21.15.72:0/3542117208 conn(0x7f485c06a190 msgr2=0x7f485c06a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:42.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.348+0000 7f4860fff700 1 -- 172.21.15.72:0/3542117208 shutdown_connections 2023-07-27T20:32:42.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.348+0000 7f4860fff700 1 -- 172.21.15.72:0/3542117208 wait complete. 2023-07-27T20:32:42.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.349+0000 7f4860fff700 1 Processor -- start 2023-07-27T20:32:42.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.350+0000 7f4860fff700 1 -- start start 2023-07-27T20:32:42.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.350+0000 7f4860fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f485c0a83a0 0x7f485c0be990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:42.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.350+0000 7f4860fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f485c0bfd90 0x7f485c1ddeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:42.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.351+0000 7f4860fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f485c13b2c0 0x7f485c1de3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:42.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.351+0000 7f4860fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c1df130 con 0x7f485c0a83a0 2023-07-27T20:32:42.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.351+0000 7f4860fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c1de930 con 0x7f485c0bfd90 2023-07-27T20:32:42.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.351+0000 7f4860fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f485c1dede0 con 0x7f485c13b2c0 2023-07-27T20:32:42.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.351+0000 7f485a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f485c0a83a0 0x7f485c0be990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:42.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.351+0000 7f485a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f485c0a83a0 0x7f485c0be990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54912/0 (socket says 172.21.15.72:54912) 2023-07-27T20:32:42.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.351+0000 7f485a59c700 1 -- 172.21.15.72:0/2488007877 learned_addr learned my addr 172.21.15.72:0/2488007877 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:42.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.351+0000 7f4859d9b700 1 --2- 172.21.15.72:0/2488007877 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f485c0bfd90 0x7f485c1ddeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:42.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.351+0000 7f485ad9d700 1 --2- 172.21.15.72:0/2488007877 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f485c13b2c0 0x7f485c1de3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:42.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.351+0000 7f485a59c700 1 -- 172.21.15.72:0/2488007877 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f485c13b2c0 msgr2=0x7f485c1de3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:42.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.351+0000 7f485a59c700 1 --2- 172.21.15.72:0/2488007877 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f485c13b2c0 0x7f485c1de3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:42.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.351+0000 7f485a59c700 1 -- 172.21.15.72:0/2488007877 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f485c0bfd90 msgr2=0x7f485c1ddeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:42.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.351+0000 7f485a59c700 1 --2- 172.21.15.72:0/2488007877 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f485c0bfd90 0x7f485c1ddeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:42.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.351+0000 7f485a59c700 1 -- 172.21.15.72:0/2488007877 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4854009b30 con 0x7f485c0a83a0 2023-07-27T20:32:42.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.351+0000 7f4859d9b700 1 --2- 172.21.15.72:0/2488007877 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f485c0bfd90 0x7f485c1ddeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:42.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.351+0000 7f485a59c700 1 --2- 172.21.15.72:0/2488007877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f485c0a83a0 0x7f485c0be990 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f484c00e870 tx=0x7f484c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:42.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.352+0000 7f484affd700 1 -- 172.21.15.72:0/2488007877 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484c009590 con 0x7f485c0a83a0 2023-07-27T20:32:42.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.352+0000 7f484affd700 1 -- 172.21.15.72:0/2488007877 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484c00ee70 con 0x7f485c0a83a0 2023-07-27T20:32:42.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.352+0000 7f484affd700 1 -- 172.21.15.72:0/2488007877 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484c00ca50 con 0x7f485c0a83a0 2023-07-27T20:32:42.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.352+0000 7f4860fff700 1 -- 172.21.15.72:0/2488007877 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f485c0bf750 con 0x7f485c0a83a0 2023-07-27T20:32:42.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.352+0000 7f4860fff700 1 -- 172.21.15.72:0/2488007877 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f485c1ea270 con 0x7f485c0a83a0 2023-07-27T20:32:42.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.353+0000 7f4860fff700 1 -- 172.21.15.72:0/2488007877 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f485c074310 con 0x7f485c0a83a0 2023-07-27T20:32:42.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.354+0000 7f484affd700 1 -- 172.21.15.72:0/2488007877 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f484c00cbb0 con 0x7f485c0a83a0 2023-07-27T20:32:42.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.354+0000 7f484affd700 1 --2- 172.21.15.72:0/2488007877 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f483c06ace0 0x7f483c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:42.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.355+0000 7f484affd700 1 -- 172.21.15.72:0/2488007877 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f484c0897d0 con 0x7f485c0a83a0 2023-07-27T20:32:42.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.355+0000 7f4859d9b700 1 --2- 172.21.15.72:0/2488007877 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f483c06ace0 0x7f483c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:42.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.356+0000 7f4859d9b700 1 --2- 172.21.15.72:0/2488007877 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f483c06ace0 0x7f483c06d1a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f485c1e71b0 tx=0x7f4850007df0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:42.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.359+0000 7f484affd700 1 -- 172.21.15.72:0/2488007877 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f484c057fd0 con 0x7f485c0a83a0 2023-07-27T20:32:42.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.555+0000 7f4860fff700 1 -- 172.21.15.72:0/2488007877 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f485c0c61f0 con 0x7f485c0a83a0 2023-07-27T20:32:42.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.556+0000 7f484affd700 1 -- 172.21.15.72:0/2488007877 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20215 (secure 0 0 0) 0x7f484c00ce60 con 0x7f485c0a83a0 2023-07-27T20:32:42.544 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:32:42.544 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":29,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:32:10.402254+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:31:27.020951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T20:31:27.566022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-27T20:31:31.182401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:32:42.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.559+0000 7f4860fff700 1 -- 172.21.15.72:0/2488007877 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f483c06ace0 msgr2=0x7f483c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:42.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.559+0000 7f4860fff700 1 --2- 172.21.15.72:0/2488007877 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f483c06ace0 0x7f483c06d1a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f485c1e71b0 tx=0x7f4850007df0 comp rx=0 tx=0).stop 2023-07-27T20:32:42.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.559+0000 7f4860fff700 1 -- 172.21.15.72:0/2488007877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f485c0a83a0 msgr2=0x7f485c0be990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:42.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.559+0000 7f4860fff700 1 --2- 172.21.15.72:0/2488007877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f485c0a83a0 0x7f485c0be990 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f484c00e870 tx=0x7f484c00ec30 comp rx=0 tx=0).stop 2023-07-27T20:32:42.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.559+0000 7f4860fff700 1 -- 172.21.15.72:0/2488007877 shutdown_connections 2023-07-27T20:32:42.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.559+0000 7f4860fff700 1 --2- 172.21.15.72:0/2488007877 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f483c06ace0 0x7f483c06d1a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:42.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.559+0000 7f4860fff700 1 --2- 172.21.15.72:0/2488007877 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f485c13b2c0 0x7f485c1de3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:42.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.559+0000 7f4860fff700 1 --2- 172.21.15.72:0/2488007877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f485c0a83a0 0x7f485c0be990 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:42.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.559+0000 7f4860fff700 1 --2- 172.21.15.72:0/2488007877 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f485c0bfd90 0x7f485c1ddeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:42.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.559+0000 7f4860fff700 1 -- 172.21.15.72:0/2488007877 >> 172.21.15.72:0/2488007877 conn(0x7f485c06a190 msgr2=0x7f485c06d100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:42.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.559+0000 7f4860fff700 1 -- 172.21.15.72:0/2488007877 shutdown_connections 2023-07-27T20:32:42.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.559+0000 7f4860fff700 1 -- 172.21.15.72:0/2488007877 wait complete. 2023-07-27T20:32:42.565 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-27T20:31:14.581785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T20:31:21.077941+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T20:31:27.020951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T20:31:27.566022+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-27T20:31:31.182401+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-27T20:32:42.565 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-27T20:32:42.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.774+0000 7f267b1ff700 1 Processor -- start 2023-07-27T20:32:42.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.775+0000 7f267b1ff700 1 -- start start 2023-07-27T20:32:42.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.776+0000 7f267b1ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f26741475a0 0x7f26741516c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:42.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.776+0000 7f267b1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f26740716f0 0x7f2674071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:42.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.776+0000 7f267b1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2674154f50 con 0x7f26740c12f0 2023-07-27T20:32:42.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.776+0000 7f267b1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2674151c00 con 0x7f26740716f0 2023-07-27T20:32:42.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.776+0000 7f267b1ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2674154340 con 0x7f26741475a0 2023-07-27T20:32:42.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.776+0000 7f2673fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f26740c12f0 0x7f26740c1d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58646/0 (socket says 172.21.15.72:58646) 2023-07-27T20:32:42.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.776+0000 7f267979c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f26740716f0 0x7f2674071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:42.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.776+0000 7f2673fff700 1 -- 172.21.15.72:0/1781623010 learned_addr learned my addr 172.21.15.72:0/1781623010 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:42.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.776+0000 7f2678f9b700 1 --2- 172.21.15.72:0/1781623010 >> v2:172.21.15.173:3300/0 conn(0x7f26741475a0 0x7f26741516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:42.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.776+0000 7f26737fe700 1 -- 172.21.15.72:0/1781623010 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3657449015 0 0) 0x7f2674154f50 con 0x7f26740c12f0 2023-07-27T20:32:42.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.776+0000 7f26737fe700 1 -- 172.21.15.72:0/1781623010 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26640057c0 con 0x7f26740c12f0 2023-07-27T20:32:42.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.777+0000 7f267979c700 1 -- 172.21.15.72:0/1781623010 >> v2:172.21.15.173:3300/0 conn(0x7f26741475a0 msgr2=0x7f26741516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:42.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.777+0000 7f267979c700 1 --2- 172.21.15.72:0/1781623010 >> v2:172.21.15.173:3300/0 conn(0x7f26741475a0 0x7f26741516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:42.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.777+0000 7f267979c700 1 -- 172.21.15.72:0/1781623010 >> v1:172.21.15.72:6789/0 conn(0x7f26740c12f0 legacy=0x7f26740c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:42.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.777+0000 7f267979c700 1 -- 172.21.15.72:0/1781623010 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2674154620 con 0x7f26740716f0 2023-07-27T20:32:42.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.777+0000 7f267979c700 1 --2- 172.21.15.72:0/1781623010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26740716f0 0x7f2674071b00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f26740c2b60 tx=0x7f266c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21565448d0161bf3 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:42.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.777+0000 7f26737fe700 1 -- 172.21.15.72:0/1781623010 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c00e070 con 0x7f26740716f0 2023-07-27T20:32:42.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.777+0000 7f26737fe700 1 -- 172.21.15.72:0/1781623010 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266c00bb20 con 0x7f26740716f0 2023-07-27T20:32:42.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.777+0000 7f26737fe700 1 -- 172.21.15.72:0/1781623010 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c012430 con 0x7f26740716f0 2023-07-27T20:32:42.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.777+0000 7f267b1ff700 1 -- 172.21.15.72:0/1781623010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26740716f0 msgr2=0x7f2674071b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:42.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.778+0000 7f267b1ff700 1 --2- 172.21.15.72:0/1781623010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26740716f0 0x7f2674071b00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f26740c2b60 tx=0x7f266c00b330 comp rx=0 tx=0).stop 2023-07-27T20:32:42.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.778+0000 7f267b1ff700 1 -- 172.21.15.72:0/1781623010 shutdown_connections 2023-07-27T20:32:42.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.778+0000 7f267b1ff700 1 --2- 172.21.15.72:0/1781623010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26740716f0 0x7f2674071b00 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:42.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.778+0000 7f267b1ff700 1 --2- 172.21.15.72:0/1781623010 >> v2:172.21.15.173:3300/0 conn(0x7f26741475a0 0x7f26741516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:42.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.778+0000 7f267b1ff700 1 -- 172.21.15.72:0/1781623010 >> 172.21.15.72:0/1781623010 conn(0x7f267406a190 msgr2=0x7f267406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:42.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.778+0000 7f267b1ff700 1 -- 172.21.15.72:0/1781623010 shutdown_connections 2023-07-27T20:32:42.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.778+0000 7f267b1ff700 1 -- 172.21.15.72:0/1781623010 wait complete. 2023-07-27T20:32:42.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.779+0000 7f267b1ff700 1 Processor -- start 2023-07-27T20:32:42.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.780+0000 7f267b1ff700 1 -- start start 2023-07-27T20:32:42.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.780+0000 7f267b1ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26740716f0 0x7f26740bd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:42.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.780+0000 7f267b1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26740c12f0 0x7f2674140220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:42.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.780+0000 7f267b1ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f26741475a0 0x7f26741eaa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:42.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.780+0000 7f267b1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26740bcfa0 con 0x7f26740c12f0 2023-07-27T20:32:42.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.780+0000 7f267b1ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267414bf50 con 0x7f26740716f0 2023-07-27T20:32:42.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.780+0000 7f267b1ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26741ed5c0 con 0x7f26741475a0 2023-07-27T20:32:42.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.781+0000 7f2673fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26740c12f0 0x7f2674140220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:42.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.781+0000 7f2673fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26740c12f0 0x7f2674140220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54928/0 (socket says 172.21.15.72:54928) 2023-07-27T20:32:42.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.781+0000 7f2673fff700 1 -- 172.21.15.72:0/127475636 learned_addr learned my addr 172.21.15.72:0/127475636 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:42.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.781+0000 7f2678f9b700 1 --2- 172.21.15.72:0/127475636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26740716f0 0x7f26740bd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:42.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.781+0000 7f267979c700 1 --2- 172.21.15.72:0/127475636 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f26741475a0 0x7f26741eaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:42.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.781+0000 7f2673fff700 1 -- 172.21.15.72:0/127475636 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f26741475a0 msgr2=0x7f26741eaa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:42.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.781+0000 7f2673fff700 1 --2- 172.21.15.72:0/127475636 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f26741475a0 0x7f26741eaa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:42.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.781+0000 7f2673fff700 1 -- 172.21.15.72:0/127475636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26740716f0 msgr2=0x7f26740bd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:42.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.781+0000 7f2673fff700 1 --2- 172.21.15.72:0/127475636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26740716f0 0x7f26740bd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:42.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.781+0000 7f2673fff700 1 -- 172.21.15.72:0/127475636 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266c009a70 con 0x7f26740c12f0 2023-07-27T20:32:42.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.781+0000 7f2673fff700 1 --2- 172.21.15.72:0/127475636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26740c12f0 0x7f2674140220 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f266000c700 tx=0x7f266000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:42.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.782+0000 7f26717fa700 1 -- 172.21.15.72:0/127475636 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2660005d70 con 0x7f26740c12f0 2023-07-27T20:32:42.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.782+0000 7f26717fa700 1 -- 172.21.15.72:0/127475636 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26600070d0 con 0x7f26740c12f0 2023-07-27T20:32:42.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.782+0000 7f267b1ff700 1 -- 172.21.15.72:0/127475636 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26741ed8a0 con 0x7f26740c12f0 2023-07-27T20:32:42.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.782+0000 7f26717fa700 1 -- 172.21.15.72:0/127475636 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2660007460 con 0x7f26740c12f0 2023-07-27T20:32:42.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.782+0000 7f267b1ff700 1 -- 172.21.15.72:0/127475636 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26740bd4d0 con 0x7f26740c12f0 2023-07-27T20:32:42.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.783+0000 7f267b1ff700 1 -- 172.21.15.72:0/127475636 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f267404e470 con 0x7f26740c12f0 2023-07-27T20:32:42.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.784+0000 7f26717fa700 1 -- 172.21.15.72:0/127475636 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f26600075c0 con 0x7f26740c12f0 2023-07-27T20:32:42.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.785+0000 7f26717fa700 1 --2- 172.21.15.72:0/127475636 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f265806ace0 0x7f265806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:42.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.785+0000 7f26717fa700 1 -- 172.21.15.72:0/127475636 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2660088d80 con 0x7f26740c12f0 2023-07-27T20:32:42.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.785+0000 7f2678f9b700 1 --2- 172.21.15.72:0/127475636 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f265806ace0 0x7f265806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:42.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.786+0000 7f2678f9b700 1 --2- 172.21.15.72:0/127475636 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f265806ace0 0x7f265806d1a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2674140b20 tx=0x7f2668009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:42.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.789+0000 7f26717fa700 1 -- 172.21.15.72:0/127475636 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2660053af0 con 0x7f26740c12f0 2023-07-27T20:32:42.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.984+0000 7f267b1ff700 1 -- 172.21.15.72:0/127475636 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f26740c10d0 con 0x7f26740c12f0 2023-07-27T20:32:42.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.985+0000 7f26717fa700 1 -- 172.21.15.72:0/127475636 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2660057110 con 0x7f26740c12f0 2023-07-27T20:32:42.972 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-27T20:32:42.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.987+0000 7f267b1ff700 1 -- 172.21.15.72:0/127475636 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f265806ace0 msgr2=0x7f265806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:42.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.987+0000 7f267b1ff700 1 --2- 172.21.15.72:0/127475636 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f265806ace0 0x7f265806d1a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2674140b20 tx=0x7f2668009210 comp rx=0 tx=0).stop 2023-07-27T20:32:42.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.987+0000 7f267b1ff700 1 -- 172.21.15.72:0/127475636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26740c12f0 msgr2=0x7f2674140220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:42.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.987+0000 7f267b1ff700 1 --2- 172.21.15.72:0/127475636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26740c12f0 0x7f2674140220 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f266000c700 tx=0x7f266000ca10 comp rx=0 tx=0).stop 2023-07-27T20:32:42.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.987+0000 7f267b1ff700 1 -- 172.21.15.72:0/127475636 shutdown_connections 2023-07-27T20:32:42.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.987+0000 7f267b1ff700 1 --2- 172.21.15.72:0/127475636 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f265806ace0 0x7f265806d1a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:42.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.987+0000 7f267b1ff700 1 --2- 172.21.15.72:0/127475636 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f26741475a0 0x7f26741eaa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:42.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.987+0000 7f267b1ff700 1 --2- 172.21.15.72:0/127475636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26740716f0 0x7f26740bd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:42.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.987+0000 7f267b1ff700 1 --2- 172.21.15.72:0/127475636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26740c12f0 0x7f2674140220 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:42.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.987+0000 7f267b1ff700 1 -- 172.21.15.72:0/127475636 >> 172.21.15.72:0/127475636 conn(0x7f267406a190 msgr2=0x7f26740bfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:42.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.987+0000 7f267b1ff700 1 -- 172.21.15.72:0/127475636 shutdown_connections 2023-07-27T20:32:42.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:42.987+0000 7f267b1ff700 1 -- 172.21.15.72:0/127475636 wait complete. 2023-07-27T20:32:42.992 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T20:32:43.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.206+0000 7f62291ff700 1 Processor -- start 2023-07-27T20:32:43.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.206+0000 7f62291ff700 1 -- start start 2023-07-27T20:32:43.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.207+0000 7f62291ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62240c7740 0x7f62240c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:43.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.207+0000 7f62291ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f62240c4700 0x7f622406c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:43.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.207+0000 7f62291ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62240c7c50 con 0x7f622414aab0 2023-07-27T20:32:43.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.207+0000 7f62291ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f622406bd40 con 0x7f62240c4700 2023-07-27T20:32:43.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.207+0000 7f62291ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62240c62f0 con 0x7f62240c7740 2023-07-27T20:32:43.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.208+0000 7f622259c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62240c7740 0x7f62240c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:43.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.208+0000 7f622359e700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f62240c4700 0x7f622406c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:43.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.208+0000 7f622359e700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f62240c4700 0x7f622406c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.72:56316/0 (socket says 172.21.15.72:56316) 2023-07-27T20:32:43.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.208+0000 7f622359e700 1 -- 172.21.15.72:0/935003903 learned_addr learned my addr 172.21.15.72:0/935003903 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:43.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.208+0000 7f6222d9d700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f622414aab0 0x7f6224154b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.72:43228/0 (socket says 172.21.15.72:43228) 2023-07-27T20:32:43.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.208+0000 7f622259c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62240c7740 0x7f62240c41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.72:45484/0 (socket says 172.21.15.72:45484) 2023-07-27T20:32:43.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.208+0000 7f622359e700 1 -- 172.21.15.72:0/935003903 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62240c7740 msgr2=0x7f62240c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:43.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.208+0000 7f622359e700 1 --2- 172.21.15.72:0/935003903 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62240c7740 0x7f62240c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:43.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.208+0000 7f622359e700 1 -- 172.21.15.72:0/935003903 >> v1:172.21.15.173:6789/0 conn(0x7f622414aab0 legacy=0x7f6224154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:43.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.208+0000 7f622359e700 1 -- 172.21.15.72:0/935003903 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622406d200 con 0x7f62240c4700 2023-07-27T20:32:43.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.208+0000 7f6221d9b700 1 -- 172.21.15.72:0/935003903 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 863661446 0 0) 0x7f62240c7c50 con 0x7f622414aab0 2023-07-27T20:32:43.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.209+0000 7f622359e700 1 --2- 172.21.15.72:0/935003903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62240c4700 0x7f622406c1d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f621c009e50 tx=0x7f621c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94044abdfb7f384b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:43.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.209+0000 7f6221d9b700 1 -- 172.21.15.72:0/935003903 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c00e070 con 0x7f62240c4700 2023-07-27T20:32:43.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.209+0000 7f6221d9b700 1 -- 172.21.15.72:0/935003903 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621c00b910 con 0x7f62240c4700 2023-07-27T20:32:43.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.209+0000 7f6221d9b700 1 -- 172.21.15.72:0/935003903 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c00bcc0 con 0x7f62240c4700 2023-07-27T20:32:43.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.209+0000 7f62291ff700 1 -- 172.21.15.72:0/935003903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62240c4700 msgr2=0x7f622406c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:43.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.209+0000 7f62291ff700 1 --2- 172.21.15.72:0/935003903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62240c4700 0x7f622406c1d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f621c009e50 tx=0x7f621c00b330 comp rx=0 tx=0).stop 2023-07-27T20:32:43.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.210+0000 7f62291ff700 1 -- 172.21.15.72:0/935003903 shutdown_connections 2023-07-27T20:32:43.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.210+0000 7f62291ff700 1 --2- 172.21.15.72:0/935003903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62240c4700 0x7f622406c1d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:43.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.210+0000 7f62291ff700 1 --2- 172.21.15.72:0/935003903 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62240c7740 0x7f62240c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:43.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.210+0000 7f62291ff700 1 -- 172.21.15.72:0/935003903 >> 172.21.15.72:0/935003903 conn(0x7f62240ab3f0 msgr2=0x7f62240ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:43.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.210+0000 7f62291ff700 1 -- 172.21.15.72:0/935003903 shutdown_connections 2023-07-27T20:32:43.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.210+0000 7f62291ff700 1 -- 172.21.15.72:0/935003903 wait complete. 2023-07-27T20:32:43.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.211+0000 7f62291ff700 1 Processor -- start 2023-07-27T20:32:43.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.211+0000 7f62291ff700 1 -- start start 2023-07-27T20:32:43.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.212+0000 7f62291ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62240c4700 0x7f62241ea160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:43.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.212+0000 7f62291ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62240c7740 0x7f62240c2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:43.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.212+0000 7f62291ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f622414aab0 0x7f62241eac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:43.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.212+0000 7f62291ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6224157500 con 0x7f62240c4700 2023-07-27T20:32:43.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.212+0000 7f62291ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6224157da0 con 0x7f62240c7740 2023-07-27T20:32:43.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.212+0000 7f62291ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62241ea6a0 con 0x7f622414aab0 2023-07-27T20:32:43.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.213+0000 7f6222d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62240c4700 0x7f62241ea160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:43.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.213+0000 7f6222d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62240c4700 0x7f62241ea160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54936/0 (socket says 172.21.15.72:54936) 2023-07-27T20:32:43.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.213+0000 7f6222d9d700 1 -- 172.21.15.72:0/3391908978 learned_addr learned my addr 172.21.15.72:0/3391908978 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:43.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.213+0000 7f622259c700 1 --2- 172.21.15.72:0/3391908978 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62240c7740 0x7f62240c2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:43.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.213+0000 7f622359e700 1 --2- 172.21.15.72:0/3391908978 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f622414aab0 0x7f62241eac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:43.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.213+0000 7f6222d9d700 1 -- 172.21.15.72:0/3391908978 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f622414aab0 msgr2=0x7f62241eac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:43.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.213+0000 7f6222d9d700 1 --2- 172.21.15.72:0/3391908978 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f622414aab0 0x7f62241eac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:43.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.213+0000 7f6222d9d700 1 -- 172.21.15.72:0/3391908978 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62240c7740 msgr2=0x7f62240c2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:43.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.213+0000 7f6222d9d700 1 --2- 172.21.15.72:0/3391908978 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62240c7740 0x7f62240c2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:43.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.213+0000 7f6222d9d700 1 -- 172.21.15.72:0/3391908978 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f621c009b30 con 0x7f62240c4700 2023-07-27T20:32:43.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.213+0000 7f6222d9d700 1 --2- 172.21.15.72:0/3391908978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62240c4700 0x7f62241ea160 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f621400c550 tx=0x7f621400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:43.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.213+0000 7f620b7fe700 1 -- 172.21.15.72:0/3391908978 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6214004c80 con 0x7f62240c4700 2023-07-27T20:32:43.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.214+0000 7f620b7fe700 1 -- 172.21.15.72:0/3391908978 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6214004e00 con 0x7f62240c4700 2023-07-27T20:32:43.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.214+0000 7f620b7fe700 1 -- 172.21.15.72:0/3391908978 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6214007310 con 0x7f62240c4700 2023-07-27T20:32:43.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.214+0000 7f62291ff700 1 -- 172.21.15.72:0/3391908978 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f622414a470 con 0x7f62240c4700 2023-07-27T20:32:43.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.214+0000 7f62291ff700 1 -- 172.21.15.72:0/3391908978 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6224157a30 con 0x7f62240c4700 2023-07-27T20:32:43.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.215+0000 7f62291ff700 1 -- 172.21.15.72:0/3391908978 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f622404e470 con 0x7f62240c4700 2023-07-27T20:32:43.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.216+0000 7f620b7fe700 1 -- 172.21.15.72:0/3391908978 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6214007470 con 0x7f62240c4700 2023-07-27T20:32:43.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.217+0000 7f620b7fe700 1 --2- 172.21.15.72:0/3391908978 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f621006ace0 0x7f621006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:43.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.217+0000 7f620b7fe700 1 -- 172.21.15.72:0/3391908978 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f62140893b0 con 0x7f62240c4700 2023-07-27T20:32:43.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.217+0000 7f622259c700 1 --2- 172.21.15.72:0/3391908978 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f621006ace0 0x7f621006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:43.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.218+0000 7f622259c700 1 --2- 172.21.15.72:0/3391908978 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f621006ace0 0x7f621006d1a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f62240c96c0 tx=0x7f6218009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:43.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.221+0000 7f620b7fe700 1 -- 172.21.15.72:0/3391908978 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6214054120 con 0x7f62240c4700 2023-07-27T20:32:43.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.416+0000 7f62291ff700 1 -- 172.21.15.72:0/3391908978 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f622406cf00 con 0x7f62240c4700 2023-07-27T20:32:43.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.416+0000 7f620b7fe700 1 -- 172.21.15.72:0/3391908978 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6214057740 con 0x7f62240c4700 2023-07-27T20:32:43.404 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-27T20:32:43.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.419+0000 7f62291ff700 1 -- 172.21.15.72:0/3391908978 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f621006ace0 msgr2=0x7f621006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:43.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.419+0000 7f62291ff700 1 --2- 172.21.15.72:0/3391908978 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f621006ace0 0x7f621006d1a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f62240c96c0 tx=0x7f6218009210 comp rx=0 tx=0).stop 2023-07-27T20:32:43.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.419+0000 7f62291ff700 1 -- 172.21.15.72:0/3391908978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62240c4700 msgr2=0x7f62241ea160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:43.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.419+0000 7f62291ff700 1 --2- 172.21.15.72:0/3391908978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62240c4700 0x7f62241ea160 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f621400c550 tx=0x7f621400c860 comp rx=0 tx=0).stop 2023-07-27T20:32:43.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.419+0000 7f62291ff700 1 -- 172.21.15.72:0/3391908978 shutdown_connections 2023-07-27T20:32:43.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.419+0000 7f62291ff700 1 --2- 172.21.15.72:0/3391908978 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f621006ace0 0x7f621006d1a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:43.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.419+0000 7f62291ff700 1 --2- 172.21.15.72:0/3391908978 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f622414aab0 0x7f62241eac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:43.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.419+0000 7f62291ff700 1 --2- 172.21.15.72:0/3391908978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62240c4700 0x7f62241ea160 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:43.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.419+0000 7f62291ff700 1 --2- 172.21.15.72:0/3391908978 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62240c7740 0x7f62240c2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:43.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.419+0000 7f62291ff700 1 -- 172.21.15.72:0/3391908978 >> 172.21.15.72:0/3391908978 conn(0x7f62240ab3f0 msgr2=0x7f62240aa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:43.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.419+0000 7f62291ff700 1 -- 172.21.15.72:0/3391908978 shutdown_connections 2023-07-27T20:32:43.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.419+0000 7f62291ff700 1 -- 172.21.15.72:0/3391908978 wait complete. 2023-07-27T20:32:43.425 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T20:32:43.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.635+0000 7fecb91ff700 1 Processor -- start 2023-07-27T20:32:43.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.635+0000 7fecb91ff700 1 -- start start 2023-07-27T20:32:43.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.636+0000 7fecb91ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fecb40c7740 0x7fecb40c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:43.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.636+0000 7fecb91ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb40c7c50 con 0x7fecb40c4700 2023-07-27T20:32:43.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.636+0000 7fecb91ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb406bd40 con 0x7fecb414aab0 2023-07-27T20:32:43.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.636+0000 7fecb91ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb40c62f0 con 0x7fecb40c7740 2023-07-27T20:32:43.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.637+0000 7fecabfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fecb40c7740 0x7fecb40c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:43.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.637+0000 7fecb359e700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fecb40c4700 0x7fecb406c1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58650/0 (socket says 172.21.15.72:58650) 2023-07-27T20:32:43.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.637+0000 7fecb359e700 1 -- 172.21.15.72:0/1905671255 learned_addr learned my addr 172.21.15.72:0/1905671255 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:43.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.637+0000 7fecabfff700 1 -- 172.21.15.72:0/1905671255 >> v1:172.21.15.173:6789/0 conn(0x7fecb414aab0 legacy=0x7fecb4154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:43.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.637+0000 7fecabfff700 1 -- 172.21.15.72:0/1905671255 >> v1:172.21.15.72:6789/0 conn(0x7fecb40c4700 legacy=0x7fecb406c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:43.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.637+0000 7fecabfff700 1 -- 172.21.15.72:0/1905671255 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb406d200 con 0x7fecb40c7740 2023-07-27T20:32:43.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.637+0000 7fecb259c700 1 -- 172.21.15.72:0/1905671255 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 164395133 0 0) 0x7fecb40c7c50 con 0x7fecb40c4700 2023-07-27T20:32:43.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.637+0000 7fecabfff700 1 --2- 172.21.15.72:0/1905671255 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecb40c7740 0x7fecb40c41c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fec9c009840 tx=0x7fec9c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=787729684ca43585 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:43.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.638+0000 7fecb259c700 1 -- 172.21.15.72:0/1905671255 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9c004230 con 0x7fecb40c7740 2023-07-27T20:32:43.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.638+0000 7fecb259c700 1 -- 172.21.15.72:0/1905671255 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9c004390 con 0x7fecb40c7740 2023-07-27T20:32:43.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.638+0000 7fecb259c700 1 -- 172.21.15.72:0/1905671255 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9c0036a0 con 0x7fecb40c7740 2023-07-27T20:32:43.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.638+0000 7fecb91ff700 1 -- 172.21.15.72:0/1905671255 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecb40c7740 msgr2=0x7fecb40c41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:43.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.638+0000 7fecb91ff700 1 --2- 172.21.15.72:0/1905671255 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecb40c7740 0x7fecb40c41c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fec9c009840 tx=0x7fec9c009b50 comp rx=0 tx=0).stop 2023-07-27T20:32:43.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.638+0000 7fecb91ff700 1 -- 172.21.15.72:0/1905671255 shutdown_connections 2023-07-27T20:32:43.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.638+0000 7fecb91ff700 1 --2- 172.21.15.72:0/1905671255 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecb40c7740 0x7fecb40c41c0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:43.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.638+0000 7fecb91ff700 1 -- 172.21.15.72:0/1905671255 >> 172.21.15.72:0/1905671255 conn(0x7fecb40ab3f0 msgr2=0x7fecb40ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:43.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.638+0000 7fecb91ff700 1 -- 172.21.15.72:0/1905671255 shutdown_connections 2023-07-27T20:32:43.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.638+0000 7fecb91ff700 1 -- 172.21.15.72:0/1905671255 wait complete. 2023-07-27T20:32:43.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.640+0000 7fecb91ff700 1 Processor -- start 2023-07-27T20:32:43.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.640+0000 7fecb91ff700 1 -- start start 2023-07-27T20:32:43.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.641+0000 7fecb91ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecb40c4700 0x7fecb41ee110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:43.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.641+0000 7fecb91ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fecb40c7740 0x7fecb4149fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:43.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.641+0000 7fecb91ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecb414aab0 0x7fecb41eb630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:43.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.641+0000 7fecb91ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb41eaad0 con 0x7fecb40c4700 2023-07-27T20:32:43.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.641+0000 7fecb91ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb41ee650 con 0x7fecb414aab0 2023-07-27T20:32:43.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.641+0000 7fecb91ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb414a4e0 con 0x7fecb40c7740 2023-07-27T20:32:43.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.641+0000 7fecb2d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecb40c4700 0x7fecb41ee110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:43.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.641+0000 7fecb2d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecb40c4700 0x7fecb41ee110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54954/0 (socket says 172.21.15.72:54954) 2023-07-27T20:32:43.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.641+0000 7fecb2d9d700 1 -- 172.21.15.72:0/2931900066 learned_addr learned my addr 172.21.15.72:0/2931900066 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:43.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.641+0000 7fecb359e700 1 --2- 172.21.15.72:0/2931900066 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecb414aab0 0x7fecb41eb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:43.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.641+0000 7fecabfff700 1 --2- 172.21.15.72:0/2931900066 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fecb40c7740 0x7fecb4149fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:43.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.642+0000 7fecb2d9d700 1 -- 172.21.15.72:0/2931900066 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fecb40c7740 msgr2=0x7fecb4149fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:43.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.642+0000 7fecb2d9d700 1 --2- 172.21.15.72:0/2931900066 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fecb40c7740 0x7fecb4149fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:43.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.642+0000 7fecb2d9d700 1 -- 172.21.15.72:0/2931900066 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecb414aab0 msgr2=0x7fecb41eb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:43.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.642+0000 7fecb2d9d700 1 --2- 172.21.15.72:0/2931900066 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecb414aab0 0x7fecb41eb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:43.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.642+0000 7fecb2d9d700 1 -- 172.21.15.72:0/2931900066 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec9c0094a0 con 0x7fecb40c4700 2023-07-27T20:32:43.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.642+0000 7fecb2d9d700 1 --2- 172.21.15.72:0/2931900066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecb40c4700 0x7fecb41ee110 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7feca400b4d0 tx=0x7feca400b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:43.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.642+0000 7fecab7fe700 1 -- 172.21.15.72:0/2931900066 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca4011830 con 0x7fecb40c4700 2023-07-27T20:32:43.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.642+0000 7fecab7fe700 1 -- 172.21.15.72:0/2931900066 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca4011990 con 0x7fecb40c4700 2023-07-27T20:32:43.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.642+0000 7fecab7fe700 1 -- 172.21.15.72:0/2931900066 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca4011d40 con 0x7fecb40c4700 2023-07-27T20:32:43.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.642+0000 7fecb91ff700 1 -- 172.21.15.72:0/2931900066 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb41ea1c0 con 0x7fecb40c4700 2023-07-27T20:32:43.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.642+0000 7fecb91ff700 1 -- 172.21.15.72:0/2931900066 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb41ea480 con 0x7fecb40c4700 2023-07-27T20:32:43.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.643+0000 7fecb91ff700 1 -- 172.21.15.72:0/2931900066 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb40ca710 con 0x7fecb40c4700 2023-07-27T20:32:43.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.644+0000 7fecab7fe700 1 -- 172.21.15.72:0/2931900066 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feca401a400 con 0x7fecb40c4700 2023-07-27T20:32:43.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.646+0000 7fecab7fe700 1 --2- 172.21.15.72:0/2931900066 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fec9406ace0 0x7fec9406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:43.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.646+0000 7fecab7fe700 1 -- 172.21.15.72:0/2931900066 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7feca4089470 con 0x7fecb40c4700 2023-07-27T20:32:43.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.646+0000 7fecabfff700 1 --2- 172.21.15.72:0/2931900066 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fec9406ace0 0x7fec9406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:43.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.647+0000 7fecabfff700 1 --2- 172.21.15.72:0/2931900066 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fec9406ace0 0x7fec9406d1a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fec9c000c00 tx=0x7fec9c01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:43.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.650+0000 7fecab7fe700 1 -- 172.21.15.72:0/2931900066 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7feca40541e0 con 0x7fecb40c4700 2023-07-27T20:32:43.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.843+0000 7fecb91ff700 1 -- 172.21.15.72:0/2931900066 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fecb40c7410 con 0x7fecb40c4700 2023-07-27T20:32:43.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.843+0000 7fecab7fe700 1 -- 172.21.15.72:0/2931900066 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7feca4057800 con 0x7fecb40c4700 2023-07-27T20:32:43.831 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:32:43.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.846+0000 7fecb91ff700 1 -- 172.21.15.72:0/2931900066 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fec9406ace0 msgr2=0x7fec9406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:43.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.846+0000 7fecb91ff700 1 --2- 172.21.15.72:0/2931900066 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fec9406ace0 0x7fec9406d1a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fec9c000c00 tx=0x7fec9c01c040 comp rx=0 tx=0).stop 2023-07-27T20:32:43.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.846+0000 7fecb91ff700 1 -- 172.21.15.72:0/2931900066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecb40c4700 msgr2=0x7fecb41ee110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:43.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.846+0000 7fecb91ff700 1 --2- 172.21.15.72:0/2931900066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecb40c4700 0x7fecb41ee110 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7feca400b4d0 tx=0x7feca400b7e0 comp rx=0 tx=0).stop 2023-07-27T20:32:43.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.846+0000 7fecb91ff700 1 -- 172.21.15.72:0/2931900066 shutdown_connections 2023-07-27T20:32:43.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.846+0000 7fecb91ff700 1 --2- 172.21.15.72:0/2931900066 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecb414aab0 0x7fecb41eb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:43.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.846+0000 7fecb91ff700 1 --2- 172.21.15.72:0/2931900066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecb40c4700 0x7fecb41ee110 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:43.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.846+0000 7fecb91ff700 1 --2- 172.21.15.72:0/2931900066 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fec9406ace0 0x7fec9406d1a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:43.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.846+0000 7fecb91ff700 1 --2- 172.21.15.72:0/2931900066 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fecb40c7740 0x7fecb4149fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:43.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.846+0000 7fecb91ff700 1 -- 172.21.15.72:0/2931900066 >> 172.21.15.72:0/2931900066 conn(0x7fecb40ab3f0 msgr2=0x7fecb4154060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:43.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.846+0000 7fecb91ff700 1 -- 172.21.15.72:0/2931900066 shutdown_connections 2023-07-27T20:32:43.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:43.846+0000 7fecb91ff700 1 -- 172.21.15.72:0/2931900066 wait complete. 2023-07-27T20:32:43.851 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T20:32:44.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.061+0000 7fdbe51ff700 1 Processor -- start 2023-07-27T20:32:44.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.061+0000 7fdbe51ff700 1 -- start start 2023-07-27T20:32:44.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.062+0000 7fdbe51ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdbe014aab0 0x7fdbe0154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:44.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.062+0000 7fdbe51ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fdbe006c1d0 0x7fdbe006c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:44.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.062+0000 7fdbe51ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbe00c7c50 con 0x7fdbe00c7740 2023-07-27T20:32:44.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.062+0000 7fdbe51ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbe006bd40 con 0x7fdbe014aab0 2023-07-27T20:32:44.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.062+0000 7fdbe51ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbe00c62f0 con 0x7fdbe006c1d0 2023-07-27T20:32:44.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.062+0000 7fdbded9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdbe014aab0 0x7fdbe0154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:44.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.062+0000 7fdbde59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fdbe00c7740 0x7fdbe00c41c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58660/0 (socket says 172.21.15.72:58660) 2023-07-27T20:32:44.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.062+0000 7fdbded9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdbe014aab0 0x7fdbe0154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54958/0 (socket says 172.21.15.72:54958) 2023-07-27T20:32:44.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.062+0000 7fdbde59c700 1 -- 172.21.15.72:0/50165138 learned_addr learned my addr 172.21.15.72:0/50165138 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:44.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.062+0000 7fdbdf59e700 1 --2- 172.21.15.72:0/50165138 >> v2:172.21.15.173:3300/0 conn(0x7fdbe006c1d0 0x7fdbe006c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:44.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.063+0000 7fdbded9d700 1 -- 172.21.15.72:0/50165138 >> v2:172.21.15.173:3300/0 conn(0x7fdbe006c1d0 msgr2=0x7fdbe006c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:44.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.063+0000 7fdbded9d700 1 --2- 172.21.15.72:0/50165138 >> v2:172.21.15.173:3300/0 conn(0x7fdbe006c1d0 0x7fdbe006c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:44.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.063+0000 7fdbded9d700 1 -- 172.21.15.72:0/50165138 >> v1:172.21.15.72:6789/0 conn(0x7fdbe00c7740 legacy=0x7fdbe00c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:44.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.063+0000 7fdbded9d700 1 -- 172.21.15.72:0/50165138 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe0155050 con 0x7fdbe014aab0 2023-07-27T20:32:44.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.063+0000 7fdbdf59e700 1 --2- 172.21.15.72:0/50165138 >> v2:172.21.15.173:3300/0 conn(0x7fdbe006c1d0 0x7fdbe006c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:32:44.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.063+0000 7fdbddd9b700 1 -- 172.21.15.72:0/50165138 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1563485607 0 0) 0x7fdbe00c7c50 con 0x7fdbe00c7740 2023-07-27T20:32:44.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.063+0000 7fdbded9d700 1 --2- 172.21.15.72:0/50165138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbe014aab0 0x7fdbe0154b10 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fdbe00c96f0 tx=0x7fdbd0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b9aa32f1c3a7c8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:44.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.063+0000 7fdbddd9b700 1 -- 172.21.15.72:0/50165138 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd0011830 con 0x7fdbe014aab0 2023-07-27T20:32:44.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.063+0000 7fdbddd9b700 1 -- 172.21.15.72:0/50165138 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd0011990 con 0x7fdbe014aab0 2023-07-27T20:32:44.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.063+0000 7fdbddd9b700 1 -- 172.21.15.72:0/50165138 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd0011d20 con 0x7fdbe014aab0 2023-07-27T20:32:44.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.064+0000 7fdbe51ff700 1 -- 172.21.15.72:0/50165138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbe014aab0 msgr2=0x7fdbe0154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:44.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.064+0000 7fdbe51ff700 1 --2- 172.21.15.72:0/50165138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbe014aab0 0x7fdbe0154b10 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fdbe00c96f0 tx=0x7fdbd0009b20 comp rx=0 tx=0).stop 2023-07-27T20:32:44.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.064+0000 7fdbe51ff700 1 -- 172.21.15.72:0/50165138 shutdown_connections 2023-07-27T20:32:44.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.064+0000 7fdbe51ff700 1 --2- 172.21.15.72:0/50165138 >> v2:172.21.15.173:3300/0 conn(0x7fdbe006c1d0 0x7fdbe006c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:44.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.064+0000 7fdbe51ff700 1 --2- 172.21.15.72:0/50165138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbe014aab0 0x7fdbe0154b10 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:44.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.064+0000 7fdbe51ff700 1 -- 172.21.15.72:0/50165138 >> 172.21.15.72:0/50165138 conn(0x7fdbe00ab3f0 msgr2=0x7fdbe00ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:44.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.064+0000 7fdbe51ff700 1 -- 172.21.15.72:0/50165138 shutdown_connections 2023-07-27T20:32:44.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.064+0000 7fdbe51ff700 1 -- 172.21.15.72:0/50165138 wait complete. 2023-07-27T20:32:44.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.065+0000 7fdbe51ff700 1 Processor -- start 2023-07-27T20:32:44.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.066+0000 7fdbe51ff700 1 -- start start 2023-07-27T20:32:44.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.066+0000 7fdbe51ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbe006c1d0 0x7fdbe00bde80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:44.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.067+0000 7fdbe51ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbe00c7740 0x7fdbe0151b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:44.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.067+0000 7fdbe51ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdbe014aab0 0x7fdbe0157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:44.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.067+0000 7fdbe51ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe014da80 con 0x7fdbe00c7740 2023-07-27T20:32:44.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.067+0000 7fdbe51ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe014cf00 con 0x7fdbe006c1d0 2023-07-27T20:32:44.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.067+0000 7fdbe51ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe014d1e0 con 0x7fdbe014aab0 2023-07-27T20:32:44.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.067+0000 7fdbde59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbe00c7740 0x7fdbe0151b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:44.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.067+0000 7fdbde59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbe00c7740 0x7fdbe0151b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54964/0 (socket says 172.21.15.72:54964) 2023-07-27T20:32:44.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.067+0000 7fdbde59c700 1 -- 172.21.15.72:0/1991508643 learned_addr learned my addr 172.21.15.72:0/1991508643 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:44.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.067+0000 7fdbded9d700 1 --2- 172.21.15.72:0/1991508643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbe006c1d0 0x7fdbe00bde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:44.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.067+0000 7fdbdf59e700 1 --2- 172.21.15.72:0/1991508643 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdbe014aab0 0x7fdbe0157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:44.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.067+0000 7fdbde59c700 1 -- 172.21.15.72:0/1991508643 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdbe014aab0 msgr2=0x7fdbe0157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:44.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.067+0000 7fdbde59c700 1 --2- 172.21.15.72:0/1991508643 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdbe014aab0 0x7fdbe0157a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:44.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.067+0000 7fdbde59c700 1 -- 172.21.15.72:0/1991508643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbe006c1d0 msgr2=0x7fdbe00bde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:44.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.067+0000 7fdbde59c700 1 --2- 172.21.15.72:0/1991508643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbe006c1d0 0x7fdbe00bde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:44.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.067+0000 7fdbde59c700 1 -- 172.21.15.72:0/1991508643 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd00094a0 con 0x7fdbe00c7740 2023-07-27T20:32:44.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.067+0000 7fdbded9d700 1 --2- 172.21.15.72:0/1991508643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbe006c1d0 0x7fdbe00bde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:44.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.068+0000 7fdbde59c700 1 --2- 172.21.15.72:0/1991508643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbe00c7740 0x7fdbe0151b90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fdbd40011e0 tx=0x7fdbd400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:44.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.068+0000 7fdbc77fe700 1 -- 172.21.15.72:0/1991508643 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd4004c80 con 0x7fdbe00c7740 2023-07-27T20:32:44.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.068+0000 7fdbc77fe700 1 -- 172.21.15.72:0/1991508643 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd4004e00 con 0x7fdbe00c7740 2023-07-27T20:32:44.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.068+0000 7fdbe51ff700 1 -- 172.21.15.72:0/1991508643 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbe014d4c0 con 0x7fdbe00c7740 2023-07-27T20:32:44.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.068+0000 7fdbc77fe700 1 -- 172.21.15.72:0/1991508643 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd4007310 con 0x7fdbe00c7740 2023-07-27T20:32:44.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.068+0000 7fdbe51ff700 1 -- 172.21.15.72:0/1991508643 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe01520d0 con 0x7fdbe00c7740 2023-07-27T20:32:44.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.069+0000 7fdbe51ff700 1 -- 172.21.15.72:0/1991508643 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbe00bea50 con 0x7fdbe00c7740 2023-07-27T20:32:44.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.070+0000 7fdbc77fe700 1 -- 172.21.15.72:0/1991508643 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdbd4007470 con 0x7fdbe00c7740 2023-07-27T20:32:44.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.071+0000 7fdbc77fe700 1 --2- 172.21.15.72:0/1991508643 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fdbcc06ace0 0x7fdbcc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:44.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.071+0000 7fdbc77fe700 1 -- 172.21.15.72:0/1991508643 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdbd4089680 con 0x7fdbe00c7740 2023-07-27T20:32:44.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.072+0000 7fdbded9d700 1 --2- 172.21.15.72:0/1991508643 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fdbcc06ace0 0x7fdbcc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:44.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.072+0000 7fdbded9d700 1 --2- 172.21.15.72:0/1991508643 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fdbcc06ace0 0x7fdbcc06d1a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdbd00090b0 tx=0x7fdbd001c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:44.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.076+0000 7fdbc77fe700 1 -- 172.21.15.72:0/1991508643 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdbe00bea50 con 0x7fdbe00c7740 2023-07-27T20:32:44.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.271+0000 7fdbe51ff700 1 -- 172.21.15.72:0/1991508643 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdbe00bea50 con 0x7fdbe00c7740 2023-07-27T20:32:44.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.271+0000 7fdbc77fe700 1 -- 172.21.15.72:0/1991508643 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdbe00bea50 con 0x7fdbe00c7740 2023-07-27T20:32:44.259 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-27T20:32:44.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.273+0000 7fdbe51ff700 1 -- 172.21.15.72:0/1991508643 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fdbcc06ace0 msgr2=0x7fdbcc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:44.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.273+0000 7fdbe51ff700 1 --2- 172.21.15.72:0/1991508643 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fdbcc06ace0 0x7fdbcc06d1a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdbd00090b0 tx=0x7fdbd001c040 comp rx=0 tx=0).stop 2023-07-27T20:32:44.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.273+0000 7fdbe51ff700 1 -- 172.21.15.72:0/1991508643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbe00c7740 msgr2=0x7fdbe0151b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:44.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.274+0000 7fdbe51ff700 1 --2- 172.21.15.72:0/1991508643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbe00c7740 0x7fdbe0151b90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fdbd40011e0 tx=0x7fdbd400cae0 comp rx=0 tx=0).stop 2023-07-27T20:32:44.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.274+0000 7fdbe51ff700 1 -- 172.21.15.72:0/1991508643 shutdown_connections 2023-07-27T20:32:44.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.274+0000 7fdbe51ff700 1 --2- 172.21.15.72:0/1991508643 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fdbcc06ace0 0x7fdbcc06d1a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:44.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.274+0000 7fdbe51ff700 1 --2- 172.21.15.72:0/1991508643 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdbe014aab0 0x7fdbe0157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:44.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.274+0000 7fdbe51ff700 1 --2- 172.21.15.72:0/1991508643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbe006c1d0 0x7fdbe00bde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:44.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.274+0000 7fdbe51ff700 1 --2- 172.21.15.72:0/1991508643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbe00c7740 0x7fdbe0151b90 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:44.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.274+0000 7fdbe51ff700 1 -- 172.21.15.72:0/1991508643 >> 172.21.15.72:0/1991508643 conn(0x7fdbe00ab3f0 msgr2=0x7fdbe00c40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:44.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.274+0000 7fdbe51ff700 1 -- 172.21.15.72:0/1991508643 shutdown_connections 2023-07-27T20:32:44.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.274+0000 7fdbe51ff700 1 -- 172.21.15.72:0/1991508643 wait complete. 2023-07-27T20:32:44.279 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-27T20:32:44.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.490+0000 7f245f7ff700 1 Processor -- start 2023-07-27T20:32:44.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.490+0000 7f245f7ff700 1 -- start start 2023-07-27T20:32:44.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.491+0000 7f245f7ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f245814db30 0x7f24580bb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:44.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.491+0000 7f245f7ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f24580bb7e0 0x7f2458153a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:44.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.491+0000 7f245f7ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f24580c0f80 0x7f2458153f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:44.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.491+0000 7f245f7ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24580bbd40 con 0x7f24580bb7e0 2023-07-27T20:32:44.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.491+0000 7f245f7ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24580baa00 con 0x7f24580c0f80 2023-07-27T20:32:44.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.491+0000 7f245f7ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24580baf20 con 0x7f245814db30 2023-07-27T20:32:44.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.492+0000 7f245cd9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f24580bb7e0 0x7f2458153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:44.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.492+0000 7f245cd9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f24580bb7e0 0x7f2458153a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54974/0 (socket says 172.21.15.72:54974) 2023-07-27T20:32:44.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.492+0000 7f245cd9a700 1 -- 172.21.15.72:0/2055353192 learned_addr learned my addr 172.21.15.72:0/2055353192 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:44.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.492+0000 7f245dd9c700 1 --2- 172.21.15.72:0/2055353192 >> v2:172.21.15.173:3300/0 conn(0x7f24580c0f80 0x7f2458153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:44.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.492+0000 7f245d59b700 1 --2- 172.21.15.72:0/2055353192 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f245814db30 0x7f24580bb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:44.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.492+0000 7f245cd9a700 1 -- 172.21.15.72:0/2055353192 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f245814db30 msgr2=0x7f24580bb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:44.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.492+0000 7f245cd9a700 1 --2- 172.21.15.72:0/2055353192 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f245814db30 0x7f24580bb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:44.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.492+0000 7f245cd9a700 1 -- 172.21.15.72:0/2055353192 >> v2:172.21.15.173:3300/0 conn(0x7f24580c0f80 msgr2=0x7f2458153f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:44.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.492+0000 7f245cd9a700 1 --2- 172.21.15.72:0/2055353192 >> v2:172.21.15.173:3300/0 conn(0x7f24580c0f80 0x7f2458153f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:44.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.492+0000 7f245cd9a700 1 -- 172.21.15.72:0/2055353192 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24581544c0 con 0x7f24580bb7e0 2023-07-27T20:32:44.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.492+0000 7f245cd9a700 1 --2- 172.21.15.72:0/2055353192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24580bb7e0 0x7f2458153a40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f245806e2d0 tx=0x7f2448009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20ea0dd1c8bad81e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:44.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.493+0000 7f244ffff700 1 -- 172.21.15.72:0/2055353192 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2448011830 con 0x7f24580bb7e0 2023-07-27T20:32:44.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.493+0000 7f244ffff700 1 -- 172.21.15.72:0/2055353192 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2448011990 con 0x7f24580bb7e0 2023-07-27T20:32:44.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.493+0000 7f244ffff700 1 -- 172.21.15.72:0/2055353192 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2448011d20 con 0x7f24580bb7e0 2023-07-27T20:32:44.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.493+0000 7f245f7ff700 1 -- 172.21.15.72:0/2055353192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24580bb7e0 msgr2=0x7f2458153a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:44.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.493+0000 7f245f7ff700 1 --2- 172.21.15.72:0/2055353192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24580bb7e0 0x7f2458153a40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f245806e2d0 tx=0x7f2448009bd0 comp rx=0 tx=0).stop 2023-07-27T20:32:44.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.493+0000 7f245f7ff700 1 -- 172.21.15.72:0/2055353192 shutdown_connections 2023-07-27T20:32:44.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.493+0000 7f245f7ff700 1 --2- 172.21.15.72:0/2055353192 >> v2:172.21.15.173:3300/0 conn(0x7f24580c0f80 0x7f2458153f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:44.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.493+0000 7f245f7ff700 1 --2- 172.21.15.72:0/2055353192 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f245814db30 0x7f24580bb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:44.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.493+0000 7f245f7ff700 1 --2- 172.21.15.72:0/2055353192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24580bb7e0 0x7f2458153a40 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:44.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.493+0000 7f245f7ff700 1 -- 172.21.15.72:0/2055353192 >> 172.21.15.72:0/2055353192 conn(0x7f245806a190 msgr2=0x7f245806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:44.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.493+0000 7f245f7ff700 1 -- 172.21.15.72:0/2055353192 shutdown_connections 2023-07-27T20:32:44.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.493+0000 7f245f7ff700 1 -- 172.21.15.72:0/2055353192 wait complete. 2023-07-27T20:32:44.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.495+0000 7f245f7ff700 1 Processor -- start 2023-07-27T20:32:44.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.495+0000 7f245f7ff700 1 -- start start 2023-07-27T20:32:44.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.496+0000 7f245f7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24580bb7e0 0x7f245814ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:44.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.496+0000 7f245f7ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24580c0f80 0x7f24580c4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:44.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.496+0000 7f245f7ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f245814db30 0x7f2458147dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:44.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.496+0000 7f245f7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24580c3180 con 0x7f24580bb7e0 2023-07-27T20:32:44.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.496+0000 7f245f7ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24580c3460 con 0x7f24580c0f80 2023-07-27T20:32:44.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.496+0000 7f245f7ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24580c3740 con 0x7f245814db30 2023-07-27T20:32:44.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.496+0000 7f245d59b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24580bb7e0 0x7f245814ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:44.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.496+0000 7f245d59b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24580bb7e0 0x7f245814ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54988/0 (socket says 172.21.15.72:54988) 2023-07-27T20:32:44.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.496+0000 7f245d59b700 1 -- 172.21.15.72:0/713218109 learned_addr learned my addr 172.21.15.72:0/713218109 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:44.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.496+0000 7f245cd9a700 1 --2- 172.21.15.72:0/713218109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24580c0f80 0x7f24580c4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:44.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.496+0000 7f245dd9c700 1 --2- 172.21.15.72:0/713218109 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f245814db30 0x7f2458147dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:44.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.496+0000 7f245d59b700 1 -- 172.21.15.72:0/713218109 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f245814db30 msgr2=0x7f2458147dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:44.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.497+0000 7f245d59b700 1 --2- 172.21.15.72:0/713218109 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f245814db30 0x7f2458147dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:44.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.497+0000 7f245d59b700 1 -- 172.21.15.72:0/713218109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24580c0f80 msgr2=0x7f24580c4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:44.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.497+0000 7f245d59b700 1 --2- 172.21.15.72:0/713218109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24580c0f80 0x7f24580c4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:44.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.497+0000 7f245d59b700 1 -- 172.21.15.72:0/713218109 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2448009550 con 0x7f24580bb7e0 2023-07-27T20:32:44.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.497+0000 7f245d59b700 1 --2- 172.21.15.72:0/713218109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24580bb7e0 0x7f245814ff70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f245400e9b0 tx=0x7f245400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:44.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.497+0000 7f244dffb700 1 -- 172.21.15.72:0/713218109 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2454009710 con 0x7f24580bb7e0 2023-07-27T20:32:44.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.497+0000 7f244dffb700 1 -- 172.21.15.72:0/713218109 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245400c850 con 0x7f24580bb7e0 2023-07-27T20:32:44.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.497+0000 7f244dffb700 1 -- 172.21.15.72:0/713218109 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245400cbc0 con 0x7f24580bb7e0 2023-07-27T20:32:44.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.497+0000 7f245f7ff700 1 -- 172.21.15.72:0/713218109 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24580c3a20 con 0x7f24580bb7e0 2023-07-27T20:32:44.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.497+0000 7f245f7ff700 1 -- 172.21.15.72:0/713218109 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24581504b0 con 0x7f24580bb7e0 2023-07-27T20:32:44.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.498+0000 7f245f7ff700 1 -- 172.21.15.72:0/713218109 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24580c2600 con 0x7f24580bb7e0 2023-07-27T20:32:44.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.499+0000 7f244dffb700 1 -- 172.21.15.72:0/713218109 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f245400cd20 con 0x7f24580bb7e0 2023-07-27T20:32:44.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.500+0000 7f244dffb700 1 --2- 172.21.15.72:0/713218109 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f243c06ace0 0x7f243c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:44.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.500+0000 7f244dffb700 1 -- 172.21.15.72:0/713218109 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2454089950 con 0x7f24580bb7e0 2023-07-27T20:32:44.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.500+0000 7f245cd9a700 1 --2- 172.21.15.72:0/713218109 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f243c06ace0 0x7f243c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:44.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.501+0000 7f245cd9a700 1 --2- 172.21.15.72:0/713218109 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f243c06ace0 0x7f243c06d1a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2448014040 tx=0x7f2448008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:44.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.504+0000 7f244dffb700 1 -- 172.21.15.72:0/713218109 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f24540580c0 con 0x7f24580bb7e0 2023-07-27T20:32:44.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.697+0000 7f245f7ff700 1 -- 172.21.15.72:0/713218109 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f245804e470 con 0x7f24580bb7e0 2023-07-27T20:32:44.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.698+0000 7f244dffb700 1 -- 172.21.15.72:0/713218109 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2454057c50 con 0x7f24580bb7e0 2023-07-27T20:32:44.686 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:32:44.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.700+0000 7f245f7ff700 1 -- 172.21.15.72:0/713218109 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f243c06ace0 msgr2=0x7f243c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:44.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.700+0000 7f245f7ff700 1 --2- 172.21.15.72:0/713218109 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f243c06ace0 0x7f243c06d1a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2448014040 tx=0x7f2448008030 comp rx=0 tx=0).stop 2023-07-27T20:32:44.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.700+0000 7f245f7ff700 1 -- 172.21.15.72:0/713218109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24580bb7e0 msgr2=0x7f245814ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:44.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.700+0000 7f245f7ff700 1 --2- 172.21.15.72:0/713218109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24580bb7e0 0x7f245814ff70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f245400e9b0 tx=0x7f245400ed70 comp rx=0 tx=0).stop 2023-07-27T20:32:44.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.700+0000 7f245f7ff700 1 -- 172.21.15.72:0/713218109 shutdown_connections 2023-07-27T20:32:44.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.700+0000 7f245f7ff700 1 --2- 172.21.15.72:0/713218109 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f243c06ace0 0x7f243c06d1a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:44.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.700+0000 7f245f7ff700 1 --2- 172.21.15.72:0/713218109 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f245814db30 0x7f2458147dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:44.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.700+0000 7f245f7ff700 1 --2- 172.21.15.72:0/713218109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24580bb7e0 0x7f245814ff70 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:44.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.700+0000 7f245f7ff700 1 --2- 172.21.15.72:0/713218109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24580c0f80 0x7f24580c4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:44.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.700+0000 7f245f7ff700 1 -- 172.21.15.72:0/713218109 >> 172.21.15.72:0/713218109 conn(0x7f245806a190 msgr2=0x7f2458151070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:44.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.700+0000 7f245f7ff700 1 -- 172.21.15.72:0/713218109 shutdown_connections 2023-07-27T20:32:44.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.700+0000 7f245f7ff700 1 -- 172.21.15.72:0/713218109 wait complete. 2023-07-27T20:32:44.706 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T20:32:44.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.912+0000 7fe26f9ff700 1 Processor -- start 2023-07-27T20:32:44.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.912+0000 7fe26f9ff700 1 -- start start 2023-07-27T20:32:44.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.913+0000 7fe26f9ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe2680c4400 0x7fe2680c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:44.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.914+0000 7fe26f9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe2681549f0 0x7fe2681514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:44.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.914+0000 7fe26f9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe26806b710 con 0x7fe26806b150 2023-07-27T20:32:44.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.914+0000 7fe26f9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2681545d0 con 0x7fe2681549f0 2023-07-27T20:32:44.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.914+0000 7fe26f9ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe26806c860 con 0x7fe2680c4400 2023-07-27T20:32:44.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.914+0000 7fe26df9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe2681549f0 0x7fe2681514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:44.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.914+0000 7fe26df9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe2681549f0 0x7fe2681514a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54996/0 (socket says 172.21.15.72:54996) 2023-07-27T20:32:44.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.914+0000 7fe26cf9a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe26806b150 0x7fe2680c4cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58670/0 (socket says 172.21.15.72:58670) 2023-07-27T20:32:44.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.914+0000 7fe26df9c700 1 -- 172.21.15.72:0/753963326 learned_addr learned my addr 172.21.15.72:0/753963326 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:44.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.914+0000 7fe26d79b700 1 --2- 172.21.15.72:0/753963326 >> v2:172.21.15.173:3300/0 conn(0x7fe2680c4400 0x7fe2680c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:44.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.914+0000 7fe26df9c700 1 -- 172.21.15.72:0/753963326 >> v2:172.21.15.173:3300/0 conn(0x7fe2680c4400 msgr2=0x7fe2680c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:44.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.914+0000 7fe26df9c700 1 --2- 172.21.15.72:0/753963326 >> v2:172.21.15.173:3300/0 conn(0x7fe2680c4400 0x7fe2680c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:44.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.914+0000 7fe26df9c700 1 -- 172.21.15.72:0/753963326 >> v1:172.21.15.72:6789/0 conn(0x7fe26806b150 legacy=0x7fe2680c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:44.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.914+0000 7fe26df9c700 1 -- 172.21.15.72:0/753963326 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe26806b9f0 con 0x7fe2681549f0 2023-07-27T20:32:44.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.914+0000 7fe26d79b700 1 --2- 172.21.15.72:0/753963326 >> v2:172.21.15.173:3300/0 conn(0x7fe2680c4400 0x7fe2680c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:44.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.915+0000 7fe26df9c700 1 --2- 172.21.15.72:0/753963326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2681549f0 0x7fe2681514a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe26808b040 tx=0x7fe26000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85ad765b67b71bf7 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:44.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.915+0000 7fe25ffff700 1 -- 172.21.15.72:0/753963326 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26000e070 con 0x7fe2681549f0 2023-07-27T20:32:44.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.915+0000 7fe25ffff700 1 -- 172.21.15.72:0/753963326 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26000b9c0 con 0x7fe2681549f0 2023-07-27T20:32:44.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.915+0000 7fe25ffff700 1 -- 172.21.15.72:0/753963326 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26000bd70 con 0x7fe2681549f0 2023-07-27T20:32:44.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.915+0000 7fe26f9ff700 1 -- 172.21.15.72:0/753963326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2681549f0 msgr2=0x7fe2681514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:44.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.915+0000 7fe26f9ff700 1 --2- 172.21.15.72:0/753963326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2681549f0 0x7fe2681514a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe26808b040 tx=0x7fe26000b330 comp rx=0 tx=0).stop 2023-07-27T20:32:44.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.915+0000 7fe26f9ff700 1 -- 172.21.15.72:0/753963326 shutdown_connections 2023-07-27T20:32:44.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.915+0000 7fe26f9ff700 1 --2- 172.21.15.72:0/753963326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2681549f0 0x7fe2681514a0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:44.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.915+0000 7fe26f9ff700 1 --2- 172.21.15.72:0/753963326 >> v2:172.21.15.173:3300/0 conn(0x7fe2680c4400 0x7fe2680c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:44.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.915+0000 7fe26f9ff700 1 -- 172.21.15.72:0/753963326 >> 172.21.15.72:0/753963326 conn(0x7fe2680ab300 msgr2=0x7fe2680ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:44.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.915+0000 7fe26f9ff700 1 -- 172.21.15.72:0/753963326 shutdown_connections 2023-07-27T20:32:44.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.916+0000 7fe26f9ff700 1 -- 172.21.15.72:0/753963326 wait complete. 2023-07-27T20:32:44.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.917+0000 7fe26f9ff700 1 Processor -- start 2023-07-27T20:32:44.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.917+0000 7fe26f9ff700 1 -- start start 2023-07-27T20:32:44.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.918+0000 7fe26f9ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe26806b150 0x7fe26814a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:44.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.918+0000 7fe26f9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2680c4400 0x7fe268149a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:44.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.918+0000 7fe26f9ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe2681549f0 0x7fe2681e9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:44.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.918+0000 7fe26f9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26814aa90 con 0x7fe2680c4400 2023-07-27T20:32:44.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.918+0000 7fe26f9ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26814dbe0 con 0x7fe26806b150 2023-07-27T20:32:44.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.918+0000 7fe26f9ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26814dec0 con 0x7fe2681549f0 2023-07-27T20:32:44.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.918+0000 7fe26d79b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe26806b150 0x7fe26814a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:44.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.918+0000 7fe26cf9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2680c4400 0x7fe268149a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:44.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.918+0000 7fe26d79b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe26806b150 0x7fe26814a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.72:56392/0 (socket says 172.21.15.72:56392) 2023-07-27T20:32:44.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.918+0000 7fe26d79b700 1 -- 172.21.15.72:0/616315704 learned_addr learned my addr 172.21.15.72:0/616315704 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:44.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.919+0000 7fe26df9c700 1 --2- 172.21.15.72:0/616315704 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe2681549f0 0x7fe2681e9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:44.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.919+0000 7fe26cf9a700 1 -- 172.21.15.72:0/616315704 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe2681549f0 msgr2=0x7fe2681e9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:44.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.919+0000 7fe26cf9a700 1 --2- 172.21.15.72:0/616315704 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe2681549f0 0x7fe2681e9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:44.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.919+0000 7fe26cf9a700 1 -- 172.21.15.72:0/616315704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe26806b150 msgr2=0x7fe26814a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:44.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.919+0000 7fe26cf9a700 1 --2- 172.21.15.72:0/616315704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe26806b150 0x7fe26814a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:44.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.919+0000 7fe26cf9a700 1 -- 172.21.15.72:0/616315704 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe260009b30 con 0x7fe2680c4400 2023-07-27T20:32:44.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.919+0000 7fe26cf9a700 1 --2- 172.21.15.72:0/616315704 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2680c4400 0x7fe268149a30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe25800c450 tx=0x7fe25800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:44.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.919+0000 7fe25dffb700 1 -- 172.21.15.72:0/616315704 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe258005cb0 con 0x7fe2680c4400 2023-07-27T20:32:44.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.919+0000 7fe25dffb700 1 -- 172.21.15.72:0/616315704 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe258005e10 con 0x7fe2680c4400 2023-07-27T20:32:44.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.919+0000 7fe26f9ff700 1 -- 172.21.15.72:0/616315704 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe26814e1a0 con 0x7fe2680c4400 2023-07-27T20:32:44.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.919+0000 7fe25dffb700 1 -- 172.21.15.72:0/616315704 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2580072d0 con 0x7fe2680c4400 2023-07-27T20:32:44.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.920+0000 7fe26f9ff700 1 -- 172.21.15.72:0/616315704 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe268149f70 con 0x7fe2680c4400 2023-07-27T20:32:44.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.920+0000 7fe26f9ff700 1 -- 172.21.15.72:0/616315704 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe268074310 con 0x7fe2680c4400 2023-07-27T20:32:44.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.921+0000 7fe25dffb700 1 -- 172.21.15.72:0/616315704 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe258007430 con 0x7fe2680c4400 2023-07-27T20:32:44.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.922+0000 7fe25dffb700 1 --2- 172.21.15.72:0/616315704 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe24c06ace0 0x7fe24c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:44.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.922+0000 7fe25dffb700 1 -- 172.21.15.72:0/616315704 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe258088980 con 0x7fe2680c4400 2023-07-27T20:32:44.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.923+0000 7fe26d79b700 1 --2- 172.21.15.72:0/616315704 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe24c06ace0 0x7fe24c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:44.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.923+0000 7fe26d79b700 1 --2- 172.21.15.72:0/616315704 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe24c06ace0 0x7fe24c06d1a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe2681526c0 tx=0x7fe264008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:44.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:44.927+0000 7fe25dffb700 1 -- 172.21.15.72:0/616315704 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe2580537a0 con 0x7fe2680c4400 2023-07-27T20:32:45.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.165+0000 7fe26f9ff700 1 -- 172.21.15.72:0/616315704 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe2680008d0 con 0x7fe2680c4400 2023-07-27T20:32:45.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.165+0000 7fe25dffb700 1 -- 172.21.15.72:0/616315704 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7fe25800ce60 con 0x7fe2680c4400 2023-07-27T20:32:45.153 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:32:45.153 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/1913374698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1913374698},{"type":"v1","addr":"172.21.15.72:6834","nonce":1913374698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/3260445560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":3260445560},{"type":"v1","addr":"172.21.15.72:6835","nonce":3260445560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1305837931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1305837931},{"type":"v1","addr":"172.21.15.173:6837","nonce":1305837931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T20:31:28.592113+0000","modified":"2023-07-27T20:31:51.217923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6835/516740687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":516740687},{"type":"v1","addr":"172.21.15.173:6835","nonce":516740687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-27T20:32:45.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.168+0000 7fe26f9ff700 1 -- 172.21.15.72:0/616315704 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe24c06ace0 msgr2=0x7fe24c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:45.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.168+0000 7fe26f9ff700 1 --2- 172.21.15.72:0/616315704 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe24c06ace0 0x7fe24c06d1a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe2681526c0 tx=0x7fe264008040 comp rx=0 tx=0).stop 2023-07-27T20:32:45.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.168+0000 7fe26f9ff700 1 -- 172.21.15.72:0/616315704 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2680c4400 msgr2=0x7fe268149a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:45.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.168+0000 7fe26f9ff700 1 --2- 172.21.15.72:0/616315704 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2680c4400 0x7fe268149a30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe25800c450 tx=0x7fe25800c760 comp rx=0 tx=0).stop 2023-07-27T20:32:45.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.168+0000 7fe26f9ff700 1 -- 172.21.15.72:0/616315704 shutdown_connections 2023-07-27T20:32:45.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.168+0000 7fe26f9ff700 1 --2- 172.21.15.72:0/616315704 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe24c06ace0 0x7fe24c06d1a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:45.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.168+0000 7fe26f9ff700 1 --2- 172.21.15.72:0/616315704 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe2681549f0 0x7fe2681e9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:45.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.168+0000 7fe26f9ff700 1 --2- 172.21.15.72:0/616315704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe26806b150 0x7fe26814a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:45.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.168+0000 7fe26f9ff700 1 --2- 172.21.15.72:0/616315704 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2680c4400 0x7fe268149a30 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:45.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.168+0000 7fe26f9ff700 1 -- 172.21.15.72:0/616315704 >> 172.21.15.72:0/616315704 conn(0x7fe2680ab300 msgr2=0x7fe268150940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:45.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.168+0000 7fe26f9ff700 1 -- 172.21.15.72:0/616315704 shutdown_connections 2023-07-27T20:32:45.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.168+0000 7fe26f9ff700 1 -- 172.21.15.72:0/616315704 wait complete. 2023-07-27T20:32:45.158 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 9 2023-07-27T20:32:45.175 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:32:45.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.382+0000 7f53fb5ff700 1 Processor -- start 2023-07-27T20:32:45.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.383+0000 7f53fb5ff700 1 -- start start 2023-07-27T20:32:45.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.384+0000 7f53fb5ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f53f406b150 0x7f53f40c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:45.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.384+0000 7f53fb5ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f53f41549f0 0x7f53f41514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:45.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.384+0000 7f53fb5ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53f406b710 con 0x7f53f40c4400 2023-07-27T20:32:45.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.384+0000 7f53fb5ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53f41545d0 con 0x7f53f41549f0 2023-07-27T20:32:45.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.384+0000 7f53fb5ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53f406c860 con 0x7f53f406b150 2023-07-27T20:32:45.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.384+0000 7f53f939b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f53f40c4400 0x7f53f40c4cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58672/0 (socket says 172.21.15.72:58672) 2023-07-27T20:32:45.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.384+0000 7f53f939b700 1 -- 172.21.15.72:0/1177937510 learned_addr learned my addr 172.21.15.72:0/1177937510 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:45.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.384+0000 7f53f9b9c700 1 --2- 172.21.15.72:0/1177937510 >> v2:172.21.15.72:3300/0 conn(0x7f53f41549f0 0x7f53f41514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:45.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.384+0000 7f53f8b9a700 1 --2- 172.21.15.72:0/1177937510 >> v2:172.21.15.173:3300/0 conn(0x7f53f406b150 0x7f53f40c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:45.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.384+0000 7f53ebfff700 1 -- 172.21.15.72:0/1177937510 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 993189560 0 0) 0x7f53f406b710 con 0x7f53f40c4400 2023-07-27T20:32:45.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.384+0000 7f53ebfff700 1 -- 172.21.15.72:0/1177937510 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53e00035b0 con 0x7f53f40c4400 2023-07-27T20:32:45.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.384+0000 7f53f9b9c700 1 -- 172.21.15.72:0/1177937510 >> v2:172.21.15.173:3300/0 conn(0x7f53f406b150 msgr2=0x7f53f40c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:45.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.384+0000 7f53f9b9c700 1 --2- 172.21.15.72:0/1177937510 >> v2:172.21.15.173:3300/0 conn(0x7f53f406b150 0x7f53f40c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:45.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.384+0000 7f53f9b9c700 1 -- 172.21.15.72:0/1177937510 >> v1:172.21.15.72:6789/0 conn(0x7f53f40c4400 legacy=0x7f53f40c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:45.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.384+0000 7f53f9b9c700 1 -- 172.21.15.72:0/1177937510 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f406b9f0 con 0x7f53f41549f0 2023-07-27T20:32:45.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.384+0000 7f53f8b9a700 1 --2- 172.21.15.72:0/1177937510 >> v2:172.21.15.173:3300/0 conn(0x7f53f406b150 0x7f53f40c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:32:45.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.385+0000 7f53f9b9c700 1 --2- 172.21.15.72:0/1177937510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53f41549f0 0x7f53f41514a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f53f40c0870 tx=0x7f53ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25fa59d79657e90c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:45.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.385+0000 7f53ebfff700 1 -- 172.21.15.72:0/1177937510 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec00e070 con 0x7f53f41549f0 2023-07-27T20:32:45.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.385+0000 7f53ebfff700 1 -- 172.21.15.72:0/1177937510 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ec00bb20 con 0x7f53f41549f0 2023-07-27T20:32:45.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.385+0000 7f53ebfff700 1 -- 172.21.15.72:0/1177937510 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec012430 con 0x7f53f41549f0 2023-07-27T20:32:45.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.385+0000 7f53fb5ff700 1 -- 172.21.15.72:0/1177937510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53f41549f0 msgr2=0x7f53f41514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:45.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.385+0000 7f53fb5ff700 1 --2- 172.21.15.72:0/1177937510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53f41549f0 0x7f53f41514a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f53f40c0870 tx=0x7f53ec00b330 comp rx=0 tx=0).stop 2023-07-27T20:32:45.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.385+0000 7f53fb5ff700 1 -- 172.21.15.72:0/1177937510 shutdown_connections 2023-07-27T20:32:45.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.385+0000 7f53fb5ff700 1 --2- 172.21.15.72:0/1177937510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53f41549f0 0x7f53f41514a0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:45.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.385+0000 7f53fb5ff700 1 --2- 172.21.15.72:0/1177937510 >> v2:172.21.15.173:3300/0 conn(0x7f53f406b150 0x7f53f40c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:45.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.385+0000 7f53fb5ff700 1 -- 172.21.15.72:0/1177937510 >> 172.21.15.72:0/1177937510 conn(0x7f53f40ab300 msgr2=0x7f53f40ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:45.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.386+0000 7f53fb5ff700 1 -- 172.21.15.72:0/1177937510 shutdown_connections 2023-07-27T20:32:45.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.386+0000 7f53fb5ff700 1 -- 172.21.15.72:0/1177937510 wait complete. 2023-07-27T20:32:45.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.388+0000 7f53fb5ff700 1 Processor -- start 2023-07-27T20:32:45.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.388+0000 7f53fb5ff700 1 -- start start 2023-07-27T20:32:45.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.389+0000 7f53fb5ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53f406b150 0x7f53f41db8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:45.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.389+0000 7f53fb5ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f53f40c4400 0x7f53f41ddba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:45.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.389+0000 7f53fb5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53f41549f0 0x7f53f41dc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:45.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.389+0000 7f53fb5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f4153780 con 0x7f53f41549f0 2023-07-27T20:32:45.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.389+0000 7f53fb5ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f41e9090 con 0x7f53f406b150 2023-07-27T20:32:45.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.389+0000 7f53fb5ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f41ed380 con 0x7f53f40c4400 2023-07-27T20:32:45.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.389+0000 7f53f9b9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53f41549f0 0x7f53f41dc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:45.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.389+0000 7f53f9b9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53f41549f0 0x7f53f41dc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55014/0 (socket says 172.21.15.72:55014) 2023-07-27T20:32:45.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.389+0000 7f53f9b9c700 1 -- 172.21.15.72:0/2605138089 learned_addr learned my addr 172.21.15.72:0/2605138089 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:45.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.390+0000 7f53f939b700 1 --2- 172.21.15.72:0/2605138089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53f406b150 0x7f53f41db8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:45.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.390+0000 7f53f8b9a700 1 --2- 172.21.15.72:0/2605138089 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f53f40c4400 0x7f53f41ddba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:45.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.390+0000 7f53f9b9c700 1 -- 172.21.15.72:0/2605138089 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f53f40c4400 msgr2=0x7f53f41ddba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:45.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.390+0000 7f53f9b9c700 1 --2- 172.21.15.72:0/2605138089 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f53f40c4400 0x7f53f41ddba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:45.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.390+0000 7f53f9b9c700 1 -- 172.21.15.72:0/2605138089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53f406b150 msgr2=0x7f53f41db8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:45.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.390+0000 7f53f9b9c700 1 --2- 172.21.15.72:0/2605138089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53f406b150 0x7f53f41db8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:45.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.390+0000 7f53f9b9c700 1 -- 172.21.15.72:0/2605138089 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ec009a70 con 0x7f53f41549f0 2023-07-27T20:32:45.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.390+0000 7f53f9b9c700 1 --2- 172.21.15.72:0/2605138089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53f41549f0 0x7f53f41dc530 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f53ec014040 tx=0x7f53ec004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:45.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.390+0000 7f53e9ffb700 1 -- 172.21.15.72:0/2605138089 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec012430 con 0x7f53f41549f0 2023-07-27T20:32:45.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.390+0000 7f53e9ffb700 1 -- 172.21.15.72:0/2605138089 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ec020070 con 0x7f53f41549f0 2023-07-27T20:32:45.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.390+0000 7f53e9ffb700 1 -- 172.21.15.72:0/2605138089 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec004280 con 0x7f53f41549f0 2023-07-27T20:32:45.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.390+0000 7f53fb5ff700 1 -- 172.21.15.72:0/2605138089 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53f41e9350 con 0x7f53f41549f0 2023-07-27T20:32:45.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.390+0000 7f53fb5ff700 1 -- 172.21.15.72:0/2605138089 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53f41e9910 con 0x7f53f41549f0 2023-07-27T20:32:45.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.392+0000 7f53d77fe700 1 -- 172.21.15.72:0/2605138089 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d00052f0 con 0x7f53f41549f0 2023-07-27T20:32:45.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.392+0000 7f53e9ffb700 1 -- 172.21.15.72:0/2605138089 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f53ec0043e0 con 0x7f53f41549f0 2023-07-27T20:32:45.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.393+0000 7f53e9ffb700 1 --2- 172.21.15.72:0/2605138089 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f53d806ace0 0x7f53d806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:45.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.393+0000 7f53e9ffb700 1 -- 172.21.15.72:0/2605138089 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f53ec022070 con 0x7f53f41549f0 2023-07-27T20:32:45.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.394+0000 7f53f939b700 1 --2- 172.21.15.72:0/2605138089 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f53d806ace0 0x7f53d806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:45.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.395+0000 7f53f939b700 1 --2- 172.21.15.72:0/2605138089 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f53d806ace0 0x7f53d806d1a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f53f00011e0 tx=0x7f53f0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:45.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.398+0000 7f53e9ffb700 1 -- 172.21.15.72:0/2605138089 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f53ec056220 con 0x7f53f41549f0 2023-07-27T20:32:45.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.592+0000 7f53d77fe700 1 -- 172.21.15.72:0/2605138089 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53d0005870 con 0x7f53f41549f0 2023-07-27T20:32:45.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.594+0000 7f53e9ffb700 1 -- 172.21.15.72:0/2605138089 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20215 (secure 0 0 0) 0x7f53ec059840 con 0x7f53f41549f0 2023-07-27T20:32:45.581 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:32:45.582 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":29,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:32:10.402254+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:31:27.020951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T20:31:27.566022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-27T20:31:31.182401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:32:45.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.596+0000 7f53d77fe700 1 -- 172.21.15.72:0/2605138089 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f53d806ace0 msgr2=0x7f53d806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:45.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.596+0000 7f53d77fe700 1 --2- 172.21.15.72:0/2605138089 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f53d806ace0 0x7f53d806d1a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f53f00011e0 tx=0x7f53f0009040 comp rx=0 tx=0).stop 2023-07-27T20:32:45.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.596+0000 7f53d77fe700 1 -- 172.21.15.72:0/2605138089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53f41549f0 msgr2=0x7f53f41dc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:45.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.596+0000 7f53d77fe700 1 --2- 172.21.15.72:0/2605138089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53f41549f0 0x7f53f41dc530 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f53ec014040 tx=0x7f53ec004ad0 comp rx=0 tx=0).stop 2023-07-27T20:32:45.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.596+0000 7f53d77fe700 1 -- 172.21.15.72:0/2605138089 shutdown_connections 2023-07-27T20:32:45.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.596+0000 7f53d77fe700 1 --2- 172.21.15.72:0/2605138089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53f41549f0 0x7f53f41dc530 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:45.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.596+0000 7f53d77fe700 1 --2- 172.21.15.72:0/2605138089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53f406b150 0x7f53f41db8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:45.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.596+0000 7f53d77fe700 1 --2- 172.21.15.72:0/2605138089 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f53d806ace0 0x7f53d806d1a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:45.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.596+0000 7f53d77fe700 1 --2- 172.21.15.72:0/2605138089 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f53f40c4400 0x7f53f41ddba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:45.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.596+0000 7f53d77fe700 1 -- 172.21.15.72:0/2605138089 >> 172.21.15.72:0/2605138089 conn(0x7f53f40ab300 msgr2=0x7f53f4149e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:45.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.597+0000 7f53d77fe700 1 -- 172.21.15.72:0/2605138089 shutdown_connections 2023-07-27T20:32:45.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.597+0000 7f53d77fe700 1 -- 172.21.15.72:0/2605138089 wait complete. 2023-07-27T20:32:45.602 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-27T20:32:45.603 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T20:32:45.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.810+0000 7fecf29ff700 1 Processor -- start 2023-07-27T20:32:45.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.810+0000 7fecf29ff700 1 -- start start 2023-07-27T20:32:45.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.811+0000 7fecf29ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fecec14da10 0x7fecec0aad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:45.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.811+0000 7fecf29ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fecec0c1930 0x7fecec06d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:45.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.811+0000 7fecf29ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecec070080 con 0x7fecec06d640 2023-07-27T20:32:45.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.811+0000 7fecf29ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecec0c25a0 con 0x7fecec0c1930 2023-07-27T20:32:45.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.811+0000 7fecf29ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecec0ab330 con 0x7fecec14da10 2023-07-27T20:32:45.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.812+0000 7fecf0f9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fecec06d640 0x7fecec0c1e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58676/0 (socket says 172.21.15.72:58676) 2023-07-27T20:32:45.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.812+0000 7fecf0f9c700 1 -- 172.21.15.72:0/2772265060 learned_addr learned my addr 172.21.15.72:0/2772265060 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:45.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.812+0000 7feceb7fe700 1 --2- 172.21.15.72:0/2772265060 >> v2:172.21.15.173:3300/0 conn(0x7fecec0c1930 0x7fecec06d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:45.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.812+0000 7fecebfff700 1 --2- 172.21.15.72:0/2772265060 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fecec14da10 0x7fecec0aad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:45.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.812+0000 7feceaffd700 1 -- 172.21.15.72:0/2772265060 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3629508235 0 0) 0x7fecec070080 con 0x7fecec06d640 2023-07-27T20:32:45.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.812+0000 7feceaffd700 1 -- 172.21.15.72:0/2772265060 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecd40057c0 con 0x7fecec06d640 2023-07-27T20:32:45.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.812+0000 7feceaffd700 1 -- 172.21.15.72:0/2772265060 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2514689587 0 0) 0x7fecd40057c0 con 0x7fecec06d640 2023-07-27T20:32:45.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.812+0000 7feceaffd700 1 -- 172.21.15.72:0/2772265060 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fecec14da10 msgr2=0x7fecec0aad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:45.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.812+0000 7feceaffd700 1 --2- 172.21.15.72:0/2772265060 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fecec14da10 0x7fecec0aad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:45.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.812+0000 7feceaffd700 1 -- 172.21.15.72:0/2772265060 >> v2:172.21.15.173:3300/0 conn(0x7fecec0c1930 msgr2=0x7fecec06d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:45.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.812+0000 7feceaffd700 1 --2- 172.21.15.72:0/2772265060 >> v2:172.21.15.173:3300/0 conn(0x7fecec0c1930 0x7fecec06d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:45.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.812+0000 7feceaffd700 1 -- 172.21.15.72:0/2772265060 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecec0702d0 con 0x7fecec06d640 2023-07-27T20:32:45.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.812+0000 7feceaffd700 1 -- 172.21.15.72:0/2772265060 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7fece40019f0 con 0x7fecec06d640 2023-07-27T20:32:45.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.812+0000 7fecebfff700 1 --2- 172.21.15.72:0/2772265060 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fecec14da10 0x7fecec0aad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:32:45.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.813+0000 7feceaffd700 1 -- 172.21.15.72:0/2772265060 >> v1:172.21.15.72:6789/0 conn(0x7fecec06d640 legacy=0x7fecec0c1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:45.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.813+0000 7feceaffd700 1 --2- 172.21.15.72:0/2772265060 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fecec14da10 0x7fecd4005c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:45.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.813+0000 7feceaffd700 1 --2- 172.21.15.72:0/2772265060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecd40061a0 0x7fecd4006a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:45.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.813+0000 7feceaffd700 1 --2- 172.21.15.72:0/2772265060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd4006fa0 0x7fecd4007420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:45.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.813+0000 7feceaffd700 1 -- 172.21.15.72:0/2772265060 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecec0c25a0 con 0x7fecd4006fa0 2023-07-27T20:32:45.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.813+0000 7feceaffd700 1 -- 172.21.15.72:0/2772265060 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecec0ab330 con 0x7fecd40061a0 2023-07-27T20:32:45.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.813+0000 7feceaffd700 1 -- 172.21.15.72:0/2772265060 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd400dc70 con 0x7fecec14da10 2023-07-27T20:32:45.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.813+0000 7feceb7fe700 1 --2- 172.21.15.72:0/2772265060 >> v2:172.21.15.173:3300/0 conn(0x7fecec0c1930 0x7fecec06d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:32:45.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.813+0000 7fecf0f9c700 1 --2- 172.21.15.72:0/2772265060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd4006fa0 0x7fecd4007420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:45.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.813+0000 7fecebfff700 1 --2- 172.21.15.72:0/2772265060 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fecec14da10 0x7fecd4005c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:45.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.813+0000 7feceb7fe700 1 --2- 172.21.15.72:0/2772265060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecd40061a0 0x7fecd4006a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:45.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.813+0000 7fecf0f9c700 1 -- 172.21.15.72:0/2772265060 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fecec14da10 msgr2=0x7fecd4005c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:45.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.813+0000 7fecf0f9c700 1 --2- 172.21.15.72:0/2772265060 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fecec14da10 0x7fecd4005c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:45.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.813+0000 7fecf0f9c700 1 -- 172.21.15.72:0/2772265060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecd40061a0 msgr2=0x7fecd4006a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:45.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.813+0000 7fecf0f9c700 1 --2- 172.21.15.72:0/2772265060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecd40061a0 0x7fecd4006a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:45.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.813+0000 7fecf0f9c700 1 -- 172.21.15.72:0/2772265060 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecdc0094a0 con 0x7fecd4006fa0 2023-07-27T20:32:45.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.814+0000 7fecf0f9c700 1 --2- 172.21.15.72:0/2772265060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd4006fa0 0x7fecd4007420 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fece400a790 tx=0x7fecd4007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12bae59b0d87539 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:45.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.814+0000 7feceaffd700 1 -- 172.21.15.72:0/2772265060 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece400a250 con 0x7fecd4006fa0 2023-07-27T20:32:45.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.814+0000 7feceaffd700 1 -- 172.21.15.72:0/2772265060 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece4012600 con 0x7fecd4006fa0 2023-07-27T20:32:45.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.814+0000 7feceaffd700 1 -- 172.21.15.72:0/2772265060 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece40129b0 con 0x7fecd4006fa0 2023-07-27T20:32:45.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.814+0000 7fecf29ff700 1 -- 172.21.15.72:0/2772265060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd4006fa0 msgr2=0x7fecd4007420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:45.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.814+0000 7fecf29ff700 1 --2- 172.21.15.72:0/2772265060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd4006fa0 0x7fecd4007420 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fece400a790 tx=0x7fecd4007a90 comp rx=0 tx=0).stop 2023-07-27T20:32:45.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.814+0000 7fecf0f9c700 1 -- 172.21.15.72:0/2772265060 reap_dead start 2023-07-27T20:32:45.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.814+0000 7fecf29ff700 1 -- 172.21.15.72:0/2772265060 shutdown_connections 2023-07-27T20:32:45.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.814+0000 7fecf29ff700 1 -- 172.21.15.72:0/2772265060 >> 172.21.15.72:0/2772265060 conn(0x7fecec06a190 msgr2=0x7fecec06a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:45.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.814+0000 7fecf29ff700 1 -- 172.21.15.72:0/2772265060 shutdown_connections 2023-07-27T20:32:45.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.814+0000 7fecf29ff700 1 -- 172.21.15.72:0/2772265060 wait complete. 2023-07-27T20:32:45.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.816+0000 7fecf29ff700 1 Processor -- start 2023-07-27T20:32:45.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.816+0000 7fecf29ff700 1 -- start start 2023-07-27T20:32:45.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.817+0000 7fecf29ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecec145660 0x7fecec0c3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:45.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.817+0000 7fecf29ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fecec1ea140 0x7fecec1ed470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:45.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.817+0000 7fecf29ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecec1ed9b0 0x7fecec13ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:45.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.817+0000 7fecf29ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecec1ea5c0 con 0x7fecec145660 2023-07-27T20:32:45.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.817+0000 7fecf29ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecec0be820 con 0x7fecec1ed9b0 2023-07-27T20:32:45.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.817+0000 7fecf29ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecec1ecd00 con 0x7fecec1ea140 2023-07-27T20:32:45.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.817+0000 7fecebfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecec145660 0x7fecec0c3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:45.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.817+0000 7fecebfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecec145660 0x7fecec0c3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55034/0 (socket says 172.21.15.72:55034) 2023-07-27T20:32:45.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.817+0000 7fecebfff700 1 -- 172.21.15.72:0/677058429 learned_addr learned my addr 172.21.15.72:0/677058429 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:45.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.818+0000 7feceb7fe700 1 --2- 172.21.15.72:0/677058429 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fecec1ea140 0x7fecec1ed470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:45.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.818+0000 7fecf0f9c700 1 --2- 172.21.15.72:0/677058429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecec1ed9b0 0x7fecec13ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:45.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.818+0000 7fecebfff700 1 -- 172.21.15.72:0/677058429 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fecec1ea140 msgr2=0x7fecec1ed470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:45.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.818+0000 7fecebfff700 1 --2- 172.21.15.72:0/677058429 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fecec1ea140 0x7fecec1ed470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:45.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.818+0000 7fecebfff700 1 -- 172.21.15.72:0/677058429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecec1ed9b0 msgr2=0x7fecec13ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:45.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.818+0000 7fecebfff700 1 --2- 172.21.15.72:0/677058429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecec1ed9b0 0x7fecec13ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:45.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.818+0000 7fecebfff700 1 -- 172.21.15.72:0/677058429 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecec0be9f0 con 0x7fecec145660 2023-07-27T20:32:45.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.818+0000 7fecebfff700 1 --2- 172.21.15.72:0/677058429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecec145660 0x7fecec0c3380 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fecdc011d00 tx=0x7fecdc00f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:45.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.818+0000 7fece8ff9700 1 -- 172.21.15.72:0/677058429 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc00fb30 con 0x7fecec145660 2023-07-27T20:32:45.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.818+0000 7fece8ff9700 1 -- 172.21.15.72:0/677058429 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecdc00fc90 con 0x7fecec145660 2023-07-27T20:32:45.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.818+0000 7fecf29ff700 1 -- 172.21.15.72:0/677058429 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecec0becd0 con 0x7fecec145660 2023-07-27T20:32:45.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.818+0000 7fece8ff9700 1 -- 172.21.15.72:0/677058429 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc004020 con 0x7fecec145660 2023-07-27T20:32:45.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.819+0000 7fecf29ff700 1 -- 172.21.15.72:0/677058429 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecec1ecf50 con 0x7fecec145660 2023-07-27T20:32:45.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.820+0000 7fecf29ff700 1 -- 172.21.15.72:0/677058429 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecec074310 con 0x7fecec145660 2023-07-27T20:32:45.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.821+0000 7fece8ff9700 1 -- 172.21.15.72:0/677058429 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fecdc004180 con 0x7fecec145660 2023-07-27T20:32:45.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.821+0000 7fece8ff9700 1 --2- 172.21.15.72:0/677058429 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fecd806ad10 0x7fecd806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:45.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.822+0000 7fece8ff9700 1 -- 172.21.15.72:0/677058429 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fecdc089be0 con 0x7fecec145660 2023-07-27T20:32:45.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.822+0000 7feceb7fe700 1 --2- 172.21.15.72:0/677058429 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fecd806ad10 0x7fecd806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:45.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.823+0000 7feceb7fe700 1 --2- 172.21.15.72:0/677058429 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fecd806ad10 0x7fecd806d1d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fecec0bf340 tx=0x7fece0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:45.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:45.826+0000 7fece8ff9700 1 -- 172.21.15.72:0/677058429 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fecdc0549f0 con 0x7fecec145660 2023-07-27T20:32:46.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.063+0000 7fecf29ff700 1 -- 172.21.15.72:0/677058429 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fecec06e2d0 con 0x7fecec145660 2023-07-27T20:32:46.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.063+0000 7fece8ff9700 1 -- 172.21.15.72:0/677058429 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7fecdc022020 con 0x7fecec145660 2023-07-27T20:32:46.051 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:32:46.051 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/1913374698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1913374698},{"type":"v1","addr":"172.21.15.72:6834","nonce":1913374698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/3260445560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":3260445560},{"type":"v1","addr":"172.21.15.72:6835","nonce":3260445560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1305837931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1305837931},{"type":"v1","addr":"172.21.15.173:6837","nonce":1305837931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T20:31:28.592113+0000","modified":"2023-07-27T20:31:51.217923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6835/516740687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":516740687},{"type":"v1","addr":"172.21.15.173:6835","nonce":516740687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-27T20:32:46.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.066+0000 7fecf29ff700 1 -- 172.21.15.72:0/677058429 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fecd806ad10 msgr2=0x7fecd806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:46.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.066+0000 7fecf29ff700 1 --2- 172.21.15.72:0/677058429 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fecd806ad10 0x7fecd806d1d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fecec0bf340 tx=0x7fece0008040 comp rx=0 tx=0).stop 2023-07-27T20:32:46.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.066+0000 7fecf29ff700 1 -- 172.21.15.72:0/677058429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecec145660 msgr2=0x7fecec0c3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:46.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.066+0000 7fecf29ff700 1 --2- 172.21.15.72:0/677058429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecec145660 0x7fecec0c3380 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fecdc011d00 tx=0x7fecdc00f520 comp rx=0 tx=0).stop 2023-07-27T20:32:46.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.066+0000 7fecf29ff700 1 -- 172.21.15.72:0/677058429 shutdown_connections 2023-07-27T20:32:46.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.066+0000 7fecf29ff700 1 --2- 172.21.15.72:0/677058429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecec1ed9b0 0x7fecec13ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:46.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.066+0000 7fecf29ff700 1 --2- 172.21.15.72:0/677058429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecec145660 0x7fecec0c3380 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:46.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.066+0000 7fecf29ff700 1 --2- 172.21.15.72:0/677058429 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fecd806ad10 0x7fecd806d1d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:46.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.066+0000 7fecf29ff700 1 --2- 172.21.15.72:0/677058429 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fecec1ea140 0x7fecec1ed470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:46.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.066+0000 7fecf29ff700 1 -- 172.21.15.72:0/677058429 >> 172.21.15.72:0/677058429 conn(0x7fecec06a190 msgr2=0x7fecec14c380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:46.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.066+0000 7fecf29ff700 1 -- 172.21.15.72:0/677058429 shutdown_connections 2023-07-27T20:32:46.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.066+0000 7fecf29ff700 1 -- 172.21.15.72:0/677058429 wait complete. 2023-07-27T20:32:46.055 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 9 2023-07-27T20:32:46.071 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T20:32:46.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.278+0000 7f54653ff700 1 Processor -- start 2023-07-27T20:32:46.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.279+0000 7f54653ff700 1 -- start start 2023-07-27T20:32:46.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.280+0000 7f54653ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f54600c4400 0x7f54600c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:46.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.280+0000 7f54653ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f546006b710 con 0x7f546006b150 2023-07-27T20:32:46.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.280+0000 7f54653ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f546006b9f0 con 0x7f54601549f0 2023-07-27T20:32:46.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.280+0000 7f54653ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54601545d0 con 0x7f54600c4400 2023-07-27T20:32:46.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.280+0000 7f545effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f54600c4400 0x7f54600c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:46.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.280+0000 7f545effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f54600c4400 0x7f54600c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55040/0 (socket says 172.21.15.72:55040) 2023-07-27T20:32:46.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.280+0000 7f545effd700 1 -- 172.21.15.72:0/4025047044 learned_addr learned my addr 172.21.15.72:0/4025047044 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:46.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.280+0000 7f545e7fc700 1 --1- 172.21.15.72:0/4025047044 >> v1:172.21.15.72:6789/0 conn(0x7f546006b150 0x7f54600c4cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58686/0 (socket says 172.21.15.72:58686) 2023-07-27T20:32:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.280+0000 7f545effd700 1 -- 172.21.15.72:0/4025047044 >> v1:172.21.15.173:6789/0 conn(0x7f54601549f0 legacy=0x7f54601514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.280+0000 7f545effd700 1 -- 172.21.15.72:0/4025047044 >> v1:172.21.15.72:6789/0 conn(0x7f546006b150 legacy=0x7f54600c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.280+0000 7f545effd700 1 -- 172.21.15.72:0/4025047044 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f546006bcd0 con 0x7f54600c4400 2023-07-27T20:32:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.280+0000 7f545dffb700 1 -- 172.21.15.72:0/4025047044 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1913609293 0 0) 0x7f546006b710 con 0x7f546006b150 2023-07-27T20:32:46.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.281+0000 7f545effd700 1 --2- 172.21.15.72:0/4025047044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54600c4400 0x7f54600c7710 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f54500098f0 tx=0x7f5450009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=944246c245605f58 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:46.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.281+0000 7f545dffb700 1 -- 172.21.15.72:0/4025047044 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5450004230 con 0x7f54600c4400 2023-07-27T20:32:46.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.281+0000 7f545dffb700 1 -- 172.21.15.72:0/4025047044 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5450004390 con 0x7f54600c4400 2023-07-27T20:32:46.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.281+0000 7f545dffb700 1 -- 172.21.15.72:0/4025047044 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54500036a0 con 0x7f54600c4400 2023-07-27T20:32:46.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.281+0000 7f54653ff700 1 -- 172.21.15.72:0/4025047044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54600c4400 msgr2=0x7f54600c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:46.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.281+0000 7f54653ff700 1 --2- 172.21.15.72:0/4025047044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54600c4400 0x7f54600c7710 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f54500098f0 tx=0x7f5450009c00 comp rx=0 tx=0).stop 2023-07-27T20:32:46.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.281+0000 7f54653ff700 1 -- 172.21.15.72:0/4025047044 shutdown_connections 2023-07-27T20:32:46.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.281+0000 7f54653ff700 1 --2- 172.21.15.72:0/4025047044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54600c4400 0x7f54600c7710 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:46.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.281+0000 7f54653ff700 1 -- 172.21.15.72:0/4025047044 >> 172.21.15.72:0/4025047044 conn(0x7f54600ab300 msgr2=0x7f54600ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:46.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.282+0000 7f54653ff700 1 -- 172.21.15.72:0/4025047044 shutdown_connections 2023-07-27T20:32:46.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.282+0000 7f54653ff700 1 -- 172.21.15.72:0/4025047044 wait complete. 2023-07-27T20:32:46.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.283+0000 7f54653ff700 1 Processor -- start 2023-07-27T20:32:46.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.283+0000 7f54653ff700 1 -- start start 2023-07-27T20:32:46.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.284+0000 7f54653ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f546006b150 0x7f54600c10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:46.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.284+0000 7f54653ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54600c4400 0x7f54600aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:46.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.284+0000 7f54653ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54601549f0 0x7f5460149d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:46.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.284+0000 7f54653ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54600c1bd0 con 0x7f546006b150 2023-07-27T20:32:46.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.284+0000 7f54653ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54600c2cc0 con 0x7f54601549f0 2023-07-27T20:32:46.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.284+0000 7f54653ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54600c15f0 con 0x7f54600c4400 2023-07-27T20:32:46.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.284+0000 7f545effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f546006b150 0x7f54600c10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:46.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.284+0000 7f545effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f546006b150 0x7f54600c10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55054/0 (socket says 172.21.15.72:55054) 2023-07-27T20:32:46.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.284+0000 7f545effd700 1 -- 172.21.15.72:0/3241336216 learned_addr learned my addr 172.21.15.72:0/3241336216 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:46.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.284+0000 7f545f7fe700 1 --2- 172.21.15.72:0/3241336216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54601549f0 0x7f5460149d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:46.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.284+0000 7f545e7fc700 1 --2- 172.21.15.72:0/3241336216 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54600c4400 0x7f54600aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:46.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.285+0000 7f545effd700 1 -- 172.21.15.72:0/3241336216 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54600c4400 msgr2=0x7f54600aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:46.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.285+0000 7f545effd700 1 --2- 172.21.15.72:0/3241336216 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54600c4400 0x7f54600aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:46.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.285+0000 7f545effd700 1 -- 172.21.15.72:0/3241336216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54601549f0 msgr2=0x7f5460149d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:46.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.285+0000 7f545effd700 1 --2- 172.21.15.72:0/3241336216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54601549f0 0x7f5460149d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:46.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.285+0000 7f545effd700 1 -- 172.21.15.72:0/3241336216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5450009550 con 0x7f546006b150 2023-07-27T20:32:46.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.285+0000 7f545effd700 1 --2- 172.21.15.72:0/3241336216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f546006b150 0x7f54600c10b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f546008b450 tx=0x7f5450004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:46.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.285+0000 7f54477fe700 1 -- 172.21.15.72:0/3241336216 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5450003cd0 con 0x7f546006b150 2023-07-27T20:32:46.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.285+0000 7f54477fe700 1 -- 172.21.15.72:0/3241336216 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545001f070 con 0x7f546006b150 2023-07-27T20:32:46.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.285+0000 7f54653ff700 1 -- 172.21.15.72:0/3241336216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54600c3800 con 0x7f546006b150 2023-07-27T20:32:46.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.285+0000 7f54477fe700 1 -- 172.21.15.72:0/3241336216 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545000b8a0 con 0x7f546006b150 2023-07-27T20:32:46.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.286+0000 7f54653ff700 1 -- 172.21.15.72:0/3241336216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54600c31b0 con 0x7f546006b150 2023-07-27T20:32:46.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.286+0000 7f54653ff700 1 -- 172.21.15.72:0/3241336216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5460074310 con 0x7f546006b150 2023-07-27T20:32:46.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.287+0000 7f54477fe700 1 -- 172.21.15.72:0/3241336216 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5450021030 con 0x7f546006b150 2023-07-27T20:32:46.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.288+0000 7f54477fe700 1 --2- 172.21.15.72:0/3241336216 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f544c06ace0 0x7f544c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:46.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.288+0000 7f54477fe700 1 -- 172.21.15.72:0/3241336216 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f545008ae00 con 0x7f546006b150 2023-07-27T20:32:46.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.289+0000 7f545e7fc700 1 --2- 172.21.15.72:0/3241336216 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f544c06ace0 0x7f544c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:46.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.290+0000 7f545e7fc700 1 --2- 172.21.15.72:0/3241336216 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f544c06ace0 0x7f544c06d1a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f54600c0d10 tx=0x7f5454007e70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:46.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.293+0000 7f54477fe700 1 -- 172.21.15.72:0/3241336216 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5450055b70 con 0x7f546006b150 2023-07-27T20:32:46.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.532+0000 7f54653ff700 1 -- 172.21.15.72:0/3241336216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5460074310 con 0x7f546006b150 2023-07-27T20:32:46.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.532+0000 7f54477fe700 1 -- 172.21.15.72:0/3241336216 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f5450022380 con 0x7f546006b150 2023-07-27T20:32:46.520 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:32:46.520 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/1913374698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1913374698},{"type":"v1","addr":"172.21.15.72:6834","nonce":1913374698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/3260445560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":3260445560},{"type":"v1","addr":"172.21.15.72:6835","nonce":3260445560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1305837931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":1305837931},{"type":"v1","addr":"172.21.15.173:6837","nonce":1305837931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T20:31:28.592113+0000","modified":"2023-07-27T20:31:51.217923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6835/516740687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":516740687},{"type":"v1","addr":"172.21.15.173:6835","nonce":516740687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-27T20:32:46.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.535+0000 7f54653ff700 1 -- 172.21.15.72:0/3241336216 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f544c06ace0 msgr2=0x7f544c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:46.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.535+0000 7f54653ff700 1 --2- 172.21.15.72:0/3241336216 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f544c06ace0 0x7f544c06d1a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f54600c0d10 tx=0x7f5454007e70 comp rx=0 tx=0).stop 2023-07-27T20:32:46.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.535+0000 7f54653ff700 1 -- 172.21.15.72:0/3241336216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f546006b150 msgr2=0x7f54600c10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:46.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.535+0000 7f54653ff700 1 --2- 172.21.15.72:0/3241336216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f546006b150 0x7f54600c10b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f546008b450 tx=0x7f5450004750 comp rx=0 tx=0).stop 2023-07-27T20:32:46.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.535+0000 7f54653ff700 1 -- 172.21.15.72:0/3241336216 shutdown_connections 2023-07-27T20:32:46.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.535+0000 7f54653ff700 1 --2- 172.21.15.72:0/3241336216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54601549f0 0x7f5460149d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:46.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.535+0000 7f54653ff700 1 --2- 172.21.15.72:0/3241336216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f546006b150 0x7f54600c10b0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:46.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.535+0000 7f54653ff700 1 --2- 172.21.15.72:0/3241336216 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f544c06ace0 0x7f544c06d1a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:46.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.535+0000 7f54653ff700 1 --2- 172.21.15.72:0/3241336216 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54600c4400 0x7f54600aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:46.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.535+0000 7f54653ff700 1 -- 172.21.15.72:0/3241336216 >> 172.21.15.72:0/3241336216 conn(0x7f54600ab300 msgr2=0x7f54600ab6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:46.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.535+0000 7f54653ff700 1 -- 172.21.15.72:0/3241336216 shutdown_connections 2023-07-27T20:32:46.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.535+0000 7f54653ff700 1 -- 172.21.15.72:0/3241336216 wait complete. 2023-07-27T20:32:46.524 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 9 2023-07-27T20:32:46.540 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:32:46.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.750+0000 7f9aef7ff700 1 Processor -- start 2023-07-27T20:32:46.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.750+0000 7f9aef7ff700 1 -- start start 2023-07-27T20:32:46.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.751+0000 7f9aef7ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9ae806b150 0x7f9ae80c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:46.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.751+0000 7f9aef7ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ae806b710 con 0x7f9ae81549f0 2023-07-27T20:32:46.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.751+0000 7f9aef7ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ae806b9f0 con 0x7f9ae80c4400 2023-07-27T20:32:46.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.751+0000 7f9aef7ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae81545d0 con 0x7f9ae806b150 2023-07-27T20:32:46.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.752+0000 7f9aedd9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9ae81549f0 0x7f9ae81514a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58698/0 (socket says 172.21.15.72:58698) 2023-07-27T20:32:46.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.752+0000 7f9aedd9c700 1 -- 172.21.15.72:0/1009028014 learned_addr learned my addr 172.21.15.72:0/1009028014 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:46.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.752+0000 7f9aecd9a700 1 --2- 172.21.15.72:0/1009028014 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9ae806b150 0x7f9ae80c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:46.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.752+0000 7f9adffff700 1 -- 172.21.15.72:0/1009028014 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 192045266 0 0) 0x7f9ae806b710 con 0x7f9ae81549f0 2023-07-27T20:32:46.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.752+0000 7f9adffff700 1 -- 172.21.15.72:0/1009028014 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ad40035b0 con 0x7f9ae81549f0 2023-07-27T20:32:46.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.752+0000 7f9adffff700 1 -- 172.21.15.72:0/1009028014 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3266012266 0 0) 0x7f9ad40035b0 con 0x7f9ae81549f0 2023-07-27T20:32:46.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.752+0000 7f9adffff700 1 -- 172.21.15.72:0/1009028014 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9ae806b150 msgr2=0x7f9ae80c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:46.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.752+0000 7f9adffff700 1 --2- 172.21.15.72:0/1009028014 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9ae806b150 0x7f9ae80c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:46.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.752+0000 7f9adffff700 1 -- 172.21.15.72:0/1009028014 >> v1:172.21.15.173:6789/0 conn(0x7f9ae80c4400 legacy=0x7f9ae80c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:46.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.752+0000 7f9adffff700 1 -- 172.21.15.72:0/1009028014 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae806bcd0 con 0x7f9ae81549f0 2023-07-27T20:32:46.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.752+0000 7f9adffff700 1 -- 172.21.15.72:0/1009028014 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f9ae00019f0 con 0x7f9ae81549f0 2023-07-27T20:32:46.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.753+0000 7f9adffff700 1 -- 172.21.15.72:0/1009028014 >> v1:172.21.15.72:6789/0 conn(0x7f9ae81549f0 legacy=0x7f9ae81514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:46.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.753+0000 7f9adffff700 1 --2- 172.21.15.72:0/1009028014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ad4003a30 0x7f9ad4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:46.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.753+0000 7f9adffff700 1 --2- 172.21.15.72:0/1009028014 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9ae806b150 0x7f9ad4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:46.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.753+0000 7f9adffff700 1 --2- 172.21.15.72:0/1009028014 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ad4004d90 0x7f9ad4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:46.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.753+0000 7f9adffff700 1 -- 172.21.15.72:0/1009028014 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae81545d0 con 0x7f9ad4003a30 2023-07-27T20:32:46.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.753+0000 7f9adffff700 1 -- 172.21.15.72:0/1009028014 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad400baf0 con 0x7f9ad4004d90 2023-07-27T20:32:46.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.753+0000 7f9adffff700 1 -- 172.21.15.72:0/1009028014 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad400bcb0 con 0x7f9ae806b150 2023-07-27T20:32:46.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.753+0000 7f9aed59b700 1 --2- 172.21.15.72:0/1009028014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ad4003a30 0x7f9ad4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:46.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.753+0000 7f9aedd9c700 1 --2- 172.21.15.72:0/1009028014 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ad4004d90 0x7f9ad4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:46.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.753+0000 7f9aecd9a700 1 --2- 172.21.15.72:0/1009028014 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9ae806b150 0x7f9ad4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:46.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.753+0000 7f9aed59b700 1 -- 172.21.15.72:0/1009028014 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9ae806b150 msgr2=0x7f9ad4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:46.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.753+0000 7f9aed59b700 1 --2- 172.21.15.72:0/1009028014 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9ae806b150 0x7f9ad4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:46.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.753+0000 7f9aed59b700 1 -- 172.21.15.72:0/1009028014 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ad4004d90 msgr2=0x7f9ad4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:46.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.753+0000 7f9aed59b700 1 --2- 172.21.15.72:0/1009028014 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ad4004d90 0x7f9ad4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:46.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.753+0000 7f9aed59b700 1 -- 172.21.15.72:0/1009028014 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad40035b0 con 0x7f9ad4003a30 2023-07-27T20:32:46.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.753+0000 7f9aecd9a700 1 --2- 172.21.15.72:0/1009028014 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9ae806b150 0x7f9ad4004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:46.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.753+0000 7f9aed59b700 1 --2- 172.21.15.72:0/1009028014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ad4003a30 0x7f9ad4003e10 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4001980 tx=0x7f9ad4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93be544d1a29e6c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:46.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.754+0000 7f9adffff700 1 -- 172.21.15.72:0/1009028014 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae4016070 con 0x7f9ad4003a30 2023-07-27T20:32:46.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.754+0000 7f9adffff700 1 -- 172.21.15.72:0/1009028014 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae4006860 con 0x7f9ad4003a30 2023-07-27T20:32:46.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.754+0000 7f9adffff700 1 -- 172.21.15.72:0/1009028014 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae4001420 con 0x7f9ad4003a30 2023-07-27T20:32:46.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.754+0000 7f9aef7ff700 1 -- 172.21.15.72:0/1009028014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ad4003a30 msgr2=0x7f9ad4003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:46.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.754+0000 7f9aef7ff700 1 --2- 172.21.15.72:0/1009028014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ad4003a30 0x7f9ad4003e10 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4001980 tx=0x7f9ad4005880 comp rx=0 tx=0).stop 2023-07-27T20:32:46.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.754+0000 7f9aedd9c700 1 -- 172.21.15.72:0/1009028014 reap_dead start 2023-07-27T20:32:46.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.754+0000 7f9aef7ff700 1 -- 172.21.15.72:0/1009028014 shutdown_connections 2023-07-27T20:32:46.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.754+0000 7f9aef7ff700 1 -- 172.21.15.72:0/1009028014 >> 172.21.15.72:0/1009028014 conn(0x7f9ae80ab300 msgr2=0x7f9ae80ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:46.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.754+0000 7f9aef7ff700 1 -- 172.21.15.72:0/1009028014 shutdown_connections 2023-07-27T20:32:46.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.754+0000 7f9aef7ff700 1 -- 172.21.15.72:0/1009028014 wait complete. 2023-07-27T20:32:46.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.756+0000 7f9aef7ff700 1 Processor -- start 2023-07-27T20:32:46.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.756+0000 7f9aef7ff700 1 -- start start 2023-07-27T20:32:46.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.757+0000 7f9aef7ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ad4003a30 0x7f9ae81ed920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:46.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.757+0000 7f9aef7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ae80aecf0 0x7f9ae81de930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:46.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.757+0000 7f9aef7ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9ae81dcbf0 0x7f9ae81dd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:46.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.757+0000 7f9aef7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae80aa0c0 con 0x7f9ae80aecf0 2023-07-27T20:32:46.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.757+0000 7f9aef7ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae81dc7d0 con 0x7f9ad4003a30 2023-07-27T20:32:46.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.757+0000 7f9aef7ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae80a9b00 con 0x7f9ae81dcbf0 2023-07-27T20:32:46.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.757+0000 7f9aecd9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ae80aecf0 0x7f9ae81de930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:46.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.757+0000 7f9aecd9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ae80aecf0 0x7f9ae81de930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55074/0 (socket says 172.21.15.72:55074) 2023-07-27T20:32:46.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.757+0000 7f9aecd9a700 1 -- 172.21.15.72:0/2386012935 learned_addr learned my addr 172.21.15.72:0/2386012935 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:46.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.758+0000 7f9aed59b700 1 --2- 172.21.15.72:0/2386012935 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ad4003a30 0x7f9ae81ed920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:46.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.758+0000 7f9aedd9c700 1 --2- 172.21.15.72:0/2386012935 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9ae81dcbf0 0x7f9ae81dd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:46.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.758+0000 7f9aecd9a700 1 -- 172.21.15.72:0/2386012935 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9ae81dcbf0 msgr2=0x7f9ae81dd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:46.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.758+0000 7f9aecd9a700 1 --2- 172.21.15.72:0/2386012935 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9ae81dcbf0 0x7f9ae81dd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:46.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.758+0000 7f9aecd9a700 1 -- 172.21.15.72:0/2386012935 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ad4003a30 msgr2=0x7f9ae81ed920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:46.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.758+0000 7f9aecd9a700 1 --2- 172.21.15.72:0/2386012935 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ad4003a30 0x7f9ae81ed920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:46.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.758+0000 7f9aecd9a700 1 -- 172.21.15.72:0/2386012935 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae80a9de0 con 0x7f9ae80aecf0 2023-07-27T20:32:46.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.758+0000 7f9aedd9c700 1 --2- 172.21.15.72:0/2386012935 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9ae81dcbf0 0x7f9ae81dd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:32:46.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.758+0000 7f9aecd9a700 1 --2- 172.21.15.72:0/2386012935 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ae80aecf0 0x7f9ae81de930 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9ad80118d0 tx=0x7f9ad8011c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:46.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.758+0000 7f9addffb700 1 -- 172.21.15.72:0/2386012935 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad8004220 con 0x7f9ae80aecf0 2023-07-27T20:32:46.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.758+0000 7f9addffb700 1 -- 172.21.15.72:0/2386012935 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad8004380 con 0x7f9ae80aecf0 2023-07-27T20:32:46.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.758+0000 7f9aef7ff700 1 -- 172.21.15.72:0/2386012935 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ae81dee70 con 0x7f9ae80aecf0 2023-07-27T20:32:46.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.758+0000 7f9addffb700 1 -- 172.21.15.72:0/2386012935 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad80036a0 con 0x7f9ae80aecf0 2023-07-27T20:32:46.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.758+0000 7f9aef7ff700 1 -- 172.21.15.72:0/2386012935 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ae81dd5b0 con 0x7f9ae80aecf0 2023-07-27T20:32:46.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.759+0000 7f9aef7ff700 1 -- 172.21.15.72:0/2386012935 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ae81dc910 con 0x7f9ae80aecf0 2023-07-27T20:32:46.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.760+0000 7f9addffb700 1 -- 172.21.15.72:0/2386012935 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9ad8003800 con 0x7f9ae80aecf0 2023-07-27T20:32:46.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.762+0000 7f9addffb700 1 --2- 172.21.15.72:0/2386012935 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9acc06ace0 0x7f9acc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:46.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.762+0000 7f9addffb700 1 -- 172.21.15.72:0/2386012935 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9ad8089bc0 con 0x7f9ae80aecf0 2023-07-27T20:32:46.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.762+0000 7f9aed59b700 1 --2- 172.21.15.72:0/2386012935 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9acc06ace0 0x7f9acc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:46.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.763+0000 7f9aed59b700 1 --2- 172.21.15.72:0/2386012935 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9acc06ace0 0x7f9acc06d1a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4014040 tx=0x7f9ae4009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:46.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.766+0000 7f9addffb700 1 -- 172.21.15.72:0/2386012935 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9ae81dc910 con 0x7f9ae80aecf0 2023-07-27T20:32:46.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.963+0000 7f9aef7ff700 1 -- 172.21.15.72:0/2386012935 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ae81dc910 con 0x7f9ae80aecf0 2023-07-27T20:32:46.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.964+0000 7f9addffb700 1 -- 172.21.15.72:0/2386012935 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20215 (secure 0 0 0) 0x7f9ae81dc910 con 0x7f9ae80aecf0 2023-07-27T20:32:46.952 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:32:46.952 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":29,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:32:10.402254+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:31:27.020951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T20:31:27.566022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-27T20:31:31.182401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:32:46.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.967+0000 7f9aef7ff700 1 -- 172.21.15.72:0/2386012935 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9acc06ace0 msgr2=0x7f9acc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:46.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.967+0000 7f9aef7ff700 1 --2- 172.21.15.72:0/2386012935 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9acc06ace0 0x7f9acc06d1a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4014040 tx=0x7f9ae4009030 comp rx=0 tx=0).stop 2023-07-27T20:32:46.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.967+0000 7f9aef7ff700 1 -- 172.21.15.72:0/2386012935 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ae80aecf0 msgr2=0x7f9ae81de930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:46.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.967+0000 7f9aef7ff700 1 --2- 172.21.15.72:0/2386012935 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ae80aecf0 0x7f9ae81de930 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9ad80118d0 tx=0x7f9ad8011c90 comp rx=0 tx=0).stop 2023-07-27T20:32:46.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.967+0000 7f9aef7ff700 1 -- 172.21.15.72:0/2386012935 shutdown_connections 2023-07-27T20:32:46.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.967+0000 7f9aef7ff700 1 --2- 172.21.15.72:0/2386012935 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9acc06ace0 0x7f9acc06d1a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:46.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.967+0000 7f9aef7ff700 1 --2- 172.21.15.72:0/2386012935 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9ae81dcbf0 0x7f9ae81dd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:46.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.967+0000 7f9aef7ff700 1 --2- 172.21.15.72:0/2386012935 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ad4003a30 0x7f9ae81ed920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:46.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.967+0000 7f9aef7ff700 1 --2- 172.21.15.72:0/2386012935 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ae80aecf0 0x7f9ae81de930 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:46.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.967+0000 7f9aef7ff700 1 -- 172.21.15.72:0/2386012935 >> 172.21.15.72:0/2386012935 conn(0x7f9ae80ab300 msgr2=0x7f9ae8154e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:46.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.967+0000 7f9aef7ff700 1 -- 172.21.15.72:0/2386012935 shutdown_connections 2023-07-27T20:32:46.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:46.967+0000 7f9aef7ff700 1 -- 172.21.15.72:0/2386012935 wait complete. 2023-07-27T20:32:46.972 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-27T20:32:47.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.183+0000 7fcb37bff700 1 Processor -- start 2023-07-27T20:32:47.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.184+0000 7fcb37bff700 1 -- start start 2023-07-27T20:32:47.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.185+0000 7fcb37bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcb3013b2c0 0x7fcb300aa420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:47.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.185+0000 7fcb37bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb30155600 con 0x7fcb300bfd90 2023-07-27T20:32:47.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.185+0000 7fcb37bff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb30155320 con 0x7fcb300a83a0 2023-07-27T20:32:47.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.185+0000 7fcb37bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb300a9620 con 0x7fcb3013b2c0 2023-07-27T20:32:47.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.185+0000 7fcb3519a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fcb300bfd90 0x7fcb300aa960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58700/0 (socket says 172.21.15.72:58700) 2023-07-27T20:32:47.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.185+0000 7fcb3519a700 1 -- 172.21.15.72:0/2317622740 learned_addr learned my addr 172.21.15.72:0/2317622740 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:47.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.185+0000 7fcb3599b700 1 --2- 172.21.15.72:0/2317622740 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcb3013b2c0 0x7fcb300aa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:47.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.186+0000 7fcb34999700 1 -- 172.21.15.72:0/2317622740 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3184578672 0 0) 0x7fcb30155600 con 0x7fcb300bfd90 2023-07-27T20:32:47.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.186+0000 7fcb34999700 1 -- 172.21.15.72:0/2317622740 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb1c0035b0 con 0x7fcb300bfd90 2023-07-27T20:32:47.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.186+0000 7fcb34999700 1 -- 172.21.15.72:0/2317622740 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4096668297 0 0) 0x7fcb30155320 con 0x7fcb300a83a0 2023-07-27T20:32:47.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.186+0000 7fcb34999700 1 -- 172.21.15.72:0/2317622740 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb30155600 con 0x7fcb300a83a0 2023-07-27T20:32:47.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.186+0000 7fcb3599b700 1 -- 172.21.15.72:0/2317622740 >> v1:172.21.15.173:6789/0 conn(0x7fcb300a83a0 legacy=0x7fcb300a8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:47.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.186+0000 7fcb3599b700 1 -- 172.21.15.72:0/2317622740 >> v1:172.21.15.72:6789/0 conn(0x7fcb300bfd90 legacy=0x7fcb300aa960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:47.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.186+0000 7fcb3599b700 1 -- 172.21.15.72:0/2317622740 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb30151e40 con 0x7fcb3013b2c0 2023-07-27T20:32:47.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.186+0000 7fcb3599b700 1 --2- 172.21.15.72:0/2317622740 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcb3013b2c0 0x7fcb300aa420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c009870 tx=0x7fcb2c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e7bb4cbdd4870f4 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:47.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.186+0000 7fcb34999700 1 -- 172.21.15.72:0/2317622740 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c011830 con 0x7fcb3013b2c0 2023-07-27T20:32:47.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.186+0000 7fcb34999700 1 -- 172.21.15.72:0/2317622740 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb2c011990 con 0x7fcb3013b2c0 2023-07-27T20:32:47.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.186+0000 7fcb34999700 1 -- 172.21.15.72:0/2317622740 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c011d20 con 0x7fcb3013b2c0 2023-07-27T20:32:47.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.187+0000 7fcb37bff700 1 -- 172.21.15.72:0/2317622740 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcb3013b2c0 msgr2=0x7fcb300aa420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:47.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.187+0000 7fcb37bff700 1 --2- 172.21.15.72:0/2317622740 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcb3013b2c0 0x7fcb300aa420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c009870 tx=0x7fcb2c009b80 comp rx=0 tx=0).stop 2023-07-27T20:32:47.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.187+0000 7fcb37bff700 1 -- 172.21.15.72:0/2317622740 shutdown_connections 2023-07-27T20:32:47.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.187+0000 7fcb37bff700 1 --2- 172.21.15.72:0/2317622740 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcb3013b2c0 0x7fcb300aa420 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:47.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.187+0000 7fcb37bff700 1 -- 172.21.15.72:0/2317622740 >> 172.21.15.72:0/2317622740 conn(0x7fcb3006a190 msgr2=0x7fcb3006a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:47.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.187+0000 7fcb37bff700 1 -- 172.21.15.72:0/2317622740 shutdown_connections 2023-07-27T20:32:47.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.187+0000 7fcb37bff700 1 -- 172.21.15.72:0/2317622740 wait complete. 2023-07-27T20:32:47.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.189+0000 7fcb37bff700 1 Processor -- start 2023-07-27T20:32:47.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.189+0000 7fcb37bff700 1 -- start start 2023-07-27T20:32:47.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.190+0000 7fcb37bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcb300a83a0 0x7fcb301df780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:47.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.190+0000 7fcb37bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb300bfd90 0x7fcb300c1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:47.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.190+0000 7fcb37bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb3013b2c0 0x7fcb300c1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:47.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.190+0000 7fcb37bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb30153ed0 con 0x7fcb3013b2c0 2023-07-27T20:32:47.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.190+0000 7fcb37bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb301532c0 con 0x7fcb300bfd90 2023-07-27T20:32:47.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.190+0000 7fcb37bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb301535a0 con 0x7fcb300a83a0 2023-07-27T20:32:47.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.190+0000 7fcb3619c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb3013b2c0 0x7fcb300c1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:47.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.190+0000 7fcb3619c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb3013b2c0 0x7fcb300c1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55084/0 (socket says 172.21.15.72:55084) 2023-07-27T20:32:47.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.190+0000 7fcb3619c700 1 -- 172.21.15.72:0/3354183876 learned_addr learned my addr 172.21.15.72:0/3354183876 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:47.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.190+0000 7fcb3519a700 1 --2- 172.21.15.72:0/3354183876 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb300bfd90 0x7fcb300c1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:47.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.190+0000 7fcb3599b700 1 --2- 172.21.15.72:0/3354183876 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcb300a83a0 0x7fcb301df780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:47.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.190+0000 7fcb3619c700 1 -- 172.21.15.72:0/3354183876 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcb300a83a0 msgr2=0x7fcb301df780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:47.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.190+0000 7fcb3619c700 1 --2- 172.21.15.72:0/3354183876 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcb300a83a0 0x7fcb301df780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:47.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.190+0000 7fcb3619c700 1 -- 172.21.15.72:0/3354183876 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb300bfd90 msgr2=0x7fcb300c1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:47.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.190+0000 7fcb3619c700 1 --2- 172.21.15.72:0/3354183876 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb300bfd90 0x7fcb300c1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:47.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.190+0000 7fcb3619c700 1 -- 172.21.15.72:0/3354183876 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb2c0094a0 con 0x7fcb3013b2c0 2023-07-27T20:32:47.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.191+0000 7fcb3619c700 1 --2- 172.21.15.72:0/3354183876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb3013b2c0 0x7fcb300c1a70 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fcb2800cc20 tx=0x7fcb2800cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:47.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.191+0000 7fcb267fc700 1 -- 172.21.15.72:0/3354183876 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb28003c00 con 0x7fcb3013b2c0 2023-07-27T20:32:47.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.191+0000 7fcb267fc700 1 -- 172.21.15.72:0/3354183876 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb28003d60 con 0x7fcb3013b2c0 2023-07-27T20:32:47.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.191+0000 7fcb267fc700 1 -- 172.21.15.72:0/3354183876 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2800aae0 con 0x7fcb3013b2c0 2023-07-27T20:32:47.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.191+0000 7fcb37bff700 1 -- 172.21.15.72:0/3354183876 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb30153880 con 0x7fcb3013b2c0 2023-07-27T20:32:47.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.191+0000 7fcb37bff700 1 -- 172.21.15.72:0/3354183876 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb301dfcc0 con 0x7fcb3013b2c0 2023-07-27T20:32:47.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.192+0000 7fcb37bff700 1 -- 172.21.15.72:0/3354183876 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb30154260 con 0x7fcb3013b2c0 2023-07-27T20:32:47.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.193+0000 7fcb267fc700 1 -- 172.21.15.72:0/3354183876 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcb2800ac40 con 0x7fcb3013b2c0 2023-07-27T20:32:47.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.194+0000 7fcb267fc700 1 --2- 172.21.15.72:0/3354183876 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcb1406ace0 0x7fcb1406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:47.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.194+0000 7fcb267fc700 1 -- 172.21.15.72:0/3354183876 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcb280898a0 con 0x7fcb3013b2c0 2023-07-27T20:32:47.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.194+0000 7fcb3599b700 1 --2- 172.21.15.72:0/3354183876 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcb1406ace0 0x7fcb1406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:47.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.195+0000 7fcb3599b700 1 --2- 172.21.15.72:0/3354183876 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcb1406ace0 0x7fcb1406d1a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c0097c0 tx=0x7fcb2c01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:47.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.198+0000 7fcb267fc700 1 -- 172.21.15.72:0/3354183876 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcb28054580 con 0x7fcb3013b2c0 2023-07-27T20:32:47.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.435+0000 7fcb37bff700 1 -- 172.21.15.72:0/3354183876 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fcb3006c140 con 0x7fcb3013b2c0 2023-07-27T20:32:47.423 INFO:tasks.ceph.mon.a.smithi072.stderr:2023-07-27T20:32:47.436+0000 7f82f93f4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-27T20:32:47.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.444+0000 7fcb267fc700 1 -- 172.21.15.72:0/3354183876 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7fcb28057ba0 con 0x7fcb3013b2c0 2023-07-27T20:32:47.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.447+0000 7fcb37bff700 1 -- 172.21.15.72:0/3354183876 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcb1406ace0 msgr2=0x7fcb1406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:47.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.447+0000 7fcb37bff700 1 --2- 172.21.15.72:0/3354183876 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcb1406ace0 0x7fcb1406d1a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c0097c0 tx=0x7fcb2c01c040 comp rx=0 tx=0).stop 2023-07-27T20:32:47.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.447+0000 7fcb37bff700 1 -- 172.21.15.72:0/3354183876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb3013b2c0 msgr2=0x7fcb300c1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:47.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.447+0000 7fcb37bff700 1 --2- 172.21.15.72:0/3354183876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb3013b2c0 0x7fcb300c1a70 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fcb2800cc20 tx=0x7fcb2800cf30 comp rx=0 tx=0).stop 2023-07-27T20:32:47.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.447+0000 7fcb37bff700 1 -- 172.21.15.72:0/3354183876 shutdown_connections 2023-07-27T20:32:47.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.447+0000 7fcb37bff700 1 --2- 172.21.15.72:0/3354183876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb3013b2c0 0x7fcb300c1a70 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:47.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.447+0000 7fcb37bff700 1 --2- 172.21.15.72:0/3354183876 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcb1406ace0 0x7fcb1406d1a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:47.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.447+0000 7fcb37bff700 1 --2- 172.21.15.72:0/3354183876 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcb300a83a0 0x7fcb301df780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:47.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.447+0000 7fcb37bff700 1 --2- 172.21.15.72:0/3354183876 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb300bfd90 0x7fcb300c1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:47.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.447+0000 7fcb37bff700 1 -- 172.21.15.72:0/3354183876 >> 172.21.15.72:0/3354183876 conn(0x7fcb3006a190 msgr2=0x7fcb30155830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:47.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.447+0000 7fcb37bff700 1 -- 172.21.15.72:0/3354183876 shutdown_connections 2023-07-27T20:32:47.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.447+0000 7fcb37bff700 1 -- 172.21.15.72:0/3354183876 wait complete. 2023-07-27T20:32:47.436 INFO:teuthology.orchestra.run.smithi072.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-27T20:32:47.440 INFO:tasks.ceph.mds.b.smithi173.stderr: -4553> 2023-07-27T20:31:34.044+0000 7f5c863f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-27T20:32:47.452 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-27T20:32:47.494 INFO:tasks.ceph.mds.b.smithi173.stdout:starting mds.b at 2023-07-27T20:32:47.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.661+0000 7f587cfff700 1 Processor -- start 2023-07-27T20:32:47.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.661+0000 7f587cfff700 1 -- start start 2023-07-27T20:32:47.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.662+0000 7f587cfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58781475a0 0x7f58781516c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:47.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.663+0000 7f587cfff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5878154f50 con 0x7f58780716f0 2023-07-27T20:32:47.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.663+0000 7f587cfff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5878154340 con 0x7f58780c12f0 2023-07-27T20:32:47.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.663+0000 7f587cfff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5878151c00 con 0x7f58781475a0 2023-07-27T20:32:47.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.663+0000 7f5876d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f58780716f0 0x7f5878071b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58710/0 (socket says 172.21.15.72:58710) 2023-07-27T20:32:47.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.663+0000 7f5876d9d700 1 -- 172.21.15.72:0/2379633692 learned_addr learned my addr 172.21.15.72:0/2379633692 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:47.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.663+0000 7f587659c700 1 --2- 172.21.15.72:0/2379633692 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58781475a0 0x7f58781516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:47.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.663+0000 7f5875d9b700 1 -- 172.21.15.72:0/2379633692 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 764280720 0 0) 0x7f5878154f50 con 0x7f58780716f0 2023-07-27T20:32:47.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.663+0000 7f5875d9b700 1 -- 172.21.15.72:0/2379633692 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58640035b0 con 0x7f58780716f0 2023-07-27T20:32:47.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.663+0000 7f5875d9b700 1 -- 172.21.15.72:0/2379633692 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1265430706 0 0) 0x7f5878154340 con 0x7f58780c12f0 2023-07-27T20:32:47.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.663+0000 7f5875d9b700 1 -- 172.21.15.72:0/2379633692 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5878154f50 con 0x7f58780c12f0 2023-07-27T20:32:47.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.663+0000 7f587659c700 1 -- 172.21.15.72:0/2379633692 >> v1:172.21.15.173:6789/0 conn(0x7f58780c12f0 legacy=0x7f58780c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:47.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.663+0000 7f587659c700 1 -- 172.21.15.72:0/2379633692 >> v1:172.21.15.72:6789/0 conn(0x7f58780716f0 legacy=0x7f5878071b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:47.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.664+0000 7f587659c700 1 -- 172.21.15.72:0/2379633692 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5878154620 con 0x7f58781475a0 2023-07-27T20:32:47.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.664+0000 7f587659c700 1 --2- 172.21.15.72:0/2379633692 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58781475a0 0x7f58781516c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5868009870 tx=0x7f5868009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cda79058317281d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:47.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.664+0000 7f5875d9b700 1 -- 172.21.15.72:0/2379633692 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5868011830 con 0x7f58781475a0 2023-07-27T20:32:47.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.664+0000 7f5875d9b700 1 -- 172.21.15.72:0/2379633692 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5868011990 con 0x7f58781475a0 2023-07-27T20:32:47.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.664+0000 7f5875d9b700 1 -- 172.21.15.72:0/2379633692 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5868011d20 con 0x7f58781475a0 2023-07-27T20:32:47.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.665+0000 7f587cfff700 1 -- 172.21.15.72:0/2379633692 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58781475a0 msgr2=0x7f58781516c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:47.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.665+0000 7f587cfff700 1 --2- 172.21.15.72:0/2379633692 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58781475a0 0x7f58781516c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5868009870 tx=0x7f5868009b80 comp rx=0 tx=0).stop 2023-07-27T20:32:47.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.665+0000 7f587cfff700 1 -- 172.21.15.72:0/2379633692 shutdown_connections 2023-07-27T20:32:47.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.665+0000 7f587cfff700 1 --2- 172.21.15.72:0/2379633692 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58781475a0 0x7f58781516c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:47.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.665+0000 7f587cfff700 1 -- 172.21.15.72:0/2379633692 >> 172.21.15.72:0/2379633692 conn(0x7f587806a190 msgr2=0x7f587806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:47.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.665+0000 7f587cfff700 1 -- 172.21.15.72:0/2379633692 shutdown_connections 2023-07-27T20:32:47.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.665+0000 7f587cfff700 1 -- 172.21.15.72:0/2379633692 wait complete. 2023-07-27T20:32:47.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.666+0000 7f587cfff700 1 Processor -- start 2023-07-27T20:32:47.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.667+0000 7f587cfff700 1 -- start start 2023-07-27T20:32:47.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.667+0000 7f587cfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58780716f0 0x7f58781e98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:47.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.667+0000 7f587cfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58780c12f0 0x7f58780bfe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:47.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.667+0000 7f587cfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58781475a0 0x7f58781ed500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:47.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.667+0000 7f587cfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5878153c40 con 0x7f58780c12f0 2023-07-27T20:32:47.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.667+0000 7f587cfff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5878153760 con 0x7f58781475a0 2023-07-27T20:32:47.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.667+0000 7f587cfff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5878153e90 con 0x7f58780716f0 2023-07-27T20:32:47.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.668+0000 7f586ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58780c12f0 0x7f58780bfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:47.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.668+0000 7f586ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58780c12f0 0x7f58780bfe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55088/0 (socket says 172.21.15.72:55088) 2023-07-27T20:32:47.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.668+0000 7f586ffff700 1 -- 172.21.15.72:0/230917510 learned_addr learned my addr 172.21.15.72:0/230917510 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:47.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.668+0000 7f587659c700 1 --2- 172.21.15.72:0/230917510 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58780716f0 0x7f58781e98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:47.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.668+0000 7f5876d9d700 1 --2- 172.21.15.72:0/230917510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58781475a0 0x7f58781ed500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:47.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.668+0000 7f586ffff700 1 -- 172.21.15.72:0/230917510 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58780716f0 msgr2=0x7f58781e98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:47.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.668+0000 7f586ffff700 1 --2- 172.21.15.72:0/230917510 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58780716f0 0x7f58781e98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:47.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.668+0000 7f586ffff700 1 -- 172.21.15.72:0/230917510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58781475a0 msgr2=0x7f58781ed500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:47.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.668+0000 7f586ffff700 1 --2- 172.21.15.72:0/230917510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58781475a0 0x7f58781ed500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:47.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.668+0000 7f586ffff700 1 -- 172.21.15.72:0/230917510 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58680094a0 con 0x7f58780c12f0 2023-07-27T20:32:47.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.668+0000 7f586ffff700 1 --2- 172.21.15.72:0/230917510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58780c12f0 0x7f58780bfe90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f586000c520 tx=0x7f586000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:47.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.668+0000 7f586effd700 1 -- 172.21.15.72:0/230917510 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58600052d0 con 0x7f58780c12f0 2023-07-27T20:32:47.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.668+0000 7f586effd700 1 -- 172.21.15.72:0/230917510 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5860005430 con 0x7f58780c12f0 2023-07-27T20:32:47.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.668+0000 7f587cfff700 1 -- 172.21.15.72:0/230917510 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58781ecfe0 con 0x7f58780c12f0 2023-07-27T20:32:47.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.668+0000 7f586effd700 1 -- 172.21.15.72:0/230917510 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58600038c0 con 0x7f58780c12f0 2023-07-27T20:32:47.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.669+0000 7f587cfff700 1 -- 172.21.15.72:0/230917510 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587814df60 con 0x7f58780c12f0 2023-07-27T20:32:47.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.669+0000 7f587cfff700 1 -- 172.21.15.72:0/230917510 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58781ece40 con 0x7f58780c12f0 2023-07-27T20:32:47.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.671+0000 7f586effd700 1 -- 172.21.15.72:0/230917510 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5860003a20 con 0x7f58780c12f0 2023-07-27T20:32:47.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.671+0000 7f586effd700 1 --2- 172.21.15.72:0/230917510 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f585806ace0 0x7f585806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:47.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.671+0000 7f586effd700 1 -- 172.21.15.72:0/230917510 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6957+0+0 (secure 0 0 0) 0x7f5860088e20 con 0x7f58780c12f0 2023-07-27T20:32:47.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.672+0000 7f587659c700 1 --2- 172.21.15.72:0/230917510 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f585806ace0 0x7f585806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:47.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.672+0000 7f587659c700 1 --2- 172.21.15.72:0/230917510 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f585806ace0 0x7f585806d1a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f58680090b0 tx=0x7f586801c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:47.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.676+0000 7f586effd700 1 -- 172.21.15.72:0/230917510 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f58781ece40 con 0x7f58780c12f0 2023-07-27T20:32:47.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:47.912+0000 7f587cfff700 1 -- 172.21.15.72:0/230917510 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f58781ece40 con 0x7f58780c12f0 2023-07-27T20:32:48.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.445+0000 7f586effd700 1 -- 172.21.15.72:0/230917510 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f58781ece40 con 0x7f58780c12f0 2023-07-27T20:32:48.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.447+0000 7f587cfff700 1 -- 172.21.15.72:0/230917510 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f585806ace0 msgr2=0x7f585806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:48.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.447+0000 7f587cfff700 1 --2- 172.21.15.72:0/230917510 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f585806ace0 0x7f585806d1a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f58680090b0 tx=0x7f586801c040 comp rx=0 tx=0).stop 2023-07-27T20:32:48.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.447+0000 7f587cfff700 1 -- 172.21.15.72:0/230917510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58780c12f0 msgr2=0x7f58780bfe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:48.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.447+0000 7f587cfff700 1 --2- 172.21.15.72:0/230917510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58780c12f0 0x7f58780bfe90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f586000c520 tx=0x7f586000c8e0 comp rx=0 tx=0).stop 2023-07-27T20:32:48.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.447+0000 7f587cfff700 1 -- 172.21.15.72:0/230917510 shutdown_connections 2023-07-27T20:32:48.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.448+0000 7f587cfff700 1 --2- 172.21.15.72:0/230917510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58781475a0 0x7f58781ed500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:48.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.448+0000 7f587cfff700 1 --2- 172.21.15.72:0/230917510 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f585806ace0 0x7f585806d1a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:48.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.448+0000 7f587cfff700 1 --2- 172.21.15.72:0/230917510 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58780716f0 0x7f58781e98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:48.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.448+0000 7f587cfff700 1 --2- 172.21.15.72:0/230917510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58780c12f0 0x7f58780bfe90 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:48.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.448+0000 7f587cfff700 1 -- 172.21.15.72:0/230917510 >> 172.21.15.72:0/230917510 conn(0x7f587806a190 msgr2=0x7f5878145340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:48.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.448+0000 7f587cfff700 1 -- 172.21.15.72:0/230917510 shutdown_connections 2023-07-27T20:32:48.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.448+0000 7f587cfff700 1 -- 172.21.15.72:0/230917510 wait complete. 2023-07-27T20:32:48.454 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-27T20:32:48.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.667+0000 7fa8491ff700 1 Processor -- start 2023-07-27T20:32:48.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.667+0000 7fa8491ff700 1 -- start start 2023-07-27T20:32:48.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.668+0000 7fa8491ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa8440c0e00 0x7fa84406cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:48.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.668+0000 7fa8491ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8440c0970 con 0x7fa8441512c0 2023-07-27T20:32:48.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.668+0000 7fa8491ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8440c1230 con 0x7fa84414a640 2023-07-27T20:32:48.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.668+0000 7fa8491ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa844070680 con 0x7fa8440c0e00 2023-07-27T20:32:48.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.669+0000 7fa84259c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa8441512c0 0x7fa84406ff70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58716/0 (socket says 172.21.15.72:58716) 2023-07-27T20:32:48.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.669+0000 7fa84259c700 1 -- 172.21.15.72:0/3897914871 learned_addr learned my addr 172.21.15.72:0/3897914871 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:48.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.669+0000 7fa84359e700 1 --2- 172.21.15.72:0/3897914871 >> v2:172.21.15.72:3300/0 conn(0x7fa8440c0e00 0x7fa84406cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:48.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.669+0000 7fa841d9b700 1 -- 172.21.15.72:0/3897914871 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3119073915 0 0) 0x7fa8440c0970 con 0x7fa8441512c0 2023-07-27T20:32:48.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.669+0000 7fa841d9b700 1 -- 172.21.15.72:0/3897914871 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa82c0035b0 con 0x7fa8441512c0 2023-07-27T20:32:48.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.669+0000 7fa84359e700 1 -- 172.21.15.72:0/3897914871 >> v1:172.21.15.173:6789/0 conn(0x7fa84414a640 legacy=0x7fa8440c1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:48.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.669+0000 7fa84359e700 1 -- 172.21.15.72:0/3897914871 >> v1:172.21.15.72:6789/0 conn(0x7fa8441512c0 legacy=0x7fa84406ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:48.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.669+0000 7fa84359e700 1 -- 172.21.15.72:0/3897914871 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8440bfd60 con 0x7fa8440c0e00 2023-07-27T20:32:48.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.669+0000 7fa84359e700 1 --2- 172.21.15.72:0/3897914871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8440c0e00 0x7fa84406cf00 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa83c009d90 tx=0x7fa83c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54864d86287f5808 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:48.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.670+0000 7fa841d9b700 1 -- 172.21.15.72:0/3897914871 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c00e070 con 0x7fa8440c0e00 2023-07-27T20:32:48.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.670+0000 7fa841d9b700 1 -- 172.21.15.72:0/3897914871 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83c00bb20 con 0x7fa8440c0e00 2023-07-27T20:32:48.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.670+0000 7fa841d9b700 1 -- 172.21.15.72:0/3897914871 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c012430 con 0x7fa8440c0e00 2023-07-27T20:32:48.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.670+0000 7fa8491ff700 1 -- 172.21.15.72:0/3897914871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8440c0e00 msgr2=0x7fa84406cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:48.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.670+0000 7fa8491ff700 1 --2- 172.21.15.72:0/3897914871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8440c0e00 0x7fa84406cf00 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa83c009d90 tx=0x7fa83c00b330 comp rx=0 tx=0).stop 2023-07-27T20:32:48.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.670+0000 7fa8491ff700 1 -- 172.21.15.72:0/3897914871 shutdown_connections 2023-07-27T20:32:48.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.670+0000 7fa8491ff700 1 --2- 172.21.15.72:0/3897914871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8440c0e00 0x7fa84406cf00 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:48.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.670+0000 7fa8491ff700 1 -- 172.21.15.72:0/3897914871 >> 172.21.15.72:0/3897914871 conn(0x7fa8440c53e0 msgr2=0x7fa8440c57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:48.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.670+0000 7fa8491ff700 1 -- 172.21.15.72:0/3897914871 shutdown_connections 2023-07-27T20:32:48.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.670+0000 7fa8491ff700 1 -- 172.21.15.72:0/3897914871 wait complete. 2023-07-27T20:32:48.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.672+0000 7fa8491ff700 1 Processor -- start 2023-07-27T20:32:48.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.673+0000 7fa8491ff700 1 -- start start 2023-07-27T20:32:48.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.674+0000 7fa8491ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa8440c0e00 0x7fa844141bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:48.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.674+0000 7fa8491ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa84414a640 0x7fa8440c4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:48.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.674+0000 7fa8491ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8441512c0 0x7fa84414c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:48.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.674+0000 7fa8491ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8441ed270 con 0x7fa8441512c0 2023-07-27T20:32:48.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.674+0000 7fa8491ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8441ed4c0 con 0x7fa84414a640 2023-07-27T20:32:48.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.674+0000 7fa8491ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8441ed7a0 con 0x7fa8440c0e00 2023-07-27T20:32:48.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.674+0000 7fa84359e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8441512c0 0x7fa84414c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:48.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.674+0000 7fa84359e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8441512c0 0x7fa84414c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55112/0 (socket says 172.21.15.72:55112) 2023-07-27T20:32:48.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.674+0000 7fa84359e700 1 -- 172.21.15.72:0/2079505256 learned_addr learned my addr 172.21.15.72:0/2079505256 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:48.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.674+0000 7fa84259c700 1 --2- 172.21.15.72:0/2079505256 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa84414a640 0x7fa8440c4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:48.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.674+0000 7fa842d9d700 1 --2- 172.21.15.72:0/2079505256 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa8440c0e00 0x7fa844141bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:48.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.675+0000 7fa84359e700 1 -- 172.21.15.72:0/2079505256 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa8440c0e00 msgr2=0x7fa844141bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:48.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.675+0000 7fa84359e700 1 --2- 172.21.15.72:0/2079505256 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa8440c0e00 0x7fa844141bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:48.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.675+0000 7fa84359e700 1 -- 172.21.15.72:0/2079505256 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa84414a640 msgr2=0x7fa8440c4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:48.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.675+0000 7fa84359e700 1 --2- 172.21.15.72:0/2079505256 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa84414a640 0x7fa8440c4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:48.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.675+0000 7fa84359e700 1 -- 172.21.15.72:0/2079505256 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83c009a70 con 0x7fa8441512c0 2023-07-27T20:32:48.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.675+0000 7fa842d9d700 1 --2- 172.21.15.72:0/2079505256 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa8440c0e00 0x7fa844141bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:48.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.675+0000 7fa84359e700 1 --2- 172.21.15.72:0/2079505256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8441512c0 0x7fa84414c140 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa84406e760 tx=0x7fa83c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:48.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.675+0000 7fa82b7fe700 1 -- 172.21.15.72:0/2079505256 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c012430 con 0x7fa8441512c0 2023-07-27T20:32:48.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.675+0000 7fa82b7fe700 1 -- 172.21.15.72:0/2079505256 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83c020070 con 0x7fa8441512c0 2023-07-27T20:32:48.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.675+0000 7fa8491ff700 1 -- 172.21.15.72:0/2079505256 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8441eda80 con 0x7fa8441512c0 2023-07-27T20:32:48.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.675+0000 7fa82b7fe700 1 -- 172.21.15.72:0/2079505256 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c004280 con 0x7fa8441512c0 2023-07-27T20:32:48.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.675+0000 7fa8491ff700 1 -- 172.21.15.72:0/2079505256 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8441ee040 con 0x7fa8441512c0 2023-07-27T20:32:48.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.676+0000 7fa8491ff700 1 -- 172.21.15.72:0/2079505256 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa84414bf40 con 0x7fa8441512c0 2023-07-27T20:32:48.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.677+0000 7fa82b7fe700 1 -- 172.21.15.72:0/2079505256 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa83c0043e0 con 0x7fa8441512c0 2023-07-27T20:32:48.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.678+0000 7fa82b7fe700 1 --2- 172.21.15.72:0/2079505256 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa83006ace0 0x7fa83006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:48.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.678+0000 7fa82b7fe700 1 -- 172.21.15.72:0/2079505256 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6957+0+0 (secure 0 0 0) 0x7fa83c022070 con 0x7fa8441512c0 2023-07-27T20:32:48.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.679+0000 7fa842d9d700 1 --2- 172.21.15.72:0/2079505256 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa83006ace0 0x7fa83006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:48.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.679+0000 7fa842d9d700 1 --2- 172.21.15.72:0/2079505256 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa83006ace0 0x7fa83006d1a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa8440aa490 tx=0x7fa834009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:48.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.682+0000 7fa82b7fe700 1 -- 172.21.15.72:0/2079505256 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa83c056200 con 0x7fa8441512c0 2023-07-27T20:32:48.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:48.879+0000 7fa8491ff700 1 -- 172.21.15.72:0/2079505256 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa84404e470 con 0x7fa8441512c0 2023-07-27T20:32:49.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.451+0000 7fa82b7fe700 1 -- 172.21.15.72:0/2079505256 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa83c059820 con 0x7fa8441512c0 2023-07-27T20:32:49.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.455+0000 7fa8491ff700 1 -- 172.21.15.72:0/2079505256 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa83006ace0 msgr2=0x7fa83006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:49.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.455+0000 7fa8491ff700 1 --2- 172.21.15.72:0/2079505256 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa83006ace0 0x7fa83006d1a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa8440aa490 tx=0x7fa834009040 comp rx=0 tx=0).stop 2023-07-27T20:32:49.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.455+0000 7fa8491ff700 1 -- 172.21.15.72:0/2079505256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8441512c0 msgr2=0x7fa84414c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:49.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.455+0000 7fa8491ff700 1 --2- 172.21.15.72:0/2079505256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8441512c0 0x7fa84414c140 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa84406e760 tx=0x7fa83c004ad0 comp rx=0 tx=0).stop 2023-07-27T20:32:49.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.456+0000 7fa8491ff700 1 -- 172.21.15.72:0/2079505256 shutdown_connections 2023-07-27T20:32:49.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.456+0000 7fa8491ff700 1 --2- 172.21.15.72:0/2079505256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8441512c0 0x7fa84414c140 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:49.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.456+0000 7fa8491ff700 1 --2- 172.21.15.72:0/2079505256 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa83006ace0 0x7fa83006d1a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:49.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.456+0000 7fa8491ff700 1 --2- 172.21.15.72:0/2079505256 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa8440c0e00 0x7fa844141bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:49.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.456+0000 7fa8491ff700 1 --2- 172.21.15.72:0/2079505256 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa84414a640 0x7fa8440c4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:49.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.456+0000 7fa8491ff700 1 -- 172.21.15.72:0/2079505256 >> 172.21.15.72:0/2079505256 conn(0x7fa8440c53e0 msgr2=0x7fa8440c57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:49.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.456+0000 7fa8491ff700 1 -- 172.21.15.72:0/2079505256 shutdown_connections 2023-07-27T20:32:49.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.456+0000 7fa8491ff700 1 -- 172.21.15.72:0/2079505256 wait complete. 2023-07-27T20:32:49.445 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' removed 2023-07-27T20:32:49.464 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-27T20:32:49.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.676+0000 7f68677ff700 1 Processor -- start 2023-07-27T20:32:49.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.676+0000 7f68677ff700 1 -- start start 2023-07-27T20:32:49.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.677+0000 7f68677ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f686013c9f0 0x7f686013cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:49.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.678+0000 7f68677ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f68600c02b0 0x7f68600c0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:49.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.678+0000 7f68677ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68601584e0 con 0x7f68600c13b0 2023-07-27T20:32:49.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.678+0000 7f68677ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68601578d0 con 0x7f68600c02b0 2023-07-27T20:32:49.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.678+0000 7f68677ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6860157bb0 con 0x7f686013c9f0 2023-07-27T20:32:49.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.678+0000 7f6864d9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f68600c02b0 0x7f68600c0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:49.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.678+0000 7f6864d9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f68600c02b0 0x7f68600c0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55124/0 (socket says 172.21.15.72:55124) 2023-07-27T20:32:49.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.678+0000 7f6864d9a700 1 -- 172.21.15.72:0/2844383136 learned_addr learned my addr 172.21.15.72:0/2844383136 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:49.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.678+0000 7f6865d9c700 1 --1- 172.21.15.72:0/2844383136 >> v1:172.21.15.72:6789/0 conn(0x7f68600c13b0 0x7f6860154240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58724/0 (socket says 172.21.15.72:58724) 2023-07-27T20:32:49.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.678+0000 7f686559b700 1 --2- 172.21.15.72:0/2844383136 >> v2:172.21.15.173:3300/0 conn(0x7f686013c9f0 0x7f686013cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:49.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.678+0000 7f6864d9a700 1 -- 172.21.15.72:0/2844383136 >> v2:172.21.15.173:3300/0 conn(0x7f686013c9f0 msgr2=0x7f686013cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:49.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.678+0000 7f6864d9a700 1 --2- 172.21.15.72:0/2844383136 >> v2:172.21.15.173:3300/0 conn(0x7f686013c9f0 0x7f686013cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:49.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.678+0000 7f6864d9a700 1 -- 172.21.15.72:0/2844383136 >> v1:172.21.15.72:6789/0 conn(0x7f68600c13b0 legacy=0x7f6860154240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:49.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.678+0000 7f6864d9a700 1 -- 172.21.15.72:0/2844383136 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6860157e90 con 0x7f68600c02b0 2023-07-27T20:32:49.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.679+0000 7f6864d9a700 1 --2- 172.21.15.72:0/2844383136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68600c02b0 0x7f68600c0e70 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f68600a9260 tx=0x7f6850009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f18ebb43dd19b792 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:49.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.679+0000 7f6857fff700 1 -- 172.21.15.72:0/2844383136 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6850011830 con 0x7f68600c02b0 2023-07-27T20:32:49.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.679+0000 7f6857fff700 1 -- 172.21.15.72:0/2844383136 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6850011990 con 0x7f68600c02b0 2023-07-27T20:32:49.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.679+0000 7f6857fff700 1 -- 172.21.15.72:0/2844383136 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6850011d20 con 0x7f68600c02b0 2023-07-27T20:32:49.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.679+0000 7f68677ff700 1 -- 172.21.15.72:0/2844383136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68600c02b0 msgr2=0x7f68600c0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:49.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.679+0000 7f68677ff700 1 --2- 172.21.15.72:0/2844383136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68600c02b0 0x7f68600c0e70 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f68600a9260 tx=0x7f6850009bd0 comp rx=0 tx=0).stop 2023-07-27T20:32:49.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.679+0000 7f68677ff700 1 -- 172.21.15.72:0/2844383136 shutdown_connections 2023-07-27T20:32:49.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.679+0000 7f68677ff700 1 --2- 172.21.15.72:0/2844383136 >> v2:172.21.15.173:3300/0 conn(0x7f686013c9f0 0x7f686013cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:49.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.679+0000 7f68677ff700 1 --2- 172.21.15.72:0/2844383136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68600c02b0 0x7f68600c0e70 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:49.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.679+0000 7f68677ff700 1 -- 172.21.15.72:0/2844383136 >> 172.21.15.72:0/2844383136 conn(0x7f68600a7b10 msgr2=0x7f686006e230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:49.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.680+0000 7f68677ff700 1 -- 172.21.15.72:0/2844383136 shutdown_connections 2023-07-27T20:32:49.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.680+0000 7f68677ff700 1 -- 172.21.15.72:0/2844383136 wait complete. 2023-07-27T20:32:49.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.682+0000 7f68677ff700 1 Processor -- start 2023-07-27T20:32:49.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.682+0000 7f68677ff700 1 -- start start 2023-07-27T20:32:49.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.683+0000 7f68677ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f68600c02b0 0x7f686006aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:49.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.683+0000 7f68677ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68600c13b0 0x7f6860134c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:49.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.683+0000 7f68677ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f686013c9f0 0x7f6860133f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:49.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.683+0000 7f68677ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68600c47f0 con 0x7f686013c9f0 2023-07-27T20:32:49.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.683+0000 7f68677ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68600c44c0 con 0x7f68600c13b0 2023-07-27T20:32:49.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.683+0000 7f68677ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68601376a0 con 0x7f68600c02b0 2023-07-27T20:32:49.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.683+0000 7f6865d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f686013c9f0 0x7f6860133f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:49.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.684+0000 7f6865d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f686013c9f0 0x7f6860133f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55138/0 (socket says 172.21.15.72:55138) 2023-07-27T20:32:49.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.684+0000 7f6865d9c700 1 -- 172.21.15.72:0/2880745953 learned_addr learned my addr 172.21.15.72:0/2880745953 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:49.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.684+0000 7f6864d9a700 1 --2- 172.21.15.72:0/2880745953 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68600c13b0 0x7f6860134c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:49.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.684+0000 7f686559b700 1 --2- 172.21.15.72:0/2880745953 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f68600c02b0 0x7f686006aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:49.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.684+0000 7f6865d9c700 1 -- 172.21.15.72:0/2880745953 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f68600c02b0 msgr2=0x7f686006aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:49.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.684+0000 7f6865d9c700 1 --2- 172.21.15.72:0/2880745953 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f68600c02b0 0x7f686006aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:49.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.684+0000 7f6865d9c700 1 -- 172.21.15.72:0/2880745953 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68600c13b0 msgr2=0x7f6860134c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:49.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.684+0000 7f6865d9c700 1 --2- 172.21.15.72:0/2880745953 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68600c13b0 0x7f6860134c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:49.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.684+0000 7f6865d9c700 1 -- 172.21.15.72:0/2880745953 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6850009550 con 0x7f686013c9f0 2023-07-27T20:32:49.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.684+0000 7f6865d9c700 1 --2- 172.21.15.72:0/2880745953 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f686013c9f0 0x7f6860133f20 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f685800cc00 tx=0x7f685800cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:49.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.684+0000 7f6855ffb700 1 -- 172.21.15.72:0/2880745953 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685800aa40 con 0x7f686013c9f0 2023-07-27T20:32:49.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.684+0000 7f6855ffb700 1 -- 172.21.15.72:0/2880745953 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685800aba0 con 0x7f686013c9f0 2023-07-27T20:32:49.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.684+0000 7f6855ffb700 1 -- 172.21.15.72:0/2880745953 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6858007070 con 0x7f686013c9f0 2023-07-27T20:32:49.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.684+0000 7f68677ff700 1 -- 172.21.15.72:0/2880745953 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6860137980 con 0x7f686013c9f0 2023-07-27T20:32:49.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.685+0000 7f68677ff700 1 -- 172.21.15.72:0/2880745953 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f686006afc0 con 0x7f686013c9f0 2023-07-27T20:32:49.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.685+0000 7f68677ff700 1 -- 172.21.15.72:0/2880745953 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6860137ea0 con 0x7f686013c9f0 2023-07-27T20:32:49.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.686+0000 7f6855ffb700 1 -- 172.21.15.72:0/2880745953 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f68580071d0 con 0x7f686013c9f0 2023-07-27T20:32:49.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.687+0000 7f6855ffb700 1 --2- 172.21.15.72:0/2880745953 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f684406ace0 0x7f684406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:49.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.687+0000 7f6855ffb700 1 -- 172.21.15.72:0/2880745953 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6519+0+0 (secure 0 0 0) 0x7f68580892f0 con 0x7f686013c9f0 2023-07-27T20:32:49.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.688+0000 7f686559b700 1 --2- 172.21.15.72:0/2880745953 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f684406ace0 0x7f684406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:49.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.689+0000 7f686559b700 1 --2- 172.21.15.72:0/2880745953 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f684406ace0 0x7f684406d1a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f686006c360 tx=0x7f685c009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:49.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.692+0000 7f6855ffb700 1 -- 172.21.15.72:0/2880745953 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6860137ea0 con 0x7f686013c9f0 2023-07-27T20:32:49.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:49.883+0000 7f68677ff700 1 -- 172.21.15.72:0/2880745953 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6860137ea0 con 0x7f686013c9f0 2023-07-27T20:32:50.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.453+0000 7f6855ffb700 1 -- 172.21.15.72:0/2880745953 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6860137ea0 con 0x7f686013c9f0 2023-07-27T20:32:50.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.457+0000 7f68677ff700 1 -- 172.21.15.72:0/2880745953 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f684406ace0 msgr2=0x7f684406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:50.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.457+0000 7f68677ff700 1 --2- 172.21.15.72:0/2880745953 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f684406ace0 0x7f684406d1a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f686006c360 tx=0x7f685c009210 comp rx=0 tx=0).stop 2023-07-27T20:32:50.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.457+0000 7f68677ff700 1 -- 172.21.15.72:0/2880745953 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f686013c9f0 msgr2=0x7f6860133f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:50.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.457+0000 7f68677ff700 1 --2- 172.21.15.72:0/2880745953 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f686013c9f0 0x7f6860133f20 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f685800cc00 tx=0x7f685800cf10 comp rx=0 tx=0).stop 2023-07-27T20:32:50.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.457+0000 7f68677ff700 1 -- 172.21.15.72:0/2880745953 shutdown_connections 2023-07-27T20:32:50.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.457+0000 7f68677ff700 1 --2- 172.21.15.72:0/2880745953 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f686013c9f0 0x7f6860133f20 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:50.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.457+0000 7f68677ff700 1 --2- 172.21.15.72:0/2880745953 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f684406ace0 0x7f684406d1a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:50.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.457+0000 7f68677ff700 1 --2- 172.21.15.72:0/2880745953 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f68600c02b0 0x7f686006aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:50.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.457+0000 7f68677ff700 1 --2- 172.21.15.72:0/2880745953 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68600c13b0 0x7f6860134c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:50.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.457+0000 7f68677ff700 1 -- 172.21.15.72:0/2880745953 >> 172.21.15.72:0/2880745953 conn(0x7f68600a7b10 msgr2=0x7f68600c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:50.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.458+0000 7f68677ff700 1 -- 172.21.15.72:0/2880745953 shutdown_connections 2023-07-27T20:32:50.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.458+0000 7f68677ff700 1 -- 172.21.15.72:0/2880745953 wait complete. 2023-07-27T20:32:50.448 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' removed 2023-07-27T20:32:50.470 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-07-27T20:32:50.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.682+0000 7f9fb0fff700 1 Processor -- start 2023-07-27T20:32:50.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.682+0000 7f9fb0fff700 1 -- start start 2023-07-27T20:32:50.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.683+0000 7f9fb0fff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9fac0c7700 0x7f9fac0c4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:50.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.683+0000 7f9fb0fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fac0c7b10 con 0x7f9fac151600 2023-07-27T20:32:50.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.684+0000 7f9fb0fff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fac0c59f0 con 0x7f9fac0c5410 2023-07-27T20:32:50.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.684+0000 7f9fb0fff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fac155090 con 0x7f9fac0c7700 2023-07-27T20:32:50.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.684+0000 7f9faa59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9fac151600 0x7f9fac154980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33598/0 (socket says 172.21.15.72:33598) 2023-07-27T20:32:50.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.684+0000 7f9faa59c700 1 -- 172.21.15.72:0/3195594922 learned_addr learned my addr 172.21.15.72:0/3195594922 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:50.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.684+0000 7f9faad9d700 1 --2- 172.21.15.72:0/3195594922 >> v2:172.21.15.173:3300/0 conn(0x7f9fac0c7700 0x7f9fac0c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:50.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.684+0000 7f9fa9d9b700 1 -- 172.21.15.72:0/3195594922 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4077651344 0 0) 0x7f9fac0c7b10 con 0x7f9fac151600 2023-07-27T20:32:50.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.684+0000 7f9fa9d9b700 1 -- 172.21.15.72:0/3195594922 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f980035b0 con 0x7f9fac151600 2023-07-27T20:32:50.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.684+0000 7f9fa9d9b700 1 -- 172.21.15.72:0/3195594922 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3557921126 0 0) 0x7f9f980035b0 con 0x7f9fac151600 2023-07-27T20:32:50.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.684+0000 7f9fa9d9b700 1 -- 172.21.15.72:0/3195594922 >> v2:172.21.15.173:3300/0 conn(0x7f9fac0c7700 msgr2=0x7f9fac0c4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:50.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.684+0000 7f9fa9d9b700 1 --2- 172.21.15.72:0/3195594922 >> v2:172.21.15.173:3300/0 conn(0x7f9fac0c7700 0x7f9fac0c4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:50.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.684+0000 7f9fa9d9b700 1 -- 172.21.15.72:0/3195594922 >> v1:172.21.15.173:6789/0 conn(0x7f9fac0c5410 legacy=0x7f9fac0c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:50.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.685+0000 7f9fa9d9b700 1 -- 172.21.15.72:0/3195594922 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fac0c5cd0 con 0x7f9fac151600 2023-07-27T20:32:50.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.685+0000 7f9fa9d9b700 1 -- 172.21.15.72:0/3195594922 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f9f9c001670 con 0x7f9fac151600 2023-07-27T20:32:50.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.685+0000 7f9fa9d9b700 1 -- 172.21.15.72:0/3195594922 >> v1:172.21.15.72:6789/0 conn(0x7f9fac151600 legacy=0x7f9fac154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:50.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.685+0000 7f9fa9d9b700 1 --2- 172.21.15.72:0/3195594922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f98003a50 0x7f9f98003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:50.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.685+0000 7f9fa9d9b700 1 --2- 172.21.15.72:0/3195594922 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9f98004850 0x7f9f98004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:50.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.685+0000 7f9fa9d9b700 1 --2- 172.21.15.72:0/3195594922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f98005260 0x7f9f9800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:50.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.685+0000 7f9fa9d9b700 1 -- 172.21.15.72:0/3195594922 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac155090 con 0x7f9f98003a50 2023-07-27T20:32:50.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.685+0000 7f9fa9d9b700 1 -- 172.21.15.72:0/3195594922 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9800c1b0 con 0x7f9f98005260 2023-07-27T20:32:50.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.685+0000 7f9fa9d9b700 1 -- 172.21.15.72:0/3195594922 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9800c370 con 0x7f9f98004850 2023-07-27T20:32:50.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.685+0000 7f9faa59c700 1 --2- 172.21.15.72:0/3195594922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f98003a50 0x7f9f98003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:50.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.685+0000 7f9fa3fff700 1 --2- 172.21.15.72:0/3195594922 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9f98004850 0x7f9f98004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:50.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.685+0000 7f9faad9d700 1 --2- 172.21.15.72:0/3195594922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f98005260 0x7f9f9800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:50.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.685+0000 7f9faa59c700 1 -- 172.21.15.72:0/3195594922 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9f98004850 msgr2=0x7f9f98004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:50.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.685+0000 7f9faa59c700 1 --2- 172.21.15.72:0/3195594922 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9f98004850 0x7f9f98004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:50.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.685+0000 7f9faa59c700 1 -- 172.21.15.72:0/3195594922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f98005260 msgr2=0x7f9f9800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:50.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.685+0000 7f9faa59c700 1 --2- 172.21.15.72:0/3195594922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f98005260 0x7f9f9800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:50.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.685+0000 7f9faa59c700 1 -- 172.21.15.72:0/3195594922 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f980035b0 con 0x7f9f98003a50 2023-07-27T20:32:50.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.685+0000 7f9faad9d700 1 --2- 172.21.15.72:0/3195594922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f98005260 0x7f9f9800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:50.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.685+0000 7f9faad9d700 1 -- 172.21.15.72:0/3195594922 reap_dead start 2023-07-27T20:32:50.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.686+0000 7f9faa59c700 1 --2- 172.21.15.72:0/3195594922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f98003a50 0x7f9f98003e70 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c001eb0 tx=0x7f9f98005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5b2eb7294366e2a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:50.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.686+0000 7f9fa9d9b700 1 -- 172.21.15.72:0/3195594922 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c007b70 con 0x7f9f98003a50 2023-07-27T20:32:50.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.686+0000 7f9fa9d9b700 1 -- 172.21.15.72:0/3195594922 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9c00ccf0 con 0x7f9f98003a50 2023-07-27T20:32:50.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.686+0000 7f9fa9d9b700 1 -- 172.21.15.72:0/3195594922 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c005ba0 con 0x7f9f98003a50 2023-07-27T20:32:50.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.686+0000 7f9fb0fff700 1 -- 172.21.15.72:0/3195594922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f98003a50 msgr2=0x7f9f98003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:50.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.686+0000 7f9fb0fff700 1 --2- 172.21.15.72:0/3195594922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f98003a50 0x7f9f98003e70 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c001eb0 tx=0x7f9f98005880 comp rx=0 tx=0).stop 2023-07-27T20:32:50.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.686+0000 7f9fb0fff700 1 -- 172.21.15.72:0/3195594922 shutdown_connections 2023-07-27T20:32:50.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.686+0000 7f9fb0fff700 1 --2- 172.21.15.72:0/3195594922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f98003a50 0x7f9f98003e70 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:50.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.686+0000 7f9fb0fff700 1 -- 172.21.15.72:0/3195594922 >> 172.21.15.72:0/3195594922 conn(0x7f9fac0c9800 msgr2=0x7f9fac0c9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:50.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.686+0000 7f9fb0fff700 1 -- 172.21.15.72:0/3195594922 shutdown_connections 2023-07-27T20:32:50.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.686+0000 7f9fb0fff700 1 -- 172.21.15.72:0/3195594922 wait complete. 2023-07-27T20:32:50.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.688+0000 7f9fb0fff700 1 Processor -- start 2023-07-27T20:32:50.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.688+0000 7f9fb0fff700 1 -- start start 2023-07-27T20:32:50.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.689+0000 7f9fb0fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9f98003a50 0x7f9fac0aa850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:50.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.689+0000 7f9fb0fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fac142aa0 0x7f9fac142f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:50.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.689+0000 7f9fb0fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fac1e9db0 0x7f9fac1ea260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:50.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.689+0000 7f9fb0fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac143460 con 0x7f9fac1e9db0 2023-07-27T20:32:50.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.689+0000 7f9fb0fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac14d9d0 con 0x7f9fac142aa0 2023-07-27T20:32:50.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.689+0000 7f9fb0fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac0c33d0 con 0x7f9f98003a50 2023-07-27T20:32:50.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.689+0000 7f9faad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fac1e9db0 0x7f9fac1ea260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:50.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.689+0000 7f9faad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fac1e9db0 0x7f9fac1ea260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49788/0 (socket says 172.21.15.72:49788) 2023-07-27T20:32:50.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.689+0000 7f9faad9d700 1 -- 172.21.15.72:0/137755853 learned_addr learned my addr 172.21.15.72:0/137755853 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:50.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.690+0000 7f9faa59c700 1 --2- 172.21.15.72:0/137755853 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9f98003a50 0x7f9fac0aa850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:50.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.690+0000 7f9fa3fff700 1 --2- 172.21.15.72:0/137755853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fac142aa0 0x7f9fac142f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:50.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.690+0000 7f9faad9d700 1 -- 172.21.15.72:0/137755853 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9f98003a50 msgr2=0x7f9fac0aa850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:50.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.690+0000 7f9faad9d700 1 --2- 172.21.15.72:0/137755853 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9f98003a50 0x7f9fac0aa850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:50.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.690+0000 7f9faad9d700 1 -- 172.21.15.72:0/137755853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fac142aa0 msgr2=0x7f9fac142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:50.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.690+0000 7f9faad9d700 1 --2- 172.21.15.72:0/137755853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fac142aa0 0x7f9fac142f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:50.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.690+0000 7f9faad9d700 1 -- 172.21.15.72:0/137755853 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fac0c3620 con 0x7f9fac1e9db0 2023-07-27T20:32:50.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.690+0000 7f9faad9d700 1 --2- 172.21.15.72:0/137755853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fac1e9db0 0x7f9fac1ea260 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9fac0c94e0 tx=0x7f9fa40104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:50.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.690+0000 7f9fa2ffd700 1 -- 172.21.15.72:0/137755853 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa400e050 con 0x7f9fac1e9db0 2023-07-27T20:32:50.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.690+0000 7f9fa2ffd700 1 -- 172.21.15.72:0/137755853 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa400f040 con 0x7f9fac1e9db0 2023-07-27T20:32:50.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.690+0000 7f9fa2ffd700 1 -- 172.21.15.72:0/137755853 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa4010df0 con 0x7f9fac1e9db0 2023-07-27T20:32:50.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.690+0000 7f9fb0fff700 1 -- 172.21.15.72:0/137755853 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fac0c08d0 con 0x7f9fac1e9db0 2023-07-27T20:32:50.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.690+0000 7f9fb0fff700 1 -- 172.21.15.72:0/137755853 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fac0c0e90 con 0x7f9fac1e9db0 2023-07-27T20:32:50.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.692+0000 7f9fb0fff700 1 -- 172.21.15.72:0/137755853 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fac154140 con 0x7f9fac1e9db0 2023-07-27T20:32:50.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.693+0000 7f9fa2ffd700 1 -- 172.21.15.72:0/137755853 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9fa4015440 con 0x7f9fac1e9db0 2023-07-27T20:32:50.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.693+0000 7f9fa2ffd700 1 --2- 172.21.15.72:0/137755853 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9f8c06ace0 0x7f9f8c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:50.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.693+0000 7f9fa2ffd700 1 -- 172.21.15.72:0/137755853 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f9fa4089520 con 0x7f9fac1e9db0 2023-07-27T20:32:50.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.694+0000 7f9faa59c700 1 --2- 172.21.15.72:0/137755853 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9f8c06ace0 0x7f9f8c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:50.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.695+0000 7f9faa59c700 1 --2- 172.21.15.72:0/137755853 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9f8c06ace0 0x7f9f8c06d1a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c000c00 tx=0x7f9f9c007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:50.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.698+0000 7f9fa2ffd700 1 -- 172.21.15.72:0/137755853 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9fa4054670 con 0x7f9fac1e9db0 2023-07-27T20:32:50.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:50.893+0000 7f9fb0fff700 1 -- 172.21.15.72:0/137755853 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9fac04e470 con 0x7f9fac1e9db0 2023-07-27T20:32:51.329 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:32:51.334 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:32:51.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.461+0000 7f9fa2ffd700 1 -- 172.21.15.72:0/137755853 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) v1 ==== 178+0+0 (secure 0 0 0) 0x7f9fa4057c90 con 0x7f9fac1e9db0 2023-07-27T20:32:51.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.465+0000 7f9fb0fff700 1 -- 172.21.15.72:0/137755853 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9f8c06ace0 msgr2=0x7f9f8c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:51.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.465+0000 7f9fb0fff700 1 --2- 172.21.15.72:0/137755853 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9f8c06ace0 0x7f9f8c06d1a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c000c00 tx=0x7f9f9c007000 comp rx=0 tx=0).stop 2023-07-27T20:32:51.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.465+0000 7f9fb0fff700 1 -- 172.21.15.72:0/137755853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fac1e9db0 msgr2=0x7f9fac1ea260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:51.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.465+0000 7f9fb0fff700 1 --2- 172.21.15.72:0/137755853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fac1e9db0 0x7f9fac1ea260 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9fac0c94e0 tx=0x7f9fa40104a0 comp rx=0 tx=0).stop 2023-07-27T20:32:51.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.465+0000 7f9fb0fff700 1 -- 172.21.15.72:0/137755853 shutdown_connections 2023-07-27T20:32:51.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.465+0000 7f9fb0fff700 1 --2- 172.21.15.72:0/137755853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fac1e9db0 0x7f9fac1ea260 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:51.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.465+0000 7f9fb0fff700 1 --2- 172.21.15.72:0/137755853 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9f8c06ace0 0x7f9f8c06d1a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:51.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.465+0000 7f9fb0fff700 1 --2- 172.21.15.72:0/137755853 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9f98003a50 0x7f9fac0aa850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:51.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.465+0000 7f9fb0fff700 1 --2- 172.21.15.72:0/137755853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fac142aa0 0x7f9fac142f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:51.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.465+0000 7f9fb0fff700 1 -- 172.21.15.72:0/137755853 >> 172.21.15.72:0/137755853 conn(0x7f9fac0c9800 msgr2=0x7f9fac0c82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:51.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.465+0000 7f9fb0fff700 1 -- 172.21.15.72:0/137755853 shutdown_connections 2023-07-27T20:32:51.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.466+0000 7f9fb0fff700 1 -- 172.21.15.72:0/137755853 wait complete. 2023-07-27T20:32:51.456 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data_ec' removed 2023-07-27T20:32:51.474 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-27T20:32:51.474 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-27T20:32:51.474 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-27T20:32:51.474 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T20:32:51.475 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-27T20:32:51.475 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-27T20:32:51.475 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-27T20:32:51.475 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T20:32:51.476 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-27T20:32:51.476 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-27T20:32:51.476 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-27T20:32:51.476 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T20:32:51.476 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-27T20:32:51.477 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-27T20:32:51.477 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-27T20:32:51.477 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T20:32:51.493 INFO:tasks.ceph.mds.b:Stopped 2023-07-27T20:32:51.493 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-27T20:32:51.494 INFO:tasks.ceph.mds.d:Stopped 2023-07-27T20:32:51.494 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-27T20:32:51.528 INFO:tasks.ceph.mds.a:Stopped 2023-07-27T20:32:51.528 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-27T20:32:51.529 INFO:tasks.ceph.mds.c:Stopped 2023-07-27T20:32:51.530 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-27T20:32:51.538 INFO:tasks.ceph.mds.b:Started 2023-07-27T20:32:51.538 DEBUG:teuthology.parallel:result is None 2023-07-27T20:32:51.540 INFO:tasks.ceph.mds.d:Started 2023-07-27T20:32:51.540 DEBUG:teuthology.parallel:result is None 2023-07-27T20:32:51.573 INFO:tasks.ceph.mds.a:Started 2023-07-27T20:32:51.573 DEBUG:teuthology.parallel:result is None 2023-07-27T20:32:51.576 INFO:tasks.ceph.mds.c:Started 2023-07-27T20:32:51.576 DEBUG:teuthology.parallel:result is None 2023-07-27T20:32:51.577 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-27T20:32:51.685 INFO:tasks.ceph.mds.b.smithi173.stdout:starting mds.b at 2023-07-27T20:32:51.686 INFO:tasks.ceph.mds.d.smithi173.stdout:starting mds.d at 2023-07-27T20:32:51.721 INFO:tasks.ceph.mds.a.smithi072.stdout:starting mds.a at 2023-07-27T20:32:51.722 INFO:tasks.ceph.mds.c.smithi072.stdout:starting mds.c at 2023-07-27T20:32:51.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.799+0000 7fd63a5ff700 1 Processor -- start 2023-07-27T20:32:51.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.799+0000 7fd63a5ff700 1 -- start start 2023-07-27T20:32:51.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.800+0000 7fd63a5ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd6340c1fb0 0x7fd634151520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:51.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.800+0000 7fd63a5ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd634070a30 con 0x7fd6340c6ea0 2023-07-27T20:32:51.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.800+0000 7fd63a5ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd634070700 con 0x7fd6340c3960 2023-07-27T20:32:51.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.800+0000 7fd63a5ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6340c3e80 con 0x7fd6340c1fb0 2023-07-27T20:32:51.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.800+0000 7fd633fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd6340c6ea0 0x7fd6340a9190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33610/0 (socket says 172.21.15.72:33610) 2023-07-27T20:32:51.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.800+0000 7fd633fff700 1 -- 172.21.15.72:0/2033238497 learned_addr learned my addr 172.21.15.72:0/2033238497 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:51.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.800+0000 7fd6337fe700 1 -- 172.21.15.72:0/2033238497 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1238896340 0 0) 0x7fd634070a30 con 0x7fd6340c6ea0 2023-07-27T20:32:51.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.800+0000 7fd638b9c700 1 --2- 172.21.15.72:0/2033238497 >> v2:172.21.15.173:3300/0 conn(0x7fd6340c1fb0 0x7fd634151520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:51.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.800+0000 7fd6337fe700 1 -- 172.21.15.72:0/2033238497 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6200035b0 con 0x7fd6340c6ea0 2023-07-27T20:32:51.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.801+0000 7fd6337fe700 1 -- 172.21.15.72:0/2033238497 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 954110787 0 0) 0x7fd6200035b0 con 0x7fd6340c6ea0 2023-07-27T20:32:51.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.801+0000 7fd6337fe700 1 -- 172.21.15.72:0/2033238497 >> v2:172.21.15.173:3300/0 conn(0x7fd6340c1fb0 msgr2=0x7fd634151520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:51.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.801+0000 7fd6337fe700 1 --2- 172.21.15.72:0/2033238497 >> v2:172.21.15.173:3300/0 conn(0x7fd6340c1fb0 0x7fd634151520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:51.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.801+0000 7fd6337fe700 1 -- 172.21.15.72:0/2033238497 >> v1:172.21.15.173:6789/0 conn(0x7fd6340c3960 legacy=0x7fd634150e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:51.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.801+0000 7fd6337fe700 1 -- 172.21.15.72:0/2033238497 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd634151a60 con 0x7fd6340c6ea0 2023-07-27T20:32:51.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.801+0000 7fd6337fe700 1 -- 172.21.15.72:0/2033238497 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7fd624001670 con 0x7fd6340c6ea0 2023-07-27T20:32:51.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.801+0000 7fd6337fe700 1 -- 172.21.15.72:0/2033238497 >> v1:172.21.15.72:6789/0 conn(0x7fd6340c6ea0 legacy=0x7fd6340a9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:51.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.801+0000 7fd6337fe700 1 --2- 172.21.15.72:0/2033238497 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd620003a00 0x7fd620003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:51.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.801+0000 7fd6337fe700 1 --2- 172.21.15.72:0/2033238497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd620004850 0x7fd620004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:51.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.801+0000 7fd6337fe700 1 --2- 172.21.15.72:0/2033238497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd620005210 0x7fd62000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:51.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.801+0000 7fd6337fe700 1 -- 172.21.15.72:0/2033238497 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6340c3e80 con 0x7fd620004850 2023-07-27T20:32:51.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.801+0000 7fd6337fe700 1 -- 172.21.15.72:0/2033238497 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62000c0c0 con 0x7fd620005210 2023-07-27T20:32:51.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.801+0000 7fd6337fe700 1 -- 172.21.15.72:0/2033238497 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd62000c280 con 0x7fd620003a00 2023-07-27T20:32:51.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.801+0000 7fd62bfff700 1 --2- 172.21.15.72:0/2033238497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd620004850 0x7fd620004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:51.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.801+0000 7fd633fff700 1 --2- 172.21.15.72:0/2033238497 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd620003a00 0x7fd620003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:51.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.801+0000 7fd638b9c700 1 --2- 172.21.15.72:0/2033238497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd620005210 0x7fd62000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:51.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.802+0000 7fd62bfff700 1 -- 172.21.15.72:0/2033238497 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd620003a00 msgr2=0x7fd620003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:51.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.802+0000 7fd62bfff700 1 --2- 172.21.15.72:0/2033238497 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd620003a00 0x7fd620003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:51.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.802+0000 7fd62bfff700 1 -- 172.21.15.72:0/2033238497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd620005210 msgr2=0x7fd62000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:51.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.802+0000 7fd62bfff700 1 --2- 172.21.15.72:0/2033238497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd620005210 0x7fd62000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:51.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.802+0000 7fd62bfff700 1 -- 172.21.15.72:0/2033238497 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6200035b0 con 0x7fd620004850 2023-07-27T20:32:51.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.802+0000 7fd638b9c700 1 --2- 172.21.15.72:0/2033238497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd620005210 0x7fd62000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:51.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.802+0000 7fd638b9c700 1 -- 172.21.15.72:0/2033238497 reap_dead start 2023-07-27T20:32:51.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.802+0000 7fd62bfff700 1 --2- 172.21.15.72:0/2033238497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd620004850 0x7fd620004cd0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd61c0017c0 tx=0x7fd620005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc236c1102b47da server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:51.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.802+0000 7fd6337fe700 1 -- 172.21.15.72:0/2033238497 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61c0052d0 con 0x7fd620004850 2023-07-27T20:32:51.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.802+0000 7fd6337fe700 1 -- 172.21.15.72:0/2033238497 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61c005430 con 0x7fd620004850 2023-07-27T20:32:51.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.802+0000 7fd6337fe700 1 -- 172.21.15.72:0/2033238497 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61c0038c0 con 0x7fd620004850 2023-07-27T20:32:51.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.803+0000 7fd63a5ff700 1 -- 172.21.15.72:0/2033238497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd620004850 msgr2=0x7fd620004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:51.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.803+0000 7fd63a5ff700 1 --2- 172.21.15.72:0/2033238497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd620004850 0x7fd620004cd0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd61c0017c0 tx=0x7fd620005880 comp rx=0 tx=0).stop 2023-07-27T20:32:51.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.803+0000 7fd63a5ff700 1 -- 172.21.15.72:0/2033238497 shutdown_connections 2023-07-27T20:32:51.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.803+0000 7fd63a5ff700 1 --2- 172.21.15.72:0/2033238497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd620004850 0x7fd620004cd0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:51.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.803+0000 7fd63a5ff700 1 -- 172.21.15.72:0/2033238497 >> 172.21.15.72:0/2033238497 conn(0x7fd63406a7c0 msgr2=0x7fd6340c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:51.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.803+0000 7fd63a5ff700 1 -- 172.21.15.72:0/2033238497 shutdown_connections 2023-07-27T20:32:51.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.803+0000 7fd63a5ff700 1 -- 172.21.15.72:0/2033238497 wait complete. 2023-07-27T20:32:51.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.804+0000 7fd63a5ff700 1 Processor -- start 2023-07-27T20:32:51.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.805+0000 7fd63a5ff700 1 -- start start 2023-07-27T20:32:51.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.805+0000 7fd63a5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd620004850 0x7fd6341e9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:51.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.805+0000 7fd63a5ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd634155390 0x7fd6340bfa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:51.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.806+0000 7fd63a5ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd6340ab1d0 0x7fd6341562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:51.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.806+0000 7fd63a5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6341ed470 con 0x7fd620004850 2023-07-27T20:32:51.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.806+0000 7fd63a5ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6341559f0 con 0x7fd634155390 2023-07-27T20:32:51.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.806+0000 7fd63a5ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd634157f60 con 0x7fd6340ab1d0 2023-07-27T20:32:51.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.806+0000 7fd633fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd620004850 0x7fd6341e9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:51.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.806+0000 7fd633fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd620004850 0x7fd6341e9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49832/0 (socket says 172.21.15.72:49832) 2023-07-27T20:32:51.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.806+0000 7fd633fff700 1 -- 172.21.15.72:0/721109648 learned_addr learned my addr 172.21.15.72:0/721109648 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:51.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.806+0000 7fd62bfff700 1 --2- 172.21.15.72:0/721109648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd634155390 0x7fd6340bfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:51.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.806+0000 7fd638b9c700 1 --2- 172.21.15.72:0/721109648 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd6340ab1d0 0x7fd6341562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:51.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.806+0000 7fd633fff700 1 -- 172.21.15.72:0/721109648 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd6340ab1d0 msgr2=0x7fd6341562f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:51.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.806+0000 7fd633fff700 1 --2- 172.21.15.72:0/721109648 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd6340ab1d0 0x7fd6341562f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:51.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.806+0000 7fd633fff700 1 -- 172.21.15.72:0/721109648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd634155390 msgr2=0x7fd6340bfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:51.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.806+0000 7fd633fff700 1 --2- 172.21.15.72:0/721109648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd634155390 0x7fd6340bfa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:51.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.806+0000 7fd633fff700 1 -- 172.21.15.72:0/721109648 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd634158240 con 0x7fd620004850 2023-07-27T20:32:51.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.806+0000 7fd633fff700 1 --2- 172.21.15.72:0/721109648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd620004850 0x7fd6341e9180 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd6240072c0 tx=0x7fd624007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:51.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.806+0000 7fd6317fa700 1 -- 172.21.15.72:0/721109648 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62400f850 con 0x7fd620004850 2023-07-27T20:32:51.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.807+0000 7fd6317fa700 1 -- 172.21.15.72:0/721109648 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62400f9f0 con 0x7fd620004850 2023-07-27T20:32:51.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.807+0000 7fd63a5ff700 1 -- 172.21.15.72:0/721109648 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6341ed100 con 0x7fd620004850 2023-07-27T20:32:51.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.807+0000 7fd6317fa700 1 -- 172.21.15.72:0/721109648 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62400fda0 con 0x7fd620004850 2023-07-27T20:32:51.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.807+0000 7fd63a5ff700 1 -- 172.21.15.72:0/721109648 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd634155e30 con 0x7fd620004850 2023-07-27T20:32:51.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.808+0000 7fd63a5ff700 1 -- 172.21.15.72:0/721109648 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd634156020 con 0x7fd620004850 2023-07-27T20:32:51.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.809+0000 7fd6317fa700 1 -- 172.21.15.72:0/721109648 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd62401d460 con 0x7fd620004850 2023-07-27T20:32:51.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.809+0000 7fd6317fa700 1 --2- 172.21.15.72:0/721109648 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd61406ace0 0x7fd61406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:51.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.810+0000 7fd6317fa700 1 -- 172.21.15.72:0/721109648 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fd624089310 con 0x7fd620004850 2023-07-27T20:32:51.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.810+0000 7fd62bfff700 1 --2- 172.21.15.72:0/721109648 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd61406ace0 0x7fd61406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:51.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.811+0000 7fd62bfff700 1 --2- 172.21.15.72:0/721109648 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd61406ace0 0x7fd61406d1a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd61c000c00 tx=0x7fd61c009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:51.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:51.814+0000 7fd6317fa700 1 -- 172.21.15.72:0/721109648 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd624054610 con 0x7fd620004850 2023-07-27T20:32:52.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.021+0000 7fd63a5ff700 1 -- 172.21.15.72:0/721109648 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd634074310 con 0x7fd620004850 2023-07-27T20:32:52.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.474+0000 7fd6317fa700 1 -- 172.21.15.72:0/721109648 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v35) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd624057c30 con 0x7fd620004850 2023-07-27T20:32:52.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.479+0000 7fd63a5ff700 1 -- 172.21.15.72:0/721109648 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd61406ace0 msgr2=0x7fd61406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:52.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.479+0000 7fd63a5ff700 1 --2- 172.21.15.72:0/721109648 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd61406ace0 0x7fd61406d1a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd61c000c00 tx=0x7fd61c009030 comp rx=0 tx=0).stop 2023-07-27T20:32:52.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.480+0000 7fd63a5ff700 1 -- 172.21.15.72:0/721109648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd620004850 msgr2=0x7fd6341e9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:52.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.480+0000 7fd63a5ff700 1 --2- 172.21.15.72:0/721109648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd620004850 0x7fd6341e9180 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd6240072c0 tx=0x7fd624007680 comp rx=0 tx=0).stop 2023-07-27T20:32:52.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.480+0000 7fd63a5ff700 1 -- 172.21.15.72:0/721109648 shutdown_connections 2023-07-27T20:32:52.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.480+0000 7fd63a5ff700 1 --2- 172.21.15.72:0/721109648 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd61406ace0 0x7fd61406d1a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:52.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.480+0000 7fd63a5ff700 1 --2- 172.21.15.72:0/721109648 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd6340ab1d0 0x7fd6341562f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:52.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.480+0000 7fd63a5ff700 1 --2- 172.21.15.72:0/721109648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd620004850 0x7fd6341e9180 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:52.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.480+0000 7fd63a5ff700 1 --2- 172.21.15.72:0/721109648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd634155390 0x7fd6340bfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:52.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.480+0000 7fd63a5ff700 1 -- 172.21.15.72:0/721109648 >> 172.21.15.72:0/721109648 conn(0x7fd63406a7c0 msgr2=0x7fd634152020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:52.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.481+0000 7fd63a5ff700 1 -- 172.21.15.72:0/721109648 shutdown_connections 2023-07-27T20:32:52.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.481+0000 7fd63a5ff700 1 -- 172.21.15.72:0/721109648 wait complete. 2023-07-27T20:32:52.472 INFO:teuthology.orchestra.run.smithi072.stderr: removed all blocklist entries 2023-07-27T20:32:52.492 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-27T20:32:52.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.699+0000 7f00d9bff700 1 Processor -- start 2023-07-27T20:32:52.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.699+0000 7f00d9bff700 1 -- start start 2023-07-27T20:32:52.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.700+0000 7f00d9bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f00d40c4400 0x7f00d40c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:52.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.701+0000 7f00d9bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00d41549f0 0x7f00d41514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:52.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.701+0000 7f00d9bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00d406b710 con 0x7f00d406b150 2023-07-27T20:32:52.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.701+0000 7f00d9bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00d41545d0 con 0x7f00d40c4400 2023-07-27T20:32:52.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.701+0000 7f00d9bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d406c860 con 0x7f00d41549f0 2023-07-27T20:32:52.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.701+0000 7f00d37fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f00d40c4400 0x7f00d40c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:52.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.701+0000 7f00d37fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f00d40c4400 0x7f00d40c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49838/0 (socket says 172.21.15.72:49838) 2023-07-27T20:32:52.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.701+0000 7f00d37fe700 1 -- 172.21.15.72:0/3007955553 learned_addr learned my addr 172.21.15.72:0/3007955553 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:52.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.701+0000 7f00d2ffd700 1 --1- 172.21.15.72:0/3007955553 >> v1:172.21.15.72:6789/0 conn(0x7f00d406b150 0x7f00d40c4cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33624/0 (socket says 172.21.15.72:33624) 2023-07-27T20:32:52.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.701+0000 7f00d3fff700 1 --2- 172.21.15.72:0/3007955553 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00d41549f0 0x7f00d41514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:52.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.701+0000 7f00d37fe700 1 -- 172.21.15.72:0/3007955553 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00d41549f0 msgr2=0x7f00d41514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:52.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.701+0000 7f00d37fe700 1 --2- 172.21.15.72:0/3007955553 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00d41549f0 0x7f00d41514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:52.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.701+0000 7f00d37fe700 1 -- 172.21.15.72:0/3007955553 >> v1:172.21.15.72:6789/0 conn(0x7f00d406b150 legacy=0x7f00d40c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:52.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.701+0000 7f00d37fe700 1 -- 172.21.15.72:0/3007955553 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d406b9f0 con 0x7f00d40c4400 2023-07-27T20:32:52.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.701+0000 7f00d27fc700 1 -- 172.21.15.72:0/3007955553 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1366016565 0 0) 0x7f00d406b710 con 0x7f00d406b150 2023-07-27T20:32:52.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.702+0000 7f00d37fe700 1 --2- 172.21.15.72:0/3007955553 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00d40c4400 0x7f00d40c7710 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f00c40098f0 tx=0x7f00c4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=275c49bb1a68acba server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:52.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.702+0000 7f00d27fc700 1 -- 172.21.15.72:0/3007955553 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c400b8a0 con 0x7f00d40c4400 2023-07-27T20:32:52.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.702+0000 7f00d27fc700 1 -- 172.21.15.72:0/3007955553 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c400ba00 con 0x7f00d40c4400 2023-07-27T20:32:52.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.702+0000 7f00d27fc700 1 -- 172.21.15.72:0/3007955553 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c400bd90 con 0x7f00d40c4400 2023-07-27T20:32:52.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.702+0000 7f00d9bff700 1 -- 172.21.15.72:0/3007955553 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00d40c4400 msgr2=0x7f00d40c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:52.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.702+0000 7f00d9bff700 1 --2- 172.21.15.72:0/3007955553 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00d40c4400 0x7f00d40c7710 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f00c40098f0 tx=0x7f00c4009c00 comp rx=0 tx=0).stop 2023-07-27T20:32:52.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.702+0000 7f00d9bff700 1 -- 172.21.15.72:0/3007955553 shutdown_connections 2023-07-27T20:32:52.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.702+0000 7f00d9bff700 1 --2- 172.21.15.72:0/3007955553 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00d41549f0 0x7f00d41514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:52.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.702+0000 7f00d9bff700 1 --2- 172.21.15.72:0/3007955553 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00d40c4400 0x7f00d40c7710 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:52.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.702+0000 7f00d9bff700 1 -- 172.21.15.72:0/3007955553 >> 172.21.15.72:0/3007955553 conn(0x7f00d40ab300 msgr2=0x7f00d40ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:52.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.702+0000 7f00d9bff700 1 -- 172.21.15.72:0/3007955553 shutdown_connections 2023-07-27T20:32:52.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.703+0000 7f00d9bff700 1 -- 172.21.15.72:0/3007955553 wait complete. 2023-07-27T20:32:52.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.704+0000 7f00d9bff700 1 Processor -- start 2023-07-27T20:32:52.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.704+0000 7f00d9bff700 1 -- start start 2023-07-27T20:32:52.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.705+0000 7f00d9bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00d406b150 0x7f00d40aa920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:52.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.705+0000 7f00d9bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00d40c4400 0x7f00d41ed710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:52.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.705+0000 7f00d9bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00d41549f0 0x7f00d40a9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:52.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.705+0000 7f00d9bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d41ea2b0 con 0x7f00d406b150 2023-07-27T20:32:52.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.705+0000 7f00d9bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d41edc50 con 0x7f00d40c4400 2023-07-27T20:32:52.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.705+0000 7f00d9bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d40ab020 con 0x7f00d41549f0 2023-07-27T20:32:52.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.705+0000 7f00d37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00d406b150 0x7f00d40aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:52.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.705+0000 7f00d37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00d406b150 0x7f00d40aa920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49842/0 (socket says 172.21.15.72:49842) 2023-07-27T20:32:52.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.705+0000 7f00d37fe700 1 -- 172.21.15.72:0/561982956 learned_addr learned my addr 172.21.15.72:0/561982956 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:52.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.705+0000 7f00d3fff700 1 --2- 172.21.15.72:0/561982956 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00d41549f0 0x7f00d40a9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:52.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.706+0000 7f00d2ffd700 1 --2- 172.21.15.72:0/561982956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00d40c4400 0x7f00d41ed710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:52.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.706+0000 7f00d37fe700 1 -- 172.21.15.72:0/561982956 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00d41549f0 msgr2=0x7f00d40a9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:52.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.706+0000 7f00d37fe700 1 --2- 172.21.15.72:0/561982956 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00d41549f0 0x7f00d40a9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:52.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.706+0000 7f00d37fe700 1 -- 172.21.15.72:0/561982956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00d40c4400 msgr2=0x7f00d41ed710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:52.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.706+0000 7f00d37fe700 1 --2- 172.21.15.72:0/561982956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00d40c4400 0x7f00d41ed710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:52.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.706+0000 7f00d37fe700 1 -- 172.21.15.72:0/561982956 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c4009550 con 0x7f00d406b150 2023-07-27T20:32:52.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.706+0000 7f00d37fe700 1 --2- 172.21.15.72:0/561982956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00d406b150 0x7f00d40aa920 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f00d40af980 tx=0x7f00c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:52.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.706+0000 7f00bbfff700 1 -- 172.21.15.72:0/561982956 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c4004380 con 0x7f00d406b150 2023-07-27T20:32:52.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.706+0000 7f00bbfff700 1 -- 172.21.15.72:0/561982956 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c401f070 con 0x7f00d406b150 2023-07-27T20:32:52.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.706+0000 7f00d9bff700 1 -- 172.21.15.72:0/561982956 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00d41ea6d0 con 0x7f00d406b150 2023-07-27T20:32:52.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.706+0000 7f00bbfff700 1 -- 172.21.15.72:0/561982956 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c40036a0 con 0x7f00d406b150 2023-07-27T20:32:52.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.706+0000 7f00d9bff700 1 -- 172.21.15.72:0/561982956 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d41e9bf0 con 0x7f00d406b150 2023-07-27T20:32:52.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.707+0000 7f00d9bff700 1 -- 172.21.15.72:0/561982956 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00d4074310 con 0x7f00d406b150 2023-07-27T20:32:52.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.708+0000 7f00bbfff700 1 -- 172.21.15.72:0/561982956 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f00c4021030 con 0x7f00d406b150 2023-07-27T20:32:52.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.709+0000 7f00bbfff700 1 --2- 172.21.15.72:0/561982956 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f00c006ace0 0x7f00c006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:52.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.709+0000 7f00bbfff700 1 -- 172.21.15.72:0/561982956 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f00c408a690 con 0x7f00d406b150 2023-07-27T20:32:52.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.709+0000 7f00d2ffd700 1 --2- 172.21.15.72:0/561982956 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f00c006ace0 0x7f00c006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:52.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.710+0000 7f00d2ffd700 1 --2- 172.21.15.72:0/561982956 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f00c006ace0 0x7f00c006d1a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f00d414ecc0 tx=0x7f00c8007be0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:52.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.713+0000 7f00bbfff700 1 -- 172.21.15.72:0/561982956 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f00c4055940 con 0x7f00d406b150 2023-07-27T20:32:52.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.981+0000 7f00d9bff700 1 -- 172.21.15.72:0/561982956 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f00d40c8a90 con 0x7f00d406b150 2023-07-27T20:32:52.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.981+0000 7f00bbfff700 1 -- 172.21.15.72:0/561982956 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6065 (secure 0 0 0) 0x7f00c4006d80 con 0x7f00d406b150 2023-07-27T20:32:52.970 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:32:52.970 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-07-27T20:32:52.970 INFO:teuthology.orchestra.run.smithi072.stdout: "auth_dump": [ 2023-07-27T20:32:52.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:32:52.971 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.a", 2023-07-27T20:32:52.971 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDg08Jk8ukYGhAA6bynYjjz+XXymZB7RuOqyg==", 2023-07-27T20:32:52.971 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:32:52.972 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-07-27T20:32:52.972 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-07-27T20:32:52.972 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-07-27T20:32:52.972 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-27T20:32:52.972 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:32:52.972 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:32:52.972 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:32:52.973 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.b", 2023-07-27T20:32:52.973 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDg08Jkowl/MRAAmGDdjr/lGUKHkBQLMdkEzA==", 2023-07-27T20:32:52.973 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:32:52.973 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-07-27T20:32:52.973 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-07-27T20:32:52.973 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-07-27T20:32:52.974 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-27T20:32:52.974 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:32:52.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:32:52.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:32:52.974 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.c", 2023-07-27T20:32:52.974 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDg08JkuNrEJRAAk6SZNv+AQw7s4J3iOVhErQ==", 2023-07-27T20:32:52.974 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:32:52.974 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-07-27T20:32:52.975 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-07-27T20:32:52.975 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-07-27T20:32:52.975 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-27T20:32:52.976 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:32:52.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:32:52.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:32:52.976 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.d", 2023-07-27T20:32:52.977 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDh08JkfJacARAAX7dowIhLgEsRPraoAJsqMw==", 2023-07-27T20:32:52.977 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:32:52.977 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-07-27T20:32:52.977 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-07-27T20:32:52.978 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-07-27T20:32:52.978 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-27T20:32:52.978 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:32:52.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:32:52.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:32:52.979 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.0", 2023-07-27T20:32:52.979 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDk08Jk8A5ELxAADkFtWQLUf7i2O+HUYDD6dA==", 2023-07-27T20:32:52.980 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:32:52.980 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-07-27T20:32:52.980 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-07-27T20:32:52.980 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-27T20:32:52.981 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:32:52.981 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:32:52.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:32:52.981 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.1", 2023-07-27T20:32:52.982 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDn08JkNU47MxAAwT5ryQLH8wuYMZhnm1CgRw==", 2023-07-27T20:32:52.982 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:32:52.982 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-07-27T20:32:52.982 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-07-27T20:32:52.983 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-27T20:32:52.983 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:32:52.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:32:52.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:32:52.984 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.2", 2023-07-27T20:32:52.984 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDq08JkaR9TNxAAYeAjHwr/HXuVstPh8+nXWw==", 2023-07-27T20:32:52.984 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:32:52.984 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-07-27T20:32:52.985 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-07-27T20:32:52.985 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-27T20:32:52.985 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:32:52.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:32:52.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:32:52.986 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.3", 2023-07-27T20:32:52.986 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDt08JkLWcVOxAAq9DWPQe8RBPGfq2rLl2e/A==", 2023-07-27T20:32:52.986 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:32:52.987 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-07-27T20:32:52.987 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-07-27T20:32:52.987 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-27T20:32:52.988 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:32:52.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:32:52.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:32:52.988 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.4", 2023-07-27T20:32:52.989 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQD008JkwcxvFhAA7qmRzaoSSEBgafwXN4Vnyw==", 2023-07-27T20:32:52.989 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:32:52.989 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-07-27T20:32:52.989 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-07-27T20:32:52.990 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-27T20:32:52.990 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:32:52.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:32:52.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:32:52.991 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.5", 2023-07-27T20:32:52.991 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQD308JkBB9tGhAAq2gNYDg2awDX4BvmWZuMVg==", 2023-07-27T20:32:52.991 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:32:52.992 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-07-27T20:32:52.992 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-07-27T20:32:52.992 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-27T20:32:52.992 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:32:52.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:32:52.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:32:52.993 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.6", 2023-07-27T20:32:52.993 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQD608Jk3FFCHhAA1EWhQfgPRpxC6U+CrjPENw==", 2023-07-27T20:32:52.994 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:32:52.994 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-07-27T20:32:52.994 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-07-27T20:32:52.994 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-27T20:32:52.995 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:32:52.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:32:52.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:32:52.995 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.7", 2023-07-27T20:32:52.996 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQD908Jk1atrIhAATt3nvk2zvQZSWDbuOcxsqg==", 2023-07-27T20:32:52.996 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:32:52.996 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-07-27T20:32:52.997 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-07-27T20:32:52.997 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-27T20:32:52.997 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:32:52.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:32:52.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:32:52.998 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.0", 2023-07-27T20:32:52.998 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDh08Jk6SgHDBAAkcBvssFv+WViV/ToWsnLCA==", 2023-07-27T20:32:52.998 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:32:52.999 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-07-27T20:32:52.999 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-07-27T20:32:52.999 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-07-27T20:32:52.999 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-07-27T20:32:53.000 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:32:53.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:32:53.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:32:53.001 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.1", 2023-07-27T20:32:53.001 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDh08JktvSlExAAay3fDYh/8Ju3iIWOXW8wmw==", 2023-07-27T20:32:53.001 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:32:53.001 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-07-27T20:32:53.002 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-07-27T20:32:53.002 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-07-27T20:32:53.002 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-07-27T20:32:53.002 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:32:53.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:32:53.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:32:53.003 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.admin", 2023-07-27T20:32:53.004 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDf08JkSMm7HhAAmZ9hevJ7imP5zGk+/q6UCg==", 2023-07-27T20:32:53.004 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:32:53.004 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-07-27T20:32:53.004 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-07-27T20:32:53.005 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-07-27T20:32:53.005 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-27T20:32:53.005 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:32:53.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:32:53.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:32:53.006 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-mds", 2023-07-27T20:32:53.006 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAF1MJkwfaZDhAA6IhpkBIoAjOFZYpzsyTYrA==", 2023-07-27T20:32:53.006 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:32:53.006 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-mds" 2023-07-27T20:32:53.006 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:32:53.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:32:53.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:32:53.007 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-mgr", 2023-07-27T20:32:53.007 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAF1MJkXQGaDhAAjRpLXgDe7twIx/N6KnW95Q==", 2023-07-27T20:32:53.007 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:32:53.007 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-mgr" 2023-07-27T20:32:53.007 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:32:53.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:32:53.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:32:53.008 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-osd", 2023-07-27T20:32:53.008 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAF1MJkIAqaDhAA9f93gw9hgVCB7+yVr7TI7Q==", 2023-07-27T20:32:53.008 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:32:53.008 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-osd" 2023-07-27T20:32:53.008 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:32:53.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:32:53.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:32:53.009 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-rbd", 2023-07-27T20:32:53.010 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAF1MJkmBKaDhAAEBVW+KFcEaTfAEdqwQ9j8w==", 2023-07-27T20:32:53.010 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:32:53.010 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-rbd" 2023-07-27T20:32:53.010 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:32:53.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:32:53.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:32:53.011 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-07-27T20:32:53.012 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAF1MJkQhuaDhAA6g2iW6EcMiw+XTksc16Qsw==", 2023-07-27T20:32:53.012 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:32:53.012 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-07-27T20:32:53.013 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:32:53.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:32:53.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:32:53.013 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-rgw", 2023-07-27T20:32:53.014 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAF1MJkiCWaDhAAX16hSvX7FnUHUMJiRJBtug==", 2023-07-27T20:32:53.014 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:32:53.014 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-rgw" 2023-07-27T20:32:53.015 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:32:53.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:32:53.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:32:53.015 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mgr.x", 2023-07-27T20:32:53.016 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDg08JkkKdiEhAAZL2azzLKEawlPleOomXeAw==", 2023-07-27T20:32:53.016 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:32:53.016 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-07-27T20:32:53.016 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile mgr", 2023-07-27T20:32:53.016 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-27T20:32:53.017 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:32:53.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:32:53.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:32:53.018 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mgr.y", 2023-07-27T20:32:53.018 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDg08Jk66J/ChAAHpdL/KV5FPIhwbDRhkyT8A==", 2023-07-27T20:32:53.018 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:32:53.018 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-07-27T20:32:53.018 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile mgr", 2023-07-27T20:32:53.018 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-27T20:32:53.019 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:32:53.019 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:32:53.019 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-07-27T20:32:53.019 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-07-27T20:32:53.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.984+0000 7f00d9bff700 1 -- 172.21.15.72:0/561982956 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f00c006ace0 msgr2=0x7f00c006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:53.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.984+0000 7f00d9bff700 1 --2- 172.21.15.72:0/561982956 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f00c006ace0 0x7f00c006d1a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f00d414ecc0 tx=0x7f00c8007be0 comp rx=0 tx=0).stop 2023-07-27T20:32:53.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.984+0000 7f00d9bff700 1 -- 172.21.15.72:0/561982956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00d406b150 msgr2=0x7f00d40aa920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:53.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.984+0000 7f00d9bff700 1 --2- 172.21.15.72:0/561982956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00d406b150 0x7f00d40aa920 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f00d40af980 tx=0x7f00c4004750 comp rx=0 tx=0).stop 2023-07-27T20:32:53.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.984+0000 7f00d9bff700 1 -- 172.21.15.72:0/561982956 shutdown_connections 2023-07-27T20:32:53.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.984+0000 7f00d9bff700 1 --2- 172.21.15.72:0/561982956 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f00c006ace0 0x7f00c006d1a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:53.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.984+0000 7f00d9bff700 1 --2- 172.21.15.72:0/561982956 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00d41549f0 0x7f00d40a9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:53.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.984+0000 7f00d9bff700 1 --2- 172.21.15.72:0/561982956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00d406b150 0x7f00d40aa920 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:53.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.984+0000 7f00d9bff700 1 --2- 172.21.15.72:0/561982956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00d40c4400 0x7f00d41ed710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:53.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.984+0000 7f00d9bff700 1 -- 172.21.15.72:0/561982956 >> 172.21.15.72:0/561982956 conn(0x7f00d40ab300 msgr2=0x7f00d414b060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:53.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.984+0000 7f00d9bff700 1 -- 172.21.15.72:0/561982956 shutdown_connections 2023-07-27T20:32:53.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:52.984+0000 7f00d9bff700 1 -- 172.21.15.72:0/561982956 wait complete. 2023-07-27T20:32:53.023 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-07-27T20:32:53.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.231+0000 7fc5cf1ff700 1 Processor -- start 2023-07-27T20:32:53.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.231+0000 7fc5cf1ff700 1 -- start start 2023-07-27T20:32:53.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.232+0000 7fc5cf1ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc5c80c4400 0x7fc5c80c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:53.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.232+0000 7fc5cf1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc5c806b150 0x7fc5c80c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:53.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.232+0000 7fc5cf1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5c80c5230 con 0x7fc5c81549f0 2023-07-27T20:32:53.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.232+0000 7fc5cf1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5c81545d0 con 0x7fc5c806b150 2023-07-27T20:32:53.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.232+0000 7fc5cf1ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5c806c860 con 0x7fc5c80c4400 2023-07-27T20:32:53.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.232+0000 7fc5c7fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc5c806b150 0x7fc5c80c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:53.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.233+0000 7fc5cd79c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc5c81549f0 0x7fc5c81514a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33638/0 (socket says 172.21.15.72:33638) 2023-07-27T20:32:53.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.233+0000 7fc5cd79c700 1 -- 172.21.15.72:0/2274467810 learned_addr learned my addr 172.21.15.72:0/2274467810 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:53.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.233+0000 7fc5ccf9b700 1 --2- 172.21.15.72:0/2274467810 >> v2:172.21.15.173:3300/0 conn(0x7fc5c80c4400 0x7fc5c80c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:53.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.233+0000 7fc5c7fff700 1 -- 172.21.15.72:0/2274467810 >> v2:172.21.15.173:3300/0 conn(0x7fc5c80c4400 msgr2=0x7fc5c80c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:53.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.233+0000 7fc5c7fff700 1 --2- 172.21.15.72:0/2274467810 >> v2:172.21.15.173:3300/0 conn(0x7fc5c80c4400 0x7fc5c80c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:53.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.233+0000 7fc5c7fff700 1 -- 172.21.15.72:0/2274467810 >> v1:172.21.15.72:6789/0 conn(0x7fc5c81549f0 legacy=0x7fc5c81514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:53.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.233+0000 7fc5c7fff700 1 -- 172.21.15.72:0/2274467810 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c806b710 con 0x7fc5c806b150 2023-07-27T20:32:53.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.233+0000 7fc5c77fe700 1 -- 172.21.15.72:0/2274467810 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3274046128 0 0) 0x7fc5c80c5230 con 0x7fc5c81549f0 2023-07-27T20:32:53.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.233+0000 7fc5c7fff700 1 --2- 172.21.15.72:0/2274467810 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5c806b150 0x7fc5c80c4cf0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc5c808b040 tx=0x7fc5b4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bcad14651b9fd3a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:53.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.233+0000 7fc5c77fe700 1 -- 172.21.15.72:0/2274467810 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4011830 con 0x7fc5c806b150 2023-07-27T20:32:53.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.234+0000 7fc5c77fe700 1 -- 172.21.15.72:0/2274467810 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b4011990 con 0x7fc5c806b150 2023-07-27T20:32:53.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.234+0000 7fc5c77fe700 1 -- 172.21.15.72:0/2274467810 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4011d20 con 0x7fc5c806b150 2023-07-27T20:32:53.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.234+0000 7fc5cf1ff700 1 -- 172.21.15.72:0/2274467810 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5c806b150 msgr2=0x7fc5c80c4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:53.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.234+0000 7fc5cf1ff700 1 --2- 172.21.15.72:0/2274467810 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5c806b150 0x7fc5c80c4cf0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc5c808b040 tx=0x7fc5b4009b20 comp rx=0 tx=0).stop 2023-07-27T20:32:53.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.234+0000 7fc5cf1ff700 1 -- 172.21.15.72:0/2274467810 shutdown_connections 2023-07-27T20:32:53.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.234+0000 7fc5cf1ff700 1 --2- 172.21.15.72:0/2274467810 >> v2:172.21.15.173:3300/0 conn(0x7fc5c80c4400 0x7fc5c80c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:53.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.234+0000 7fc5cf1ff700 1 --2- 172.21.15.72:0/2274467810 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5c806b150 0x7fc5c80c4cf0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:53.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.234+0000 7fc5cf1ff700 1 -- 172.21.15.72:0/2274467810 >> 172.21.15.72:0/2274467810 conn(0x7fc5c80ab300 msgr2=0x7fc5c80ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:53.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.234+0000 7fc5cf1ff700 1 -- 172.21.15.72:0/2274467810 shutdown_connections 2023-07-27T20:32:53.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.234+0000 7fc5cf1ff700 1 -- 172.21.15.72:0/2274467810 wait complete. 2023-07-27T20:32:53.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.236+0000 7fc5cf1ff700 1 Processor -- start 2023-07-27T20:32:53.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.236+0000 7fc5cf1ff700 1 -- start start 2023-07-27T20:32:53.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.237+0000 7fc5cf1ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5c806b150 0x7fc5c8147be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:53.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.237+0000 7fc5cf1ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc5c80c4400 0x7fc5c80c33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:53.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.237+0000 7fc5cf1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5c81549f0 0x7fc5c8151270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:53.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.237+0000 7fc5cf1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c81ecbe0 con 0x7fc5c81549f0 2023-07-27T20:32:53.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.237+0000 7fc5cf1ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c814ebb0 con 0x7fc5c806b150 2023-07-27T20:32:53.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.237+0000 7fc5cf1ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c81e9b70 con 0x7fc5c80c4400 2023-07-27T20:32:53.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.237+0000 7fc5cd79c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5c81549f0 0x7fc5c8151270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:53.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.237+0000 7fc5cd79c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5c81549f0 0x7fc5c8151270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49854/0 (socket says 172.21.15.72:49854) 2023-07-27T20:32:53.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.237+0000 7fc5cd79c700 1 -- 172.21.15.72:0/2379507161 learned_addr learned my addr 172.21.15.72:0/2379507161 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:53.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.237+0000 7fc5ccf9b700 1 --2- 172.21.15.72:0/2379507161 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5c806b150 0x7fc5c8147be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:53.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.237+0000 7fc5c7fff700 1 --2- 172.21.15.72:0/2379507161 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc5c80c4400 0x7fc5c80c33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:53.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.238+0000 7fc5cd79c700 1 -- 172.21.15.72:0/2379507161 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc5c80c4400 msgr2=0x7fc5c80c33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:53.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.238+0000 7fc5cd79c700 1 --2- 172.21.15.72:0/2379507161 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc5c80c4400 0x7fc5c80c33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:53.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.238+0000 7fc5cd79c700 1 -- 172.21.15.72:0/2379507161 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5c806b150 msgr2=0x7fc5c8147be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:53.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.238+0000 7fc5cd79c700 1 --2- 172.21.15.72:0/2379507161 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5c806b150 0x7fc5c8147be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:53.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.238+0000 7fc5cd79c700 1 -- 172.21.15.72:0/2379507161 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b40094a0 con 0x7fc5c81549f0 2023-07-27T20:32:53.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.238+0000 7fc5cd79c700 1 --2- 172.21.15.72:0/2379507161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5c81549f0 0x7fc5c8151270 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0002230 tx=0x7fc5c000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:53.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.238+0000 7fc5c57fa700 1 -- 172.21.15.72:0/2379507161 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c000ab70 con 0x7fc5c81549f0 2023-07-27T20:32:53.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.238+0000 7fc5c57fa700 1 -- 172.21.15.72:0/2379507161 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c000acf0 con 0x7fc5c81549f0 2023-07-27T20:32:53.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.238+0000 7fc5cf1ff700 1 -- 172.21.15.72:0/2379507161 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5c81e9e50 con 0x7fc5c81549f0 2023-07-27T20:32:53.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.238+0000 7fc5c57fa700 1 -- 172.21.15.72:0/2379507161 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0007310 con 0x7fc5c81549f0 2023-07-27T20:32:53.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.238+0000 7fc5cf1ff700 1 -- 172.21.15.72:0/2379507161 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c81ea410 con 0x7fc5c81549f0 2023-07-27T20:32:53.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.239+0000 7fc5cf1ff700 1 -- 172.21.15.72:0/2379507161 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5c8148180 con 0x7fc5c81549f0 2023-07-27T20:32:53.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.240+0000 7fc5c57fa700 1 -- 172.21.15.72:0/2379507161 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc5c0007470 con 0x7fc5c81549f0 2023-07-27T20:32:53.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.241+0000 7fc5c57fa700 1 --2- 172.21.15.72:0/2379507161 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc5ac06ace0 0x7fc5ac06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:53.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.241+0000 7fc5c57fa700 1 -- 172.21.15.72:0/2379507161 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fc5c00890e0 con 0x7fc5c81549f0 2023-07-27T20:32:53.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.242+0000 7fc5ccf9b700 1 --2- 172.21.15.72:0/2379507161 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc5ac06ace0 0x7fc5ac06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:53.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.242+0000 7fc5ccf9b700 1 --2- 172.21.15.72:0/2379507161 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc5ac06ace0 0x7fc5ac06d1a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc5c80af450 tx=0x7fc5bc009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:53.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.245+0000 7fc5c57fa700 1 -- 172.21.15.72:0/2379507161 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc5c0054390 con 0x7fc5c81549f0 2023-07-27T20:32:53.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.518+0000 7fc5cf1ff700 1 -- 172.21.15.72:0/2379507161 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fc5c8074310 con 0x7fc5c81549f0 2023-07-27T20:32:53.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.521+0000 7fc5c57fa700 1 -- 172.21.15.72:0/2379507161 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc5c000ae60 con 0x7fc5c81549f0 2023-07-27T20:32:53.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.524+0000 7fc5cf1ff700 1 -- 172.21.15.72:0/2379507161 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc5ac06ace0 msgr2=0x7fc5ac06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:53.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.524+0000 7fc5cf1ff700 1 --2- 172.21.15.72:0/2379507161 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc5ac06ace0 0x7fc5ac06d1a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc5c80af450 tx=0x7fc5bc009210 comp rx=0 tx=0).stop 2023-07-27T20:32:53.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.524+0000 7fc5cf1ff700 1 -- 172.21.15.72:0/2379507161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5c81549f0 msgr2=0x7fc5c8151270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:53.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.524+0000 7fc5cf1ff700 1 --2- 172.21.15.72:0/2379507161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5c81549f0 0x7fc5c8151270 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0002230 tx=0x7fc5c000cf50 comp rx=0 tx=0).stop 2023-07-27T20:32:53.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.524+0000 7fc5cf1ff700 1 -- 172.21.15.72:0/2379507161 shutdown_connections 2023-07-27T20:32:53.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.524+0000 7fc5cf1ff700 1 --2- 172.21.15.72:0/2379507161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5c81549f0 0x7fc5c8151270 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:53.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.524+0000 7fc5cf1ff700 1 --2- 172.21.15.72:0/2379507161 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5c806b150 0x7fc5c8147be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:53.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.524+0000 7fc5cf1ff700 1 --2- 172.21.15.72:0/2379507161 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc5ac06ace0 0x7fc5ac06d1a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:53.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.524+0000 7fc5cf1ff700 1 --2- 172.21.15.72:0/2379507161 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc5c80c4400 0x7fc5c80c33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:53.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.524+0000 7fc5cf1ff700 1 -- 172.21.15.72:0/2379507161 >> 172.21.15.72:0/2379507161 conn(0x7fc5c80ab300 msgr2=0x7fc5c8150920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:53.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.524+0000 7fc5cf1ff700 1 -- 172.21.15.72:0/2379507161 shutdown_connections 2023-07-27T20:32:53.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.524+0000 7fc5cf1ff700 1 -- 172.21.15.72:0/2379507161 wait complete. 2023-07-27T20:32:53.530 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-07-27T20:32:53.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.738+0000 7f63e6fff700 1 Processor -- start 2023-07-27T20:32:53.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.738+0000 7f63e6fff700 1 -- start start 2023-07-27T20:32:53.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.739+0000 7f63e6fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63e006da80 0x7f63e01549e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:53.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.739+0000 7f63e6fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f63e0071720 0x7f63e0071b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:53.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.739+0000 7f63e6fff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63e013d610 con 0x7f63e013d230 2023-07-27T20:32:53.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.739+0000 7f63e6fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e0154f20 con 0x7f63e0071720 2023-07-27T20:32:53.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.739+0000 7f63e6fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e0157550 con 0x7f63e006da80 2023-07-27T20:32:53.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.739+0000 7f63e559c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f63e0071720 0x7f63e0071b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:53.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.739+0000 7f63e559c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f63e0071720 0x7f63e0071b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49856/0 (socket says 172.21.15.72:49856) 2023-07-27T20:32:53.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.739+0000 7f63e559c700 1 -- 172.21.15.72:0/891571326 learned_addr learned my addr 172.21.15.72:0/891571326 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:53.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.740+0000 7f63dffff700 1 --2- 172.21.15.72:0/891571326 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63e006da80 0x7f63e01549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:53.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.740+0000 7f63e559c700 1 -- 172.21.15.72:0/891571326 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63e006da80 msgr2=0x7f63e01549e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:53.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.740+0000 7f63e559c700 1 --2- 172.21.15.72:0/891571326 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63e006da80 0x7f63e01549e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:53.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.740+0000 7f63e559c700 1 -- 172.21.15.72:0/891571326 >> v1:172.21.15.173:6789/0 conn(0x7f63e013d230 legacy=0x7f63e00c1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:53.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.740+0000 7f63e559c700 1 -- 172.21.15.72:0/891571326 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e0157830 con 0x7f63e0071720 2023-07-27T20:32:53.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.740+0000 7f63e559c700 1 --2- 172.21.15.72:0/891571326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63e0071720 0x7f63e0071b90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f63d8009e50 tx=0x7f63d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d60b5f3cb1092aae server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:53.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.740+0000 7f63df7fe700 1 -- 172.21.15.72:0/891571326 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d800e070 con 0x7f63e0071720 2023-07-27T20:32:53.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.740+0000 7f63df7fe700 1 -- 172.21.15.72:0/891571326 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d800b910 con 0x7f63e0071720 2023-07-27T20:32:53.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.740+0000 7f63df7fe700 1 -- 172.21.15.72:0/891571326 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d800bcc0 con 0x7f63e0071720 2023-07-27T20:32:53.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.741+0000 7f63e6fff700 1 -- 172.21.15.72:0/891571326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63e0071720 msgr2=0x7f63e0071b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:53.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.741+0000 7f63e6fff700 1 --2- 172.21.15.72:0/891571326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63e0071720 0x7f63e0071b90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f63d8009e50 tx=0x7f63d800b330 comp rx=0 tx=0).stop 2023-07-27T20:32:53.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.741+0000 7f63e6fff700 1 -- 172.21.15.72:0/891571326 shutdown_connections 2023-07-27T20:32:53.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.741+0000 7f63e6fff700 1 --2- 172.21.15.72:0/891571326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63e0071720 0x7f63e0071b90 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:53.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.741+0000 7f63e6fff700 1 --2- 172.21.15.72:0/891571326 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63e006da80 0x7f63e01549e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:53.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.741+0000 7f63e6fff700 1 -- 172.21.15.72:0/891571326 >> 172.21.15.72:0/891571326 conn(0x7f63e006a190 msgr2=0x7f63e006a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:53.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.741+0000 7f63e6fff700 1 -- 172.21.15.72:0/891571326 shutdown_connections 2023-07-27T20:32:53.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.741+0000 7f63e6fff700 1 -- 172.21.15.72:0/891571326 wait complete. 2023-07-27T20:32:53.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.743+0000 7f63e6fff700 1 Processor -- start 2023-07-27T20:32:53.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.743+0000 7f63e6fff700 1 -- start start 2023-07-27T20:32:53.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.745+0000 7f63e6fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63e006da80 0x7f63e00c0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:53.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.745+0000 7f63e6fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63e0071720 0x7f63e0150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:53.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.745+0000 7f63e6fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63e013d230 0x7f63e01513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:53.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.745+0000 7f63e6fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e00c3360 con 0x7f63e0071720 2023-07-27T20:32:53.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.745+0000 7f63e6fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e00c3530 con 0x7f63e006da80 2023-07-27T20:32:53.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.745+0000 7f63e6fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e00a9dd0 con 0x7f63e013d230 2023-07-27T20:32:53.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.745+0000 7f63dffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63e0071720 0x7f63e0150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:53.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.745+0000 7f63dffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63e0071720 0x7f63e0150e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49864/0 (socket says 172.21.15.72:49864) 2023-07-27T20:32:53.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.745+0000 7f63dffff700 1 -- 172.21.15.72:0/2829129232 learned_addr learned my addr 172.21.15.72:0/2829129232 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:53.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.745+0000 7f63e559c700 1 --2- 172.21.15.72:0/2829129232 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63e013d230 0x7f63e01513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:53.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.745+0000 7f63e4d9b700 1 --2- 172.21.15.72:0/2829129232 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63e006da80 0x7f63e00c0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:53.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.745+0000 7f63dffff700 1 -- 172.21.15.72:0/2829129232 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63e013d230 msgr2=0x7f63e01513a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:53.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.745+0000 7f63dffff700 1 --2- 172.21.15.72:0/2829129232 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63e013d230 0x7f63e01513a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:53.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.745+0000 7f63dffff700 1 -- 172.21.15.72:0/2829129232 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63e006da80 msgr2=0x7f63e00c0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:53.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.745+0000 7f63dffff700 1 --2- 172.21.15.72:0/2829129232 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63e006da80 0x7f63e00c0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:53.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.745+0000 7f63dffff700 1 -- 172.21.15.72:0/2829129232 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d8009b30 con 0x7f63e0071720 2023-07-27T20:32:53.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.745+0000 7f63dffff700 1 --2- 172.21.15.72:0/2829129232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63e0071720 0x7f63e0150e60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f63cc00e9b0 tx=0x7f63cc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:53.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.746+0000 7f63dd7fa700 1 -- 172.21.15.72:0/2829129232 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc009710 con 0x7f63e0071720 2023-07-27T20:32:53.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.746+0000 7f63dd7fa700 1 -- 172.21.15.72:0/2829129232 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63cc00c850 con 0x7f63e0071720 2023-07-27T20:32:53.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.746+0000 7f63e6fff700 1 -- 172.21.15.72:0/2829129232 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e00aa070 con 0x7f63e0071720 2023-07-27T20:32:53.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.746+0000 7f63dd7fa700 1 -- 172.21.15.72:0/2829129232 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc00cbc0 con 0x7f63e0071720 2023-07-27T20:32:53.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.746+0000 7f63e6fff700 1 -- 172.21.15.72:0/2829129232 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e00a9a20 con 0x7f63e0071720 2023-07-27T20:32:53.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.747+0000 7f63e6fff700 1 -- 172.21.15.72:0/2829129232 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63e00a9880 con 0x7f63e0071720 2023-07-27T20:32:53.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.748+0000 7f63dd7fa700 1 -- 172.21.15.72:0/2829129232 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f63cc00cd20 con 0x7f63e0071720 2023-07-27T20:32:53.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.749+0000 7f63dd7fa700 1 --2- 172.21.15.72:0/2829129232 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f63c406ace0 0x7f63c406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:53.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.749+0000 7f63dd7fa700 1 -- 172.21.15.72:0/2829129232 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f63cc089480 con 0x7f63e0071720 2023-07-27T20:32:53.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.749+0000 7f63e4d9b700 1 --2- 172.21.15.72:0/2829129232 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f63c406ace0 0x7f63c406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:53.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.750+0000 7f63e4d9b700 1 --2- 172.21.15.72:0/2829129232 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f63c406ace0 0x7f63c406d1a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f63d4000f60 tx=0x7f63d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:53.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:53.753+0000 7f63dd7fa700 1 -- 172.21.15.72:0/2829129232 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f63e00a9880 con 0x7f63e0071720 2023-07-27T20:32:54.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.024+0000 7f63e6fff700 1 -- 172.21.15.72:0/2829129232 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f63e00a9880 con 0x7f63e0071720 2023-07-27T20:32:54.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.028+0000 7f63dd7fa700 1 -- 172.21.15.72:0/2829129232 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f63e00a9880 con 0x7f63e0071720 2023-07-27T20:32:54.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.030+0000 7f63e6fff700 1 -- 172.21.15.72:0/2829129232 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f63c406ace0 msgr2=0x7f63c406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:54.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.030+0000 7f63e6fff700 1 --2- 172.21.15.72:0/2829129232 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f63c406ace0 0x7f63c406d1a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f63d4000f60 tx=0x7f63d4009040 comp rx=0 tx=0).stop 2023-07-27T20:32:54.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.030+0000 7f63e6fff700 1 -- 172.21.15.72:0/2829129232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63e0071720 msgr2=0x7f63e0150e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:54.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.030+0000 7f63e6fff700 1 --2- 172.21.15.72:0/2829129232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63e0071720 0x7f63e0150e60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f63cc00e9b0 tx=0x7f63cc00ed70 comp rx=0 tx=0).stop 2023-07-27T20:32:54.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.031+0000 7f63e6fff700 1 -- 172.21.15.72:0/2829129232 shutdown_connections 2023-07-27T20:32:54.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.031+0000 7f63e6fff700 1 --2- 172.21.15.72:0/2829129232 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f63c406ace0 0x7f63c406d1a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:54.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.031+0000 7f63e6fff700 1 --2- 172.21.15.72:0/2829129232 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63e013d230 0x7f63e01513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:54.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.031+0000 7f63e6fff700 1 --2- 172.21.15.72:0/2829129232 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63e006da80 0x7f63e00c0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:54.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.031+0000 7f63e6fff700 1 --2- 172.21.15.72:0/2829129232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63e0071720 0x7f63e0150e60 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:54.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.031+0000 7f63e6fff700 1 -- 172.21.15.72:0/2829129232 >> 172.21.15.72:0/2829129232 conn(0x7f63e006a190 msgr2=0x7f63e0139e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:54.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.031+0000 7f63e6fff700 1 -- 172.21.15.72:0/2829129232 shutdown_connections 2023-07-27T20:32:54.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.031+0000 7f63e6fff700 1 -- 172.21.15.72:0/2829129232 wait complete. 2023-07-27T20:32:54.037 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-07-27T20:32:54.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.246+0000 7f108c5ff700 1 Processor -- start 2023-07-27T20:32:54.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.246+0000 7f108c5ff700 1 -- start start 2023-07-27T20:32:54.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.247+0000 7f108c5ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f10840c1930 0x7f10840aad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:54.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.247+0000 7f108c5ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f108414da10 0x7f10840c1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:54.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.247+0000 7f108c5ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1084070080 con 0x7f108406d100 2023-07-27T20:32:54.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.247+0000 7f108c5ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10840ab330 con 0x7f10840c1930 2023-07-27T20:32:54.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.247+0000 7f108c5ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10840702d0 con 0x7f108414da10 2023-07-27T20:32:54.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.247+0000 7f108a39b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f10840c1930 0x7f10840aad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:54.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.247+0000 7f108a39b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f10840c1930 0x7f10840aad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49876/0 (socket says 172.21.15.72:49876) 2023-07-27T20:32:54.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.247+0000 7f108a39b700 1 -- 172.21.15.72:0/3023084282 learned_addr learned my addr 172.21.15.72:0/3023084282 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:54.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.248+0000 7f1089b9a700 1 --2- 172.21.15.72:0/3023084282 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f108414da10 0x7f10840c1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:54.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.248+0000 7f108a39b700 1 -- 172.21.15.72:0/3023084282 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f108414da10 msgr2=0x7f10840c1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:54.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.248+0000 7f108a39b700 1 --2- 172.21.15.72:0/3023084282 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f108414da10 0x7f10840c1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:54.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.248+0000 7f108a39b700 1 -- 172.21.15.72:0/3023084282 >> v1:172.21.15.173:6789/0 conn(0x7f108406d100 legacy=0x7f10841504b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:54.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.248+0000 7f108a39b700 1 -- 172.21.15.72:0/3023084282 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10840705b0 con 0x7f10840c1930 2023-07-27T20:32:54.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.248+0000 7f108a39b700 1 --2- 172.21.15.72:0/3023084282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10840c1930 0x7f10840aad50 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f10800098f0 tx=0x7f1080009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8923987fdb55ab91 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:54.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.248+0000 7f1089399700 1 -- 172.21.15.72:0/3023084282 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108000b8a0 con 0x7f10840c1930 2023-07-27T20:32:54.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.248+0000 7f1089399700 1 -- 172.21.15.72:0/3023084282 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108000ba00 con 0x7f10840c1930 2023-07-27T20:32:54.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.248+0000 7f1089399700 1 -- 172.21.15.72:0/3023084282 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108000bd90 con 0x7f10840c1930 2023-07-27T20:32:54.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.249+0000 7f108c5ff700 1 -- 172.21.15.72:0/3023084282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10840c1930 msgr2=0x7f10840aad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:54.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.249+0000 7f108c5ff700 1 --2- 172.21.15.72:0/3023084282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10840c1930 0x7f10840aad50 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f10800098f0 tx=0x7f1080009c00 comp rx=0 tx=0).stop 2023-07-27T20:32:54.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.249+0000 7f108c5ff700 1 -- 172.21.15.72:0/3023084282 shutdown_connections 2023-07-27T20:32:54.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.249+0000 7f108c5ff700 1 --2- 172.21.15.72:0/3023084282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10840c1930 0x7f10840aad50 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:54.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.249+0000 7f108c5ff700 1 --2- 172.21.15.72:0/3023084282 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f108414da10 0x7f10840c1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:54.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.249+0000 7f108c5ff700 1 -- 172.21.15.72:0/3023084282 >> 172.21.15.72:0/3023084282 conn(0x7f108406a190 msgr2=0x7f108406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:54.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.249+0000 7f108c5ff700 1 -- 172.21.15.72:0/3023084282 shutdown_connections 2023-07-27T20:32:54.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.249+0000 7f108c5ff700 1 -- 172.21.15.72:0/3023084282 wait complete. 2023-07-27T20:32:54.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.251+0000 7f108c5ff700 1 Processor -- start 2023-07-27T20:32:54.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.251+0000 7f108c5ff700 1 -- start start 2023-07-27T20:32:54.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.252+0000 7f108c5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f108406d100 0x7f1084155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:54.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.252+0000 7f108c5ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10840c1930 0x7f10841e7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:54.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.252+0000 7f108c5ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f108414da10 0x7f10841e7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:54.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.252+0000 7f108c5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10841e81f0 con 0x7f108406d100 2023-07-27T20:32:54.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.252+0000 7f108c5ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10841e7270 con 0x7f108414da10 2023-07-27T20:32:54.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.252+0000 7f108c5ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10841eb640 con 0x7f10840c1930 2023-07-27T20:32:54.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.252+0000 7f108a39b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f108406d100 0x7f1084155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:54.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.252+0000 7f108a39b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f108406d100 0x7f1084155530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49890/0 (socket says 172.21.15.72:49890) 2023-07-27T20:32:54.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.252+0000 7f108a39b700 1 -- 172.21.15.72:0/836914663 learned_addr learned my addr 172.21.15.72:0/836914663 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:54.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.252+0000 7f108a39b700 1 -- 172.21.15.72:0/836914663 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10840c1930 msgr2=0x7f10841e7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:54.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.252+0000 7f108a39b700 1 --2- 172.21.15.72:0/836914663 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10840c1930 0x7f10841e7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:54.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.252+0000 7f108a39b700 1 -- 172.21.15.72:0/836914663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f108414da10 msgr2=0x7f10841e7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:54.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.252+0000 7f108a39b700 1 --2- 172.21.15.72:0/836914663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f108414da10 0x7f10841e7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:54.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.252+0000 7f108a39b700 1 -- 172.21.15.72:0/836914663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1080009550 con 0x7f108406d100 2023-07-27T20:32:54.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.252+0000 7f108a39b700 1 --2- 172.21.15.72:0/836914663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f108406d100 0x7f1084155530 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1080000c00 tx=0x7f1080004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:54.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.253+0000 7f107affd700 1 -- 172.21.15.72:0/836914663 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1080004480 con 0x7f108406d100 2023-07-27T20:32:54.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.253+0000 7f107affd700 1 -- 172.21.15.72:0/836914663 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108001f070 con 0x7f108406d100 2023-07-27T20:32:54.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.253+0000 7f107affd700 1 -- 172.21.15.72:0/836914663 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10800038a0 con 0x7f108406d100 2023-07-27T20:32:54.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.253+0000 7f108c5ff700 1 -- 172.21.15.72:0/836914663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10841541d0 con 0x7f108406d100 2023-07-27T20:32:54.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.253+0000 7f108c5ff700 1 -- 172.21.15.72:0/836914663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1084154790 con 0x7f108406d100 2023-07-27T20:32:54.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.254+0000 7f108c5ff700 1 -- 172.21.15.72:0/836914663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10841e75c0 con 0x7f108406d100 2023-07-27T20:32:54.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.255+0000 7f107affd700 1 -- 172.21.15.72:0/836914663 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1080021030 con 0x7f108406d100 2023-07-27T20:32:54.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.256+0000 7f107affd700 1 --2- 172.21.15.72:0/836914663 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f106806ace0 0x7f106806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:54.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.256+0000 7f107affd700 1 -- 172.21.15.72:0/836914663 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f108008a8c0 con 0x7f108406d100 2023-07-27T20:32:54.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.256+0000 7f1089b9a700 1 --2- 172.21.15.72:0/836914663 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f106806ace0 0x7f106806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:54.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.257+0000 7f1089b9a700 1 --2- 172.21.15.72:0/836914663 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f106806ace0 0x7f106806d1a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1074006f10 tx=0x7f1074008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:54.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.260+0000 7f107affd700 1 -- 172.21.15.72:0/836914663 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1080055b70 con 0x7f108406d100 2023-07-27T20:32:54.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.531+0000 7f108c5ff700 1 -- 172.21.15.72:0/836914663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f1084074310 con 0x7f108406d100 2023-07-27T20:32:54.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.535+0000 7f107affd700 1 -- 172.21.15.72:0/836914663 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1080059190 con 0x7f108406d100 2023-07-27T20:32:54.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.537+0000 7f108c5ff700 1 -- 172.21.15.72:0/836914663 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f106806ace0 msgr2=0x7f106806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:54.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.537+0000 7f108c5ff700 1 --2- 172.21.15.72:0/836914663 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f106806ace0 0x7f106806d1a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1074006f10 tx=0x7f1074008040 comp rx=0 tx=0).stop 2023-07-27T20:32:54.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.537+0000 7f108c5ff700 1 -- 172.21.15.72:0/836914663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f108406d100 msgr2=0x7f1084155530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:54.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.537+0000 7f108c5ff700 1 --2- 172.21.15.72:0/836914663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f108406d100 0x7f1084155530 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1080000c00 tx=0x7f1080004750 comp rx=0 tx=0).stop 2023-07-27T20:32:54.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.537+0000 7f108c5ff700 1 -- 172.21.15.72:0/836914663 shutdown_connections 2023-07-27T20:32:54.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.537+0000 7f108c5ff700 1 --2- 172.21.15.72:0/836914663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f108414da10 0x7f10841e7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:54.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.537+0000 7f108c5ff700 1 --2- 172.21.15.72:0/836914663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f108406d100 0x7f1084155530 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:54.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.537+0000 7f108c5ff700 1 --2- 172.21.15.72:0/836914663 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f106806ace0 0x7f106806d1a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:54.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.537+0000 7f108c5ff700 1 --2- 172.21.15.72:0/836914663 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10840c1930 0x7f10841e7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:54.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.537+0000 7f108c5ff700 1 -- 172.21.15.72:0/836914663 >> 172.21.15.72:0/836914663 conn(0x7f108406a190 msgr2=0x7f10840c0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:54.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.538+0000 7f108c5ff700 1 -- 172.21.15.72:0/836914663 shutdown_connections 2023-07-27T20:32:54.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.538+0000 7f108c5ff700 1 -- 172.21.15.72:0/836914663 wait complete. 2023-07-27T20:32:54.545 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-07-27T20:32:54.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.753+0000 7fd4465ff700 1 Processor -- start 2023-07-27T20:32:54.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.753+0000 7fd4465ff700 1 -- start start 2023-07-27T20:32:54.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.754+0000 7fd4465ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd4400c1930 0x7fd4400aad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:54.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.754+0000 7fd4465ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd4401504b0 0x7fd440150930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:54.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.754+0000 7fd4465ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd440070080 con 0x7fd44014da10 2023-07-27T20:32:54.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.754+0000 7fd4465ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4400ab330 con 0x7fd4401504b0 2023-07-27T20:32:54.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.754+0000 7fd4465ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4400702d0 con 0x7fd4400c1930 2023-07-27T20:32:54.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.754+0000 7fd444b9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd4401504b0 0x7fd440150930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:54.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.754+0000 7fd444b9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd4401504b0 0x7fd440150930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49898/0 (socket says 172.21.15.72:49898) 2023-07-27T20:32:54.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.754+0000 7fd444b9c700 1 -- 172.21.15.72:0/452475735 learned_addr learned my addr 172.21.15.72:0/452475735 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:54.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.755+0000 7fd43f7fe700 1 --2- 172.21.15.72:0/452475735 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd4400c1930 0x7fd4400aad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:54.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.755+0000 7fd444b9c700 1 -- 172.21.15.72:0/452475735 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd4400c1930 msgr2=0x7fd4400aad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:54.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.755+0000 7fd444b9c700 1 --2- 172.21.15.72:0/452475735 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd4400c1930 0x7fd4400aad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:54.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.755+0000 7fd444b9c700 1 -- 172.21.15.72:0/452475735 >> v1:172.21.15.173:6789/0 conn(0x7fd44014da10 legacy=0x7fd44006d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:54.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.755+0000 7fd444b9c700 1 -- 172.21.15.72:0/452475735 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4400705b0 con 0x7fd4401504b0 2023-07-27T20:32:54.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.755+0000 7fd444b9c700 1 --2- 172.21.15.72:0/452475735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4401504b0 0x7fd440150930 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd438009e50 tx=0x7fd43800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd0f7d49539a46fd server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:54.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.755+0000 7fd43effd700 1 -- 172.21.15.72:0/452475735 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43800e070 con 0x7fd4401504b0 2023-07-27T20:32:54.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.755+0000 7fd43effd700 1 -- 172.21.15.72:0/452475735 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43800b9c0 con 0x7fd4401504b0 2023-07-27T20:32:54.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.755+0000 7fd43effd700 1 -- 172.21.15.72:0/452475735 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43800bd70 con 0x7fd4401504b0 2023-07-27T20:32:54.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.756+0000 7fd4465ff700 1 -- 172.21.15.72:0/452475735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4401504b0 msgr2=0x7fd440150930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:54.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.756+0000 7fd4465ff700 1 --2- 172.21.15.72:0/452475735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4401504b0 0x7fd440150930 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd438009e50 tx=0x7fd43800b330 comp rx=0 tx=0).stop 2023-07-27T20:32:54.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.756+0000 7fd4465ff700 1 -- 172.21.15.72:0/452475735 shutdown_connections 2023-07-27T20:32:54.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.756+0000 7fd4465ff700 1 --2- 172.21.15.72:0/452475735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4401504b0 0x7fd440150930 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:54.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.756+0000 7fd4465ff700 1 --2- 172.21.15.72:0/452475735 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd4400c1930 0x7fd4400aad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:54.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.756+0000 7fd4465ff700 1 -- 172.21.15.72:0/452475735 >> 172.21.15.72:0/452475735 conn(0x7fd44006a190 msgr2=0x7fd44006a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:54.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.756+0000 7fd4465ff700 1 -- 172.21.15.72:0/452475735 shutdown_connections 2023-07-27T20:32:54.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.756+0000 7fd4465ff700 1 -- 172.21.15.72:0/452475735 wait complete. 2023-07-27T20:32:54.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.758+0000 7fd4465ff700 1 Processor -- start 2023-07-27T20:32:54.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.758+0000 7fd4465ff700 1 -- start start 2023-07-27T20:32:54.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.759+0000 7fd4465ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4400c1930 0x7fd4401457c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:54.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.759+0000 7fd4465ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd44014da10 0x7fd440142c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:54.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.759+0000 7fd4465ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd4401504b0 0x7fd4401431c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:54.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.759+0000 7fd4465ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4401ed5b0 con 0x7fd4400c1930 2023-07-27T20:32:54.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.759+0000 7fd4465ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4401edae0 con 0x7fd44014da10 2023-07-27T20:32:54.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.759+0000 7fd4465ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4401ed800 con 0x7fd4401504b0 2023-07-27T20:32:54.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.759+0000 7fd43ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4400c1930 0x7fd4401457c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:54.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.759+0000 7fd43ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4400c1930 0x7fd4401457c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49908/0 (socket says 172.21.15.72:49908) 2023-07-27T20:32:54.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.759+0000 7fd43ffff700 1 -- 172.21.15.72:0/2712902160 learned_addr learned my addr 172.21.15.72:0/2712902160 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:54.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.759+0000 7fd43f7fe700 1 --2- 172.21.15.72:0/2712902160 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd44014da10 0x7fd440142c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:54.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.759+0000 7fd444b9c700 1 --2- 172.21.15.72:0/2712902160 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd4401504b0 0x7fd4401431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:54.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.759+0000 7fd43ffff700 1 -- 172.21.15.72:0/2712902160 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd4401504b0 msgr2=0x7fd4401431c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:54.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.759+0000 7fd43ffff700 1 --2- 172.21.15.72:0/2712902160 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd4401504b0 0x7fd4401431c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:54.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.759+0000 7fd43ffff700 1 -- 172.21.15.72:0/2712902160 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd44014da10 msgr2=0x7fd440142c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:54.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.759+0000 7fd43ffff700 1 --2- 172.21.15.72:0/2712902160 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd44014da10 0x7fd440142c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:54.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.759+0000 7fd43ffff700 1 -- 172.21.15.72:0/2712902160 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd438009b30 con 0x7fd4400c1930 2023-07-27T20:32:54.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.760+0000 7fd43ffff700 1 --2- 172.21.15.72:0/2712902160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4400c1930 0x7fd4401457c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd43000c4e0 tx=0x7fd43000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:54.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.760+0000 7fd43cff9700 1 -- 172.21.15.72:0/2712902160 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4300052d0 con 0x7fd4400c1930 2023-07-27T20:32:54.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.760+0000 7fd43cff9700 1 -- 172.21.15.72:0/2712902160 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd430005430 con 0x7fd4400c1930 2023-07-27T20:32:54.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.760+0000 7fd4465ff700 1 -- 172.21.15.72:0/2712902160 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd440152ad0 con 0x7fd4400c1930 2023-07-27T20:32:54.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.760+0000 7fd43cff9700 1 -- 172.21.15.72:0/2712902160 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4300038c0 con 0x7fd4400c1930 2023-07-27T20:32:54.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.760+0000 7fd4465ff700 1 -- 172.21.15.72:0/2712902160 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd440143700 con 0x7fd4400c1930 2023-07-27T20:32:54.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.761+0000 7fd4465ff700 1 -- 172.21.15.72:0/2712902160 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4400a8190 con 0x7fd4400c1930 2023-07-27T20:32:54.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.762+0000 7fd43cff9700 1 -- 172.21.15.72:0/2712902160 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd430003a20 con 0x7fd4400c1930 2023-07-27T20:32:54.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.763+0000 7fd43cff9700 1 --2- 172.21.15.72:0/2712902160 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd42c06ace0 0x7fd42c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:54.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.763+0000 7fd43cff9700 1 -- 172.21.15.72:0/2712902160 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fd4300886c0 con 0x7fd4400c1930 2023-07-27T20:32:54.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.763+0000 7fd43f7fe700 1 --2- 172.21.15.72:0/2712902160 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd42c06ace0 0x7fd42c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:54.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.764+0000 7fd43f7fe700 1 --2- 172.21.15.72:0/2712902160 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd42c06ace0 0x7fd42c06d1a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd4400ab090 tx=0x7fd434008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:54.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:54.767+0000 7fd43cff9700 1 -- 172.21.15.72:0/2712902160 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd430053a10 con 0x7fd4400c1930 2023-07-27T20:32:55.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.041+0000 7fd4465ff700 1 -- 172.21.15.72:0/2712902160 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fd440074310 con 0x7fd4400c1930 2023-07-27T20:32:55.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.045+0000 7fd43cff9700 1 -- 172.21.15.72:0/2712902160 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd430057030 con 0x7fd4400c1930 2023-07-27T20:32:55.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.047+0000 7fd4465ff700 1 -- 172.21.15.72:0/2712902160 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd42c06ace0 msgr2=0x7fd42c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:55.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.047+0000 7fd4465ff700 1 --2- 172.21.15.72:0/2712902160 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd42c06ace0 0x7fd42c06d1a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd4400ab090 tx=0x7fd434008040 comp rx=0 tx=0).stop 2023-07-27T20:32:55.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.047+0000 7fd4465ff700 1 -- 172.21.15.72:0/2712902160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4400c1930 msgr2=0x7fd4401457c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:55.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.047+0000 7fd4465ff700 1 --2- 172.21.15.72:0/2712902160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4400c1930 0x7fd4401457c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd43000c4e0 tx=0x7fd43000c8a0 comp rx=0 tx=0).stop 2023-07-27T20:32:55.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.047+0000 7fd4465ff700 1 -- 172.21.15.72:0/2712902160 shutdown_connections 2023-07-27T20:32:55.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.047+0000 7fd4465ff700 1 --2- 172.21.15.72:0/2712902160 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd42c06ace0 0x7fd42c06d1a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:55.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.047+0000 7fd4465ff700 1 --2- 172.21.15.72:0/2712902160 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd4401504b0 0x7fd4401431c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:55.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.047+0000 7fd4465ff700 1 --2- 172.21.15.72:0/2712902160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4400c1930 0x7fd4401457c0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:55.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.047+0000 7fd4465ff700 1 --2- 172.21.15.72:0/2712902160 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd44014da10 0x7fd440142c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:55.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.047+0000 7fd4465ff700 1 -- 172.21.15.72:0/2712902160 >> 172.21.15.72:0/2712902160 conn(0x7fd44006a190 msgr2=0x7fd44006a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:55.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.047+0000 7fd4465ff700 1 -- 172.21.15.72:0/2712902160 shutdown_connections 2023-07-27T20:32:55.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.047+0000 7fd4465ff700 1 -- 172.21.15.72:0/2712902160 wait complete. 2023-07-27T20:32:55.054 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-07-27T20:32:55.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.262+0000 7f871b1ff700 1 Processor -- start 2023-07-27T20:32:55.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.262+0000 7f871b1ff700 1 -- start start 2023-07-27T20:32:55.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.263+0000 7f871b1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8714139960 0x7f87140c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:55.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.263+0000 7f871b1ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8714139f80 0x7f87140c1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:55.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.263+0000 7f871b1ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87140c2340 0x7f87141542e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:55.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.263+0000 7f871b1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87140c0ee0 con 0x7f8714139960 2023-07-27T20:32:55.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.263+0000 7f871b1ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87140c1810 con 0x7f8714139f80 2023-07-27T20:32:55.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.263+0000 7f871b1ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8714139d40 con 0x7f87140c2340 2023-07-27T20:32:55.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.264+0000 7f8718f9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8714139960 0x7f87140c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:55.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.264+0000 7f8718f9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8714139960 0x7f87140c12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49922/0 (socket says 172.21.15.72:49922) 2023-07-27T20:32:55.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.264+0000 7f8718f9b700 1 -- 172.21.15.72:0/1253154533 learned_addr learned my addr 172.21.15.72:0/1253154533 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:55.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.264+0000 7f8713fff700 1 --2- 172.21.15.72:0/1253154533 >> v2:172.21.15.173:3300/0 conn(0x7f8714139f80 0x7f87140c1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:55.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.264+0000 7f8718f9b700 1 -- 172.21.15.72:0/1253154533 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87140c2340 msgr2=0x7f87141542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:55.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.264+0000 7f871979c700 1 --2- 172.21.15.72:0/1253154533 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87140c2340 0x7f87141542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:55.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.264+0000 7f8718f9b700 1 --2- 172.21.15.72:0/1253154533 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87140c2340 0x7f87141542e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:55.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.264+0000 7f8718f9b700 1 -- 172.21.15.72:0/1253154533 >> v2:172.21.15.173:3300/0 conn(0x7f8714139f80 msgr2=0x7f87140c1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:55.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.264+0000 7f8718f9b700 1 --2- 172.21.15.72:0/1253154533 >> v2:172.21.15.173:3300/0 conn(0x7f8714139f80 0x7f87140c1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:55.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.264+0000 7f8718f9b700 1 -- 172.21.15.72:0/1253154533 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8714151060 con 0x7f8714139960 2023-07-27T20:32:55.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.264+0000 7f8713fff700 1 --2- 172.21.15.72:0/1253154533 >> v2:172.21.15.173:3300/0 conn(0x7f8714139f80 0x7f87140c1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:32:55.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.264+0000 7f871979c700 1 --2- 172.21.15.72:0/1253154533 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87140c2340 0x7f87141542e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:32:55.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.264+0000 7f8718f9b700 1 --2- 172.21.15.72:0/1253154533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8714139960 0x7f87140c12d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f87140c28a0 tx=0x7f8708009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fedaa0978b6b7b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:55.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.264+0000 7f87137fe700 1 -- 172.21.15.72:0/1253154533 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870800b870 con 0x7f8714139960 2023-07-27T20:32:55.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.264+0000 7f87137fe700 1 -- 172.21.15.72:0/1253154533 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870800b9d0 con 0x7f8714139960 2023-07-27T20:32:55.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.265+0000 7f87137fe700 1 -- 172.21.15.72:0/1253154533 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870800bd60 con 0x7f8714139960 2023-07-27T20:32:55.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.265+0000 7f871b1ff700 1 -- 172.21.15.72:0/1253154533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8714139960 msgr2=0x7f87140c12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:55.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.265+0000 7f871b1ff700 1 --2- 172.21.15.72:0/1253154533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8714139960 0x7f87140c12d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f87140c28a0 tx=0x7f8708009bd0 comp rx=0 tx=0).stop 2023-07-27T20:32:55.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.265+0000 7f871b1ff700 1 -- 172.21.15.72:0/1253154533 shutdown_connections 2023-07-27T20:32:55.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.265+0000 7f871b1ff700 1 --2- 172.21.15.72:0/1253154533 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87140c2340 0x7f87141542e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:55.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.265+0000 7f871b1ff700 1 --2- 172.21.15.72:0/1253154533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8714139960 0x7f87140c12d0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:55.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.265+0000 7f871b1ff700 1 --2- 172.21.15.72:0/1253154533 >> v2:172.21.15.173:3300/0 conn(0x7f8714139f80 0x7f87140c1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:55.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.265+0000 7f871b1ff700 1 -- 172.21.15.72:0/1253154533 >> 172.21.15.72:0/1253154533 conn(0x7f871406a190 msgr2=0x7f871406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:55.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.265+0000 7f871b1ff700 1 -- 172.21.15.72:0/1253154533 shutdown_connections 2023-07-27T20:32:55.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.265+0000 7f871b1ff700 1 -- 172.21.15.72:0/1253154533 wait complete. 2023-07-27T20:32:55.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.267+0000 7f871b1ff700 1 Processor -- start 2023-07-27T20:32:55.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.267+0000 7f871b1ff700 1 -- start start 2023-07-27T20:32:55.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.268+0000 7f871b1ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87140c2340 0x7f87141ed550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:55.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.268+0000 7f871b1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8714139960 0x7f87141508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:55.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.268+0000 7f871b1ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8714139f80 0x7f871412c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:55.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.268+0000 7f871b1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8714132e70 con 0x7f8714139960 2023-07-27T20:32:55.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.268+0000 7f871b1ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87141ecb00 con 0x7f8714139f80 2023-07-27T20:32:55.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.268+0000 7f871b1ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8714130eb0 con 0x7f87140c2340 2023-07-27T20:32:55.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.268+0000 7f8713fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8714139960 0x7f87141508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:55.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.268+0000 7f8713fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8714139960 0x7f87141508c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49926/0 (socket says 172.21.15.72:49926) 2023-07-27T20:32:55.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.268+0000 7f8713fff700 1 -- 172.21.15.72:0/1910411745 learned_addr learned my addr 172.21.15.72:0/1910411745 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:55.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.268+0000 7f8718f9b700 1 --2- 172.21.15.72:0/1910411745 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87140c2340 0x7f87141ed550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:55.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.268+0000 7f871979c700 1 --2- 172.21.15.72:0/1910411745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8714139f80 0x7f871412c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:55.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.268+0000 7f8713fff700 1 -- 172.21.15.72:0/1910411745 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87140c2340 msgr2=0x7f87141ed550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:55.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.268+0000 7f8713fff700 1 --2- 172.21.15.72:0/1910411745 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87140c2340 0x7f87141ed550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:55.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.268+0000 7f8713fff700 1 -- 172.21.15.72:0/1910411745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8714139f80 msgr2=0x7f871412c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:55.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.268+0000 7f8713fff700 1 --2- 172.21.15.72:0/1910411745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8714139f80 0x7f871412c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:55.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.268+0000 7f8713fff700 1 -- 172.21.15.72:0/1910411745 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8708009550 con 0x7f8714139960 2023-07-27T20:32:55.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.269+0000 7f871979c700 1 --2- 172.21.15.72:0/1910411745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8714139f80 0x7f871412c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:55.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.269+0000 7f8713fff700 1 --2- 172.21.15.72:0/1910411745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8714139960 0x7f87141508c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f870000c820 tx=0x7f870000cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:55.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.269+0000 7f87117fa700 1 -- 172.21.15.72:0/1910411745 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8700004220 con 0x7f8714139960 2023-07-27T20:32:55.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.269+0000 7f87117fa700 1 -- 172.21.15.72:0/1910411745 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8700004380 con 0x7f8714139960 2023-07-27T20:32:55.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.269+0000 7f871b1ff700 1 -- 172.21.15.72:0/1910411745 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87141330c0 con 0x7f8714139960 2023-07-27T20:32:55.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.269+0000 7f87117fa700 1 -- 172.21.15.72:0/1910411745 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87000036c0 con 0x7f8714139960 2023-07-27T20:32:55.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.269+0000 7f871b1ff700 1 -- 172.21.15.72:0/1910411745 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87141ecd50 con 0x7f8714139960 2023-07-27T20:32:55.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.270+0000 7f871b1ff700 1 -- 172.21.15.72:0/1910411745 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8714074310 con 0x7f8714139960 2023-07-27T20:32:55.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.271+0000 7f87117fa700 1 -- 172.21.15.72:0/1910411745 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8700003820 con 0x7f8714139960 2023-07-27T20:32:55.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.272+0000 7f87117fa700 1 --2- 172.21.15.72:0/1910411745 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f86f806ace0 0x7f86f806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:55.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.272+0000 7f87117fa700 1 -- 172.21.15.72:0/1910411745 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f8700088d50 con 0x7f8714139960 2023-07-27T20:32:55.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.273+0000 7f8718f9b700 1 --2- 172.21.15.72:0/1910411745 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f86f806ace0 0x7f86f806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:55.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.273+0000 7f8718f9b700 1 --2- 172.21.15.72:0/1910411745 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f86f806ace0 0x7f86f806d1a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8708014040 tx=0x7f8708008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:55.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.276+0000 7f87117fa700 1 -- 172.21.15.72:0/1910411745 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8700054000 con 0x7f8714139960 2023-07-27T20:32:55.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.550+0000 7f871b1ff700 1 -- 172.21.15.72:0/1910411745 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f87140bf570 con 0x7f8714139960 2023-07-27T20:32:55.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.553+0000 7f87117fa700 1 -- 172.21.15.72:0/1910411745 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8700057620 con 0x7f8714139960 2023-07-27T20:32:55.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.556+0000 7f871b1ff700 1 -- 172.21.15.72:0/1910411745 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f86f806ace0 msgr2=0x7f86f806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:55.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.556+0000 7f871b1ff700 1 --2- 172.21.15.72:0/1910411745 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f86f806ace0 0x7f86f806d1a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8708014040 tx=0x7f8708008030 comp rx=0 tx=0).stop 2023-07-27T20:32:55.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.556+0000 7f871b1ff700 1 -- 172.21.15.72:0/1910411745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8714139960 msgr2=0x7f87141508c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:55.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.556+0000 7f871b1ff700 1 --2- 172.21.15.72:0/1910411745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8714139960 0x7f87141508c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f870000c820 tx=0x7f870000cb30 comp rx=0 tx=0).stop 2023-07-27T20:32:55.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.556+0000 7f871b1ff700 1 -- 172.21.15.72:0/1910411745 shutdown_connections 2023-07-27T20:32:55.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.556+0000 7f871b1ff700 1 --2- 172.21.15.72:0/1910411745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8714139f80 0x7f871412c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:55.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.556+0000 7f871b1ff700 1 --2- 172.21.15.72:0/1910411745 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f86f806ace0 0x7f86f806d1a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:55.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.556+0000 7f871b1ff700 1 --2- 172.21.15.72:0/1910411745 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87140c2340 0x7f87141ed550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:55.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.556+0000 7f871b1ff700 1 --2- 172.21.15.72:0/1910411745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8714139960 0x7f87141508c0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:55.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.556+0000 7f871b1ff700 1 -- 172.21.15.72:0/1910411745 >> 172.21.15.72:0/1910411745 conn(0x7f871406a190 msgr2=0x7f871406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:55.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.556+0000 7f871b1ff700 1 -- 172.21.15.72:0/1910411745 shutdown_connections 2023-07-27T20:32:55.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.556+0000 7f871b1ff700 1 -- 172.21.15.72:0/1910411745 wait complete. 2023-07-27T20:32:55.562 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-07-27T20:32:55.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.771+0000 7eff07dff700 1 Processor -- start 2023-07-27T20:32:55.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.771+0000 7eff07dff700 1 -- start start 2023-07-27T20:32:55.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.773+0000 7eff07dff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7eff0013b2c0 0x7eff000aa420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:55.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.773+0000 7eff07dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7eff000a83a0 0x7eff000a8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:55.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.773+0000 7eff07dff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff00155600 con 0x7eff000bfd90 2023-07-27T20:32:55.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.773+0000 7eff07dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff000a9620 con 0x7eff000a83a0 2023-07-27T20:32:55.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.773+0000 7eff07dff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff00155320 con 0x7eff0013b2c0 2023-07-27T20:32:55.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.773+0000 7eff0639c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7eff000a83a0 0x7eff000a8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:55.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.773+0000 7eff0639c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7eff000a83a0 0x7eff000a8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49940/0 (socket says 172.21.15.72:49940) 2023-07-27T20:32:55.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.773+0000 7eff0639c700 1 -- 172.21.15.72:0/3045331924 learned_addr learned my addr 172.21.15.72:0/3045331924 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:55.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.773+0000 7eff05b9b700 1 --2- 172.21.15.72:0/3045331924 >> v2:172.21.15.173:3300/0 conn(0x7eff0013b2c0 0x7eff000aa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:55.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.773+0000 7eff0639c700 1 -- 172.21.15.72:0/3045331924 >> v2:172.21.15.173:3300/0 conn(0x7eff0013b2c0 msgr2=0x7eff000aa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:55.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.773+0000 7eff0639c700 1 --2- 172.21.15.72:0/3045331924 >> v2:172.21.15.173:3300/0 conn(0x7eff0013b2c0 0x7eff000aa420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:55.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.773+0000 7eff0639c700 1 -- 172.21.15.72:0/3045331924 >> v1:172.21.15.173:6789/0 conn(0x7eff000bfd90 legacy=0x7eff000aa960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:55.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.773+0000 7eff0639c700 1 -- 172.21.15.72:0/3045331924 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff00151e40 con 0x7eff000a83a0 2023-07-27T20:32:55.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.773+0000 7eff04b99700 1 -- 172.21.15.72:0/3045331924 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1270085594 0 0) 0x7eff00155600 con 0x7eff000bfd90 2023-07-27T20:32:55.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.774+0000 7eff0639c700 1 --2- 172.21.15.72:0/3045331924 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff000a83a0 0x7eff000a8810 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7eff000c64a0 tx=0x7efef800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3073654d8e32a5e6 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:55.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.774+0000 7eff04b99700 1 -- 172.21.15.72:0/3045331924 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef800e070 con 0x7eff000a83a0 2023-07-27T20:32:55.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.774+0000 7eff04b99700 1 -- 172.21.15.72:0/3045331924 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef800b910 con 0x7eff000a83a0 2023-07-27T20:32:55.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.774+0000 7eff04b99700 1 -- 172.21.15.72:0/3045331924 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef800bcc0 con 0x7eff000a83a0 2023-07-27T20:32:55.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.774+0000 7eff07dff700 1 -- 172.21.15.72:0/3045331924 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff000a83a0 msgr2=0x7eff000a8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:55.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.774+0000 7eff07dff700 1 --2- 172.21.15.72:0/3045331924 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff000a83a0 0x7eff000a8810 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7eff000c64a0 tx=0x7efef800b330 comp rx=0 tx=0).stop 2023-07-27T20:32:55.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.775+0000 7eff07dff700 1 -- 172.21.15.72:0/3045331924 shutdown_connections 2023-07-27T20:32:55.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.775+0000 7eff07dff700 1 --2- 172.21.15.72:0/3045331924 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff000a83a0 0x7eff000a8810 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:55.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.775+0000 7eff07dff700 1 --2- 172.21.15.72:0/3045331924 >> v2:172.21.15.173:3300/0 conn(0x7eff0013b2c0 0x7eff000aa420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:55.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.775+0000 7eff07dff700 1 -- 172.21.15.72:0/3045331924 >> 172.21.15.72:0/3045331924 conn(0x7eff0006a190 msgr2=0x7eff0006a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:55.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.775+0000 7eff07dff700 1 -- 172.21.15.72:0/3045331924 shutdown_connections 2023-07-27T20:32:55.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.775+0000 7eff07dff700 1 -- 172.21.15.72:0/3045331924 wait complete. 2023-07-27T20:32:55.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.776+0000 7eff07dff700 1 Processor -- start 2023-07-27T20:32:55.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.776+0000 7eff07dff700 1 -- start start 2023-07-27T20:32:55.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.777+0000 7eff07dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7eff000a83a0 0x7eff001e9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:55.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.777+0000 7eff07dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff000bfd90 0x7eff000be990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:55.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.777+0000 7eff07dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff0013b2c0 0x7eff00137b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:55.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.777+0000 7eff07dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff001dc110 con 0x7eff0013b2c0 2023-07-27T20:32:55.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.777+0000 7eff07dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff00150d60 con 0x7eff000bfd90 2023-07-27T20:32:55.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.777+0000 7eff07dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff00151040 con 0x7eff000a83a0 2023-07-27T20:32:55.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.778+0000 7eff0639c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff0013b2c0 0x7eff00137b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:55.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.778+0000 7eff0639c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff0013b2c0 0x7eff00137b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49952/0 (socket says 172.21.15.72:49952) 2023-07-27T20:32:55.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.778+0000 7eff0639c700 1 -- 172.21.15.72:0/2771887306 learned_addr learned my addr 172.21.15.72:0/2771887306 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:55.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.778+0000 7eff05b9b700 1 --2- 172.21.15.72:0/2771887306 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7eff000a83a0 0x7eff001e9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:55.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.778+0000 7eff0539a700 1 --2- 172.21.15.72:0/2771887306 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff000bfd90 0x7eff000be990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:55.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.778+0000 7eff0639c700 1 -- 172.21.15.72:0/2771887306 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7eff000a83a0 msgr2=0x7eff001e9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:55.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.778+0000 7eff0639c700 1 --2- 172.21.15.72:0/2771887306 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7eff000a83a0 0x7eff001e9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:55.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.778+0000 7eff0639c700 1 -- 172.21.15.72:0/2771887306 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff000bfd90 msgr2=0x7eff000be990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:55.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.778+0000 7eff0639c700 1 --2- 172.21.15.72:0/2771887306 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff000bfd90 0x7eff000be990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:55.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.778+0000 7eff0639c700 1 -- 172.21.15.72:0/2771887306 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef8009b30 con 0x7eff0013b2c0 2023-07-27T20:32:55.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.778+0000 7eff0539a700 1 --2- 172.21.15.72:0/2771887306 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff000bfd90 0x7eff000be990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:55.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.778+0000 7eff05b9b700 1 --2- 172.21.15.72:0/2771887306 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7eff000a83a0 0x7eff001e9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:55.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.778+0000 7eff0639c700 1 --2- 172.21.15.72:0/2771887306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff0013b2c0 0x7eff00137b60 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7eff000723d0 tx=0x7efef8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:55.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.778+0000 7efef67fc700 1 -- 172.21.15.72:0/2771887306 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef80099b0 con 0x7eff0013b2c0 2023-07-27T20:32:55.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.778+0000 7efef67fc700 1 -- 172.21.15.72:0/2771887306 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef80092e0 con 0x7eff0013b2c0 2023-07-27T20:32:55.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.778+0000 7eff07dff700 1 -- 172.21.15.72:0/2771887306 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff001db390 con 0x7eff0013b2c0 2023-07-27T20:32:55.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.778+0000 7efef67fc700 1 -- 172.21.15.72:0/2771887306 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef801c660 con 0x7eff0013b2c0 2023-07-27T20:32:55.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.779+0000 7eff07dff700 1 -- 172.21.15.72:0/2771887306 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff000beed0 con 0x7eff0013b2c0 2023-07-27T20:32:55.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.780+0000 7eff07dff700 1 -- 172.21.15.72:0/2771887306 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff001db850 con 0x7eff0013b2c0 2023-07-27T20:32:55.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.781+0000 7efef67fc700 1 -- 172.21.15.72:0/2771887306 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efef801c7c0 con 0x7eff0013b2c0 2023-07-27T20:32:55.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.782+0000 7efef67fc700 1 --2- 172.21.15.72:0/2771887306 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7efee406ace0 0x7efee406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:55.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.782+0000 7efef67fc700 1 -- 172.21.15.72:0/2771887306 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7efef808ac00 con 0x7eff0013b2c0 2023-07-27T20:32:55.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.782+0000 7eff05b9b700 1 --2- 172.21.15.72:0/2771887306 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7efee406ace0 0x7efee406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:55.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.783+0000 7eff05b9b700 1 --2- 172.21.15.72:0/2771887306 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7efee406ace0 0x7efee406d1a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7efefc009b90 tx=0x7efefc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:55.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:55.786+0000 7efef67fc700 1 -- 172.21.15.72:0/2771887306 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7efef8091080 con 0x7eff0013b2c0 2023-07-27T20:32:56.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.057+0000 7eff07dff700 1 -- 172.21.15.72:0/2771887306 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7eff00074310 con 0x7eff0013b2c0 2023-07-27T20:32:56.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.062+0000 7efef67fc700 1 -- 172.21.15.72:0/2771887306 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7efef8055f50 con 0x7eff0013b2c0 2023-07-27T20:32:56.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.064+0000 7eff07dff700 1 -- 172.21.15.72:0/2771887306 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7efee406ace0 msgr2=0x7efee406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:56.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.064+0000 7eff07dff700 1 --2- 172.21.15.72:0/2771887306 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7efee406ace0 0x7efee406d1a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7efefc009b90 tx=0x7efefc008040 comp rx=0 tx=0).stop 2023-07-27T20:32:56.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.064+0000 7eff07dff700 1 -- 172.21.15.72:0/2771887306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff0013b2c0 msgr2=0x7eff00137b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:56.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.064+0000 7eff07dff700 1 --2- 172.21.15.72:0/2771887306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff0013b2c0 0x7eff00137b60 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7eff000723d0 tx=0x7efef8004ad0 comp rx=0 tx=0).stop 2023-07-27T20:32:56.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.064+0000 7eff07dff700 1 -- 172.21.15.72:0/2771887306 shutdown_connections 2023-07-27T20:32:56.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.064+0000 7eff07dff700 1 --2- 172.21.15.72:0/2771887306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff0013b2c0 0x7eff00137b60 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:56.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.064+0000 7eff07dff700 1 --2- 172.21.15.72:0/2771887306 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7efee406ace0 0x7efee406d1a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:56.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.064+0000 7eff07dff700 1 --2- 172.21.15.72:0/2771887306 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7eff000a83a0 0x7eff001e9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:56.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.064+0000 7eff07dff700 1 --2- 172.21.15.72:0/2771887306 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff000bfd90 0x7eff000be990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:56.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.064+0000 7eff07dff700 1 -- 172.21.15.72:0/2771887306 >> 172.21.15.72:0/2771887306 conn(0x7eff0006a190 msgr2=0x7eff00155830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:56.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.064+0000 7eff07dff700 1 -- 172.21.15.72:0/2771887306 shutdown_connections 2023-07-27T20:32:56.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.065+0000 7eff07dff700 1 -- 172.21.15.72:0/2771887306 wait complete. 2023-07-27T20:32:56.070 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:32:56.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.279+0000 7f4477bff700 1 Processor -- start 2023-07-27T20:32:56.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.279+0000 7f4477bff700 1 -- start start 2023-07-27T20:32:56.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.280+0000 7f4477bff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f447006b150 0x7f44700c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:56.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.280+0000 7f4477bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44701549f0 0x7f44701514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:56.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.280+0000 7f4477bff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f447006b710 con 0x7f44700c4400 2023-07-27T20:32:56.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.280+0000 7f4477bff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44701545d0 con 0x7f447006b150 2023-07-27T20:32:56.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.280+0000 7f4477bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f447006c860 con 0x7f44701549f0 2023-07-27T20:32:56.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.281+0000 7f447619c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44701549f0 0x7f44701514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:56.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.281+0000 7f447619c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44701549f0 0x7f44701514a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.72:49466/0 (socket says 172.21.15.72:49466) 2023-07-27T20:32:56.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.281+0000 7f447619c700 1 -- 172.21.15.72:0/991025775 learned_addr learned my addr 172.21.15.72:0/991025775 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:56.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.281+0000 7f447599b700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f44700c4400 0x7f44700c4cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.72:44046/0 (socket says 172.21.15.72:44046) 2023-07-27T20:32:56.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.281+0000 7f447519a700 1 --2- 172.21.15.72:0/991025775 >> v2:172.21.15.173:3300/0 conn(0x7f447006b150 0x7f44700c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:56.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.281+0000 7f447619c700 1 -- 172.21.15.72:0/991025775 >> v2:172.21.15.173:3300/0 conn(0x7f447006b150 msgr2=0x7f44700c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:56.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.281+0000 7f447619c700 1 --2- 172.21.15.72:0/991025775 >> v2:172.21.15.173:3300/0 conn(0x7f447006b150 0x7f44700c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:56.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.281+0000 7f447619c700 1 -- 172.21.15.72:0/991025775 >> v1:172.21.15.173:6789/0 conn(0x7f44700c4400 legacy=0x7f44700c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:56.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.281+0000 7f4474999700 1 -- 172.21.15.72:0/991025775 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1569989635 0 0) 0x7f447006b710 con 0x7f44700c4400 2023-07-27T20:32:56.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.281+0000 7f447619c700 1 -- 172.21.15.72:0/991025775 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f447006b9f0 con 0x7f44701549f0 2023-07-27T20:32:56.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.281+0000 7f447619c700 1 --2- 172.21.15.72:0/991025775 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44701549f0 0x7f44701514a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4468009e50 tx=0x7f446800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eea28c00a8a4808f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:56.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.282+0000 7f4474999700 1 -- 172.21.15.72:0/991025775 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446800e070 con 0x7f44701549f0 2023-07-27T20:32:56.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.282+0000 7f4474999700 1 -- 172.21.15.72:0/991025775 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446800b910 con 0x7f44701549f0 2023-07-27T20:32:56.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.282+0000 7f4474999700 1 -- 172.21.15.72:0/991025775 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446800bcc0 con 0x7f44701549f0 2023-07-27T20:32:56.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.282+0000 7f4477bff700 1 -- 172.21.15.72:0/991025775 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44701549f0 msgr2=0x7f44701514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:56.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.282+0000 7f4477bff700 1 --2- 172.21.15.72:0/991025775 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44701549f0 0x7f44701514a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4468009e50 tx=0x7f446800b330 comp rx=0 tx=0).stop 2023-07-27T20:32:56.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.282+0000 7f4477bff700 1 -- 172.21.15.72:0/991025775 shutdown_connections 2023-07-27T20:32:56.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.282+0000 7f4477bff700 1 --2- 172.21.15.72:0/991025775 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44701549f0 0x7f44701514a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:56.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.282+0000 7f4477bff700 1 --2- 172.21.15.72:0/991025775 >> v2:172.21.15.173:3300/0 conn(0x7f447006b150 0x7f44700c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:56.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.282+0000 7f4477bff700 1 -- 172.21.15.72:0/991025775 >> 172.21.15.72:0/991025775 conn(0x7f44700ab300 msgr2=0x7f44700ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:56.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.282+0000 7f4477bff700 1 -- 172.21.15.72:0/991025775 shutdown_connections 2023-07-27T20:32:56.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.282+0000 7f4477bff700 1 -- 172.21.15.72:0/991025775 wait complete. 2023-07-27T20:32:56.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.284+0000 7f4477bff700 1 Processor -- start 2023-07-27T20:32:56.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.284+0000 7f4477bff700 1 -- start start 2023-07-27T20:32:56.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.285+0000 7f4477bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f447006b150 0x7f44700aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:56.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.285+0000 7f4477bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44700c4400 0x7f4470149bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:56.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.285+0000 7f4477bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44701549f0 0x7f447014a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:56.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.285+0000 7f4477bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44700c1c20 con 0x7f44700c4400 2023-07-27T20:32:56.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.285+0000 7f4477bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447014d4b0 con 0x7f44701549f0 2023-07-27T20:32:56.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.285+0000 7f4477bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f447014a640 con 0x7f447006b150 2023-07-27T20:32:56.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.285+0000 7f447519a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44700c4400 0x7f4470149bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:56.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.285+0000 7f447519a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44700c4400 0x7f4470149bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49968/0 (socket says 172.21.15.72:49968) 2023-07-27T20:32:56.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.285+0000 7f447519a700 1 -- 172.21.15.72:0/219912700 learned_addr learned my addr 172.21.15.72:0/219912700 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:56.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.286+0000 7f447619c700 1 --2- 172.21.15.72:0/219912700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44701549f0 0x7f447014a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:56.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.286+0000 7f447599b700 1 --2- 172.21.15.72:0/219912700 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f447006b150 0x7f44700aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:56.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.286+0000 7f447519a700 1 -- 172.21.15.72:0/219912700 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f447006b150 msgr2=0x7f44700aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:56.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.286+0000 7f447519a700 1 --2- 172.21.15.72:0/219912700 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f447006b150 0x7f44700aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:56.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.286+0000 7f447519a700 1 -- 172.21.15.72:0/219912700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44701549f0 msgr2=0x7f447014a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:56.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.286+0000 7f447519a700 1 --2- 172.21.15.72:0/219912700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44701549f0 0x7f447014a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:56.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.286+0000 7f447519a700 1 -- 172.21.15.72:0/219912700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4468009b30 con 0x7f44700c4400 2023-07-27T20:32:56.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.286+0000 7f447519a700 1 --2- 172.21.15.72:0/219912700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44700c4400 0x7f4470149bc0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f446000e8a0 tx=0x7f446000ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:56.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.286+0000 7f44667fc700 1 -- 172.21.15.72:0/219912700 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4460009590 con 0x7f44700c4400 2023-07-27T20:32:56.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.286+0000 7f44667fc700 1 -- 172.21.15.72:0/219912700 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446000eea0 con 0x7f44700c4400 2023-07-27T20:32:56.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.286+0000 7f44667fc700 1 -- 172.21.15.72:0/219912700 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446000ca50 con 0x7f44700c4400 2023-07-27T20:32:56.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.286+0000 7f4477bff700 1 -- 172.21.15.72:0/219912700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f447014d1d0 con 0x7f44700c4400 2023-07-27T20:32:56.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.286+0000 7f4477bff700 1 -- 172.21.15.72:0/219912700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44700c1470 con 0x7f44700c4400 2023-07-27T20:32:56.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.287+0000 7f4477bff700 1 -- 172.21.15.72:0/219912700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4470074310 con 0x7f44700c4400 2023-07-27T20:32:56.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.288+0000 7f44667fc700 1 -- 172.21.15.72:0/219912700 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f446000cbb0 con 0x7f44700c4400 2023-07-27T20:32:56.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.289+0000 7f44667fc700 1 --2- 172.21.15.72:0/219912700 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f445406ace0 0x7f445406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:56.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.289+0000 7f44667fc700 1 -- 172.21.15.72:0/219912700 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f4460089240 con 0x7f44700c4400 2023-07-27T20:32:56.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.290+0000 7f447599b700 1 --2- 172.21.15.72:0/219912700 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f445406ace0 0x7f445406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:56.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.290+0000 7f447599b700 1 --2- 172.21.15.72:0/219912700 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f445406ace0 0x7f445406d1a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f446c000f60 tx=0x7f446c007be0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:56.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.294+0000 7f44667fc700 1 -- 172.21.15.72:0/219912700 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4460057f80 con 0x7f44700c4400 2023-07-27T20:32:56.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.486+0000 7f4477bff700 1 -- 172.21.15.72:0/219912700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44700c17e0 con 0x7f44700c4400 2023-07-27T20:32:56.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.487+0000 7f44667fc700 1 -- 172.21.15.72:0/219912700 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+14844 (secure 0 0 0) 0x7f4460057b10 con 0x7f44700c4400 2023-07-27T20:32:56.476 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:32:56.476 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":37,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:32:52.486442+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:32:56.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.489+0000 7f4477bff700 1 -- 172.21.15.72:0/219912700 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f445406ace0 msgr2=0x7f445406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:56.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.489+0000 7f4477bff700 1 --2- 172.21.15.72:0/219912700 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f445406ace0 0x7f445406d1a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f446c000f60 tx=0x7f446c007be0 comp rx=0 tx=0).stop 2023-07-27T20:32:56.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.489+0000 7f4477bff700 1 -- 172.21.15.72:0/219912700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44700c4400 msgr2=0x7f4470149bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:56.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.489+0000 7f4477bff700 1 --2- 172.21.15.72:0/219912700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44700c4400 0x7f4470149bc0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f446000e8a0 tx=0x7f446000ec60 comp rx=0 tx=0).stop 2023-07-27T20:32:56.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.490+0000 7f4477bff700 1 -- 172.21.15.72:0/219912700 shutdown_connections 2023-07-27T20:32:56.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.490+0000 7f4477bff700 1 --2- 172.21.15.72:0/219912700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44701549f0 0x7f447014a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:56.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.490+0000 7f4477bff700 1 --2- 172.21.15.72:0/219912700 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f445406ace0 0x7f445406d1a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:56.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.490+0000 7f4477bff700 1 --2- 172.21.15.72:0/219912700 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f447006b150 0x7f44700aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:56.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.490+0000 7f4477bff700 1 --2- 172.21.15.72:0/219912700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44700c4400 0x7f4470149bc0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:56.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.490+0000 7f4477bff700 1 -- 172.21.15.72:0/219912700 >> 172.21.15.72:0/219912700 conn(0x7f44700ab300 msgr2=0x7f4470152e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:56.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.490+0000 7f4477bff700 1 -- 172.21.15.72:0/219912700 shutdown_connections 2023-07-27T20:32:56.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.490+0000 7f4477bff700 1 -- 172.21.15.72:0/219912700 wait complete. 2023-07-27T20:32:56.496 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-27T20:31:14.581785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T20:31:21.077941+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-27T20:32:56.496 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-27T20:32:56.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.706+0000 7f7d2ddff700 1 Processor -- start 2023-07-27T20:32:56.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.706+0000 7f7d2ddff700 1 -- start start 2023-07-27T20:32:56.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.707+0000 7f7d2ddff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7d2814aab0 0x7f7d28154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:56.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.707+0000 7f7d2ddff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7d280c7740 0x7f7d280c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:56.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.707+0000 7f7d2ddff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d280c7c50 con 0x7f7d280c4700 2023-07-27T20:32:56.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.707+0000 7f7d2ddff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d2806bd40 con 0x7f7d280c7740 2023-07-27T20:32:56.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.707+0000 7f7d2ddff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d280c62f0 con 0x7f7d2814aab0 2023-07-27T20:32:56.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.707+0000 7f7d27fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7d280c4700 0x7f7d2806c1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33640/0 (socket says 172.21.15.72:33640) 2023-07-27T20:32:56.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.707+0000 7f7d27fff700 1 -- 172.21.15.72:0/3919674236 learned_addr learned my addr 172.21.15.72:0/3919674236 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:56.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.707+0000 7f7d26ffd700 1 --2- 172.21.15.72:0/3919674236 >> v2:172.21.15.173:3300/0 conn(0x7f7d280c7740 0x7f7d280c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:56.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.707+0000 7f7d277fe700 1 --2- 172.21.15.72:0/3919674236 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7d2814aab0 0x7f7d28154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:56.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.707+0000 7f7d267fc700 1 -- 172.21.15.72:0/3919674236 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1983477694 0 0) 0x7f7d280c7c50 con 0x7f7d280c4700 2023-07-27T20:32:56.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.707+0000 7f7d267fc700 1 -- 172.21.15.72:0/3919674236 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d100035b0 con 0x7f7d280c4700 2023-07-27T20:32:56.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.708+0000 7f7d267fc700 1 -- 172.21.15.72:0/3919674236 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1976079397 0 0) 0x7f7d100035b0 con 0x7f7d280c4700 2023-07-27T20:32:56.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.708+0000 7f7d267fc700 1 -- 172.21.15.72:0/3919674236 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7d2814aab0 msgr2=0x7f7d28154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:56.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.708+0000 7f7d267fc700 1 --2- 172.21.15.72:0/3919674236 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7d2814aab0 0x7f7d28154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:56.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.708+0000 7f7d267fc700 1 -- 172.21.15.72:0/3919674236 >> v2:172.21.15.173:3300/0 conn(0x7f7d280c7740 msgr2=0x7f7d280c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:56.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.708+0000 7f7d267fc700 1 --2- 172.21.15.72:0/3919674236 >> v2:172.21.15.173:3300/0 conn(0x7f7d280c7740 0x7f7d280c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:56.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.708+0000 7f7d267fc700 1 -- 172.21.15.72:0/3919674236 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d28155050 con 0x7f7d280c4700 2023-07-27T20:32:56.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.708+0000 7f7d267fc700 1 -- 172.21.15.72:0/3919674236 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f7d200019f0 con 0x7f7d280c4700 2023-07-27T20:32:56.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.708+0000 7f7d267fc700 1 -- 172.21.15.72:0/3919674236 >> v1:172.21.15.72:6789/0 conn(0x7f7d280c4700 legacy=0x7f7d2806c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:56.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.708+0000 7f7d267fc700 1 --2- 172.21.15.72:0/3919674236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d10003a00 0x7f7d10003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:56.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.708+0000 7f7d267fc700 1 --2- 172.21.15.72:0/3919674236 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7d2814aab0 0x7f7d10004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:56.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.708+0000 7f7d267fc700 1 --2- 172.21.15.72:0/3919674236 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d10004d90 0x7f7d10005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:56.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.708+0000 7f7d267fc700 1 -- 172.21.15.72:0/3919674236 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2806bd40 con 0x7f7d10003a00 2023-07-27T20:32:56.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.708+0000 7f7d267fc700 1 -- 172.21.15.72:0/3919674236 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d280c62f0 con 0x7f7d10004d90 2023-07-27T20:32:56.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.708+0000 7f7d267fc700 1 -- 172.21.15.72:0/3919674236 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1000ba10 con 0x7f7d2814aab0 2023-07-27T20:32:56.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.708+0000 7f7d26ffd700 1 --2- 172.21.15.72:0/3919674236 >> v2:172.21.15.173:3300/0 conn(0x7f7d280c7740 0x7f7d280c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:32:56.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.708+0000 7f7d277fe700 1 --2- 172.21.15.72:0/3919674236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d10003a00 0x7f7d10003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:56.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.708+0000 7f7d27fff700 1 --2- 172.21.15.72:0/3919674236 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d10004d90 0x7f7d10005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:56.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.709+0000 7f7d277fe700 1 -- 172.21.15.72:0/3919674236 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7d2814aab0 msgr2=0x7f7d10004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:56.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.709+0000 7f7d26ffd700 1 --2- 172.21.15.72:0/3919674236 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7d2814aab0 0x7f7d10004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:56.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.709+0000 7f7d277fe700 1 --2- 172.21.15.72:0/3919674236 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7d2814aab0 0x7f7d10004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:56.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.709+0000 7f7d277fe700 1 -- 172.21.15.72:0/3919674236 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d10004d90 msgr2=0x7f7d10005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:56.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.709+0000 7f7d277fe700 1 --2- 172.21.15.72:0/3919674236 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d10004d90 0x7f7d10005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:56.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.709+0000 7f7d277fe700 1 -- 172.21.15.72:0/3919674236 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d100035b0 con 0x7f7d10003a00 2023-07-27T20:32:56.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.709+0000 7f7d27fff700 1 --2- 172.21.15.72:0/3919674236 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d10004d90 0x7f7d10005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:56.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.709+0000 7f7d26ffd700 1 --2- 172.21.15.72:0/3919674236 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7d2814aab0 0x7f7d10004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:32:56.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.709+0000 7f7d277fe700 1 --2- 172.21.15.72:0/3919674236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d10003a00 0x7f7d10003e20 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7d18009b60 tx=0x7f7d10005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=434a86c596835136 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:56.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.709+0000 7f7d267fc700 1 -- 172.21.15.72:0/3919674236 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1800e6c0 con 0x7f7d10003a00 2023-07-27T20:32:56.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.709+0000 7f7d267fc700 1 -- 172.21.15.72:0/3919674236 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d1800e820 con 0x7f7d10003a00 2023-07-27T20:32:56.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.709+0000 7f7d267fc700 1 -- 172.21.15.72:0/3919674236 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1800eb90 con 0x7f7d10003a00 2023-07-27T20:32:56.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.710+0000 7f7d2ddff700 1 -- 172.21.15.72:0/3919674236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d10003a00 msgr2=0x7f7d10003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:56.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.710+0000 7f7d2ddff700 1 --2- 172.21.15.72:0/3919674236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d10003a00 0x7f7d10003e20 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7d18009b60 tx=0x7f7d10005880 comp rx=0 tx=0).stop 2023-07-27T20:32:56.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.710+0000 7f7d27fff700 1 -- 172.21.15.72:0/3919674236 reap_dead start 2023-07-27T20:32:56.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.710+0000 7f7d2ddff700 1 -- 172.21.15.72:0/3919674236 shutdown_connections 2023-07-27T20:32:56.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.710+0000 7f7d2ddff700 1 -- 172.21.15.72:0/3919674236 >> 172.21.15.72:0/3919674236 conn(0x7f7d280ab3f0 msgr2=0x7f7d280ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:56.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.710+0000 7f7d2ddff700 1 -- 172.21.15.72:0/3919674236 shutdown_connections 2023-07-27T20:32:56.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.710+0000 7f7d2ddff700 1 -- 172.21.15.72:0/3919674236 wait complete. 2023-07-27T20:32:56.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.711+0000 7f7d2ddff700 1 Processor -- start 2023-07-27T20:32:56.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.712+0000 7f7d2ddff700 1 -- start start 2023-07-27T20:32:56.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.712+0000 7f7d2ddff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d10003a00 0x7f7d280bfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:56.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.713+0000 7f7d2ddff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d280c2d50 0x7f7d281ecde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:56.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.713+0000 7f7d2ddff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7d281ed320 0x7f7d28149b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:56.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.713+0000 7f7d2ddff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d281ed7a0 con 0x7f7d10003a00 2023-07-27T20:32:56.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.713+0000 7f7d2ddff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d28157b70 con 0x7f7d280c2d50 2023-07-27T20:32:56.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.713+0000 7f7d2ddff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d28158660 con 0x7f7d281ed320 2023-07-27T20:32:56.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.713+0000 7f7d277fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d10003a00 0x7f7d280bfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:56.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.713+0000 7f7d277fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d10003a00 0x7f7d280bfcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49978/0 (socket says 172.21.15.72:49978) 2023-07-27T20:32:56.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.713+0000 7f7d277fe700 1 -- 172.21.15.72:0/4182241870 learned_addr learned my addr 172.21.15.72:0/4182241870 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:56.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.713+0000 7f7d277fe700 1 -- 172.21.15.72:0/4182241870 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7d281ed320 msgr2=0x7f7d28149b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:56.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.713+0000 7f7d277fe700 1 --2- 172.21.15.72:0/4182241870 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7d281ed320 0x7f7d28149b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:56.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.713+0000 7f7d277fe700 1 -- 172.21.15.72:0/4182241870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d280c2d50 msgr2=0x7f7d281ecde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:56.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.713+0000 7f7d277fe700 1 --2- 172.21.15.72:0/4182241870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d280c2d50 0x7f7d281ecde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:56.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.713+0000 7f7d277fe700 1 -- 172.21.15.72:0/4182241870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d281580a0 con 0x7f7d10003a00 2023-07-27T20:32:56.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.713+0000 7f7d277fe700 1 --2- 172.21.15.72:0/4182241870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d10003a00 0x7f7d280bfcc0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f7d10004730 tx=0x7f7d180047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:56.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.714+0000 7f7d0ffff700 1 -- 172.21.15.72:0/4182241870 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1800e6c0 con 0x7f7d10003a00 2023-07-27T20:32:56.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.714+0000 7f7d0ffff700 1 -- 172.21.15.72:0/4182241870 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d18003ad0 con 0x7f7d10003a00 2023-07-27T20:32:56.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.714+0000 7f7d2ddff700 1 -- 172.21.15.72:0/4182241870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d28158380 con 0x7f7d10003a00 2023-07-27T20:32:56.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.714+0000 7f7d0ffff700 1 -- 172.21.15.72:0/4182241870 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d180045d0 con 0x7f7d10003a00 2023-07-27T20:32:56.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.714+0000 7f7d2ddff700 1 -- 172.21.15.72:0/4182241870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d281558b0 con 0x7f7d10003a00 2023-07-27T20:32:56.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.715+0000 7f7d2ddff700 1 -- 172.21.15.72:0/4182241870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d281ed740 con 0x7f7d10003a00 2023-07-27T20:32:56.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.716+0000 7f7d0ffff700 1 -- 172.21.15.72:0/4182241870 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7d18013470 con 0x7f7d10003a00 2023-07-27T20:32:56.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.717+0000 7f7d0ffff700 1 --2- 172.21.15.72:0/4182241870 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f7d1406ace0 0x7f7d1406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:56.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.717+0000 7f7d0ffff700 1 -- 172.21.15.72:0/4182241870 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f7d1808aac0 con 0x7f7d10003a00 2023-07-27T20:32:56.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.717+0000 7f7d26ffd700 1 --2- 172.21.15.72:0/4182241870 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f7d1406ace0 0x7f7d1406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:56.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.718+0000 7f7d26ffd700 1 --2- 172.21.15.72:0/4182241870 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f7d1406ace0 0x7f7d1406d1a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7d280c0460 tx=0x7f7d1c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:56.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.721+0000 7f7d0ffff700 1 -- 172.21.15.72:0/4182241870 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7d281ed740 con 0x7f7d10003a00 2023-07-27T20:32:56.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.914+0000 7f7d2ddff700 1 -- 172.21.15.72:0/4182241870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7d281ed740 con 0x7f7d10003a00 2023-07-27T20:32:56.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.915+0000 7f7d0ffff700 1 -- 172.21.15.72:0/4182241870 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7d281ed740 con 0x7f7d10003a00 2023-07-27T20:32:56.904 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-27T20:32:56.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.917+0000 7f7d2ddff700 1 -- 172.21.15.72:0/4182241870 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f7d1406ace0 msgr2=0x7f7d1406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:56.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.917+0000 7f7d2ddff700 1 --2- 172.21.15.72:0/4182241870 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f7d1406ace0 0x7f7d1406d1a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7d280c0460 tx=0x7f7d1c008040 comp rx=0 tx=0).stop 2023-07-27T20:32:56.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.917+0000 7f7d2ddff700 1 -- 172.21.15.72:0/4182241870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d10003a00 msgr2=0x7f7d280bfcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:56.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.917+0000 7f7d2ddff700 1 --2- 172.21.15.72:0/4182241870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d10003a00 0x7f7d280bfcc0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f7d10004730 tx=0x7f7d180047c0 comp rx=0 tx=0).stop 2023-07-27T20:32:56.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.917+0000 7f7d2ddff700 1 -- 172.21.15.72:0/4182241870 shutdown_connections 2023-07-27T20:32:56.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.917+0000 7f7d2ddff700 1 --2- 172.21.15.72:0/4182241870 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f7d1406ace0 0x7f7d1406d1a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:56.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.917+0000 7f7d2ddff700 1 --2- 172.21.15.72:0/4182241870 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7d281ed320 0x7f7d28149b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:56.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.917+0000 7f7d2ddff700 1 --2- 172.21.15.72:0/4182241870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d10003a00 0x7f7d280bfcc0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:56.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.917+0000 7f7d2ddff700 1 --2- 172.21.15.72:0/4182241870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d280c2d50 0x7f7d281ecde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:56.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.917+0000 7f7d2ddff700 1 -- 172.21.15.72:0/4182241870 >> 172.21.15.72:0/4182241870 conn(0x7f7d280ab3f0 msgr2=0x7f7d280ae4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:56.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.917+0000 7f7d2ddff700 1 -- 172.21.15.72:0/4182241870 shutdown_connections 2023-07-27T20:32:56.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:56.917+0000 7f7d2ddff700 1 -- 172.21.15.72:0/4182241870 wait complete. 2023-07-27T20:32:56.924 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T20:32:57.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.134+0000 7f03419ff700 1 Processor -- start 2023-07-27T20:32:57.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.135+0000 7f03419ff700 1 -- start start 2023-07-27T20:32:57.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.136+0000 7f03419ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f033c14db30 0x7f033c0bb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:57.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.136+0000 7f03419ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f033c0baf20 con 0x7f033c0bb7e0 2023-07-27T20:32:57.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.136+0000 7f03419ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f033c14df10 con 0x7f033c0c0f80 2023-07-27T20:32:57.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.136+0000 7f03419ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f033c0bbd40 con 0x7f033c14db30 2023-07-27T20:32:57.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.137+0000 7f033a7fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f033c0bb7e0 0x7f033c153a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33644/0 (socket says 172.21.15.72:33644) 2023-07-27T20:32:57.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.137+0000 7f033a7fc700 1 -- 172.21.15.72:0/2409636141 learned_addr learned my addr 172.21.15.72:0/2409636141 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:57.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.137+0000 7f033affd700 1 --2- 172.21.15.72:0/2409636141 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f033c14db30 0x7f033c0bb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:57.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.137+0000 7f0339ffb700 1 -- 172.21.15.72:0/2409636141 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 391648259 0 0) 0x7f033c0baf20 con 0x7f033c0bb7e0 2023-07-27T20:32:57.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.137+0000 7f0339ffb700 1 -- 172.21.15.72:0/2409636141 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03240035b0 con 0x7f033c0bb7e0 2023-07-27T20:32:57.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.137+0000 7f0339ffb700 1 -- 172.21.15.72:0/2409636141 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1186696185 0 0) 0x7f033c14df10 con 0x7f033c0c0f80 2023-07-27T20:32:57.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.137+0000 7f0339ffb700 1 -- 172.21.15.72:0/2409636141 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f033c0baf20 con 0x7f033c0c0f80 2023-07-27T20:32:57.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.137+0000 7f033affd700 1 -- 172.21.15.72:0/2409636141 >> v1:172.21.15.173:6789/0 conn(0x7f033c0c0f80 legacy=0x7f033c15ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:57.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.137+0000 7f033affd700 1 -- 172.21.15.72:0/2409636141 >> v1:172.21.15.72:6789/0 conn(0x7f033c0bb7e0 legacy=0x7f033c153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:57.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.137+0000 7f033affd700 1 -- 172.21.15.72:0/2409636141 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033c0ba440 con 0x7f033c14db30 2023-07-27T20:32:57.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.138+0000 7f033affd700 1 --2- 172.21.15.72:0/2409636141 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f033c14db30 0x7f033c0bb2a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f032c00aa10 tx=0x7f032c00ad20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e071e4fd2931a2c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:57.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.138+0000 7f0339ffb700 1 -- 172.21.15.72:0/2409636141 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c00cb70 con 0x7f033c14db30 2023-07-27T20:32:57.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.138+0000 7f0339ffb700 1 -- 172.21.15.72:0/2409636141 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032c00ccd0 con 0x7f033c14db30 2023-07-27T20:32:57.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.138+0000 7f0339ffb700 1 -- 172.21.15.72:0/2409636141 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c018620 con 0x7f033c14db30 2023-07-27T20:32:57.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.138+0000 7f03419ff700 1 -- 172.21.15.72:0/2409636141 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f033c14db30 msgr2=0x7f033c0bb2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:57.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.138+0000 7f03419ff700 1 --2- 172.21.15.72:0/2409636141 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f033c14db30 0x7f033c0bb2a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f032c00aa10 tx=0x7f032c00ad20 comp rx=0 tx=0).stop 2023-07-27T20:32:57.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.138+0000 7f03419ff700 1 -- 172.21.15.72:0/2409636141 shutdown_connections 2023-07-27T20:32:57.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.138+0000 7f03419ff700 1 --2- 172.21.15.72:0/2409636141 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f033c14db30 0x7f033c0bb2a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:57.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.138+0000 7f03419ff700 1 -- 172.21.15.72:0/2409636141 >> 172.21.15.72:0/2409636141 conn(0x7f033c06a190 msgr2=0x7f033c06a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:57.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.139+0000 7f03419ff700 1 -- 172.21.15.72:0/2409636141 shutdown_connections 2023-07-27T20:32:57.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.139+0000 7f03419ff700 1 -- 172.21.15.72:0/2409636141 wait complete. 2023-07-27T20:32:57.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.140+0000 7f03419ff700 1 Processor -- start 2023-07-27T20:32:57.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.140+0000 7f03419ff700 1 -- start start 2023-07-27T20:32:57.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.141+0000 7f03419ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f033c0bb7e0 0x7f033c1e53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:57.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.141+0000 7f03419ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f033c0c0f80 0x7f033c1e5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:57.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.141+0000 7f03419ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f033c14db30 0x7f033c1404f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:57.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.141+0000 7f03419ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033c0bc7b0 con 0x7f033c0bb7e0 2023-07-27T20:32:57.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.141+0000 7f03419ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033c1ea2b0 con 0x7f033c0c0f80 2023-07-27T20:32:57.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.141+0000 7f03419ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f033c1e5e70 con 0x7f033c14db30 2023-07-27T20:32:57.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.141+0000 7f033affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f033c0bb7e0 0x7f033c1e53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:57.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.141+0000 7f033affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f033c0bb7e0 0x7f033c1e53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49988/0 (socket says 172.21.15.72:49988) 2023-07-27T20:32:57.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.142+0000 7f033affd700 1 -- 172.21.15.72:0/390607684 learned_addr learned my addr 172.21.15.72:0/390607684 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:57.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.142+0000 7f033a7fc700 1 --2- 172.21.15.72:0/390607684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f033c0c0f80 0x7f033c1e5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:57.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.142+0000 7f033b7fe700 1 --2- 172.21.15.72:0/390607684 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f033c14db30 0x7f033c1404f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:57.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.142+0000 7f033affd700 1 -- 172.21.15.72:0/390607684 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f033c14db30 msgr2=0x7f033c1404f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:57.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.142+0000 7f033affd700 1 --2- 172.21.15.72:0/390607684 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f033c14db30 0x7f033c1404f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:57.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.142+0000 7f033affd700 1 -- 172.21.15.72:0/390607684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f033c0c0f80 msgr2=0x7f033c1e5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:57.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.142+0000 7f033affd700 1 --2- 172.21.15.72:0/390607684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f033c0c0f80 0x7f033c1e5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:57.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.142+0000 7f033affd700 1 -- 172.21.15.72:0/390607684 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f032c00a640 con 0x7f033c0bb7e0 2023-07-27T20:32:57.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.142+0000 7f033b7fe700 1 --2- 172.21.15.72:0/390607684 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f033c14db30 0x7f033c1404f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:57.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.142+0000 7f033affd700 1 --2- 172.21.15.72:0/390607684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f033c0bb7e0 0x7f033c1e53f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f032c00a960 tx=0x7f032c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:57.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.142+0000 7f0323fff700 1 -- 172.21.15.72:0/390607684 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c00c970 con 0x7f033c0bb7e0 2023-07-27T20:32:57.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.142+0000 7f0323fff700 1 -- 172.21.15.72:0/390607684 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032c00caf0 con 0x7f033c0bb7e0 2023-07-27T20:32:57.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.142+0000 7f0323fff700 1 -- 172.21.15.72:0/390607684 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c023660 con 0x7f033c0bb7e0 2023-07-27T20:32:57.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.142+0000 7f03419ff700 1 -- 172.21.15.72:0/390607684 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f033c1ea740 con 0x7f033c0bb7e0 2023-07-27T20:32:57.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.143+0000 7f03419ff700 1 -- 172.21.15.72:0/390607684 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f033c1e9980 con 0x7f033c0bb7e0 2023-07-27T20:32:57.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.144+0000 7f03419ff700 1 -- 172.21.15.72:0/390607684 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f033c1ea590 con 0x7f033c0bb7e0 2023-07-27T20:32:57.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.144+0000 7f0323fff700 1 -- 172.21.15.72:0/390607684 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f032c021070 con 0x7f033c0bb7e0 2023-07-27T20:32:57.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.145+0000 7f0323fff700 1 --2- 172.21.15.72:0/390607684 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f032806ace0 0x7f032806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:57.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.145+0000 7f0323fff700 1 -- 172.21.15.72:0/390607684 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f032c089fb0 con 0x7f033c0bb7e0 2023-07-27T20:32:57.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.146+0000 7f033a7fc700 1 --2- 172.21.15.72:0/390607684 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f032806ace0 0x7f032806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:57.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.146+0000 7f033a7fc700 1 --2- 172.21.15.72:0/390607684 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f032806ace0 0x7f032806d1a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f033c0713e0 tx=0x7f0330007e00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:57.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.150+0000 7f0323fff700 1 -- 172.21.15.72:0/390607684 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f032c0bc310 con 0x7f033c0bb7e0 2023-07-27T20:32:57.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.344+0000 7f03419ff700 1 -- 172.21.15.72:0/390607684 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f033c0721e0 con 0x7f033c0bb7e0 2023-07-27T20:32:57.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.344+0000 7f0323fff700 1 -- 172.21.15.72:0/390607684 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v37) v1 ==== 92+0+10 (secure 0 0 0) 0x7f032c0280a0 con 0x7f033c0bb7e0 2023-07-27T20:32:57.333 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-27T20:32:57.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.347+0000 7f03419ff700 1 -- 172.21.15.72:0/390607684 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f032806ace0 msgr2=0x7f032806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:57.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.347+0000 7f03419ff700 1 --2- 172.21.15.72:0/390607684 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f032806ace0 0x7f032806d1a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f033c0713e0 tx=0x7f0330007e00 comp rx=0 tx=0).stop 2023-07-27T20:32:57.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.347+0000 7f03419ff700 1 -- 172.21.15.72:0/390607684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f033c0bb7e0 msgr2=0x7f033c1e53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:57.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.347+0000 7f03419ff700 1 --2- 172.21.15.72:0/390607684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f033c0bb7e0 0x7f033c1e53f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f032c00a960 tx=0x7f032c0047c0 comp rx=0 tx=0).stop 2023-07-27T20:32:57.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.347+0000 7f03419ff700 1 -- 172.21.15.72:0/390607684 shutdown_connections 2023-07-27T20:32:57.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.347+0000 7f03419ff700 1 --2- 172.21.15.72:0/390607684 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f032806ace0 0x7f032806d1a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:57.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.347+0000 7f03419ff700 1 --2- 172.21.15.72:0/390607684 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f033c14db30 0x7f033c1404f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:57.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.347+0000 7f03419ff700 1 --2- 172.21.15.72:0/390607684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f033c0bb7e0 0x7f033c1e53f0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:57.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.347+0000 7f03419ff700 1 --2- 172.21.15.72:0/390607684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f033c0c0f80 0x7f033c1e5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:57.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.347+0000 7f03419ff700 1 -- 172.21.15.72:0/390607684 >> 172.21.15.72:0/390607684 conn(0x7f033c06a190 msgr2=0x7f033c153b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:57.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.347+0000 7f03419ff700 1 -- 172.21.15.72:0/390607684 shutdown_connections 2023-07-27T20:32:57.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.347+0000 7f03419ff700 1 -- 172.21.15.72:0/390607684 wait complete. 2023-07-27T20:32:57.353 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-27T20:32:57.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.560+0000 7f0b713ff700 1 Processor -- start 2023-07-27T20:32:57.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.560+0000 7f0b713ff700 1 -- start start 2023-07-27T20:32:57.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.561+0000 7f0b713ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0b6c06b520 0x7f0b6c0a8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:57.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.561+0000 7f0b713ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0b6c06ef00 0x7f0b6c06b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:57.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.561+0000 7f0b713ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b6c06e270 con 0x7f0b6c158000 2023-07-27T20:32:57.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.561+0000 7f0b713ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b6c0c1850 con 0x7f0b6c06ef00 2023-07-27T20:32:57.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.561+0000 7f0b713ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b6c06e7a0 con 0x7f0b6c06b520 2023-07-27T20:32:57.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.562+0000 7f0b63fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0b6c06ef00 0x7f0b6c06b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:57.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.562+0000 7f0b63fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0b6c06ef00 0x7f0b6c06b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49990/0 (socket says 172.21.15.72:49990) 2023-07-27T20:32:57.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.562+0000 7f0b63fff700 1 -- 172.21.15.72:0/375605638 learned_addr learned my addr 172.21.15.72:0/375605638 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:57.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.562+0000 7f0b6affd700 1 --2- 172.21.15.72:0/375605638 >> v2:172.21.15.173:3300/0 conn(0x7f0b6c06b520 0x7f0b6c0a8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:57.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.562+0000 7f0b63fff700 1 -- 172.21.15.72:0/375605638 >> v2:172.21.15.173:3300/0 conn(0x7f0b6c06b520 msgr2=0x7f0b6c0a8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:57.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.562+0000 7f0b63fff700 1 --2- 172.21.15.72:0/375605638 >> v2:172.21.15.173:3300/0 conn(0x7f0b6c06b520 0x7f0b6c0a8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:57.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.562+0000 7f0b63fff700 1 -- 172.21.15.72:0/375605638 >> v1:172.21.15.173:6789/0 conn(0x7f0b6c158000 legacy=0x7f0b6c154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:57.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.562+0000 7f0b63fff700 1 -- 172.21.15.72:0/375605638 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6c0c2dd0 con 0x7f0b6c06ef00 2023-07-27T20:32:57.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.562+0000 7f0b6affd700 1 --2- 172.21.15.72:0/375605638 >> v2:172.21.15.173:3300/0 conn(0x7f0b6c06b520 0x7f0b6c0a8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:32:57.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.562+0000 7f0b63fff700 1 --2- 172.21.15.72:0/375605638 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b6c06ef00 0x7f0b6c06b900 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c0c00e0 tx=0x7f0b54009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92cbeea3ca134987 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:57.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.562+0000 7f0b6a7fc700 1 -- 172.21.15.72:0/375605638 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b54004230 con 0x7f0b6c06ef00 2023-07-27T20:32:57.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.563+0000 7f0b6a7fc700 1 -- 172.21.15.72:0/375605638 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b54004390 con 0x7f0b6c06ef00 2023-07-27T20:32:57.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.563+0000 7f0b6a7fc700 1 -- 172.21.15.72:0/375605638 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b540036a0 con 0x7f0b6c06ef00 2023-07-27T20:32:57.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.563+0000 7f0b713ff700 1 -- 172.21.15.72:0/375605638 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b6c06ef00 msgr2=0x7f0b6c06b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:57.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.563+0000 7f0b713ff700 1 --2- 172.21.15.72:0/375605638 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b6c06ef00 0x7f0b6c06b900 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c0c00e0 tx=0x7f0b54009bd0 comp rx=0 tx=0).stop 2023-07-27T20:32:57.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.563+0000 7f0b713ff700 1 -- 172.21.15.72:0/375605638 shutdown_connections 2023-07-27T20:32:57.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.563+0000 7f0b713ff700 1 --2- 172.21.15.72:0/375605638 >> v2:172.21.15.173:3300/0 conn(0x7f0b6c06b520 0x7f0b6c0a8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:57.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.563+0000 7f0b713ff700 1 --2- 172.21.15.72:0/375605638 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b6c06ef00 0x7f0b6c06b900 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:57.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.563+0000 7f0b713ff700 1 -- 172.21.15.72:0/375605638 >> 172.21.15.72:0/375605638 conn(0x7f0b6c0c6800 msgr2=0x7f0b6c0c6c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:57.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.563+0000 7f0b713ff700 1 -- 172.21.15.72:0/375605638 shutdown_connections 2023-07-27T20:32:57.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.563+0000 7f0b713ff700 1 -- 172.21.15.72:0/375605638 wait complete. 2023-07-27T20:32:57.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.565+0000 7f0b713ff700 1 Processor -- start 2023-07-27T20:32:57.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.565+0000 7f0b713ff700 1 -- start start 2023-07-27T20:32:57.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.566+0000 7f0b713ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b6c06b520 0x7f0b6c0a9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:57.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.566+0000 7f0b713ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0b6c06ef00 0x7f0b6c1548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:57.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.566+0000 7f0b713ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b6c158000 0x7f0b6c150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:57.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.566+0000 7f0b713ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c14c470 con 0x7f0b6c06b520 2023-07-27T20:32:57.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.566+0000 7f0b713ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c0ac4b0 con 0x7f0b6c158000 2023-07-27T20:32:57.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.566+0000 7f0b713ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c0a98c0 con 0x7f0b6c06ef00 2023-07-27T20:32:57.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.566+0000 7f0b6affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b6c06b520 0x7f0b6c0a9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:57.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.566+0000 7f0b6affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b6c06b520 0x7f0b6c0a9380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49994/0 (socket says 172.21.15.72:49994) 2023-07-27T20:32:57.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.566+0000 7f0b6affd700 1 -- 172.21.15.72:0/3308813830 learned_addr learned my addr 172.21.15.72:0/3308813830 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:57.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.566+0000 7f0b63fff700 1 --2- 172.21.15.72:0/3308813830 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0b6c06ef00 0x7f0b6c1548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:57.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.566+0000 7f0b6b7fe700 1 --2- 172.21.15.72:0/3308813830 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b6c158000 0x7f0b6c150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:57.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.566+0000 7f0b6affd700 1 -- 172.21.15.72:0/3308813830 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0b6c06ef00 msgr2=0x7f0b6c1548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:57.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.566+0000 7f0b6affd700 1 --2- 172.21.15.72:0/3308813830 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0b6c06ef00 0x7f0b6c1548c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:57.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.566+0000 7f0b6affd700 1 -- 172.21.15.72:0/3308813830 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b6c158000 msgr2=0x7f0b6c150d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:57.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.566+0000 7f0b6affd700 1 --2- 172.21.15.72:0/3308813830 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b6c158000 0x7f0b6c150d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:57.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.566+0000 7f0b6affd700 1 -- 172.21.15.72:0/3308813830 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b54009550 con 0x7f0b6c06b520 2023-07-27T20:32:57.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.567+0000 7f0b6affd700 1 --2- 172.21.15.72:0/3308813830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b6c06b520 0x7f0b6c0a9380 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c00c780 tx=0x7f0b5c00cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:57.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.567+0000 7f0b637fe700 1 -- 172.21.15.72:0/3308813830 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c011800 con 0x7f0b6c06b520 2023-07-27T20:32:57.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.567+0000 7f0b637fe700 1 -- 172.21.15.72:0/3308813830 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5c011960 con 0x7f0b6c06b520 2023-07-27T20:32:57.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.567+0000 7f0b637fe700 1 -- 172.21.15.72:0/3308813830 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c011cd0 con 0x7f0b6c06b520 2023-07-27T20:32:57.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.567+0000 7f0b713ff700 1 -- 172.21.15.72:0/3308813830 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b6c14c6c0 con 0x7f0b6c06b520 2023-07-27T20:32:57.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.567+0000 7f0b713ff700 1 -- 172.21.15.72:0/3308813830 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b6c0ac140 con 0x7f0b6c06b520 2023-07-27T20:32:57.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.568+0000 7f0b713ff700 1 -- 172.21.15.72:0/3308813830 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b6c074310 con 0x7f0b6c06b520 2023-07-27T20:32:57.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.569+0000 7f0b637fe700 1 -- 172.21.15.72:0/3308813830 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0b5c021350 con 0x7f0b6c06b520 2023-07-27T20:32:57.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.570+0000 7f0b637fe700 1 --2- 172.21.15.72:0/3308813830 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0b4c06ace0 0x7f0b4c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:57.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.570+0000 7f0b637fe700 1 -- 172.21.15.72:0/3308813830 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f0b5c089300 con 0x7f0b6c06b520 2023-07-27T20:32:57.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.571+0000 7f0b63fff700 1 --2- 172.21.15.72:0/3308813830 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0b4c06ace0 0x7f0b4c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:57.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.572+0000 7f0b63fff700 1 --2- 172.21.15.72:0/3308813830 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0b4c06ace0 0x7f0b4c06d1a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c06f320 tx=0x7f0b54008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:57.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.575+0000 7f0b637fe700 1 -- 172.21.15.72:0/3308813830 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0b5c054530 con 0x7f0b6c06b520 2023-07-27T20:32:57.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.771+0000 7f0b713ff700 1 -- 172.21.15.72:0/3308813830 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0b6c154710 con 0x7f0b6c06b520 2023-07-27T20:32:57.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.772+0000 7f0b637fe700 1 -- 172.21.15.72:0/3308813830 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v37) v1 ==== 84+0+126 (secure 0 0 0) 0x7f0b5c057b50 con 0x7f0b6c06b520 2023-07-27T20:32:57.761 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:32:57.761 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2023-07-27T20:32:57.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:32:57.761 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 1, 2023-07-27T20:32:57.761 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": ".mgr" 2023-07-27T20:32:57.761 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:32:57.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:32:57.762 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 2, 2023-07-27T20:32:57.762 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "rbd" 2023-07-27T20:32:57.762 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:32:57.762 INFO:teuthology.orchestra.run.smithi072.stdout:] 2023-07-27T20:32:57.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.774+0000 7f0b713ff700 1 -- 172.21.15.72:0/3308813830 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0b4c06ace0 msgr2=0x7f0b4c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:57.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.774+0000 7f0b713ff700 1 --2- 172.21.15.72:0/3308813830 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0b4c06ace0 0x7f0b4c06d1a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c06f320 tx=0x7f0b54008030 comp rx=0 tx=0).stop 2023-07-27T20:32:57.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.774+0000 7f0b713ff700 1 -- 172.21.15.72:0/3308813830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b6c06b520 msgr2=0x7f0b6c0a9380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:57.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.774+0000 7f0b713ff700 1 --2- 172.21.15.72:0/3308813830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b6c06b520 0x7f0b6c0a9380 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c00c780 tx=0x7f0b5c00cb40 comp rx=0 tx=0).stop 2023-07-27T20:32:57.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.774+0000 7f0b713ff700 1 -- 172.21.15.72:0/3308813830 shutdown_connections 2023-07-27T20:32:57.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.774+0000 7f0b713ff700 1 --2- 172.21.15.72:0/3308813830 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b6c158000 0x7f0b6c150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:57.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.774+0000 7f0b713ff700 1 --2- 172.21.15.72:0/3308813830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b6c06b520 0x7f0b6c0a9380 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:57.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.774+0000 7f0b713ff700 1 --2- 172.21.15.72:0/3308813830 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0b4c06ace0 0x7f0b4c06d1a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:57.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.774+0000 7f0b713ff700 1 --2- 172.21.15.72:0/3308813830 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0b6c06ef00 0x7f0b6c1548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:57.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.774+0000 7f0b713ff700 1 -- 172.21.15.72:0/3308813830 >> 172.21.15.72:0/3308813830 conn(0x7f0b6c0c6800 msgr2=0x7f0b6c0c2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:57.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.774+0000 7f0b713ff700 1 -- 172.21.15.72:0/3308813830 shutdown_connections 2023-07-27T20:32:57.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.774+0000 7f0b713ff700 1 -- 172.21.15.72:0/3308813830 wait complete. 2023-07-27T20:32:57.781 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-27T20:32:57.781 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-27T20:32:57.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.993+0000 7f57853ff700 1 Processor -- start 2023-07-27T20:32:57.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.994+0000 7f57853ff700 1 -- start start 2023-07-27T20:32:57.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.995+0000 7f57853ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5780157e70 0x7f57800c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:57.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.995+0000 7f57853ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57800c2050 con 0x7f57800c2660 2023-07-27T20:32:57.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.995+0000 7f57853ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f578006bcb0 con 0x7f57801518a0 2023-07-27T20:32:57.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.995+0000 7f57853ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578006c1e0 con 0x7f5780157e70 2023-07-27T20:32:57.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.995+0000 7f5777fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f57800c2660 0x7f5780157760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33658/0 (socket says 172.21.15.72:33658) 2023-07-27T20:32:57.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.995+0000 7f5777fff700 1 -- 172.21.15.72:0/2969365391 learned_addr learned my addr 172.21.15.72:0/2969365391 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:57.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.995+0000 7f577f7fe700 1 --2- 172.21.15.72:0/2969365391 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5780157e70 0x7f57800c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:57.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.995+0000 7f577e7fc700 1 -- 172.21.15.72:0/2969365391 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1418562786 0 0) 0x7f57800c2050 con 0x7f57800c2660 2023-07-27T20:32:57.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.995+0000 7f577e7fc700 1 -- 172.21.15.72:0/2969365391 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f576c0035b0 con 0x7f57800c2660 2023-07-27T20:32:57.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.996+0000 7f577e7fc700 1 -- 172.21.15.72:0/2969365391 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 230872634 0 0) 0x7f578006bcb0 con 0x7f57801518a0 2023-07-27T20:32:57.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.996+0000 7f577e7fc700 1 -- 172.21.15.72:0/2969365391 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57800c2050 con 0x7f57801518a0 2023-07-27T20:32:57.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.996+0000 7f577e7fc700 1 -- 172.21.15.72:0/2969365391 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2238757571 0 0) 0x7f576c0035b0 con 0x7f57800c2660 2023-07-27T20:32:57.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.996+0000 7f577e7fc700 1 -- 172.21.15.72:0/2969365391 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5780157e70 msgr2=0x7f57800c55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:57.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.996+0000 7f577e7fc700 1 --2- 172.21.15.72:0/2969365391 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5780157e70 0x7f57800c55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:57.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.996+0000 7f577e7fc700 1 -- 172.21.15.72:0/2969365391 >> v1:172.21.15.173:6789/0 conn(0x7f57801518a0 legacy=0x7f57800c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:57.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.996+0000 7f577e7fc700 1 -- 172.21.15.72:0/2969365391 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57800a6f30 con 0x7f57800c2660 2023-07-27T20:32:57.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.996+0000 7f577e7fc700 1 -- 172.21.15.72:0/2969365391 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f5768001670 con 0x7f57800c2660 2023-07-27T20:32:57.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.996+0000 7f577e7fc700 1 -- 172.21.15.72:0/2969365391 >> v1:172.21.15.72:6789/0 conn(0x7f57800c2660 legacy=0x7f5780157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:57.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.996+0000 7f577e7fc700 1 --2- 172.21.15.72:0/2969365391 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5780157e70 0x7f576c003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:57.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.996+0000 7f577e7fc700 1 --2- 172.21.15.72:0/2969365391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f576c004120 0x7f576c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:57.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.996+0000 7f577e7fc700 1 --2- 172.21.15.72:0/2969365391 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f576c004d90 0x7f576c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:57.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.996+0000 7f577e7fc700 1 -- 172.21.15.72:0/2969365391 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578006c1e0 con 0x7f576c004120 2023-07-27T20:32:57.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.996+0000 7f577e7fc700 1 -- 172.21.15.72:0/2969365391 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576c00baf0 con 0x7f576c004d90 2023-07-27T20:32:57.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.996+0000 7f577e7fc700 1 -- 172.21.15.72:0/2969365391 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f576c00bcb0 con 0x7f5780157e70 2023-07-27T20:32:57.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.996+0000 7f5777fff700 1 --2- 172.21.15.72:0/2969365391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f576c004120 0x7f576c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:57.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.996+0000 7f577f7fe700 1 --2- 172.21.15.72:0/2969365391 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f576c004d90 0x7f576c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:57.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.996+0000 7f577effd700 1 --2- 172.21.15.72:0/2969365391 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5780157e70 0x7f576c003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:57.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.997+0000 7f5777fff700 1 -- 172.21.15.72:0/2969365391 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5780157e70 msgr2=0x7f576c003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:57.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.997+0000 7f5777fff700 1 --2- 172.21.15.72:0/2969365391 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5780157e70 0x7f576c003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:57.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.997+0000 7f5777fff700 1 -- 172.21.15.72:0/2969365391 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f576c004d90 msgr2=0x7f576c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:57.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.997+0000 7f5777fff700 1 --2- 172.21.15.72:0/2969365391 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f576c004d90 0x7f576c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:57.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.997+0000 7f5777fff700 1 -- 172.21.15.72:0/2969365391 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f576c0035b0 con 0x7f576c004120 2023-07-27T20:32:57.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.997+0000 7f577f7fe700 1 --2- 172.21.15.72:0/2969365391 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f576c004d90 0x7f576c005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:32:57.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.997+0000 7f5777fff700 1 --2- 172.21.15.72:0/2969365391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f576c004120 0x7f576c004850 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f576800c210 tx=0x7f576c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce8c44637b8e139e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:57.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.997+0000 7f577e7fc700 1 -- 172.21.15.72:0/2969365391 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576800cdb0 con 0x7f576c004120 2023-07-27T20:32:57.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.997+0000 7f577e7fc700 1 -- 172.21.15.72:0/2969365391 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5768001af0 con 0x7f576c004120 2023-07-27T20:32:57.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.997+0000 7f577e7fc700 1 -- 172.21.15.72:0/2969365391 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5768005ba0 con 0x7f576c004120 2023-07-27T20:32:57.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.998+0000 7f57853ff700 1 -- 172.21.15.72:0/2969365391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f576c004120 msgr2=0x7f576c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:57.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.998+0000 7f57853ff700 1 --2- 172.21.15.72:0/2969365391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f576c004120 0x7f576c004850 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f576800c210 tx=0x7f576c005880 comp rx=0 tx=0).stop 2023-07-27T20:32:57.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.998+0000 7f577f7fe700 1 -- 172.21.15.72:0/2969365391 reap_dead start 2023-07-27T20:32:57.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.998+0000 7f57853ff700 1 -- 172.21.15.72:0/2969365391 shutdown_connections 2023-07-27T20:32:57.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.998+0000 7f57853ff700 1 -- 172.21.15.72:0/2969365391 >> 172.21.15.72:0/2969365391 conn(0x7f57800c4150 msgr2=0x7f57800c4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:57.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.998+0000 7f57853ff700 1 -- 172.21.15.72:0/2969365391 shutdown_connections 2023-07-27T20:32:57.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.998+0000 7f57853ff700 1 -- 172.21.15.72:0/2969365391 wait complete. 2023-07-27T20:32:57.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:57.999+0000 7f57853ff700 1 Processor -- start 2023-07-27T20:32:57.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.000+0000 7f57853ff700 1 -- start start 2023-07-27T20:32:57.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.000+0000 7f57853ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f576c004120 0x7f5780154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:57.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.000+0000 7f57853ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57801eaab0 0x7f57800bb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:57.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.000+0000 7f57853ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f57801e11d0 0x7f57800bb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:57.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.000+0000 7f57853ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57800c15f0 con 0x7f57801eaab0 2023-07-27T20:32:57.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.000+0000 7f57853ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57801e9dc0 con 0x7f576c004120 2023-07-27T20:32:57.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.000+0000 7f57853ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57801ea620 con 0x7f57801e11d0 2023-07-27T20:32:57.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.001+0000 7f5777fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57801eaab0 0x7f57800bb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:57.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.001+0000 7f5777fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57801eaab0 0x7f57800bb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50002/0 (socket says 172.21.15.72:50002) 2023-07-27T20:32:57.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.001+0000 7f5777fff700 1 -- 172.21.15.72:0/961436775 learned_addr learned my addr 172.21.15.72:0/961436775 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:57.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.001+0000 7f577f7fe700 1 --2- 172.21.15.72:0/961436775 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f57801e11d0 0x7f57800bb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:57.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.001+0000 7f577effd700 1 --2- 172.21.15.72:0/961436775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f576c004120 0x7f5780154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:57.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.001+0000 7f5777fff700 1 -- 172.21.15.72:0/961436775 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f57801e11d0 msgr2=0x7f57800bb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:57.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.001+0000 7f5777fff700 1 --2- 172.21.15.72:0/961436775 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f57801e11d0 0x7f57800bb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:57.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.001+0000 7f5777fff700 1 -- 172.21.15.72:0/961436775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f576c004120 msgr2=0x7f5780154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:57.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.001+0000 7f5777fff700 1 --2- 172.21.15.72:0/961436775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f576c004120 0x7f5780154480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:57.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.001+0000 7f5777fff700 1 -- 172.21.15.72:0/961436775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57800c1310 con 0x7f57801eaab0 2023-07-27T20:32:57.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.001+0000 7f5777fff700 1 --2- 172.21.15.72:0/961436775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57801eaab0 0x7f57800bb150 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f576c00bac0 tx=0x7f5768001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:57.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.001+0000 7f57777fe700 1 -- 172.21.15.72:0/961436775 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57680072d0 con 0x7f57801eaab0 2023-07-27T20:32:57.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.002+0000 7f57777fe700 1 -- 172.21.15.72:0/961436775 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5768007450 con 0x7f57801eaab0 2023-07-27T20:32:57.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.002+0000 7f57853ff700 1 -- 172.21.15.72:0/961436775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57801e9fd0 con 0x7f57801eaab0 2023-07-27T20:32:57.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.002+0000 7f57777fe700 1 -- 172.21.15.72:0/961436775 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5768007800 con 0x7f57801eaab0 2023-07-27T20:32:57.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.002+0000 7f57853ff700 1 -- 172.21.15.72:0/961436775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57801549c0 con 0x7f57801eaab0 2023-07-27T20:32:57.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.003+0000 7f57853ff700 1 -- 172.21.15.72:0/961436775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57801ea7d0 con 0x7f57801eaab0 2023-07-27T20:32:57.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.004+0000 7f57777fe700 1 -- 172.21.15.72:0/961436775 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f576801e430 con 0x7f57801eaab0 2023-07-27T20:32:57.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.004+0000 7f57777fe700 1 --2- 172.21.15.72:0/961436775 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f576006ace0 0x7f576006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:57.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.005+0000 7f57777fe700 1 -- 172.21.15.72:0/961436775 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f5768089eb0 con 0x7f57801eaab0 2023-07-27T20:32:57.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.005+0000 7f577effd700 1 --2- 172.21.15.72:0/961436775 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f576006ace0 0x7f576006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:57.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.006+0000 7f577effd700 1 --2- 172.21.15.72:0/961436775 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f576006ace0 0x7f576006d1a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5770000c00 tx=0x7f5770009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:57.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.009+0000 7f57777fe700 1 -- 172.21.15.72:0/961436775 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f57801ea7d0 con 0x7f57801eaab0 2023-07-27T20:32:58.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.203+0000 7f57853ff700 1 -- 172.21.15.72:0/961436775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f57801ea790 con 0x7f57801eaab0 2023-07-27T20:32:58.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.552+0000 7f57777fe700 1 -- 172.21.15.72:0/961436775 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v38) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5768055200 con 0x7f57801eaab0 2023-07-27T20:32:58.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.557+0000 7f57853ff700 1 -- 172.21.15.72:0/961436775 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f576006ace0 msgr2=0x7f576006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:58.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.557+0000 7f57853ff700 1 --2- 172.21.15.72:0/961436775 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f576006ace0 0x7f576006d1a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5770000c00 tx=0x7f5770009040 comp rx=0 tx=0).stop 2023-07-27T20:32:58.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.557+0000 7f57853ff700 1 -- 172.21.15.72:0/961436775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57801eaab0 msgr2=0x7f57800bb150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:58.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.557+0000 7f57853ff700 1 --2- 172.21.15.72:0/961436775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57801eaab0 0x7f57800bb150 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f576c00bac0 tx=0x7f5768001980 comp rx=0 tx=0).stop 2023-07-27T20:32:58.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.558+0000 7f57853ff700 1 -- 172.21.15.72:0/961436775 shutdown_connections 2023-07-27T20:32:58.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.558+0000 7f57853ff700 1 --2- 172.21.15.72:0/961436775 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f576006ace0 0x7f576006d1a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:58.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.558+0000 7f57853ff700 1 --2- 172.21.15.72:0/961436775 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f57801e11d0 0x7f57800bb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:58.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.558+0000 7f57853ff700 1 --2- 172.21.15.72:0/961436775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f576c004120 0x7f5780154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:58.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.558+0000 7f57853ff700 1 --2- 172.21.15.72:0/961436775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57801eaab0 0x7f57800bb150 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:58.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.558+0000 7f57853ff700 1 -- 172.21.15.72:0/961436775 >> 172.21.15.72:0/961436775 conn(0x7f57800c4150 msgr2=0x7f5780157570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:58.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.559+0000 7f57853ff700 1 -- 172.21.15.72:0/961436775 shutdown_connections 2023-07-27T20:32:58.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.560+0000 7f57853ff700 1 -- 172.21.15.72:0/961436775 wait complete. 2023-07-27T20:32:58.550 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' created 2023-07-27T20:32:58.568 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-27T20:32:58.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.781+0000 7fbebbbff700 1 Processor -- start 2023-07-27T20:32:58.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.781+0000 7fbebbbff700 1 -- start start 2023-07-27T20:32:58.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.782+0000 7fbebbbff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbeb40bff30 0x7fbeb40a8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:58.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.782+0000 7fbebbbff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbeb40ab300 0x7fbeb40a89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:58.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.782+0000 7fbebbbff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeb40aae70 con 0x7fbeb414f680 2023-07-27T20:32:58.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.782+0000 7fbebbbff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeb4151ec0 con 0x7fbeb40bff30 2023-07-27T20:32:58.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.782+0000 7fbebbbff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeb41520b0 con 0x7fbeb40ab300 2023-07-27T20:32:58.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.783+0000 7fbeb919a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbeb40bff30 0x7fbeb40a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:58.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.783+0000 7fbeb919a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbeb40bff30 0x7fbeb40a8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50004/0 (socket says 172.21.15.72:50004) 2023-07-27T20:32:58.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.783+0000 7fbeb919a700 1 -- 172.21.15.72:0/840453393 learned_addr learned my addr 172.21.15.72:0/840453393 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:58.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.783+0000 7fbeba19c700 1 --2- 172.21.15.72:0/840453393 >> v2:172.21.15.173:3300/0 conn(0x7fbeb40ab300 0x7fbeb40a89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:58.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.783+0000 7fbeb919a700 1 -- 172.21.15.72:0/840453393 >> v2:172.21.15.173:3300/0 conn(0x7fbeb40ab300 msgr2=0x7fbeb40a89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:58.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.783+0000 7fbeb919a700 1 --2- 172.21.15.72:0/840453393 >> v2:172.21.15.173:3300/0 conn(0x7fbeb40ab300 0x7fbeb40a89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:58.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.783+0000 7fbeb919a700 1 -- 172.21.15.72:0/840453393 >> v1:172.21.15.72:6789/0 conn(0x7fbeb414f680 legacy=0x7fbeb40c0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:58.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.783+0000 7fbeb919a700 1 -- 172.21.15.72:0/840453393 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb40aa540 con 0x7fbeb40bff30 2023-07-27T20:32:58.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.783+0000 7fbeb8999700 1 -- 172.21.15.72:0/840453393 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2095260938 0 0) 0x7fbeb40aae70 con 0x7fbeb414f680 2023-07-27T20:32:58.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.783+0000 7fbeb919a700 1 --2- 172.21.15.72:0/840453393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbeb40bff30 0x7fbeb40a8480 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fbeb40aade0 tx=0x7fbea4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe94e0a5c61b9fc server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:58.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.784+0000 7fbeb8999700 1 -- 172.21.15.72:0/840453393 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea400b870 con 0x7fbeb40bff30 2023-07-27T20:32:58.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.784+0000 7fbeb8999700 1 -- 172.21.15.72:0/840453393 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea400b9d0 con 0x7fbeb40bff30 2023-07-27T20:32:58.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.784+0000 7fbeb8999700 1 -- 172.21.15.72:0/840453393 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea400bd60 con 0x7fbeb40bff30 2023-07-27T20:32:58.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.784+0000 7fbebbbff700 1 -- 172.21.15.72:0/840453393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbeb40bff30 msgr2=0x7fbeb40a8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:58.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.784+0000 7fbebbbff700 1 --2- 172.21.15.72:0/840453393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbeb40bff30 0x7fbeb40a8480 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fbeb40aade0 tx=0x7fbea4009bd0 comp rx=0 tx=0).stop 2023-07-27T20:32:58.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.784+0000 7fbebbbff700 1 -- 172.21.15.72:0/840453393 shutdown_connections 2023-07-27T20:32:58.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.784+0000 7fbebbbff700 1 --2- 172.21.15.72:0/840453393 >> v2:172.21.15.173:3300/0 conn(0x7fbeb40ab300 0x7fbeb40a89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:58.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.784+0000 7fbebbbff700 1 --2- 172.21.15.72:0/840453393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbeb40bff30 0x7fbeb40a8480 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:58.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.784+0000 7fbebbbff700 1 -- 172.21.15.72:0/840453393 >> 172.21.15.72:0/840453393 conn(0x7fbeb40c55b0 msgr2=0x7fbeb40c59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:58.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.784+0000 7fbebbbff700 1 -- 172.21.15.72:0/840453393 shutdown_connections 2023-07-27T20:32:58.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.784+0000 7fbebbbff700 1 -- 172.21.15.72:0/840453393 wait complete. 2023-07-27T20:32:58.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.786+0000 7fbebbbff700 1 Processor -- start 2023-07-27T20:32:58.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.786+0000 7fbebbbff700 1 -- start start 2023-07-27T20:32:58.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.787+0000 7fbebbbff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbeb40ab300 0x7fbeb4155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:58.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.787+0000 7fbebbbff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbeb40bff30 0x7fbeb40c3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:58.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.787+0000 7fbebbbff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbeb414f680 0x7fbeb41eab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:58.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.787+0000 7fbebbbff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb414ab90 con 0x7fbeb414f680 2023-07-27T20:32:58.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.787+0000 7fbebbbff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb4144890 con 0x7fbeb40ab300 2023-07-27T20:32:58.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.787+0000 7fbebbbff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb4144a20 con 0x7fbeb40bff30 2023-07-27T20:32:58.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.787+0000 7fbeba19c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbeb414f680 0x7fbeb41eab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:58.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.787+0000 7fbeba19c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbeb414f680 0x7fbeb41eab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50014/0 (socket says 172.21.15.72:50014) 2023-07-27T20:32:58.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.787+0000 7fbeba19c700 1 -- 172.21.15.72:0/540351269 learned_addr learned my addr 172.21.15.72:0/540351269 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:58.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.788+0000 7fbeb999b700 1 --2- 172.21.15.72:0/540351269 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbeb40ab300 0x7fbeb4155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:58.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.788+0000 7fbeba19c700 1 -- 172.21.15.72:0/540351269 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbeb40bff30 msgr2=0x7fbeb40c3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:58.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.788+0000 7fbeba19c700 1 --2- 172.21.15.72:0/540351269 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbeb40bff30 0x7fbeb40c3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:58.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.788+0000 7fbeba19c700 1 -- 172.21.15.72:0/540351269 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbeb40ab300 msgr2=0x7fbeb4155720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:58.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.788+0000 7fbeba19c700 1 --2- 172.21.15.72:0/540351269 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbeb40ab300 0x7fbeb4155720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:58.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.788+0000 7fbeba19c700 1 -- 172.21.15.72:0/540351269 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea4009550 con 0x7fbeb414f680 2023-07-27T20:32:58.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.788+0000 7fbeb999b700 1 --2- 172.21.15.72:0/540351269 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbeb40ab300 0x7fbeb4155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:32:58.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.788+0000 7fbeba19c700 1 --2- 172.21.15.72:0/540351269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbeb414f680 0x7fbeb41eab80 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fbeac007e60 tx=0x7fbeac00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:58.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.788+0000 7fbeaa7fc700 1 -- 172.21.15.72:0/540351269 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac00ede0 con 0x7fbeb414f680 2023-07-27T20:32:58.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.788+0000 7fbeaa7fc700 1 -- 172.21.15.72:0/540351269 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeac014420 con 0x7fbeb414f680 2023-07-27T20:32:58.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.788+0000 7fbebbbff700 1 -- 172.21.15.72:0/540351269 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeb4154a60 con 0x7fbeb414f680 2023-07-27T20:32:58.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.788+0000 7fbeaa7fc700 1 -- 172.21.15.72:0/540351269 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac0147d0 con 0x7fbeb414f680 2023-07-27T20:32:58.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.788+0000 7fbebbbff700 1 -- 172.21.15.72:0/540351269 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeb41546f0 con 0x7fbeb414f680 2023-07-27T20:32:58.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.789+0000 7fbebbbff700 1 -- 172.21.15.72:0/540351269 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeb4154bf0 con 0x7fbeb414f680 2023-07-27T20:32:58.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.790+0000 7fbeaa7fc700 1 -- 172.21.15.72:0/540351269 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbeac014930 con 0x7fbeb414f680 2023-07-27T20:32:58.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.791+0000 7fbeaa7fc700 1 --2- 172.21.15.72:0/540351269 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fbe9806ace0 0x7fbe9806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:58.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.791+0000 7fbeaa7fc700 1 -- 172.21.15.72:0/540351269 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5900+0+0 (secure 0 0 0) 0x7fbeac089bc0 con 0x7fbeb414f680 2023-07-27T20:32:58.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.792+0000 7fbeb999b700 1 --2- 172.21.15.72:0/540351269 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fbe9806ace0 0x7fbe9806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:58.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.792+0000 7fbeb999b700 1 --2- 172.21.15.72:0/540351269 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fbe9806ace0 0x7fbe9806d1a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbeb0000f60 tx=0x7fbeb0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:58.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.796+0000 7fbeaa7fc700 1 -- 172.21.15.72:0/540351269 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbeac058790 con 0x7fbeb414f680 2023-07-27T20:32:58.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:58.991+0000 7fbebbbff700 1 -- 172.21.15.72:0/540351269 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fbeb404e470 con 0x7fbeb414f680 2023-07-27T20:32:59.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.560+0000 7fbeaa7fc700 1 -- 172.21.15.72:0/540351269 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v39) v1 ==== 170+0+0 (secure 0 0 0) 0x7fbeac058320 con 0x7fbeb414f680 2023-07-27T20:32:59.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.567+0000 7fbebbbff700 1 -- 172.21.15.72:0/540351269 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fbe9806ace0 msgr2=0x7fbe9806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:59.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.567+0000 7fbebbbff700 1 --2- 172.21.15.72:0/540351269 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fbe9806ace0 0x7fbe9806d1a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbeb0000f60 tx=0x7fbeb0009040 comp rx=0 tx=0).stop 2023-07-27T20:32:59.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.567+0000 7fbebbbff700 1 -- 172.21.15.72:0/540351269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbeb414f680 msgr2=0x7fbeb41eab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:59.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.567+0000 7fbebbbff700 1 --2- 172.21.15.72:0/540351269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbeb414f680 0x7fbeb41eab80 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fbeac007e60 tx=0x7fbeac00e3c0 comp rx=0 tx=0).stop 2023-07-27T20:32:59.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.568+0000 7fbebbbff700 1 -- 172.21.15.72:0/540351269 shutdown_connections 2023-07-27T20:32:59.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.568+0000 7fbebbbff700 1 --2- 172.21.15.72:0/540351269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbeb414f680 0x7fbeb41eab80 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:59.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.568+0000 7fbebbbff700 1 --2- 172.21.15.72:0/540351269 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbeb40ab300 0x7fbeb4155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:59.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.568+0000 7fbebbbff700 1 --2- 172.21.15.72:0/540351269 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fbe9806ace0 0x7fbe9806d1a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:59.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.568+0000 7fbebbbff700 1 --2- 172.21.15.72:0/540351269 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbeb40bff30 0x7fbeb40c3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:59.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.568+0000 7fbebbbff700 1 -- 172.21.15.72:0/540351269 >> 172.21.15.72:0/540351269 conn(0x7fbeb40c55b0 msgr2=0x7fbeb414d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:59.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.569+0000 7fbebbbff700 1 -- 172.21.15.72:0/540351269 shutdown_connections 2023-07-27T20:32:59.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.569+0000 7fbebbbff700 1 -- 172.21.15.72:0/540351269 wait complete. 2023-07-27T20:32:59.565 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' created 2023-07-27T20:32:59.588 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-27T20:32:59.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.799+0000 7f23475ff700 1 Processor -- start 2023-07-27T20:32:59.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.799+0000 7f23475ff700 1 -- start start 2023-07-27T20:32:59.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.800+0000 7f23475ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23401475a0 0x7f23401516c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:59.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.800+0000 7f23475ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f23400716f0 0x7f2340071b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:59.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.800+0000 7f23475ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2340154f50 con 0x7f23400c12f0 2023-07-27T20:32:59.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.800+0000 7f23475ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2340151c00 con 0x7f23400716f0 2023-07-27T20:32:59.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.800+0000 7f23475ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2340154340 con 0x7f23401475a0 2023-07-27T20:32:59.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.801+0000 7f234539b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23401475a0 0x7f23401516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:59.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.801+0000 7f2344b9a700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f23400c12f0 0x7f23400c1d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.72:44066/0 (socket says 172.21.15.72:44066) 2023-07-27T20:32:59.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.801+0000 7f2344b9a700 1 -- 172.21.15.72:0/4246395020 learned_addr learned my addr 172.21.15.72:0/4246395020 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:32:59.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.801+0000 7f2345b9c700 1 --2- 172.21.15.72:0/4246395020 >> v2:172.21.15.173:3300/0 conn(0x7f23400716f0 0x7f2340071b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:59.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.801+0000 7f2337fff700 1 -- 172.21.15.72:0/4246395020 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2223735930 0 0) 0x7f2340154f50 con 0x7f23400c12f0 2023-07-27T20:32:59.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.801+0000 7f2337fff700 1 -- 172.21.15.72:0/4246395020 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f232c0057c0 con 0x7f23400c12f0 2023-07-27T20:32:59.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.801+0000 7f2345b9c700 1 -- 172.21.15.72:0/4246395020 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23401475a0 msgr2=0x7f23401516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:32:59.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.801+0000 7f2345b9c700 1 --2- 172.21.15.72:0/4246395020 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23401475a0 0x7f23401516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:59.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.801+0000 7f2345b9c700 1 -- 172.21.15.72:0/4246395020 >> v1:172.21.15.173:6789/0 conn(0x7f23400c12f0 legacy=0x7f23400c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:59.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.801+0000 7f2345b9c700 1 -- 172.21.15.72:0/4246395020 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2340154620 con 0x7f23400716f0 2023-07-27T20:32:59.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.801+0000 7f234539b700 1 --2- 172.21.15.72:0/4246395020 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23401475a0 0x7f23401516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:32:59.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.802+0000 7f2345b9c700 1 --2- 172.21.15.72:0/4246395020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23400716f0 0x7f2340071b60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2338009d90 tx=0x7f233800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9391c12e3e33563 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:59.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.802+0000 7f2337fff700 1 -- 172.21.15.72:0/4246395020 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233800e070 con 0x7f23400716f0 2023-07-27T20:32:59.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.802+0000 7f2337fff700 1 -- 172.21.15.72:0/4246395020 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233800bb20 con 0x7f23400716f0 2023-07-27T20:32:59.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.802+0000 7f2337fff700 1 -- 172.21.15.72:0/4246395020 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2338012430 con 0x7f23400716f0 2023-07-27T20:32:59.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.802+0000 7f23475ff700 1 -- 172.21.15.72:0/4246395020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23400716f0 msgr2=0x7f2340071b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:59.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.802+0000 7f23475ff700 1 --2- 172.21.15.72:0/4246395020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23400716f0 0x7f2340071b60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2338009d90 tx=0x7f233800b330 comp rx=0 tx=0).stop 2023-07-27T20:32:59.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.802+0000 7f23475ff700 1 -- 172.21.15.72:0/4246395020 shutdown_connections 2023-07-27T20:32:59.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.803+0000 7f23475ff700 1 --2- 172.21.15.72:0/4246395020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23400716f0 0x7f2340071b60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:59.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.803+0000 7f23475ff700 1 --2- 172.21.15.72:0/4246395020 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23401475a0 0x7f23401516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:59.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.803+0000 7f23475ff700 1 -- 172.21.15.72:0/4246395020 >> 172.21.15.72:0/4246395020 conn(0x7f234006a190 msgr2=0x7f234006a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:32:59.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.803+0000 7f23475ff700 1 -- 172.21.15.72:0/4246395020 shutdown_connections 2023-07-27T20:32:59.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.803+0000 7f23475ff700 1 -- 172.21.15.72:0/4246395020 wait complete. 2023-07-27T20:32:59.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.804+0000 7f23475ff700 1 Processor -- start 2023-07-27T20:32:59.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.804+0000 7f23475ff700 1 -- start start 2023-07-27T20:32:59.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.805+0000 7f23475ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23400716f0 0x7f23400bb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:59.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.805+0000 7f23475ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23400c12f0 0x7f23401ddaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:59.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.805+0000 7f23475ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23401475a0 0x7f23401e9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:59.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.805+0000 7f23475ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23400c4920 con 0x7f23400716f0 2023-07-27T20:32:59.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.805+0000 7f23475ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23400c3580 con 0x7f23400c12f0 2023-07-27T20:32:59.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.805+0000 7f23475ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23401da500 con 0x7f23401475a0 2023-07-27T20:32:59.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.805+0000 7f234539b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23400716f0 0x7f23400bb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:59.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.805+0000 7f234539b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23400716f0 0x7f23400bb620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50026/0 (socket says 172.21.15.72:50026) 2023-07-27T20:32:59.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.806+0000 7f234539b700 1 -- 172.21.15.72:0/498352103 learned_addr learned my addr 172.21.15.72:0/498352103 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:32:59.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.806+0000 7f2344b9a700 1 --2- 172.21.15.72:0/498352103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23400c12f0 0x7f23401ddaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:59.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.806+0000 7f2345b9c700 1 --2- 172.21.15.72:0/498352103 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23401475a0 0x7f23401e9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:59.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.806+0000 7f234539b700 1 -- 172.21.15.72:0/498352103 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23401475a0 msgr2=0x7f23401e9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:59.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.806+0000 7f234539b700 1 --2- 172.21.15.72:0/498352103 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23401475a0 0x7f23401e9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:59.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.806+0000 7f234539b700 1 -- 172.21.15.72:0/498352103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23400c12f0 msgr2=0x7f23401ddaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:32:59.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.806+0000 7f234539b700 1 --2- 172.21.15.72:0/498352103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23400c12f0 0x7f23401ddaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:32:59.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.806+0000 7f234539b700 1 -- 172.21.15.72:0/498352103 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233c0094a0 con 0x7f23400716f0 2023-07-27T20:32:59.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.806+0000 7f234539b700 1 --2- 172.21.15.72:0/498352103 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23400716f0 0x7f23400bb620 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f233c00ebe0 tx=0x7f233c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:59.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.806+0000 7f2335ffb700 1 -- 172.21.15.72:0/498352103 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c009760 con 0x7f23400716f0 2023-07-27T20:32:59.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.806+0000 7f2335ffb700 1 -- 172.21.15.72:0/498352103 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233c00c7f0 con 0x7f23400716f0 2023-07-27T20:32:59.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.807+0000 7f23475ff700 1 -- 172.21.15.72:0/498352103 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2338009a70 con 0x7f23400716f0 2023-07-27T20:32:59.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.807+0000 7f2335ffb700 1 -- 172.21.15.72:0/498352103 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c00cb80 con 0x7f23400716f0 2023-07-27T20:32:59.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.807+0000 7f23475ff700 1 -- 172.21.15.72:0/498352103 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23400c4070 con 0x7f23400716f0 2023-07-27T20:32:59.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.808+0000 7f23475ff700 1 -- 172.21.15.72:0/498352103 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23401ded50 con 0x7f23400716f0 2023-07-27T20:32:59.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.810+0000 7f2335ffb700 1 -- 172.21.15.72:0/498352103 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f233c00cce0 con 0x7f23400716f0 2023-07-27T20:32:59.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.811+0000 7f2335ffb700 1 --2- 172.21.15.72:0/498352103 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f232406ace0 0x7f232406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:32:59.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.811+0000 7f2335ffb700 1 -- 172.21.15.72:0/498352103 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f233c0897a0 con 0x7f23400716f0 2023-07-27T20:32:59.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.811+0000 7f2344b9a700 1 --2- 172.21.15.72:0/498352103 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f232406ace0 0x7f232406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:32:59.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.812+0000 7f2344b9a700 1 --2- 172.21.15.72:0/498352103 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f232406ace0 0x7f232406d1a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f23401de3f0 tx=0x7f2330007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:32:59.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:32:59.814+0000 7f2335ffb700 1 -- 172.21.15.72:0/498352103 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f233c0548e0 con 0x7f23400716f0 2023-07-27T20:33:00.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.051+0000 7f23475ff700 1 -- 172.21.15.72:0/498352103 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f23400c2390 con 0x7f23400716f0 2023-07-27T20:33:00.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.578+0000 7f2335ffb700 1 -- 172.21.15.72:0/498352103 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f233c057f00 con 0x7f23400716f0 2023-07-27T20:33:00.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.583+0000 7f23475ff700 1 -- 172.21.15.72:0/498352103 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f232406ace0 msgr2=0x7f232406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:00.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.583+0000 7f23475ff700 1 --2- 172.21.15.72:0/498352103 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f232406ace0 0x7f232406d1a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f23401de3f0 tx=0x7f2330007dc0 comp rx=0 tx=0).stop 2023-07-27T20:33:00.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.584+0000 7f23475ff700 1 -- 172.21.15.72:0/498352103 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23400716f0 msgr2=0x7f23400bb620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:00.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.584+0000 7f23475ff700 1 --2- 172.21.15.72:0/498352103 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23400716f0 0x7f23400bb620 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f233c00ebe0 tx=0x7f233c00eef0 comp rx=0 tx=0).stop 2023-07-27T20:33:00.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.585+0000 7f23475ff700 1 -- 172.21.15.72:0/498352103 shutdown_connections 2023-07-27T20:33:00.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.585+0000 7f23475ff700 1 --2- 172.21.15.72:0/498352103 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f232406ace0 0x7f232406d1a0 secure :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f23401de3f0 tx=0x7f2330007dc0 comp rx=0 tx=0).stop 2023-07-27T20:33:00.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.585+0000 7f23475ff700 1 --2- 172.21.15.72:0/498352103 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23401475a0 0x7f23401e9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:00.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.585+0000 7f23475ff700 1 --2- 172.21.15.72:0/498352103 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23400716f0 0x7f23400bb620 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:00.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.585+0000 7f23475ff700 1 --2- 172.21.15.72:0/498352103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23400c12f0 0x7f23401ddaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:00.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.585+0000 7f23475ff700 1 -- 172.21.15.72:0/498352103 >> 172.21.15.72:0/498352103 conn(0x7f234006a190 msgr2=0x7f23401df130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:00.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.589+0000 7f23475ff700 1 -- 172.21.15.72:0/498352103 shutdown_connections 2023-07-27T20:33:00.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.589+0000 7f23475ff700 1 -- 172.21.15.72:0/498352103 wait complete. 2023-07-27T20:33:00.582 INFO:teuthology.orchestra.run.smithi072.stderr:new fs with metadata pool 6 and data pool 7 2023-07-27T20:33:00.605 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:33:00.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.814+0000 7ff6893ff700 1 Processor -- start 2023-07-27T20:33:00.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.814+0000 7ff6893ff700 1 -- start start 2023-07-27T20:33:00.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.815+0000 7ff6893ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff68406b520 0x7ff6840a8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:00.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.815+0000 7ff6893ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff68406bd90 con 0x7ff68406b900 2023-07-27T20:33:00.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.815+0000 7ff6893ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff68406e270 con 0x7ff68406ef00 2023-07-27T20:33:00.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.815+0000 7ff6893ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6840c1850 con 0x7ff68406b520 2023-07-27T20:33:00.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.816+0000 7ff682ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff68406b520 0x7ff6840a8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:00.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.816+0000 7ff6837fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff68406b900 0x7ff684154000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41116/0 (socket says 172.21.15.72:41116) 2023-07-27T20:33:00.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.816+0000 7ff6837fe700 1 -- 172.21.15.72:0/2640139526 learned_addr learned my addr 172.21.15.72:0/2640139526 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:00.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.816+0000 7ff682ffd700 1 -- 172.21.15.72:0/2640139526 >> v1:172.21.15.173:6789/0 conn(0x7ff68406ef00 legacy=0x7ff684158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:00.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.816+0000 7ff682ffd700 1 -- 172.21.15.72:0/2640139526 >> v1:172.21.15.72:6789/0 conn(0x7ff68406b900 legacy=0x7ff684154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:00.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.816+0000 7ff682ffd700 1 -- 172.21.15.72:0/2640139526 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff68406e7a0 con 0x7ff68406b520 2023-07-27T20:33:00.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.816+0000 7ff682ffd700 1 --2- 172.21.15.72:0/2640139526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff68406b520 0x7ff6840a8de0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff674009840 tx=0x7ff674009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b847096b9fbfab server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:00.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.816+0000 7ff681ffb700 1 -- 172.21.15.72:0/2640139526 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff674011830 con 0x7ff68406b520 2023-07-27T20:33:00.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.817+0000 7ff681ffb700 1 -- 172.21.15.72:0/2640139526 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff674011990 con 0x7ff68406b520 2023-07-27T20:33:00.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.817+0000 7ff681ffb700 1 -- 172.21.15.72:0/2640139526 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff674011d20 con 0x7ff68406b520 2023-07-27T20:33:00.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.817+0000 7ff6893ff700 1 -- 172.21.15.72:0/2640139526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff68406b520 msgr2=0x7ff6840a8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:00.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.817+0000 7ff6893ff700 1 --2- 172.21.15.72:0/2640139526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff68406b520 0x7ff6840a8de0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff674009840 tx=0x7ff674009b50 comp rx=0 tx=0).stop 2023-07-27T20:33:00.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.817+0000 7ff6893ff700 1 -- 172.21.15.72:0/2640139526 shutdown_connections 2023-07-27T20:33:00.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.817+0000 7ff6893ff700 1 --2- 172.21.15.72:0/2640139526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff68406b520 0x7ff6840a8de0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:00.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.817+0000 7ff6893ff700 1 -- 172.21.15.72:0/2640139526 >> 172.21.15.72:0/2640139526 conn(0x7ff6840c6800 msgr2=0x7ff6840c6c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:00.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.817+0000 7ff6893ff700 1 -- 172.21.15.72:0/2640139526 shutdown_connections 2023-07-27T20:33:00.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.817+0000 7ff6893ff700 1 -- 172.21.15.72:0/2640139526 wait complete. 2023-07-27T20:33:00.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.819+0000 7ff6893ff700 1 Processor -- start 2023-07-27T20:33:00.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.819+0000 7ff6893ff700 1 -- start start 2023-07-27T20:33:00.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.820+0000 7ff6893ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff68406b520 0x7ff6841ed820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:00.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.820+0000 7ff6893ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff68406b900 0x7ff6840abd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:00.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.820+0000 7ff6893ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff68406ef00 0x7ff684150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:00.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.820+0000 7ff6893ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff684150a40 con 0x7ff68406ef00 2023-07-27T20:33:00.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.820+0000 7ff6893ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6841edd60 con 0x7ff68406b900 2023-07-27T20:33:00.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.820+0000 7ff6893ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff68414f590 con 0x7ff68406b520 2023-07-27T20:33:00.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.820+0000 7ff6837fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff68406ef00 0x7ff684150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:00.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.820+0000 7ff6837fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff68406ef00 0x7ff684150eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41208/0 (socket says 172.21.15.72:41208) 2023-07-27T20:33:00.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.820+0000 7ff6837fe700 1 -- 172.21.15.72:0/1823197449 learned_addr learned my addr 172.21.15.72:0/1823197449 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:00.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.820+0000 7ff682ffd700 1 --2- 172.21.15.72:0/1823197449 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff68406b520 0x7ff6841ed820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:00.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.820+0000 7ff6827fc700 1 --2- 172.21.15.72:0/1823197449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff68406b900 0x7ff6840abd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:00.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.821+0000 7ff6837fe700 1 -- 172.21.15.72:0/1823197449 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff68406b520 msgr2=0x7ff6841ed820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:00.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.821+0000 7ff6837fe700 1 --2- 172.21.15.72:0/1823197449 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff68406b520 0x7ff6841ed820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:00.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.821+0000 7ff6837fe700 1 -- 172.21.15.72:0/1823197449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff68406b900 msgr2=0x7ff6840abd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:00.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.821+0000 7ff6837fe700 1 --2- 172.21.15.72:0/1823197449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff68406b900 0x7ff6840abd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:00.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.821+0000 7ff6837fe700 1 -- 172.21.15.72:0/1823197449 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6740094a0 con 0x7ff68406ef00 2023-07-27T20:33:00.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.821+0000 7ff6837fe700 1 --2- 172.21.15.72:0/1823197449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff68406ef00 0x7ff684150eb0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ff67c00cbc0 tx=0x7ff67c00cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:00.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.821+0000 7ff66b7fe700 1 -- 172.21.15.72:0/1823197449 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67c00ab50 con 0x7ff68406ef00 2023-07-27T20:33:00.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.821+0000 7ff66b7fe700 1 -- 172.21.15.72:0/1823197449 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff67c00acb0 con 0x7ff68406ef00 2023-07-27T20:33:00.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.821+0000 7ff66b7fe700 1 -- 172.21.15.72:0/1823197449 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67c012600 con 0x7ff68406ef00 2023-07-27T20:33:00.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.821+0000 7ff6893ff700 1 -- 172.21.15.72:0/1823197449 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6840a93f0 con 0x7ff68406ef00 2023-07-27T20:33:00.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.821+0000 7ff6893ff700 1 -- 172.21.15.72:0/1823197449 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff68414ecf0 con 0x7ff68406ef00 2023-07-27T20:33:00.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.822+0000 7ff6893ff700 1 -- 172.21.15.72:0/1823197449 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6840a9100 con 0x7ff68406ef00 2023-07-27T20:33:00.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.823+0000 7ff66b7fe700 1 -- 172.21.15.72:0/1823197449 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff67c01b3b0 con 0x7ff68406ef00 2023-07-27T20:33:00.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.825+0000 7ff66b7fe700 1 --2- 172.21.15.72:0/1823197449 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff67006ace0 0x7ff67006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:00.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.825+0000 7ff66b7fe700 1 -- 172.21.15.72:0/1823197449 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff67c089170 con 0x7ff68406ef00 2023-07-27T20:33:00.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.825+0000 7ff682ffd700 1 --2- 172.21.15.72:0/1823197449 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff67006ace0 0x7ff67006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:00.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.826+0000 7ff682ffd700 1 --2- 172.21.15.72:0/1823197449 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff67006ace0 0x7ff67006d1a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff6740090b0 tx=0x7ff674008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:00.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:00.829+0000 7ff66b7fe700 1 -- 172.21.15.72:0/1823197449 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff67c0540f0 con 0x7ff68406ef00 2023-07-27T20:33:01.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.021+0000 7ff6893ff700 1 -- 172.21.15.72:0/1823197449 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff68406bd90 con 0x7ff68406ef00 2023-07-27T20:33:01.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.023+0000 7ff66b7fe700 1 -- 172.21.15.72:0/1823197449 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+18513 (secure 0 0 0) 0x7ff68406bd90 con 0x7ff68406ef00 2023-07-27T20:33:01.011 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:33:01.012 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":40,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:33:00.053873+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:32:58.242890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-27T20:32:59.032110+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:33:01.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.025+0000 7ff6893ff700 1 -- 172.21.15.72:0/1823197449 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff67006ace0 msgr2=0x7ff67006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:01.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.025+0000 7ff6893ff700 1 --2- 172.21.15.72:0/1823197449 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff67006ace0 0x7ff67006d1a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff6740090b0 tx=0x7ff674008030 comp rx=0 tx=0).stop 2023-07-27T20:33:01.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.025+0000 7ff6893ff700 1 -- 172.21.15.72:0/1823197449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff68406ef00 msgr2=0x7ff684150eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:01.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.025+0000 7ff6893ff700 1 --2- 172.21.15.72:0/1823197449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff68406ef00 0x7ff684150eb0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ff67c00cbc0 tx=0x7ff67c00cf80 comp rx=0 tx=0).stop 2023-07-27T20:33:01.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.025+0000 7ff6893ff700 1 -- 172.21.15.72:0/1823197449 shutdown_connections 2023-07-27T20:33:01.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.025+0000 7ff6893ff700 1 --2- 172.21.15.72:0/1823197449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff68406ef00 0x7ff684150eb0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:01.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.025+0000 7ff6893ff700 1 --2- 172.21.15.72:0/1823197449 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff67006ace0 0x7ff67006d1a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:01.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.025+0000 7ff6893ff700 1 --2- 172.21.15.72:0/1823197449 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff68406b520 0x7ff6841ed820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:01.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.025+0000 7ff6893ff700 1 --2- 172.21.15.72:0/1823197449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff68406b900 0x7ff6840abd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:01.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.025+0000 7ff6893ff700 1 -- 172.21.15.72:0/1823197449 >> 172.21.15.72:0/1823197449 conn(0x7ff6840c6800 msgr2=0x7ff684156b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:01.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.025+0000 7ff6893ff700 1 -- 172.21.15.72:0/1823197449 shutdown_connections 2023-07-27T20:33:01.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.025+0000 7ff6893ff700 1 -- 172.21.15.72:0/1823197449 wait complete. 2023-07-27T20:33:01.032 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:33:01.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.240+0000 7fcacfbff700 1 Processor -- start 2023-07-27T20:33:01.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.241+0000 7fcacfbff700 1 -- start start 2023-07-27T20:33:01.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.242+0000 7fcacfbff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcac806b150 0x7fcac80c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:01.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.242+0000 7fcacfbff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcac81549f0 0x7fcac81514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:01.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.242+0000 7fcacfbff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcac806b710 con 0x7fcac80c4400 2023-07-27T20:33:01.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.242+0000 7fcacfbff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac81545d0 con 0x7fcac81549f0 2023-07-27T20:33:01.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.242+0000 7fcacfbff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac806c860 con 0x7fcac806b150 2023-07-27T20:33:01.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.243+0000 7fcacd19a700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcac806b150 0x7fcac80c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:01.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.243+0000 7fcace19c700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcac81549f0 0x7fcac81514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:01.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.243+0000 7fcacd99b700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fcac80c4400 0x7fcac80c4cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.72:55482/0 (socket says 172.21.15.72:55482) 2023-07-27T20:33:01.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.243+0000 7fcacd99b700 1 -- 172.21.15.72:0/2383056725 learned_addr learned my addr 172.21.15.72:0/2383056725 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:01.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.243+0000 7fcacc999700 1 -- 172.21.15.72:0/2383056725 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3853229348 0 0) 0x7fcac806b710 con 0x7fcac80c4400 2023-07-27T20:33:01.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.243+0000 7fcacc999700 1 -- 172.21.15.72:0/2383056725 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcab40035b0 con 0x7fcac80c4400 2023-07-27T20:33:01.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.243+0000 7fcace19c700 1 -- 172.21.15.72:0/2383056725 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcac806b150 msgr2=0x7fcac80c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:01.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.243+0000 7fcace19c700 1 --2- 172.21.15.72:0/2383056725 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcac806b150 0x7fcac80c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:01.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.243+0000 7fcace19c700 1 -- 172.21.15.72:0/2383056725 >> v1:172.21.15.173:6789/0 conn(0x7fcac80c4400 legacy=0x7fcac80c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:01.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.243+0000 7fcace19c700 1 -- 172.21.15.72:0/2383056725 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac806b9f0 con 0x7fcac81549f0 2023-07-27T20:33:01.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.244+0000 7fcacd19a700 1 --2- 172.21.15.72:0/2383056725 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcac806b150 0x7fcac80c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:33:01.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.244+0000 7fcace19c700 1 --2- 172.21.15.72:0/2383056725 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcac81549f0 0x7fcac81514a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcac0009d90 tx=0x7fcac000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f0cf8acbd00daec server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:01.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.244+0000 7fcacc999700 1 -- 172.21.15.72:0/2383056725 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac000e070 con 0x7fcac81549f0 2023-07-27T20:33:01.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.244+0000 7fcacc999700 1 -- 172.21.15.72:0/2383056725 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac000bb20 con 0x7fcac81549f0 2023-07-27T20:33:01.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.244+0000 7fcacc999700 1 -- 172.21.15.72:0/2383056725 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac0012430 con 0x7fcac81549f0 2023-07-27T20:33:01.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.245+0000 7fcacfbff700 1 -- 172.21.15.72:0/2383056725 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcac81549f0 msgr2=0x7fcac81514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:01.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.245+0000 7fcacfbff700 1 --2- 172.21.15.72:0/2383056725 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcac81549f0 0x7fcac81514a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcac0009d90 tx=0x7fcac000b330 comp rx=0 tx=0).stop 2023-07-27T20:33:01.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.245+0000 7fcacfbff700 1 -- 172.21.15.72:0/2383056725 shutdown_connections 2023-07-27T20:33:01.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.245+0000 7fcacfbff700 1 --2- 172.21.15.72:0/2383056725 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcac81549f0 0x7fcac81514a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:01.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.245+0000 7fcacfbff700 1 --2- 172.21.15.72:0/2383056725 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcac806b150 0x7fcac80c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:01.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.245+0000 7fcacfbff700 1 -- 172.21.15.72:0/2383056725 >> 172.21.15.72:0/2383056725 conn(0x7fcac80ab300 msgr2=0x7fcac80ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:01.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.245+0000 7fcacfbff700 1 -- 172.21.15.72:0/2383056725 shutdown_connections 2023-07-27T20:33:01.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.245+0000 7fcacfbff700 1 -- 172.21.15.72:0/2383056725 wait complete. 2023-07-27T20:33:01.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.247+0000 7fcacfbff700 1 Processor -- start 2023-07-27T20:33:01.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.247+0000 7fcacfbff700 1 -- start start 2023-07-27T20:33:01.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.248+0000 7fcacfbff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcac806b150 0x7fcac81ed460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:01.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.248+0000 7fcacfbff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcac80c4400 0x7fcac81e9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:01.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.248+0000 7fcacfbff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcac81549f0 0x7fcac80aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:01.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.248+0000 7fcacfbff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac81ea2a0 con 0x7fcac80c4400 2023-07-27T20:33:01.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.248+0000 7fcacfbff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac80af250 con 0x7fcac806b150 2023-07-27T20:33:01.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.248+0000 7fcacfbff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac80aa790 con 0x7fcac81549f0 2023-07-27T20:33:01.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.249+0000 7fcacd19a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcac80c4400 0x7fcac81e9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:01.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.249+0000 7fcacd19a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcac80c4400 0x7fcac81e9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41222/0 (socket says 172.21.15.72:41222) 2023-07-27T20:33:01.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.249+0000 7fcacd19a700 1 -- 172.21.15.72:0/2101656210 learned_addr learned my addr 172.21.15.72:0/2101656210 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:01.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.249+0000 7fcacd99b700 1 --2- 172.21.15.72:0/2101656210 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcac806b150 0x7fcac81ed460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:01.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.249+0000 7fcace19c700 1 --2- 172.21.15.72:0/2101656210 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcac81549f0 0x7fcac80aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:01.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.249+0000 7fcacd19a700 1 -- 172.21.15.72:0/2101656210 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcac81549f0 msgr2=0x7fcac80aed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:01.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.249+0000 7fcacd19a700 1 --2- 172.21.15.72:0/2101656210 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcac81549f0 0x7fcac80aed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:01.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.249+0000 7fcacd19a700 1 -- 172.21.15.72:0/2101656210 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcac806b150 msgr2=0x7fcac81ed460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:01.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.249+0000 7fcacd19a700 1 --2- 172.21.15.72:0/2101656210 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcac806b150 0x7fcac81ed460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:01.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.249+0000 7fcacd19a700 1 -- 172.21.15.72:0/2101656210 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab80094a0 con 0x7fcac80c4400 2023-07-27T20:33:01.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.249+0000 7fcacd19a700 1 --2- 172.21.15.72:0/2101656210 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcac80c4400 0x7fcac81e9d60 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fcab800ec10 tx=0x7fcab800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:01.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.250+0000 7fcabe7fc700 1 -- 172.21.15.72:0/2101656210 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab800c850 con 0x7fcac80c4400 2023-07-27T20:33:01.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.250+0000 7fcabe7fc700 1 -- 172.21.15.72:0/2101656210 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcab800c9b0 con 0x7fcac80c4400 2023-07-27T20:33:01.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.250+0000 7fcabe7fc700 1 -- 172.21.15.72:0/2101656210 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab800cd20 con 0x7fcac80c4400 2023-07-27T20:33:01.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.250+0000 7fcacfbff700 1 -- 172.21.15.72:0/2101656210 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac0009a70 con 0x7fcac80c4400 2023-07-27T20:33:01.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.250+0000 7fcacfbff700 1 -- 172.21.15.72:0/2101656210 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac81ec980 con 0x7fcac80c4400 2023-07-27T20:33:01.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.251+0000 7fcacfbff700 1 -- 172.21.15.72:0/2101656210 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcac8151980 con 0x7fcac80c4400 2023-07-27T20:33:01.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.252+0000 7fcabe7fc700 1 -- 172.21.15.72:0/2101656210 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcab8013470 con 0x7fcac80c4400 2023-07-27T20:33:01.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.253+0000 7fcabe7fc700 1 --2- 172.21.15.72:0/2101656210 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcaac06ace0 0x7fcaac06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:01.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.253+0000 7fcabe7fc700 1 -- 172.21.15.72:0/2101656210 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fcab8089630 con 0x7fcac80c4400 2023-07-27T20:33:01.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.253+0000 7fcacd99b700 1 --2- 172.21.15.72:0/2101656210 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcaac06ace0 0x7fcaac06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:01.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.254+0000 7fcacd99b700 1 --2- 172.21.15.72:0/2101656210 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcaac06ace0 0x7fcaac06d1a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcac4007fd0 tx=0x7fcac4007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:01.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.257+0000 7fcabe7fc700 1 -- 172.21.15.72:0/2101656210 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcab80545a0 con 0x7fcac80c4400 2023-07-27T20:33:01.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.456+0000 7fcacfbff700 1 -- 172.21.15.72:0/2101656210 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcac814ed10 con 0x7fcac80c4400 2023-07-27T20:33:01.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.457+0000 7fcabe7fc700 1 -- 172.21.15.72:0/2101656210 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+18513 (secure 0 0 0) 0x7fcab8057bc0 con 0x7fcac80c4400 2023-07-27T20:33:01.446 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:33:01.446 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":40,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:33:00.053873+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:32:58.242890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-27T20:32:59.032110+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:33:01.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.459+0000 7fcacfbff700 1 -- 172.21.15.72:0/2101656210 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcaac06ace0 msgr2=0x7fcaac06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:01.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.459+0000 7fcacfbff700 1 --2- 172.21.15.72:0/2101656210 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcaac06ace0 0x7fcaac06d1a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcac4007fd0 tx=0x7fcac4007dc0 comp rx=0 tx=0).stop 2023-07-27T20:33:01.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.459+0000 7fcacfbff700 1 -- 172.21.15.72:0/2101656210 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcac80c4400 msgr2=0x7fcac81e9d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:01.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.459+0000 7fcacfbff700 1 --2- 172.21.15.72:0/2101656210 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcac80c4400 0x7fcac81e9d60 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fcab800ec10 tx=0x7fcab800ef20 comp rx=0 tx=0).stop 2023-07-27T20:33:01.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.459+0000 7fcacfbff700 1 -- 172.21.15.72:0/2101656210 shutdown_connections 2023-07-27T20:33:01.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.459+0000 7fcacfbff700 1 --2- 172.21.15.72:0/2101656210 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcaac06ace0 0x7fcaac06d1a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:01.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.459+0000 7fcacfbff700 1 --2- 172.21.15.72:0/2101656210 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcac81549f0 0x7fcac80aed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:01.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.459+0000 7fcacfbff700 1 --2- 172.21.15.72:0/2101656210 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcac806b150 0x7fcac81ed460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:01.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.459+0000 7fcacfbff700 1 --2- 172.21.15.72:0/2101656210 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcac80c4400 0x7fcac81e9d60 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:01.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.459+0000 7fcacfbff700 1 -- 172.21.15.72:0/2101656210 >> 172.21.15.72:0/2101656210 conn(0x7fcac80ab300 msgr2=0x7fcac8151270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:01.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.459+0000 7fcacfbff700 1 -- 172.21.15.72:0/2101656210 shutdown_connections 2023-07-27T20:33:01.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.460+0000 7fcacfbff700 1 -- 172.21.15.72:0/2101656210 wait complete. 2023-07-27T20:33:01.466 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-27T20:33:01.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.679+0000 7f67169ff700 1 Processor -- start 2023-07-27T20:33:01.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.679+0000 7f67169ff700 1 -- start start 2023-07-27T20:33:01.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.680+0000 7f67169ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f671014aab0 0x7f6710154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:01.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.680+0000 7f67169ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f67100c7740 0x7f67100c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:01.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.680+0000 7f67169ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67100c7c50 con 0x7f67100c4700 2023-07-27T20:33:01.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.680+0000 7f67169ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f671006bd40 con 0x7f671014aab0 2023-07-27T20:33:01.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.680+0000 7f67169ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67100c62f0 con 0x7f67100c7740 2023-07-27T20:33:01.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.681+0000 7f670ffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f671014aab0 0x7f6710154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:01.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.681+0000 7f670ffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f671014aab0 0x7f6710154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41230/0 (socket says 172.21.15.72:41230) 2023-07-27T20:33:01.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.681+0000 7f670ffff700 1 -- 172.21.15.72:0/4248607216 learned_addr learned my addr 172.21.15.72:0/4248607216 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:01.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.681+0000 7f670f7fe700 1 --2- 172.21.15.72:0/4248607216 >> v2:172.21.15.173:3300/0 conn(0x7f67100c7740 0x7f67100c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:01.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.681+0000 7f670ffff700 1 -- 172.21.15.72:0/4248607216 >> v2:172.21.15.173:3300/0 conn(0x7f67100c7740 msgr2=0x7f67100c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:01.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.681+0000 7f670ffff700 1 --2- 172.21.15.72:0/4248607216 >> v2:172.21.15.173:3300/0 conn(0x7f67100c7740 0x7f67100c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:01.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.681+0000 7f670ffff700 1 -- 172.21.15.72:0/4248607216 >> v1:172.21.15.173:6789/0 conn(0x7f67100c4700 legacy=0x7f671006c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:01.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.681+0000 7f670ffff700 1 -- 172.21.15.72:0/4248607216 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6710155050 con 0x7f671014aab0 2023-07-27T20:33:01.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.682+0000 7f670ffff700 1 --2- 172.21.15.72:0/4248607216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f671014aab0 0x7f6710154b10 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f67100a9090 tx=0x7f6700009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fd3088bf060e13c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:01.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.682+0000 7f670effd700 1 -- 172.21.15.72:0/4248607216 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670000b870 con 0x7f671014aab0 2023-07-27T20:33:01.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.682+0000 7f670effd700 1 -- 172.21.15.72:0/4248607216 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670000b9d0 con 0x7f671014aab0 2023-07-27T20:33:01.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.682+0000 7f670effd700 1 -- 172.21.15.72:0/4248607216 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670000bd60 con 0x7f671014aab0 2023-07-27T20:33:01.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.682+0000 7f67169ff700 1 -- 172.21.15.72:0/4248607216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f671014aab0 msgr2=0x7f6710154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:01.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.682+0000 7f67169ff700 1 --2- 172.21.15.72:0/4248607216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f671014aab0 0x7f6710154b10 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f67100a9090 tx=0x7f6700009bd0 comp rx=0 tx=0).stop 2023-07-27T20:33:01.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.682+0000 7f67169ff700 1 -- 172.21.15.72:0/4248607216 shutdown_connections 2023-07-27T20:33:01.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.682+0000 7f67169ff700 1 --2- 172.21.15.72:0/4248607216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f671014aab0 0x7f6710154b10 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:01.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.682+0000 7f67169ff700 1 --2- 172.21.15.72:0/4248607216 >> v2:172.21.15.173:3300/0 conn(0x7f67100c7740 0x7f67100c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:01.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.682+0000 7f67169ff700 1 -- 172.21.15.72:0/4248607216 >> 172.21.15.72:0/4248607216 conn(0x7f67100ab3f0 msgr2=0x7f67100ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:01.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.682+0000 7f67169ff700 1 -- 172.21.15.72:0/4248607216 shutdown_connections 2023-07-27T20:33:01.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.682+0000 7f67169ff700 1 -- 172.21.15.72:0/4248607216 wait complete. 2023-07-27T20:33:01.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.684+0000 7f67169ff700 1 Processor -- start 2023-07-27T20:33:01.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.684+0000 7f67169ff700 1 -- start start 2023-07-27T20:33:01.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.685+0000 7f67169ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f67100c4700 0x7f67100bd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:01.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.685+0000 7f67169ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67100c7740 0x7f67100bbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:01.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.685+0000 7f67169ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f671014aab0 0x7f67100bc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:01.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.685+0000 7f67169ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67100bc740 con 0x7f671014aab0 2023-07-27T20:33:01.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.685+0000 7f67169ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67100bf180 con 0x7f67100c7740 2023-07-27T20:33:01.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.685+0000 7f67169ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67100bfca0 con 0x7f67100c4700 2023-07-27T20:33:01.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.685+0000 7f6714f9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f671014aab0 0x7f67100bc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:01.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.685+0000 7f6714f9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f671014aab0 0x7f67100bc200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41236/0 (socket says 172.21.15.72:41236) 2023-07-27T20:33:01.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.685+0000 7f670ffff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f67100c4700 0x7f67100bd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:01.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.685+0000 7f6714f9c700 1 -- 172.21.15.72:0/2177901870 learned_addr learned my addr 172.21.15.72:0/2177901870 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:01.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.685+0000 7f670f7fe700 1 --2- 172.21.15.72:0/2177901870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67100c7740 0x7f67100bbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:01.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.686+0000 7f6714f9c700 1 -- 172.21.15.72:0/2177901870 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f67100c4700 msgr2=0x7f67100bd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:01.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.686+0000 7f6714f9c700 1 --2- 172.21.15.72:0/2177901870 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f67100c4700 0x7f67100bd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:01.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.686+0000 7f6714f9c700 1 -- 172.21.15.72:0/2177901870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67100c7740 msgr2=0x7f67100bbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:01.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.686+0000 7f6714f9c700 1 --2- 172.21.15.72:0/2177901870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67100c7740 0x7f67100bbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:01.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.686+0000 7f6714f9c700 1 -- 172.21.15.72:0/2177901870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6700009550 con 0x7f671014aab0 2023-07-27T20:33:01.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.686+0000 7f6714f9c700 1 --2- 172.21.15.72:0/2177901870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f671014aab0 0x7f67100bc200 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f670800cc80 tx=0x7f670800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:01.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.686+0000 7f670cff9700 1 -- 172.21.15.72:0/2177901870 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6708003c00 con 0x7f671014aab0 2023-07-27T20:33:01.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.686+0000 7f670cff9700 1 -- 172.21.15.72:0/2177901870 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6708003d60 con 0x7f671014aab0 2023-07-27T20:33:01.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.686+0000 7f67169ff700 1 -- 172.21.15.72:0/2177901870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67100bf370 con 0x7f671014aab0 2023-07-27T20:33:01.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.686+0000 7f670cff9700 1 -- 172.21.15.72:0/2177901870 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670800aaa0 con 0x7f671014aab0 2023-07-27T20:33:01.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.686+0000 7f67169ff700 1 -- 172.21.15.72:0/2177901870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67100bf930 con 0x7f671014aab0 2023-07-27T20:33:01.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.687+0000 7f67169ff700 1 -- 172.21.15.72:0/2177901870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67100be870 con 0x7f671014aab0 2023-07-27T20:33:01.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.688+0000 7f670cff9700 1 -- 172.21.15.72:0/2177901870 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f670800ac00 con 0x7f671014aab0 2023-07-27T20:33:01.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.689+0000 7f670cff9700 1 --2- 172.21.15.72:0/2177901870 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f66fc06ace0 0x7f66fc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:01.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.689+0000 7f670cff9700 1 -- 172.21.15.72:0/2177901870 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6708089540 con 0x7f671014aab0 2023-07-27T20:33:01.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.689+0000 7f670ffff700 1 --2- 172.21.15.72:0/2177901870 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f66fc06ace0 0x7f66fc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:01.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.690+0000 7f670ffff700 1 --2- 172.21.15.72:0/2177901870 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f66fc06ace0 0x7f66fc06d1a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6700014040 tx=0x7f6700008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:01.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.693+0000 7f670cff9700 1 -- 172.21.15.72:0/2177901870 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f67100be870 con 0x7f671014aab0 2023-07-27T20:33:01.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:01.934+0000 7f67169ff700 1 -- 172.21.15.72:0/2177901870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f67100be870 con 0x7f671014aab0 2023-07-27T20:33:02.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.585+0000 7f670cff9700 1 -- 172.21.15.72:0/2177901870 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f67100be870 con 0x7f671014aab0 2023-07-27T20:33:02.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.588+0000 7f67169ff700 1 -- 172.21.15.72:0/2177901870 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f66fc06ace0 msgr2=0x7f66fc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:02.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.588+0000 7f67169ff700 1 --2- 172.21.15.72:0/2177901870 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f66fc06ace0 0x7f66fc06d1a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6700014040 tx=0x7f6700008030 comp rx=0 tx=0).stop 2023-07-27T20:33:02.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.588+0000 7f67169ff700 1 -- 172.21.15.72:0/2177901870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f671014aab0 msgr2=0x7f67100bc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:02.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.588+0000 7f67169ff700 1 --2- 172.21.15.72:0/2177901870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f671014aab0 0x7f67100bc200 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f670800cc80 tx=0x7f670800cf90 comp rx=0 tx=0).stop 2023-07-27T20:33:02.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.588+0000 7f67169ff700 1 -- 172.21.15.72:0/2177901870 shutdown_connections 2023-07-27T20:33:02.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.588+0000 7f67169ff700 1 --2- 172.21.15.72:0/2177901870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f671014aab0 0x7f67100bc200 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:02.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.588+0000 7f67169ff700 1 --2- 172.21.15.72:0/2177901870 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f66fc06ace0 0x7f66fc06d1a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:02.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.588+0000 7f67169ff700 1 --2- 172.21.15.72:0/2177901870 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f67100c4700 0x7f67100bd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:02.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.588+0000 7f67169ff700 1 --2- 172.21.15.72:0/2177901870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67100c7740 0x7f67100bbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:02.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.588+0000 7f67169ff700 1 -- 172.21.15.72:0/2177901870 >> 172.21.15.72:0/2177901870 conn(0x7f67100ab3f0 msgr2=0x7f671006c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:02.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.588+0000 7f67169ff700 1 -- 172.21.15.72:0/2177901870 shutdown_connections 2023-07-27T20:33:02.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.588+0000 7f67169ff700 1 -- 172.21.15.72:0/2177901870 wait complete. 2023-07-27T20:33:02.595 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-27T20:33:02.595 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-27T20:33:02.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.805+0000 7fda903ff700 1 Processor -- start 2023-07-27T20:33:02.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.805+0000 7fda903ff700 1 -- start start 2023-07-27T20:33:02.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.807+0000 7fda903ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fda880a80a0 0x7fda8815f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:02.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.807+0000 7fda903ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda88154940 con 0x7fda881515a0 2023-07-27T20:33:02.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.807+0000 7fda903ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda88154e70 con 0x7fda88072230 2023-07-27T20:33:02.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.807+0000 7fda903ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda88151980 con 0x7fda880a80a0 2023-07-27T20:33:02.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.807+0000 7fda8e19b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fda881515a0 0x7fda8806b2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41126/0 (socket says 172.21.15.72:41126) 2023-07-27T20:33:02.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.807+0000 7fda8e19b700 1 -- 172.21.15.72:0/2210404213 learned_addr learned my addr 172.21.15.72:0/2210404213 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:02.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.807+0000 7fda8e99c700 1 --2- 172.21.15.72:0/2210404213 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fda880a80a0 0x7fda8815f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:02.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.807+0000 7fda8d199700 1 -- 172.21.15.72:0/2210404213 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1735671413 0 0) 0x7fda88154940 con 0x7fda881515a0 2023-07-27T20:33:02.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.807+0000 7fda8d199700 1 -- 172.21.15.72:0/2210404213 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda740035b0 con 0x7fda881515a0 2023-07-27T20:33:02.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.808+0000 7fda8d199700 1 -- 172.21.15.72:0/2210404213 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4175233997 0 0) 0x7fda88154e70 con 0x7fda88072230 2023-07-27T20:33:02.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.808+0000 7fda8d199700 1 -- 172.21.15.72:0/2210404213 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda88154940 con 0x7fda88072230 2023-07-27T20:33:02.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.808+0000 7fda8d199700 1 -- 172.21.15.72:0/2210404213 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 938769758 0 0) 0x7fda740035b0 con 0x7fda881515a0 2023-07-27T20:33:02.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.808+0000 7fda8d199700 1 -- 172.21.15.72:0/2210404213 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fda880a80a0 msgr2=0x7fda8815f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:02.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.808+0000 7fda8d199700 1 --2- 172.21.15.72:0/2210404213 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fda880a80a0 0x7fda8815f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:02.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.808+0000 7fda8d199700 1 -- 172.21.15.72:0/2210404213 >> v1:172.21.15.173:6789/0 conn(0x7fda88072230 legacy=0x7fda88071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:02.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.808+0000 7fda8d199700 1 -- 172.21.15.72:0/2210404213 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda88071da0 con 0x7fda881515a0 2023-07-27T20:33:02.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.808+0000 7fda8d199700 1 -- 172.21.15.72:0/2210404213 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7fda84001670 con 0x7fda881515a0 2023-07-27T20:33:02.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.808+0000 7fda8d199700 1 -- 172.21.15.72:0/2210404213 >> v1:172.21.15.72:6789/0 conn(0x7fda881515a0 legacy=0x7fda8806b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:02.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.808+0000 7fda8d199700 1 --2- 172.21.15.72:0/2210404213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda74003bc0 0x7fda74003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:02.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.808+0000 7fda8d199700 1 --2- 172.21.15.72:0/2210404213 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fda880a80a0 0x7fda74004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:02.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.808+0000 7fda8d199700 1 --2- 172.21.15.72:0/2210404213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda74004d90 0x7fda74005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:02.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.808+0000 7fda8d199700 1 -- 172.21.15.72:0/2210404213 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda88151980 con 0x7fda74003bc0 2023-07-27T20:33:02.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.808+0000 7fda8d199700 1 -- 172.21.15.72:0/2210404213 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7400bc50 con 0x7fda74004d90 2023-07-27T20:33:02.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.808+0000 7fda8d199700 1 -- 172.21.15.72:0/2210404213 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda7400be10 con 0x7fda880a80a0 2023-07-27T20:33:02.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.808+0000 7fda8e19b700 1 --2- 172.21.15.72:0/2210404213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda74003bc0 0x7fda74003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:02.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.808+0000 7fda8d99a700 1 --2- 172.21.15.72:0/2210404213 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fda880a80a0 0x7fda74004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:02.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.808+0000 7fda8e99c700 1 --2- 172.21.15.72:0/2210404213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda74004d90 0x7fda74005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:02.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.808+0000 7fda8e19b700 1 -- 172.21.15.72:0/2210404213 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fda880a80a0 msgr2=0x7fda74004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:02.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.808+0000 7fda8e19b700 1 --2- 172.21.15.72:0/2210404213 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fda880a80a0 0x7fda74004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:02.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.808+0000 7fda8e19b700 1 -- 172.21.15.72:0/2210404213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda74004d90 msgr2=0x7fda74005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:02.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.808+0000 7fda8e19b700 1 --2- 172.21.15.72:0/2210404213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda74004d90 0x7fda74005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:02.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.808+0000 7fda8e19b700 1 -- 172.21.15.72:0/2210404213 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda740035b0 con 0x7fda74003bc0 2023-07-27T20:33:02.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.808+0000 7fda8e99c700 1 --2- 172.21.15.72:0/2210404213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda74004d90 0x7fda74005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:33:02.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.809+0000 7fda8e19b700 1 --2- 172.21.15.72:0/2210404213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda74003bc0 0x7fda74003fc0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fda8400c110 tx=0x7fda74005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=638fa206c76fd7bf server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:02.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.809+0000 7fda8d199700 1 -- 172.21.15.72:0/2210404213 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8400cc70 con 0x7fda74003bc0 2023-07-27T20:33:02.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.809+0000 7fda8d199700 1 -- 172.21.15.72:0/2210404213 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8400cdf0 con 0x7fda74003bc0 2023-07-27T20:33:02.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.809+0000 7fda8d199700 1 -- 172.21.15.72:0/2210404213 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda84005ba0 con 0x7fda74003bc0 2023-07-27T20:33:02.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.809+0000 7fda903ff700 1 -- 172.21.15.72:0/2210404213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda74003bc0 msgr2=0x7fda74003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:02.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.809+0000 7fda903ff700 1 --2- 172.21.15.72:0/2210404213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda74003bc0 0x7fda74003fc0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fda8400c110 tx=0x7fda74005880 comp rx=0 tx=0).stop 2023-07-27T20:33:02.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.809+0000 7fda8e99c700 1 -- 172.21.15.72:0/2210404213 reap_dead start 2023-07-27T20:33:02.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.810+0000 7fda903ff700 1 -- 172.21.15.72:0/2210404213 shutdown_connections 2023-07-27T20:33:02.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.810+0000 7fda903ff700 1 -- 172.21.15.72:0/2210404213 >> 172.21.15.72:0/2210404213 conn(0x7fda880c2f40 msgr2=0x7fda880c3350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:02.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.810+0000 7fda903ff700 1 -- 172.21.15.72:0/2210404213 shutdown_connections 2023-07-27T20:33:02.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.810+0000 7fda903ff700 1 -- 172.21.15.72:0/2210404213 wait complete. 2023-07-27T20:33:02.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.811+0000 7fda903ff700 1 Processor -- start 2023-07-27T20:33:02.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.811+0000 7fda903ff700 1 -- start start 2023-07-27T20:33:02.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.812+0000 7fda903ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fda74003bc0 0x7fda880c4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:02.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.812+0000 7fda903ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda880c4aa0 0x7fda881ea000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:02.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.812+0000 7fda903ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda881ea540 0x7fda8814c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:02.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.812+0000 7fda903ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda881e9bb0 con 0x7fda881ea540 2023-07-27T20:33:02.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.812+0000 7fda903ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda881eb020 con 0x7fda880c4aa0 2023-07-27T20:33:02.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.812+0000 7fda903ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda881ed500 con 0x7fda74003bc0 2023-07-27T20:33:02.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.813+0000 7fda8e99c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda881ea540 0x7fda8814c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:02.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.813+0000 7fda8e99c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda881ea540 0x7fda8814c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41262/0 (socket says 172.21.15.72:41262) 2023-07-27T20:33:02.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.813+0000 7fda8e99c700 1 -- 172.21.15.72:0/4223347310 learned_addr learned my addr 172.21.15.72:0/4223347310 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:02.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.813+0000 7fda8e19b700 1 --2- 172.21.15.72:0/4223347310 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fda74003bc0 0x7fda880c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:02.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.813+0000 7fda8d99a700 1 --2- 172.21.15.72:0/4223347310 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda880c4aa0 0x7fda881ea000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:02.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.813+0000 7fda8e99c700 1 -- 172.21.15.72:0/4223347310 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fda74003bc0 msgr2=0x7fda880c4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:02.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.813+0000 7fda8e99c700 1 --2- 172.21.15.72:0/4223347310 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fda74003bc0 0x7fda880c4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:02.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.813+0000 7fda8e99c700 1 -- 172.21.15.72:0/4223347310 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda880c4aa0 msgr2=0x7fda881ea000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:02.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.813+0000 7fda8e99c700 1 --2- 172.21.15.72:0/4223347310 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda880c4aa0 0x7fda881ea000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:02.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.813+0000 7fda8e99c700 1 -- 172.21.15.72:0/4223347310 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda881ed7e0 con 0x7fda881ea540 2023-07-27T20:33:02.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.813+0000 7fda8e99c700 1 --2- 172.21.15.72:0/4223347310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda881ea540 0x7fda8814c2e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fda8806f250 tx=0x7fda800104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:02.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.813+0000 7fda7effd700 1 -- 172.21.15.72:0/4223347310 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8000e050 con 0x7fda881ea540 2023-07-27T20:33:02.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.814+0000 7fda7effd700 1 -- 172.21.15.72:0/4223347310 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8000f040 con 0x7fda881ea540 2023-07-27T20:33:02.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.814+0000 7fda7effd700 1 -- 172.21.15.72:0/4223347310 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda80010da0 con 0x7fda881ea540 2023-07-27T20:33:02.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.814+0000 7fda903ff700 1 -- 172.21.15.72:0/4223347310 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda881edac0 con 0x7fda881ea540 2023-07-27T20:33:02.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.814+0000 7fda903ff700 1 -- 172.21.15.72:0/4223347310 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda881ea9f0 con 0x7fda881ea540 2023-07-27T20:33:02.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.815+0000 7fda903ff700 1 -- 172.21.15.72:0/4223347310 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda88074310 con 0x7fda881ea540 2023-07-27T20:33:02.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.815+0000 7fda7effd700 1 -- 172.21.15.72:0/4223347310 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fda80015440 con 0x7fda881ea540 2023-07-27T20:33:02.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.816+0000 7fda7effd700 1 --2- 172.21.15.72:0/4223347310 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fda6c06ace0 0x7fda6c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:02.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.816+0000 7fda7effd700 1 -- 172.21.15.72:0/4223347310 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fda80089960 con 0x7fda881ea540 2023-07-27T20:33:02.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.817+0000 7fda8e19b700 1 --2- 172.21.15.72:0/4223347310 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fda6c06ace0 0x7fda6c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:02.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.817+0000 7fda8e19b700 1 --2- 172.21.15.72:0/4223347310 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fda6c06ace0 0x7fda6c06d1a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fda84000c00 tx=0x7fda8400a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:02.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:02.821+0000 7fda7effd700 1 -- 172.21.15.72:0/4223347310 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fda80054960 con 0x7fda881ea540 2023-07-27T20:33:03.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.057+0000 7fda903ff700 1 -- 172.21.15.72:0/4223347310 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fda880ac1d0 con 0x7fda881ea540 2023-07-27T20:33:03.463 INFO:tasks.ceph.mds.c.smithi072.stderr:2023-07-27T20:33:03.475+0000 7fd699df1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-27T20:33:03.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.587+0000 7fda7effd700 1 -- 172.21.15.72:0/4223347310 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7fda80057f80 con 0x7fda881ea540 2023-07-27T20:33:03.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.590+0000 7fda903ff700 1 -- 172.21.15.72:0/4223347310 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fda6c06ace0 msgr2=0x7fda6c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:03.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.590+0000 7fda903ff700 1 --2- 172.21.15.72:0/4223347310 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fda6c06ace0 0x7fda6c06d1a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fda84000c00 tx=0x7fda8400a000 comp rx=0 tx=0).stop 2023-07-27T20:33:03.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.590+0000 7fda903ff700 1 -- 172.21.15.72:0/4223347310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda881ea540 msgr2=0x7fda8814c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:03.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.590+0000 7fda903ff700 1 --2- 172.21.15.72:0/4223347310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda881ea540 0x7fda8814c2e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fda8806f250 tx=0x7fda800104a0 comp rx=0 tx=0).stop 2023-07-27T20:33:03.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.590+0000 7fda903ff700 1 -- 172.21.15.72:0/4223347310 shutdown_connections 2023-07-27T20:33:03.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.590+0000 7fda903ff700 1 --2- 172.21.15.72:0/4223347310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda881ea540 0x7fda8814c2e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:03.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.590+0000 7fda903ff700 1 --2- 172.21.15.72:0/4223347310 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fda6c06ace0 0x7fda6c06d1a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:03.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.590+0000 7fda903ff700 1 --2- 172.21.15.72:0/4223347310 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fda74003bc0 0x7fda880c4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:03.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.590+0000 7fda903ff700 1 --2- 172.21.15.72:0/4223347310 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda880c4aa0 0x7fda881ea000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:03.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.590+0000 7fda903ff700 1 -- 172.21.15.72:0/4223347310 >> 172.21.15.72:0/4223347310 conn(0x7fda880c2f40 msgr2=0x7fda881dd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:03.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.590+0000 7fda903ff700 1 -- 172.21.15.72:0/4223347310 shutdown_connections 2023-07-27T20:33:03.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.590+0000 7fda903ff700 1 -- 172.21.15.72:0/4223347310 wait complete. 2023-07-27T20:33:03.598 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-27T20:33:03.598 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T20:33:03.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.806+0000 7fbcfe9ff700 1 Processor -- start 2023-07-27T20:33:03.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.806+0000 7fbcfe9ff700 1 -- start start 2023-07-27T20:33:03.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.808+0000 7fbcfe9ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbcf8139960 0x7fbcf80c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:03.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.808+0000 7fbcfe9ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbcf81542e0 0x7fbcf8154730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:03.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.808+0000 7fbcfe9ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf80c1810 con 0x7fbcf8139f80 2023-07-27T20:33:03.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.808+0000 7fbcfe9ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcf80c0ee0 con 0x7fbcf81542e0 2023-07-27T20:33:03.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.808+0000 7fbcfe9ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf8139d40 con 0x7fbcf8139960 2023-07-27T20:33:03.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.808+0000 7fbcf7fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbcf8139960 0x7fbcf80c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:03.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.808+0000 7fbcf7fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbcf8139960 0x7fbcf80c12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.72:38006/0 (socket says 172.21.15.72:38006) 2023-07-27T20:33:03.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.808+0000 7fbcf77fe700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fbcf8139f80 0x7fbcf80c1e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.72:55506/0 (socket says 172.21.15.72:55506) 2023-07-27T20:33:03.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.808+0000 7fbcf7fff700 1 -- 172.21.15.72:0/1093404274 learned_addr learned my addr 172.21.15.72:0/1093404274 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:03.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.808+0000 7fbcfcf9c700 1 --2- 172.21.15.72:0/1093404274 >> v2:172.21.15.173:3300/0 conn(0x7fbcf81542e0 0x7fbcf8154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:03.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.809+0000 7fbcf6ffd700 1 -- 172.21.15.72:0/1093404274 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 422358398 0 0) 0x7fbcf80c1810 con 0x7fbcf8139f80 2023-07-27T20:33:03.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.809+0000 7fbcf7fff700 1 -- 172.21.15.72:0/1093404274 >> v2:172.21.15.173:3300/0 conn(0x7fbcf81542e0 msgr2=0x7fbcf8154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:03.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.809+0000 7fbcf7fff700 1 --2- 172.21.15.72:0/1093404274 >> v2:172.21.15.173:3300/0 conn(0x7fbcf81542e0 0x7fbcf8154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:03.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.809+0000 7fbcf7fff700 1 -- 172.21.15.72:0/1093404274 >> v1:172.21.15.173:6789/0 conn(0x7fbcf8139f80 legacy=0x7fbcf80c1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:03.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.809+0000 7fbcf7fff700 1 -- 172.21.15.72:0/1093404274 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf8151060 con 0x7fbcf8139960 2023-07-27T20:33:03.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.809+0000 7fbcfcf9c700 1 --2- 172.21.15.72:0/1093404274 >> v2:172.21.15.173:3300/0 conn(0x7fbcf81542e0 0x7fbcf8154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:33:03.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.809+0000 7fbcf7fff700 1 --2- 172.21.15.72:0/1093404274 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbcf8139960 0x7fbcf80c12d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbce80098f0 tx=0x7fbce8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfd7f3d9f637dcfd server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:03.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.810+0000 7fbcf6ffd700 1 -- 172.21.15.72:0/1093404274 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce8011830 con 0x7fbcf8139960 2023-07-27T20:33:03.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.810+0000 7fbcf6ffd700 1 -- 172.21.15.72:0/1093404274 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce8011990 con 0x7fbcf8139960 2023-07-27T20:33:03.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.810+0000 7fbcf6ffd700 1 -- 172.21.15.72:0/1093404274 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce8011d20 con 0x7fbcf8139960 2023-07-27T20:33:03.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.810+0000 7fbcfe9ff700 1 -- 172.21.15.72:0/1093404274 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbcf8139960 msgr2=0x7fbcf80c12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:03.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.810+0000 7fbcfe9ff700 1 --2- 172.21.15.72:0/1093404274 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbcf8139960 0x7fbcf80c12d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbce80098f0 tx=0x7fbce8009c00 comp rx=0 tx=0).stop 2023-07-27T20:33:03.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.810+0000 7fbcfe9ff700 1 -- 172.21.15.72:0/1093404274 shutdown_connections 2023-07-27T20:33:03.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.810+0000 7fbcfe9ff700 1 --2- 172.21.15.72:0/1093404274 >> v2:172.21.15.173:3300/0 conn(0x7fbcf81542e0 0x7fbcf8154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:03.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.810+0000 7fbcfe9ff700 1 --2- 172.21.15.72:0/1093404274 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbcf8139960 0x7fbcf80c12d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:03.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.810+0000 7fbcfe9ff700 1 -- 172.21.15.72:0/1093404274 >> 172.21.15.72:0/1093404274 conn(0x7fbcf806a190 msgr2=0x7fbcf806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:03.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.810+0000 7fbcfe9ff700 1 -- 172.21.15.72:0/1093404274 shutdown_connections 2023-07-27T20:33:03.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.810+0000 7fbcfe9ff700 1 -- 172.21.15.72:0/1093404274 wait complete. 2023-07-27T20:33:03.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.812+0000 7fbcfe9ff700 1 Processor -- start 2023-07-27T20:33:03.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.812+0000 7fbcfe9ff700 1 -- start start 2023-07-27T20:33:03.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.813+0000 7fbcfe9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcf8139960 0x7fbcf8138a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:03.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.813+0000 7fbcfe9ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbcf8139f80 0x7fbcf80aa630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:03.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.813+0000 7fbcfe9ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbcf81542e0 0x7fbcf814dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:03.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.813+0000 7fbcfe9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf8139110 con 0x7fbcf8139960 2023-07-27T20:33:03.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.813+0000 7fbcfe9ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf81e9500 con 0x7fbcf81542e0 2023-07-27T20:33:03.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.813+0000 7fbcfe9ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf81e8740 con 0x7fbcf8139f80 2023-07-27T20:33:03.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.813+0000 7fbcf7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcf8139960 0x7fbcf8138a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:03.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.813+0000 7fbcf7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcf8139960 0x7fbcf8138a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41276/0 (socket says 172.21.15.72:41276) 2023-07-27T20:33:03.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.813+0000 7fbcf7fff700 1 -- 172.21.15.72:0/2601814870 learned_addr learned my addr 172.21.15.72:0/2601814870 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:03.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.813+0000 7fbcf77fe700 1 --2- 172.21.15.72:0/2601814870 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbcf8139f80 0x7fbcf80aa630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:03.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.813+0000 7fbcfcf9c700 1 --2- 172.21.15.72:0/2601814870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbcf81542e0 0x7fbcf814dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:03.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.813+0000 7fbcf7fff700 1 -- 172.21.15.72:0/2601814870 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbcf8139f80 msgr2=0x7fbcf80aa630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:03.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.813+0000 7fbcf7fff700 1 --2- 172.21.15.72:0/2601814870 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbcf8139f80 0x7fbcf80aa630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:03.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.813+0000 7fbcf7fff700 1 -- 172.21.15.72:0/2601814870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbcf81542e0 msgr2=0x7fbcf814dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:03.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.813+0000 7fbcf7fff700 1 --2- 172.21.15.72:0/2601814870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbcf81542e0 0x7fbcf814dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:03.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.814+0000 7fbcf7fff700 1 -- 172.21.15.72:0/2601814870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf00099e0 con 0x7fbcf8139960 2023-07-27T20:33:03.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.814+0000 7fbcfcf9c700 1 --2- 172.21.15.72:0/2601814870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbcf81542e0 0x7fbcf814dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:33:03.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.814+0000 7fbcf7fff700 1 --2- 172.21.15.72:0/2601814870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcf8139960 0x7fbcf8138a50 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fbce8009c40 tx=0x7fbce8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:03.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.814+0000 7fbcf4ff9700 1 -- 172.21.15.72:0/2601814870 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce80036a0 con 0x7fbcf8139960 2023-07-27T20:33:03.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.814+0000 7fbcf4ff9700 1 -- 172.21.15.72:0/2601814870 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce801e070 con 0x7fbcf8139960 2023-07-27T20:33:03.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.814+0000 7fbcf4ff9700 1 -- 172.21.15.72:0/2601814870 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce8003a20 con 0x7fbcf8139960 2023-07-27T20:33:03.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.814+0000 7fbcfe9ff700 1 -- 172.21.15.72:0/2601814870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbce8009550 con 0x7fbcf8139960 2023-07-27T20:33:03.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.814+0000 7fbcfe9ff700 1 -- 172.21.15.72:0/2601814870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcf81e8d00 con 0x7fbcf8139960 2023-07-27T20:33:03.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.815+0000 7fbcde7fc700 1 -- 172.21.15.72:0/2601814870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcf8074310 con 0x7fbcf8139960 2023-07-27T20:33:03.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.816+0000 7fbcf4ff9700 1 -- 172.21.15.72:0/2601814870 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbce8003b80 con 0x7fbcf8139960 2023-07-27T20:33:03.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.817+0000 7fbcf4ff9700 1 --2- 172.21.15.72:0/2601814870 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fbce406ad10 0x7fbce406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:03.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.817+0000 7fbcf4ff9700 1 -- 172.21.15.72:0/2601814870 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fbce808a510 con 0x7fbcf8139960 2023-07-27T20:33:03.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.818+0000 7fbcf77fe700 1 --2- 172.21.15.72:0/2601814870 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fbce406ad10 0x7fbce406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:03.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.818+0000 7fbcf77fe700 1 --2- 172.21.15.72:0/2601814870 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fbce406ad10 0x7fbce406d1d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbcf80ab0f0 tx=0x7fbcec007be0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:03.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:03.821+0000 7fbcf4ff9700 1 -- 172.21.15.72:0/2601814870 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbce80554f0 con 0x7fbcf8139960 2023-07-27T20:33:04.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.054+0000 7fbcde7fc700 1 -- 172.21.15.72:0/2601814870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbcf80c10b0 con 0x7fbcf8139960 2023-07-27T20:33:04.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.055+0000 7fbcf4ff9700 1 -- 172.21.15.72:0/2601814870 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4671 (secure 0 0 0) 0x7fbce8058b10 con 0x7fbcf8139960 2023-07-27T20:33:04.044 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:33:04.044 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/1685903768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1685903768},{"type":"v1","addr":"172.21.15.173:6836","nonce":1685903768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5269,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/43862591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":43862591},{"type":"v1","addr":"172.21.15.173:6837","nonce":43862591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/1644610738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1644610738},{"type":"v1","addr":"172.21.15.72:6835","nonce":1644610738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T20:33:00.054239+0000","modified":"2023-07-27T20:33:03.586058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5409},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5409":{"gid":5409,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.72:6834/1959104268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":1959104268},{"type":"v1","addr":"172.21.15.72:6834","nonce":1959104268}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-27T20:33:04.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.057+0000 7fbcde7fc700 1 -- 172.21.15.72:0/2601814870 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fbce406ad10 msgr2=0x7fbce406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:04.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.057+0000 7fbcde7fc700 1 --2- 172.21.15.72:0/2601814870 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fbce406ad10 0x7fbce406d1d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbcf80ab0f0 tx=0x7fbcec007be0 comp rx=0 tx=0).stop 2023-07-27T20:33:04.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.057+0000 7fbcde7fc700 1 -- 172.21.15.72:0/2601814870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcf8139960 msgr2=0x7fbcf8138a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:04.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.057+0000 7fbcde7fc700 1 --2- 172.21.15.72:0/2601814870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcf8139960 0x7fbcf8138a50 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fbce8009c40 tx=0x7fbce8004750 comp rx=0 tx=0).stop 2023-07-27T20:33:04.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.057+0000 7fbcde7fc700 1 -- 172.21.15.72:0/2601814870 shutdown_connections 2023-07-27T20:33:04.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.057+0000 7fbcde7fc700 1 --2- 172.21.15.72:0/2601814870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbcf81542e0 0x7fbcf814dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:04.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.057+0000 7fbcde7fc700 1 --2- 172.21.15.72:0/2601814870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcf8139960 0x7fbcf8138a50 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:04.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.057+0000 7fbcde7fc700 1 --2- 172.21.15.72:0/2601814870 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fbce406ad10 0x7fbce406d1d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:04.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.057+0000 7fbcde7fc700 1 --2- 172.21.15.72:0/2601814870 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbcf8139f80 0x7fbcf80aa630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:04.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.057+0000 7fbcde7fc700 1 -- 172.21.15.72:0/2601814870 >> 172.21.15.72:0/2601814870 conn(0x7fbcf806a190 msgr2=0x7fbcf80c5840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:04.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.058+0000 7fbcde7fc700 1 -- 172.21.15.72:0/2601814870 shutdown_connections 2023-07-27T20:33:04.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.058+0000 7fbcde7fc700 1 -- 172.21.15.72:0/2601814870 wait complete. 2023-07-27T20:33:04.048 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 17 2023-07-27T20:33:04.064 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:33:04.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.271+0000 7f64d9dff700 1 Processor -- start 2023-07-27T20:33:04.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.271+0000 7f64d9dff700 1 -- start start 2023-07-27T20:33:04.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.272+0000 7f64d9dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f64d40aad50 0x7f64d4150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:04.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.272+0000 7f64d9dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64d4070080 con 0x7f64d40c1930 2023-07-27T20:33:04.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.272+0000 7f64d9dff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64d40ab330 con 0x7f64d414da10 2023-07-27T20:33:04.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.272+0000 7f64d9dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64d40702d0 con 0x7f64d40aad50 2023-07-27T20:33:04.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.272+0000 7f64d3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f64d40aad50 0x7f64d4150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:04.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.272+0000 7f64d3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f64d40aad50 0x7f64d4150bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41288/0 (socket says 172.21.15.72:41288) 2023-07-27T20:33:04.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.272+0000 7f64d3fff700 1 -- 172.21.15.72:0/1282350290 learned_addr learned my addr 172.21.15.72:0/1282350290 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:04.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.273+0000 7f64d3fff700 1 -- 172.21.15.72:0/1282350290 >> v1:172.21.15.173:6789/0 conn(0x7f64d414da10 legacy=0x7f64d406d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:04.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.273+0000 7f64d3fff700 1 -- 172.21.15.72:0/1282350290 >> v1:172.21.15.72:6789/0 conn(0x7f64d40c1930 legacy=0x7f64d41504b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:04.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.273+0000 7f64d3fff700 1 -- 172.21.15.72:0/1282350290 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d40705b0 con 0x7f64d40aad50 2023-07-27T20:33:04.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.273+0000 7f64d3fff700 1 --2- 172.21.15.72:0/1282350290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64d40aad50 0x7f64d4150bc0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f64cc009e50 tx=0x7f64cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaf8d2673f9a4356 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:04.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.273+0000 7f64d27fc700 1 -- 172.21.15.72:0/1282350290 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc00bbc0 con 0x7f64d40aad50 2023-07-27T20:33:04.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.273+0000 7f64d27fc700 1 -- 172.21.15.72:0/1282350290 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64cc00bd20 con 0x7f64d40aad50 2023-07-27T20:33:04.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.273+0000 7f64d27fc700 1 -- 172.21.15.72:0/1282350290 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc0106c0 con 0x7f64d40aad50 2023-07-27T20:33:04.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.274+0000 7f64d9dff700 1 -- 172.21.15.72:0/1282350290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64d40aad50 msgr2=0x7f64d4150bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:04.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.274+0000 7f64d9dff700 1 --2- 172.21.15.72:0/1282350290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64d40aad50 0x7f64d4150bc0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f64cc009e50 tx=0x7f64cc00b330 comp rx=0 tx=0).stop 2023-07-27T20:33:04.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.274+0000 7f64d9dff700 1 -- 172.21.15.72:0/1282350290 shutdown_connections 2023-07-27T20:33:04.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.274+0000 7f64d9dff700 1 --2- 172.21.15.72:0/1282350290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64d40aad50 0x7f64d4150bc0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:04.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.274+0000 7f64d9dff700 1 -- 172.21.15.72:0/1282350290 >> 172.21.15.72:0/1282350290 conn(0x7f64d406a190 msgr2=0x7f64d406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:04.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.274+0000 7f64d9dff700 1 -- 172.21.15.72:0/1282350290 shutdown_connections 2023-07-27T20:33:04.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.274+0000 7f64d9dff700 1 -- 172.21.15.72:0/1282350290 wait complete. 2023-07-27T20:33:04.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.276+0000 7f64d9dff700 1 Processor -- start 2023-07-27T20:33:04.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.276+0000 7f64d9dff700 1 -- start start 2023-07-27T20:33:04.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.277+0000 7f64d9dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64d40aad50 0x7f64d40c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:04.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.277+0000 7f64d9dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64d40c1930 0x7f64d40c2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:04.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.277+0000 7f64d9dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f64d414da10 0x7f64d414f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:04.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.277+0000 7f64d9dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d40c4b10 con 0x7f64d40c1930 2023-07-27T20:33:04.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.277+0000 7f64d9dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d4146040 con 0x7f64d40aad50 2023-07-27T20:33:04.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.277+0000 7f64d9dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d4145e90 con 0x7f64d414da10 2023-07-27T20:33:04.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.277+0000 7f64d2ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64d40c1930 0x7f64d40c2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:04.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.277+0000 7f64d2ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64d40c1930 0x7f64d40c2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41302/0 (socket says 172.21.15.72:41302) 2023-07-27T20:33:04.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.277+0000 7f64d2ffd700 1 -- 172.21.15.72:0/996152778 learned_addr learned my addr 172.21.15.72:0/996152778 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:04.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.277+0000 7f64d3fff700 1 --2- 172.21.15.72:0/996152778 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f64d414da10 0x7f64d414f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:04.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.277+0000 7f64d37fe700 1 --2- 172.21.15.72:0/996152778 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64d40aad50 0x7f64d40c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:04.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.277+0000 7f64d2ffd700 1 -- 172.21.15.72:0/996152778 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f64d414da10 msgr2=0x7f64d414f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:04.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.277+0000 7f64d2ffd700 1 --2- 172.21.15.72:0/996152778 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f64d414da10 0x7f64d414f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:04.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.277+0000 7f64d2ffd700 1 -- 172.21.15.72:0/996152778 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64d40aad50 msgr2=0x7f64d40c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:04.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.277+0000 7f64d2ffd700 1 --2- 172.21.15.72:0/996152778 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64d40aad50 0x7f64d40c5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:04.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.277+0000 7f64d2ffd700 1 -- 172.21.15.72:0/996152778 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64cc009b30 con 0x7f64d40c1930 2023-07-27T20:33:04.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.277+0000 7f64d2ffd700 1 --2- 172.21.15.72:0/996152778 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64d40c1930 0x7f64d40c2fe0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f64c800c450 tx=0x7f64c800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:04.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.278+0000 7f64bbfff700 1 -- 172.21.15.72:0/996152778 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c80052d0 con 0x7f64d40c1930 2023-07-27T20:33:04.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.278+0000 7f64bbfff700 1 -- 172.21.15.72:0/996152778 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c8005430 con 0x7f64d40c1930 2023-07-27T20:33:04.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.278+0000 7f64bbfff700 1 -- 172.21.15.72:0/996152778 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c80038c0 con 0x7f64d40c1930 2023-07-27T20:33:04.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.278+0000 7f64d9dff700 1 -- 172.21.15.72:0/996152778 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64d41e9df0 con 0x7f64d40c1930 2023-07-27T20:33:04.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.278+0000 7f64d9dff700 1 -- 172.21.15.72:0/996152778 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64d4146710 con 0x7f64d40c1930 2023-07-27T20:33:04.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.279+0000 7f64d9dff700 1 -- 172.21.15.72:0/996152778 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64d4074310 con 0x7f64d40c1930 2023-07-27T20:33:04.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.280+0000 7f64bbfff700 1 -- 172.21.15.72:0/996152778 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f64c8003a20 con 0x7f64d40c1930 2023-07-27T20:33:04.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.281+0000 7f64bbfff700 1 --2- 172.21.15.72:0/996152778 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f64c006ace0 0x7f64c006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:04.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.281+0000 7f64bbfff700 1 -- 172.21.15.72:0/996152778 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f64c8088a90 con 0x7f64d40c1930 2023-07-27T20:33:04.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.281+0000 7f64d37fe700 1 --2- 172.21.15.72:0/996152778 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f64c006ace0 0x7f64c006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:04.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.282+0000 7f64d37fe700 1 --2- 172.21.15.72:0/996152778 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f64c006ace0 0x7f64c006d1a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f64c4000f60 tx=0x7f64c4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:04.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.285+0000 7f64bbfff700 1 -- 172.21.15.72:0/996152778 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f64c80538d0 con 0x7f64d40c1930 2023-07-27T20:33:04.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.479+0000 7f64d9dff700 1 -- 172.21.15.72:0/996152778 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64d406e2d0 con 0x7f64d40c1930 2023-07-27T20:33:04.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.480+0000 7f64bbfff700 1 -- 172.21.15.72:0/996152778 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+18500 (secure 0 0 0) 0x7f64c8056ef0 con 0x7f64d40c1930 2023-07-27T20:33:04.469 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:33:04.469 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":41,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:33:01.572436+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:32:58.242890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-27T20:32:59.032110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:33:04.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.483+0000 7f64d9dff700 1 -- 172.21.15.72:0/996152778 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f64c006ace0 msgr2=0x7f64c006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:04.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.483+0000 7f64d9dff700 1 --2- 172.21.15.72:0/996152778 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f64c006ace0 0x7f64c006d1a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f64c4000f60 tx=0x7f64c4009040 comp rx=0 tx=0).stop 2023-07-27T20:33:04.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.483+0000 7f64d9dff700 1 -- 172.21.15.72:0/996152778 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64d40c1930 msgr2=0x7f64d40c2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:04.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.483+0000 7f64d9dff700 1 --2- 172.21.15.72:0/996152778 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64d40c1930 0x7f64d40c2fe0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f64c800c450 tx=0x7f64c800c810 comp rx=0 tx=0).stop 2023-07-27T20:33:04.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.483+0000 7f64d9dff700 1 -- 172.21.15.72:0/996152778 shutdown_connections 2023-07-27T20:33:04.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.483+0000 7f64d9dff700 1 --2- 172.21.15.72:0/996152778 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f64c006ace0 0x7f64c006d1a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:04.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.483+0000 7f64d9dff700 1 --2- 172.21.15.72:0/996152778 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f64d414da10 0x7f64d414f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:04.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.483+0000 7f64d9dff700 1 --2- 172.21.15.72:0/996152778 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64d40aad50 0x7f64d40c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:04.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.483+0000 7f64d9dff700 1 --2- 172.21.15.72:0/996152778 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64d40c1930 0x7f64d40c2fe0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:04.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.483+0000 7f64d9dff700 1 -- 172.21.15.72:0/996152778 >> 172.21.15.72:0/996152778 conn(0x7f64d406a190 msgr2=0x7f64d406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:04.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.483+0000 7f64d9dff700 1 -- 172.21.15.72:0/996152778 shutdown_connections 2023-07-27T20:33:04.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.483+0000 7f64d9dff700 1 -- 172.21.15.72:0/996152778 wait complete. 2023-07-27T20:33:04.489 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-27T20:33:04.490 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T20:33:04.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.699+0000 7faffa3ff700 1 Processor -- start 2023-07-27T20:33:04.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.699+0000 7faffa3ff700 1 -- start start 2023-07-27T20:33:04.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.699+0000 7faffa3ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faff4151800 0x7faff40c1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:04.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.699+0000 7faffa3ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7faff4154960 0x7faff4154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:04.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.699+0000 7faffa3ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faff40706f0 con 0x7faff40c5c00 2023-07-27T20:33:04.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.699+0000 7faffa3ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faff4154510 con 0x7faff4154960 2023-07-27T20:33:04.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.699+0000 7faffa3ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff4070c90 con 0x7faff4151800 2023-07-27T20:33:04.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.700+0000 7faff3fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faff4151800 0x7faff40c1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:04.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.700+0000 7faff3fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faff4151800 0x7faff40c1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.72:38028/0 (socket says 172.21.15.72:38028) 2023-07-27T20:33:04.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.700+0000 7faff37fe700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7faff40c5c00 0x7faff40a9190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.72:55526/0 (socket says 172.21.15.72:55526) 2023-07-27T20:33:04.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.700+0000 7faff3fff700 1 -- 172.21.15.72:0/1104507924 learned_addr learned my addr 172.21.15.72:0/1104507924 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:04.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.700+0000 7faff899c700 1 --2- 172.21.15.72:0/1104507924 >> v2:172.21.15.173:3300/0 conn(0x7faff4154960 0x7faff4154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:04.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.700+0000 7faff3fff700 1 -- 172.21.15.72:0/1104507924 >> v2:172.21.15.173:3300/0 conn(0x7faff4154960 msgr2=0x7faff4154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:04.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.700+0000 7faff3fff700 1 --2- 172.21.15.72:0/1104507924 >> v2:172.21.15.173:3300/0 conn(0x7faff4154960 0x7faff4154dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:04.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.700+0000 7faff3fff700 1 -- 172.21.15.72:0/1104507924 >> v1:172.21.15.173:6789/0 conn(0x7faff40c5c00 legacy=0x7faff40a9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:04.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.700+0000 7faff2ffd700 1 -- 172.21.15.72:0/1104507924 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1283633491 0 0) 0x7faff40706f0 con 0x7faff40c5c00 2023-07-27T20:33:04.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.700+0000 7faff3fff700 1 -- 172.21.15.72:0/1104507924 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff41585d0 con 0x7faff4151800 2023-07-27T20:33:04.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.701+0000 7faff3fff700 1 --2- 172.21.15.72:0/1104507924 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faff4151800 0x7faff40c1fb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fafe40098f0 tx=0x7fafe4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee21e7dcaf76a1a3 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:04.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.701+0000 7faff2ffd700 1 -- 172.21.15.72:0/1104507924 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe4011830 con 0x7faff4151800 2023-07-27T20:33:04.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.701+0000 7faff2ffd700 1 -- 172.21.15.72:0/1104507924 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe4011990 con 0x7faff4151800 2023-07-27T20:33:04.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.701+0000 7faff2ffd700 1 -- 172.21.15.72:0/1104507924 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe4011d20 con 0x7faff4151800 2023-07-27T20:33:04.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.701+0000 7faffa3ff700 1 -- 172.21.15.72:0/1104507924 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faff4151800 msgr2=0x7faff40c1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:04.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.701+0000 7faffa3ff700 1 --2- 172.21.15.72:0/1104507924 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faff4151800 0x7faff40c1fb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fafe40098f0 tx=0x7fafe4009c00 comp rx=0 tx=0).stop 2023-07-27T20:33:04.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.701+0000 7faffa3ff700 1 -- 172.21.15.72:0/1104507924 shutdown_connections 2023-07-27T20:33:04.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.701+0000 7faffa3ff700 1 --2- 172.21.15.72:0/1104507924 >> v2:172.21.15.173:3300/0 conn(0x7faff4154960 0x7faff4154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:04.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.701+0000 7faffa3ff700 1 --2- 172.21.15.72:0/1104507924 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faff4151800 0x7faff40c1fb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:04.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.701+0000 7faffa3ff700 1 -- 172.21.15.72:0/1104507924 >> 172.21.15.72:0/1104507924 conn(0x7faff406a7c0 msgr2=0x7faff40c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:04.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.702+0000 7faffa3ff700 1 -- 172.21.15.72:0/1104507924 shutdown_connections 2023-07-27T20:33:04.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.702+0000 7faffa3ff700 1 -- 172.21.15.72:0/1104507924 wait complete. 2023-07-27T20:33:04.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.703+0000 7faffa3ff700 1 Processor -- start 2023-07-27T20:33:04.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.703+0000 7faffa3ff700 1 -- start start 2023-07-27T20:33:04.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.704+0000 7faffa3ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faff40c5c00 0x7faff40be670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:04.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.704+0000 7faffa3ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faff4151800 0x7faff41ed7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:04.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.704+0000 7faffa3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faff4154960 0x7faff4150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:04.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.704+0000 7faffa3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff40c0560 con 0x7faff4154960 2023-07-27T20:33:04.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.704+0000 7faffa3ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff40bebb0 con 0x7faff40c5c00 2023-07-27T20:33:04.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.704+0000 7faffa3ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff414e3c0 con 0x7faff4151800 2023-07-27T20:33:04.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.705+0000 7faff3fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faff40c5c00 0x7faff40be670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:04.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.705+0000 7faff899c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faff4154960 0x7faff4150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:04.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.705+0000 7faff3fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faff40c5c00 0x7faff40be670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.72:51302/0 (socket says 172.21.15.72:51302) 2023-07-27T20:33:04.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.705+0000 7faff3fff700 1 -- 172.21.15.72:0/2783889520 learned_addr learned my addr 172.21.15.72:0/2783889520 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:04.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.705+0000 7faff37fe700 1 --2- 172.21.15.72:0/2783889520 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faff4151800 0x7faff41ed7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:04.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.705+0000 7faff3fff700 1 -- 172.21.15.72:0/2783889520 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faff4151800 msgr2=0x7faff41ed7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:04.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.705+0000 7faff3fff700 1 --2- 172.21.15.72:0/2783889520 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faff4151800 0x7faff41ed7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:04.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.705+0000 7faff3fff700 1 -- 172.21.15.72:0/2783889520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faff4154960 msgr2=0x7faff4150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:04.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.705+0000 7faff3fff700 1 --2- 172.21.15.72:0/2783889520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faff4154960 0x7faff4150350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:04.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.705+0000 7faff3fff700 1 -- 172.21.15.72:0/2783889520 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe4009550 con 0x7faff40c5c00 2023-07-27T20:33:04.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.705+0000 7faff3fff700 1 --2- 172.21.15.72:0/2783889520 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faff40c5c00 0x7faff40be670 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fafe4009c40 tx=0x7fafe4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:04.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.706+0000 7faff0ff9700 1 -- 172.21.15.72:0/2783889520 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe4004510 con 0x7faff40c5c00 2023-07-27T20:33:04.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.706+0000 7faff0ff9700 1 -- 172.21.15.72:0/2783889520 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe401e070 con 0x7faff40c5c00 2023-07-27T20:33:04.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.706+0000 7faffa3ff700 1 -- 172.21.15.72:0/2783889520 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faff414dc30 con 0x7faff40c5c00 2023-07-27T20:33:04.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.706+0000 7faff0ff9700 1 -- 172.21.15.72:0/2783889520 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe40038c0 con 0x7faff40c5c00 2023-07-27T20:33:04.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.706+0000 7faffa3ff700 1 -- 172.21.15.72:0/2783889520 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff41ed2a0 con 0x7faff40c5c00 2023-07-27T20:33:04.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.707+0000 7faffa3ff700 1 -- 172.21.15.72:0/2783889520 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faff4074310 con 0x7faff40c5c00 2023-07-27T20:33:04.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.708+0000 7faff0ff9700 1 -- 172.21.15.72:0/2783889520 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fafe4003a20 con 0x7faff40c5c00 2023-07-27T20:33:04.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.708+0000 7faff0ff9700 1 --2- 172.21.15.72:0/2783889520 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fafe006ace0 0x7fafe006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:04.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.709+0000 7faff0ff9700 1 -- 172.21.15.72:0/2783889520 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fafe4020070 con 0x7faff40c5c00 2023-07-27T20:33:04.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.709+0000 7faff37fe700 1 --2- 172.21.15.72:0/2783889520 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fafe006ace0 0x7fafe006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:04.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.709+0000 7faff37fe700 1 --2- 172.21.15.72:0/2783889520 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fafe006ace0 0x7fafe006d1a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7faff41e1970 tx=0x7fafe8007e70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:04.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.715+0000 7faff0ff9700 1 -- 172.21.15.72:0/2783889520 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fafe4055800 con 0x7faff40c5c00 2023-07-27T20:33:04.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.908+0000 7faffa3ff700 1 -- 172.21.15.72:0/2783889520 --> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faff4151be0 con 0x7fafe006ace0 2023-07-27T20:33:04.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.919+0000 7faff0ff9700 1 -- 172.21.15.72:0/2783889520 <== mgr.4107 v2:172.21.15.173:6832/910681537 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305756 (secure 0 0 0) 0x7fafe8001290 con 0x7fafe006ace0 2023-07-27T20:33:04.910 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:33:04.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.923+0000 7faffa3ff700 1 -- 172.21.15.72:0/2783889520 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fafe006ace0 msgr2=0x7fafe006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:04.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.923+0000 7faffa3ff700 1 --2- 172.21.15.72:0/2783889520 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fafe006ace0 0x7fafe006d1a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7faff41e1970 tx=0x7fafe8007e70 comp rx=0 tx=0).stop 2023-07-27T20:33:04.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.923+0000 7faffa3ff700 1 -- 172.21.15.72:0/2783889520 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faff40c5c00 msgr2=0x7faff40be670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:04.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.923+0000 7faffa3ff700 1 --2- 172.21.15.72:0/2783889520 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faff40c5c00 0x7faff40be670 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fafe4009c40 tx=0x7fafe4004750 comp rx=0 tx=0).stop 2023-07-27T20:33:04.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.923+0000 7faffa3ff700 1 -- 172.21.15.72:0/2783889520 shutdown_connections 2023-07-27T20:33:04.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.923+0000 7faffa3ff700 1 --2- 172.21.15.72:0/2783889520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faff4154960 0x7faff4150350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:04.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.923+0000 7faffa3ff700 1 --2- 172.21.15.72:0/2783889520 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faff40c5c00 0x7faff40be670 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:04.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.923+0000 7faffa3ff700 1 --2- 172.21.15.72:0/2783889520 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fafe006ace0 0x7fafe006d1a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:04.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.923+0000 7faffa3ff700 1 --2- 172.21.15.72:0/2783889520 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faff4151800 0x7faff41ed7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:04.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.923+0000 7faffa3ff700 1 -- 172.21.15.72:0/2783889520 >> 172.21.15.72:0/2783889520 conn(0x7faff406a7c0 msgr2=0x7faff406f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:04.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.923+0000 7faffa3ff700 1 -- 172.21.15.72:0/2783889520 shutdown_connections 2023-07-27T20:33:04.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:04.923+0000 7faffa3ff700 1 -- 172.21.15.72:0/2783889520 wait complete. 2023-07-27T20:33:04.914 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-07-27T20:33:04.929 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2023-07-27T20:33:04.550801+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":25,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220760,"kb_used_data":4596,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753960,"statfs":{"total":773094113280,"available":772868055040,"internally_reserved":0,"allocated":4706304,"data_stored":2719092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.996411"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.567842+0000","last_change":"2023-07-27T20:32:59.567842+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.567842+0000","last_undegraded":"2023-07-27T20:32:59.567842+0000","last_fullsized":"2023-07-27T20:32:59.567842+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.569932+0000","last_change":"2023-07-27T20:32:59.569932+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.569932+0000","last_undegraded":"2023-07-27T20:32:59.569932+0000","last_fullsized":"2023-07-27T20:32:59.569932+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.570253+0000","last_change":"2023-07-27T20:32:59.570253+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.570253+0000","last_undegraded":"2023-07-27T20:32:59.570253+0000","last_fullsized":"2023-07-27T20:32:59.570253+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.565765+0000","last_change":"2023-07-27T20:32:59.565765+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.565765+0000","last_undegraded":"2023-07-27T20:32:59.565765+0000","last_fullsized":"2023-07-27T20:32:59.565765+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.569378+0000","last_change":"2023-07-27T20:32:59.569378+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.569378+0000","last_undegraded":"2023-07-27T20:32:59.569378+0000","last_fullsized":"2023-07-27T20:32:59.569378+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.565133+0000","last_change":"2023-07-27T20:32:59.565133+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.565133+0000","last_undegraded":"2023-07-27T20:32:59.565133+0000","last_fullsized":"2023-07-27T20:32:59.565133+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.568305+0000","last_change":"2023-07-27T20:32:59.568305+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.568305+0000","last_undegraded":"2023-07-27T20:32:59.568305+0000","last_fullsized":"2023-07-27T20:32:59.568305+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.564621+0000","last_change":"2023-07-27T20:32:59.564621+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.564621+0000","last_undegraded":"2023-07-27T20:32:59.564621+0000","last_fullsized":"2023-07-27T20:32:59.564621+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.565120+0000","last_change":"2023-07-27T20:32:59.565120+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.565120+0000","last_undegraded":"2023-07-27T20:32:59.565120+0000","last_fullsized":"2023-07-27T20:32:59.565120+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.566143+0000","last_change":"2023-07-27T20:32:59.566143+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.566143+0000","last_undegraded":"2023-07-27T20:32:59.566143+0000","last_fullsized":"2023-07-27T20:32:59.566143+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.565448+0000","last_change":"2023-07-27T20:32:59.565448+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.565448+0000","last_undegraded":"2023-07-27T20:32:59.565448+0000","last_fullsized":"2023-07-27T20:32:59.565448+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.570381+0000","last_change":"2023-07-27T20:32:59.570381+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.570381+0000","last_undegraded":"2023-07-27T20:32:59.570381+0000","last_fullsized":"2023-07-27T20:32:59.570381+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.574499+0000","last_change":"2023-07-27T20:32:59.574499+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.574499+0000","last_undegraded":"2023-07-27T20:32:59.574499+0000","last_fullsized":"2023-07-27T20:32:59.574499+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.566369+0000","last_change":"2023-07-27T20:32:59.566369+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.566369+0000","last_undegraded":"2023-07-27T20:32:59.566369+0000","last_fullsized":"2023-07-27T20:32:59.566369+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.569914+0000","last_change":"2023-07-27T20:32:59.569914+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.569914+0000","last_undegraded":"2023-07-27T20:32:59.569914+0000","last_fullsized":"2023-07-27T20:32:59.569914+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.564178+0000","last_change":"2023-07-27T20:32:59.564178+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.564178+0000","last_undegraded":"2023-07-27T20:32:59.564178+0000","last_fullsized":"2023-07-27T20:32:59.564178+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.568795+0000","last_change":"2023-07-27T20:32:59.568795+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.568795+0000","last_undegraded":"2023-07-27T20:32:59.568795+0000","last_fullsized":"2023-07-27T20:32:59.568795+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.570637+0000","last_change":"2023-07-27T20:32:59.570637+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.570637+0000","last_undegraded":"2023-07-27T20:32:59.570637+0000","last_fullsized":"2023-07-27T20:32:59.570637+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.563688+0000","last_change":"2023-07-27T20:32:59.563688+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.563688+0000","last_undegraded":"2023-07-27T20:32:59.563688+0000","last_fullsized":"2023-07-27T20:32:59.563688+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.575128+0000","last_change":"2023-07-27T20:32:59.575128+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.575128+0000","last_undegraded":"2023-07-27T20:32:59.575128+0000","last_fullsized":"2023-07-27T20:32:59.575128+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.568600+0000","last_change":"2023-07-27T20:32:59.568600+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.568600+0000","last_undegraded":"2023-07-27T20:32:59.568600+0000","last_fullsized":"2023-07-27T20:32:59.568600+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.565127+0000","last_change":"2023-07-27T20:32:59.565127+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.565127+0000","last_undegraded":"2023-07-27T20:32:59.565127+0000","last_fullsized":"2023-07-27T20:32:59.565127+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.564165+0000","last_change":"2023-07-27T20:32:59.564165+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.564165+0000","last_undegraded":"2023-07-27T20:32:59.564165+0000","last_fullsized":"2023-07-27T20:32:59.564165+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.563046+0000","last_change":"2023-07-27T20:32:59.563046+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.563046+0000","last_undegraded":"2023-07-27T20:32:59.563046+0000","last_fullsized":"2023-07-27T20:32:59.563046+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.563155+0000","last_change":"2023-07-27T20:32:59.563155+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.563155+0000","last_undegraded":"2023-07-27T20:32:59.563155+0000","last_fullsized":"2023-07-27T20:32:59.563155+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.573150+0000","last_change":"2023-07-27T20:32:59.573150+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.573150+0000","last_undegraded":"2023-07-27T20:32:59.573150+0000","last_fullsized":"2023-07-27T20:32:59.573150+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.567727+0000","last_change":"2023-07-27T20:32:59.567727+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.567727+0000","last_undegraded":"2023-07-27T20:32:59.567727+0000","last_fullsized":"2023-07-27T20:32:59.567727+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.571281+0000","last_change":"2023-07-27T20:32:59.571281+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.571281+0000","last_undegraded":"2023-07-27T20:32:59.571281+0000","last_fullsized":"2023-07-27T20:32:59.571281+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.563375+0000","last_change":"2023-07-27T20:32:59.563375+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.563375+0000","last_undegraded":"2023-07-27T20:32:59.563375+0000","last_fullsized":"2023-07-27T20:32:59.563375+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.569703+0000","last_change":"2023-07-27T20:32:59.569703+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.569703+0000","last_undegraded":"2023-07-27T20:32:59.569703+0000","last_fullsized":"2023-07-27T20:32:59.569703+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.570528+0000","last_change":"2023-07-27T20:32:59.570528+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.570528+0000","last_undegraded":"2023-07-27T20:32:59.570528+0000","last_fullsized":"2023-07-27T20:32:59.570528+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.573628+0000","last_change":"2023-07-27T20:32:59.573628+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.573628+0000","last_undegraded":"2023-07-27T20:32:59.573628+0000","last_fullsized":"2023-07-27T20:32:59.573628+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.569101+0000","last_change":"2023-07-27T20:32:59.569101+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.569101+0000","last_undegraded":"2023-07-27T20:32:59.569101+0000","last_fullsized":"2023-07-27T20:32:59.569101+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.589083+0000","last_change":"2023-07-27T20:32:59.584807+0000","last_active":"2023-07-27T20:32:59.589083+0000","last_peered":"2023-07-27T20:32:59.589083+0000","last_clean":"2023-07-27T20:32:59.589083+0000","last_became_active":"2023-07-27T20:32:59.584538+0000","last_became_peered":"2023-07-27T20:32:59.584538+0000","last_unstale":"2023-07-27T20:32:59.589083+0000","last_undegraded":"2023-07-27T20:32:59.589083+0000","last_fullsized":"2023-07-27T20:32:59.589083+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:08:25.823264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.564379+0000","last_change":"2023-07-27T20:32:59.564379+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.564379+0000","last_undegraded":"2023-07-27T20:32:59.564379+0000","last_fullsized":"2023-07-27T20:32:59.564379+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.585196+0000","last_change":"2023-07-27T20:32:59.578355+0000","last_active":"2023-07-27T20:32:59.585196+0000","last_peered":"2023-07-27T20:32:59.585196+0000","last_clean":"2023-07-27T20:32:59.585196+0000","last_became_active":"2023-07-27T20:32:59.577716+0000","last_became_peered":"2023-07-27T20:32:59.577716+0000","last_unstale":"2023-07-27T20:32:59.585196+0000","last_undegraded":"2023-07-27T20:32:59.585196+0000","last_fullsized":"2023-07-27T20:32:59.585196+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:34:47.120294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.570822+0000","last_change":"2023-07-27T20:32:59.570822+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.570822+0000","last_undegraded":"2023-07-27T20:32:59.570822+0000","last_fullsized":"2023-07-27T20:32:59.570822+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.588631+0000","last_change":"2023-07-27T20:32:59.584693+0000","last_active":"2023-07-27T20:32:59.588631+0000","last_peered":"2023-07-27T20:32:59.588631+0000","last_clean":"2023-07-27T20:32:59.588631+0000","last_became_active":"2023-07-27T20:32:59.584388+0000","last_became_peered":"2023-07-27T20:32:59.584388+0000","last_unstale":"2023-07-27T20:32:59.588631+0000","last_undegraded":"2023-07-27T20:32:59.588631+0000","last_fullsized":"2023-07-27T20:32:59.588631+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:08:59.366031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.569877+0000","last_change":"2023-07-27T20:32:59.569877+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.569877+0000","last_undegraded":"2023-07-27T20:32:59.569877+0000","last_fullsized":"2023-07-27T20:32:59.569877+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.587821+0000","last_change":"2023-07-27T20:32:59.583845+0000","last_active":"2023-07-27T20:32:59.587821+0000","last_peered":"2023-07-27T20:32:59.587821+0000","last_clean":"2023-07-27T20:32:59.587821+0000","last_became_active":"2023-07-27T20:32:59.583553+0000","last_became_peered":"2023-07-27T20:32:59.583553+0000","last_unstale":"2023-07-27T20:32:59.587821+0000","last_undegraded":"2023-07-27T20:32:59.587821+0000","last_fullsized":"2023-07-27T20:32:59.587821+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:00:27.962358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.569226+0000","last_change":"2023-07-27T20:32:59.569226+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.569226+0000","last_undegraded":"2023-07-27T20:32:59.569226+0000","last_fullsized":"2023-07-27T20:32:59.569226+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.588961+0000","last_change":"2023-07-27T20:32:59.580842+0000","last_active":"2023-07-27T20:32:59.588961+0000","last_peered":"2023-07-27T20:32:59.588961+0000","last_clean":"2023-07-27T20:32:59.588961+0000","last_became_active":"2023-07-27T20:32:59.580445+0000","last_became_peered":"2023-07-27T20:32:59.580445+0000","last_unstale":"2023-07-27T20:32:59.588961+0000","last_undegraded":"2023-07-27T20:32:59.588961+0000","last_fullsized":"2023-07-27T20:32:59.588961+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:42:04.208572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.564863+0000","last_change":"2023-07-27T20:32:59.564863+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.564863+0000","last_undegraded":"2023-07-27T20:32:59.564863+0000","last_fullsized":"2023-07-27T20:32:59.564863+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.588048+0000","last_change":"2023-07-27T20:32:59.584387+0000","last_active":"2023-07-27T20:32:59.588048+0000","last_peered":"2023-07-27T20:32:59.588048+0000","last_clean":"2023-07-27T20:32:59.588048+0000","last_became_active":"2023-07-27T20:32:59.584123+0000","last_became_peered":"2023-07-27T20:32:59.584123+0000","last_unstale":"2023-07-27T20:32:59.588048+0000","last_undegraded":"2023-07-27T20:32:59.588048+0000","last_fullsized":"2023-07-27T20:32:59.588048+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:15:29.060138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.563861+0000","last_change":"2023-07-27T20:32:59.563861+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.563861+0000","last_undegraded":"2023-07-27T20:32:59.563861+0000","last_fullsized":"2023-07-27T20:32:59.563861+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.591407+0000","last_change":"2023-07-27T20:32:59.588694+0000","last_active":"2023-07-27T20:32:59.591407+0000","last_peered":"2023-07-27T20:32:59.591407+0000","last_clean":"2023-07-27T20:32:59.591407+0000","last_became_active":"2023-07-27T20:32:59.588450+0000","last_became_peered":"2023-07-27T20:32:59.588450+0000","last_unstale":"2023-07-27T20:32:59.591407+0000","last_undegraded":"2023-07-27T20:32:59.591407+0000","last_fullsized":"2023-07-27T20:32:59.591407+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:36:05.551639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.563724+0000","last_change":"2023-07-27T20:32:59.563724+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.563724+0000","last_undegraded":"2023-07-27T20:32:59.563724+0000","last_fullsized":"2023-07-27T20:32:59.563724+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.580833+0000","last_change":"2023-07-27T20:32:59.577003+0000","last_active":"2023-07-27T20:32:59.580833+0000","last_peered":"2023-07-27T20:32:59.580833+0000","last_clean":"2023-07-27T20:32:59.580833+0000","last_became_active":"2023-07-27T20:32:59.576722+0000","last_became_peered":"2023-07-27T20:32:59.576722+0000","last_unstale":"2023-07-27T20:32:59.580833+0000","last_undegraded":"2023-07-27T20:32:59.580833+0000","last_fullsized":"2023-07-27T20:32:59.580833+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:59:10.292810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.568884+0000","last_change":"2023-07-27T20:32:59.568884+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.568884+0000","last_undegraded":"2023-07-27T20:32:59.568884+0000","last_fullsized":"2023-07-27T20:32:59.568884+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.585283+0000","last_change":"2023-07-27T20:32:59.580000+0000","last_active":"2023-07-27T20:32:59.585283+0000","last_peered":"2023-07-27T20:32:59.585283+0000","last_clean":"2023-07-27T20:32:59.585283+0000","last_became_active":"2023-07-27T20:32:59.579693+0000","last_became_peered":"2023-07-27T20:32:59.579693+0000","last_unstale":"2023-07-27T20:32:59.585283+0000","last_undegraded":"2023-07-27T20:32:59.585283+0000","last_fullsized":"2023-07-27T20:32:59.585283+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:40:08.076481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.567348+0000","last_change":"2023-07-27T20:32:59.567348+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.567348+0000","last_undegraded":"2023-07-27T20:32:59.567348+0000","last_fullsized":"2023-07-27T20:32:59.567348+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.582123+0000","last_change":"2023-07-27T20:32:59.577773+0000","last_active":"2023-07-27T20:32:59.582123+0000","last_peered":"2023-07-27T20:32:59.582123+0000","last_clean":"2023-07-27T20:32:59.582123+0000","last_became_active":"2023-07-27T20:32:59.577537+0000","last_became_peered":"2023-07-27T20:32:59.577537+0000","last_unstale":"2023-07-27T20:32:59.582123+0000","last_undegraded":"2023-07-27T20:32:59.582123+0000","last_fullsized":"2023-07-27T20:32:59.582123+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:36:05.551639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.564865+0000","last_change":"2023-07-27T20:32:59.564865+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.564865+0000","last_undegraded":"2023-07-27T20:32:59.564865+0000","last_fullsized":"2023-07-27T20:32:59.564865+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.583148+0000","last_change":"2023-07-27T20:32:59.579139+0000","last_active":"2023-07-27T20:32:59.583148+0000","last_peered":"2023-07-27T20:32:59.583148+0000","last_clean":"2023-07-27T20:32:59.583148+0000","last_became_active":"2023-07-27T20:32:59.578856+0000","last_became_peered":"2023-07-27T20:32:59.578856+0000","last_unstale":"2023-07-27T20:32:59.583148+0000","last_undegraded":"2023-07-27T20:32:59.583148+0000","last_fullsized":"2023-07-27T20:32:59.583148+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:33:46.826785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.567502+0000","last_change":"2023-07-27T20:32:59.567502+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.567502+0000","last_undegraded":"2023-07-27T20:32:59.567502+0000","last_fullsized":"2023-07-27T20:32:59.567502+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.586600+0000","last_change":"2023-07-27T20:32:59.583956+0000","last_active":"2023-07-27T20:32:59.586600+0000","last_peered":"2023-07-27T20:32:59.586600+0000","last_clean":"2023-07-27T20:32:59.586600+0000","last_became_active":"2023-07-27T20:32:59.583495+0000","last_became_peered":"2023-07-27T20:32:59.583495+0000","last_unstale":"2023-07-27T20:32:59.586600+0000","last_undegraded":"2023-07-27T20:32:59.586600+0000","last_fullsized":"2023-07-27T20:32:59.586600+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:57:07.019999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.562951+0000","last_change":"2023-07-27T20:32:59.562951+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.562951+0000","last_undegraded":"2023-07-27T20:32:59.562951+0000","last_fullsized":"2023-07-27T20:32:59.562951+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.588987+0000","last_change":"2023-07-27T20:32:59.581127+0000","last_active":"2023-07-27T20:32:59.588987+0000","last_peered":"2023-07-27T20:32:59.588987+0000","last_clean":"2023-07-27T20:32:59.588987+0000","last_became_active":"2023-07-27T20:32:59.580831+0000","last_became_peered":"2023-07-27T20:32:59.580831+0000","last_unstale":"2023-07-27T20:32:59.588987+0000","last_undegraded":"2023-07-27T20:32:59.588987+0000","last_fullsized":"2023-07-27T20:32:59.588987+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:49:09.328449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.563822+0000","last_change":"2023-07-27T20:32:59.563822+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.563822+0000","last_undegraded":"2023-07-27T20:32:59.563822+0000","last_fullsized":"2023-07-27T20:32:59.563822+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.583189+0000","last_change":"2023-07-27T20:32:59.581242+0000","last_active":"2023-07-27T20:32:59.583189+0000","last_peered":"2023-07-27T20:32:59.583189+0000","last_clean":"2023-07-27T20:32:59.583189+0000","last_became_active":"2023-07-27T20:32:59.580941+0000","last_became_peered":"2023-07-27T20:32:59.580941+0000","last_unstale":"2023-07-27T20:32:59.583189+0000","last_undegraded":"2023-07-27T20:32:59.583189+0000","last_fullsized":"2023-07-27T20:32:59.583189+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:22:16.460215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.569122+0000","last_change":"2023-07-27T20:32:59.569122+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.569122+0000","last_undegraded":"2023-07-27T20:32:59.569122+0000","last_fullsized":"2023-07-27T20:32:59.569122+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.589056+0000","last_change":"2023-07-27T20:32:59.583865+0000","last_active":"2023-07-27T20:32:59.589056+0000","last_peered":"2023-07-27T20:32:59.589056+0000","last_clean":"2023-07-27T20:32:59.589056+0000","last_became_active":"2023-07-27T20:32:59.583587+0000","last_became_peered":"2023-07-27T20:32:59.583587+0000","last_unstale":"2023-07-27T20:32:59.589056+0000","last_undegraded":"2023-07-27T20:32:59.589056+0000","last_fullsized":"2023-07-27T20:32:59.589056+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:04:51.056626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.567499+0000","last_change":"2023-07-27T20:32:59.567499+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.567499+0000","last_undegraded":"2023-07-27T20:32:59.567499+0000","last_fullsized":"2023-07-27T20:32:59.567499+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.585702+0000","last_change":"2023-07-27T20:32:59.583107+0000","last_active":"2023-07-27T20:32:59.585702+0000","last_peered":"2023-07-27T20:32:59.585702+0000","last_clean":"2023-07-27T20:32:59.585702+0000","last_became_active":"2023-07-27T20:32:59.582831+0000","last_became_peered":"2023-07-27T20:32:59.582831+0000","last_unstale":"2023-07-27T20:32:59.585702+0000","last_undegraded":"2023-07-27T20:32:59.585702+0000","last_fullsized":"2023-07-27T20:32:59.585702+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:12:40.374487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.572720+0000","last_change":"2023-07-27T20:32:59.572720+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.572720+0000","last_undegraded":"2023-07-27T20:32:59.572720+0000","last_fullsized":"2023-07-27T20:32:59.572720+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.588609+0000","last_change":"2023-07-27T20:32:59.586172+0000","last_active":"2023-07-27T20:32:59.588609+0000","last_peered":"2023-07-27T20:32:59.588609+0000","last_clean":"2023-07-27T20:32:59.588609+0000","last_became_active":"2023-07-27T20:32:59.585871+0000","last_became_peered":"2023-07-27T20:32:59.585871+0000","last_unstale":"2023-07-27T20:32:59.588609+0000","last_undegraded":"2023-07-27T20:32:59.588609+0000","last_fullsized":"2023-07-27T20:32:59.588609+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:32:18.167581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.563846+0000","last_change":"2023-07-27T20:32:59.563846+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.563846+0000","last_undegraded":"2023-07-27T20:32:59.563846+0000","last_fullsized":"2023-07-27T20:32:59.563846+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.585216+0000","last_change":"2023-07-27T20:32:59.580768+0000","last_active":"2023-07-27T20:32:59.585216+0000","last_peered":"2023-07-27T20:32:59.585216+0000","last_clean":"2023-07-27T20:32:59.585216+0000","last_became_active":"2023-07-27T20:32:59.580496+0000","last_became_peered":"2023-07-27T20:32:59.580496+0000","last_unstale":"2023-07-27T20:32:59.585216+0000","last_undegraded":"2023-07-27T20:32:59.585216+0000","last_fullsized":"2023-07-27T20:32:59.585216+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:10:02.524163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.563209+0000","last_change":"2023-07-27T20:32:59.563209+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.563209+0000","last_undegraded":"2023-07-27T20:32:59.563209+0000","last_fullsized":"2023-07-27T20:32:59.563209+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.591418+0000","last_change":"2023-07-27T20:32:59.588890+0000","last_active":"2023-07-27T20:32:59.591418+0000","last_peered":"2023-07-27T20:32:59.591418+0000","last_clean":"2023-07-27T20:32:59.591418+0000","last_became_active":"2023-07-27T20:32:59.588570+0000","last_became_peered":"2023-07-27T20:32:59.588570+0000","last_unstale":"2023-07-27T20:32:59.591418+0000","last_undegraded":"2023-07-27T20:32:59.591418+0000","last_fullsized":"2023-07-27T20:32:59.591418+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:15:02.312650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.563086+0000","last_change":"2023-07-27T20:32:59.563086+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.563086+0000","last_undegraded":"2023-07-27T20:32:59.563086+0000","last_fullsized":"2023-07-27T20:32:59.563086+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.589121+0000","last_change":"2023-07-27T20:32:59.585317+0000","last_active":"2023-07-27T20:32:59.589121+0000","last_peered":"2023-07-27T20:32:59.589121+0000","last_clean":"2023-07-27T20:32:59.589121+0000","last_became_active":"2023-07-27T20:32:59.585008+0000","last_became_peered":"2023-07-27T20:32:59.585008+0000","last_unstale":"2023-07-27T20:32:59.589121+0000","last_undegraded":"2023-07-27T20:32:59.589121+0000","last_fullsized":"2023-07-27T20:32:59.589121+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:43:20.425329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.565556+0000","last_change":"2023-07-27T20:32:59.565556+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.565556+0000","last_undegraded":"2023-07-27T20:32:59.565556+0000","last_fullsized":"2023-07-27T20:32:59.565556+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.588976+0000","last_change":"2023-07-27T20:32:59.581014+0000","last_active":"2023-07-27T20:32:59.588976+0000","last_peered":"2023-07-27T20:32:59.588976+0000","last_clean":"2023-07-27T20:32:59.588976+0000","last_became_active":"2023-07-27T20:32:59.580563+0000","last_became_peered":"2023-07-27T20:32:59.580563+0000","last_unstale":"2023-07-27T20:32:59.588976+0000","last_undegraded":"2023-07-27T20:32:59.588976+0000","last_fullsized":"2023-07-27T20:32:59.588976+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:19:35.470363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.569099+0000","last_change":"2023-07-27T20:32:59.569099+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.569099+0000","last_undegraded":"2023-07-27T20:32:59.569099+0000","last_fullsized":"2023-07-27T20:32:59.569099+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.586523+0000","last_change":"2023-07-27T20:32:59.583381+0000","last_active":"2023-07-27T20:32:59.586523+0000","last_peered":"2023-07-27T20:32:59.586523+0000","last_clean":"2023-07-27T20:32:59.586523+0000","last_became_active":"2023-07-27T20:32:59.582911+0000","last_became_peered":"2023-07-27T20:32:59.582911+0000","last_unstale":"2023-07-27T20:32:59.586523+0000","last_undegraded":"2023-07-27T20:32:59.586523+0000","last_fullsized":"2023-07-27T20:32:59.586523+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:22:23.203330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.573149+0000","last_change":"2023-07-27T20:32:59.573149+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.573149+0000","last_undegraded":"2023-07-27T20:32:59.573149+0000","last_fullsized":"2023-07-27T20:32:59.573149+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.582346+0000","last_change":"2023-07-27T20:32:59.577740+0000","last_active":"2023-07-27T20:32:59.582346+0000","last_peered":"2023-07-27T20:32:59.582346+0000","last_clean":"2023-07-27T20:32:59.582346+0000","last_became_active":"2023-07-27T20:32:59.577456+0000","last_became_peered":"2023-07-27T20:32:59.577456+0000","last_unstale":"2023-07-27T20:32:59.582346+0000","last_undegraded":"2023-07-27T20:32:59.582346+0000","last_fullsized":"2023-07-27T20:32:59.582346+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:43:10.317241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.565984+0000","last_change":"2023-07-27T20:32:59.565984+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.565984+0000","last_undegraded":"2023-07-27T20:32:59.565984+0000","last_fullsized":"2023-07-27T20:32:59.565984+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.583138+0000","last_change":"2023-07-27T20:32:59.581455+0000","last_active":"2023-07-27T20:32:59.583138+0000","last_peered":"2023-07-27T20:32:59.583138+0000","last_clean":"2023-07-27T20:32:59.583138+0000","last_became_active":"2023-07-27T20:32:59.579901+0000","last_became_peered":"2023-07-27T20:32:59.579901+0000","last_unstale":"2023-07-27T20:32:59.583138+0000","last_undegraded":"2023-07-27T20:32:59.583138+0000","last_fullsized":"2023-07-27T20:32:59.583138+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:51:36.297342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.569690+0000","last_change":"2023-07-27T20:32:59.569690+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.569690+0000","last_undegraded":"2023-07-27T20:32:59.569690+0000","last_fullsized":"2023-07-27T20:32:59.569690+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.585666+0000","last_change":"2023-07-27T20:32:59.581609+0000","last_active":"2023-07-27T20:32:59.585666+0000","last_peered":"2023-07-27T20:32:59.585666+0000","last_clean":"2023-07-27T20:32:59.585666+0000","last_became_active":"2023-07-27T20:32:59.580643+0000","last_became_peered":"2023-07-27T20:32:59.580643+0000","last_unstale":"2023-07-27T20:32:59.585666+0000","last_undegraded":"2023-07-27T20:32:59.585666+0000","last_fullsized":"2023-07-27T20:32:59.585666+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:47:17.437878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.570437+0000","last_change":"2023-07-27T20:31:22.848698+0000","last_active":"2023-07-27T20:32:59.570437+0000","last_peered":"2023-07-27T20:32:59.570437+0000","last_clean":"2023-07-27T20:32:59.570437+0000","last_became_active":"2023-07-27T20:31:22.848346+0000","last_became_peered":"2023-07-27T20:31:22.848346+0000","last_unstale":"2023-07-27T20:32:59.570437+0000","last_undegraded":"2023-07-27T20:32:59.570437+0000","last_fullsized":"2023-07-27T20:32:59.570437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:27:03.039316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.563925+0000","last_change":"2023-07-27T20:32:59.563925+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.563925+0000","last_undegraded":"2023-07-27T20:32:59.563925+0000","last_fullsized":"2023-07-27T20:32:59.563925+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.587716+0000","last_change":"2023-07-27T20:32:59.579071+0000","last_active":"2023-07-27T20:32:59.587716+0000","last_peered":"2023-07-27T20:32:59.587716+0000","last_clean":"2023-07-27T20:32:59.587716+0000","last_became_active":"2023-07-27T20:32:59.578792+0000","last_became_peered":"2023-07-27T20:32:59.578792+0000","last_unstale":"2023-07-27T20:32:59.587716+0000","last_undegraded":"2023-07-27T20:32:59.587716+0000","last_fullsized":"2023-07-27T20:32:59.587716+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:52:22.368996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.575330+0000","last_change":"2023-07-27T20:31:22.849178+0000","last_active":"2023-07-27T20:32:59.575330+0000","last_peered":"2023-07-27T20:32:59.575330+0000","last_clean":"2023-07-27T20:32:59.575330+0000","last_became_active":"2023-07-27T20:31:22.848856+0000","last_became_peered":"2023-07-27T20:31:22.848856+0000","last_unstale":"2023-07-27T20:32:59.575330+0000","last_undegraded":"2023-07-27T20:32:59.575330+0000","last_fullsized":"2023-07-27T20:32:59.575330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:20:39.735418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.563834+0000","last_change":"2023-07-27T20:32:59.563834+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.563834+0000","last_undegraded":"2023-07-27T20:32:59.563834+0000","last_fullsized":"2023-07-27T20:32:59.563834+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.583164+0000","last_change":"2023-07-27T20:32:59.579248+0000","last_active":"2023-07-27T20:32:59.583164+0000","last_peered":"2023-07-27T20:32:59.583164+0000","last_clean":"2023-07-27T20:32:59.583164+0000","last_became_active":"2023-07-27T20:32:59.578926+0000","last_became_peered":"2023-07-27T20:32:59.578926+0000","last_unstale":"2023-07-27T20:32:59.583164+0000","last_undegraded":"2023-07-27T20:32:59.583164+0000","last_fullsized":"2023-07-27T20:32:59.583164+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:20:33.806998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.572987+0000","last_change":"2023-07-27T20:31:22.959811+0000","last_active":"2023-07-27T20:32:59.572987+0000","last_peered":"2023-07-27T20:32:59.572987+0000","last_clean":"2023-07-27T20:32:59.572987+0000","last_became_active":"2023-07-27T20:31:22.959449+0000","last_became_peered":"2023-07-27T20:31:22.959449+0000","last_unstale":"2023-07-27T20:32:59.572987+0000","last_undegraded":"2023-07-27T20:32:59.572987+0000","last_fullsized":"2023-07-27T20:32:59.572987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:37:34.216731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.563831+0000","last_change":"2023-07-27T20:32:59.563831+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.563831+0000","last_undegraded":"2023-07-27T20:32:59.563831+0000","last_fullsized":"2023-07-27T20:32:59.563831+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.587999+0000","last_change":"2023-07-27T20:32:59.585447+0000","last_active":"2023-07-27T20:32:59.587999+0000","last_peered":"2023-07-27T20:32:59.587999+0000","last_clean":"2023-07-27T20:32:59.587999+0000","last_became_active":"2023-07-27T20:32:59.585172+0000","last_became_peered":"2023-07-27T20:32:59.585172+0000","last_unstale":"2023-07-27T20:32:59.587999+0000","last_undegraded":"2023-07-27T20:32:59.587999+0000","last_fullsized":"2023-07-27T20:32:59.587999+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:51:36.297342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.569610+0000","last_change":"2023-07-27T20:31:22.847766+0000","last_active":"2023-07-27T20:32:59.569610+0000","last_peered":"2023-07-27T20:32:59.569610+0000","last_clean":"2023-07-27T20:32:59.569610+0000","last_became_active":"2023-07-27T20:31:22.847396+0000","last_became_peered":"2023-07-27T20:31:22.847396+0000","last_unstale":"2023-07-27T20:32:59.569610+0000","last_undegraded":"2023-07-27T20:32:59.569610+0000","last_fullsized":"2023-07-27T20:32:59.569610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:45:40.713082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":203,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.570134+0000","last_change":"2023-07-27T20:31:15.812727+0000","last_active":"2023-07-27T20:32:59.570134+0000","last_peered":"2023-07-27T20:32:59.570134+0000","last_clean":"2023-07-27T20:32:59.570134+0000","last_became_active":"2023-07-27T20:31:15.811803+0000","last_became_peered":"2023-07-27T20:31:15.811803+0000","last_unstale":"2023-07-27T20:32:59.570134+0000","last_undegraded":"2023-07-27T20:32:59.570134+0000","last_fullsized":"2023-07-27T20:32:59.570134+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:14.789257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:14.789257+0000","last_clean_scrub_stamp":"2023-07-27T20:31:14.789257+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:13:18.556026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.566975+0000","last_change":"2023-07-27T20:32:59.566975+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.566975+0000","last_undegraded":"2023-07-27T20:32:59.566975+0000","last_fullsized":"2023-07-27T20:32:59.566975+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.588591+0000","last_change":"2023-07-27T20:32:59.584665+0000","last_active":"2023-07-27T20:32:59.588591+0000","last_peered":"2023-07-27T20:32:59.588591+0000","last_clean":"2023-07-27T20:32:59.588591+0000","last_became_active":"2023-07-27T20:32:59.584357+0000","last_became_peered":"2023-07-27T20:32:59.584357+0000","last_unstale":"2023-07-27T20:32:59.588591+0000","last_undegraded":"2023-07-27T20:32:59.588591+0000","last_fullsized":"2023-07-27T20:32:59.588591+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:08:20.963539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.570839+0000","last_change":"2023-07-27T20:31:22.848181+0000","last_active":"2023-07-27T20:32:59.570839+0000","last_peered":"2023-07-27T20:32:59.570839+0000","last_clean":"2023-07-27T20:32:59.570839+0000","last_became_active":"2023-07-27T20:31:22.847865+0000","last_became_peered":"2023-07-27T20:31:22.847865+0000","last_unstale":"2023-07-27T20:32:59.570839+0000","last_undegraded":"2023-07-27T20:32:59.570839+0000","last_fullsized":"2023-07-27T20:32:59.570839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:07:49.453832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.568446+0000","last_change":"2023-07-27T20:32:59.568446+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.568446+0000","last_undegraded":"2023-07-27T20:32:59.568446+0000","last_fullsized":"2023-07-27T20:32:59.568446+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.588253+0000","last_change":"2023-07-27T20:32:59.579303+0000","last_active":"2023-07-27T20:32:59.588253+0000","last_peered":"2023-07-27T20:32:59.588253+0000","last_clean":"2023-07-27T20:32:59.588253+0000","last_became_active":"2023-07-27T20:32:59.579015+0000","last_became_peered":"2023-07-27T20:32:59.579015+0000","last_unstale":"2023-07-27T20:32:59.588253+0000","last_undegraded":"2023-07-27T20:32:59.588253+0000","last_fullsized":"2023-07-27T20:32:59.588253+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:45:59.778612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.572266+0000","last_change":"2023-07-27T20:31:22.848025+0000","last_active":"2023-07-27T20:32:59.572266+0000","last_peered":"2023-07-27T20:32:59.572266+0000","last_clean":"2023-07-27T20:32:59.572266+0000","last_became_active":"2023-07-27T20:31:22.847603+0000","last_became_peered":"2023-07-27T20:31:22.847603+0000","last_unstale":"2023-07-27T20:32:59.572266+0000","last_undegraded":"2023-07-27T20:32:59.572266+0000","last_fullsized":"2023-07-27T20:32:59.572266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:41:43.700532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.568173+0000","last_change":"2023-07-27T20:32:59.568173+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.568173+0000","last_undegraded":"2023-07-27T20:32:59.568173+0000","last_fullsized":"2023-07-27T20:32:59.568173+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.590792+0000","last_change":"2023-07-27T20:32:59.586199+0000","last_active":"2023-07-27T20:32:59.590792+0000","last_peered":"2023-07-27T20:32:59.590792+0000","last_clean":"2023-07-27T20:32:59.590792+0000","last_became_active":"2023-07-27T20:32:59.585937+0000","last_became_peered":"2023-07-27T20:32:59.585937+0000","last_unstale":"2023-07-27T20:32:59.590792+0000","last_undegraded":"2023-07-27T20:32:59.590792+0000","last_fullsized":"2023-07-27T20:32:59.590792+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:50:44.917196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.570642+0000","last_change":"2023-07-27T20:31:22.845641+0000","last_active":"2023-07-27T20:32:59.570642+0000","last_peered":"2023-07-27T20:32:59.570642+0000","last_clean":"2023-07-27T20:32:59.570642+0000","last_became_active":"2023-07-27T20:31:22.845368+0000","last_became_peered":"2023-07-27T20:31:22.845368+0000","last_unstale":"2023-07-27T20:32:59.570642+0000","last_undegraded":"2023-07-27T20:32:59.570642+0000","last_fullsized":"2023-07-27T20:32:59.570642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:53:10.286326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.564646+0000","last_change":"2023-07-27T20:32:59.564646+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.564646+0000","last_undegraded":"2023-07-27T20:32:59.564646+0000","last_fullsized":"2023-07-27T20:32:59.564646+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.583113+0000","last_change":"2023-07-27T20:32:59.579629+0000","last_active":"2023-07-27T20:32:59.583113+0000","last_peered":"2023-07-27T20:32:59.583113+0000","last_clean":"2023-07-27T20:32:59.583113+0000","last_became_active":"2023-07-27T20:32:59.579376+0000","last_became_peered":"2023-07-27T20:32:59.579376+0000","last_unstale":"2023-07-27T20:32:59.583113+0000","last_undegraded":"2023-07-27T20:32:59.583113+0000","last_fullsized":"2023-07-27T20:32:59.583113+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:34:01.141411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.565740+0000","last_change":"2023-07-27T20:31:22.846540+0000","last_active":"2023-07-27T20:32:59.565740+0000","last_peered":"2023-07-27T20:32:59.565740+0000","last_clean":"2023-07-27T20:32:59.565740+0000","last_became_active":"2023-07-27T20:31:22.846128+0000","last_became_peered":"2023-07-27T20:31:22.846128+0000","last_unstale":"2023-07-27T20:32:59.565740+0000","last_undegraded":"2023-07-27T20:32:59.565740+0000","last_fullsized":"2023-07-27T20:32:59.565740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:41:50.272995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1032192,"data_stored":781795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":3.5609999999999999,"5min":3.5609999999999999,"15min":3.5609999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.56299999999999994}]},{"osd":1,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":3.927,"5min":3.927,"15min":3.927},"last":0.745}]},{"osd":2,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.1589999999999998,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":0.69299999999999995}]},{"osd":3,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.4239999999999999,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":3.1080000000000001,"5min":3.1080000000000001,"15min":3.1080000000000001},"last":0.83399999999999996}]},{"osd":4,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.2730000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.624}]},{"osd":5,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":6.1619999999999999,"5min":6.1619999999999999,"15min":6.1619999999999999},"last":0.438},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":6.2729999999999997,"5min":6.2729999999999997,"15min":6.2729999999999997},"last":0.65300000000000002}]},{"osd":6,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":3.5289999999999999,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":0.67600000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":191427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.56499999999999995}]},{"osd":1,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.60599999999999998}]},{"osd":2,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.70199999999999996}]},{"osd":3,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":0.58399999999999996}]},{"osd":4,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.80000000000000004}]},{"osd":5,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.81599999999999995}]},{"osd":7,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.623}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":191427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.40699999999999997}]},{"osd":2,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.504}]},{"osd":3,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.435}]},{"osd":4,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.74099999999999999}]},{"osd":5,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.69599999999999995}]},{"osd":7,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.627},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.55100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1032192,"data_stored":781795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.433},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.59099999999999997}]},{"osd":4,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.69899999999999995}]},{"osd":6,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.751},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.67200000000000004}]},{"osd":7,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.65500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":191427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.313},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":3.2999999999999998,"5min":3.2999999999999998,"15min":3.2999999999999998},"last":0.36599999999999999}]},{"osd":1,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":3.0600000000000001,"5min":3.0600000000000001,"15min":3.0600000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":3.4580000000000002,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.35199999999999998}]},{"osd":3,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":9.2200000000000006,"5min":9.2200000000000006,"15min":9.2200000000000006},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.498}]},{"osd":4,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":4.2930000000000001,"5min":4.2930000000000001,"15min":4.2930000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.70799999999999996}]},{"osd":5,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.67400000000000004}]},{"osd":6,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":3.3999999999999999,"5min":3.3999999999999999,"15min":3.3999999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":3.4990000000000001,"5min":3.4990000000000001,"15min":3.4990000000000001},"last":0.79200000000000004}]},{"osd":7,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.84199999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":191427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":2.1480000000000001,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":0.372}]},{"osd":1,"last update":"Thu Jul 27 20:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.41799999999999998}]},{"osd":2,"last update":"Thu Jul 27 20:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":0.44},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.45100000000000001}]},{"osd":4,"last update":"Thu Jul 27 20:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.755}]},{"osd":5,"last update":"Thu Jul 27 20:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.81499999999999995}]},{"osd":6,"last update":"Thu Jul 27 20:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.82499999999999996}]},{"osd":7,"last update":"Thu Jul 27 20:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.73999999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":450560,"data_stored":198367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.78000000000000003}]},{"osd":1,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.57099999999999995}]},{"osd":2,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.63200000000000001}]},{"osd":3,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.76500000000000001}]},{"osd":5,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.66300000000000003}]},{"osd":6,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.69099999999999995}]},{"osd":7,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.94599999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":191427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.50900000000000001}]},{"osd":1,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.627},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.61799999999999999}]},{"osd":4,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.437}]},{"osd":6,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.59999999999999998}]},{"osd":7,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.68100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T20:33:04.937 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T20:33:05.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.176+0000 7f1eb89ff700 1 Processor -- start 2023-07-27T20:33:05.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.176+0000 7f1eb89ff700 1 -- start start 2023-07-27T20:33:05.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.177+0000 7f1eb89ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1eb40c4400 0x7f1eb40c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:05.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.177+0000 7f1eb89ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1eb406b150 0x7f1eb40c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:05.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.177+0000 7f1eb89ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1eb41549f0 0x7f1eb41514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:05.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.177+0000 7f1eb89ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eb41545d0 con 0x7f1eb41549f0 2023-07-27T20:33:05.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.177+0000 7f1eb89ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eb406c860 con 0x7f1eb406b150 2023-07-27T20:33:05.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.177+0000 7f1eb89ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb40c5230 con 0x7f1eb40c4400 2023-07-27T20:33:05.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.177+0000 7f1eb2d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1eb41549f0 0x7f1eb41514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:05.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.177+0000 7f1eb2d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1eb41549f0 0x7f1eb41514a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41328/0 (socket says 172.21.15.72:41328) 2023-07-27T20:33:05.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.177+0000 7f1eb2d9d700 1 -- 172.21.15.72:0/3459323379 learned_addr learned my addr 172.21.15.72:0/3459323379 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:05.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.178+0000 7f1eb1d9b700 1 --2- 172.21.15.72:0/3459323379 >> v2:172.21.15.173:3300/0 conn(0x7f1eb406b150 0x7f1eb40c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:05.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.178+0000 7f1eb259c700 1 --2- 172.21.15.72:0/3459323379 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1eb40c4400 0x7f1eb40c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:05.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.178+0000 7f1eb2d9d700 1 -- 172.21.15.72:0/3459323379 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1eb40c4400 msgr2=0x7f1eb40c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:05.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.178+0000 7f1eb2d9d700 1 --2- 172.21.15.72:0/3459323379 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1eb40c4400 0x7f1eb40c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:05.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.178+0000 7f1eb2d9d700 1 -- 172.21.15.72:0/3459323379 >> v2:172.21.15.173:3300/0 conn(0x7f1eb406b150 msgr2=0x7f1eb40c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:05.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.178+0000 7f1eb2d9d700 1 --2- 172.21.15.72:0/3459323379 >> v2:172.21.15.173:3300/0 conn(0x7f1eb406b150 0x7f1eb40c4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:05.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.178+0000 7f1eb2d9d700 1 -- 172.21.15.72:0/3459323379 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb406b710 con 0x7f1eb41549f0 2023-07-27T20:33:05.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.178+0000 7f1eb2d9d700 1 --2- 172.21.15.72:0/3459323379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1eb41549f0 0x7f1eb41514a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1eb408b480 tx=0x7f1eac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e0dbbe397201784 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:05.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.178+0000 7f1eb159a700 1 -- 172.21.15.72:0/3459323379 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eac00e070 con 0x7f1eb41549f0 2023-07-27T20:33:05.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.178+0000 7f1eb159a700 1 -- 172.21.15.72:0/3459323379 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eac00b9c0 con 0x7f1eb41549f0 2023-07-27T20:33:05.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.178+0000 7f1eb159a700 1 -- 172.21.15.72:0/3459323379 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eac00bd70 con 0x7f1eb41549f0 2023-07-27T20:33:05.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.179+0000 7f1eb89ff700 1 -- 172.21.15.72:0/3459323379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1eb41549f0 msgr2=0x7f1eb41514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:05.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.179+0000 7f1eb89ff700 1 --2- 172.21.15.72:0/3459323379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1eb41549f0 0x7f1eb41514a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1eb408b480 tx=0x7f1eac00b330 comp rx=0 tx=0).stop 2023-07-27T20:33:05.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.179+0000 7f1eb89ff700 1 -- 172.21.15.72:0/3459323379 shutdown_connections 2023-07-27T20:33:05.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.179+0000 7f1eb89ff700 1 --2- 172.21.15.72:0/3459323379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1eb41549f0 0x7f1eb41514a0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:05.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.179+0000 7f1eb89ff700 1 --2- 172.21.15.72:0/3459323379 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1eb40c4400 0x7f1eb40c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:05.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.179+0000 7f1eb89ff700 1 --2- 172.21.15.72:0/3459323379 >> v2:172.21.15.173:3300/0 conn(0x7f1eb406b150 0x7f1eb40c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:05.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.179+0000 7f1eb89ff700 1 -- 172.21.15.72:0/3459323379 >> 172.21.15.72:0/3459323379 conn(0x7f1eb40ab300 msgr2=0x7f1eb40ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:05.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.179+0000 7f1eb89ff700 1 -- 172.21.15.72:0/3459323379 shutdown_connections 2023-07-27T20:33:05.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.179+0000 7f1eb89ff700 1 -- 172.21.15.72:0/3459323379 wait complete. 2023-07-27T20:33:05.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.181+0000 7f1eb89ff700 1 Processor -- start 2023-07-27T20:33:05.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.182+0000 7f1eb89ff700 1 -- start start 2023-07-27T20:33:05.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.183+0000 7f1eb89ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1eb406b150 0x7f1eb41ec770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:05.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.183+0000 7f1eb89ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1eb40c4400 0x7f1eb4148dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:05.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.183+0000 7f1eb89ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1eb41549f0 0x7f1eb4149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:05.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.183+0000 7f1eb89ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb4149850 con 0x7f1eb406b150 2023-07-27T20:33:05.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.183+0000 7f1eb89ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb40aa7e0 con 0x7f1eb40c4400 2023-07-27T20:33:05.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.183+0000 7f1eb89ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb41ed440 con 0x7f1eb41549f0 2023-07-27T20:33:05.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.183+0000 7f1eb259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1eb406b150 0x7f1eb41ec770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:05.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.183+0000 7f1eb259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1eb406b150 0x7f1eb41ec770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41336/0 (socket says 172.21.15.72:41336) 2023-07-27T20:33:05.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.183+0000 7f1eb259c700 1 -- 172.21.15.72:0/2329420256 learned_addr learned my addr 172.21.15.72:0/2329420256 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:05.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.183+0000 7f1eb2d9d700 1 --2- 172.21.15.72:0/2329420256 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1eb41549f0 0x7f1eb4149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:05.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.183+0000 7f1eb1d9b700 1 --2- 172.21.15.72:0/2329420256 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1eb40c4400 0x7f1eb4148dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:05.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.183+0000 7f1eb259c700 1 -- 172.21.15.72:0/2329420256 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1eb41549f0 msgr2=0x7f1eb4149310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:05.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.183+0000 7f1eb259c700 1 --2- 172.21.15.72:0/2329420256 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1eb41549f0 0x7f1eb4149310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:05.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.183+0000 7f1eb259c700 1 -- 172.21.15.72:0/2329420256 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1eb40c4400 msgr2=0x7f1eb4148dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:05.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.183+0000 7f1eb259c700 1 --2- 172.21.15.72:0/2329420256 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1eb40c4400 0x7f1eb4148dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:05.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.183+0000 7f1eb259c700 1 -- 172.21.15.72:0/2329420256 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eac009b30 con 0x7f1eb406b150 2023-07-27T20:33:05.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.184+0000 7f1eb259c700 1 --2- 172.21.15.72:0/2329420256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1eb406b150 0x7f1eb41ec770 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f1ea400e810 tx=0x7f1ea400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:05.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.184+0000 7f1ea2ffd700 1 -- 172.21.15.72:0/2329420256 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea400c070 con 0x7f1eb406b150 2023-07-27T20:33:05.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.184+0000 7f1ea2ffd700 1 -- 172.21.15.72:0/2329420256 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea4013610 con 0x7f1eb406b150 2023-07-27T20:33:05.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.184+0000 7f1eb89ff700 1 -- 172.21.15.72:0/2329420256 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eb41dd730 con 0x7f1eb406b150 2023-07-27T20:33:05.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.184+0000 7f1ea2ffd700 1 -- 172.21.15.72:0/2329420256 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea40139c0 con 0x7f1eb406b150 2023-07-27T20:33:05.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.184+0000 7f1eb89ff700 1 -- 172.21.15.72:0/2329420256 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb41dd0e0 con 0x7f1eb406b150 2023-07-27T20:33:05.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.185+0000 7f1eb89ff700 1 -- 172.21.15.72:0/2329420256 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb4074310 con 0x7f1eb406b150 2023-07-27T20:33:05.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.186+0000 7f1ea2ffd700 1 -- 172.21.15.72:0/2329420256 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1ea4013b20 con 0x7f1eb406b150 2023-07-27T20:33:05.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.187+0000 7f1ea2ffd700 1 --2- 172.21.15.72:0/2329420256 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1e9406ace0 0x7f1e9406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:05.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.187+0000 7f1ea2ffd700 1 -- 172.21.15.72:0/2329420256 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1ea4089060 con 0x7f1eb406b150 2023-07-27T20:33:05.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.187+0000 7f1eb1d9b700 1 --2- 172.21.15.72:0/2329420256 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1e9406ace0 0x7f1e9406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:05.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.188+0000 7f1eb1d9b700 1 --2- 172.21.15.72:0/2329420256 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1e9406ace0 0x7f1e9406d1a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40c0670 tx=0x7f1ea8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:05.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.191+0000 7f1ea2ffd700 1 -- 172.21.15.72:0/2329420256 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1ea4057a50 con 0x7f1eb406b150 2023-07-27T20:33:05.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.382+0000 7f1eb89ff700 1 -- 172.21.15.72:0/2329420256 --> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1eb406bcd0 con 0x7f1e9406ace0 2023-07-27T20:33:05.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.392+0000 7f1ea2ffd700 1 -- 172.21.15.72:0/2329420256 <== mgr.4107 v2:172.21.15.173:6832/910681537 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305756 (secure 0 0 0) 0x7f1ea8009e40 con 0x7f1e9406ace0 2023-07-27T20:33:05.383 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:33:05.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.397+0000 7f1eb89ff700 1 -- 172.21.15.72:0/2329420256 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1e9406ace0 msgr2=0x7f1e9406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:05.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.397+0000 7f1eb89ff700 1 --2- 172.21.15.72:0/2329420256 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1e9406ace0 0x7f1e9406d1a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40c0670 tx=0x7f1ea8008040 comp rx=0 tx=0).stop 2023-07-27T20:33:05.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.397+0000 7f1eb89ff700 1 -- 172.21.15.72:0/2329420256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1eb406b150 msgr2=0x7f1eb41ec770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:05.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.397+0000 7f1eb89ff700 1 --2- 172.21.15.72:0/2329420256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1eb406b150 0x7f1eb41ec770 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f1ea400e810 tx=0x7f1ea400eb20 comp rx=0 tx=0).stop 2023-07-27T20:33:05.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.397+0000 7f1eb89ff700 1 -- 172.21.15.72:0/2329420256 shutdown_connections 2023-07-27T20:33:05.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.397+0000 7f1eb89ff700 1 --2- 172.21.15.72:0/2329420256 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1e9406ace0 0x7f1e9406d1a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:05.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.397+0000 7f1eb89ff700 1 --2- 172.21.15.72:0/2329420256 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1eb41549f0 0x7f1eb4149310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:05.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.397+0000 7f1eb89ff700 1 --2- 172.21.15.72:0/2329420256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1eb406b150 0x7f1eb41ec770 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:05.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.397+0000 7f1eb89ff700 1 --2- 172.21.15.72:0/2329420256 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1eb40c4400 0x7f1eb4148dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:05.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.397+0000 7f1eb89ff700 1 -- 172.21.15.72:0/2329420256 >> 172.21.15.72:0/2329420256 conn(0x7f1eb40ab300 msgr2=0x7f1eb414b120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:05.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.397+0000 7f1eb89ff700 1 -- 172.21.15.72:0/2329420256 shutdown_connections 2023-07-27T20:33:05.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.397+0000 7f1eb89ff700 1 -- 172.21.15.72:0/2329420256 wait complete. 2023-07-27T20:33:05.387 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-07-27T20:33:05.403 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2023-07-27T20:33:04.550801+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":25,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220760,"kb_used_data":4596,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753960,"statfs":{"total":773094113280,"available":772868055040,"internally_reserved":0,"allocated":4706304,"data_stored":2719092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.996411"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.567842+0000","last_change":"2023-07-27T20:32:59.567842+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.567842+0000","last_undegraded":"2023-07-27T20:32:59.567842+0000","last_fullsized":"2023-07-27T20:32:59.567842+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.569932+0000","last_change":"2023-07-27T20:32:59.569932+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.569932+0000","last_undegraded":"2023-07-27T20:32:59.569932+0000","last_fullsized":"2023-07-27T20:32:59.569932+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.570253+0000","last_change":"2023-07-27T20:32:59.570253+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.570253+0000","last_undegraded":"2023-07-27T20:32:59.570253+0000","last_fullsized":"2023-07-27T20:32:59.570253+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.565765+0000","last_change":"2023-07-27T20:32:59.565765+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.565765+0000","last_undegraded":"2023-07-27T20:32:59.565765+0000","last_fullsized":"2023-07-27T20:32:59.565765+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.569378+0000","last_change":"2023-07-27T20:32:59.569378+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.569378+0000","last_undegraded":"2023-07-27T20:32:59.569378+0000","last_fullsized":"2023-07-27T20:32:59.569378+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.565133+0000","last_change":"2023-07-27T20:32:59.565133+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.565133+0000","last_undegraded":"2023-07-27T20:32:59.565133+0000","last_fullsized":"2023-07-27T20:32:59.565133+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.568305+0000","last_change":"2023-07-27T20:32:59.568305+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.568305+0000","last_undegraded":"2023-07-27T20:32:59.568305+0000","last_fullsized":"2023-07-27T20:32:59.568305+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.564621+0000","last_change":"2023-07-27T20:32:59.564621+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.564621+0000","last_undegraded":"2023-07-27T20:32:59.564621+0000","last_fullsized":"2023-07-27T20:32:59.564621+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.565120+0000","last_change":"2023-07-27T20:32:59.565120+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.565120+0000","last_undegraded":"2023-07-27T20:32:59.565120+0000","last_fullsized":"2023-07-27T20:32:59.565120+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.566143+0000","last_change":"2023-07-27T20:32:59.566143+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.566143+0000","last_undegraded":"2023-07-27T20:32:59.566143+0000","last_fullsized":"2023-07-27T20:32:59.566143+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.565448+0000","last_change":"2023-07-27T20:32:59.565448+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.565448+0000","last_undegraded":"2023-07-27T20:32:59.565448+0000","last_fullsized":"2023-07-27T20:32:59.565448+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.570381+0000","last_change":"2023-07-27T20:32:59.570381+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.570381+0000","last_undegraded":"2023-07-27T20:32:59.570381+0000","last_fullsized":"2023-07-27T20:32:59.570381+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.574499+0000","last_change":"2023-07-27T20:32:59.574499+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.574499+0000","last_undegraded":"2023-07-27T20:32:59.574499+0000","last_fullsized":"2023-07-27T20:32:59.574499+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.566369+0000","last_change":"2023-07-27T20:32:59.566369+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.566369+0000","last_undegraded":"2023-07-27T20:32:59.566369+0000","last_fullsized":"2023-07-27T20:32:59.566369+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.569914+0000","last_change":"2023-07-27T20:32:59.569914+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.569914+0000","last_undegraded":"2023-07-27T20:32:59.569914+0000","last_fullsized":"2023-07-27T20:32:59.569914+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.564178+0000","last_change":"2023-07-27T20:32:59.564178+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.564178+0000","last_undegraded":"2023-07-27T20:32:59.564178+0000","last_fullsized":"2023-07-27T20:32:59.564178+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.568795+0000","last_change":"2023-07-27T20:32:59.568795+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.568795+0000","last_undegraded":"2023-07-27T20:32:59.568795+0000","last_fullsized":"2023-07-27T20:32:59.568795+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.570637+0000","last_change":"2023-07-27T20:32:59.570637+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.570637+0000","last_undegraded":"2023-07-27T20:32:59.570637+0000","last_fullsized":"2023-07-27T20:32:59.570637+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.563688+0000","last_change":"2023-07-27T20:32:59.563688+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.563688+0000","last_undegraded":"2023-07-27T20:32:59.563688+0000","last_fullsized":"2023-07-27T20:32:59.563688+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.575128+0000","last_change":"2023-07-27T20:32:59.575128+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.575128+0000","last_undegraded":"2023-07-27T20:32:59.575128+0000","last_fullsized":"2023-07-27T20:32:59.575128+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.568600+0000","last_change":"2023-07-27T20:32:59.568600+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.568600+0000","last_undegraded":"2023-07-27T20:32:59.568600+0000","last_fullsized":"2023-07-27T20:32:59.568600+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.565127+0000","last_change":"2023-07-27T20:32:59.565127+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.565127+0000","last_undegraded":"2023-07-27T20:32:59.565127+0000","last_fullsized":"2023-07-27T20:32:59.565127+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.564165+0000","last_change":"2023-07-27T20:32:59.564165+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.564165+0000","last_undegraded":"2023-07-27T20:32:59.564165+0000","last_fullsized":"2023-07-27T20:32:59.564165+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.563046+0000","last_change":"2023-07-27T20:32:59.563046+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.563046+0000","last_undegraded":"2023-07-27T20:32:59.563046+0000","last_fullsized":"2023-07-27T20:32:59.563046+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.563155+0000","last_change":"2023-07-27T20:32:59.563155+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.563155+0000","last_undegraded":"2023-07-27T20:32:59.563155+0000","last_fullsized":"2023-07-27T20:32:59.563155+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.573150+0000","last_change":"2023-07-27T20:32:59.573150+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.573150+0000","last_undegraded":"2023-07-27T20:32:59.573150+0000","last_fullsized":"2023-07-27T20:32:59.573150+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.567727+0000","last_change":"2023-07-27T20:32:59.567727+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.567727+0000","last_undegraded":"2023-07-27T20:32:59.567727+0000","last_fullsized":"2023-07-27T20:32:59.567727+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.571281+0000","last_change":"2023-07-27T20:32:59.571281+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.571281+0000","last_undegraded":"2023-07-27T20:32:59.571281+0000","last_fullsized":"2023-07-27T20:32:59.571281+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.563375+0000","last_change":"2023-07-27T20:32:59.563375+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.563375+0000","last_undegraded":"2023-07-27T20:32:59.563375+0000","last_fullsized":"2023-07-27T20:32:59.563375+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.569703+0000","last_change":"2023-07-27T20:32:59.569703+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.569703+0000","last_undegraded":"2023-07-27T20:32:59.569703+0000","last_fullsized":"2023-07-27T20:32:59.569703+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.570528+0000","last_change":"2023-07-27T20:32:59.570528+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.570528+0000","last_undegraded":"2023-07-27T20:32:59.570528+0000","last_fullsized":"2023-07-27T20:32:59.570528+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.573628+0000","last_change":"2023-07-27T20:32:59.573628+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.573628+0000","last_undegraded":"2023-07-27T20:32:59.573628+0000","last_fullsized":"2023-07-27T20:32:59.573628+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.569101+0000","last_change":"2023-07-27T20:32:59.569101+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.569101+0000","last_undegraded":"2023-07-27T20:32:59.569101+0000","last_fullsized":"2023-07-27T20:32:59.569101+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.589083+0000","last_change":"2023-07-27T20:32:59.584807+0000","last_active":"2023-07-27T20:32:59.589083+0000","last_peered":"2023-07-27T20:32:59.589083+0000","last_clean":"2023-07-27T20:32:59.589083+0000","last_became_active":"2023-07-27T20:32:59.584538+0000","last_became_peered":"2023-07-27T20:32:59.584538+0000","last_unstale":"2023-07-27T20:32:59.589083+0000","last_undegraded":"2023-07-27T20:32:59.589083+0000","last_fullsized":"2023-07-27T20:32:59.589083+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:08:25.823264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.564379+0000","last_change":"2023-07-27T20:32:59.564379+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.564379+0000","last_undegraded":"2023-07-27T20:32:59.564379+0000","last_fullsized":"2023-07-27T20:32:59.564379+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.585196+0000","last_change":"2023-07-27T20:32:59.578355+0000","last_active":"2023-07-27T20:32:59.585196+0000","last_peered":"2023-07-27T20:32:59.585196+0000","last_clean":"2023-07-27T20:32:59.585196+0000","last_became_active":"2023-07-27T20:32:59.577716+0000","last_became_peered":"2023-07-27T20:32:59.577716+0000","last_unstale":"2023-07-27T20:32:59.585196+0000","last_undegraded":"2023-07-27T20:32:59.585196+0000","last_fullsized":"2023-07-27T20:32:59.585196+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:34:47.120294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.570822+0000","last_change":"2023-07-27T20:32:59.570822+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.570822+0000","last_undegraded":"2023-07-27T20:32:59.570822+0000","last_fullsized":"2023-07-27T20:32:59.570822+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.588631+0000","last_change":"2023-07-27T20:32:59.584693+0000","last_active":"2023-07-27T20:32:59.588631+0000","last_peered":"2023-07-27T20:32:59.588631+0000","last_clean":"2023-07-27T20:32:59.588631+0000","last_became_active":"2023-07-27T20:32:59.584388+0000","last_became_peered":"2023-07-27T20:32:59.584388+0000","last_unstale":"2023-07-27T20:32:59.588631+0000","last_undegraded":"2023-07-27T20:32:59.588631+0000","last_fullsized":"2023-07-27T20:32:59.588631+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:08:59.366031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.569877+0000","last_change":"2023-07-27T20:32:59.569877+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.569877+0000","last_undegraded":"2023-07-27T20:32:59.569877+0000","last_fullsized":"2023-07-27T20:32:59.569877+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.587821+0000","last_change":"2023-07-27T20:32:59.583845+0000","last_active":"2023-07-27T20:32:59.587821+0000","last_peered":"2023-07-27T20:32:59.587821+0000","last_clean":"2023-07-27T20:32:59.587821+0000","last_became_active":"2023-07-27T20:32:59.583553+0000","last_became_peered":"2023-07-27T20:32:59.583553+0000","last_unstale":"2023-07-27T20:32:59.587821+0000","last_undegraded":"2023-07-27T20:32:59.587821+0000","last_fullsized":"2023-07-27T20:32:59.587821+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:00:27.962358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.569226+0000","last_change":"2023-07-27T20:32:59.569226+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.569226+0000","last_undegraded":"2023-07-27T20:32:59.569226+0000","last_fullsized":"2023-07-27T20:32:59.569226+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.588961+0000","last_change":"2023-07-27T20:32:59.580842+0000","last_active":"2023-07-27T20:32:59.588961+0000","last_peered":"2023-07-27T20:32:59.588961+0000","last_clean":"2023-07-27T20:32:59.588961+0000","last_became_active":"2023-07-27T20:32:59.580445+0000","last_became_peered":"2023-07-27T20:32:59.580445+0000","last_unstale":"2023-07-27T20:32:59.588961+0000","last_undegraded":"2023-07-27T20:32:59.588961+0000","last_fullsized":"2023-07-27T20:32:59.588961+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:42:04.208572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.564863+0000","last_change":"2023-07-27T20:32:59.564863+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.564863+0000","last_undegraded":"2023-07-27T20:32:59.564863+0000","last_fullsized":"2023-07-27T20:32:59.564863+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.588048+0000","last_change":"2023-07-27T20:32:59.584387+0000","last_active":"2023-07-27T20:32:59.588048+0000","last_peered":"2023-07-27T20:32:59.588048+0000","last_clean":"2023-07-27T20:32:59.588048+0000","last_became_active":"2023-07-27T20:32:59.584123+0000","last_became_peered":"2023-07-27T20:32:59.584123+0000","last_unstale":"2023-07-27T20:32:59.588048+0000","last_undegraded":"2023-07-27T20:32:59.588048+0000","last_fullsized":"2023-07-27T20:32:59.588048+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:15:29.060138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.563861+0000","last_change":"2023-07-27T20:32:59.563861+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.563861+0000","last_undegraded":"2023-07-27T20:32:59.563861+0000","last_fullsized":"2023-07-27T20:32:59.563861+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.591407+0000","last_change":"2023-07-27T20:32:59.588694+0000","last_active":"2023-07-27T20:32:59.591407+0000","last_peered":"2023-07-27T20:32:59.591407+0000","last_clean":"2023-07-27T20:32:59.591407+0000","last_became_active":"2023-07-27T20:32:59.588450+0000","last_became_peered":"2023-07-27T20:32:59.588450+0000","last_unstale":"2023-07-27T20:32:59.591407+0000","last_undegraded":"2023-07-27T20:32:59.591407+0000","last_fullsized":"2023-07-27T20:32:59.591407+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:36:05.551639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.563724+0000","last_change":"2023-07-27T20:32:59.563724+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.563724+0000","last_undegraded":"2023-07-27T20:32:59.563724+0000","last_fullsized":"2023-07-27T20:32:59.563724+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.580833+0000","last_change":"2023-07-27T20:32:59.577003+0000","last_active":"2023-07-27T20:32:59.580833+0000","last_peered":"2023-07-27T20:32:59.580833+0000","last_clean":"2023-07-27T20:32:59.580833+0000","last_became_active":"2023-07-27T20:32:59.576722+0000","last_became_peered":"2023-07-27T20:32:59.576722+0000","last_unstale":"2023-07-27T20:32:59.580833+0000","last_undegraded":"2023-07-27T20:32:59.580833+0000","last_fullsized":"2023-07-27T20:32:59.580833+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:59:10.292810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.568884+0000","last_change":"2023-07-27T20:32:59.568884+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.568884+0000","last_undegraded":"2023-07-27T20:32:59.568884+0000","last_fullsized":"2023-07-27T20:32:59.568884+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.585283+0000","last_change":"2023-07-27T20:32:59.580000+0000","last_active":"2023-07-27T20:32:59.585283+0000","last_peered":"2023-07-27T20:32:59.585283+0000","last_clean":"2023-07-27T20:32:59.585283+0000","last_became_active":"2023-07-27T20:32:59.579693+0000","last_became_peered":"2023-07-27T20:32:59.579693+0000","last_unstale":"2023-07-27T20:32:59.585283+0000","last_undegraded":"2023-07-27T20:32:59.585283+0000","last_fullsized":"2023-07-27T20:32:59.585283+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:40:08.076481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.567348+0000","last_change":"2023-07-27T20:32:59.567348+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.567348+0000","last_undegraded":"2023-07-27T20:32:59.567348+0000","last_fullsized":"2023-07-27T20:32:59.567348+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.582123+0000","last_change":"2023-07-27T20:32:59.577773+0000","last_active":"2023-07-27T20:32:59.582123+0000","last_peered":"2023-07-27T20:32:59.582123+0000","last_clean":"2023-07-27T20:32:59.582123+0000","last_became_active":"2023-07-27T20:32:59.577537+0000","last_became_peered":"2023-07-27T20:32:59.577537+0000","last_unstale":"2023-07-27T20:32:59.582123+0000","last_undegraded":"2023-07-27T20:32:59.582123+0000","last_fullsized":"2023-07-27T20:32:59.582123+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:36:05.551639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.564865+0000","last_change":"2023-07-27T20:32:59.564865+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.564865+0000","last_undegraded":"2023-07-27T20:32:59.564865+0000","last_fullsized":"2023-07-27T20:32:59.564865+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.583148+0000","last_change":"2023-07-27T20:32:59.579139+0000","last_active":"2023-07-27T20:32:59.583148+0000","last_peered":"2023-07-27T20:32:59.583148+0000","last_clean":"2023-07-27T20:32:59.583148+0000","last_became_active":"2023-07-27T20:32:59.578856+0000","last_became_peered":"2023-07-27T20:32:59.578856+0000","last_unstale":"2023-07-27T20:32:59.583148+0000","last_undegraded":"2023-07-27T20:32:59.583148+0000","last_fullsized":"2023-07-27T20:32:59.583148+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:33:46.826785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.567502+0000","last_change":"2023-07-27T20:32:59.567502+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.567502+0000","last_undegraded":"2023-07-27T20:32:59.567502+0000","last_fullsized":"2023-07-27T20:32:59.567502+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.586600+0000","last_change":"2023-07-27T20:32:59.583956+0000","last_active":"2023-07-27T20:32:59.586600+0000","last_peered":"2023-07-27T20:32:59.586600+0000","last_clean":"2023-07-27T20:32:59.586600+0000","last_became_active":"2023-07-27T20:32:59.583495+0000","last_became_peered":"2023-07-27T20:32:59.583495+0000","last_unstale":"2023-07-27T20:32:59.586600+0000","last_undegraded":"2023-07-27T20:32:59.586600+0000","last_fullsized":"2023-07-27T20:32:59.586600+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:57:07.019999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.562951+0000","last_change":"2023-07-27T20:32:59.562951+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.562951+0000","last_undegraded":"2023-07-27T20:32:59.562951+0000","last_fullsized":"2023-07-27T20:32:59.562951+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.588987+0000","last_change":"2023-07-27T20:32:59.581127+0000","last_active":"2023-07-27T20:32:59.588987+0000","last_peered":"2023-07-27T20:32:59.588987+0000","last_clean":"2023-07-27T20:32:59.588987+0000","last_became_active":"2023-07-27T20:32:59.580831+0000","last_became_peered":"2023-07-27T20:32:59.580831+0000","last_unstale":"2023-07-27T20:32:59.588987+0000","last_undegraded":"2023-07-27T20:32:59.588987+0000","last_fullsized":"2023-07-27T20:32:59.588987+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:49:09.328449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.563822+0000","last_change":"2023-07-27T20:32:59.563822+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.563822+0000","last_undegraded":"2023-07-27T20:32:59.563822+0000","last_fullsized":"2023-07-27T20:32:59.563822+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.583189+0000","last_change":"2023-07-27T20:32:59.581242+0000","last_active":"2023-07-27T20:32:59.583189+0000","last_peered":"2023-07-27T20:32:59.583189+0000","last_clean":"2023-07-27T20:32:59.583189+0000","last_became_active":"2023-07-27T20:32:59.580941+0000","last_became_peered":"2023-07-27T20:32:59.580941+0000","last_unstale":"2023-07-27T20:32:59.583189+0000","last_undegraded":"2023-07-27T20:32:59.583189+0000","last_fullsized":"2023-07-27T20:32:59.583189+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:22:16.460215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.569122+0000","last_change":"2023-07-27T20:32:59.569122+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.569122+0000","last_undegraded":"2023-07-27T20:32:59.569122+0000","last_fullsized":"2023-07-27T20:32:59.569122+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.589056+0000","last_change":"2023-07-27T20:32:59.583865+0000","last_active":"2023-07-27T20:32:59.589056+0000","last_peered":"2023-07-27T20:32:59.589056+0000","last_clean":"2023-07-27T20:32:59.589056+0000","last_became_active":"2023-07-27T20:32:59.583587+0000","last_became_peered":"2023-07-27T20:32:59.583587+0000","last_unstale":"2023-07-27T20:32:59.589056+0000","last_undegraded":"2023-07-27T20:32:59.589056+0000","last_fullsized":"2023-07-27T20:32:59.589056+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:04:51.056626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.567499+0000","last_change":"2023-07-27T20:32:59.567499+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.567499+0000","last_undegraded":"2023-07-27T20:32:59.567499+0000","last_fullsized":"2023-07-27T20:32:59.567499+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.585702+0000","last_change":"2023-07-27T20:32:59.583107+0000","last_active":"2023-07-27T20:32:59.585702+0000","last_peered":"2023-07-27T20:32:59.585702+0000","last_clean":"2023-07-27T20:32:59.585702+0000","last_became_active":"2023-07-27T20:32:59.582831+0000","last_became_peered":"2023-07-27T20:32:59.582831+0000","last_unstale":"2023-07-27T20:32:59.585702+0000","last_undegraded":"2023-07-27T20:32:59.585702+0000","last_fullsized":"2023-07-27T20:32:59.585702+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:12:40.374487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.572720+0000","last_change":"2023-07-27T20:32:59.572720+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.572720+0000","last_undegraded":"2023-07-27T20:32:59.572720+0000","last_fullsized":"2023-07-27T20:32:59.572720+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.588609+0000","last_change":"2023-07-27T20:32:59.586172+0000","last_active":"2023-07-27T20:32:59.588609+0000","last_peered":"2023-07-27T20:32:59.588609+0000","last_clean":"2023-07-27T20:32:59.588609+0000","last_became_active":"2023-07-27T20:32:59.585871+0000","last_became_peered":"2023-07-27T20:32:59.585871+0000","last_unstale":"2023-07-27T20:32:59.588609+0000","last_undegraded":"2023-07-27T20:32:59.588609+0000","last_fullsized":"2023-07-27T20:32:59.588609+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:32:18.167581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.563846+0000","last_change":"2023-07-27T20:32:59.563846+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.563846+0000","last_undegraded":"2023-07-27T20:32:59.563846+0000","last_fullsized":"2023-07-27T20:32:59.563846+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.585216+0000","last_change":"2023-07-27T20:32:59.580768+0000","last_active":"2023-07-27T20:32:59.585216+0000","last_peered":"2023-07-27T20:32:59.585216+0000","last_clean":"2023-07-27T20:32:59.585216+0000","last_became_active":"2023-07-27T20:32:59.580496+0000","last_became_peered":"2023-07-27T20:32:59.580496+0000","last_unstale":"2023-07-27T20:32:59.585216+0000","last_undegraded":"2023-07-27T20:32:59.585216+0000","last_fullsized":"2023-07-27T20:32:59.585216+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:10:02.524163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.563209+0000","last_change":"2023-07-27T20:32:59.563209+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.563209+0000","last_undegraded":"2023-07-27T20:32:59.563209+0000","last_fullsized":"2023-07-27T20:32:59.563209+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.591418+0000","last_change":"2023-07-27T20:32:59.588890+0000","last_active":"2023-07-27T20:32:59.591418+0000","last_peered":"2023-07-27T20:32:59.591418+0000","last_clean":"2023-07-27T20:32:59.591418+0000","last_became_active":"2023-07-27T20:32:59.588570+0000","last_became_peered":"2023-07-27T20:32:59.588570+0000","last_unstale":"2023-07-27T20:32:59.591418+0000","last_undegraded":"2023-07-27T20:32:59.591418+0000","last_fullsized":"2023-07-27T20:32:59.591418+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:15:02.312650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.563086+0000","last_change":"2023-07-27T20:32:59.563086+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.563086+0000","last_undegraded":"2023-07-27T20:32:59.563086+0000","last_fullsized":"2023-07-27T20:32:59.563086+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.589121+0000","last_change":"2023-07-27T20:32:59.585317+0000","last_active":"2023-07-27T20:32:59.589121+0000","last_peered":"2023-07-27T20:32:59.589121+0000","last_clean":"2023-07-27T20:32:59.589121+0000","last_became_active":"2023-07-27T20:32:59.585008+0000","last_became_peered":"2023-07-27T20:32:59.585008+0000","last_unstale":"2023-07-27T20:32:59.589121+0000","last_undegraded":"2023-07-27T20:32:59.589121+0000","last_fullsized":"2023-07-27T20:32:59.589121+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:43:20.425329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.565556+0000","last_change":"2023-07-27T20:32:59.565556+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.565556+0000","last_undegraded":"2023-07-27T20:32:59.565556+0000","last_fullsized":"2023-07-27T20:32:59.565556+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.588976+0000","last_change":"2023-07-27T20:32:59.581014+0000","last_active":"2023-07-27T20:32:59.588976+0000","last_peered":"2023-07-27T20:32:59.588976+0000","last_clean":"2023-07-27T20:32:59.588976+0000","last_became_active":"2023-07-27T20:32:59.580563+0000","last_became_peered":"2023-07-27T20:32:59.580563+0000","last_unstale":"2023-07-27T20:32:59.588976+0000","last_undegraded":"2023-07-27T20:32:59.588976+0000","last_fullsized":"2023-07-27T20:32:59.588976+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:19:35.470363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.569099+0000","last_change":"2023-07-27T20:32:59.569099+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.569099+0000","last_undegraded":"2023-07-27T20:32:59.569099+0000","last_fullsized":"2023-07-27T20:32:59.569099+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.586523+0000","last_change":"2023-07-27T20:32:59.583381+0000","last_active":"2023-07-27T20:32:59.586523+0000","last_peered":"2023-07-27T20:32:59.586523+0000","last_clean":"2023-07-27T20:32:59.586523+0000","last_became_active":"2023-07-27T20:32:59.582911+0000","last_became_peered":"2023-07-27T20:32:59.582911+0000","last_unstale":"2023-07-27T20:32:59.586523+0000","last_undegraded":"2023-07-27T20:32:59.586523+0000","last_fullsized":"2023-07-27T20:32:59.586523+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:22:23.203330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.573149+0000","last_change":"2023-07-27T20:32:59.573149+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.573149+0000","last_undegraded":"2023-07-27T20:32:59.573149+0000","last_fullsized":"2023-07-27T20:32:59.573149+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.582346+0000","last_change":"2023-07-27T20:32:59.577740+0000","last_active":"2023-07-27T20:32:59.582346+0000","last_peered":"2023-07-27T20:32:59.582346+0000","last_clean":"2023-07-27T20:32:59.582346+0000","last_became_active":"2023-07-27T20:32:59.577456+0000","last_became_peered":"2023-07-27T20:32:59.577456+0000","last_unstale":"2023-07-27T20:32:59.582346+0000","last_undegraded":"2023-07-27T20:32:59.582346+0000","last_fullsized":"2023-07-27T20:32:59.582346+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:43:10.317241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.565984+0000","last_change":"2023-07-27T20:32:59.565984+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.565984+0000","last_undegraded":"2023-07-27T20:32:59.565984+0000","last_fullsized":"2023-07-27T20:32:59.565984+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.583138+0000","last_change":"2023-07-27T20:32:59.581455+0000","last_active":"2023-07-27T20:32:59.583138+0000","last_peered":"2023-07-27T20:32:59.583138+0000","last_clean":"2023-07-27T20:32:59.583138+0000","last_became_active":"2023-07-27T20:32:59.579901+0000","last_became_peered":"2023-07-27T20:32:59.579901+0000","last_unstale":"2023-07-27T20:32:59.583138+0000","last_undegraded":"2023-07-27T20:32:59.583138+0000","last_fullsized":"2023-07-27T20:32:59.583138+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:51:36.297342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.569690+0000","last_change":"2023-07-27T20:32:59.569690+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.569690+0000","last_undegraded":"2023-07-27T20:32:59.569690+0000","last_fullsized":"2023-07-27T20:32:59.569690+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.585666+0000","last_change":"2023-07-27T20:32:59.581609+0000","last_active":"2023-07-27T20:32:59.585666+0000","last_peered":"2023-07-27T20:32:59.585666+0000","last_clean":"2023-07-27T20:32:59.585666+0000","last_became_active":"2023-07-27T20:32:59.580643+0000","last_became_peered":"2023-07-27T20:32:59.580643+0000","last_unstale":"2023-07-27T20:32:59.585666+0000","last_undegraded":"2023-07-27T20:32:59.585666+0000","last_fullsized":"2023-07-27T20:32:59.585666+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:47:17.437878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.570437+0000","last_change":"2023-07-27T20:31:22.848698+0000","last_active":"2023-07-27T20:32:59.570437+0000","last_peered":"2023-07-27T20:32:59.570437+0000","last_clean":"2023-07-27T20:32:59.570437+0000","last_became_active":"2023-07-27T20:31:22.848346+0000","last_became_peered":"2023-07-27T20:31:22.848346+0000","last_unstale":"2023-07-27T20:32:59.570437+0000","last_undegraded":"2023-07-27T20:32:59.570437+0000","last_fullsized":"2023-07-27T20:32:59.570437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:27:03.039316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.563925+0000","last_change":"2023-07-27T20:32:59.563925+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.563925+0000","last_undegraded":"2023-07-27T20:32:59.563925+0000","last_fullsized":"2023-07-27T20:32:59.563925+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.587716+0000","last_change":"2023-07-27T20:32:59.579071+0000","last_active":"2023-07-27T20:32:59.587716+0000","last_peered":"2023-07-27T20:32:59.587716+0000","last_clean":"2023-07-27T20:32:59.587716+0000","last_became_active":"2023-07-27T20:32:59.578792+0000","last_became_peered":"2023-07-27T20:32:59.578792+0000","last_unstale":"2023-07-27T20:32:59.587716+0000","last_undegraded":"2023-07-27T20:32:59.587716+0000","last_fullsized":"2023-07-27T20:32:59.587716+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:52:22.368996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.575330+0000","last_change":"2023-07-27T20:31:22.849178+0000","last_active":"2023-07-27T20:32:59.575330+0000","last_peered":"2023-07-27T20:32:59.575330+0000","last_clean":"2023-07-27T20:32:59.575330+0000","last_became_active":"2023-07-27T20:31:22.848856+0000","last_became_peered":"2023-07-27T20:31:22.848856+0000","last_unstale":"2023-07-27T20:32:59.575330+0000","last_undegraded":"2023-07-27T20:32:59.575330+0000","last_fullsized":"2023-07-27T20:32:59.575330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:20:39.735418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.563834+0000","last_change":"2023-07-27T20:32:59.563834+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.563834+0000","last_undegraded":"2023-07-27T20:32:59.563834+0000","last_fullsized":"2023-07-27T20:32:59.563834+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.583164+0000","last_change":"2023-07-27T20:32:59.579248+0000","last_active":"2023-07-27T20:32:59.583164+0000","last_peered":"2023-07-27T20:32:59.583164+0000","last_clean":"2023-07-27T20:32:59.583164+0000","last_became_active":"2023-07-27T20:32:59.578926+0000","last_became_peered":"2023-07-27T20:32:59.578926+0000","last_unstale":"2023-07-27T20:32:59.583164+0000","last_undegraded":"2023-07-27T20:32:59.583164+0000","last_fullsized":"2023-07-27T20:32:59.583164+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:20:33.806998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.572987+0000","last_change":"2023-07-27T20:31:22.959811+0000","last_active":"2023-07-27T20:32:59.572987+0000","last_peered":"2023-07-27T20:32:59.572987+0000","last_clean":"2023-07-27T20:32:59.572987+0000","last_became_active":"2023-07-27T20:31:22.959449+0000","last_became_peered":"2023-07-27T20:31:22.959449+0000","last_unstale":"2023-07-27T20:32:59.572987+0000","last_undegraded":"2023-07-27T20:32:59.572987+0000","last_fullsized":"2023-07-27T20:32:59.572987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:37:34.216731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.563831+0000","last_change":"2023-07-27T20:32:59.563831+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.563831+0000","last_undegraded":"2023-07-27T20:32:59.563831+0000","last_fullsized":"2023-07-27T20:32:59.563831+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.587999+0000","last_change":"2023-07-27T20:32:59.585447+0000","last_active":"2023-07-27T20:32:59.587999+0000","last_peered":"2023-07-27T20:32:59.587999+0000","last_clean":"2023-07-27T20:32:59.587999+0000","last_became_active":"2023-07-27T20:32:59.585172+0000","last_became_peered":"2023-07-27T20:32:59.585172+0000","last_unstale":"2023-07-27T20:32:59.587999+0000","last_undegraded":"2023-07-27T20:32:59.587999+0000","last_fullsized":"2023-07-27T20:32:59.587999+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:51:36.297342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.569610+0000","last_change":"2023-07-27T20:31:22.847766+0000","last_active":"2023-07-27T20:32:59.569610+0000","last_peered":"2023-07-27T20:32:59.569610+0000","last_clean":"2023-07-27T20:32:59.569610+0000","last_became_active":"2023-07-27T20:31:22.847396+0000","last_became_peered":"2023-07-27T20:31:22.847396+0000","last_unstale":"2023-07-27T20:32:59.569610+0000","last_undegraded":"2023-07-27T20:32:59.569610+0000","last_fullsized":"2023-07-27T20:32:59.569610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:45:40.713082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":203,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.570134+0000","last_change":"2023-07-27T20:31:15.812727+0000","last_active":"2023-07-27T20:32:59.570134+0000","last_peered":"2023-07-27T20:32:59.570134+0000","last_clean":"2023-07-27T20:32:59.570134+0000","last_became_active":"2023-07-27T20:31:15.811803+0000","last_became_peered":"2023-07-27T20:31:15.811803+0000","last_unstale":"2023-07-27T20:32:59.570134+0000","last_undegraded":"2023-07-27T20:32:59.570134+0000","last_fullsized":"2023-07-27T20:32:59.570134+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:14.789257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:14.789257+0000","last_clean_scrub_stamp":"2023-07-27T20:31:14.789257+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:13:18.556026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.566975+0000","last_change":"2023-07-27T20:32:59.566975+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.566975+0000","last_undegraded":"2023-07-27T20:32:59.566975+0000","last_fullsized":"2023-07-27T20:32:59.566975+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.588591+0000","last_change":"2023-07-27T20:32:59.584665+0000","last_active":"2023-07-27T20:32:59.588591+0000","last_peered":"2023-07-27T20:32:59.588591+0000","last_clean":"2023-07-27T20:32:59.588591+0000","last_became_active":"2023-07-27T20:32:59.584357+0000","last_became_peered":"2023-07-27T20:32:59.584357+0000","last_unstale":"2023-07-27T20:32:59.588591+0000","last_undegraded":"2023-07-27T20:32:59.588591+0000","last_fullsized":"2023-07-27T20:32:59.588591+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:08:20.963539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.570839+0000","last_change":"2023-07-27T20:31:22.848181+0000","last_active":"2023-07-27T20:32:59.570839+0000","last_peered":"2023-07-27T20:32:59.570839+0000","last_clean":"2023-07-27T20:32:59.570839+0000","last_became_active":"2023-07-27T20:31:22.847865+0000","last_became_peered":"2023-07-27T20:31:22.847865+0000","last_unstale":"2023-07-27T20:32:59.570839+0000","last_undegraded":"2023-07-27T20:32:59.570839+0000","last_fullsized":"2023-07-27T20:32:59.570839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:07:49.453832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.568446+0000","last_change":"2023-07-27T20:32:59.568446+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.568446+0000","last_undegraded":"2023-07-27T20:32:59.568446+0000","last_fullsized":"2023-07-27T20:32:59.568446+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.588253+0000","last_change":"2023-07-27T20:32:59.579303+0000","last_active":"2023-07-27T20:32:59.588253+0000","last_peered":"2023-07-27T20:32:59.588253+0000","last_clean":"2023-07-27T20:32:59.588253+0000","last_became_active":"2023-07-27T20:32:59.579015+0000","last_became_peered":"2023-07-27T20:32:59.579015+0000","last_unstale":"2023-07-27T20:32:59.588253+0000","last_undegraded":"2023-07-27T20:32:59.588253+0000","last_fullsized":"2023-07-27T20:32:59.588253+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:45:59.778612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.572266+0000","last_change":"2023-07-27T20:31:22.848025+0000","last_active":"2023-07-27T20:32:59.572266+0000","last_peered":"2023-07-27T20:32:59.572266+0000","last_clean":"2023-07-27T20:32:59.572266+0000","last_became_active":"2023-07-27T20:31:22.847603+0000","last_became_peered":"2023-07-27T20:31:22.847603+0000","last_unstale":"2023-07-27T20:32:59.572266+0000","last_undegraded":"2023-07-27T20:32:59.572266+0000","last_fullsized":"2023-07-27T20:32:59.572266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:41:43.700532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.568173+0000","last_change":"2023-07-27T20:32:59.568173+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.568173+0000","last_undegraded":"2023-07-27T20:32:59.568173+0000","last_fullsized":"2023-07-27T20:32:59.568173+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.590792+0000","last_change":"2023-07-27T20:32:59.586199+0000","last_active":"2023-07-27T20:32:59.590792+0000","last_peered":"2023-07-27T20:32:59.590792+0000","last_clean":"2023-07-27T20:32:59.590792+0000","last_became_active":"2023-07-27T20:32:59.585937+0000","last_became_peered":"2023-07-27T20:32:59.585937+0000","last_unstale":"2023-07-27T20:32:59.590792+0000","last_undegraded":"2023-07-27T20:32:59.590792+0000","last_fullsized":"2023-07-27T20:32:59.590792+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:50:44.917196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.570642+0000","last_change":"2023-07-27T20:31:22.845641+0000","last_active":"2023-07-27T20:32:59.570642+0000","last_peered":"2023-07-27T20:32:59.570642+0000","last_clean":"2023-07-27T20:32:59.570642+0000","last_became_active":"2023-07-27T20:31:22.845368+0000","last_became_peered":"2023-07-27T20:31:22.845368+0000","last_unstale":"2023-07-27T20:32:59.570642+0000","last_undegraded":"2023-07-27T20:32:59.570642+0000","last_fullsized":"2023-07-27T20:32:59.570642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:53:10.286326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.564646+0000","last_change":"2023-07-27T20:32:59.564646+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.564646+0000","last_undegraded":"2023-07-27T20:32:59.564646+0000","last_fullsized":"2023-07-27T20:32:59.564646+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.583113+0000","last_change":"2023-07-27T20:32:59.579629+0000","last_active":"2023-07-27T20:32:59.583113+0000","last_peered":"2023-07-27T20:32:59.583113+0000","last_clean":"2023-07-27T20:32:59.583113+0000","last_became_active":"2023-07-27T20:32:59.579376+0000","last_became_peered":"2023-07-27T20:32:59.579376+0000","last_unstale":"2023-07-27T20:32:59.583113+0000","last_undegraded":"2023-07-27T20:32:59.583113+0000","last_fullsized":"2023-07-27T20:32:59.583113+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:34:01.141411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.565740+0000","last_change":"2023-07-27T20:31:22.846540+0000","last_active":"2023-07-27T20:32:59.565740+0000","last_peered":"2023-07-27T20:32:59.565740+0000","last_clean":"2023-07-27T20:32:59.565740+0000","last_became_active":"2023-07-27T20:31:22.846128+0000","last_became_peered":"2023-07-27T20:31:22.846128+0000","last_unstale":"2023-07-27T20:32:59.565740+0000","last_undegraded":"2023-07-27T20:32:59.565740+0000","last_fullsized":"2023-07-27T20:32:59.565740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:41:50.272995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1032192,"data_stored":781795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":3.5609999999999999,"5min":3.5609999999999999,"15min":3.5609999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.56299999999999994}]},{"osd":1,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":3.927,"5min":3.927,"15min":3.927},"last":0.745}]},{"osd":2,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.1589999999999998,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":0.69299999999999995}]},{"osd":3,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.4239999999999999,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":3.1080000000000001,"5min":3.1080000000000001,"15min":3.1080000000000001},"last":0.83399999999999996}]},{"osd":4,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.2730000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.624}]},{"osd":5,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":6.1619999999999999,"5min":6.1619999999999999,"15min":6.1619999999999999},"last":0.438},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":6.2729999999999997,"5min":6.2729999999999997,"15min":6.2729999999999997},"last":0.65300000000000002}]},{"osd":6,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":3.5289999999999999,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":0.67600000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":191427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.56499999999999995}]},{"osd":1,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.60599999999999998}]},{"osd":2,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.70199999999999996}]},{"osd":3,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":0.58399999999999996}]},{"osd":4,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.80000000000000004}]},{"osd":5,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.81599999999999995}]},{"osd":7,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.623}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":191427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.40699999999999997}]},{"osd":2,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.504}]},{"osd":3,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.435}]},{"osd":4,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.74099999999999999}]},{"osd":5,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.69599999999999995}]},{"osd":7,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.627},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.55100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1032192,"data_stored":781795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.433},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.59099999999999997}]},{"osd":4,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.69899999999999995}]},{"osd":6,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.751},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.67200000000000004}]},{"osd":7,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.65500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":191427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.313},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":3.2999999999999998,"5min":3.2999999999999998,"15min":3.2999999999999998},"last":0.36599999999999999}]},{"osd":1,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":3.0600000000000001,"5min":3.0600000000000001,"15min":3.0600000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":3.4580000000000002,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.35199999999999998}]},{"osd":3,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":9.2200000000000006,"5min":9.2200000000000006,"15min":9.2200000000000006},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.498}]},{"osd":4,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":4.2930000000000001,"5min":4.2930000000000001,"15min":4.2930000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.70799999999999996}]},{"osd":5,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.67400000000000004}]},{"osd":6,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":3.3999999999999999,"5min":3.3999999999999999,"15min":3.3999999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":3.4990000000000001,"5min":3.4990000000000001,"15min":3.4990000000000001},"last":0.79200000000000004}]},{"osd":7,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.84199999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":191427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":2.1480000000000001,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":0.372}]},{"osd":1,"last update":"Thu Jul 27 20:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.41799999999999998}]},{"osd":2,"last update":"Thu Jul 27 20:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":0.44},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.45100000000000001}]},{"osd":4,"last update":"Thu Jul 27 20:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.755}]},{"osd":5,"last update":"Thu Jul 27 20:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.81499999999999995}]},{"osd":6,"last update":"Thu Jul 27 20:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.82499999999999996}]},{"osd":7,"last update":"Thu Jul 27 20:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.73999999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":450560,"data_stored":198367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.78000000000000003}]},{"osd":1,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.57099999999999995}]},{"osd":2,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.63200000000000001}]},{"osd":3,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.76500000000000001}]},{"osd":5,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.66300000000000003}]},{"osd":6,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.69099999999999995}]},{"osd":7,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.94599999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":191427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.50900000000000001}]},{"osd":1,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.627},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.61799999999999999}]},{"osd":4,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.437}]},{"osd":6,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.59999999999999998}]},{"osd":7,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.68100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T20:33:05.410 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T20:33:05.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.651+0000 7f576fdff700 1 Processor -- start 2023-07-27T20:33:05.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.651+0000 7f576fdff700 1 -- start start 2023-07-27T20:33:05.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.651+0000 7f576fdff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f576806b150 0x7f57680c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:05.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.651+0000 7f576fdff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f57681549f0 0x7f57681514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:05.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.651+0000 7f576fdff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f576806b710 con 0x7f57680c4400 2023-07-27T20:33:05.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.651+0000 7f576fdff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57681545d0 con 0x7f57681549f0 2023-07-27T20:33:05.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.651+0000 7f576fdff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f576806c860 con 0x7f576806b150 2023-07-27T20:33:05.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.651+0000 7f576e39c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f57681549f0 0x7f57681514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:05.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.651+0000 7f576e39c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f57681549f0 0x7f57681514a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41340/0 (socket says 172.21.15.72:41340) 2023-07-27T20:33:05.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.651+0000 7f576e39c700 1 -- 172.21.15.72:0/2271955514 learned_addr learned my addr 172.21.15.72:0/2271955514 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:05.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.651+0000 7f576d39a700 1 --2- 172.21.15.72:0/2271955514 >> v2:172.21.15.173:3300/0 conn(0x7f576806b150 0x7f57680c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:05.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.652+0000 7f576e39c700 1 -- 172.21.15.72:0/2271955514 >> v2:172.21.15.173:3300/0 conn(0x7f576806b150 msgr2=0x7f57680c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:05.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.652+0000 7f576e39c700 1 --2- 172.21.15.72:0/2271955514 >> v2:172.21.15.173:3300/0 conn(0x7f576806b150 0x7f57680c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:05.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.652+0000 7f576e39c700 1 -- 172.21.15.72:0/2271955514 >> v1:172.21.15.173:6789/0 conn(0x7f57680c4400 legacy=0x7f57680c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:05.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.652+0000 7f576e39c700 1 -- 172.21.15.72:0/2271955514 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f576806b9f0 con 0x7f57681549f0 2023-07-27T20:33:05.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.652+0000 7f576e39c700 1 --2- 172.21.15.72:0/2271955514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57681549f0 0x7f57681514a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f57680c0870 tx=0x7f576000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa96d87720638c39 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:05.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.652+0000 7f576cb99700 1 -- 172.21.15.72:0/2271955514 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576000e070 con 0x7f57681549f0 2023-07-27T20:33:05.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.652+0000 7f576cb99700 1 -- 172.21.15.72:0/2271955514 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576000b910 con 0x7f57681549f0 2023-07-27T20:33:05.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.652+0000 7f576cb99700 1 -- 172.21.15.72:0/2271955514 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576000bcc0 con 0x7f57681549f0 2023-07-27T20:33:05.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.653+0000 7f576fdff700 1 -- 172.21.15.72:0/2271955514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57681549f0 msgr2=0x7f57681514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:05.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.653+0000 7f576fdff700 1 --2- 172.21.15.72:0/2271955514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57681549f0 0x7f57681514a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f57680c0870 tx=0x7f576000b330 comp rx=0 tx=0).stop 2023-07-27T20:33:05.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.653+0000 7f576fdff700 1 -- 172.21.15.72:0/2271955514 shutdown_connections 2023-07-27T20:33:05.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.653+0000 7f576fdff700 1 --2- 172.21.15.72:0/2271955514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57681549f0 0x7f57681514a0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:05.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.653+0000 7f576fdff700 1 --2- 172.21.15.72:0/2271955514 >> v2:172.21.15.173:3300/0 conn(0x7f576806b150 0x7f57680c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:05.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.653+0000 7f576fdff700 1 -- 172.21.15.72:0/2271955514 >> 172.21.15.72:0/2271955514 conn(0x7f57680ab300 msgr2=0x7f57680ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:05.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.653+0000 7f576fdff700 1 -- 172.21.15.72:0/2271955514 shutdown_connections 2023-07-27T20:33:05.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.653+0000 7f576fdff700 1 -- 172.21.15.72:0/2271955514 wait complete. 2023-07-27T20:33:05.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.654+0000 7f576fdff700 1 Processor -- start 2023-07-27T20:33:05.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.655+0000 7f576fdff700 1 -- start start 2023-07-27T20:33:05.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.655+0000 7f576fdff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f576806b150 0x7f57680ad6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:05.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.655+0000 7f576fdff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57680c4400 0x7f576814e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:05.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.655+0000 7f576fdff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57681549f0 0x7f576814c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:05.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.655+0000 7f576fdff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576814a850 con 0x7f57680c4400 2023-07-27T20:33:05.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.655+0000 7f576fdff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576814b9b0 con 0x7f57681549f0 2023-07-27T20:33:05.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.655+0000 7f576fdff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57680adbe0 con 0x7f576806b150 2023-07-27T20:33:05.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.656+0000 7f576d39a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57680c4400 0x7f576814e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:05.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.656+0000 7f576d39a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57680c4400 0x7f576814e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41350/0 (socket says 172.21.15.72:41350) 2023-07-27T20:33:05.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.656+0000 7f576d39a700 1 -- 172.21.15.72:0/554874625 learned_addr learned my addr 172.21.15.72:0/554874625 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:05.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.656+0000 7f576e39c700 1 --2- 172.21.15.72:0/554874625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57681549f0 0x7f576814c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:05.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.656+0000 7f576db9b700 1 --2- 172.21.15.72:0/554874625 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f576806b150 0x7f57680ad6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:05.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.656+0000 7f576d39a700 1 -- 172.21.15.72:0/554874625 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f576806b150 msgr2=0x7f57680ad6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:05.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.656+0000 7f576d39a700 1 --2- 172.21.15.72:0/554874625 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f576806b150 0x7f57680ad6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:05.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.656+0000 7f576d39a700 1 -- 172.21.15.72:0/554874625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57681549f0 msgr2=0x7f576814c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:05.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.656+0000 7f576d39a700 1 --2- 172.21.15.72:0/554874625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57681549f0 0x7f576814c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:05.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.656+0000 7f576d39a700 1 -- 172.21.15.72:0/554874625 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5760009b30 con 0x7f57680c4400 2023-07-27T20:33:05.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.656+0000 7f576d39a700 1 --2- 172.21.15.72:0/554874625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57680c4400 0x7f576814e3c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f575800e9b0 tx=0x7f575800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:05.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.657+0000 7f575e7fc700 1 -- 172.21.15.72:0/554874625 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5758009710 con 0x7f57680c4400 2023-07-27T20:33:05.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.657+0000 7f575e7fc700 1 -- 172.21.15.72:0/554874625 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575800c850 con 0x7f57680c4400 2023-07-27T20:33:05.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.657+0000 7f575e7fc700 1 -- 172.21.15.72:0/554874625 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575800cbc0 con 0x7f57680c4400 2023-07-27T20:33:05.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.657+0000 7f576fdff700 1 -- 172.21.15.72:0/554874625 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f576814aaa0 con 0x7f57680c4400 2023-07-27T20:33:05.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.657+0000 7f576fdff700 1 -- 172.21.15.72:0/554874625 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f576814bc70 con 0x7f57680c4400 2023-07-27T20:33:05.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.658+0000 7f576fdff700 1 -- 172.21.15.72:0/554874625 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5768074310 con 0x7f57680c4400 2023-07-27T20:33:05.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.659+0000 7f575e7fc700 1 -- 172.21.15.72:0/554874625 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f575800cd20 con 0x7f57680c4400 2023-07-27T20:33:05.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.659+0000 7f575e7fc700 1 --2- 172.21.15.72:0/554874625 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f574c06ace0 0x7f574c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:05.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.660+0000 7f575e7fc700 1 -- 172.21.15.72:0/554874625 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f5758089640 con 0x7f57680c4400 2023-07-27T20:33:05.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.660+0000 7f576db9b700 1 --2- 172.21.15.72:0/554874625 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f574c06ace0 0x7f574c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:05.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.661+0000 7f576db9b700 1 --2- 172.21.15.72:0/554874625 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f574c06ace0 0x7f574c06d1a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5764000f60 tx=0x7f5764009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:05.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.665+0000 7f575e7fc700 1 -- 172.21.15.72:0/554874625 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f57580580d0 con 0x7f57680c4400 2023-07-27T20:33:05.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.854+0000 7f576fdff700 1 -- 172.21.15.72:0/554874625 --> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5768154180 con 0x7f574c06ace0 2023-07-27T20:33:05.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.864+0000 7f575e7fc700 1 -- 172.21.15.72:0/554874625 <== mgr.4107 v2:172.21.15.173:6832/910681537 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305756 (secure 0 0 0) 0x7f5764001490 con 0x7f574c06ace0 2023-07-27T20:33:05.854 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:33:05.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.868+0000 7f576fdff700 1 -- 172.21.15.72:0/554874625 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f574c06ace0 msgr2=0x7f574c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:05.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.868+0000 7f576fdff700 1 --2- 172.21.15.72:0/554874625 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f574c06ace0 0x7f574c06d1a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5764000f60 tx=0x7f5764009040 comp rx=0 tx=0).stop 2023-07-27T20:33:05.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.868+0000 7f576fdff700 1 -- 172.21.15.72:0/554874625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57680c4400 msgr2=0x7f576814e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:05.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.868+0000 7f576fdff700 1 --2- 172.21.15.72:0/554874625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57680c4400 0x7f576814e3c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f575800e9b0 tx=0x7f575800ed70 comp rx=0 tx=0).stop 2023-07-27T20:33:05.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.868+0000 7f576fdff700 1 -- 172.21.15.72:0/554874625 shutdown_connections 2023-07-27T20:33:05.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.868+0000 7f576fdff700 1 --2- 172.21.15.72:0/554874625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57681549f0 0x7f576814c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:05.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.868+0000 7f576fdff700 1 --2- 172.21.15.72:0/554874625 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f574c06ace0 0x7f574c06d1a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:05.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.868+0000 7f576fdff700 1 --2- 172.21.15.72:0/554874625 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f576806b150 0x7f57680ad6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:05.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.868+0000 7f576fdff700 1 --2- 172.21.15.72:0/554874625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57680c4400 0x7f576814e3c0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:05.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.868+0000 7f576fdff700 1 -- 172.21.15.72:0/554874625 >> 172.21.15.72:0/554874625 conn(0x7f57680ab300 msgr2=0x7f57680c5430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:05.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.868+0000 7f576fdff700 1 -- 172.21.15.72:0/554874625 shutdown_connections 2023-07-27T20:33:05.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:05.868+0000 7f576fdff700 1 -- 172.21.15.72:0/554874625 wait complete. 2023-07-27T20:33:05.858 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-07-27T20:33:05.874 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2023-07-27T20:33:04.550801+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":25,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220760,"kb_used_data":4596,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753960,"statfs":{"total":773094113280,"available":772868055040,"internally_reserved":0,"allocated":4706304,"data_stored":2719092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.996411"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.567842+0000","last_change":"2023-07-27T20:32:59.567842+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.567842+0000","last_undegraded":"2023-07-27T20:32:59.567842+0000","last_fullsized":"2023-07-27T20:32:59.567842+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.569932+0000","last_change":"2023-07-27T20:32:59.569932+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.569932+0000","last_undegraded":"2023-07-27T20:32:59.569932+0000","last_fullsized":"2023-07-27T20:32:59.569932+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.570253+0000","last_change":"2023-07-27T20:32:59.570253+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.570253+0000","last_undegraded":"2023-07-27T20:32:59.570253+0000","last_fullsized":"2023-07-27T20:32:59.570253+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.565765+0000","last_change":"2023-07-27T20:32:59.565765+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.565765+0000","last_undegraded":"2023-07-27T20:32:59.565765+0000","last_fullsized":"2023-07-27T20:32:59.565765+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.569378+0000","last_change":"2023-07-27T20:32:59.569378+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.569378+0000","last_undegraded":"2023-07-27T20:32:59.569378+0000","last_fullsized":"2023-07-27T20:32:59.569378+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.565133+0000","last_change":"2023-07-27T20:32:59.565133+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.565133+0000","last_undegraded":"2023-07-27T20:32:59.565133+0000","last_fullsized":"2023-07-27T20:32:59.565133+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.568305+0000","last_change":"2023-07-27T20:32:59.568305+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.568305+0000","last_undegraded":"2023-07-27T20:32:59.568305+0000","last_fullsized":"2023-07-27T20:32:59.568305+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.564621+0000","last_change":"2023-07-27T20:32:59.564621+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.564621+0000","last_undegraded":"2023-07-27T20:32:59.564621+0000","last_fullsized":"2023-07-27T20:32:59.564621+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.565120+0000","last_change":"2023-07-27T20:32:59.565120+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.565120+0000","last_undegraded":"2023-07-27T20:32:59.565120+0000","last_fullsized":"2023-07-27T20:32:59.565120+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.566143+0000","last_change":"2023-07-27T20:32:59.566143+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.566143+0000","last_undegraded":"2023-07-27T20:32:59.566143+0000","last_fullsized":"2023-07-27T20:32:59.566143+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.565448+0000","last_change":"2023-07-27T20:32:59.565448+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.565448+0000","last_undegraded":"2023-07-27T20:32:59.565448+0000","last_fullsized":"2023-07-27T20:32:59.565448+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.570381+0000","last_change":"2023-07-27T20:32:59.570381+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.570381+0000","last_undegraded":"2023-07-27T20:32:59.570381+0000","last_fullsized":"2023-07-27T20:32:59.570381+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.574499+0000","last_change":"2023-07-27T20:32:59.574499+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.574499+0000","last_undegraded":"2023-07-27T20:32:59.574499+0000","last_fullsized":"2023-07-27T20:32:59.574499+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.566369+0000","last_change":"2023-07-27T20:32:59.566369+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.566369+0000","last_undegraded":"2023-07-27T20:32:59.566369+0000","last_fullsized":"2023-07-27T20:32:59.566369+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.569914+0000","last_change":"2023-07-27T20:32:59.569914+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.569914+0000","last_undegraded":"2023-07-27T20:32:59.569914+0000","last_fullsized":"2023-07-27T20:32:59.569914+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.564178+0000","last_change":"2023-07-27T20:32:59.564178+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.564178+0000","last_undegraded":"2023-07-27T20:32:59.564178+0000","last_fullsized":"2023-07-27T20:32:59.564178+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.568795+0000","last_change":"2023-07-27T20:32:59.568795+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.568795+0000","last_undegraded":"2023-07-27T20:32:59.568795+0000","last_fullsized":"2023-07-27T20:32:59.568795+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.570637+0000","last_change":"2023-07-27T20:32:59.570637+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.570637+0000","last_undegraded":"2023-07-27T20:32:59.570637+0000","last_fullsized":"2023-07-27T20:32:59.570637+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.563688+0000","last_change":"2023-07-27T20:32:59.563688+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.563688+0000","last_undegraded":"2023-07-27T20:32:59.563688+0000","last_fullsized":"2023-07-27T20:32:59.563688+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.575128+0000","last_change":"2023-07-27T20:32:59.575128+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.575128+0000","last_undegraded":"2023-07-27T20:32:59.575128+0000","last_fullsized":"2023-07-27T20:32:59.575128+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.568600+0000","last_change":"2023-07-27T20:32:59.568600+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.568600+0000","last_undegraded":"2023-07-27T20:32:59.568600+0000","last_fullsized":"2023-07-27T20:32:59.568600+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.565127+0000","last_change":"2023-07-27T20:32:59.565127+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.565127+0000","last_undegraded":"2023-07-27T20:32:59.565127+0000","last_fullsized":"2023-07-27T20:32:59.565127+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.564165+0000","last_change":"2023-07-27T20:32:59.564165+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.564165+0000","last_undegraded":"2023-07-27T20:32:59.564165+0000","last_fullsized":"2023-07-27T20:32:59.564165+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.563046+0000","last_change":"2023-07-27T20:32:59.563046+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.563046+0000","last_undegraded":"2023-07-27T20:32:59.563046+0000","last_fullsized":"2023-07-27T20:32:59.563046+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.563155+0000","last_change":"2023-07-27T20:32:59.563155+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.563155+0000","last_undegraded":"2023-07-27T20:32:59.563155+0000","last_fullsized":"2023-07-27T20:32:59.563155+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.573150+0000","last_change":"2023-07-27T20:32:59.573150+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.573150+0000","last_undegraded":"2023-07-27T20:32:59.573150+0000","last_fullsized":"2023-07-27T20:32:59.573150+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.567727+0000","last_change":"2023-07-27T20:32:59.567727+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.567727+0000","last_undegraded":"2023-07-27T20:32:59.567727+0000","last_fullsized":"2023-07-27T20:32:59.567727+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.571281+0000","last_change":"2023-07-27T20:32:59.571281+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.571281+0000","last_undegraded":"2023-07-27T20:32:59.571281+0000","last_fullsized":"2023-07-27T20:32:59.571281+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.563375+0000","last_change":"2023-07-27T20:32:59.563375+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.563375+0000","last_undegraded":"2023-07-27T20:32:59.563375+0000","last_fullsized":"2023-07-27T20:32:59.563375+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.569703+0000","last_change":"2023-07-27T20:32:59.569703+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.569703+0000","last_undegraded":"2023-07-27T20:32:59.569703+0000","last_fullsized":"2023-07-27T20:32:59.569703+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.570528+0000","last_change":"2023-07-27T20:32:59.570528+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.570528+0000","last_undegraded":"2023-07-27T20:32:59.570528+0000","last_fullsized":"2023-07-27T20:32:59.570528+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.573628+0000","last_change":"2023-07-27T20:32:59.573628+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.573628+0000","last_undegraded":"2023-07-27T20:32:59.573628+0000","last_fullsized":"2023-07-27T20:32:59.573628+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.569101+0000","last_change":"2023-07-27T20:32:59.569101+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.569101+0000","last_undegraded":"2023-07-27T20:32:59.569101+0000","last_fullsized":"2023-07-27T20:32:59.569101+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.589083+0000","last_change":"2023-07-27T20:32:59.584807+0000","last_active":"2023-07-27T20:32:59.589083+0000","last_peered":"2023-07-27T20:32:59.589083+0000","last_clean":"2023-07-27T20:32:59.589083+0000","last_became_active":"2023-07-27T20:32:59.584538+0000","last_became_peered":"2023-07-27T20:32:59.584538+0000","last_unstale":"2023-07-27T20:32:59.589083+0000","last_undegraded":"2023-07-27T20:32:59.589083+0000","last_fullsized":"2023-07-27T20:32:59.589083+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:08:25.823264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.564379+0000","last_change":"2023-07-27T20:32:59.564379+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.564379+0000","last_undegraded":"2023-07-27T20:32:59.564379+0000","last_fullsized":"2023-07-27T20:32:59.564379+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.585196+0000","last_change":"2023-07-27T20:32:59.578355+0000","last_active":"2023-07-27T20:32:59.585196+0000","last_peered":"2023-07-27T20:32:59.585196+0000","last_clean":"2023-07-27T20:32:59.585196+0000","last_became_active":"2023-07-27T20:32:59.577716+0000","last_became_peered":"2023-07-27T20:32:59.577716+0000","last_unstale":"2023-07-27T20:32:59.585196+0000","last_undegraded":"2023-07-27T20:32:59.585196+0000","last_fullsized":"2023-07-27T20:32:59.585196+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:34:47.120294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.570822+0000","last_change":"2023-07-27T20:32:59.570822+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.570822+0000","last_undegraded":"2023-07-27T20:32:59.570822+0000","last_fullsized":"2023-07-27T20:32:59.570822+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.588631+0000","last_change":"2023-07-27T20:32:59.584693+0000","last_active":"2023-07-27T20:32:59.588631+0000","last_peered":"2023-07-27T20:32:59.588631+0000","last_clean":"2023-07-27T20:32:59.588631+0000","last_became_active":"2023-07-27T20:32:59.584388+0000","last_became_peered":"2023-07-27T20:32:59.584388+0000","last_unstale":"2023-07-27T20:32:59.588631+0000","last_undegraded":"2023-07-27T20:32:59.588631+0000","last_fullsized":"2023-07-27T20:32:59.588631+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:08:59.366031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.569877+0000","last_change":"2023-07-27T20:32:59.569877+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.569877+0000","last_undegraded":"2023-07-27T20:32:59.569877+0000","last_fullsized":"2023-07-27T20:32:59.569877+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.587821+0000","last_change":"2023-07-27T20:32:59.583845+0000","last_active":"2023-07-27T20:32:59.587821+0000","last_peered":"2023-07-27T20:32:59.587821+0000","last_clean":"2023-07-27T20:32:59.587821+0000","last_became_active":"2023-07-27T20:32:59.583553+0000","last_became_peered":"2023-07-27T20:32:59.583553+0000","last_unstale":"2023-07-27T20:32:59.587821+0000","last_undegraded":"2023-07-27T20:32:59.587821+0000","last_fullsized":"2023-07-27T20:32:59.587821+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:00:27.962358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.569226+0000","last_change":"2023-07-27T20:32:59.569226+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.569226+0000","last_undegraded":"2023-07-27T20:32:59.569226+0000","last_fullsized":"2023-07-27T20:32:59.569226+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.588961+0000","last_change":"2023-07-27T20:32:59.580842+0000","last_active":"2023-07-27T20:32:59.588961+0000","last_peered":"2023-07-27T20:32:59.588961+0000","last_clean":"2023-07-27T20:32:59.588961+0000","last_became_active":"2023-07-27T20:32:59.580445+0000","last_became_peered":"2023-07-27T20:32:59.580445+0000","last_unstale":"2023-07-27T20:32:59.588961+0000","last_undegraded":"2023-07-27T20:32:59.588961+0000","last_fullsized":"2023-07-27T20:32:59.588961+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:42:04.208572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.564863+0000","last_change":"2023-07-27T20:32:59.564863+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.564863+0000","last_undegraded":"2023-07-27T20:32:59.564863+0000","last_fullsized":"2023-07-27T20:32:59.564863+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.588048+0000","last_change":"2023-07-27T20:32:59.584387+0000","last_active":"2023-07-27T20:32:59.588048+0000","last_peered":"2023-07-27T20:32:59.588048+0000","last_clean":"2023-07-27T20:32:59.588048+0000","last_became_active":"2023-07-27T20:32:59.584123+0000","last_became_peered":"2023-07-27T20:32:59.584123+0000","last_unstale":"2023-07-27T20:32:59.588048+0000","last_undegraded":"2023-07-27T20:32:59.588048+0000","last_fullsized":"2023-07-27T20:32:59.588048+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:15:29.060138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.563861+0000","last_change":"2023-07-27T20:32:59.563861+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.563861+0000","last_undegraded":"2023-07-27T20:32:59.563861+0000","last_fullsized":"2023-07-27T20:32:59.563861+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.591407+0000","last_change":"2023-07-27T20:32:59.588694+0000","last_active":"2023-07-27T20:32:59.591407+0000","last_peered":"2023-07-27T20:32:59.591407+0000","last_clean":"2023-07-27T20:32:59.591407+0000","last_became_active":"2023-07-27T20:32:59.588450+0000","last_became_peered":"2023-07-27T20:32:59.588450+0000","last_unstale":"2023-07-27T20:32:59.591407+0000","last_undegraded":"2023-07-27T20:32:59.591407+0000","last_fullsized":"2023-07-27T20:32:59.591407+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:36:05.551639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.563724+0000","last_change":"2023-07-27T20:32:59.563724+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.563724+0000","last_undegraded":"2023-07-27T20:32:59.563724+0000","last_fullsized":"2023-07-27T20:32:59.563724+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.580833+0000","last_change":"2023-07-27T20:32:59.577003+0000","last_active":"2023-07-27T20:32:59.580833+0000","last_peered":"2023-07-27T20:32:59.580833+0000","last_clean":"2023-07-27T20:32:59.580833+0000","last_became_active":"2023-07-27T20:32:59.576722+0000","last_became_peered":"2023-07-27T20:32:59.576722+0000","last_unstale":"2023-07-27T20:32:59.580833+0000","last_undegraded":"2023-07-27T20:32:59.580833+0000","last_fullsized":"2023-07-27T20:32:59.580833+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:59:10.292810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.568884+0000","last_change":"2023-07-27T20:32:59.568884+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.568884+0000","last_undegraded":"2023-07-27T20:32:59.568884+0000","last_fullsized":"2023-07-27T20:32:59.568884+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.585283+0000","last_change":"2023-07-27T20:32:59.580000+0000","last_active":"2023-07-27T20:32:59.585283+0000","last_peered":"2023-07-27T20:32:59.585283+0000","last_clean":"2023-07-27T20:32:59.585283+0000","last_became_active":"2023-07-27T20:32:59.579693+0000","last_became_peered":"2023-07-27T20:32:59.579693+0000","last_unstale":"2023-07-27T20:32:59.585283+0000","last_undegraded":"2023-07-27T20:32:59.585283+0000","last_fullsized":"2023-07-27T20:32:59.585283+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:40:08.076481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.567348+0000","last_change":"2023-07-27T20:32:59.567348+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.567348+0000","last_undegraded":"2023-07-27T20:32:59.567348+0000","last_fullsized":"2023-07-27T20:32:59.567348+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.582123+0000","last_change":"2023-07-27T20:32:59.577773+0000","last_active":"2023-07-27T20:32:59.582123+0000","last_peered":"2023-07-27T20:32:59.582123+0000","last_clean":"2023-07-27T20:32:59.582123+0000","last_became_active":"2023-07-27T20:32:59.577537+0000","last_became_peered":"2023-07-27T20:32:59.577537+0000","last_unstale":"2023-07-27T20:32:59.582123+0000","last_undegraded":"2023-07-27T20:32:59.582123+0000","last_fullsized":"2023-07-27T20:32:59.582123+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:36:05.551639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.564865+0000","last_change":"2023-07-27T20:32:59.564865+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.564865+0000","last_undegraded":"2023-07-27T20:32:59.564865+0000","last_fullsized":"2023-07-27T20:32:59.564865+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.583148+0000","last_change":"2023-07-27T20:32:59.579139+0000","last_active":"2023-07-27T20:32:59.583148+0000","last_peered":"2023-07-27T20:32:59.583148+0000","last_clean":"2023-07-27T20:32:59.583148+0000","last_became_active":"2023-07-27T20:32:59.578856+0000","last_became_peered":"2023-07-27T20:32:59.578856+0000","last_unstale":"2023-07-27T20:32:59.583148+0000","last_undegraded":"2023-07-27T20:32:59.583148+0000","last_fullsized":"2023-07-27T20:32:59.583148+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:33:46.826785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.567502+0000","last_change":"2023-07-27T20:32:59.567502+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.567502+0000","last_undegraded":"2023-07-27T20:32:59.567502+0000","last_fullsized":"2023-07-27T20:32:59.567502+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.586600+0000","last_change":"2023-07-27T20:32:59.583956+0000","last_active":"2023-07-27T20:32:59.586600+0000","last_peered":"2023-07-27T20:32:59.586600+0000","last_clean":"2023-07-27T20:32:59.586600+0000","last_became_active":"2023-07-27T20:32:59.583495+0000","last_became_peered":"2023-07-27T20:32:59.583495+0000","last_unstale":"2023-07-27T20:32:59.586600+0000","last_undegraded":"2023-07-27T20:32:59.586600+0000","last_fullsized":"2023-07-27T20:32:59.586600+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:57:07.019999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.562951+0000","last_change":"2023-07-27T20:32:59.562951+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.562951+0000","last_undegraded":"2023-07-27T20:32:59.562951+0000","last_fullsized":"2023-07-27T20:32:59.562951+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.588987+0000","last_change":"2023-07-27T20:32:59.581127+0000","last_active":"2023-07-27T20:32:59.588987+0000","last_peered":"2023-07-27T20:32:59.588987+0000","last_clean":"2023-07-27T20:32:59.588987+0000","last_became_active":"2023-07-27T20:32:59.580831+0000","last_became_peered":"2023-07-27T20:32:59.580831+0000","last_unstale":"2023-07-27T20:32:59.588987+0000","last_undegraded":"2023-07-27T20:32:59.588987+0000","last_fullsized":"2023-07-27T20:32:59.588987+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:49:09.328449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.563822+0000","last_change":"2023-07-27T20:32:59.563822+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.563822+0000","last_undegraded":"2023-07-27T20:32:59.563822+0000","last_fullsized":"2023-07-27T20:32:59.563822+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.583189+0000","last_change":"2023-07-27T20:32:59.581242+0000","last_active":"2023-07-27T20:32:59.583189+0000","last_peered":"2023-07-27T20:32:59.583189+0000","last_clean":"2023-07-27T20:32:59.583189+0000","last_became_active":"2023-07-27T20:32:59.580941+0000","last_became_peered":"2023-07-27T20:32:59.580941+0000","last_unstale":"2023-07-27T20:32:59.583189+0000","last_undegraded":"2023-07-27T20:32:59.583189+0000","last_fullsized":"2023-07-27T20:32:59.583189+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:22:16.460215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.569122+0000","last_change":"2023-07-27T20:32:59.569122+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.569122+0000","last_undegraded":"2023-07-27T20:32:59.569122+0000","last_fullsized":"2023-07-27T20:32:59.569122+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.589056+0000","last_change":"2023-07-27T20:32:59.583865+0000","last_active":"2023-07-27T20:32:59.589056+0000","last_peered":"2023-07-27T20:32:59.589056+0000","last_clean":"2023-07-27T20:32:59.589056+0000","last_became_active":"2023-07-27T20:32:59.583587+0000","last_became_peered":"2023-07-27T20:32:59.583587+0000","last_unstale":"2023-07-27T20:32:59.589056+0000","last_undegraded":"2023-07-27T20:32:59.589056+0000","last_fullsized":"2023-07-27T20:32:59.589056+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:04:51.056626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.567499+0000","last_change":"2023-07-27T20:32:59.567499+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.567499+0000","last_undegraded":"2023-07-27T20:32:59.567499+0000","last_fullsized":"2023-07-27T20:32:59.567499+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.585702+0000","last_change":"2023-07-27T20:32:59.583107+0000","last_active":"2023-07-27T20:32:59.585702+0000","last_peered":"2023-07-27T20:32:59.585702+0000","last_clean":"2023-07-27T20:32:59.585702+0000","last_became_active":"2023-07-27T20:32:59.582831+0000","last_became_peered":"2023-07-27T20:32:59.582831+0000","last_unstale":"2023-07-27T20:32:59.585702+0000","last_undegraded":"2023-07-27T20:32:59.585702+0000","last_fullsized":"2023-07-27T20:32:59.585702+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:12:40.374487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.572720+0000","last_change":"2023-07-27T20:32:59.572720+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.572720+0000","last_undegraded":"2023-07-27T20:32:59.572720+0000","last_fullsized":"2023-07-27T20:32:59.572720+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.588609+0000","last_change":"2023-07-27T20:32:59.586172+0000","last_active":"2023-07-27T20:32:59.588609+0000","last_peered":"2023-07-27T20:32:59.588609+0000","last_clean":"2023-07-27T20:32:59.588609+0000","last_became_active":"2023-07-27T20:32:59.585871+0000","last_became_peered":"2023-07-27T20:32:59.585871+0000","last_unstale":"2023-07-27T20:32:59.588609+0000","last_undegraded":"2023-07-27T20:32:59.588609+0000","last_fullsized":"2023-07-27T20:32:59.588609+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:32:18.167581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.563846+0000","last_change":"2023-07-27T20:32:59.563846+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.563846+0000","last_undegraded":"2023-07-27T20:32:59.563846+0000","last_fullsized":"2023-07-27T20:32:59.563846+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.585216+0000","last_change":"2023-07-27T20:32:59.580768+0000","last_active":"2023-07-27T20:32:59.585216+0000","last_peered":"2023-07-27T20:32:59.585216+0000","last_clean":"2023-07-27T20:32:59.585216+0000","last_became_active":"2023-07-27T20:32:59.580496+0000","last_became_peered":"2023-07-27T20:32:59.580496+0000","last_unstale":"2023-07-27T20:32:59.585216+0000","last_undegraded":"2023-07-27T20:32:59.585216+0000","last_fullsized":"2023-07-27T20:32:59.585216+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:10:02.524163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.563209+0000","last_change":"2023-07-27T20:32:59.563209+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.563209+0000","last_undegraded":"2023-07-27T20:32:59.563209+0000","last_fullsized":"2023-07-27T20:32:59.563209+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.591418+0000","last_change":"2023-07-27T20:32:59.588890+0000","last_active":"2023-07-27T20:32:59.591418+0000","last_peered":"2023-07-27T20:32:59.591418+0000","last_clean":"2023-07-27T20:32:59.591418+0000","last_became_active":"2023-07-27T20:32:59.588570+0000","last_became_peered":"2023-07-27T20:32:59.588570+0000","last_unstale":"2023-07-27T20:32:59.591418+0000","last_undegraded":"2023-07-27T20:32:59.591418+0000","last_fullsized":"2023-07-27T20:32:59.591418+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:15:02.312650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.563086+0000","last_change":"2023-07-27T20:32:59.563086+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.563086+0000","last_undegraded":"2023-07-27T20:32:59.563086+0000","last_fullsized":"2023-07-27T20:32:59.563086+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.589121+0000","last_change":"2023-07-27T20:32:59.585317+0000","last_active":"2023-07-27T20:32:59.589121+0000","last_peered":"2023-07-27T20:32:59.589121+0000","last_clean":"2023-07-27T20:32:59.589121+0000","last_became_active":"2023-07-27T20:32:59.585008+0000","last_became_peered":"2023-07-27T20:32:59.585008+0000","last_unstale":"2023-07-27T20:32:59.589121+0000","last_undegraded":"2023-07-27T20:32:59.589121+0000","last_fullsized":"2023-07-27T20:32:59.589121+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:43:20.425329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.565556+0000","last_change":"2023-07-27T20:32:59.565556+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.565556+0000","last_undegraded":"2023-07-27T20:32:59.565556+0000","last_fullsized":"2023-07-27T20:32:59.565556+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.588976+0000","last_change":"2023-07-27T20:32:59.581014+0000","last_active":"2023-07-27T20:32:59.588976+0000","last_peered":"2023-07-27T20:32:59.588976+0000","last_clean":"2023-07-27T20:32:59.588976+0000","last_became_active":"2023-07-27T20:32:59.580563+0000","last_became_peered":"2023-07-27T20:32:59.580563+0000","last_unstale":"2023-07-27T20:32:59.588976+0000","last_undegraded":"2023-07-27T20:32:59.588976+0000","last_fullsized":"2023-07-27T20:32:59.588976+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:19:35.470363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.569099+0000","last_change":"2023-07-27T20:32:59.569099+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.569099+0000","last_undegraded":"2023-07-27T20:32:59.569099+0000","last_fullsized":"2023-07-27T20:32:59.569099+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.586523+0000","last_change":"2023-07-27T20:32:59.583381+0000","last_active":"2023-07-27T20:32:59.586523+0000","last_peered":"2023-07-27T20:32:59.586523+0000","last_clean":"2023-07-27T20:32:59.586523+0000","last_became_active":"2023-07-27T20:32:59.582911+0000","last_became_peered":"2023-07-27T20:32:59.582911+0000","last_unstale":"2023-07-27T20:32:59.586523+0000","last_undegraded":"2023-07-27T20:32:59.586523+0000","last_fullsized":"2023-07-27T20:32:59.586523+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:22:23.203330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.573149+0000","last_change":"2023-07-27T20:32:59.573149+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.573149+0000","last_undegraded":"2023-07-27T20:32:59.573149+0000","last_fullsized":"2023-07-27T20:32:59.573149+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.582346+0000","last_change":"2023-07-27T20:32:59.577740+0000","last_active":"2023-07-27T20:32:59.582346+0000","last_peered":"2023-07-27T20:32:59.582346+0000","last_clean":"2023-07-27T20:32:59.582346+0000","last_became_active":"2023-07-27T20:32:59.577456+0000","last_became_peered":"2023-07-27T20:32:59.577456+0000","last_unstale":"2023-07-27T20:32:59.582346+0000","last_undegraded":"2023-07-27T20:32:59.582346+0000","last_fullsized":"2023-07-27T20:32:59.582346+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:43:10.317241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.565984+0000","last_change":"2023-07-27T20:32:59.565984+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.565984+0000","last_undegraded":"2023-07-27T20:32:59.565984+0000","last_fullsized":"2023-07-27T20:32:59.565984+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.583138+0000","last_change":"2023-07-27T20:32:59.581455+0000","last_active":"2023-07-27T20:32:59.583138+0000","last_peered":"2023-07-27T20:32:59.583138+0000","last_clean":"2023-07-27T20:32:59.583138+0000","last_became_active":"2023-07-27T20:32:59.579901+0000","last_became_peered":"2023-07-27T20:32:59.579901+0000","last_unstale":"2023-07-27T20:32:59.583138+0000","last_undegraded":"2023-07-27T20:32:59.583138+0000","last_fullsized":"2023-07-27T20:32:59.583138+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:51:36.297342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.569690+0000","last_change":"2023-07-27T20:32:59.569690+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.569690+0000","last_undegraded":"2023-07-27T20:32:59.569690+0000","last_fullsized":"2023-07-27T20:32:59.569690+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.585666+0000","last_change":"2023-07-27T20:32:59.581609+0000","last_active":"2023-07-27T20:32:59.585666+0000","last_peered":"2023-07-27T20:32:59.585666+0000","last_clean":"2023-07-27T20:32:59.585666+0000","last_became_active":"2023-07-27T20:32:59.580643+0000","last_became_peered":"2023-07-27T20:32:59.580643+0000","last_unstale":"2023-07-27T20:32:59.585666+0000","last_undegraded":"2023-07-27T20:32:59.585666+0000","last_fullsized":"2023-07-27T20:32:59.585666+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:47:17.437878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.570437+0000","last_change":"2023-07-27T20:31:22.848698+0000","last_active":"2023-07-27T20:32:59.570437+0000","last_peered":"2023-07-27T20:32:59.570437+0000","last_clean":"2023-07-27T20:32:59.570437+0000","last_became_active":"2023-07-27T20:31:22.848346+0000","last_became_peered":"2023-07-27T20:31:22.848346+0000","last_unstale":"2023-07-27T20:32:59.570437+0000","last_undegraded":"2023-07-27T20:32:59.570437+0000","last_fullsized":"2023-07-27T20:32:59.570437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:27:03.039316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.563925+0000","last_change":"2023-07-27T20:32:59.563925+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.563925+0000","last_undegraded":"2023-07-27T20:32:59.563925+0000","last_fullsized":"2023-07-27T20:32:59.563925+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.587716+0000","last_change":"2023-07-27T20:32:59.579071+0000","last_active":"2023-07-27T20:32:59.587716+0000","last_peered":"2023-07-27T20:32:59.587716+0000","last_clean":"2023-07-27T20:32:59.587716+0000","last_became_active":"2023-07-27T20:32:59.578792+0000","last_became_peered":"2023-07-27T20:32:59.578792+0000","last_unstale":"2023-07-27T20:32:59.587716+0000","last_undegraded":"2023-07-27T20:32:59.587716+0000","last_fullsized":"2023-07-27T20:32:59.587716+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:52:22.368996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.575330+0000","last_change":"2023-07-27T20:31:22.849178+0000","last_active":"2023-07-27T20:32:59.575330+0000","last_peered":"2023-07-27T20:32:59.575330+0000","last_clean":"2023-07-27T20:32:59.575330+0000","last_became_active":"2023-07-27T20:31:22.848856+0000","last_became_peered":"2023-07-27T20:31:22.848856+0000","last_unstale":"2023-07-27T20:32:59.575330+0000","last_undegraded":"2023-07-27T20:32:59.575330+0000","last_fullsized":"2023-07-27T20:32:59.575330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:20:39.735418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.563834+0000","last_change":"2023-07-27T20:32:59.563834+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.563834+0000","last_undegraded":"2023-07-27T20:32:59.563834+0000","last_fullsized":"2023-07-27T20:32:59.563834+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.583164+0000","last_change":"2023-07-27T20:32:59.579248+0000","last_active":"2023-07-27T20:32:59.583164+0000","last_peered":"2023-07-27T20:32:59.583164+0000","last_clean":"2023-07-27T20:32:59.583164+0000","last_became_active":"2023-07-27T20:32:59.578926+0000","last_became_peered":"2023-07-27T20:32:59.578926+0000","last_unstale":"2023-07-27T20:32:59.583164+0000","last_undegraded":"2023-07-27T20:32:59.583164+0000","last_fullsized":"2023-07-27T20:32:59.583164+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:20:33.806998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.572987+0000","last_change":"2023-07-27T20:31:22.959811+0000","last_active":"2023-07-27T20:32:59.572987+0000","last_peered":"2023-07-27T20:32:59.572987+0000","last_clean":"2023-07-27T20:32:59.572987+0000","last_became_active":"2023-07-27T20:31:22.959449+0000","last_became_peered":"2023-07-27T20:31:22.959449+0000","last_unstale":"2023-07-27T20:32:59.572987+0000","last_undegraded":"2023-07-27T20:32:59.572987+0000","last_fullsized":"2023-07-27T20:32:59.572987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:37:34.216731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.563831+0000","last_change":"2023-07-27T20:32:59.563831+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.563831+0000","last_undegraded":"2023-07-27T20:32:59.563831+0000","last_fullsized":"2023-07-27T20:32:59.563831+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.587999+0000","last_change":"2023-07-27T20:32:59.585447+0000","last_active":"2023-07-27T20:32:59.587999+0000","last_peered":"2023-07-27T20:32:59.587999+0000","last_clean":"2023-07-27T20:32:59.587999+0000","last_became_active":"2023-07-27T20:32:59.585172+0000","last_became_peered":"2023-07-27T20:32:59.585172+0000","last_unstale":"2023-07-27T20:32:59.587999+0000","last_undegraded":"2023-07-27T20:32:59.587999+0000","last_fullsized":"2023-07-27T20:32:59.587999+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:51:36.297342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.569610+0000","last_change":"2023-07-27T20:31:22.847766+0000","last_active":"2023-07-27T20:32:59.569610+0000","last_peered":"2023-07-27T20:32:59.569610+0000","last_clean":"2023-07-27T20:32:59.569610+0000","last_became_active":"2023-07-27T20:31:22.847396+0000","last_became_peered":"2023-07-27T20:31:22.847396+0000","last_unstale":"2023-07-27T20:32:59.569610+0000","last_undegraded":"2023-07-27T20:32:59.569610+0000","last_fullsized":"2023-07-27T20:32:59.569610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:45:40.713082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":203,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.570134+0000","last_change":"2023-07-27T20:31:15.812727+0000","last_active":"2023-07-27T20:32:59.570134+0000","last_peered":"2023-07-27T20:32:59.570134+0000","last_clean":"2023-07-27T20:32:59.570134+0000","last_became_active":"2023-07-27T20:31:15.811803+0000","last_became_peered":"2023-07-27T20:31:15.811803+0000","last_unstale":"2023-07-27T20:32:59.570134+0000","last_undegraded":"2023-07-27T20:32:59.570134+0000","last_fullsized":"2023-07-27T20:32:59.570134+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:14.789257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:14.789257+0000","last_clean_scrub_stamp":"2023-07-27T20:31:14.789257+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:13:18.556026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.566975+0000","last_change":"2023-07-27T20:32:59.566975+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.566975+0000","last_undegraded":"2023-07-27T20:32:59.566975+0000","last_fullsized":"2023-07-27T20:32:59.566975+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.588591+0000","last_change":"2023-07-27T20:32:59.584665+0000","last_active":"2023-07-27T20:32:59.588591+0000","last_peered":"2023-07-27T20:32:59.588591+0000","last_clean":"2023-07-27T20:32:59.588591+0000","last_became_active":"2023-07-27T20:32:59.584357+0000","last_became_peered":"2023-07-27T20:32:59.584357+0000","last_unstale":"2023-07-27T20:32:59.588591+0000","last_undegraded":"2023-07-27T20:32:59.588591+0000","last_fullsized":"2023-07-27T20:32:59.588591+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:08:20.963539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.570839+0000","last_change":"2023-07-27T20:31:22.848181+0000","last_active":"2023-07-27T20:32:59.570839+0000","last_peered":"2023-07-27T20:32:59.570839+0000","last_clean":"2023-07-27T20:32:59.570839+0000","last_became_active":"2023-07-27T20:31:22.847865+0000","last_became_peered":"2023-07-27T20:31:22.847865+0000","last_unstale":"2023-07-27T20:32:59.570839+0000","last_undegraded":"2023-07-27T20:32:59.570839+0000","last_fullsized":"2023-07-27T20:32:59.570839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:07:49.453832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.568446+0000","last_change":"2023-07-27T20:32:59.568446+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.568446+0000","last_undegraded":"2023-07-27T20:32:59.568446+0000","last_fullsized":"2023-07-27T20:32:59.568446+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.588253+0000","last_change":"2023-07-27T20:32:59.579303+0000","last_active":"2023-07-27T20:32:59.588253+0000","last_peered":"2023-07-27T20:32:59.588253+0000","last_clean":"2023-07-27T20:32:59.588253+0000","last_became_active":"2023-07-27T20:32:59.579015+0000","last_became_peered":"2023-07-27T20:32:59.579015+0000","last_unstale":"2023-07-27T20:32:59.588253+0000","last_undegraded":"2023-07-27T20:32:59.588253+0000","last_fullsized":"2023-07-27T20:32:59.588253+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:45:59.778612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.572266+0000","last_change":"2023-07-27T20:31:22.848025+0000","last_active":"2023-07-27T20:32:59.572266+0000","last_peered":"2023-07-27T20:32:59.572266+0000","last_clean":"2023-07-27T20:32:59.572266+0000","last_became_active":"2023-07-27T20:31:22.847603+0000","last_became_peered":"2023-07-27T20:31:22.847603+0000","last_unstale":"2023-07-27T20:32:59.572266+0000","last_undegraded":"2023-07-27T20:32:59.572266+0000","last_fullsized":"2023-07-27T20:32:59.572266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:41:43.700532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.568173+0000","last_change":"2023-07-27T20:32:59.568173+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.568173+0000","last_undegraded":"2023-07-27T20:32:59.568173+0000","last_fullsized":"2023-07-27T20:32:59.568173+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.590792+0000","last_change":"2023-07-27T20:32:59.586199+0000","last_active":"2023-07-27T20:32:59.590792+0000","last_peered":"2023-07-27T20:32:59.590792+0000","last_clean":"2023-07-27T20:32:59.590792+0000","last_became_active":"2023-07-27T20:32:59.585937+0000","last_became_peered":"2023-07-27T20:32:59.585937+0000","last_unstale":"2023-07-27T20:32:59.590792+0000","last_undegraded":"2023-07-27T20:32:59.590792+0000","last_fullsized":"2023-07-27T20:32:59.590792+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:50:44.917196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.570642+0000","last_change":"2023-07-27T20:31:22.845641+0000","last_active":"2023-07-27T20:32:59.570642+0000","last_peered":"2023-07-27T20:32:59.570642+0000","last_clean":"2023-07-27T20:32:59.570642+0000","last_became_active":"2023-07-27T20:31:22.845368+0000","last_became_peered":"2023-07-27T20:31:22.845368+0000","last_unstale":"2023-07-27T20:32:59.570642+0000","last_undegraded":"2023-07-27T20:32:59.570642+0000","last_fullsized":"2023-07-27T20:32:59.570642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:53:10.286326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-27T20:32:59.564646+0000","last_change":"2023-07-27T20:32:59.564646+0000","last_active":"2023-07-27T20:32:59.553193+0000","last_peered":"2023-07-27T20:32:59.553193+0000","last_clean":"2023-07-27T20:32:59.553193+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:32:59.564646+0000","last_undegraded":"2023-07-27T20:32:59.564646+0000","last_fullsized":"2023-07-27T20:32:59.564646+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.583113+0000","last_change":"2023-07-27T20:32:59.579629+0000","last_active":"2023-07-27T20:32:59.583113+0000","last_peered":"2023-07-27T20:32:59.583113+0000","last_clean":"2023-07-27T20:32:59.583113+0000","last_became_active":"2023-07-27T20:32:59.579376+0000","last_became_peered":"2023-07-27T20:32:59.579376+0000","last_unstale":"2023-07-27T20:32:59.583113+0000","last_undegraded":"2023-07-27T20:32:59.583113+0000","last_fullsized":"2023-07-27T20:32:59.583113+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:34:01.141411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-27T20:32:59.565740+0000","last_change":"2023-07-27T20:31:22.846540+0000","last_active":"2023-07-27T20:32:59.565740+0000","last_peered":"2023-07-27T20:32:59.565740+0000","last_clean":"2023-07-27T20:32:59.565740+0000","last_became_active":"2023-07-27T20:31:22.846128+0000","last_became_peered":"2023-07-27T20:31:22.846128+0000","last_unstale":"2023-07-27T20:32:59.565740+0000","last_undegraded":"2023-07-27T20:32:59.565740+0000","last_fullsized":"2023-07-27T20:32:59.565740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:41:50.272995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1032192,"data_stored":781795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":3.5609999999999999,"5min":3.5609999999999999,"15min":3.5609999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.56299999999999994}]},{"osd":1,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":3.927,"5min":3.927,"15min":3.927},"last":0.745}]},{"osd":2,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.1589999999999998,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":0.69299999999999995}]},{"osd":3,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.4239999999999999,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":3.1080000000000001,"5min":3.1080000000000001,"15min":3.1080000000000001},"last":0.83399999999999996}]},{"osd":4,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.2730000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.624}]},{"osd":5,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":6.1619999999999999,"5min":6.1619999999999999,"15min":6.1619999999999999},"last":0.438},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":6.2729999999999997,"5min":6.2729999999999997,"15min":6.2729999999999997},"last":0.65300000000000002}]},{"osd":6,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":3.5289999999999999,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":0.67600000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":191427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.56499999999999995}]},{"osd":1,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.60599999999999998}]},{"osd":2,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.70199999999999996}]},{"osd":3,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":0.58399999999999996}]},{"osd":4,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.80000000000000004}]},{"osd":5,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.81599999999999995}]},{"osd":7,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.623}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":191427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.40699999999999997}]},{"osd":2,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.504}]},{"osd":3,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.435}]},{"osd":4,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.74099999999999999}]},{"osd":5,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.69599999999999995}]},{"osd":7,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.627},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.55100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1032192,"data_stored":781795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.433},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.59099999999999997}]},{"osd":4,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.69899999999999995}]},{"osd":6,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.751},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.67200000000000004}]},{"osd":7,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.65500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":191427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.313},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":3.2999999999999998,"5min":3.2999999999999998,"15min":3.2999999999999998},"last":0.36599999999999999}]},{"osd":1,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":3.0600000000000001,"5min":3.0600000000000001,"15min":3.0600000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":3.4580000000000002,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.35199999999999998}]},{"osd":3,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":9.2200000000000006,"5min":9.2200000000000006,"15min":9.2200000000000006},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.498}]},{"osd":4,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":4.2930000000000001,"5min":4.2930000000000001,"15min":4.2930000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.70799999999999996}]},{"osd":5,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.67400000000000004}]},{"osd":6,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":3.3999999999999999,"5min":3.3999999999999999,"15min":3.3999999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":3.4990000000000001,"5min":3.4990000000000001,"15min":3.4990000000000001},"last":0.79200000000000004}]},{"osd":7,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.84199999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":191427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":2.1480000000000001,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":0.372}]},{"osd":1,"last update":"Thu Jul 27 20:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.41799999999999998}]},{"osd":2,"last update":"Thu Jul 27 20:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":0.44},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.45100000000000001}]},{"osd":4,"last update":"Thu Jul 27 20:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.755}]},{"osd":5,"last update":"Thu Jul 27 20:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.81499999999999995}]},{"osd":6,"last update":"Thu Jul 27 20:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.82499999999999996}]},{"osd":7,"last update":"Thu Jul 27 20:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.73999999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":450560,"data_stored":198367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.78000000000000003}]},{"osd":1,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.57099999999999995}]},{"osd":2,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.63200000000000001}]},{"osd":3,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.76500000000000001}]},{"osd":5,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.66300000000000003}]},{"osd":6,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.69099999999999995}]},{"osd":7,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.94599999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":191427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.50900000000000001}]},{"osd":1,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.627},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.61799999999999999}]},{"osd":4,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.437}]},{"osd":6,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.59999999999999998}]},{"osd":7,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.68100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T20:33:05.881 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3f is not active+clean 2023-07-27T20:33:05.881 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.567842+0000', 'last_change': '2023-07-27T20:32:59.567842+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.567842+0000', 'last_undegraded': '2023-07-27T20:32:59.567842+0000', 'last_fullsized': '2023-07-27T20:32:59.567842+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-27T20:33:05.882 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3e is not active+clean 2023-07-27T20:33:05.882 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.569932+0000', 'last_change': '2023-07-27T20:32:59.569932+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.569932+0000', 'last_undegraded': '2023-07-27T20:32:59.569932+0000', 'last_fullsized': '2023-07-27T20:32:59.569932+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-27T20:33:05.882 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3d is not active+clean 2023-07-27T20:33:05.882 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.570253+0000', 'last_change': '2023-07-27T20:32:59.570253+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.570253+0000', 'last_undegraded': '2023-07-27T20:32:59.570253+0000', 'last_fullsized': '2023-07-27T20:32:59.570253+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-27T20:33:05.883 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3c is not active+clean 2023-07-27T20:33:05.883 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.565765+0000', 'last_change': '2023-07-27T20:32:59.565765+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.565765+0000', 'last_undegraded': '2023-07-27T20:32:59.565765+0000', 'last_fullsized': '2023-07-27T20:32:59.565765+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-27T20:33:05.883 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3b is not active+clean 2023-07-27T20:33:05.884 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.569378+0000', 'last_change': '2023-07-27T20:32:59.569378+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.569378+0000', 'last_undegraded': '2023-07-27T20:32:59.569378+0000', 'last_fullsized': '2023-07-27T20:32:59.569378+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-27T20:33:05.884 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3a is not active+clean 2023-07-27T20:33:05.884 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.565133+0000', 'last_change': '2023-07-27T20:32:59.565133+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.565133+0000', 'last_undegraded': '2023-07-27T20:32:59.565133+0000', 'last_fullsized': '2023-07-27T20:32:59.565133+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-27T20:33:05.885 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.39 is not active+clean 2023-07-27T20:33:05.885 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.568305+0000', 'last_change': '2023-07-27T20:32:59.568305+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.568305+0000', 'last_undegraded': '2023-07-27T20:32:59.568305+0000', 'last_fullsized': '2023-07-27T20:32:59.568305+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-27T20:33:05.885 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.38 is not active+clean 2023-07-27T20:33:05.886 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.564621+0000', 'last_change': '2023-07-27T20:32:59.564621+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.564621+0000', 'last_undegraded': '2023-07-27T20:32:59.564621+0000', 'last_fullsized': '2023-07-27T20:32:59.564621+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-27T20:33:05.886 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.37 is not active+clean 2023-07-27T20:33:05.886 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.565120+0000', 'last_change': '2023-07-27T20:32:59.565120+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.565120+0000', 'last_undegraded': '2023-07-27T20:32:59.565120+0000', 'last_fullsized': '2023-07-27T20:32:59.565120+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-27T20:33:05.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.36 is not active+clean 2023-07-27T20:33:05.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.566143+0000', 'last_change': '2023-07-27T20:32:59.566143+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.566143+0000', 'last_undegraded': '2023-07-27T20:32:59.566143+0000', 'last_fullsized': '2023-07-27T20:32:59.566143+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-27T20:33:05.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.35 is not active+clean 2023-07-27T20:33:05.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.565448+0000', 'last_change': '2023-07-27T20:32:59.565448+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.565448+0000', 'last_undegraded': '2023-07-27T20:32:59.565448+0000', 'last_fullsized': '2023-07-27T20:32:59.565448+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-27T20:33:05.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.34 is not active+clean 2023-07-27T20:33:05.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.570381+0000', 'last_change': '2023-07-27T20:32:59.570381+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.570381+0000', 'last_undegraded': '2023-07-27T20:32:59.570381+0000', 'last_fullsized': '2023-07-27T20:32:59.570381+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-27T20:33:05.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.33 is not active+clean 2023-07-27T20:33:05.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.574499+0000', 'last_change': '2023-07-27T20:32:59.574499+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.574499+0000', 'last_undegraded': '2023-07-27T20:32:59.574499+0000', 'last_fullsized': '2023-07-27T20:32:59.574499+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-27T20:33:05.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.32 is not active+clean 2023-07-27T20:33:05.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.566369+0000', 'last_change': '2023-07-27T20:32:59.566369+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.566369+0000', 'last_undegraded': '2023-07-27T20:32:59.566369+0000', 'last_fullsized': '2023-07-27T20:32:59.566369+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-27T20:33:05.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.31 is not active+clean 2023-07-27T20:33:05.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.569914+0000', 'last_change': '2023-07-27T20:32:59.569914+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.569914+0000', 'last_undegraded': '2023-07-27T20:32:59.569914+0000', 'last_fullsized': '2023-07-27T20:32:59.569914+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-27T20:33:05.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.30 is not active+clean 2023-07-27T20:33:05.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.564178+0000', 'last_change': '2023-07-27T20:32:59.564178+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.564178+0000', 'last_undegraded': '2023-07-27T20:32:59.564178+0000', 'last_fullsized': '2023-07-27T20:32:59.564178+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-27T20:33:05.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2f is not active+clean 2023-07-27T20:33:05.892 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.568795+0000', 'last_change': '2023-07-27T20:32:59.568795+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.568795+0000', 'last_undegraded': '2023-07-27T20:32:59.568795+0000', 'last_fullsized': '2023-07-27T20:32:59.568795+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-27T20:33:05.892 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2e is not active+clean 2023-07-27T20:33:05.892 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.570637+0000', 'last_change': '2023-07-27T20:32:59.570637+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.570637+0000', 'last_undegraded': '2023-07-27T20:32:59.570637+0000', 'last_fullsized': '2023-07-27T20:32:59.570637+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-27T20:33:05.893 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2d is not active+clean 2023-07-27T20:33:05.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.563688+0000', 'last_change': '2023-07-27T20:32:59.563688+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.563688+0000', 'last_undegraded': '2023-07-27T20:32:59.563688+0000', 'last_fullsized': '2023-07-27T20:32:59.563688+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-27T20:33:05.893 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2c is not active+clean 2023-07-27T20:33:05.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.575128+0000', 'last_change': '2023-07-27T20:32:59.575128+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.575128+0000', 'last_undegraded': '2023-07-27T20:32:59.575128+0000', 'last_fullsized': '2023-07-27T20:32:59.575128+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-27T20:33:05.894 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2b is not active+clean 2023-07-27T20:33:05.894 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.568600+0000', 'last_change': '2023-07-27T20:32:59.568600+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.568600+0000', 'last_undegraded': '2023-07-27T20:32:59.568600+0000', 'last_fullsized': '2023-07-27T20:32:59.568600+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-27T20:33:05.894 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2a is not active+clean 2023-07-27T20:33:05.895 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.565127+0000', 'last_change': '2023-07-27T20:32:59.565127+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.565127+0000', 'last_undegraded': '2023-07-27T20:32:59.565127+0000', 'last_fullsized': '2023-07-27T20:32:59.565127+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-27T20:33:05.895 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.29 is not active+clean 2023-07-27T20:33:05.895 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.564165+0000', 'last_change': '2023-07-27T20:32:59.564165+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.564165+0000', 'last_undegraded': '2023-07-27T20:32:59.564165+0000', 'last_fullsized': '2023-07-27T20:32:59.564165+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-27T20:33:05.896 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.28 is not active+clean 2023-07-27T20:33:05.896 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.563046+0000', 'last_change': '2023-07-27T20:32:59.563046+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.563046+0000', 'last_undegraded': '2023-07-27T20:32:59.563046+0000', 'last_fullsized': '2023-07-27T20:32:59.563046+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-27T20:33:05.896 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.27 is not active+clean 2023-07-27T20:33:05.897 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.563155+0000', 'last_change': '2023-07-27T20:32:59.563155+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.563155+0000', 'last_undegraded': '2023-07-27T20:32:59.563155+0000', 'last_fullsized': '2023-07-27T20:32:59.563155+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-27T20:33:05.897 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.26 is not active+clean 2023-07-27T20:33:05.897 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.573150+0000', 'last_change': '2023-07-27T20:32:59.573150+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.573150+0000', 'last_undegraded': '2023-07-27T20:32:59.573150+0000', 'last_fullsized': '2023-07-27T20:32:59.573150+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-27T20:33:05.898 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.25 is not active+clean 2023-07-27T20:33:05.898 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.567727+0000', 'last_change': '2023-07-27T20:32:59.567727+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.567727+0000', 'last_undegraded': '2023-07-27T20:32:59.567727+0000', 'last_fullsized': '2023-07-27T20:32:59.567727+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-27T20:33:05.898 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.24 is not active+clean 2023-07-27T20:33:05.899 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.571281+0000', 'last_change': '2023-07-27T20:32:59.571281+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.571281+0000', 'last_undegraded': '2023-07-27T20:32:59.571281+0000', 'last_fullsized': '2023-07-27T20:32:59.571281+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-27T20:33:05.899 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.23 is not active+clean 2023-07-27T20:33:05.899 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.563375+0000', 'last_change': '2023-07-27T20:32:59.563375+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.563375+0000', 'last_undegraded': '2023-07-27T20:32:59.563375+0000', 'last_fullsized': '2023-07-27T20:32:59.563375+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-27T20:33:05.900 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.22 is not active+clean 2023-07-27T20:33:05.900 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.569703+0000', 'last_change': '2023-07-27T20:32:59.569703+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.569703+0000', 'last_undegraded': '2023-07-27T20:32:59.569703+0000', 'last_fullsized': '2023-07-27T20:32:59.569703+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-27T20:33:05.900 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.21 is not active+clean 2023-07-27T20:33:05.901 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.570528+0000', 'last_change': '2023-07-27T20:32:59.570528+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.570528+0000', 'last_undegraded': '2023-07-27T20:32:59.570528+0000', 'last_fullsized': '2023-07-27T20:32:59.570528+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-27T20:33:05.901 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.20 is not active+clean 2023-07-27T20:33:05.901 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.573628+0000', 'last_change': '2023-07-27T20:32:59.573628+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.573628+0000', 'last_undegraded': '2023-07-27T20:32:59.573628+0000', 'last_fullsized': '2023-07-27T20:32:59.573628+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-27T20:33:05.902 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2023-07-27T20:33:05.902 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.569101+0000', 'last_change': '2023-07-27T20:32:59.569101+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.569101+0000', 'last_undegraded': '2023-07-27T20:32:59.569101+0000', 'last_fullsized': '2023-07-27T20:32:59.569101+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-27T20:33:05.902 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2023-07-27T20:33:05.902 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.564379+0000', 'last_change': '2023-07-27T20:32:59.564379+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.564379+0000', 'last_undegraded': '2023-07-27T20:32:59.564379+0000', 'last_fullsized': '2023-07-27T20:32:59.564379+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-27T20:33:05.903 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2023-07-27T20:33:05.903 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.570822+0000', 'last_change': '2023-07-27T20:32:59.570822+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.570822+0000', 'last_undegraded': '2023-07-27T20:32:59.570822+0000', 'last_fullsized': '2023-07-27T20:32:59.570822+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-27T20:33:05.903 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2023-07-27T20:33:05.904 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.569877+0000', 'last_change': '2023-07-27T20:32:59.569877+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.569877+0000', 'last_undegraded': '2023-07-27T20:32:59.569877+0000', 'last_fullsized': '2023-07-27T20:32:59.569877+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-27T20:33:05.904 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2023-07-27T20:33:05.904 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.569226+0000', 'last_change': '2023-07-27T20:32:59.569226+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.569226+0000', 'last_undegraded': '2023-07-27T20:32:59.569226+0000', 'last_fullsized': '2023-07-27T20:32:59.569226+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-27T20:33:05.905 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2023-07-27T20:33:05.905 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.564863+0000', 'last_change': '2023-07-27T20:32:59.564863+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.564863+0000', 'last_undegraded': '2023-07-27T20:32:59.564863+0000', 'last_fullsized': '2023-07-27T20:32:59.564863+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-27T20:33:05.905 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2023-07-27T20:33:05.906 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.563861+0000', 'last_change': '2023-07-27T20:32:59.563861+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.563861+0000', 'last_undegraded': '2023-07-27T20:32:59.563861+0000', 'last_fullsized': '2023-07-27T20:32:59.563861+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-27T20:33:05.906 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2023-07-27T20:33:05.906 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.563724+0000', 'last_change': '2023-07-27T20:32:59.563724+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.563724+0000', 'last_undegraded': '2023-07-27T20:32:59.563724+0000', 'last_fullsized': '2023-07-27T20:32:59.563724+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-27T20:33:05.907 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2023-07-27T20:33:05.907 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.568884+0000', 'last_change': '2023-07-27T20:32:59.568884+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.568884+0000', 'last_undegraded': '2023-07-27T20:32:59.568884+0000', 'last_fullsized': '2023-07-27T20:32:59.568884+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-27T20:33:05.907 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2023-07-27T20:33:05.908 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.567348+0000', 'last_change': '2023-07-27T20:32:59.567348+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.567348+0000', 'last_undegraded': '2023-07-27T20:32:59.567348+0000', 'last_fullsized': '2023-07-27T20:32:59.567348+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-27T20:33:05.908 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.14 is not active+clean 2023-07-27T20:33:05.908 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.564865+0000', 'last_change': '2023-07-27T20:32:59.564865+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.564865+0000', 'last_undegraded': '2023-07-27T20:32:59.564865+0000', 'last_fullsized': '2023-07-27T20:32:59.564865+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-27T20:33:05.909 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2023-07-27T20:33:05.909 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.567502+0000', 'last_change': '2023-07-27T20:32:59.567502+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.567502+0000', 'last_undegraded': '2023-07-27T20:32:59.567502+0000', 'last_fullsized': '2023-07-27T20:32:59.567502+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-27T20:33:05.909 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2023-07-27T20:33:05.910 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.562951+0000', 'last_change': '2023-07-27T20:32:59.562951+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.562951+0000', 'last_undegraded': '2023-07-27T20:32:59.562951+0000', 'last_fullsized': '2023-07-27T20:32:59.562951+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-27T20:33:05.910 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.13 is not active+clean 2023-07-27T20:33:05.910 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.563822+0000', 'last_change': '2023-07-27T20:32:59.563822+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.563822+0000', 'last_undegraded': '2023-07-27T20:32:59.563822+0000', 'last_fullsized': '2023-07-27T20:32:59.563822+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-27T20:33:05.911 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.10 is not active+clean 2023-07-27T20:33:05.911 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.569122+0000', 'last_change': '2023-07-27T20:32:59.569122+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.569122+0000', 'last_undegraded': '2023-07-27T20:32:59.569122+0000', 'last_fullsized': '2023-07-27T20:32:59.569122+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-27T20:33:05.911 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2023-07-27T20:33:05.911 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.567499+0000', 'last_change': '2023-07-27T20:32:59.567499+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.567499+0000', 'last_undegraded': '2023-07-27T20:32:59.567499+0000', 'last_fullsized': '2023-07-27T20:32:59.567499+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-27T20:33:05.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.e is not active+clean 2023-07-27T20:33:05.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.572720+0000', 'last_change': '2023-07-27T20:32:59.572720+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.572720+0000', 'last_undegraded': '2023-07-27T20:32:59.572720+0000', 'last_fullsized': '2023-07-27T20:32:59.572720+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-27T20:33:05.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2023-07-27T20:33:05.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.563846+0000', 'last_change': '2023-07-27T20:32:59.563846+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.563846+0000', 'last_undegraded': '2023-07-27T20:32:59.563846+0000', 'last_fullsized': '2023-07-27T20:32:59.563846+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-27T20:33:05.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2023-07-27T20:33:05.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.563209+0000', 'last_change': '2023-07-27T20:32:59.563209+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.563209+0000', 'last_undegraded': '2023-07-27T20:32:59.563209+0000', 'last_fullsized': '2023-07-27T20:32:59.563209+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-27T20:33:05.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2023-07-27T20:33:05.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.563086+0000', 'last_change': '2023-07-27T20:32:59.563086+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.563086+0000', 'last_undegraded': '2023-07-27T20:32:59.563086+0000', 'last_fullsized': '2023-07-27T20:32:59.563086+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-27T20:33:05.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.a is not active+clean 2023-07-27T20:33:05.915 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.565556+0000', 'last_change': '2023-07-27T20:32:59.565556+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.565556+0000', 'last_undegraded': '2023-07-27T20:32:59.565556+0000', 'last_fullsized': '2023-07-27T20:32:59.565556+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-27T20:33:05.915 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2023-07-27T20:33:05.915 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.569099+0000', 'last_change': '2023-07-27T20:32:59.569099+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.569099+0000', 'last_undegraded': '2023-07-27T20:32:59.569099+0000', 'last_fullsized': '2023-07-27T20:32:59.569099+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-27T20:33:05.916 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.8 is not active+clean 2023-07-27T20:33:05.916 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.573149+0000', 'last_change': '2023-07-27T20:32:59.573149+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.573149+0000', 'last_undegraded': '2023-07-27T20:32:59.573149+0000', 'last_fullsized': '2023-07-27T20:32:59.573149+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-27T20:33:05.916 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2023-07-27T20:33:05.917 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.565984+0000', 'last_change': '2023-07-27T20:32:59.565984+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.565984+0000', 'last_undegraded': '2023-07-27T20:32:59.565984+0000', 'last_fullsized': '2023-07-27T20:32:59.565984+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-27T20:33:05.917 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2023-07-27T20:33:05.917 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.569690+0000', 'last_change': '2023-07-27T20:32:59.569690+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.569690+0000', 'last_undegraded': '2023-07-27T20:32:59.569690+0000', 'last_fullsized': '2023-07-27T20:32:59.569690+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-27T20:33:05.918 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2023-07-27T20:33:05.918 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.563925+0000', 'last_change': '2023-07-27T20:32:59.563925+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.563925+0000', 'last_undegraded': '2023-07-27T20:32:59.563925+0000', 'last_fullsized': '2023-07-27T20:32:59.563925+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-27T20:33:05.918 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2023-07-27T20:33:05.919 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.563834+0000', 'last_change': '2023-07-27T20:32:59.563834+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.563834+0000', 'last_undegraded': '2023-07-27T20:32:59.563834+0000', 'last_fullsized': '2023-07-27T20:32:59.563834+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-27T20:33:05.919 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.6 is not active+clean 2023-07-27T20:33:05.919 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.563831+0000', 'last_change': '2023-07-27T20:32:59.563831+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.563831+0000', 'last_undegraded': '2023-07-27T20:32:59.563831+0000', 'last_fullsized': '2023-07-27T20:32:59.563831+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-27T20:33:05.920 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2023-07-27T20:33:05.920 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.566975+0000', 'last_change': '2023-07-27T20:32:59.566975+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.566975+0000', 'last_undegraded': '2023-07-27T20:32:59.566975+0000', 'last_fullsized': '2023-07-27T20:32:59.566975+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-27T20:33:05.920 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2023-07-27T20:33:05.920 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.568446+0000', 'last_change': '2023-07-27T20:32:59.568446+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.568446+0000', 'last_undegraded': '2023-07-27T20:32:59.568446+0000', 'last_fullsized': '2023-07-27T20:32:59.568446+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-27T20:33:05.921 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3 is not active+clean 2023-07-27T20:33:05.921 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.568173+0000', 'last_change': '2023-07-27T20:32:59.568173+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.568173+0000', 'last_undegraded': '2023-07-27T20:32:59.568173+0000', 'last_fullsized': '2023-07-27T20:32:59.568173+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-27T20:33:05.921 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2 is not active+clean 2023-07-27T20:33:05.922 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-27T20:32:59.564646+0000', 'last_change': '2023-07-27T20:32:59.564646+0000', 'last_active': '2023-07-27T20:32:59.553193+0000', 'last_peered': '2023-07-27T20:32:59.553193+0000', 'last_clean': '2023-07-27T20:32:59.553193+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T20:32:59.564646+0000', 'last_undegraded': '2023-07-27T20:32:59.564646+0000', 'last_fullsized': '2023-07-27T20:32:59.564646+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'last_clean_scrub_stamp': '2023-07-27T20:32:59.553193+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-27T20:33:05.923 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-27T20:33:06.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.129+0000 7f91873ff700 1 Processor -- start 2023-07-27T20:33:06.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.129+0000 7f91873ff700 1 -- start start 2023-07-27T20:33:06.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.131+0000 7f91873ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f918014e120 0x7f9180150c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:06.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.131+0000 7f91873ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91800718e0 con 0x7f91800c02e0 2023-07-27T20:33:06.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.131+0000 7f91873ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9180071bc0 con 0x7f91800713c0 2023-07-27T20:33:06.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.131+0000 7f91873ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9180071ea0 con 0x7f918014e120 2023-07-27T20:33:06.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.131+0000 7f918599c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f91800c02e0 0x7f91800c0730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41136/0 (socket says 172.21.15.72:41136) 2023-07-27T20:33:06.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.131+0000 7f918599c700 1 -- 172.21.15.72:0/2200956012 learned_addr learned my addr 172.21.15.72:0/2200956012 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:06.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.131+0000 7f918519b700 1 --2- 172.21.15.72:0/2200956012 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f918014e120 0x7f9180150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:06.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.131+0000 7f9177fff700 1 -- 172.21.15.72:0/2200956012 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3068381304 0 0) 0x7f91800718e0 con 0x7f91800c02e0 2023-07-27T20:33:06.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.132+0000 7f9177fff700 1 -- 172.21.15.72:0/2200956012 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f916c0035b0 con 0x7f91800c02e0 2023-07-27T20:33:06.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.132+0000 7f9177fff700 1 -- 172.21.15.72:0/2200956012 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2152318680 0 0) 0x7f9180071bc0 con 0x7f91800713c0 2023-07-27T20:33:06.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.132+0000 7f9177fff700 1 -- 172.21.15.72:0/2200956012 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91800718e0 con 0x7f91800713c0 2023-07-27T20:33:06.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.132+0000 7f918519b700 1 -- 172.21.15.72:0/2200956012 >> v1:172.21.15.173:6789/0 conn(0x7f91800713c0 legacy=0x7f918006d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:06.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.132+0000 7f918519b700 1 -- 172.21.15.72:0/2200956012 >> v1:172.21.15.72:6789/0 conn(0x7f91800c02e0 legacy=0x7f91800c0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:06.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.132+0000 7f9177fff700 1 -- 172.21.15.72:0/2200956012 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2499745827 0 0) 0x7f916c0035b0 con 0x7f91800c02e0 2023-07-27T20:33:06.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.132+0000 7f918519b700 1 -- 172.21.15.72:0/2200956012 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9180072180 con 0x7f918014e120 2023-07-27T20:33:06.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.132+0000 7f918519b700 1 --2- 172.21.15.72:0/2200956012 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f918014e120 0x7f9180150c40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f917c009870 tx=0x7f917c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82c7d9ac922a830e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:06.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.132+0000 7f9177fff700 1 -- 172.21.15.72:0/2200956012 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917c011830 con 0x7f918014e120 2023-07-27T20:33:06.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.132+0000 7f9177fff700 1 -- 172.21.15.72:0/2200956012 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f917c011990 con 0x7f918014e120 2023-07-27T20:33:06.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.132+0000 7f9177fff700 1 -- 172.21.15.72:0/2200956012 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917c011d20 con 0x7f918014e120 2023-07-27T20:33:06.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.133+0000 7f91873ff700 1 -- 172.21.15.72:0/2200956012 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f918014e120 msgr2=0x7f9180150c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:06.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.133+0000 7f91873ff700 1 --2- 172.21.15.72:0/2200956012 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f918014e120 0x7f9180150c40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f917c009870 tx=0x7f917c009b80 comp rx=0 tx=0).stop 2023-07-27T20:33:06.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.133+0000 7f91873ff700 1 -- 172.21.15.72:0/2200956012 shutdown_connections 2023-07-27T20:33:06.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.133+0000 7f91873ff700 1 --2- 172.21.15.72:0/2200956012 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f918014e120 0x7f9180150c40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:06.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.133+0000 7f91873ff700 1 -- 172.21.15.72:0/2200956012 >> 172.21.15.72:0/2200956012 conn(0x7f91800a7b40 msgr2=0x7f918006a190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:06.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.133+0000 7f91873ff700 1 -- 172.21.15.72:0/2200956012 shutdown_connections 2023-07-27T20:33:06.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.133+0000 7f91873ff700 1 -- 172.21.15.72:0/2200956012 wait complete. 2023-07-27T20:33:06.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.135+0000 7f91873ff700 1 Processor -- start 2023-07-27T20:33:06.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.135+0000 7f91873ff700 1 -- start start 2023-07-27T20:33:06.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.136+0000 7f91873ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91800713c0 0x7f91800c23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:06.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.136+0000 7f91873ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91800c02e0 0x7f918014f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:06.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.136+0000 7f91873ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f918014e120 0x7f9180147300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:06.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.136+0000 7f91873ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918014ebb0 con 0x7f91800c02e0 2023-07-27T20:33:06.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.136+0000 7f91873ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91800bf590 con 0x7f91800713c0 2023-07-27T20:33:06.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.136+0000 7f91873ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91801e9eb0 con 0x7f918014e120 2023-07-27T20:33:06.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.136+0000 7f918499a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91800c02e0 0x7f918014f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:06.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.136+0000 7f918499a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91800c02e0 0x7f918014f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41364/0 (socket says 172.21.15.72:41364) 2023-07-27T20:33:06.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.136+0000 7f918499a700 1 -- 172.21.15.72:0/2781245091 learned_addr learned my addr 172.21.15.72:0/2781245091 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:06.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.136+0000 7f918519b700 1 --2- 172.21.15.72:0/2781245091 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91800713c0 0x7f91800c23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:06.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.136+0000 7f918599c700 1 --2- 172.21.15.72:0/2781245091 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f918014e120 0x7f9180147300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:06.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.136+0000 7f918499a700 1 -- 172.21.15.72:0/2781245091 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f918014e120 msgr2=0x7f9180147300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:06.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.136+0000 7f918499a700 1 --2- 172.21.15.72:0/2781245091 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f918014e120 0x7f9180147300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:06.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.136+0000 7f918499a700 1 -- 172.21.15.72:0/2781245091 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91800713c0 msgr2=0x7f91800c23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:06.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.136+0000 7f918499a700 1 --2- 172.21.15.72:0/2781245091 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91800713c0 0x7f91800c23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:06.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.136+0000 7f918499a700 1 -- 172.21.15.72:0/2781245091 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f917c0094a0 con 0x7f91800c02e0 2023-07-27T20:33:06.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.136+0000 7f918499a700 1 --2- 172.21.15.72:0/2781245091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91800c02e0 0x7f918014f600 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f917000c520 tx=0x7f917000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:06.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.137+0000 7f9175ffb700 1 -- 172.21.15.72:0/2781245091 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91700052d0 con 0x7f91800c02e0 2023-07-27T20:33:06.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.137+0000 7f9175ffb700 1 -- 172.21.15.72:0/2781245091 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9170005430 con 0x7f91800c02e0 2023-07-27T20:33:06.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.137+0000 7f91873ff700 1 -- 172.21.15.72:0/2781245091 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91801ea190 con 0x7f91800c02e0 2023-07-27T20:33:06.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.137+0000 7f9175ffb700 1 -- 172.21.15.72:0/2781245091 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91700038c0 con 0x7f91800c02e0 2023-07-27T20:33:06.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.137+0000 7f91873ff700 1 -- 172.21.15.72:0/2781245091 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f918014f0e0 con 0x7f91800c02e0 2023-07-27T20:33:06.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.138+0000 7f91873ff700 1 -- 172.21.15.72:0/2781245091 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f918004e470 con 0x7f91800c02e0 2023-07-27T20:33:06.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.139+0000 7f9175ffb700 1 -- 172.21.15.72:0/2781245091 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9170003a20 con 0x7f91800c02e0 2023-07-27T20:33:06.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.140+0000 7f9175ffb700 1 --2- 172.21.15.72:0/2781245091 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f916406ad10 0x7f916406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:06.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.140+0000 7f9175ffb700 1 -- 172.21.15.72:0/2781245091 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9170088b60 con 0x7f91800c02e0 2023-07-27T20:33:06.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.140+0000 7f918519b700 1 --2- 172.21.15.72:0/2781245091 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f916406ad10 0x7f916406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:06.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.141+0000 7f918519b700 1 --2- 172.21.15.72:0/2781245091 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f916406ad10 0x7f916406d1d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f917c0090b0 tx=0x7f917c01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:06.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.144+0000 7f9175ffb700 1 -- 172.21.15.72:0/2781245091 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9170053ac0 con 0x7f91800c02e0 2023-07-27T20:33:06.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.419+0000 7f91873ff700 1 -- 172.21.15.72:0/2781245091 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f91800726a0 con 0x7f91800c02e0 2023-07-27T20:33:06.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.419+0000 7f9175ffb700 1 -- 172.21.15.72:0/2781245091 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1034 (secure 0 0 0) 0x7f9170088020 con 0x7f91800c02e0 2023-07-27T20:33:06.407 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:33:06.407 INFO:teuthology.orchestra.run.smithi072.stdout:{"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":125,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":41,"num_osds":8,"num_up_osds":8,"osd_up_since":1690489873,"num_in_osds":8,"osd_in_since":1690489864,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":226058240,"bytes_avail":772868055040,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5409}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-07-27T20:32:34.543213+0000","services":{}},"progress_events":{}} 2023-07-27T20:33:06.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.421+0000 7f91873ff700 1 -- 172.21.15.72:0/2781245091 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f916406ad10 msgr2=0x7f916406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:06.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.421+0000 7f91873ff700 1 --2- 172.21.15.72:0/2781245091 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f916406ad10 0x7f916406d1d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f917c0090b0 tx=0x7f917c01c040 comp rx=0 tx=0).stop 2023-07-27T20:33:06.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.421+0000 7f91873ff700 1 -- 172.21.15.72:0/2781245091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91800c02e0 msgr2=0x7f918014f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:06.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.421+0000 7f91873ff700 1 --2- 172.21.15.72:0/2781245091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91800c02e0 0x7f918014f600 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f917000c520 tx=0x7f917000c8e0 comp rx=0 tx=0).stop 2023-07-27T20:33:06.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.421+0000 7f91873ff700 1 -- 172.21.15.72:0/2781245091 shutdown_connections 2023-07-27T20:33:06.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.421+0000 7f91873ff700 1 --2- 172.21.15.72:0/2781245091 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f916406ad10 0x7f916406d1d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:06.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.421+0000 7f91873ff700 1 --2- 172.21.15.72:0/2781245091 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f918014e120 0x7f9180147300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:06.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.421+0000 7f91873ff700 1 --2- 172.21.15.72:0/2781245091 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91800713c0 0x7f91800c23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:06.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.421+0000 7f91873ff700 1 --2- 172.21.15.72:0/2781245091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91800c02e0 0x7f918014f600 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:06.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.421+0000 7f91873ff700 1 -- 172.21.15.72:0/2781245091 >> 172.21.15.72:0/2781245091 conn(0x7f91800a7b40 msgr2=0x7f918006a190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:06.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.422+0000 7f91873ff700 1 -- 172.21.15.72:0/2781245091 shutdown_connections 2023-07-27T20:33:06.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.422+0000 7f91873ff700 1 -- 172.21.15.72:0/2781245091 wait complete. 2023-07-27T20:33:06.426 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-27T20:33:06.427 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T20:33:06.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.635+0000 7f779fbff700 1 Processor -- start 2023-07-27T20:33:06.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.635+0000 7f779fbff700 1 -- start start 2023-07-27T20:33:06.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.637+0000 7f779fbff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f77980aad50 0x7f7798150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:06.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.637+0000 7f779fbff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7798070080 con 0x7f77980c1930 2023-07-27T20:33:06.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.637+0000 7f779fbff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77980ab330 con 0x7f779814da10 2023-07-27T20:33:06.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.637+0000 7f779fbff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77980702d0 con 0x7f77980aad50 2023-07-27T20:33:06.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.637+0000 7f779e19c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f77980aad50 0x7f7798150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:06.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.637+0000 7f779e19c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f77980aad50 0x7f7798150bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41368/0 (socket says 172.21.15.72:41368) 2023-07-27T20:33:06.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.637+0000 7f779e19c700 1 -- 172.21.15.72:0/3036023305 learned_addr learned my addr 172.21.15.72:0/3036023305 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:06.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.637+0000 7f779e19c700 1 -- 172.21.15.72:0/3036023305 >> v1:172.21.15.173:6789/0 conn(0x7f779814da10 legacy=0x7f779806d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:06.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.637+0000 7f779e19c700 1 -- 172.21.15.72:0/3036023305 >> v1:172.21.15.72:6789/0 conn(0x7f77980c1930 legacy=0x7f77981504b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:06.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.637+0000 7f779e19c700 1 -- 172.21.15.72:0/3036023305 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77980705b0 con 0x7f77980aad50 2023-07-27T20:33:06.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.637+0000 7f779c999700 1 -- 172.21.15.72:0/3036023305 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1241020998 0 0) 0x7f7798070080 con 0x7f77980c1930 2023-07-27T20:33:06.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.638+0000 7f779e19c700 1 --2- 172.21.15.72:0/3036023305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77980aad50 0x7f7798150bc0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7790009e50 tx=0x7f779000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66e7026d75066df3 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:06.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.638+0000 7f779c999700 1 -- 172.21.15.72:0/3036023305 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779000e070 con 0x7f77980aad50 2023-07-27T20:33:06.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.638+0000 7f779c999700 1 -- 172.21.15.72:0/3036023305 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779000b9c0 con 0x7f77980aad50 2023-07-27T20:33:06.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.638+0000 7f779c999700 1 -- 172.21.15.72:0/3036023305 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779000bd70 con 0x7f77980aad50 2023-07-27T20:33:06.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.638+0000 7f779fbff700 1 -- 172.21.15.72:0/3036023305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77980aad50 msgr2=0x7f7798150bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:06.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.638+0000 7f779fbff700 1 --2- 172.21.15.72:0/3036023305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77980aad50 0x7f7798150bc0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7790009e50 tx=0x7f779000b330 comp rx=0 tx=0).stop 2023-07-27T20:33:06.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.638+0000 7f779fbff700 1 -- 172.21.15.72:0/3036023305 shutdown_connections 2023-07-27T20:33:06.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.638+0000 7f779fbff700 1 --2- 172.21.15.72:0/3036023305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77980aad50 0x7f7798150bc0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:06.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.638+0000 7f779fbff700 1 -- 172.21.15.72:0/3036023305 >> 172.21.15.72:0/3036023305 conn(0x7f779806a190 msgr2=0x7f779806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:06.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.639+0000 7f779fbff700 1 -- 172.21.15.72:0/3036023305 shutdown_connections 2023-07-27T20:33:06.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.639+0000 7f779fbff700 1 -- 172.21.15.72:0/3036023305 wait complete. 2023-07-27T20:33:06.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.640+0000 7f779fbff700 1 Processor -- start 2023-07-27T20:33:06.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.640+0000 7f779fbff700 1 -- start start 2023-07-27T20:33:06.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.641+0000 7f779fbff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77980aad50 0x7f779814f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:06.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.641+0000 7f779fbff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77980c1930 0x7f779813ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:06.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.641+0000 7f779fbff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f779814da10 0x7f779813b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:06.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.641+0000 7f779fbff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77980aa940 con 0x7f779814da10 2023-07-27T20:33:06.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.641+0000 7f779fbff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77981da110 con 0x7f77980aad50 2023-07-27T20:33:06.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.641+0000 7f779fbff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77981546e0 con 0x7f77980c1930 2023-07-27T20:33:06.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.641+0000 7f779e19c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f779814da10 0x7f779813b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:06.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.641+0000 7f779e19c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f779814da10 0x7f779813b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41378/0 (socket says 172.21.15.72:41378) 2023-07-27T20:33:06.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.641+0000 7f779e19c700 1 -- 172.21.15.72:0/546526203 learned_addr learned my addr 172.21.15.72:0/546526203 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:06.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.642+0000 7f779e19c700 1 -- 172.21.15.72:0/546526203 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77980c1930 msgr2=0x7f779813ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:06.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.642+0000 7f779e19c700 1 --2- 172.21.15.72:0/546526203 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77980c1930 0x7f779813ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:06.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.642+0000 7f779e19c700 1 -- 172.21.15.72:0/546526203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77980aad50 msgr2=0x7f779814f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:06.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.642+0000 7f779e19c700 1 --2- 172.21.15.72:0/546526203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77980aad50 0x7f779814f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:06.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.642+0000 7f779e19c700 1 -- 172.21.15.72:0/546526203 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7790009b30 con 0x7f779814da10 2023-07-27T20:33:06.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.642+0000 7f779e19c700 1 --2- 172.21.15.72:0/546526203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f779814da10 0x7f779813b1b0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f77980c2860 tx=0x7f7790004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:06.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.642+0000 7f778e7fc700 1 -- 172.21.15.72:0/546526203 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77900099b0 con 0x7f779814da10 2023-07-27T20:33:06.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.642+0000 7f778e7fc700 1 -- 172.21.15.72:0/546526203 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77900092e0 con 0x7f779814da10 2023-07-27T20:33:06.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.642+0000 7f779fbff700 1 -- 172.21.15.72:0/546526203 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7798154930 con 0x7f779814da10 2023-07-27T20:33:06.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.642+0000 7f778e7fc700 1 -- 172.21.15.72:0/546526203 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779001b630 con 0x7f779814da10 2023-07-27T20:33:06.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.642+0000 7f779fbff700 1 -- 172.21.15.72:0/546526203 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77980aa280 con 0x7f779814da10 2023-07-27T20:33:06.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.643+0000 7f779fbff700 1 -- 172.21.15.72:0/546526203 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7798074310 con 0x7f779814da10 2023-07-27T20:33:06.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.645+0000 7f778e7fc700 1 -- 172.21.15.72:0/546526203 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f779001b790 con 0x7f779814da10 2023-07-27T20:33:06.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.645+0000 7f778e7fc700 1 --2- 172.21.15.72:0/546526203 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f777c06ace0 0x7f777c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:06.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.646+0000 7f778e7fc700 1 -- 172.21.15.72:0/546526203 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f779008acf0 con 0x7f779814da10 2023-07-27T20:33:06.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.646+0000 7f779d99b700 1 --2- 172.21.15.72:0/546526203 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f777c06ace0 0x7f777c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:06.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.646+0000 7f779d99b700 1 --2- 172.21.15.72:0/546526203 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f777c06ace0 0x7f777c06d1a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7794000f60 tx=0x7f7794007a40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:06.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.650+0000 7f778e7fc700 1 -- 172.21.15.72:0/546526203 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7790055c50 con 0x7f779814da10 2023-07-27T20:33:06.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.840+0000 7f779fbff700 1 -- 172.21.15.72:0/546526203 --> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7798070890 con 0x7f777c06ace0 2023-07-27T20:33:06.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.850+0000 7f778e7fc700 1 -- 172.21.15.72:0/546526203 <== mgr.4107 v2:172.21.15.173:6832/910681537 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311180 (secure 0 0 0) 0x7f7794005080 con 0x7f777c06ace0 2023-07-27T20:33:06.841 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:33:06.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.855+0000 7f779fbff700 1 -- 172.21.15.72:0/546526203 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f777c06ace0 msgr2=0x7f777c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:06.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.855+0000 7f779fbff700 1 --2- 172.21.15.72:0/546526203 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f777c06ace0 0x7f777c06d1a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7794000f60 tx=0x7f7794007a40 comp rx=0 tx=0).stop 2023-07-27T20:33:06.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.855+0000 7f779fbff700 1 -- 172.21.15.72:0/546526203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f779814da10 msgr2=0x7f779813b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:06.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.855+0000 7f779fbff700 1 --2- 172.21.15.72:0/546526203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f779814da10 0x7f779813b1b0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f77980c2860 tx=0x7f7790004ad0 comp rx=0 tx=0).stop 2023-07-27T20:33:06.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.855+0000 7f779fbff700 1 -- 172.21.15.72:0/546526203 shutdown_connections 2023-07-27T20:33:06.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.855+0000 7f779fbff700 1 --2- 172.21.15.72:0/546526203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f779814da10 0x7f779813b1b0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:06.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.855+0000 7f779fbff700 1 --2- 172.21.15.72:0/546526203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77980aad50 0x7f779814f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:06.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.855+0000 7f779fbff700 1 --2- 172.21.15.72:0/546526203 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f777c06ace0 0x7f777c06d1a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:06.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.855+0000 7f779fbff700 1 --2- 172.21.15.72:0/546526203 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77980c1930 0x7f779813ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:06.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.855+0000 7f779fbff700 1 -- 172.21.15.72:0/546526203 >> 172.21.15.72:0/546526203 conn(0x7f779806a190 msgr2=0x7f7798147160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:06.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.855+0000 7f779fbff700 1 -- 172.21.15.72:0/546526203 shutdown_connections 2023-07-27T20:33:06.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:06.855+0000 7f779fbff700 1 -- 172.21.15.72:0/546526203 wait complete. 2023-07-27T20:33:06.845 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-07-27T20:33:06.860 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2023-07-27T20:33:06.551100+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221128,"kb_used_data":4936,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753592,"statfs":{"total":773094113280,"available":772867678208,"internally_reserved":0,"allocated":5054464,"data_stored":2887764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":50,"apply_latency_ms":50,"commit_latency_ns":50000000,"apply_latency_ns":50000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.990100"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582690+0000","last_change":"2023-07-27T20:33:00.583515+0000","last_active":"2023-07-27T20:33:01.582690+0000","last_peered":"2023-07-27T20:33:01.582690+0000","last_clean":"2023-07-27T20:33:01.582690+0000","last_became_active":"2023-07-27T20:33:00.583261+0000","last_became_peered":"2023-07-27T20:33:00.583261+0000","last_unstale":"2023-07-27T20:33:01.582690+0000","last_undegraded":"2023-07-27T20:33:01.582690+0000","last_fullsized":"2023-07-27T20:33:01.582690+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:49:17.774438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582730+0000","last_change":"2023-07-27T20:33:00.590019+0000","last_active":"2023-07-27T20:33:01.582730+0000","last_peered":"2023-07-27T20:33:01.582730+0000","last_clean":"2023-07-27T20:33:01.582730+0000","last_became_active":"2023-07-27T20:33:00.589674+0000","last_became_peered":"2023-07-27T20:33:00.589674+0000","last_unstale":"2023-07-27T20:33:01.582730+0000","last_undegraded":"2023-07-27T20:33:01.582730+0000","last_fullsized":"2023-07-27T20:33:01.582730+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:01:27.768802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.750888+0000","last_change":"2023-07-27T20:33:00.581650+0000","last_active":"2023-07-27T20:33:01.750888+0000","last_peered":"2023-07-27T20:33:01.750888+0000","last_clean":"2023-07-27T20:33:01.750888+0000","last_became_active":"2023-07-27T20:33:00.581308+0000","last_became_peered":"2023-07-27T20:33:00.581308+0000","last_unstale":"2023-07-27T20:33:01.750888+0000","last_undegraded":"2023-07-27T20:33:01.750888+0000","last_fullsized":"2023-07-27T20:33:01.750888+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:19:38.220683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.581596+0000","last_change":"2023-07-27T20:33:00.597501+0000","last_active":"2023-07-27T20:33:01.581596+0000","last_peered":"2023-07-27T20:33:01.581596+0000","last_clean":"2023-07-27T20:33:01.581596+0000","last_became_active":"2023-07-27T20:33:00.594645+0000","last_became_peered":"2023-07-27T20:33:00.594645+0000","last_unstale":"2023-07-27T20:33:01.581596+0000","last_undegraded":"2023-07-27T20:33:01.581596+0000","last_fullsized":"2023-07-27T20:33:01.581596+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:37:32.256155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582809+0000","last_change":"2023-07-27T20:33:00.590369+0000","last_active":"2023-07-27T20:33:01.582809+0000","last_peered":"2023-07-27T20:33:01.582809+0000","last_clean":"2023-07-27T20:33:01.582809+0000","last_became_active":"2023-07-27T20:33:00.590016+0000","last_became_peered":"2023-07-27T20:33:00.590016+0000","last_unstale":"2023-07-27T20:33:01.582809+0000","last_undegraded":"2023-07-27T20:33:01.582809+0000","last_fullsized":"2023-07-27T20:33:01.582809+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:27:38.597006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.746059+0000","last_change":"2023-07-27T20:33:00.588002+0000","last_active":"2023-07-27T20:33:01.746059+0000","last_peered":"2023-07-27T20:33:01.746059+0000","last_clean":"2023-07-27T20:33:01.746059+0000","last_became_active":"2023-07-27T20:33:00.587552+0000","last_became_peered":"2023-07-27T20:33:00.587552+0000","last_unstale":"2023-07-27T20:33:01.746059+0000","last_undegraded":"2023-07-27T20:33:01.746059+0000","last_fullsized":"2023-07-27T20:33:01.746059+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:03:22.452364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582458+0000","last_change":"2023-07-27T20:33:00.592227+0000","last_active":"2023-07-27T20:33:01.582458+0000","last_peered":"2023-07-27T20:33:01.582458+0000","last_clean":"2023-07-27T20:33:01.582458+0000","last_became_active":"2023-07-27T20:33:00.591718+0000","last_became_peered":"2023-07-27T20:33:00.591718+0000","last_unstale":"2023-07-27T20:33:01.582458+0000","last_undegraded":"2023-07-27T20:33:01.582458+0000","last_fullsized":"2023-07-27T20:33:01.582458+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:30:40.022997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.581049+0000","last_change":"2023-07-27T20:33:00.599242+0000","last_active":"2023-07-27T20:33:01.581049+0000","last_peered":"2023-07-27T20:33:01.581049+0000","last_clean":"2023-07-27T20:33:01.581049+0000","last_became_active":"2023-07-27T20:33:00.598810+0000","last_became_peered":"2023-07-27T20:33:00.598810+0000","last_unstale":"2023-07-27T20:33:01.581049+0000","last_undegraded":"2023-07-27T20:33:01.581049+0000","last_fullsized":"2023-07-27T20:33:01.581049+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:19:51.636873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.581819+0000","last_change":"2023-07-27T20:33:00.583733+0000","last_active":"2023-07-27T20:33:01.581819+0000","last_peered":"2023-07-27T20:33:01.581819+0000","last_clean":"2023-07-27T20:33:01.581819+0000","last_became_active":"2023-07-27T20:33:00.583442+0000","last_became_peered":"2023-07-27T20:33:00.583442+0000","last_unstale":"2023-07-27T20:33:01.581819+0000","last_undegraded":"2023-07-27T20:33:01.581819+0000","last_fullsized":"2023-07-27T20:33:01.581819+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:38:34.851684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.581905+0000","last_change":"2023-07-27T20:33:00.594067+0000","last_active":"2023-07-27T20:33:01.581905+0000","last_peered":"2023-07-27T20:33:01.581905+0000","last_clean":"2023-07-27T20:33:01.581905+0000","last_became_active":"2023-07-27T20:33:00.593772+0000","last_became_peered":"2023-07-27T20:33:00.593772+0000","last_unstale":"2023-07-27T20:33:01.581905+0000","last_undegraded":"2023-07-27T20:33:01.581905+0000","last_fullsized":"2023-07-27T20:33:01.581905+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:53:00.572896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.581654+0000","last_change":"2023-07-27T20:33:00.584457+0000","last_active":"2023-07-27T20:33:01.581654+0000","last_peered":"2023-07-27T20:33:01.581654+0000","last_clean":"2023-07-27T20:33:01.581654+0000","last_became_active":"2023-07-27T20:33:00.584193+0000","last_became_peered":"2023-07-27T20:33:00.584193+0000","last_unstale":"2023-07-27T20:33:01.581654+0000","last_undegraded":"2023-07-27T20:33:01.581654+0000","last_fullsized":"2023-07-27T20:33:01.581654+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:16:32.940169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.583087+0000","last_change":"2023-07-27T20:33:00.594729+0000","last_active":"2023-07-27T20:33:01.583087+0000","last_peered":"2023-07-27T20:33:01.583087+0000","last_clean":"2023-07-27T20:33:01.583087+0000","last_became_active":"2023-07-27T20:33:00.594045+0000","last_became_peered":"2023-07-27T20:33:00.594045+0000","last_unstale":"2023-07-27T20:33:01.583087+0000","last_undegraded":"2023-07-27T20:33:01.583087+0000","last_fullsized":"2023-07-27T20:33:01.583087+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:30:40.022997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.922344+0000","last_change":"2023-07-27T20:33:00.592723+0000","last_active":"2023-07-27T20:33:01.922344+0000","last_peered":"2023-07-27T20:33:01.922344+0000","last_clean":"2023-07-27T20:33:01.922344+0000","last_became_active":"2023-07-27T20:33:00.592222+0000","last_became_peered":"2023-07-27T20:33:00.592222+0000","last_unstale":"2023-07-27T20:33:01.922344+0000","last_undegraded":"2023-07-27T20:33:01.922344+0000","last_fullsized":"2023-07-27T20:33:01.922344+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:19:44.081500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.581139+0000","last_change":"2023-07-27T20:33:00.585154+0000","last_active":"2023-07-27T20:33:01.581139+0000","last_peered":"2023-07-27T20:33:01.581139+0000","last_clean":"2023-07-27T20:33:01.581139+0000","last_became_active":"2023-07-27T20:33:00.584912+0000","last_became_peered":"2023-07-27T20:33:00.584912+0000","last_unstale":"2023-07-27T20:33:01.581139+0000","last_undegraded":"2023-07-27T20:33:01.581139+0000","last_fullsized":"2023-07-27T20:33:01.581139+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:01:27.768802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.746138+0000","last_change":"2023-07-27T20:33:00.585997+0000","last_active":"2023-07-27T20:33:01.746138+0000","last_peered":"2023-07-27T20:33:01.746138+0000","last_clean":"2023-07-27T20:33:01.746138+0000","last_became_active":"2023-07-27T20:33:00.585348+0000","last_became_peered":"2023-07-27T20:33:00.585348+0000","last_unstale":"2023-07-27T20:33:01.746138+0000","last_undegraded":"2023-07-27T20:33:01.746138+0000","last_fullsized":"2023-07-27T20:33:01.746138+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:36:59.294934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:02.477279+0000","last_change":"2023-07-27T20:33:00.594429+0000","last_active":"2023-07-27T20:33:02.477279+0000","last_peered":"2023-07-27T20:33:02.477279+0000","last_clean":"2023-07-27T20:33:02.477279+0000","last_became_active":"2023-07-27T20:33:00.593854+0000","last_became_peered":"2023-07-27T20:33:00.593854+0000","last_unstale":"2023-07-27T20:33:02.477279+0000","last_undegraded":"2023-07-27T20:33:02.477279+0000","last_fullsized":"2023-07-27T20:33:02.477279+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:18:16.230977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.750974+0000","last_change":"2023-07-27T20:33:00.582399+0000","last_active":"2023-07-27T20:33:01.750974+0000","last_peered":"2023-07-27T20:33:01.750974+0000","last_clean":"2023-07-27T20:33:01.750974+0000","last_became_active":"2023-07-27T20:33:00.582064+0000","last_became_peered":"2023-07-27T20:33:00.582064+0000","last_unstale":"2023-07-27T20:33:01.750974+0000","last_undegraded":"2023-07-27T20:33:01.750974+0000","last_fullsized":"2023-07-27T20:33:01.750974+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:30:37.916663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.750796+0000","last_change":"2023-07-27T20:33:00.572976+0000","last_active":"2023-07-27T20:33:01.750796+0000","last_peered":"2023-07-27T20:33:01.750796+0000","last_clean":"2023-07-27T20:33:01.750796+0000","last_became_active":"2023-07-27T20:33:00.572377+0000","last_became_peered":"2023-07-27T20:33:00.572377+0000","last_unstale":"2023-07-27T20:33:01.750796+0000","last_undegraded":"2023-07-27T20:33:01.750796+0000","last_fullsized":"2023-07-27T20:33:01.750796+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:38:09.922409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:02.477837+0000","last_change":"2023-07-27T20:33:00.595816+0000","last_active":"2023-07-27T20:33:02.477837+0000","last_peered":"2023-07-27T20:33:02.477837+0000","last_clean":"2023-07-27T20:33:02.477837+0000","last_became_active":"2023-07-27T20:33:00.595429+0000","last_became_peered":"2023-07-27T20:33:00.595429+0000","last_unstale":"2023-07-27T20:33:02.477837+0000","last_undegraded":"2023-07-27T20:33:02.477837+0000","last_fullsized":"2023-07-27T20:33:02.477837+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:01:47.469093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.922304+0000","last_change":"2023-07-27T20:33:00.593232+0000","last_active":"2023-07-27T20:33:01.922304+0000","last_peered":"2023-07-27T20:33:01.922304+0000","last_clean":"2023-07-27T20:33:01.922304+0000","last_became_active":"2023-07-27T20:33:00.592968+0000","last_became_peered":"2023-07-27T20:33:00.592968+0000","last_unstale":"2023-07-27T20:33:01.922304+0000","last_undegraded":"2023-07-27T20:33:01.922304+0000","last_fullsized":"2023-07-27T20:33:01.922304+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:00:33.389999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.746059+0000","last_change":"2023-07-27T20:33:00.588688+0000","last_active":"2023-07-27T20:33:01.746059+0000","last_peered":"2023-07-27T20:33:01.746059+0000","last_clean":"2023-07-27T20:33:01.746059+0000","last_became_active":"2023-07-27T20:33:00.588417+0000","last_became_peered":"2023-07-27T20:33:00.588417+0000","last_unstale":"2023-07-27T20:33:01.746059+0000","last_undegraded":"2023-07-27T20:33:01.746059+0000","last_fullsized":"2023-07-27T20:33:01.746059+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:26:10.112801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.581263+0000","last_change":"2023-07-27T20:33:00.594352+0000","last_active":"2023-07-27T20:33:01.581263+0000","last_peered":"2023-07-27T20:33:01.581263+0000","last_clean":"2023-07-27T20:33:01.581263+0000","last_became_active":"2023-07-27T20:33:00.593480+0000","last_became_peered":"2023-07-27T20:33:00.593480+0000","last_unstale":"2023-07-27T20:33:01.581263+0000","last_undegraded":"2023-07-27T20:33:01.581263+0000","last_fullsized":"2023-07-27T20:33:01.581263+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:37:50.368366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:02.477352+0000","last_change":"2023-07-27T20:33:00.594997+0000","last_active":"2023-07-27T20:33:02.477352+0000","last_peered":"2023-07-27T20:33:02.477352+0000","last_clean":"2023-07-27T20:33:02.477352+0000","last_became_active":"2023-07-27T20:33:00.594705+0000","last_became_peered":"2023-07-27T20:33:00.594705+0000","last_unstale":"2023-07-27T20:33:02.477352+0000","last_undegraded":"2023-07-27T20:33:02.477352+0000","last_fullsized":"2023-07-27T20:33:02.477352+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:34:18.903892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:02.477392+0000","last_change":"2023-07-27T20:33:00.587648+0000","last_active":"2023-07-27T20:33:02.477392+0000","last_peered":"2023-07-27T20:33:02.477392+0000","last_clean":"2023-07-27T20:33:02.477392+0000","last_became_active":"2023-07-27T20:33:00.587312+0000","last_became_peered":"2023-07-27T20:33:00.587312+0000","last_unstale":"2023-07-27T20:33:02.477392+0000","last_undegraded":"2023-07-27T20:33:02.477392+0000","last_fullsized":"2023-07-27T20:33:02.477392+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:57:49.089736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:02.477865+0000","last_change":"2023-07-27T20:33:00.596364+0000","last_active":"2023-07-27T20:33:02.477865+0000","last_peered":"2023-07-27T20:33:02.477865+0000","last_clean":"2023-07-27T20:33:02.477865+0000","last_became_active":"2023-07-27T20:33:00.595818+0000","last_became_peered":"2023-07-27T20:33:00.595818+0000","last_unstale":"2023-07-27T20:33:02.477865+0000","last_undegraded":"2023-07-27T20:33:02.477865+0000","last_fullsized":"2023-07-27T20:33:02.477865+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:28:31.477176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.922365+0000","last_change":"2023-07-27T20:33:00.592982+0000","last_active":"2023-07-27T20:33:01.922365+0000","last_peered":"2023-07-27T20:33:01.922365+0000","last_clean":"2023-07-27T20:33:01.922365+0000","last_became_active":"2023-07-27T20:33:00.592652+0000","last_became_peered":"2023-07-27T20:33:00.592652+0000","last_unstale":"2023-07-27T20:33:01.922365+0000","last_undegraded":"2023-07-27T20:33:01.922365+0000","last_fullsized":"2023-07-27T20:33:01.922365+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:18:16.230977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.750828+0000","last_change":"2023-07-27T20:33:00.582313+0000","last_active":"2023-07-27T20:33:01.750828+0000","last_peered":"2023-07-27T20:33:01.750828+0000","last_clean":"2023-07-27T20:33:01.750828+0000","last_became_active":"2023-07-27T20:33:00.582037+0000","last_became_peered":"2023-07-27T20:33:00.582037+0000","last_unstale":"2023-07-27T20:33:01.750828+0000","last_undegraded":"2023-07-27T20:33:01.750828+0000","last_fullsized":"2023-07-27T20:33:01.750828+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:33:47.017844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582825+0000","last_change":"2023-07-27T20:33:00.594896+0000","last_active":"2023-07-27T20:33:01.582825+0000","last_peered":"2023-07-27T20:33:01.582825+0000","last_clean":"2023-07-27T20:33:01.582825+0000","last_became_active":"2023-07-27T20:33:00.594415+0000","last_became_peered":"2023-07-27T20:33:00.594415+0000","last_unstale":"2023-07-27T20:33:01.582825+0000","last_undegraded":"2023-07-27T20:33:01.582825+0000","last_fullsized":"2023-07-27T20:33:01.582825+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:27:33.017218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:02.477519+0000","last_change":"2023-07-27T20:33:00.595500+0000","last_active":"2023-07-27T20:33:02.477519+0000","last_peered":"2023-07-27T20:33:02.477519+0000","last_clean":"2023-07-27T20:33:02.477519+0000","last_became_active":"2023-07-27T20:33:00.595248+0000","last_became_peered":"2023-07-27T20:33:00.595248+0000","last_unstale":"2023-07-27T20:33:02.477519+0000","last_undegraded":"2023-07-27T20:33:02.477519+0000","last_fullsized":"2023-07-27T20:33:02.477519+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:25:51.042111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.750634+0000","last_change":"2023-07-27T20:33:00.578692+0000","last_active":"2023-07-27T20:33:01.750634+0000","last_peered":"2023-07-27T20:33:01.750634+0000","last_clean":"2023-07-27T20:33:01.750634+0000","last_became_active":"2023-07-27T20:33:00.578401+0000","last_became_peered":"2023-07-27T20:33:00.578401+0000","last_unstale":"2023-07-27T20:33:01.750634+0000","last_undegraded":"2023-07-27T20:33:01.750634+0000","last_fullsized":"2023-07-27T20:33:01.750634+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:47:20.283073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.745918+0000","last_change":"2023-07-27T20:33:00.586163+0000","last_active":"2023-07-27T20:33:01.745918+0000","last_peered":"2023-07-27T20:33:01.745918+0000","last_clean":"2023-07-27T20:33:01.745918+0000","last_became_active":"2023-07-27T20:33:00.585656+0000","last_became_peered":"2023-07-27T20:33:00.585656+0000","last_unstale":"2023-07-27T20:33:01.745918+0000","last_undegraded":"2023-07-27T20:33:01.745918+0000","last_fullsized":"2023-07-27T20:33:01.745918+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:38:34.851684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.922128+0000","last_change":"2023-07-27T20:33:00.592631+0000","last_active":"2023-07-27T20:33:01.922128+0000","last_peered":"2023-07-27T20:33:01.922128+0000","last_clean":"2023-07-27T20:33:01.922128+0000","last_became_active":"2023-07-27T20:33:00.592323+0000","last_became_peered":"2023-07-27T20:33:00.592323+0000","last_unstale":"2023-07-27T20:33:01.922128+0000","last_undegraded":"2023-07-27T20:33:01.922128+0000","last_fullsized":"2023-07-27T20:33:01.922128+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:20:16.014702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.872667+0000","last_change":"2023-07-27T20:33:00.588040+0000","last_active":"2023-07-27T20:33:01.872667+0000","last_peered":"2023-07-27T20:33:01.872667+0000","last_clean":"2023-07-27T20:33:01.872667+0000","last_became_active":"2023-07-27T20:33:00.587701+0000","last_became_peered":"2023-07-27T20:33:00.587701+0000","last_unstale":"2023-07-27T20:33:01.872667+0000","last_undegraded":"2023-07-27T20:33:01.872667+0000","last_fullsized":"2023-07-27T20:33:01.872667+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:52:23.376308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"40'4","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.746501+0000","last_change":"2023-07-27T20:32:59.584807+0000","last_active":"2023-07-27T20:33:01.746501+0000","last_peered":"2023-07-27T20:33:01.746501+0000","last_clean":"2023-07-27T20:33:01.746501+0000","last_became_active":"2023-07-27T20:32:59.584538+0000","last_became_peered":"2023-07-27T20:32:59.584538+0000","last_unstale":"2023-07-27T20:33:01.746501+0000","last_undegraded":"2023-07-27T20:33:01.746501+0000","last_fullsized":"2023-07-27T20:33:01.746501+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:15:36.951198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:02.477646+0000","last_change":"2023-07-27T20:33:00.593205+0000","last_active":"2023-07-27T20:33:02.477646+0000","last_peered":"2023-07-27T20:33:02.477646+0000","last_clean":"2023-07-27T20:33:02.477646+0000","last_became_active":"2023-07-27T20:33:00.592912+0000","last_became_peered":"2023-07-27T20:33:00.592912+0000","last_unstale":"2023-07-27T20:33:02.477646+0000","last_undegraded":"2023-07-27T20:33:02.477646+0000","last_fullsized":"2023-07-27T20:33:02.477646+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:14:59.457130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.751112+0000","last_change":"2023-07-27T20:32:59.578355+0000","last_active":"2023-07-27T20:33:01.751112+0000","last_peered":"2023-07-27T20:33:01.751112+0000","last_clean":"2023-07-27T20:33:01.751112+0000","last_became_active":"2023-07-27T20:32:59.577716+0000","last_became_peered":"2023-07-27T20:32:59.577716+0000","last_unstale":"2023-07-27T20:33:01.751112+0000","last_undegraded":"2023-07-27T20:33:01.751112+0000","last_fullsized":"2023-07-27T20:33:01.751112+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:16:16.524768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582978+0000","last_change":"2023-07-27T20:33:00.585983+0000","last_active":"2023-07-27T20:33:01.582978+0000","last_peered":"2023-07-27T20:33:01.582978+0000","last_clean":"2023-07-27T20:33:01.582978+0000","last_became_active":"2023-07-27T20:33:00.585714+0000","last_became_peered":"2023-07-27T20:33:00.585714+0000","last_unstale":"2023-07-27T20:33:01.582978+0000","last_undegraded":"2023-07-27T20:33:01.582978+0000","last_fullsized":"2023-07-27T20:33:01.582978+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:41:09.597388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.872766+0000","last_change":"2023-07-27T20:32:59.584693+0000","last_active":"2023-07-27T20:33:01.872766+0000","last_peered":"2023-07-27T20:33:01.872766+0000","last_clean":"2023-07-27T20:33:01.872766+0000","last_became_active":"2023-07-27T20:32:59.584388+0000","last_became_peered":"2023-07-27T20:32:59.584388+0000","last_unstale":"2023-07-27T20:33:01.872766+0000","last_undegraded":"2023-07-27T20:33:01.872766+0000","last_fullsized":"2023-07-27T20:33:01.872766+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:42:04.208572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.872700+0000","last_change":"2023-07-27T20:33:00.600434+0000","last_active":"2023-07-27T20:33:01.872700+0000","last_peered":"2023-07-27T20:33:01.872700+0000","last_clean":"2023-07-27T20:33:01.872700+0000","last_became_active":"2023-07-27T20:33:00.599887+0000","last_became_peered":"2023-07-27T20:33:00.599887+0000","last_unstale":"2023-07-27T20:33:01.872700+0000","last_undegraded":"2023-07-27T20:33:01.872700+0000","last_fullsized":"2023-07-27T20:33:01.872700+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:08:26.830576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582720+0000","last_change":"2023-07-27T20:32:59.583845+0000","last_active":"2023-07-27T20:33:01.582720+0000","last_peered":"2023-07-27T20:33:01.582720+0000","last_clean":"2023-07-27T20:33:01.582720+0000","last_became_active":"2023-07-27T20:32:59.583553+0000","last_became_peered":"2023-07-27T20:32:59.583553+0000","last_unstale":"2023-07-27T20:33:01.582720+0000","last_undegraded":"2023-07-27T20:33:01.582720+0000","last_fullsized":"2023-07-27T20:33:01.582720+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:37:31.248843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.751006+0000","last_change":"2023-07-27T20:33:00.596464+0000","last_active":"2023-07-27T20:33:01.751006+0000","last_peered":"2023-07-27T20:33:01.751006+0000","last_clean":"2023-07-27T20:33:01.751006+0000","last_became_active":"2023-07-27T20:33:00.596200+0000","last_became_peered":"2023-07-27T20:33:00.596200+0000","last_unstale":"2023-07-27T20:33:01.751006+0000","last_undegraded":"2023-07-27T20:33:01.751006+0000","last_fullsized":"2023-07-27T20:33:01.751006+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:41:19.760977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.746356+0000","last_change":"2023-07-27T20:32:59.580842+0000","last_active":"2023-07-27T20:33:01.746356+0000","last_peered":"2023-07-27T20:33:01.746356+0000","last_clean":"2023-07-27T20:33:01.746356+0000","last_became_active":"2023-07-27T20:32:59.580445+0000","last_became_peered":"2023-07-27T20:32:59.580445+0000","last_unstale":"2023-07-27T20:33:01.746356+0000","last_undegraded":"2023-07-27T20:33:01.746356+0000","last_fullsized":"2023-07-27T20:33:01.746356+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:19:25.141850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.581419+0000","last_change":"2023-07-27T20:33:00.582438+0000","last_active":"2023-07-27T20:33:01.581419+0000","last_peered":"2023-07-27T20:33:01.581419+0000","last_clean":"2023-07-27T20:33:01.581419+0000","last_became_active":"2023-07-27T20:33:00.582148+0000","last_became_peered":"2023-07-27T20:33:00.582148+0000","last_unstale":"2023-07-27T20:33:01.581419+0000","last_undegraded":"2023-07-27T20:33:01.581419+0000","last_fullsized":"2023-07-27T20:33:01.581419+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:27:15.025815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.751089+0000","last_change":"2023-07-27T20:32:59.584387+0000","last_active":"2023-07-27T20:33:01.751089+0000","last_peered":"2023-07-27T20:33:01.751089+0000","last_clean":"2023-07-27T20:33:01.751089+0000","last_became_active":"2023-07-27T20:32:59.584123+0000","last_became_peered":"2023-07-27T20:32:59.584123+0000","last_unstale":"2023-07-27T20:33:01.751089+0000","last_undegraded":"2023-07-27T20:33:01.751089+0000","last_fullsized":"2023-07-27T20:33:01.751089+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:00:54.752952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.581132+0000","last_change":"2023-07-27T20:33:00.593317+0000","last_active":"2023-07-27T20:33:01.581132+0000","last_peered":"2023-07-27T20:33:01.581132+0000","last_clean":"2023-07-27T20:33:01.581132+0000","last_became_active":"2023-07-27T20:33:00.593040+0000","last_became_peered":"2023-07-27T20:33:00.593040+0000","last_unstale":"2023-07-27T20:33:01.581132+0000","last_undegraded":"2023-07-27T20:33:01.581132+0000","last_fullsized":"2023-07-27T20:33:01.581132+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:41:09.597388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582119+0000","last_change":"2023-07-27T20:32:59.588694+0000","last_active":"2023-07-27T20:33:01.582119+0000","last_peered":"2023-07-27T20:33:01.582119+0000","last_clean":"2023-07-27T20:33:01.582119+0000","last_became_active":"2023-07-27T20:32:59.588450+0000","last_became_peered":"2023-07-27T20:32:59.588450+0000","last_unstale":"2023-07-27T20:33:01.582119+0000","last_undegraded":"2023-07-27T20:33:01.582119+0000","last_fullsized":"2023-07-27T20:33:01.582119+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:06:49.396831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:02.477325+0000","last_change":"2023-07-27T20:33:00.590399+0000","last_active":"2023-07-27T20:33:02.477325+0000","last_peered":"2023-07-27T20:33:02.477325+0000","last_clean":"2023-07-27T20:33:02.477325+0000","last_became_active":"2023-07-27T20:33:00.590134+0000","last_became_peered":"2023-07-27T20:33:00.590134+0000","last_unstale":"2023-07-27T20:33:02.477325+0000","last_undegraded":"2023-07-27T20:33:02.477325+0000","last_fullsized":"2023-07-27T20:33:02.477325+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:41:37.112348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.581177+0000","last_change":"2023-07-27T20:32:59.577003+0000","last_active":"2023-07-27T20:33:01.581177+0000","last_peered":"2023-07-27T20:33:01.581177+0000","last_clean":"2023-07-27T20:33:01.581177+0000","last_became_active":"2023-07-27T20:32:59.576722+0000","last_became_peered":"2023-07-27T20:32:59.576722+0000","last_unstale":"2023-07-27T20:33:01.581177+0000","last_undegraded":"2023-07-27T20:33:01.581177+0000","last_fullsized":"2023-07-27T20:33:01.581177+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:27:32.009906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.751002+0000","last_change":"2023-07-27T20:33:00.572761+0000","last_active":"2023-07-27T20:33:01.751002+0000","last_peered":"2023-07-27T20:33:01.751002+0000","last_clean":"2023-07-27T20:33:01.751002+0000","last_became_active":"2023-07-27T20:33:00.572373+0000","last_became_peered":"2023-07-27T20:33:00.572373+0000","last_unstale":"2023-07-27T20:33:01.751002+0000","last_undegraded":"2023-07-27T20:33:01.751002+0000","last_fullsized":"2023-07-27T20:33:01.751002+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:53:46.229684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.751107+0000","last_change":"2023-07-27T20:32:59.580000+0000","last_active":"2023-07-27T20:33:01.751107+0000","last_peered":"2023-07-27T20:33:01.751107+0000","last_clean":"2023-07-27T20:33:01.751107+0000","last_became_active":"2023-07-27T20:32:59.579693+0000","last_became_peered":"2023-07-27T20:32:59.579693+0000","last_unstale":"2023-07-27T20:33:01.751107+0000","last_undegraded":"2023-07-27T20:33:01.751107+0000","last_fullsized":"2023-07-27T20:33:01.751107+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:48:23.280646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582860+0000","last_change":"2023-07-27T20:33:00.586432+0000","last_active":"2023-07-27T20:33:01.582860+0000","last_peered":"2023-07-27T20:33:01.582860+0000","last_clean":"2023-07-27T20:33:01.582860+0000","last_became_active":"2023-07-27T20:33:00.586115+0000","last_became_peered":"2023-07-27T20:33:00.586115+0000","last_unstale":"2023-07-27T20:33:01.582860+0000","last_undegraded":"2023-07-27T20:33:01.582860+0000","last_fullsized":"2023-07-27T20:33:01.582860+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:16:47.190935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582011+0000","last_change":"2023-07-27T20:32:59.577773+0000","last_active":"2023-07-27T20:33:01.582011+0000","last_peered":"2023-07-27T20:33:01.582011+0000","last_clean":"2023-07-27T20:33:01.582011+0000","last_became_active":"2023-07-27T20:32:59.577537+0000","last_became_peered":"2023-07-27T20:32:59.577537+0000","last_unstale":"2023-07-27T20:33:01.582011+0000","last_undegraded":"2023-07-27T20:33:01.582011+0000","last_fullsized":"2023-07-27T20:33:01.582011+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:26:09.105489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.746361+0000","last_change":"2023-07-27T20:33:00.585029+0000","last_active":"2023-07-27T20:33:01.746361+0000","last_peered":"2023-07-27T20:33:01.746361+0000","last_clean":"2023-07-27T20:33:01.746361+0000","last_became_active":"2023-07-27T20:33:00.584714+0000","last_became_peered":"2023-07-27T20:33:00.584714+0000","last_unstale":"2023-07-27T20:33:01.746361+0000","last_undegraded":"2023-07-27T20:33:01.746361+0000","last_fullsized":"2023-07-27T20:33:01.746361+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:44:20.625780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"40'3","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.583148+0000","last_change":"2023-07-27T20:32:59.579139+0000","last_active":"2023-07-27T20:33:01.583148+0000","last_peered":"2023-07-27T20:33:01.583148+0000","last_clean":"2023-07-27T20:33:01.583148+0000","last_became_active":"2023-07-27T20:32:59.578856+0000","last_became_peered":"2023-07-27T20:32:59.578856+0000","last_unstale":"2023-07-27T20:33:01.583148+0000","last_undegraded":"2023-07-27T20:33:01.583148+0000","last_fullsized":"2023-07-27T20:33:01.583148+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:26:09.105489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582986+0000","last_change":"2023-07-27T20:33:00.591576+0000","last_active":"2023-07-27T20:33:01.582986+0000","last_peered":"2023-07-27T20:33:01.582986+0000","last_clean":"2023-07-27T20:33:01.582986+0000","last_became_active":"2023-07-27T20:33:00.591241+0000","last_became_peered":"2023-07-27T20:33:00.591241+0000","last_unstale":"2023-07-27T20:33:01.582986+0000","last_undegraded":"2023-07-27T20:33:01.582986+0000","last_fullsized":"2023-07-27T20:33:01.582986+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:53:00.572896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"40'6","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.922438+0000","last_change":"2023-07-27T20:32:59.583956+0000","last_active":"2023-07-27T20:33:01.922438+0000","last_peered":"2023-07-27T20:33:01.922438+0000","last_clean":"2023-07-27T20:33:01.922438+0000","last_became_active":"2023-07-27T20:32:59.583495+0000","last_became_peered":"2023-07-27T20:32:59.583495+0000","last_unstale":"2023-07-27T20:33:01.922438+0000","last_undegraded":"2023-07-27T20:33:01.922438+0000","last_fullsized":"2023-07-27T20:33:01.922438+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:57:48.082425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:02.477563+0000","last_change":"2023-07-27T20:33:00.594625+0000","last_active":"2023-07-27T20:33:02.477563+0000","last_peered":"2023-07-27T20:33:02.477563+0000","last_clean":"2023-07-27T20:33:02.477563+0000","last_became_active":"2023-07-27T20:33:00.594342+0000","last_became_peered":"2023-07-27T20:33:00.594342+0000","last_unstale":"2023-07-27T20:33:02.477563+0000","last_undegraded":"2023-07-27T20:33:02.477563+0000","last_fullsized":"2023-07-27T20:33:02.477563+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:57:02.618003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.746209+0000","last_change":"2023-07-27T20:32:59.581127+0000","last_active":"2023-07-27T20:33:01.746209+0000","last_peered":"2023-07-27T20:33:01.746209+0000","last_clean":"2023-07-27T20:33:01.746209+0000","last_became_active":"2023-07-27T20:32:59.580831+0000","last_became_peered":"2023-07-27T20:32:59.580831+0000","last_unstale":"2023-07-27T20:33:01.746209+0000","last_undegraded":"2023-07-27T20:33:01.746209+0000","last_fullsized":"2023-07-27T20:33:01.746209+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:23:35.212084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.581454+0000","last_change":"2023-07-27T20:33:00.578726+0000","last_active":"2023-07-27T20:33:01.581454+0000","last_peered":"2023-07-27T20:33:01.581454+0000","last_clean":"2023-07-27T20:33:01.581454+0000","last_became_active":"2023-07-27T20:33:00.578439+0000","last_became_peered":"2023-07-27T20:33:00.578439+0000","last_unstale":"2023-07-27T20:33:01.581454+0000","last_undegraded":"2023-07-27T20:33:01.581454+0000","last_fullsized":"2023-07-27T20:33:01.581454+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:49:17.774438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582500+0000","last_change":"2023-07-27T20:32:59.581242+0000","last_active":"2023-07-27T20:33:01.582500+0000","last_peered":"2023-07-27T20:33:01.582500+0000","last_clean":"2023-07-27T20:33:01.582500+0000","last_became_active":"2023-07-27T20:32:59.580941+0000","last_became_peered":"2023-07-27T20:32:59.580941+0000","last_unstale":"2023-07-27T20:33:01.582500+0000","last_undegraded":"2023-07-27T20:33:01.582500+0000","last_fullsized":"2023-07-27T20:33:01.582500+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:55:27.482074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.745919+0000","last_change":"2023-07-27T20:33:00.583374+0000","last_active":"2023-07-27T20:33:01.745919+0000","last_peered":"2023-07-27T20:33:01.745919+0000","last_clean":"2023-07-27T20:33:01.745919+0000","last_became_active":"2023-07-27T20:33:00.583064+0000","last_became_peered":"2023-07-27T20:33:00.583064+0000","last_unstale":"2023-07-27T20:33:01.745919+0000","last_undegraded":"2023-07-27T20:33:01.745919+0000","last_fullsized":"2023-07-27T20:33:01.745919+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:16:47.190935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.745994+0000","last_change":"2023-07-27T20:32:59.583865+0000","last_active":"2023-07-27T20:33:01.745994+0000","last_peered":"2023-07-27T20:33:01.745994+0000","last_clean":"2023-07-27T20:33:01.745994+0000","last_became_active":"2023-07-27T20:32:59.583587+0000","last_became_peered":"2023-07-27T20:32:59.583587+0000","last_unstale":"2023-07-27T20:33:01.745994+0000","last_undegraded":"2023-07-27T20:33:01.745994+0000","last_fullsized":"2023-07-27T20:33:01.745994+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:52:59.565584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582758+0000","last_change":"2023-07-27T20:33:00.598092+0000","last_active":"2023-07-27T20:33:01.582758+0000","last_peered":"2023-07-27T20:33:01.582758+0000","last_clean":"2023-07-27T20:33:01.582758+0000","last_became_active":"2023-07-27T20:33:00.597585+0000","last_became_peered":"2023-07-27T20:33:00.597585+0000","last_unstale":"2023-07-27T20:33:01.582758+0000","last_undegraded":"2023-07-27T20:33:01.582758+0000","last_fullsized":"2023-07-27T20:33:01.582758+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:16:32.940169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"40'8","reported_seq":21,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.581311+0000","last_change":"2023-07-27T20:32:59.583107+0000","last_active":"2023-07-27T20:33:01.581311+0000","last_peered":"2023-07-27T20:33:01.581311+0000","last_clean":"2023-07-27T20:33:01.581311+0000","last_became_active":"2023-07-27T20:32:59.582831+0000","last_became_peered":"2023-07-27T20:32:59.582831+0000","last_unstale":"2023-07-27T20:33:01.581311+0000","last_undegraded":"2023-07-27T20:33:01.581311+0000","last_fullsized":"2023-07-27T20:33:01.581311+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:30:39.015685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.922417+0000","last_change":"2023-07-27T20:33:00.583423+0000","last_active":"2023-07-27T20:33:01.922417+0000","last_peered":"2023-07-27T20:33:01.922417+0000","last_clean":"2023-07-27T20:33:01.922417+0000","last_became_active":"2023-07-27T20:33:00.583146+0000","last_became_peered":"2023-07-27T20:33:00.583146+0000","last_unstale":"2023-07-27T20:33:01.922417+0000","last_undegraded":"2023-07-27T20:33:01.922417+0000","last_fullsized":"2023-07-27T20:33:01.922417+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:34:18.903892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.922520+0000","last_change":"2023-07-27T20:32:59.586172+0000","last_active":"2023-07-27T20:33:01.922520+0000","last_peered":"2023-07-27T20:33:01.922520+0000","last_clean":"2023-07-27T20:33:01.922520+0000","last_became_active":"2023-07-27T20:32:59.585871+0000","last_became_peered":"2023-07-27T20:32:59.585871+0000","last_unstale":"2023-07-27T20:33:01.922520+0000","last_undegraded":"2023-07-27T20:33:01.922520+0000","last_fullsized":"2023-07-27T20:33:01.922520+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:41:36.105037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582111+0000","last_change":"2023-07-27T20:33:00.592417+0000","last_active":"2023-07-27T20:33:01.582111+0000","last_peered":"2023-07-27T20:33:01.582111+0000","last_clean":"2023-07-27T20:33:01.582111+0000","last_became_active":"2023-07-27T20:33:00.592164+0000","last_became_peered":"2023-07-27T20:33:00.592164+0000","last_unstale":"2023-07-27T20:33:01.582111+0000","last_undegraded":"2023-07-27T20:33:01.582111+0000","last_fullsized":"2023-07-27T20:33:01.582111+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:03:22.452364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.750836+0000","last_change":"2023-07-27T20:32:59.580768+0000","last_active":"2023-07-27T20:33:01.750836+0000","last_peered":"2023-07-27T20:33:01.750836+0000","last_clean":"2023-07-27T20:33:01.750836+0000","last_became_active":"2023-07-27T20:32:59.580496+0000","last_became_peered":"2023-07-27T20:32:59.580496+0000","last_unstale":"2023-07-27T20:33:01.750836+0000","last_undegraded":"2023-07-27T20:33:01.750836+0000","last_fullsized":"2023-07-27T20:33:01.750836+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:58:40.348368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:02.477708+0000","last_change":"2023-07-27T20:33:00.602792+0000","last_active":"2023-07-27T20:33:02.477708+0000","last_peered":"2023-07-27T20:33:02.477708+0000","last_clean":"2023-07-27T20:33:02.477708+0000","last_became_active":"2023-07-27T20:33:00.602393+0000","last_became_peered":"2023-07-27T20:33:00.602393+0000","last_unstale":"2023-07-27T20:33:02.477708+0000","last_undegraded":"2023-07-27T20:33:02.477708+0000","last_fullsized":"2023-07-27T20:33:02.477708+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:09:37.527165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582327+0000","last_change":"2023-07-27T20:32:59.588890+0000","last_active":"2023-07-27T20:33:01.582327+0000","last_peered":"2023-07-27T20:33:01.582327+0000","last_clean":"2023-07-27T20:33:01.582327+0000","last_became_active":"2023-07-27T20:32:59.588570+0000","last_became_peered":"2023-07-27T20:32:59.588570+0000","last_unstale":"2023-07-27T20:33:01.582327+0000","last_undegraded":"2023-07-27T20:33:01.582327+0000","last_fullsized":"2023-07-27T20:33:01.582327+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:39:38.296269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:02.477949+0000","last_change":"2023-07-27T20:33:00.597737+0000","last_active":"2023-07-27T20:33:02.477949+0000","last_peered":"2023-07-27T20:33:02.477949+0000","last_clean":"2023-07-27T20:33:02.477949+0000","last_became_active":"2023-07-27T20:33:00.597390+0000","last_became_peered":"2023-07-27T20:33:00.597390+0000","last_unstale":"2023-07-27T20:33:02.477949+0000","last_undegraded":"2023-07-27T20:33:02.477949+0000","last_fullsized":"2023-07-27T20:33:02.477949+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:07:59.864740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.746431+0000","last_change":"2023-07-27T20:32:59.585317+0000","last_active":"2023-07-27T20:33:01.746431+0000","last_peered":"2023-07-27T20:33:01.746431+0000","last_clean":"2023-07-27T20:33:01.746431+0000","last_became_active":"2023-07-27T20:32:59.585008+0000","last_became_peered":"2023-07-27T20:32:59.585008+0000","last_unstale":"2023-07-27T20:33:01.746431+0000","last_undegraded":"2023-07-27T20:33:01.746431+0000","last_fullsized":"2023-07-27T20:33:01.746431+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:14:26.844155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.746014+0000","last_change":"2023-07-27T20:33:00.588162+0000","last_active":"2023-07-27T20:33:01.746014+0000","last_peered":"2023-07-27T20:33:01.746014+0000","last_clean":"2023-07-27T20:33:01.746014+0000","last_became_active":"2023-07-27T20:33:00.587546+0000","last_became_peered":"2023-07-27T20:33:00.587546+0000","last_unstale":"2023-07-27T20:33:01.746014+0000","last_undegraded":"2023-07-27T20:33:01.746014+0000","last_fullsized":"2023-07-27T20:33:01.746014+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:17:35.471819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.746341+0000","last_change":"2023-07-27T20:32:59.581014+0000","last_active":"2023-07-27T20:33:01.746341+0000","last_peered":"2023-07-27T20:33:01.746341+0000","last_clean":"2023-07-27T20:33:01.746341+0000","last_became_active":"2023-07-27T20:32:59.580563+0000","last_became_peered":"2023-07-27T20:32:59.580563+0000","last_unstale":"2023-07-27T20:33:01.746341+0000","last_undegraded":"2023-07-27T20:33:01.746341+0000","last_fullsized":"2023-07-27T20:33:01.746341+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:17:47.165420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.872566+0000","last_change":"2023-07-27T20:33:00.585619+0000","last_active":"2023-07-27T20:33:01.872566+0000","last_peered":"2023-07-27T20:33:01.872566+0000","last_clean":"2023-07-27T20:33:01.872566+0000","last_became_active":"2023-07-27T20:33:00.585362+0000","last_became_peered":"2023-07-27T20:33:00.585362+0000","last_unstale":"2023-07-27T20:33:01.872566+0000","last_undegraded":"2023-07-27T20:33:01.872566+0000","last_fullsized":"2023-07-27T20:33:01.872566+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:20:34.814310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582217+0000","last_change":"2023-07-27T20:32:59.583381+0000","last_active":"2023-07-27T20:33:01.582217+0000","last_peered":"2023-07-27T20:33:01.582217+0000","last_clean":"2023-07-27T20:33:01.582217+0000","last_became_active":"2023-07-27T20:32:59.582911+0000","last_became_peered":"2023-07-27T20:32:59.582911+0000","last_unstale":"2023-07-27T20:33:01.582217+0000","last_undegraded":"2023-07-27T20:33:01.582217+0000","last_fullsized":"2023-07-27T20:33:01.582217+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:05:39.044767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.922178+0000","last_change":"2023-07-27T20:33:00.580697+0000","last_active":"2023-07-27T20:33:01.922178+0000","last_peered":"2023-07-27T20:33:01.922178+0000","last_clean":"2023-07-27T20:33:01.922178+0000","last_became_active":"2023-07-27T20:33:00.580386+0000","last_became_peered":"2023-07-27T20:33:00.580386+0000","last_unstale":"2023-07-27T20:33:01.922178+0000","last_undegraded":"2023-07-27T20:33:01.922178+0000","last_fullsized":"2023-07-27T20:33:01.922178+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:57:26.752625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.581154+0000","last_change":"2023-07-27T20:32:59.577740+0000","last_active":"2023-07-27T20:33:01.581154+0000","last_peered":"2023-07-27T20:33:01.581154+0000","last_clean":"2023-07-27T20:33:01.581154+0000","last_became_active":"2023-07-27T20:32:59.577456+0000","last_became_peered":"2023-07-27T20:32:59.577456+0000","last_unstale":"2023-07-27T20:33:01.581154+0000","last_undegraded":"2023-07-27T20:33:01.581154+0000","last_fullsized":"2023-07-27T20:33:01.581154+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:27:37.589694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.581117+0000","last_change":"2023-07-27T20:33:00.583933+0000","last_active":"2023-07-27T20:33:01.581117+0000","last_peered":"2023-07-27T20:33:01.581117+0000","last_clean":"2023-07-27T20:33:01.581117+0000","last_became_active":"2023-07-27T20:33:00.583598+0000","last_became_peered":"2023-07-27T20:33:00.583598+0000","last_unstale":"2023-07-27T20:33:01.581117+0000","last_undegraded":"2023-07-27T20:33:01.581117+0000","last_fullsized":"2023-07-27T20:33:01.581117+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:01:21.270310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582119+0000","last_change":"2023-07-27T20:32:59.581455+0000","last_active":"2023-07-27T20:33:01.582119+0000","last_peered":"2023-07-27T20:33:01.582119+0000","last_clean":"2023-07-27T20:33:01.582119+0000","last_became_active":"2023-07-27T20:32:59.579901+0000","last_became_peered":"2023-07-27T20:32:59.579901+0000","last_unstale":"2023-07-27T20:33:01.582119+0000","last_undegraded":"2023-07-27T20:33:01.582119+0000","last_fullsized":"2023-07-27T20:33:01.582119+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:41:08.590077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.750694+0000","last_change":"2023-07-27T20:33:00.588668+0000","last_active":"2023-07-27T20:33:01.750694+0000","last_peered":"2023-07-27T20:33:01.750694+0000","last_clean":"2023-07-27T20:33:01.750694+0000","last_became_active":"2023-07-27T20:33:00.588375+0000","last_became_peered":"2023-07-27T20:33:00.588375+0000","last_unstale":"2023-07-27T20:33:01.750694+0000","last_undegraded":"2023-07-27T20:33:01.750694+0000","last_fullsized":"2023-07-27T20:33:01.750694+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:47:02.186816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.581339+0000","last_change":"2023-07-27T20:32:59.581609+0000","last_active":"2023-07-27T20:33:01.581339+0000","last_peered":"2023-07-27T20:33:01.581339+0000","last_clean":"2023-07-27T20:33:01.581339+0000","last_became_active":"2023-07-27T20:32:59.580643+0000","last_became_peered":"2023-07-27T20:32:59.580643+0000","last_unstale":"2023-07-27T20:33:01.581339+0000","last_undegraded":"2023-07-27T20:33:01.581339+0000","last_fullsized":"2023-07-27T20:33:01.581339+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:55:27.482074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.872536+0000","last_change":"2023-07-27T20:31:22.848698+0000","last_active":"2023-07-27T20:33:01.872536+0000","last_peered":"2023-07-27T20:33:01.872536+0000","last_clean":"2023-07-27T20:33:01.872536+0000","last_became_active":"2023-07-27T20:31:22.848346+0000","last_became_peered":"2023-07-27T20:31:22.848346+0000","last_unstale":"2023-07-27T20:33:01.872536+0000","last_undegraded":"2023-07-27T20:33:01.872536+0000","last_fullsized":"2023-07-27T20:33:01.872536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:32:10.101989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:02.477695+0000","last_change":"2023-07-27T20:33:00.594284+0000","last_active":"2023-07-27T20:33:02.477695+0000","last_peered":"2023-07-27T20:33:02.477695+0000","last_clean":"2023-07-27T20:33:02.477695+0000","last_became_active":"2023-07-27T20:33:00.593915+0000","last_became_peered":"2023-07-27T20:33:00.593915+0000","last_unstale":"2023-07-27T20:33:02.477695+0000","last_undegraded":"2023-07-27T20:33:02.477695+0000","last_fullsized":"2023-07-27T20:33:02.477695+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:32:44.944176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"41'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.746564+0000","last_change":"2023-07-27T20:32:59.579071+0000","last_active":"2023-07-27T20:33:01.746564+0000","last_peered":"2023-07-27T20:33:01.746564+0000","last_clean":"2023-07-27T20:33:01.746564+0000","last_became_active":"2023-07-27T20:32:59.578792+0000","last_became_peered":"2023-07-27T20:32:59.578792+0000","last_unstale":"2023-07-27T20:33:01.746564+0000","last_undegraded":"2023-07-27T20:33:01.746564+0000","last_fullsized":"2023-07-27T20:33:01.746564+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:53:15.992800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582430+0000","last_change":"2023-07-27T20:31:22.849178+0000","last_active":"2023-07-27T20:33:01.582430+0000","last_peered":"2023-07-27T20:33:01.582430+0000","last_clean":"2023-07-27T20:33:01.582430+0000","last_became_active":"2023-07-27T20:31:22.848856+0000","last_became_peered":"2023-07-27T20:31:22.848856+0000","last_unstale":"2023-07-27T20:33:01.582430+0000","last_undegraded":"2023-07-27T20:33:01.582430+0000","last_fullsized":"2023-07-27T20:33:01.582430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:18:13.904765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.581692+0000","last_change":"2023-07-27T20:33:00.572709+0000","last_active":"2023-07-27T20:33:01.581692+0000","last_peered":"2023-07-27T20:33:01.581692+0000","last_clean":"2023-07-27T20:33:01.581692+0000","last_became_active":"2023-07-27T20:33:00.572428+0000","last_became_peered":"2023-07-27T20:33:00.572428+0000","last_unstale":"2023-07-27T20:33:01.581692+0000","last_undegraded":"2023-07-27T20:33:01.581692+0000","last_fullsized":"2023-07-27T20:33:01.581692+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:16:47.190935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.583223+0000","last_change":"2023-07-27T20:32:59.579248+0000","last_active":"2023-07-27T20:33:01.583223+0000","last_peered":"2023-07-27T20:33:01.583223+0000","last_clean":"2023-07-27T20:33:01.583223+0000","last_became_active":"2023-07-27T20:32:59.578926+0000","last_became_peered":"2023-07-27T20:32:59.578926+0000","last_unstale":"2023-07-27T20:33:01.583223+0000","last_undegraded":"2023-07-27T20:33:01.583223+0000","last_fullsized":"2023-07-27T20:33:01.583223+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:03:21.445052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.922102+0000","last_change":"2023-07-27T20:31:22.959811+0000","last_active":"2023-07-27T20:33:01.922102+0000","last_peered":"2023-07-27T20:33:01.922102+0000","last_clean":"2023-07-27T20:33:01.922102+0000","last_became_active":"2023-07-27T20:31:22.959449+0000","last_became_peered":"2023-07-27T20:31:22.959449+0000","last_unstale":"2023-07-27T20:33:01.922102+0000","last_undegraded":"2023-07-27T20:33:01.922102+0000","last_fullsized":"2023-07-27T20:33:01.922102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:22:35.775094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.581932+0000","last_change":"2023-07-27T20:33:00.581823+0000","last_active":"2023-07-27T20:33:01.581932+0000","last_peered":"2023-07-27T20:33:01.581932+0000","last_clean":"2023-07-27T20:33:01.581932+0000","last_became_active":"2023-07-27T20:33:00.581520+0000","last_became_peered":"2023-07-27T20:33:00.581520+0000","last_unstale":"2023-07-27T20:33:01.581932+0000","last_undegraded":"2023-07-27T20:33:01.581932+0000","last_fullsized":"2023-07-27T20:33:01.581932+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:17:35.471819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582987+0000","last_change":"2023-07-27T20:32:59.585447+0000","last_active":"2023-07-27T20:33:01.582987+0000","last_peered":"2023-07-27T20:33:01.582987+0000","last_clean":"2023-07-27T20:33:01.582987+0000","last_became_active":"2023-07-27T20:32:59.585172+0000","last_became_peered":"2023-07-27T20:32:59.585172+0000","last_unstale":"2023-07-27T20:33:01.582987+0000","last_undegraded":"2023-07-27T20:33:01.582987+0000","last_fullsized":"2023-07-27T20:33:01.582987+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:37:49.361054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582535+0000","last_change":"2023-07-27T20:31:22.847766+0000","last_active":"2023-07-27T20:33:01.582535+0000","last_peered":"2023-07-27T20:33:01.582535+0000","last_clean":"2023-07-27T20:33:01.582535+0000","last_became_active":"2023-07-27T20:31:22.847396+0000","last_became_peered":"2023-07-27T20:31:22.847396+0000","last_unstale":"2023-07-27T20:33:01.582535+0000","last_undegraded":"2023-07-27T20:33:01.582535+0000","last_fullsized":"2023-07-27T20:33:01.582535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:59:43.538201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":207,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582376+0000","last_change":"2023-07-27T20:31:15.812727+0000","last_active":"2023-07-27T20:33:01.582376+0000","last_peered":"2023-07-27T20:33:01.582376+0000","last_clean":"2023-07-27T20:33:01.582376+0000","last_became_active":"2023-07-27T20:31:15.811803+0000","last_became_peered":"2023-07-27T20:31:15.811803+0000","last_unstale":"2023-07-27T20:33:01.582376+0000","last_undegraded":"2023-07-27T20:33:01.582376+0000","last_fullsized":"2023-07-27T20:33:01.582376+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:14.789257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:14.789257+0000","last_clean_scrub_stamp":"2023-07-27T20:31:14.789257+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:36:05.604430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.583051+0000","last_change":"2023-07-27T20:33:00.590390+0000","last_active":"2023-07-27T20:33:01.583051+0000","last_peered":"2023-07-27T20:33:01.583051+0000","last_clean":"2023-07-27T20:33:01.583051+0000","last_became_active":"2023-07-27T20:33:00.590070+0000","last_became_peered":"2023-07-27T20:33:00.590070+0000","last_unstale":"2023-07-27T20:33:01.583051+0000","last_undegraded":"2023-07-27T20:33:01.583051+0000","last_fullsized":"2023-07-27T20:33:01.583051+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:17:35.471819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.872440+0000","last_change":"2023-07-27T20:32:59.584665+0000","last_active":"2023-07-27T20:33:01.872440+0000","last_peered":"2023-07-27T20:33:01.872440+0000","last_clean":"2023-07-27T20:33:01.872440+0000","last_became_active":"2023-07-27T20:32:59.584357+0000","last_became_peered":"2023-07-27T20:32:59.584357+0000","last_unstale":"2023-07-27T20:33:01.872440+0000","last_undegraded":"2023-07-27T20:33:01.872440+0000","last_fullsized":"2023-07-27T20:33:01.872440+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:09:26.178628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582528+0000","last_change":"2023-07-27T20:31:22.848181+0000","last_active":"2023-07-27T20:33:01.582528+0000","last_peered":"2023-07-27T20:33:01.582528+0000","last_clean":"2023-07-27T20:33:01.582528+0000","last_became_active":"2023-07-27T20:31:22.847865+0000","last_became_peered":"2023-07-27T20:31:22.847865+0000","last_unstale":"2023-07-27T20:33:01.582528+0000","last_undegraded":"2023-07-27T20:33:01.582528+0000","last_fullsized":"2023-07-27T20:33:01.582528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:25:37.293707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582036+0000","last_change":"2023-07-27T20:33:00.590893+0000","last_active":"2023-07-27T20:33:01.582036+0000","last_peered":"2023-07-27T20:33:01.582036+0000","last_clean":"2023-07-27T20:33:01.582036+0000","last_became_active":"2023-07-27T20:33:00.590559+0000","last_became_peered":"2023-07-27T20:33:00.590559+0000","last_unstale":"2023-07-27T20:33:01.582036+0000","last_undegraded":"2023-07-27T20:33:01.582036+0000","last_fullsized":"2023-07-27T20:33:01.582036+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:04:16.885923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.872403+0000","last_change":"2023-07-27T20:32:59.579303+0000","last_active":"2023-07-27T20:33:01.872403+0000","last_peered":"2023-07-27T20:33:01.872403+0000","last_clean":"2023-07-27T20:33:01.872403+0000","last_became_active":"2023-07-27T20:32:59.579015+0000","last_became_peered":"2023-07-27T20:32:59.579015+0000","last_unstale":"2023-07-27T20:33:01.872403+0000","last_undegraded":"2023-07-27T20:33:01.872403+0000","last_fullsized":"2023-07-27T20:33:01.872403+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:34:01.141411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.583237+0000","last_change":"2023-07-27T20:31:22.848025+0000","last_active":"2023-07-27T20:33:01.583237+0000","last_peered":"2023-07-27T20:33:01.583237+0000","last_clean":"2023-07-27T20:33:01.583237+0000","last_became_active":"2023-07-27T20:31:22.847603+0000","last_became_peered":"2023-07-27T20:31:22.847603+0000","last_unstale":"2023-07-27T20:33:01.583237+0000","last_undegraded":"2023-07-27T20:33:01.583237+0000","last_fullsized":"2023-07-27T20:33:01.583237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:35:21.562826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.746184+0000","last_change":"2023-07-27T20:33:00.586803+0000","last_active":"2023-07-27T20:33:01.746184+0000","last_peered":"2023-07-27T20:33:01.746184+0000","last_clean":"2023-07-27T20:33:01.746184+0000","last_became_active":"2023-07-27T20:33:00.586523+0000","last_became_peered":"2023-07-27T20:33:00.586523+0000","last_unstale":"2023-07-27T20:33:01.746184+0000","last_undegraded":"2023-07-27T20:33:01.746184+0000","last_fullsized":"2023-07-27T20:33:01.746184+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:01:37.390164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.750840+0000","last_change":"2023-07-27T20:32:59.586199+0000","last_active":"2023-07-27T20:33:01.750840+0000","last_peered":"2023-07-27T20:33:01.750840+0000","last_clean":"2023-07-27T20:33:01.750840+0000","last_became_active":"2023-07-27T20:32:59.585937+0000","last_became_peered":"2023-07-27T20:32:59.585937+0000","last_unstale":"2023-07-27T20:33:01.750840+0000","last_undegraded":"2023-07-27T20:33:01.750840+0000","last_fullsized":"2023-07-27T20:33:01.750840+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:33:27.775453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.872677+0000","last_change":"2023-07-27T20:31:22.845641+0000","last_active":"2023-07-27T20:33:01.872677+0000","last_peered":"2023-07-27T20:33:01.872677+0000","last_clean":"2023-07-27T20:33:01.872677+0000","last_became_active":"2023-07-27T20:31:22.845368+0000","last_became_peered":"2023-07-27T20:31:22.845368+0000","last_unstale":"2023-07-27T20:33:01.872677+0000","last_undegraded":"2023-07-27T20:33:01.872677+0000","last_fullsized":"2023-07-27T20:33:01.872677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:41:43.700532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.746195+0000","last_change":"2023-07-27T20:33:00.587812+0000","last_active":"2023-07-27T20:33:01.746195+0000","last_peered":"2023-07-27T20:33:01.746195+0000","last_clean":"2023-07-27T20:33:01.746195+0000","last_became_active":"2023-07-27T20:33:00.587294+0000","last_became_peered":"2023-07-27T20:33:00.587294+0000","last_unstale":"2023-07-27T20:33:01.746195+0000","last_undegraded":"2023-07-27T20:33:01.746195+0000","last_fullsized":"2023-07-27T20:33:01.746195+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:12:28.115055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582956+0000","last_change":"2023-07-27T20:32:59.579629+0000","last_active":"2023-07-27T20:33:01.582956+0000","last_peered":"2023-07-27T20:33:01.582956+0000","last_clean":"2023-07-27T20:33:01.582956+0000","last_became_active":"2023-07-27T20:32:59.579376+0000","last_became_peered":"2023-07-27T20:32:59.579376+0000","last_unstale":"2023-07-27T20:33:01.582956+0000","last_undegraded":"2023-07-27T20:33:01.582956+0000","last_fullsized":"2023-07-27T20:33:01.582956+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:38:33.844373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:02.477896+0000","last_change":"2023-07-27T20:31:22.846540+0000","last_active":"2023-07-27T20:33:02.477896+0000","last_peered":"2023-07-27T20:33:02.477896+0000","last_clean":"2023-07-27T20:33:02.477896+0000","last_became_active":"2023-07-27T20:31:22.846128+0000","last_became_peered":"2023-07-27T20:31:22.846128+0000","last_unstale":"2023-07-27T20:33:02.477896+0000","last_undegraded":"2023-07-27T20:33:02.477896+0000","last_fullsized":"2023-07-27T20:33:02.477896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:07:19.416757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343768,"statfs":{"total":96636764160,"available":96608018432,"internally_reserved":0,"allocated":1073152,"data_stored":803246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":3.5609999999999999,"5min":3.5609999999999999,"15min":3.5609999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":1.0620000000000001}]},{"osd":1,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":3.927,"5min":3.927,"15min":3.927},"last":0.86399999999999999}]},{"osd":2,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.1589999999999998,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":0.84099999999999997}]},{"osd":3,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.4239999999999999,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":3.1080000000000001,"5min":3.1080000000000001,"15min":3.1080000000000001},"last":0.80400000000000005}]},{"osd":4,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.2730000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.88300000000000001}]},{"osd":5,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":6.1619999999999999,"5min":6.1619999999999999,"15min":6.1619999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":6.2729999999999997,"5min":6.2729999999999997,"15min":6.2729999999999997},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.018},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":3.5289999999999999,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":0.77100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":213460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.63200000000000001}]},{"osd":1,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.56599999999999995}]},{"osd":2,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.69199999999999995}]},{"osd":3,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":0.74199999999999999}]},{"osd":4,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.81000000000000005}]},{"osd":5,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.59699999999999998}]},{"osd":7,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.82499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":212858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.39700000000000002}]},{"osd":2,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.496},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.59799999999999998}]},{"osd":5,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.66200000000000003}]},{"osd":7,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.61399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343768,"statfs":{"total":96636764160,"available":96608018432,"internally_reserved":0,"allocated":1073152,"data_stored":803190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.46000000000000002}]},{"osd":2,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.42899999999999999}]},{"osd":3,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.65600000000000003}]},{"osd":5,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.64500000000000002}]},{"osd":6,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.749}]},{"osd":7,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.71699999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":491520,"data_stored":214374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":3.2999999999999998,"5min":3.2999999999999998,"15min":3.2999999999999998},"last":0.35999999999999999}]},{"osd":1,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":3.0600000000000001,"5min":3.0600000000000001,"15min":3.0600000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":3.4580000000000002,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.45100000000000001}]},{"osd":3,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":9.2200000000000006,"5min":9.2200000000000006,"15min":9.2200000000000006},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":4.2930000000000001,"5min":4.2930000000000001,"15min":4.2930000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.65600000000000003}]},{"osd":5,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.64800000000000002}]},{"osd":6,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":3.3999999999999999,"5min":3.3999999999999999,"15min":3.3999999999999999},"last":0.747},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":3.4990000000000001,"5min":3.4990000000000001,"15min":3.4990000000000001},"last":0.68200000000000005}]},{"osd":7,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.77400000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":487424,"data_stored":213426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":2.1480000000000001,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Jul 27 20:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Jul 27 20:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.45400000000000001}]},{"osd":4,"last update":"Thu Jul 27 20:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.63},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.60499999999999998}]},{"osd":5,"last update":"Thu Jul 27 20:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.57599999999999996}]},{"osd":6,"last update":"Thu Jul 27 20:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.80700000000000005}]},{"osd":7,"last update":"Thu Jul 27 20:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.59299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":487424,"data_stored":214352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.621},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.66300000000000003}]},{"osd":1,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.73199999999999998}]},{"osd":2,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.68200000000000005}]},{"osd":3,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.751},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.79300000000000004}]},{"osd":5,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.45800000000000002}]},{"osd":6,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.48399999999999999}]},{"osd":7,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.77600000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":212858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.72099999999999997}]},{"osd":1,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.73899999999999999}]},{"osd":2,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.84699999999999998}]},{"osd":3,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.875}]},{"osd":4,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.80100000000000005}]},{"osd":6,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.66600000000000004}]},{"osd":7,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.754}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T20:33:09.868 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T20:33:10.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.089+0000 7f1c021ff700 1 Processor -- start 2023-07-27T20:33:10.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.089+0000 7f1c021ff700 1 -- start start 2023-07-27T20:33:10.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.090+0000 7f1c021ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1bfc0c4400 0x7f1bfc0c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:10.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.090+0000 7f1c021ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1bfc06b150 0x7f1bfc0c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:10.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.090+0000 7f1c021ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bfc1549f0 0x7f1bfc1514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:10.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.090+0000 7f1c021ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bfc1545d0 con 0x7f1bfc0c4400 2023-07-27T20:33:10.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.090+0000 7f1c021ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bfc06c860 con 0x7f1bfc06b150 2023-07-27T20:33:10.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.090+0000 7f1c021ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc0c5230 con 0x7f1bfc1549f0 2023-07-27T20:33:10.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.090+0000 7f1bfb7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1bfc0c4400 0x7f1bfc0c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:10.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.091+0000 7f1bfb7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1bfc0c4400 0x7f1bfc0c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57596/0 (socket says 172.21.15.72:57596) 2023-07-27T20:33:10.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.091+0000 7f1bfb7fe700 1 -- 172.21.15.72:0/3582377258 learned_addr learned my addr 172.21.15.72:0/3582377258 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:10.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.091+0000 7f1bfaffd700 1 --2- 172.21.15.72:0/3582377258 >> v2:172.21.15.173:3300/0 conn(0x7f1bfc06b150 0x7f1bfc0c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:10.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.091+0000 7f1bfbfff700 1 --2- 172.21.15.72:0/3582377258 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bfc1549f0 0x7f1bfc1514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:10.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.091+0000 7f1bfb7fe700 1 -- 172.21.15.72:0/3582377258 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bfc1549f0 msgr2=0x7f1bfc1514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:10.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.091+0000 7f1bfb7fe700 1 --2- 172.21.15.72:0/3582377258 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bfc1549f0 0x7f1bfc1514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:10.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.091+0000 7f1bfb7fe700 1 -- 172.21.15.72:0/3582377258 >> v2:172.21.15.173:3300/0 conn(0x7f1bfc06b150 msgr2=0x7f1bfc0c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:10.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.091+0000 7f1bfb7fe700 1 --2- 172.21.15.72:0/3582377258 >> v2:172.21.15.173:3300/0 conn(0x7f1bfc06b150 0x7f1bfc0c4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:10.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.091+0000 7f1bfb7fe700 1 -- 172.21.15.72:0/3582377258 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bfc06b710 con 0x7f1bfc0c4400 2023-07-27T20:33:10.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.091+0000 7f1bfb7fe700 1 --2- 172.21.15.72:0/3582377258 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bfc0c4400 0x7f1bfc0c7710 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc0c0870 tx=0x7f1bec009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d03f8664b445bac server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:10.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.091+0000 7f1bfa7fc700 1 -- 172.21.15.72:0/3582377258 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec00b870 con 0x7f1bfc0c4400 2023-07-27T20:33:10.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.091+0000 7f1bfa7fc700 1 -- 172.21.15.72:0/3582377258 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bec00b9d0 con 0x7f1bfc0c4400 2023-07-27T20:33:10.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.091+0000 7f1bfa7fc700 1 -- 172.21.15.72:0/3582377258 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec00bd60 con 0x7f1bfc0c4400 2023-07-27T20:33:10.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.092+0000 7f1c021ff700 1 -- 172.21.15.72:0/3582377258 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bfc0c4400 msgr2=0x7f1bfc0c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:10.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.092+0000 7f1c021ff700 1 --2- 172.21.15.72:0/3582377258 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bfc0c4400 0x7f1bfc0c7710 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc0c0870 tx=0x7f1bec009bd0 comp rx=0 tx=0).stop 2023-07-27T20:33:10.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.092+0000 7f1c021ff700 1 -- 172.21.15.72:0/3582377258 shutdown_connections 2023-07-27T20:33:10.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.092+0000 7f1c021ff700 1 --2- 172.21.15.72:0/3582377258 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bfc1549f0 0x7f1bfc1514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:10.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.092+0000 7f1c021ff700 1 --2- 172.21.15.72:0/3582377258 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bfc0c4400 0x7f1bfc0c7710 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:10.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.092+0000 7f1c021ff700 1 --2- 172.21.15.72:0/3582377258 >> v2:172.21.15.173:3300/0 conn(0x7f1bfc06b150 0x7f1bfc0c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:10.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.092+0000 7f1c021ff700 1 -- 172.21.15.72:0/3582377258 >> 172.21.15.72:0/3582377258 conn(0x7f1bfc0ab300 msgr2=0x7f1bfc0ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:10.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.092+0000 7f1c021ff700 1 -- 172.21.15.72:0/3582377258 shutdown_connections 2023-07-27T20:33:10.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.092+0000 7f1c021ff700 1 -- 172.21.15.72:0/3582377258 wait complete. 2023-07-27T20:33:10.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.094+0000 7f1c021ff700 1 Processor -- start 2023-07-27T20:33:10.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.095+0000 7f1c021ff700 1 -- start start 2023-07-27T20:33:10.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.096+0000 7f1c021ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bfc06b150 0x7f1bfc149da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:10.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.096+0000 7f1c021ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bfc0c4400 0x7f1bfc0c1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:10.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.096+0000 7f1c021ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bfc1549f0 0x7f1bfc0aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:10.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.096+0000 7f1c021ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc14dc00 con 0x7f1bfc1549f0 2023-07-27T20:33:10.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.096+0000 7f1c021ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc0c2300 con 0x7f1bfc0c4400 2023-07-27T20:33:10.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.096+0000 7f1c021ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc14c440 con 0x7f1bfc06b150 2023-07-27T20:33:10.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.096+0000 7f1bfbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bfc1549f0 0x7f1bfc0aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:10.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.096+0000 7f1bfbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bfc1549f0 0x7f1bfc0aea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57612/0 (socket says 172.21.15.72:57612) 2023-07-27T20:33:10.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.096+0000 7f1bfbfff700 1 -- 172.21.15.72:0/1453363606 learned_addr learned my addr 172.21.15.72:0/1453363606 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:10.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.096+0000 7f1bfb7fe700 1 --2- 172.21.15.72:0/1453363606 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bfc06b150 0x7f1bfc149da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:10.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.096+0000 7f1bfaffd700 1 --2- 172.21.15.72:0/1453363606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bfc0c4400 0x7f1bfc0c1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:10.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.096+0000 7f1bfbfff700 1 -- 172.21.15.72:0/1453363606 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bfc06b150 msgr2=0x7f1bfc149da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:10.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.096+0000 7f1bfbfff700 1 --2- 172.21.15.72:0/1453363606 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bfc06b150 0x7f1bfc149da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:10.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.096+0000 7f1bfbfff700 1 -- 172.21.15.72:0/1453363606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bfc0c4400 msgr2=0x7f1bfc0c1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:10.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.096+0000 7f1bfbfff700 1 --2- 172.21.15.72:0/1453363606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bfc0c4400 0x7f1bfc0c1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:10.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.096+0000 7f1bfbfff700 1 -- 172.21.15.72:0/1453363606 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bec009550 con 0x7f1bfc1549f0 2023-07-27T20:33:10.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.097+0000 7f1bfbfff700 1 --2- 172.21.15.72:0/1453363606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bfc1549f0 0x7f1bfc0aea80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4007e90 tx=0x7f1bf400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:10.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.097+0000 7f1be3fff700 1 -- 172.21.15.72:0/1453363606 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf400ed30 con 0x7f1bfc1549f0 2023-07-27T20:33:10.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.097+0000 7f1be3fff700 1 -- 172.21.15.72:0/1453363606 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf400ee90 con 0x7f1bfc1549f0 2023-07-27T20:33:10.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.097+0000 7f1be3fff700 1 -- 172.21.15.72:0/1453363606 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf4014660 con 0x7f1bfc1549f0 2023-07-27T20:33:10.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.097+0000 7f1c021ff700 1 -- 172.21.15.72:0/1453363606 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bfc149ac0 con 0x7f1bfc1549f0 2023-07-27T20:33:10.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.097+0000 7f1c021ff700 1 -- 172.21.15.72:0/1453363606 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bfc0aefc0 con 0x7f1bfc1549f0 2023-07-27T20:33:10.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.098+0000 7f1c021ff700 1 -- 172.21.15.72:0/1453363606 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bfc0c1ae0 con 0x7f1bfc1549f0 2023-07-27T20:33:10.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.099+0000 7f1be3fff700 1 -- 172.21.15.72:0/1453363606 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1bf40147c0 con 0x7f1bfc1549f0 2023-07-27T20:33:10.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.100+0000 7f1be3fff700 1 --2- 172.21.15.72:0/1453363606 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1be806ace0 0x7f1be806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:10.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.100+0000 7f1be3fff700 1 -- 172.21.15.72:0/1453363606 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1bf4089bd0 con 0x7f1bfc1549f0 2023-07-27T20:33:10.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.100+0000 7f1bfb7fe700 1 --2- 172.21.15.72:0/1453363606 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1be806ace0 0x7f1be806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:10.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.101+0000 7f1bfb7fe700 1 --2- 172.21.15.72:0/1453363606 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1be806ace0 0x7f1be806d1a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1bec000c00 tx=0x7f1bec008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:10.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.104+0000 7f1be3fff700 1 -- 172.21.15.72:0/1453363606 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1bf4054be0 con 0x7f1bfc1549f0 2023-07-27T20:33:10.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.298+0000 7f1c021ff700 1 -- 172.21.15.72:0/1453363606 --> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1bfc14c2c0 con 0x7f1be806ace0 2023-07-27T20:33:10.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.307+0000 7f1be3fff700 1 -- 172.21.15.72:0/1453363606 <== mgr.4107 v2:172.21.15.173:6832/910681537 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310895 (secure 0 0 0) 0x7f1bec00bb40 con 0x7f1be806ace0 2023-07-27T20:33:10.298 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:33:10.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.311+0000 7f1c021ff700 1 -- 172.21.15.72:0/1453363606 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1be806ace0 msgr2=0x7f1be806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:10.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.312+0000 7f1c021ff700 1 --2- 172.21.15.72:0/1453363606 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1be806ace0 0x7f1be806d1a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1bec000c00 tx=0x7f1bec008030 comp rx=0 tx=0).stop 2023-07-27T20:33:10.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.312+0000 7f1c021ff700 1 -- 172.21.15.72:0/1453363606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bfc1549f0 msgr2=0x7f1bfc0aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:10.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.312+0000 7f1c021ff700 1 --2- 172.21.15.72:0/1453363606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bfc1549f0 0x7f1bfc0aea80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4007e90 tx=0x7f1bf400e3c0 comp rx=0 tx=0).stop 2023-07-27T20:33:10.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.312+0000 7f1c021ff700 1 -- 172.21.15.72:0/1453363606 shutdown_connections 2023-07-27T20:33:10.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.312+0000 7f1c021ff700 1 --2- 172.21.15.72:0/1453363606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bfc1549f0 0x7f1bfc0aea80 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:10.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.312+0000 7f1c021ff700 1 --2- 172.21.15.72:0/1453363606 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1be806ace0 0x7f1be806d1a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:10.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.312+0000 7f1c021ff700 1 --2- 172.21.15.72:0/1453363606 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bfc06b150 0x7f1bfc149da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:10.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.312+0000 7f1c021ff700 1 --2- 172.21.15.72:0/1453363606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bfc0c4400 0x7f1bfc0c1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:10.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.312+0000 7f1c021ff700 1 -- 172.21.15.72:0/1453363606 >> 172.21.15.72:0/1453363606 conn(0x7f1bfc0ab300 msgr2=0x7f1bfc151c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:10.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.312+0000 7f1c021ff700 1 -- 172.21.15.72:0/1453363606 shutdown_connections 2023-07-27T20:33:10.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.312+0000 7f1c021ff700 1 -- 172.21.15.72:0/1453363606 wait complete. 2023-07-27T20:33:10.304 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-07-27T20:33:10.317 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2023-07-27T20:33:10.116646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221128,"kb_used_data":4936,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753592,"statfs":{"total":773094113280,"available":772867678208,"internally_reserved":0,"allocated":5054464,"data_stored":2887764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.550648"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582690+0000","last_change":"2023-07-27T20:33:00.583515+0000","last_active":"2023-07-27T20:33:01.582690+0000","last_peered":"2023-07-27T20:33:01.582690+0000","last_clean":"2023-07-27T20:33:01.582690+0000","last_became_active":"2023-07-27T20:33:00.583261+0000","last_became_peered":"2023-07-27T20:33:00.583261+0000","last_unstale":"2023-07-27T20:33:01.582690+0000","last_undegraded":"2023-07-27T20:33:01.582690+0000","last_fullsized":"2023-07-27T20:33:01.582690+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:49:17.774438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582730+0000","last_change":"2023-07-27T20:33:00.590019+0000","last_active":"2023-07-27T20:33:01.582730+0000","last_peered":"2023-07-27T20:33:01.582730+0000","last_clean":"2023-07-27T20:33:01.582730+0000","last_became_active":"2023-07-27T20:33:00.589674+0000","last_became_peered":"2023-07-27T20:33:00.589674+0000","last_unstale":"2023-07-27T20:33:01.582730+0000","last_undegraded":"2023-07-27T20:33:01.582730+0000","last_fullsized":"2023-07-27T20:33:01.582730+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:01:27.768802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.750888+0000","last_change":"2023-07-27T20:33:00.581650+0000","last_active":"2023-07-27T20:33:01.750888+0000","last_peered":"2023-07-27T20:33:01.750888+0000","last_clean":"2023-07-27T20:33:01.750888+0000","last_became_active":"2023-07-27T20:33:00.581308+0000","last_became_peered":"2023-07-27T20:33:00.581308+0000","last_unstale":"2023-07-27T20:33:01.750888+0000","last_undegraded":"2023-07-27T20:33:01.750888+0000","last_fullsized":"2023-07-27T20:33:01.750888+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:19:38.220683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.581596+0000","last_change":"2023-07-27T20:33:00.597501+0000","last_active":"2023-07-27T20:33:01.581596+0000","last_peered":"2023-07-27T20:33:01.581596+0000","last_clean":"2023-07-27T20:33:01.581596+0000","last_became_active":"2023-07-27T20:33:00.594645+0000","last_became_peered":"2023-07-27T20:33:00.594645+0000","last_unstale":"2023-07-27T20:33:01.581596+0000","last_undegraded":"2023-07-27T20:33:01.581596+0000","last_fullsized":"2023-07-27T20:33:01.581596+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:37:32.256155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582809+0000","last_change":"2023-07-27T20:33:00.590369+0000","last_active":"2023-07-27T20:33:01.582809+0000","last_peered":"2023-07-27T20:33:01.582809+0000","last_clean":"2023-07-27T20:33:01.582809+0000","last_became_active":"2023-07-27T20:33:00.590016+0000","last_became_peered":"2023-07-27T20:33:00.590016+0000","last_unstale":"2023-07-27T20:33:01.582809+0000","last_undegraded":"2023-07-27T20:33:01.582809+0000","last_fullsized":"2023-07-27T20:33:01.582809+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:27:38.597006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.746059+0000","last_change":"2023-07-27T20:33:00.588002+0000","last_active":"2023-07-27T20:33:01.746059+0000","last_peered":"2023-07-27T20:33:01.746059+0000","last_clean":"2023-07-27T20:33:01.746059+0000","last_became_active":"2023-07-27T20:33:00.587552+0000","last_became_peered":"2023-07-27T20:33:00.587552+0000","last_unstale":"2023-07-27T20:33:01.746059+0000","last_undegraded":"2023-07-27T20:33:01.746059+0000","last_fullsized":"2023-07-27T20:33:01.746059+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:03:22.452364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582458+0000","last_change":"2023-07-27T20:33:00.592227+0000","last_active":"2023-07-27T20:33:01.582458+0000","last_peered":"2023-07-27T20:33:01.582458+0000","last_clean":"2023-07-27T20:33:01.582458+0000","last_became_active":"2023-07-27T20:33:00.591718+0000","last_became_peered":"2023-07-27T20:33:00.591718+0000","last_unstale":"2023-07-27T20:33:01.582458+0000","last_undegraded":"2023-07-27T20:33:01.582458+0000","last_fullsized":"2023-07-27T20:33:01.582458+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:30:40.022997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.581049+0000","last_change":"2023-07-27T20:33:00.599242+0000","last_active":"2023-07-27T20:33:01.581049+0000","last_peered":"2023-07-27T20:33:01.581049+0000","last_clean":"2023-07-27T20:33:01.581049+0000","last_became_active":"2023-07-27T20:33:00.598810+0000","last_became_peered":"2023-07-27T20:33:00.598810+0000","last_unstale":"2023-07-27T20:33:01.581049+0000","last_undegraded":"2023-07-27T20:33:01.581049+0000","last_fullsized":"2023-07-27T20:33:01.581049+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:19:51.636873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.581819+0000","last_change":"2023-07-27T20:33:00.583733+0000","last_active":"2023-07-27T20:33:01.581819+0000","last_peered":"2023-07-27T20:33:01.581819+0000","last_clean":"2023-07-27T20:33:01.581819+0000","last_became_active":"2023-07-27T20:33:00.583442+0000","last_became_peered":"2023-07-27T20:33:00.583442+0000","last_unstale":"2023-07-27T20:33:01.581819+0000","last_undegraded":"2023-07-27T20:33:01.581819+0000","last_fullsized":"2023-07-27T20:33:01.581819+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:38:34.851684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.581905+0000","last_change":"2023-07-27T20:33:00.594067+0000","last_active":"2023-07-27T20:33:01.581905+0000","last_peered":"2023-07-27T20:33:01.581905+0000","last_clean":"2023-07-27T20:33:01.581905+0000","last_became_active":"2023-07-27T20:33:00.593772+0000","last_became_peered":"2023-07-27T20:33:00.593772+0000","last_unstale":"2023-07-27T20:33:01.581905+0000","last_undegraded":"2023-07-27T20:33:01.581905+0000","last_fullsized":"2023-07-27T20:33:01.581905+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:53:00.572896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.581654+0000","last_change":"2023-07-27T20:33:00.584457+0000","last_active":"2023-07-27T20:33:01.581654+0000","last_peered":"2023-07-27T20:33:01.581654+0000","last_clean":"2023-07-27T20:33:01.581654+0000","last_became_active":"2023-07-27T20:33:00.584193+0000","last_became_peered":"2023-07-27T20:33:00.584193+0000","last_unstale":"2023-07-27T20:33:01.581654+0000","last_undegraded":"2023-07-27T20:33:01.581654+0000","last_fullsized":"2023-07-27T20:33:01.581654+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:16:32.940169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.583087+0000","last_change":"2023-07-27T20:33:00.594729+0000","last_active":"2023-07-27T20:33:01.583087+0000","last_peered":"2023-07-27T20:33:01.583087+0000","last_clean":"2023-07-27T20:33:01.583087+0000","last_became_active":"2023-07-27T20:33:00.594045+0000","last_became_peered":"2023-07-27T20:33:00.594045+0000","last_unstale":"2023-07-27T20:33:01.583087+0000","last_undegraded":"2023-07-27T20:33:01.583087+0000","last_fullsized":"2023-07-27T20:33:01.583087+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:30:40.022997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.922344+0000","last_change":"2023-07-27T20:33:00.592723+0000","last_active":"2023-07-27T20:33:01.922344+0000","last_peered":"2023-07-27T20:33:01.922344+0000","last_clean":"2023-07-27T20:33:01.922344+0000","last_became_active":"2023-07-27T20:33:00.592222+0000","last_became_peered":"2023-07-27T20:33:00.592222+0000","last_unstale":"2023-07-27T20:33:01.922344+0000","last_undegraded":"2023-07-27T20:33:01.922344+0000","last_fullsized":"2023-07-27T20:33:01.922344+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:19:44.081500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.581139+0000","last_change":"2023-07-27T20:33:00.585154+0000","last_active":"2023-07-27T20:33:01.581139+0000","last_peered":"2023-07-27T20:33:01.581139+0000","last_clean":"2023-07-27T20:33:01.581139+0000","last_became_active":"2023-07-27T20:33:00.584912+0000","last_became_peered":"2023-07-27T20:33:00.584912+0000","last_unstale":"2023-07-27T20:33:01.581139+0000","last_undegraded":"2023-07-27T20:33:01.581139+0000","last_fullsized":"2023-07-27T20:33:01.581139+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:01:27.768802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.746138+0000","last_change":"2023-07-27T20:33:00.585997+0000","last_active":"2023-07-27T20:33:01.746138+0000","last_peered":"2023-07-27T20:33:01.746138+0000","last_clean":"2023-07-27T20:33:01.746138+0000","last_became_active":"2023-07-27T20:33:00.585348+0000","last_became_peered":"2023-07-27T20:33:00.585348+0000","last_unstale":"2023-07-27T20:33:01.746138+0000","last_undegraded":"2023-07-27T20:33:01.746138+0000","last_fullsized":"2023-07-27T20:33:01.746138+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:36:59.294934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:02.477279+0000","last_change":"2023-07-27T20:33:00.594429+0000","last_active":"2023-07-27T20:33:02.477279+0000","last_peered":"2023-07-27T20:33:02.477279+0000","last_clean":"2023-07-27T20:33:02.477279+0000","last_became_active":"2023-07-27T20:33:00.593854+0000","last_became_peered":"2023-07-27T20:33:00.593854+0000","last_unstale":"2023-07-27T20:33:02.477279+0000","last_undegraded":"2023-07-27T20:33:02.477279+0000","last_fullsized":"2023-07-27T20:33:02.477279+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:18:16.230977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.750974+0000","last_change":"2023-07-27T20:33:00.582399+0000","last_active":"2023-07-27T20:33:01.750974+0000","last_peered":"2023-07-27T20:33:01.750974+0000","last_clean":"2023-07-27T20:33:01.750974+0000","last_became_active":"2023-07-27T20:33:00.582064+0000","last_became_peered":"2023-07-27T20:33:00.582064+0000","last_unstale":"2023-07-27T20:33:01.750974+0000","last_undegraded":"2023-07-27T20:33:01.750974+0000","last_fullsized":"2023-07-27T20:33:01.750974+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:30:37.916663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.750796+0000","last_change":"2023-07-27T20:33:00.572976+0000","last_active":"2023-07-27T20:33:01.750796+0000","last_peered":"2023-07-27T20:33:01.750796+0000","last_clean":"2023-07-27T20:33:01.750796+0000","last_became_active":"2023-07-27T20:33:00.572377+0000","last_became_peered":"2023-07-27T20:33:00.572377+0000","last_unstale":"2023-07-27T20:33:01.750796+0000","last_undegraded":"2023-07-27T20:33:01.750796+0000","last_fullsized":"2023-07-27T20:33:01.750796+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:38:09.922409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:02.477837+0000","last_change":"2023-07-27T20:33:00.595816+0000","last_active":"2023-07-27T20:33:02.477837+0000","last_peered":"2023-07-27T20:33:02.477837+0000","last_clean":"2023-07-27T20:33:02.477837+0000","last_became_active":"2023-07-27T20:33:00.595429+0000","last_became_peered":"2023-07-27T20:33:00.595429+0000","last_unstale":"2023-07-27T20:33:02.477837+0000","last_undegraded":"2023-07-27T20:33:02.477837+0000","last_fullsized":"2023-07-27T20:33:02.477837+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:01:47.469093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.922304+0000","last_change":"2023-07-27T20:33:00.593232+0000","last_active":"2023-07-27T20:33:01.922304+0000","last_peered":"2023-07-27T20:33:01.922304+0000","last_clean":"2023-07-27T20:33:01.922304+0000","last_became_active":"2023-07-27T20:33:00.592968+0000","last_became_peered":"2023-07-27T20:33:00.592968+0000","last_unstale":"2023-07-27T20:33:01.922304+0000","last_undegraded":"2023-07-27T20:33:01.922304+0000","last_fullsized":"2023-07-27T20:33:01.922304+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:00:33.389999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.746059+0000","last_change":"2023-07-27T20:33:00.588688+0000","last_active":"2023-07-27T20:33:01.746059+0000","last_peered":"2023-07-27T20:33:01.746059+0000","last_clean":"2023-07-27T20:33:01.746059+0000","last_became_active":"2023-07-27T20:33:00.588417+0000","last_became_peered":"2023-07-27T20:33:00.588417+0000","last_unstale":"2023-07-27T20:33:01.746059+0000","last_undegraded":"2023-07-27T20:33:01.746059+0000","last_fullsized":"2023-07-27T20:33:01.746059+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:26:10.112801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.581263+0000","last_change":"2023-07-27T20:33:00.594352+0000","last_active":"2023-07-27T20:33:01.581263+0000","last_peered":"2023-07-27T20:33:01.581263+0000","last_clean":"2023-07-27T20:33:01.581263+0000","last_became_active":"2023-07-27T20:33:00.593480+0000","last_became_peered":"2023-07-27T20:33:00.593480+0000","last_unstale":"2023-07-27T20:33:01.581263+0000","last_undegraded":"2023-07-27T20:33:01.581263+0000","last_fullsized":"2023-07-27T20:33:01.581263+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:37:50.368366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:02.477352+0000","last_change":"2023-07-27T20:33:00.594997+0000","last_active":"2023-07-27T20:33:02.477352+0000","last_peered":"2023-07-27T20:33:02.477352+0000","last_clean":"2023-07-27T20:33:02.477352+0000","last_became_active":"2023-07-27T20:33:00.594705+0000","last_became_peered":"2023-07-27T20:33:00.594705+0000","last_unstale":"2023-07-27T20:33:02.477352+0000","last_undegraded":"2023-07-27T20:33:02.477352+0000","last_fullsized":"2023-07-27T20:33:02.477352+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:34:18.903892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:02.477392+0000","last_change":"2023-07-27T20:33:00.587648+0000","last_active":"2023-07-27T20:33:02.477392+0000","last_peered":"2023-07-27T20:33:02.477392+0000","last_clean":"2023-07-27T20:33:02.477392+0000","last_became_active":"2023-07-27T20:33:00.587312+0000","last_became_peered":"2023-07-27T20:33:00.587312+0000","last_unstale":"2023-07-27T20:33:02.477392+0000","last_undegraded":"2023-07-27T20:33:02.477392+0000","last_fullsized":"2023-07-27T20:33:02.477392+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:57:49.089736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:02.477865+0000","last_change":"2023-07-27T20:33:00.596364+0000","last_active":"2023-07-27T20:33:02.477865+0000","last_peered":"2023-07-27T20:33:02.477865+0000","last_clean":"2023-07-27T20:33:02.477865+0000","last_became_active":"2023-07-27T20:33:00.595818+0000","last_became_peered":"2023-07-27T20:33:00.595818+0000","last_unstale":"2023-07-27T20:33:02.477865+0000","last_undegraded":"2023-07-27T20:33:02.477865+0000","last_fullsized":"2023-07-27T20:33:02.477865+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:28:31.477176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.922365+0000","last_change":"2023-07-27T20:33:00.592982+0000","last_active":"2023-07-27T20:33:01.922365+0000","last_peered":"2023-07-27T20:33:01.922365+0000","last_clean":"2023-07-27T20:33:01.922365+0000","last_became_active":"2023-07-27T20:33:00.592652+0000","last_became_peered":"2023-07-27T20:33:00.592652+0000","last_unstale":"2023-07-27T20:33:01.922365+0000","last_undegraded":"2023-07-27T20:33:01.922365+0000","last_fullsized":"2023-07-27T20:33:01.922365+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:18:16.230977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.750828+0000","last_change":"2023-07-27T20:33:00.582313+0000","last_active":"2023-07-27T20:33:01.750828+0000","last_peered":"2023-07-27T20:33:01.750828+0000","last_clean":"2023-07-27T20:33:01.750828+0000","last_became_active":"2023-07-27T20:33:00.582037+0000","last_became_peered":"2023-07-27T20:33:00.582037+0000","last_unstale":"2023-07-27T20:33:01.750828+0000","last_undegraded":"2023-07-27T20:33:01.750828+0000","last_fullsized":"2023-07-27T20:33:01.750828+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:33:47.017844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582825+0000","last_change":"2023-07-27T20:33:00.594896+0000","last_active":"2023-07-27T20:33:01.582825+0000","last_peered":"2023-07-27T20:33:01.582825+0000","last_clean":"2023-07-27T20:33:01.582825+0000","last_became_active":"2023-07-27T20:33:00.594415+0000","last_became_peered":"2023-07-27T20:33:00.594415+0000","last_unstale":"2023-07-27T20:33:01.582825+0000","last_undegraded":"2023-07-27T20:33:01.582825+0000","last_fullsized":"2023-07-27T20:33:01.582825+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:27:33.017218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:02.477519+0000","last_change":"2023-07-27T20:33:00.595500+0000","last_active":"2023-07-27T20:33:02.477519+0000","last_peered":"2023-07-27T20:33:02.477519+0000","last_clean":"2023-07-27T20:33:02.477519+0000","last_became_active":"2023-07-27T20:33:00.595248+0000","last_became_peered":"2023-07-27T20:33:00.595248+0000","last_unstale":"2023-07-27T20:33:02.477519+0000","last_undegraded":"2023-07-27T20:33:02.477519+0000","last_fullsized":"2023-07-27T20:33:02.477519+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:25:51.042111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.750634+0000","last_change":"2023-07-27T20:33:00.578692+0000","last_active":"2023-07-27T20:33:01.750634+0000","last_peered":"2023-07-27T20:33:01.750634+0000","last_clean":"2023-07-27T20:33:01.750634+0000","last_became_active":"2023-07-27T20:33:00.578401+0000","last_became_peered":"2023-07-27T20:33:00.578401+0000","last_unstale":"2023-07-27T20:33:01.750634+0000","last_undegraded":"2023-07-27T20:33:01.750634+0000","last_fullsized":"2023-07-27T20:33:01.750634+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:47:20.283073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.745918+0000","last_change":"2023-07-27T20:33:00.586163+0000","last_active":"2023-07-27T20:33:01.745918+0000","last_peered":"2023-07-27T20:33:01.745918+0000","last_clean":"2023-07-27T20:33:01.745918+0000","last_became_active":"2023-07-27T20:33:00.585656+0000","last_became_peered":"2023-07-27T20:33:00.585656+0000","last_unstale":"2023-07-27T20:33:01.745918+0000","last_undegraded":"2023-07-27T20:33:01.745918+0000","last_fullsized":"2023-07-27T20:33:01.745918+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:38:34.851684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.922128+0000","last_change":"2023-07-27T20:33:00.592631+0000","last_active":"2023-07-27T20:33:01.922128+0000","last_peered":"2023-07-27T20:33:01.922128+0000","last_clean":"2023-07-27T20:33:01.922128+0000","last_became_active":"2023-07-27T20:33:00.592323+0000","last_became_peered":"2023-07-27T20:33:00.592323+0000","last_unstale":"2023-07-27T20:33:01.922128+0000","last_undegraded":"2023-07-27T20:33:01.922128+0000","last_fullsized":"2023-07-27T20:33:01.922128+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:20:16.014702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.872667+0000","last_change":"2023-07-27T20:33:00.588040+0000","last_active":"2023-07-27T20:33:01.872667+0000","last_peered":"2023-07-27T20:33:01.872667+0000","last_clean":"2023-07-27T20:33:01.872667+0000","last_became_active":"2023-07-27T20:33:00.587701+0000","last_became_peered":"2023-07-27T20:33:00.587701+0000","last_unstale":"2023-07-27T20:33:01.872667+0000","last_undegraded":"2023-07-27T20:33:01.872667+0000","last_fullsized":"2023-07-27T20:33:01.872667+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:52:23.376308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"40'4","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.746501+0000","last_change":"2023-07-27T20:32:59.584807+0000","last_active":"2023-07-27T20:33:01.746501+0000","last_peered":"2023-07-27T20:33:01.746501+0000","last_clean":"2023-07-27T20:33:01.746501+0000","last_became_active":"2023-07-27T20:32:59.584538+0000","last_became_peered":"2023-07-27T20:32:59.584538+0000","last_unstale":"2023-07-27T20:33:01.746501+0000","last_undegraded":"2023-07-27T20:33:01.746501+0000","last_fullsized":"2023-07-27T20:33:01.746501+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:15:36.951198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:02.477646+0000","last_change":"2023-07-27T20:33:00.593205+0000","last_active":"2023-07-27T20:33:02.477646+0000","last_peered":"2023-07-27T20:33:02.477646+0000","last_clean":"2023-07-27T20:33:02.477646+0000","last_became_active":"2023-07-27T20:33:00.592912+0000","last_became_peered":"2023-07-27T20:33:00.592912+0000","last_unstale":"2023-07-27T20:33:02.477646+0000","last_undegraded":"2023-07-27T20:33:02.477646+0000","last_fullsized":"2023-07-27T20:33:02.477646+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:14:59.457130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.751112+0000","last_change":"2023-07-27T20:32:59.578355+0000","last_active":"2023-07-27T20:33:01.751112+0000","last_peered":"2023-07-27T20:33:01.751112+0000","last_clean":"2023-07-27T20:33:01.751112+0000","last_became_active":"2023-07-27T20:32:59.577716+0000","last_became_peered":"2023-07-27T20:32:59.577716+0000","last_unstale":"2023-07-27T20:33:01.751112+0000","last_undegraded":"2023-07-27T20:33:01.751112+0000","last_fullsized":"2023-07-27T20:33:01.751112+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:16:16.524768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582978+0000","last_change":"2023-07-27T20:33:00.585983+0000","last_active":"2023-07-27T20:33:01.582978+0000","last_peered":"2023-07-27T20:33:01.582978+0000","last_clean":"2023-07-27T20:33:01.582978+0000","last_became_active":"2023-07-27T20:33:00.585714+0000","last_became_peered":"2023-07-27T20:33:00.585714+0000","last_unstale":"2023-07-27T20:33:01.582978+0000","last_undegraded":"2023-07-27T20:33:01.582978+0000","last_fullsized":"2023-07-27T20:33:01.582978+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:41:09.597388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.872766+0000","last_change":"2023-07-27T20:32:59.584693+0000","last_active":"2023-07-27T20:33:01.872766+0000","last_peered":"2023-07-27T20:33:01.872766+0000","last_clean":"2023-07-27T20:33:01.872766+0000","last_became_active":"2023-07-27T20:32:59.584388+0000","last_became_peered":"2023-07-27T20:32:59.584388+0000","last_unstale":"2023-07-27T20:33:01.872766+0000","last_undegraded":"2023-07-27T20:33:01.872766+0000","last_fullsized":"2023-07-27T20:33:01.872766+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:42:04.208572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.872700+0000","last_change":"2023-07-27T20:33:00.600434+0000","last_active":"2023-07-27T20:33:01.872700+0000","last_peered":"2023-07-27T20:33:01.872700+0000","last_clean":"2023-07-27T20:33:01.872700+0000","last_became_active":"2023-07-27T20:33:00.599887+0000","last_became_peered":"2023-07-27T20:33:00.599887+0000","last_unstale":"2023-07-27T20:33:01.872700+0000","last_undegraded":"2023-07-27T20:33:01.872700+0000","last_fullsized":"2023-07-27T20:33:01.872700+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:08:26.830576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582720+0000","last_change":"2023-07-27T20:32:59.583845+0000","last_active":"2023-07-27T20:33:01.582720+0000","last_peered":"2023-07-27T20:33:01.582720+0000","last_clean":"2023-07-27T20:33:01.582720+0000","last_became_active":"2023-07-27T20:32:59.583553+0000","last_became_peered":"2023-07-27T20:32:59.583553+0000","last_unstale":"2023-07-27T20:33:01.582720+0000","last_undegraded":"2023-07-27T20:33:01.582720+0000","last_fullsized":"2023-07-27T20:33:01.582720+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:37:31.248843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.751006+0000","last_change":"2023-07-27T20:33:00.596464+0000","last_active":"2023-07-27T20:33:01.751006+0000","last_peered":"2023-07-27T20:33:01.751006+0000","last_clean":"2023-07-27T20:33:01.751006+0000","last_became_active":"2023-07-27T20:33:00.596200+0000","last_became_peered":"2023-07-27T20:33:00.596200+0000","last_unstale":"2023-07-27T20:33:01.751006+0000","last_undegraded":"2023-07-27T20:33:01.751006+0000","last_fullsized":"2023-07-27T20:33:01.751006+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:41:19.760977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.746356+0000","last_change":"2023-07-27T20:32:59.580842+0000","last_active":"2023-07-27T20:33:01.746356+0000","last_peered":"2023-07-27T20:33:01.746356+0000","last_clean":"2023-07-27T20:33:01.746356+0000","last_became_active":"2023-07-27T20:32:59.580445+0000","last_became_peered":"2023-07-27T20:32:59.580445+0000","last_unstale":"2023-07-27T20:33:01.746356+0000","last_undegraded":"2023-07-27T20:33:01.746356+0000","last_fullsized":"2023-07-27T20:33:01.746356+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:19:25.141850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.581419+0000","last_change":"2023-07-27T20:33:00.582438+0000","last_active":"2023-07-27T20:33:01.581419+0000","last_peered":"2023-07-27T20:33:01.581419+0000","last_clean":"2023-07-27T20:33:01.581419+0000","last_became_active":"2023-07-27T20:33:00.582148+0000","last_became_peered":"2023-07-27T20:33:00.582148+0000","last_unstale":"2023-07-27T20:33:01.581419+0000","last_undegraded":"2023-07-27T20:33:01.581419+0000","last_fullsized":"2023-07-27T20:33:01.581419+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:27:15.025815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.751089+0000","last_change":"2023-07-27T20:32:59.584387+0000","last_active":"2023-07-27T20:33:01.751089+0000","last_peered":"2023-07-27T20:33:01.751089+0000","last_clean":"2023-07-27T20:33:01.751089+0000","last_became_active":"2023-07-27T20:32:59.584123+0000","last_became_peered":"2023-07-27T20:32:59.584123+0000","last_unstale":"2023-07-27T20:33:01.751089+0000","last_undegraded":"2023-07-27T20:33:01.751089+0000","last_fullsized":"2023-07-27T20:33:01.751089+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:00:54.752952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.581132+0000","last_change":"2023-07-27T20:33:00.593317+0000","last_active":"2023-07-27T20:33:01.581132+0000","last_peered":"2023-07-27T20:33:01.581132+0000","last_clean":"2023-07-27T20:33:01.581132+0000","last_became_active":"2023-07-27T20:33:00.593040+0000","last_became_peered":"2023-07-27T20:33:00.593040+0000","last_unstale":"2023-07-27T20:33:01.581132+0000","last_undegraded":"2023-07-27T20:33:01.581132+0000","last_fullsized":"2023-07-27T20:33:01.581132+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:41:09.597388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582119+0000","last_change":"2023-07-27T20:32:59.588694+0000","last_active":"2023-07-27T20:33:01.582119+0000","last_peered":"2023-07-27T20:33:01.582119+0000","last_clean":"2023-07-27T20:33:01.582119+0000","last_became_active":"2023-07-27T20:32:59.588450+0000","last_became_peered":"2023-07-27T20:32:59.588450+0000","last_unstale":"2023-07-27T20:33:01.582119+0000","last_undegraded":"2023-07-27T20:33:01.582119+0000","last_fullsized":"2023-07-27T20:33:01.582119+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:06:49.396831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:02.477325+0000","last_change":"2023-07-27T20:33:00.590399+0000","last_active":"2023-07-27T20:33:02.477325+0000","last_peered":"2023-07-27T20:33:02.477325+0000","last_clean":"2023-07-27T20:33:02.477325+0000","last_became_active":"2023-07-27T20:33:00.590134+0000","last_became_peered":"2023-07-27T20:33:00.590134+0000","last_unstale":"2023-07-27T20:33:02.477325+0000","last_undegraded":"2023-07-27T20:33:02.477325+0000","last_fullsized":"2023-07-27T20:33:02.477325+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:41:37.112348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.581177+0000","last_change":"2023-07-27T20:32:59.577003+0000","last_active":"2023-07-27T20:33:01.581177+0000","last_peered":"2023-07-27T20:33:01.581177+0000","last_clean":"2023-07-27T20:33:01.581177+0000","last_became_active":"2023-07-27T20:32:59.576722+0000","last_became_peered":"2023-07-27T20:32:59.576722+0000","last_unstale":"2023-07-27T20:33:01.581177+0000","last_undegraded":"2023-07-27T20:33:01.581177+0000","last_fullsized":"2023-07-27T20:33:01.581177+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:27:32.009906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.751002+0000","last_change":"2023-07-27T20:33:00.572761+0000","last_active":"2023-07-27T20:33:01.751002+0000","last_peered":"2023-07-27T20:33:01.751002+0000","last_clean":"2023-07-27T20:33:01.751002+0000","last_became_active":"2023-07-27T20:33:00.572373+0000","last_became_peered":"2023-07-27T20:33:00.572373+0000","last_unstale":"2023-07-27T20:33:01.751002+0000","last_undegraded":"2023-07-27T20:33:01.751002+0000","last_fullsized":"2023-07-27T20:33:01.751002+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:53:46.229684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.751107+0000","last_change":"2023-07-27T20:32:59.580000+0000","last_active":"2023-07-27T20:33:01.751107+0000","last_peered":"2023-07-27T20:33:01.751107+0000","last_clean":"2023-07-27T20:33:01.751107+0000","last_became_active":"2023-07-27T20:32:59.579693+0000","last_became_peered":"2023-07-27T20:32:59.579693+0000","last_unstale":"2023-07-27T20:33:01.751107+0000","last_undegraded":"2023-07-27T20:33:01.751107+0000","last_fullsized":"2023-07-27T20:33:01.751107+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:48:23.280646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582860+0000","last_change":"2023-07-27T20:33:00.586432+0000","last_active":"2023-07-27T20:33:01.582860+0000","last_peered":"2023-07-27T20:33:01.582860+0000","last_clean":"2023-07-27T20:33:01.582860+0000","last_became_active":"2023-07-27T20:33:00.586115+0000","last_became_peered":"2023-07-27T20:33:00.586115+0000","last_unstale":"2023-07-27T20:33:01.582860+0000","last_undegraded":"2023-07-27T20:33:01.582860+0000","last_fullsized":"2023-07-27T20:33:01.582860+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:16:47.190935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582011+0000","last_change":"2023-07-27T20:32:59.577773+0000","last_active":"2023-07-27T20:33:01.582011+0000","last_peered":"2023-07-27T20:33:01.582011+0000","last_clean":"2023-07-27T20:33:01.582011+0000","last_became_active":"2023-07-27T20:32:59.577537+0000","last_became_peered":"2023-07-27T20:32:59.577537+0000","last_unstale":"2023-07-27T20:33:01.582011+0000","last_undegraded":"2023-07-27T20:33:01.582011+0000","last_fullsized":"2023-07-27T20:33:01.582011+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:26:09.105489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.746361+0000","last_change":"2023-07-27T20:33:00.585029+0000","last_active":"2023-07-27T20:33:01.746361+0000","last_peered":"2023-07-27T20:33:01.746361+0000","last_clean":"2023-07-27T20:33:01.746361+0000","last_became_active":"2023-07-27T20:33:00.584714+0000","last_became_peered":"2023-07-27T20:33:00.584714+0000","last_unstale":"2023-07-27T20:33:01.746361+0000","last_undegraded":"2023-07-27T20:33:01.746361+0000","last_fullsized":"2023-07-27T20:33:01.746361+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:44:20.625780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"40'3","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.583148+0000","last_change":"2023-07-27T20:32:59.579139+0000","last_active":"2023-07-27T20:33:01.583148+0000","last_peered":"2023-07-27T20:33:01.583148+0000","last_clean":"2023-07-27T20:33:01.583148+0000","last_became_active":"2023-07-27T20:32:59.578856+0000","last_became_peered":"2023-07-27T20:32:59.578856+0000","last_unstale":"2023-07-27T20:33:01.583148+0000","last_undegraded":"2023-07-27T20:33:01.583148+0000","last_fullsized":"2023-07-27T20:33:01.583148+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:26:09.105489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582986+0000","last_change":"2023-07-27T20:33:00.591576+0000","last_active":"2023-07-27T20:33:01.582986+0000","last_peered":"2023-07-27T20:33:01.582986+0000","last_clean":"2023-07-27T20:33:01.582986+0000","last_became_active":"2023-07-27T20:33:00.591241+0000","last_became_peered":"2023-07-27T20:33:00.591241+0000","last_unstale":"2023-07-27T20:33:01.582986+0000","last_undegraded":"2023-07-27T20:33:01.582986+0000","last_fullsized":"2023-07-27T20:33:01.582986+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:53:00.572896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"40'6","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.922438+0000","last_change":"2023-07-27T20:32:59.583956+0000","last_active":"2023-07-27T20:33:01.922438+0000","last_peered":"2023-07-27T20:33:01.922438+0000","last_clean":"2023-07-27T20:33:01.922438+0000","last_became_active":"2023-07-27T20:32:59.583495+0000","last_became_peered":"2023-07-27T20:32:59.583495+0000","last_unstale":"2023-07-27T20:33:01.922438+0000","last_undegraded":"2023-07-27T20:33:01.922438+0000","last_fullsized":"2023-07-27T20:33:01.922438+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:57:48.082425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:02.477563+0000","last_change":"2023-07-27T20:33:00.594625+0000","last_active":"2023-07-27T20:33:02.477563+0000","last_peered":"2023-07-27T20:33:02.477563+0000","last_clean":"2023-07-27T20:33:02.477563+0000","last_became_active":"2023-07-27T20:33:00.594342+0000","last_became_peered":"2023-07-27T20:33:00.594342+0000","last_unstale":"2023-07-27T20:33:02.477563+0000","last_undegraded":"2023-07-27T20:33:02.477563+0000","last_fullsized":"2023-07-27T20:33:02.477563+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:57:02.618003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.746209+0000","last_change":"2023-07-27T20:32:59.581127+0000","last_active":"2023-07-27T20:33:01.746209+0000","last_peered":"2023-07-27T20:33:01.746209+0000","last_clean":"2023-07-27T20:33:01.746209+0000","last_became_active":"2023-07-27T20:32:59.580831+0000","last_became_peered":"2023-07-27T20:32:59.580831+0000","last_unstale":"2023-07-27T20:33:01.746209+0000","last_undegraded":"2023-07-27T20:33:01.746209+0000","last_fullsized":"2023-07-27T20:33:01.746209+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:23:35.212084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.581454+0000","last_change":"2023-07-27T20:33:00.578726+0000","last_active":"2023-07-27T20:33:01.581454+0000","last_peered":"2023-07-27T20:33:01.581454+0000","last_clean":"2023-07-27T20:33:01.581454+0000","last_became_active":"2023-07-27T20:33:00.578439+0000","last_became_peered":"2023-07-27T20:33:00.578439+0000","last_unstale":"2023-07-27T20:33:01.581454+0000","last_undegraded":"2023-07-27T20:33:01.581454+0000","last_fullsized":"2023-07-27T20:33:01.581454+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:49:17.774438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582500+0000","last_change":"2023-07-27T20:32:59.581242+0000","last_active":"2023-07-27T20:33:01.582500+0000","last_peered":"2023-07-27T20:33:01.582500+0000","last_clean":"2023-07-27T20:33:01.582500+0000","last_became_active":"2023-07-27T20:32:59.580941+0000","last_became_peered":"2023-07-27T20:32:59.580941+0000","last_unstale":"2023-07-27T20:33:01.582500+0000","last_undegraded":"2023-07-27T20:33:01.582500+0000","last_fullsized":"2023-07-27T20:33:01.582500+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:55:27.482074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.745919+0000","last_change":"2023-07-27T20:33:00.583374+0000","last_active":"2023-07-27T20:33:01.745919+0000","last_peered":"2023-07-27T20:33:01.745919+0000","last_clean":"2023-07-27T20:33:01.745919+0000","last_became_active":"2023-07-27T20:33:00.583064+0000","last_became_peered":"2023-07-27T20:33:00.583064+0000","last_unstale":"2023-07-27T20:33:01.745919+0000","last_undegraded":"2023-07-27T20:33:01.745919+0000","last_fullsized":"2023-07-27T20:33:01.745919+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:16:47.190935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.745994+0000","last_change":"2023-07-27T20:32:59.583865+0000","last_active":"2023-07-27T20:33:01.745994+0000","last_peered":"2023-07-27T20:33:01.745994+0000","last_clean":"2023-07-27T20:33:01.745994+0000","last_became_active":"2023-07-27T20:32:59.583587+0000","last_became_peered":"2023-07-27T20:32:59.583587+0000","last_unstale":"2023-07-27T20:33:01.745994+0000","last_undegraded":"2023-07-27T20:33:01.745994+0000","last_fullsized":"2023-07-27T20:33:01.745994+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:52:59.565584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582758+0000","last_change":"2023-07-27T20:33:00.598092+0000","last_active":"2023-07-27T20:33:01.582758+0000","last_peered":"2023-07-27T20:33:01.582758+0000","last_clean":"2023-07-27T20:33:01.582758+0000","last_became_active":"2023-07-27T20:33:00.597585+0000","last_became_peered":"2023-07-27T20:33:00.597585+0000","last_unstale":"2023-07-27T20:33:01.582758+0000","last_undegraded":"2023-07-27T20:33:01.582758+0000","last_fullsized":"2023-07-27T20:33:01.582758+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:16:32.940169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"40'8","reported_seq":21,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.581311+0000","last_change":"2023-07-27T20:32:59.583107+0000","last_active":"2023-07-27T20:33:01.581311+0000","last_peered":"2023-07-27T20:33:01.581311+0000","last_clean":"2023-07-27T20:33:01.581311+0000","last_became_active":"2023-07-27T20:32:59.582831+0000","last_became_peered":"2023-07-27T20:32:59.582831+0000","last_unstale":"2023-07-27T20:33:01.581311+0000","last_undegraded":"2023-07-27T20:33:01.581311+0000","last_fullsized":"2023-07-27T20:33:01.581311+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:30:39.015685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.922417+0000","last_change":"2023-07-27T20:33:00.583423+0000","last_active":"2023-07-27T20:33:01.922417+0000","last_peered":"2023-07-27T20:33:01.922417+0000","last_clean":"2023-07-27T20:33:01.922417+0000","last_became_active":"2023-07-27T20:33:00.583146+0000","last_became_peered":"2023-07-27T20:33:00.583146+0000","last_unstale":"2023-07-27T20:33:01.922417+0000","last_undegraded":"2023-07-27T20:33:01.922417+0000","last_fullsized":"2023-07-27T20:33:01.922417+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:34:18.903892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.922520+0000","last_change":"2023-07-27T20:32:59.586172+0000","last_active":"2023-07-27T20:33:01.922520+0000","last_peered":"2023-07-27T20:33:01.922520+0000","last_clean":"2023-07-27T20:33:01.922520+0000","last_became_active":"2023-07-27T20:32:59.585871+0000","last_became_peered":"2023-07-27T20:32:59.585871+0000","last_unstale":"2023-07-27T20:33:01.922520+0000","last_undegraded":"2023-07-27T20:33:01.922520+0000","last_fullsized":"2023-07-27T20:33:01.922520+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:41:36.105037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582111+0000","last_change":"2023-07-27T20:33:00.592417+0000","last_active":"2023-07-27T20:33:01.582111+0000","last_peered":"2023-07-27T20:33:01.582111+0000","last_clean":"2023-07-27T20:33:01.582111+0000","last_became_active":"2023-07-27T20:33:00.592164+0000","last_became_peered":"2023-07-27T20:33:00.592164+0000","last_unstale":"2023-07-27T20:33:01.582111+0000","last_undegraded":"2023-07-27T20:33:01.582111+0000","last_fullsized":"2023-07-27T20:33:01.582111+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:03:22.452364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.750836+0000","last_change":"2023-07-27T20:32:59.580768+0000","last_active":"2023-07-27T20:33:01.750836+0000","last_peered":"2023-07-27T20:33:01.750836+0000","last_clean":"2023-07-27T20:33:01.750836+0000","last_became_active":"2023-07-27T20:32:59.580496+0000","last_became_peered":"2023-07-27T20:32:59.580496+0000","last_unstale":"2023-07-27T20:33:01.750836+0000","last_undegraded":"2023-07-27T20:33:01.750836+0000","last_fullsized":"2023-07-27T20:33:01.750836+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:58:40.348368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:02.477708+0000","last_change":"2023-07-27T20:33:00.602792+0000","last_active":"2023-07-27T20:33:02.477708+0000","last_peered":"2023-07-27T20:33:02.477708+0000","last_clean":"2023-07-27T20:33:02.477708+0000","last_became_active":"2023-07-27T20:33:00.602393+0000","last_became_peered":"2023-07-27T20:33:00.602393+0000","last_unstale":"2023-07-27T20:33:02.477708+0000","last_undegraded":"2023-07-27T20:33:02.477708+0000","last_fullsized":"2023-07-27T20:33:02.477708+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:09:37.527165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582327+0000","last_change":"2023-07-27T20:32:59.588890+0000","last_active":"2023-07-27T20:33:01.582327+0000","last_peered":"2023-07-27T20:33:01.582327+0000","last_clean":"2023-07-27T20:33:01.582327+0000","last_became_active":"2023-07-27T20:32:59.588570+0000","last_became_peered":"2023-07-27T20:32:59.588570+0000","last_unstale":"2023-07-27T20:33:01.582327+0000","last_undegraded":"2023-07-27T20:33:01.582327+0000","last_fullsized":"2023-07-27T20:33:01.582327+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:39:38.296269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:02.477949+0000","last_change":"2023-07-27T20:33:00.597737+0000","last_active":"2023-07-27T20:33:02.477949+0000","last_peered":"2023-07-27T20:33:02.477949+0000","last_clean":"2023-07-27T20:33:02.477949+0000","last_became_active":"2023-07-27T20:33:00.597390+0000","last_became_peered":"2023-07-27T20:33:00.597390+0000","last_unstale":"2023-07-27T20:33:02.477949+0000","last_undegraded":"2023-07-27T20:33:02.477949+0000","last_fullsized":"2023-07-27T20:33:02.477949+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:07:59.864740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.746431+0000","last_change":"2023-07-27T20:32:59.585317+0000","last_active":"2023-07-27T20:33:01.746431+0000","last_peered":"2023-07-27T20:33:01.746431+0000","last_clean":"2023-07-27T20:33:01.746431+0000","last_became_active":"2023-07-27T20:32:59.585008+0000","last_became_peered":"2023-07-27T20:32:59.585008+0000","last_unstale":"2023-07-27T20:33:01.746431+0000","last_undegraded":"2023-07-27T20:33:01.746431+0000","last_fullsized":"2023-07-27T20:33:01.746431+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:14:26.844155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.746014+0000","last_change":"2023-07-27T20:33:00.588162+0000","last_active":"2023-07-27T20:33:01.746014+0000","last_peered":"2023-07-27T20:33:01.746014+0000","last_clean":"2023-07-27T20:33:01.746014+0000","last_became_active":"2023-07-27T20:33:00.587546+0000","last_became_peered":"2023-07-27T20:33:00.587546+0000","last_unstale":"2023-07-27T20:33:01.746014+0000","last_undegraded":"2023-07-27T20:33:01.746014+0000","last_fullsized":"2023-07-27T20:33:01.746014+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:17:35.471819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.746341+0000","last_change":"2023-07-27T20:32:59.581014+0000","last_active":"2023-07-27T20:33:01.746341+0000","last_peered":"2023-07-27T20:33:01.746341+0000","last_clean":"2023-07-27T20:33:01.746341+0000","last_became_active":"2023-07-27T20:32:59.580563+0000","last_became_peered":"2023-07-27T20:32:59.580563+0000","last_unstale":"2023-07-27T20:33:01.746341+0000","last_undegraded":"2023-07-27T20:33:01.746341+0000","last_fullsized":"2023-07-27T20:33:01.746341+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:17:47.165420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.872566+0000","last_change":"2023-07-27T20:33:00.585619+0000","last_active":"2023-07-27T20:33:01.872566+0000","last_peered":"2023-07-27T20:33:01.872566+0000","last_clean":"2023-07-27T20:33:01.872566+0000","last_became_active":"2023-07-27T20:33:00.585362+0000","last_became_peered":"2023-07-27T20:33:00.585362+0000","last_unstale":"2023-07-27T20:33:01.872566+0000","last_undegraded":"2023-07-27T20:33:01.872566+0000","last_fullsized":"2023-07-27T20:33:01.872566+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:20:34.814310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582217+0000","last_change":"2023-07-27T20:32:59.583381+0000","last_active":"2023-07-27T20:33:01.582217+0000","last_peered":"2023-07-27T20:33:01.582217+0000","last_clean":"2023-07-27T20:33:01.582217+0000","last_became_active":"2023-07-27T20:32:59.582911+0000","last_became_peered":"2023-07-27T20:32:59.582911+0000","last_unstale":"2023-07-27T20:33:01.582217+0000","last_undegraded":"2023-07-27T20:33:01.582217+0000","last_fullsized":"2023-07-27T20:33:01.582217+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:05:39.044767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.922178+0000","last_change":"2023-07-27T20:33:00.580697+0000","last_active":"2023-07-27T20:33:01.922178+0000","last_peered":"2023-07-27T20:33:01.922178+0000","last_clean":"2023-07-27T20:33:01.922178+0000","last_became_active":"2023-07-27T20:33:00.580386+0000","last_became_peered":"2023-07-27T20:33:00.580386+0000","last_unstale":"2023-07-27T20:33:01.922178+0000","last_undegraded":"2023-07-27T20:33:01.922178+0000","last_fullsized":"2023-07-27T20:33:01.922178+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:57:26.752625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.581154+0000","last_change":"2023-07-27T20:32:59.577740+0000","last_active":"2023-07-27T20:33:01.581154+0000","last_peered":"2023-07-27T20:33:01.581154+0000","last_clean":"2023-07-27T20:33:01.581154+0000","last_became_active":"2023-07-27T20:32:59.577456+0000","last_became_peered":"2023-07-27T20:32:59.577456+0000","last_unstale":"2023-07-27T20:33:01.581154+0000","last_undegraded":"2023-07-27T20:33:01.581154+0000","last_fullsized":"2023-07-27T20:33:01.581154+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:27:37.589694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.581117+0000","last_change":"2023-07-27T20:33:00.583933+0000","last_active":"2023-07-27T20:33:01.581117+0000","last_peered":"2023-07-27T20:33:01.581117+0000","last_clean":"2023-07-27T20:33:01.581117+0000","last_became_active":"2023-07-27T20:33:00.583598+0000","last_became_peered":"2023-07-27T20:33:00.583598+0000","last_unstale":"2023-07-27T20:33:01.581117+0000","last_undegraded":"2023-07-27T20:33:01.581117+0000","last_fullsized":"2023-07-27T20:33:01.581117+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:01:21.270310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582119+0000","last_change":"2023-07-27T20:32:59.581455+0000","last_active":"2023-07-27T20:33:01.582119+0000","last_peered":"2023-07-27T20:33:01.582119+0000","last_clean":"2023-07-27T20:33:01.582119+0000","last_became_active":"2023-07-27T20:32:59.579901+0000","last_became_peered":"2023-07-27T20:32:59.579901+0000","last_unstale":"2023-07-27T20:33:01.582119+0000","last_undegraded":"2023-07-27T20:33:01.582119+0000","last_fullsized":"2023-07-27T20:33:01.582119+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:41:08.590077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.750694+0000","last_change":"2023-07-27T20:33:00.588668+0000","last_active":"2023-07-27T20:33:01.750694+0000","last_peered":"2023-07-27T20:33:01.750694+0000","last_clean":"2023-07-27T20:33:01.750694+0000","last_became_active":"2023-07-27T20:33:00.588375+0000","last_became_peered":"2023-07-27T20:33:00.588375+0000","last_unstale":"2023-07-27T20:33:01.750694+0000","last_undegraded":"2023-07-27T20:33:01.750694+0000","last_fullsized":"2023-07-27T20:33:01.750694+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:47:02.186816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.581339+0000","last_change":"2023-07-27T20:32:59.581609+0000","last_active":"2023-07-27T20:33:01.581339+0000","last_peered":"2023-07-27T20:33:01.581339+0000","last_clean":"2023-07-27T20:33:01.581339+0000","last_became_active":"2023-07-27T20:32:59.580643+0000","last_became_peered":"2023-07-27T20:32:59.580643+0000","last_unstale":"2023-07-27T20:33:01.581339+0000","last_undegraded":"2023-07-27T20:33:01.581339+0000","last_fullsized":"2023-07-27T20:33:01.581339+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:55:27.482074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.872536+0000","last_change":"2023-07-27T20:31:22.848698+0000","last_active":"2023-07-27T20:33:01.872536+0000","last_peered":"2023-07-27T20:33:01.872536+0000","last_clean":"2023-07-27T20:33:01.872536+0000","last_became_active":"2023-07-27T20:31:22.848346+0000","last_became_peered":"2023-07-27T20:31:22.848346+0000","last_unstale":"2023-07-27T20:33:01.872536+0000","last_undegraded":"2023-07-27T20:33:01.872536+0000","last_fullsized":"2023-07-27T20:33:01.872536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:32:10.101989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:02.477695+0000","last_change":"2023-07-27T20:33:00.594284+0000","last_active":"2023-07-27T20:33:02.477695+0000","last_peered":"2023-07-27T20:33:02.477695+0000","last_clean":"2023-07-27T20:33:02.477695+0000","last_became_active":"2023-07-27T20:33:00.593915+0000","last_became_peered":"2023-07-27T20:33:00.593915+0000","last_unstale":"2023-07-27T20:33:02.477695+0000","last_undegraded":"2023-07-27T20:33:02.477695+0000","last_fullsized":"2023-07-27T20:33:02.477695+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:32:44.944176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"41'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.746564+0000","last_change":"2023-07-27T20:32:59.579071+0000","last_active":"2023-07-27T20:33:01.746564+0000","last_peered":"2023-07-27T20:33:01.746564+0000","last_clean":"2023-07-27T20:33:01.746564+0000","last_became_active":"2023-07-27T20:32:59.578792+0000","last_became_peered":"2023-07-27T20:32:59.578792+0000","last_unstale":"2023-07-27T20:33:01.746564+0000","last_undegraded":"2023-07-27T20:33:01.746564+0000","last_fullsized":"2023-07-27T20:33:01.746564+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:53:15.992800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582430+0000","last_change":"2023-07-27T20:31:22.849178+0000","last_active":"2023-07-27T20:33:01.582430+0000","last_peered":"2023-07-27T20:33:01.582430+0000","last_clean":"2023-07-27T20:33:01.582430+0000","last_became_active":"2023-07-27T20:31:22.848856+0000","last_became_peered":"2023-07-27T20:31:22.848856+0000","last_unstale":"2023-07-27T20:33:01.582430+0000","last_undegraded":"2023-07-27T20:33:01.582430+0000","last_fullsized":"2023-07-27T20:33:01.582430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:18:13.904765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.581692+0000","last_change":"2023-07-27T20:33:00.572709+0000","last_active":"2023-07-27T20:33:01.581692+0000","last_peered":"2023-07-27T20:33:01.581692+0000","last_clean":"2023-07-27T20:33:01.581692+0000","last_became_active":"2023-07-27T20:33:00.572428+0000","last_became_peered":"2023-07-27T20:33:00.572428+0000","last_unstale":"2023-07-27T20:33:01.581692+0000","last_undegraded":"2023-07-27T20:33:01.581692+0000","last_fullsized":"2023-07-27T20:33:01.581692+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:16:47.190935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.583223+0000","last_change":"2023-07-27T20:32:59.579248+0000","last_active":"2023-07-27T20:33:01.583223+0000","last_peered":"2023-07-27T20:33:01.583223+0000","last_clean":"2023-07-27T20:33:01.583223+0000","last_became_active":"2023-07-27T20:32:59.578926+0000","last_became_peered":"2023-07-27T20:32:59.578926+0000","last_unstale":"2023-07-27T20:33:01.583223+0000","last_undegraded":"2023-07-27T20:33:01.583223+0000","last_fullsized":"2023-07-27T20:33:01.583223+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:03:21.445052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.922102+0000","last_change":"2023-07-27T20:31:22.959811+0000","last_active":"2023-07-27T20:33:01.922102+0000","last_peered":"2023-07-27T20:33:01.922102+0000","last_clean":"2023-07-27T20:33:01.922102+0000","last_became_active":"2023-07-27T20:31:22.959449+0000","last_became_peered":"2023-07-27T20:31:22.959449+0000","last_unstale":"2023-07-27T20:33:01.922102+0000","last_undegraded":"2023-07-27T20:33:01.922102+0000","last_fullsized":"2023-07-27T20:33:01.922102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:22:35.775094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.581932+0000","last_change":"2023-07-27T20:33:00.581823+0000","last_active":"2023-07-27T20:33:01.581932+0000","last_peered":"2023-07-27T20:33:01.581932+0000","last_clean":"2023-07-27T20:33:01.581932+0000","last_became_active":"2023-07-27T20:33:00.581520+0000","last_became_peered":"2023-07-27T20:33:00.581520+0000","last_unstale":"2023-07-27T20:33:01.581932+0000","last_undegraded":"2023-07-27T20:33:01.581932+0000","last_fullsized":"2023-07-27T20:33:01.581932+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:17:35.471819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582987+0000","last_change":"2023-07-27T20:32:59.585447+0000","last_active":"2023-07-27T20:33:01.582987+0000","last_peered":"2023-07-27T20:33:01.582987+0000","last_clean":"2023-07-27T20:33:01.582987+0000","last_became_active":"2023-07-27T20:32:59.585172+0000","last_became_peered":"2023-07-27T20:32:59.585172+0000","last_unstale":"2023-07-27T20:33:01.582987+0000","last_undegraded":"2023-07-27T20:33:01.582987+0000","last_fullsized":"2023-07-27T20:33:01.582987+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:37:49.361054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582535+0000","last_change":"2023-07-27T20:31:22.847766+0000","last_active":"2023-07-27T20:33:01.582535+0000","last_peered":"2023-07-27T20:33:01.582535+0000","last_clean":"2023-07-27T20:33:01.582535+0000","last_became_active":"2023-07-27T20:31:22.847396+0000","last_became_peered":"2023-07-27T20:31:22.847396+0000","last_unstale":"2023-07-27T20:33:01.582535+0000","last_undegraded":"2023-07-27T20:33:01.582535+0000","last_fullsized":"2023-07-27T20:33:01.582535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:59:43.538201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":207,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582376+0000","last_change":"2023-07-27T20:31:15.812727+0000","last_active":"2023-07-27T20:33:01.582376+0000","last_peered":"2023-07-27T20:33:01.582376+0000","last_clean":"2023-07-27T20:33:01.582376+0000","last_became_active":"2023-07-27T20:31:15.811803+0000","last_became_peered":"2023-07-27T20:31:15.811803+0000","last_unstale":"2023-07-27T20:33:01.582376+0000","last_undegraded":"2023-07-27T20:33:01.582376+0000","last_fullsized":"2023-07-27T20:33:01.582376+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:14.789257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:14.789257+0000","last_clean_scrub_stamp":"2023-07-27T20:31:14.789257+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:36:05.604430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.583051+0000","last_change":"2023-07-27T20:33:00.590390+0000","last_active":"2023-07-27T20:33:01.583051+0000","last_peered":"2023-07-27T20:33:01.583051+0000","last_clean":"2023-07-27T20:33:01.583051+0000","last_became_active":"2023-07-27T20:33:00.590070+0000","last_became_peered":"2023-07-27T20:33:00.590070+0000","last_unstale":"2023-07-27T20:33:01.583051+0000","last_undegraded":"2023-07-27T20:33:01.583051+0000","last_fullsized":"2023-07-27T20:33:01.583051+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:17:35.471819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.872440+0000","last_change":"2023-07-27T20:32:59.584665+0000","last_active":"2023-07-27T20:33:01.872440+0000","last_peered":"2023-07-27T20:33:01.872440+0000","last_clean":"2023-07-27T20:33:01.872440+0000","last_became_active":"2023-07-27T20:32:59.584357+0000","last_became_peered":"2023-07-27T20:32:59.584357+0000","last_unstale":"2023-07-27T20:33:01.872440+0000","last_undegraded":"2023-07-27T20:33:01.872440+0000","last_fullsized":"2023-07-27T20:33:01.872440+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:09:26.178628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582528+0000","last_change":"2023-07-27T20:31:22.848181+0000","last_active":"2023-07-27T20:33:01.582528+0000","last_peered":"2023-07-27T20:33:01.582528+0000","last_clean":"2023-07-27T20:33:01.582528+0000","last_became_active":"2023-07-27T20:31:22.847865+0000","last_became_peered":"2023-07-27T20:31:22.847865+0000","last_unstale":"2023-07-27T20:33:01.582528+0000","last_undegraded":"2023-07-27T20:33:01.582528+0000","last_fullsized":"2023-07-27T20:33:01.582528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:25:37.293707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582036+0000","last_change":"2023-07-27T20:33:00.590893+0000","last_active":"2023-07-27T20:33:01.582036+0000","last_peered":"2023-07-27T20:33:01.582036+0000","last_clean":"2023-07-27T20:33:01.582036+0000","last_became_active":"2023-07-27T20:33:00.590559+0000","last_became_peered":"2023-07-27T20:33:00.590559+0000","last_unstale":"2023-07-27T20:33:01.582036+0000","last_undegraded":"2023-07-27T20:33:01.582036+0000","last_fullsized":"2023-07-27T20:33:01.582036+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:04:16.885923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.872403+0000","last_change":"2023-07-27T20:32:59.579303+0000","last_active":"2023-07-27T20:33:01.872403+0000","last_peered":"2023-07-27T20:33:01.872403+0000","last_clean":"2023-07-27T20:33:01.872403+0000","last_became_active":"2023-07-27T20:32:59.579015+0000","last_became_peered":"2023-07-27T20:32:59.579015+0000","last_unstale":"2023-07-27T20:33:01.872403+0000","last_undegraded":"2023-07-27T20:33:01.872403+0000","last_fullsized":"2023-07-27T20:33:01.872403+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:34:01.141411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.583237+0000","last_change":"2023-07-27T20:31:22.848025+0000","last_active":"2023-07-27T20:33:01.583237+0000","last_peered":"2023-07-27T20:33:01.583237+0000","last_clean":"2023-07-27T20:33:01.583237+0000","last_became_active":"2023-07-27T20:31:22.847603+0000","last_became_peered":"2023-07-27T20:31:22.847603+0000","last_unstale":"2023-07-27T20:33:01.583237+0000","last_undegraded":"2023-07-27T20:33:01.583237+0000","last_fullsized":"2023-07-27T20:33:01.583237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:35:21.562826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.746184+0000","last_change":"2023-07-27T20:33:00.586803+0000","last_active":"2023-07-27T20:33:01.746184+0000","last_peered":"2023-07-27T20:33:01.746184+0000","last_clean":"2023-07-27T20:33:01.746184+0000","last_became_active":"2023-07-27T20:33:00.586523+0000","last_became_peered":"2023-07-27T20:33:00.586523+0000","last_unstale":"2023-07-27T20:33:01.746184+0000","last_undegraded":"2023-07-27T20:33:01.746184+0000","last_fullsized":"2023-07-27T20:33:01.746184+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:01:37.390164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.750840+0000","last_change":"2023-07-27T20:32:59.586199+0000","last_active":"2023-07-27T20:33:01.750840+0000","last_peered":"2023-07-27T20:33:01.750840+0000","last_clean":"2023-07-27T20:33:01.750840+0000","last_became_active":"2023-07-27T20:32:59.585937+0000","last_became_peered":"2023-07-27T20:32:59.585937+0000","last_unstale":"2023-07-27T20:33:01.750840+0000","last_undegraded":"2023-07-27T20:33:01.750840+0000","last_fullsized":"2023-07-27T20:33:01.750840+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:33:27.775453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.872677+0000","last_change":"2023-07-27T20:31:22.845641+0000","last_active":"2023-07-27T20:33:01.872677+0000","last_peered":"2023-07-27T20:33:01.872677+0000","last_clean":"2023-07-27T20:33:01.872677+0000","last_became_active":"2023-07-27T20:31:22.845368+0000","last_became_peered":"2023-07-27T20:31:22.845368+0000","last_unstale":"2023-07-27T20:33:01.872677+0000","last_undegraded":"2023-07-27T20:33:01.872677+0000","last_fullsized":"2023-07-27T20:33:01.872677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:41:43.700532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.746195+0000","last_change":"2023-07-27T20:33:00.587812+0000","last_active":"2023-07-27T20:33:01.746195+0000","last_peered":"2023-07-27T20:33:01.746195+0000","last_clean":"2023-07-27T20:33:01.746195+0000","last_became_active":"2023-07-27T20:33:00.587294+0000","last_became_peered":"2023-07-27T20:33:00.587294+0000","last_unstale":"2023-07-27T20:33:01.746195+0000","last_undegraded":"2023-07-27T20:33:01.746195+0000","last_fullsized":"2023-07-27T20:33:01.746195+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:12:28.115055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:01.582956+0000","last_change":"2023-07-27T20:32:59.579629+0000","last_active":"2023-07-27T20:33:01.582956+0000","last_peered":"2023-07-27T20:33:01.582956+0000","last_clean":"2023-07-27T20:33:01.582956+0000","last_became_active":"2023-07-27T20:32:59.579376+0000","last_became_peered":"2023-07-27T20:32:59.579376+0000","last_unstale":"2023-07-27T20:33:01.582956+0000","last_undegraded":"2023-07-27T20:33:01.582956+0000","last_fullsized":"2023-07-27T20:33:01.582956+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:38:33.844373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-27T20:33:02.477896+0000","last_change":"2023-07-27T20:31:22.846540+0000","last_active":"2023-07-27T20:33:02.477896+0000","last_peered":"2023-07-27T20:33:02.477896+0000","last_clean":"2023-07-27T20:33:02.477896+0000","last_became_active":"2023-07-27T20:31:22.846128+0000","last_became_peered":"2023-07-27T20:31:22.846128+0000","last_unstale":"2023-07-27T20:33:02.477896+0000","last_undegraded":"2023-07-27T20:33:02.477896+0000","last_fullsized":"2023-07-27T20:33:02.477896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:07:19.416757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343768,"statfs":{"total":96636764160,"available":96608018432,"internally_reserved":0,"allocated":1073152,"data_stored":803246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":3.5609999999999999,"5min":3.5609999999999999,"15min":3.5609999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.88700000000000001}]},{"osd":1,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":3.927,"5min":3.927,"15min":3.927},"last":0.85399999999999998}]},{"osd":2,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.1589999999999998,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":0.83899999999999997}]},{"osd":3,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.4239999999999999,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":3.1080000000000001,"5min":3.1080000000000001,"15min":3.1080000000000001},"last":0.70399999999999996}]},{"osd":4,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.2730000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.86799999999999999}]},{"osd":5,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":6.1619999999999999,"5min":6.1619999999999999,"15min":6.1619999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":6.2729999999999997,"5min":6.2729999999999997,"15min":6.2729999999999997},"last":0.749}]},{"osd":6,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":3.5289999999999999,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":0.82399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":213460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.71399999999999997}]},{"osd":1,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.879},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.749}]},{"osd":2,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.81100000000000005}]},{"osd":3,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":0.78800000000000003}]},{"osd":4,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.63}]},{"osd":5,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.76200000000000001}]},{"osd":7,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.73099999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":212858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.56299999999999994}]},{"osd":3,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.497}]},{"osd":4,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.79800000000000004}]},{"osd":5,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.748},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.76100000000000001}]},{"osd":6,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.874}]},{"osd":7,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.86199999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343768,"statfs":{"total":96636764160,"available":96608018432,"internally_reserved":0,"allocated":1073152,"data_stored":803190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.307},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.441}]},{"osd":3,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.377},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.40200000000000002}]},{"osd":4,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.751},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.66000000000000003}]},{"osd":5,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.622},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.79900000000000004}]},{"osd":6,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.72299999999999998}]},{"osd":7,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.77000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":491520,"data_stored":214374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":3.2999999999999998,"5min":3.2999999999999998,"15min":3.2999999999999998},"last":0.497}]},{"osd":1,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":3.0600000000000001,"5min":3.0600000000000001,"15min":3.0600000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":3.4580000000000002,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":9.2200000000000006,"5min":9.2200000000000006,"15min":9.2200000000000006},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.64100000000000001}]},{"osd":4,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":4.2930000000000001,"5min":4.2930000000000001,"15min":4.2930000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.91000000000000003}]},{"osd":5,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.82899999999999996}]},{"osd":6,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":3.3999999999999999,"5min":3.3999999999999999,"15min":3.3999999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":3.4990000000000001,"5min":3.4990000000000001,"15min":3.4990000000000001},"last":1.004}]},{"osd":7,"last update":"Thu Jul 27 20:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":1.022}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":487424,"data_stored":213426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":2.1480000000000001,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":0.68400000000000005}]},{"osd":1,"last update":"Thu Jul 27 20:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.70299999999999996}]},{"osd":2,"last update":"Thu Jul 27 20:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":0.62},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.73499999999999999}]},{"osd":4,"last update":"Thu Jul 27 20:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.875}]},{"osd":5,"last update":"Thu Jul 27 20:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.89700000000000002}]},{"osd":6,"last update":"Thu Jul 27 20:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.97899999999999998}]},{"osd":7,"last update":"Thu Jul 27 20:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":1.016}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":487424,"data_stored":214352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.80900000000000005}]},{"osd":1,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.85599999999999998}]},{"osd":2,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.629}]},{"osd":3,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.90900000000000003}]},{"osd":5,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.872},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.73099999999999998}]},{"osd":7,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.94699999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":212858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.745}]},{"osd":1,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.67800000000000005}]},{"osd":2,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.61699999999999999}]},{"osd":3,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.56200000000000006}]},{"osd":4,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.78600000000000003}]},{"osd":6,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.72899999999999998}]},{"osd":7,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.81100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T20:33:10.324 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-27T20:33:10.325 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-27T20:33:10.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.572+0000 7fc0a15ff700 1 Processor -- start 2023-07-27T20:33:10.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.572+0000 7fc0a15ff700 1 -- start start 2023-07-27T20:33:10.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.573+0000 7fc0a15ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc09c06c6f0 0x7fc09c154be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:10.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.573+0000 7fc0a15ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc09c155120 0x7fc09c152490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:10.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.574+0000 7fc0a15ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc09c0c0ae0 con 0x7fc09c154800 2023-07-27T20:33:10.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.574+0000 7fc0a15ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc09c0c0900 con 0x7fc09c155120 2023-07-27T20:33:10.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.574+0000 7fc0a15ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c155570 con 0x7fc09c06c6f0 2023-07-27T20:33:10.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.574+0000 7fc093fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc09c06c6f0 0x7fc09c154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:10.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.574+0000 7fc09affd700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fc09c154800 0x7fc09c14abb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.72:49650/0 (socket says 172.21.15.72:49650) 2023-07-27T20:33:10.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.574+0000 7fc09affd700 1 -- 172.21.15.72:0/2564755754 learned_addr learned my addr 172.21.15.72:0/2564755754 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:10.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.574+0000 7fc09b7fe700 1 --2- 172.21.15.72:0/2564755754 >> v2:172.21.15.173:3300/0 conn(0x7fc09c155120 0x7fc09c152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:10.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.575+0000 7fc09a7fc700 1 -- 172.21.15.72:0/2564755754 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3524928848 0 0) 0x7fc09c0c0ae0 con 0x7fc09c154800 2023-07-27T20:33:10.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.575+0000 7fc093fff700 1 -- 172.21.15.72:0/2564755754 >> v2:172.21.15.173:3300/0 conn(0x7fc09c155120 msgr2=0x7fc09c152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:10.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.575+0000 7fc093fff700 1 --2- 172.21.15.72:0/2564755754 >> v2:172.21.15.173:3300/0 conn(0x7fc09c155120 0x7fc09c152490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:10.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.575+0000 7fc093fff700 1 -- 172.21.15.72:0/2564755754 >> v1:172.21.15.173:6789/0 conn(0x7fc09c154800 legacy=0x7fc09c14abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:10.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.575+0000 7fc093fff700 1 -- 172.21.15.72:0/2564755754 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09c0c0dc0 con 0x7fc09c06c6f0 2023-07-27T20:33:10.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.575+0000 7fc093fff700 1 --2- 172.21.15.72:0/2564755754 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc09c06c6f0 0x7fc09c154be0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc08400bae0 tx=0x7fc08400bdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e81ed8ebe1ef3874 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:10.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.575+0000 7fc09a7fc700 1 -- 172.21.15.72:0/2564755754 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08400dc70 con 0x7fc09c06c6f0 2023-07-27T20:33:10.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.575+0000 7fc09a7fc700 1 -- 172.21.15.72:0/2564755754 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08400ddd0 con 0x7fc09c06c6f0 2023-07-27T20:33:10.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.575+0000 7fc09a7fc700 1 -- 172.21.15.72:0/2564755754 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc084010690 con 0x7fc09c06c6f0 2023-07-27T20:33:10.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.576+0000 7fc0a15ff700 1 -- 172.21.15.72:0/2564755754 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc09c06c6f0 msgr2=0x7fc09c154be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:10.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.576+0000 7fc0a15ff700 1 --2- 172.21.15.72:0/2564755754 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc09c06c6f0 0x7fc09c154be0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc08400bae0 tx=0x7fc08400bdf0 comp rx=0 tx=0).stop 2023-07-27T20:33:10.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.576+0000 7fc0a15ff700 1 -- 172.21.15.72:0/2564755754 shutdown_connections 2023-07-27T20:33:10.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.576+0000 7fc0a15ff700 1 --2- 172.21.15.72:0/2564755754 >> v2:172.21.15.173:3300/0 conn(0x7fc09c155120 0x7fc09c152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:10.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.576+0000 7fc0a15ff700 1 --2- 172.21.15.72:0/2564755754 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc09c06c6f0 0x7fc09c154be0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:10.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.576+0000 7fc0a15ff700 1 -- 172.21.15.72:0/2564755754 >> 172.21.15.72:0/2564755754 conn(0x7fc09c0c55b0 msgr2=0x7fc09c0c59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:10.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.576+0000 7fc0a15ff700 1 -- 172.21.15.72:0/2564755754 shutdown_connections 2023-07-27T20:33:10.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.576+0000 7fc0a15ff700 1 -- 172.21.15.72:0/2564755754 wait complete. 2023-07-27T20:33:10.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.578+0000 7fc0a15ff700 1 Processor -- start 2023-07-27T20:33:10.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.578+0000 7fc0a15ff700 1 -- start start 2023-07-27T20:33:10.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.579+0000 7fc0a15ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc09c06c6f0 0x7fc09c1439e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:10.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.579+0000 7fc0a15ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc09c154800 0x7fc09c1dedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:10.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.579+0000 7fc0a15ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc09c155120 0x7fc09c1ea100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:10.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.579+0000 7fc0a15ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c071f80 con 0x7fc09c154800 2023-07-27T20:33:10.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.579+0000 7fc0a15ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c143f20 con 0x7fc09c155120 2023-07-27T20:33:10.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.579+0000 7fc0a15ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c0719c0 con 0x7fc09c06c6f0 2023-07-27T20:33:10.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.579+0000 7fc093fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc09c154800 0x7fc09c1dedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:10.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.579+0000 7fc093fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc09c154800 0x7fc09c1dedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57620/0 (socket says 172.21.15.72:57620) 2023-07-27T20:33:10.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.579+0000 7fc093fff700 1 -- 172.21.15.72:0/1210103014 learned_addr learned my addr 172.21.15.72:0/1210103014 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:10.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.579+0000 7fc09affd700 1 --2- 172.21.15.72:0/1210103014 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc09c06c6f0 0x7fc09c1439e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:10.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.579+0000 7fc09b7fe700 1 --2- 172.21.15.72:0/1210103014 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc09c155120 0x7fc09c1ea100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:10.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.579+0000 7fc093fff700 1 -- 172.21.15.72:0/1210103014 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc09c06c6f0 msgr2=0x7fc09c1439e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:10.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.579+0000 7fc093fff700 1 --2- 172.21.15.72:0/1210103014 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc09c06c6f0 0x7fc09c1439e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:10.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.579+0000 7fc093fff700 1 -- 172.21.15.72:0/1210103014 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc09c155120 msgr2=0x7fc09c1ea100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:10.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.579+0000 7fc093fff700 1 --2- 172.21.15.72:0/1210103014 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc09c155120 0x7fc09c1ea100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:10.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.579+0000 7fc093fff700 1 -- 172.21.15.72:0/1210103014 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08400b740 con 0x7fc09c154800 2023-07-27T20:33:10.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.580+0000 7fc093fff700 1 --2- 172.21.15.72:0/1210103014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc09c154800 0x7fc09c1dedf0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc08400b2c0 tx=0x7fc084004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:10.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.580+0000 7fc0937fe700 1 -- 172.21.15.72:0/1210103014 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08401d070 con 0x7fc09c154800 2023-07-27T20:33:10.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.580+0000 7fc0937fe700 1 -- 172.21.15.72:0/1210103014 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc084010680 con 0x7fc09c154800 2023-07-27T20:33:10.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.580+0000 7fc0a15ff700 1 -- 172.21.15.72:0/1210103014 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc09c071ca0 con 0x7fc09c154800 2023-07-27T20:33:10.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.580+0000 7fc0937fe700 1 -- 172.21.15.72:0/1210103014 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc084010aa0 con 0x7fc09c154800 2023-07-27T20:33:10.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.580+0000 7fc0a15ff700 1 -- 172.21.15.72:0/1210103014 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc09c1e9be0 con 0x7fc09c154800 2023-07-27T20:33:10.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.581+0000 7fc0a15ff700 1 -- 172.21.15.72:0/1210103014 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc09c1e9760 con 0x7fc09c154800 2023-07-27T20:33:10.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.582+0000 7fc0937fe700 1 -- 172.21.15.72:0/1210103014 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc0840036a0 con 0x7fc09c154800 2023-07-27T20:33:10.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.583+0000 7fc0937fe700 1 --2- 172.21.15.72:0/1210103014 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc07c06ace0 0x7fc07c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:10.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.583+0000 7fc0937fe700 1 -- 172.21.15.72:0/1210103014 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fc08408aba0 con 0x7fc09c154800 2023-07-27T20:33:10.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.583+0000 7fc09affd700 1 --2- 172.21.15.72:0/1210103014 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc07c06ace0 0x7fc07c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:10.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.584+0000 7fc09affd700 1 --2- 172.21.15.72:0/1210103014 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc07c06ace0 0x7fc07c06d1a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc08c007fd0 tx=0x7fc08c007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:10.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.587+0000 7fc0937fe700 1 -- 172.21.15.72:0/1210103014 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc09c1e9760 con 0x7fc09c154800 2023-07-27T20:33:10.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.858+0000 7fc0a15ff700 1 -- 172.21.15.72:0/1210103014 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc09c1e9760 con 0x7fc09c154800 2023-07-27T20:33:10.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.862+0000 7fc0937fe700 1 -- 172.21.15.72:0/1210103014 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7fc09c1e9760 con 0x7fc09c154800 2023-07-27T20:33:10.850 INFO:teuthology.orchestra.run.smithi072.stdout:[client.0] 2023-07-27T20:33:10.850 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDh08Jk6SgHDBAAkcBvssFv+WViV/ToWsnLCA== 2023-07-27T20:33:10.850 INFO:teuthology.orchestra.run.smithi072.stdout: caps mds = "allow" 2023-07-27T20:33:10.850 INFO:teuthology.orchestra.run.smithi072.stdout: caps mon = "allow r" 2023-07-27T20:33:10.850 INFO:teuthology.orchestra.run.smithi072.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-27T20:33:10.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.864+0000 7fc0a15ff700 1 -- 172.21.15.72:0/1210103014 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc07c06ace0 msgr2=0x7fc07c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:10.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.864+0000 7fc0a15ff700 1 --2- 172.21.15.72:0/1210103014 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc07c06ace0 0x7fc07c06d1a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc08c007fd0 tx=0x7fc08c007de0 comp rx=0 tx=0).stop 2023-07-27T20:33:10.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.864+0000 7fc0a15ff700 1 -- 172.21.15.72:0/1210103014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc09c154800 msgr2=0x7fc09c1dedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:10.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.864+0000 7fc0a15ff700 1 --2- 172.21.15.72:0/1210103014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc09c154800 0x7fc09c1dedf0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc08400b2c0 tx=0x7fc084004750 comp rx=0 tx=0).stop 2023-07-27T20:33:10.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.864+0000 7fc0a15ff700 1 -- 172.21.15.72:0/1210103014 shutdown_connections 2023-07-27T20:33:10.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.864+0000 7fc0a15ff700 1 --2- 172.21.15.72:0/1210103014 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc09c155120 0x7fc09c1ea100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:10.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.864+0000 7fc0a15ff700 1 --2- 172.21.15.72:0/1210103014 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc07c06ace0 0x7fc07c06d1a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:10.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.864+0000 7fc0a15ff700 1 --2- 172.21.15.72:0/1210103014 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc09c06c6f0 0x7fc09c1439e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:10.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.864+0000 7fc0a15ff700 1 --2- 172.21.15.72:0/1210103014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc09c154800 0x7fc09c1dedf0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:10.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.864+0000 7fc0a15ff700 1 -- 172.21.15.72:0/1210103014 >> 172.21.15.72:0/1210103014 conn(0x7fc09c0c55b0 msgr2=0x7fc09c0c3c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:10.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.864+0000 7fc0a15ff700 1 -- 172.21.15.72:0/1210103014 shutdown_connections 2023-07-27T20:33:10.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:10.865+0000 7fc0a15ff700 1 -- 172.21.15.72:0/1210103014 wait complete. 2023-07-27T20:33:10.854 INFO:teuthology.orchestra.run.smithi072.stderr:updated caps for client.0 2023-07-27T20:33:10.870 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T20:33:11.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.078+0000 7fcc071ff700 1 Processor -- start 2023-07-27T20:33:11.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.078+0000 7fcc071ff700 1 -- start start 2023-07-27T20:33:11.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.080+0000 7fcc071ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcc0006b150 0x7fcc000c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:11.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.080+0000 7fcc071ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc0006b710 con 0x7fcc000c4400 2023-07-27T20:33:11.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.080+0000 7fcc071ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc0006b9f0 con 0x7fcc001549f0 2023-07-27T20:33:11.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.080+0000 7fcc071ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc001545d0 con 0x7fcc0006b150 2023-07-27T20:33:11.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.080+0000 7fcbfffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcc0006b150 0x7fcc000c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:11.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.080+0000 7fcbfffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcc0006b150 0x7fcc000c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57626/0 (socket says 172.21.15.72:57626) 2023-07-27T20:33:11.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.080+0000 7fcbfffff700 1 -- 172.21.15.72:0/3594325593 learned_addr learned my addr 172.21.15.72:0/3594325593 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:11.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.080+0000 7fcbfffff700 1 -- 172.21.15.72:0/3594325593 >> v1:172.21.15.173:6789/0 conn(0x7fcc001549f0 legacy=0x7fcc001514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:11.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.080+0000 7fcbfffff700 1 -- 172.21.15.72:0/3594325593 >> v1:172.21.15.72:6789/0 conn(0x7fcc000c4400 legacy=0x7fcc000c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:11.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.080+0000 7fcbfffff700 1 -- 172.21.15.72:0/3594325593 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc0006bcd0 con 0x7fcc0006b150 2023-07-27T20:33:11.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.080+0000 7fcbff7fe700 1 -- 172.21.15.72:0/3594325593 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3046977213 0 0) 0x7fcc0006b710 con 0x7fcc000c4400 2023-07-27T20:33:11.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.081+0000 7fcbfffff700 1 --2- 172.21.15.72:0/3594325593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc0006b150 0x7fcc000c7710 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fcbec0098f0 tx=0x7fcbec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a2946b66f1f99ce server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:11.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.081+0000 7fcbff7fe700 1 -- 172.21.15.72:0/3594325593 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbec00b8a0 con 0x7fcc0006b150 2023-07-27T20:33:11.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.081+0000 7fcbff7fe700 1 -- 172.21.15.72:0/3594325593 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbec00ba00 con 0x7fcc0006b150 2023-07-27T20:33:11.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.081+0000 7fcbff7fe700 1 -- 172.21.15.72:0/3594325593 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbec00bd90 con 0x7fcc0006b150 2023-07-27T20:33:11.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.081+0000 7fcc071ff700 1 -- 172.21.15.72:0/3594325593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc0006b150 msgr2=0x7fcc000c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:11.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.081+0000 7fcc071ff700 1 --2- 172.21.15.72:0/3594325593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc0006b150 0x7fcc000c7710 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fcbec0098f0 tx=0x7fcbec009c00 comp rx=0 tx=0).stop 2023-07-27T20:33:11.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.081+0000 7fcc071ff700 1 -- 172.21.15.72:0/3594325593 shutdown_connections 2023-07-27T20:33:11.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.081+0000 7fcc071ff700 1 --2- 172.21.15.72:0/3594325593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc0006b150 0x7fcc000c7710 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:11.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.081+0000 7fcc071ff700 1 -- 172.21.15.72:0/3594325593 >> 172.21.15.72:0/3594325593 conn(0x7fcc000ab300 msgr2=0x7fcc000ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:11.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.082+0000 7fcc071ff700 1 -- 172.21.15.72:0/3594325593 shutdown_connections 2023-07-27T20:33:11.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.082+0000 7fcc071ff700 1 -- 172.21.15.72:0/3594325593 wait complete. 2023-07-27T20:33:11.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.083+0000 7fcc071ff700 1 Processor -- start 2023-07-27T20:33:11.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.083+0000 7fcc071ff700 1 -- start start 2023-07-27T20:33:11.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.084+0000 7fcc071ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcc0006b150 0x7fcc001e98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:11.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.084+0000 7fcc071ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc000c4400 0x7fcc0014a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:11.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.084+0000 7fcc071ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc001549f0 0x7fcc000ae810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:11.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.084+0000 7fcc071ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc000c3830 con 0x7fcc001549f0 2023-07-27T20:33:11.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.084+0000 7fcc071ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc000bf700 con 0x7fcc000c4400 2023-07-27T20:33:11.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.084+0000 7fcc071ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc001e9e00 con 0x7fcc0006b150 2023-07-27T20:33:11.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.084+0000 7fcc0579c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc001549f0 0x7fcc000ae810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:11.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.084+0000 7fcc0579c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc001549f0 0x7fcc000ae810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57630/0 (socket says 172.21.15.72:57630) 2023-07-27T20:33:11.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.084+0000 7fcc0579c700 1 -- 172.21.15.72:0/1192067073 learned_addr learned my addr 172.21.15.72:0/1192067073 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:11.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.084+0000 7fcbfffff700 1 --2- 172.21.15.72:0/1192067073 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc000c4400 0x7fcc0014a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:11.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.085+0000 7fcc04f9b700 1 --2- 172.21.15.72:0/1192067073 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcc0006b150 0x7fcc001e98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:11.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.085+0000 7fcc0579c700 1 -- 172.21.15.72:0/1192067073 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcc0006b150 msgr2=0x7fcc001e98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:11.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.085+0000 7fcc0579c700 1 --2- 172.21.15.72:0/1192067073 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcc0006b150 0x7fcc001e98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:11.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.085+0000 7fcc0579c700 1 -- 172.21.15.72:0/1192067073 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc000c4400 msgr2=0x7fcc0014a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:11.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.085+0000 7fcc0579c700 1 --2- 172.21.15.72:0/1192067073 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc000c4400 0x7fcc0014a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:11.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.085+0000 7fcc0579c700 1 -- 172.21.15.72:0/1192067073 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbec009550 con 0x7fcc001549f0 2023-07-27T20:33:11.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.085+0000 7fcc0579c700 1 --2- 172.21.15.72:0/1192067073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc001549f0 0x7fcc000ae810 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fcbf800cc80 tx=0x7fcbf800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:11.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.085+0000 7fcbfd7fa700 1 -- 172.21.15.72:0/1192067073 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf8003c00 con 0x7fcc001549f0 2023-07-27T20:33:11.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.085+0000 7fcbfd7fa700 1 -- 172.21.15.72:0/1192067073 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf8003d60 con 0x7fcc001549f0 2023-07-27T20:33:11.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.085+0000 7fcc071ff700 1 -- 172.21.15.72:0/1192067073 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc000bff80 con 0x7fcc001549f0 2023-07-27T20:33:11.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.085+0000 7fcbfd7fa700 1 -- 172.21.15.72:0/1192067073 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf800ab50 con 0x7fcc001549f0 2023-07-27T20:33:11.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.085+0000 7fcc071ff700 1 -- 172.21.15.72:0/1192067073 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc0014f410 con 0x7fcc001549f0 2023-07-27T20:33:11.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.086+0000 7fcc071ff700 1 -- 172.21.15.72:0/1192067073 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc000bdfb0 con 0x7fcc001549f0 2023-07-27T20:33:11.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.087+0000 7fcbfd7fa700 1 -- 172.21.15.72:0/1192067073 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcbf800acb0 con 0x7fcc001549f0 2023-07-27T20:33:11.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.088+0000 7fcbfd7fa700 1 --2- 172.21.15.72:0/1192067073 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcbe406ace0 0x7fcbe406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:11.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.089+0000 7fcbfd7fa700 1 -- 172.21.15.72:0/1192067073 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fcbf80896b0 con 0x7fcc001549f0 2023-07-27T20:33:11.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.089+0000 7fcc04f9b700 1 --2- 172.21.15.72:0/1192067073 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcbe406ace0 0x7fcbe406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:11.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.090+0000 7fcc04f9b700 1 --2- 172.21.15.72:0/1192067073 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcbe406ace0 0x7fcbe406d1a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcc000bd720 tx=0x7fcbf4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:11.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.092+0000 7fcbfd7fa700 1 -- 172.21.15.72:0/1192067073 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcbf80545d0 con 0x7fcc001549f0 2023-07-27T20:33:11.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.333+0000 7fcc071ff700 1 -- 172.21.15.72:0/1192067073 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc000c0110 con 0x7fcc001549f0 2023-07-27T20:33:11.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.334+0000 7fcbfd7fa700 1 -- 172.21.15.72:0/1192067073 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4671 (secure 0 0 0) 0x7fcbf8057bf0 con 0x7fcc001549f0 2023-07-27T20:33:11.322 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:33:11.323 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/1685903768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1685903768},{"type":"v1","addr":"172.21.15.173:6836","nonce":1685903768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5269,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/43862591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":43862591},{"type":"v1","addr":"172.21.15.173:6837","nonce":43862591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/1644610738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1644610738},{"type":"v1","addr":"172.21.15.72:6835","nonce":1644610738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T20:33:00.054239+0000","modified":"2023-07-27T20:33:03.586058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5409},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5409":{"gid":5409,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.72:6834/1959104268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":1959104268},{"type":"v1","addr":"172.21.15.72:6834","nonce":1959104268}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-27T20:33:11.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.336+0000 7fcc071ff700 1 -- 172.21.15.72:0/1192067073 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcbe406ace0 msgr2=0x7fcbe406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:11.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.336+0000 7fcc071ff700 1 --2- 172.21.15.72:0/1192067073 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcbe406ace0 0x7fcbe406d1a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcc000bd720 tx=0x7fcbf4009040 comp rx=0 tx=0).stop 2023-07-27T20:33:11.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.336+0000 7fcc071ff700 1 -- 172.21.15.72:0/1192067073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc001549f0 msgr2=0x7fcc000ae810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:11.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.336+0000 7fcc071ff700 1 --2- 172.21.15.72:0/1192067073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc001549f0 0x7fcc000ae810 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fcbf800cc80 tx=0x7fcbf800cf90 comp rx=0 tx=0).stop 2023-07-27T20:33:11.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.336+0000 7fcc071ff700 1 -- 172.21.15.72:0/1192067073 shutdown_connections 2023-07-27T20:33:11.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.336+0000 7fcc071ff700 1 --2- 172.21.15.72:0/1192067073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc001549f0 0x7fcc000ae810 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:11.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.336+0000 7fcc071ff700 1 --2- 172.21.15.72:0/1192067073 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcbe406ace0 0x7fcbe406d1a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:11.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.336+0000 7fcc071ff700 1 --2- 172.21.15.72:0/1192067073 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcc0006b150 0x7fcc001e98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:11.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.336+0000 7fcc071ff700 1 --2- 172.21.15.72:0/1192067073 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc000c4400 0x7fcc0014a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:11.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.336+0000 7fcc071ff700 1 -- 172.21.15.72:0/1192067073 >> 172.21.15.72:0/1192067073 conn(0x7fcc000ab300 msgr2=0x7fcc000c73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:11.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.336+0000 7fcc071ff700 1 -- 172.21.15.72:0/1192067073 shutdown_connections 2023-07-27T20:33:11.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.336+0000 7fcc071ff700 1 -- 172.21.15.72:0/1192067073 wait complete. 2023-07-27T20:33:11.327 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 17 2023-07-27T20:33:11.743 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-27T20:33:00.054239+0000', 'modified': '2023-07-27T20:33:03.586058+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5409}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5409': {'gid': 5409, 'name': 'c', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.72:6834/1959104268', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6833', 'nonce': 1959104268}, {'type': 'v1', 'addr': '172.21.15.72:6834', 'nonce': 1959104268}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-27T20:33:11.744 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-27T20:33:11.744 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-27T20:33:11.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.956+0000 7f86471ff700 1 Processor -- start 2023-07-27T20:33:11.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.957+0000 7f86471ff700 1 -- start start 2023-07-27T20:33:11.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.958+0000 7f86471ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f86400c4400 0x7f86400c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:11.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.958+0000 7f86471ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86401549f0 0x7f86401514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:11.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.958+0000 7f86471ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f864006b710 con 0x7f864006b150 2023-07-27T20:33:11.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.958+0000 7f86471ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86401545d0 con 0x7f86400c4400 2023-07-27T20:33:11.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.958+0000 7f86471ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f864006c860 con 0x7f86401549f0 2023-07-27T20:33:11.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.958+0000 7f8644f9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f86400c4400 0x7f86400c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:11.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.958+0000 7f8644f9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f86400c4400 0x7f86400c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57644/0 (socket says 172.21.15.72:57644) 2023-07-27T20:33:11.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.958+0000 7f8644f9b700 1 -- 172.21.15.72:0/3579176556 learned_addr learned my addr 172.21.15.72:0/3579176556 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:11.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.958+0000 7f864579c700 1 --2- 172.21.15.72:0/3579176556 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86401549f0 0x7f86401514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:11.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.958+0000 7f8644f9b700 1 -- 172.21.15.72:0/3579176556 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86401549f0 msgr2=0x7f86401514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:11.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.958+0000 7f8644f9b700 1 --2- 172.21.15.72:0/3579176556 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86401549f0 0x7f86401514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:11.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.958+0000 7f8644f9b700 1 -- 172.21.15.72:0/3579176556 >> v1:172.21.15.173:6789/0 conn(0x7f864006b150 legacy=0x7f86400c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:11.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.958+0000 7f8644f9b700 1 -- 172.21.15.72:0/3579176556 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864006b9f0 con 0x7f86400c4400 2023-07-27T20:33:11.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.959+0000 7f8644f9b700 1 --2- 172.21.15.72:0/3579176556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86400c4400 0x7f86400c7710 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f86340098f0 tx=0x7f8634009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06481614b45c158 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:11.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.959+0000 7f863f7fe700 1 -- 172.21.15.72:0/3579176556 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8634011830 con 0x7f86400c4400 2023-07-27T20:33:11.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.959+0000 7f863f7fe700 1 -- 172.21.15.72:0/3579176556 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8634011990 con 0x7f86400c4400 2023-07-27T20:33:11.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.959+0000 7f863f7fe700 1 -- 172.21.15.72:0/3579176556 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8634011d20 con 0x7f86400c4400 2023-07-27T20:33:11.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.959+0000 7f86471ff700 1 -- 172.21.15.72:0/3579176556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86400c4400 msgr2=0x7f86400c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:11.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.959+0000 7f86471ff700 1 --2- 172.21.15.72:0/3579176556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86400c4400 0x7f86400c7710 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f86340098f0 tx=0x7f8634009c00 comp rx=0 tx=0).stop 2023-07-27T20:33:11.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.960+0000 7f86471ff700 1 -- 172.21.15.72:0/3579176556 shutdown_connections 2023-07-27T20:33:11.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.960+0000 7f86471ff700 1 --2- 172.21.15.72:0/3579176556 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86401549f0 0x7f86401514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:11.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.960+0000 7f86471ff700 1 --2- 172.21.15.72:0/3579176556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86400c4400 0x7f86400c7710 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:11.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.960+0000 7f86471ff700 1 -- 172.21.15.72:0/3579176556 >> 172.21.15.72:0/3579176556 conn(0x7f86400ab300 msgr2=0x7f86400ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:11.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.960+0000 7f86471ff700 1 -- 172.21.15.72:0/3579176556 shutdown_connections 2023-07-27T20:33:11.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.960+0000 7f86471ff700 1 -- 172.21.15.72:0/3579176556 wait complete. 2023-07-27T20:33:11.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.961+0000 7f86471ff700 1 Processor -- start 2023-07-27T20:33:11.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.962+0000 7f86471ff700 1 -- start start 2023-07-27T20:33:11.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.962+0000 7f86471ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f864006b150 0x7f86400ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:11.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.962+0000 7f86471ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86400c4400 0x7f86400bd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:11.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.962+0000 7f86471ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86401549f0 0x7f86400bddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:11.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.962+0000 7f86471ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86401ed670 con 0x7f864006b150 2023-07-27T20:33:11.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.962+0000 7f86471ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86401ec810 con 0x7f86401549f0 2023-07-27T20:33:11.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.962+0000 7f86471ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86401eca60 con 0x7f86400c4400 2023-07-27T20:33:11.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.963+0000 7f8644f9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f864006b150 0x7f86400ae3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:11.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.963+0000 7f8644f9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f864006b150 0x7f86400ae3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57658/0 (socket says 172.21.15.72:57658) 2023-07-27T20:33:11.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.963+0000 7f8644f9b700 1 -- 172.21.15.72:0/1073853787 learned_addr learned my addr 172.21.15.72:0/1073853787 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:11.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.963+0000 7f863ffff700 1 --2- 172.21.15.72:0/1073853787 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86400c4400 0x7f86400bd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:11.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.963+0000 7f864579c700 1 --2- 172.21.15.72:0/1073853787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86401549f0 0x7f86400bddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:11.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.963+0000 7f8644f9b700 1 -- 172.21.15.72:0/1073853787 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86400c4400 msgr2=0x7f86400bd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:11.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.963+0000 7f8644f9b700 1 --2- 172.21.15.72:0/1073853787 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86400c4400 0x7f86400bd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:11.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.963+0000 7f8644f9b700 1 -- 172.21.15.72:0/1073853787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86401549f0 msgr2=0x7f86400bddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:11.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.963+0000 7f8644f9b700 1 --2- 172.21.15.72:0/1073853787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86401549f0 0x7f86400bddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:11.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.963+0000 7f8644f9b700 1 -- 172.21.15.72:0/1073853787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8634009550 con 0x7f864006b150 2023-07-27T20:33:11.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.963+0000 7f863ffff700 1 --2- 172.21.15.72:0/1073853787 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86400c4400 0x7f86400bd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:33:11.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.963+0000 7f864579c700 1 --2- 172.21.15.72:0/1073853787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86401549f0 0x7f86400bddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:33:11.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.963+0000 7f8644f9b700 1 --2- 172.21.15.72:0/1073853787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f864006b150 0x7f86400ae3b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8634000c00 tx=0x7f8634004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:11.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.964+0000 7f863d7fa700 1 -- 172.21.15.72:0/1073853787 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8634004570 con 0x7f864006b150 2023-07-27T20:33:11.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.964+0000 7f863d7fa700 1 -- 172.21.15.72:0/1073853787 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863401f070 con 0x7f864006b150 2023-07-27T20:33:11.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.964+0000 7f863d7fa700 1 -- 172.21.15.72:0/1073853787 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86340038c0 con 0x7f864006b150 2023-07-27T20:33:11.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.964+0000 7f86471ff700 1 -- 172.21.15.72:0/1073853787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86401ecd40 con 0x7f864006b150 2023-07-27T20:33:11.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.964+0000 7f86471ff700 1 -- 172.21.15.72:0/1073853787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86401ed300 con 0x7f864006b150 2023-07-27T20:33:11.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.966+0000 7f863d7fa700 1 -- 172.21.15.72:0/1073853787 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8634021030 con 0x7f864006b150 2023-07-27T20:33:11.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.967+0000 7f863d7fa700 1 --2- 172.21.15.72:0/1073853787 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f862406ace0 0x7f862406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:11.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.967+0000 7f863d7fa700 1 -- 172.21.15.72:0/1073853787 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f863408aa30 con 0x7f864006b150 2023-07-27T20:33:11.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.967+0000 7f863ffff700 1 --2- 172.21.15.72:0/1073853787 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f862406ace0 0x7f862406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:11.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.968+0000 7f863ffff700 1 --2- 172.21.15.72:0/1073853787 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f862406ace0 0x7f862406d1a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f86400c3d50 tx=0x7f862c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:11.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.968+0000 7f865abe9b80 1 Processor -- start 2023-07-27T20:33:11.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.969+0000 7f865abe9b80 1 -- start start 2023-07-27T20:33:11.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.969+0000 7f865abe9b80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55de649cdd20 0x55de649b1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:11.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.969+0000 7f865abe9b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de649ce100 0x55de649aadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:11.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.969+0000 7f865abe9b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55de649ce580 0x55de649ab2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:11.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.969+0000 7f865abe9b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de64924ab0 con 0x55de649ce580 2023-07-27T20:33:11.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.969+0000 7f865abe9b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de64909440 con 0x55de649ce100 2023-07-27T20:33:11.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.969+0000 7f865abe9b80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55de64906ba0 con 0x55de649cdd20 2023-07-27T20:33:11.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.970+0000 7f864579c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55de649ce580 0x55de649ab2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:11.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.970+0000 7f864579c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55de649ce580 0x55de649ab2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57672/0 (socket says 172.21.15.72:57672) 2023-07-27T20:33:11.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.970+0000 7f864579c700 1 -- 172.21.15.72:0/4267427279 learned_addr learned my addr 172.21.15.72:0/4267427279 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:11.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.970+0000 7f8644f9b700 1 --2- 172.21.15.72:0/4267427279 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55de649cdd20 0x55de649b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:11.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.970+0000 7f864579c700 1 -- 172.21.15.72:0/4267427279 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55de649cdd20 msgr2=0x55de649b1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:11.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.970+0000 7f864579c700 1 --2- 172.21.15.72:0/4267427279 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55de649cdd20 0x55de649b1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:11.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.970+0000 7f864579c700 1 -- 172.21.15.72:0/4267427279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de649ce100 msgr2=0x55de649aadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:11.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.970+0000 7f863ffff700 1 --2- 172.21.15.72:0/4267427279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de649ce100 0x55de649aadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:11.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.970+0000 7f864579c700 1 --2- 172.21.15.72:0/4267427279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de649ce100 0x55de649aadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:11.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.970+0000 7f864579c700 1 -- 172.21.15.72:0/4267427279 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de646f5790 con 0x55de649ce580 2023-07-27T20:33:11.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.970+0000 7f863ffff700 1 --2- 172.21.15.72:0/4267427279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de649ce100 0x55de649aadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:33:11.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.970+0000 7f864579c700 1 --2- 172.21.15.72:0/4267427279 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55de649ce580 0x55de649ab2f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f86380076e0 tx=0x7f8638009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa5e3b8017b3c799 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:11.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.970+0000 7f862a7fc700 1 -- 172.21.15.72:0/4267427279 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86380147e0 con 0x55de649ce580 2023-07-27T20:33:11.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.971+0000 7f862a7fc700 1 -- 172.21.15.72:0/4267427279 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863800f050 con 0x55de649ce580 2023-07-27T20:33:11.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.971+0000 7f862a7fc700 1 -- 172.21.15.72:0/4267427279 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8638014b40 con 0x55de649ce580 2023-07-27T20:33:11.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.971+0000 7f865abe9b80 1 -- 172.21.15.72:0/4267427279 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55de649ce580 msgr2=0x55de649ab2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:11.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.971+0000 7f865abe9b80 1 --2- 172.21.15.72:0/4267427279 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55de649ce580 0x55de649ab2f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f86380076e0 tx=0x7f8638009750 comp rx=0 tx=0).stop 2023-07-27T20:33:11.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.971+0000 7f865abe9b80 1 -- 172.21.15.72:0/4267427279 shutdown_connections 2023-07-27T20:33:11.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.971+0000 7f865abe9b80 1 --2- 172.21.15.72:0/4267427279 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55de649ce580 0x55de649ab2f0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:11.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.971+0000 7f865abe9b80 1 --2- 172.21.15.72:0/4267427279 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55de649cdd20 0x55de649b1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:11.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.971+0000 7f865abe9b80 1 --2- 172.21.15.72:0/4267427279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de649ce100 0x55de649aadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:11.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.971+0000 7f865abe9b80 1 -- 172.21.15.72:0/4267427279 >> 172.21.15.72:0/4267427279 conn(0x55de649103a0 msgr2=0x55de649adce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:11.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.971+0000 7f865abe9b80 1 -- 172.21.15.72:0/4267427279 shutdown_connections 2023-07-27T20:33:11.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.971+0000 7f865abe9b80 1 -- 172.21.15.72:0/4267427279 wait complete. 2023-07-27T20:33:11.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.972+0000 7f865abe9b80 1 -- start start 2023-07-27T20:33:11.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.972+0000 7f865abe9b80 1 Processor -- start 2023-07-27T20:33:11.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.973+0000 7f865abe9b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de649cdd20 0x55de649efb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:11.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.973+0000 7f865abe9b80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55de649ce100 0x55de649e9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:11.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.973+0000 7f865abe9b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55de649ce580 0x55de649e7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:11.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.973+0000 7f865abe9b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de64902490 con 0x55de649ce580 2023-07-27T20:33:11.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.973+0000 7f865abe9b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de648bf5b0 con 0x55de649cdd20 2023-07-27T20:33:11.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.973+0000 7f865abe9b80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55de648a5910 con 0x55de649ce100 2023-07-27T20:33:11.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.973+0000 7f865abe9b80 10 client.0 _ll_register_callbacks cb 0x55de646fea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-27T20:33:11.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.974+0000 7f864579c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55de649ce580 0x55de649e7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:11.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.974+0000 7f864579c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55de649ce580 0x55de649e7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57686/0 (socket says 172.21.15.72:57686) 2023-07-27T20:33:11.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.974+0000 7f864579c700 1 -- 172.21.15.72:0/3633238657 learned_addr learned my addr 172.21.15.72:0/3633238657 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:11.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.974+0000 7f863ffff700 1 --2- 172.21.15.72:0/3633238657 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55de649ce100 0x55de649e9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:11.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.974+0000 7f8644f9b700 1 --2- 172.21.15.72:0/3633238657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de649cdd20 0x55de649efb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:11.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.974+0000 7f864579c700 1 -- 172.21.15.72:0/3633238657 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55de649ce100 msgr2=0x55de649e9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:11.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.974+0000 7f864579c700 1 --2- 172.21.15.72:0/3633238657 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55de649ce100 0x55de649e9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:11.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.974+0000 7f864579c700 1 -- 172.21.15.72:0/3633238657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de649cdd20 msgr2=0x55de649efb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:11.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.974+0000 7f864579c700 1 --2- 172.21.15.72:0/3633238657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de649cdd20 0x55de649efb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:11.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.974+0000 7f864579c700 1 -- 172.21.15.72:0/3633238657 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8638007330 con 0x55de649ce580 2023-07-27T20:33:11.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.974+0000 7f864579c700 1 --2- 172.21.15.72:0/3633238657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55de649ce580 0x55de649e7590 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f8638009790 tx=0x7f8638004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c44a20f4ac525a1 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:11.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.974+0000 7f861f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-07-27T20:33:11.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.975+0000 7f861f7fe700 1 -- 172.21.15.72:0/3633238657 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8638015880 con 0x55de649ce580 2023-07-27T20:33:11.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.975+0000 7f865abe9b80 1 -- 172.21.15.72:0/3633238657 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55de649a2d80 con 0x55de649ce580 2023-07-27T20:33:11.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.975+0000 7f861f7fe700 1 -- 172.21.15.72:0/3633238657 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f8638025070 con 0x55de649ce580 2023-07-27T20:33:11.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.975+0000 7f861f7fe700 1 -- 172.21.15.72:0/3633238657 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8638014e60 con 0x55de649ce580 2023-07-27T20:33:11.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.975+0000 7f865abe9b80 10 client.5601 fetch_fsmap learned FSMap version 17 2023-07-27T20:33:11.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.975+0000 7f865abe9b80 1 -- 172.21.15.72:0/3633238657 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55de647e20a0 con 0x55de649ce580 2023-07-27T20:33:11.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.975+0000 7f861f7fe700 1 -- 172.21.15.72:0/3633238657 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55de649a2d80 con 0x55de649ce580 2023-07-27T20:33:11.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.975+0000 7f861f7fe700 1 -- 172.21.15.72:0/3633238657 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f86380159e0 con 0x55de649ce580 2023-07-27T20:33:11.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.975+0000 7f865abe9b80 10 client.5601 fetch_fsmap finished waiting for FSMap version 17 2023-07-27T20:33:11.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.975+0000 7f865abe9b80 10 client.5601 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-27T20:33:11.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.975+0000 7f865abe9b80 20 client.5601 populate_metadata read hostname 'smithi072' 2023-07-27T20:33:11.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.975+0000 7f865abe9b80 1 --2- 172.21.15.72:0/3633238657 >> [v2:172.21.15.72:6833/1959104268,v1:172.21.15.72:6834/1959104268] conn(0x55de649fc220 0x55de649feae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:11.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.975+0000 7f865abe9b80 4 client.5601 mds_command: new command op to 5409 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-27T20:33:11.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.975+0000 7f865abe9b80 1 -- 172.21.15.72:0/3633238657 --> [v2:172.21.15.72:6833/1959104268,v1:172.21.15.72:6834/1959104268] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55de6497fb50 con 0x55de649fc220 2023-07-27T20:33:11.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.976+0000 7f8644f9b700 1 --2- 172.21.15.72:0/3633238657 >> [v2:172.21.15.72:6833/1959104268,v1:172.21.15.72:6834/1959104268] conn(0x55de649fc220 0x55de649feae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:11.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.976+0000 7f861f7fe700 10 client.5601 ms_handle_connect on v2:172.21.15.72:6833/1959104268 2023-07-27T20:33:11.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.976+0000 7f8644f9b700 1 --2- 172.21.15.72:0/3633238657 >> [v2:172.21.15.72:6833/1959104268,v1:172.21.15.72:6834/1959104268] conn(0x55de649fc220 0x55de649feae0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=744a8a754267e5ff server_cookie=add161a8638233b1 in_seq=0 out_seq=0 2023-07-27T20:33:11.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.977+0000 7f861f7fe700 1 -- 172.21.15.72:0/3633238657 <== mds.0 v2:172.21.15.72:6833/1959104268 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55de6497fb50 con 0x55de649fc220 2023-07-27T20:33:11.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.977+0000 7f861f7fe700 10 client.5601 handle_command_reply: tid=0 2023-07-27T20:33:11.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.977+0000 7f865abe9b80 1 client.5601 shutdown 2023-07-27T20:33:11.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.977+0000 7f865abe9b80 1 -- 172.21.15.72:0/3633238657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55de649ce580 msgr2=0x55de649e7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:11.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.977+0000 7f865abe9b80 1 --2- 172.21.15.72:0/3633238657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55de649ce580 0x55de649e7590 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f8638009790 tx=0x7f8638004b40 comp rx=0 tx=0).stop 2023-07-27T20:33:11.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.977+0000 7f865abe9b80 1 -- 172.21.15.72:0/3633238657 shutdown_connections 2023-07-27T20:33:11.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.977+0000 7f865abe9b80 1 --2- 172.21.15.72:0/3633238657 >> [v2:172.21.15.72:6833/1959104268,v1:172.21.15.72:6834/1959104268] conn(0x55de649fc220 0x55de649feae0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:11.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.977+0000 7f865abe9b80 1 --2- 172.21.15.72:0/3633238657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55de649ce580 0x55de649e7590 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:11.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.977+0000 7f865abe9b80 1 --2- 172.21.15.72:0/3633238657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de649cdd20 0x55de649efb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:11.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.977+0000 7f865abe9b80 1 --2- 172.21.15.72:0/3633238657 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55de649ce100 0x55de649e9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:11.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.977+0000 7f861f7fe700 0 client.5601 ms_handle_reset on v2:172.21.15.72:6833/1959104268 2023-07-27T20:33:11.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.977+0000 7f865abe9b80 1 -- 172.21.15.72:0/3633238657 >> 172.21.15.72:0/3633238657 conn(0x55de649103a0 msgr2=0x55de649aa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:11.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.977+0000 7f865abe9b80 1 -- 172.21.15.72:0/3633238657 shutdown_connections 2023-07-27T20:33:11.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.977+0000 7f865abe9b80 1 -- 172.21.15.72:0/3633238657 wait complete. 2023-07-27T20:33:11.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.977+0000 7f865abe9b80 20 client.5601 trim_cache size 0 max 16384 2023-07-27T20:33:11.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.995+0000 7f865abe9b80 1 Processor -- start 2023-07-27T20:33:11.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.995+0000 7f865abe9b80 1 -- start start 2023-07-27T20:33:11.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.996+0000 7f865abe9b80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55de649cdd20 0x55de649eaac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:11.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.996+0000 7f865abe9b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de649ce100 0x55de649e5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:11.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.996+0000 7f865abe9b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55de649ce580 0x55de649e6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:11.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.996+0000 7f865abe9b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de646f6390 con 0x55de649ce580 2023-07-27T20:33:11.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.996+0000 7f865abe9b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de649ec280 con 0x55de649ce100 2023-07-27T20:33:11.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.996+0000 7f865abe9b80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55de649eff10 con 0x55de649cdd20 2023-07-27T20:33:11.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.996+0000 7f864579c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55de649ce580 0x55de649e6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:11.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.996+0000 7f864579c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55de649ce580 0x55de649e6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57696/0 (socket says 172.21.15.72:57696) 2023-07-27T20:33:11.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.996+0000 7f864579c700 1 -- 172.21.15.72:0/3173726567 learned_addr learned my addr 172.21.15.72:0/3173726567 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:11.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.996+0000 7f8644f9b700 1 --2- 172.21.15.72:0/3173726567 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55de649cdd20 0x55de649eaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:11.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.996+0000 7f864579c700 1 -- 172.21.15.72:0/3173726567 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55de649cdd20 msgr2=0x55de649eaac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:11.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.996+0000 7f863ffff700 1 --2- 172.21.15.72:0/3173726567 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de649ce100 0x55de649e5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:11.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.996+0000 7f864579c700 1 --2- 172.21.15.72:0/3173726567 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55de649cdd20 0x55de649eaac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:11.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.996+0000 7f864579c700 1 -- 172.21.15.72:0/3173726567 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de649ce100 msgr2=0x55de649e5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:11.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.996+0000 7f864579c700 1 --2- 172.21.15.72:0/3173726567 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de649ce100 0x55de649e5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:11.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.996+0000 7f864579c700 1 -- 172.21.15.72:0/3173726567 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de648c7b10 con 0x55de649ce580 2023-07-27T20:33:11.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.996+0000 7f8644f9b700 1 --2- 172.21.15.72:0/3173726567 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55de649cdd20 0x55de649eaac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:33:11.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.997+0000 7f864579c700 1 --2- 172.21.15.72:0/3173726567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55de649ce580 0x55de649e6460 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f863802aa10 tx=0x7f8638021070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd9065c62fde09e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:11.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.997+0000 7f862affd700 1 -- 172.21.15.72:0/3173726567 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8638009cc0 con 0x55de649ce580 2023-07-27T20:33:11.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.997+0000 7f862affd700 1 -- 172.21.15.72:0/3173726567 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8638023070 con 0x55de649ce580 2023-07-27T20:33:11.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.997+0000 7f862affd700 1 -- 172.21.15.72:0/3173726567 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863802ad70 con 0x55de649ce580 2023-07-27T20:33:11.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.997+0000 7f865abe9b80 1 -- 172.21.15.72:0/3173726567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55de649ce580 msgr2=0x55de649e6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:11.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.997+0000 7f865abe9b80 1 --2- 172.21.15.72:0/3173726567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55de649ce580 0x55de649e6460 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f863802aa10 tx=0x7f8638021070 comp rx=0 tx=0).stop 2023-07-27T20:33:11.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.997+0000 7f865abe9b80 1 -- 172.21.15.72:0/3173726567 shutdown_connections 2023-07-27T20:33:11.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.997+0000 7f865abe9b80 1 --2- 172.21.15.72:0/3173726567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55de649ce580 0x55de649e6460 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:11.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.997+0000 7f865abe9b80 1 --2- 172.21.15.72:0/3173726567 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55de649cdd20 0x55de649eaac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:11.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.997+0000 7f865abe9b80 1 --2- 172.21.15.72:0/3173726567 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de649ce100 0x55de649e5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:11.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.997+0000 7f865abe9b80 1 -- 172.21.15.72:0/3173726567 >> 172.21.15.72:0/3173726567 conn(0x55de649103a0 msgr2=0x55de649b0540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:11.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.998+0000 7f865abe9b80 1 -- 172.21.15.72:0/3173726567 shutdown_connections 2023-07-27T20:33:11.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.998+0000 7f865abe9b80 1 -- 172.21.15.72:0/3173726567 wait complete. 2023-07-27T20:33:11.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.998+0000 7f865abe9b80 1 -- start start 2023-07-27T20:33:11.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.998+0000 7f865abe9b80 1 Processor -- start 2023-07-27T20:33:11.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.999+0000 7f865abe9b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55de649cdd20 0x55de649f0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:11.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.999+0000 7f865abe9b80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55de649ce100 0x55de64a56090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:11.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.999+0000 7f865abe9b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de649ce580 0x55de64a4fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:11.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.999+0000 7f865abe9b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de649c6920 con 0x55de649cdd20 2023-07-27T20:33:11.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.999+0000 7f865abe9b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de64a56db0 con 0x55de649ce580 2023-07-27T20:33:11.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.999+0000 7f865abe9b80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55de649fb610 con 0x55de649ce100 2023-07-27T20:33:11.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.999+0000 7f865abe9b80 10 client.0 _ll_register_callbacks cb 0x55de646fea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-27T20:33:11.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.999+0000 7f8644f9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55de649cdd20 0x55de649f0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:11.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:11.999+0000 7f8644f9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55de649cdd20 0x55de649f0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57708/0 (socket says 172.21.15.72:57708) 2023-07-27T20:33:11.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.000+0000 7f8644f9b700 1 -- 172.21.15.72:0/1895995879 learned_addr learned my addr 172.21.15.72:0/1895995879 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:11.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.000+0000 7f8644f9b700 1 -- 172.21.15.72:0/1895995879 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55de649ce100 msgr2=0x55de64a56090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:11.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.000+0000 7f863ffff700 1 --2- 172.21.15.72:0/1895995879 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55de649ce100 0x55de64a56090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:11.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.000+0000 7f8644f9b700 1 --2- 172.21.15.72:0/1895995879 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55de649ce100 0x55de64a56090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:11.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.000+0000 7f8644f9b700 1 -- 172.21.15.72:0/1895995879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de649ce580 msgr2=0x55de64a4fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:11.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.000+0000 7f8644f9b700 1 --2- 172.21.15.72:0/1895995879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de649ce580 0x55de64a4fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:11.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.000+0000 7f8644f9b700 1 -- 172.21.15.72:0/1895995879 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55de647e20a0 con 0x55de649cdd20 2023-07-27T20:33:11.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.000+0000 7f863ffff700 1 --2- 172.21.15.72:0/1895995879 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55de649ce100 0x55de64a56090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:33:11.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.000+0000 7f8644f9b700 1 --2- 172.21.15.72:0/1895995879 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55de649cdd20 0x55de649f0bc0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f8634055bb0 tx=0x7f863405d670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d1dc68767337ba8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:11.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.000+0000 7f861f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-07-27T20:33:11.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.000+0000 7f861f7fe700 1 -- 172.21.15.72:0/1895995879 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8634057a50 con 0x55de649cdd20 2023-07-27T20:33:11.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.000+0000 7f861f7fe700 1 -- 172.21.15.72:0/1895995879 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f8634055dc0 con 0x55de649cdd20 2023-07-27T20:33:11.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.000+0000 7f865abe9b80 1 -- 172.21.15.72:0/1895995879 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f863800f050 con 0x55de649cdd20 2023-07-27T20:33:11.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.000+0000 7f861f7fe700 1 -- 172.21.15.72:0/1895995879 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8634055f80 con 0x55de649cdd20 2023-07-27T20:33:11.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.000+0000 7f865abe9b80 10 client.5607 fetch_fsmap learned FSMap version 17 2023-07-27T20:33:11.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.000+0000 7f865abe9b80 1 -- 172.21.15.72:0/1895995879 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55de647561d0 con 0x55de649cdd20 2023-07-27T20:33:11.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.001+0000 7f861f7fe700 1 -- 172.21.15.72:0/1895995879 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863800f050 con 0x55de649cdd20 2023-07-27T20:33:11.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.001+0000 7f861f7fe700 1 -- 172.21.15.72:0/1895995879 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f8634058ba0 con 0x55de649cdd20 2023-07-27T20:33:11.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.001+0000 7f865abe9b80 10 client.5607 fetch_fsmap finished waiting for FSMap version 17 2023-07-27T20:33:11.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.001+0000 7f865abe9b80 10 client.5607 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-27T20:33:11.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.001+0000 7f865abe9b80 20 client.5607 populate_metadata read hostname 'smithi072' 2023-07-27T20:33:11.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.001+0000 7f865abe9b80 1 --2- 172.21.15.72:0/1895995879 >> [v2:172.21.15.72:6833/1959104268,v1:172.21.15.72:6834/1959104268] conn(0x55de64a50160 0x55de649adce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:11.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.001+0000 7f865abe9b80 4 client.5607 mds_command: new command op to 5409 tid=0[{"prefix": "status"}] 2023-07-27T20:33:11.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.001+0000 7f865abe9b80 1 -- 172.21.15.72:0/1895995879 --> [v2:172.21.15.72:6833/1959104268,v1:172.21.15.72:6834/1959104268] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55de648fb5d0 con 0x55de64a50160 2023-07-27T20:33:11.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.001+0000 7f863ffff700 1 --2- 172.21.15.72:0/1895995879 >> [v2:172.21.15.72:6833/1959104268,v1:172.21.15.72:6834/1959104268] conn(0x55de64a50160 0x55de649adce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:11.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.001+0000 7f863ffff700 1 --2- 172.21.15.72:0/1895995879 >> [v2:172.21.15.72:6833/1959104268,v1:172.21.15.72:6834/1959104268] conn(0x55de64a50160 0x55de649adce0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84074527627f453e server_cookie=49c1a689ea341425 in_seq=0 out_seq=0 2023-07-27T20:33:11.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.001+0000 7f861f7fe700 10 client.5607 ms_handle_connect on v2:172.21.15.72:6833/1959104268 2023-07-27T20:33:11.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.002+0000 7f861f7fe700 1 -- 172.21.15.72:0/1895995879 <== mds.0 v2:172.21.15.72:6833/1959104268 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55de648fb5d0 con 0x55de64a50160 2023-07-27T20:33:11.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.002+0000 7f861f7fe700 10 client.5607 handle_command_reply: tid=0 2023-07-27T20:33:11.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.002+0000 7f865abe9b80 1 client.5607 shutdown 2023-07-27T20:33:11.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.002+0000 7f865abe9b80 1 -- 172.21.15.72:0/1895995879 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55de649cdd20 msgr2=0x55de649f0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:11.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.002+0000 7f865abe9b80 1 --2- 172.21.15.72:0/1895995879 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55de649cdd20 0x55de649f0bc0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f8634055bb0 tx=0x7f863405d670 comp rx=0 tx=0).stop 2023-07-27T20:33:11.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.002+0000 7f865abe9b80 1 -- 172.21.15.72:0/1895995879 shutdown_connections 2023-07-27T20:33:11.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.002+0000 7f865abe9b80 1 --2- 172.21.15.72:0/1895995879 >> [v2:172.21.15.72:6833/1959104268,v1:172.21.15.72:6834/1959104268] conn(0x55de64a50160 0x55de649adce0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:11.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.002+0000 7f865abe9b80 1 --2- 172.21.15.72:0/1895995879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de649ce580 0x55de64a4fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:11.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.002+0000 7f865abe9b80 1 --2- 172.21.15.72:0/1895995879 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55de649cdd20 0x55de649f0bc0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:11.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.002+0000 7f865abe9b80 1 --2- 172.21.15.72:0/1895995879 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55de649ce100 0x55de64a56090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:11.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.002+0000 7f861f7fe700 0 client.5607 ms_handle_reset on v2:172.21.15.72:6833/1959104268 2023-07-27T20:33:11.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.002+0000 7f865abe9b80 1 -- 172.21.15.72:0/1895995879 >> 172.21.15.72:0/1895995879 conn(0x55de649103a0 msgr2=0x55de649eaac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:11.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.002+0000 7f865abe9b80 1 -- 172.21.15.72:0/1895995879 shutdown_connections 2023-07-27T20:33:11.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.002+0000 7f865abe9b80 1 -- 172.21.15.72:0/1895995879 wait complete. 2023-07-27T20:33:12.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.002+0000 7f865abe9b80 20 client.5607 trim_cache size 0 max 16384 2023-07-27T20:33:12.000 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-07-27T20:33:12.000 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "173d349e-573f-4bc7-9f3a-2e1b4345c501", 2023-07-27T20:33:12.000 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 0, 2023-07-27T20:33:12.000 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 5409, 2023-07-27T20:33:12.001 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2023-07-27T20:33:12.001 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2023-07-27T20:33:12.001 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2023-07-27T20:33:12.001 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 11.428422880999999, 2023-07-27T20:33:12.001 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 17, 2023-07-27T20:33:12.001 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 43, 2023-07-27T20:33:12.001 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 41, 2023-07-27T20:33:12.002 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 20.262905742000001 2023-07-27T20:33:12.002 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-07-27T20:33:12.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.003+0000 7f86471ff700 1 -- 172.21.15.72:0/1073853787 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f862406ace0 msgr2=0x7f862406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:12.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.003+0000 7f86471ff700 1 --2- 172.21.15.72:0/1073853787 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f862406ace0 0x7f862406d1a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f86400c3d50 tx=0x7f862c009040 comp rx=0 tx=0).stop 2023-07-27T20:33:12.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.003+0000 7f86471ff700 1 -- 172.21.15.72:0/1073853787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f864006b150 msgr2=0x7f86400ae3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:12.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.003+0000 7f86471ff700 1 --2- 172.21.15.72:0/1073853787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f864006b150 0x7f86400ae3b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8634000c00 tx=0x7f8634004750 comp rx=0 tx=0).stop 2023-07-27T20:33:12.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.003+0000 7f86471ff700 1 -- 172.21.15.72:0/1073853787 shutdown_connections 2023-07-27T20:33:12.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.003+0000 7f86471ff700 1 --2- 172.21.15.72:0/1073853787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86401549f0 0x7f86400bddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:12.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.003+0000 7f86471ff700 1 --2- 172.21.15.72:0/1073853787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f864006b150 0x7f86400ae3b0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:12.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.003+0000 7f86471ff700 1 --2- 172.21.15.72:0/1073853787 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f862406ace0 0x7f862406d1a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:12.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.003+0000 7f86471ff700 1 --2- 172.21.15.72:0/1073853787 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86400c4400 0x7f86400bd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:12.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.003+0000 7f86471ff700 1 -- 172.21.15.72:0/1073853787 >> 172.21.15.72:0/1073853787 conn(0x7f86400ab300 msgr2=0x7f86401528d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:12.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.003+0000 7f86471ff700 1 -- 172.21.15.72:0/1073853787 shutdown_connections 2023-07-27T20:33:12.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.003+0000 7f86471ff700 1 -- 172.21.15.72:0/1073853787 wait complete. 2023-07-27T20:33:12.007 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-27T20:33:12.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.216+0000 7f21269ff700 1 Processor -- start 2023-07-27T20:33:12.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.216+0000 7f21269ff700 1 -- start start 2023-07-27T20:33:12.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.217+0000 7f21269ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f212006b150 0x7f21200c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:12.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.217+0000 7f21269ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f21201549f0 0x7f21201514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:12.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.217+0000 7f21269ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f212006b710 con 0x7f21200c4400 2023-07-27T20:33:12.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.217+0000 7f21269ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21201545d0 con 0x7f21201549f0 2023-07-27T20:33:12.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.217+0000 7f21269ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f212006c860 con 0x7f212006b150 2023-07-27T20:33:12.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.218+0000 7f2124f9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f21201549f0 0x7f21201514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:12.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.218+0000 7f2124f9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f21201549f0 0x7f21201514a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57724/0 (socket says 172.21.15.72:57724) 2023-07-27T20:33:12.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.218+0000 7f2124f9c700 1 -- 172.21.15.72:0/2544644452 learned_addr learned my addr 172.21.15.72:0/2544644452 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:12.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.218+0000 7f211f7fe700 1 --2- 172.21.15.72:0/2544644452 >> v2:172.21.15.173:3300/0 conn(0x7f212006b150 0x7f21200c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:12.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.218+0000 7f2124f9c700 1 -- 172.21.15.72:0/2544644452 >> v2:172.21.15.173:3300/0 conn(0x7f212006b150 msgr2=0x7f21200c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:12.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.218+0000 7f2124f9c700 1 --2- 172.21.15.72:0/2544644452 >> v2:172.21.15.173:3300/0 conn(0x7f212006b150 0x7f21200c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:12.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.218+0000 7f2124f9c700 1 -- 172.21.15.72:0/2544644452 >> v1:172.21.15.173:6789/0 conn(0x7f21200c4400 legacy=0x7f21200c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:12.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.218+0000 7f2124f9c700 1 -- 172.21.15.72:0/2544644452 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212006b9f0 con 0x7f21201549f0 2023-07-27T20:33:12.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.218+0000 7f211effd700 1 -- 172.21.15.72:0/2544644452 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1433410162 0 0) 0x7f212006b710 con 0x7f21200c4400 2023-07-27T20:33:12.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.218+0000 7f2124f9c700 1 --2- 172.21.15.72:0/2544644452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21201549f0 0x7f21201514a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f21200c0870 tx=0x7f211800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9cb935ba1441c7d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:12.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.219+0000 7f211effd700 1 -- 172.21.15.72:0/2544644452 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211800e070 con 0x7f21201549f0 2023-07-27T20:33:12.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.219+0000 7f211effd700 1 -- 172.21.15.72:0/2544644452 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211800b910 con 0x7f21201549f0 2023-07-27T20:33:12.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.219+0000 7f211effd700 1 -- 172.21.15.72:0/2544644452 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211800bcc0 con 0x7f21201549f0 2023-07-27T20:33:12.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.219+0000 7f21269ff700 1 -- 172.21.15.72:0/2544644452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21201549f0 msgr2=0x7f21201514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:12.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.219+0000 7f21269ff700 1 --2- 172.21.15.72:0/2544644452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21201549f0 0x7f21201514a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f21200c0870 tx=0x7f211800b330 comp rx=0 tx=0).stop 2023-07-27T20:33:12.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.219+0000 7f21269ff700 1 -- 172.21.15.72:0/2544644452 shutdown_connections 2023-07-27T20:33:12.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.219+0000 7f21269ff700 1 --2- 172.21.15.72:0/2544644452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21201549f0 0x7f21201514a0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:12.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.219+0000 7f21269ff700 1 --2- 172.21.15.72:0/2544644452 >> v2:172.21.15.173:3300/0 conn(0x7f212006b150 0x7f21200c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:12.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.219+0000 7f21269ff700 1 -- 172.21.15.72:0/2544644452 >> 172.21.15.72:0/2544644452 conn(0x7f21200ab300 msgr2=0x7f21200ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:12.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.219+0000 7f21269ff700 1 -- 172.21.15.72:0/2544644452 shutdown_connections 2023-07-27T20:33:12.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.219+0000 7f21269ff700 1 -- 172.21.15.72:0/2544644452 wait complete. 2023-07-27T20:33:12.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.221+0000 7f21269ff700 1 Processor -- start 2023-07-27T20:33:12.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.221+0000 7f21269ff700 1 -- start start 2023-07-27T20:33:12.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.222+0000 7f21269ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f212006b150 0x7f2120145690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:12.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.222+0000 7f21269ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f21200c4400 0x7f2120149420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:12.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.222+0000 7f21269ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21201549f0 0x7f21201eca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:12.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.222+0000 7f21269ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21201dc530 con 0x7f21201549f0 2023-07-27T20:33:12.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.222+0000 7f21269ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2120153200 con 0x7f212006b150 2023-07-27T20:33:12.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.222+0000 7f21269ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2120145d90 con 0x7f21200c4400 2023-07-27T20:33:12.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.222+0000 7f2124f9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21201549f0 0x7f21201eca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:12.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.222+0000 7f2124f9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21201549f0 0x7f21201eca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57732/0 (socket says 172.21.15.72:57732) 2023-07-27T20:33:12.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.222+0000 7f2124f9c700 1 -- 172.21.15.72:0/3776237894 learned_addr learned my addr 172.21.15.72:0/3776237894 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:12.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.222+0000 7f211f7fe700 1 --2- 172.21.15.72:0/3776237894 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f21200c4400 0x7f2120149420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:12.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.222+0000 7f211ffff700 1 --2- 172.21.15.72:0/3776237894 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f212006b150 0x7f2120145690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:12.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.223+0000 7f2124f9c700 1 -- 172.21.15.72:0/3776237894 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f21200c4400 msgr2=0x7f2120149420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:12.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.223+0000 7f2124f9c700 1 --2- 172.21.15.72:0/3776237894 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f21200c4400 0x7f2120149420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:12.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.223+0000 7f2124f9c700 1 -- 172.21.15.72:0/3776237894 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f212006b150 msgr2=0x7f2120145690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:12.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.223+0000 7f2124f9c700 1 --2- 172.21.15.72:0/3776237894 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f212006b150 0x7f2120145690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:12.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.223+0000 7f2124f9c700 1 -- 172.21.15.72:0/3776237894 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2118009b30 con 0x7f21201549f0 2023-07-27T20:33:12.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.223+0000 7f2124f9c700 1 --2- 172.21.15.72:0/3776237894 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21201549f0 0x7f21201eca60 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f211800b680 tx=0x7f2118004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:12.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.223+0000 7f211cff9700 1 -- 172.21.15.72:0/3776237894 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2118004830 con 0x7f21201549f0 2023-07-27T20:33:12.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.223+0000 7f211cff9700 1 -- 172.21.15.72:0/3776237894 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21180099b0 con 0x7f21201549f0 2023-07-27T20:33:12.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.223+0000 7f21269ff700 1 -- 172.21.15.72:0/3776237894 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2120146070 con 0x7f21201549f0 2023-07-27T20:33:12.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.223+0000 7f211cff9700 1 -- 172.21.15.72:0/3776237894 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211801b670 con 0x7f21201549f0 2023-07-27T20:33:12.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.223+0000 7f21269ff700 1 -- 172.21.15.72:0/3776237894 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21201dca60 con 0x7f21201549f0 2023-07-27T20:33:12.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.224+0000 7f21269ff700 1 -- 172.21.15.72:0/3776237894 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21201462b0 con 0x7f21201549f0 2023-07-27T20:33:12.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.225+0000 7f211cff9700 1 -- 172.21.15.72:0/3776237894 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f211801b7d0 con 0x7f21201549f0 2023-07-27T20:33:12.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.226+0000 7f211cff9700 1 --2- 172.21.15.72:0/3776237894 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f210c06ace0 0x7f210c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:12.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.226+0000 7f211cff9700 1 -- 172.21.15.72:0/3776237894 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f211808ad70 con 0x7f21201549f0 2023-07-27T20:33:12.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.227+0000 7f211ffff700 1 --2- 172.21.15.72:0/3776237894 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f210c06ace0 0x7f210c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:12.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.227+0000 7f211ffff700 1 --2- 172.21.15.72:0/3776237894 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f210c06ace0 0x7f210c06d1a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2110007fd0 tx=0x7f2110009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:12.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.231+0000 7f211cff9700 1 -- 172.21.15.72:0/3776237894 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2118055c90 con 0x7f21201549f0 2023-07-27T20:33:12.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.467+0000 7f21269ff700 1 -- 172.21.15.72:0/3776237894 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f21201dcc80 con 0x7f21201549f0 2023-07-27T20:33:12.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.467+0000 7f211cff9700 1 -- 172.21.15.72:0/3776237894 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f21180592b0 con 0x7f21201549f0 2023-07-27T20:33:12.455 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-27T20:33:12.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.470+0000 7f21269ff700 1 -- 172.21.15.72:0/3776237894 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f210c06ace0 msgr2=0x7f210c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:12.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.470+0000 7f21269ff700 1 --2- 172.21.15.72:0/3776237894 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f210c06ace0 0x7f210c06d1a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2110007fd0 tx=0x7f2110009040 comp rx=0 tx=0).stop 2023-07-27T20:33:12.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.470+0000 7f21269ff700 1 -- 172.21.15.72:0/3776237894 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21201549f0 msgr2=0x7f21201eca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:12.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.470+0000 7f21269ff700 1 --2- 172.21.15.72:0/3776237894 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21201549f0 0x7f21201eca60 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f211800b680 tx=0x7f2118004ad0 comp rx=0 tx=0).stop 2023-07-27T20:33:12.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.470+0000 7f21269ff700 1 -- 172.21.15.72:0/3776237894 shutdown_connections 2023-07-27T20:33:12.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.470+0000 7f21269ff700 1 --2- 172.21.15.72:0/3776237894 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21201549f0 0x7f21201eca60 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:12.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.470+0000 7f21269ff700 1 --2- 172.21.15.72:0/3776237894 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f212006b150 0x7f2120145690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:12.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.470+0000 7f21269ff700 1 --2- 172.21.15.72:0/3776237894 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f210c06ace0 0x7f210c06d1a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:12.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.470+0000 7f21269ff700 1 --2- 172.21.15.72:0/3776237894 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f21200c4400 0x7f2120149420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:12.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.470+0000 7f21269ff700 1 -- 172.21.15.72:0/3776237894 >> 172.21.15.72:0/3776237894 conn(0x7f21200ab300 msgr2=0x7f21201deb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:12.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.470+0000 7f21269ff700 1 -- 172.21.15.72:0/3776237894 shutdown_connections 2023-07-27T20:33:12.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:12.470+0000 7f21269ff700 1 -- 172.21.15.72:0/3776237894 wait complete. 2023-07-27T20:33:12.475 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-27T20:33:12.475 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T20:33:12.475 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2023-07-27T20:33:12.476 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-27T20:33:12.476 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-27T20:33:12.476 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-27T20:33:12.476 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-27T20:33:12.477 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-27T20:33:12.477 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-27T20:33:12.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:12.478 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2023-07-27T20:33:12.525 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T20:33:12.525 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T20:33:12.525 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T20:33:12.525 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:33:12.525 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-07-27T20:33:12.526 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:33:12.526 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T20:33:12.526 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2023-07-27T20:33:12.526 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f0 2023-07-27T20:33:12.526 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T20:33:12.526 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2023-07-27T20:33:12.526 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f1 2023-07-27T20:33:12.527 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T20:33:12.527 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2023-07-27T20:33:12.527 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T20:33:12.527 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2023-07-27T20:33:12.527 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T20:33:12.527 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 39891sec preferred_lft 39891sec 2023-07-27T20:33:12.527 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2023-07-27T20:33:12.527 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:33:12.528 INFO:teuthology.orchestra.run.smithi072.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-27T20:33:12.528 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0a:3b:6c:6f:2b:36 brd ff:ff:ff:ff:ff:ff 2023-07-27T20:33:12.528 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-27T20:33:12.528 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:33:12.528 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::f80c:f1ff:fe0e:35f4/64 scope link 2023-07-27T20:33:12.529 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:33:12.529 INFO:teuthology.orchestra.run.smithi072.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T20:33:12.529 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0a:3b:6c:6f:2b:36 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-27T20:33:12.529 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::83b:6cff:fe6f:2b36/64 scope link 2023-07-27T20:33:12.529 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:33:12.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:12.531 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T20:33:12.638 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-07-27T20:33:12.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:12.641 DEBUG:teuthology.orchestra.run.smithi072:> route 2023-07-27T20:33:12.689 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2023-07-27T20:33:12.689 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T20:33:12.689 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T20:33:12.689 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T20:33:12.690 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T20:33:12.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:12.691 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-07-27T20:33:12.691 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-07-27T20:33:12.692 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T20:33:12.692 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T20:33:12.692 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T20:33:12.693 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-07-27T20:33:12.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:12.862 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-07-27T20:33:12.908 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-27T20:33:12.909 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-27T20:33:12.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:12.910 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2023-07-27T20:33:12.980 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-07-27T20:33:12.981 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-27T20:33:12.981 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-27T20:33:13.027 INFO:teuthology.orchestra.run.smithi072.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-27T20:33:13.027 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-27T20:33:13.028 DEBUG:teuthology.orchestra.run.smithi072:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-27T20:33:13.112 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-07-27T20:33:13.222 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-27T20:33:13.223 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-27T20:33:13.292 INFO:teuthology.orchestra.run.smithi072.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-27T20:33:13.295 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-27T20:33:13.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:13.296 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-07-27T20:33:13.342 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-27T20:33:13.342 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-07-27T20:33:13.386 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-07-27T20:33:13.458 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-27T20:33:13.459 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-27T20:33:13.531 INFO:teuthology.orchestra.run.smithi072.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-27T20:33:13.533 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-27T20:33:13.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:13.535 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-07-27T20:33:13.557 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:2023-07-27T20:33:13.570+0000 7f98f718a5c0 -1 init, newargv = 0x561c504c54e0 newargc=15 2023-07-27T20:33:13.558 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:ceph-fuse[159444]: starting ceph client 2023-07-27T20:33:13.567 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:ceph-fuse[159444]: starting fuse 2023-07-27T20:33:13.583 INFO:teuthology.orchestra.run.smithi072.stdout:44 2023-07-27T20:33:13.584 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2023-07-27T20:33:13.585 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-27T20:33:13.585 DEBUG:teuthology.orchestra.run.smithi072:> import glob 2023-07-27T20:33:13.585 DEBUG:teuthology.orchestra.run.smithi072:> import re 2023-07-27T20:33:13.586 DEBUG:teuthology.orchestra.run.smithi072:> import os 2023-07-27T20:33:13.586 DEBUG:teuthology.orchestra.run.smithi072:> import subprocess 2023-07-27T20:33:13.586 DEBUG:teuthology.orchestra.run.smithi072:> 2023-07-27T20:33:13.587 DEBUG:teuthology.orchestra.run.smithi072:> def _find_admin_socket(client_name): 2023-07-27T20:33:13.587 DEBUG:teuthology.orchestra.run.smithi072:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-07-27T20:33:13.587 DEBUG:teuthology.orchestra.run.smithi072:> files = glob.glob(asok_path) 2023-07-27T20:33:13.587 DEBUG:teuthology.orchestra.run.smithi072:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-07-27T20:33:13.588 DEBUG:teuthology.orchestra.run.smithi072:> 2023-07-27T20:33:13.588 DEBUG:teuthology.orchestra.run.smithi072:> # Given a non-glob path, it better be there 2023-07-27T20:33:13.588 DEBUG:teuthology.orchestra.run.smithi072:> if "*" not in asok_path: 2023-07-27T20:33:13.589 DEBUG:teuthology.orchestra.run.smithi072:> assert(len(files) == 1) 2023-07-27T20:33:13.589 DEBUG:teuthology.orchestra.run.smithi072:> return files[0] 2023-07-27T20:33:13.589 DEBUG:teuthology.orchestra.run.smithi072:> 2023-07-27T20:33:13.590 DEBUG:teuthology.orchestra.run.smithi072:> for f in files: 2023-07-27T20:33:13.590 DEBUG:teuthology.orchestra.run.smithi072:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-27T20:33:13.590 DEBUG:teuthology.orchestra.run.smithi072:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-27T20:33:13.591 DEBUG:teuthology.orchestra.run.smithi072:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-27T20:33:13.591 DEBUG:teuthology.orchestra.run.smithi072:> contents = proc_f.read() 2023-07-27T20:33:13.591 DEBUG:teuthology.orchestra.run.smithi072:> if mountpoint in contents: 2023-07-27T20:33:13.592 DEBUG:teuthology.orchestra.run.smithi072:> return f 2023-07-27T20:33:13.592 DEBUG:teuthology.orchestra.run.smithi072:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-27T20:33:13.593 DEBUG:teuthology.orchestra.run.smithi072:> 2023-07-27T20:33:13.593 DEBUG:teuthology.orchestra.run.smithi072:> print(_find_admin_socket("client.0")) 2023-07-27T20:33:13.593 DEBUG:teuthology.orchestra.run.smithi072:> ' 2023-07-27T20:33:13.766 INFO:teuthology.orchestra.run.smithi072.stdout:/var/run/ceph/ceph-client.0.159444.asok 2023-07-27T20:33:13.945 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.159444.asok 2023-07-27T20:33:13.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:13.946 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.159444.asok status 2023-07-27T20:33:14.171 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-07-27T20:33:14.171 INFO:teuthology.orchestra.run.smithi072.stdout: "metadata": { 2023-07-27T20:33:14.171 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_sha1": "a5d48e8c688c2543997a98b8acbae2ce9635578c", 2023-07-27T20:33:14.171 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_version": "ceph version 18.0.0-5128-ga5d48e8c (a5d48e8c688c2543997a98b8acbae2ce9635578c) reef (dev)", 2023-07-27T20:33:14.172 INFO:teuthology.orchestra.run.smithi072.stdout: "entity_id": "0", 2023-07-27T20:33:14.172 INFO:teuthology.orchestra.run.smithi072.stdout: "hostname": "smithi072", 2023-07-27T20:33:14.172 INFO:teuthology.orchestra.run.smithi072.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-07-27T20:33:14.172 INFO:teuthology.orchestra.run.smithi072.stdout: "pid": "159444", 2023-07-27T20:33:14.172 INFO:teuthology.orchestra.run.smithi072.stdout: "root": "/" 2023-07-27T20:33:14.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:33:14.172 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_count": 0, 2023-07-27T20:33:14.173 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_pinned_count": 0, 2023-07-27T20:33:14.173 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 5622, 2023-07-27T20:33:14.173 INFO:teuthology.orchestra.run.smithi072.stdout: "inst": { 2023-07-27T20:33:14.173 INFO:teuthology.orchestra.run.smithi072.stdout: "name": { 2023-07-27T20:33:14.173 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "client", 2023-07-27T20:33:14.173 INFO:teuthology.orchestra.run.smithi072.stdout: "num": 5622 2023-07-27T20:33:14.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:33:14.173 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2023-07-27T20:33:14.174 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-07-27T20:33:14.174 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "192.168.0.1:0", 2023-07-27T20:33:14.174 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 1136767778 2023-07-27T20:33:14.174 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:33:14.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:33:14.174 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2023-07-27T20:33:14.174 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-07-27T20:33:14.175 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "192.168.0.1:0", 2023-07-27T20:33:14.175 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 1136767778 2023-07-27T20:33:14.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:33:14.175 INFO:teuthology.orchestra.run.smithi072.stdout: "inst_str": "client.5622 192.168.0.1:0/1136767778", 2023-07-27T20:33:14.175 INFO:teuthology.orchestra.run.smithi072.stdout: "addr_str": "192.168.0.1:0/1136767778", 2023-07-27T20:33:14.175 INFO:teuthology.orchestra.run.smithi072.stdout: "inode_count": 1, 2023-07-27T20:33:14.175 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_epoch": 17, 2023-07-27T20:33:14.175 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch": 43, 2023-07-27T20:33:14.176 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch_barrier": 0, 2023-07-27T20:33:14.176 INFO:teuthology.orchestra.run.smithi072.stdout: "blocklisted": false, 2023-07-27T20:33:14.176 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs" 2023-07-27T20:33:14.176 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-07-27T20:33:14.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:14.185 DEBUG:teuthology.orchestra.run.smithi072:> stat --file-system '--printf=%T 2023-07-27T20:33:14.185 DEBUG:teuthology.orchestra.run.smithi072:> ' -- /home/ubuntu/cephtest/mnt.0 2023-07-27T20:33:14.232 INFO:teuthology.orchestra.run.smithi072.stdout:fuseblk 2023-07-27T20:33:14.233 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-07-27T20:33:14.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:14.233 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-27T20:33:14.304 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-27T20:33:14.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.510+0000 7f9c14fff700 1 Processor -- start 2023-07-27T20:33:14.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.511+0000 7f9c14fff700 1 -- start start 2023-07-27T20:33:14.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.512+0000 7f9c14fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c100c0a60 0x7f9c100c3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:14.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.512+0000 7f9c14fff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9c1015c9d0 0x7f9c1015edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:14.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.512+0000 7f9c14fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c100c4140 con 0x7f9c100c0680 2023-07-27T20:33:14.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.512+0000 7f9c14fff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c100c13f0 con 0x7f9c1015c9d0 2023-07-27T20:33:14.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.512+0000 7f9c14fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c100c2120 con 0x7f9c100c0a60 2023-07-27T20:33:14.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.512+0000 7f9c0e59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9c100c0680 0x7f9c10154ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58244/0 (socket says 172.21.15.72:58244) 2023-07-27T20:33:14.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.512+0000 7f9c0e59c700 1 -- 172.21.15.72:0/3953052983 learned_addr learned my addr 172.21.15.72:0/3953052983 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:14.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.512+0000 7f9c07fff700 1 --2- 172.21.15.72:0/3953052983 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c100c0a60 0x7f9c100c3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:14.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.512+0000 7f9c0ed9d700 1 --2- 172.21.15.72:0/3953052983 >> v2:172.21.15.173:3300/0 conn(0x7f9c1015c9d0 0x7f9c1015edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:14.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.512+0000 7f9c0dd9b700 1 -- 172.21.15.72:0/3953052983 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 352306338 0 0) 0x7f9c100c4140 con 0x7f9c100c0680 2023-07-27T20:33:14.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.512+0000 7f9c0dd9b700 1 -- 172.21.15.72:0/3953052983 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bfc0035b0 con 0x7f9c100c0680 2023-07-27T20:33:14.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.513+0000 7f9c0dd9b700 1 -- 172.21.15.72:0/3953052983 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2173046052 0 0) 0x7f9bfc0035b0 con 0x7f9c100c0680 2023-07-27T20:33:14.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.513+0000 7f9c0dd9b700 1 -- 172.21.15.72:0/3953052983 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c100c0a60 msgr2=0x7f9c100c3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:14.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.513+0000 7f9c0dd9b700 1 --2- 172.21.15.72:0/3953052983 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c100c0a60 0x7f9c100c3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:14.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.513+0000 7f9c0dd9b700 1 -- 172.21.15.72:0/3953052983 >> v2:172.21.15.173:3300/0 conn(0x7f9c1015c9d0 msgr2=0x7f9c1015edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:14.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.513+0000 7f9c0dd9b700 1 --2- 172.21.15.72:0/3953052983 >> v2:172.21.15.173:3300/0 conn(0x7f9c1015c9d0 0x7f9c1015edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:14.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.513+0000 7f9c0dd9b700 1 -- 172.21.15.72:0/3953052983 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c10154630 con 0x7f9c100c0680 2023-07-27T20:33:14.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.513+0000 7f9c0dd9b700 1 -- 172.21.15.72:0/3953052983 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f9c00001670 con 0x7f9c100c0680 2023-07-27T20:33:14.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.513+0000 7f9c0dd9b700 1 -- 172.21.15.72:0/3953052983 >> v1:172.21.15.72:6789/0 conn(0x7f9c100c0680 legacy=0x7f9c10154ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:14.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.513+0000 7f9c0dd9b700 1 --2- 172.21.15.72:0/3953052983 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9bfc003a00 0x7f9bfc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:14.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.513+0000 7f9c0dd9b700 1 --2- 172.21.15.72:0/3953052983 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c100c0a60 0x7f9bfc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:14.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.513+0000 7f9c0dd9b700 1 --2- 172.21.15.72:0/3953052983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9bfc004d90 0x7f9bfc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:14.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.513+0000 7f9c0dd9b700 1 -- 172.21.15.72:0/3953052983 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c100c13f0 con 0x7f9bfc004d90 2023-07-27T20:33:14.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.513+0000 7f9c0dd9b700 1 -- 172.21.15.72:0/3953052983 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c100c2120 con 0x7f9bfc003a00 2023-07-27T20:33:14.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.513+0000 7f9c0dd9b700 1 -- 172.21.15.72:0/3953052983 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bfc00bae0 con 0x7f9c100c0a60 2023-07-27T20:33:14.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.513+0000 7f9c0ed9d700 1 --2- 172.21.15.72:0/3953052983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9bfc004d90 0x7f9bfc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:14.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.513+0000 7f9c0e59c700 1 --2- 172.21.15.72:0/3953052983 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9bfc003a00 0x7f9bfc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:14.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.513+0000 7f9c07fff700 1 --2- 172.21.15.72:0/3953052983 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c100c0a60 0x7f9bfc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:14.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.513+0000 7f9c0ed9d700 1 -- 172.21.15.72:0/3953052983 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c100c0a60 msgr2=0x7f9bfc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:14.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.513+0000 7f9c0ed9d700 1 --2- 172.21.15.72:0/3953052983 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c100c0a60 0x7f9bfc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:14.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.513+0000 7f9c0ed9d700 1 -- 172.21.15.72:0/3953052983 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9bfc003a00 msgr2=0x7f9bfc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:14.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.513+0000 7f9c0ed9d700 1 --2- 172.21.15.72:0/3953052983 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9bfc003a00 0x7f9bfc003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:14.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.513+0000 7f9c0ed9d700 1 -- 172.21.15.72:0/3953052983 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bfc0035b0 con 0x7f9bfc004d90 2023-07-27T20:33:14.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.513+0000 7f9c0e59c700 1 --2- 172.21.15.72:0/3953052983 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9bfc003a00 0x7f9bfc003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:33:14.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.514+0000 7f9c0ed9d700 1 --2- 172.21.15.72:0/3953052983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9bfc004d90 0x7f9bfc005210 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f9c10073d00 tx=0x7f9bfc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55579f3181cbb6f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:14.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.514+0000 7f9c0dd9b700 1 -- 172.21.15.72:0/3953052983 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0800ebd0 con 0x7f9bfc004d90 2023-07-27T20:33:14.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.514+0000 7f9c0dd9b700 1 -- 172.21.15.72:0/3953052983 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0800f040 con 0x7f9bfc004d90 2023-07-27T20:33:14.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.514+0000 7f9c0dd9b700 1 -- 172.21.15.72:0/3953052983 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c08014480 con 0x7f9bfc004d90 2023-07-27T20:33:14.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.514+0000 7f9c14fff700 1 -- 172.21.15.72:0/3953052983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9bfc004d90 msgr2=0x7f9bfc005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:14.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.514+0000 7f9c14fff700 1 --2- 172.21.15.72:0/3953052983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9bfc004d90 0x7f9bfc005210 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f9c10073d00 tx=0x7f9bfc005880 comp rx=0 tx=0).stop 2023-07-27T20:33:14.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.514+0000 7f9c0ed9d700 1 -- 172.21.15.72:0/3953052983 reap_dead start 2023-07-27T20:33:14.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.514+0000 7f9c14fff700 1 -- 172.21.15.72:0/3953052983 shutdown_connections 2023-07-27T20:33:14.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.514+0000 7f9c14fff700 1 -- 172.21.15.72:0/3953052983 >> 172.21.15.72:0/3953052983 conn(0x7f9c1006a190 msgr2=0x7f9c1006a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:14.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.514+0000 7f9c14fff700 1 -- 172.21.15.72:0/3953052983 shutdown_connections 2023-07-27T20:33:14.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.514+0000 7f9c14fff700 1 -- 172.21.15.72:0/3953052983 wait complete. 2023-07-27T20:33:14.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.516+0000 7f9c14fff700 1 Processor -- start 2023-07-27T20:33:14.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.516+0000 7f9c14fff700 1 -- start start 2023-07-27T20:33:14.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.517+0000 7f9c14fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9bfc004d90 0x7f9c100ab010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:14.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.517+0000 7f9c14fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c1006db10 0x7f9c100aa020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:14.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.517+0000 7f9c14fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c100ba0b0 0x7f9c100aa560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:14.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.517+0000 7f9c14fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c100a9bd0 con 0x7f9bfc004d90 2023-07-27T20:33:14.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.517+0000 7f9c14fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c100aaaa0 con 0x7f9c1006db10 2023-07-27T20:33:14.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.517+0000 7f9c14fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c101ed800 con 0x7f9c100ba0b0 2023-07-27T20:33:14.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.517+0000 7f9c0e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9bfc004d90 0x7f9c100ab010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:14.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.517+0000 7f9c0e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9bfc004d90 0x7f9c100ab010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57754/0 (socket says 172.21.15.72:57754) 2023-07-27T20:33:14.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.517+0000 7f9c0e59c700 1 -- 172.21.15.72:0/3975702875 learned_addr learned my addr 172.21.15.72:0/3975702875 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:14.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.518+0000 7f9c0ed9d700 1 --2- 172.21.15.72:0/3975702875 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c100ba0b0 0x7f9c100aa560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:14.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.518+0000 7f9c07fff700 1 --2- 172.21.15.72:0/3975702875 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c1006db10 0x7f9c100aa020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:14.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.518+0000 7f9c0e59c700 1 -- 172.21.15.72:0/3975702875 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c100ba0b0 msgr2=0x7f9c100aa560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:14.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.518+0000 7f9c0e59c700 1 --2- 172.21.15.72:0/3975702875 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c100ba0b0 0x7f9c100aa560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:14.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.518+0000 7f9c0e59c700 1 -- 172.21.15.72:0/3975702875 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c1006db10 msgr2=0x7f9c100aa020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:14.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.518+0000 7f9c0e59c700 1 --2- 172.21.15.72:0/3975702875 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c1006db10 0x7f9c100aa020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:14.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.518+0000 7f9c0e59c700 1 -- 172.21.15.72:0/3975702875 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c101edae0 con 0x7f9bfc004d90 2023-07-27T20:33:14.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.518+0000 7f9c0ed9d700 1 --2- 172.21.15.72:0/3975702875 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c100ba0b0 0x7f9c100aa560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:33:14.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.518+0000 7f9c07fff700 1 --2- 172.21.15.72:0/3975702875 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c1006db10 0x7f9c100aa020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:33:14.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.518+0000 7f9c0e59c700 1 --2- 172.21.15.72:0/3975702875 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9bfc004d90 0x7f9c100ab010 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f9c00001200 tx=0x7f9c0000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:14.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.518+0000 7f9c06ffd700 1 -- 172.21.15.72:0/3975702875 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c00005e00 con 0x7f9bfc004d90 2023-07-27T20:33:14.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.518+0000 7f9c06ffd700 1 -- 172.21.15.72:0/3975702875 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0000c780 con 0x7f9bfc004d90 2023-07-27T20:33:14.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.518+0000 7f9c06ffd700 1 -- 172.21.15.72:0/3975702875 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0000cb10 con 0x7f9bfc004d90 2023-07-27T20:33:14.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.518+0000 7f9c14fff700 1 -- 172.21.15.72:0/3975702875 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c1014a460 con 0x7f9bfc004d90 2023-07-27T20:33:14.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.518+0000 7f9c14fff700 1 -- 172.21.15.72:0/3975702875 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c100ab550 con 0x7f9bfc004d90 2023-07-27T20:33:14.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.519+0000 7f9c14fff700 1 -- 172.21.15.72:0/3975702875 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c10074310 con 0x7f9bfc004d90 2023-07-27T20:33:14.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.520+0000 7f9c06ffd700 1 -- 172.21.15.72:0/3975702875 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9c0000cc70 con 0x7f9bfc004d90 2023-07-27T20:33:14.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.521+0000 7f9c06ffd700 1 --2- 172.21.15.72:0/3975702875 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9bf006ace0 0x7f9bf006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:14.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.521+0000 7f9c06ffd700 1 -- 172.21.15.72:0/3975702875 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f9c00089470 con 0x7f9bfc004d90 2023-07-27T20:33:14.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.522+0000 7f9c07fff700 1 --2- 172.21.15.72:0/3975702875 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9bf006ace0 0x7f9bf006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:14.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.522+0000 7f9c07fff700 1 --2- 172.21.15.72:0/3975702875 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9bf006ace0 0x7f9bf006d1a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9c100a7370 tx=0x7f9bf8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:14.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.525+0000 7f9c06ffd700 1 -- 172.21.15.72:0/3975702875 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9c00054390 con 0x7f9bfc004d90 2023-07-27T20:33:14.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.764+0000 7f9c14fff700 1 -- 172.21.15.72:0/3975702875 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9c1006e9e0 con 0x7f9bfc004d90 2023-07-27T20:33:14.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.764+0000 7f9c06ffd700 1 -- 172.21.15.72:0/3975702875 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9c000579b0 con 0x7f9bfc004d90 2023-07-27T20:33:14.752 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-27T20:33:14.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.767+0000 7f9c14fff700 1 -- 172.21.15.72:0/3975702875 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9bf006ace0 msgr2=0x7f9bf006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:14.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.767+0000 7f9c14fff700 1 --2- 172.21.15.72:0/3975702875 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9bf006ace0 0x7f9bf006d1a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9c100a7370 tx=0x7f9bf8008040 comp rx=0 tx=0).stop 2023-07-27T20:33:14.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.767+0000 7f9c14fff700 1 -- 172.21.15.72:0/3975702875 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9bfc004d90 msgr2=0x7f9c100ab010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:14.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.767+0000 7f9c14fff700 1 --2- 172.21.15.72:0/3975702875 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9bfc004d90 0x7f9c100ab010 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f9c00001200 tx=0x7f9c0000ee80 comp rx=0 tx=0).stop 2023-07-27T20:33:14.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.767+0000 7f9c14fff700 1 -- 172.21.15.72:0/3975702875 shutdown_connections 2023-07-27T20:33:14.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.767+0000 7f9c14fff700 1 --2- 172.21.15.72:0/3975702875 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9bf006ace0 0x7f9bf006d1a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:14.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.767+0000 7f9c14fff700 1 --2- 172.21.15.72:0/3975702875 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c100ba0b0 0x7f9c100aa560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:14.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.767+0000 7f9c14fff700 1 --2- 172.21.15.72:0/3975702875 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9bfc004d90 0x7f9c100ab010 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:14.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.767+0000 7f9c14fff700 1 --2- 172.21.15.72:0/3975702875 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c1006db10 0x7f9c100aa020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:14.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.767+0000 7f9c14fff700 1 -- 172.21.15.72:0/3975702875 >> 172.21.15.72:0/3975702875 conn(0x7f9c1006a190 msgr2=0x7f9c10150a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:14.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.767+0000 7f9c14fff700 1 -- 172.21.15.72:0/3975702875 shutdown_connections 2023-07-27T20:33:14.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:14.767+0000 7f9c14fff700 1 -- 172.21.15.72:0/3975702875 wait complete. 2023-07-27T20:33:14.772 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-27T20:33:14.772 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T20:33:14.773 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi173.front.sepia.ceph.com 2023-07-27T20:33:14.773 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-27T20:33:14.773 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-27T20:33:14.773 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-27T20:33:14.774 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-27T20:33:14.774 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-27T20:33:14.775 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-27T20:33:14.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:14.775 DEBUG:teuthology.orchestra.run.smithi173:> ip addr 2023-07-27T20:33:14.829 INFO:teuthology.orchestra.run.smithi173.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T20:33:14.829 INFO:teuthology.orchestra.run.smithi173.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T20:33:14.829 INFO:teuthology.orchestra.run.smithi173.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T20:33:14.829 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:33:14.830 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 ::1/128 scope host 2023-07-27T20:33:14.830 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:33:14.830 INFO:teuthology.orchestra.run.smithi173.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T20:33:14.830 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6a brd ff:ff:ff:ff:ff:ff 2023-07-27T20:33:14.830 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f0 2023-07-27T20:33:14.830 INFO:teuthology.orchestra.run.smithi173.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T20:33:14.830 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6b brd ff:ff:ff:ff:ff:ff 2023-07-27T20:33:14.831 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f1 2023-07-27T20:33:14.831 INFO:teuthology.orchestra.run.smithi173.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T20:33:14.831 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:58 brd ff:ff:ff:ff:ff:ff 2023-07-27T20:33:14.831 INFO:teuthology.orchestra.run.smithi173.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T20:33:14.831 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:59 brd ff:ff:ff:ff:ff:ff 2023-07-27T20:33:14.831 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.21.15.173/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T20:33:14.831 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft 39921sec preferred_lft 39921sec 2023-07-27T20:33:14.832 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::ec4:7aff:fe88:7259/64 scope link 2023-07-27T20:33:14.832 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:33:14.832 INFO:teuthology.orchestra.run.smithi173.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-27T20:33:14.832 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether f2:7f:58:8c:3b:de brd ff:ff:ff:ff:ff:ff 2023-07-27T20:33:14.832 INFO:teuthology.orchestra.run.smithi173.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-27T20:33:14.832 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:33:14.832 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::84ab:86ff:fec2:f207/64 scope link 2023-07-27T20:33:14.833 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:33:14.833 INFO:teuthology.orchestra.run.smithi173.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T20:33:14.833 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether f2:7f:58:8c:3b:de brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-27T20:33:14.833 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::f07f:58ff:fe8c:3bde/64 scope link 2023-07-27T20:33:14.833 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:33:14.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:14.835 DEBUG:teuthology.orchestra.run.smithi173:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T20:33:14.905 INFO:teuthology.orchestra.run.smithi173.stdout:1 2023-07-27T20:33:14.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:14.909 DEBUG:teuthology.orchestra.run.smithi173:> route 2023-07-27T20:33:14.960 INFO:teuthology.orchestra.run.smithi173.stdout:Kernel IP routing table 2023-07-27T20:33:14.961 INFO:teuthology.orchestra.run.smithi173.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T20:33:14.961 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T20:33:14.961 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T20:33:14.962 INFO:teuthology.orchestra.run.smithi173.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T20:33:14.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:14.963 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2023-07-27T20:33:14.963 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2023-07-27T20:33:14.964 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T20:33:14.965 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T20:33:14.965 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T20:33:14.966 DEBUG:teuthology.orchestra.run.smithi173:> ') 2023-07-27T20:33:15.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:15.135 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list 2023-07-27T20:33:15.182 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-27T20:33:15.183 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-27T20:33:15.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:15.184 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set brx.0 up 2023-07-27T20:33:15.255 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-07-27T20:33:15.256 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-27T20:33:15.257 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-27T20:33:15.304 INFO:teuthology.orchestra.run.smithi173.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-27T20:33:15.304 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-27T20:33:15.305 DEBUG:teuthology.orchestra.run.smithi173:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-27T20:33:15.389 DEBUG:teuthology.orchestra.run.smithi173:> sudo modprobe fuse 2023-07-27T20:33:15.500 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-27T20:33:15.501 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-27T20:33:15.570 INFO:teuthology.orchestra.run.smithi173.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-27T20:33:15.572 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-27T20:33:15.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:15.574 DEBUG:teuthology.orchestra.run.smithi173:> ls /sys/fs/fuse/connections 2023-07-27T20:33:15.620 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-27T20:33:15.621 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-07-27T20:33:15.664 DEBUG:teuthology.orchestra.run.smithi173:> sudo modprobe fuse 2023-07-27T20:33:15.736 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-27T20:33:15.737 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-27T20:33:15.805 INFO:teuthology.orchestra.run.smithi173.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-27T20:33:15.808 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-27T20:33:15.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:15.809 DEBUG:teuthology.orchestra.run.smithi173:> ls /sys/fs/fuse/connections 2023-07-27T20:33:15.831 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi173.stderr:2023-07-27T20:33:15.843+0000 7f5b8865d5c0 -1 init, newargv = 0x55f34b39cb20 newargc=15 2023-07-27T20:33:15.831 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi173.stderr:ceph-fuse[148891]: starting ceph client 2023-07-27T20:33:15.840 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi173.stderr:ceph-fuse[148891]: starting fuse 2023-07-27T20:33:15.858 INFO:teuthology.orchestra.run.smithi173.stdout:43 2023-07-27T20:33:15.858 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-07-27T20:33:15.858 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-27T20:33:15.859 DEBUG:teuthology.orchestra.run.smithi173:> import glob 2023-07-27T20:33:15.859 DEBUG:teuthology.orchestra.run.smithi173:> import re 2023-07-27T20:33:15.860 DEBUG:teuthology.orchestra.run.smithi173:> import os 2023-07-27T20:33:15.860 DEBUG:teuthology.orchestra.run.smithi173:> import subprocess 2023-07-27T20:33:15.861 DEBUG:teuthology.orchestra.run.smithi173:> 2023-07-27T20:33:15.861 DEBUG:teuthology.orchestra.run.smithi173:> def _find_admin_socket(client_name): 2023-07-27T20:33:15.861 DEBUG:teuthology.orchestra.run.smithi173:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-07-27T20:33:15.862 DEBUG:teuthology.orchestra.run.smithi173:> files = glob.glob(asok_path) 2023-07-27T20:33:15.862 DEBUG:teuthology.orchestra.run.smithi173:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-07-27T20:33:15.862 DEBUG:teuthology.orchestra.run.smithi173:> 2023-07-27T20:33:15.863 DEBUG:teuthology.orchestra.run.smithi173:> # Given a non-glob path, it better be there 2023-07-27T20:33:15.863 DEBUG:teuthology.orchestra.run.smithi173:> if "*" not in asok_path: 2023-07-27T20:33:15.863 DEBUG:teuthology.orchestra.run.smithi173:> assert(len(files) == 1) 2023-07-27T20:33:15.863 DEBUG:teuthology.orchestra.run.smithi173:> return files[0] 2023-07-27T20:33:15.864 DEBUG:teuthology.orchestra.run.smithi173:> 2023-07-27T20:33:15.864 DEBUG:teuthology.orchestra.run.smithi173:> for f in files: 2023-07-27T20:33:15.864 DEBUG:teuthology.orchestra.run.smithi173:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-27T20:33:15.865 DEBUG:teuthology.orchestra.run.smithi173:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-27T20:33:15.865 DEBUG:teuthology.orchestra.run.smithi173:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-27T20:33:15.865 DEBUG:teuthology.orchestra.run.smithi173:> contents = proc_f.read() 2023-07-27T20:33:15.866 DEBUG:teuthology.orchestra.run.smithi173:> if mountpoint in contents: 2023-07-27T20:33:15.866 DEBUG:teuthology.orchestra.run.smithi173:> return f 2023-07-27T20:33:15.866 DEBUG:teuthology.orchestra.run.smithi173:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-27T20:33:15.867 DEBUG:teuthology.orchestra.run.smithi173:> 2023-07-27T20:33:15.867 DEBUG:teuthology.orchestra.run.smithi173:> print(_find_admin_socket("client.1")) 2023-07-27T20:33:15.867 DEBUG:teuthology.orchestra.run.smithi173:> ' 2023-07-27T20:33:16.042 INFO:teuthology.orchestra.run.smithi173.stdout:/var/run/ceph/ceph-client.1.148891.asok 2023-07-27T20:33:16.220 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.148891.asok 2023-07-27T20:33:16.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:16.221 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.148891.asok status 2023-07-27T20:33:16.444 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2023-07-27T20:33:16.444 INFO:teuthology.orchestra.run.smithi173.stdout: "metadata": { 2023-07-27T20:33:16.445 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_sha1": "a5d48e8c688c2543997a98b8acbae2ce9635578c", 2023-07-27T20:33:16.445 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_version": "ceph version 18.0.0-5128-ga5d48e8c (a5d48e8c688c2543997a98b8acbae2ce9635578c) reef (dev)", 2023-07-27T20:33:16.445 INFO:teuthology.orchestra.run.smithi173.stdout: "entity_id": "1", 2023-07-27T20:33:16.445 INFO:teuthology.orchestra.run.smithi173.stdout: "hostname": "smithi173", 2023-07-27T20:33:16.445 INFO:teuthology.orchestra.run.smithi173.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-07-27T20:33:16.445 INFO:teuthology.orchestra.run.smithi173.stdout: "pid": "148891", 2023-07-27T20:33:16.445 INFO:teuthology.orchestra.run.smithi173.stdout: "root": "/" 2023-07-27T20:33:16.446 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-07-27T20:33:16.446 INFO:teuthology.orchestra.run.smithi173.stdout: "dentry_count": 0, 2023-07-27T20:33:16.446 INFO:teuthology.orchestra.run.smithi173.stdout: "dentry_pinned_count": 0, 2023-07-27T20:33:16.446 INFO:teuthology.orchestra.run.smithi173.stdout: "id": 5105, 2023-07-27T20:33:16.446 INFO:teuthology.orchestra.run.smithi173.stdout: "inst": { 2023-07-27T20:33:16.446 INFO:teuthology.orchestra.run.smithi173.stdout: "name": { 2023-07-27T20:33:16.446 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "client", 2023-07-27T20:33:16.447 INFO:teuthology.orchestra.run.smithi173.stdout: "num": 5105 2023-07-27T20:33:16.447 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-07-27T20:33:16.447 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": { 2023-07-27T20:33:16.447 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "v1", 2023-07-27T20:33:16.448 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": "192.168.0.1:0", 2023-07-27T20:33:16.448 INFO:teuthology.orchestra.run.smithi173.stdout: "nonce": 3537388184 2023-07-27T20:33:16.448 INFO:teuthology.orchestra.run.smithi173.stdout: } 2023-07-27T20:33:16.448 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-07-27T20:33:16.448 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": { 2023-07-27T20:33:16.448 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "v1", 2023-07-27T20:33:16.448 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": "192.168.0.1:0", 2023-07-27T20:33:16.449 INFO:teuthology.orchestra.run.smithi173.stdout: "nonce": 3537388184 2023-07-27T20:33:16.449 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-07-27T20:33:16.449 INFO:teuthology.orchestra.run.smithi173.stdout: "inst_str": "client.5105 192.168.0.1:0/3537388184", 2023-07-27T20:33:16.449 INFO:teuthology.orchestra.run.smithi173.stdout: "addr_str": "192.168.0.1:0/3537388184", 2023-07-27T20:33:16.449 INFO:teuthology.orchestra.run.smithi173.stdout: "inode_count": 1, 2023-07-27T20:33:16.449 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_epoch": 17, 2023-07-27T20:33:16.449 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_epoch": 43, 2023-07-27T20:33:16.449 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_epoch_barrier": 0, 2023-07-27T20:33:16.450 INFO:teuthology.orchestra.run.smithi173.stdout: "blocklisted": false, 2023-07-27T20:33:16.450 INFO:teuthology.orchestra.run.smithi173.stdout: "fs_name": "cephfs" 2023-07-27T20:33:16.450 INFO:teuthology.orchestra.run.smithi173.stdout:} 2023-07-27T20:33:16.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:16.458 DEBUG:teuthology.orchestra.run.smithi173:> stat --file-system '--printf=%T 2023-07-27T20:33:16.459 DEBUG:teuthology.orchestra.run.smithi173:> ' -- /home/ubuntu/cephtest/mnt.1 2023-07-27T20:33:16.506 INFO:teuthology.orchestra.run.smithi173.stdout:fuseblk 2023-07-27T20:33:16.506 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-07-27T20:33:16.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:16.508 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-27T20:33:16.579 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-07-27T20:33:16.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.798+0000 7f92adfff700 1 Processor -- start 2023-07-27T20:33:16.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.798+0000 7f92adfff700 1 -- start start 2023-07-27T20:33:16.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.799+0000 7f92adfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f92a806b150 0x7f92a80c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:16.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.799+0000 7f92adfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f92a81549f0 0x7f92a81514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:16.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.799+0000 7f92adfff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92a806b710 con 0x7f92a80c4400 2023-07-27T20:33:16.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.799+0000 7f92adfff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92a81545d0 con 0x7f92a806b150 2023-07-27T20:33:16.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.799+0000 7f92adfff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a806c860 con 0x7f92a81549f0 2023-07-27T20:33:16.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.799+0000 7f92a6ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f92a806b150 0x7f92a80c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:16.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.799+0000 7f92a77fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f92a80c4400 0x7f92a80c4cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58256/0 (socket says 172.21.15.72:58256) 2023-07-27T20:33:16.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.799+0000 7f92a77fe700 1 -- 172.21.15.72:0/3502858268 learned_addr learned my addr 172.21.15.72:0/3502858268 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:16.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.800+0000 7f92a7fff700 1 --2- 172.21.15.72:0/3502858268 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f92a81549f0 0x7f92a81514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:16.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.800+0000 7f92a6ffd700 1 -- 172.21.15.72:0/3502858268 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f92a81549f0 msgr2=0x7f92a81514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:16.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.800+0000 7f92a6ffd700 1 --2- 172.21.15.72:0/3502858268 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f92a81549f0 0x7f92a81514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:16.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.800+0000 7f92a6ffd700 1 -- 172.21.15.72:0/3502858268 >> v1:172.21.15.72:6789/0 conn(0x7f92a80c4400 legacy=0x7f92a80c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:16.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.800+0000 7f92a6ffd700 1 -- 172.21.15.72:0/3502858268 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a806b9f0 con 0x7f92a806b150 2023-07-27T20:33:16.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.800+0000 7f92a67fc700 1 -- 172.21.15.72:0/3502858268 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 600813221 0 0) 0x7f92a806b710 con 0x7f92a80c4400 2023-07-27T20:33:16.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.800+0000 7f92a6ffd700 1 --2- 172.21.15.72:0/3502858268 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92a806b150 0x7f92a80c7710 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f929c009840 tx=0x7f929c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f75af0bf097f2412 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:16.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.800+0000 7f92a67fc700 1 -- 172.21.15.72:0/3502858268 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929c011830 con 0x7f92a806b150 2023-07-27T20:33:16.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.800+0000 7f92a67fc700 1 -- 172.21.15.72:0/3502858268 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929c011990 con 0x7f92a806b150 2023-07-27T20:33:16.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.800+0000 7f92a67fc700 1 -- 172.21.15.72:0/3502858268 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929c011d20 con 0x7f92a806b150 2023-07-27T20:33:16.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.801+0000 7f92adfff700 1 -- 172.21.15.72:0/3502858268 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92a806b150 msgr2=0x7f92a80c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:16.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.801+0000 7f92adfff700 1 --2- 172.21.15.72:0/3502858268 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92a806b150 0x7f92a80c7710 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f929c009840 tx=0x7f929c009b50 comp rx=0 tx=0).stop 2023-07-27T20:33:16.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.801+0000 7f92adfff700 1 -- 172.21.15.72:0/3502858268 shutdown_connections 2023-07-27T20:33:16.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.801+0000 7f92adfff700 1 --2- 172.21.15.72:0/3502858268 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f92a81549f0 0x7f92a81514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:16.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.801+0000 7f92adfff700 1 --2- 172.21.15.72:0/3502858268 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92a806b150 0x7f92a80c7710 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:16.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.801+0000 7f92adfff700 1 -- 172.21.15.72:0/3502858268 >> 172.21.15.72:0/3502858268 conn(0x7f92a80ab300 msgr2=0x7f92a80ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:16.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.801+0000 7f92adfff700 1 -- 172.21.15.72:0/3502858268 shutdown_connections 2023-07-27T20:33:16.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.801+0000 7f92adfff700 1 -- 172.21.15.72:0/3502858268 wait complete. 2023-07-27T20:33:16.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.803+0000 7f92adfff700 1 Processor -- start 2023-07-27T20:33:16.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.803+0000 7f92adfff700 1 -- start start 2023-07-27T20:33:16.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.804+0000 7f92adfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92a806b150 0x7f92a814e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:16.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.804+0000 7f92adfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92a80c4400 0x7f92a80ad3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:16.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.804+0000 7f92adfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f92a81549f0 0x7f92a81e91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:16.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.804+0000 7f92adfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a80aceb0 con 0x7f92a806b150 2023-07-27T20:33:16.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.804+0000 7f92adfff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a80ac640 con 0x7f92a80c4400 2023-07-27T20:33:16.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.804+0000 7f92adfff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a81ed120 con 0x7f92a81549f0 2023-07-27T20:33:16.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.804+0000 7f92a77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92a806b150 0x7f92a814e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:16.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.804+0000 7f92a77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92a806b150 0x7f92a814e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57772/0 (socket says 172.21.15.72:57772) 2023-07-27T20:33:16.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.804+0000 7f92a77fe700 1 -- 172.21.15.72:0/2471396062 learned_addr learned my addr 172.21.15.72:0/2471396062 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:16.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.804+0000 7f92a6ffd700 1 --2- 172.21.15.72:0/2471396062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92a80c4400 0x7f92a80ad3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:16.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.804+0000 7f92a7fff700 1 --2- 172.21.15.72:0/2471396062 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f92a81549f0 0x7f92a81e91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:16.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.804+0000 7f92a77fe700 1 -- 172.21.15.72:0/2471396062 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f92a81549f0 msgr2=0x7f92a81e91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:16.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.804+0000 7f92a77fe700 1 --2- 172.21.15.72:0/2471396062 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f92a81549f0 0x7f92a81e91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:16.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.804+0000 7f92a77fe700 1 -- 172.21.15.72:0/2471396062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92a80c4400 msgr2=0x7f92a80ad3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:16.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.804+0000 7f92a77fe700 1 --2- 172.21.15.72:0/2471396062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92a80c4400 0x7f92a80ad3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:16.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.804+0000 7f92a77fe700 1 -- 172.21.15.72:0/2471396062 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f929c0094a0 con 0x7f92a806b150 2023-07-27T20:33:16.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.805+0000 7f92a77fe700 1 --2- 172.21.15.72:0/2471396062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92a806b150 0x7f92a814e000 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f92980011e0 tx=0x7f929800ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:16.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.805+0000 7f928ffff700 1 -- 172.21.15.72:0/2471396062 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9298004c80 con 0x7f92a806b150 2023-07-27T20:33:16.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.805+0000 7f928ffff700 1 -- 172.21.15.72:0/2471396062 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9298004e00 con 0x7f92a806b150 2023-07-27T20:33:16.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.805+0000 7f92adfff700 1 -- 172.21.15.72:0/2471396062 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92a80ad0c0 con 0x7f92a806b150 2023-07-27T20:33:16.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.805+0000 7f928ffff700 1 -- 172.21.15.72:0/2471396062 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9298007310 con 0x7f92a806b150 2023-07-27T20:33:16.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.805+0000 7f92adfff700 1 -- 172.21.15.72:0/2471396062 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92a80ac850 con 0x7f92a806b150 2023-07-27T20:33:16.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.806+0000 7f92adfff700 1 -- 172.21.15.72:0/2471396062 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92a80aca40 con 0x7f92a806b150 2023-07-27T20:33:16.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.807+0000 7f928ffff700 1 -- 172.21.15.72:0/2471396062 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9298007470 con 0x7f92a806b150 2023-07-27T20:33:16.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.808+0000 7f928ffff700 1 --2- 172.21.15.72:0/2471396062 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f929406ace0 0x7f929406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:16.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.808+0000 7f928ffff700 1 -- 172.21.15.72:0/2471396062 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f9298089350 con 0x7f92a806b150 2023-07-27T20:33:16.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.808+0000 7f92a6ffd700 1 --2- 172.21.15.72:0/2471396062 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f929406ace0 0x7f929406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:16.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.809+0000 7f92a6ffd700 1 --2- 172.21.15.72:0/2471396062 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f929406ace0 0x7f929406d1a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f929c0090b0 tx=0x7f929c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:16.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:16.812+0000 7f928ffff700 1 -- 172.21.15.72:0/2471396062 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f92980541e0 con 0x7f92a806b150 2023-07-27T20:33:17.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.087+0000 7f92adfff700 1 -- 172.21.15.72:0/2471396062 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7f92a806bca0 con 0x7f92a806b150 2023-07-27T20:33:17.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.087+0000 7f928ffff700 1 -- 172.21.15.72:0/2471396062 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v11) v1 ==== 84+0+0 (secure 0 0 0) 0x7f9298057800 con 0x7f92a806b150 2023-07-27T20:33:17.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.090+0000 7f92adfff700 1 -- 172.21.15.72:0/2471396062 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f929406ace0 msgr2=0x7f929406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:17.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.090+0000 7f92adfff700 1 --2- 172.21.15.72:0/2471396062 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f929406ace0 0x7f929406d1a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f929c0090b0 tx=0x7f929c008030 comp rx=0 tx=0).stop 2023-07-27T20:33:17.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.090+0000 7f92adfff700 1 -- 172.21.15.72:0/2471396062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92a806b150 msgr2=0x7f92a814e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:17.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.090+0000 7f92adfff700 1 --2- 172.21.15.72:0/2471396062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92a806b150 0x7f92a814e000 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f92980011e0 tx=0x7f929800ca30 comp rx=0 tx=0).stop 2023-07-27T20:33:17.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.090+0000 7f92adfff700 1 -- 172.21.15.72:0/2471396062 shutdown_connections 2023-07-27T20:33:17.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.090+0000 7f92adfff700 1 --2- 172.21.15.72:0/2471396062 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f929406ace0 0x7f929406d1a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:17.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.090+0000 7f92adfff700 1 --2- 172.21.15.72:0/2471396062 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f92a81549f0 0x7f92a81e91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:17.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.090+0000 7f92adfff700 1 --2- 172.21.15.72:0/2471396062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92a806b150 0x7f92a814e000 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:17.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.090+0000 7f92adfff700 1 --2- 172.21.15.72:0/2471396062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92a80c4400 0x7f92a80ad3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:17.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.090+0000 7f92adfff700 1 -- 172.21.15.72:0/2471396062 >> 172.21.15.72:0/2471396062 conn(0x7f92a80ab300 msgr2=0x7f92a80c7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:17.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.090+0000 7f92adfff700 1 -- 172.21.15.72:0/2471396062 shutdown_connections 2023-07-27T20:33:17.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.090+0000 7f92adfff700 1 -- 172.21.15.72:0/2471396062 wait complete. 2023-07-27T20:33:17.095 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:33:17.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.305+0000 7ff7eb3ff700 1 Processor -- start 2023-07-27T20:33:17.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.305+0000 7ff7eb3ff700 1 -- start start 2023-07-27T20:33:17.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.306+0000 7ff7eb3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff7e40c12d0 0x7ff7e41549f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:17.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.306+0000 7ff7eb3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7e4139d40 con 0x7ff7e4139960 2023-07-27T20:33:17.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.306+0000 7ff7eb3ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7e4151060 con 0x7ff7e4139f80 2023-07-27T20:33:17.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.306+0000 7ff7eb3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7e40c0ee0 con 0x7ff7e40c12d0 2023-07-27T20:33:17.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.306+0000 7ff7e999c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff7e40c12d0 0x7ff7e41549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:17.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.306+0000 7ff7e919b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff7e4139960 0x7ff7e40c1e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58262/0 (socket says 172.21.15.72:58262) 2023-07-27T20:33:17.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.306+0000 7ff7e919b700 1 -- 172.21.15.72:0/98951110 learned_addr learned my addr 172.21.15.72:0/98951110 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:17.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.307+0000 7ff7dbfff700 1 -- 172.21.15.72:0/98951110 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3326308820 0 0) 0x7ff7e4139d40 con 0x7ff7e4139960 2023-07-27T20:33:17.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.307+0000 7ff7dbfff700 1 -- 172.21.15.72:0/98951110 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7d00057c0 con 0x7ff7e4139960 2023-07-27T20:33:17.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.307+0000 7ff7e999c700 1 -- 172.21.15.72:0/98951110 >> v1:172.21.15.173:6789/0 conn(0x7ff7e4139f80 legacy=0x7ff7e41542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:17.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.307+0000 7ff7e999c700 1 -- 172.21.15.72:0/98951110 >> v1:172.21.15.72:6789/0 conn(0x7ff7e4139960 legacy=0x7ff7e40c1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:17.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.307+0000 7ff7e999c700 1 -- 172.21.15.72:0/98951110 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e4151340 con 0x7ff7e40c12d0 2023-07-27T20:33:17.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.307+0000 7ff7e999c700 1 --2- 172.21.15.72:0/98951110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7e40c12d0 0x7ff7e41549f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc009d90 tx=0x7ff7dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ab63542d61166 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:17.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.307+0000 7ff7dbfff700 1 -- 172.21.15.72:0/98951110 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc00e070 con 0x7ff7e40c12d0 2023-07-27T20:33:17.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.308+0000 7ff7dbfff700 1 -- 172.21.15.72:0/98951110 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7dc00bb20 con 0x7ff7e40c12d0 2023-07-27T20:33:17.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.308+0000 7ff7dbfff700 1 -- 172.21.15.72:0/98951110 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc012430 con 0x7ff7e40c12d0 2023-07-27T20:33:17.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.308+0000 7ff7eb3ff700 1 -- 172.21.15.72:0/98951110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7e40c12d0 msgr2=0x7ff7e41549f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:17.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.308+0000 7ff7eb3ff700 1 --2- 172.21.15.72:0/98951110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7e40c12d0 0x7ff7e41549f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc009d90 tx=0x7ff7dc00b330 comp rx=0 tx=0).stop 2023-07-27T20:33:17.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.308+0000 7ff7eb3ff700 1 -- 172.21.15.72:0/98951110 shutdown_connections 2023-07-27T20:33:17.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.308+0000 7ff7eb3ff700 1 --2- 172.21.15.72:0/98951110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7e40c12d0 0x7ff7e41549f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:17.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.308+0000 7ff7eb3ff700 1 -- 172.21.15.72:0/98951110 >> 172.21.15.72:0/98951110 conn(0x7ff7e406a190 msgr2=0x7ff7e406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:17.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.308+0000 7ff7eb3ff700 1 -- 172.21.15.72:0/98951110 shutdown_connections 2023-07-27T20:33:17.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.308+0000 7ff7eb3ff700 1 -- 172.21.15.72:0/98951110 wait complete. 2023-07-27T20:33:17.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.310+0000 7ff7eb3ff700 1 Processor -- start 2023-07-27T20:33:17.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.311+0000 7ff7eb3ff700 1 -- start start 2023-07-27T20:33:17.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.312+0000 7ff7eb3ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff7e40c12d0 0x7ff7e4070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:17.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.312+0000 7ff7eb3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7e4139960 0x7ff7e41289c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:17.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.312+0000 7ff7eb3ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff7e4139f80 0x7ff7e4128f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:17.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.312+0000 7ff7eb3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e414f210 con 0x7ff7e4139960 2023-07-27T20:33:17.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.312+0000 7ff7eb3ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e4129440 con 0x7ff7e40c12d0 2023-07-27T20:33:17.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.312+0000 7ff7eb3ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e4153c10 con 0x7ff7e4139f80 2023-07-27T20:33:17.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.312+0000 7ff7e899a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7e4139960 0x7ff7e41289c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:17.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.312+0000 7ff7e899a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7e4139960 0x7ff7e41289c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57800/0 (socket says 172.21.15.72:57800) 2023-07-27T20:33:17.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.312+0000 7ff7e899a700 1 -- 172.21.15.72:0/3810992488 learned_addr learned my addr 172.21.15.72:0/3810992488 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:17.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.312+0000 7ff7e919b700 1 --2- 172.21.15.72:0/3810992488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff7e40c12d0 0x7ff7e4070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:17.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.312+0000 7ff7e999c700 1 --2- 172.21.15.72:0/3810992488 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff7e4139f80 0x7ff7e4128f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:17.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.312+0000 7ff7e899a700 1 -- 172.21.15.72:0/3810992488 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff7e4139f80 msgr2=0x7ff7e4128f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:17.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.312+0000 7ff7e899a700 1 --2- 172.21.15.72:0/3810992488 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff7e4139f80 0x7ff7e4128f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:17.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.312+0000 7ff7e899a700 1 -- 172.21.15.72:0/3810992488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff7e40c12d0 msgr2=0x7ff7e4070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:17.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.312+0000 7ff7e899a700 1 --2- 172.21.15.72:0/3810992488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff7e40c12d0 0x7ff7e4070ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:17.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.312+0000 7ff7e899a700 1 -- 172.21.15.72:0/3810992488 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7dc009a70 con 0x7ff7e4139960 2023-07-27T20:33:17.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.313+0000 7ff7e899a700 1 --2- 172.21.15.72:0/3810992488 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7e4139960 0x7ff7e41289c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff7d400c4e0 tx=0x7ff7d400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:17.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.313+0000 7ff7d9ffb700 1 -- 172.21.15.72:0/3810992488 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d40052d0 con 0x7ff7e4139960 2023-07-27T20:33:17.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.313+0000 7ff7d9ffb700 1 -- 172.21.15.72:0/3810992488 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7d4005430 con 0x7ff7e4139960 2023-07-27T20:33:17.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.313+0000 7ff7eb3ff700 1 -- 172.21.15.72:0/3810992488 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7e4153e70 con 0x7ff7e4139960 2023-07-27T20:33:17.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.313+0000 7ff7d9ffb700 1 -- 172.21.15.72:0/3810992488 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d40038c0 con 0x7ff7e4139960 2023-07-27T20:33:17.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.313+0000 7ff7eb3ff700 1 -- 172.21.15.72:0/3810992488 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7e4150930 con 0x7ff7e4139960 2023-07-27T20:33:17.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.314+0000 7ff7eb3ff700 1 -- 172.21.15.72:0/3810992488 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7e40aa4f0 con 0x7ff7e4139960 2023-07-27T20:33:17.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.315+0000 7ff7d9ffb700 1 -- 172.21.15.72:0/3810992488 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff7d4003a20 con 0x7ff7e4139960 2023-07-27T20:33:17.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.316+0000 7ff7d9ffb700 1 --2- 172.21.15.72:0/3810992488 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff7c806ace0 0x7ff7c806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:17.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.317+0000 7ff7d9ffb700 1 -- 172.21.15.72:0/3810992488 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7ff7d40889e0 con 0x7ff7e4139960 2023-07-27T20:33:17.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.317+0000 7ff7e919b700 1 --2- 172.21.15.72:0/3810992488 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff7c806ace0 0x7ff7c806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:17.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.318+0000 7ff7e919b700 1 --2- 172.21.15.72:0/3810992488 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff7c806ace0 0x7ff7c806d1a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0007fd0 tx=0x7ff7e0007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:17.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.321+0000 7ff7d9ffb700 1 -- 172.21.15.72:0/3810992488 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff7d4053870 con 0x7ff7e4139960 2023-07-27T20:33:17.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.518+0000 7ff7eb3ff700 1 -- 172.21.15.72:0/3810992488 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7e4074310 con 0x7ff7e4139960 2023-07-27T20:33:17.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.519+0000 7ff7d9ffb700 1 -- 172.21.15.72:0/3810992488 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18596 (secure 0 0 0) 0x7ff7d4056e90 con 0x7ff7e4139960 2023-07-27T20:33:17.507 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:33:17.508 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":43,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:33:11.120578+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:32:58.242890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-27T20:32:59.032110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2c","mappings":[{"from":0,"to":4}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:33:17.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.522+0000 7ff7eb3ff700 1 -- 172.21.15.72:0/3810992488 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff7c806ace0 msgr2=0x7ff7c806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:17.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.522+0000 7ff7eb3ff700 1 --2- 172.21.15.72:0/3810992488 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff7c806ace0 0x7ff7c806d1a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0007fd0 tx=0x7ff7e0007dc0 comp rx=0 tx=0).stop 2023-07-27T20:33:17.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.522+0000 7ff7eb3ff700 1 -- 172.21.15.72:0/3810992488 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7e4139960 msgr2=0x7ff7e41289c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:17.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.522+0000 7ff7eb3ff700 1 --2- 172.21.15.72:0/3810992488 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7e4139960 0x7ff7e41289c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff7d400c4e0 tx=0x7ff7d400c7f0 comp rx=0 tx=0).stop 2023-07-27T20:33:17.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.522+0000 7ff7eb3ff700 1 -- 172.21.15.72:0/3810992488 shutdown_connections 2023-07-27T20:33:17.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.522+0000 7ff7eb3ff700 1 --2- 172.21.15.72:0/3810992488 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff7c806ace0 0x7ff7c806d1a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:17.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.522+0000 7ff7eb3ff700 1 --2- 172.21.15.72:0/3810992488 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff7e4139f80 0x7ff7e4128f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:17.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.522+0000 7ff7eb3ff700 1 --2- 172.21.15.72:0/3810992488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff7e40c12d0 0x7ff7e4070ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:17.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.522+0000 7ff7eb3ff700 1 --2- 172.21.15.72:0/3810992488 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7e4139960 0x7ff7e41289c0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:17.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.522+0000 7ff7eb3ff700 1 -- 172.21.15.72:0/3810992488 >> 172.21.15.72:0/3810992488 conn(0x7ff7e406a190 msgr2=0x7ff7e406d100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:17.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.522+0000 7ff7eb3ff700 1 -- 172.21.15.72:0/3810992488 shutdown_connections 2023-07-27T20:33:17.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.522+0000 7ff7eb3ff700 1 -- 172.21.15.72:0/3810992488 wait complete. 2023-07-27T20:33:17.527 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-27T20:31:14.581785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T20:31:21.077941+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T20:32:58.242890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T20:32:59.032110+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-27T20:33:17.529 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-27T20:33:17.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.741+0000 7f31b6fff700 1 Processor -- start 2023-07-27T20:33:17.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.741+0000 7f31b6fff700 1 -- start start 2023-07-27T20:33:17.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.742+0000 7f31b6fff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f31b0071190 0x7f31b0158100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:17.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.742+0000 7f31b6fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31b00a8ec0 con 0x7f31b00a8aa0 2023-07-27T20:33:17.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.742+0000 7f31b6fff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31b0071700 con 0x7f31b00a86c0 2023-07-27T20:33:17.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.742+0000 7f31b6fff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31b00c3e30 con 0x7f31b0071190 2023-07-27T20:33:17.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.742+0000 7f31b559c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f31b00a8aa0 0x7f31b006b2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58274/0 (socket says 172.21.15.72:58274) 2023-07-27T20:33:17.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.742+0000 7f31b559c700 1 -- 172.21.15.72:0/2993129757 learned_addr learned my addr 172.21.15.72:0/2993129757 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:17.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.742+0000 7f31affff700 1 --2- 172.21.15.72:0/2993129757 >> v2:172.21.15.173:3300/0 conn(0x7f31b0071190 0x7f31b0158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:17.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.743+0000 7f31af7fe700 1 -- 172.21.15.72:0/2993129757 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 461909296 0 0) 0x7f31b00a8ec0 con 0x7f31b00a8aa0 2023-07-27T20:33:17.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.743+0000 7f31af7fe700 1 -- 172.21.15.72:0/2993129757 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31a00035b0 con 0x7f31b00a8aa0 2023-07-27T20:33:17.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.743+0000 7f31af7fe700 1 -- 172.21.15.72:0/2993129757 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3538832417 0 0) 0x7f31b0071700 con 0x7f31b00a86c0 2023-07-27T20:33:17.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.743+0000 7f31affff700 1 -- 172.21.15.72:0/2993129757 >> v1:172.21.15.173:6789/0 conn(0x7f31b00a86c0 legacy=0x7f31b0154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:17.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.743+0000 7f31affff700 1 -- 172.21.15.72:0/2993129757 >> v1:172.21.15.72:6789/0 conn(0x7f31b00a8aa0 legacy=0x7f31b006b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:17.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.743+0000 7f31affff700 1 -- 172.21.15.72:0/2993129757 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b00719e0 con 0x7f31b0071190 2023-07-27T20:33:17.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.743+0000 7f31affff700 1 --2- 172.21.15.72:0/2993129757 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31b0071190 0x7f31b0158100 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f319c009840 tx=0x7f319c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd66aae2e922f1cc server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:17.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.744+0000 7f31af7fe700 1 -- 172.21.15.72:0/2993129757 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319c011830 con 0x7f31b0071190 2023-07-27T20:33:17.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.744+0000 7f31af7fe700 1 -- 172.21.15.72:0/2993129757 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319c011990 con 0x7f31b0071190 2023-07-27T20:33:17.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.744+0000 7f31af7fe700 1 -- 172.21.15.72:0/2993129757 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319c011d20 con 0x7f31b0071190 2023-07-27T20:33:17.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.744+0000 7f31b6fff700 1 -- 172.21.15.72:0/2993129757 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31b0071190 msgr2=0x7f31b0158100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:17.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.744+0000 7f31b6fff700 1 --2- 172.21.15.72:0/2993129757 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31b0071190 0x7f31b0158100 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f319c009840 tx=0x7f319c009b50 comp rx=0 tx=0).stop 2023-07-27T20:33:17.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.745+0000 7f31b6fff700 1 -- 172.21.15.72:0/2993129757 shutdown_connections 2023-07-27T20:33:17.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.745+0000 7f31b6fff700 1 --2- 172.21.15.72:0/2993129757 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31b0071190 0x7f31b0158100 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:17.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.745+0000 7f31b6fff700 1 -- 172.21.15.72:0/2993129757 >> 172.21.15.72:0/2993129757 conn(0x7f31b00c2fd0 msgr2=0x7f31b00c33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:17.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.745+0000 7f31b6fff700 1 -- 172.21.15.72:0/2993129757 shutdown_connections 2023-07-27T20:33:17.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.745+0000 7f31b6fff700 1 -- 172.21.15.72:0/2993129757 wait complete. 2023-07-27T20:33:17.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.746+0000 7f31b6fff700 1 Processor -- start 2023-07-27T20:33:17.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.746+0000 7f31b6fff700 1 -- start start 2023-07-27T20:33:17.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.747+0000 7f31b6fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f31b0071190 0x7f31b01e9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:17.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.747+0000 7f31b6fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31b00a86c0 0x7f31b0156970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:17.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.747+0000 7f31b6fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31b00a8aa0 0x7f31b01ec940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:17.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.747+0000 7f31b6fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b0157000 con 0x7f31b00a86c0 2023-07-27T20:33:17.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.747+0000 7f31b6fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b01e9460 con 0x7f31b00a8aa0 2023-07-27T20:33:17.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.747+0000 7f31b6fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b01e9740 con 0x7f31b0071190 2023-07-27T20:33:17.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.747+0000 7f31affff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31b00a86c0 0x7f31b0156970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:17.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.748+0000 7f31affff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31b00a86c0 0x7f31b0156970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57810/0 (socket says 172.21.15.72:57810) 2023-07-27T20:33:17.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.748+0000 7f31affff700 1 -- 172.21.15.72:0/1268968436 learned_addr learned my addr 172.21.15.72:0/1268968436 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:17.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.748+0000 7f31b559c700 1 --2- 172.21.15.72:0/1268968436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31b00a8aa0 0x7f31b01ec940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:17.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.748+0000 7f31b4d9b700 1 --2- 172.21.15.72:0/1268968436 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f31b0071190 0x7f31b01e9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:17.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.748+0000 7f31affff700 1 -- 172.21.15.72:0/1268968436 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f31b0071190 msgr2=0x7f31b01e9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:17.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.748+0000 7f31affff700 1 --2- 172.21.15.72:0/1268968436 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f31b0071190 0x7f31b01e9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:17.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.748+0000 7f31affff700 1 -- 172.21.15.72:0/1268968436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31b00a8aa0 msgr2=0x7f31b01ec940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:17.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.748+0000 7f31affff700 1 --2- 172.21.15.72:0/1268968436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31b00a8aa0 0x7f31b01ec940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:17.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.748+0000 7f31affff700 1 -- 172.21.15.72:0/1268968436 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319c0094a0 con 0x7f31b00a86c0 2023-07-27T20:33:17.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.748+0000 7f31affff700 1 --2- 172.21.15.72:0/1268968436 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31b00a86c0 0x7f31b0156970 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f319c014040 tx=0x7f319c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:17.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.749+0000 7f31ad7fa700 1 -- 172.21.15.72:0/1268968436 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319c01a7e0 con 0x7f31b00a86c0 2023-07-27T20:33:17.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.749+0000 7f31ad7fa700 1 -- 172.21.15.72:0/1268968436 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319c01a940 con 0x7f31b00a86c0 2023-07-27T20:33:17.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.749+0000 7f31ad7fa700 1 -- 172.21.15.72:0/1268968436 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319c01acd0 con 0x7f31b00a86c0 2023-07-27T20:33:17.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.749+0000 7f31b6fff700 1 -- 172.21.15.72:0/1268968436 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b01e9a20 con 0x7f31b00a86c0 2023-07-27T20:33:17.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.749+0000 7f31b6fff700 1 -- 172.21.15.72:0/1268968436 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b01572e0 con 0x7f31b00a86c0 2023-07-27T20:33:17.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.750+0000 7f31b6fff700 1 -- 172.21.15.72:0/1268968436 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31b01e9c30 con 0x7f31b00a86c0 2023-07-27T20:33:17.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.751+0000 7f31ad7fa700 1 -- 172.21.15.72:0/1268968436 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f319c022070 con 0x7f31b00a86c0 2023-07-27T20:33:17.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.752+0000 7f31ad7fa700 1 --2- 172.21.15.72:0/1268968436 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f319406ace0 0x7f319406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:17.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.752+0000 7f31ad7fa700 1 -- 172.21.15.72:0/1268968436 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f319c08a280 con 0x7f31b00a86c0 2023-07-27T20:33:17.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.752+0000 7f31b4d9b700 1 --2- 172.21.15.72:0/1268968436 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f319406ace0 0x7f319406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:17.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.753+0000 7f31b4d9b700 1 --2- 172.21.15.72:0/1268968436 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f319406ace0 0x7f319406d1a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f31a4007fd0 tx=0x7f31a4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:17.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.756+0000 7f31ad7fa700 1 -- 172.21.15.72:0/1268968436 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f319c0551a0 con 0x7f31b00a86c0 2023-07-27T20:33:17.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.949+0000 7f31b6fff700 1 -- 172.21.15.72:0/1268968436 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f31b004e470 con 0x7f31b00a86c0 2023-07-27T20:33:17.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.949+0000 7f31ad7fa700 1 -- 172.21.15.72:0/1268968436 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f319c0150a0 con 0x7f31b00a86c0 2023-07-27T20:33:17.938 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-27T20:33:17.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.952+0000 7f31b6fff700 1 -- 172.21.15.72:0/1268968436 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f319406ace0 msgr2=0x7f319406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:17.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.952+0000 7f31b6fff700 1 --2- 172.21.15.72:0/1268968436 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f319406ace0 0x7f319406d1a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f31a4007fd0 tx=0x7f31a4009040 comp rx=0 tx=0).stop 2023-07-27T20:33:17.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.952+0000 7f31b6fff700 1 -- 172.21.15.72:0/1268968436 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31b00a86c0 msgr2=0x7f31b0156970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:17.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.952+0000 7f31b6fff700 1 --2- 172.21.15.72:0/1268968436 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31b00a86c0 0x7f31b0156970 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f319c014040 tx=0x7f319c004750 comp rx=0 tx=0).stop 2023-07-27T20:33:17.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.952+0000 7f31b6fff700 1 -- 172.21.15.72:0/1268968436 shutdown_connections 2023-07-27T20:33:17.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.952+0000 7f31b6fff700 1 --2- 172.21.15.72:0/1268968436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31b00a8aa0 0x7f31b01ec940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:17.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.952+0000 7f31b6fff700 1 --2- 172.21.15.72:0/1268968436 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f319406ace0 0x7f319406d1a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:17.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.952+0000 7f31b6fff700 1 --2- 172.21.15.72:0/1268968436 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f31b0071190 0x7f31b01e9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:17.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.952+0000 7f31b6fff700 1 --2- 172.21.15.72:0/1268968436 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31b00a86c0 0x7f31b0156970 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:17.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.952+0000 7f31b6fff700 1 -- 172.21.15.72:0/1268968436 >> 172.21.15.72:0/1268968436 conn(0x7f31b00c2fd0 msgr2=0x7f31b00c33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:17.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.952+0000 7f31b6fff700 1 -- 172.21.15.72:0/1268968436 shutdown_connections 2023-07-27T20:33:17.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:17.952+0000 7f31b6fff700 1 -- 172.21.15.72:0/1268968436 wait complete. 2023-07-27T20:33:17.957 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T20:33:18.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.168+0000 7fcdaad9d700 1 Processor -- start 2023-07-27T20:33:18.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.168+0000 7fcdaad9d700 1 -- start start 2023-07-27T20:33:18.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.169+0000 7fcdaad9d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcda40c6160 0x7fcda4154990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:18.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.169+0000 7fcdaad9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcda40c6540 0x7fcda4157c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:18.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.169+0000 7fcdaad9d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcda40c69d0 con 0x7fcda406cef0 2023-07-27T20:33:18.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.169+0000 7fcdaad9d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcda4158150 con 0x7fcda40c6540 2023-07-27T20:33:18.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.169+0000 7fcdaad9d700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda40c7650 con 0x7fcda40c6160 2023-07-27T20:33:18.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.169+0000 7fcda959a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fcda406cef0 0x7fcda4157500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58286/0 (socket says 172.21.15.72:58286) 2023-07-27T20:33:18.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.169+0000 7fcda959a700 1 -- 172.21.15.72:0/4209362305 learned_addr learned my addr 172.21.15.72:0/4209362305 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:18.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.169+0000 7fcdaa59c700 1 --2- 172.21.15.72:0/4209362305 >> v2:172.21.15.72:3300/0 conn(0x7fcda40c6540 0x7fcda4157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:18.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.169+0000 7fcda9d9b700 1 --2- 172.21.15.72:0/4209362305 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcda40c6160 0x7fcda4154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:18.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.170+0000 7fcda8d99700 1 -- 172.21.15.72:0/4209362305 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 179373884 0 0) 0x7fcd94001110 con 0x7fcda406cef0 2023-07-27T20:33:18.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.170+0000 7fcdaa59c700 1 -- 172.21.15.72:0/4209362305 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcda40c6160 msgr2=0x7fcda4154990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:18.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.170+0000 7fcdaa59c700 1 --2- 172.21.15.72:0/4209362305 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcda40c6160 0x7fcda4154990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:18.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.170+0000 7fcdaa59c700 1 -- 172.21.15.72:0/4209362305 >> v1:172.21.15.72:6789/0 conn(0x7fcda406cef0 legacy=0x7fcda4157500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:18.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.170+0000 7fcdaa59c700 1 -- 172.21.15.72:0/4209362305 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda40c4970 con 0x7fcda40c6540 2023-07-27T20:33:18.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.170+0000 7fcdaa59c700 1 --2- 172.21.15.72:0/4209362305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcda40c6540 0x7fcda4157c10 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c009d90 tx=0x7fcd9c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f87e61fa80c4dd7 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:18.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.170+0000 7fcda8d99700 1 -- 172.21.15.72:0/4209362305 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c00e070 con 0x7fcda40c6540 2023-07-27T20:33:18.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.170+0000 7fcda8d99700 1 -- 172.21.15.72:0/4209362305 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9c00bbd0 con 0x7fcda40c6540 2023-07-27T20:33:18.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.170+0000 7fcda8d99700 1 -- 172.21.15.72:0/4209362305 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c012430 con 0x7fcda40c6540 2023-07-27T20:33:18.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.171+0000 7fcdaad9d700 1 -- 172.21.15.72:0/4209362305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcda40c6540 msgr2=0x7fcda4157c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:18.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.171+0000 7fcdaad9d700 1 --2- 172.21.15.72:0/4209362305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcda40c6540 0x7fcda4157c10 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c009d90 tx=0x7fcd9c00b330 comp rx=0 tx=0).stop 2023-07-27T20:33:18.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.171+0000 7fcdaad9d700 1 -- 172.21.15.72:0/4209362305 shutdown_connections 2023-07-27T20:33:18.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.171+0000 7fcdaad9d700 1 --2- 172.21.15.72:0/4209362305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcda40c6540 0x7fcda4157c10 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:18.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.171+0000 7fcdaad9d700 1 --2- 172.21.15.72:0/4209362305 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcda40c6160 0x7fcda4154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:18.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.171+0000 7fcdaad9d700 1 -- 172.21.15.72:0/4209362305 >> 172.21.15.72:0/4209362305 conn(0x7fcda40ab340 msgr2=0x7fcda40ab720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:18.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.171+0000 7fcdaad9d700 1 -- 172.21.15.72:0/4209362305 shutdown_connections 2023-07-27T20:33:18.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.171+0000 7fcdaad9d700 1 -- 172.21.15.72:0/4209362305 wait complete. 2023-07-27T20:33:18.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.172+0000 7fcdaad9d700 1 Processor -- start 2023-07-27T20:33:18.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.172+0000 7fcdaad9d700 1 -- start start 2023-07-27T20:33:18.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.173+0000 7fcdaad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcda406cef0 0x7fcda41e9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:18.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.173+0000 7fcdaad9d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcda40c6160 0x7fcda4151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:18.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.173+0000 7fcdaad9d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcda40c6540 0x7fcda4156100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:18.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.173+0000 7fcdaad9d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda40c3560 con 0x7fcda406cef0 2023-07-27T20:33:18.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.173+0000 7fcdaad9d700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda40bfb20 con 0x7fcda40c6160 2023-07-27T20:33:18.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.173+0000 7fcdaad9d700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda41e95b0 con 0x7fcda40c6540 2023-07-27T20:33:18.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.174+0000 7fcda9d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcda406cef0 0x7fcda41e9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:18.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.174+0000 7fcda9d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcda406cef0 0x7fcda41e9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57836/0 (socket says 172.21.15.72:57836) 2023-07-27T20:33:18.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.174+0000 7fcda9d9b700 1 -- 172.21.15.72:0/3088804678 learned_addr learned my addr 172.21.15.72:0/3088804678 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:18.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.174+0000 7fcda9d9b700 1 -- 172.21.15.72:0/3088804678 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcda40c6540 msgr2=0x7fcda4156100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:18.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.174+0000 7fcda9d9b700 1 --2- 172.21.15.72:0/3088804678 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcda40c6540 0x7fcda4156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:18.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.174+0000 7fcda9d9b700 1 -- 172.21.15.72:0/3088804678 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcda40c6160 msgr2=0x7fcda4151d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:18.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.174+0000 7fcda9d9b700 1 --2- 172.21.15.72:0/3088804678 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcda40c6160 0x7fcda4151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:18.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.174+0000 7fcda9d9b700 1 -- 172.21.15.72:0/3088804678 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9c009a70 con 0x7fcda406cef0 2023-07-27T20:33:18.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.174+0000 7fcda9d9b700 1 --2- 172.21.15.72:0/3088804678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcda406cef0 0x7fcda41e9a40 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fcda000e840 tx=0x7fcda000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:18.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.174+0000 7fcd9a7fc700 1 -- 172.21.15.72:0/3088804678 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda0013610 con 0x7fcda406cef0 2023-07-27T20:33:18.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.174+0000 7fcd9a7fc700 1 -- 172.21.15.72:0/3088804678 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda0013770 con 0x7fcda406cef0 2023-07-27T20:33:18.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.174+0000 7fcdaad9d700 1 -- 172.21.15.72:0/3088804678 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcda41e8f80 con 0x7fcda406cef0 2023-07-27T20:33:18.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.174+0000 7fcd9a7fc700 1 -- 172.21.15.72:0/3088804678 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda0013b20 con 0x7fcda406cef0 2023-07-27T20:33:18.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.175+0000 7fcdaad9d700 1 -- 172.21.15.72:0/3088804678 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcda40c0050 con 0x7fcda406cef0 2023-07-27T20:33:18.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.175+0000 7fcdaad9d700 1 -- 172.21.15.72:0/3088804678 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcda41e9890 con 0x7fcda406cef0 2023-07-27T20:33:18.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.176+0000 7fcd9a7fc700 1 -- 172.21.15.72:0/3088804678 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcda0013c80 con 0x7fcda406cef0 2023-07-27T20:33:18.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.178+0000 7fcd9a7fc700 1 --2- 172.21.15.72:0/3088804678 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcd8806ace0 0x7fcd8806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:18.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.178+0000 7fcd9a7fc700 1 -- 172.21.15.72:0/3088804678 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fcda00892e0 con 0x7fcda406cef0 2023-07-27T20:33:18.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.178+0000 7fcda959a700 1 --2- 172.21.15.72:0/3088804678 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcd8806ace0 0x7fcd8806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:18.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.179+0000 7fcda959a700 1 --2- 172.21.15.72:0/3088804678 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcd8806ace0 0x7fcd8806d1a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fcda41e6ae0 tx=0x7fcd94001310 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:18.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.182+0000 7fcd9a7fc700 1 -- 172.21.15.72:0/3088804678 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcda0054200 con 0x7fcda406cef0 2023-07-27T20:33:18.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.374+0000 7fcdaad9d700 1 -- 172.21.15.72:0/3088804678 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcda40c0240 con 0x7fcda406cef0 2023-07-27T20:33:18.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.375+0000 7fcd9a7fc700 1 -- 172.21.15.72:0/3088804678 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v43) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcda0057820 con 0x7fcda406cef0 2023-07-27T20:33:18.363 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-27T20:33:18.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.377+0000 7fcdaad9d700 1 -- 172.21.15.72:0/3088804678 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcd8806ace0 msgr2=0x7fcd8806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:18.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.377+0000 7fcdaad9d700 1 --2- 172.21.15.72:0/3088804678 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcd8806ace0 0x7fcd8806d1a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fcda41e6ae0 tx=0x7fcd94001310 comp rx=0 tx=0).stop 2023-07-27T20:33:18.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.377+0000 7fcdaad9d700 1 -- 172.21.15.72:0/3088804678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcda406cef0 msgr2=0x7fcda41e9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:18.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.377+0000 7fcdaad9d700 1 --2- 172.21.15.72:0/3088804678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcda406cef0 0x7fcda41e9a40 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fcda000e840 tx=0x7fcda000ec00 comp rx=0 tx=0).stop 2023-07-27T20:33:18.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.377+0000 7fcdaad9d700 1 -- 172.21.15.72:0/3088804678 shutdown_connections 2023-07-27T20:33:18.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.377+0000 7fcdaad9d700 1 --2- 172.21.15.72:0/3088804678 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcd8806ace0 0x7fcd8806d1a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:18.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.377+0000 7fcdaad9d700 1 --2- 172.21.15.72:0/3088804678 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcda40c6540 0x7fcda4156100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:18.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.377+0000 7fcdaad9d700 1 --2- 172.21.15.72:0/3088804678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcda406cef0 0x7fcda41e9a40 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:18.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.377+0000 7fcdaad9d700 1 --2- 172.21.15.72:0/3088804678 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcda40c6160 0x7fcda4151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:18.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.377+0000 7fcdaad9d700 1 -- 172.21.15.72:0/3088804678 >> 172.21.15.72:0/3088804678 conn(0x7fcda40ab340 msgr2=0x7fcda406c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:18.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.377+0000 7fcdaad9d700 1 -- 172.21.15.72:0/3088804678 shutdown_connections 2023-07-27T20:33:18.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.377+0000 7fcdaad9d700 1 -- 172.21.15.72:0/3088804678 wait complete. 2023-07-27T20:33:18.383 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T20:33:18.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.596+0000 7ff6115ff700 1 Processor -- start 2023-07-27T20:33:18.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.596+0000 7ff6115ff700 1 -- start start 2023-07-27T20:33:18.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.597+0000 7ff6115ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff60c1516a0 0x7ff60c0c76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:18.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.597+0000 7ff6115ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff60c0c5420 0x7ff60c0c5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:18.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.597+0000 7ff6115ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff60c158400 con 0x7ff60c0c43d0 2023-07-27T20:33:18.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.597+0000 7ff6115ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff60c0c4920 con 0x7ff60c1516a0 2023-07-27T20:33:18.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.597+0000 7ff6115ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff60c157860 con 0x7ff60c0c5420 2023-07-27T20:33:18.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.597+0000 7ff60affd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff60c1516a0 0x7ff60c0c76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:18.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.597+0000 7ff60affd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff60c1516a0 0x7ff60c0c76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57842/0 (socket says 172.21.15.72:57842) 2023-07-27T20:33:18.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.597+0000 7ff60affd700 1 -- 172.21.15.72:0/1882867 learned_addr learned my addr 172.21.15.72:0/1882867 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:18.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.598+0000 7ff60affd700 1 -- 172.21.15.72:0/1882867 >> v2:172.21.15.173:3300/0 conn(0x7ff60c0c5420 msgr2=0x7ff60c0c5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:18.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.598+0000 7ff60affd700 1 --2- 172.21.15.72:0/1882867 >> v2:172.21.15.173:3300/0 conn(0x7ff60c0c5420 0x7ff60c0c5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:18.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.598+0000 7ff60affd700 1 -- 172.21.15.72:0/1882867 >> v1:172.21.15.173:6789/0 conn(0x7ff60c0c43d0 legacy=0x7ff60c157cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:18.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.598+0000 7ff60affd700 1 -- 172.21.15.72:0/1882867 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60c0c4b70 con 0x7ff60c1516a0 2023-07-27T20:33:18.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.598+0000 7ff60affd700 1 --2- 172.21.15.72:0/1882867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff60c1516a0 0x7ff60c0c76a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff60c154fd0 tx=0x7ff5fc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb8202179abc587 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:18.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.598+0000 7ff609ffb700 1 -- 172.21.15.72:0/1882867 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc004230 con 0x7ff60c1516a0 2023-07-27T20:33:18.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.598+0000 7ff609ffb700 1 -- 172.21.15.72:0/1882867 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5fc004390 con 0x7ff60c1516a0 2023-07-27T20:33:18.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.598+0000 7ff609ffb700 1 -- 172.21.15.72:0/1882867 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc0036a0 con 0x7ff60c1516a0 2023-07-27T20:33:18.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.599+0000 7ff6115ff700 1 -- 172.21.15.72:0/1882867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff60c1516a0 msgr2=0x7ff60c0c76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:18.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.599+0000 7ff6115ff700 1 --2- 172.21.15.72:0/1882867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff60c1516a0 0x7ff60c0c76a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff60c154fd0 tx=0x7ff5fc009bd0 comp rx=0 tx=0).stop 2023-07-27T20:33:18.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.599+0000 7ff6115ff700 1 -- 172.21.15.72:0/1882867 shutdown_connections 2023-07-27T20:33:18.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.599+0000 7ff6115ff700 1 --2- 172.21.15.72:0/1882867 >> v2:172.21.15.173:3300/0 conn(0x7ff60c0c5420 0x7ff60c0c5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:18.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.599+0000 7ff6115ff700 1 --2- 172.21.15.72:0/1882867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff60c1516a0 0x7ff60c0c76a0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:18.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.599+0000 7ff6115ff700 1 -- 172.21.15.72:0/1882867 >> 172.21.15.72:0/1882867 conn(0x7ff60c0ab290 msgr2=0x7ff60c0ab6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:18.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.599+0000 7ff6115ff700 1 -- 172.21.15.72:0/1882867 shutdown_connections 2023-07-27T20:33:18.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.599+0000 7ff6115ff700 1 -- 172.21.15.72:0/1882867 wait complete. 2023-07-27T20:33:18.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.600+0000 7ff6115ff700 1 Processor -- start 2023-07-27T20:33:18.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.601+0000 7ff6115ff700 1 -- start start 2023-07-27T20:33:18.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.601+0000 7ff6115ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff60c0c43d0 0x7ff60c146d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:18.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.601+0000 7ff6115ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff60c0c5420 0x7ff60c149cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:18.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.602+0000 7ff6115ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff60c1516a0 0x7ff60c1e9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:18.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.602+0000 7ff6115ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c0ab000 con 0x7ff60c0c5420 2023-07-27T20:33:18.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.602+0000 7ff6115ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c141670 con 0x7ff60c1516a0 2023-07-27T20:33:18.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.602+0000 7ff6115ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c147240 con 0x7ff60c0c43d0 2023-07-27T20:33:18.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.602+0000 7ff60a7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff60c0c5420 0x7ff60c149cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:18.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.602+0000 7ff60a7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff60c0c5420 0x7ff60c149cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57852/0 (socket says 172.21.15.72:57852) 2023-07-27T20:33:18.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.602+0000 7ff60a7fc700 1 -- 172.21.15.72:0/3801329911 learned_addr learned my addr 172.21.15.72:0/3801329911 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:18.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.602+0000 7ff60affd700 1 --2- 172.21.15.72:0/3801329911 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff60c0c43d0 0x7ff60c146d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:18.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.602+0000 7ff60b7fe700 1 --2- 172.21.15.72:0/3801329911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff60c1516a0 0x7ff60c1e9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:18.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.602+0000 7ff60a7fc700 1 -- 172.21.15.72:0/3801329911 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff60c0c43d0 msgr2=0x7ff60c146d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:18.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.602+0000 7ff60a7fc700 1 --2- 172.21.15.72:0/3801329911 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff60c0c43d0 0x7ff60c146d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:18.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.602+0000 7ff60a7fc700 1 -- 172.21.15.72:0/3801329911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff60c1516a0 msgr2=0x7ff60c1e9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:18.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.602+0000 7ff60a7fc700 1 --2- 172.21.15.72:0/3801329911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff60c1516a0 0x7ff60c1e9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:18.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.602+0000 7ff60a7fc700 1 -- 172.21.15.72:0/3801329911 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5fc009550 con 0x7ff60c0c5420 2023-07-27T20:33:18.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.602+0000 7ff60b7fe700 1 --2- 172.21.15.72:0/3801329911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff60c1516a0 0x7ff60c1e9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:33:18.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.603+0000 7ff60a7fc700 1 --2- 172.21.15.72:0/3801329911 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff60c0c5420 0x7ff60c149cb0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff60000b450 tx=0x7ff60000b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:18.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.603+0000 7ff5f37fe700 1 -- 172.21.15.72:0/3801329911 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff600011830 con 0x7ff60c0c5420 2023-07-27T20:33:18.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.603+0000 7ff5f37fe700 1 -- 172.21.15.72:0/3801329911 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff600011990 con 0x7ff60c0c5420 2023-07-27T20:33:18.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.603+0000 7ff5f37fe700 1 -- 172.21.15.72:0/3801329911 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff600011d20 con 0x7ff60c0c5420 2023-07-27T20:33:18.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.603+0000 7ff6115ff700 1 -- 172.21.15.72:0/3801329911 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff60c156150 con 0x7ff60c0c5420 2023-07-27T20:33:18.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.603+0000 7ff6115ff700 1 -- 172.21.15.72:0/3801329911 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff60c148ef0 con 0x7ff60c0c5420 2023-07-27T20:33:18.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.604+0000 7ff6115ff700 1 -- 172.21.15.72:0/3801329911 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff60c074310 con 0x7ff60c0c5420 2023-07-27T20:33:18.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.605+0000 7ff5f37fe700 1 -- 172.21.15.72:0/3801329911 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff60001a400 con 0x7ff60c0c5420 2023-07-27T20:33:18.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.606+0000 7ff5f37fe700 1 --2- 172.21.15.72:0/3801329911 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff5f806ace0 0x7ff5f806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:18.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.606+0000 7ff5f37fe700 1 -- 172.21.15.72:0/3801329911 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7ff600089580 con 0x7ff60c0c5420 2023-07-27T20:33:18.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.606+0000 7ff60affd700 1 --2- 172.21.15.72:0/3801329911 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff5f806ace0 0x7ff5f806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:18.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.607+0000 7ff60affd700 1 --2- 172.21.15.72:0/3801329911 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff5f806ace0 0x7ff5f806d1a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc009130 tx=0x7ff5fc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:18.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.610+0000 7ff5f37fe700 1 -- 172.21.15.72:0/3801329911 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff6000544a0 con 0x7ff60c0c5420 2023-07-27T20:33:18.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.802+0000 7ff6115ff700 1 -- 172.21.15.72:0/3801329911 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff60c0c41b0 con 0x7ff60c0c5420 2023-07-27T20:33:18.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.802+0000 7ff5f37fe700 1 -- 172.21.15.72:0/3801329911 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff600057ac0 con 0x7ff60c0c5420 2023-07-27T20:33:18.791 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:33:18.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.805+0000 7ff6115ff700 1 -- 172.21.15.72:0/3801329911 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff5f806ace0 msgr2=0x7ff5f806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:18.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.805+0000 7ff6115ff700 1 --2- 172.21.15.72:0/3801329911 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff5f806ace0 0x7ff5f806d1a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc009130 tx=0x7ff5fc008030 comp rx=0 tx=0).stop 2023-07-27T20:33:18.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.805+0000 7ff6115ff700 1 -- 172.21.15.72:0/3801329911 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff60c0c5420 msgr2=0x7ff60c149cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:18.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.805+0000 7ff6115ff700 1 --2- 172.21.15.72:0/3801329911 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff60c0c5420 0x7ff60c149cb0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff60000b450 tx=0x7ff60000b760 comp rx=0 tx=0).stop 2023-07-27T20:33:18.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.805+0000 7ff6115ff700 1 -- 172.21.15.72:0/3801329911 shutdown_connections 2023-07-27T20:33:18.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.805+0000 7ff6115ff700 1 --2- 172.21.15.72:0/3801329911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff60c1516a0 0x7ff60c1e9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:18.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.805+0000 7ff6115ff700 1 --2- 172.21.15.72:0/3801329911 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff5f806ace0 0x7ff5f806d1a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:18.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.805+0000 7ff6115ff700 1 --2- 172.21.15.72:0/3801329911 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff60c0c43d0 0x7ff60c146d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:18.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.805+0000 7ff6115ff700 1 --2- 172.21.15.72:0/3801329911 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff60c0c5420 0x7ff60c149cb0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:18.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.805+0000 7ff6115ff700 1 -- 172.21.15.72:0/3801329911 >> 172.21.15.72:0/3801329911 conn(0x7ff60c0ab290 msgr2=0x7ff60c0c6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:18.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.805+0000 7ff6115ff700 1 -- 172.21.15.72:0/3801329911 shutdown_connections 2023-07-27T20:33:18.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:18.805+0000 7ff6115ff700 1 -- 172.21.15.72:0/3801329911 wait complete. 2023-07-27T20:33:18.810 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T20:33:19.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.020+0000 7f61973ff700 1 Processor -- start 2023-07-27T20:33:19.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.021+0000 7f61973ff700 1 -- start start 2023-07-27T20:33:19.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.022+0000 7f61973ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f61900c7740 0x7f61900c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:19.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.022+0000 7f61973ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61900c4700 0x7f619006c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:19.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.022+0000 7f61973ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61900c7c50 con 0x7f619014aab0 2023-07-27T20:33:19.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.022+0000 7f61973ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f619006bd40 con 0x7f61900c7740 2023-07-27T20:33:19.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.022+0000 7f61973ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61900c62f0 con 0x7f61900c4700 2023-07-27T20:33:19.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.023+0000 7f619499a700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f61900c7740 0x7f61900c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:19.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.023+0000 7f619599c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61900c4700 0x7f619006c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:19.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.023+0000 7f619519b700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f619014aab0 0x7f6190154b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.72:49728/0 (socket says 172.21.15.72:49728) 2023-07-27T20:33:19.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.023+0000 7f619519b700 1 -- 172.21.15.72:0/616824207 learned_addr learned my addr 172.21.15.72:0/616824207 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:19.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.023+0000 7f619599c700 1 -- 172.21.15.72:0/616824207 >> v2:172.21.15.173:3300/0 conn(0x7f61900c7740 msgr2=0x7f61900c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:19.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.023+0000 7f619599c700 1 --2- 172.21.15.72:0/616824207 >> v2:172.21.15.173:3300/0 conn(0x7f61900c7740 0x7f61900c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:19.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.023+0000 7f619599c700 1 -- 172.21.15.72:0/616824207 >> v1:172.21.15.173:6789/0 conn(0x7f619014aab0 legacy=0x7f6190154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:19.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.023+0000 7f6187fff700 1 -- 172.21.15.72:0/616824207 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1795112255 0 0) 0x7f61900c7c50 con 0x7f619014aab0 2023-07-27T20:33:19.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.023+0000 7f619599c700 1 -- 172.21.15.72:0/616824207 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f619006d200 con 0x7f61900c4700 2023-07-27T20:33:19.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.023+0000 7f619599c700 1 --2- 172.21.15.72:0/616824207 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61900c4700 0x7f619006c1d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6188009d90 tx=0x7f618800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccbaab1bb387eaf0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:19.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.024+0000 7f6187fff700 1 -- 172.21.15.72:0/616824207 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618800e070 con 0x7f61900c4700 2023-07-27T20:33:19.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.024+0000 7f6187fff700 1 -- 172.21.15.72:0/616824207 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618800bb20 con 0x7f61900c4700 2023-07-27T20:33:19.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.024+0000 7f6187fff700 1 -- 172.21.15.72:0/616824207 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6188012430 con 0x7f61900c4700 2023-07-27T20:33:19.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.024+0000 7f61973ff700 1 -- 172.21.15.72:0/616824207 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61900c4700 msgr2=0x7f619006c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:19.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.024+0000 7f61973ff700 1 --2- 172.21.15.72:0/616824207 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61900c4700 0x7f619006c1d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6188009d90 tx=0x7f618800b330 comp rx=0 tx=0).stop 2023-07-27T20:33:19.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.024+0000 7f61973ff700 1 -- 172.21.15.72:0/616824207 shutdown_connections 2023-07-27T20:33:19.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.024+0000 7f61973ff700 1 --2- 172.21.15.72:0/616824207 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61900c4700 0x7f619006c1d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:19.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.024+0000 7f61973ff700 1 --2- 172.21.15.72:0/616824207 >> v2:172.21.15.173:3300/0 conn(0x7f61900c7740 0x7f61900c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:19.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.024+0000 7f61973ff700 1 -- 172.21.15.72:0/616824207 >> 172.21.15.72:0/616824207 conn(0x7f61900ab3f0 msgr2=0x7f61900ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:19.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.024+0000 7f61973ff700 1 -- 172.21.15.72:0/616824207 shutdown_connections 2023-07-27T20:33:19.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.024+0000 7f61973ff700 1 -- 172.21.15.72:0/616824207 wait complete. 2023-07-27T20:33:19.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.026+0000 7f61973ff700 1 Processor -- start 2023-07-27T20:33:19.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.026+0000 7f61973ff700 1 -- start start 2023-07-27T20:33:19.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.027+0000 7f61973ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61900c4700 0x7f6190149a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:19.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.027+0000 7f61973ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61900c7740 0x7f61901eca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:19.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.027+0000 7f61973ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f619014aab0 0x7f61901ecf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:19.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.027+0000 7f61973ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61900bdf50 con 0x7f619014aab0 2023-07-27T20:33:19.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.027+0000 7f61973ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61901e9db0 con 0x7f61900c7740 2023-07-27T20:33:19.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.027+0000 7f61973ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61901e94a0 con 0x7f61900c4700 2023-07-27T20:33:19.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.027+0000 7f619599c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f619014aab0 0x7f61901ecf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:19.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.027+0000 7f619599c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f619014aab0 0x7f61901ecf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57864/0 (socket says 172.21.15.72:57864) 2023-07-27T20:33:19.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.027+0000 7f619599c700 1 -- 172.21.15.72:0/2484037779 learned_addr learned my addr 172.21.15.72:0/2484037779 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:19.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.027+0000 7f619499a700 1 --2- 172.21.15.72:0/2484037779 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61900c7740 0x7f61901eca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:19.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.027+0000 7f619519b700 1 --2- 172.21.15.72:0/2484037779 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61900c4700 0x7f6190149a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:19.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.028+0000 7f619599c700 1 -- 172.21.15.72:0/2484037779 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61900c4700 msgr2=0x7f6190149a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:19.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.028+0000 7f619599c700 1 --2- 172.21.15.72:0/2484037779 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61900c4700 0x7f6190149a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:19.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.028+0000 7f619599c700 1 -- 172.21.15.72:0/2484037779 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61900c7740 msgr2=0x7f61901eca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:19.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.028+0000 7f619599c700 1 --2- 172.21.15.72:0/2484037779 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61900c7740 0x7f61901eca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:19.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.028+0000 7f619599c700 1 -- 172.21.15.72:0/2484037779 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6188009a70 con 0x7f619014aab0 2023-07-27T20:33:19.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.028+0000 7f619599c700 1 --2- 172.21.15.72:0/2484037779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f619014aab0 0x7f61901ecf50 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f61900a9200 tx=0x7f6188004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:19.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.028+0000 7f6185ffb700 1 -- 172.21.15.72:0/2484037779 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6188012430 con 0x7f619014aab0 2023-07-27T20:33:19.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.028+0000 7f6185ffb700 1 -- 172.21.15.72:0/2484037779 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6188020070 con 0x7f619014aab0 2023-07-27T20:33:19.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.028+0000 7f6185ffb700 1 -- 172.21.15.72:0/2484037779 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6188004280 con 0x7f619014aab0 2023-07-27T20:33:19.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.028+0000 7f61973ff700 1 -- 172.21.15.72:0/2484037779 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61900bd8e0 con 0x7f619014aab0 2023-07-27T20:33:19.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.029+0000 7f61973ff700 1 -- 172.21.15.72:0/2484037779 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61901e9a40 con 0x7f619014aab0 2023-07-27T20:33:19.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.029+0000 7f61973ff700 1 -- 172.21.15.72:0/2484037779 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61901e9bd0 con 0x7f619014aab0 2023-07-27T20:33:19.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.030+0000 7f6185ffb700 1 -- 172.21.15.72:0/2484037779 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f61880043e0 con 0x7f619014aab0 2023-07-27T20:33:19.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.031+0000 7f6185ffb700 1 --2- 172.21.15.72:0/2484037779 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f617406ace0 0x7f617406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:19.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.031+0000 7f6185ffb700 1 -- 172.21.15.72:0/2484037779 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f6188022070 con 0x7f619014aab0 2023-07-27T20:33:19.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.032+0000 7f619519b700 1 --2- 172.21.15.72:0/2484037779 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f617406ace0 0x7f617406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:19.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.032+0000 7f619519b700 1 --2- 172.21.15.72:0/2484037779 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f617406ace0 0x7f617406d1a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f618c000f60 tx=0x7f618c007e70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:19.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.035+0000 7f6185ffb700 1 -- 172.21.15.72:0/2484037779 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f61880561d0 con 0x7f619014aab0 2023-07-27T20:33:19.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.230+0000 7f61973ff700 1 -- 172.21.15.72:0/2484037779 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f619004e470 con 0x7f619014aab0 2023-07-27T20:33:19.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.230+0000 7f6185ffb700 1 -- 172.21.15.72:0/2484037779 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7f61880597f0 con 0x7f619014aab0 2023-07-27T20:33:19.218 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-27T20:33:19.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.232+0000 7f61973ff700 1 -- 172.21.15.72:0/2484037779 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f617406ace0 msgr2=0x7f617406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:19.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.232+0000 7f61973ff700 1 --2- 172.21.15.72:0/2484037779 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f617406ace0 0x7f617406d1a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f618c000f60 tx=0x7f618c007e70 comp rx=0 tx=0).stop 2023-07-27T20:33:19.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.232+0000 7f61973ff700 1 -- 172.21.15.72:0/2484037779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f619014aab0 msgr2=0x7f61901ecf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:19.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.232+0000 7f61973ff700 1 --2- 172.21.15.72:0/2484037779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f619014aab0 0x7f61901ecf50 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f61900a9200 tx=0x7f6188004ad0 comp rx=0 tx=0).stop 2023-07-27T20:33:19.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.232+0000 7f61973ff700 1 -- 172.21.15.72:0/2484037779 shutdown_connections 2023-07-27T20:33:19.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.232+0000 7f61973ff700 1 --2- 172.21.15.72:0/2484037779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f619014aab0 0x7f61901ecf50 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:19.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.232+0000 7f61973ff700 1 --2- 172.21.15.72:0/2484037779 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f617406ace0 0x7f617406d1a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:19.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.232+0000 7f61973ff700 1 --2- 172.21.15.72:0/2484037779 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61900c4700 0x7f6190149a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:19.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.232+0000 7f61973ff700 1 --2- 172.21.15.72:0/2484037779 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61900c7740 0x7f61901eca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:19.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.232+0000 7f61973ff700 1 -- 172.21.15.72:0/2484037779 >> 172.21.15.72:0/2484037779 conn(0x7f61900ab3f0 msgr2=0x7f61900aacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:19.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.232+0000 7f61973ff700 1 -- 172.21.15.72:0/2484037779 shutdown_connections 2023-07-27T20:33:19.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.233+0000 7f61973ff700 1 -- 172.21.15.72:0/2484037779 wait complete. 2023-07-27T20:33:19.237 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-27T20:33:19.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.446+0000 7fca587ff700 1 Processor -- start 2023-07-27T20:33:19.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.447+0000 7fca587ff700 1 -- start start 2023-07-27T20:33:19.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.448+0000 7fca587ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fca500c4400 0x7fca500c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:19.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.448+0000 7fca587ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fca5006b150 0x7fca500c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:19.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.448+0000 7fca587ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca500c5230 con 0x7fca501549f0 2023-07-27T20:33:19.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.448+0000 7fca587ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca501545d0 con 0x7fca500c4400 2023-07-27T20:33:19.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.448+0000 7fca587ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca5006c860 con 0x7fca5006b150 2023-07-27T20:33:19.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.448+0000 7fca5659b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fca500c4400 0x7fca500c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:19.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.448+0000 7fca5659b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fca500c4400 0x7fca500c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57872/0 (socket says 172.21.15.72:57872) 2023-07-27T20:33:19.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.448+0000 7fca5659b700 1 -- 172.21.15.72:0/1625377760 learned_addr learned my addr 172.21.15.72:0/1625377760 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:19.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.448+0000 7fca5659b700 1 -- 172.21.15.72:0/1625377760 >> v2:172.21.15.173:3300/0 conn(0x7fca5006b150 msgr2=0x7fca500c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:19.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.448+0000 7fca5659b700 1 --2- 172.21.15.72:0/1625377760 >> v2:172.21.15.173:3300/0 conn(0x7fca5006b150 0x7fca500c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:19.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.448+0000 7fca5659b700 1 -- 172.21.15.72:0/1625377760 >> v1:172.21.15.173:6789/0 conn(0x7fca501549f0 legacy=0x7fca501514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:19.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.448+0000 7fca5659b700 1 -- 172.21.15.72:0/1625377760 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5006b710 con 0x7fca500c4400 2023-07-27T20:33:19.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.449+0000 7fca5659b700 1 --2- 172.21.15.72:0/1625377760 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca500c4400 0x7fca500c7710 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fca500c0870 tx=0x7fca4c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d354e2b3897a6 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:19.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.449+0000 7fca55599700 1 -- 172.21.15.72:0/1625377760 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4c004230 con 0x7fca500c4400 2023-07-27T20:33:19.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.449+0000 7fca55599700 1 -- 172.21.15.72:0/1625377760 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4c004390 con 0x7fca500c4400 2023-07-27T20:33:19.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.449+0000 7fca55599700 1 -- 172.21.15.72:0/1625377760 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4c0036a0 con 0x7fca500c4400 2023-07-27T20:33:19.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.449+0000 7fca587ff700 1 -- 172.21.15.72:0/1625377760 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca500c4400 msgr2=0x7fca500c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:19.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.449+0000 7fca587ff700 1 --2- 172.21.15.72:0/1625377760 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca500c4400 0x7fca500c7710 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fca500c0870 tx=0x7fca4c009bd0 comp rx=0 tx=0).stop 2023-07-27T20:33:19.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.449+0000 7fca587ff700 1 -- 172.21.15.72:0/1625377760 shutdown_connections 2023-07-27T20:33:19.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.449+0000 7fca587ff700 1 --2- 172.21.15.72:0/1625377760 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca500c4400 0x7fca500c7710 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:19.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.449+0000 7fca587ff700 1 --2- 172.21.15.72:0/1625377760 >> v2:172.21.15.173:3300/0 conn(0x7fca5006b150 0x7fca500c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:19.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.449+0000 7fca587ff700 1 -- 172.21.15.72:0/1625377760 >> 172.21.15.72:0/1625377760 conn(0x7fca500ab300 msgr2=0x7fca500ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:19.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.450+0000 7fca587ff700 1 -- 172.21.15.72:0/1625377760 shutdown_connections 2023-07-27T20:33:19.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.450+0000 7fca587ff700 1 -- 172.21.15.72:0/1625377760 wait complete. 2023-07-27T20:33:19.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.451+0000 7fca587ff700 1 Processor -- start 2023-07-27T20:33:19.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.451+0000 7fca587ff700 1 -- start start 2023-07-27T20:33:19.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.452+0000 7fca587ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca5006b150 0x7fca50149cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:19.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.452+0000 7fca587ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca500c4400 0x7fca501ea2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:19.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.452+0000 7fca587ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca501549f0 0x7fca50147990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:19.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.452+0000 7fca587ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca500acdf0 con 0x7fca501549f0 2023-07-27T20:33:19.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.452+0000 7fca587ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca501e9bb0 con 0x7fca5006b150 2023-07-27T20:33:19.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.452+0000 7fca587ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca500acb50 con 0x7fca500c4400 2023-07-27T20:33:19.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.452+0000 7fca56d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca501549f0 0x7fca50147990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:19.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.452+0000 7fca56d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca501549f0 0x7fca50147990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57874/0 (socket says 172.21.15.72:57874) 2023-07-27T20:33:19.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.452+0000 7fca56d9c700 1 -- 172.21.15.72:0/2613507243 learned_addr learned my addr 172.21.15.72:0/2613507243 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:19.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.452+0000 7fca55d9a700 1 --2- 172.21.15.72:0/2613507243 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca500c4400 0x7fca501ea2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:19.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.453+0000 7fca5659b700 1 --2- 172.21.15.72:0/2613507243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca5006b150 0x7fca50149cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:19.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.453+0000 7fca56d9c700 1 -- 172.21.15.72:0/2613507243 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca500c4400 msgr2=0x7fca501ea2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:19.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.453+0000 7fca56d9c700 1 --2- 172.21.15.72:0/2613507243 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca500c4400 0x7fca501ea2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:19.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.453+0000 7fca56d9c700 1 -- 172.21.15.72:0/2613507243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca5006b150 msgr2=0x7fca50149cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:19.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.453+0000 7fca56d9c700 1 --2- 172.21.15.72:0/2613507243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca5006b150 0x7fca50149cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:19.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.453+0000 7fca56d9c700 1 -- 172.21.15.72:0/2613507243 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca4c009550 con 0x7fca501549f0 2023-07-27T20:33:19.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.453+0000 7fca56d9c700 1 --2- 172.21.15.72:0/2613507243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca501549f0 0x7fca50147990 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fca4800c7a0 tx=0x7fca4800cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:19.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.453+0000 7fca46ffd700 1 -- 172.21.15.72:0/2613507243 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca48003e10 con 0x7fca501549f0 2023-07-27T20:33:19.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.453+0000 7fca46ffd700 1 -- 172.21.15.72:0/2613507243 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca48005070 con 0x7fca501549f0 2023-07-27T20:33:19.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.453+0000 7fca46ffd700 1 -- 172.21.15.72:0/2613507243 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca48005420 con 0x7fca501549f0 2023-07-27T20:33:19.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.453+0000 7fca587ff700 1 -- 172.21.15.72:0/2613507243 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca500ade20 con 0x7fca501549f0 2023-07-27T20:33:19.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.453+0000 7fca587ff700 1 -- 172.21.15.72:0/2613507243 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca501e9dc0 con 0x7fca501549f0 2023-07-27T20:33:19.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.454+0000 7fca587ff700 1 -- 172.21.15.72:0/2613507243 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca501e9fb0 con 0x7fca501549f0 2023-07-27T20:33:19.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.455+0000 7fca46ffd700 1 -- 172.21.15.72:0/2613507243 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fca48005580 con 0x7fca501549f0 2023-07-27T20:33:19.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.456+0000 7fca46ffd700 1 --2- 172.21.15.72:0/2613507243 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fca3406ace0 0x7fca3406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:19.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.456+0000 7fca46ffd700 1 -- 172.21.15.72:0/2613507243 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fca480887c0 con 0x7fca501549f0 2023-07-27T20:33:19.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.457+0000 7fca5659b700 1 --2- 172.21.15.72:0/2613507243 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fca3406ace0 0x7fca3406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:19.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.457+0000 7fca5659b700 1 --2- 172.21.15.72:0/2613507243 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fca3406ace0 0x7fca3406d1a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fca4c009130 tx=0x7fca4c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:19.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.460+0000 7fca46ffd700 1 -- 172.21.15.72:0/2613507243 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fca480536e0 con 0x7fca501549f0 2023-07-27T20:33:19.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.657+0000 7fca587ff700 1 -- 172.21.15.72:0/2613507243 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fca5006bca0 con 0x7fca501549f0 2023-07-27T20:33:19.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.657+0000 7fca46ffd700 1 -- 172.21.15.72:0/2613507243 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v43) v1 ==== 84+0+268 (secure 0 0 0) 0x7fca48056d00 con 0x7fca501549f0 2023-07-27T20:33:19.645 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:33:19.645 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2023-07-27T20:33:19.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:33:19.646 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 1, 2023-07-27T20:33:19.646 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": ".mgr" 2023-07-27T20:33:19.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:33:19.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:33:19.647 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 2, 2023-07-27T20:33:19.647 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "rbd" 2023-07-27T20:33:19.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:33:19.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:33:19.648 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 6, 2023-07-27T20:33:19.648 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "cephfs_metadata" 2023-07-27T20:33:19.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:33:19.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:33:19.649 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 7, 2023-07-27T20:33:19.649 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "cephfs_data" 2023-07-27T20:33:19.649 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:33:19.649 INFO:teuthology.orchestra.run.smithi072.stdout:] 2023-07-27T20:33:19.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.660+0000 7fca587ff700 1 -- 172.21.15.72:0/2613507243 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fca3406ace0 msgr2=0x7fca3406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:19.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.660+0000 7fca587ff700 1 --2- 172.21.15.72:0/2613507243 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fca3406ace0 0x7fca3406d1a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fca4c009130 tx=0x7fca4c008030 comp rx=0 tx=0).stop 2023-07-27T20:33:19.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.660+0000 7fca587ff700 1 -- 172.21.15.72:0/2613507243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca501549f0 msgr2=0x7fca50147990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:19.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.660+0000 7fca587ff700 1 --2- 172.21.15.72:0/2613507243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca501549f0 0x7fca50147990 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fca4800c7a0 tx=0x7fca4800cab0 comp rx=0 tx=0).stop 2023-07-27T20:33:19.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.660+0000 7fca587ff700 1 -- 172.21.15.72:0/2613507243 shutdown_connections 2023-07-27T20:33:19.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.660+0000 7fca587ff700 1 --2- 172.21.15.72:0/2613507243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca501549f0 0x7fca50147990 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:19.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.660+0000 7fca587ff700 1 --2- 172.21.15.72:0/2613507243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca5006b150 0x7fca50149cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:19.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.660+0000 7fca587ff700 1 --2- 172.21.15.72:0/2613507243 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fca3406ace0 0x7fca3406d1a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:19.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.660+0000 7fca587ff700 1 --2- 172.21.15.72:0/2613507243 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca500c4400 0x7fca501ea2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:19.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.660+0000 7fca587ff700 1 -- 172.21.15.72:0/2613507243 >> 172.21.15.72:0/2613507243 conn(0x7fca500ab300 msgr2=0x7fca50152a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:19.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.660+0000 7fca587ff700 1 -- 172.21.15.72:0/2613507243 shutdown_connections 2023-07-27T20:33:19.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.660+0000 7fca587ff700 1 -- 172.21.15.72:0/2613507243 wait complete. 2023-07-27T20:33:19.665 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-07-27T20:33:19.666 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-07-27T20:33:19.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.878+0000 7f61d2dff700 1 Processor -- start 2023-07-27T20:33:19.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.878+0000 7f61d2dff700 1 -- start start 2023-07-27T20:33:19.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.879+0000 7f61d2dff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f61cc1518a0 0x7f61cc0c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:19.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.879+0000 7f61d2dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61cc0c2b40 0x7f61cc157760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:19.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.879+0000 7f61d2dff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61cc0c2050 con 0x7f61cc0c2660 2023-07-27T20:33:19.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.879+0000 7f61d2dff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61cc06c1e0 con 0x7f61cc1518a0 2023-07-27T20:33:19.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.879+0000 7f61d2dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc06bcb0 con 0x7f61cc0c2b40 2023-07-27T20:33:19.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.880+0000 7f61d139c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61cc0c2b40 0x7f61cc157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:19.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.880+0000 7f61d139c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61cc0c2b40 0x7f61cc157760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.72:54858/0 (socket says 172.21.15.72:54858) 2023-07-27T20:33:19.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.880+0000 7f61d139c700 1 -- 172.21.15.72:0/1239465754 learned_addr learned my addr 172.21.15.72:0/1239465754 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:19.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.880+0000 7f61d0b9b700 1 --2- 172.21.15.72:0/1239465754 >> v2:172.21.15.173:3300/0 conn(0x7f61cc1518a0 0x7f61cc0c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:19.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.880+0000 7f61d139c700 1 -- 172.21.15.72:0/1239465754 >> v2:172.21.15.173:3300/0 conn(0x7f61cc1518a0 msgr2=0x7f61cc0c55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:19.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.880+0000 7f61d139c700 1 --2- 172.21.15.72:0/1239465754 >> v2:172.21.15.173:3300/0 conn(0x7f61cc1518a0 0x7f61cc0c55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:19.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.880+0000 7f61d139c700 1 -- 172.21.15.72:0/1239465754 >> v1:172.21.15.173:6789/0 conn(0x7f61cc0c2660 legacy=0x7f61cc0c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:19.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.880+0000 7f61d139c700 1 -- 172.21.15.72:0/1239465754 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61cc0a6f30 con 0x7f61cc0c2b40 2023-07-27T20:33:19.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.880+0000 7f61cb7fe700 1 -- 172.21.15.72:0/1239465754 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1346747376 0 0) 0x7f61cc0c2050 con 0x7f61cc0c2660 2023-07-27T20:33:19.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.881+0000 7f61d139c700 1 --2- 172.21.15.72:0/1239465754 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61cc0c2b40 0x7f61cc157760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f61c4009e50 tx=0x7f61c400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d93bc7766276a19 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:19.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.881+0000 7f61cb7fe700 1 -- 172.21.15.72:0/1239465754 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c400e070 con 0x7f61cc0c2b40 2023-07-27T20:33:19.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.881+0000 7f61cb7fe700 1 -- 172.21.15.72:0/1239465754 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c400b910 con 0x7f61cc0c2b40 2023-07-27T20:33:19.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.881+0000 7f61cb7fe700 1 -- 172.21.15.72:0/1239465754 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c400bcc0 con 0x7f61cc0c2b40 2023-07-27T20:33:19.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.881+0000 7f61d2dff700 1 -- 172.21.15.72:0/1239465754 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61cc0c2b40 msgr2=0x7f61cc157760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:19.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.881+0000 7f61d2dff700 1 --2- 172.21.15.72:0/1239465754 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61cc0c2b40 0x7f61cc157760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f61c4009e50 tx=0x7f61c400b330 comp rx=0 tx=0).stop 2023-07-27T20:33:19.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.881+0000 7f61d2dff700 1 -- 172.21.15.72:0/1239465754 shutdown_connections 2023-07-27T20:33:19.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.881+0000 7f61d2dff700 1 --2- 172.21.15.72:0/1239465754 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61cc0c2b40 0x7f61cc157760 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:19.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.881+0000 7f61d2dff700 1 --2- 172.21.15.72:0/1239465754 >> v2:172.21.15.173:3300/0 conn(0x7f61cc1518a0 0x7f61cc0c55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:19.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.881+0000 7f61d2dff700 1 -- 172.21.15.72:0/1239465754 >> 172.21.15.72:0/1239465754 conn(0x7f61cc0c4150 msgr2=0x7f61cc0c4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:19.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.881+0000 7f61d2dff700 1 -- 172.21.15.72:0/1239465754 shutdown_connections 2023-07-27T20:33:19.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.882+0000 7f61d2dff700 1 -- 172.21.15.72:0/1239465754 wait complete. 2023-07-27T20:33:19.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.883+0000 7f61d2dff700 1 Processor -- start 2023-07-27T20:33:19.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.883+0000 7f61d2dff700 1 -- start start 2023-07-27T20:33:19.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.884+0000 7f61d2dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61cc0c2660 0x7f61cc06fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:19.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.884+0000 7f61d2dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61cc0c2b40 0x7f61cc0bf120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:19.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.884+0000 7f61d2dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61cc1518a0 0x7f61cc1eced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:19.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.884+0000 7f61d2dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc0706f0 con 0x7f61cc0c2b40 2023-07-27T20:33:19.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.884+0000 7f61d2dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc0c1000 con 0x7f61cc0c2660 2023-07-27T20:33:19.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.884+0000 7f61d2dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc154d70 con 0x7f61cc1518a0 2023-07-27T20:33:19.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.884+0000 7f61cbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61cc0c2b40 0x7f61cc0bf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:19.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.884+0000 7f61cbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61cc0c2b40 0x7f61cc0bf120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57886/0 (socket says 172.21.15.72:57886) 2023-07-27T20:33:19.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.884+0000 7f61cbfff700 1 -- 172.21.15.72:0/3533200034 learned_addr learned my addr 172.21.15.72:0/3533200034 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:19.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.885+0000 7f61d139c700 1 --2- 172.21.15.72:0/3533200034 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61cc1518a0 0x7f61cc1eced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:19.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.885+0000 7f61d0b9b700 1 --2- 172.21.15.72:0/3533200034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61cc0c2660 0x7f61cc06fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:19.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.885+0000 7f61cbfff700 1 -- 172.21.15.72:0/3533200034 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61cc1518a0 msgr2=0x7f61cc1eced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:19.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.885+0000 7f61cbfff700 1 --2- 172.21.15.72:0/3533200034 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61cc1518a0 0x7f61cc1eced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:19.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.885+0000 7f61cbfff700 1 -- 172.21.15.72:0/3533200034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61cc0c2660 msgr2=0x7f61cc06fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:19.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.885+0000 7f61cbfff700 1 --2- 172.21.15.72:0/3533200034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61cc0c2660 0x7f61cc06fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:19.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.885+0000 7f61cbfff700 1 -- 172.21.15.72:0/3533200034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c4009b30 con 0x7f61cc0c2b40 2023-07-27T20:33:19.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.885+0000 7f61cbfff700 1 --2- 172.21.15.72:0/3533200034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61cc0c2b40 0x7f61cc0bf120 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f61b80011e0 tx=0x7f61b800ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:19.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.885+0000 7f61c97fa700 1 -- 172.21.15.72:0/3533200034 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b80054e0 con 0x7f61cc0c2b40 2023-07-27T20:33:19.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.885+0000 7f61c97fa700 1 -- 172.21.15.72:0/3533200034 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b8003680 con 0x7f61cc0c2b40 2023-07-27T20:33:19.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.885+0000 7f61d2dff700 1 -- 172.21.15.72:0/3533200034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61cc0c6010 con 0x7f61cc0c2b40 2023-07-27T20:33:19.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.885+0000 7f61c97fa700 1 -- 172.21.15.72:0/3533200034 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b8003a30 con 0x7f61cc0c2b40 2023-07-27T20:33:19.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.886+0000 7f61d2dff700 1 -- 172.21.15.72:0/3533200034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61cc0c65d0 con 0x7f61cc0c2b40 2023-07-27T20:33:19.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.887+0000 7f61d2dff700 1 -- 172.21.15.72:0/3533200034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61cc0c1240 con 0x7f61cc0c2b40 2023-07-27T20:33:19.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.888+0000 7f61c97fa700 1 -- 172.21.15.72:0/3533200034 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f61b8003b90 con 0x7f61cc0c2b40 2023-07-27T20:33:19.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.889+0000 7f61c97fa700 1 --2- 172.21.15.72:0/3533200034 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f61b006ace0 0x7f61b006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:19.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.889+0000 7f61c97fa700 1 -- 172.21.15.72:0/3533200034 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f61b8088a60 con 0x7f61cc0c2b40 2023-07-27T20:33:19.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.889+0000 7f61d0b9b700 1 --2- 172.21.15.72:0/3533200034 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f61b006ace0 0x7f61b006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:19.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.890+0000 7f61d0b9b700 1 --2- 172.21.15.72:0/3533200034 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f61b006ace0 0x7f61b006d1a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f61c0009ad0 tx=0x7f61c0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:19.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:19.893+0000 7f61c97fa700 1 -- 172.21.15.72:0/3533200034 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f61cc0c1240 con 0x7f61cc0c2b40 2023-07-27T20:33:20.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.086+0000 7f61d2dff700 1 -- 172.21.15.72:0/3533200034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f61cc0c1240 con 0x7f61cc0c2b40 2023-07-27T20:33:20.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.170+0000 7f61c97fa700 1 -- 172.21.15.72:0/3533200034 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v44) v1 ==== 140+0+0 (secure 0 0 0) 0x7f61cc0c1240 con 0x7f61cc0c2b40 2023-07-27T20:33:20.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.174+0000 7f61d2dff700 1 -- 172.21.15.72:0/3533200034 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f61b006ace0 msgr2=0x7f61b006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:20.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.174+0000 7f61d2dff700 1 --2- 172.21.15.72:0/3533200034 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f61b006ace0 0x7f61b006d1a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f61c0009ad0 tx=0x7f61c0008040 comp rx=0 tx=0).stop 2023-07-27T20:33:20.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.174+0000 7f61d2dff700 1 -- 172.21.15.72:0/3533200034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61cc0c2b40 msgr2=0x7f61cc0bf120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:20.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.174+0000 7f61d2dff700 1 --2- 172.21.15.72:0/3533200034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61cc0c2b40 0x7f61cc0bf120 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f61b80011e0 tx=0x7f61b800ca30 comp rx=0 tx=0).stop 2023-07-27T20:33:20.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.176+0000 7f61d2dff700 1 -- 172.21.15.72:0/3533200034 shutdown_connections 2023-07-27T20:33:20.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.176+0000 7f61d2dff700 1 --2- 172.21.15.72:0/3533200034 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f61b006ace0 0x7f61b006d1a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:20.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.176+0000 7f61d2dff700 1 --2- 172.21.15.72:0/3533200034 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61cc1518a0 0x7f61cc1eced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:20.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.176+0000 7f61d2dff700 1 --2- 172.21.15.72:0/3533200034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61cc0c2660 0x7f61cc06fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:20.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.176+0000 7f61d2dff700 1 --2- 172.21.15.72:0/3533200034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61cc0c2b40 0x7f61cc0bf120 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:20.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.176+0000 7f61d2dff700 1 -- 172.21.15.72:0/3533200034 >> 172.21.15.72:0/3533200034 conn(0x7f61cc0c4150 msgr2=0x7f61cc14d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:20.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.177+0000 7f61d2dff700 1 -- 172.21.15.72:0/3533200034 shutdown_connections 2023-07-27T20:33:20.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.178+0000 7f61d2dff700 1 -- 172.21.15.72:0/3533200034 wait complete. 2023-07-27T20:33:20.167 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs2_metadata' created 2023-07-27T20:33:20.184 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-27T20:33:20.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.399+0000 7f4b65dff700 1 Processor -- start 2023-07-27T20:33:20.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.399+0000 7f4b65dff700 1 -- start start 2023-07-27T20:33:20.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.400+0000 7f4b65dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4b600c41e0 0x7f4b600c45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:20.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.400+0000 7f4b65dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b600c7760 0x7f4b6015e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:20.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.400+0000 7f4b65dff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b600ca7f0 con 0x7f4b600c4d60 2023-07-27T20:33:20.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.400+0000 7f4b65dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b60154060 con 0x7f4b600c41e0 2023-07-27T20:33:20.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.400+0000 7f4b65dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b600c5990 con 0x7f4b600c7760 2023-07-27T20:33:20.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.401+0000 7f4b5f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4b600c41e0 0x7f4b600c45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:20.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.401+0000 7f4b5f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4b600c41e0 0x7f4b600c45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39610/0 (socket says 172.21.15.72:39610) 2023-07-27T20:33:20.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.401+0000 7f4b5f7fe700 1 -- 172.21.15.72:0/888868478 learned_addr learned my addr 172.21.15.72:0/888868478 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:20.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.401+0000 7f4b5ffff700 1 --2- 172.21.15.72:0/888868478 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b600c7760 0x7f4b6015e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:20.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.401+0000 7f4b5f7fe700 1 -- 172.21.15.72:0/888868478 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b600c7760 msgr2=0x7f4b6015e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:20.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.401+0000 7f4b5f7fe700 1 --2- 172.21.15.72:0/888868478 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b600c7760 0x7f4b6015e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:20.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.401+0000 7f4b5f7fe700 1 -- 172.21.15.72:0/888868478 >> v1:172.21.15.173:6789/0 conn(0x7f4b600c4d60 legacy=0x7f4b60154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:20.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.401+0000 7f4b5f7fe700 1 -- 172.21.15.72:0/888868478 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b600c5c10 con 0x7f4b600c41e0 2023-07-27T20:33:20.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.401+0000 7f4b5f7fe700 1 --2- 172.21.15.72:0/888868478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b600c41e0 0x7f4b600c45c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4b500098f0 tx=0x7f4b50009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34baac3d4419fbaa server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:20.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.402+0000 7f4b5e7fc700 1 -- 172.21.15.72:0/888868478 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b50004230 con 0x7f4b600c41e0 2023-07-27T20:33:20.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.402+0000 7f4b5e7fc700 1 -- 172.21.15.72:0/888868478 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b50004390 con 0x7f4b600c41e0 2023-07-27T20:33:20.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.402+0000 7f4b5e7fc700 1 -- 172.21.15.72:0/888868478 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b500036a0 con 0x7f4b600c41e0 2023-07-27T20:33:20.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.402+0000 7f4b65dff700 1 -- 172.21.15.72:0/888868478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b600c41e0 msgr2=0x7f4b600c45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:20.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.402+0000 7f4b65dff700 1 --2- 172.21.15.72:0/888868478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b600c41e0 0x7f4b600c45c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4b500098f0 tx=0x7f4b50009c00 comp rx=0 tx=0).stop 2023-07-27T20:33:20.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.402+0000 7f4b65dff700 1 -- 172.21.15.72:0/888868478 shutdown_connections 2023-07-27T20:33:20.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.402+0000 7f4b65dff700 1 --2- 172.21.15.72:0/888868478 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b600c7760 0x7f4b6015e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:20.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.402+0000 7f4b65dff700 1 --2- 172.21.15.72:0/888868478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b600c41e0 0x7f4b600c45c0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:20.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.402+0000 7f4b65dff700 1 -- 172.21.15.72:0/888868478 >> 172.21.15.72:0/888868478 conn(0x7f4b600c9860 msgr2=0x7f4b600c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:20.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.402+0000 7f4b65dff700 1 -- 172.21.15.72:0/888868478 shutdown_connections 2023-07-27T20:33:20.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.402+0000 7f4b65dff700 1 -- 172.21.15.72:0/888868478 wait complete. 2023-07-27T20:33:20.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.404+0000 7f4b65dff700 1 Processor -- start 2023-07-27T20:33:20.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.404+0000 7f4b65dff700 1 -- start start 2023-07-27T20:33:20.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.405+0000 7f4b65dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b600c41e0 0x7f4b600aa5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:20.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.405+0000 7f4b65dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b600c4d60 0x7f4b600c1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:20.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.405+0000 7f4b65dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b600c7760 0x7f4b600c1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:20.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.405+0000 7f4b65dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6014d6a0 con 0x7f4b600c4d60 2023-07-27T20:33:20.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.405+0000 7f4b65dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b600bc790 con 0x7f4b600c41e0 2023-07-27T20:33:20.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.405+0000 7f4b65dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b600bca70 con 0x7f4b600c7760 2023-07-27T20:33:20.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.405+0000 7f4b5effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b600c4d60 0x7f4b600c1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:20.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.405+0000 7f4b5effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b600c4d60 0x7f4b600c1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39622/0 (socket says 172.21.15.72:39622) 2023-07-27T20:33:20.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.405+0000 7f4b5effd700 1 -- 172.21.15.72:0/1997529582 learned_addr learned my addr 172.21.15.72:0/1997529582 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:20.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.405+0000 7f4b5ffff700 1 --2- 172.21.15.72:0/1997529582 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b600c7760 0x7f4b600c1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:20.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.405+0000 7f4b5f7fe700 1 --2- 172.21.15.72:0/1997529582 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b600c41e0 0x7f4b600aa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:20.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.406+0000 7f4b5effd700 1 -- 172.21.15.72:0/1997529582 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b600c7760 msgr2=0x7f4b600c1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:20.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.406+0000 7f4b5effd700 1 --2- 172.21.15.72:0/1997529582 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b600c7760 0x7f4b600c1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:20.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.406+0000 7f4b5effd700 1 -- 172.21.15.72:0/1997529582 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b600c41e0 msgr2=0x7f4b600aa5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:20.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.406+0000 7f4b5effd700 1 --2- 172.21.15.72:0/1997529582 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b600c41e0 0x7f4b600aa5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:20.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.406+0000 7f4b5effd700 1 -- 172.21.15.72:0/1997529582 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b50009550 con 0x7f4b600c4d60 2023-07-27T20:33:20.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.406+0000 7f4b5effd700 1 --2- 172.21.15.72:0/1997529582 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b600c4d60 0x7f4b600c1a70 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4b5400c4d0 tx=0x7f4b5400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:20.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.406+0000 7f4b47fff700 1 -- 172.21.15.72:0/1997529582 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b54011790 con 0x7f4b600c4d60 2023-07-27T20:33:20.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.406+0000 7f4b47fff700 1 -- 172.21.15.72:0/1997529582 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b540118f0 con 0x7f4b600c4d60 2023-07-27T20:33:20.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.406+0000 7f4b65dff700 1 -- 172.21.15.72:0/1997529582 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b6014d940 con 0x7f4b600c4d60 2023-07-27T20:33:20.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.406+0000 7f4b47fff700 1 -- 172.21.15.72:0/1997529582 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b54011ca0 con 0x7f4b600c4d60 2023-07-27T20:33:20.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.406+0000 7f4b65dff700 1 -- 172.21.15.72:0/1997529582 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b600aab10 con 0x7f4b600c4d60 2023-07-27T20:33:20.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.408+0000 7f4b65dff700 1 -- 172.21.15.72:0/1997529582 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b6004e470 con 0x7f4b600c4d60 2023-07-27T20:33:20.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.409+0000 7f4b47fff700 1 -- 172.21.15.72:0/1997529582 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4b5401c460 con 0x7f4b600c4d60 2023-07-27T20:33:20.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.410+0000 7f4b47fff700 1 --2- 172.21.15.72:0/1997529582 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4b4c06ace0 0x7f4b4c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:20.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.410+0000 7f4b47fff700 1 -- 172.21.15.72:0/1997529582 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6811+0+0 (secure 0 0 0) 0x7f4b54089ef0 con 0x7f4b600c4d60 2023-07-27T20:33:20.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.410+0000 7f4b5f7fe700 1 --2- 172.21.15.72:0/1997529582 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4b4c06ace0 0x7f4b4c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:20.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.411+0000 7f4b5f7fe700 1 --2- 172.21.15.72:0/1997529582 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4b4c06ace0 0x7f4b4c06d1a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4b50009130 tx=0x7f4b50008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:20.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.414+0000 7f4b47fff700 1 -- 172.21.15.72:0/1997529582 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4b54054d90 con 0x7f4b600c4d60 2023-07-27T20:33:20.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:20.609+0000 7f4b65dff700 1 -- 172.21.15.72:0/1997529582 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4b600c9590 con 0x7f4b600c4d60 2023-07-27T20:33:21.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.179+0000 7f4b47fff700 1 -- 172.21.15.72:0/1997529582 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v45) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4b540583b0 con 0x7f4b600c4d60 2023-07-27T20:33:21.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.190+0000 7f4b65dff700 1 -- 172.21.15.72:0/1997529582 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4b4c06ace0 msgr2=0x7f4b4c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:21.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.190+0000 7f4b65dff700 1 --2- 172.21.15.72:0/1997529582 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4b4c06ace0 0x7f4b4c06d1a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4b50009130 tx=0x7f4b50008030 comp rx=0 tx=0).stop 2023-07-27T20:33:21.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.190+0000 7f4b65dff700 1 -- 172.21.15.72:0/1997529582 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b600c4d60 msgr2=0x7f4b600c1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:21.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.190+0000 7f4b65dff700 1 --2- 172.21.15.72:0/1997529582 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b600c4d60 0x7f4b600c1a70 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4b5400c4d0 tx=0x7f4b5400c7e0 comp rx=0 tx=0).stop 2023-07-27T20:33:21.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.192+0000 7f4b65dff700 1 -- 172.21.15.72:0/1997529582 shutdown_connections 2023-07-27T20:33:21.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.192+0000 7f4b65dff700 1 --2- 172.21.15.72:0/1997529582 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4b4c06ace0 0x7f4b4c06d1a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:21.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.192+0000 7f4b65dff700 1 --2- 172.21.15.72:0/1997529582 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b600c7760 0x7f4b600c1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:21.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.192+0000 7f4b65dff700 1 --2- 172.21.15.72:0/1997529582 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b600c41e0 0x7f4b600aa5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:21.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.192+0000 7f4b65dff700 1 --2- 172.21.15.72:0/1997529582 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b600c4d60 0x7f4b600c1a70 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:21.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.192+0000 7f4b65dff700 1 -- 172.21.15.72:0/1997529582 >> 172.21.15.72:0/1997529582 conn(0x7f4b600c9860 msgr2=0x7f4b60151da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:21.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.193+0000 7f4b65dff700 1 -- 172.21.15.72:0/1997529582 shutdown_connections 2023-07-27T20:33:21.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.193+0000 7f4b65dff700 1 -- 172.21.15.72:0/1997529582 wait complete. 2023-07-27T20:33:21.185 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs2_data' created 2023-07-27T20:33:21.207 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-07-27T20:33:21.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.420+0000 7f153afff700 1 Processor -- start 2023-07-27T20:33:21.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.420+0000 7f153afff700 1 -- start start 2023-07-27T20:33:21.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.421+0000 7f153afff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f153414aab0 0x7f1534154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:21.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.421+0000 7f153afff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f15340c7740 0x7f15340c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:21.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.421+0000 7f153afff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15340c7c50 con 0x7f15340c4700 2023-07-27T20:33:21.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.421+0000 7f153afff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f153406bd40 con 0x7f15340c7740 2023-07-27T20:33:21.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.421+0000 7f153afff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15340c62f0 con 0x7f153414aab0 2023-07-27T20:33:21.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.422+0000 7f1538d9b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f153414aab0 0x7f1534154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:21.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.422+0000 7f153959c700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f15340c4700 0x7f153406c1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.72:46508/0 (socket says 172.21.15.72:46508) 2023-07-27T20:33:21.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.422+0000 7f153959c700 1 -- 172.21.15.72:0/4159571117 learned_addr learned my addr 172.21.15.72:0/4159571117 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:21.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.422+0000 7f1533fff700 1 --2- 172.21.15.72:0/4159571117 >> v2:172.21.15.173:3300/0 conn(0x7f15340c7740 0x7f15340c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:21.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.422+0000 7f15337fe700 1 -- 172.21.15.72:0/4159571117 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2165328336 0 0) 0x7f15340c7c50 con 0x7f15340c4700 2023-07-27T20:33:21.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.422+0000 7f15337fe700 1 -- 172.21.15.72:0/4159571117 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15240035b0 con 0x7f15340c4700 2023-07-27T20:33:21.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.422+0000 7f1538d9b700 1 -- 172.21.15.72:0/4159571117 >> v2:172.21.15.173:3300/0 conn(0x7f15340c7740 msgr2=0x7f15340c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:21.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.422+0000 7f1538d9b700 1 --2- 172.21.15.72:0/4159571117 >> v2:172.21.15.173:3300/0 conn(0x7f15340c7740 0x7f15340c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:21.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.422+0000 7f1538d9b700 1 -- 172.21.15.72:0/4159571117 >> v1:172.21.15.173:6789/0 conn(0x7f15340c4700 legacy=0x7f153406c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:21.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.422+0000 7f1538d9b700 1 -- 172.21.15.72:0/4159571117 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1534155050 con 0x7f153414aab0 2023-07-27T20:33:21.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.422+0000 7f1533fff700 1 --2- 172.21.15.72:0/4159571117 >> v2:172.21.15.173:3300/0 conn(0x7f15340c7740 0x7f15340c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:33:21.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.422+0000 7f1538d9b700 1 --2- 172.21.15.72:0/4159571117 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f153414aab0 0x7f1534154b10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1528009840 tx=0x7f1528009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2f0070a4cffd165 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:21.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.423+0000 7f15337fe700 1 -- 172.21.15.72:0/4159571117 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1528011830 con 0x7f153414aab0 2023-07-27T20:33:21.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.423+0000 7f15337fe700 1 -- 172.21.15.72:0/4159571117 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1528011990 con 0x7f153414aab0 2023-07-27T20:33:21.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.423+0000 7f15337fe700 1 -- 172.21.15.72:0/4159571117 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1528011d20 con 0x7f153414aab0 2023-07-27T20:33:21.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.423+0000 7f153afff700 1 -- 172.21.15.72:0/4159571117 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f153414aab0 msgr2=0x7f1534154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:21.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.423+0000 7f153afff700 1 --2- 172.21.15.72:0/4159571117 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f153414aab0 0x7f1534154b10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1528009840 tx=0x7f1528009b50 comp rx=0 tx=0).stop 2023-07-27T20:33:21.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.423+0000 7f153afff700 1 -- 172.21.15.72:0/4159571117 shutdown_connections 2023-07-27T20:33:21.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.423+0000 7f153afff700 1 --2- 172.21.15.72:0/4159571117 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f153414aab0 0x7f1534154b10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:21.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.423+0000 7f153afff700 1 --2- 172.21.15.72:0/4159571117 >> v2:172.21.15.173:3300/0 conn(0x7f15340c7740 0x7f15340c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:21.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.423+0000 7f153afff700 1 -- 172.21.15.72:0/4159571117 >> 172.21.15.72:0/4159571117 conn(0x7f15340ab3f0 msgr2=0x7f15340ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:21.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.423+0000 7f153afff700 1 -- 172.21.15.72:0/4159571117 shutdown_connections 2023-07-27T20:33:21.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.423+0000 7f153afff700 1 -- 172.21.15.72:0/4159571117 wait complete. 2023-07-27T20:33:21.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.425+0000 7f153afff700 1 Processor -- start 2023-07-27T20:33:21.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.425+0000 7f153afff700 1 -- start start 2023-07-27T20:33:21.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.426+0000 7f153afff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15340c4700 0x7f15340c2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:21.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.426+0000 7f153afff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f15340c7740 0x7f1534156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:21.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.426+0000 7f153afff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f153414aab0 0x7f1534141ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:21.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.426+0000 7f153afff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1534156420 con 0x7f153414aab0 2023-07-27T20:33:21.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.426+0000 7f153afff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15340c1990 con 0x7f15340c4700 2023-07-27T20:33:21.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.426+0000 7f153afff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15341434e0 con 0x7f15340c7740 2023-07-27T20:33:21.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.426+0000 7f153959c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f153414aab0 0x7f1534141ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:21.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.427+0000 7f153959c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f153414aab0 0x7f1534141ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39636/0 (socket says 172.21.15.72:39636) 2023-07-27T20:33:21.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.427+0000 7f153959c700 1 -- 172.21.15.72:0/2215167973 learned_addr learned my addr 172.21.15.72:0/2215167973 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:21.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.427+0000 7f1533fff700 1 --2- 172.21.15.72:0/2215167973 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f15340c7740 0x7f1534156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:21.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.427+0000 7f1538d9b700 1 --2- 172.21.15.72:0/2215167973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15340c4700 0x7f15340c2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:21.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.427+0000 7f153959c700 1 -- 172.21.15.72:0/2215167973 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f15340c7740 msgr2=0x7f1534156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:21.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.427+0000 7f153959c700 1 --2- 172.21.15.72:0/2215167973 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f15340c7740 0x7f1534156840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:21.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.427+0000 7f153959c700 1 -- 172.21.15.72:0/2215167973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15340c4700 msgr2=0x7f15340c2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:21.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.427+0000 7f153959c700 1 --2- 172.21.15.72:0/2215167973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15340c4700 0x7f15340c2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:21.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.427+0000 7f153959c700 1 -- 172.21.15.72:0/2215167973 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15200094a0 con 0x7f153414aab0 2023-07-27T20:33:21.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.427+0000 7f153959c700 1 --2- 172.21.15.72:0/2215167973 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f153414aab0 0x7f1534141ad0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f152c00cb40 tx=0x7f152c00ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:21.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.427+0000 7f15317fa700 1 -- 172.21.15.72:0/2215167973 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152c00a9e0 con 0x7f153414aab0 2023-07-27T20:33:21.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.427+0000 7f15317fa700 1 -- 172.21.15.72:0/2215167973 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f152c00ab40 con 0x7f153414aab0 2023-07-27T20:33:21.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.427+0000 7f153afff700 1 -- 172.21.15.72:0/2215167973 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15280094a0 con 0x7f153414aab0 2023-07-27T20:33:21.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.427+0000 7f15317fa700 1 -- 172.21.15.72:0/2215167973 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152c012400 con 0x7f153414aab0 2023-07-27T20:33:21.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.428+0000 7f153afff700 1 -- 172.21.15.72:0/2215167973 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15340c1c20 con 0x7f153414aab0 2023-07-27T20:33:21.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.429+0000 7f153afff700 1 -- 172.21.15.72:0/2215167973 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15340c3a00 con 0x7f153414aab0 2023-07-27T20:33:21.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.430+0000 7f15317fa700 1 -- 172.21.15.72:0/2215167973 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f152c01b3b0 con 0x7f153414aab0 2023-07-27T20:33:21.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.431+0000 7f15317fa700 1 --2- 172.21.15.72:0/2215167973 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f151806ace0 0x7f151806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:21.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.431+0000 7f15317fa700 1 -- 172.21.15.72:0/2215167973 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 7194+0+0 (secure 0 0 0) 0x7f152c0894f0 con 0x7f153414aab0 2023-07-27T20:33:21.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.431+0000 7f1538d9b700 1 --2- 172.21.15.72:0/2215167973 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f151806ace0 0x7f151806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:21.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.432+0000 7f1538d9b700 1 --2- 172.21.15.72:0/2215167973 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f151806ace0 0x7f151806d1a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1528000c00 tx=0x7f1528008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:21.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.435+0000 7f15317fa700 1 -- 172.21.15.72:0/2215167973 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f152c0541d0 con 0x7f153414aab0 2023-07-27T20:33:21.459 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:33:21.464 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:33:21.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:21.677+0000 7f153afff700 1 -- 172.21.15.72:0/2215167973 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f153404e470 con 0x7f153414aab0 2023-07-27T20:33:22.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.182+0000 7f15317fa700 1 -- 172.21.15.72:0/2215167973 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 8 and data pool 9 v18) v1 ==== 175+0+0 (secure 0 0 0) 0x7f152c0577f0 con 0x7f153414aab0 2023-07-27T20:33:22.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.192+0000 7f153afff700 1 -- 172.21.15.72:0/2215167973 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f151806ace0 msgr2=0x7f151806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:22.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.192+0000 7f153afff700 1 --2- 172.21.15.72:0/2215167973 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f151806ace0 0x7f151806d1a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1528000c00 tx=0x7f1528008030 comp rx=0 tx=0).stop 2023-07-27T20:33:22.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.192+0000 7f153afff700 1 -- 172.21.15.72:0/2215167973 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f153414aab0 msgr2=0x7f1534141ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:22.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.192+0000 7f153afff700 1 --2- 172.21.15.72:0/2215167973 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f153414aab0 0x7f1534141ad0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f152c00cb40 tx=0x7f152c00ce50 comp rx=0 tx=0).stop 2023-07-27T20:33:22.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.195+0000 7f153afff700 1 -- 172.21.15.72:0/2215167973 shutdown_connections 2023-07-27T20:33:22.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.195+0000 7f153afff700 1 --2- 172.21.15.72:0/2215167973 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f153414aab0 0x7f1534141ad0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:22.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.195+0000 7f153afff700 1 --2- 172.21.15.72:0/2215167973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15340c4700 0x7f15340c2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:22.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.195+0000 7f153afff700 1 --2- 172.21.15.72:0/2215167973 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f151806ace0 0x7f151806d1a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:22.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.195+0000 7f153afff700 1 --2- 172.21.15.72:0/2215167973 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f15340c7740 0x7f1534156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:22.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.195+0000 7f153afff700 1 -- 172.21.15.72:0/2215167973 >> 172.21.15.72:0/2215167973 conn(0x7f15340ab3f0 msgr2=0x7f1534152560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:22.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.200+0000 7f153afff700 1 -- 172.21.15.72:0/2215167973 shutdown_connections 2023-07-27T20:33:22.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.207+0000 7f153afff700 1 -- 172.21.15.72:0/2215167973 wait complete. 2023-07-27T20:33:22.205 INFO:teuthology.orchestra.run.smithi072.stderr:new fs with metadata pool 8 and data pool 9 2023-07-27T20:33:22.223 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:33:22.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.431+0000 7fb347bff700 1 Processor -- start 2023-07-27T20:33:22.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.431+0000 7fb347bff700 1 -- start start 2023-07-27T20:33:22.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.432+0000 7fb347bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb34006b150 0x7fb3400c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:22.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.432+0000 7fb347bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb3401549f0 0x7fb3401514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:22.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.432+0000 7fb347bff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb34006b710 con 0x7fb3400c4400 2023-07-27T20:33:22.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.432+0000 7fb347bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3401545d0 con 0x7fb3401549f0 2023-07-27T20:33:22.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.432+0000 7fb347bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34006c860 con 0x7fb34006b150 2023-07-27T20:33:22.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.432+0000 7fb34619c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb3401549f0 0x7fb3401514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:22.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.433+0000 7fb34619c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb3401549f0 0x7fb3401514a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39638/0 (socket says 172.21.15.72:39638) 2023-07-27T20:33:22.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.433+0000 7fb34619c700 1 -- 172.21.15.72:0/3981872502 learned_addr learned my addr 172.21.15.72:0/3981872502 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:22.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.433+0000 7fb34519a700 1 --2- 172.21.15.72:0/3981872502 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb34006b150 0x7fb3400c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:22.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.433+0000 7fb34619c700 1 -- 172.21.15.72:0/3981872502 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb34006b150 msgr2=0x7fb3400c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:22.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.433+0000 7fb34619c700 1 --2- 172.21.15.72:0/3981872502 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb34006b150 0x7fb3400c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:22.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.433+0000 7fb34619c700 1 -- 172.21.15.72:0/3981872502 >> v1:172.21.15.173:6789/0 conn(0x7fb3400c4400 legacy=0x7fb3400c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:22.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.433+0000 7fb34619c700 1 -- 172.21.15.72:0/3981872502 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34006b9f0 con 0x7fb3401549f0 2023-07-27T20:33:22.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.433+0000 7fb344999700 1 -- 172.21.15.72:0/3981872502 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2801189245 0 0) 0x7fb34006b710 con 0x7fb3400c4400 2023-07-27T20:33:22.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.433+0000 7fb34619c700 1 --2- 172.21.15.72:0/3981872502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3401549f0 0x7fb3401514a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fb338009e50 tx=0x7fb33800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c91c7c29b5e4f64 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:22.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.434+0000 7fb344999700 1 -- 172.21.15.72:0/3981872502 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33800e070 con 0x7fb3401549f0 2023-07-27T20:33:22.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.434+0000 7fb344999700 1 -- 172.21.15.72:0/3981872502 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33800b910 con 0x7fb3401549f0 2023-07-27T20:33:22.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.434+0000 7fb344999700 1 -- 172.21.15.72:0/3981872502 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33800bcc0 con 0x7fb3401549f0 2023-07-27T20:33:22.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.434+0000 7fb347bff700 1 -- 172.21.15.72:0/3981872502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3401549f0 msgr2=0x7fb3401514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:22.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.434+0000 7fb347bff700 1 --2- 172.21.15.72:0/3981872502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3401549f0 0x7fb3401514a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fb338009e50 tx=0x7fb33800b330 comp rx=0 tx=0).stop 2023-07-27T20:33:22.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.434+0000 7fb347bff700 1 -- 172.21.15.72:0/3981872502 shutdown_connections 2023-07-27T20:33:22.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.434+0000 7fb347bff700 1 --2- 172.21.15.72:0/3981872502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3401549f0 0x7fb3401514a0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:22.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.434+0000 7fb347bff700 1 --2- 172.21.15.72:0/3981872502 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb34006b150 0x7fb3400c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:22.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.434+0000 7fb347bff700 1 -- 172.21.15.72:0/3981872502 >> 172.21.15.72:0/3981872502 conn(0x7fb3400ab300 msgr2=0x7fb3400ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:22.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.434+0000 7fb347bff700 1 -- 172.21.15.72:0/3981872502 shutdown_connections 2023-07-27T20:33:22.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.434+0000 7fb347bff700 1 -- 172.21.15.72:0/3981872502 wait complete. 2023-07-27T20:33:22.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.436+0000 7fb347bff700 1 Processor -- start 2023-07-27T20:33:22.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.436+0000 7fb347bff700 1 -- start start 2023-07-27T20:33:22.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.437+0000 7fb347bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb34006b150 0x7fb34014def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:22.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.437+0000 7fb347bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb3400c4400 0x7fb3401ecb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:22.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.437+0000 7fb347bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3401549f0 0x7fb3401ed040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:22.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.437+0000 7fb347bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3400be7b0 con 0x7fb34006b150 2023-07-27T20:33:22.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.437+0000 7fb347bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3400af070 con 0x7fb3401549f0 2023-07-27T20:33:22.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.437+0000 7fb347bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3400bf470 con 0x7fb3400c4400 2023-07-27T20:33:22.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.437+0000 7fb34599b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb34006b150 0x7fb34014def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:22.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.437+0000 7fb34599b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb34006b150 0x7fb34014def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39648/0 (socket says 172.21.15.72:39648) 2023-07-27T20:33:22.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.437+0000 7fb34599b700 1 -- 172.21.15.72:0/1601999661 learned_addr learned my addr 172.21.15.72:0/1601999661 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:22.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.438+0000 7fb34599b700 1 -- 172.21.15.72:0/1601999661 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb3400c4400 msgr2=0x7fb3401ecb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:22.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.438+0000 7fb34599b700 1 --2- 172.21.15.72:0/1601999661 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb3400c4400 0x7fb3401ecb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:22.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.438+0000 7fb34599b700 1 -- 172.21.15.72:0/1601999661 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3401549f0 msgr2=0x7fb3401ed040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:22.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.438+0000 7fb34599b700 1 --2- 172.21.15.72:0/1601999661 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3401549f0 0x7fb3401ed040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:22.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.438+0000 7fb34599b700 1 -- 172.21.15.72:0/1601999661 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb338009b30 con 0x7fb34006b150 2023-07-27T20:33:22.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.438+0000 7fb34599b700 1 --2- 172.21.15.72:0/1601999661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb34006b150 0x7fb34014def0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb33c0011e0 tx=0x7fb33c00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:22.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.438+0000 7fb3367fc700 1 -- 172.21.15.72:0/1601999661 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c0054e0 con 0x7fb34006b150 2023-07-27T20:33:22.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.438+0000 7fb3367fc700 1 -- 172.21.15.72:0/1601999661 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33c003680 con 0x7fb34006b150 2023-07-27T20:33:22.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.438+0000 7fb3367fc700 1 -- 172.21.15.72:0/1601999661 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c003a30 con 0x7fb34006b150 2023-07-27T20:33:22.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.438+0000 7fb347bff700 1 -- 172.21.15.72:0/1601999661 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb340149e50 con 0x7fb34006b150 2023-07-27T20:33:22.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.438+0000 7fb347bff700 1 -- 172.21.15.72:0/1601999661 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb34014e430 con 0x7fb34006b150 2023-07-27T20:33:22.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.439+0000 7fb347bff700 1 -- 172.21.15.72:0/1601999661 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3400af4c0 con 0x7fb34006b150 2023-07-27T20:33:22.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.440+0000 7fb3367fc700 1 -- 172.21.15.72:0/1601999661 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb33c003b90 con 0x7fb34006b150 2023-07-27T20:33:22.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.441+0000 7fb3367fc700 1 --2- 172.21.15.72:0/1601999661 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb32406ace0 0x7fb32406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:22.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.442+0000 7fb3367fc700 1 -- 172.21.15.72:0/1601999661 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 7296+0+0 (secure 0 0 0) 0x7fb33c088e80 con 0x7fb34006b150 2023-07-27T20:33:22.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.442+0000 7fb34519a700 1 --2- 172.21.15.72:0/1601999661 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb32406ace0 0x7fb32406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:22.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.443+0000 7fb34519a700 1 --2- 172.21.15.72:0/1601999661 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb32406ace0 0x7fb32406d1a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb330006b20 tx=0x7fb330006ab0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:22.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.446+0000 7fb3367fc700 1 -- 172.21.15.72:0/1601999661 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb3400af4c0 con 0x7fb34006b150 2023-07-27T20:33:22.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.645+0000 7fb347bff700 1 -- 172.21.15.72:0/1601999661 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3400af4c0 con 0x7fb34006b150 2023-07-27T20:33:22.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.646+0000 7fb3367fc700 1 -- 172.21.15.72:0/1601999661 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+22321 (secure 0 0 0) 0x7fb3400af4c0 con 0x7fb34006b150 2023-07-27T20:33:22.634 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:33:22.634 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":46,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:33:21.678379+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:32:58.242890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-27T20:32:59.032110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_metadata","create_time":"2023-07-27T20:33:20.125785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs2_data","create_time":"2023-07-27T20:33:20.647929+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2c","mappings":[{"from":0,"to":4}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:33:22.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.649+0000 7fb347bff700 1 -- 172.21.15.72:0/1601999661 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb32406ace0 msgr2=0x7fb32406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:22.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.649+0000 7fb347bff700 1 --2- 172.21.15.72:0/1601999661 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb32406ace0 0x7fb32406d1a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb330006b20 tx=0x7fb330006ab0 comp rx=0 tx=0).stop 2023-07-27T20:33:22.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.649+0000 7fb347bff700 1 -- 172.21.15.72:0/1601999661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb34006b150 msgr2=0x7fb34014def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:22.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.649+0000 7fb347bff700 1 --2- 172.21.15.72:0/1601999661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb34006b150 0x7fb34014def0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb33c0011e0 tx=0x7fb33c00cae0 comp rx=0 tx=0).stop 2023-07-27T20:33:22.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.649+0000 7fb347bff700 1 -- 172.21.15.72:0/1601999661 shutdown_connections 2023-07-27T20:33:22.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.649+0000 7fb347bff700 1 --2- 172.21.15.72:0/1601999661 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3401549f0 0x7fb3401ed040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:22.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.649+0000 7fb347bff700 1 --2- 172.21.15.72:0/1601999661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb34006b150 0x7fb34014def0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:22.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.649+0000 7fb347bff700 1 --2- 172.21.15.72:0/1601999661 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb32406ace0 0x7fb32406d1a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:22.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.649+0000 7fb347bff700 1 --2- 172.21.15.72:0/1601999661 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb3400c4400 0x7fb3401ecb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:22.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.649+0000 7fb347bff700 1 -- 172.21.15.72:0/1601999661 >> 172.21.15.72:0/1601999661 conn(0x7fb3400ab300 msgr2=0x7fb340151270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:22.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.649+0000 7fb347bff700 1 -- 172.21.15.72:0/1601999661 shutdown_connections 2023-07-27T20:33:22.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.649+0000 7fb347bff700 1 -- 172.21.15.72:0/1601999661 wait complete. 2023-07-27T20:33:22.655 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:33:22.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.864+0000 7f25d13ff700 1 Processor -- start 2023-07-27T20:33:22.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.864+0000 7f25d13ff700 1 -- start start 2023-07-27T20:33:22.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.865+0000 7f25d13ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f25cc0c1fb0 0x7f25cc0c39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:22.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.865+0000 7f25d13ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f25cc0a9570 0x7f25cc157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:22.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.865+0000 7f25d13ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25cc0a99e0 con 0x7f25cc0a9190 2023-07-27T20:33:22.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.865+0000 7f25d13ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25cc0c2ea0 con 0x7f25cc0c1fb0 2023-07-27T20:33:22.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.865+0000 7f25d13ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25cc154ba0 con 0x7f25cc0a9570 2023-07-27T20:33:22.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.865+0000 7f25ca7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f25cc0c1fb0 0x7f25cc0c39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:22.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.865+0000 7f25ca7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f25cc0c1fb0 0x7f25cc0c39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39652/0 (socket says 172.21.15.72:39652) 2023-07-27T20:33:22.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.865+0000 7f25ca7fc700 1 -- 172.21.15.72:0/2992927676 learned_addr learned my addr 172.21.15.72:0/2992927676 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:22.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.865+0000 7f25cb7fe700 1 --2- 172.21.15.72:0/2992927676 >> v2:172.21.15.173:3300/0 conn(0x7f25cc0a9570 0x7f25cc157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:22.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.866+0000 7f25ca7fc700 1 -- 172.21.15.72:0/2992927676 >> v2:172.21.15.173:3300/0 conn(0x7f25cc0a9570 msgr2=0x7f25cc157dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:22.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.866+0000 7f25ca7fc700 1 --2- 172.21.15.72:0/2992927676 >> v2:172.21.15.173:3300/0 conn(0x7f25cc0a9570 0x7f25cc157dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:22.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.866+0000 7f25ca7fc700 1 -- 172.21.15.72:0/2992927676 >> v1:172.21.15.173:6789/0 conn(0x7f25cc0a9190 legacy=0x7f25cc1576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:22.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.866+0000 7f25ca7fc700 1 -- 172.21.15.72:0/2992927676 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25cc154e80 con 0x7f25cc0c1fb0 2023-07-27T20:33:22.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.866+0000 7f25ca7fc700 1 --2- 172.21.15.72:0/2992927676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25cc0c1fb0 0x7f25cc0c39d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f25cc0c8680 tx=0x7f25c0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d0b9d8ff6fdf3b9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:22.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.866+0000 7f25c9ffb700 1 -- 172.21.15.72:0/2992927676 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c000b870 con 0x7f25cc0c1fb0 2023-07-27T20:33:22.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.866+0000 7f25c9ffb700 1 -- 172.21.15.72:0/2992927676 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c000b9d0 con 0x7f25cc0c1fb0 2023-07-27T20:33:22.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.866+0000 7f25c9ffb700 1 -- 172.21.15.72:0/2992927676 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c000bd60 con 0x7f25cc0c1fb0 2023-07-27T20:33:22.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.867+0000 7f25d13ff700 1 -- 172.21.15.72:0/2992927676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25cc0c1fb0 msgr2=0x7f25cc0c39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:22.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.867+0000 7f25d13ff700 1 --2- 172.21.15.72:0/2992927676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25cc0c1fb0 0x7f25cc0c39d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f25cc0c8680 tx=0x7f25c0009bd0 comp rx=0 tx=0).stop 2023-07-27T20:33:22.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.867+0000 7f25d13ff700 1 -- 172.21.15.72:0/2992927676 shutdown_connections 2023-07-27T20:33:22.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.867+0000 7f25d13ff700 1 --2- 172.21.15.72:0/2992927676 >> v2:172.21.15.173:3300/0 conn(0x7f25cc0a9570 0x7f25cc157dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:22.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.867+0000 7f25d13ff700 1 --2- 172.21.15.72:0/2992927676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25cc0c1fb0 0x7f25cc0c39d0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:22.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.867+0000 7f25d13ff700 1 -- 172.21.15.72:0/2992927676 >> 172.21.15.72:0/2992927676 conn(0x7f25cc06a7c0 msgr2=0x7f25cc0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:22.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.867+0000 7f25d13ff700 1 -- 172.21.15.72:0/2992927676 shutdown_connections 2023-07-27T20:33:22.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.867+0000 7f25d13ff700 1 -- 172.21.15.72:0/2992927676 wait complete. 2023-07-27T20:33:22.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.869+0000 7f25d13ff700 1 Processor -- start 2023-07-27T20:33:22.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.869+0000 7f25d13ff700 1 -- start start 2023-07-27T20:33:22.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.870+0000 7f25d13ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25cc0a9190 0x7f25cc0be8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:22.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.870+0000 7f25d13ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f25cc0a9570 0x7f25cc0bee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:22.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.870+0000 7f25d13ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25cc1521f0 0x7f25cc1526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:22.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.870+0000 7f25d13ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc0c0800 con 0x7f25cc0a9190 2023-07-27T20:33:22.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.870+0000 7f25d13ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc0c0ae0 con 0x7f25cc1521f0 2023-07-27T20:33:22.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.870+0000 7f25d13ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc0c0dc0 con 0x7f25cc0a9570 2023-07-27T20:33:22.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.870+0000 7f25caffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25cc0a9190 0x7f25cc0be8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:22.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.870+0000 7f25caffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25cc0a9190 0x7f25cc0be8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39664/0 (socket says 172.21.15.72:39664) 2023-07-27T20:33:22.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.870+0000 7f25caffd700 1 -- 172.21.15.72:0/2402265776 learned_addr learned my addr 172.21.15.72:0/2402265776 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:22.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.870+0000 7f25ca7fc700 1 --2- 172.21.15.72:0/2402265776 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f25cc0a9570 0x7f25cc0bee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:22.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.870+0000 7f25cb7fe700 1 --2- 172.21.15.72:0/2402265776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25cc1521f0 0x7f25cc1526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:22.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.870+0000 7f25caffd700 1 -- 172.21.15.72:0/2402265776 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f25cc0a9570 msgr2=0x7f25cc0bee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:22.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.870+0000 7f25caffd700 1 --2- 172.21.15.72:0/2402265776 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f25cc0a9570 0x7f25cc0bee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:22.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.870+0000 7f25caffd700 1 -- 172.21.15.72:0/2402265776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25cc1521f0 msgr2=0x7f25cc1526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:22.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.870+0000 7f25caffd700 1 --2- 172.21.15.72:0/2402265776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25cc1521f0 0x7f25cc1526a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:22.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.870+0000 7f25caffd700 1 -- 172.21.15.72:0/2402265776 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c0009550 con 0x7f25cc0a9190 2023-07-27T20:33:22.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.870+0000 7f25cb7fe700 1 --2- 172.21.15.72:0/2402265776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25cc1521f0 0x7f25cc1526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:33:22.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.870+0000 7f25caffd700 1 --2- 172.21.15.72:0/2402265776 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25cc0a9190 0x7f25cc0be8e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f25bc00c4e0 tx=0x7f25bc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:22.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.871+0000 7f25b37fe700 1 -- 172.21.15.72:0/2402265776 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc0052d0 con 0x7f25cc0a9190 2023-07-27T20:33:22.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.871+0000 7f25b37fe700 1 -- 172.21.15.72:0/2402265776 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25bc005430 con 0x7f25cc0a9190 2023-07-27T20:33:22.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.871+0000 7f25d13ff700 1 -- 172.21.15.72:0/2402265776 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25cc0c10a0 con 0x7f25cc0a9190 2023-07-27T20:33:22.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.871+0000 7f25b37fe700 1 -- 172.21.15.72:0/2402265776 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc0038c0 con 0x7f25cc0a9190 2023-07-27T20:33:22.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.871+0000 7f25d13ff700 1 -- 172.21.15.72:0/2402265776 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25cc154290 con 0x7f25cc0a9190 2023-07-27T20:33:22.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.872+0000 7f25d13ff700 1 -- 172.21.15.72:0/2402265776 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25cc151ff0 con 0x7f25cc0a9190 2023-07-27T20:33:22.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.873+0000 7f25b37fe700 1 -- 172.21.15.72:0/2402265776 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f25bc003a20 con 0x7f25cc0a9190 2023-07-27T20:33:22.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.873+0000 7f25b37fe700 1 --2- 172.21.15.72:0/2402265776 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f25b806ace0 0x7f25b806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:22.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.874+0000 7f25b37fe700 1 -- 172.21.15.72:0/2402265776 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f25bc088e60 con 0x7f25cc0a9190 2023-07-27T20:33:22.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.874+0000 7f25ca7fc700 1 --2- 172.21.15.72:0/2402265776 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f25b806ace0 0x7f25b806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:22.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.875+0000 7f25ca7fc700 1 --2- 172.21.15.72:0/2402265776 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f25b806ace0 0x7f25b806d1a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f25c0014040 tx=0x7f25c0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:22.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:22.878+0000 7f25b37fe700 1 -- 172.21.15.72:0/2402265776 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f25bc053a50 con 0x7f25cc0a9190 2023-07-27T20:33:23.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.072+0000 7f25d13ff700 1 -- 172.21.15.72:0/2402265776 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25cc074310 con 0x7f25cc0a9190 2023-07-27T20:33:23.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.074+0000 7f25b37fe700 1 -- 172.21.15.72:0/2402265776 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+22321 (secure 0 0 0) 0x7f25bc057070 con 0x7f25cc0a9190 2023-07-27T20:33:23.061 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:33:23.062 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":46,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:33:21.678379+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:32:58.242890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-27T20:32:59.032110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_metadata","create_time":"2023-07-27T20:33:20.125785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs2_data","create_time":"2023-07-27T20:33:20.647929+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2c","mappings":[{"from":0,"to":4}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:33:23.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.076+0000 7f25d13ff700 1 -- 172.21.15.72:0/2402265776 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f25b806ace0 msgr2=0x7f25b806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:23.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.076+0000 7f25d13ff700 1 --2- 172.21.15.72:0/2402265776 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f25b806ace0 0x7f25b806d1a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f25c0014040 tx=0x7f25c0008030 comp rx=0 tx=0).stop 2023-07-27T20:33:23.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.076+0000 7f25d13ff700 1 -- 172.21.15.72:0/2402265776 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25cc0a9190 msgr2=0x7f25cc0be8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:23.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.076+0000 7f25d13ff700 1 --2- 172.21.15.72:0/2402265776 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25cc0a9190 0x7f25cc0be8e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f25bc00c4e0 tx=0x7f25bc00c8a0 comp rx=0 tx=0).stop 2023-07-27T20:33:23.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.076+0000 7f25d13ff700 1 -- 172.21.15.72:0/2402265776 shutdown_connections 2023-07-27T20:33:23.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.076+0000 7f25d13ff700 1 --2- 172.21.15.72:0/2402265776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25cc1521f0 0x7f25cc1526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:23.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.076+0000 7f25d13ff700 1 --2- 172.21.15.72:0/2402265776 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25cc0a9190 0x7f25cc0be8e0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:23.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.076+0000 7f25d13ff700 1 --2- 172.21.15.72:0/2402265776 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f25b806ace0 0x7f25b806d1a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:23.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.076+0000 7f25d13ff700 1 --2- 172.21.15.72:0/2402265776 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f25cc0a9570 0x7f25cc0bee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:23.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.076+0000 7f25d13ff700 1 -- 172.21.15.72:0/2402265776 >> 172.21.15.72:0/2402265776 conn(0x7f25cc06a7c0 msgr2=0x7f25cc14f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:23.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.076+0000 7f25d13ff700 1 -- 172.21.15.72:0/2402265776 shutdown_connections 2023-07-27T20:33:23.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.077+0000 7f25d13ff700 1 -- 172.21.15.72:0/2402265776 wait complete. 2023-07-27T20:33:23.082 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-07-27T20:33:23.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.296+0000 7f97ccfff700 1 Processor -- start 2023-07-27T20:33:23.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.296+0000 7f97ccfff700 1 -- start start 2023-07-27T20:33:23.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.297+0000 7f97ccfff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f97c814db30 0x7f97c80bb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:23.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.297+0000 7f97ccfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f97c80bb7e0 0x7f97c8153a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:23.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.297+0000 7f97ccfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97c80c0f80 0x7f97c8153f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:23.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.297+0000 7f97ccfff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97c80bbd40 con 0x7f97c80bb7e0 2023-07-27T20:33:23.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.297+0000 7f97ccfff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97c80baa00 con 0x7f97c814db30 2023-07-27T20:33:23.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.297+0000 7f97ccfff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c80baf20 con 0x7f97c80c0f80 2023-07-27T20:33:23.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.297+0000 7f97bffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f97c80bb7e0 0x7f97c8153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:23.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.297+0000 7f97bffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f97c80bb7e0 0x7f97c8153a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39678/0 (socket says 172.21.15.72:39678) 2023-07-27T20:33:23.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.297+0000 7f97bffff700 1 -- 172.21.15.72:0/820714915 learned_addr learned my addr 172.21.15.72:0/820714915 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:23.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.297+0000 7f97c659c700 1 --2- 172.21.15.72:0/820714915 >> v2:172.21.15.173:3300/0 conn(0x7f97c814db30 0x7f97c80bb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:23.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.297+0000 7f97c6d9d700 1 --2- 172.21.15.72:0/820714915 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97c80c0f80 0x7f97c8153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:23.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.298+0000 7f97bffff700 1 -- 172.21.15.72:0/820714915 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97c80c0f80 msgr2=0x7f97c8153f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:23.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.298+0000 7f97bffff700 1 --2- 172.21.15.72:0/820714915 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97c80c0f80 0x7f97c8153f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:23.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.298+0000 7f97bffff700 1 -- 172.21.15.72:0/820714915 >> v2:172.21.15.173:3300/0 conn(0x7f97c814db30 msgr2=0x7f97c80bb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:23.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.298+0000 7f97bffff700 1 --2- 172.21.15.72:0/820714915 >> v2:172.21.15.173:3300/0 conn(0x7f97c814db30 0x7f97c80bb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:23.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.298+0000 7f97bffff700 1 -- 172.21.15.72:0/820714915 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c81544c0 con 0x7f97c80bb7e0 2023-07-27T20:33:23.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.298+0000 7f97c659c700 1 --2- 172.21.15.72:0/820714915 >> v2:172.21.15.173:3300/0 conn(0x7f97c814db30 0x7f97c80bb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:33:23.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.298+0000 7f97bffff700 1 --2- 172.21.15.72:0/820714915 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97c80bb7e0 0x7f97c8153a40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f97c80c0f50 tx=0x7f97b0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e8db2c8d773f0b0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:23.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.298+0000 7f97c5d9b700 1 -- 172.21.15.72:0/820714915 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b000b870 con 0x7f97c80bb7e0 2023-07-27T20:33:23.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.298+0000 7f97c5d9b700 1 -- 172.21.15.72:0/820714915 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b000b9d0 con 0x7f97c80bb7e0 2023-07-27T20:33:23.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.298+0000 7f97c5d9b700 1 -- 172.21.15.72:0/820714915 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b000bd60 con 0x7f97c80bb7e0 2023-07-27T20:33:23.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.299+0000 7f97ccfff700 1 -- 172.21.15.72:0/820714915 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97c80bb7e0 msgr2=0x7f97c8153a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:23.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.299+0000 7f97ccfff700 1 --2- 172.21.15.72:0/820714915 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97c80bb7e0 0x7f97c8153a40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f97c80c0f50 tx=0x7f97b0009bd0 comp rx=0 tx=0).stop 2023-07-27T20:33:23.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.299+0000 7f97ccfff700 1 -- 172.21.15.72:0/820714915 shutdown_connections 2023-07-27T20:33:23.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.299+0000 7f97ccfff700 1 --2- 172.21.15.72:0/820714915 >> v2:172.21.15.173:3300/0 conn(0x7f97c814db30 0x7f97c80bb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:23.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.299+0000 7f97ccfff700 1 --2- 172.21.15.72:0/820714915 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97c80c0f80 0x7f97c8153f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:23.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.299+0000 7f97ccfff700 1 --2- 172.21.15.72:0/820714915 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97c80bb7e0 0x7f97c8153a40 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:23.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.299+0000 7f97ccfff700 1 -- 172.21.15.72:0/820714915 >> 172.21.15.72:0/820714915 conn(0x7f97c806a190 msgr2=0x7f97c806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:23.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.299+0000 7f97ccfff700 1 -- 172.21.15.72:0/820714915 shutdown_connections 2023-07-27T20:33:23.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.299+0000 7f97ccfff700 1 -- 172.21.15.72:0/820714915 wait complete. 2023-07-27T20:33:23.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.301+0000 7f97ccfff700 1 Processor -- start 2023-07-27T20:33:23.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.301+0000 7f97ccfff700 1 -- start start 2023-07-27T20:33:23.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.301+0000 7f97ccfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97c80bb7e0 0x7f97c81439b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:23.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.301+0000 7f97ccfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97c80c0f80 0x7f97c80aa610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:23.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.301+0000 7f97ccfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97c814db30 0x7f97c814c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:23.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.302+0000 7f97ccfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c81e9fb0 con 0x7f97c814db30 2023-07-27T20:33:23.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.302+0000 7f97ccfff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c81e90e0 con 0x7f97c80bb7e0 2023-07-27T20:33:23.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.302+0000 7f97ccfff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c81e93a0 con 0x7f97c80c0f80 2023-07-27T20:33:23.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.302+0000 7f97c6d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97c814db30 0x7f97c814c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:23.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.302+0000 7f97c6d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97c814db30 0x7f97c814c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39684/0 (socket says 172.21.15.72:39684) 2023-07-27T20:33:23.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.302+0000 7f97c6d9d700 1 -- 172.21.15.72:0/4200424591 learned_addr learned my addr 172.21.15.72:0/4200424591 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:23.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.302+0000 7f97c659c700 1 --2- 172.21.15.72:0/4200424591 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97c80bb7e0 0x7f97c81439b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:23.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.302+0000 7f97bffff700 1 --2- 172.21.15.72:0/4200424591 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97c80c0f80 0x7f97c80aa610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:23.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.302+0000 7f97c6d9d700 1 -- 172.21.15.72:0/4200424591 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97c80c0f80 msgr2=0x7f97c80aa610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:23.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.302+0000 7f97c6d9d700 1 --2- 172.21.15.72:0/4200424591 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97c80c0f80 0x7f97c80aa610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:23.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.302+0000 7f97c6d9d700 1 -- 172.21.15.72:0/4200424591 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97c80bb7e0 msgr2=0x7f97c81439b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:23.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.302+0000 7f97c6d9d700 1 --2- 172.21.15.72:0/4200424591 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97c80bb7e0 0x7f97c81439b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:23.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.302+0000 7f97c6d9d700 1 -- 172.21.15.72:0/4200424591 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b0009550 con 0x7f97c814db30 2023-07-27T20:33:23.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.302+0000 7f97c6d9d700 1 --2- 172.21.15.72:0/4200424591 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97c814db30 0x7f97c814c360 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f97c0009b30 tx=0x7f97c0009ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:23.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.302+0000 7f97beffd700 1 -- 172.21.15.72:0/4200424591 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c0010070 con 0x7f97c814db30 2023-07-27T20:33:23.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.303+0000 7f97beffd700 1 -- 172.21.15.72:0/4200424591 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c0003a20 con 0x7f97c814db30 2023-07-27T20:33:23.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.303+0000 7f97beffd700 1 -- 172.21.15.72:0/4200424591 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c0003db0 con 0x7f97c814db30 2023-07-27T20:33:23.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.303+0000 7f97ccfff700 1 -- 172.21.15.72:0/4200424591 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97c81e9680 con 0x7f97c814db30 2023-07-27T20:33:23.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.303+0000 7f97ccfff700 1 -- 172.21.15.72:0/4200424591 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97c81e9c40 con 0x7f97c814db30 2023-07-27T20:33:23.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.304+0000 7f97ccfff700 1 -- 172.21.15.72:0/4200424591 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97c81e9dd0 con 0x7f97c814db30 2023-07-27T20:33:23.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.305+0000 7f97beffd700 1 -- 172.21.15.72:0/4200424591 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f97c0014070 con 0x7f97c814db30 2023-07-27T20:33:23.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.306+0000 7f97beffd700 1 --2- 172.21.15.72:0/4200424591 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f97a806ace0 0x7f97a806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:23.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.306+0000 7f97beffd700 1 -- 172.21.15.72:0/4200424591 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f97c0088ff0 con 0x7f97c814db30 2023-07-27T20:33:23.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.306+0000 7f97c659c700 1 --2- 172.21.15.72:0/4200424591 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f97a806ace0 0x7f97a806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:23.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.307+0000 7f97c659c700 1 --2- 172.21.15.72:0/4200424591 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f97a806ace0 0x7f97a806d1a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f97b8009990 tx=0x7f97b8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:23.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.310+0000 7f97beffd700 1 -- 172.21.15.72:0/4200424591 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f97c00bb310 con 0x7f97c814db30 2023-07-27T20:33:23.464 INFO:tasks.ceph.mds.a.smithi072.stderr:2023-07-27T20:33:23.477+0000 7f34821f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-27T20:33:23.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:23.547+0000 7f97ccfff700 1 -- 172.21.15.72:0/4200424591 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f97c804e470 con 0x7f97c814db30 2023-07-27T20:33:24.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.206+0000 7f97beffd700 1 -- 172.21.15.72:0/4200424591 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v21) v1 ==== 119+0+0 (secure 0 0 0) 0x7f97c0053c20 con 0x7f97c814db30 2023-07-27T20:33:24.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.209+0000 7f97ccfff700 1 -- 172.21.15.72:0/4200424591 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f97a806ace0 msgr2=0x7f97a806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:24.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.209+0000 7f97ccfff700 1 --2- 172.21.15.72:0/4200424591 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f97a806ace0 0x7f97a806d1a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f97b8009990 tx=0x7f97b8008040 comp rx=0 tx=0).stop 2023-07-27T20:33:24.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.209+0000 7f97ccfff700 1 -- 172.21.15.72:0/4200424591 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97c814db30 msgr2=0x7f97c814c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:24.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.209+0000 7f97ccfff700 1 --2- 172.21.15.72:0/4200424591 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97c814db30 0x7f97c814c360 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f97c0009b30 tx=0x7f97c0009ef0 comp rx=0 tx=0).stop 2023-07-27T20:33:24.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.209+0000 7f97ccfff700 1 -- 172.21.15.72:0/4200424591 shutdown_connections 2023-07-27T20:33:24.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.209+0000 7f97ccfff700 1 --2- 172.21.15.72:0/4200424591 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97c814db30 0x7f97c814c360 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:24.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.209+0000 7f97ccfff700 1 --2- 172.21.15.72:0/4200424591 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97c80bb7e0 0x7f97c81439b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:24.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.209+0000 7f97ccfff700 1 --2- 172.21.15.72:0/4200424591 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f97a806ace0 0x7f97a806d1a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:24.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.209+0000 7f97ccfff700 1 --2- 172.21.15.72:0/4200424591 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97c80c0f80 0x7f97c80aa610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:24.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.209+0000 7f97ccfff700 1 -- 172.21.15.72:0/4200424591 >> 172.21.15.72:0/4200424591 conn(0x7f97c806a190 msgr2=0x7f97c806d900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:24.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.209+0000 7f97ccfff700 1 -- 172.21.15.72:0/4200424591 shutdown_connections 2023-07-27T20:33:24.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.209+0000 7f97ccfff700 1 -- 172.21.15.72:0/4200424591 wait complete. 2023-07-27T20:33:24.216 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-27T20:33:24.217 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-07-27T20:33:24.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.431+0000 7f21bc5ff700 1 Processor -- start 2023-07-27T20:33:24.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.431+0000 7f21bc5ff700 1 -- start start 2023-07-27T20:33:24.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.433+0000 7f21bc5ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f21b4154150 0x7f21b415bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:24.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.433+0000 7f21bc5ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b40baf20 con 0x7f21b40c0f80 2023-07-27T20:33:24.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.433+0000 7f21bc5ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b414df10 con 0x7f21b414db30 2023-07-27T20:33:24.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.433+0000 7f21bc5ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b40bbd40 con 0x7f21b4154150 2023-07-27T20:33:24.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.433+0000 7f21b9b9a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f21b40c0f80 0x7f21b4153a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43448/0 (socket says 172.21.15.72:43448) 2023-07-27T20:33:24.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.433+0000 7f21b9b9a700 1 -- 172.21.15.72:0/1866121064 learned_addr learned my addr 172.21.15.72:0/1866121064 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:24.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.433+0000 7f21bab9c700 1 --2- 172.21.15.72:0/1866121064 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f21b4154150 0x7f21b415bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:24.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.433+0000 7f21b9399700 1 -- 172.21.15.72:0/1866121064 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1780022428 0 0) 0x7f21b40baf20 con 0x7f21b40c0f80 2023-07-27T20:33:24.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.434+0000 7f21b9399700 1 -- 172.21.15.72:0/1866121064 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21a00035b0 con 0x7f21b40c0f80 2023-07-27T20:33:24.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.434+0000 7f21b9399700 1 -- 172.21.15.72:0/1866121064 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1703960757 0 0) 0x7f21b414df10 con 0x7f21b414db30 2023-07-27T20:33:24.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.434+0000 7f21b9399700 1 -- 172.21.15.72:0/1866121064 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21b40baf20 con 0x7f21b414db30 2023-07-27T20:33:24.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.434+0000 7f21b9399700 1 -- 172.21.15.72:0/1866121064 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2489139913 0 0) 0x7f21a00035b0 con 0x7f21b40c0f80 2023-07-27T20:33:24.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.434+0000 7f21b9399700 1 -- 172.21.15.72:0/1866121064 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f21b4154150 msgr2=0x7f21b415bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:24.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.434+0000 7f21b9399700 1 --2- 172.21.15.72:0/1866121064 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f21b4154150 0x7f21b415bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:24.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.434+0000 7f21b9399700 1 -- 172.21.15.72:0/1866121064 >> v1:172.21.15.173:6789/0 conn(0x7f21b414db30 legacy=0x7f21b40bb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:24.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.434+0000 7f21b9399700 1 -- 172.21.15.72:0/1866121064 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b40ba440 con 0x7f21b40c0f80 2023-07-27T20:33:24.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.434+0000 7f21b9399700 1 -- 172.21.15.72:0/1866121064 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f21a4001670 con 0x7f21b40c0f80 2023-07-27T20:33:24.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.434+0000 7f21b9399700 1 -- 172.21.15.72:0/1866121064 >> v1:172.21.15.72:6789/0 conn(0x7f21b40c0f80 legacy=0x7f21b4153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:24.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.434+0000 7f21b9399700 1 --2- 172.21.15.72:0/1866121064 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21a0003bc0 0x7f21a0003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:24.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.434+0000 7f21b9399700 1 --2- 172.21.15.72:0/1866121064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21a0004850 0x7f21a0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:24.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.434+0000 7f21b9399700 1 --2- 172.21.15.72:0/1866121064 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f21b4154150 0x7f21a0005310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:24.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.434+0000 7f21b9399700 1 -- 172.21.15.72:0/1866121064 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a000ddf0 con 0x7f21a0003bc0 2023-07-27T20:33:24.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.434+0000 7f21b9399700 1 -- 172.21.15.72:0/1866121064 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a000df60 con 0x7f21a0004850 2023-07-27T20:33:24.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.434+0000 7f21b9399700 1 -- 172.21.15.72:0/1866121064 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a000e120 con 0x7f21b4154150 2023-07-27T20:33:24.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.434+0000 7f21ba39b700 1 --2- 172.21.15.72:0/1866121064 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21a0003bc0 0x7f21a0003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:24.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.434+0000 7f21b9b9a700 1 --2- 172.21.15.72:0/1866121064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21a0004850 0x7f21a0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:24.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.434+0000 7f21bab9c700 1 --2- 172.21.15.72:0/1866121064 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f21b4154150 0x7f21a0005310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:24.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.435+0000 7f21ba39b700 1 -- 172.21.15.72:0/1866121064 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f21b4154150 msgr2=0x7f21a0005310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:24.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.435+0000 7f21ba39b700 1 --2- 172.21.15.72:0/1866121064 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f21b4154150 0x7f21a0005310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:24.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.435+0000 7f21ba39b700 1 -- 172.21.15.72:0/1866121064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21a0004850 msgr2=0x7f21a0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:24.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.435+0000 7f21ba39b700 1 --2- 172.21.15.72:0/1866121064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21a0004850 0x7f21a0004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:24.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.435+0000 7f21ba39b700 1 -- 172.21.15.72:0/1866121064 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a00035b0 con 0x7f21a0003bc0 2023-07-27T20:33:24.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.435+0000 7f21ba39b700 1 --2- 172.21.15.72:0/1866121064 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21a0003bc0 0x7f21a0003fc0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f21b0001980 tx=0x7f21a0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d552df4392377f51 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:24.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.435+0000 7f21b9399700 1 -- 172.21.15.72:0/1866121064 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b0001470 con 0x7f21a0003bc0 2023-07-27T20:33:24.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.435+0000 7f21b9399700 1 -- 172.21.15.72:0/1866121064 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b00052d0 con 0x7f21a0003bc0 2023-07-27T20:33:24.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.435+0000 7f21b9399700 1 -- 172.21.15.72:0/1866121064 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b0003680 con 0x7f21a0003bc0 2023-07-27T20:33:24.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.436+0000 7f21bc5ff700 1 -- 172.21.15.72:0/1866121064 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21a0003bc0 msgr2=0x7f21a0003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:24.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.436+0000 7f21bc5ff700 1 --2- 172.21.15.72:0/1866121064 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21a0003bc0 0x7f21a0003fc0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f21b0001980 tx=0x7f21a0005880 comp rx=0 tx=0).stop 2023-07-27T20:33:24.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.436+0000 7f21bab9c700 1 -- 172.21.15.72:0/1866121064 reap_dead start 2023-07-27T20:33:24.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.436+0000 7f21bc5ff700 1 -- 172.21.15.72:0/1866121064 shutdown_connections 2023-07-27T20:33:24.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.436+0000 7f21bc5ff700 1 -- 172.21.15.72:0/1866121064 >> 172.21.15.72:0/1866121064 conn(0x7f21b406a190 msgr2=0x7f21b406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:24.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.436+0000 7f21bc5ff700 1 -- 172.21.15.72:0/1866121064 shutdown_connections 2023-07-27T20:33:24.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.436+0000 7f21bc5ff700 1 -- 172.21.15.72:0/1866121064 wait complete. 2023-07-27T20:33:24.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.438+0000 7f21bc5ff700 1 Processor -- start 2023-07-27T20:33:24.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.438+0000 7f21bc5ff700 1 -- start start 2023-07-27T20:33:24.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.439+0000 7f21bc5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21a0003bc0 0x7f21b41e8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:24.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.439+0000 7f21bc5ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f21b4146d70 0x7f21b41522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:24.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.439+0000 7f21bc5ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21b41472a0 0x7f21b4152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:24.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.439+0000 7f21bc5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b41da3b0 con 0x7f21a0003bc0 2023-07-27T20:33:24.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.439+0000 7f21bc5ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b41d9d80 con 0x7f21b41472a0 2023-07-27T20:33:24.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.439+0000 7f21bc5ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b41e92a0 con 0x7f21b4146d70 2023-07-27T20:33:24.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.439+0000 7f21ba39b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21a0003bc0 0x7f21b41e8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:24.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.439+0000 7f21ba39b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21a0003bc0 0x7f21b41e8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39696/0 (socket says 172.21.15.72:39696) 2023-07-27T20:33:24.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.439+0000 7f21ba39b700 1 -- 172.21.15.72:0/38576853 learned_addr learned my addr 172.21.15.72:0/38576853 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:24.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.439+0000 7f21b9b9a700 1 --2- 172.21.15.72:0/38576853 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f21b4146d70 0x7f21b41522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:24.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.439+0000 7f21bab9c700 1 --2- 172.21.15.72:0/38576853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21b41472a0 0x7f21b4152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:24.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.439+0000 7f21ba39b700 1 -- 172.21.15.72:0/38576853 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f21b4146d70 msgr2=0x7f21b41522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:24.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.439+0000 7f21ba39b700 1 --2- 172.21.15.72:0/38576853 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f21b4146d70 0x7f21b41522e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:24.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.439+0000 7f21ba39b700 1 -- 172.21.15.72:0/38576853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21b41472a0 msgr2=0x7f21b4152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:24.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.439+0000 7f21ba39b700 1 --2- 172.21.15.72:0/38576853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21b41472a0 0x7f21b4152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:24.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.439+0000 7f21ba39b700 1 -- 172.21.15.72:0/38576853 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b41e9580 con 0x7f21a0003bc0 2023-07-27T20:33:24.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.439+0000 7f21bab9c700 1 --2- 172.21.15.72:0/38576853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21b41472a0 0x7f21b4152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:33:24.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.439+0000 7f21ba39b700 1 --2- 172.21.15.72:0/38576853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21a0003bc0 0x7f21b41e8a60 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f21b000c3c0 tx=0x7f21b0001310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:24.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.440+0000 7f21aaffd700 1 -- 172.21.15.72:0/38576853 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b0001410 con 0x7f21a0003bc0 2023-07-27T20:33:24.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.440+0000 7f21aaffd700 1 -- 172.21.15.72:0/38576853 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b0007250 con 0x7f21a0003bc0 2023-07-27T20:33:24.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.440+0000 7f21aaffd700 1 -- 172.21.15.72:0/38576853 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b0007600 con 0x7f21a0003bc0 2023-07-27T20:33:24.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.440+0000 7f21bc5ff700 1 -- 172.21.15.72:0/38576853 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21b41d9fd0 con 0x7f21a0003bc0 2023-07-27T20:33:24.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.440+0000 7f21bc5ff700 1 -- 172.21.15.72:0/38576853 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21b41534e0 con 0x7f21a0003bc0 2023-07-27T20:33:24.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.441+0000 7f21bc5ff700 1 -- 172.21.15.72:0/38576853 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21b41e9710 con 0x7f21a0003bc0 2023-07-27T20:33:24.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.442+0000 7f21aaffd700 1 -- 172.21.15.72:0/38576853 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f21b0003680 con 0x7f21a0003bc0 2023-07-27T20:33:24.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.443+0000 7f21aaffd700 1 --2- 172.21.15.72:0/38576853 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f219806ace0 0x7f219806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:24.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.443+0000 7f21aaffd700 1 -- 172.21.15.72:0/38576853 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f21b008a7c0 con 0x7f21a0003bc0 2023-07-27T20:33:24.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.444+0000 7f21b9b9a700 1 --2- 172.21.15.72:0/38576853 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f219806ace0 0x7f219806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:24.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.444+0000 7f21b9b9a700 1 --2- 172.21.15.72:0/38576853 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f219806ace0 0x7f219806d1a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f21b414a260 tx=0x7f21a4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:24.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.448+0000 7f21aaffd700 1 -- 172.21.15.72:0/38576853 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f21b0055430 con 0x7f21a0003bc0 2023-07-27T20:33:24.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:24.694+0000 7f21bc5ff700 1 -- 172.21.15.72:0/38576853 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f21b404e470 con 0x7f21a0003bc0 2023-07-27T20:33:25.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.212+0000 7f21aaffd700 1 -- 172.21.15.72:0/38576853 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v22) v1 ==== 123+0+0 (secure 0 0 0) 0x7f21b0058a50 con 0x7f21a0003bc0 2023-07-27T20:33:25.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.215+0000 7f21bc5ff700 1 -- 172.21.15.72:0/38576853 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f219806ace0 msgr2=0x7f219806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:25.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.215+0000 7f21bc5ff700 1 --2- 172.21.15.72:0/38576853 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f219806ace0 0x7f219806d1a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f21b414a260 tx=0x7f21a4009040 comp rx=0 tx=0).stop 2023-07-27T20:33:25.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.215+0000 7f21bc5ff700 1 -- 172.21.15.72:0/38576853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21a0003bc0 msgr2=0x7f21b41e8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:25.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.215+0000 7f21bc5ff700 1 --2- 172.21.15.72:0/38576853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21a0003bc0 0x7f21b41e8a60 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f21b000c3c0 tx=0x7f21b0001310 comp rx=0 tx=0).stop 2023-07-27T20:33:25.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.215+0000 7f21bc5ff700 1 -- 172.21.15.72:0/38576853 shutdown_connections 2023-07-27T20:33:25.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.215+0000 7f21bc5ff700 1 --2- 172.21.15.72:0/38576853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21b41472a0 0x7f21b4152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:25.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.215+0000 7f21bc5ff700 1 --2- 172.21.15.72:0/38576853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21a0003bc0 0x7f21b41e8a60 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:25.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.215+0000 7f21bc5ff700 1 --2- 172.21.15.72:0/38576853 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f219806ace0 0x7f219806d1a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:25.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.215+0000 7f21bc5ff700 1 --2- 172.21.15.72:0/38576853 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f21b4146d70 0x7f21b41522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:25.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.215+0000 7f21bc5ff700 1 -- 172.21.15.72:0/38576853 >> 172.21.15.72:0/38576853 conn(0x7f21b406a190 msgr2=0x7f21b40c0540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:25.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.215+0000 7f21bc5ff700 1 -- 172.21.15.72:0/38576853 shutdown_connections 2023-07-27T20:33:25.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.215+0000 7f21bc5ff700 1 -- 172.21.15.72:0/38576853 wait complete. 2023-07-27T20:33:25.222 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-07-27T20:33:25.222 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T20:33:25.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.430+0000 7f13c53ff700 1 Processor -- start 2023-07-27T20:33:25.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.430+0000 7f13c53ff700 1 -- start start 2023-07-27T20:33:25.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.431+0000 7f13c53ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f13c00c4400 0x7f13c00c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:25.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.431+0000 7f13c53ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f13c01549f0 0x7f13c01514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:25.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.431+0000 7f13c53ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13c006b710 con 0x7f13c006b150 2023-07-27T20:33:25.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.432+0000 7f13c53ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13c01545d0 con 0x7f13c00c4400 2023-07-27T20:33:25.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.432+0000 7f13c53ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c006c860 con 0x7f13c01549f0 2023-07-27T20:33:25.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.432+0000 7f13beffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f13c00c4400 0x7f13c00c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:25.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.432+0000 7f13beffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f13c00c4400 0x7f13c00c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39698/0 (socket says 172.21.15.72:39698) 2023-07-27T20:33:25.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.432+0000 7f13beffd700 1 -- 172.21.15.72:0/1288782505 learned_addr learned my addr 172.21.15.72:0/1288782505 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:25.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.432+0000 7f13beffd700 1 -- 172.21.15.72:0/1288782505 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f13c01549f0 msgr2=0x7f13c01514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:25.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.432+0000 7f13bf7fe700 1 --2- 172.21.15.72:0/1288782505 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f13c01549f0 0x7f13c01514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:25.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.432+0000 7f13beffd700 1 --2- 172.21.15.72:0/1288782505 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f13c01549f0 0x7f13c01514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:25.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.432+0000 7f13beffd700 1 -- 172.21.15.72:0/1288782505 >> v1:172.21.15.173:6789/0 conn(0x7f13c006b150 legacy=0x7f13c00c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:25.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.432+0000 7f13beffd700 1 -- 172.21.15.72:0/1288782505 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c006b9f0 con 0x7f13c00c4400 2023-07-27T20:33:25.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.432+0000 7f13bf7fe700 1 --2- 172.21.15.72:0/1288782505 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f13c01549f0 0x7f13c01514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:33:25.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.432+0000 7f13beffd700 1 --2- 172.21.15.72:0/1288782505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13c00c4400 0x7f13c00c7710 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f13b00098f0 tx=0x7f13b0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=477a8ff8611ad59a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:25.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.433+0000 7f13be7fc700 1 -- 172.21.15.72:0/1288782505 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b000b8a0 con 0x7f13c00c4400 2023-07-27T20:33:25.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.433+0000 7f13be7fc700 1 -- 172.21.15.72:0/1288782505 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b000ba00 con 0x7f13c00c4400 2023-07-27T20:33:25.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.433+0000 7f13be7fc700 1 -- 172.21.15.72:0/1288782505 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b000bd90 con 0x7f13c00c4400 2023-07-27T20:33:25.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.433+0000 7f13c53ff700 1 -- 172.21.15.72:0/1288782505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13c00c4400 msgr2=0x7f13c00c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:25.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.433+0000 7f13c53ff700 1 --2- 172.21.15.72:0/1288782505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13c00c4400 0x7f13c00c7710 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f13b00098f0 tx=0x7f13b0009c00 comp rx=0 tx=0).stop 2023-07-27T20:33:25.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.433+0000 7f13c53ff700 1 -- 172.21.15.72:0/1288782505 shutdown_connections 2023-07-27T20:33:25.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.433+0000 7f13c53ff700 1 --2- 172.21.15.72:0/1288782505 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f13c01549f0 0x7f13c01514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:25.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.433+0000 7f13c53ff700 1 --2- 172.21.15.72:0/1288782505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13c00c4400 0x7f13c00c7710 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:25.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.433+0000 7f13c53ff700 1 -- 172.21.15.72:0/1288782505 >> 172.21.15.72:0/1288782505 conn(0x7f13c00ab300 msgr2=0x7f13c00ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:25.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.433+0000 7f13c53ff700 1 -- 172.21.15.72:0/1288782505 shutdown_connections 2023-07-27T20:33:25.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.433+0000 7f13c53ff700 1 -- 172.21.15.72:0/1288782505 wait complete. 2023-07-27T20:33:25.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.435+0000 7f13c53ff700 1 Processor -- start 2023-07-27T20:33:25.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.435+0000 7f13c53ff700 1 -- start start 2023-07-27T20:33:25.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.436+0000 7f13c53ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13c006b150 0x7f13c00aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:25.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.436+0000 7f13c53ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13c00c4400 0x7f13c01ecde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:25.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.436+0000 7f13c53ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f13c01549f0 0x7f13c01ed320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:25.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.436+0000 7f13c53ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c014cbe0 con 0x7f13c006b150 2023-07-27T20:33:25.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.436+0000 7f13c53ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c014dd10 con 0x7f13c00c4400 2023-07-27T20:33:25.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.436+0000 7f13c53ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c014c290 con 0x7f13c01549f0 2023-07-27T20:33:25.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.436+0000 7f13beffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13c006b150 0x7f13c00aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:25.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.436+0000 7f13beffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13c006b150 0x7f13c00aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39706/0 (socket says 172.21.15.72:39706) 2023-07-27T20:33:25.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.436+0000 7f13beffd700 1 -- 172.21.15.72:0/1423848353 learned_addr learned my addr 172.21.15.72:0/1423848353 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:25.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.437+0000 7f13bf7fe700 1 --2- 172.21.15.72:0/1423848353 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f13c01549f0 0x7f13c01ed320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:25.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.437+0000 7f13b7fff700 1 --2- 172.21.15.72:0/1423848353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13c00c4400 0x7f13c01ecde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:25.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.437+0000 7f13beffd700 1 -- 172.21.15.72:0/1423848353 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f13c01549f0 msgr2=0x7f13c01ed320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:25.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.437+0000 7f13beffd700 1 --2- 172.21.15.72:0/1423848353 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f13c01549f0 0x7f13c01ed320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:25.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.437+0000 7f13beffd700 1 -- 172.21.15.72:0/1423848353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13c00c4400 msgr2=0x7f13c01ecde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:25.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.437+0000 7f13beffd700 1 --2- 172.21.15.72:0/1423848353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13c00c4400 0x7f13c01ecde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:25.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.437+0000 7f13beffd700 1 -- 172.21.15.72:0/1423848353 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b0009550 con 0x7f13c006b150 2023-07-27T20:33:25.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.437+0000 7f13beffd700 1 --2- 172.21.15.72:0/1423848353 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13c006b150 0x7f13c00aed60 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f13b0000c00 tx=0x7f13b0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:25.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.437+0000 7f13b77fe700 1 -- 172.21.15.72:0/1423848353 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b00038a0 con 0x7f13c006b150 2023-07-27T20:33:25.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.437+0000 7f13b77fe700 1 -- 172.21.15.72:0/1423848353 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b0003a00 con 0x7f13c006b150 2023-07-27T20:33:25.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.437+0000 7f13b77fe700 1 -- 172.21.15.72:0/1423848353 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b0003db0 con 0x7f13c006b150 2023-07-27T20:33:25.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.437+0000 7f13c53ff700 1 -- 172.21.15.72:0/1423848353 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13c014bff0 con 0x7f13c006b150 2023-07-27T20:33:25.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.437+0000 7f13c53ff700 1 -- 172.21.15.72:0/1423848353 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13c014c870 con 0x7f13c006b150 2023-07-27T20:33:25.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.438+0000 7f13c53ff700 1 -- 172.21.15.72:0/1423848353 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13c01ecc30 con 0x7f13c006b150 2023-07-27T20:33:25.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.439+0000 7f13b77fe700 1 -- 172.21.15.72:0/1423848353 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f13b0021070 con 0x7f13c006b150 2023-07-27T20:33:25.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.440+0000 7f13b77fe700 1 --2- 172.21.15.72:0/1423848353 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f13a006ace0 0x7f13a006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:25.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.440+0000 7f13b77fe700 1 -- 172.21.15.72:0/1423848353 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f13b008aff0 con 0x7f13c006b150 2023-07-27T20:33:25.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.441+0000 7f13b7fff700 1 --2- 172.21.15.72:0/1423848353 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f13a006ace0 0x7f13a006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:25.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.441+0000 7f13b7fff700 1 --2- 172.21.15.72:0/1423848353 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f13a006ace0 0x7f13a006d1a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f13c0153a90 tx=0x7f13a8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:25.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.444+0000 7f13b77fe700 1 -- 172.21.15.72:0/1423848353 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f13b0055be0 con 0x7f13c006b150 2023-07-27T20:33:25.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.680+0000 7f13c53ff700 1 -- 172.21.15.72:0/1423848353 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f13c0074310 con 0x7f13c006b150 2023-07-27T20:33:25.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.681+0000 7f13b77fe700 1 -- 172.21.15.72:0/1423848353 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+5816 (secure 0 0 0) 0x7f13b0015090 con 0x7f13c006b150 2023-07-27T20:33:25.669 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:33:25.669 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/1685903768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1685903768},{"type":"v1","addr":"172.21.15.173:6836","nonce":1685903768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5269,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/43862591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":43862591},{"type":"v1","addr":"172.21.15.173:6837","nonce":43862591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T20:33:00.054239+0000","modified":"2023-07-27T20:33:03.586058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5409},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5409":{"gid":5409,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.72:6834/1959104268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":1959104268},{"type":"v1","addr":"172.21.15.72:6834","nonce":1959104268}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T20:33:21.678859+0000","modified":"2023-07-27T20:33:25.206336+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5281":{"gid":5281,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.72:6835/1644610738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1644610738},{"type":"v1","addr":"172.21.15.72:6835","nonce":1644610738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-27T20:33:25.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.683+0000 7f13c53ff700 1 -- 172.21.15.72:0/1423848353 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f13a006ace0 msgr2=0x7f13a006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:25.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.683+0000 7f13c53ff700 1 --2- 172.21.15.72:0/1423848353 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f13a006ace0 0x7f13a006d1a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f13c0153a90 tx=0x7f13a8009040 comp rx=0 tx=0).stop 2023-07-27T20:33:25.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.683+0000 7f13c53ff700 1 -- 172.21.15.72:0/1423848353 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13c006b150 msgr2=0x7f13c00aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:25.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.683+0000 7f13c53ff700 1 --2- 172.21.15.72:0/1423848353 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13c006b150 0x7f13c00aed60 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f13b0000c00 tx=0x7f13b0004750 comp rx=0 tx=0).stop 2023-07-27T20:33:25.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.683+0000 7f13c53ff700 1 -- 172.21.15.72:0/1423848353 shutdown_connections 2023-07-27T20:33:25.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.683+0000 7f13c53ff700 1 --2- 172.21.15.72:0/1423848353 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f13a006ace0 0x7f13a006d1a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:25.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.683+0000 7f13c53ff700 1 --2- 172.21.15.72:0/1423848353 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f13c01549f0 0x7f13c01ed320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:25.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.683+0000 7f13c53ff700 1 --2- 172.21.15.72:0/1423848353 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13c006b150 0x7f13c00aed60 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:25.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.683+0000 7f13c53ff700 1 --2- 172.21.15.72:0/1423848353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13c00c4400 0x7f13c01ecde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:25.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.683+0000 7f13c53ff700 1 -- 172.21.15.72:0/1423848353 >> 172.21.15.72:0/1423848353 conn(0x7f13c00ab300 msgr2=0x7f13c0150a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:25.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.683+0000 7f13c53ff700 1 -- 172.21.15.72:0/1423848353 shutdown_connections 2023-07-27T20:33:25.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.683+0000 7f13c53ff700 1 -- 172.21.15.72:0/1423848353 wait complete. 2023-07-27T20:33:25.673 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 22 2023-07-27T20:33:25.688 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:33:25.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.897+0000 7f3a98bff700 1 Processor -- start 2023-07-27T20:33:25.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.897+0000 7f3a98bff700 1 -- start start 2023-07-27T20:33:25.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.898+0000 7f3a98bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3a9406b520 0x7f3a940a8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:25.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.898+0000 7f3a98bff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3a9406b900 0x7f3a94154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:25.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.898+0000 7f3a98bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a9406bd90 con 0x7f3a9406ef00 2023-07-27T20:33:25.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.898+0000 7f3a98bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a940c1850 con 0x7f3a9406b520 2023-07-27T20:33:25.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.898+0000 7f3a98bff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a9406e270 con 0x7f3a9406b900 2023-07-27T20:33:25.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.898+0000 7f3a9259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3a9406b520 0x7f3a940a8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:25.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.898+0000 7f3a8bfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3a9406ef00 0x7f3a94158000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43452/0 (socket says 172.21.15.72:43452) 2023-07-27T20:33:25.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.898+0000 7f3a8bfff700 1 -- 172.21.15.72:0/3434139694 learned_addr learned my addr 172.21.15.72:0/3434139694 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:25.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.899+0000 7f3a92d9d700 1 --2- 172.21.15.72:0/3434139694 >> v2:172.21.15.173:3300/0 conn(0x7f3a9406b900 0x7f3a94154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:25.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.899+0000 7f3a9259c700 1 -- 172.21.15.72:0/3434139694 >> v2:172.21.15.173:3300/0 conn(0x7f3a9406b900 msgr2=0x7f3a94154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:25.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.899+0000 7f3a9259c700 1 --2- 172.21.15.72:0/3434139694 >> v2:172.21.15.173:3300/0 conn(0x7f3a9406b900 0x7f3a94154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:25.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.899+0000 7f3a9259c700 1 -- 172.21.15.72:0/3434139694 >> v1:172.21.15.72:6789/0 conn(0x7f3a9406ef00 legacy=0x7f3a94158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:25.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.899+0000 7f3a9259c700 1 -- 172.21.15.72:0/3434139694 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a9406e7a0 con 0x7f3a9406b520 2023-07-27T20:33:25.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.899+0000 7f3a92d9d700 1 --2- 172.21.15.72:0/3434139694 >> v2:172.21.15.173:3300/0 conn(0x7f3a9406b900 0x7f3a94154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:33:25.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.899+0000 7f3a9259c700 1 --2- 172.21.15.72:0/3434139694 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a9406b520 0x7f3a940a8de0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f3a940c0a80 tx=0x7f3a8400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94702bf8ceef84c8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:25.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.899+0000 7f3a91d9b700 1 -- 172.21.15.72:0/3434139694 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8400e070 con 0x7f3a9406b520 2023-07-27T20:33:25.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.899+0000 7f3a91d9b700 1 -- 172.21.15.72:0/3434139694 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a8400bbd0 con 0x7f3a9406b520 2023-07-27T20:33:25.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.899+0000 7f3a91d9b700 1 -- 172.21.15.72:0/3434139694 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a84012430 con 0x7f3a9406b520 2023-07-27T20:33:25.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.900+0000 7f3a98bff700 1 -- 172.21.15.72:0/3434139694 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a9406b520 msgr2=0x7f3a940a8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:25.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.900+0000 7f3a98bff700 1 --2- 172.21.15.72:0/3434139694 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a9406b520 0x7f3a940a8de0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f3a940c0a80 tx=0x7f3a8400b330 comp rx=0 tx=0).stop 2023-07-27T20:33:25.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.900+0000 7f3a98bff700 1 -- 172.21.15.72:0/3434139694 shutdown_connections 2023-07-27T20:33:25.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.900+0000 7f3a98bff700 1 --2- 172.21.15.72:0/3434139694 >> v2:172.21.15.173:3300/0 conn(0x7f3a9406b900 0x7f3a94154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:25.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.900+0000 7f3a98bff700 1 --2- 172.21.15.72:0/3434139694 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a9406b520 0x7f3a940a8de0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:25.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.900+0000 7f3a98bff700 1 -- 172.21.15.72:0/3434139694 >> 172.21.15.72:0/3434139694 conn(0x7f3a940c6800 msgr2=0x7f3a940c6c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:25.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.900+0000 7f3a98bff700 1 -- 172.21.15.72:0/3434139694 shutdown_connections 2023-07-27T20:33:25.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.900+0000 7f3a98bff700 1 -- 172.21.15.72:0/3434139694 wait complete. 2023-07-27T20:33:25.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.902+0000 7f3a98bff700 1 Processor -- start 2023-07-27T20:33:25.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.902+0000 7f3a98bff700 1 -- start start 2023-07-27T20:33:25.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.903+0000 7f3a98bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a9406b520 0x7f3a941eca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:25.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.903+0000 7f3a98bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a9406b900 0x7f3a9414aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:25.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.903+0000 7f3a98bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3a9406ef00 0x7f3a9414aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:25.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.903+0000 7f3a98bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a940ab470 con 0x7f3a9406b520 2023-07-27T20:33:25.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.903+0000 7f3a98bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9414b530 con 0x7f3a9406b900 2023-07-27T20:33:25.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.903+0000 7f3a98bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a940abc40 con 0x7f3a9406ef00 2023-07-27T20:33:25.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.903+0000 7f3a9259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a9406b520 0x7f3a941eca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:25.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.903+0000 7f3a9259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a9406b520 0x7f3a941eca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39718/0 (socket says 172.21.15.72:39718) 2023-07-27T20:33:25.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.903+0000 7f3a9259c700 1 -- 172.21.15.72:0/3084671657 learned_addr learned my addr 172.21.15.72:0/3084671657 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:25.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.903+0000 7f3a8bfff700 1 --2- 172.21.15.72:0/3084671657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a9406b900 0x7f3a9414aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:25.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.903+0000 7f3a92d9d700 1 --2- 172.21.15.72:0/3084671657 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3a9406ef00 0x7f3a9414aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:25.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.903+0000 7f3a9259c700 1 -- 172.21.15.72:0/3084671657 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3a9406ef00 msgr2=0x7f3a9414aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:25.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.903+0000 7f3a9259c700 1 --2- 172.21.15.72:0/3084671657 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3a9406ef00 0x7f3a9414aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:25.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.903+0000 7f3a9259c700 1 -- 172.21.15.72:0/3084671657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a9406b900 msgr2=0x7f3a9414aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:25.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.903+0000 7f3a9259c700 1 --2- 172.21.15.72:0/3084671657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a9406b900 0x7f3a9414aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:25.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.903+0000 7f3a9259c700 1 -- 172.21.15.72:0/3084671657 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a84009a70 con 0x7f3a9406b520 2023-07-27T20:33:25.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.903+0000 7f3a92d9d700 1 --2- 172.21.15.72:0/3084671657 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3a9406ef00 0x7f3a9414aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:33:25.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.904+0000 7f3a9259c700 1 --2- 172.21.15.72:0/3084671657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a9406b520 0x7f3a941eca80 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f3a940bf970 tx=0x7f3a84004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:25.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.904+0000 7f3a8affd700 1 -- 172.21.15.72:0/3084671657 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a84012430 con 0x7f3a9406b520 2023-07-27T20:33:25.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.904+0000 7f3a8affd700 1 -- 172.21.15.72:0/3084671657 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a84020070 con 0x7f3a9406b520 2023-07-27T20:33:25.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.904+0000 7f3a8affd700 1 -- 172.21.15.72:0/3084671657 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a84004280 con 0x7f3a9406b520 2023-07-27T20:33:25.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.904+0000 7f3a98bff700 1 -- 172.21.15.72:0/3084671657 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a9414e9a0 con 0x7f3a9406b520 2023-07-27T20:33:25.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.904+0000 7f3a98bff700 1 -- 172.21.15.72:0/3084671657 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a940ab680 con 0x7f3a9406b520 2023-07-27T20:33:25.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.905+0000 7f3a98bff700 1 -- 172.21.15.72:0/3084671657 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a94074310 con 0x7f3a9406b520 2023-07-27T20:33:25.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.906+0000 7f3a8affd700 1 -- 172.21.15.72:0/3084671657 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3a840043e0 con 0x7f3a9406b520 2023-07-27T20:33:25.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.907+0000 7f3a8affd700 1 --2- 172.21.15.72:0/3084671657 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3a7406ace0 0x7f3a7406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:25.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.907+0000 7f3a8affd700 1 -- 172.21.15.72:0/3084671657 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f3a84022070 con 0x7f3a9406b520 2023-07-27T20:33:25.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.907+0000 7f3a8bfff700 1 --2- 172.21.15.72:0/3084671657 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3a7406ace0 0x7f3a7406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:25.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.908+0000 7f3a8bfff700 1 --2- 172.21.15.72:0/3084671657 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3a7406ace0 0x7f3a7406d1a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3a940725a0 tx=0x7f3a7c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:25.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:25.911+0000 7f3a8affd700 1 -- 172.21.15.72:0/3084671657 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3a840568e0 con 0x7f3a9406b520 2023-07-27T20:33:26.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.108+0000 7f3a98bff700 1 -- 172.21.15.72:0/3084671657 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a940c07f0 con 0x7f3a9406b520 2023-07-27T20:33:26.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.110+0000 7f3a8affd700 1 -- 172.21.15.72:0/3084671657 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+22308 (secure 0 0 0) 0x7f3a84059f00 con 0x7f3a9406b520 2023-07-27T20:33:26.097 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:33:26.098 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":47,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:33:23.191066+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:32:58.242890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-27T20:32:59.032110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_metadata","create_time":"2023-07-27T20:33:20.125785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs2_data","create_time":"2023-07-27T20:33:20.647929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2c","mappings":[{"from":0,"to":4}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:33:26.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.112+0000 7f3a98bff700 1 -- 172.21.15.72:0/3084671657 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3a7406ace0 msgr2=0x7f3a7406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:26.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.112+0000 7f3a98bff700 1 --2- 172.21.15.72:0/3084671657 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3a7406ace0 0x7f3a7406d1a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3a940725a0 tx=0x7f3a7c009040 comp rx=0 tx=0).stop 2023-07-27T20:33:26.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.112+0000 7f3a98bff700 1 -- 172.21.15.72:0/3084671657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a9406b520 msgr2=0x7f3a941eca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:26.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.112+0000 7f3a98bff700 1 --2- 172.21.15.72:0/3084671657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a9406b520 0x7f3a941eca80 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f3a940bf970 tx=0x7f3a84004ad0 comp rx=0 tx=0).stop 2023-07-27T20:33:26.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.112+0000 7f3a98bff700 1 -- 172.21.15.72:0/3084671657 shutdown_connections 2023-07-27T20:33:26.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.112+0000 7f3a98bff700 1 --2- 172.21.15.72:0/3084671657 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3a7406ace0 0x7f3a7406d1a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:26.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.112+0000 7f3a98bff700 1 --2- 172.21.15.72:0/3084671657 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3a9406ef00 0x7f3a9414aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:26.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.112+0000 7f3a98bff700 1 --2- 172.21.15.72:0/3084671657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a9406b520 0x7f3a941eca80 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:26.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.112+0000 7f3a98bff700 1 --2- 172.21.15.72:0/3084671657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a9406b900 0x7f3a9414aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:26.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.112+0000 7f3a98bff700 1 -- 172.21.15.72:0/3084671657 >> 172.21.15.72:0/3084671657 conn(0x7f3a940c6800 msgr2=0x7f3a940c5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:26.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.112+0000 7f3a98bff700 1 -- 172.21.15.72:0/3084671657 shutdown_connections 2023-07-27T20:33:26.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.112+0000 7f3a98bff700 1 -- 172.21.15.72:0/3084671657 wait complete. 2023-07-27T20:33:26.117 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-27T20:33:26.118 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T20:33:26.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.325+0000 7f0b20bff700 1 Processor -- start 2023-07-27T20:33:26.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.326+0000 7f0b20bff700 1 -- start start 2023-07-27T20:33:26.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.327+0000 7f0b20bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0b1c139960 0x7f0b1c0c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:26.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.327+0000 7f0b20bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0b1c1542e0 0x7f0b1c154730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:26.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.327+0000 7f0b20bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b1c0c1810 con 0x7f0b1c139f80 2023-07-27T20:33:26.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.327+0000 7f0b20bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b1c0c0ee0 con 0x7f0b1c1542e0 2023-07-27T20:33:26.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.327+0000 7f0b20bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1c139d40 con 0x7f0b1c139960 2023-07-27T20:33:26.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.327+0000 7f0b1ad9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0b1c1542e0 0x7f0b1c154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:26.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.327+0000 7f0b19d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0b1c139f80 0x7f0b1c0c1e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43456/0 (socket says 172.21.15.72:43456) 2023-07-27T20:33:26.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.327+0000 7f0b19d9b700 1 -- 172.21.15.72:0/3425365641 learned_addr learned my addr 172.21.15.72:0/3425365641 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:26.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.327+0000 7f0b1a59c700 1 --2- 172.21.15.72:0/3425365641 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0b1c139960 0x7f0b1c0c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:26.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.328+0000 7f0b1959a700 1 -- 172.21.15.72:0/3425365641 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2506304351 0 0) 0x7f0b1c0c1810 con 0x7f0b1c139f80 2023-07-27T20:33:26.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.328+0000 7f0b1959a700 1 -- 172.21.15.72:0/3425365641 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b040057c0 con 0x7f0b1c139f80 2023-07-27T20:33:26.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.328+0000 7f0b1ad9d700 1 -- 172.21.15.72:0/3425365641 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0b1c139960 msgr2=0x7f0b1c0c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:26.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.328+0000 7f0b1ad9d700 1 --2- 172.21.15.72:0/3425365641 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0b1c139960 0x7f0b1c0c12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:26.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.328+0000 7f0b1ad9d700 1 -- 172.21.15.72:0/3425365641 >> v1:172.21.15.72:6789/0 conn(0x7f0b1c139f80 legacy=0x7f0b1c0c1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:26.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.328+0000 7f0b1ad9d700 1 -- 172.21.15.72:0/3425365641 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b1c151060 con 0x7f0b1c1542e0 2023-07-27T20:33:26.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.328+0000 7f0b1ad9d700 1 --2- 172.21.15.72:0/3425365641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b1c1542e0 0x7f0b1c154730 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0b14009d90 tx=0x7f0b1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b396576bd85a42a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:26.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.328+0000 7f0b1959a700 1 -- 172.21.15.72:0/3425365641 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1400e070 con 0x7f0b1c1542e0 2023-07-27T20:33:26.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.328+0000 7f0b1959a700 1 -- 172.21.15.72:0/3425365641 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1400bb20 con 0x7f0b1c1542e0 2023-07-27T20:33:26.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.328+0000 7f0b1959a700 1 -- 172.21.15.72:0/3425365641 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b14012430 con 0x7f0b1c1542e0 2023-07-27T20:33:26.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.329+0000 7f0b20bff700 1 -- 172.21.15.72:0/3425365641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b1c1542e0 msgr2=0x7f0b1c154730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:26.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.329+0000 7f0b20bff700 1 --2- 172.21.15.72:0/3425365641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b1c1542e0 0x7f0b1c154730 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0b14009d90 tx=0x7f0b1400b330 comp rx=0 tx=0).stop 2023-07-27T20:33:26.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.329+0000 7f0b20bff700 1 -- 172.21.15.72:0/3425365641 shutdown_connections 2023-07-27T20:33:26.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.329+0000 7f0b20bff700 1 --2- 172.21.15.72:0/3425365641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b1c1542e0 0x7f0b1c154730 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:26.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.329+0000 7f0b20bff700 1 --2- 172.21.15.72:0/3425365641 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0b1c139960 0x7f0b1c0c12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:26.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.329+0000 7f0b20bff700 1 -- 172.21.15.72:0/3425365641 >> 172.21.15.72:0/3425365641 conn(0x7f0b1c06a190 msgr2=0x7f0b1c06a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:26.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.329+0000 7f0b20bff700 1 -- 172.21.15.72:0/3425365641 shutdown_connections 2023-07-27T20:33:26.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.329+0000 7f0b20bff700 1 -- 172.21.15.72:0/3425365641 wait complete. 2023-07-27T20:33:26.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.330+0000 7f0b20bff700 1 Processor -- start 2023-07-27T20:33:26.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.331+0000 7f0b20bff700 1 -- start start 2023-07-27T20:33:26.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.331+0000 7f0b20bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b1c139960 0x7f0b1c1e9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:26.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.331+0000 7f0b20bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0b1c139f80 0x7f0b1c0c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:26.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.331+0000 7f0b20bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b1c1542e0 0x7f0b1c1372a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:26.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.331+0000 7f0b20bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1c0c43f0 con 0x7f0b1c1542e0 2023-07-27T20:33:26.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.331+0000 7f0b20bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1c1ea2a0 con 0x7f0b1c139960 2023-07-27T20:33:26.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.331+0000 7f0b20bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1c0c3d20 con 0x7f0b1c139f80 2023-07-27T20:33:26.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.332+0000 7f0b1ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b1c1542e0 0x7f0b1c1372a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:26.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.332+0000 7f0b1ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b1c1542e0 0x7f0b1c1372a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39738/0 (socket says 172.21.15.72:39738) 2023-07-27T20:33:26.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.332+0000 7f0b1ad9d700 1 -- 172.21.15.72:0/3049418845 learned_addr learned my addr 172.21.15.72:0/3049418845 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:26.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.332+0000 7f0b1a59c700 1 --2- 172.21.15.72:0/3049418845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b1c139960 0x7f0b1c1e9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:26.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.332+0000 7f0b19d9b700 1 --2- 172.21.15.72:0/3049418845 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0b1c139f80 0x7f0b1c0c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:26.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.332+0000 7f0b1ad9d700 1 -- 172.21.15.72:0/3049418845 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0b1c139f80 msgr2=0x7f0b1c0c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:26.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.332+0000 7f0b1ad9d700 1 --2- 172.21.15.72:0/3049418845 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0b1c139f80 0x7f0b1c0c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:26.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.332+0000 7f0b1ad9d700 1 -- 172.21.15.72:0/3049418845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b1c139960 msgr2=0x7f0b1c1e9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:26.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.332+0000 7f0b1ad9d700 1 --2- 172.21.15.72:0/3049418845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b1c139960 0x7f0b1c1e9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:26.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.332+0000 7f0b1ad9d700 1 -- 172.21.15.72:0/3049418845 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b14009a70 con 0x7f0b1c1542e0 2023-07-27T20:33:26.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.333+0000 7f0b1ad9d700 1 --2- 172.21.15.72:0/3049418845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b1c1542e0 0x7f0b1c1372a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f0b14014040 tx=0x7f0b14004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:26.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.333+0000 7f0b0affd700 1 -- 172.21.15.72:0/3049418845 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b140129f0 con 0x7f0b1c1542e0 2023-07-27T20:33:26.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.333+0000 7f0b0affd700 1 -- 172.21.15.72:0/3049418845 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b14020070 con 0x7f0b1c1542e0 2023-07-27T20:33:26.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.333+0000 7f0b0affd700 1 -- 172.21.15.72:0/3049418845 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b14012db0 con 0x7f0b1c1542e0 2023-07-27T20:33:26.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.333+0000 7f0b20bff700 1 -- 172.21.15.72:0/3049418845 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b1c1eca70 con 0x7f0b1c1542e0 2023-07-27T20:33:26.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.333+0000 7f0b20bff700 1 -- 172.21.15.72:0/3049418845 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b1c1ed030 con 0x7f0b1c1542e0 2023-07-27T20:33:26.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.334+0000 7f0b08ff9700 1 -- 172.21.15.72:0/3049418845 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b1c1ec8d0 con 0x7f0b1c1542e0 2023-07-27T20:33:26.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.335+0000 7f0b0affd700 1 -- 172.21.15.72:0/3049418845 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0b14004040 con 0x7f0b1c1542e0 2023-07-27T20:33:26.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.336+0000 7f0b0affd700 1 --2- 172.21.15.72:0/3049418845 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0afc06ace0 0x7f0afc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:26.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.336+0000 7f0b0affd700 1 -- 172.21.15.72:0/3049418845 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f0b14022070 con 0x7f0b1c1542e0 2023-07-27T20:33:26.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.336+0000 7f0b1a59c700 1 --2- 172.21.15.72:0/3049418845 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0afc06ace0 0x7f0afc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:26.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.337+0000 7f0b1a59c700 1 --2- 172.21.15.72:0/3049418845 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0afc06ace0 0x7f0afc06d1a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c009b40 tx=0x7f0b0c009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:26.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.340+0000 7f0b0affd700 1 -- 172.21.15.72:0/3049418845 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0b1c1ec8d0 con 0x7f0b1c1542e0 2023-07-27T20:33:26.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.530+0000 7f0b08ff9700 1 -- 172.21.15.72:0/3049418845 --> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0b1c151620 con 0x7f0afc06ace0 2023-07-27T20:33:26.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.546+0000 7f0b0affd700 1 -- 172.21.15.72:0/3049418845 <== mgr.4107 v2:172.21.15.173:6832/910681537 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+535088 (secure 0 0 0) 0x7f0b0c011810 con 0x7f0afc06ace0 2023-07-27T20:33:26.543 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:33:26.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.552+0000 7f0b08ff9700 1 -- 172.21.15.72:0/3049418845 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0afc06ace0 msgr2=0x7f0afc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:26.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.552+0000 7f0b08ff9700 1 --2- 172.21.15.72:0/3049418845 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0afc06ace0 0x7f0afc06d1a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c009b40 tx=0x7f0b0c009210 comp rx=0 tx=0).stop 2023-07-27T20:33:26.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.552+0000 7f0b08ff9700 1 -- 172.21.15.72:0/3049418845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b1c1542e0 msgr2=0x7f0b1c1372a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:26.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.552+0000 7f0b08ff9700 1 --2- 172.21.15.72:0/3049418845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b1c1542e0 0x7f0b1c1372a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f0b14014040 tx=0x7f0b14004ad0 comp rx=0 tx=0).stop 2023-07-27T20:33:26.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.553+0000 7f0b08ff9700 1 -- 172.21.15.72:0/3049418845 shutdown_connections 2023-07-27T20:33:26.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.553+0000 7f0b08ff9700 1 --2- 172.21.15.72:0/3049418845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b1c1542e0 0x7f0b1c1372a0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:26.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.553+0000 7f0b08ff9700 1 --2- 172.21.15.72:0/3049418845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b1c139960 0x7f0b1c1e9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:26.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.553+0000 7f0b08ff9700 1 --2- 172.21.15.72:0/3049418845 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0afc06ace0 0x7f0afc06d1a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:26.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.553+0000 7f0b08ff9700 1 --2- 172.21.15.72:0/3049418845 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0b1c139f80 0x7f0b1c0c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:26.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.553+0000 7f0b08ff9700 1 -- 172.21.15.72:0/3049418845 >> 172.21.15.72:0/3049418845 conn(0x7f0b1c06a190 msgr2=0x7f0b1c132740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:26.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.553+0000 7f0b08ff9700 1 -- 172.21.15.72:0/3049418845 shutdown_connections 2023-07-27T20:33:26.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.553+0000 7f0b08ff9700 1 -- 172.21.15.72:0/3049418845 wait complete. 2023-07-27T20:33:26.548 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-07-27T20:33:26.559 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2023-07-27T20:33:24.555432+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594427,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221292,"kb_used_data":5128,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753428,"statfs":{"total":773094113280,"available":772867510272,"internally_reserved":0,"allocated":5251072,"data_stored":2998454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.380337"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":53,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.825517+0000","last_change":"2023-07-27T20:31:22.846540+0000","last_active":"2023-07-27T20:33:11.825517+0000","last_peered":"2023-07-27T20:33:11.825517+0000","last_clean":"2023-07-27T20:33:11.825517+0000","last_became_active":"2023-07-27T20:31:22.846128+0000","last_became_peered":"2023-07-27T20:31:22.846128+0000","last_unstale":"2023-07-27T20:33:11.825517+0000","last_undegraded":"2023-07-27T20:33:11.825517+0000","last_fullsized":"2023-07-27T20:33:11.825517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:34:28.826843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.824613+0000","last_change":"2023-07-27T20:32:59.579629+0000","last_active":"2023-07-27T20:33:11.824613+0000","last_peered":"2023-07-27T20:33:11.824613+0000","last_clean":"2023-07-27T20:33:11.824613+0000","last_became_active":"2023-07-27T20:32:59.579376+0000","last_became_peered":"2023-07-27T20:32:59.579376+0000","last_unstale":"2023-07-27T20:33:11.824613+0000","last_undegraded":"2023-07-27T20:33:11.824613+0000","last_fullsized":"2023-07-27T20:33:11.824613+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:58:40.348368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.824456+0000","last_change":"2023-07-27T20:33:00.587812+0000","last_active":"2023-07-27T20:33:11.824456+0000","last_peered":"2023-07-27T20:33:11.824456+0000","last_clean":"2023-07-27T20:33:11.824456+0000","last_became_active":"2023-07-27T20:33:00.587294+0000","last_became_peered":"2023-07-27T20:33:00.587294+0000","last_unstale":"2023-07-27T20:33:11.824456+0000","last_undegraded":"2023-07-27T20:33:11.824456+0000","last_fullsized":"2023-07-27T20:33:11.824456+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:16:17.532080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:20.160896+0000","last_change":"2023-07-27T20:33:20.160896+0000","last_active":"2023-07-27T20:33:20.160896+0000","last_peered":"2023-07-27T20:33:20.160896+0000","last_clean":"2023-07-27T20:33:20.160896+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:20.160896+0000","last_undegraded":"2023-07-27T20:33:20.160896+0000","last_fullsized":"2023-07-27T20:33:20.160896+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.824783+0000","last_change":"2023-07-27T20:31:22.845641+0000","last_active":"2023-07-27T20:33:11.824783+0000","last_peered":"2023-07-27T20:33:11.824783+0000","last_clean":"2023-07-27T20:33:11.824783+0000","last_became_active":"2023-07-27T20:31:22.845368+0000","last_became_peered":"2023-07-27T20:31:22.845368+0000","last_unstale":"2023-07-27T20:33:11.824783+0000","last_undegraded":"2023-07-27T20:33:11.824783+0000","last_fullsized":"2023-07-27T20:33:11.824783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:35:21.562826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.127025+0000","last_change":"2023-07-27T20:32:59.586199+0000","last_active":"2023-07-27T20:33:11.127025+0000","last_peered":"2023-07-27T20:33:11.127025+0000","last_clean":"2023-07-27T20:33:11.127025+0000","last_became_active":"2023-07-27T20:32:59.585937+0000","last_became_peered":"2023-07-27T20:32:59.585937+0000","last_unstale":"2023-07-27T20:33:11.127025+0000","last_undegraded":"2023-07-27T20:33:11.127025+0000","last_fullsized":"2023-07-27T20:33:11.127025+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:46:13.819810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.824803+0000","last_change":"2023-07-27T20:33:00.586803+0000","last_active":"2023-07-27T20:33:11.824803+0000","last_peered":"2023-07-27T20:33:11.824803+0000","last_clean":"2023-07-27T20:33:11.824803+0000","last_became_active":"2023-07-27T20:33:00.586523+0000","last_became_peered":"2023-07-27T20:33:00.586523+0000","last_unstale":"2023-07-27T20:33:11.824803+0000","last_undegraded":"2023-07-27T20:33:11.824803+0000","last_fullsized":"2023-07-27T20:33:11.824803+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:14:20.703469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:20.160896+0000","last_change":"2023-07-27T20:33:20.160896+0000","last_active":"2023-07-27T20:33:20.160896+0000","last_peered":"2023-07-27T20:33:20.160896+0000","last_clean":"2023-07-27T20:33:20.160896+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:20.160896+0000","last_undegraded":"2023-07-27T20:33:20.160896+0000","last_fullsized":"2023-07-27T20:33:20.160896+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.825047+0000","last_change":"2023-07-27T20:31:22.848025+0000","last_active":"2023-07-27T20:33:11.825047+0000","last_peered":"2023-07-27T20:33:11.825047+0000","last_clean":"2023-07-27T20:33:11.825047+0000","last_became_active":"2023-07-27T20:31:22.847603+0000","last_became_peered":"2023-07-27T20:31:22.847603+0000","last_unstale":"2023-07-27T20:33:11.825047+0000","last_undegraded":"2023-07-27T20:33:11.825047+0000","last_fullsized":"2023-07-27T20:33:11.825047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:59:18.028156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.824252+0000","last_change":"2023-07-27T20:32:59.579303+0000","last_active":"2023-07-27T20:33:11.824252+0000","last_peered":"2023-07-27T20:33:11.824252+0000","last_clean":"2023-07-27T20:33:11.824252+0000","last_became_active":"2023-07-27T20:32:59.579015+0000","last_became_peered":"2023-07-27T20:32:59.579015+0000","last_unstale":"2023-07-27T20:33:11.824252+0000","last_undegraded":"2023-07-27T20:33:11.824252+0000","last_fullsized":"2023-07-27T20:33:11.824252+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:38:33.844373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.127619+0000","last_change":"2023-07-27T20:33:00.590893+0000","last_active":"2023-07-27T20:33:11.127619+0000","last_peered":"2023-07-27T20:33:11.127619+0000","last_clean":"2023-07-27T20:33:11.127619+0000","last_became_active":"2023-07-27T20:33:00.590559+0000","last_became_peered":"2023-07-27T20:33:00.590559+0000","last_unstale":"2023-07-27T20:33:11.127619+0000","last_undegraded":"2023-07-27T20:33:11.127619+0000","last_fullsized":"2023-07-27T20:33:11.127619+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:15:30.067449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:20.160896+0000","last_change":"2023-07-27T20:33:20.160896+0000","last_active":"2023-07-27T20:33:20.160896+0000","last_peered":"2023-07-27T20:33:20.160896+0000","last_clean":"2023-07-27T20:33:20.160896+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:20.160896+0000","last_undegraded":"2023-07-27T20:33:20.160896+0000","last_fullsized":"2023-07-27T20:33:20.160896+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.824445+0000","last_change":"2023-07-27T20:31:22.848181+0000","last_active":"2023-07-27T20:33:11.824445+0000","last_peered":"2023-07-27T20:33:11.824445+0000","last_clean":"2023-07-27T20:33:11.824445+0000","last_became_active":"2023-07-27T20:31:22.847865+0000","last_became_peered":"2023-07-27T20:31:22.847865+0000","last_unstale":"2023-07-27T20:33:11.824445+0000","last_undegraded":"2023-07-27T20:33:11.824445+0000","last_fullsized":"2023-07-27T20:33:11.824445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:45:24.454708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.824486+0000","last_change":"2023-07-27T20:32:59.584665+0000","last_active":"2023-07-27T20:33:11.824486+0000","last_peered":"2023-07-27T20:33:11.824486+0000","last_clean":"2023-07-27T20:33:11.824486+0000","last_became_active":"2023-07-27T20:32:59.584357+0000","last_became_peered":"2023-07-27T20:32:59.584357+0000","last_unstale":"2023-07-27T20:33:11.824486+0000","last_undegraded":"2023-07-27T20:33:11.824486+0000","last_fullsized":"2023-07-27T20:33:11.824486+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:17:34.464507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.824746+0000","last_change":"2023-07-27T20:33:00.590390+0000","last_active":"2023-07-27T20:33:11.824746+0000","last_peered":"2023-07-27T20:33:11.824746+0000","last_clean":"2023-07-27T20:33:11.824746+0000","last_became_active":"2023-07-27T20:33:00.590070+0000","last_became_peered":"2023-07-27T20:33:00.590070+0000","last_unstale":"2023-07-27T20:33:11.824746+0000","last_undegraded":"2023-07-27T20:33:11.824746+0000","last_fullsized":"2023-07-27T20:33:11.824746+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:19:38.220683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:20.160896+0000","last_change":"2023-07-27T20:33:20.160896+0000","last_active":"2023-07-27T20:33:20.160896+0000","last_peered":"2023-07-27T20:33:20.160896+0000","last_clean":"2023-07-27T20:33:20.160896+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:20.160896+0000","last_undegraded":"2023-07-27T20:33:20.160896+0000","last_fullsized":"2023-07-27T20:33:20.160896+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":212,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.824348+0000","last_change":"2023-07-27T20:31:15.812727+0000","last_active":"2023-07-27T20:33:11.824348+0000","last_peered":"2023-07-27T20:33:11.824348+0000","last_clean":"2023-07-27T20:33:11.824348+0000","last_became_active":"2023-07-27T20:31:15.811803+0000","last_became_peered":"2023-07-27T20:31:15.811803+0000","last_unstale":"2023-07-27T20:33:11.824348+0000","last_undegraded":"2023-07-27T20:33:11.824348+0000","last_fullsized":"2023-07-27T20:33:11.824348+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:14.789257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:14.789257+0000","last_clean_scrub_stamp":"2023-07-27T20:31:14.789257+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:54:40.756657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.127977+0000","last_change":"2023-07-27T20:31:22.847766+0000","last_active":"2023-07-27T20:33:11.127977+0000","last_peered":"2023-07-27T20:33:11.127977+0000","last_clean":"2023-07-27T20:33:11.127977+0000","last_became_active":"2023-07-27T20:31:22.847396+0000","last_became_peered":"2023-07-27T20:31:22.847396+0000","last_unstale":"2023-07-27T20:33:11.127977+0000","last_undegraded":"2023-07-27T20:33:11.127977+0000","last_fullsized":"2023-07-27T20:33:11.127977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:38:01.210671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"40'2","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.128029+0000","last_change":"2023-07-27T20:32:59.585447+0000","last_active":"2023-07-27T20:33:11.128029+0000","last_peered":"2023-07-27T20:33:11.128029+0000","last_clean":"2023-07-27T20:33:11.128029+0000","last_became_active":"2023-07-27T20:32:59.585172+0000","last_became_peered":"2023-07-27T20:32:59.585172+0000","last_unstale":"2023-07-27T20:33:11.128029+0000","last_undegraded":"2023-07-27T20:33:11.128029+0000","last_fullsized":"2023-07-27T20:33:11.128029+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:07:42.993967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.124931+0000","last_change":"2023-07-27T20:33:00.581823+0000","last_active":"2023-07-27T20:33:11.124931+0000","last_peered":"2023-07-27T20:33:11.124931+0000","last_clean":"2023-07-27T20:33:11.124931+0000","last_became_active":"2023-07-27T20:33:00.581520+0000","last_became_peered":"2023-07-27T20:33:00.581520+0000","last_unstale":"2023-07-27T20:33:11.124931+0000","last_undegraded":"2023-07-27T20:33:11.124931+0000","last_fullsized":"2023-07-27T20:33:11.124931+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:16:17.532080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:20.160896+0000","last_change":"2023-07-27T20:33:20.160896+0000","last_active":"2023-07-27T20:33:20.160896+0000","last_peered":"2023-07-27T20:33:20.160896+0000","last_clean":"2023-07-27T20:33:20.160896+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:20.160896+0000","last_undegraded":"2023-07-27T20:33:20.160896+0000","last_fullsized":"2023-07-27T20:33:20.160896+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.126246+0000","last_change":"2023-07-27T20:31:22.959811+0000","last_active":"2023-07-27T20:33:11.126246+0000","last_peered":"2023-07-27T20:33:11.126246+0000","last_clean":"2023-07-27T20:33:11.126246+0000","last_became_active":"2023-07-27T20:31:22.959449+0000","last_became_peered":"2023-07-27T20:31:22.959449+0000","last_unstale":"2023-07-27T20:33:11.126246+0000","last_undegraded":"2023-07-27T20:33:11.126246+0000","last_fullsized":"2023-07-27T20:33:11.126246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:59:06.695876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.824926+0000","last_change":"2023-07-27T20:32:59.579248+0000","last_active":"2023-07-27T20:33:11.824926+0000","last_peered":"2023-07-27T20:33:11.824926+0000","last_clean":"2023-07-27T20:33:11.824926+0000","last_became_active":"2023-07-27T20:32:59.578926+0000","last_became_peered":"2023-07-27T20:32:59.578926+0000","last_unstale":"2023-07-27T20:33:11.824926+0000","last_undegraded":"2023-07-27T20:33:11.824926+0000","last_fullsized":"2023-07-27T20:33:11.824926+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:53:45.222372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.125167+0000","last_change":"2023-07-27T20:33:00.572709+0000","last_active":"2023-07-27T20:33:11.125167+0000","last_peered":"2023-07-27T20:33:11.125167+0000","last_clean":"2023-07-27T20:33:11.125167+0000","last_became_active":"2023-07-27T20:33:00.572428+0000","last_became_peered":"2023-07-27T20:33:00.572428+0000","last_unstale":"2023-07-27T20:33:11.125167+0000","last_undegraded":"2023-07-27T20:33:11.125167+0000","last_fullsized":"2023-07-27T20:33:11.125167+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:09:23.724263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:20.160896+0000","last_change":"2023-07-27T20:33:20.160896+0000","last_active":"2023-07-27T20:33:20.160896+0000","last_peered":"2023-07-27T20:33:20.160896+0000","last_clean":"2023-07-27T20:33:20.160896+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:20.160896+0000","last_undegraded":"2023-07-27T20:33:20.160896+0000","last_fullsized":"2023-07-27T20:33:20.160896+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.128042+0000","last_change":"2023-07-27T20:31:22.849178+0000","last_active":"2023-07-27T20:33:11.128042+0000","last_peered":"2023-07-27T20:33:11.128042+0000","last_clean":"2023-07-27T20:33:11.128042+0000","last_became_active":"2023-07-27T20:31:22.848856+0000","last_became_peered":"2023-07-27T20:31:22.848856+0000","last_unstale":"2023-07-27T20:33:11.128042+0000","last_undegraded":"2023-07-27T20:33:11.128042+0000","last_fullsized":"2023-07-27T20:33:11.128042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:32:16.683293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"41'1","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.824814+0000","last_change":"2023-07-27T20:32:59.579071+0000","last_active":"2023-07-27T20:33:11.824814+0000","last_peered":"2023-07-27T20:33:11.824814+0000","last_clean":"2023-07-27T20:33:11.824814+0000","last_became_active":"2023-07-27T20:32:59.578792+0000","last_became_peered":"2023-07-27T20:32:59.578792+0000","last_unstale":"2023-07-27T20:33:11.824814+0000","last_undegraded":"2023-07-27T20:33:11.824814+0000","last_fullsized":"2023-07-27T20:33:11.824814+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:09:22.716951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.825151+0000","last_change":"2023-07-27T20:33:00.594284+0000","last_active":"2023-07-27T20:33:11.825151+0000","last_peered":"2023-07-27T20:33:11.825151+0000","last_clean":"2023-07-27T20:33:11.825151+0000","last_became_active":"2023-07-27T20:33:00.593915+0000","last_became_peered":"2023-07-27T20:33:00.593915+0000","last_unstale":"2023-07-27T20:33:11.825151+0000","last_undegraded":"2023-07-27T20:33:11.825151+0000","last_fullsized":"2023-07-27T20:33:11.825151+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:08:21.970851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:20.160896+0000","last_change":"2023-07-27T20:33:20.160896+0000","last_active":"2023-07-27T20:33:20.160896+0000","last_peered":"2023-07-27T20:33:20.160896+0000","last_clean":"2023-07-27T20:33:20.160896+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:20.160896+0000","last_undegraded":"2023-07-27T20:33:20.160896+0000","last_fullsized":"2023-07-27T20:33:20.160896+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.824624+0000","last_change":"2023-07-27T20:31:22.848698+0000","last_active":"2023-07-27T20:33:11.824624+0000","last_peered":"2023-07-27T20:33:11.824624+0000","last_clean":"2023-07-27T20:33:11.824624+0000","last_became_active":"2023-07-27T20:31:22.848346+0000","last_became_peered":"2023-07-27T20:31:22.848346+0000","last_unstale":"2023-07-27T20:33:11.824624+0000","last_undegraded":"2023-07-27T20:33:11.824624+0000","last_fullsized":"2023-07-27T20:33:11.824624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:24:32.380693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.125000+0000","last_change":"2023-07-27T20:32:59.581609+0000","last_active":"2023-07-27T20:33:11.125000+0000","last_peered":"2023-07-27T20:33:11.125000+0000","last_clean":"2023-07-27T20:33:11.125000+0000","last_became_active":"2023-07-27T20:32:59.580643+0000","last_became_peered":"2023-07-27T20:32:59.580643+0000","last_unstale":"2023-07-27T20:33:11.125000+0000","last_undegraded":"2023-07-27T20:33:11.125000+0000","last_fullsized":"2023-07-27T20:33:11.125000+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:53:20.503050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.126559+0000","last_change":"2023-07-27T20:33:00.588668+0000","last_active":"2023-07-27T20:33:11.126559+0000","last_peered":"2023-07-27T20:33:11.126559+0000","last_clean":"2023-07-27T20:33:11.126559+0000","last_became_active":"2023-07-27T20:33:00.588375+0000","last_became_peered":"2023-07-27T20:33:00.588375+0000","last_unstale":"2023-07-27T20:33:11.126559+0000","last_undegraded":"2023-07-27T20:33:11.126559+0000","last_fullsized":"2023-07-27T20:33:11.126559+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:35:34.110909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:20.160896+0000","last_change":"2023-07-27T20:33:20.160896+0000","last_active":"2023-07-27T20:33:20.160896+0000","last_peered":"2023-07-27T20:33:20.160896+0000","last_clean":"2023-07-27T20:33:20.160896+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:20.160896+0000","last_undegraded":"2023-07-27T20:33:20.160896+0000","last_fullsized":"2023-07-27T20:33:20.160896+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.824111+0000","last_change":"2023-07-27T20:32:59.581455+0000","last_active":"2023-07-27T20:33:11.824111+0000","last_peered":"2023-07-27T20:33:11.824111+0000","last_clean":"2023-07-27T20:33:11.824111+0000","last_became_active":"2023-07-27T20:32:59.579901+0000","last_became_peered":"2023-07-27T20:32:59.579901+0000","last_unstale":"2023-07-27T20:33:11.824111+0000","last_undegraded":"2023-07-27T20:33:11.824111+0000","last_fullsized":"2023-07-27T20:33:11.824111+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:24:42.458606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.124432+0000","last_change":"2023-07-27T20:33:00.583933+0000","last_active":"2023-07-27T20:33:11.124432+0000","last_peered":"2023-07-27T20:33:11.124432+0000","last_clean":"2023-07-27T20:33:11.124432+0000","last_became_active":"2023-07-27T20:33:00.583598+0000","last_became_peered":"2023-07-27T20:33:00.583598+0000","last_unstale":"2023-07-27T20:33:11.124432+0000","last_undegraded":"2023-07-27T20:33:11.124432+0000","last_fullsized":"2023-07-27T20:33:11.124432+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:47:20.283073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:20.160896+0000","last_change":"2023-07-27T20:33:20.160896+0000","last_active":"2023-07-27T20:33:20.160896+0000","last_peered":"2023-07-27T20:33:20.160896+0000","last_clean":"2023-07-27T20:33:20.160896+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:20.160896+0000","last_undegraded":"2023-07-27T20:33:20.160896+0000","last_fullsized":"2023-07-27T20:33:20.160896+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.124490+0000","last_change":"2023-07-27T20:32:59.577740+0000","last_active":"2023-07-27T20:33:11.124490+0000","last_peered":"2023-07-27T20:33:11.124490+0000","last_clean":"2023-07-27T20:33:11.124490+0000","last_became_active":"2023-07-27T20:32:59.577456+0000","last_became_peered":"2023-07-27T20:32:59.577456+0000","last_unstale":"2023-07-27T20:33:11.124490+0000","last_undegraded":"2023-07-27T20:33:11.124490+0000","last_fullsized":"2023-07-27T20:33:11.124490+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:38:08.915097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.126285+0000","last_change":"2023-07-27T20:33:00.580697+0000","last_active":"2023-07-27T20:33:11.126285+0000","last_peered":"2023-07-27T20:33:11.126285+0000","last_clean":"2023-07-27T20:33:11.126285+0000","last_became_active":"2023-07-27T20:33:00.580386+0000","last_became_peered":"2023-07-27T20:33:00.580386+0000","last_unstale":"2023-07-27T20:33:11.126285+0000","last_undegraded":"2023-07-27T20:33:11.126285+0000","last_fullsized":"2023-07-27T20:33:11.126285+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:41:51.218208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:20.160896+0000","last_change":"2023-07-27T20:33:20.160896+0000","last_active":"2023-07-27T20:33:20.160896+0000","last_peered":"2023-07-27T20:33:20.160896+0000","last_clean":"2023-07-27T20:33:20.160896+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:20.160896+0000","last_undegraded":"2023-07-27T20:33:20.160896+0000","last_fullsized":"2023-07-27T20:33:20.160896+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.127852+0000","last_change":"2023-07-27T20:32:59.583381+0000","last_active":"2023-07-27T20:33:11.127852+0000","last_peered":"2023-07-27T20:33:11.127852+0000","last_clean":"2023-07-27T20:33:11.127852+0000","last_became_active":"2023-07-27T20:32:59.582911+0000","last_became_peered":"2023-07-27T20:32:59.582911+0000","last_unstale":"2023-07-27T20:33:11.127852+0000","last_undegraded":"2023-07-27T20:33:11.127852+0000","last_fullsized":"2023-07-27T20:33:11.127852+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:34:47.120294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.824452+0000","last_change":"2023-07-27T20:33:00.585619+0000","last_active":"2023-07-27T20:33:11.824452+0000","last_peered":"2023-07-27T20:33:11.824452+0000","last_clean":"2023-07-27T20:33:11.824452+0000","last_became_active":"2023-07-27T20:33:00.585362+0000","last_became_peered":"2023-07-27T20:33:00.585362+0000","last_unstale":"2023-07-27T20:33:11.824452+0000","last_undegraded":"2023-07-27T20:33:11.824452+0000","last_fullsized":"2023-07-27T20:33:11.824452+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:53:00.572896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:20.160896+0000","last_change":"2023-07-27T20:33:20.160896+0000","last_active":"2023-07-27T20:33:20.160896+0000","last_peered":"2023-07-27T20:33:20.160896+0000","last_clean":"2023-07-27T20:33:20.160896+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:20.160896+0000","last_undegraded":"2023-07-27T20:33:20.160896+0000","last_fullsized":"2023-07-27T20:33:20.160896+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"40'2","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.824950+0000","last_change":"2023-07-27T20:32:59.581014+0000","last_active":"2023-07-27T20:33:11.824950+0000","last_peered":"2023-07-27T20:33:11.824950+0000","last_clean":"2023-07-27T20:33:11.824950+0000","last_became_active":"2023-07-27T20:32:59.580563+0000","last_became_peered":"2023-07-27T20:32:59.580563+0000","last_unstale":"2023-07-27T20:33:11.824950+0000","last_undegraded":"2023-07-27T20:33:11.824950+0000","last_fullsized":"2023-07-27T20:33:11.824950+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:02:45.047821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.824195+0000","last_change":"2023-07-27T20:33:00.588162+0000","last_active":"2023-07-27T20:33:11.824195+0000","last_peered":"2023-07-27T20:33:11.824195+0000","last_clean":"2023-07-27T20:33:11.824195+0000","last_became_active":"2023-07-27T20:33:00.587546+0000","last_became_peered":"2023-07-27T20:33:00.587546+0000","last_unstale":"2023-07-27T20:33:11.824195+0000","last_undegraded":"2023-07-27T20:33:11.824195+0000","last_fullsized":"2023-07-27T20:33:11.824195+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:33:47.017844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:20.160896+0000","last_change":"2023-07-27T20:33:20.160896+0000","last_active":"2023-07-27T20:33:20.160896+0000","last_peered":"2023-07-27T20:33:20.160896+0000","last_clean":"2023-07-27T20:33:20.160896+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:20.160896+0000","last_undegraded":"2023-07-27T20:33:20.160896+0000","last_fullsized":"2023-07-27T20:33:20.160896+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.824572+0000","last_change":"2023-07-27T20:32:59.585317+0000","last_active":"2023-07-27T20:33:11.824572+0000","last_peered":"2023-07-27T20:33:11.824572+0000","last_clean":"2023-07-27T20:33:11.824572+0000","last_became_active":"2023-07-27T20:32:59.585008+0000","last_became_peered":"2023-07-27T20:32:59.585008+0000","last_unstale":"2023-07-27T20:33:11.824572+0000","last_undegraded":"2023-07-27T20:33:11.824572+0000","last_fullsized":"2023-07-27T20:33:11.824572+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:02:43.327365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.825454+0000","last_change":"2023-07-27T20:33:00.597737+0000","last_active":"2023-07-27T20:33:11.825454+0000","last_peered":"2023-07-27T20:33:11.825454+0000","last_clean":"2023-07-27T20:33:11.825454+0000","last_became_active":"2023-07-27T20:33:00.597390+0000","last_became_peered":"2023-07-27T20:33:00.597390+0000","last_unstale":"2023-07-27T20:33:11.825454+0000","last_undegraded":"2023-07-27T20:33:11.825454+0000","last_fullsized":"2023-07-27T20:33:11.825454+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:12:41.381799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:20.160896+0000","last_change":"2023-07-27T20:33:20.160896+0000","last_active":"2023-07-27T20:33:20.160896+0000","last_peered":"2023-07-27T20:33:20.160896+0000","last_clean":"2023-07-27T20:33:20.160896+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:20.160896+0000","last_undegraded":"2023-07-27T20:33:20.160896+0000","last_fullsized":"2023-07-27T20:33:20.160896+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"40'1","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.128055+0000","last_change":"2023-07-27T20:32:59.588890+0000","last_active":"2023-07-27T20:33:11.128055+0000","last_peered":"2023-07-27T20:33:11.128055+0000","last_clean":"2023-07-27T20:33:11.128055+0000","last_became_active":"2023-07-27T20:32:59.588570+0000","last_became_peered":"2023-07-27T20:32:59.588570+0000","last_unstale":"2023-07-27T20:33:11.128055+0000","last_undegraded":"2023-07-27T20:33:11.128055+0000","last_fullsized":"2023-07-27T20:33:11.128055+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:21:23.897565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.825353+0000","last_change":"2023-07-27T20:33:00.602792+0000","last_active":"2023-07-27T20:33:11.825353+0000","last_peered":"2023-07-27T20:33:11.825353+0000","last_clean":"2023-07-27T20:33:11.825353+0000","last_became_active":"2023-07-27T20:33:00.602393+0000","last_became_peered":"2023-07-27T20:33:00.602393+0000","last_unstale":"2023-07-27T20:33:11.825353+0000","last_undegraded":"2023-07-27T20:33:11.825353+0000","last_fullsized":"2023-07-27T20:33:11.825353+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:54:48.018434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:20.160896+0000","last_change":"2023-07-27T20:33:20.160896+0000","last_active":"2023-07-27T20:33:20.160896+0000","last_peered":"2023-07-27T20:33:20.160896+0000","last_clean":"2023-07-27T20:33:20.160896+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:20.160896+0000","last_undegraded":"2023-07-27T20:33:20.160896+0000","last_fullsized":"2023-07-27T20:33:20.160896+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"40'2","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.126864+0000","last_change":"2023-07-27T20:32:59.580768+0000","last_active":"2023-07-27T20:33:11.126864+0000","last_peered":"2023-07-27T20:33:11.126864+0000","last_clean":"2023-07-27T20:33:11.126864+0000","last_became_active":"2023-07-27T20:32:59.580496+0000","last_became_peered":"2023-07-27T20:32:59.580496+0000","last_unstale":"2023-07-27T20:33:11.126864+0000","last_undegraded":"2023-07-27T20:33:11.126864+0000","last_fullsized":"2023-07-27T20:33:11.126864+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:09:49.648760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.124855+0000","last_change":"2023-07-27T20:33:00.592417+0000","last_active":"2023-07-27T20:33:11.124855+0000","last_peered":"2023-07-27T20:33:11.124855+0000","last_clean":"2023-07-27T20:33:11.124855+0000","last_became_active":"2023-07-27T20:33:00.592164+0000","last_became_peered":"2023-07-27T20:33:00.592164+0000","last_unstale":"2023-07-27T20:33:11.124855+0000","last_undegraded":"2023-07-27T20:33:11.124855+0000","last_fullsized":"2023-07-27T20:33:11.124855+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:33:47.017844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:20.160896+0000","last_change":"2023-07-27T20:33:20.160896+0000","last_active":"2023-07-27T20:33:20.160896+0000","last_peered":"2023-07-27T20:33:20.160896+0000","last_clean":"2023-07-27T20:33:20.160896+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:20.160896+0000","last_undegraded":"2023-07-27T20:33:20.160896+0000","last_fullsized":"2023-07-27T20:33:20.160896+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"40'1","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.126692+0000","last_change":"2023-07-27T20:32:59.586172+0000","last_active":"2023-07-27T20:33:11.126692+0000","last_peered":"2023-07-27T20:33:11.126692+0000","last_clean":"2023-07-27T20:33:11.126692+0000","last_became_active":"2023-07-27T20:32:59.585871+0000","last_became_peered":"2023-07-27T20:32:59.585871+0000","last_unstale":"2023-07-27T20:33:11.126692+0000","last_undegraded":"2023-07-27T20:33:11.126692+0000","last_fullsized":"2023-07-27T20:33:11.126692+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:06:52.792601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.126642+0000","last_change":"2023-07-27T20:33:00.583423+0000","last_active":"2023-07-27T20:33:11.126642+0000","last_peered":"2023-07-27T20:33:11.126642+0000","last_clean":"2023-07-27T20:33:11.126642+0000","last_became_active":"2023-07-27T20:33:00.583146+0000","last_became_peered":"2023-07-27T20:33:00.583146+0000","last_unstale":"2023-07-27T20:33:11.126642+0000","last_undegraded":"2023-07-27T20:33:11.126642+0000","last_fullsized":"2023-07-27T20:33:11.126642+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:19:32.218760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:20.160896+0000","last_change":"2023-07-27T20:33:20.160896+0000","last_active":"2023-07-27T20:33:20.160896+0000","last_peered":"2023-07-27T20:33:20.160896+0000","last_clean":"2023-07-27T20:33:20.160896+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:20.160896+0000","last_undegraded":"2023-07-27T20:33:20.160896+0000","last_fullsized":"2023-07-27T20:33:20.160896+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"40'8","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.124868+0000","last_change":"2023-07-27T20:32:59.583107+0000","last_active":"2023-07-27T20:33:11.124868+0000","last_peered":"2023-07-27T20:33:11.124868+0000","last_clean":"2023-07-27T20:33:11.124868+0000","last_became_active":"2023-07-27T20:32:59.582831+0000","last_became_peered":"2023-07-27T20:32:59.582831+0000","last_unstale":"2023-07-27T20:33:11.124868+0000","last_undegraded":"2023-07-27T20:33:11.124868+0000","last_fullsized":"2023-07-27T20:33:11.124868+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:30:36.909351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.824287+0000","last_change":"2023-07-27T20:33:00.598092+0000","last_active":"2023-07-27T20:33:11.824287+0000","last_peered":"2023-07-27T20:33:11.824287+0000","last_clean":"2023-07-27T20:33:11.824287+0000","last_became_active":"2023-07-27T20:33:00.597585+0000","last_became_peered":"2023-07-27T20:33:00.597585+0000","last_unstale":"2023-07-27T20:33:11.824287+0000","last_undegraded":"2023-07-27T20:33:11.824287+0000","last_fullsized":"2023-07-27T20:33:11.824287+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:07:51.721231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:20.160896+0000","last_change":"2023-07-27T20:33:20.160896+0000","last_active":"2023-07-27T20:33:20.160896+0000","last_peered":"2023-07-27T20:33:20.160896+0000","last_clean":"2023-07-27T20:33:20.160896+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:20.160896+0000","last_undegraded":"2023-07-27T20:33:20.160896+0000","last_fullsized":"2023-07-27T20:33:20.160896+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.824174+0000","last_change":"2023-07-27T20:32:59.583865+0000","last_active":"2023-07-27T20:33:11.824174+0000","last_peered":"2023-07-27T20:33:11.824174+0000","last_clean":"2023-07-27T20:33:11.824174+0000","last_became_active":"2023-07-27T20:32:59.583587+0000","last_became_peered":"2023-07-27T20:32:59.583587+0000","last_unstale":"2023-07-27T20:33:11.824174+0000","last_undegraded":"2023-07-27T20:33:11.824174+0000","last_fullsized":"2023-07-27T20:33:11.824174+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:53:45.222372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.823956+0000","last_change":"2023-07-27T20:33:00.583374+0000","last_active":"2023-07-27T20:33:11.823956+0000","last_peered":"2023-07-27T20:33:11.823956+0000","last_clean":"2023-07-27T20:33:11.823956+0000","last_became_active":"2023-07-27T20:33:00.583064+0000","last_became_peered":"2023-07-27T20:33:00.583064+0000","last_unstale":"2023-07-27T20:33:11.823956+0000","last_undegraded":"2023-07-27T20:33:11.823956+0000","last_fullsized":"2023-07-27T20:33:11.823956+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:19:38.220683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:20.160896+0000","last_change":"2023-07-27T20:33:20.160896+0000","last_active":"2023-07-27T20:33:20.160896+0000","last_peered":"2023-07-27T20:33:20.160896+0000","last_clean":"2023-07-27T20:33:20.160896+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:20.160896+0000","last_undegraded":"2023-07-27T20:33:20.160896+0000","last_fullsized":"2023-07-27T20:33:20.160896+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.824399+0000","last_change":"2023-07-27T20:32:59.581242+0000","last_active":"2023-07-27T20:33:11.824399+0000","last_peered":"2023-07-27T20:33:11.824399+0000","last_clean":"2023-07-27T20:33:11.824399+0000","last_became_active":"2023-07-27T20:32:59.580941+0000","last_became_peered":"2023-07-27T20:32:59.580941+0000","last_unstale":"2023-07-27T20:33:11.824399+0000","last_undegraded":"2023-07-27T20:33:11.824399+0000","last_fullsized":"2023-07-27T20:33:11.824399+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:47:19.275761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.124935+0000","last_change":"2023-07-27T20:33:00.578726+0000","last_active":"2023-07-27T20:33:11.124935+0000","last_peered":"2023-07-27T20:33:11.124935+0000","last_clean":"2023-07-27T20:33:11.124935+0000","last_became_active":"2023-07-27T20:33:00.578439+0000","last_became_peered":"2023-07-27T20:33:00.578439+0000","last_unstale":"2023-07-27T20:33:11.124935+0000","last_undegraded":"2023-07-27T20:33:11.124935+0000","last_fullsized":"2023-07-27T20:33:11.124935+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:48:24.287958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:20.160896+0000","last_change":"2023-07-27T20:33:20.160896+0000","last_active":"2023-07-27T20:33:20.160896+0000","last_peered":"2023-07-27T20:33:20.160896+0000","last_clean":"2023-07-27T20:33:20.160896+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:20.160896+0000","last_undegraded":"2023-07-27T20:33:20.160896+0000","last_fullsized":"2023-07-27T20:33:20.160896+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"40'2","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.824844+0000","last_change":"2023-07-27T20:32:59.581127+0000","last_active":"2023-07-27T20:33:11.824844+0000","last_peered":"2023-07-27T20:33:11.824844+0000","last_clean":"2023-07-27T20:33:11.824844+0000","last_became_active":"2023-07-27T20:32:59.580831+0000","last_became_peered":"2023-07-27T20:32:59.580831+0000","last_unstale":"2023-07-27T20:33:11.824844+0000","last_undegraded":"2023-07-27T20:33:11.824844+0000","last_fullsized":"2023-07-27T20:33:11.824844+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:28:04.951116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.825426+0000","last_change":"2023-07-27T20:33:00.594625+0000","last_active":"2023-07-27T20:33:11.825426+0000","last_peered":"2023-07-27T20:33:11.825426+0000","last_clean":"2023-07-27T20:33:11.825426+0000","last_became_active":"2023-07-27T20:33:00.594342+0000","last_became_peered":"2023-07-27T20:33:00.594342+0000","last_unstale":"2023-07-27T20:33:11.825426+0000","last_undegraded":"2023-07-27T20:33:11.825426+0000","last_fullsized":"2023-07-27T20:33:11.825426+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:59:11.300122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:20.160896+0000","last_change":"2023-07-27T20:33:20.160896+0000","last_active":"2023-07-27T20:33:20.160896+0000","last_peered":"2023-07-27T20:33:20.160896+0000","last_clean":"2023-07-27T20:33:20.160896+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:20.160896+0000","last_undegraded":"2023-07-27T20:33:20.160896+0000","last_fullsized":"2023-07-27T20:33:20.160896+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"43'9","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:15.851594+0000","last_change":"2023-07-27T20:32:59.583956+0000","last_active":"2023-07-27T20:33:15.851594+0000","last_peered":"2023-07-27T20:33:15.851594+0000","last_clean":"2023-07-27T20:33:15.851594+0000","last_became_active":"2023-07-27T20:32:59.583495+0000","last_became_peered":"2023-07-27T20:32:59.583495+0000","last_unstale":"2023-07-27T20:33:15.851594+0000","last_undegraded":"2023-07-27T20:33:15.851594+0000","last_fullsized":"2023-07-27T20:33:15.851594+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:51:34.088092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3261,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.824663+0000","last_change":"2023-07-27T20:33:00.591576+0000","last_active":"2023-07-27T20:33:11.824663+0000","last_peered":"2023-07-27T20:33:11.824663+0000","last_clean":"2023-07-27T20:33:11.824663+0000","last_became_active":"2023-07-27T20:33:00.591241+0000","last_became_peered":"2023-07-27T20:33:00.591241+0000","last_unstale":"2023-07-27T20:33:11.824663+0000","last_undegraded":"2023-07-27T20:33:11.824663+0000","last_fullsized":"2023-07-27T20:33:11.824663+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:33:28.782765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:20.160896+0000","last_change":"2023-07-27T20:33:20.160896+0000","last_active":"2023-07-27T20:33:20.160896+0000","last_peered":"2023-07-27T20:33:20.160896+0000","last_clean":"2023-07-27T20:33:20.160896+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:20.160896+0000","last_undegraded":"2023-07-27T20:33:20.160896+0000","last_fullsized":"2023-07-27T20:33:20.160896+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"40'3","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.824804+0000","last_change":"2023-07-27T20:32:59.579139+0000","last_active":"2023-07-27T20:33:11.824804+0000","last_peered":"2023-07-27T20:33:11.824804+0000","last_clean":"2023-07-27T20:33:11.824804+0000","last_became_active":"2023-07-27T20:32:59.578856+0000","last_became_peered":"2023-07-27T20:32:59.578856+0000","last_unstale":"2023-07-27T20:33:11.824804+0000","last_undegraded":"2023-07-27T20:33:11.824804+0000","last_fullsized":"2023-07-27T20:33:11.824804+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:41:18.753666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.824520+0000","last_change":"2023-07-27T20:33:00.585029+0000","last_active":"2023-07-27T20:33:11.824520+0000","last_peered":"2023-07-27T20:33:11.824520+0000","last_clean":"2023-07-27T20:33:11.824520+0000","last_became_active":"2023-07-27T20:33:00.584714+0000","last_became_peered":"2023-07-27T20:33:00.584714+0000","last_unstale":"2023-07-27T20:33:11.824520+0000","last_undegraded":"2023-07-27T20:33:11.824520+0000","last_fullsized":"2023-07-27T20:33:11.824520+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:48:24.287958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:20.160896+0000","last_change":"2023-07-27T20:33:20.160896+0000","last_active":"2023-07-27T20:33:20.160896+0000","last_peered":"2023-07-27T20:33:20.160896+0000","last_clean":"2023-07-27T20:33:20.160896+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:20.160896+0000","last_undegraded":"2023-07-27T20:33:20.160896+0000","last_fullsized":"2023-07-27T20:33:20.160896+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.125082+0000","last_change":"2023-07-27T20:32:59.577773+0000","last_active":"2023-07-27T20:33:11.125082+0000","last_peered":"2023-07-27T20:33:11.125082+0000","last_clean":"2023-07-27T20:33:11.125082+0000","last_became_active":"2023-07-27T20:32:59.577537+0000","last_became_peered":"2023-07-27T20:32:59.577537+0000","last_unstale":"2023-07-27T20:33:11.125082+0000","last_undegraded":"2023-07-27T20:33:11.125082+0000","last_fullsized":"2023-07-27T20:33:11.125082+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:14:19.696157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.825105+0000","last_change":"2023-07-27T20:33:00.586432+0000","last_active":"2023-07-27T20:33:11.825105+0000","last_peered":"2023-07-27T20:33:11.825105+0000","last_clean":"2023-07-27T20:33:11.825105+0000","last_became_active":"2023-07-27T20:33:00.586115+0000","last_became_peered":"2023-07-27T20:33:00.586115+0000","last_unstale":"2023-07-27T20:33:11.825105+0000","last_undegraded":"2023-07-27T20:33:11.825105+0000","last_fullsized":"2023-07-27T20:33:11.825105+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:30:37.916663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:20.160896+0000","last_change":"2023-07-27T20:33:20.160896+0000","last_active":"2023-07-27T20:33:20.160896+0000","last_peered":"2023-07-27T20:33:20.160896+0000","last_clean":"2023-07-27T20:33:20.160896+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:20.160896+0000","last_undegraded":"2023-07-27T20:33:20.160896+0000","last_fullsized":"2023-07-27T20:33:20.160896+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.127024+0000","last_change":"2023-07-27T20:32:59.580000+0000","last_active":"2023-07-27T20:33:11.127024+0000","last_peered":"2023-07-27T20:33:11.127024+0000","last_clean":"2023-07-27T20:33:11.127024+0000","last_became_active":"2023-07-27T20:32:59.579693+0000","last_became_peered":"2023-07-27T20:32:59.579693+0000","last_unstale":"2023-07-27T20:33:11.127024+0000","last_undegraded":"2023-07-27T20:33:11.127024+0000","last_fullsized":"2023-07-27T20:33:11.127024+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:16:54.253853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.127015+0000","last_change":"2023-07-27T20:33:00.572761+0000","last_active":"2023-07-27T20:33:11.127015+0000","last_peered":"2023-07-27T20:33:11.127015+0000","last_clean":"2023-07-27T20:33:11.127015+0000","last_became_active":"2023-07-27T20:33:00.572373+0000","last_became_peered":"2023-07-27T20:33:00.572373+0000","last_unstale":"2023-07-27T20:33:11.127015+0000","last_undegraded":"2023-07-27T20:33:11.127015+0000","last_fullsized":"2023-07-27T20:33:11.127015+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:02:39.562712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:20.160896+0000","last_change":"2023-07-27T20:33:20.160896+0000","last_active":"2023-07-27T20:33:20.160896+0000","last_peered":"2023-07-27T20:33:20.160896+0000","last_clean":"2023-07-27T20:33:20.160896+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:20.160896+0000","last_undegraded":"2023-07-27T20:33:20.160896+0000","last_fullsized":"2023-07-27T20:33:20.160896+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.124732+0000","last_change":"2023-07-27T20:32:59.577003+0000","last_active":"2023-07-27T20:33:11.124732+0000","last_peered":"2023-07-27T20:33:11.124732+0000","last_clean":"2023-07-27T20:33:11.124732+0000","last_became_active":"2023-07-27T20:32:59.576722+0000","last_became_peered":"2023-07-27T20:32:59.576722+0000","last_unstale":"2023-07-27T20:33:11.124732+0000","last_undegraded":"2023-07-27T20:33:11.124732+0000","last_fullsized":"2023-07-27T20:33:11.124732+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:19:37.213372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.824874+0000","last_change":"2023-07-27T20:33:00.590399+0000","last_active":"2023-07-27T20:33:11.824874+0000","last_peered":"2023-07-27T20:33:11.824874+0000","last_clean":"2023-07-27T20:33:11.824874+0000","last_became_active":"2023-07-27T20:33:00.590134+0000","last_became_peered":"2023-07-27T20:33:00.590134+0000","last_unstale":"2023-07-27T20:33:11.824874+0000","last_undegraded":"2023-07-27T20:33:11.824874+0000","last_fullsized":"2023-07-27T20:33:11.824874+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:32:24.375178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:20.160896+0000","last_change":"2023-07-27T20:33:20.160896+0000","last_active":"2023-07-27T20:33:20.160896+0000","last_peered":"2023-07-27T20:33:20.160896+0000","last_clean":"2023-07-27T20:33:20.160896+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:20.160896+0000","last_undegraded":"2023-07-27T20:33:20.160896+0000","last_fullsized":"2023-07-27T20:33:20.160896+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.127690+0000","last_change":"2023-07-27T20:32:59.588694+0000","last_active":"2023-07-27T20:33:11.127690+0000","last_peered":"2023-07-27T20:33:11.127690+0000","last_clean":"2023-07-27T20:33:11.127690+0000","last_became_active":"2023-07-27T20:32:59.588450+0000","last_became_peered":"2023-07-27T20:32:59.588450+0000","last_unstale":"2023-07-27T20:33:11.127690+0000","last_undegraded":"2023-07-27T20:33:11.127690+0000","last_fullsized":"2023-07-27T20:33:11.127690+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:50:44.917196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.124490+0000","last_change":"2023-07-27T20:33:00.593317+0000","last_active":"2023-07-27T20:33:11.124490+0000","last_peered":"2023-07-27T20:33:11.124490+0000","last_clean":"2023-07-27T20:33:11.124490+0000","last_became_active":"2023-07-27T20:33:00.593040+0000","last_became_peered":"2023-07-27T20:33:00.593040+0000","last_unstale":"2023-07-27T20:33:11.124490+0000","last_undegraded":"2023-07-27T20:33:11.124490+0000","last_fullsized":"2023-07-27T20:33:11.124490+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:47:02.186816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:20.160896+0000","last_change":"2023-07-27T20:33:20.160896+0000","last_active":"2023-07-27T20:33:20.160896+0000","last_peered":"2023-07-27T20:33:20.160896+0000","last_clean":"2023-07-27T20:33:20.160896+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:20.160896+0000","last_undegraded":"2023-07-27T20:33:20.160896+0000","last_fullsized":"2023-07-27T20:33:20.160896+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"40'1","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.127139+0000","last_change":"2023-07-27T20:32:59.584387+0000","last_active":"2023-07-27T20:33:11.127139+0000","last_peered":"2023-07-27T20:33:11.127139+0000","last_clean":"2023-07-27T20:33:11.127139+0000","last_became_active":"2023-07-27T20:32:59.584123+0000","last_became_peered":"2023-07-27T20:32:59.584123+0000","last_unstale":"2023-07-27T20:33:11.127139+0000","last_undegraded":"2023-07-27T20:33:11.127139+0000","last_fullsized":"2023-07-27T20:33:11.127139+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:57:44.960655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.124794+0000","last_change":"2023-07-27T20:33:00.582438+0000","last_active":"2023-07-27T20:33:11.124794+0000","last_peered":"2023-07-27T20:33:11.124794+0000","last_clean":"2023-07-27T20:33:11.124794+0000","last_became_active":"2023-07-27T20:33:00.582148+0000","last_became_peered":"2023-07-27T20:33:00.582148+0000","last_unstale":"2023-07-27T20:33:11.124794+0000","last_undegraded":"2023-07-27T20:33:11.124794+0000","last_fullsized":"2023-07-27T20:33:11.124794+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:41:19.760977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:20.160896+0000","last_change":"2023-07-27T20:33:20.160896+0000","last_active":"2023-07-27T20:33:20.160896+0000","last_peered":"2023-07-27T20:33:20.160896+0000","last_clean":"2023-07-27T20:33:20.160896+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:20.160896+0000","last_undegraded":"2023-07-27T20:33:20.160896+0000","last_fullsized":"2023-07-27T20:33:20.160896+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"40'1","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.824989+0000","last_change":"2023-07-27T20:32:59.580842+0000","last_active":"2023-07-27T20:33:11.824989+0000","last_peered":"2023-07-27T20:33:11.824989+0000","last_clean":"2023-07-27T20:33:11.824989+0000","last_became_active":"2023-07-27T20:32:59.580445+0000","last_became_peered":"2023-07-27T20:32:59.580445+0000","last_unstale":"2023-07-27T20:33:11.824989+0000","last_undegraded":"2023-07-27T20:33:11.824989+0000","last_fullsized":"2023-07-27T20:33:11.824989+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:19:07.620447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.126775+0000","last_change":"2023-07-27T20:33:00.596464+0000","last_active":"2023-07-27T20:33:11.126775+0000","last_peered":"2023-07-27T20:33:11.126775+0000","last_clean":"2023-07-27T20:33:11.126775+0000","last_became_active":"2023-07-27T20:33:00.596200+0000","last_became_peered":"2023-07-27T20:33:00.596200+0000","last_unstale":"2023-07-27T20:33:11.126775+0000","last_undegraded":"2023-07-27T20:33:11.126775+0000","last_fullsized":"2023-07-27T20:33:11.126775+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:40:05.874588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:20.160896+0000","last_change":"2023-07-27T20:33:20.160896+0000","last_active":"2023-07-27T20:33:20.160896+0000","last_peered":"2023-07-27T20:33:20.160896+0000","last_clean":"2023-07-27T20:33:20.160896+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:20.160896+0000","last_undegraded":"2023-07-27T20:33:20.160896+0000","last_fullsized":"2023-07-27T20:33:20.160896+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"40'2","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.824576+0000","last_change":"2023-07-27T20:32:59.583845+0000","last_active":"2023-07-27T20:33:11.824576+0000","last_peered":"2023-07-27T20:33:11.824576+0000","last_clean":"2023-07-27T20:33:11.824576+0000","last_became_active":"2023-07-27T20:32:59.583553+0000","last_became_peered":"2023-07-27T20:32:59.583553+0000","last_unstale":"2023-07-27T20:33:11.824576+0000","last_undegraded":"2023-07-27T20:33:11.824576+0000","last_fullsized":"2023-07-27T20:33:11.824576+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:38:08.915097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.825090+0000","last_change":"2023-07-27T20:33:00.600434+0000","last_active":"2023-07-27T20:33:11.825090+0000","last_peered":"2023-07-27T20:33:11.825090+0000","last_clean":"2023-07-27T20:33:11.825090+0000","last_became_active":"2023-07-27T20:33:00.599887+0000","last_became_peered":"2023-07-27T20:33:00.599887+0000","last_unstale":"2023-07-27T20:33:11.825090+0000","last_undegraded":"2023-07-27T20:33:11.825090+0000","last_fullsized":"2023-07-27T20:33:11.825090+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:01:37.390164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:20.160896+0000","last_change":"2023-07-27T20:33:20.160896+0000","last_active":"2023-07-27T20:33:20.160896+0000","last_peered":"2023-07-27T20:33:20.160896+0000","last_clean":"2023-07-27T20:33:20.160896+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:20.160896+0000","last_undegraded":"2023-07-27T20:33:20.160896+0000","last_fullsized":"2023-07-27T20:33:20.160896+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"40'2","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.825134+0000","last_change":"2023-07-27T20:32:59.584693+0000","last_active":"2023-07-27T20:33:11.825134+0000","last_peered":"2023-07-27T20:33:11.825134+0000","last_clean":"2023-07-27T20:33:11.825134+0000","last_became_active":"2023-07-27T20:32:59.584388+0000","last_became_peered":"2023-07-27T20:32:59.584388+0000","last_unstale":"2023-07-27T20:33:11.825134+0000","last_undegraded":"2023-07-27T20:33:11.825134+0000","last_fullsized":"2023-07-27T20:33:11.825134+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:12:27.107743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.128201+0000","last_change":"2023-07-27T20:33:00.585983+0000","last_active":"2023-07-27T20:33:11.128201+0000","last_peered":"2023-07-27T20:33:11.128201+0000","last_clean":"2023-07-27T20:33:11.128201+0000","last_became_active":"2023-07-27T20:33:00.585714+0000","last_became_peered":"2023-07-27T20:33:00.585714+0000","last_unstale":"2023-07-27T20:33:11.128201+0000","last_undegraded":"2023-07-27T20:33:11.128201+0000","last_fullsized":"2023-07-27T20:33:11.128201+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:25:57.607838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:20.160896+0000","last_change":"2023-07-27T20:33:20.160896+0000","last_active":"2023-07-27T20:33:20.160896+0000","last_peered":"2023-07-27T20:33:20.160896+0000","last_clean":"2023-07-27T20:33:20.160896+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:20.160896+0000","last_undegraded":"2023-07-27T20:33:20.160896+0000","last_fullsized":"2023-07-27T20:33:20.160896+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"40'1","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.127140+0000","last_change":"2023-07-27T20:32:59.578355+0000","last_active":"2023-07-27T20:33:11.127140+0000","last_peered":"2023-07-27T20:33:11.127140+0000","last_clean":"2023-07-27T20:33:11.127140+0000","last_became_active":"2023-07-27T20:32:59.577716+0000","last_became_peered":"2023-07-27T20:32:59.577716+0000","last_unstale":"2023-07-27T20:33:11.127140+0000","last_undegraded":"2023-07-27T20:33:11.127140+0000","last_fullsized":"2023-07-27T20:33:11.127140+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:46:40.755773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.824990+0000","last_change":"2023-07-27T20:33:00.593205+0000","last_active":"2023-07-27T20:33:11.824990+0000","last_peered":"2023-07-27T20:33:11.824990+0000","last_clean":"2023-07-27T20:33:11.824990+0000","last_became_active":"2023-07-27T20:33:00.592912+0000","last_became_peered":"2023-07-27T20:33:00.592912+0000","last_unstale":"2023-07-27T20:33:11.824990+0000","last_undegraded":"2023-07-27T20:33:11.824990+0000","last_fullsized":"2023-07-27T20:33:11.824990+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:09:00.373343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:20.160896+0000","last_change":"2023-07-27T20:33:20.160896+0000","last_active":"2023-07-27T20:33:20.160896+0000","last_peered":"2023-07-27T20:33:20.160896+0000","last_clean":"2023-07-27T20:33:20.160896+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:20.160896+0000","last_undegraded":"2023-07-27T20:33:20.160896+0000","last_fullsized":"2023-07-27T20:33:20.160896+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"40'4","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.824944+0000","last_change":"2023-07-27T20:32:59.584807+0000","last_active":"2023-07-27T20:33:11.824944+0000","last_peered":"2023-07-27T20:33:11.824944+0000","last_clean":"2023-07-27T20:33:11.824944+0000","last_became_active":"2023-07-27T20:32:59.584538+0000","last_became_peered":"2023-07-27T20:32:59.584538+0000","last_unstale":"2023-07-27T20:33:11.824944+0000","last_undegraded":"2023-07-27T20:33:11.824944+0000","last_fullsized":"2023-07-27T20:33:11.824944+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:10:17.579159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.824663+0000","last_change":"2023-07-27T20:33:00.588040+0000","last_active":"2023-07-27T20:33:11.824663+0000","last_peered":"2023-07-27T20:33:11.824663+0000","last_clean":"2023-07-27T20:33:11.824663+0000","last_became_active":"2023-07-27T20:33:00.587701+0000","last_became_peered":"2023-07-27T20:33:00.587701+0000","last_unstale":"2023-07-27T20:33:11.824663+0000","last_undegraded":"2023-07-27T20:33:11.824663+0000","last_fullsized":"2023-07-27T20:33:11.824663+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:03:22.452364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:20.160896+0000","last_change":"2023-07-27T20:33:20.160896+0000","last_active":"2023-07-27T20:33:20.160896+0000","last_peered":"2023-07-27T20:33:20.160896+0000","last_clean":"2023-07-27T20:33:20.160896+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:20.160896+0000","last_undegraded":"2023-07-27T20:33:20.160896+0000","last_fullsized":"2023-07-27T20:33:20.160896+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.126253+0000","last_change":"2023-07-27T20:33:00.592631+0000","last_active":"2023-07-27T20:33:11.126253+0000","last_peered":"2023-07-27T20:33:11.126253+0000","last_clean":"2023-07-27T20:33:11.126253+0000","last_became_active":"2023-07-27T20:33:00.592323+0000","last_became_peered":"2023-07-27T20:33:00.592323+0000","last_unstale":"2023-07-27T20:33:11.126253+0000","last_undegraded":"2023-07-27T20:33:11.126253+0000","last_fullsized":"2023-07-27T20:33:11.126253+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:32:52.810098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.823965+0000","last_change":"2023-07-27T20:33:00.586163+0000","last_active":"2023-07-27T20:33:11.823965+0000","last_peered":"2023-07-27T20:33:11.823965+0000","last_clean":"2023-07-27T20:33:11.823965+0000","last_became_active":"2023-07-27T20:33:00.585656+0000","last_became_peered":"2023-07-27T20:33:00.585656+0000","last_unstale":"2023-07-27T20:33:11.823965+0000","last_undegraded":"2023-07-27T20:33:11.823965+0000","last_fullsized":"2023-07-27T20:33:11.823965+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:41:19.760977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.126558+0000","last_change":"2023-07-27T20:33:00.578692+0000","last_active":"2023-07-27T20:33:11.126558+0000","last_peered":"2023-07-27T20:33:11.126558+0000","last_clean":"2023-07-27T20:33:11.126558+0000","last_became_active":"2023-07-27T20:33:00.578401+0000","last_became_peered":"2023-07-27T20:33:00.578401+0000","last_unstale":"2023-07-27T20:33:11.126558+0000","last_undegraded":"2023-07-27T20:33:11.126558+0000","last_fullsized":"2023-07-27T20:33:11.126558+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:12:09.667517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.825121+0000","last_change":"2023-07-27T20:33:00.595500+0000","last_active":"2023-07-27T20:33:11.825121+0000","last_peered":"2023-07-27T20:33:11.825121+0000","last_clean":"2023-07-27T20:33:11.825121+0000","last_became_active":"2023-07-27T20:33:00.595248+0000","last_became_peered":"2023-07-27T20:33:00.595248+0000","last_unstale":"2023-07-27T20:33:11.825121+0000","last_undegraded":"2023-07-27T20:33:11.825121+0000","last_fullsized":"2023-07-27T20:33:11.825121+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:28:40.771424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.127955+0000","last_change":"2023-07-27T20:33:00.594896+0000","last_active":"2023-07-27T20:33:11.127955+0000","last_peered":"2023-07-27T20:33:11.127955+0000","last_clean":"2023-07-27T20:33:11.127955+0000","last_became_active":"2023-07-27T20:33:00.594415+0000","last_became_peered":"2023-07-27T20:33:00.594415+0000","last_unstale":"2023-07-27T20:33:11.127955+0000","last_undegraded":"2023-07-27T20:33:11.127955+0000","last_fullsized":"2023-07-27T20:33:11.127955+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:24:02.222524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.126788+0000","last_change":"2023-07-27T20:33:00.582313+0000","last_active":"2023-07-27T20:33:11.126788+0000","last_peered":"2023-07-27T20:33:11.126788+0000","last_clean":"2023-07-27T20:33:11.126788+0000","last_became_active":"2023-07-27T20:33:00.582037+0000","last_became_peered":"2023-07-27T20:33:00.582037+0000","last_unstale":"2023-07-27T20:33:11.126788+0000","last_undegraded":"2023-07-27T20:33:11.126788+0000","last_fullsized":"2023-07-27T20:33:11.126788+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:42:17.605562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.126606+0000","last_change":"2023-07-27T20:33:00.592982+0000","last_active":"2023-07-27T20:33:11.126606+0000","last_peered":"2023-07-27T20:33:11.126606+0000","last_clean":"2023-07-27T20:33:11.126606+0000","last_became_active":"2023-07-27T20:33:00.592652+0000","last_became_peered":"2023-07-27T20:33:00.592652+0000","last_unstale":"2023-07-27T20:33:11.126606+0000","last_undegraded":"2023-07-27T20:33:11.126606+0000","last_fullsized":"2023-07-27T20:33:11.126606+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:06:18.417640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.825488+0000","last_change":"2023-07-27T20:33:00.596364+0000","last_active":"2023-07-27T20:33:11.825488+0000","last_peered":"2023-07-27T20:33:11.825488+0000","last_clean":"2023-07-27T20:33:11.825488+0000","last_became_active":"2023-07-27T20:33:00.595818+0000","last_became_peered":"2023-07-27T20:33:00.595818+0000","last_unstale":"2023-07-27T20:33:11.825488+0000","last_undegraded":"2023-07-27T20:33:11.825488+0000","last_fullsized":"2023-07-27T20:33:11.825488+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:43:11.324553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.825176+0000","last_change":"2023-07-27T20:33:00.587648+0000","last_active":"2023-07-27T20:33:11.825176+0000","last_peered":"2023-07-27T20:33:11.825176+0000","last_clean":"2023-07-27T20:33:11.825176+0000","last_became_active":"2023-07-27T20:33:00.587312+0000","last_became_peered":"2023-07-27T20:33:00.587312+0000","last_unstale":"2023-07-27T20:33:11.825176+0000","last_undegraded":"2023-07-27T20:33:11.825176+0000","last_fullsized":"2023-07-27T20:33:11.825176+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:46:00.785923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.824927+0000","last_change":"2023-07-27T20:33:00.594997+0000","last_active":"2023-07-27T20:33:11.824927+0000","last_peered":"2023-07-27T20:33:11.824927+0000","last_clean":"2023-07-27T20:33:11.824927+0000","last_became_active":"2023-07-27T20:33:00.594705+0000","last_became_peered":"2023-07-27T20:33:00.594705+0000","last_unstale":"2023-07-27T20:33:11.824927+0000","last_undegraded":"2023-07-27T20:33:11.824927+0000","last_fullsized":"2023-07-27T20:33:11.824927+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:11:00.474377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.124529+0000","last_change":"2023-07-27T20:33:00.594352+0000","last_active":"2023-07-27T20:33:11.124529+0000","last_peered":"2023-07-27T20:33:11.124529+0000","last_clean":"2023-07-27T20:33:11.124529+0000","last_became_active":"2023-07-27T20:33:00.593480+0000","last_became_peered":"2023-07-27T20:33:00.593480+0000","last_unstale":"2023-07-27T20:33:11.124529+0000","last_undegraded":"2023-07-27T20:33:11.124529+0000","last_fullsized":"2023-07-27T20:33:11.124529+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:58:41.355680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.824765+0000","last_change":"2023-07-27T20:33:00.588688+0000","last_active":"2023-07-27T20:33:11.824765+0000","last_peered":"2023-07-27T20:33:11.824765+0000","last_clean":"2023-07-27T20:33:11.824765+0000","last_became_active":"2023-07-27T20:33:00.588417+0000","last_became_peered":"2023-07-27T20:33:00.588417+0000","last_unstale":"2023-07-27T20:33:11.824765+0000","last_undegraded":"2023-07-27T20:33:11.824765+0000","last_fullsized":"2023-07-27T20:33:11.824765+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:53:21.510362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.129939+0000","last_change":"2023-07-27T20:33:11.129939+0000","last_active":"2023-07-27T20:33:11.129939+0000","last_peered":"2023-07-27T20:33:11.129939+0000","last_clean":"2023-07-27T20:33:11.129939+0000","last_became_active":"2023-07-27T20:33:11.129716+0000","last_became_peered":"2023-07-27T20:33:11.129716+0000","last_unstale":"2023-07-27T20:33:11.129939+0000","last_undegraded":"2023-07-27T20:33:11.129939+0000","last_fullsized":"2023-07-27T20:33:11.129939+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:20:09.271606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.825354+0000","last_change":"2023-07-27T20:33:00.595816+0000","last_active":"2023-07-27T20:33:11.825354+0000","last_peered":"2023-07-27T20:33:11.825354+0000","last_clean":"2023-07-27T20:33:11.825354+0000","last_became_active":"2023-07-27T20:33:00.595429+0000","last_became_peered":"2023-07-27T20:33:00.595429+0000","last_unstale":"2023-07-27T20:33:11.825354+0000","last_undegraded":"2023-07-27T20:33:11.825354+0000","last_fullsized":"2023-07-27T20:33:11.825354+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:40:46.513345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.126650+0000","last_change":"2023-07-27T20:33:00.572976+0000","last_active":"2023-07-27T20:33:11.126650+0000","last_peered":"2023-07-27T20:33:11.126650+0000","last_clean":"2023-07-27T20:33:11.126650+0000","last_became_active":"2023-07-27T20:33:00.572377+0000","last_became_peered":"2023-07-27T20:33:00.572377+0000","last_unstale":"2023-07-27T20:33:11.126650+0000","last_undegraded":"2023-07-27T20:33:11.126650+0000","last_fullsized":"2023-07-27T20:33:11.126650+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:58:59.626655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.127287+0000","last_change":"2023-07-27T20:33:00.582399+0000","last_active":"2023-07-27T20:33:11.127287+0000","last_peered":"2023-07-27T20:33:11.127287+0000","last_clean":"2023-07-27T20:33:11.127287+0000","last_became_active":"2023-07-27T20:33:00.582064+0000","last_became_peered":"2023-07-27T20:33:00.582064+0000","last_unstale":"2023-07-27T20:33:11.127287+0000","last_undegraded":"2023-07-27T20:33:11.127287+0000","last_fullsized":"2023-07-27T20:33:11.127287+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:23:33.860400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.824792+0000","last_change":"2023-07-27T20:33:00.594429+0000","last_active":"2023-07-27T20:33:11.824792+0000","last_peered":"2023-07-27T20:33:11.824792+0000","last_clean":"2023-07-27T20:33:11.824792+0000","last_became_active":"2023-07-27T20:33:00.593854+0000","last_became_peered":"2023-07-27T20:33:00.593854+0000","last_unstale":"2023-07-27T20:33:11.824792+0000","last_undegraded":"2023-07-27T20:33:11.824792+0000","last_fullsized":"2023-07-27T20:33:11.824792+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:13:28.449380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.824300+0000","last_change":"2023-07-27T20:33:00.585997+0000","last_active":"2023-07-27T20:33:11.824300+0000","last_peered":"2023-07-27T20:33:11.824300+0000","last_clean":"2023-07-27T20:33:11.824300+0000","last_became_active":"2023-07-27T20:33:00.585348+0000","last_became_peered":"2023-07-27T20:33:00.585348+0000","last_unstale":"2023-07-27T20:33:11.824300+0000","last_undegraded":"2023-07-27T20:33:11.824300+0000","last_fullsized":"2023-07-27T20:33:11.824300+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:30:37.916663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.124424+0000","last_change":"2023-07-27T20:33:00.585154+0000","last_active":"2023-07-27T20:33:11.124424+0000","last_peered":"2023-07-27T20:33:11.124424+0000","last_clean":"2023-07-27T20:33:11.124424+0000","last_became_active":"2023-07-27T20:33:00.584912+0000","last_became_peered":"2023-07-27T20:33:00.584912+0000","last_unstale":"2023-07-27T20:33:11.124424+0000","last_undegraded":"2023-07-27T20:33:11.124424+0000","last_fullsized":"2023-07-27T20:33:11.124424+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:53:21.302890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.126474+0000","last_change":"2023-07-27T20:33:00.592723+0000","last_active":"2023-07-27T20:33:11.126474+0000","last_peered":"2023-07-27T20:33:11.126474+0000","last_clean":"2023-07-27T20:33:11.126474+0000","last_became_active":"2023-07-27T20:33:00.592222+0000","last_became_peered":"2023-07-27T20:33:00.592222+0000","last_unstale":"2023-07-27T20:33:11.126474+0000","last_undegraded":"2023-07-27T20:33:11.126474+0000","last_fullsized":"2023-07-27T20:33:11.126474+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:51:58.381974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.128316+0000","last_change":"2023-07-27T20:33:00.594729+0000","last_active":"2023-07-27T20:33:11.128316+0000","last_peered":"2023-07-27T20:33:11.128316+0000","last_clean":"2023-07-27T20:33:11.128316+0000","last_became_active":"2023-07-27T20:33:00.594045+0000","last_became_peered":"2023-07-27T20:33:00.594045+0000","last_unstale":"2023-07-27T20:33:11.128316+0000","last_undegraded":"2023-07-27T20:33:11.128316+0000","last_fullsized":"2023-07-27T20:33:11.128316+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:17:27.802357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.124528+0000","last_change":"2023-07-27T20:33:00.584457+0000","last_active":"2023-07-27T20:33:11.124528+0000","last_peered":"2023-07-27T20:33:11.124528+0000","last_clean":"2023-07-27T20:33:11.124528+0000","last_became_active":"2023-07-27T20:33:00.584193+0000","last_became_peered":"2023-07-27T20:33:00.584193+0000","last_unstale":"2023-07-27T20:33:11.124528+0000","last_undegraded":"2023-07-27T20:33:11.124528+0000","last_fullsized":"2023-07-27T20:33:11.124528+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:00:55.760264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.124812+0000","last_change":"2023-07-27T20:33:00.594067+0000","last_active":"2023-07-27T20:33:11.124812+0000","last_peered":"2023-07-27T20:33:11.124812+0000","last_clean":"2023-07-27T20:33:11.124812+0000","last_became_active":"2023-07-27T20:33:00.593772+0000","last_became_peered":"2023-07-27T20:33:00.593772+0000","last_unstale":"2023-07-27T20:33:11.124812+0000","last_undegraded":"2023-07-27T20:33:11.124812+0000","last_fullsized":"2023-07-27T20:33:11.124812+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:53:46.229684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.124690+0000","last_change":"2023-07-27T20:33:00.583733+0000","last_active":"2023-07-27T20:33:11.124690+0000","last_peered":"2023-07-27T20:33:11.124690+0000","last_clean":"2023-07-27T20:33:11.124690+0000","last_became_active":"2023-07-27T20:33:00.583442+0000","last_became_peered":"2023-07-27T20:33:00.583442+0000","last_unstale":"2023-07-27T20:33:11.124690+0000","last_undegraded":"2023-07-27T20:33:11.124690+0000","last_fullsized":"2023-07-27T20:33:11.124690+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:33:28.782765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.124366+0000","last_change":"2023-07-27T20:33:00.599242+0000","last_active":"2023-07-27T20:33:11.124366+0000","last_peered":"2023-07-27T20:33:11.124366+0000","last_clean":"2023-07-27T20:33:11.124366+0000","last_became_active":"2023-07-27T20:33:00.598810+0000","last_became_peered":"2023-07-27T20:33:00.598810+0000","last_unstale":"2023-07-27T20:33:11.124366+0000","last_undegraded":"2023-07-27T20:33:11.124366+0000","last_fullsized":"2023-07-27T20:33:11.124366+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:56:25.520593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.824309+0000","last_change":"2023-07-27T20:33:00.592227+0000","last_active":"2023-07-27T20:33:11.824309+0000","last_peered":"2023-07-27T20:33:11.824309+0000","last_clean":"2023-07-27T20:33:11.824309+0000","last_became_active":"2023-07-27T20:33:00.591718+0000","last_became_peered":"2023-07-27T20:33:00.591718+0000","last_unstale":"2023-07-27T20:33:11.824309+0000","last_undegraded":"2023-07-27T20:33:11.824309+0000","last_fullsized":"2023-07-27T20:33:11.824309+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:53:21.302890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.824334+0000","last_change":"2023-07-27T20:33:00.588002+0000","last_active":"2023-07-27T20:33:11.824334+0000","last_peered":"2023-07-27T20:33:11.824334+0000","last_clean":"2023-07-27T20:33:11.824334+0000","last_became_active":"2023-07-27T20:33:00.587552+0000","last_became_peered":"2023-07-27T20:33:00.587552+0000","last_unstale":"2023-07-27T20:33:11.824334+0000","last_undegraded":"2023-07-27T20:33:11.824334+0000","last_fullsized":"2023-07-27T20:33:11.824334+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:00:55.760264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.127837+0000","last_change":"2023-07-27T20:33:00.590369+0000","last_active":"2023-07-27T20:33:11.127837+0000","last_peered":"2023-07-27T20:33:11.127837+0000","last_clean":"2023-07-27T20:33:11.127837+0000","last_became_active":"2023-07-27T20:33:00.590016+0000","last_became_peered":"2023-07-27T20:33:00.590016+0000","last_unstale":"2023-07-27T20:33:11.127837+0000","last_undegraded":"2023-07-27T20:33:11.127837+0000","last_fullsized":"2023-07-27T20:33:11.127837+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:58:55.968684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.124955+0000","last_change":"2023-07-27T20:33:00.597501+0000","last_active":"2023-07-27T20:33:11.124955+0000","last_peered":"2023-07-27T20:33:11.124955+0000","last_clean":"2023-07-27T20:33:11.124955+0000","last_became_active":"2023-07-27T20:33:00.594645+0000","last_became_peered":"2023-07-27T20:33:00.594645+0000","last_unstale":"2023-07-27T20:33:11.124955+0000","last_undegraded":"2023-07-27T20:33:11.124955+0000","last_fullsized":"2023-07-27T20:33:11.124955+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:02:44.334677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.126744+0000","last_change":"2023-07-27T20:33:00.581650+0000","last_active":"2023-07-27T20:33:11.126744+0000","last_peered":"2023-07-27T20:33:11.126744+0000","last_clean":"2023-07-27T20:33:11.126744+0000","last_became_active":"2023-07-27T20:33:00.581308+0000","last_became_peered":"2023-07-27T20:33:00.581308+0000","last_unstale":"2023-07-27T20:33:11.126744+0000","last_undegraded":"2023-07-27T20:33:11.126744+0000","last_fullsized":"2023-07-27T20:33:11.126744+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:20:09.376124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.131899+0000","last_change":"2023-07-27T20:33:11.131899+0000","last_active":"2023-07-27T20:33:11.131899+0000","last_peered":"2023-07-27T20:33:11.131899+0000","last_clean":"2023-07-27T20:33:11.131899+0000","last_became_active":"2023-07-27T20:33:11.131474+0000","last_became_peered":"2023-07-27T20:33:11.131474+0000","last_unstale":"2023-07-27T20:33:11.131899+0000","last_undegraded":"2023-07-27T20:33:11.131899+0000","last_fullsized":"2023-07-27T20:33:11.131899+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:10:03.531475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:33:21.169302+0000","last_change":"2023-07-27T20:33:21.169302+0000","last_active":"2023-07-27T20:33:21.169302+0000","last_peered":"2023-07-27T20:33:21.169302+0000","last_clean":"2023-07-27T20:33:21.169302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:33:21.169302+0000","last_undegraded":"2023-07-27T20:33:21.169302+0000","last_fullsized":"2023-07-27T20:33:21.169302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-27T20:33:11.825067+0000","last_change":"2023-07-27T20:33:00.583515+0000","last_active":"2023-07-27T20:33:11.825067+0000","last_peered":"2023-07-27T20:33:11.825067+0000","last_clean":"2023-07-27T20:33:11.825067+0000","last_became_active":"2023-07-27T20:33:00.583261+0000","last_became_peered":"2023-07-27T20:33:00.583261+0000","last_unstale":"2023-07-27T20:33:11.825067+0000","last_undegraded":"2023-07-27T20:33:11.825067+0000","last_fullsized":"2023-07-27T20:33:11.825067+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:33:47.017844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":4059,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1097728,"data_stored":816658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":3.5609999999999999,"5min":3.5609999999999999,"15min":3.5609999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.45000000000000001}]},{"osd":1,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":3.927,"5min":3.927,"15min":3.927},"last":0.505}]},{"osd":2,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.1589999999999998,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":0.443},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":0.60999999999999999}]},{"osd":3,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.4239999999999999,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":3.1080000000000001,"5min":3.1080000000000001,"15min":3.1080000000000001},"last":0.57099999999999995}]},{"osd":4,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.2730000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.58499999999999996}]},{"osd":5,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":6.1619999999999999,"5min":6.1619999999999999,"15min":6.1619999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":6.2729999999999997,"5min":6.2729999999999997,"15min":6.2729999999999997},"last":0.38100000000000001}]},{"osd":6,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":3.5289999999999999,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":0.42699999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":507904,"data_stored":226872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.56299999999999994}]},{"osd":1,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.68200000000000005}]},{"osd":2,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.64800000000000002}]},{"osd":3,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":0.66400000000000003}]},{"osd":4,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.754},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.70299999999999996}]},{"osd":7,"last update":"Thu Jul 27 20:32:18 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.63500000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":503808,"data_stored":226270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:33:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.28399999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.53600000000000003,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.47499999999999998,"15min":0.47999999999999998},"min":{"1min":0.32100000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63500000000000001,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.42199999999999999}]},{"osd":2,"last update":"Thu Jul 27 20:33:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.438,"15min":0.435},"min":{"1min":0.34300000000000003,"5min":0.308,"15min":0.308},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.62,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.52900000000000003}]},{"osd":3,"last update":"Thu Jul 27 20:33:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53000000000000003,"15min":0.53100000000000003},"min":{"1min":0.45100000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.501,"15min":0.503},"min":{"1min":0.376,"5min":0.31,"15min":0.31},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.379}]},{"osd":4,"last update":"Thu Jul 27 20:33:15 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.73899999999999999,"15min":0.747},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.90700000000000003,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.73699999999999999,"15min":0.73199999999999998},"min":{"1min":0.59799999999999998,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.751}]},{"osd":5,"last update":"Thu Jul 27 20:33:15 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.72499999999999998,"15min":0.73299999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.91800000000000004,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.621},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.751,"15min":0.753},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.78900000000000003}]},{"osd":6,"last update":"Thu Jul 27 20:33:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.78900000000000003,"15min":0.79900000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.88600000000000001,"5min":1.347,"15min":1.347},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.81699999999999995,"15min":0.82499999999999996},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.0349999999999999,"5min":1.409,"15min":1.409},"last":0.69899999999999995}]},{"osd":7,"last update":"Thu Jul 27 20:33:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.018,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.79600000000000004,"15min":0.80600000000000005},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.94399999999999995,"5min":1.069,"15min":1.069},"last":0.67700000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28096,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343744,"statfs":{"total":96636764160,"available":96607993856,"internally_reserved":0,"allocated":1097728,"data_stored":816602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 20:33:16 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.38500000000000001,"15min":0.39000000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.46600000000000003,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.46400000000000002,"15min":0.46500000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.56399999999999995,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.443}]},{"osd":2,"last update":"Thu Jul 27 20:33:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.48799999999999999,"15min":0.49199999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.55600000000000005,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.45200000000000001,"15min":0.45600000000000002},"min":{"1min":0.34999999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.56100000000000005,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.371}]},{"osd":3,"last update":"Thu Jul 27 20:33:16 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.46700000000000003,"15min":0.47099999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.53900000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.54000000000000004,"15min":0.54500000000000004},"min":{"1min":0.40200000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.63500000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.40699999999999997}]},{"osd":4,"last update":"Thu Jul 27 20:33:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71399999999999997,"15min":0.71499999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.046,"5min":1.069,"15min":1.069},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.73199999999999998,"15min":0.73699999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.88300000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.48899999999999999}]},{"osd":5,"last update":"Thu Jul 27 20:33:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.745,"15min":0.75},"min":{"1min":0.55500000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.84699999999999998,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.752,"15min":0.75600000000000001},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.997,"5min":1.196,"15min":1.196},"last":0.57299999999999995}]},{"osd":6,"last update":"Thu Jul 27 20:33:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.73599999999999999,"15min":0.74099999999999999},"min":{"1min":0.56799999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.014,"5min":1.05,"15min":1.05},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.77600000000000002,"15min":0.78300000000000003},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.95199999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.624}]},{"osd":7,"last update":"Thu Jul 27 20:33:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76400000000000001,"15min":0.77300000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.88100000000000001,"5min":1.117,"15min":1.117},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.92600000000000005,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.61499999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":516096,"data_stored":229483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:33:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.47199999999999998,"15min":0.48599999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57499999999999996,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.372},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.68500000000000005,"15min":0.72999999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.52900000000000003,"5min":3.2999999999999998,"15min":3.2999999999999998},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Jul 27 20:33:17 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.59999999999999998,"15min":0.628},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.58599999999999997,"5min":3.0600000000000001,"15min":3.0600000000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.65700000000000003,"15min":0.68500000000000005},"min":{"1min":0.34200000000000003,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.69599999999999995,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Jul 27 20:33:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.99099999999999999,"15min":1.0780000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.66200000000000003,"5min":9.2200000000000006,"15min":9.2200000000000006},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.58899999999999997,"15min":0.60099999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.64100000000000001,"5min":1.552,"15min":1.552},"last":0.42099999999999999}]},{"osd":4,"last update":"Thu Jul 27 20:33:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.90900000000000003,"15min":0.94199999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.93200000000000005,"5min":4.2930000000000001,"15min":4.2930000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.77200000000000002,"15min":0.78400000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.91000000000000003,"5min":1.24,"15min":1.24},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Jul 27 20:33:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.76200000000000001,"15min":0.77200000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.95099999999999996,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.89700000000000002,"15min":0.92400000000000004},"min":{"1min":0.505,"5min":0.5,"15min":0.5},"max":{"1min":1.222,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.53800000000000003}]},{"osd":6,"last update":"Thu Jul 27 20:33:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.92600000000000005,"15min":0.95799999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2609999999999999,"5min":3.3999999999999999,"15min":3.3999999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.753,"5min":0.97399999999999998,"15min":1.0109999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.004,"5min":3.4990000000000001,"15min":3.4990000000000001},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jul 27 20:33:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.83499999999999996,"15min":0.85299999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0029999999999999,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.622},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.89100000000000001,"15min":0.90700000000000003},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2929999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.64400000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":512000,"data_stored":226838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:33:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.46200000000000002,"15min":0.47499999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.65100000000000002,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.68400000000000005,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":0.437}]},{"osd":1,"last update":"Thu Jul 27 20:33:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.495,"15min":0.50600000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.58299999999999996,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.55500000000000005,"15min":0.57599999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.70299999999999996,"5min":1.788,"15min":1.788},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jul 27 20:33:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.58099999999999996,"15min":0.59899999999999998},"min":{"1min":0.37,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76200000000000001,"5min":2.117,"15min":2.117},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.622,"15min":0.64100000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.73499999999999999,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.56899999999999995}]},{"osd":4,"last update":"Thu Jul 27 20:33:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.71899999999999997,"15min":0.72199999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.80600000000000005,"15min":0.81999999999999995},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97599999999999998,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.55200000000000005}]},{"osd":5,"last update":"Thu Jul 27 20:33:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72999999999999998,"15min":0.73499999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95799999999999996,"5min":1.125,"15min":1.125},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.81699999999999995,"15min":0.83599999999999997},"min":{"1min":0.54600000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.89700000000000002,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.66500000000000004}]},{"osd":6,"last update":"Thu Jul 27 20:33:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.80400000000000005,"15min":0.81899999999999995},"min":{"1min":0.501,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93300000000000005,"5min":1.758,"15min":1.758},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.82699999999999996,"15min":0.84099999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.997,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.622}]},{"osd":7,"last update":"Thu Jul 27 20:33:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.83899999999999997,"15min":0.85599999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.95099999999999996,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.75800000000000001,"15min":0.76700000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.016,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.71999999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":512000,"data_stored":229461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:33:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.70499999999999996,"15min":0.70099999999999996},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.89200000000000002,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.71199999999999997,"15min":0.71399999999999997},"min":{"1min":0.53600000000000003,"5min":0.5,"15min":0.5},"max":{"1min":0.93200000000000005,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.81699999999999995}]},{"osd":1,"last update":"Thu Jul 27 20:33:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.70299999999999996,"15min":0.70099999999999996},"min":{"1min":0.46700000000000003,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89900000000000002,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.74199999999999999,"15min":0.73999999999999999},"min":{"1min":0.57099999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.88300000000000001,"5min":1.002,"15min":1.002},"last":0.83699999999999997}]},{"osd":2,"last update":"Thu Jul 27 20:33:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.67700000000000005,"15min":0.66900000000000004},"min":{"1min":0.57699999999999996,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.879,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.57899999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.77900000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.68400000000000005}]},{"osd":3,"last update":"Thu Jul 27 20:33:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.748,"15min":0.75600000000000001},"min":{"1min":0.51700000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.81000000000000005,"5min":1.645,"15min":1.645},"last":0.748},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.75700000000000001,"15min":0.76300000000000001},"min":{"1min":0.57799999999999996,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.90900000000000003,"5min":1.708,"15min":1.708},"last":0.622}]},{"osd":5,"last update":"Thu Jul 27 20:33:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40100000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.872,"5min":1.113,"15min":1.113},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.68899999999999995,"15min":0.69499999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.86499999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.64300000000000002}]},{"osd":6,"last update":"Thu Jul 27 20:33:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.70599999999999996,"15min":0.70699999999999996},"min":{"1min":0.48099999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.92300000000000004,"5min":1.127,"15min":1.127},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.746,"15min":0.74399999999999999},"min":{"1min":0.48399999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94499999999999995,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.873}]},{"osd":7,"last update":"Thu Jul 27 20:33:19 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.77500000000000002,"15min":0.78000000000000003},"min":{"1min":0.52300000000000002,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.91700000000000004,"5min":1.198,"15min":1.198},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.81599999999999995,"15min":0.81799999999999995},"min":{"1min":0.63100000000000001,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":0.94699999999999995,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.80000000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":503808,"data_stored":226270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.67300000000000004}]},{"osd":1,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.5},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.56000000000000005}]},{"osd":2,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.54100000000000004}]},{"osd":3,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.65300000000000002}]},{"osd":4,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.59199999999999997}]},{"osd":6,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.61399999999999999}]},{"osd":7,"last update":"Thu Jul 27 20:32:17 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.754},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.76700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T20:33:26.572 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T20:33:26.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.808+0000 7f5b2afff700 1 Processor -- start 2023-07-27T20:33:26.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.808+0000 7f5b2afff700 1 -- start start 2023-07-27T20:33:26.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.809+0000 7f5b2afff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5b240bfd90 0x7f5b240aab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:26.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.809+0000 7f5b2afff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b24155600 con 0x7f5b240a83a0 2023-07-27T20:33:26.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.809+0000 7f5b2afff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b24155320 con 0x7f5b2413b2c0 2023-07-27T20:33:26.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.809+0000 7f5b2afff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b240a9620 con 0x7f5b240bfd90 2023-07-27T20:33:26.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.810+0000 7f5b23fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5b240bfd90 0x7f5b240aab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:26.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.810+0000 7f5b2959c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5b240a83a0 0x7f5b240a8810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43458/0 (socket says 172.21.15.72:43458) 2023-07-27T20:33:26.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.810+0000 7f5b2959c700 1 -- 172.21.15.72:0/1106313402 learned_addr learned my addr 172.21.15.72:0/1106313402 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:26.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.810+0000 7f5b237fe700 1 -- 172.21.15.72:0/1106313402 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2619388959 0 0) 0x7f5b24155600 con 0x7f5b240a83a0 2023-07-27T20:33:26.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.810+0000 7f5b23fff700 1 -- 172.21.15.72:0/1106313402 >> v1:172.21.15.173:6789/0 conn(0x7f5b2413b2c0 legacy=0x7f5b240aa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:26.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.810+0000 7f5b23fff700 1 -- 172.21.15.72:0/1106313402 >> v1:172.21.15.72:6789/0 conn(0x7f5b240a83a0 legacy=0x7f5b240a8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:26.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.810+0000 7f5b23fff700 1 -- 172.21.15.72:0/1106313402 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b24151e40 con 0x7f5b240bfd90 2023-07-27T20:33:26.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.810+0000 7f5b23fff700 1 --2- 172.21.15.72:0/1106313402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b240bfd90 0x7f5b240aab30 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f5b10009840 tx=0x7f5b10009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f28f1ce4d92b5423 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:26.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.810+0000 7f5b237fe700 1 -- 172.21.15.72:0/1106313402 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b10011830 con 0x7f5b240bfd90 2023-07-27T20:33:26.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.810+0000 7f5b237fe700 1 -- 172.21.15.72:0/1106313402 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b10011990 con 0x7f5b240bfd90 2023-07-27T20:33:26.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.810+0000 7f5b237fe700 1 -- 172.21.15.72:0/1106313402 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b10011d20 con 0x7f5b240bfd90 2023-07-27T20:33:26.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.811+0000 7f5b2afff700 1 -- 172.21.15.72:0/1106313402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b240bfd90 msgr2=0x7f5b240aab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:26.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.811+0000 7f5b2afff700 1 --2- 172.21.15.72:0/1106313402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b240bfd90 0x7f5b240aab30 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f5b10009840 tx=0x7f5b10009b50 comp rx=0 tx=0).stop 2023-07-27T20:33:26.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.811+0000 7f5b2afff700 1 -- 172.21.15.72:0/1106313402 shutdown_connections 2023-07-27T20:33:26.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.811+0000 7f5b2afff700 1 --2- 172.21.15.72:0/1106313402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b240bfd90 0x7f5b240aab30 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:26.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.811+0000 7f5b2afff700 1 -- 172.21.15.72:0/1106313402 >> 172.21.15.72:0/1106313402 conn(0x7f5b2406a190 msgr2=0x7f5b2406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:26.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.811+0000 7f5b2afff700 1 -- 172.21.15.72:0/1106313402 shutdown_connections 2023-07-27T20:33:26.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.811+0000 7f5b2afff700 1 -- 172.21.15.72:0/1106313402 wait complete. 2023-07-27T20:33:26.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.813+0000 7f5b2afff700 1 Processor -- start 2023-07-27T20:33:26.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.813+0000 7f5b2afff700 1 -- start start 2023-07-27T20:33:26.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.814+0000 7f5b2afff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5b240a83a0 0x7f5b2406d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:26.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.814+0000 7f5b2afff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b240bfd90 0x7f5b2414dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:26.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.814+0000 7f5b2afff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b2413b2c0 0x7f5b2414e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:26.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.814+0000 7f5b2afff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b240a8f20 con 0x7f5b2413b2c0 2023-07-27T20:33:26.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.814+0000 7f5b2afff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b241df1e0 con 0x7f5b240bfd90 2023-07-27T20:33:26.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.814+0000 7f5b2afff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b241de5d0 con 0x7f5b240a83a0 2023-07-27T20:33:26.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.814+0000 7f5b2959c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b2413b2c0 0x7f5b2414e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:26.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.814+0000 7f5b2959c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b2413b2c0 0x7f5b2414e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39764/0 (socket says 172.21.15.72:39764) 2023-07-27T20:33:26.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.814+0000 7f5b2959c700 1 -- 172.21.15.72:0/2695596158 learned_addr learned my addr 172.21.15.72:0/2695596158 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:26.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.815+0000 7f5b28d9b700 1 --2- 172.21.15.72:0/2695596158 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5b240a83a0 0x7f5b2406d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:26.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.815+0000 7f5b23fff700 1 --2- 172.21.15.72:0/2695596158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b240bfd90 0x7f5b2414dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:26.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.815+0000 7f5b2959c700 1 -- 172.21.15.72:0/2695596158 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5b240a83a0 msgr2=0x7f5b2406d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:26.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.815+0000 7f5b2959c700 1 --2- 172.21.15.72:0/2695596158 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5b240a83a0 0x7f5b2406d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:26.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.815+0000 7f5b2959c700 1 -- 172.21.15.72:0/2695596158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b240bfd90 msgr2=0x7f5b2414dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:26.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.815+0000 7f5b2959c700 1 --2- 172.21.15.72:0/2695596158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b240bfd90 0x7f5b2414dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:26.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.815+0000 7f5b2959c700 1 -- 172.21.15.72:0/2695596158 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b100094a0 con 0x7f5b2413b2c0 2023-07-27T20:33:26.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.815+0000 7f5b2959c700 1 --2- 172.21.15.72:0/2695596158 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b2413b2c0 0x7f5b2414e150 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00cca0 tx=0x7f5b1c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:26.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.815+0000 7f5b217fa700 1 -- 172.21.15.72:0/2695596158 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c00cea0 con 0x7f5b2413b2c0 2023-07-27T20:33:26.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.815+0000 7f5b217fa700 1 -- 172.21.15.72:0/2695596158 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1c00ade0 con 0x7f5b2413b2c0 2023-07-27T20:33:26.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.815+0000 7f5b2afff700 1 -- 172.21.15.72:0/2695596158 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b241de8b0 con 0x7f5b2413b2c0 2023-07-27T20:33:26.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.815+0000 7f5b217fa700 1 -- 172.21.15.72:0/2695596158 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c007310 con 0x7f5b2413b2c0 2023-07-27T20:33:26.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.815+0000 7f5b2afff700 1 -- 172.21.15.72:0/2695596158 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b241dee70 con 0x7f5b2413b2c0 2023-07-27T20:33:26.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.816+0000 7f5b2afff700 1 -- 172.21.15.72:0/2695596158 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b241df350 con 0x7f5b2413b2c0 2023-07-27T20:33:26.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.817+0000 7f5b217fa700 1 -- 172.21.15.72:0/2695596158 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5b1c007470 con 0x7f5b2413b2c0 2023-07-27T20:33:26.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.819+0000 7f5b217fa700 1 --2- 172.21.15.72:0/2695596158 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5b0806ace0 0x7f5b0806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:26.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.819+0000 7f5b217fa700 1 -- 172.21.15.72:0/2695596158 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f5b1c089890 con 0x7f5b2413b2c0 2023-07-27T20:33:26.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.820+0000 7f5b28d9b700 1 --2- 172.21.15.72:0/2695596158 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5b0806ace0 0x7f5b0806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:26.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.820+0000 7f5b28d9b700 1 --2- 172.21.15.72:0/2695596158 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5b0806ace0 0x7f5b0806d1a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5b18000f60 tx=0x7f5b18009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:26.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:26.823+0000 7f5b217fa700 1 -- 172.21.15.72:0/2695596158 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5b1c054480 con 0x7f5b2413b2c0 2023-07-27T20:33:26.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.011+0000 7f5b2afff700 1 -- 172.21.15.72:0/2695596158 --> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5b24152400 con 0x7f5b0806ace0 2023-07-27T20:33:27.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.027+0000 7f5b217fa700 1 -- 172.21.15.72:0/2695596158 <== mgr.4107 v2:172.21.15.173:6832/910681537 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+550079 (secure 0 0 0) 0x7f5b180013f0 con 0x7f5b0806ace0 2023-07-27T20:33:27.020 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:33:27.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.033+0000 7f5b2afff700 1 -- 172.21.15.72:0/2695596158 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5b0806ace0 msgr2=0x7f5b0806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:27.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.033+0000 7f5b2afff700 1 --2- 172.21.15.72:0/2695596158 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5b0806ace0 0x7f5b0806d1a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5b18000f60 tx=0x7f5b18009040 comp rx=0 tx=0).stop 2023-07-27T20:33:27.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.033+0000 7f5b2afff700 1 -- 172.21.15.72:0/2695596158 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b2413b2c0 msgr2=0x7f5b2414e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:27.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.033+0000 7f5b2afff700 1 --2- 172.21.15.72:0/2695596158 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b2413b2c0 0x7f5b2414e150 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00cca0 tx=0x7f5b1c00a340 comp rx=0 tx=0).stop 2023-07-27T20:33:27.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.033+0000 7f5b2afff700 1 -- 172.21.15.72:0/2695596158 shutdown_connections 2023-07-27T20:33:27.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.033+0000 7f5b2afff700 1 --2- 172.21.15.72:0/2695596158 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b2413b2c0 0x7f5b2414e150 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:27.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.033+0000 7f5b2afff700 1 --2- 172.21.15.72:0/2695596158 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5b0806ace0 0x7f5b0806d1a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:27.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.033+0000 7f5b2afff700 1 --2- 172.21.15.72:0/2695596158 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5b240a83a0 0x7f5b2406d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:27.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.033+0000 7f5b2afff700 1 --2- 172.21.15.72:0/2695596158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b240bfd90 0x7f5b2414dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:27.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.033+0000 7f5b2afff700 1 -- 172.21.15.72:0/2695596158 >> 172.21.15.72:0/2695596158 conn(0x7f5b2406a190 msgr2=0x7f5b240a8810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:27.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.033+0000 7f5b2afff700 1 -- 172.21.15.72:0/2695596158 shutdown_connections 2023-07-27T20:33:27.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.033+0000 7f5b2afff700 1 -- 172.21.15.72:0/2695596158 wait complete. 2023-07-27T20:33:27.025 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-07-27T20:33:27.038 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":106,"stamp":"2023-07-27T20:33:26.555874+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596789,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":393,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221756,"kb_used_data":5564,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754752964,"statfs":{"total":773094113280,"available":772867035136,"internally_reserved":0,"allocated":5697536,"data_stored":3249144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001363"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":61,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.202965+0000","last_change":"2023-07-27T20:31:22.846540+0000","last_active":"2023-07-27T20:33:23.202965+0000","last_peered":"2023-07-27T20:33:23.202965+0000","last_clean":"2023-07-27T20:33:23.202965+0000","last_became_active":"2023-07-27T20:31:22.846128+0000","last_became_peered":"2023-07-27T20:31:22.846128+0000","last_unstale":"2023-07-27T20:33:23.202965+0000","last_undegraded":"2023-07-27T20:33:23.202965+0000","last_fullsized":"2023-07-27T20:33:23.202965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:51:43.570782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":25,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.201657+0000","last_change":"2023-07-27T20:32:59.579629+0000","last_active":"2023-07-27T20:33:23.201657+0000","last_peered":"2023-07-27T20:33:23.201657+0000","last_clean":"2023-07-27T20:33:23.201657+0000","last_became_active":"2023-07-27T20:32:59.579376+0000","last_became_peered":"2023-07-27T20:32:59.579376+0000","last_unstale":"2023-07-27T20:33:23.201657+0000","last_undegraded":"2023-07-27T20:33:23.201657+0000","last_fullsized":"2023-07-27T20:33:23.201657+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:40:05.204450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.081334+0000","last_change":"2023-07-27T20:33:00.587812+0000","last_active":"2023-07-27T20:33:24.081334+0000","last_peered":"2023-07-27T20:33:24.081334+0000","last_clean":"2023-07-27T20:33:24.081334+0000","last_became_active":"2023-07-27T20:33:00.587294+0000","last_became_peered":"2023-07-27T20:33:00.587294+0000","last_unstale":"2023-07-27T20:33:24.081334+0000","last_undegraded":"2023-07-27T20:33:24.081334+0000","last_fullsized":"2023-07-27T20:33:24.081334+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:15:30.458614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"46'1","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.699857+0000","last_change":"2023-07-27T20:33:21.203992+0000","last_active":"2023-07-27T20:33:23.699857+0000","last_peered":"2023-07-27T20:33:23.699857+0000","last_clean":"2023-07-27T20:33:23.699857+0000","last_became_active":"2023-07-27T20:33:21.203661+0000","last_became_peered":"2023-07-27T20:33:21.203661+0000","last_unstale":"2023-07-27T20:33:23.699857+0000","last_undegraded":"2023-07-27T20:33:23.699857+0000","last_fullsized":"2023-07-27T20:33:23.699857+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:23:08.246499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.081957+0000","last_change":"2023-07-27T20:33:22.208280+0000","last_active":"2023-07-27T20:33:24.081957+0000","last_peered":"2023-07-27T20:33:24.081957+0000","last_clean":"2023-07-27T20:33:24.081957+0000","last_became_active":"2023-07-27T20:33:22.208019+0000","last_became_peered":"2023-07-27T20:33:22.208019+0000","last_unstale":"2023-07-27T20:33:24.081957+0000","last_undegraded":"2023-07-27T20:33:24.081957+0000","last_fullsized":"2023-07-27T20:33:24.081957+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:45:36.719080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.777288+0000","last_change":"2023-07-27T20:31:22.845641+0000","last_active":"2023-07-27T20:33:23.777288+0000","last_peered":"2023-07-27T20:33:23.777288+0000","last_clean":"2023-07-27T20:33:23.777288+0000","last_became_active":"2023-07-27T20:31:22.845368+0000","last_became_peered":"2023-07-27T20:31:22.845368+0000","last_unstale":"2023-07-27T20:33:23.777288+0000","last_undegraded":"2023-07-27T20:33:23.777288+0000","last_fullsized":"2023-07-27T20:33:23.777288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:57:21.894547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":25,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.202602+0000","last_change":"2023-07-27T20:32:59.586199+0000","last_active":"2023-07-27T20:33:23.202602+0000","last_peered":"2023-07-27T20:33:23.202602+0000","last_clean":"2023-07-27T20:33:23.202602+0000","last_became_active":"2023-07-27T20:32:59.585937+0000","last_became_peered":"2023-07-27T20:32:59.585937+0000","last_unstale":"2023-07-27T20:33:23.202602+0000","last_undegraded":"2023-07-27T20:33:23.202602+0000","last_fullsized":"2023-07-27T20:33:23.202602+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:20:04.491478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.082280+0000","last_change":"2023-07-27T20:33:00.586803+0000","last_active":"2023-07-27T20:33:24.082280+0000","last_peered":"2023-07-27T20:33:24.082280+0000","last_clean":"2023-07-27T20:33:24.082280+0000","last_became_active":"2023-07-27T20:33:00.586523+0000","last_became_peered":"2023-07-27T20:33:00.586523+0000","last_unstale":"2023-07-27T20:33:24.082280+0000","last_undegraded":"2023-07-27T20:33:24.082280+0000","last_fullsized":"2023-07-27T20:33:24.082280+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:01:02.831422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.200611+0000","last_change":"2023-07-27T20:33:21.194874+0000","last_active":"2023-07-27T20:33:23.200611+0000","last_peered":"2023-07-27T20:33:23.200611+0000","last_clean":"2023-07-27T20:33:23.200611+0000","last_became_active":"2023-07-27T20:33:21.194575+0000","last_became_peered":"2023-07-27T20:33:21.194575+0000","last_unstale":"2023-07-27T20:33:23.200611+0000","last_undegraded":"2023-07-27T20:33:23.200611+0000","last_fullsized":"2023-07-27T20:33:23.200611+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:01:20.785294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.201446+0000","last_change":"2023-07-27T20:33:22.215084+0000","last_active":"2023-07-27T20:33:23.201446+0000","last_peered":"2023-07-27T20:33:23.201446+0000","last_clean":"2023-07-27T20:33:23.201446+0000","last_became_active":"2023-07-27T20:33:22.214501+0000","last_became_peered":"2023-07-27T20:33:22.214501+0000","last_unstale":"2023-07-27T20:33:23.201446+0000","last_undegraded":"2023-07-27T20:33:23.201446+0000","last_fullsized":"2023-07-27T20:33:23.201446+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:55:18.449431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.201523+0000","last_change":"2023-07-27T20:31:22.848025+0000","last_active":"2023-07-27T20:33:23.201523+0000","last_peered":"2023-07-27T20:33:23.201523+0000","last_clean":"2023-07-27T20:33:23.201523+0000","last_became_active":"2023-07-27T20:31:22.847603+0000","last_became_peered":"2023-07-27T20:31:22.847603+0000","last_unstale":"2023-07-27T20:33:23.201523+0000","last_undegraded":"2023-07-27T20:33:23.201523+0000","last_fullsized":"2023-07-27T20:33:23.201523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:47:49.475823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":25,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.776293+0000","last_change":"2023-07-27T20:32:59.579303+0000","last_active":"2023-07-27T20:33:23.776293+0000","last_peered":"2023-07-27T20:33:23.776293+0000","last_clean":"2023-07-27T20:33:23.776293+0000","last_became_active":"2023-07-27T20:32:59.579015+0000","last_became_peered":"2023-07-27T20:32:59.579015+0000","last_unstale":"2023-07-27T20:33:23.776293+0000","last_undegraded":"2023-07-27T20:33:23.776293+0000","last_fullsized":"2023-07-27T20:33:23.776293+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:54:16.455583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.698822+0000","last_change":"2023-07-27T20:33:00.590893+0000","last_active":"2023-07-27T20:33:23.698822+0000","last_peered":"2023-07-27T20:33:23.698822+0000","last_clean":"2023-07-27T20:33:23.698822+0000","last_became_active":"2023-07-27T20:33:00.590559+0000","last_became_peered":"2023-07-27T20:33:00.590559+0000","last_unstale":"2023-07-27T20:33:23.698822+0000","last_undegraded":"2023-07-27T20:33:23.698822+0000","last_fullsized":"2023-07-27T20:33:23.698822+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:25:29.252182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"46'1","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.082493+0000","last_change":"2023-07-27T20:33:21.202491+0000","last_active":"2023-07-27T20:33:24.082493+0000","last_peered":"2023-07-27T20:33:24.082493+0000","last_clean":"2023-07-27T20:33:24.082493+0000","last_became_active":"2023-07-27T20:33:21.200272+0000","last_became_peered":"2023-07-27T20:33:21.200272+0000","last_unstale":"2023-07-27T20:33:24.082493+0000","last_undegraded":"2023-07-27T20:33:24.082493+0000","last_fullsized":"2023-07-27T20:33:24.082493+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:01:50.321607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.201637+0000","last_change":"2023-07-27T20:33:22.198640+0000","last_active":"2023-07-27T20:33:23.201637+0000","last_peered":"2023-07-27T20:33:23.201637+0000","last_clean":"2023-07-27T20:33:23.201637+0000","last_became_active":"2023-07-27T20:33:22.198341+0000","last_became_peered":"2023-07-27T20:33:22.198341+0000","last_unstale":"2023-07-27T20:33:23.201637+0000","last_undegraded":"2023-07-27T20:33:23.201637+0000","last_fullsized":"2023-07-27T20:33:23.201637+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:00:41.005083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.200832+0000","last_change":"2023-07-27T20:31:22.848181+0000","last_active":"2023-07-27T20:33:23.200832+0000","last_peered":"2023-07-27T20:33:23.200832+0000","last_clean":"2023-07-27T20:33:23.200832+0000","last_became_active":"2023-07-27T20:31:22.847865+0000","last_became_peered":"2023-07-27T20:31:22.847865+0000","last_unstale":"2023-07-27T20:33:23.200832+0000","last_undegraded":"2023-07-27T20:33:23.200832+0000","last_fullsized":"2023-07-27T20:33:23.200832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:44:13.830552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":25,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.776972+0000","last_change":"2023-07-27T20:32:59.584665+0000","last_active":"2023-07-27T20:33:23.776972+0000","last_peered":"2023-07-27T20:33:23.776972+0000","last_clean":"2023-07-27T20:33:23.776972+0000","last_became_active":"2023-07-27T20:32:59.584357+0000","last_became_peered":"2023-07-27T20:32:59.584357+0000","last_unstale":"2023-07-27T20:33:23.776972+0000","last_undegraded":"2023-07-27T20:33:23.776972+0000","last_fullsized":"2023-07-27T20:33:23.776972+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:14:09.797577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.203814+0000","last_change":"2023-07-27T20:33:00.590390+0000","last_active":"2023-07-27T20:33:23.203814+0000","last_peered":"2023-07-27T20:33:23.203814+0000","last_clean":"2023-07-27T20:33:23.203814+0000","last_became_active":"2023-07-27T20:33:00.590070+0000","last_became_peered":"2023-07-27T20:33:00.590070+0000","last_unstale":"2023-07-27T20:33:23.203814+0000","last_undegraded":"2023-07-27T20:33:23.203814+0000","last_fullsized":"2023-07-27T20:33:23.203814+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:52:36.612619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.776838+0000","last_change":"2023-07-27T20:33:21.196648+0000","last_active":"2023-07-27T20:33:23.776838+0000","last_peered":"2023-07-27T20:33:23.776838+0000","last_clean":"2023-07-27T20:33:23.776838+0000","last_became_active":"2023-07-27T20:33:21.196343+0000","last_became_peered":"2023-07-27T20:33:21.196343+0000","last_unstale":"2023-07-27T20:33:23.776838+0000","last_undegraded":"2023-07-27T20:33:23.776838+0000","last_fullsized":"2023-07-27T20:33:23.776838+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:48:49.610125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.200487+0000","last_change":"2023-07-27T20:33:22.206414+0000","last_active":"2023-07-27T20:33:23.200487+0000","last_peered":"2023-07-27T20:33:23.200487+0000","last_clean":"2023-07-27T20:33:23.200487+0000","last_became_active":"2023-07-27T20:33:22.206178+0000","last_became_peered":"2023-07-27T20:33:22.206178+0000","last_unstale":"2023-07-27T20:33:23.200487+0000","last_undegraded":"2023-07-27T20:33:23.200487+0000","last_fullsized":"2023-07-27T20:33:23.200487+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:15:52.074724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":220,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.200936+0000","last_change":"2023-07-27T20:31:15.812727+0000","last_active":"2023-07-27T20:33:23.200936+0000","last_peered":"2023-07-27T20:33:23.200936+0000","last_clean":"2023-07-27T20:33:23.200936+0000","last_became_active":"2023-07-27T20:31:15.811803+0000","last_became_peered":"2023-07-27T20:31:15.811803+0000","last_unstale":"2023-07-27T20:33:23.200936+0000","last_undegraded":"2023-07-27T20:33:23.200936+0000","last_fullsized":"2023-07-27T20:33:23.200936+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:14.789257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:14.789257+0000","last_clean_scrub_stamp":"2023-07-27T20:31:14.789257+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:29:34.049647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":59,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.699474+0000","last_change":"2023-07-27T20:31:22.847766+0000","last_active":"2023-07-27T20:33:23.699474+0000","last_peered":"2023-07-27T20:33:23.699474+0000","last_clean":"2023-07-27T20:33:23.699474+0000","last_became_active":"2023-07-27T20:31:22.847396+0000","last_became_peered":"2023-07-27T20:31:22.847396+0000","last_unstale":"2023-07-27T20:33:23.699474+0000","last_undegraded":"2023-07-27T20:33:23.699474+0000","last_fullsized":"2023-07-27T20:33:23.699474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:31:00.930297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"40'2","reported_seq":27,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.700021+0000","last_change":"2023-07-27T20:32:59.585447+0000","last_active":"2023-07-27T20:33:23.700021+0000","last_peered":"2023-07-27T20:33:23.700021+0000","last_clean":"2023-07-27T20:33:23.700021+0000","last_became_active":"2023-07-27T20:32:59.585172+0000","last_became_peered":"2023-07-27T20:32:59.585172+0000","last_unstale":"2023-07-27T20:33:23.700021+0000","last_undegraded":"2023-07-27T20:33:23.700021+0000","last_fullsized":"2023-07-27T20:33:23.700021+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:23:11.955401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.200995+0000","last_change":"2023-07-27T20:33:00.581823+0000","last_active":"2023-07-27T20:33:23.200995+0000","last_peered":"2023-07-27T20:33:23.200995+0000","last_clean":"2023-07-27T20:33:23.200995+0000","last_became_active":"2023-07-27T20:33:00.581520+0000","last_became_peered":"2023-07-27T20:33:00.581520+0000","last_unstale":"2023-07-27T20:33:23.200995+0000","last_undegraded":"2023-07-27T20:33:23.200995+0000","last_fullsized":"2023-07-27T20:33:23.200995+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:28:47.448212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.203658+0000","last_change":"2023-07-27T20:33:21.203031+0000","last_active":"2023-07-27T20:33:23.203658+0000","last_peered":"2023-07-27T20:33:23.203658+0000","last_clean":"2023-07-27T20:33:23.203658+0000","last_became_active":"2023-07-27T20:33:21.202713+0000","last_became_peered":"2023-07-27T20:33:21.202713+0000","last_unstale":"2023-07-27T20:33:23.203658+0000","last_undegraded":"2023-07-27T20:33:23.203658+0000","last_fullsized":"2023-07-27T20:33:23.203658+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:41:40.368681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.081195+0000","last_change":"2023-07-27T20:33:22.209647+0000","last_active":"2023-07-27T20:33:24.081195+0000","last_peered":"2023-07-27T20:33:24.081195+0000","last_clean":"2023-07-27T20:33:24.081195+0000","last_became_active":"2023-07-27T20:33:22.209389+0000","last_became_peered":"2023-07-27T20:33:22.209389+0000","last_unstale":"2023-07-27T20:33:24.081195+0000","last_undegraded":"2023-07-27T20:33:24.081195+0000","last_fullsized":"2023-07-27T20:33:24.081195+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:38:50.250901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.025856+0000","last_change":"2023-07-27T20:31:22.959811+0000","last_active":"2023-07-27T20:33:24.025856+0000","last_peered":"2023-07-27T20:33:24.025856+0000","last_clean":"2023-07-27T20:33:24.025856+0000","last_became_active":"2023-07-27T20:31:22.959449+0000","last_became_peered":"2023-07-27T20:31:22.959449+0000","last_unstale":"2023-07-27T20:33:24.025856+0000","last_undegraded":"2023-07-27T20:33:24.025856+0000","last_fullsized":"2023-07-27T20:33:24.025856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:15:09.458827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":25,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.202350+0000","last_change":"2023-07-27T20:32:59.579248+0000","last_active":"2023-07-27T20:33:23.202350+0000","last_peered":"2023-07-27T20:33:23.202350+0000","last_clean":"2023-07-27T20:33:23.202350+0000","last_became_active":"2023-07-27T20:32:59.578926+0000","last_became_peered":"2023-07-27T20:32:59.578926+0000","last_unstale":"2023-07-27T20:33:23.202350+0000","last_undegraded":"2023-07-27T20:33:23.202350+0000","last_fullsized":"2023-07-27T20:33:23.202350+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:13:55.878493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.201268+0000","last_change":"2023-07-27T20:33:00.572709+0000","last_active":"2023-07-27T20:33:23.201268+0000","last_peered":"2023-07-27T20:33:23.201268+0000","last_clean":"2023-07-27T20:33:23.201268+0000","last_became_active":"2023-07-27T20:33:00.572428+0000","last_became_peered":"2023-07-27T20:33:00.572428+0000","last_unstale":"2023-07-27T20:33:23.201268+0000","last_undegraded":"2023-07-27T20:33:23.201268+0000","last_fullsized":"2023-07-27T20:33:23.201268+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:01:02.831422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"46'2","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.081616+0000","last_change":"2023-07-27T20:33:21.205926+0000","last_active":"2023-07-27T20:33:24.081616+0000","last_peered":"2023-07-27T20:33:24.081616+0000","last_clean":"2023-07-27T20:33:24.081616+0000","last_became_active":"2023-07-27T20:33:21.205327+0000","last_became_peered":"2023-07-27T20:33:21.205327+0000","last_unstale":"2023-07-27T20:33:24.081616+0000","last_undegraded":"2023-07-27T20:33:24.081616+0000","last_fullsized":"2023-07-27T20:33:24.081616+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:51:31.938603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.699054+0000","last_change":"2023-07-27T20:33:22.212940+0000","last_active":"2023-07-27T20:33:23.699054+0000","last_peered":"2023-07-27T20:33:23.699054+0000","last_clean":"2023-07-27T20:33:23.699054+0000","last_became_active":"2023-07-27T20:33:22.212300+0000","last_became_peered":"2023-07-27T20:33:22.212300+0000","last_unstale":"2023-07-27T20:33:23.699054+0000","last_undegraded":"2023-07-27T20:33:23.699054+0000","last_fullsized":"2023-07-27T20:33:23.699054+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:21:17.790248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":59,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.699476+0000","last_change":"2023-07-27T20:31:22.849178+0000","last_active":"2023-07-27T20:33:23.699476+0000","last_peered":"2023-07-27T20:33:23.699476+0000","last_clean":"2023-07-27T20:33:23.699476+0000","last_became_active":"2023-07-27T20:31:22.848856+0000","last_became_peered":"2023-07-27T20:31:22.848856+0000","last_unstale":"2023-07-27T20:33:23.699476+0000","last_undegraded":"2023-07-27T20:33:23.699476+0000","last_fullsized":"2023-07-27T20:33:23.699476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:03:10.229438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"41'1","reported_seq":26,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.080910+0000","last_change":"2023-07-27T20:32:59.579071+0000","last_active":"2023-07-27T20:33:24.080910+0000","last_peered":"2023-07-27T20:33:24.080910+0000","last_clean":"2023-07-27T20:33:24.080910+0000","last_became_active":"2023-07-27T20:32:59.578792+0000","last_became_peered":"2023-07-27T20:32:59.578792+0000","last_unstale":"2023-07-27T20:33:24.080910+0000","last_undegraded":"2023-07-27T20:33:24.080910+0000","last_fullsized":"2023-07-27T20:33:24.080910+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:43:04.070113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.202624+0000","last_change":"2023-07-27T20:33:00.594284+0000","last_active":"2023-07-27T20:33:23.202624+0000","last_peered":"2023-07-27T20:33:23.202624+0000","last_clean":"2023-07-27T20:33:23.202624+0000","last_became_active":"2023-07-27T20:33:00.593915+0000","last_became_peered":"2023-07-27T20:33:00.593915+0000","last_unstale":"2023-07-27T20:33:23.202624+0000","last_undegraded":"2023-07-27T20:33:23.202624+0000","last_fullsized":"2023-07-27T20:33:23.202624+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:37:28.822060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.699016+0000","last_change":"2023-07-27T20:33:21.199509+0000","last_active":"2023-07-27T20:33:23.699016+0000","last_peered":"2023-07-27T20:33:23.699016+0000","last_clean":"2023-07-27T20:33:23.699016+0000","last_became_active":"2023-07-27T20:33:21.199097+0000","last_became_peered":"2023-07-27T20:33:21.199097+0000","last_unstale":"2023-07-27T20:33:23.699016+0000","last_undegraded":"2023-07-27T20:33:23.699016+0000","last_fullsized":"2023-07-27T20:33:23.699016+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:04:59.974210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.199990+0000","last_change":"2023-07-27T20:33:22.197055+0000","last_active":"2023-07-27T20:33:23.199990+0000","last_peered":"2023-07-27T20:33:23.199990+0000","last_clean":"2023-07-27T20:33:23.199990+0000","last_became_active":"2023-07-27T20:33:22.196518+0000","last_became_peered":"2023-07-27T20:33:22.196518+0000","last_unstale":"2023-07-27T20:33:23.199990+0000","last_undegraded":"2023-07-27T20:33:23.199990+0000","last_fullsized":"2023-07-27T20:33:23.199990+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:43:23.707599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.777005+0000","last_change":"2023-07-27T20:31:22.848698+0000","last_active":"2023-07-27T20:33:23.777005+0000","last_peered":"2023-07-27T20:33:23.777005+0000","last_clean":"2023-07-27T20:33:23.777005+0000","last_became_active":"2023-07-27T20:31:22.848346+0000","last_became_peered":"2023-07-27T20:31:22.848346+0000","last_unstale":"2023-07-27T20:33:23.777005+0000","last_undegraded":"2023-07-27T20:33:23.777005+0000","last_fullsized":"2023-07-27T20:33:23.777005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:49:45.258938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":25,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.200342+0000","last_change":"2023-07-27T20:32:59.581609+0000","last_active":"2023-07-27T20:33:23.200342+0000","last_peered":"2023-07-27T20:33:23.200342+0000","last_clean":"2023-07-27T20:33:23.200342+0000","last_became_active":"2023-07-27T20:32:59.580643+0000","last_became_peered":"2023-07-27T20:32:59.580643+0000","last_unstale":"2023-07-27T20:33:23.200342+0000","last_undegraded":"2023-07-27T20:33:23.200342+0000","last_fullsized":"2023-07-27T20:33:23.200342+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:28:10.465361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.201997+0000","last_change":"2023-07-27T20:33:00.588668+0000","last_active":"2023-07-27T20:33:23.201997+0000","last_peered":"2023-07-27T20:33:23.201997+0000","last_clean":"2023-07-27T20:33:23.201997+0000","last_became_active":"2023-07-27T20:33:00.588375+0000","last_became_peered":"2023-07-27T20:33:00.588375+0000","last_unstale":"2023-07-27T20:33:23.201997+0000","last_undegraded":"2023-07-27T20:33:23.201997+0000","last_fullsized":"2023-07-27T20:33:23.201997+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:19:21.273332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"46'2","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.200751+0000","last_change":"2023-07-27T20:33:21.195437+0000","last_active":"2023-07-27T20:33:23.200751+0000","last_peered":"2023-07-27T20:33:23.200751+0000","last_clean":"2023-07-27T20:33:23.200751+0000","last_became_active":"2023-07-27T20:33:21.195192+0000","last_became_peered":"2023-07-27T20:33:21.195192+0000","last_unstale":"2023-07-27T20:33:23.200751+0000","last_undegraded":"2023-07-27T20:33:23.200751+0000","last_fullsized":"2023-07-27T20:33:23.200751+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:24:12.102823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.699668+0000","last_change":"2023-07-27T20:33:22.213814+0000","last_active":"2023-07-27T20:33:23.699668+0000","last_peered":"2023-07-27T20:33:23.699668+0000","last_clean":"2023-07-27T20:33:23.699668+0000","last_became_active":"2023-07-27T20:33:22.213488+0000","last_became_peered":"2023-07-27T20:33:22.213488+0000","last_unstale":"2023-07-27T20:33:23.699668+0000","last_undegraded":"2023-07-27T20:33:23.699668+0000","last_fullsized":"2023-07-27T20:33:23.699668+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:46:42.488427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":25,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.201167+0000","last_change":"2023-07-27T20:32:59.581455+0000","last_active":"2023-07-27T20:33:23.201167+0000","last_peered":"2023-07-27T20:33:23.201167+0000","last_clean":"2023-07-27T20:33:23.201167+0000","last_became_active":"2023-07-27T20:32:59.579901+0000","last_became_peered":"2023-07-27T20:32:59.579901+0000","last_unstale":"2023-07-27T20:33:23.201167+0000","last_undegraded":"2023-07-27T20:33:23.201167+0000","last_fullsized":"2023-07-27T20:33:23.201167+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:15:27.877024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.199920+0000","last_change":"2023-07-27T20:33:00.583933+0000","last_active":"2023-07-27T20:33:23.199920+0000","last_peered":"2023-07-27T20:33:23.199920+0000","last_clean":"2023-07-27T20:33:23.199920+0000","last_became_active":"2023-07-27T20:33:00.583598+0000","last_became_peered":"2023-07-27T20:33:00.583598+0000","last_unstale":"2023-07-27T20:33:23.199920+0000","last_undegraded":"2023-07-27T20:33:23.199920+0000","last_fullsized":"2023-07-27T20:33:23.199920+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:02:48.527036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.200838+0000","last_change":"2023-07-27T20:33:21.197744+0000","last_active":"2023-07-27T20:33:23.200838+0000","last_peered":"2023-07-27T20:33:23.200838+0000","last_clean":"2023-07-27T20:33:23.200838+0000","last_became_active":"2023-07-27T20:33:21.197466+0000","last_became_peered":"2023-07-27T20:33:21.197466+0000","last_unstale":"2023-07-27T20:33:23.200838+0000","last_undegraded":"2023-07-27T20:33:23.200838+0000","last_fullsized":"2023-07-27T20:33:23.200838+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:26:48.539605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.699773+0000","last_change":"2023-07-27T20:33:22.210649+0000","last_active":"2023-07-27T20:33:23.699773+0000","last_peered":"2023-07-27T20:33:23.699773+0000","last_clean":"2023-07-27T20:33:23.699773+0000","last_became_active":"2023-07-27T20:33:22.210369+0000","last_became_peered":"2023-07-27T20:33:22.210369+0000","last_unstale":"2023-07-27T20:33:23.699773+0000","last_undegraded":"2023-07-27T20:33:23.699773+0000","last_fullsized":"2023-07-27T20:33:23.699773+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:01:57.829653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":25,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.200109+0000","last_change":"2023-07-27T20:32:59.577740+0000","last_active":"2023-07-27T20:33:23.200109+0000","last_peered":"2023-07-27T20:33:23.200109+0000","last_clean":"2023-07-27T20:33:23.200109+0000","last_became_active":"2023-07-27T20:32:59.577456+0000","last_became_peered":"2023-07-27T20:32:59.577456+0000","last_unstale":"2023-07-27T20:33:23.200109+0000","last_undegraded":"2023-07-27T20:33:23.200109+0000","last_fullsized":"2023-07-27T20:33:23.200109+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:14:49.492531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.025850+0000","last_change":"2023-07-27T20:33:00.580697+0000","last_active":"2023-07-27T20:33:24.025850+0000","last_peered":"2023-07-27T20:33:24.025850+0000","last_clean":"2023-07-27T20:33:24.025850+0000","last_became_active":"2023-07-27T20:33:00.580386+0000","last_became_peered":"2023-07-27T20:33:00.580386+0000","last_unstale":"2023-07-27T20:33:24.025850+0000","last_undegraded":"2023-07-27T20:33:24.025850+0000","last_fullsized":"2023-07-27T20:33:24.025850+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:16:32.940169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"46'2","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.777332+0000","last_change":"2023-07-27T20:33:21.200962+0000","last_active":"2023-07-27T20:33:23.777332+0000","last_peered":"2023-07-27T20:33:23.777332+0000","last_clean":"2023-07-27T20:33:23.777332+0000","last_became_active":"2023-07-27T20:33:21.200666+0000","last_became_peered":"2023-07-27T20:33:21.200666+0000","last_unstale":"2023-07-27T20:33:23.777332+0000","last_undegraded":"2023-07-27T20:33:23.777332+0000","last_fullsized":"2023-07-27T20:33:23.777332+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:20:29.983827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.700060+0000","last_change":"2023-07-27T20:33:22.204256+0000","last_active":"2023-07-27T20:33:23.700060+0000","last_peered":"2023-07-27T20:33:23.700060+0000","last_clean":"2023-07-27T20:33:23.700060+0000","last_became_active":"2023-07-27T20:33:22.203968+0000","last_became_peered":"2023-07-27T20:33:22.203968+0000","last_unstale":"2023-07-27T20:33:23.700060+0000","last_undegraded":"2023-07-27T20:33:23.700060+0000","last_fullsized":"2023-07-27T20:33:23.700060+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:46:13.178769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":25,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.698630+0000","last_change":"2023-07-27T20:32:59.583381+0000","last_active":"2023-07-27T20:33:23.698630+0000","last_peered":"2023-07-27T20:33:23.698630+0000","last_clean":"2023-07-27T20:33:23.698630+0000","last_became_active":"2023-07-27T20:32:59.582911+0000","last_became_peered":"2023-07-27T20:32:59.582911+0000","last_unstale":"2023-07-27T20:33:23.698630+0000","last_undegraded":"2023-07-27T20:33:23.698630+0000","last_fullsized":"2023-07-27T20:33:23.698630+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:09:26.107033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.776664+0000","last_change":"2023-07-27T20:33:00.585619+0000","last_active":"2023-07-27T20:33:23.776664+0000","last_peered":"2023-07-27T20:33:23.776664+0000","last_clean":"2023-07-27T20:33:23.776664+0000","last_became_active":"2023-07-27T20:33:00.585362+0000","last_became_peered":"2023-07-27T20:33:00.585362+0000","last_unstale":"2023-07-27T20:33:23.776664+0000","last_undegraded":"2023-07-27T20:33:23.776664+0000","last_fullsized":"2023-07-27T20:33:23.776664+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:36:51.127871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.699952+0000","last_change":"2023-07-27T20:33:21.205588+0000","last_active":"2023-07-27T20:33:23.699952+0000","last_peered":"2023-07-27T20:33:23.699952+0000","last_clean":"2023-07-27T20:33:23.699952+0000","last_became_active":"2023-07-27T20:33:21.205251+0000","last_became_peered":"2023-07-27T20:33:21.205251+0000","last_unstale":"2023-07-27T20:33:23.699952+0000","last_undegraded":"2023-07-27T20:33:23.699952+0000","last_fullsized":"2023-07-27T20:33:23.699952+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:43:46.710169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.201322+0000","last_change":"2023-07-27T20:33:22.209991+0000","last_active":"2023-07-27T20:33:23.201322+0000","last_peered":"2023-07-27T20:33:23.201322+0000","last_clean":"2023-07-27T20:33:23.201322+0000","last_became_active":"2023-07-27T20:33:22.209399+0000","last_became_peered":"2023-07-27T20:33:22.209399+0000","last_unstale":"2023-07-27T20:33:23.201322+0000","last_undegraded":"2023-07-27T20:33:23.201322+0000","last_fullsized":"2023-07-27T20:33:23.201322+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:15:25.692903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"40'2","reported_seq":27,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.080847+0000","last_change":"2023-07-27T20:32:59.581014+0000","last_active":"2023-07-27T20:33:24.080847+0000","last_peered":"2023-07-27T20:33:24.080847+0000","last_clean":"2023-07-27T20:33:24.080847+0000","last_became_active":"2023-07-27T20:32:59.580563+0000","last_became_peered":"2023-07-27T20:32:59.580563+0000","last_unstale":"2023-07-27T20:33:24.080847+0000","last_undegraded":"2023-07-27T20:33:24.080847+0000","last_fullsized":"2023-07-27T20:33:24.080847+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:42:32.538843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.081605+0000","last_change":"2023-07-27T20:33:00.588162+0000","last_active":"2023-07-27T20:33:24.081605+0000","last_peered":"2023-07-27T20:33:24.081605+0000","last_clean":"2023-07-27T20:33:24.081605+0000","last_became_active":"2023-07-27T20:33:00.587546+0000","last_became_peered":"2023-07-27T20:33:00.587546+0000","last_unstale":"2023-07-27T20:33:24.081605+0000","last_undegraded":"2023-07-27T20:33:24.081605+0000","last_fullsized":"2023-07-27T20:33:24.081605+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:26:27.931901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.203643+0000","last_change":"2023-07-27T20:33:21.204549+0000","last_active":"2023-07-27T20:33:23.203643+0000","last_peered":"2023-07-27T20:33:23.203643+0000","last_clean":"2023-07-27T20:33:23.203643+0000","last_became_active":"2023-07-27T20:33:21.204284+0000","last_became_peered":"2023-07-27T20:33:21.204284+0000","last_unstale":"2023-07-27T20:33:23.203643+0000","last_undegraded":"2023-07-27T20:33:23.203643+0000","last_fullsized":"2023-07-27T20:33:23.203643+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:54:06.837388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.776832+0000","last_change":"2023-07-27T20:33:22.212650+0000","last_active":"2023-07-27T20:33:23.776832+0000","last_peered":"2023-07-27T20:33:23.776832+0000","last_clean":"2023-07-27T20:33:23.776832+0000","last_became_active":"2023-07-27T20:33:22.211928+0000","last_became_peered":"2023-07-27T20:33:22.211928+0000","last_unstale":"2023-07-27T20:33:23.776832+0000","last_undegraded":"2023-07-27T20:33:23.776832+0000","last_fullsized":"2023-07-27T20:33:23.776832+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:06:44.741427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":25,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.080847+0000","last_change":"2023-07-27T20:32:59.585317+0000","last_active":"2023-07-27T20:33:24.080847+0000","last_peered":"2023-07-27T20:33:24.080847+0000","last_clean":"2023-07-27T20:33:24.080847+0000","last_became_active":"2023-07-27T20:32:59.585008+0000","last_became_peered":"2023-07-27T20:32:59.585008+0000","last_unstale":"2023-07-27T20:33:24.080847+0000","last_undegraded":"2023-07-27T20:33:24.080847+0000","last_fullsized":"2023-07-27T20:33:24.080847+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:52:35.605307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.203005+0000","last_change":"2023-07-27T20:33:00.597737+0000","last_active":"2023-07-27T20:33:23.203005+0000","last_peered":"2023-07-27T20:33:23.203005+0000","last_clean":"2023-07-27T20:33:23.203005+0000","last_became_active":"2023-07-27T20:33:00.597390+0000","last_became_peered":"2023-07-27T20:33:00.597390+0000","last_unstale":"2023-07-27T20:33:23.203005+0000","last_undegraded":"2023-07-27T20:33:23.203005+0000","last_fullsized":"2023-07-27T20:33:23.203005+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:47:20.283073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.202260+0000","last_change":"2023-07-27T20:33:21.207010+0000","last_active":"2023-07-27T20:33:23.202260+0000","last_peered":"2023-07-27T20:33:23.202260+0000","last_clean":"2023-07-27T20:33:23.202260+0000","last_became_active":"2023-07-27T20:33:21.206616+0000","last_became_peered":"2023-07-27T20:33:21.206616+0000","last_unstale":"2023-07-27T20:33:23.202260+0000","last_undegraded":"2023-07-27T20:33:23.202260+0000","last_fullsized":"2023-07-27T20:33:23.202260+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:26:48.539605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.202187+0000","last_change":"2023-07-27T20:33:22.211181+0000","last_active":"2023-07-27T20:33:23.202187+0000","last_peered":"2023-07-27T20:33:23.202187+0000","last_clean":"2023-07-27T20:33:23.202187+0000","last_became_active":"2023-07-27T20:33:22.210921+0000","last_became_peered":"2023-07-27T20:33:22.210921+0000","last_unstale":"2023-07-27T20:33:23.202187+0000","last_undegraded":"2023-07-27T20:33:23.202187+0000","last_fullsized":"2023-07-27T20:33:23.202187+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:56:37.330885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.d","version":"40'1","reported_seq":26,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.700020+0000","last_change":"2023-07-27T20:32:59.588890+0000","last_active":"2023-07-27T20:33:23.700020+0000","last_peered":"2023-07-27T20:33:23.700020+0000","last_clean":"2023-07-27T20:33:23.700020+0000","last_became_active":"2023-07-27T20:32:59.588570+0000","last_became_peered":"2023-07-27T20:32:59.588570+0000","last_unstale":"2023-07-27T20:33:23.700020+0000","last_undegraded":"2023-07-27T20:33:23.700020+0000","last_fullsized":"2023-07-27T20:33:23.700020+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:31:17.806271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.202483+0000","last_change":"2023-07-27T20:33:00.602792+0000","last_active":"2023-07-27T20:33:23.202483+0000","last_peered":"2023-07-27T20:33:23.202483+0000","last_clean":"2023-07-27T20:33:23.202483+0000","last_became_active":"2023-07-27T20:33:00.602393+0000","last_became_peered":"2023-07-27T20:33:00.602393+0000","last_unstale":"2023-07-27T20:33:23.202483+0000","last_undegraded":"2023-07-27T20:33:23.202483+0000","last_fullsized":"2023-07-27T20:33:23.202483+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:17:27.802357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.776613+0000","last_change":"2023-07-27T20:33:21.206966+0000","last_active":"2023-07-27T20:33:23.776613+0000","last_peered":"2023-07-27T20:33:23.776613+0000","last_clean":"2023-07-27T20:33:23.776613+0000","last_became_active":"2023-07-27T20:33:21.206656+0000","last_became_peered":"2023-07-27T20:33:21.206656+0000","last_unstale":"2023-07-27T20:33:23.776613+0000","last_undegraded":"2023-07-27T20:33:23.776613+0000","last_fullsized":"2023-07-27T20:33:23.776613+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:46:21.983324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.081867+0000","last_change":"2023-07-27T20:33:22.212237+0000","last_active":"2023-07-27T20:33:24.081867+0000","last_peered":"2023-07-27T20:33:24.081867+0000","last_clean":"2023-07-27T20:33:24.081867+0000","last_became_active":"2023-07-27T20:33:22.211537+0000","last_became_peered":"2023-07-27T20:33:22.211537+0000","last_unstale":"2023-07-27T20:33:24.081867+0000","last_undegraded":"2023-07-27T20:33:24.081867+0000","last_fullsized":"2023-07-27T20:33:24.081867+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:29:09.064321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"40'2","reported_seq":27,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.202560+0000","last_change":"2023-07-27T20:32:59.580768+0000","last_active":"2023-07-27T20:33:23.202560+0000","last_peered":"2023-07-27T20:33:23.202560+0000","last_clean":"2023-07-27T20:33:23.202560+0000","last_became_active":"2023-07-27T20:32:59.580496+0000","last_became_peered":"2023-07-27T20:32:59.580496+0000","last_unstale":"2023-07-27T20:33:23.202560+0000","last_undegraded":"2023-07-27T20:33:23.202560+0000","last_fullsized":"2023-07-27T20:33:23.202560+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:18:59.502113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.201380+0000","last_change":"2023-07-27T20:33:00.592417+0000","last_active":"2023-07-27T20:33:23.201380+0000","last_peered":"2023-07-27T20:33:23.201380+0000","last_clean":"2023-07-27T20:33:23.201380+0000","last_became_active":"2023-07-27T20:33:00.592164+0000","last_became_peered":"2023-07-27T20:33:00.592164+0000","last_unstale":"2023-07-27T20:33:23.201380+0000","last_undegraded":"2023-07-27T20:33:23.201380+0000","last_fullsized":"2023-07-27T20:33:23.201380+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:19:38.767274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.081445+0000","last_change":"2023-07-27T20:33:21.204386+0000","last_active":"2023-07-27T20:33:24.081445+0000","last_peered":"2023-07-27T20:33:24.081445+0000","last_clean":"2023-07-27T20:33:24.081445+0000","last_became_active":"2023-07-27T20:33:21.204118+0000","last_became_peered":"2023-07-27T20:33:21.204118+0000","last_unstale":"2023-07-27T20:33:24.081445+0000","last_undegraded":"2023-07-27T20:33:24.081445+0000","last_fullsized":"2023-07-27T20:33:24.081445+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:26:31.916894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.081406+0000","last_change":"2023-07-27T20:33:22.207895+0000","last_active":"2023-07-27T20:33:24.081406+0000","last_peered":"2023-07-27T20:33:24.081406+0000","last_clean":"2023-07-27T20:33:24.081406+0000","last_became_active":"2023-07-27T20:33:22.207238+0000","last_became_peered":"2023-07-27T20:33:22.207238+0000","last_unstale":"2023-07-27T20:33:24.081406+0000","last_undegraded":"2023-07-27T20:33:24.081406+0000","last_fullsized":"2023-07-27T20:33:24.081406+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:01:21.793700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.f","version":"40'1","reported_seq":26,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.026693+0000","last_change":"2023-07-27T20:32:59.586172+0000","last_active":"2023-07-27T20:33:24.026693+0000","last_peered":"2023-07-27T20:33:24.026693+0000","last_clean":"2023-07-27T20:33:24.026693+0000","last_became_active":"2023-07-27T20:32:59.585871+0000","last_became_peered":"2023-07-27T20:32:59.585871+0000","last_unstale":"2023-07-27T20:33:24.026693+0000","last_undegraded":"2023-07-27T20:33:24.026693+0000","last_fullsized":"2023-07-27T20:33:24.026693+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:17:47.165420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.026557+0000","last_change":"2023-07-27T20:33:00.583423+0000","last_active":"2023-07-27T20:33:24.026557+0000","last_peered":"2023-07-27T20:33:24.026557+0000","last_clean":"2023-07-27T20:33:24.026557+0000","last_became_active":"2023-07-27T20:33:00.583146+0000","last_became_peered":"2023-07-27T20:33:00.583146+0000","last_unstale":"2023-07-27T20:33:24.026557+0000","last_undegraded":"2023-07-27T20:33:24.026557+0000","last_fullsized":"2023-07-27T20:33:24.026557+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:01:37.390164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.776661+0000","last_change":"2023-07-27T20:33:21.199637+0000","last_active":"2023-07-27T20:33:23.776661+0000","last_peered":"2023-07-27T20:33:23.776661+0000","last_clean":"2023-07-27T20:33:23.776661+0000","last_became_active":"2023-07-27T20:33:21.199347+0000","last_became_peered":"2023-07-27T20:33:21.199347+0000","last_unstale":"2023-07-27T20:33:23.776661+0000","last_undegraded":"2023-07-27T20:33:23.776661+0000","last_fullsized":"2023-07-27T20:33:23.776661+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:34:28.880225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.776450+0000","last_change":"2023-07-27T20:33:22.205206+0000","last_active":"2023-07-27T20:33:23.776450+0000","last_peered":"2023-07-27T20:33:23.776450+0000","last_clean":"2023-07-27T20:33:23.776450+0000","last_became_active":"2023-07-27T20:33:22.204899+0000","last_became_peered":"2023-07-27T20:33:22.204899+0000","last_unstale":"2023-07-27T20:33:23.776450+0000","last_undegraded":"2023-07-27T20:33:23.776450+0000","last_fullsized":"2023-07-27T20:33:23.776450+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:59:37.720592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.777405+0000","last_change":"2023-07-27T20:33:22.215381+0000","last_active":"2023-07-27T20:33:23.777405+0000","last_peered":"2023-07-27T20:33:23.777405+0000","last_clean":"2023-07-27T20:33:23.777405+0000","last_became_active":"2023-07-27T20:33:22.214645+0000","last_became_peered":"2023-07-27T20:33:22.214645+0000","last_unstale":"2023-07-27T20:33:23.777405+0000","last_undegraded":"2023-07-27T20:33:23.777405+0000","last_fullsized":"2023-07-27T20:33:23.777405+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:40:27.490698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"40'8","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.200179+0000","last_change":"2023-07-27T20:32:59.583107+0000","last_active":"2023-07-27T20:33:23.200179+0000","last_peered":"2023-07-27T20:33:23.200179+0000","last_clean":"2023-07-27T20:33:23.200179+0000","last_became_active":"2023-07-27T20:32:59.582831+0000","last_became_peered":"2023-07-27T20:32:59.582831+0000","last_unstale":"2023-07-27T20:33:23.200179+0000","last_undegraded":"2023-07-27T20:33:23.200179+0000","last_fullsized":"2023-07-27T20:33:23.200179+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:40:08.367110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.201984+0000","last_change":"2023-07-27T20:33:00.598092+0000","last_active":"2023-07-27T20:33:23.201984+0000","last_peered":"2023-07-27T20:33:23.201984+0000","last_clean":"2023-07-27T20:33:23.201984+0000","last_became_active":"2023-07-27T20:33:00.597585+0000","last_became_peered":"2023-07-27T20:33:00.597585+0000","last_unstale":"2023-07-27T20:33:23.201984+0000","last_undegraded":"2023-07-27T20:33:23.201984+0000","last_fullsized":"2023-07-27T20:33:23.201984+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:03:20.958499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"46'1","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.082324+0000","last_change":"2023-07-27T20:33:21.205660+0000","last_active":"2023-07-27T20:33:24.082324+0000","last_peered":"2023-07-27T20:33:24.082324+0000","last_clean":"2023-07-27T20:33:24.082324+0000","last_became_active":"2023-07-27T20:33:21.205314+0000","last_became_peered":"2023-07-27T20:33:21.205314+0000","last_unstale":"2023-07-27T20:33:24.082324+0000","last_undegraded":"2023-07-27T20:33:24.082324+0000","last_fullsized":"2023-07-27T20:33:24.082324+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:15:24.684497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.200605+0000","last_change":"2023-07-27T20:33:22.212187+0000","last_active":"2023-07-27T20:33:23.200605+0000","last_peered":"2023-07-27T20:33:23.200605+0000","last_clean":"2023-07-27T20:33:23.200605+0000","last_became_active":"2023-07-27T20:33:22.211950+0000","last_became_peered":"2023-07-27T20:33:22.211950+0000","last_unstale":"2023-07-27T20:33:23.200605+0000","last_undegraded":"2023-07-27T20:33:23.200605+0000","last_fullsized":"2023-07-27T20:33:23.200605+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:21:19.582044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":25,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.080766+0000","last_change":"2023-07-27T20:32:59.583865+0000","last_active":"2023-07-27T20:33:24.080766+0000","last_peered":"2023-07-27T20:33:24.080766+0000","last_clean":"2023-07-27T20:33:24.080766+0000","last_became_active":"2023-07-27T20:32:59.583587+0000","last_became_peered":"2023-07-27T20:32:59.583587+0000","last_unstale":"2023-07-27T20:33:24.080766+0000","last_undegraded":"2023-07-27T20:33:24.080766+0000","last_fullsized":"2023-07-27T20:33:24.080766+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:43:01.084177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.081346+0000","last_change":"2023-07-27T20:33:00.583374+0000","last_active":"2023-07-27T20:33:24.081346+0000","last_peered":"2023-07-27T20:33:24.081346+0000","last_clean":"2023-07-27T20:33:24.081346+0000","last_became_active":"2023-07-27T20:33:00.583064+0000","last_became_peered":"2023-07-27T20:33:00.583064+0000","last_unstale":"2023-07-27T20:33:24.081346+0000","last_undegraded":"2023-07-27T20:33:24.081346+0000","last_fullsized":"2023-07-27T20:33:24.081346+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:28:11.472672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1f","version":"46'4","reported_seq":17,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.201010+0000","last_change":"2023-07-27T20:33:21.203545+0000","last_active":"2023-07-27T20:33:23.201010+0000","last_peered":"2023-07-27T20:33:23.201010+0000","last_clean":"2023-07-27T20:33:23.201010+0000","last_became_active":"2023-07-27T20:33:21.202985+0000","last_became_peered":"2023-07-27T20:33:21.202985+0000","last_unstale":"2023-07-27T20:33:23.201010+0000","last_undegraded":"2023-07-27T20:33:23.201010+0000","last_fullsized":"2023-07-27T20:33:23.201010+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:26:31.916894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.201409+0000","last_change":"2023-07-27T20:33:22.210158+0000","last_active":"2023-07-27T20:33:23.201409+0000","last_peered":"2023-07-27T20:33:23.201409+0000","last_clean":"2023-07-27T20:33:23.201409+0000","last_became_active":"2023-07-27T20:33:22.209735+0000","last_became_peered":"2023-07-27T20:33:22.209735+0000","last_unstale":"2023-07-27T20:33:23.201409+0000","last_undegraded":"2023-07-27T20:33:23.201409+0000","last_fullsized":"2023-07-27T20:33:23.201409+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:10:58.440474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":25,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.201292+0000","last_change":"2023-07-27T20:32:59.581242+0000","last_active":"2023-07-27T20:33:23.201292+0000","last_peered":"2023-07-27T20:33:23.201292+0000","last_clean":"2023-07-27T20:33:23.201292+0000","last_became_active":"2023-07-27T20:32:59.580941+0000","last_became_peered":"2023-07-27T20:32:59.580941+0000","last_unstale":"2023-07-27T20:33:23.201292+0000","last_undegraded":"2023-07-27T20:33:23.201292+0000","last_fullsized":"2023-07-27T20:33:23.201292+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:38:11.889117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.200763+0000","last_change":"2023-07-27T20:33:00.578726+0000","last_active":"2023-07-27T20:33:23.200763+0000","last_peered":"2023-07-27T20:33:23.200763+0000","last_clean":"2023-07-27T20:33:23.200763+0000","last_became_active":"2023-07-27T20:33:00.578439+0000","last_became_peered":"2023-07-27T20:33:00.578439+0000","last_unstale":"2023-07-27T20:33:23.200763+0000","last_undegraded":"2023-07-27T20:33:23.200763+0000","last_fullsized":"2023-07-27T20:33:23.200763+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:51:11.330900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"46'2","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.699210+0000","last_change":"2023-07-27T20:33:21.205310+0000","last_active":"2023-07-27T20:33:23.699210+0000","last_peered":"2023-07-27T20:33:23.699210+0000","last_clean":"2023-07-27T20:33:23.699210+0000","last_became_active":"2023-07-27T20:33:21.205052+0000","last_became_peered":"2023-07-27T20:33:21.205052+0000","last_unstale":"2023-07-27T20:33:23.699210+0000","last_undegraded":"2023-07-27T20:33:23.699210+0000","last_fullsized":"2023-07-27T20:33:23.699210+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:46:29.004440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.13","version":"40'2","reported_seq":27,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.081019+0000","last_change":"2023-07-27T20:32:59.581127+0000","last_active":"2023-07-27T20:33:24.081019+0000","last_peered":"2023-07-27T20:33:24.081019+0000","last_clean":"2023-07-27T20:33:24.081019+0000","last_became_active":"2023-07-27T20:32:59.580831+0000","last_became_peered":"2023-07-27T20:32:59.580831+0000","last_unstale":"2023-07-27T20:33:24.081019+0000","last_undegraded":"2023-07-27T20:33:24.081019+0000","last_fullsized":"2023-07-27T20:33:24.081019+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:25:16.041803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.202539+0000","last_change":"2023-07-27T20:33:00.594625+0000","last_active":"2023-07-27T20:33:23.202539+0000","last_peered":"2023-07-27T20:33:23.202539+0000","last_clean":"2023-07-27T20:33:23.202539+0000","last_became_active":"2023-07-27T20:33:00.594342+0000","last_became_peered":"2023-07-27T20:33:00.594342+0000","last_unstale":"2023-07-27T20:33:23.202539+0000","last_undegraded":"2023-07-27T20:33:23.202539+0000","last_fullsized":"2023-07-27T20:33:23.202539+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:31:32.906330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1d","version":"46'2","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.201137+0000","last_change":"2023-07-27T20:33:21.197580+0000","last_active":"2023-07-27T20:33:23.201137+0000","last_peered":"2023-07-27T20:33:23.201137+0000","last_clean":"2023-07-27T20:33:23.201137+0000","last_became_active":"2023-07-27T20:33:21.197289+0000","last_became_peered":"2023-07-27T20:33:21.197289+0000","last_unstale":"2023-07-27T20:33:23.201137+0000","last_undegraded":"2023-07-27T20:33:23.201137+0000","last_fullsized":"2023-07-27T20:33:23.201137+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:20:26.106493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.200774+0000","last_change":"2023-07-27T20:33:22.210866+0000","last_active":"2023-07-27T20:33:23.200774+0000","last_peered":"2023-07-27T20:33:23.200774+0000","last_clean":"2023-07-27T20:33:23.200774+0000","last_became_active":"2023-07-27T20:33:22.210584+0000","last_became_peered":"2023-07-27T20:33:22.210584+0000","last_unstale":"2023-07-27T20:33:23.200774+0000","last_undegraded":"2023-07-27T20:33:23.200774+0000","last_fullsized":"2023-07-27T20:33:23.200774+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:19:42.889441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"43'9","reported_seq":34,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.025690+0000","last_change":"2023-07-27T20:32:59.583956+0000","last_active":"2023-07-27T20:33:24.025690+0000","last_peered":"2023-07-27T20:33:24.025690+0000","last_clean":"2023-07-27T20:33:24.025690+0000","last_became_active":"2023-07-27T20:32:59.583495+0000","last_became_peered":"2023-07-27T20:32:59.583495+0000","last_unstale":"2023-07-27T20:33:24.025690+0000","last_undegraded":"2023-07-27T20:33:24.025690+0000","last_fullsized":"2023-07-27T20:33:24.025690+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:27:14.018503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3261,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.203949+0000","last_change":"2023-07-27T20:33:00.591576+0000","last_active":"2023-07-27T20:33:23.203949+0000","last_peered":"2023-07-27T20:33:23.203949+0000","last_clean":"2023-07-27T20:33:23.203949+0000","last_became_active":"2023-07-27T20:33:00.591241+0000","last_became_peered":"2023-07-27T20:33:00.591241+0000","last_unstale":"2023-07-27T20:33:23.203949+0000","last_undegraded":"2023-07-27T20:33:23.203949+0000","last_fullsized":"2023-07-27T20:33:23.203949+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:43:05.077425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1a","version":"46'1","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.200990+0000","last_change":"2023-07-27T20:33:21.197723+0000","last_active":"2023-07-27T20:33:23.200990+0000","last_peered":"2023-07-27T20:33:23.200990+0000","last_clean":"2023-07-27T20:33:23.200990+0000","last_became_active":"2023-07-27T20:33:21.197418+0000","last_became_peered":"2023-07-27T20:33:21.197418+0000","last_unstale":"2023-07-27T20:33:23.200990+0000","last_undegraded":"2023-07-27T20:33:23.200990+0000","last_fullsized":"2023-07-27T20:33:23.200990+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:57:37.909072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.081923+0000","last_change":"2023-07-27T20:33:22.200524+0000","last_active":"2023-07-27T20:33:24.081923+0000","last_peered":"2023-07-27T20:33:24.081923+0000","last_clean":"2023-07-27T20:33:24.081923+0000","last_became_active":"2023-07-27T20:33:22.200270+0000","last_became_peered":"2023-07-27T20:33:22.200270+0000","last_unstale":"2023-07-27T20:33:24.081923+0000","last_undegraded":"2023-07-27T20:33:24.081923+0000","last_fullsized":"2023-07-27T20:33:24.081923+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:20:27.114899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"40'3","reported_seq":28,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.202483+0000","last_change":"2023-07-27T20:32:59.579139+0000","last_active":"2023-07-27T20:33:23.202483+0000","last_peered":"2023-07-27T20:33:23.202483+0000","last_clean":"2023-07-27T20:33:23.202483+0000","last_became_active":"2023-07-27T20:32:59.578856+0000","last_became_peered":"2023-07-27T20:32:59.578856+0000","last_unstale":"2023-07-27T20:33:23.202483+0000","last_undegraded":"2023-07-27T20:33:23.202483+0000","last_fullsized":"2023-07-27T20:33:23.202483+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:43:01.084177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.081785+0000","last_change":"2023-07-27T20:33:00.585029+0000","last_active":"2023-07-27T20:33:24.081785+0000","last_peered":"2023-07-27T20:33:24.081785+0000","last_clean":"2023-07-27T20:33:24.081785+0000","last_became_active":"2023-07-27T20:33:00.584714+0000","last_became_peered":"2023-07-27T20:33:00.584714+0000","last_unstale":"2023-07-27T20:33:24.081785+0000","last_undegraded":"2023-07-27T20:33:24.081785+0000","last_fullsized":"2023-07-27T20:33:24.081785+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:56:49.337207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"46'1","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.201562+0000","last_change":"2023-07-27T20:33:21.204147+0000","last_active":"2023-07-27T20:33:23.201562+0000","last_peered":"2023-07-27T20:33:23.201562+0000","last_clean":"2023-07-27T20:33:23.201562+0000","last_became_active":"2023-07-27T20:33:21.203824+0000","last_became_peered":"2023-07-27T20:33:21.203824+0000","last_unstale":"2023-07-27T20:33:23.201562+0000","last_undegraded":"2023-07-27T20:33:23.201562+0000","last_fullsized":"2023-07-27T20:33:23.201562+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:25:21.756918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.081572+0000","last_change":"2023-07-27T20:33:22.205448+0000","last_active":"2023-07-27T20:33:24.081572+0000","last_peered":"2023-07-27T20:33:24.081572+0000","last_clean":"2023-07-27T20:33:24.081572+0000","last_became_active":"2023-07-27T20:33:22.203077+0000","last_became_peered":"2023-07-27T20:33:22.203077+0000","last_unstale":"2023-07-27T20:33:24.081572+0000","last_undegraded":"2023-07-27T20:33:24.081572+0000","last_fullsized":"2023-07-27T20:33:24.081572+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:19:42.889441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":25,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.201100+0000","last_change":"2023-07-27T20:32:59.577773+0000","last_active":"2023-07-27T20:33:23.201100+0000","last_peered":"2023-07-27T20:33:23.201100+0000","last_clean":"2023-07-27T20:33:23.201100+0000","last_became_active":"2023-07-27T20:32:59.577537+0000","last_became_peered":"2023-07-27T20:32:59.577537+0000","last_unstale":"2023-07-27T20:33:23.201100+0000","last_undegraded":"2023-07-27T20:33:23.201100+0000","last_fullsized":"2023-07-27T20:33:23.201100+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:18:59.502113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.202053+0000","last_change":"2023-07-27T20:33:00.586432+0000","last_active":"2023-07-27T20:33:23.202053+0000","last_peered":"2023-07-27T20:33:23.202053+0000","last_clean":"2023-07-27T20:33:23.202053+0000","last_became_active":"2023-07-27T20:33:00.586115+0000","last_became_peered":"2023-07-27T20:33:00.586115+0000","last_unstale":"2023-07-27T20:33:23.202053+0000","last_undegraded":"2023-07-27T20:33:23.202053+0000","last_fullsized":"2023-07-27T20:33:23.202053+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:49:48.098719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.201577+0000","last_change":"2023-07-27T20:33:21.209431+0000","last_active":"2023-07-27T20:33:23.201577+0000","last_peered":"2023-07-27T20:33:23.201577+0000","last_clean":"2023-07-27T20:33:23.201577+0000","last_became_active":"2023-07-27T20:33:21.209107+0000","last_became_peered":"2023-07-27T20:33:21.209107+0000","last_unstale":"2023-07-27T20:33:23.201577+0000","last_undegraded":"2023-07-27T20:33:23.201577+0000","last_fullsized":"2023-07-27T20:33:23.201577+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:21:18.573638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.081414+0000","last_change":"2023-07-27T20:33:22.208040+0000","last_active":"2023-07-27T20:33:24.081414+0000","last_peered":"2023-07-27T20:33:24.081414+0000","last_clean":"2023-07-27T20:33:24.081414+0000","last_became_active":"2023-07-27T20:33:22.207558+0000","last_became_peered":"2023-07-27T20:33:22.207558+0000","last_unstale":"2023-07-27T20:33:24.081414+0000","last_undegraded":"2023-07-27T20:33:24.081414+0000","last_fullsized":"2023-07-27T20:33:24.081414+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:25:22.765324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":25,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.201643+0000","last_change":"2023-07-27T20:32:59.580000+0000","last_active":"2023-07-27T20:33:23.201643+0000","last_peered":"2023-07-27T20:33:23.201643+0000","last_clean":"2023-07-27T20:33:23.201643+0000","last_became_active":"2023-07-27T20:32:59.579693+0000","last_became_peered":"2023-07-27T20:32:59.579693+0000","last_unstale":"2023-07-27T20:33:23.201643+0000","last_undegraded":"2023-07-27T20:33:23.201643+0000","last_fullsized":"2023-07-27T20:33:23.201643+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:00:59.170279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.202434+0000","last_change":"2023-07-27T20:33:00.572761+0000","last_active":"2023-07-27T20:33:23.202434+0000","last_peered":"2023-07-27T20:33:23.202434+0000","last_clean":"2023-07-27T20:33:23.202434+0000","last_became_active":"2023-07-27T20:33:00.572373+0000","last_became_peered":"2023-07-27T20:33:00.572373+0000","last_unstale":"2023-07-27T20:33:23.202434+0000","last_undegraded":"2023-07-27T20:33:23.202434+0000","last_fullsized":"2023-07-27T20:33:23.202434+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:56:49.337207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.699320+0000","last_change":"2023-07-27T20:33:21.206372+0000","last_active":"2023-07-27T20:33:23.699320+0000","last_peered":"2023-07-27T20:33:23.699320+0000","last_clean":"2023-07-27T20:33:23.699320+0000","last_became_active":"2023-07-27T20:33:21.206116+0000","last_became_peered":"2023-07-27T20:33:21.206116+0000","last_unstale":"2023-07-27T20:33:23.699320+0000","last_undegraded":"2023-07-27T20:33:23.699320+0000","last_fullsized":"2023-07-27T20:33:23.699320+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:12:06.295605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.205083+0000","last_change":"2023-07-27T20:33:22.214609+0000","last_active":"2023-07-27T20:33:23.205083+0000","last_peered":"2023-07-27T20:33:23.205083+0000","last_clean":"2023-07-27T20:33:23.205083+0000","last_became_active":"2023-07-27T20:33:22.214345+0000","last_became_peered":"2023-07-27T20:33:22.214345+0000","last_unstale":"2023-07-27T20:33:23.205083+0000","last_undegraded":"2023-07-27T20:33:23.205083+0000","last_fullsized":"2023-07-27T20:33:23.205083+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:34:08.633953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":25,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.200140+0000","last_change":"2023-07-27T20:32:59.577003+0000","last_active":"2023-07-27T20:33:23.200140+0000","last_peered":"2023-07-27T20:33:23.200140+0000","last_clean":"2023-07-27T20:33:23.200140+0000","last_became_active":"2023-07-27T20:32:59.576722+0000","last_became_peered":"2023-07-27T20:32:59.576722+0000","last_unstale":"2023-07-27T20:33:23.200140+0000","last_undegraded":"2023-07-27T20:33:23.200140+0000","last_fullsized":"2023-07-27T20:33:23.200140+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:43:04.070113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.203188+0000","last_change":"2023-07-27T20:33:00.590399+0000","last_active":"2023-07-27T20:33:23.203188+0000","last_peered":"2023-07-27T20:33:23.203188+0000","last_clean":"2023-07-27T20:33:23.203188+0000","last_became_active":"2023-07-27T20:33:00.590134+0000","last_became_peered":"2023-07-27T20:33:00.590134+0000","last_unstale":"2023-07-27T20:33:23.203188+0000","last_undegraded":"2023-07-27T20:33:23.203188+0000","last_fullsized":"2023-07-27T20:33:23.203188+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:47:02.186816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.082376+0000","last_change":"2023-07-27T20:33:21.205220+0000","last_active":"2023-07-27T20:33:24.082376+0000","last_peered":"2023-07-27T20:33:24.082376+0000","last_clean":"2023-07-27T20:33:24.082376+0000","last_became_active":"2023-07-27T20:33:21.204967+0000","last_became_peered":"2023-07-27T20:33:21.204967+0000","last_unstale":"2023-07-27T20:33:24.082376+0000","last_undegraded":"2023-07-27T20:33:24.082376+0000","last_fullsized":"2023-07-27T20:33:24.082376+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:10:57.432068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.202296+0000","last_change":"2023-07-27T20:33:22.214840+0000","last_active":"2023-07-27T20:33:23.202296+0000","last_peered":"2023-07-27T20:33:23.202296+0000","last_clean":"2023-07-27T20:33:23.202296+0000","last_became_active":"2023-07-27T20:33:22.214233+0000","last_became_peered":"2023-07-27T20:33:22.214233+0000","last_unstale":"2023-07-27T20:33:23.202296+0000","last_undegraded":"2023-07-27T20:33:23.202296+0000","last_fullsized":"2023-07-27T20:33:23.202296+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:23:56.888875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":25,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.699329+0000","last_change":"2023-07-27T20:32:59.588694+0000","last_active":"2023-07-27T20:33:23.699329+0000","last_peered":"2023-07-27T20:33:23.699329+0000","last_clean":"2023-07-27T20:33:23.699329+0000","last_became_active":"2023-07-27T20:32:59.588450+0000","last_became_peered":"2023-07-27T20:32:59.588450+0000","last_unstale":"2023-07-27T20:33:23.699329+0000","last_undegraded":"2023-07-27T20:33:23.699329+0000","last_fullsized":"2023-07-27T20:33:23.699329+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:48:41.947121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.200018+0000","last_change":"2023-07-27T20:33:00.593317+0000","last_active":"2023-07-27T20:33:23.200018+0000","last_peered":"2023-07-27T20:33:23.200018+0000","last_clean":"2023-07-27T20:33:23.200018+0000","last_became_active":"2023-07-27T20:33:00.593040+0000","last_became_peered":"2023-07-27T20:33:00.593040+0000","last_unstale":"2023-07-27T20:33:23.200018+0000","last_undegraded":"2023-07-27T20:33:23.200018+0000","last_fullsized":"2023-07-27T20:33:23.200018+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:52:36.612619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.202506+0000","last_change":"2023-07-27T20:33:21.202563+0000","last_active":"2023-07-27T20:33:23.202506+0000","last_peered":"2023-07-27T20:33:23.202506+0000","last_clean":"2023-07-27T20:33:23.202506+0000","last_became_active":"2023-07-27T20:33:21.202250+0000","last_became_peered":"2023-07-27T20:33:21.202250+0000","last_unstale":"2023-07-27T20:33:23.202506+0000","last_undegraded":"2023-07-27T20:33:23.202506+0000","last_fullsized":"2023-07-27T20:33:23.202506+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:03:09.134740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.202269+0000","last_change":"2023-07-27T20:33:22.212272+0000","last_active":"2023-07-27T20:33:23.202269+0000","last_peered":"2023-07-27T20:33:23.202269+0000","last_clean":"2023-07-27T20:33:23.202269+0000","last_became_active":"2023-07-27T20:33:22.211964+0000","last_became_peered":"2023-07-27T20:33:22.211964+0000","last_unstale":"2023-07-27T20:33:23.202269+0000","last_undegraded":"2023-07-27T20:33:23.202269+0000","last_fullsized":"2023-07-27T20:33:23.202269+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:12:20.518795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"40'1","reported_seq":26,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.202756+0000","last_change":"2023-07-27T20:32:59.584387+0000","last_active":"2023-07-27T20:33:23.202756+0000","last_peered":"2023-07-27T20:33:23.202756+0000","last_clean":"2023-07-27T20:33:23.202756+0000","last_became_active":"2023-07-27T20:32:59.584123+0000","last_became_peered":"2023-07-27T20:32:59.584123+0000","last_unstale":"2023-07-27T20:33:23.202756+0000","last_undegraded":"2023-07-27T20:33:23.202756+0000","last_fullsized":"2023-07-27T20:33:23.202756+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:45:14.095659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.200707+0000","last_change":"2023-07-27T20:33:00.582438+0000","last_active":"2023-07-27T20:33:23.200707+0000","last_peered":"2023-07-27T20:33:23.200707+0000","last_clean":"2023-07-27T20:33:23.200707+0000","last_became_active":"2023-07-27T20:33:00.582148+0000","last_became_peered":"2023-07-27T20:33:00.582148+0000","last_unstale":"2023-07-27T20:33:23.200707+0000","last_undegraded":"2023-07-27T20:33:23.200707+0000","last_fullsized":"2023-07-27T20:33:23.200707+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:22:57.457699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"46'6","reported_seq":19,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.202063+0000","last_change":"2023-07-27T20:33:21.207637+0000","last_active":"2023-07-27T20:33:23.202063+0000","last_peered":"2023-07-27T20:33:23.202063+0000","last_clean":"2023-07-27T20:33:23.202063+0000","last_became_active":"2023-07-27T20:33:21.207329+0000","last_became_peered":"2023-07-27T20:33:21.207329+0000","last_unstale":"2023-07-27T20:33:23.202063+0000","last_undegraded":"2023-07-27T20:33:23.202063+0000","last_fullsized":"2023-07-27T20:33:23.202063+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:11:14.366124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.201288+0000","last_change":"2023-07-27T20:33:22.214525+0000","last_active":"2023-07-27T20:33:23.201288+0000","last_peered":"2023-07-27T20:33:23.201288+0000","last_clean":"2023-07-27T20:33:23.201288+0000","last_became_active":"2023-07-27T20:33:22.214130+0000","last_became_peered":"2023-07-27T20:33:22.214130+0000","last_unstale":"2023-07-27T20:33:23.201288+0000","last_undegraded":"2023-07-27T20:33:23.201288+0000","last_fullsized":"2023-07-27T20:33:23.201288+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:18:50.888278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1b","version":"40'1","reported_seq":26,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.080898+0000","last_change":"2023-07-27T20:32:59.580842+0000","last_active":"2023-07-27T20:33:24.080898+0000","last_peered":"2023-07-27T20:33:24.080898+0000","last_clean":"2023-07-27T20:33:24.080898+0000","last_became_active":"2023-07-27T20:32:59.580445+0000","last_became_peered":"2023-07-27T20:32:59.580445+0000","last_unstale":"2023-07-27T20:33:24.080898+0000","last_undegraded":"2023-07-27T20:33:24.080898+0000","last_fullsized":"2023-07-27T20:33:24.080898+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:14:49.492531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.202490+0000","last_change":"2023-07-27T20:33:00.596464+0000","last_active":"2023-07-27T20:33:23.202490+0000","last_peered":"2023-07-27T20:33:23.202490+0000","last_clean":"2023-07-27T20:33:23.202490+0000","last_became_active":"2023-07-27T20:33:00.596200+0000","last_became_peered":"2023-07-27T20:33:00.596200+0000","last_unstale":"2023-07-27T20:33:23.202490+0000","last_undegraded":"2023-07-27T20:33:23.202490+0000","last_fullsized":"2023-07-27T20:33:23.202490+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:28:47.448212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"46'3","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.204049+0000","last_change":"2023-07-27T20:33:21.203092+0000","last_active":"2023-07-27T20:33:23.204049+0000","last_peered":"2023-07-27T20:33:23.204049+0000","last_clean":"2023-07-27T20:33:23.204049+0000","last_became_active":"2023-07-27T20:33:21.202806+0000","last_became_peered":"2023-07-27T20:33:21.202806+0000","last_unstale":"2023-07-27T20:33:23.204049+0000","last_undegraded":"2023-07-27T20:33:23.204049+0000","last_fullsized":"2023-07-27T20:33:23.204049+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:40:29.982125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.776607+0000","last_change":"2023-07-27T20:33:22.212805+0000","last_active":"2023-07-27T20:33:23.776607+0000","last_peered":"2023-07-27T20:33:23.776607+0000","last_clean":"2023-07-27T20:33:23.776607+0000","last_became_active":"2023-07-27T20:33:22.212291+0000","last_became_peered":"2023-07-27T20:33:22.212291+0000","last_unstale":"2023-07-27T20:33:23.776607+0000","last_undegraded":"2023-07-27T20:33:23.776607+0000","last_fullsized":"2023-07-27T20:33:23.776607+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:13:46.776580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"40'2","reported_seq":27,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.200990+0000","last_change":"2023-07-27T20:32:59.583845+0000","last_active":"2023-07-27T20:33:23.200990+0000","last_peered":"2023-07-27T20:33:23.200990+0000","last_clean":"2023-07-27T20:33:23.200990+0000","last_became_active":"2023-07-27T20:32:59.583553+0000","last_became_peered":"2023-07-27T20:32:59.583553+0000","last_unstale":"2023-07-27T20:33:23.200990+0000","last_undegraded":"2023-07-27T20:33:23.200990+0000","last_fullsized":"2023-07-27T20:33:23.200990+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:02:02.608203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.776902+0000","last_change":"2023-07-27T20:33:00.600434+0000","last_active":"2023-07-27T20:33:23.776902+0000","last_peered":"2023-07-27T20:33:23.776902+0000","last_clean":"2023-07-27T20:33:23.776902+0000","last_became_active":"2023-07-27T20:33:00.599887+0000","last_became_peered":"2023-07-27T20:33:00.599887+0000","last_unstale":"2023-07-27T20:33:23.776902+0000","last_undegraded":"2023-07-27T20:33:23.776902+0000","last_fullsized":"2023-07-27T20:33:23.776902+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:11:33.494554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.202176+0000","last_change":"2023-07-27T20:33:21.205586+0000","last_active":"2023-07-27T20:33:23.202176+0000","last_peered":"2023-07-27T20:33:23.202176+0000","last_clean":"2023-07-27T20:33:23.202176+0000","last_became_active":"2023-07-27T20:33:21.205323+0000","last_became_peered":"2023-07-27T20:33:21.205323+0000","last_unstale":"2023-07-27T20:33:23.202176+0000","last_undegraded":"2023-07-27T20:33:23.202176+0000","last_fullsized":"2023-07-27T20:33:23.202176+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:26:18.215542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.201839+0000","last_change":"2023-07-27T20:33:22.205793+0000","last_active":"2023-07-27T20:33:23.201839+0000","last_peered":"2023-07-27T20:33:23.201839+0000","last_clean":"2023-07-27T20:33:23.201839+0000","last_became_active":"2023-07-27T20:33:22.205129+0000","last_became_peered":"2023-07-27T20:33:22.205129+0000","last_unstale":"2023-07-27T20:33:23.201839+0000","last_undegraded":"2023-07-27T20:33:23.201839+0000","last_fullsized":"2023-07-27T20:33:23.201839+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:34:26.313568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1d","version":"40'2","reported_seq":27,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.777157+0000","last_change":"2023-07-27T20:32:59.584693+0000","last_active":"2023-07-27T20:33:23.777157+0000","last_peered":"2023-07-27T20:33:23.777157+0000","last_clean":"2023-07-27T20:33:23.777157+0000","last_became_active":"2023-07-27T20:32:59.584388+0000","last_became_peered":"2023-07-27T20:32:59.584388+0000","last_unstale":"2023-07-27T20:33:23.777157+0000","last_undegraded":"2023-07-27T20:33:23.777157+0000","last_fullsized":"2023-07-27T20:33:23.777157+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:22:30.005362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.699640+0000","last_change":"2023-07-27T20:33:00.585983+0000","last_active":"2023-07-27T20:33:23.699640+0000","last_peered":"2023-07-27T20:33:23.699640+0000","last_clean":"2023-07-27T20:33:23.699640+0000","last_became_active":"2023-07-27T20:33:00.585714+0000","last_became_peered":"2023-07-27T20:33:00.585714+0000","last_unstale":"2023-07-27T20:33:23.699640+0000","last_undegraded":"2023-07-27T20:33:23.699640+0000","last_fullsized":"2023-07-27T20:33:23.699640+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:52:26.371916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"46'2","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.082173+0000","last_change":"2023-07-27T20:33:21.205388+0000","last_active":"2023-07-27T20:33:24.082173+0000","last_peered":"2023-07-27T20:33:24.082173+0000","last_clean":"2023-07-27T20:33:24.082173+0000","last_became_active":"2023-07-27T20:33:21.204960+0000","last_became_peered":"2023-07-27T20:33:21.204960+0000","last_unstale":"2023-07-27T20:33:24.082173+0000","last_undegraded":"2023-07-27T20:33:24.082173+0000","last_fullsized":"2023-07-27T20:33:24.082173+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:09:56.836701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.699087+0000","last_change":"2023-07-27T20:33:22.213137+0000","last_active":"2023-07-27T20:33:23.699087+0000","last_peered":"2023-07-27T20:33:23.699087+0000","last_clean":"2023-07-27T20:33:23.699087+0000","last_became_active":"2023-07-27T20:33:22.212667+0000","last_became_peered":"2023-07-27T20:33:22.212667+0000","last_unstale":"2023-07-27T20:33:23.699087+0000","last_undegraded":"2023-07-27T20:33:23.699087+0000","last_fullsized":"2023-07-27T20:33:23.699087+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:47:17.863710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1e","version":"40'1","reported_seq":26,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.202853+0000","last_change":"2023-07-27T20:32:59.578355+0000","last_active":"2023-07-27T20:33:23.202853+0000","last_peered":"2023-07-27T20:33:23.202853+0000","last_clean":"2023-07-27T20:33:23.202853+0000","last_became_active":"2023-07-27T20:32:59.577716+0000","last_became_peered":"2023-07-27T20:32:59.577716+0000","last_unstale":"2023-07-27T20:33:23.202853+0000","last_undegraded":"2023-07-27T20:33:23.202853+0000","last_fullsized":"2023-07-27T20:33:23.202853+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:09:35.221686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.202491+0000","last_change":"2023-07-27T20:33:00.593205+0000","last_active":"2023-07-27T20:33:23.202491+0000","last_peered":"2023-07-27T20:33:23.202491+0000","last_clean":"2023-07-27T20:33:23.202491+0000","last_became_active":"2023-07-27T20:33:00.592912+0000","last_became_peered":"2023-07-27T20:33:00.592912+0000","last_unstale":"2023-07-27T20:33:23.202491+0000","last_undegraded":"2023-07-27T20:33:23.202491+0000","last_fullsized":"2023-07-27T20:33:23.202491+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:07:49.860246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"46'8","reported_seq":21,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.201304+0000","last_change":"2023-07-27T20:33:21.204006+0000","last_active":"2023-07-27T20:33:23.201304+0000","last_peered":"2023-07-27T20:33:23.201304+0000","last_clean":"2023-07-27T20:33:23.201304+0000","last_became_active":"2023-07-27T20:33:21.203711+0000","last_became_peered":"2023-07-27T20:33:21.203711+0000","last_unstale":"2023-07-27T20:33:23.201304+0000","last_undegraded":"2023-07-27T20:33:23.201304+0000","last_fullsized":"2023-07-27T20:33:23.201304+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:36:30.484355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.201571+0000","last_change":"2023-07-27T20:33:22.215235+0000","last_active":"2023-07-27T20:33:23.201571+0000","last_peered":"2023-07-27T20:33:23.201571+0000","last_clean":"2023-07-27T20:33:23.201571+0000","last_became_active":"2023-07-27T20:33:22.214908+0000","last_became_peered":"2023-07-27T20:33:22.214908+0000","last_unstale":"2023-07-27T20:33:23.201571+0000","last_undegraded":"2023-07-27T20:33:23.201571+0000","last_fullsized":"2023-07-27T20:33:23.201571+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:21:17.470044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"40'4","reported_seq":29,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.080938+0000","last_change":"2023-07-27T20:32:59.584807+0000","last_active":"2023-07-27T20:33:24.080938+0000","last_peered":"2023-07-27T20:33:24.080938+0000","last_clean":"2023-07-27T20:33:24.080938+0000","last_became_active":"2023-07-27T20:32:59.584538+0000","last_became_peered":"2023-07-27T20:32:59.584538+0000","last_unstale":"2023-07-27T20:33:24.080938+0000","last_undegraded":"2023-07-27T20:33:24.080938+0000","last_fullsized":"2023-07-27T20:33:24.080938+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:58.545881+0000","last_clean_scrub_stamp":"2023-07-27T20:32:58.545881+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:40:08.367110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.777162+0000","last_change":"2023-07-27T20:33:00.588040+0000","last_active":"2023-07-27T20:33:23.777162+0000","last_peered":"2023-07-27T20:33:23.777162+0000","last_clean":"2023-07-27T20:33:23.777162+0000","last_became_active":"2023-07-27T20:33:00.587701+0000","last_became_peered":"2023-07-27T20:33:00.587701+0000","last_unstale":"2023-07-27T20:33:23.777162+0000","last_undegraded":"2023-07-27T20:33:23.777162+0000","last_fullsized":"2023-07-27T20:33:23.777162+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:12:09.667517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.699002+0000","last_change":"2023-07-27T20:33:21.199731+0000","last_active":"2023-07-27T20:33:23.699002+0000","last_peered":"2023-07-27T20:33:23.699002+0000","last_clean":"2023-07-27T20:33:23.699002+0000","last_became_active":"2023-07-27T20:33:21.199406+0000","last_became_peered":"2023-07-27T20:33:21.199406+0000","last_unstale":"2023-07-27T20:33:23.699002+0000","last_undegraded":"2023-07-27T20:33:23.699002+0000","last_fullsized":"2023-07-27T20:33:23.699002+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:20.160896+0000","last_clean_scrub_stamp":"2023-07-27T20:33:20.160896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:59:19.181509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.201446+0000","last_change":"2023-07-27T20:33:22.214706+0000","last_active":"2023-07-27T20:33:23.201446+0000","last_peered":"2023-07-27T20:33:23.201446+0000","last_clean":"2023-07-27T20:33:23.201446+0000","last_became_active":"2023-07-27T20:33:22.214450+0000","last_became_peered":"2023-07-27T20:33:22.214450+0000","last_unstale":"2023-07-27T20:33:23.201446+0000","last_undegraded":"2023-07-27T20:33:23.201446+0000","last_fullsized":"2023-07-27T20:33:23.201446+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:38:50.250901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.201489+0000","last_change":"2023-07-27T20:33:22.210584+0000","last_active":"2023-07-27T20:33:23.201489+0000","last_peered":"2023-07-27T20:33:23.201489+0000","last_clean":"2023-07-27T20:33:23.201489+0000","last_became_active":"2023-07-27T20:33:22.210288+0000","last_became_peered":"2023-07-27T20:33:22.210288+0000","last_unstale":"2023-07-27T20:33:23.201489+0000","last_undegraded":"2023-07-27T20:33:23.201489+0000","last_fullsized":"2023-07-27T20:33:23.201489+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:29:01.191769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.025807+0000","last_change":"2023-07-27T20:33:00.592631+0000","last_active":"2023-07-27T20:33:24.025807+0000","last_peered":"2023-07-27T20:33:24.025807+0000","last_clean":"2023-07-27T20:33:24.025807+0000","last_became_active":"2023-07-27T20:33:00.592323+0000","last_became_peered":"2023-07-27T20:33:00.592323+0000","last_unstale":"2023-07-27T20:33:24.025807+0000","last_undegraded":"2023-07-27T20:33:24.025807+0000","last_fullsized":"2023-07-27T20:33:24.025807+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:49:17.774438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.082351+0000","last_change":"2023-07-27T20:33:22.209131+0000","last_active":"2023-07-27T20:33:24.082351+0000","last_peered":"2023-07-27T20:33:24.082351+0000","last_clean":"2023-07-27T20:33:24.082351+0000","last_became_active":"2023-07-27T20:33:22.208886+0000","last_became_peered":"2023-07-27T20:33:22.208886+0000","last_unstale":"2023-07-27T20:33:24.082351+0000","last_undegraded":"2023-07-27T20:33:24.082351+0000","last_fullsized":"2023-07-27T20:33:24.082351+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:20:00.383384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.081505+0000","last_change":"2023-07-27T20:33:00.586163+0000","last_active":"2023-07-27T20:33:24.081505+0000","last_peered":"2023-07-27T20:33:24.081505+0000","last_clean":"2023-07-27T20:33:24.081505+0000","last_became_active":"2023-07-27T20:33:00.585656+0000","last_became_peered":"2023-07-27T20:33:00.585656+0000","last_unstale":"2023-07-27T20:33:24.081505+0000","last_undegraded":"2023-07-27T20:33:24.081505+0000","last_fullsized":"2023-07-27T20:33:24.081505+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:23:51.495120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.081726+0000","last_change":"2023-07-27T20:33:22.217908+0000","last_active":"2023-07-27T20:33:24.081726+0000","last_peered":"2023-07-27T20:33:24.081726+0000","last_clean":"2023-07-27T20:33:24.081726+0000","last_became_active":"2023-07-27T20:33:22.217613+0000","last_became_peered":"2023-07-27T20:33:22.217613+0000","last_unstale":"2023-07-27T20:33:24.081726+0000","last_undegraded":"2023-07-27T20:33:24.081726+0000","last_fullsized":"2023-07-27T20:33:24.081726+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:12:20.518795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.202353+0000","last_change":"2023-07-27T20:33:00.578692+0000","last_active":"2023-07-27T20:33:23.202353+0000","last_peered":"2023-07-27T20:33:23.202353+0000","last_clean":"2023-07-27T20:33:23.202353+0000","last_became_active":"2023-07-27T20:33:00.578401+0000","last_became_peered":"2023-07-27T20:33:00.578401+0000","last_unstale":"2023-07-27T20:33:23.202353+0000","last_undegraded":"2023-07-27T20:33:23.202353+0000","last_fullsized":"2023-07-27T20:33:23.202353+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:57:17.301369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.026366+0000","last_change":"2023-07-27T20:33:22.210679+0000","last_active":"2023-07-27T20:33:24.026366+0000","last_peered":"2023-07-27T20:33:24.026366+0000","last_clean":"2023-07-27T20:33:24.026366+0000","last_became_active":"2023-07-27T20:33:22.210414+0000","last_became_peered":"2023-07-27T20:33:22.210414+0000","last_unstale":"2023-07-27T20:33:24.026366+0000","last_undegraded":"2023-07-27T20:33:24.026366+0000","last_fullsized":"2023-07-27T20:33:24.026366+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:26:31.728911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.203337+0000","last_change":"2023-07-27T20:33:00.595500+0000","last_active":"2023-07-27T20:33:23.203337+0000","last_peered":"2023-07-27T20:33:23.203337+0000","last_clean":"2023-07-27T20:33:23.203337+0000","last_became_active":"2023-07-27T20:33:00.595248+0000","last_became_peered":"2023-07-27T20:33:00.595248+0000","last_unstale":"2023-07-27T20:33:23.203337+0000","last_undegraded":"2023-07-27T20:33:23.203337+0000","last_fullsized":"2023-07-27T20:33:23.203337+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:58:41.355680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.081416+0000","last_change":"2023-07-27T20:33:22.205577+0000","last_active":"2023-07-27T20:33:24.081416+0000","last_peered":"2023-07-27T20:33:24.081416+0000","last_clean":"2023-07-27T20:33:24.081416+0000","last_became_active":"2023-07-27T20:33:22.203416+0000","last_became_peered":"2023-07-27T20:33:22.203416+0000","last_unstale":"2023-07-27T20:33:24.081416+0000","last_undegraded":"2023-07-27T20:33:24.081416+0000","last_fullsized":"2023-07-27T20:33:24.081416+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:21:19.582044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.699847+0000","last_change":"2023-07-27T20:33:00.594896+0000","last_active":"2023-07-27T20:33:23.699847+0000","last_peered":"2023-07-27T20:33:23.699847+0000","last_clean":"2023-07-27T20:33:23.699847+0000","last_became_active":"2023-07-27T20:33:00.594415+0000","last_became_peered":"2023-07-27T20:33:00.594415+0000","last_unstale":"2023-07-27T20:33:23.699847+0000","last_undegraded":"2023-07-27T20:33:23.699847+0000","last_fullsized":"2023-07-27T20:33:23.699847+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:33:31.084462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.201569+0000","last_change":"2023-07-27T20:33:22.206013+0000","last_active":"2023-07-27T20:33:23.201569+0000","last_peered":"2023-07-27T20:33:23.201569+0000","last_clean":"2023-07-27T20:33:23.201569+0000","last_became_active":"2023-07-27T20:33:22.205477+0000","last_became_peered":"2023-07-27T20:33:22.205477+0000","last_unstale":"2023-07-27T20:33:23.201569+0000","last_undegraded":"2023-07-27T20:33:23.201569+0000","last_fullsized":"2023-07-27T20:33:23.201569+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:26:31.133464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.201821+0000","last_change":"2023-07-27T20:33:00.582313+0000","last_active":"2023-07-27T20:33:23.201821+0000","last_peered":"2023-07-27T20:33:23.201821+0000","last_clean":"2023-07-27T20:33:23.201821+0000","last_became_active":"2023-07-27T20:33:00.582037+0000","last_became_peered":"2023-07-27T20:33:00.582037+0000","last_unstale":"2023-07-27T20:33:23.201821+0000","last_undegraded":"2023-07-27T20:33:23.201821+0000","last_fullsized":"2023-07-27T20:33:23.201821+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:22:57.457699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.202804+0000","last_change":"2023-07-27T20:33:22.219346+0000","last_active":"2023-07-27T20:33:23.202804+0000","last_peered":"2023-07-27T20:33:23.202804+0000","last_clean":"2023-07-27T20:33:23.202804+0000","last_became_active":"2023-07-27T20:33:22.219062+0000","last_became_peered":"2023-07-27T20:33:22.219062+0000","last_unstale":"2023-07-27T20:33:23.202804+0000","last_undegraded":"2023-07-27T20:33:23.202804+0000","last_fullsized":"2023-07-27T20:33:23.202804+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:25:05.082028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.026440+0000","last_change":"2023-07-27T20:33:00.592982+0000","last_active":"2023-07-27T20:33:24.026440+0000","last_peered":"2023-07-27T20:33:24.026440+0000","last_clean":"2023-07-27T20:33:24.026440+0000","last_became_active":"2023-07-27T20:33:00.592652+0000","last_became_peered":"2023-07-27T20:33:00.592652+0000","last_unstale":"2023-07-27T20:33:24.026440+0000","last_undegraded":"2023-07-27T20:33:24.026440+0000","last_fullsized":"2023-07-27T20:33:24.026440+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:36:59.294934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.202145+0000","last_change":"2023-07-27T20:33:22.215306+0000","last_active":"2023-07-27T20:33:23.202145+0000","last_peered":"2023-07-27T20:33:23.202145+0000","last_clean":"2023-07-27T20:33:23.202145+0000","last_became_active":"2023-07-27T20:33:22.215023+0000","last_became_peered":"2023-07-27T20:33:22.215023+0000","last_unstale":"2023-07-27T20:33:23.202145+0000","last_undegraded":"2023-07-27T20:33:23.202145+0000","last_fullsized":"2023-07-27T20:33:23.202145+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:55:04.377359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.202833+0000","last_change":"2023-07-27T20:33:00.596364+0000","last_active":"2023-07-27T20:33:23.202833+0000","last_peered":"2023-07-27T20:33:23.202833+0000","last_clean":"2023-07-27T20:33:23.202833+0000","last_became_active":"2023-07-27T20:33:00.595818+0000","last_became_peered":"2023-07-27T20:33:00.595818+0000","last_unstale":"2023-07-27T20:33:23.202833+0000","last_undegraded":"2023-07-27T20:33:23.202833+0000","last_fullsized":"2023-07-27T20:33:23.202833+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:07:51.721231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.699638+0000","last_change":"2023-07-27T20:33:22.203358+0000","last_active":"2023-07-27T20:33:23.699638+0000","last_peered":"2023-07-27T20:33:23.699638+0000","last_clean":"2023-07-27T20:33:23.699638+0000","last_became_active":"2023-07-27T20:33:22.203065+0000","last_became_peered":"2023-07-27T20:33:22.203065+0000","last_unstale":"2023-07-27T20:33:23.699638+0000","last_undegraded":"2023-07-27T20:33:23.699638+0000","last_fullsized":"2023-07-27T20:33:23.699638+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:51:02.340332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.202901+0000","last_change":"2023-07-27T20:33:00.587648+0000","last_active":"2023-07-27T20:33:23.202901+0000","last_peered":"2023-07-27T20:33:23.202901+0000","last_clean":"2023-07-27T20:33:23.202901+0000","last_became_active":"2023-07-27T20:33:00.587312+0000","last_became_peered":"2023-07-27T20:33:00.587312+0000","last_unstale":"2023-07-27T20:33:23.202901+0000","last_undegraded":"2023-07-27T20:33:23.202901+0000","last_fullsized":"2023-07-27T20:33:23.202901+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:56:25.520593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.026622+0000","last_change":"2023-07-27T20:33:22.214275+0000","last_active":"2023-07-27T20:33:24.026622+0000","last_peered":"2023-07-27T20:33:24.026622+0000","last_clean":"2023-07-27T20:33:24.026622+0000","last_became_active":"2023-07-27T20:33:22.214023+0000","last_became_peered":"2023-07-27T20:33:22.214023+0000","last_unstale":"2023-07-27T20:33:24.026622+0000","last_undegraded":"2023-07-27T20:33:24.026622+0000","last_fullsized":"2023-07-27T20:33:24.026622+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:23:57.835506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.203344+0000","last_change":"2023-07-27T20:33:00.594997+0000","last_active":"2023-07-27T20:33:23.203344+0000","last_peered":"2023-07-27T20:33:23.203344+0000","last_clean":"2023-07-27T20:33:23.203344+0000","last_became_active":"2023-07-27T20:33:00.594705+0000","last_became_peered":"2023-07-27T20:33:00.594705+0000","last_unstale":"2023-07-27T20:33:23.203344+0000","last_undegraded":"2023-07-27T20:33:23.203344+0000","last_fullsized":"2023-07-27T20:33:23.203344+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:38:09.922409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.026203+0000","last_change":"2023-07-27T20:33:22.204537+0000","last_active":"2023-07-27T20:33:24.026203+0000","last_peered":"2023-07-27T20:33:24.026203+0000","last_clean":"2023-07-27T20:33:24.026203+0000","last_became_active":"2023-07-27T20:33:22.204266+0000","last_became_peered":"2023-07-27T20:33:22.204266+0000","last_unstale":"2023-07-27T20:33:24.026203+0000","last_undegraded":"2023-07-27T20:33:24.026203+0000","last_fullsized":"2023-07-27T20:33:24.026203+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:53:22.189006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.201152+0000","last_change":"2023-07-27T20:33:00.594352+0000","last_active":"2023-07-27T20:33:23.201152+0000","last_peered":"2023-07-27T20:33:23.201152+0000","last_clean":"2023-07-27T20:33:23.201152+0000","last_became_active":"2023-07-27T20:33:00.593480+0000","last_became_peered":"2023-07-27T20:33:00.593480+0000","last_unstale":"2023-07-27T20:33:23.201152+0000","last_undegraded":"2023-07-27T20:33:23.201152+0000","last_fullsized":"2023-07-27T20:33:23.201152+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:45:15.102970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.200794+0000","last_change":"2023-07-27T20:33:22.209133+0000","last_active":"2023-07-27T20:33:23.200794+0000","last_peered":"2023-07-27T20:33:23.200794+0000","last_clean":"2023-07-27T20:33:23.200794+0000","last_became_active":"2023-07-27T20:33:22.208570+0000","last_became_peered":"2023-07-27T20:33:22.208570+0000","last_unstale":"2023-07-27T20:33:23.200794+0000","last_undegraded":"2023-07-27T20:33:23.200794+0000","last_fullsized":"2023-07-27T20:33:23.200794+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:11:15.374530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.082336+0000","last_change":"2023-07-27T20:33:00.588688+0000","last_active":"2023-07-27T20:33:24.082336+0000","last_peered":"2023-07-27T20:33:24.082336+0000","last_clean":"2023-07-27T20:33:24.082336+0000","last_became_active":"2023-07-27T20:33:00.588417+0000","last_became_peered":"2023-07-27T20:33:00.588417+0000","last_unstale":"2023-07-27T20:33:24.082336+0000","last_undegraded":"2023-07-27T20:33:24.082336+0000","last_fullsized":"2023-07-27T20:33:24.082336+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:34:41.136240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.202258+0000","last_change":"2023-07-27T20:33:22.201827+0000","last_active":"2023-07-27T20:33:23.202258+0000","last_peered":"2023-07-27T20:33:23.202258+0000","last_clean":"2023-07-27T20:33:23.202258+0000","last_became_active":"2023-07-27T20:33:22.201524+0000","last_became_peered":"2023-07-27T20:33:22.201524+0000","last_unstale":"2023-07-27T20:33:23.202258+0000","last_undegraded":"2023-07-27T20:33:23.202258+0000","last_fullsized":"2023-07-27T20:33:23.202258+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:23:34.578822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":28,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.026408+0000","last_change":"2023-07-27T20:33:11.129939+0000","last_active":"2023-07-27T20:33:24.026408+0000","last_peered":"2023-07-27T20:33:24.026408+0000","last_clean":"2023-07-27T20:33:24.026408+0000","last_became_active":"2023-07-27T20:33:11.129716+0000","last_became_peered":"2023-07-27T20:33:11.129716+0000","last_unstale":"2023-07-27T20:33:24.026408+0000","last_undegraded":"2023-07-27T20:33:24.026408+0000","last_fullsized":"2023-07-27T20:33:24.026408+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:03:22.452364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.081615+0000","last_change":"2023-07-27T20:33:22.206665+0000","last_active":"2023-07-27T20:33:24.081615+0000","last_peered":"2023-07-27T20:33:24.081615+0000","last_clean":"2023-07-27T20:33:24.081615+0000","last_became_active":"2023-07-27T20:33:22.206396+0000","last_became_peered":"2023-07-27T20:33:22.206396+0000","last_unstale":"2023-07-27T20:33:24.081615+0000","last_undegraded":"2023-07-27T20:33:24.081615+0000","last_fullsized":"2023-07-27T20:33:24.081615+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:11:15.374530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.203341+0000","last_change":"2023-07-27T20:33:00.595816+0000","last_active":"2023-07-27T20:33:23.203341+0000","last_peered":"2023-07-27T20:33:23.203341+0000","last_clean":"2023-07-27T20:33:23.203341+0000","last_became_active":"2023-07-27T20:33:00.595429+0000","last_became_peered":"2023-07-27T20:33:00.595429+0000","last_unstale":"2023-07-27T20:33:23.203341+0000","last_undegraded":"2023-07-27T20:33:23.203341+0000","last_fullsized":"2023-07-27T20:33:23.203341+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:33:28.782765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.199909+0000","last_change":"2023-07-27T20:33:22.203073+0000","last_active":"2023-07-27T20:33:23.199909+0000","last_peered":"2023-07-27T20:33:23.199909+0000","last_clean":"2023-07-27T20:33:23.199909+0000","last_became_active":"2023-07-27T20:33:22.202793+0000","last_became_peered":"2023-07-27T20:33:22.202793+0000","last_unstale":"2023-07-27T20:33:23.199909+0000","last_undegraded":"2023-07-27T20:33:23.199909+0000","last_fullsized":"2023-07-27T20:33:23.199909+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:14:18.501915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.202983+0000","last_change":"2023-07-27T20:33:00.572976+0000","last_active":"2023-07-27T20:33:23.202983+0000","last_peered":"2023-07-27T20:33:23.202983+0000","last_clean":"2023-07-27T20:33:23.202983+0000","last_became_active":"2023-07-27T20:33:00.572377+0000","last_became_peered":"2023-07-27T20:33:00.572377+0000","last_unstale":"2023-07-27T20:33:23.202983+0000","last_undegraded":"2023-07-27T20:33:23.202983+0000","last_fullsized":"2023-07-27T20:33:23.202983+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:01:02.831422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.025911+0000","last_change":"2023-07-27T20:33:22.204591+0000","last_active":"2023-07-27T20:33:24.025911+0000","last_peered":"2023-07-27T20:33:24.025911+0000","last_clean":"2023-07-27T20:33:24.025911+0000","last_became_active":"2023-07-27T20:33:22.204334+0000","last_became_peered":"2023-07-27T20:33:22.204334+0000","last_unstale":"2023-07-27T20:33:24.025911+0000","last_undegraded":"2023-07-27T20:33:24.025911+0000","last_fullsized":"2023-07-27T20:33:24.025911+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:37:53.872264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.201435+0000","last_change":"2023-07-27T20:33:00.582399+0000","last_active":"2023-07-27T20:33:23.201435+0000","last_peered":"2023-07-27T20:33:23.201435+0000","last_clean":"2023-07-27T20:33:23.201435+0000","last_became_active":"2023-07-27T20:33:00.582064+0000","last_became_peered":"2023-07-27T20:33:00.582064+0000","last_unstale":"2023-07-27T20:33:23.201435+0000","last_undegraded":"2023-07-27T20:33:23.201435+0000","last_fullsized":"2023-07-27T20:33:23.201435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:15:30.458614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.081924+0000","last_change":"2023-07-27T20:33:22.212986+0000","last_active":"2023-07-27T20:33:24.081924+0000","last_peered":"2023-07-27T20:33:24.081924+0000","last_clean":"2023-07-27T20:33:24.081924+0000","last_became_active":"2023-07-27T20:33:22.212728+0000","last_became_peered":"2023-07-27T20:33:22.212728+0000","last_unstale":"2023-07-27T20:33:24.081924+0000","last_undegraded":"2023-07-27T20:33:24.081924+0000","last_fullsized":"2023-07-27T20:33:24.081924+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:19:22.125534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.203478+0000","last_change":"2023-07-27T20:33:00.594429+0000","last_active":"2023-07-27T20:33:23.203478+0000","last_peered":"2023-07-27T20:33:23.203478+0000","last_clean":"2023-07-27T20:33:23.203478+0000","last_became_active":"2023-07-27T20:33:00.593854+0000","last_became_peered":"2023-07-27T20:33:00.593854+0000","last_unstale":"2023-07-27T20:33:23.203478+0000","last_undegraded":"2023-07-27T20:33:23.203478+0000","last_fullsized":"2023-07-27T20:33:23.203478+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:19:38.220683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.026589+0000","last_change":"2023-07-27T20:33:22.216032+0000","last_active":"2023-07-27T20:33:24.026589+0000","last_peered":"2023-07-27T20:33:24.026589+0000","last_clean":"2023-07-27T20:33:24.026589+0000","last_became_active":"2023-07-27T20:33:22.215731+0000","last_became_peered":"2023-07-27T20:33:22.215731+0000","last_unstale":"2023-07-27T20:33:24.026589+0000","last_undegraded":"2023-07-27T20:33:24.026589+0000","last_fullsized":"2023-07-27T20:33:24.026589+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:12:49.731165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.081765+0000","last_change":"2023-07-27T20:33:00.585997+0000","last_active":"2023-07-27T20:33:24.081765+0000","last_peered":"2023-07-27T20:33:24.081765+0000","last_clean":"2023-07-27T20:33:24.081765+0000","last_became_active":"2023-07-27T20:33:00.585348+0000","last_became_peered":"2023-07-27T20:33:00.585348+0000","last_unstale":"2023-07-27T20:33:24.081765+0000","last_undegraded":"2023-07-27T20:33:24.081765+0000","last_fullsized":"2023-07-27T20:33:24.081765+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:57:17.301369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.699397+0000","last_change":"2023-07-27T20:33:22.204767+0000","last_active":"2023-07-27T20:33:23.699397+0000","last_peered":"2023-07-27T20:33:23.699397+0000","last_clean":"2023-07-27T20:33:23.699397+0000","last_became_active":"2023-07-27T20:33:22.204463+0000","last_became_peered":"2023-07-27T20:33:22.204463+0000","last_unstale":"2023-07-27T20:33:23.699397+0000","last_undegraded":"2023-07-27T20:33:23.699397+0000","last_fullsized":"2023-07-27T20:33:23.699397+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:26:15.925578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.200467+0000","last_change":"2023-07-27T20:33:00.585154+0000","last_active":"2023-07-27T20:33:23.200467+0000","last_peered":"2023-07-27T20:33:23.200467+0000","last_clean":"2023-07-27T20:33:23.200467+0000","last_became_active":"2023-07-27T20:33:00.584912+0000","last_became_peered":"2023-07-27T20:33:00.584912+0000","last_unstale":"2023-07-27T20:33:23.200467+0000","last_undegraded":"2023-07-27T20:33:23.200467+0000","last_fullsized":"2023-07-27T20:33:23.200467+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:25:01.149214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.203890+0000","last_change":"2023-07-27T20:33:22.212241+0000","last_active":"2023-07-27T20:33:23.203890+0000","last_peered":"2023-07-27T20:33:23.203890+0000","last_clean":"2023-07-27T20:33:23.203890+0000","last_became_active":"2023-07-27T20:33:22.207324+0000","last_became_peered":"2023-07-27T20:33:22.207324+0000","last_unstale":"2023-07-27T20:33:23.203890+0000","last_undegraded":"2023-07-27T20:33:23.203890+0000","last_fullsized":"2023-07-27T20:33:23.203890+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:15:12.115952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.026238+0000","last_change":"2023-07-27T20:33:00.592723+0000","last_active":"2023-07-27T20:33:24.026238+0000","last_peered":"2023-07-27T20:33:24.026238+0000","last_clean":"2023-07-27T20:33:24.026238+0000","last_became_active":"2023-07-27T20:33:00.592222+0000","last_became_peered":"2023-07-27T20:33:00.592222+0000","last_unstale":"2023-07-27T20:33:24.026238+0000","last_undegraded":"2023-07-27T20:33:24.026238+0000","last_fullsized":"2023-07-27T20:33:24.026238+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:17:35.471819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.200372+0000","last_change":"2023-07-27T20:33:22.199225+0000","last_active":"2023-07-27T20:33:23.200372+0000","last_peered":"2023-07-27T20:33:23.200372+0000","last_clean":"2023-07-27T20:33:23.200372+0000","last_became_active":"2023-07-27T20:33:22.198976+0000","last_became_peered":"2023-07-27T20:33:22.198976+0000","last_unstale":"2023-07-27T20:33:23.200372+0000","last_undegraded":"2023-07-27T20:33:23.200372+0000","last_fullsized":"2023-07-27T20:33:23.200372+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:56:18.703002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.699218+0000","last_change":"2023-07-27T20:33:00.594729+0000","last_active":"2023-07-27T20:33:23.699218+0000","last_peered":"2023-07-27T20:33:23.699218+0000","last_clean":"2023-07-27T20:33:23.699218+0000","last_became_active":"2023-07-27T20:33:00.594045+0000","last_became_peered":"2023-07-27T20:33:00.594045+0000","last_unstale":"2023-07-27T20:33:23.699218+0000","last_undegraded":"2023-07-27T20:33:23.699218+0000","last_fullsized":"2023-07-27T20:33:23.699218+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:56:14.299950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.026201+0000","last_change":"2023-07-27T20:33:22.205553+0000","last_active":"2023-07-27T20:33:24.026201+0000","last_peered":"2023-07-27T20:33:24.026201+0000","last_clean":"2023-07-27T20:33:24.026201+0000","last_became_active":"2023-07-27T20:33:22.205318+0000","last_became_peered":"2023-07-27T20:33:22.205318+0000","last_unstale":"2023-07-27T20:33:24.026201+0000","last_undegraded":"2023-07-27T20:33:24.026201+0000","last_fullsized":"2023-07-27T20:33:24.026201+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:38:56.467794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.201223+0000","last_change":"2023-07-27T20:33:00.584457+0000","last_active":"2023-07-27T20:33:23.201223+0000","last_peered":"2023-07-27T20:33:23.201223+0000","last_clean":"2023-07-27T20:33:23.201223+0000","last_became_active":"2023-07-27T20:33:00.584193+0000","last_became_peered":"2023-07-27T20:33:00.584193+0000","last_unstale":"2023-07-27T20:33:23.201223+0000","last_undegraded":"2023-07-27T20:33:23.201223+0000","last_fullsized":"2023-07-27T20:33:23.201223+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:09:36.228998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.081185+0000","last_change":"2023-07-27T20:33:22.206423+0000","last_active":"2023-07-27T20:33:24.081185+0000","last_peered":"2023-07-27T20:33:24.081185+0000","last_clean":"2023-07-27T20:33:24.081185+0000","last_became_active":"2023-07-27T20:33:22.206158+0000","last_became_peered":"2023-07-27T20:33:22.206158+0000","last_unstale":"2023-07-27T20:33:24.081185+0000","last_undegraded":"2023-07-27T20:33:24.081185+0000","last_fullsized":"2023-07-27T20:33:24.081185+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:56:18.703002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.200989+0000","last_change":"2023-07-27T20:33:00.594067+0000","last_active":"2023-07-27T20:33:23.200989+0000","last_peered":"2023-07-27T20:33:23.200989+0000","last_clean":"2023-07-27T20:33:23.200989+0000","last_became_active":"2023-07-27T20:33:00.593772+0000","last_became_peered":"2023-07-27T20:33:00.593772+0000","last_unstale":"2023-07-27T20:33:23.200989+0000","last_undegraded":"2023-07-27T20:33:23.200989+0000","last_fullsized":"2023-07-27T20:33:23.200989+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:56:49.337207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.201748+0000","last_change":"2023-07-27T20:33:22.204497+0000","last_active":"2023-07-27T20:33:23.201748+0000","last_peered":"2023-07-27T20:33:23.201748+0000","last_clean":"2023-07-27T20:33:23.201748+0000","last_became_active":"2023-07-27T20:33:22.204183+0000","last_became_peered":"2023-07-27T20:33:22.204183+0000","last_unstale":"2023-07-27T20:33:23.201748+0000","last_undegraded":"2023-07-27T20:33:23.201748+0000","last_fullsized":"2023-07-27T20:33:23.201748+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:28:33.088782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.200939+0000","last_change":"2023-07-27T20:33:00.583733+0000","last_active":"2023-07-27T20:33:23.200939+0000","last_peered":"2023-07-27T20:33:23.200939+0000","last_clean":"2023-07-27T20:33:23.200939+0000","last_became_active":"2023-07-27T20:33:00.583442+0000","last_became_peered":"2023-07-27T20:33:00.583442+0000","last_unstale":"2023-07-27T20:33:23.200939+0000","last_undegraded":"2023-07-27T20:33:23.200939+0000","last_fullsized":"2023-07-27T20:33:23.200939+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:11:58.902686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.777172+0000","last_change":"2023-07-27T20:33:22.211040+0000","last_active":"2023-07-27T20:33:23.777172+0000","last_peered":"2023-07-27T20:33:23.777172+0000","last_clean":"2023-07-27T20:33:23.777172+0000","last_became_active":"2023-07-27T20:33:22.210711+0000","last_became_peered":"2023-07-27T20:33:22.210711+0000","last_unstale":"2023-07-27T20:33:23.777172+0000","last_undegraded":"2023-07-27T20:33:23.777172+0000","last_fullsized":"2023-07-27T20:33:23.777172+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:58:33.778134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.199987+0000","last_change":"2023-07-27T20:33:00.599242+0000","last_active":"2023-07-27T20:33:23.199987+0000","last_peered":"2023-07-27T20:33:23.199987+0000","last_clean":"2023-07-27T20:33:23.199987+0000","last_became_active":"2023-07-27T20:33:00.598810+0000","last_became_peered":"2023-07-27T20:33:00.598810+0000","last_unstale":"2023-07-27T20:33:23.199987+0000","last_undegraded":"2023-07-27T20:33:23.199987+0000","last_fullsized":"2023-07-27T20:33:23.199987+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:42:33.546155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.201261+0000","last_change":"2023-07-27T20:33:22.196665+0000","last_active":"2023-07-27T20:33:23.201261+0000","last_peered":"2023-07-27T20:33:23.201261+0000","last_clean":"2023-07-27T20:33:23.201261+0000","last_became_active":"2023-07-27T20:33:22.196381+0000","last_became_peered":"2023-07-27T20:33:22.196381+0000","last_unstale":"2023-07-27T20:33:23.201261+0000","last_undegraded":"2023-07-27T20:33:23.201261+0000","last_fullsized":"2023-07-27T20:33:23.201261+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:56:18.703002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.201863+0000","last_change":"2023-07-27T20:33:00.592227+0000","last_active":"2023-07-27T20:33:23.201863+0000","last_peered":"2023-07-27T20:33:23.201863+0000","last_clean":"2023-07-27T20:33:23.201863+0000","last_became_active":"2023-07-27T20:33:00.591718+0000","last_became_peered":"2023-07-27T20:33:00.591718+0000","last_unstale":"2023-07-27T20:33:23.201863+0000","last_undegraded":"2023-07-27T20:33:23.201863+0000","last_fullsized":"2023-07-27T20:33:23.201863+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:39:05.523661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.699743+0000","last_change":"2023-07-27T20:33:22.209245+0000","last_active":"2023-07-27T20:33:23.699743+0000","last_peered":"2023-07-27T20:33:23.699743+0000","last_clean":"2023-07-27T20:33:23.699743+0000","last_became_active":"2023-07-27T20:33:22.208970+0000","last_became_peered":"2023-07-27T20:33:22.208970+0000","last_unstale":"2023-07-27T20:33:23.699743+0000","last_undegraded":"2023-07-27T20:33:23.699743+0000","last_fullsized":"2023-07-27T20:33:23.699743+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:02:13.680839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:24.081473+0000","last_change":"2023-07-27T20:33:00.588002+0000","last_active":"2023-07-27T20:33:24.081473+0000","last_peered":"2023-07-27T20:33:24.081473+0000","last_clean":"2023-07-27T20:33:24.081473+0000","last_became_active":"2023-07-27T20:33:00.587552+0000","last_became_peered":"2023-07-27T20:33:00.587552+0000","last_unstale":"2023-07-27T20:33:24.081473+0000","last_undegraded":"2023-07-27T20:33:24.081473+0000","last_fullsized":"2023-07-27T20:33:24.081473+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:22:57.457699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.776919+0000","last_change":"2023-07-27T20:33:22.213030+0000","last_active":"2023-07-27T20:33:23.776919+0000","last_peered":"2023-07-27T20:33:23.776919+0000","last_clean":"2023-07-27T20:33:23.776919+0000","last_became_active":"2023-07-27T20:33:22.212641+0000","last_became_peered":"2023-07-27T20:33:22.212641+0000","last_unstale":"2023-07-27T20:33:23.776919+0000","last_undegraded":"2023-07-27T20:33:23.776919+0000","last_fullsized":"2023-07-27T20:33:23.776919+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:51:15.377583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.699339+0000","last_change":"2023-07-27T20:33:00.590369+0000","last_active":"2023-07-27T20:33:23.699339+0000","last_peered":"2023-07-27T20:33:23.699339+0000","last_clean":"2023-07-27T20:33:23.699339+0000","last_became_active":"2023-07-27T20:33:00.590016+0000","last_became_peered":"2023-07-27T20:33:00.590016+0000","last_unstale":"2023-07-27T20:33:23.699339+0000","last_undegraded":"2023-07-27T20:33:23.699339+0000","last_fullsized":"2023-07-27T20:33:23.699339+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:48:36.790780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.202129+0000","last_change":"2023-07-27T20:33:22.202413+0000","last_active":"2023-07-27T20:33:23.202129+0000","last_peered":"2023-07-27T20:33:23.202129+0000","last_clean":"2023-07-27T20:33:23.202129+0000","last_became_active":"2023-07-27T20:33:22.202141+0000","last_became_peered":"2023-07-27T20:33:22.202141+0000","last_unstale":"2023-07-27T20:33:23.202129+0000","last_undegraded":"2023-07-27T20:33:23.202129+0000","last_fullsized":"2023-07-27T20:33:23.202129+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:51:32.947009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.200408+0000","last_change":"2023-07-27T20:33:00.597501+0000","last_active":"2023-07-27T20:33:23.200408+0000","last_peered":"2023-07-27T20:33:23.200408+0000","last_clean":"2023-07-27T20:33:23.200408+0000","last_became_active":"2023-07-27T20:33:00.594645+0000","last_became_peered":"2023-07-27T20:33:00.594645+0000","last_unstale":"2023-07-27T20:33:23.200408+0000","last_undegraded":"2023-07-27T20:33:23.200408+0000","last_fullsized":"2023-07-27T20:33:23.200408+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:38:28.634792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.202762+0000","last_change":"2023-07-27T20:33:22.215959+0000","last_active":"2023-07-27T20:33:23.202762+0000","last_peered":"2023-07-27T20:33:23.202762+0000","last_clean":"2023-07-27T20:33:23.202762+0000","last_became_active":"2023-07-27T20:33:22.215684+0000","last_became_peered":"2023-07-27T20:33:22.215684+0000","last_unstale":"2023-07-27T20:33:23.202762+0000","last_undegraded":"2023-07-27T20:33:23.202762+0000","last_fullsized":"2023-07-27T20:33:23.202762+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:52:47.394981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.201701+0000","last_change":"2023-07-27T20:33:00.581650+0000","last_active":"2023-07-27T20:33:23.201701+0000","last_peered":"2023-07-27T20:33:23.201701+0000","last_clean":"2023-07-27T20:33:23.201701+0000","last_became_active":"2023-07-27T20:33:00.581308+0000","last_became_peered":"2023-07-27T20:33:00.581308+0000","last_unstale":"2023-07-27T20:33:23.201701+0000","last_undegraded":"2023-07-27T20:33:23.201701+0000","last_fullsized":"2023-07-27T20:33:23.201701+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:26:11.309191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.200333+0000","last_change":"2023-07-27T20:33:22.204721+0000","last_active":"2023-07-27T20:33:23.200333+0000","last_peered":"2023-07-27T20:33:23.200333+0000","last_clean":"2023-07-27T20:33:23.200333+0000","last_became_active":"2023-07-27T20:33:22.204436+0000","last_became_peered":"2023-07-27T20:33:22.204436+0000","last_unstale":"2023-07-27T20:33:23.200333+0000","last_undegraded":"2023-07-27T20:33:23.200333+0000","last_fullsized":"2023-07-27T20:33:23.200333+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:25:38.665224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":28,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.699859+0000","last_change":"2023-07-27T20:33:11.131899+0000","last_active":"2023-07-27T20:33:23.699859+0000","last_peered":"2023-07-27T20:33:23.699859+0000","last_clean":"2023-07-27T20:33:23.699859+0000","last_became_active":"2023-07-27T20:33:11.131474+0000","last_became_peered":"2023-07-27T20:33:11.131474+0000","last_unstale":"2023-07-27T20:33:23.699859+0000","last_undegraded":"2023-07-27T20:33:23.699859+0000","last_fullsized":"2023-07-27T20:33:23.699859+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:20:32.314975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.201899+0000","last_change":"2023-07-27T20:33:22.209149+0000","last_active":"2023-07-27T20:33:23.201899+0000","last_peered":"2023-07-27T20:33:23.201899+0000","last_clean":"2023-07-27T20:33:23.201899+0000","last_became_active":"2023-07-27T20:33:22.208840+0000","last_became_peered":"2023-07-27T20:33:22.208840+0000","last_unstale":"2023-07-27T20:33:23.201899+0000","last_undegraded":"2023-07-27T20:33:23.201899+0000","last_fullsized":"2023-07-27T20:33:23.201899+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:33:21.169302+0000","last_clean_scrub_stamp":"2023-07-27T20:33:21.169302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:24:13.111229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T20:33:23.203792+0000","last_change":"2023-07-27T20:33:00.583515+0000","last_active":"2023-07-27T20:33:23.203792+0000","last_peered":"2023-07-27T20:33:23.203792+0000","last_clean":"2023-07-27T20:33:23.203792+0000","last_became_active":"2023-07-27T20:33:00.583261+0000","last_became_peered":"2023-07-27T20:33:00.583261+0000","last_unstale":"2023-07-27T20:33:23.203792+0000","last_undegraded":"2023-07-27T20:33:23.203792+0000","last_fullsized":"2023-07-27T20:33:23.203792+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:32:59.553193+0000","last_clean_scrub_stamp":"2023-07-27T20:32:59.553193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:42:33.546155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":4059,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28156,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343684,"statfs":{"total":96636764160,"available":96607932416,"internally_reserved":0,"allocated":1155072,"data_stored":848557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:33:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.79700000000000004,"15min":0.81599999999999995},"min":{"1min":0.41799999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0589999999999999,"5min":3.5609999999999999,"15min":3.5609999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.72399999999999998,"15min":0.73199999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0620000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.64000000000000001}]},{"osd":1,"last update":"Thu Jul 27 20:33:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.71599999999999997,"15min":0.72299999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.82499999999999996,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.85999999999999999,"15min":0.88100000000000001},"min":{"1min":0.48799999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.119,"5min":3.927,"15min":3.927},"last":0.60799999999999998}]},{"osd":2,"last update":"Thu Jul 27 20:33:22 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.83899999999999997,"15min":0.85299999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.163,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.80200000000000005,"15min":0.82199999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.84099999999999997,"5min":2.093,"15min":2.093},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jul 27 20:33:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.79700000000000004,"15min":0.82399999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.92400000000000004,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.748,"5min":0.89100000000000001,"15min":0.91500000000000004},"min":{"1min":0.57099999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.238,"5min":3.1080000000000001,"15min":3.1080000000000001},"last":0.65800000000000003}]},{"osd":4,"last update":"Thu Jul 27 20:33:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.78700000000000003,"15min":0.79900000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.97099999999999997,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.82999999999999996,"15min":0.84399999999999997},"min":{"1min":0.58499999999999996,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0189999999999999,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.80100000000000005}]},{"osd":5,"last update":"Thu Jul 27 20:33:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.97599999999999998,"15min":1.022},"min":{"1min":0.40600000000000003,"5min":0.378,"15min":0.378},"max":{"1min":1.3300000000000001,"5min":6.1619999999999999,"15min":6.1619999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":1.0189999999999999,"15min":1.0669999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.1970000000000001,"5min":6.2729999999999997,"15min":6.2729999999999997},"last":0.69099999999999995}]},{"osd":6,"last update":"Thu Jul 27 20:33:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.84299999999999997,"15min":0.85499999999999998},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.018,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.88900000000000001,"15min":0.91900000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93500000000000005,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":0.84599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":557056,"data_stored":258611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:33:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.68300000000000005,"15min":0.69099999999999995},"min":{"1min":0.47799999999999998,"5min":0.441,"15min":0.441},"max":{"1min":0.85699999999999998,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.66600000000000004,"15min":0.66900000000000004},"min":{"1min":0.47199999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.83899999999999997,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.79700000000000004}]},{"osd":1,"last update":"Thu Jul 27 20:33:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.71499999999999997,"15min":0.72699999999999998},"min":{"1min":0.46999999999999997,"5min":0.442,"15min":0.442},"max":{"1min":0.879,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.70599999999999996,"15min":0.70999999999999996},"min":{"1min":0.51500000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.83599999999999997,"5min":1.266,"15min":1.266},"last":0.61499999999999999}]},{"osd":2,"last update":"Thu Jul 27 20:33:19 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.71799999999999997,"15min":0.72599999999999998},"min":{"1min":0.49199999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.85999999999999999,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.75600000000000001,"15min":0.76600000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.86799999999999999,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.77300000000000002}]},{"osd":3,"last update":"Thu Jul 27 20:33:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.74099999999999999,"15min":0.749},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.86399999999999999,"5min":1.377,"15min":1.377},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.752,"15min":0.76400000000000001},"min":{"1min":0.52000000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.82199999999999995,"5min":1.736,"15min":1.736},"last":0.65600000000000003}]},{"osd":4,"last update":"Thu Jul 27 20:33:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.48099999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86199999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.69899999999999995,"15min":0.69399999999999995},"min":{"1min":0.50900000000000001,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.84899999999999998,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.86699999999999999}]},{"osd":5,"last update":"Thu Jul 27 20:33:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.66600000000000004,"15min":0.66400000000000003},"min":{"1min":0.48599999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.88200000000000001,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.73699999999999999,"15min":0.73099999999999998},"min":{"1min":0.59699999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.872,"5min":1.081,"15min":1.081},"last":0.89000000000000001}]},{"osd":7,"last update":"Thu Jul 27 20:33:19 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.755,"15min":0.755},"min":{"1min":0.64300000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.89800000000000002,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.73599999999999999,"15min":0.73499999999999999},"min":{"1min":0.59399999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.90700000000000003,"5min":1.119,"15min":1.119},"last":0.753}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":557056,"data_stored":258099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:33:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.28399999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.53600000000000003,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.47499999999999998,"15min":0.47999999999999998},"min":{"1min":0.32100000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63500000000000001,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.504}]},{"osd":2,"last update":"Thu Jul 27 20:33:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.438,"15min":0.435},"min":{"1min":0.34300000000000003,"5min":0.308,"15min":0.308},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.62,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jul 27 20:33:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53000000000000003,"15min":0.53100000000000003},"min":{"1min":0.45100000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.501,"15min":0.503},"min":{"1min":0.376,"5min":0.31,"15min":0.31},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.44500000000000001}]},{"osd":4,"last update":"Thu Jul 27 20:33:15 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.73899999999999999,"15min":0.747},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.90700000000000003,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.73699999999999999,"15min":0.73199999999999998},"min":{"1min":0.59799999999999998,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.77100000000000002}]},{"osd":5,"last update":"Thu Jul 27 20:33:15 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.72499999999999998,"15min":0.73299999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.91800000000000004,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.751,"15min":0.753},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.80600000000000005}]},{"osd":6,"last update":"Thu Jul 27 20:33:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.78900000000000003,"15min":0.79900000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.88600000000000001,"5min":1.347,"15min":1.347},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.81699999999999995,"15min":0.82499999999999996},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.0349999999999999,"5min":1.409,"15min":1.409},"last":0.82099999999999995}]},{"osd":7,"last update":"Thu Jul 27 20:33:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.018,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.79600000000000004,"15min":0.80600000000000005},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.94399999999999995,"5min":1.069,"15min":1.069},"last":0.78700000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28160,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343680,"statfs":{"total":96636764160,"available":96607928320,"internally_reserved":0,"allocated":1163264,"data_stored":850487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 20:33:16 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.38500000000000001,"15min":0.39000000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.46600000000000003,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.46400000000000002,"15min":0.46500000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.56399999999999995,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.52400000000000002}]},{"osd":2,"last update":"Thu Jul 27 20:33:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.48799999999999999,"15min":0.49199999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.55600000000000005,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.45200000000000001,"15min":0.45600000000000002},"min":{"1min":0.34999999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.56100000000000005,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.59199999999999997}]},{"osd":3,"last update":"Thu Jul 27 20:33:16 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.46700000000000003,"15min":0.47099999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.53900000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.54000000000000004,"15min":0.54500000000000004},"min":{"1min":0.40200000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.63500000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.41199999999999998}]},{"osd":4,"last update":"Thu Jul 27 20:33:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71399999999999997,"15min":0.71499999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.046,"5min":1.069,"15min":1.069},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.73199999999999998,"15min":0.73699999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.88300000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.747}]},{"osd":5,"last update":"Thu Jul 27 20:33:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.745,"15min":0.75},"min":{"1min":0.55500000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.84699999999999998,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.752,"15min":0.75600000000000001},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.997,"5min":1.196,"15min":1.196},"last":0.77300000000000002}]},{"osd":6,"last update":"Thu Jul 27 20:33:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.73599999999999999,"15min":0.74099999999999999},"min":{"1min":0.56799999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.014,"5min":1.05,"15min":1.05},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.77600000000000002,"15min":0.78300000000000003},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.95199999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.76300000000000001}]},{"osd":7,"last update":"Thu Jul 27 20:33:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76400000000000001,"15min":0.77300000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.88100000000000001,"5min":1.117,"15min":1.117},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.92600000000000005,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.82999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":573440,"data_stored":261278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:33:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.47199999999999998,"15min":0.48599999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57499999999999996,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.68500000000000005,"15min":0.72999999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.52900000000000003,"5min":3.2999999999999998,"15min":3.2999999999999998},"last":0.32500000000000001}]},{"osd":1,"last update":"Thu Jul 27 20:33:17 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.59999999999999998,"15min":0.628},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.58599999999999997,"5min":3.0600000000000001,"15min":3.0600000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.65700000000000003,"15min":0.68500000000000005},"min":{"1min":0.34200000000000003,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.69599999999999995,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.42499999999999999}]},{"osd":3,"last update":"Thu Jul 27 20:33:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.99099999999999999,"15min":1.0780000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.66200000000000003,"5min":9.2200000000000006,"15min":9.2200000000000006},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.58899999999999997,"15min":0.60099999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.64100000000000001,"5min":1.552,"15min":1.552},"last":0.56799999999999995}]},{"osd":4,"last update":"Thu Jul 27 20:33:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.90900000000000003,"15min":0.94199999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.93200000000000005,"5min":4.2930000000000001,"15min":4.2930000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.77200000000000002,"15min":0.78400000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.91000000000000003,"5min":1.24,"15min":1.24},"last":0.77200000000000002}]},{"osd":5,"last update":"Thu Jul 27 20:33:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.76200000000000001,"15min":0.77200000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.95099999999999996,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.89700000000000002,"15min":0.92400000000000004},"min":{"1min":0.505,"5min":0.5,"15min":0.5},"max":{"1min":1.222,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.79900000000000004}]},{"osd":6,"last update":"Thu Jul 27 20:33:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.92600000000000005,"15min":0.95799999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2609999999999999,"5min":3.3999999999999999,"15min":3.3999999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.753,"5min":0.97399999999999998,"15min":1.0109999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.004,"5min":3.4990000000000001,"15min":3.4990000000000001},"last":0.97199999999999998}]},{"osd":7,"last update":"Thu Jul 27 20:33:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.83499999999999996,"15min":0.85299999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0029999999999999,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.755},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.89100000000000001,"15min":0.90700000000000003},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2929999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.94299999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":569344,"data_stored":258633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:33:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.46200000000000002,"15min":0.47499999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.65100000000000002,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.68400000000000005,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Jul 27 20:33:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.495,"15min":0.50600000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.58299999999999996,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.501},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.55500000000000005,"15min":0.57599999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.70299999999999996,"5min":1.788,"15min":1.788},"last":0.443}]},{"osd":2,"last update":"Thu Jul 27 20:33:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.58099999999999996,"15min":0.59899999999999998},"min":{"1min":0.37,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76200000000000001,"5min":2.117,"15min":2.117},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.622,"15min":0.64100000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.73499999999999999,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.56499999999999995}]},{"osd":4,"last update":"Thu Jul 27 20:33:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.71899999999999997,"15min":0.72199999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.80600000000000005,"15min":0.81999999999999995},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97599999999999998,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jul 27 20:33:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72999999999999998,"15min":0.73499999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95799999999999996,"5min":1.125,"15min":1.125},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.81699999999999995,"15min":0.83599999999999997},"min":{"1min":0.54600000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.89700000000000002,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.621}]},{"osd":6,"last update":"Thu Jul 27 20:33:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.80400000000000005,"15min":0.81899999999999995},"min":{"1min":0.501,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93300000000000005,"5min":1.758,"15min":1.758},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.82699999999999996,"15min":0.84099999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.997,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.68600000000000005}]},{"osd":7,"last update":"Thu Jul 27 20:33:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.83899999999999997,"15min":0.85599999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.95099999999999996,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.75800000000000001,"15min":0.76700000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.016,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.63500000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":573440,"data_stored":262764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:33:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.70499999999999996,"15min":0.70099999999999996},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.89200000000000002,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.71199999999999997,"15min":0.71399999999999997},"min":{"1min":0.53600000000000003,"5min":0.5,"15min":0.5},"max":{"1min":0.93200000000000005,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.62}]},{"osd":1,"last update":"Thu Jul 27 20:33:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.70299999999999996,"15min":0.70099999999999996},"min":{"1min":0.46700000000000003,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89900000000000002,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.74199999999999999,"15min":0.73999999999999999},"min":{"1min":0.57099999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.88300000000000001,"5min":1.002,"15min":1.002},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Jul 27 20:33:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.67700000000000005,"15min":0.66900000000000004},"min":{"1min":0.57699999999999996,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.879,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.57899999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.77900000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.70699999999999996}]},{"osd":3,"last update":"Thu Jul 27 20:33:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.748,"15min":0.75600000000000001},"min":{"1min":0.51700000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.81000000000000005,"5min":1.645,"15min":1.645},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.75700000000000001,"15min":0.76300000000000001},"min":{"1min":0.57799999999999996,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.90900000000000003,"5min":1.708,"15min":1.708},"last":0.73999999999999999}]},{"osd":5,"last update":"Thu Jul 27 20:33:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40100000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.872,"5min":1.113,"15min":1.113},"last":0.505},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.68899999999999995,"15min":0.69499999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.86499999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jul 27 20:33:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.70599999999999996,"15min":0.70699999999999996},"min":{"1min":0.48099999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.92300000000000004,"5min":1.127,"15min":1.127},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.746,"15min":0.74399999999999999},"min":{"1min":0.48399999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94499999999999995,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.48399999999999999}]},{"osd":7,"last update":"Thu Jul 27 20:33:19 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.77500000000000002,"15min":0.78000000000000003},"min":{"1min":0.52300000000000002,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.91700000000000004,"5min":1.198,"15min":1.198},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.81599999999999995,"15min":0.81799999999999995},"min":{"1min":0.63100000000000001,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":0.94699999999999995,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.75900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":548864,"data_stored":250715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:33:21 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.65500000000000003,"15min":0.63},"min":{"1min":0.47099999999999997,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":4.0510000000000002,"5min":4.0510000000000002,"15min":4.0510000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.72199999999999998,"15min":0.68200000000000005},"min":{"1min":0.48599999999999999,"5min":0.379,"15min":0.379},"max":{"1min":6.431,"5min":6.431,"15min":6.431},"last":0.438}]},{"osd":1,"last update":"Thu Jul 27 20:33:21 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.68999999999999995,"15min":0.65700000000000003},"min":{"1min":0.45900000000000002,"5min":0.372,"15min":0.372},"max":{"1min":5.3330000000000002,"5min":5.3330000000000002,"15min":5.3330000000000002},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.69399999999999995,"15min":0.67100000000000004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":4.2169999999999996,"5min":4.2169999999999996,"15min":4.2169999999999996},"last":0.63100000000000001}]},{"osd":2,"last update":"Thu Jul 27 20:33:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.70599999999999996,"15min":0.66500000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":6.4850000000000003,"5min":6.4850000000000003,"15min":6.4850000000000003},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.68400000000000005,"15min":0.66200000000000003},"min":{"1min":0.54100000000000004,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":3.5760000000000001,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Jul 27 20:33:21 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.76700000000000002,"15min":0.745},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":4.7809999999999997,"5min":4.7809999999999997,"15min":4.7809999999999997},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.76800000000000002,"15min":0.73999999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":5.423,"5min":5.423,"15min":5.423},"last":0.66100000000000003}]},{"osd":4,"last update":"Thu Jul 27 20:33:21 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.67800000000000005,"15min":0.65700000000000003},"min":{"1min":0.39500000000000002,"5min":0.375,"15min":0.375},"max":{"1min":3.988,"5min":3.988,"15min":3.988},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.75900000000000001,"15min":0.73099999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":4.827,"5min":4.827,"15min":4.827},"last":0.52700000000000002}]},{"osd":6,"last update":"Thu Jul 27 20:33:21 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":0.78300000000000003,"15min":0.73399999999999999},"min":{"1min":0.48199999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":7.7000000000000002,"5min":7.7000000000000002,"15min":7.7000000000000002},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.754,"15min":0.72899999999999998},"min":{"1min":0.58899999999999997,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":4.0999999999999996,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Jul 27 20:33:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":0.84299999999999997,"15min":0.78400000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":9.1180000000000003,"5min":9.1180000000000003,"15min":9.1180000000000003},"last":0.64800000000000002},{"interface":"front","average":{"1min":1.032,"5min":0.83599999999999997,"15min":0.80400000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":5.2880000000000003,"5min":5.2880000000000003,"15min":5.2880000000000003},"last":0.61799999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T20:33:27.050 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-27T20:33:27.051 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-07-27T20:33:27.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.294+0000 7f6247dff700 1 Processor -- start 2023-07-27T20:33:27.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.295+0000 7f6247dff700 1 -- start start 2023-07-27T20:33:27.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.296+0000 7f6247dff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f624006df80 0x7f624013a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:27.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.296+0000 7f6247dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f624013b070 con 0x7f62400c58f0 2023-07-27T20:33:27.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.296+0000 7f6247dff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f624013b350 con 0x7f6240072330 2023-07-27T20:33:27.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.296+0000 7f6247dff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6240070410 con 0x7f624006df80 2023-07-27T20:33:27.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.296+0000 7f6245b9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f62400c58f0 0x7f6240151d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43466/0 (socket says 172.21.15.72:43466) 2023-07-27T20:33:27.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.296+0000 7f6245b9b700 1 -- 172.21.15.72:0/1790810429 learned_addr learned my addr 172.21.15.72:0/1790810429 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:27.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.296+0000 7f6244b99700 1 -- 172.21.15.72:0/1790810429 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 932070167 0 0) 0x7f624013b070 con 0x7f62400c58f0 2023-07-27T20:33:27.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.296+0000 7f6244b99700 1 -- 172.21.15.72:0/1790810429 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f622c0035b0 con 0x7f62400c58f0 2023-07-27T20:33:27.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.296+0000 7f624539a700 1 --2- 172.21.15.72:0/1790810429 >> v2:172.21.15.173:3300/0 conn(0x7f624006df80 0x7f624013a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:27.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.297+0000 7f6244b99700 1 -- 172.21.15.72:0/1790810429 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4038014957 0 0) 0x7f622c0035b0 con 0x7f62400c58f0 2023-07-27T20:33:27.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.297+0000 7f6244b99700 1 -- 172.21.15.72:0/1790810429 >> v2:172.21.15.173:3300/0 conn(0x7f624006df80 msgr2=0x7f624013a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:27.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.297+0000 7f6244b99700 1 --2- 172.21.15.72:0/1790810429 >> v2:172.21.15.173:3300/0 conn(0x7f624006df80 0x7f624013a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:27.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.297+0000 7f6244b99700 1 -- 172.21.15.72:0/1790810429 >> v1:172.21.15.173:6789/0 conn(0x7f6240072330 legacy=0x7f624015c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:27.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.297+0000 7f6244b99700 1 -- 172.21.15.72:0/1790810429 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6240071850 con 0x7f62400c58f0 2023-07-27T20:33:27.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.297+0000 7f6244b99700 1 -- 172.21.15.72:0/1790810429 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f623c001670 con 0x7f62400c58f0 2023-07-27T20:33:27.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.297+0000 7f6244b99700 1 -- 172.21.15.72:0/1790810429 >> v1:172.21.15.72:6789/0 conn(0x7f62400c58f0 legacy=0x7f6240151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:27.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.297+0000 7f6244b99700 1 --2- 172.21.15.72:0/1790810429 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f622c003a00 0x7f622c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:27.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.297+0000 7f6244b99700 1 --2- 172.21.15.72:0/1790810429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f622c004850 0x7f622c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:27.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.297+0000 7f6244b99700 1 --2- 172.21.15.72:0/1790810429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f622c005210 0x7f622c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:27.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.297+0000 7f6244b99700 1 -- 172.21.15.72:0/1790810429 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622c00c180 con 0x7f622c004850 2023-07-27T20:33:27.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.297+0000 7f6244b99700 1 -- 172.21.15.72:0/1790810429 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622c00c2f0 con 0x7f622c005210 2023-07-27T20:33:27.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.297+0000 7f6244b99700 1 -- 172.21.15.72:0/1790810429 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f622c00c4b0 con 0x7f622c003a00 2023-07-27T20:33:27.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.297+0000 7f624539a700 1 --2- 172.21.15.72:0/1790810429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f622c004850 0x7f622c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:27.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.297+0000 7f6245b9b700 1 --2- 172.21.15.72:0/1790810429 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f622c003a00 0x7f622c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:27.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.297+0000 7f624639c700 1 --2- 172.21.15.72:0/1790810429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f622c005210 0x7f622c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:27.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.298+0000 7f624539a700 1 -- 172.21.15.72:0/1790810429 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f622c003a00 msgr2=0x7f622c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:27.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.298+0000 7f624539a700 1 --2- 172.21.15.72:0/1790810429 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f622c003a00 0x7f622c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:27.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.298+0000 7f624539a700 1 -- 172.21.15.72:0/1790810429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f622c005210 msgr2=0x7f622c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:27.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.298+0000 7f624539a700 1 --2- 172.21.15.72:0/1790810429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f622c005210 0x7f622c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:27.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.298+0000 7f624539a700 1 -- 172.21.15.72:0/1790810429 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622c0035b0 con 0x7f622c004850 2023-07-27T20:33:27.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.298+0000 7f624639c700 1 -- 172.21.15.72:0/1790810429 reap_dead start 2023-07-27T20:33:27.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.298+0000 7f624539a700 1 --2- 172.21.15.72:0/1790810429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f622c004850 0x7f622c004cd0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f6230009b30 tx=0x7f622c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a49e626ca238d6d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:27.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.298+0000 7f6244b99700 1 -- 172.21.15.72:0/1790810429 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623000e6c0 con 0x7f622c004850 2023-07-27T20:33:27.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.298+0000 7f6244b99700 1 -- 172.21.15.72:0/1790810429 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623000e820 con 0x7f622c004850 2023-07-27T20:33:27.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.298+0000 7f6244b99700 1 -- 172.21.15.72:0/1790810429 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623000eb90 con 0x7f622c004850 2023-07-27T20:33:27.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.299+0000 7f6247dff700 1 -- 172.21.15.72:0/1790810429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f622c004850 msgr2=0x7f622c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:27.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.299+0000 7f6247dff700 1 --2- 172.21.15.72:0/1790810429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f622c004850 0x7f622c004cd0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f6230009b30 tx=0x7f622c005880 comp rx=0 tx=0).stop 2023-07-27T20:33:27.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.299+0000 7f6247dff700 1 -- 172.21.15.72:0/1790810429 shutdown_connections 2023-07-27T20:33:27.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.299+0000 7f6247dff700 1 --2- 172.21.15.72:0/1790810429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f622c004850 0x7f622c004cd0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:27.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.299+0000 7f6247dff700 1 -- 172.21.15.72:0/1790810429 >> 172.21.15.72:0/1790810429 conn(0x7f62400a7480 msgr2=0x7f62400a7860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:27.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.299+0000 7f6247dff700 1 -- 172.21.15.72:0/1790810429 shutdown_connections 2023-07-27T20:33:27.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.299+0000 7f6247dff700 1 -- 172.21.15.72:0/1790810429 wait complete. 2023-07-27T20:33:27.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.301+0000 7f6247dff700 1 Processor -- start 2023-07-27T20:33:27.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.301+0000 7f6247dff700 1 -- start start 2023-07-27T20:33:27.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.302+0000 7f6247dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f622c004850 0x7f62400a9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:27.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.302+0000 7f6247dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62401525b0 0x7f624014eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:27.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.302+0000 7f6247dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f624014f080 0x7f62400bff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:27.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.302+0000 7f6247dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62400c14b0 con 0x7f624014f080 2023-07-27T20:33:27.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.302+0000 7f6247dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62401e5d80 con 0x7f622c004850 2023-07-27T20:33:27.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.302+0000 7f6247dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62401e62b0 con 0x7f62401525b0 2023-07-27T20:33:27.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.303+0000 7f624639c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f624014f080 0x7f62400bff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:27.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.303+0000 7f624639c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f624014f080 0x7f62400bff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39792/0 (socket says 172.21.15.72:39792) 2023-07-27T20:33:27.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.303+0000 7f6245b9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f622c004850 0x7f62400a9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:27.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.303+0000 7f624639c700 1 -- 172.21.15.72:0/835220608 learned_addr learned my addr 172.21.15.72:0/835220608 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:27.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.303+0000 7f624539a700 1 --2- 172.21.15.72:0/835220608 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62401525b0 0x7f624014eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:27.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.303+0000 7f624639c700 1 -- 172.21.15.72:0/835220608 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62401525b0 msgr2=0x7f624014eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:27.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.303+0000 7f624639c700 1 --2- 172.21.15.72:0/835220608 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62401525b0 0x7f624014eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:27.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.303+0000 7f624639c700 1 -- 172.21.15.72:0/835220608 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f622c004850 msgr2=0x7f62400a9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:27.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.303+0000 7f624639c700 1 --2- 172.21.15.72:0/835220608 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f622c004850 0x7f62400a9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:27.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.303+0000 7f624639c700 1 -- 172.21.15.72:0/835220608 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62400a94d0 con 0x7f624014f080 2023-07-27T20:33:27.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.303+0000 7f624639c700 1 --2- 172.21.15.72:0/835220608 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f624014f080 0x7f62400bff00 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6240072760 tx=0x7f62380021e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:27.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.304+0000 7f62367fc700 1 -- 172.21.15.72:0/835220608 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6238003cd0 con 0x7f624014f080 2023-07-27T20:33:27.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.304+0000 7f62367fc700 1 -- 172.21.15.72:0/835220608 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6238003e30 con 0x7f624014f080 2023-07-27T20:33:27.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.304+0000 7f62367fc700 1 -- 172.21.15.72:0/835220608 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6238005310 con 0x7f624014f080 2023-07-27T20:33:27.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.304+0000 7f6247dff700 1 -- 172.21.15.72:0/835220608 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6240152b70 con 0x7f624014f080 2023-07-27T20:33:27.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.304+0000 7f6247dff700 1 -- 172.21.15.72:0/835220608 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62400a8e80 con 0x7f624014f080 2023-07-27T20:33:27.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.305+0000 7f6247dff700 1 -- 172.21.15.72:0/835220608 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6240074310 con 0x7f624014f080 2023-07-27T20:33:27.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.306+0000 7f62367fc700 1 -- 172.21.15.72:0/835220608 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6238005470 con 0x7f624014f080 2023-07-27T20:33:27.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.306+0000 7f62367fc700 1 --2- 172.21.15.72:0/835220608 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f622406acd0 0x7f622406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:27.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.307+0000 7f62367fc700 1 -- 172.21.15.72:0/835220608 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f62380899f0 con 0x7f624014f080 2023-07-27T20:33:27.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.307+0000 7f6245b9b700 1 --2- 172.21.15.72:0/835220608 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f622406acd0 0x7f622406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:27.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.308+0000 7f6245b9b700 1 --2- 172.21.15.72:0/835220608 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f622406acd0 0x7f622406d190 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f623c001050 tx=0x7f623c000f80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:27.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.311+0000 7f62367fc700 1 -- 172.21.15.72:0/835220608 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6238054660 con 0x7f624014f080 2023-07-27T20:33:27.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.578+0000 7f6247dff700 1 -- 172.21.15.72:0/835220608 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f6240070e00 con 0x7f624014f080 2023-07-27T20:33:27.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.582+0000 7f62367fc700 1 -- 172.21.15.72:0/835220608 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v12) v1 ==== 185+0+142 (secure 0 0 0) 0x7f6238057c80 con 0x7f624014f080 2023-07-27T20:33:27.569 INFO:teuthology.orchestra.run.smithi072.stdout:[client.1] 2023-07-27T20:33:27.569 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDh08JktvSlExAAay3fDYh/8Ju3iIWOXW8wmw== 2023-07-27T20:33:27.570 INFO:teuthology.orchestra.run.smithi072.stdout: caps mds = "allow" 2023-07-27T20:33:27.570 INFO:teuthology.orchestra.run.smithi072.stdout: caps mon = "allow r" 2023-07-27T20:33:27.570 INFO:teuthology.orchestra.run.smithi072.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-07-27T20:33:27.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.584+0000 7f6247dff700 1 -- 172.21.15.72:0/835220608 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f622406acd0 msgr2=0x7f622406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:27.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.584+0000 7f6247dff700 1 --2- 172.21.15.72:0/835220608 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f622406acd0 0x7f622406d190 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f623c001050 tx=0x7f623c000f80 comp rx=0 tx=0).stop 2023-07-27T20:33:27.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.584+0000 7f6247dff700 1 -- 172.21.15.72:0/835220608 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f624014f080 msgr2=0x7f62400bff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:27.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.584+0000 7f6247dff700 1 --2- 172.21.15.72:0/835220608 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f624014f080 0x7f62400bff00 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6240072760 tx=0x7f62380021e0 comp rx=0 tx=0).stop 2023-07-27T20:33:27.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.584+0000 7f6247dff700 1 -- 172.21.15.72:0/835220608 shutdown_connections 2023-07-27T20:33:27.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.584+0000 7f6247dff700 1 --2- 172.21.15.72:0/835220608 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f624014f080 0x7f62400bff00 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:27.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.584+0000 7f6247dff700 1 --2- 172.21.15.72:0/835220608 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f622c004850 0x7f62400a9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:27.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.584+0000 7f6247dff700 1 --2- 172.21.15.72:0/835220608 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f622406acd0 0x7f622406d190 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:27.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.584+0000 7f6247dff700 1 --2- 172.21.15.72:0/835220608 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62401525b0 0x7f624014eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:27.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.584+0000 7f6247dff700 1 -- 172.21.15.72:0/835220608 >> 172.21.15.72:0/835220608 conn(0x7f62400a7480 msgr2=0x7f6240138cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:27.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.584+0000 7f6247dff700 1 -- 172.21.15.72:0/835220608 shutdown_connections 2023-07-27T20:33:27.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.584+0000 7f6247dff700 1 -- 172.21.15.72:0/835220608 wait complete. 2023-07-27T20:33:27.573 INFO:teuthology.orchestra.run.smithi072.stderr:updated caps for client.1 2023-07-27T20:33:27.589 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-07-27T20:33:27.590 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-27T20:33:27.641 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:33:27.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.850+0000 7f091adff700 1 Processor -- start 2023-07-27T20:33:27.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.850+0000 7f091adff700 1 -- start start 2023-07-27T20:33:27.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.851+0000 7f091adff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f09140c5c00 0x7f09140c1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:27.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.851+0000 7f091adff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09140706f0 con 0x7f0914154960 2023-07-27T20:33:27.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.851+0000 7f091adff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09141585d0 con 0x7f0914151800 2023-07-27T20:33:27.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.851+0000 7f091adff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0914154510 con 0x7f09140c5c00 2023-07-27T20:33:27.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.852+0000 7f091939c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0914154960 0x7f091415eb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43468/0 (socket says 172.21.15.72:43468) 2023-07-27T20:33:27.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.852+0000 7f091939c700 1 -- 172.21.15.72:0/1104468446 learned_addr learned my addr 172.21.15.72:0/1104468446 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:27.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.852+0000 7f09137fe700 1 -- 172.21.15.72:0/1104468446 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1470825570 0 0) 0x7f09140706f0 con 0x7f0914154960 2023-07-27T20:33:27.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.852+0000 7f09137fe700 1 -- 172.21.15.72:0/1104468446 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09040035b0 con 0x7f0914154960 2023-07-27T20:33:27.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.852+0000 7f0913fff700 1 --2- 172.21.15.72:0/1104468446 >> v2:172.21.15.173:3300/0 conn(0x7f09140c5c00 0x7f09140c1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:27.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.852+0000 7f09137fe700 1 -- 172.21.15.72:0/1104468446 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2006156443 0 0) 0x7f09040035b0 con 0x7f0914154960 2023-07-27T20:33:27.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.852+0000 7f09137fe700 1 -- 172.21.15.72:0/1104468446 >> v2:172.21.15.173:3300/0 conn(0x7f09140c5c00 msgr2=0x7f09140c1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:27.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.852+0000 7f09137fe700 1 --2- 172.21.15.72:0/1104468446 >> v2:172.21.15.173:3300/0 conn(0x7f09140c5c00 0x7f09140c1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:27.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.852+0000 7f09137fe700 1 -- 172.21.15.72:0/1104468446 >> v1:172.21.15.173:6789/0 conn(0x7f0914151800 legacy=0x7f09140a9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:27.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.852+0000 7f09137fe700 1 -- 172.21.15.72:0/1104468446 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09140709b0 con 0x7f0914154960 2023-07-27T20:33:27.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.852+0000 7f09137fe700 1 -- 172.21.15.72:0/1104468446 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f090c0019f0 con 0x7f0914154960 2023-07-27T20:33:27.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.852+0000 7f09137fe700 1 -- 172.21.15.72:0/1104468446 >> v1:172.21.15.72:6789/0 conn(0x7f0914154960 legacy=0x7f091415eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:27.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.852+0000 7f09137fe700 1 --2- 172.21.15.72:0/1104468446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0904003a00 0x7f0904003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:27.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.853+0000 7f09137fe700 1 --2- 172.21.15.72:0/1104468446 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0904004850 0x7f0904004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:27.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.853+0000 7f09137fe700 1 --2- 172.21.15.72:0/1104468446 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0904005210 0x7f090400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:27.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.853+0000 7f09137fe700 1 -- 172.21.15.72:0/1104468446 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0914154510 con 0x7f0904005210 2023-07-27T20:33:27.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.853+0000 7f09137fe700 1 -- 172.21.15.72:0/1104468446 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090400c160 con 0x7f0904003a00 2023-07-27T20:33:27.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.853+0000 7f09137fe700 1 -- 172.21.15.72:0/1104468446 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f090400c320 con 0x7f0904004850 2023-07-27T20:33:27.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.853+0000 7f091939c700 1 --2- 172.21.15.72:0/1104468446 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0904005210 0x7f090400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:27.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.853+0000 7f0918b9b700 1 --2- 172.21.15.72:0/1104468446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0904003a00 0x7f0904003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:27.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.853+0000 7f0913fff700 1 --2- 172.21.15.72:0/1104468446 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0904004850 0x7f0904004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:27.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.853+0000 7f091939c700 1 -- 172.21.15.72:0/1104468446 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0904004850 msgr2=0x7f0904004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:27.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.853+0000 7f091939c700 1 --2- 172.21.15.72:0/1104468446 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0904004850 0x7f0904004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:27.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.853+0000 7f091939c700 1 -- 172.21.15.72:0/1104468446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0904003a00 msgr2=0x7f0904003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:27.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.853+0000 7f091939c700 1 --2- 172.21.15.72:0/1104468446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0904003a00 0x7f0904003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:27.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.853+0000 7f091939c700 1 -- 172.21.15.72:0/1104468446 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09040035b0 con 0x7f0904005210 2023-07-27T20:33:27.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.853+0000 7f091939c700 1 -- 172.21.15.72:0/1104468446 reap_dead start 2023-07-27T20:33:27.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.853+0000 7f091939c700 1 --2- 172.21.15.72:0/1104468446 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0904005210 0x7f090400ba10 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f090c00a830 tx=0x7f0904005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=798263295870ab61 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:27.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.854+0000 7f09137fe700 1 -- 172.21.15.72:0/1104468446 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c00a2f0 con 0x7f0904005210 2023-07-27T20:33:27.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.854+0000 7f09137fe700 1 -- 172.21.15.72:0/1104468446 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090c012600 con 0x7f0904005210 2023-07-27T20:33:27.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.854+0000 7f09137fe700 1 -- 172.21.15.72:0/1104468446 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c0129b0 con 0x7f0904005210 2023-07-27T20:33:27.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.854+0000 7f091adff700 1 -- 172.21.15.72:0/1104468446 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0904005210 msgr2=0x7f090400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:27.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.854+0000 7f091adff700 1 --2- 172.21.15.72:0/1104468446 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0904005210 0x7f090400ba10 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f090c00a830 tx=0x7f0904005880 comp rx=0 tx=0).stop 2023-07-27T20:33:27.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.854+0000 7f091adff700 1 -- 172.21.15.72:0/1104468446 shutdown_connections 2023-07-27T20:33:27.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.854+0000 7f091adff700 1 --2- 172.21.15.72:0/1104468446 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0904005210 0x7f090400ba10 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:27.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.854+0000 7f091adff700 1 -- 172.21.15.72:0/1104468446 >> 172.21.15.72:0/1104468446 conn(0x7f091406a7c0 msgr2=0x7f09140c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:27.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.854+0000 7f091adff700 1 -- 172.21.15.72:0/1104468446 shutdown_connections 2023-07-27T20:33:27.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.854+0000 7f091adff700 1 -- 172.21.15.72:0/1104468446 wait complete. 2023-07-27T20:33:27.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.856+0000 7f091adff700 1 Processor -- start 2023-07-27T20:33:27.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.856+0000 7f091adff700 1 -- start start 2023-07-27T20:33:27.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.857+0000 7f091adff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0904005210 0x7f09140c0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:27.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.857+0000 7f091adff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0914157b40 0x7f09141558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:27.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.857+0000 7f091adff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0914155e00 0x7f09141ed260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:27.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.857+0000 7f091adff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09140c0780 con 0x7f0914155e00 2023-07-27T20:33:27.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.857+0000 7f091adff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09140c01c0 con 0x7f0904005210 2023-07-27T20:33:27.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.857+0000 7f091adff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09140c04a0 con 0x7f0914157b40 2023-07-27T20:33:27.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.857+0000 7f091939c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0914155e00 0x7f09141ed260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:27.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.857+0000 7f091939c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0914155e00 0x7f09141ed260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39822/0 (socket says 172.21.15.72:39822) 2023-07-27T20:33:27.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.857+0000 7f091939c700 1 -- 172.21.15.72:0/940650326 learned_addr learned my addr 172.21.15.72:0/940650326 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:27.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.857+0000 7f0913fff700 1 --2- 172.21.15.72:0/940650326 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0914157b40 0x7f09141558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:27.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.857+0000 7f0918b9b700 1 --2- 172.21.15.72:0/940650326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0904005210 0x7f09140c0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:27.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.858+0000 7f091939c700 1 -- 172.21.15.72:0/940650326 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0914157b40 msgr2=0x7f09141558c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:27.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.858+0000 7f091939c700 1 --2- 172.21.15.72:0/940650326 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0914157b40 0x7f09141558c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:27.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.858+0000 7f091939c700 1 -- 172.21.15.72:0/940650326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0904005210 msgr2=0x7f09140c0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:27.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.858+0000 7f091939c700 1 --2- 172.21.15.72:0/940650326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0904005210 0x7f09140c0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:27.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.858+0000 7f091939c700 1 -- 172.21.15.72:0/940650326 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09140be7a0 con 0x7f0914155e00 2023-07-27T20:33:27.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.858+0000 7f091939c700 1 --2- 172.21.15.72:0/940650326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0914155e00 0x7f09141ed260 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f09140c5960 tx=0x7f090c001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:27.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.858+0000 7f09117fa700 1 -- 172.21.15.72:0/940650326 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c001250 con 0x7f0914155e00 2023-07-27T20:33:27.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.858+0000 7f09117fa700 1 -- 172.21.15.72:0/940650326 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090c012400 con 0x7f0914155e00 2023-07-27T20:33:27.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.858+0000 7f091adff700 1 -- 172.21.15.72:0/940650326 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09140bea80 con 0x7f0914155e00 2023-07-27T20:33:27.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.858+0000 7f09117fa700 1 -- 172.21.15.72:0/940650326 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c01d660 con 0x7f0914155e00 2023-07-27T20:33:27.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.858+0000 7f091adff700 1 -- 172.21.15.72:0/940650326 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09140c1230 con 0x7f0914155e00 2023-07-27T20:33:27.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.859+0000 7f091adff700 1 -- 172.21.15.72:0/940650326 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09140c13c0 con 0x7f0914155e00 2023-07-27T20:33:27.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.860+0000 7f09117fa700 1 -- 172.21.15.72:0/940650326 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f090c01d7c0 con 0x7f0914155e00 2023-07-27T20:33:27.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.861+0000 7f09117fa700 1 --2- 172.21.15.72:0/940650326 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f08f806ad10 0x7f08f806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:27.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.861+0000 7f09117fa700 1 -- 172.21.15.72:0/940650326 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f090c08b660 con 0x7f0914155e00 2023-07-27T20:33:27.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.862+0000 7f0918b9b700 1 --2- 172.21.15.72:0/940650326 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f08f806ad10 0x7f08f806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:27.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.863+0000 7f0918b9b700 1 --2- 172.21.15.72:0/940650326 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f08f806ad10 0x7f08f806d1d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0908007fd0 tx=0x7f0908009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:27.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:27.865+0000 7f09117fa700 1 -- 172.21.15.72:0/940650326 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f09140c13c0 con 0x7f0914155e00 2023-07-27T20:33:28.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.061+0000 7f091adff700 1 -- 172.21.15.72:0/940650326 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09141555e0 con 0x7f0914155e00 2023-07-27T20:33:28.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.063+0000 7f09117fa700 1 -- 172.21.15.72:0/940650326 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+22308 (secure 0 0 0) 0x7f09141555e0 con 0x7f0914155e00 2023-07-27T20:33:28.050 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:33:28.051 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":47,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:33:23.191066+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:32:58.242890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-27T20:32:59.032110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_metadata","create_time":"2023-07-27T20:33:20.125785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs2_data","create_time":"2023-07-27T20:33:20.647929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2c","mappings":[{"from":0,"to":4}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:33:28.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.065+0000 7f091adff700 1 -- 172.21.15.72:0/940650326 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f08f806ad10 msgr2=0x7f08f806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:28.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.065+0000 7f091adff700 1 --2- 172.21.15.72:0/940650326 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f08f806ad10 0x7f08f806d1d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0908007fd0 tx=0x7f0908009040 comp rx=0 tx=0).stop 2023-07-27T20:33:28.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.065+0000 7f091adff700 1 -- 172.21.15.72:0/940650326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0914155e00 msgr2=0x7f09141ed260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:28.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.065+0000 7f091adff700 1 --2- 172.21.15.72:0/940650326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0914155e00 0x7f09141ed260 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f09140c5960 tx=0x7f090c001d80 comp rx=0 tx=0).stop 2023-07-27T20:33:28.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.065+0000 7f091adff700 1 -- 172.21.15.72:0/940650326 shutdown_connections 2023-07-27T20:33:28.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.065+0000 7f091adff700 1 --2- 172.21.15.72:0/940650326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0914155e00 0x7f09141ed260 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:28.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.065+0000 7f091adff700 1 --2- 172.21.15.72:0/940650326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0904005210 0x7f09140c0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:28.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.065+0000 7f091adff700 1 --2- 172.21.15.72:0/940650326 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f08f806ad10 0x7f08f806d1d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:28.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.065+0000 7f091adff700 1 --2- 172.21.15.72:0/940650326 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0914157b40 0x7f09141558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:28.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.065+0000 7f091adff700 1 -- 172.21.15.72:0/940650326 >> 172.21.15.72:0/940650326 conn(0x7f091406a7c0 msgr2=0x7f09140c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:28.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.065+0000 7f091adff700 1 -- 172.21.15.72:0/940650326 shutdown_connections 2023-07-27T20:33:28.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.065+0000 7f091adff700 1 -- 172.21.15.72:0/940650326 wait complete. 2023-07-27T20:33:28.070 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-27T20:31:14.581785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T20:31:21.077941+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T20:32:58.242890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T20:32:59.032110+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-07-27T20:33:20.125785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs2_data', 'create_time': '2023-07-27T20:33:20.647929+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-27T20:33:28.071 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-27T20:33:28.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.283+0000 7fe5f4bff700 1 Processor -- start 2023-07-27T20:33:28.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.284+0000 7fe5f4bff700 1 -- start start 2023-07-27T20:33:28.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.285+0000 7fe5f4bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe5f014aab0 0x7fe5f0154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:28.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.285+0000 7fe5f4bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5f00c7c50 con 0x7fe5f00c7740 2023-07-27T20:33:28.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.285+0000 7fe5f4bff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5f006bd40 con 0x7fe5f006c1d0 2023-07-27T20:33:28.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.285+0000 7fe5f4bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5f00c62f0 con 0x7fe5f014aab0 2023-07-27T20:33:28.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.285+0000 7fe5e7fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe5f00c7740 0x7fe5f00c41c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43478/0 (socket says 172.21.15.72:43478) 2023-07-27T20:33:28.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.285+0000 7fe5e7fff700 1 -- 172.21.15.72:0/3968471082 learned_addr learned my addr 172.21.15.72:0/3968471082 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:28.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.285+0000 7fe5ee59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe5f014aab0 0x7fe5f0154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:28.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.285+0000 7fe5edd9b700 1 -- 172.21.15.72:0/3968471082 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4246014667 0 0) 0x7fe5f00c7c50 con 0x7fe5f00c7740 2023-07-27T20:33:28.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.285+0000 7fe5edd9b700 1 -- 172.21.15.72:0/3968471082 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5dc0035b0 con 0x7fe5f00c7740 2023-07-27T20:33:28.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.285+0000 7fe5ee59c700 1 -- 172.21.15.72:0/3968471082 >> v1:172.21.15.173:6789/0 conn(0x7fe5f006c1d0 legacy=0x7fe5f006c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:28.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.285+0000 7fe5ee59c700 1 -- 172.21.15.72:0/3968471082 >> v1:172.21.15.72:6789/0 conn(0x7fe5f00c7740 legacy=0x7fe5f00c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:28.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.285+0000 7fe5ee59c700 1 -- 172.21.15.72:0/3968471082 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f006cd00 con 0x7fe5f014aab0 2023-07-27T20:33:28.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.286+0000 7fe5ee59c700 1 --2- 172.21.15.72:0/3968471082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5f014aab0 0x7fe5f0154b10 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0009840 tx=0x7fe5e0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abdf226b5d1fb310 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:28.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.286+0000 7fe5edd9b700 1 -- 172.21.15.72:0/3968471082 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0011830 con 0x7fe5f014aab0 2023-07-27T20:33:28.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.286+0000 7fe5edd9b700 1 -- 172.21.15.72:0/3968471082 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e0011990 con 0x7fe5f014aab0 2023-07-27T20:33:28.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.286+0000 7fe5edd9b700 1 -- 172.21.15.72:0/3968471082 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0011d20 con 0x7fe5f014aab0 2023-07-27T20:33:28.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.286+0000 7fe5f4bff700 1 -- 172.21.15.72:0/3968471082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5f014aab0 msgr2=0x7fe5f0154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:28.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.286+0000 7fe5f4bff700 1 --2- 172.21.15.72:0/3968471082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5f014aab0 0x7fe5f0154b10 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0009840 tx=0x7fe5e0009b50 comp rx=0 tx=0).stop 2023-07-27T20:33:28.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.286+0000 7fe5f4bff700 1 -- 172.21.15.72:0/3968471082 shutdown_connections 2023-07-27T20:33:28.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.286+0000 7fe5f4bff700 1 --2- 172.21.15.72:0/3968471082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5f014aab0 0x7fe5f0154b10 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:28.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.286+0000 7fe5f4bff700 1 -- 172.21.15.72:0/3968471082 >> 172.21.15.72:0/3968471082 conn(0x7fe5f00ab3f0 msgr2=0x7fe5f00ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:28.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.287+0000 7fe5f4bff700 1 -- 172.21.15.72:0/3968471082 shutdown_connections 2023-07-27T20:33:28.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.287+0000 7fe5f4bff700 1 -- 172.21.15.72:0/3968471082 wait complete. 2023-07-27T20:33:28.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.289+0000 7fe5f4bff700 1 Processor -- start 2023-07-27T20:33:28.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.289+0000 7fe5f4bff700 1 -- start start 2023-07-27T20:33:28.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.290+0000 7fe5f4bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe5f006c1d0 0x7fe5f014e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:28.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.290+0000 7fe5f4bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5f00c7740 0x7fe5f00be620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:28.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.290+0000 7fe5f4bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe5f014aab0 0x7fe5f01ed1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:28.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.290+0000 7fe5f4bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f00bfa70 con 0x7fe5f00c7740 2023-07-27T20:33:28.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.290+0000 7fe5f4bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f00bf4b0 con 0x7fe5f006c1d0 2023-07-27T20:33:28.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.290+0000 7fe5f4bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f00bf790 con 0x7fe5f014aab0 2023-07-27T20:33:28.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.290+0000 7fe5e7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5f00c7740 0x7fe5f00be620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:28.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.290+0000 7fe5e7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5f00c7740 0x7fe5f00be620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39838/0 (socket says 172.21.15.72:39838) 2023-07-27T20:33:28.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.290+0000 7fe5e7fff700 1 -- 172.21.15.72:0/1007209057 learned_addr learned my addr 172.21.15.72:0/1007209057 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:28.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.291+0000 7fe5ee59c700 1 --2- 172.21.15.72:0/1007209057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe5f006c1d0 0x7fe5f014e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:28.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.291+0000 7fe5e7fff700 1 -- 172.21.15.72:0/1007209057 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe5f014aab0 msgr2=0x7fe5f01ed1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:28.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.291+0000 7fe5e7fff700 1 --2- 172.21.15.72:0/1007209057 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe5f014aab0 0x7fe5f01ed1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:28.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.291+0000 7fe5e7fff700 1 -- 172.21.15.72:0/1007209057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe5f006c1d0 msgr2=0x7fe5f014e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:28.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.291+0000 7fe5e7fff700 1 --2- 172.21.15.72:0/1007209057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe5f006c1d0 0x7fe5f014e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:28.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.291+0000 7fe5e7fff700 1 -- 172.21.15.72:0/1007209057 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e00094a0 con 0x7fe5f00c7740 2023-07-27T20:33:28.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.291+0000 7fe5e7fff700 1 --2- 172.21.15.72:0/1007209057 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5f00c7740 0x7fe5f00be620 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fe5d800c700 tx=0x7fe5d800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:28.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.291+0000 7fe5e6ffd700 1 -- 172.21.15.72:0/1007209057 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d8005d70 con 0x7fe5f00c7740 2023-07-27T20:33:28.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.291+0000 7fe5e6ffd700 1 -- 172.21.15.72:0/1007209057 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d80070d0 con 0x7fe5f00c7740 2023-07-27T20:33:28.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.291+0000 7fe5e6ffd700 1 -- 172.21.15.72:0/1007209057 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d8007460 con 0x7fe5f00c7740 2023-07-27T20:33:28.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.291+0000 7fe5f4bff700 1 -- 172.21.15.72:0/1007209057 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f00bde20 con 0x7fe5f00c7740 2023-07-27T20:33:28.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.291+0000 7fe5f4bff700 1 -- 172.21.15.72:0/1007209057 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f01512e0 con 0x7fe5f00c7740 2023-07-27T20:33:28.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.292+0000 7fe5f4bff700 1 -- 172.21.15.72:0/1007209057 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f00be340 con 0x7fe5f00c7740 2023-07-27T20:33:28.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.293+0000 7fe5e6ffd700 1 -- 172.21.15.72:0/1007209057 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe5d80075c0 con 0x7fe5f00c7740 2023-07-27T20:33:28.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.294+0000 7fe5e6ffd700 1 --2- 172.21.15.72:0/1007209057 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe5d006ace0 0x7fe5d006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:28.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.294+0000 7fe5e6ffd700 1 -- 172.21.15.72:0/1007209057 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7fe5d8088fa0 con 0x7fe5f00c7740 2023-07-27T20:33:28.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.295+0000 7fe5ee59c700 1 --2- 172.21.15.72:0/1007209057 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe5d006ace0 0x7fe5d006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:28.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.295+0000 7fe5ee59c700 1 --2- 172.21.15.72:0/1007209057 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe5d006ace0 0x7fe5d006d1a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe5e00090b0 tx=0x7fe5e0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:28.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.298+0000 7fe5e6ffd700 1 -- 172.21.15.72:0/1007209057 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe5f00be340 con 0x7fe5f00c7740 2023-07-27T20:33:28.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.489+0000 7fe5f4bff700 1 -- 172.21.15.72:0/1007209057 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe5f00be340 con 0x7fe5f00c7740 2023-07-27T20:33:28.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.490+0000 7fe5e6ffd700 1 -- 172.21.15.72:0/1007209057 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe5f00be340 con 0x7fe5f00c7740 2023-07-27T20:33:28.477 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-27T20:33:28.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.492+0000 7fe5f4bff700 1 -- 172.21.15.72:0/1007209057 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe5d006ace0 msgr2=0x7fe5d006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:28.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.492+0000 7fe5f4bff700 1 --2- 172.21.15.72:0/1007209057 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe5d006ace0 0x7fe5d006d1a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe5e00090b0 tx=0x7fe5e0008030 comp rx=0 tx=0).stop 2023-07-27T20:33:28.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.492+0000 7fe5f4bff700 1 -- 172.21.15.72:0/1007209057 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5f00c7740 msgr2=0x7fe5f00be620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:28.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.492+0000 7fe5f4bff700 1 --2- 172.21.15.72:0/1007209057 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5f00c7740 0x7fe5f00be620 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fe5d800c700 tx=0x7fe5d800cac0 comp rx=0 tx=0).stop 2023-07-27T20:33:28.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.492+0000 7fe5f4bff700 1 -- 172.21.15.72:0/1007209057 shutdown_connections 2023-07-27T20:33:28.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.492+0000 7fe5f4bff700 1 --2- 172.21.15.72:0/1007209057 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe5d006ace0 0x7fe5d006d1a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:28.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.492+0000 7fe5f4bff700 1 --2- 172.21.15.72:0/1007209057 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe5f014aab0 0x7fe5f01ed1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:28.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.492+0000 7fe5f4bff700 1 --2- 172.21.15.72:0/1007209057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe5f006c1d0 0x7fe5f014e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:28.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.492+0000 7fe5f4bff700 1 --2- 172.21.15.72:0/1007209057 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5f00c7740 0x7fe5f00be620 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:28.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.492+0000 7fe5f4bff700 1 -- 172.21.15.72:0/1007209057 >> 172.21.15.72:0/1007209057 conn(0x7fe5f00ab3f0 msgr2=0x7fe5f0152780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:28.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.492+0000 7fe5f4bff700 1 -- 172.21.15.72:0/1007209057 shutdown_connections 2023-07-27T20:33:28.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.492+0000 7fe5f4bff700 1 -- 172.21.15.72:0/1007209057 wait complete. 2023-07-27T20:33:28.498 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T20:33:28.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.711+0000 7f4d6bfff700 1 Processor -- start 2023-07-27T20:33:28.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.711+0000 7f4d6bfff700 1 -- start start 2023-07-27T20:33:28.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.712+0000 7f4d6bfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d640c12f0 0x7f4d641516c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:28.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.712+0000 7f4d6bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4d640716f0 0x7f4d64071b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:28.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.712+0000 7f4d6bfff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d64154f50 con 0x7f4d641475a0 2023-07-27T20:33:28.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.712+0000 7f4d6bfff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d64151c00 con 0x7f4d640716f0 2023-07-27T20:33:28.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.712+0000 7f4d6bfff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d64154340 con 0x7f4d640c12f0 2023-07-27T20:33:28.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.713+0000 7f4d6a59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4d640716f0 0x7f4d64071b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:28.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.713+0000 7f4d69d9b700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f4d641475a0 0x7f4d640c1d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.72:46604/0 (socket says 172.21.15.72:46604) 2023-07-27T20:33:28.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.713+0000 7f4d69d9b700 1 -- 172.21.15.72:0/58250041 learned_addr learned my addr 172.21.15.72:0/58250041 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:28.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.713+0000 7f4d6959a700 1 --2- 172.21.15.72:0/58250041 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d640c12f0 0x7f4d641516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:28.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.713+0000 7f4d6a59c700 1 -- 172.21.15.72:0/58250041 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d640c12f0 msgr2=0x7f4d641516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:28.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.713+0000 7f4d6a59c700 1 --2- 172.21.15.72:0/58250041 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d640c12f0 0x7f4d641516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:28.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.713+0000 7f4d6a59c700 1 -- 172.21.15.72:0/58250041 >> v1:172.21.15.173:6789/0 conn(0x7f4d641475a0 legacy=0x7f4d640c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:28.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.713+0000 7f4d6a59c700 1 -- 172.21.15.72:0/58250041 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d64154620 con 0x7f4d640716f0 2023-07-27T20:33:28.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.713+0000 7f4d68d99700 1 -- 172.21.15.72:0/58250041 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2943945420 0 0) 0x7f4d64154f50 con 0x7f4d641475a0 2023-07-27T20:33:28.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.713+0000 7f4d6a59c700 1 --2- 172.21.15.72:0/58250041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d640716f0 0x7f4d64071b60 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c009d90 tx=0x7f4d5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e252977f2f6981ff server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:28.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.714+0000 7f4d68d99700 1 -- 172.21.15.72:0/58250041 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c00e070 con 0x7f4d640716f0 2023-07-27T20:33:28.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.714+0000 7f4d68d99700 1 -- 172.21.15.72:0/58250041 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5c00bb20 con 0x7f4d640716f0 2023-07-27T20:33:28.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.714+0000 7f4d68d99700 1 -- 172.21.15.72:0/58250041 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c012430 con 0x7f4d640716f0 2023-07-27T20:33:28.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.714+0000 7f4d6bfff700 1 -- 172.21.15.72:0/58250041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d640716f0 msgr2=0x7f4d64071b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:28.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.714+0000 7f4d6bfff700 1 --2- 172.21.15.72:0/58250041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d640716f0 0x7f4d64071b60 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c009d90 tx=0x7f4d5c00b330 comp rx=0 tx=0).stop 2023-07-27T20:33:28.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.714+0000 7f4d6bfff700 1 -- 172.21.15.72:0/58250041 shutdown_connections 2023-07-27T20:33:28.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.714+0000 7f4d6bfff700 1 --2- 172.21.15.72:0/58250041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d640716f0 0x7f4d64071b60 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:28.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.714+0000 7f4d6bfff700 1 --2- 172.21.15.72:0/58250041 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d640c12f0 0x7f4d641516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:28.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.714+0000 7f4d6bfff700 1 -- 172.21.15.72:0/58250041 >> 172.21.15.72:0/58250041 conn(0x7f4d6406a190 msgr2=0x7f4d6406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:28.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.714+0000 7f4d6bfff700 1 -- 172.21.15.72:0/58250041 shutdown_connections 2023-07-27T20:33:28.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.714+0000 7f4d6bfff700 1 -- 172.21.15.72:0/58250041 wait complete. 2023-07-27T20:33:28.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.716+0000 7f4d6bfff700 1 Processor -- start 2023-07-27T20:33:28.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.716+0000 7f4d6bfff700 1 -- start start 2023-07-27T20:33:28.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.717+0000 7f4d6bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d640716f0 0x7f4d641e9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:28.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.717+0000 7f4d6bfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d640c12f0 0x7f4d641dc920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:28.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.717+0000 7f4d6bfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d641475a0 0x7f4d64140af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:28.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.717+0000 7f4d6bfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d64150320 con 0x7f4d640716f0 2023-07-27T20:33:28.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.717+0000 7f4d6bfff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6414c940 con 0x7f4d640c12f0 2023-07-27T20:33:28.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.717+0000 7f4d6bfff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6414f570 con 0x7f4d641475a0 2023-07-27T20:33:28.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.717+0000 7f4d69d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d640716f0 0x7f4d641e9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:28.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.717+0000 7f4d69d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d640716f0 0x7f4d641e9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39846/0 (socket says 172.21.15.72:39846) 2023-07-27T20:33:28.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.717+0000 7f4d69d9b700 1 -- 172.21.15.72:0/2619183347 learned_addr learned my addr 172.21.15.72:0/2619183347 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:28.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.717+0000 7f4d69d9b700 1 -- 172.21.15.72:0/2619183347 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d641475a0 msgr2=0x7f4d64140af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:28.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.717+0000 7f4d69d9b700 1 --2- 172.21.15.72:0/2619183347 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d641475a0 0x7f4d64140af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:28.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.717+0000 7f4d69d9b700 1 -- 172.21.15.72:0/2619183347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d640c12f0 msgr2=0x7f4d641dc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:28.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.717+0000 7f4d69d9b700 1 --2- 172.21.15.72:0/2619183347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d640c12f0 0x7f4d641dc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:28.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.717+0000 7f4d69d9b700 1 -- 172.21.15.72:0/2619183347 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5c009a70 con 0x7f4d640716f0 2023-07-27T20:33:28.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.718+0000 7f4d69d9b700 1 --2- 172.21.15.72:0/2619183347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d640716f0 0x7f4d641e9b20 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f4d6000c550 tx=0x7f4d6000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:28.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.718+0000 7f4d5a7fc700 1 -- 172.21.15.72:0/2619183347 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d60004c80 con 0x7f4d640716f0 2023-07-27T20:33:28.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.718+0000 7f4d5a7fc700 1 -- 172.21.15.72:0/2619183347 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d60004e00 con 0x7f4d640716f0 2023-07-27T20:33:28.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.718+0000 7f4d6bfff700 1 -- 172.21.15.72:0/2619183347 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d641ea060 con 0x7f4d640716f0 2023-07-27T20:33:28.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.718+0000 7f4d5a7fc700 1 -- 172.21.15.72:0/2619183347 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d60007310 con 0x7f4d640716f0 2023-07-27T20:33:28.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.718+0000 7f4d6bfff700 1 -- 172.21.15.72:0/2619183347 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d6414fa80 con 0x7f4d640716f0 2023-07-27T20:33:28.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.719+0000 7f4d6bfff700 1 -- 172.21.15.72:0/2619183347 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d6404e470 con 0x7f4d640716f0 2023-07-27T20:33:28.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.720+0000 7f4d5a7fc700 1 -- 172.21.15.72:0/2619183347 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4d60007470 con 0x7f4d640716f0 2023-07-27T20:33:28.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.721+0000 7f4d5a7fc700 1 --2- 172.21.15.72:0/2619183347 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4d4806ace0 0x7f4d4806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:28.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.721+0000 7f4d5a7fc700 1 -- 172.21.15.72:0/2619183347 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f4d60089530 con 0x7f4d640716f0 2023-07-27T20:33:28.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.721+0000 7f4d6959a700 1 --2- 172.21.15.72:0/2619183347 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4d4806ace0 0x7f4d4806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:28.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.722+0000 7f4d6959a700 1 --2- 172.21.15.72:0/2619183347 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4d4806ace0 0x7f4d4806d1a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4d54006b20 tx=0x7f4d54006ab0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:28.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.725+0000 7f4d5a7fc700 1 -- 172.21.15.72:0/2619183347 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4d60054090 con 0x7f4d640716f0 2023-07-27T20:33:28.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.918+0000 7f4d6bfff700 1 -- 172.21.15.72:0/2619183347 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4d641ea060 con 0x7f4d640716f0 2023-07-27T20:33:28.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.919+0000 7f4d5a7fc700 1 -- 172.21.15.72:0/2619183347 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v47) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4d641ea060 con 0x7f4d640716f0 2023-07-27T20:33:28.907 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-27T20:33:28.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.921+0000 7f4d6bfff700 1 -- 172.21.15.72:0/2619183347 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4d4806ace0 msgr2=0x7f4d4806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:28.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.921+0000 7f4d6bfff700 1 --2- 172.21.15.72:0/2619183347 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4d4806ace0 0x7f4d4806d1a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4d54006b20 tx=0x7f4d54006ab0 comp rx=0 tx=0).stop 2023-07-27T20:33:28.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.921+0000 7f4d6bfff700 1 -- 172.21.15.72:0/2619183347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d640716f0 msgr2=0x7f4d641e9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:28.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.921+0000 7f4d6bfff700 1 --2- 172.21.15.72:0/2619183347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d640716f0 0x7f4d641e9b20 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f4d6000c550 tx=0x7f4d6000c910 comp rx=0 tx=0).stop 2023-07-27T20:33:28.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.921+0000 7f4d6bfff700 1 -- 172.21.15.72:0/2619183347 shutdown_connections 2023-07-27T20:33:28.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.921+0000 7f4d6bfff700 1 --2- 172.21.15.72:0/2619183347 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4d4806ace0 0x7f4d4806d1a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:28.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.921+0000 7f4d6bfff700 1 --2- 172.21.15.72:0/2619183347 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d641475a0 0x7f4d64140af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:28.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.921+0000 7f4d6bfff700 1 --2- 172.21.15.72:0/2619183347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d640716f0 0x7f4d641e9b20 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:28.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.921+0000 7f4d6bfff700 1 --2- 172.21.15.72:0/2619183347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d640c12f0 0x7f4d641dc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:28.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.921+0000 7f4d6bfff700 1 -- 172.21.15.72:0/2619183347 >> 172.21.15.72:0/2619183347 conn(0x7f4d6406a190 msgr2=0x7f4d641dbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:28.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.921+0000 7f4d6bfff700 1 -- 172.21.15.72:0/2619183347 shutdown_connections 2023-07-27T20:33:28.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:28.921+0000 7f4d6bfff700 1 -- 172.21.15.72:0/2619183347 wait complete. 2023-07-27T20:33:28.926 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T20:33:29.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.137+0000 7fe1755ff700 1 Processor -- start 2023-07-27T20:33:29.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.138+0000 7fe1755ff700 1 -- start start 2023-07-27T20:33:29.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.139+0000 7fe1755ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe17006c1d0 0x7fe17006c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:29.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.139+0000 7fe1755ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1700c7c50 con 0x7fe1700c7740 2023-07-27T20:33:29.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.139+0000 7fe1755ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe17006bd40 con 0x7fe17014aab0 2023-07-27T20:33:29.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.139+0000 7fe1755ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1700c62f0 con 0x7fe17006c1d0 2023-07-27T20:33:29.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.139+0000 7fe167fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe1700c7740 0x7fe1700c41c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43486/0 (socket says 172.21.15.72:43486) 2023-07-27T20:33:29.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.139+0000 7fe167fff700 1 -- 172.21.15.72:0/1575736628 learned_addr learned my addr 172.21.15.72:0/1575736628 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:29.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.139+0000 7fe16f7fe700 1 --2- 172.21.15.72:0/1575736628 >> v2:172.21.15.72:3300/0 conn(0x7fe17006c1d0 0x7fe17006c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:29.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.139+0000 7fe16e7fc700 1 -- 172.21.15.72:0/1575736628 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1432345274 0 0) 0x7fe1700c7c50 con 0x7fe1700c7740 2023-07-27T20:33:29.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.140+0000 7fe16e7fc700 1 -- 172.21.15.72:0/1575736628 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe15c0035b0 con 0x7fe1700c7740 2023-07-27T20:33:29.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.140+0000 7fe16e7fc700 1 -- 172.21.15.72:0/1575736628 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 350042689 0 0) 0x7fe17006bd40 con 0x7fe17014aab0 2023-07-27T20:33:29.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.140+0000 7fe16e7fc700 1 -- 172.21.15.72:0/1575736628 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1700c7c50 con 0x7fe17014aab0 2023-07-27T20:33:29.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.140+0000 7fe16f7fe700 1 -- 172.21.15.72:0/1575736628 >> v1:172.21.15.173:6789/0 conn(0x7fe17014aab0 legacy=0x7fe170154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:29.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.140+0000 7fe16f7fe700 1 -- 172.21.15.72:0/1575736628 >> v1:172.21.15.72:6789/0 conn(0x7fe1700c7740 legacy=0x7fe1700c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:29.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.140+0000 7fe16f7fe700 1 -- 172.21.15.72:0/1575736628 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17006d200 con 0x7fe17006c1d0 2023-07-27T20:33:29.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.140+0000 7fe16f7fe700 1 --2- 172.21.15.72:0/1575736628 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe17006c1d0 0x7fe17006c5f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fe168009d90 tx=0x7fe16800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a82da01dfa2e7 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:29.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.140+0000 7fe16e7fc700 1 -- 172.21.15.72:0/1575736628 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16800e070 con 0x7fe17006c1d0 2023-07-27T20:33:29.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.140+0000 7fe16e7fc700 1 -- 172.21.15.72:0/1575736628 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16800bb20 con 0x7fe17006c1d0 2023-07-27T20:33:29.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.140+0000 7fe16e7fc700 1 -- 172.21.15.72:0/1575736628 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe168012430 con 0x7fe17006c1d0 2023-07-27T20:33:29.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.141+0000 7fe1755ff700 1 -- 172.21.15.72:0/1575736628 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe17006c1d0 msgr2=0x7fe17006c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:29.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.141+0000 7fe1755ff700 1 --2- 172.21.15.72:0/1575736628 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe17006c1d0 0x7fe17006c5f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fe168009d90 tx=0x7fe16800b330 comp rx=0 tx=0).stop 2023-07-27T20:33:29.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.141+0000 7fe1755ff700 1 -- 172.21.15.72:0/1575736628 shutdown_connections 2023-07-27T20:33:29.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.141+0000 7fe1755ff700 1 --2- 172.21.15.72:0/1575736628 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe17006c1d0 0x7fe17006c5f0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:29.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.141+0000 7fe1755ff700 1 -- 172.21.15.72:0/1575736628 >> 172.21.15.72:0/1575736628 conn(0x7fe1700ab3f0 msgr2=0x7fe1700ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:29.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.141+0000 7fe1755ff700 1 -- 172.21.15.72:0/1575736628 shutdown_connections 2023-07-27T20:33:29.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.141+0000 7fe1755ff700 1 -- 172.21.15.72:0/1575736628 wait complete. 2023-07-27T20:33:29.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.143+0000 7fe1755ff700 1 Processor -- start 2023-07-27T20:33:29.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.143+0000 7fe1755ff700 1 -- start start 2023-07-27T20:33:29.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.144+0000 7fe1755ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe17006c1d0 0x7fe1700c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:29.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.144+0000 7fe1755ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1700c7740 0x7fe17014fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:29.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.144+0000 7fe1755ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe17014aab0 0x7fe170148ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:29.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.144+0000 7fe1755ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17014c910 con 0x7fe1700c7740 2023-07-27T20:33:29.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.144+0000 7fe1755ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17014d9f0 con 0x7fe17006c1d0 2023-07-27T20:33:29.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.144+0000 7fe1755ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17014d5f0 con 0x7fe17014aab0 2023-07-27T20:33:29.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.145+0000 7fe167fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1700c7740 0x7fe17014fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:29.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.145+0000 7fe167fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1700c7740 0x7fe17014fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39872/0 (socket says 172.21.15.72:39872) 2023-07-27T20:33:29.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.145+0000 7fe167fff700 1 -- 172.21.15.72:0/3996584334 learned_addr learned my addr 172.21.15.72:0/3996584334 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:29.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.145+0000 7fe16effd700 1 --2- 172.21.15.72:0/3996584334 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe17006c1d0 0x7fe1700c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:29.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.145+0000 7fe16f7fe700 1 --2- 172.21.15.72:0/3996584334 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe17014aab0 0x7fe170148ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:29.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.145+0000 7fe167fff700 1 -- 172.21.15.72:0/3996584334 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe17014aab0 msgr2=0x7fe170148ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:29.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.145+0000 7fe167fff700 1 --2- 172.21.15.72:0/3996584334 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe17014aab0 0x7fe170148ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:29.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.145+0000 7fe167fff700 1 -- 172.21.15.72:0/3996584334 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe17006c1d0 msgr2=0x7fe1700c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:29.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.145+0000 7fe167fff700 1 --2- 172.21.15.72:0/3996584334 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe17006c1d0 0x7fe1700c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:29.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.145+0000 7fe167fff700 1 -- 172.21.15.72:0/3996584334 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe168009a70 con 0x7fe1700c7740 2023-07-27T20:33:29.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.145+0000 7fe167fff700 1 --2- 172.21.15.72:0/3996584334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1700c7740 0x7fe17014fff0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fe15800c700 tx=0x7fe15800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:29.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.146+0000 7fe1677fe700 1 -- 172.21.15.72:0/3996584334 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe158005d70 con 0x7fe1700c7740 2023-07-27T20:33:29.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.146+0000 7fe1677fe700 1 -- 172.21.15.72:0/3996584334 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1580070d0 con 0x7fe1700c7740 2023-07-27T20:33:29.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.146+0000 7fe1677fe700 1 -- 172.21.15.72:0/3996584334 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe158007460 con 0x7fe1700c7740 2023-07-27T20:33:29.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.146+0000 7fe1755ff700 1 -- 172.21.15.72:0/3996584334 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe17014b9c0 con 0x7fe1700c7740 2023-07-27T20:33:29.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.146+0000 7fe1755ff700 1 -- 172.21.15.72:0/3996584334 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe17014dec0 con 0x7fe1700c7740 2023-07-27T20:33:29.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.147+0000 7fe1755ff700 1 -- 172.21.15.72:0/3996584334 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe17004e470 con 0x7fe1700c7740 2023-07-27T20:33:29.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.148+0000 7fe1677fe700 1 -- 172.21.15.72:0/3996584334 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe1580075c0 con 0x7fe1700c7740 2023-07-27T20:33:29.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.149+0000 7fe1677fe700 1 --2- 172.21.15.72:0/3996584334 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe15006ace0 0x7fe15006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:29.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.149+0000 7fe1677fe700 1 -- 172.21.15.72:0/3996584334 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7fe158088ee0 con 0x7fe1700c7740 2023-07-27T20:33:29.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.149+0000 7fe16effd700 1 --2- 172.21.15.72:0/3996584334 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe15006ace0 0x7fe15006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:29.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.150+0000 7fe16effd700 1 --2- 172.21.15.72:0/3996584334 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe15006ace0 0x7fe15006d1a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe1600011e0 tx=0x7fe160009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:29.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.153+0000 7fe1677fe700 1 -- 172.21.15.72:0/3996584334 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe158053ac0 con 0x7fe1700c7740 2023-07-27T20:33:29.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.354+0000 7fe1755ff700 1 -- 172.21.15.72:0/3996584334 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe17006cf00 con 0x7fe1700c7740 2023-07-27T20:33:29.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.354+0000 7fe1677fe700 1 -- 172.21.15.72:0/3996584334 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe1580570e0 con 0x7fe1700c7740 2023-07-27T20:33:29.342 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:33:29.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.356+0000 7fe1755ff700 1 -- 172.21.15.72:0/3996584334 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe15006ace0 msgr2=0x7fe15006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:29.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.356+0000 7fe1755ff700 1 --2- 172.21.15.72:0/3996584334 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe15006ace0 0x7fe15006d1a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe1600011e0 tx=0x7fe160009040 comp rx=0 tx=0).stop 2023-07-27T20:33:29.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.356+0000 7fe1755ff700 1 -- 172.21.15.72:0/3996584334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1700c7740 msgr2=0x7fe17014fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:29.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.356+0000 7fe1755ff700 1 --2- 172.21.15.72:0/3996584334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1700c7740 0x7fe17014fff0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fe15800c700 tx=0x7fe15800ca10 comp rx=0 tx=0).stop 2023-07-27T20:33:29.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.357+0000 7fe1755ff700 1 -- 172.21.15.72:0/3996584334 shutdown_connections 2023-07-27T20:33:29.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.357+0000 7fe1755ff700 1 --2- 172.21.15.72:0/3996584334 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe15006ace0 0x7fe15006d1a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:29.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.357+0000 7fe1755ff700 1 --2- 172.21.15.72:0/3996584334 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe17014aab0 0x7fe170148ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:29.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.357+0000 7fe1755ff700 1 --2- 172.21.15.72:0/3996584334 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe17006c1d0 0x7fe1700c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:29.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.357+0000 7fe1755ff700 1 --2- 172.21.15.72:0/3996584334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1700c7740 0x7fe17014fff0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:29.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.357+0000 7fe1755ff700 1 -- 172.21.15.72:0/3996584334 >> 172.21.15.72:0/3996584334 conn(0x7fe1700ab3f0 msgr2=0x7fe1701df050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:29.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.357+0000 7fe1755ff700 1 -- 172.21.15.72:0/3996584334 shutdown_connections 2023-07-27T20:33:29.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.357+0000 7fe1755ff700 1 -- 172.21.15.72:0/3996584334 wait complete. 2023-07-27T20:33:29.362 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T20:33:29.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.574+0000 7f500a9ff700 1 Processor -- start 2023-07-27T20:33:29.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.574+0000 7f500a9ff700 1 -- start start 2023-07-27T20:33:29.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.575+0000 7f500a9ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f50040c7740 0x7f50040c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:29.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.575+0000 7f500a9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50040c7c50 con 0x7f50040c4700 2023-07-27T20:33:29.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.575+0000 7f500a9ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f500406bd40 con 0x7f500414aab0 2023-07-27T20:33:29.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.575+0000 7f500a9ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50040c62f0 con 0x7f50040c7740 2023-07-27T20:33:29.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.575+0000 7f5008f9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f50040c4700 0x7f500406c1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43488/0 (socket says 172.21.15.72:43488) 2023-07-27T20:33:29.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.575+0000 7f5008f9c700 1 -- 172.21.15.72:0/2619414641 learned_addr learned my addr 172.21.15.72:0/2619414641 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:29.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.576+0000 7f50037fe700 1 --2- 172.21.15.72:0/2619414641 >> v2:172.21.15.173:3300/0 conn(0x7f50040c7740 0x7f50040c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:29.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.576+0000 7f5002ffd700 1 -- 172.21.15.72:0/2619414641 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229169065 0 0) 0x7f50040c7c50 con 0x7f50040c4700 2023-07-27T20:33:29.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.576+0000 7f5002ffd700 1 -- 172.21.15.72:0/2619414641 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fec0035b0 con 0x7f50040c4700 2023-07-27T20:33:29.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.576+0000 7f5002ffd700 1 -- 172.21.15.72:0/2619414641 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 113179535 0 0) 0x7f4fec0035b0 con 0x7f50040c4700 2023-07-27T20:33:29.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.576+0000 7f5002ffd700 1 -- 172.21.15.72:0/2619414641 >> v2:172.21.15.173:3300/0 conn(0x7f50040c7740 msgr2=0x7f50040c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:29.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.576+0000 7f5002ffd700 1 --2- 172.21.15.72:0/2619414641 >> v2:172.21.15.173:3300/0 conn(0x7f50040c7740 0x7f50040c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:29.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.576+0000 7f5002ffd700 1 -- 172.21.15.72:0/2619414641 >> v1:172.21.15.173:6789/0 conn(0x7f500414aab0 legacy=0x7f5004154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:29.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.576+0000 7f5002ffd700 1 -- 172.21.15.72:0/2619414641 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500406d200 con 0x7f50040c4700 2023-07-27T20:33:29.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.576+0000 7f5002ffd700 1 -- 172.21.15.72:0/2619414641 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f4ffc0019f0 con 0x7f50040c4700 2023-07-27T20:33:29.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.576+0000 7f5002ffd700 1 -- 172.21.15.72:0/2619414641 >> v1:172.21.15.72:6789/0 conn(0x7f50040c4700 legacy=0x7f500406c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:29.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.576+0000 7f5002ffd700 1 --2- 172.21.15.72:0/2619414641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fec003a00 0x7f4fec003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:29.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.576+0000 7f5002ffd700 1 --2- 172.21.15.72:0/2619414641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fec004850 0x7f4fec004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:29.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.576+0000 7f5002ffd700 1 --2- 172.21.15.72:0/2619414641 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4fec005210 0x7f4fec00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:29.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.576+0000 7f5002ffd700 1 -- 172.21.15.72:0/2619414641 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50040c62f0 con 0x7f4fec004850 2023-07-27T20:33:29.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.576+0000 7f5002ffd700 1 -- 172.21.15.72:0/2619414641 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fec00c060 con 0x7f4fec003a00 2023-07-27T20:33:29.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.576+0000 7f5002ffd700 1 -- 172.21.15.72:0/2619414641 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fec00c220 con 0x7f4fec005210 2023-07-27T20:33:29.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.576+0000 7f50037fe700 1 --2- 172.21.15.72:0/2619414641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fec004850 0x7f4fec004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:29.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.577+0000 7f5003fff700 1 --2- 172.21.15.72:0/2619414641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fec003a00 0x7f4fec003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:29.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.577+0000 7f5008f9c700 1 --2- 172.21.15.72:0/2619414641 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4fec005210 0x7f4fec00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:29.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.577+0000 7f50037fe700 1 -- 172.21.15.72:0/2619414641 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4fec005210 msgr2=0x7f4fec00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:29.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.577+0000 7f50037fe700 1 --2- 172.21.15.72:0/2619414641 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4fec005210 0x7f4fec00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:29.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.577+0000 7f50037fe700 1 -- 172.21.15.72:0/2619414641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fec003a00 msgr2=0x7f4fec003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:29.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.577+0000 7f50037fe700 1 --2- 172.21.15.72:0/2619414641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fec003a00 0x7f4fec003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:29.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.577+0000 7f50037fe700 1 -- 172.21.15.72:0/2619414641 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fec0035b0 con 0x7f4fec004850 2023-07-27T20:33:29.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.577+0000 7f5008f9c700 1 -- 172.21.15.72:0/2619414641 reap_dead start 2023-07-27T20:33:29.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.577+0000 7f50037fe700 1 --2- 172.21.15.72:0/2619414641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fec004850 0x7f4fec004cd0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8009b60 tx=0x7f4fec005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=660865c34a81e445 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:29.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.577+0000 7f5002ffd700 1 -- 172.21.15.72:0/2619414641 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff800e6c0 con 0x7f4fec004850 2023-07-27T20:33:29.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.577+0000 7f5002ffd700 1 -- 172.21.15.72:0/2619414641 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff800e820 con 0x7f4fec004850 2023-07-27T20:33:29.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.577+0000 7f5002ffd700 1 -- 172.21.15.72:0/2619414641 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff800eb90 con 0x7f4fec004850 2023-07-27T20:33:29.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.578+0000 7f500a9ff700 1 -- 172.21.15.72:0/2619414641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fec004850 msgr2=0x7f4fec004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:29.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.578+0000 7f500a9ff700 1 --2- 172.21.15.72:0/2619414641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fec004850 0x7f4fec004cd0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8009b60 tx=0x7f4fec005880 comp rx=0 tx=0).stop 2023-07-27T20:33:29.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.578+0000 7f500a9ff700 1 -- 172.21.15.72:0/2619414641 shutdown_connections 2023-07-27T20:33:29.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.578+0000 7f500a9ff700 1 --2- 172.21.15.72:0/2619414641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fec004850 0x7f4fec004cd0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:29.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.578+0000 7f500a9ff700 1 -- 172.21.15.72:0/2619414641 >> 172.21.15.72:0/2619414641 conn(0x7f50040ab3f0 msgr2=0x7f50040ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:29.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.578+0000 7f500a9ff700 1 -- 172.21.15.72:0/2619414641 shutdown_connections 2023-07-27T20:33:29.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.578+0000 7f500a9ff700 1 -- 172.21.15.72:0/2619414641 wait complete. 2023-07-27T20:33:29.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.580+0000 7f500a9ff700 1 Processor -- start 2023-07-27T20:33:29.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.580+0000 7f500a9ff700 1 -- start start 2023-07-27T20:33:29.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.581+0000 7f500a9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fec004850 0x7f50040c3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:29.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.581+0000 7f500a9ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5004147b30 0x7f50041ece50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:29.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.581+0000 7f500a9ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f50041ed390 0x7f50041eb550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:29.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.581+0000 7f500a9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50041479c0 con 0x7f4fec004850 2023-07-27T20:33:29.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.581+0000 7f500a9ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50041edd60 con 0x7f5004147b30 2023-07-27T20:33:29.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.581+0000 7f500a9ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50041eb0c0 con 0x7f50041ed390 2023-07-27T20:33:29.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.581+0000 7f5003fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fec004850 0x7f50040c3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:29.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.581+0000 7f5003fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fec004850 0x7f50040c3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39884/0 (socket says 172.21.15.72:39884) 2023-07-27T20:33:29.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.581+0000 7f5003fff700 1 -- 172.21.15.72:0/2666230584 learned_addr learned my addr 172.21.15.72:0/2666230584 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:29.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.581+0000 7f50037fe700 1 --2- 172.21.15.72:0/2666230584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5004147b30 0x7f50041ece50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:29.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.581+0000 7f5008f9c700 1 --2- 172.21.15.72:0/2666230584 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f50041ed390 0x7f50041eb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:29.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.581+0000 7f5003fff700 1 -- 172.21.15.72:0/2666230584 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f50041ed390 msgr2=0x7f50041eb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:29.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.581+0000 7f5003fff700 1 --2- 172.21.15.72:0/2666230584 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f50041ed390 0x7f50041eb550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:29.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.581+0000 7f5003fff700 1 -- 172.21.15.72:0/2666230584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5004147b30 msgr2=0x7f50041ece50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:29.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.581+0000 7f5003fff700 1 --2- 172.21.15.72:0/2666230584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5004147b30 0x7f50041ece50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:29.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.581+0000 7f5003fff700 1 -- 172.21.15.72:0/2666230584 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50040af3a0 con 0x7f4fec004850 2023-07-27T20:33:29.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.582+0000 7f5003fff700 1 --2- 172.21.15.72:0/2666230584 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fec004850 0x7f50040c3870 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f4ff400f6f0 tx=0x7f4ff400fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:29.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.582+0000 7f5000ff9700 1 -- 172.21.15.72:0/2666230584 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff40052e0 con 0x7f4fec004850 2023-07-27T20:33:29.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.582+0000 7f5000ff9700 1 -- 172.21.15.72:0/2666230584 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff4005460 con 0x7f4fec004850 2023-07-27T20:33:29.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.582+0000 7f500a9ff700 1 -- 172.21.15.72:0/2666230584 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50040af680 con 0x7f4fec004850 2023-07-27T20:33:29.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.582+0000 7f5000ff9700 1 -- 172.21.15.72:0/2666230584 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff40038c0 con 0x7f4fec004850 2023-07-27T20:33:29.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.582+0000 7f500a9ff700 1 -- 172.21.15.72:0/2666230584 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50040ae570 con 0x7f4fec004850 2023-07-27T20:33:29.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.583+0000 7f500a9ff700 1 -- 172.21.15.72:0/2666230584 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50040ae730 con 0x7f4fec004850 2023-07-27T20:33:29.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.584+0000 7f5000ff9700 1 -- 172.21.15.72:0/2666230584 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4ff4003a20 con 0x7f4fec004850 2023-07-27T20:33:29.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.585+0000 7f5000ff9700 1 --2- 172.21.15.72:0/2666230584 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4ff006ad10 0x7f4ff006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:29.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.585+0000 7f5000ff9700 1 -- 172.21.15.72:0/2666230584 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f4ff4089570 con 0x7f4fec004850 2023-07-27T20:33:29.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.585+0000 7f50037fe700 1 --2- 172.21.15.72:0/2666230584 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4ff006ad10 0x7f4ff006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:29.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.586+0000 7f50037fe700 1 --2- 172.21.15.72:0/2666230584 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4ff006ad10 0x7f4ff006d1d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4ff80090b0 tx=0x7f4ff801e040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:29.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.589+0000 7f5000ff9700 1 -- 172.21.15.72:0/2666230584 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4ff4054160 con 0x7f4fec004850 2023-07-27T20:33:29.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.785+0000 7f500a9ff700 1 -- 172.21.15.72:0/2666230584 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f50041ec260 con 0x7f4fec004850 2023-07-27T20:33:29.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.785+0000 7f5000ff9700 1 -- 172.21.15.72:0/2666230584 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) v1 ==== 100+0+11 (secure 0 0 0) 0x7f50041ec260 con 0x7f4fec004850 2023-07-27T20:33:29.773 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-27T20:33:29.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.787+0000 7f500a9ff700 1 -- 172.21.15.72:0/2666230584 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4ff006ad10 msgr2=0x7f4ff006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:29.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.787+0000 7f500a9ff700 1 --2- 172.21.15.72:0/2666230584 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4ff006ad10 0x7f4ff006d1d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4ff80090b0 tx=0x7f4ff801e040 comp rx=0 tx=0).stop 2023-07-27T20:33:29.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.787+0000 7f500a9ff700 1 -- 172.21.15.72:0/2666230584 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fec004850 msgr2=0x7f50040c3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:29.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.787+0000 7f500a9ff700 1 --2- 172.21.15.72:0/2666230584 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fec004850 0x7f50040c3870 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f4ff400f6f0 tx=0x7f4ff400fa00 comp rx=0 tx=0).stop 2023-07-27T20:33:29.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.787+0000 7f500a9ff700 1 -- 172.21.15.72:0/2666230584 shutdown_connections 2023-07-27T20:33:29.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.787+0000 7f500a9ff700 1 --2- 172.21.15.72:0/2666230584 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4ff006ad10 0x7f4ff006d1d0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:29.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.787+0000 7f500a9ff700 1 --2- 172.21.15.72:0/2666230584 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f50041ed390 0x7f50041eb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:29.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.787+0000 7f500a9ff700 1 --2- 172.21.15.72:0/2666230584 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fec004850 0x7f50040c3870 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:29.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.787+0000 7f500a9ff700 1 --2- 172.21.15.72:0/2666230584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5004147b30 0x7f50041ece50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:29.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.787+0000 7f500a9ff700 1 -- 172.21.15.72:0/2666230584 >> 172.21.15.72:0/2666230584 conn(0x7f50040ab3f0 msgr2=0x7f50040a9850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:29.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.788+0000 7f500a9ff700 1 -- 172.21.15.72:0/2666230584 shutdown_connections 2023-07-27T20:33:29.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:29.788+0000 7f500a9ff700 1 -- 172.21.15.72:0/2666230584 wait complete. 2023-07-27T20:33:29.792 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-07-27T20:33:29.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.002+0000 7f8b243ff700 1 Processor -- start 2023-07-27T20:33:29.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.002+0000 7f8b243ff700 1 -- start start 2023-07-27T20:33:29.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.003+0000 7f8b243ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8b1c06e140 0x7f8b1c0ba310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:29.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.003+0000 7f8b243ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b1c06ce10 con 0x7f8b1c0ba850 2023-07-27T20:33:29.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.003+0000 7f8b243ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b1c152680 con 0x7f8b1c13b150 2023-07-27T20:33:29.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.003+0000 7f8b243ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b1c152960 con 0x7f8b1c06e140 2023-07-27T20:33:29.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.003+0000 7f8b2299c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8b1c0ba850 0x7f8b1c06d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53728/0 (socket says 172.21.15.72:53728) 2023-07-27T20:33:29.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.003+0000 7f8b2299c700 1 -- 172.21.15.72:0/2414791157 learned_addr learned my addr 172.21.15.72:0/2414791157 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:29.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.004+0000 7f8b2199a700 1 --2- 172.21.15.72:0/2414791157 >> v2:172.21.15.173:3300/0 conn(0x7f8b1c06e140 0x7f8b1c0ba310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:29.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.004+0000 7f8b21199700 1 -- 172.21.15.72:0/2414791157 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1161590994 0 0) 0x7f8b1c06ce10 con 0x7f8b1c0ba850 2023-07-27T20:33:29.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.004+0000 7f8b21199700 1 -- 172.21.15.72:0/2414791157 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b080035b0 con 0x7f8b1c0ba850 2023-07-27T20:33:29.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.004+0000 7f8b21199700 1 -- 172.21.15.72:0/2414791157 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4061422485 0 0) 0x7f8b080035b0 con 0x7f8b1c0ba850 2023-07-27T20:33:29.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.004+0000 7f8b21199700 1 -- 172.21.15.72:0/2414791157 >> v2:172.21.15.173:3300/0 conn(0x7f8b1c06e140 msgr2=0x7f8b1c0ba310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:29.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.004+0000 7f8b21199700 1 --2- 172.21.15.72:0/2414791157 >> v2:172.21.15.173:3300/0 conn(0x7f8b1c06e140 0x7f8b1c0ba310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:29.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.004+0000 7f8b21199700 1 -- 172.21.15.72:0/2414791157 >> v1:172.21.15.173:6789/0 conn(0x7f8b1c13b150 legacy=0x7f8b1c151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:29.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.004+0000 7f8b21199700 1 -- 172.21.15.72:0/2414791157 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b1c152c40 con 0x7f8b1c0ba850 2023-07-27T20:33:29.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.004+0000 7f8b21199700 1 -- 172.21.15.72:0/2414791157 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f8b140019f0 con 0x7f8b1c0ba850 2023-07-27T20:33:29.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.004+0000 7f8b21199700 1 -- 172.21.15.72:0/2414791157 >> v1:172.21.15.72:6789/0 conn(0x7f8b1c0ba850 legacy=0x7f8b1c06d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:29.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.004+0000 7f8b21199700 1 --2- 172.21.15.72:0/2414791157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b08003a00 0x7f8b08003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:29.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.004+0000 7f8b21199700 1 --2- 172.21.15.72:0/2414791157 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b08004400 0x7f8b080048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:29.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.004+0000 7f8b21199700 1 --2- 172.21.15.72:0/2414791157 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b08005170 0x7f8b0800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:29.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.004+0000 7f8b21199700 1 -- 172.21.15.72:0/2414791157 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c152960 con 0x7f8b08003a00 2023-07-27T20:33:29.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.004+0000 7f8b21199700 1 -- 172.21.15.72:0/2414791157 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0800c0b0 con 0x7f8b08005170 2023-07-27T20:33:29.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.004+0000 7f8b21199700 1 -- 172.21.15.72:0/2414791157 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0800c270 con 0x7f8b08004400 2023-07-27T20:33:29.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.004+0000 7f8b2219b700 1 --2- 172.21.15.72:0/2414791157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b08003a00 0x7f8b08003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:29.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.005+0000 7f8b2299c700 1 --2- 172.21.15.72:0/2414791157 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b08005170 0x7f8b0800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:29.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.005+0000 7f8b2199a700 1 --2- 172.21.15.72:0/2414791157 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b08004400 0x7f8b080048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:29.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.005+0000 7f8b2219b700 1 -- 172.21.15.72:0/2414791157 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b08004400 msgr2=0x7f8b080048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:29.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.005+0000 7f8b2219b700 1 --2- 172.21.15.72:0/2414791157 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b08004400 0x7f8b080048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:29.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.005+0000 7f8b2219b700 1 -- 172.21.15.72:0/2414791157 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b08005170 msgr2=0x7f8b0800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:29.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.005+0000 7f8b2219b700 1 --2- 172.21.15.72:0/2414791157 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b08005170 0x7f8b0800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:29.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.005+0000 7f8b2219b700 1 -- 172.21.15.72:0/2414791157 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b080035b0 con 0x7f8b08003a00 2023-07-27T20:33:29.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.005+0000 7f8b2299c700 1 -- 172.21.15.72:0/2414791157 reap_dead start 2023-07-27T20:33:29.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.005+0000 7f8b2199a700 1 --2- 172.21.15.72:0/2414791157 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b08004400 0x7f8b080048d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:33:29.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.005+0000 7f8b2219b700 1 --2- 172.21.15.72:0/2414791157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b08003a00 0x7f8b08003de0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f8b180018d0 tx=0x7f8b08005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5123bd173e19091f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:29.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.005+0000 7f8b21199700 1 -- 172.21.15.72:0/2414791157 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b180052d0 con 0x7f8b08003a00 2023-07-27T20:33:29.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.005+0000 7f8b21199700 1 -- 172.21.15.72:0/2414791157 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b18005430 con 0x7f8b08003a00 2023-07-27T20:33:29.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.005+0000 7f8b21199700 1 -- 172.21.15.72:0/2414791157 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b180038c0 con 0x7f8b08003a00 2023-07-27T20:33:29.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.006+0000 7f8b243ff700 1 -- 172.21.15.72:0/2414791157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b08003a00 msgr2=0x7f8b08003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:29.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.006+0000 7f8b243ff700 1 --2- 172.21.15.72:0/2414791157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b08003a00 0x7f8b08003de0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f8b180018d0 tx=0x7f8b08005880 comp rx=0 tx=0).stop 2023-07-27T20:33:29.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.006+0000 7f8b243ff700 1 -- 172.21.15.72:0/2414791157 shutdown_connections 2023-07-27T20:33:29.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.006+0000 7f8b243ff700 1 --2- 172.21.15.72:0/2414791157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b08003a00 0x7f8b08003de0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:29.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.006+0000 7f8b243ff700 1 -- 172.21.15.72:0/2414791157 >> 172.21.15.72:0/2414791157 conn(0x7f8b1c06a190 msgr2=0x7f8b1c06a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:29.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.006+0000 7f8b243ff700 1 -- 172.21.15.72:0/2414791157 shutdown_connections 2023-07-27T20:33:29.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.006+0000 7f8b243ff700 1 -- 172.21.15.72:0/2414791157 wait complete. 2023-07-27T20:33:30.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.008+0000 7f8b243ff700 1 Processor -- start 2023-07-27T20:33:30.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.008+0000 7f8b243ff700 1 -- start start 2023-07-27T20:33:30.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.009+0000 7f8b243ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b08003a00 0x7f8b1c151740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:30.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.009+0000 7f8b243ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b1c0a9fe0 0x7f8b1c135c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:30.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.009+0000 7f8b243ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b1c136160 0x7f8b1c0a91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:30.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.009+0000 7f8b243ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c14b080 con 0x7f8b1c0a9fe0 2023-07-27T20:33:30.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.009+0000 7f8b243ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c0720c0 con 0x7f8b1c136160 2023-07-27T20:33:30.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.009+0000 7f8b243ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c14d100 con 0x7f8b08003a00 2023-07-27T20:33:30.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.009+0000 7f8b2199a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b1c0a9fe0 0x7f8b1c135c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:30.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.009+0000 7f8b2199a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b1c0a9fe0 0x7f8b1c135c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36000/0 (socket says 172.21.15.72:36000) 2023-07-27T20:33:30.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.009+0000 7f8b2199a700 1 -- 172.21.15.72:0/4095344789 learned_addr learned my addr 172.21.15.72:0/4095344789 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:30.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.009+0000 7f8b2299c700 1 --2- 172.21.15.72:0/4095344789 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b1c136160 0x7f8b1c0a91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:30.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.009+0000 7f8b2219b700 1 --2- 172.21.15.72:0/4095344789 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b08003a00 0x7f8b1c151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:30.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.009+0000 7f8b2199a700 1 -- 172.21.15.72:0/4095344789 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b08003a00 msgr2=0x7f8b1c151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:30.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.009+0000 7f8b2199a700 1 --2- 172.21.15.72:0/4095344789 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b08003a00 0x7f8b1c151740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:30.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.009+0000 7f8b2199a700 1 -- 172.21.15.72:0/4095344789 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b1c136160 msgr2=0x7f8b1c0a91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:30.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.009+0000 7f8b2199a700 1 --2- 172.21.15.72:0/4095344789 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b1c136160 0x7f8b1c0a91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:30.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.009+0000 7f8b2199a700 1 -- 172.21.15.72:0/4095344789 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b1c14ada0 con 0x7f8b1c0a9fe0 2023-07-27T20:33:30.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.010+0000 7f8b2199a700 1 --2- 172.21.15.72:0/4095344789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b1c0a9fe0 0x7f8b1c135c20 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c011590 tx=0x7f8b0c011950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:30.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.010+0000 7f8b12ffd700 1 -- 172.21.15.72:0/4095344789 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c004220 con 0x7f8b1c0a9fe0 2023-07-27T20:33:30.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.010+0000 7f8b12ffd700 1 -- 172.21.15.72:0/4095344789 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0c004380 con 0x7f8b1c0a9fe0 2023-07-27T20:33:30.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.010+0000 7f8b243ff700 1 -- 172.21.15.72:0/4095344789 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b1c14c620 con 0x7f8b1c0a9fe0 2023-07-27T20:33:30.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.010+0000 7f8b12ffd700 1 -- 172.21.15.72:0/4095344789 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c0036a0 con 0x7f8b1c0a9fe0 2023-07-27T20:33:30.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.010+0000 7f8b243ff700 1 -- 172.21.15.72:0/4095344789 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b1c14cbe0 con 0x7f8b1c0a9fe0 2023-07-27T20:33:30.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.011+0000 7f8b243ff700 1 -- 172.21.15.72:0/4095344789 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b1c14c460 con 0x7f8b1c0a9fe0 2023-07-27T20:33:30.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.012+0000 7f8b12ffd700 1 -- 172.21.15.72:0/4095344789 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8b0c003800 con 0x7f8b1c0a9fe0 2023-07-27T20:33:30.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.013+0000 7f8b12ffd700 1 --2- 172.21.15.72:0/4095344789 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8b0006ad10 0x7f8b0006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:30.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.013+0000 7f8b12ffd700 1 -- 172.21.15.72:0/4095344789 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f8b0c089ac0 con 0x7f8b1c0a9fe0 2023-07-27T20:33:30.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.013+0000 7f8b2219b700 1 --2- 172.21.15.72:0/4095344789 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8b0006ad10 0x7f8b0006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:30.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.014+0000 7f8b2219b700 1 --2- 172.21.15.72:0/4095344789 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8b0006ad10 0x7f8b0006d1d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8b18000c00 tx=0x7f8b18005000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:30.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.017+0000 7f8b12ffd700 1 -- 172.21.15.72:0/4095344789 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8b0c0546b0 con 0x7f8b1c0a9fe0 2023-07-27T20:33:30.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.214+0000 7f8b243ff700 1 -- 172.21.15.72:0/4095344789 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8b1c04e470 con 0x7f8b1c0a9fe0 2023-07-27T20:33:30.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.214+0000 7f8b12ffd700 1 -- 172.21.15.72:0/4095344789 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v47) v1 ==== 105+0+11 (secure 0 0 0) 0x7f8b0c057cd0 con 0x7f8b1c0a9fe0 2023-07-27T20:33:30.202 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:33:30.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.217+0000 7f8b243ff700 1 -- 172.21.15.72:0/4095344789 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8b0006ad10 msgr2=0x7f8b0006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:30.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.217+0000 7f8b243ff700 1 --2- 172.21.15.72:0/4095344789 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8b0006ad10 0x7f8b0006d1d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8b18000c00 tx=0x7f8b18005000 comp rx=0 tx=0).stop 2023-07-27T20:33:30.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.217+0000 7f8b243ff700 1 -- 172.21.15.72:0/4095344789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b1c0a9fe0 msgr2=0x7f8b1c135c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:30.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.217+0000 7f8b243ff700 1 --2- 172.21.15.72:0/4095344789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b1c0a9fe0 0x7f8b1c135c20 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c011590 tx=0x7f8b0c011950 comp rx=0 tx=0).stop 2023-07-27T20:33:30.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.217+0000 7f8b243ff700 1 -- 172.21.15.72:0/4095344789 shutdown_connections 2023-07-27T20:33:30.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.217+0000 7f8b243ff700 1 --2- 172.21.15.72:0/4095344789 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b1c136160 0x7f8b1c0a91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:30.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.217+0000 7f8b243ff700 1 --2- 172.21.15.72:0/4095344789 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8b0006ad10 0x7f8b0006d1d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:30.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.217+0000 7f8b243ff700 1 --2- 172.21.15.72:0/4095344789 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b08003a00 0x7f8b1c151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:30.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.217+0000 7f8b243ff700 1 --2- 172.21.15.72:0/4095344789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b1c0a9fe0 0x7f8b1c135c20 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:30.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.217+0000 7f8b243ff700 1 -- 172.21.15.72:0/4095344789 >> 172.21.15.72:0/4095344789 conn(0x7f8b1c06a190 msgr2=0x7f8b1c0c4170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:30.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.217+0000 7f8b243ff700 1 -- 172.21.15.72:0/4095344789 shutdown_connections 2023-07-27T20:33:30.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.217+0000 7f8b243ff700 1 -- 172.21.15.72:0/4095344789 wait complete. 2023-07-27T20:33:30.223 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-07-27T20:33:30.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.433+0000 7f027bdff700 1 Processor -- start 2023-07-27T20:33:30.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.433+0000 7f027bdff700 1 -- start start 2023-07-27T20:33:30.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.434+0000 7f027bdff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f02740a86c0 0x7f0274158100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:30.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.434+0000 7f027bdff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f02740a8aa0 0x7f027406b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:30.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.435+0000 7f027bdff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02740a8ec0 con 0x7f0274071190 2023-07-27T20:33:30.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.435+0000 7f027bdff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02740c3e30 con 0x7f02740a86c0 2023-07-27T20:33:30.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.435+0000 7f027bdff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02740c2ca0 con 0x7f02740a8aa0 2023-07-27T20:33:30.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.435+0000 7f027939a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0274071190 0x7f0274154a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53730/0 (socket says 172.21.15.72:53730) 2023-07-27T20:33:30.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.435+0000 7f027939a700 1 -- 172.21.15.72:0/117403609 learned_addr learned my addr 172.21.15.72:0/117403609 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:30.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.435+0000 7f0279b9b700 1 --2- 172.21.15.72:0/117403609 >> v2:172.21.15.72:3300/0 conn(0x7f02740a86c0 0x7f0274158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:30.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.435+0000 7f027a39c700 1 --2- 172.21.15.72:0/117403609 >> v2:172.21.15.173:3300/0 conn(0x7f02740a8aa0 0x7f027406b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:30.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.435+0000 7f0279b9b700 1 -- 172.21.15.72:0/117403609 >> v2:172.21.15.173:3300/0 conn(0x7f02740a8aa0 msgr2=0x7f027406b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:30.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.435+0000 7f0279b9b700 1 --2- 172.21.15.72:0/117403609 >> v2:172.21.15.173:3300/0 conn(0x7f02740a8aa0 0x7f027406b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:30.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.435+0000 7f0279b9b700 1 -- 172.21.15.72:0/117403609 >> v1:172.21.15.72:6789/0 conn(0x7f0274071190 legacy=0x7f0274154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:30.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.435+0000 7f0279b9b700 1 -- 172.21.15.72:0/117403609 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0274071700 con 0x7f02740a86c0 2023-07-27T20:33:30.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.435+0000 7f027a39c700 1 --2- 172.21.15.72:0/117403609 >> v2:172.21.15.173:3300/0 conn(0x7f02740a8aa0 0x7f027406b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:33:30.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.435+0000 7f0278b99700 1 -- 172.21.15.72:0/117403609 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804345995 0 0) 0x7f02740a8ec0 con 0x7f0274071190 2023-07-27T20:33:30.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.436+0000 7f0279b9b700 1 --2- 172.21.15.72:0/117403609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02740a86c0 0x7f0274158100 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0274071ed0 tx=0x7f0270009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f216ff4f3f4f45f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:30.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.436+0000 7f0278b99700 1 -- 172.21.15.72:0/117403609 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0270011830 con 0x7f02740a86c0 2023-07-27T20:33:30.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.436+0000 7f0278b99700 1 -- 172.21.15.72:0/117403609 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0270011990 con 0x7f02740a86c0 2023-07-27T20:33:30.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.436+0000 7f0278b99700 1 -- 172.21.15.72:0/117403609 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0270011d20 con 0x7f02740a86c0 2023-07-27T20:33:30.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.436+0000 7f027bdff700 1 -- 172.21.15.72:0/117403609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02740a86c0 msgr2=0x7f0274158100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:30.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.436+0000 7f027bdff700 1 --2- 172.21.15.72:0/117403609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02740a86c0 0x7f0274158100 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0274071ed0 tx=0x7f0270009b20 comp rx=0 tx=0).stop 2023-07-27T20:33:30.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.436+0000 7f027bdff700 1 -- 172.21.15.72:0/117403609 shutdown_connections 2023-07-27T20:33:30.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.436+0000 7f027bdff700 1 --2- 172.21.15.72:0/117403609 >> v2:172.21.15.173:3300/0 conn(0x7f02740a8aa0 0x7f027406b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:30.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.436+0000 7f027bdff700 1 --2- 172.21.15.72:0/117403609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02740a86c0 0x7f0274158100 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:30.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.436+0000 7f027bdff700 1 -- 172.21.15.72:0/117403609 >> 172.21.15.72:0/117403609 conn(0x7f02740c2fd0 msgr2=0x7f02740c33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:30.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.436+0000 7f027bdff700 1 -- 172.21.15.72:0/117403609 shutdown_connections 2023-07-27T20:33:30.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.436+0000 7f027bdff700 1 -- 172.21.15.72:0/117403609 wait complete. 2023-07-27T20:33:30.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.438+0000 7f027bdff700 1 Processor -- start 2023-07-27T20:33:30.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.438+0000 7f027bdff700 1 -- start start 2023-07-27T20:33:30.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.439+0000 7f027bdff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0274071190 0x7f027414c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:30.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.439+0000 7f027bdff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02740a86c0 0x7f0274145980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:30.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.439+0000 7f027bdff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f02740a8aa0 0x7f0274145ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:30.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.439+0000 7f027bdff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02741469e0 con 0x7f0274071190 2023-07-27T20:33:30.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.439+0000 7f027bdff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0274155a30 con 0x7f02740a86c0 2023-07-27T20:33:30.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.439+0000 7f027bdff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0274146e90 con 0x7f02740a8aa0 2023-07-27T20:33:30.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.439+0000 7f0279b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0274071190 0x7f027414c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:30.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.439+0000 7f0279b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0274071190 0x7f027414c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36010/0 (socket says 172.21.15.72:36010) 2023-07-27T20:33:30.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.439+0000 7f0279b9b700 1 -- 172.21.15.72:0/631562187 learned_addr learned my addr 172.21.15.72:0/631562187 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:30.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.440+0000 7f027939a700 1 --2- 172.21.15.72:0/631562187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02740a86c0 0x7f0274145980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:30.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.440+0000 7f0279b9b700 1 -- 172.21.15.72:0/631562187 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f02740a8aa0 msgr2=0x7f0274145ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:30.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.440+0000 7f0279b9b700 1 --2- 172.21.15.72:0/631562187 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f02740a8aa0 0x7f0274145ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:30.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.440+0000 7f0279b9b700 1 -- 172.21.15.72:0/631562187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02740a86c0 msgr2=0x7f0274145980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:30.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.440+0000 7f0279b9b700 1 --2- 172.21.15.72:0/631562187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02740a86c0 0x7f0274145980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:30.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.440+0000 7f0279b9b700 1 -- 172.21.15.72:0/631562187 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02700094a0 con 0x7f0274071190 2023-07-27T20:33:30.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.440+0000 7f0279b9b700 1 --2- 172.21.15.72:0/631562187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0274071190 0x7f027414c040 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f02700090b0 tx=0x7f0270004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:30.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.440+0000 7f026a7fc700 1 -- 172.21.15.72:0/631562187 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02700038a0 con 0x7f0274071190 2023-07-27T20:33:30.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.440+0000 7f026a7fc700 1 -- 172.21.15.72:0/631562187 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027001f070 con 0x7f0274071190 2023-07-27T20:33:30.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.440+0000 7f026a7fc700 1 -- 172.21.15.72:0/631562187 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0270003c20 con 0x7f0274071190 2023-07-27T20:33:30.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.440+0000 7f027bdff700 1 -- 172.21.15.72:0/631562187 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0274146bb0 con 0x7f0274071190 2023-07-27T20:33:30.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.440+0000 7f027bdff700 1 -- 172.21.15.72:0/631562187 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02741556c0 con 0x7f0274071190 2023-07-27T20:33:30.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.441+0000 7f027bdff700 1 -- 172.21.15.72:0/631562187 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f027404e470 con 0x7f0274071190 2023-07-27T20:33:30.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.442+0000 7f026a7fc700 1 -- 172.21.15.72:0/631562187 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f027001a430 con 0x7f0274071190 2023-07-27T20:33:30.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.443+0000 7f026a7fc700 1 --2- 172.21.15.72:0/631562187 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f025806ace0 0x7f025806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:30.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.443+0000 7f026a7fc700 1 -- 172.21.15.72:0/631562187 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f0270021070 con 0x7f0274071190 2023-07-27T20:33:30.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.444+0000 7f027939a700 1 --2- 172.21.15.72:0/631562187 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f025806ace0 0x7f025806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:30.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.445+0000 7f027939a700 1 --2- 172.21.15.72:0/631562187 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f025806ace0 0x7f025806d1a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f02740bd2d0 tx=0x7f0264007c90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:30.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.448+0000 7f026a7fc700 1 -- 172.21.15.72:0/631562187 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0270055f10 con 0x7f0274071190 2023-07-27T20:33:30.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.645+0000 7f027bdff700 1 -- 172.21.15.72:0/631562187 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f0274072360 con 0x7f0274071190 2023-07-27T20:33:30.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.645+0000 7f026a7fc700 1 -- 172.21.15.72:0/631562187 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v47) v1 ==== 101+0+11 (secure 0 0 0) 0x7f0270059530 con 0x7f0274071190 2023-07-27T20:33:30.633 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-27T20:33:30.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.648+0000 7f027bdff700 1 -- 172.21.15.72:0/631562187 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f025806ace0 msgr2=0x7f025806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:30.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.648+0000 7f027bdff700 1 --2- 172.21.15.72:0/631562187 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f025806ace0 0x7f025806d1a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f02740bd2d0 tx=0x7f0264007c90 comp rx=0 tx=0).stop 2023-07-27T20:33:30.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.648+0000 7f027bdff700 1 -- 172.21.15.72:0/631562187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0274071190 msgr2=0x7f027414c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:30.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.648+0000 7f027bdff700 1 --2- 172.21.15.72:0/631562187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0274071190 0x7f027414c040 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f02700090b0 tx=0x7f0270004750 comp rx=0 tx=0).stop 2023-07-27T20:33:30.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.648+0000 7f027bdff700 1 -- 172.21.15.72:0/631562187 shutdown_connections 2023-07-27T20:33:30.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.648+0000 7f027bdff700 1 --2- 172.21.15.72:0/631562187 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f025806ace0 0x7f025806d1a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:30.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.648+0000 7f027bdff700 1 --2- 172.21.15.72:0/631562187 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f02740a8aa0 0x7f0274145ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:30.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.648+0000 7f027bdff700 1 --2- 172.21.15.72:0/631562187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0274071190 0x7f027414c040 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:30.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.648+0000 7f027bdff700 1 --2- 172.21.15.72:0/631562187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02740a86c0 0x7f0274145980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:30.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.648+0000 7f027bdff700 1 -- 172.21.15.72:0/631562187 >> 172.21.15.72:0/631562187 conn(0x7f02740c2fd0 msgr2=0x7f027406b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:30.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.648+0000 7f027bdff700 1 -- 172.21.15.72:0/631562187 shutdown_connections 2023-07-27T20:33:30.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.648+0000 7f027bdff700 1 -- 172.21.15.72:0/631562187 wait complete. 2023-07-27T20:33:30.653 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-27T20:33:30.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.862+0000 7f44099ff700 1 Processor -- start 2023-07-27T20:33:30.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.862+0000 7f44099ff700 1 -- start start 2023-07-27T20:33:30.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.863+0000 7f44099ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f440406b150 0x7f44040c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:30.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.863+0000 7f44099ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f44041549f0 0x7f44041514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:30.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.863+0000 7f44099ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f440406b710 con 0x7f44040c4400 2023-07-27T20:33:30.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.863+0000 7f44099ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44041545d0 con 0x7f44041549f0 2023-07-27T20:33:30.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.863+0000 7f44099ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f440406c860 con 0x7f440406b150 2023-07-27T20:33:30.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.864+0000 7f43fbfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f440406b150 0x7f44040c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:30.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.864+0000 7f4402ffd700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f44040c4400 0x7f44040c4cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.72:34440/0 (socket says 172.21.15.72:34440) 2023-07-27T20:33:30.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.864+0000 7f44037fe700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f44041549f0 0x7f44041514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:30.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.864+0000 7f4402ffd700 1 -- 172.21.15.72:0/585757176 learned_addr learned my addr 172.21.15.72:0/585757176 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:30.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.865+0000 7f44037fe700 1 -- 172.21.15.72:0/585757176 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f440406b150 msgr2=0x7f44040c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:30.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.865+0000 7f44037fe700 1 --2- 172.21.15.72:0/585757176 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f440406b150 0x7f44040c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:30.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.865+0000 7f44037fe700 1 -- 172.21.15.72:0/585757176 >> v1:172.21.15.173:6789/0 conn(0x7f44040c4400 legacy=0x7f44040c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:30.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.865+0000 7f44037fe700 1 -- 172.21.15.72:0/585757176 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f440406b9f0 con 0x7f44041549f0 2023-07-27T20:33:30.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.865+0000 7f44037fe700 1 --2- 172.21.15.72:0/585757176 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44041549f0 0x7f44041514a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f43fc009d90 tx=0x7f43fc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=569121674a0cfdd0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:30.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.865+0000 7f44027fc700 1 -- 172.21.15.72:0/585757176 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc00e070 con 0x7f44041549f0 2023-07-27T20:33:30.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.865+0000 7f44027fc700 1 -- 172.21.15.72:0/585757176 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43fc00bb20 con 0x7f44041549f0 2023-07-27T20:33:30.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.865+0000 7f44027fc700 1 -- 172.21.15.72:0/585757176 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc012430 con 0x7f44041549f0 2023-07-27T20:33:30.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.866+0000 7f44099ff700 1 -- 172.21.15.72:0/585757176 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44041549f0 msgr2=0x7f44041514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:30.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.866+0000 7f44099ff700 1 --2- 172.21.15.72:0/585757176 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44041549f0 0x7f44041514a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f43fc009d90 tx=0x7f43fc00b330 comp rx=0 tx=0).stop 2023-07-27T20:33:30.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.866+0000 7f44099ff700 1 -- 172.21.15.72:0/585757176 shutdown_connections 2023-07-27T20:33:30.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.866+0000 7f44099ff700 1 --2- 172.21.15.72:0/585757176 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44041549f0 0x7f44041514a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:30.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.866+0000 7f44099ff700 1 --2- 172.21.15.72:0/585757176 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f440406b150 0x7f44040c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:30.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.866+0000 7f44099ff700 1 -- 172.21.15.72:0/585757176 >> 172.21.15.72:0/585757176 conn(0x7f44040ab300 msgr2=0x7f44040ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:30.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.866+0000 7f44099ff700 1 -- 172.21.15.72:0/585757176 shutdown_connections 2023-07-27T20:33:30.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.866+0000 7f44099ff700 1 -- 172.21.15.72:0/585757176 wait complete. 2023-07-27T20:33:30.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.868+0000 7f44099ff700 1 Processor -- start 2023-07-27T20:33:30.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.868+0000 7f44099ff700 1 -- start start 2023-07-27T20:33:30.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.869+0000 7f44099ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f440406b150 0x7f4404149b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:30.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.869+0000 7f44099ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44040c4400 0x7f44041eb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:30.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.869+0000 7f44099ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44041549f0 0x7f44041eb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:30.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.869+0000 7f44099ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44041eae80 con 0x7f440406b150 2023-07-27T20:33:30.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.869+0000 7f44099ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44040c2a10 con 0x7f44040c4400 2023-07-27T20:33:30.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.869+0000 7f44099ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44040c12b0 con 0x7f44041549f0 2023-07-27T20:33:30.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.869+0000 7f4402ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f440406b150 0x7f4404149b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:30.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.869+0000 7f4402ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f440406b150 0x7f4404149b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36012/0 (socket says 172.21.15.72:36012) 2023-07-27T20:33:30.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.869+0000 7f4402ffd700 1 -- 172.21.15.72:0/2027068804 learned_addr learned my addr 172.21.15.72:0/2027068804 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:30.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.869+0000 7f44037fe700 1 --2- 172.21.15.72:0/2027068804 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44041549f0 0x7f44041eb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:30.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.869+0000 7f43fbfff700 1 --2- 172.21.15.72:0/2027068804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44040c4400 0x7f44041eb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:30.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.869+0000 7f4402ffd700 1 -- 172.21.15.72:0/2027068804 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44041549f0 msgr2=0x7f44041eb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:30.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.869+0000 7f4402ffd700 1 --2- 172.21.15.72:0/2027068804 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44041549f0 0x7f44041eb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:30.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.869+0000 7f4402ffd700 1 -- 172.21.15.72:0/2027068804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44040c4400 msgr2=0x7f44041eb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:30.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.869+0000 7f4402ffd700 1 --2- 172.21.15.72:0/2027068804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44040c4400 0x7f44041eb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:30.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.869+0000 7f4402ffd700 1 -- 172.21.15.72:0/2027068804 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43fc009a70 con 0x7f440406b150 2023-07-27T20:33:30.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.870+0000 7f4402ffd700 1 --2- 172.21.15.72:0/2027068804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f440406b150 0x7f4404149b40 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f43f400c550 tx=0x7f43f400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:30.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.870+0000 7f4400ff9700 1 -- 172.21.15.72:0/2027068804 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f4005d70 con 0x7f440406b150 2023-07-27T20:33:30.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.870+0000 7f4400ff9700 1 -- 172.21.15.72:0/2027068804 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f40070d0 con 0x7f440406b150 2023-07-27T20:33:30.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.870+0000 7f4400ff9700 1 -- 172.21.15.72:0/2027068804 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f4007440 con 0x7f440406b150 2023-07-27T20:33:30.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.870+0000 7f44099ff700 1 -- 172.21.15.72:0/2027068804 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44040c1590 con 0x7f440406b150 2023-07-27T20:33:30.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.870+0000 7f44099ff700 1 -- 172.21.15.72:0/2027068804 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f440414a080 con 0x7f440406b150 2023-07-27T20:33:30.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.871+0000 7f44099ff700 1 -- 172.21.15.72:0/2027068804 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44041eb160 con 0x7f440406b150 2023-07-27T20:33:30.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.872+0000 7f4400ff9700 1 -- 172.21.15.72:0/2027068804 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f43f40075a0 con 0x7f440406b150 2023-07-27T20:33:30.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.873+0000 7f4400ff9700 1 --2- 172.21.15.72:0/2027068804 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f43e406ace0 0x7f43e406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:30.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.873+0000 7f4400ff9700 1 -- 172.21.15.72:0/2027068804 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f43f4088be0 con 0x7f440406b150 2023-07-27T20:33:30.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.873+0000 7f43fbfff700 1 --2- 172.21.15.72:0/2027068804 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f43e406ace0 0x7f43e406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:30.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.874+0000 7f43fbfff700 1 --2- 172.21.15.72:0/2027068804 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f43e406ace0 0x7f43e406d1a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4404153ab0 tx=0x7f43ec009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:30.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:30.877+0000 7f4400ff9700 1 -- 172.21.15.72:0/2027068804 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f43f4053880 con 0x7f440406b150 2023-07-27T20:33:31.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.088+0000 7f44099ff700 1 -- 172.21.15.72:0/2027068804 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f440406bca0 con 0x7f440406b150 2023-07-27T20:33:31.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.089+0000 7f4400ff9700 1 -- 172.21.15.72:0/2027068804 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v47) v1 ==== 80+0+0 (secure 0 0 0) 0x7f43f4056ea0 con 0x7f440406b150 2023-07-27T20:33:31.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.091+0000 7f44099ff700 1 -- 172.21.15.72:0/2027068804 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f43e406ace0 msgr2=0x7f43e406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:31.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.091+0000 7f44099ff700 1 --2- 172.21.15.72:0/2027068804 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f43e406ace0 0x7f43e406d1a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4404153ab0 tx=0x7f43ec009210 comp rx=0 tx=0).stop 2023-07-27T20:33:31.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.091+0000 7f44099ff700 1 -- 172.21.15.72:0/2027068804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f440406b150 msgr2=0x7f4404149b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:31.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.091+0000 7f44099ff700 1 --2- 172.21.15.72:0/2027068804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f440406b150 0x7f4404149b40 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f43f400c550 tx=0x7f43f400c860 comp rx=0 tx=0).stop 2023-07-27T20:33:31.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.091+0000 7f44099ff700 1 -- 172.21.15.72:0/2027068804 shutdown_connections 2023-07-27T20:33:31.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.091+0000 7f44099ff700 1 --2- 172.21.15.72:0/2027068804 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f43e406ace0 0x7f43e406d1a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:31.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.091+0000 7f44099ff700 1 --2- 172.21.15.72:0/2027068804 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44041549f0 0x7f44041eb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:31.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.091+0000 7f44099ff700 1 --2- 172.21.15.72:0/2027068804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f440406b150 0x7f4404149b40 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:31.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.091+0000 7f44099ff700 1 --2- 172.21.15.72:0/2027068804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44040c4400 0x7f44041eb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:31.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.091+0000 7f44099ff700 1 -- 172.21.15.72:0/2027068804 >> 172.21.15.72:0/2027068804 conn(0x7f44040ab300 msgr2=0x7f44040c7390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:31.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.092+0000 7f44099ff700 1 -- 172.21.15.72:0/2027068804 shutdown_connections 2023-07-27T20:33:31.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.092+0000 7f44099ff700 1 -- 172.21.15.72:0/2027068804 wait complete. 2023-07-27T20:33:31.081 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-07-27T20:33:31.097 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-07-27T20:33:31.097 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-27T20:33:31.149 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:33:31.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.358+0000 7f57015ff700 1 Processor -- start 2023-07-27T20:33:31.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.358+0000 7f57015ff700 1 -- start start 2023-07-27T20:33:31.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.360+0000 7f57015ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f56fc13b2c0 0x7f56fc0aa420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:31.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.360+0000 7f57015ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f56fc0bfd90 0x7f56fc0aa960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:31.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.360+0000 7f57015ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56fc0aaea0 con 0x7f56fc0a83a0 2023-07-27T20:33:31.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.360+0000 7f57015ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56fc0a9620 con 0x7f56fc0bfd90 2023-07-27T20:33:31.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.360+0000 7f57015ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56fc0a8f20 con 0x7f56fc13b2c0 2023-07-27T20:33:31.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.360+0000 7f56f3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f56fc0bfd90 0x7f56fc0aa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:31.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.360+0000 7f56f3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f56fc0bfd90 0x7f56fc0aa960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36018/0 (socket says 172.21.15.72:36018) 2023-07-27T20:33:31.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.360+0000 7f56f3fff700 1 -- 172.21.15.72:0/3492950028 learned_addr learned my addr 172.21.15.72:0/3492950028 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:31.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.360+0000 7f56faffd700 1 --2- 172.21.15.72:0/3492950028 >> v2:172.21.15.173:3300/0 conn(0x7f56fc13b2c0 0x7f56fc0aa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:31.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.360+0000 7f56f3fff700 1 -- 172.21.15.72:0/3492950028 >> v2:172.21.15.173:3300/0 conn(0x7f56fc13b2c0 msgr2=0x7f56fc0aa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:31.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.360+0000 7f56f3fff700 1 --2- 172.21.15.72:0/3492950028 >> v2:172.21.15.173:3300/0 conn(0x7f56fc13b2c0 0x7f56fc0aa420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:31.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.360+0000 7f56f3fff700 1 -- 172.21.15.72:0/3492950028 >> v1:172.21.15.173:6789/0 conn(0x7f56fc0a83a0 legacy=0x7f56fc0a8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:31.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.360+0000 7f56f3fff700 1 -- 172.21.15.72:0/3492950028 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56fc155600 con 0x7f56fc0bfd90 2023-07-27T20:33:31.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.360+0000 7f56faffd700 1 --2- 172.21.15.72:0/3492950028 >> v2:172.21.15.173:3300/0 conn(0x7f56fc13b2c0 0x7f56fc0aa420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:33:31.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.361+0000 7f56f3fff700 1 --2- 172.21.15.72:0/3492950028 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56fc0bfd90 0x7f56fc0aa960 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f56fc0c64a0 tx=0x7f56e4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c881e6c6eea7e8af server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:31.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.361+0000 7f56fa7fc700 1 -- 172.21.15.72:0/3492950028 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e400b860 con 0x7f56fc0bfd90 2023-07-27T20:33:31.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.361+0000 7f56fa7fc700 1 -- 172.21.15.72:0/3492950028 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e400b9c0 con 0x7f56fc0bfd90 2023-07-27T20:33:31.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.361+0000 7f56fa7fc700 1 -- 172.21.15.72:0/3492950028 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e400bd50 con 0x7f56fc0bfd90 2023-07-27T20:33:31.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.361+0000 7f57015ff700 1 -- 172.21.15.72:0/3492950028 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56fc0bfd90 msgr2=0x7f56fc0aa960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:31.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.361+0000 7f57015ff700 1 --2- 172.21.15.72:0/3492950028 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56fc0bfd90 0x7f56fc0aa960 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f56fc0c64a0 tx=0x7f56e4009c00 comp rx=0 tx=0).stop 2023-07-27T20:33:31.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.362+0000 7f57015ff700 1 -- 172.21.15.72:0/3492950028 shutdown_connections 2023-07-27T20:33:31.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.362+0000 7f57015ff700 1 --2- 172.21.15.72:0/3492950028 >> v2:172.21.15.173:3300/0 conn(0x7f56fc13b2c0 0x7f56fc0aa420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:31.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.362+0000 7f57015ff700 1 --2- 172.21.15.72:0/3492950028 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56fc0bfd90 0x7f56fc0aa960 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:31.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.362+0000 7f57015ff700 1 -- 172.21.15.72:0/3492950028 >> 172.21.15.72:0/3492950028 conn(0x7f56fc06a190 msgr2=0x7f56fc06a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:31.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.362+0000 7f57015ff700 1 -- 172.21.15.72:0/3492950028 shutdown_connections 2023-07-27T20:33:31.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.362+0000 7f57015ff700 1 -- 172.21.15.72:0/3492950028 wait complete. 2023-07-27T20:33:31.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.363+0000 7f57015ff700 1 Processor -- start 2023-07-27T20:33:31.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.363+0000 7f57015ff700 1 -- start start 2023-07-27T20:33:31.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.364+0000 7f57015ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56fc0a83a0 0x7f56fc153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:31.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.364+0000 7f57015ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f56fc0bfd90 0x7f56fc1376d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:31.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.364+0000 7f57015ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56fc13b2c0 0x7f56fc137c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:31.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.364+0000 7f57015ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc0ba860 con 0x7f56fc0a83a0 2023-07-27T20:33:31.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.364+0000 7f57015ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc1dc720 con 0x7f56fc13b2c0 2023-07-27T20:33:31.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.364+0000 7f57015ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc1dd740 con 0x7f56fc0bfd90 2023-07-27T20:33:31.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.364+0000 7f56faffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56fc0a83a0 0x7f56fc153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:31.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.365+0000 7f56faffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56fc0a83a0 0x7f56fc153d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36020/0 (socket says 172.21.15.72:36020) 2023-07-27T20:33:31.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.365+0000 7f56faffd700 1 -- 172.21.15.72:0/110110863 learned_addr learned my addr 172.21.15.72:0/110110863 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:31.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.365+0000 7f56f3fff700 1 --2- 172.21.15.72:0/110110863 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f56fc0bfd90 0x7f56fc1376d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:31.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.365+0000 7f56fb7fe700 1 --2- 172.21.15.72:0/110110863 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56fc13b2c0 0x7f56fc137c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:31.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.365+0000 7f56faffd700 1 -- 172.21.15.72:0/110110863 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f56fc0bfd90 msgr2=0x7f56fc1376d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:31.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.365+0000 7f56faffd700 1 --2- 172.21.15.72:0/110110863 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f56fc0bfd90 0x7f56fc1376d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:31.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.365+0000 7f56faffd700 1 -- 172.21.15.72:0/110110863 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56fc13b2c0 msgr2=0x7f56fc137c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:31.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.365+0000 7f56faffd700 1 --2- 172.21.15.72:0/110110863 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56fc13b2c0 0x7f56fc137c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:31.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.365+0000 7f56faffd700 1 -- 172.21.15.72:0/110110863 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e4009550 con 0x7f56fc0a83a0 2023-07-27T20:33:31.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.365+0000 7f56f3fff700 1 --2- 172.21.15.72:0/110110863 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f56fc0bfd90 0x7f56fc1376d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:33:31.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.365+0000 7f56fb7fe700 1 --2- 172.21.15.72:0/110110863 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56fc13b2c0 0x7f56fc137c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:33:31.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.365+0000 7f56faffd700 1 --2- 172.21.15.72:0/110110863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56fc0a83a0 0x7f56fc153d60 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f56ec00c7f0 tx=0x7f56ec00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:31.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.365+0000 7f56f37fe700 1 -- 172.21.15.72:0/110110863 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec011800 con 0x7f56fc0a83a0 2023-07-27T20:33:31.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.365+0000 7f56f37fe700 1 -- 172.21.15.72:0/110110863 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56ec011960 con 0x7f56fc0a83a0 2023-07-27T20:33:31.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.365+0000 7f56f37fe700 1 -- 172.21.15.72:0/110110863 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec011d10 con 0x7f56fc0a83a0 2023-07-27T20:33:31.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.365+0000 7f57015ff700 1 -- 172.21.15.72:0/110110863 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56fc1dc160 con 0x7f56fc0a83a0 2023-07-27T20:33:31.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.366+0000 7f57015ff700 1 -- 172.21.15.72:0/110110863 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56fc1dd3d0 con 0x7f56fc0a83a0 2023-07-27T20:33:31.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.367+0000 7f57015ff700 1 -- 172.21.15.72:0/110110863 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56fc1dd230 con 0x7f56fc0a83a0 2023-07-27T20:33:31.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.368+0000 7f56f37fe700 1 -- 172.21.15.72:0/110110863 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f56ec018360 con 0x7f56fc0a83a0 2023-07-27T20:33:31.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.368+0000 7f56f37fe700 1 --2- 172.21.15.72:0/110110863 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f56dc06ace0 0x7f56dc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:31.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.369+0000 7f56f37fe700 1 -- 172.21.15.72:0/110110863 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f56ec0899b0 con 0x7f56fc0a83a0 2023-07-27T20:33:31.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.369+0000 7f56f3fff700 1 --2- 172.21.15.72:0/110110863 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f56dc06ace0 0x7f56dc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:31.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.370+0000 7f56f3fff700 1 --2- 172.21.15.72:0/110110863 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f56dc06ace0 0x7f56dc06d1a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f56fc0c01b0 tx=0x7f56e4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:31.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.373+0000 7f56f37fe700 1 -- 172.21.15.72:0/110110863 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f56fc1dd230 con 0x7f56fc0a83a0 2023-07-27T20:33:31.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.566+0000 7f57015ff700 1 -- 172.21.15.72:0/110110863 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56fc1dd230 con 0x7f56fc0a83a0 2023-07-27T20:33:31.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.567+0000 7f56f37fe700 1 -- 172.21.15.72:0/110110863 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+22308 (secure 0 0 0) 0x7f56fc1dd230 con 0x7f56fc0a83a0 2023-07-27T20:33:31.555 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:33:31.555 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":47,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:33:23.191066+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:32:58.242890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-27T20:32:59.032110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_metadata","create_time":"2023-07-27T20:33:20.125785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs2_data","create_time":"2023-07-27T20:33:20.647929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2c","mappings":[{"from":0,"to":4}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:33:31.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.570+0000 7f57015ff700 1 -- 172.21.15.72:0/110110863 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f56dc06ace0 msgr2=0x7f56dc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:31.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.570+0000 7f57015ff700 1 --2- 172.21.15.72:0/110110863 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f56dc06ace0 0x7f56dc06d1a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f56fc0c01b0 tx=0x7f56e4008030 comp rx=0 tx=0).stop 2023-07-27T20:33:31.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.570+0000 7f57015ff700 1 -- 172.21.15.72:0/110110863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56fc0a83a0 msgr2=0x7f56fc153d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:31.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.570+0000 7f57015ff700 1 --2- 172.21.15.72:0/110110863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56fc0a83a0 0x7f56fc153d60 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f56ec00c7f0 tx=0x7f56ec00cbb0 comp rx=0 tx=0).stop 2023-07-27T20:33:31.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.570+0000 7f57015ff700 1 -- 172.21.15.72:0/110110863 shutdown_connections 2023-07-27T20:33:31.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.570+0000 7f57015ff700 1 --2- 172.21.15.72:0/110110863 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56fc13b2c0 0x7f56fc137c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:31.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.570+0000 7f57015ff700 1 --2- 172.21.15.72:0/110110863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56fc0a83a0 0x7f56fc153d60 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:31.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.570+0000 7f57015ff700 1 --2- 172.21.15.72:0/110110863 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f56dc06ace0 0x7f56dc06d1a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:31.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.570+0000 7f57015ff700 1 --2- 172.21.15.72:0/110110863 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f56fc0bfd90 0x7f56fc1376d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:31.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.570+0000 7f57015ff700 1 -- 172.21.15.72:0/110110863 >> 172.21.15.72:0/110110863 conn(0x7f56fc06a190 msgr2=0x7f56fc139760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:31.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.570+0000 7f57015ff700 1 -- 172.21.15.72:0/110110863 shutdown_connections 2023-07-27T20:33:31.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.570+0000 7f57015ff700 1 -- 172.21.15.72:0/110110863 wait complete. 2023-07-27T20:33:31.577 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-27T20:31:14.581785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T20:31:21.077941+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T20:32:58.242890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T20:32:59.032110+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-07-27T20:33:20.125785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs2_data', 'create_time': '2023-07-27T20:33:20.647929+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-27T20:33:31.578 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-27T20:33:31.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.788+0000 7f19787ff700 1 Processor -- start 2023-07-27T20:33:31.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.788+0000 7f19787ff700 1 -- start start 2023-07-27T20:33:31.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.790+0000 7f19787ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f19700c12f0 0x7f19701516c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:31.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.790+0000 7f19787ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f19700716f0 0x7f1970071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:31.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.790+0000 7f19787ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1970154f50 con 0x7f19701475a0 2023-07-27T20:33:31.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.790+0000 7f19787ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1970151c00 con 0x7f19700c12f0 2023-07-27T20:33:31.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.790+0000 7f19787ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1970154340 con 0x7f19700716f0 2023-07-27T20:33:31.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.790+0000 7f1975d9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f19700c12f0 0x7f19701516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:31.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.790+0000 7f197659b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f19701475a0 0x7f19700c1d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53742/0 (socket says 172.21.15.72:53742) 2023-07-27T20:33:31.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.790+0000 7f197659b700 1 -- 172.21.15.72:0/3383950990 learned_addr learned my addr 172.21.15.72:0/3383950990 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:31.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.790+0000 7f1976d9c700 1 --2- 172.21.15.72:0/3383950990 >> v2:172.21.15.173:3300/0 conn(0x7f19700716f0 0x7f1970071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:31.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.790+0000 7f1975d9a700 1 -- 172.21.15.72:0/3383950990 >> v2:172.21.15.173:3300/0 conn(0x7f19700716f0 msgr2=0x7f1970071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:31.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.790+0000 7f1975d9a700 1 --2- 172.21.15.72:0/3383950990 >> v2:172.21.15.173:3300/0 conn(0x7f19700716f0 0x7f1970071b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:31.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.790+0000 7f1975d9a700 1 -- 172.21.15.72:0/3383950990 >> v1:172.21.15.72:6789/0 conn(0x7f19701475a0 legacy=0x7f19700c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:31.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.790+0000 7f1975d9a700 1 -- 172.21.15.72:0/3383950990 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1970154620 con 0x7f19700c12f0 2023-07-27T20:33:31.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.790+0000 7f1976d9c700 1 --2- 172.21.15.72:0/3383950990 >> v2:172.21.15.173:3300/0 conn(0x7f19700716f0 0x7f1970071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:33:31.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.790+0000 7f1975599700 1 -- 172.21.15.72:0/3383950990 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4194717573 0 0) 0x7f1970154f50 con 0x7f19701475a0 2023-07-27T20:33:31.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.791+0000 7f1975d9a700 1 --2- 172.21.15.72:0/3383950990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19700c12f0 0x7f19701516c0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f19700c1780 tx=0x7f1960009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edd53814db58bb2a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:31.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.791+0000 7f1975599700 1 -- 172.21.15.72:0/3383950990 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1960011830 con 0x7f19700c12f0 2023-07-27T20:33:31.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.791+0000 7f1975599700 1 -- 172.21.15.72:0/3383950990 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1960011990 con 0x7f19700c12f0 2023-07-27T20:33:31.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.791+0000 7f1975599700 1 -- 172.21.15.72:0/3383950990 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1960011d20 con 0x7f19700c12f0 2023-07-27T20:33:31.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.791+0000 7f19787ff700 1 -- 172.21.15.72:0/3383950990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19700c12f0 msgr2=0x7f19701516c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:31.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.791+0000 7f19787ff700 1 --2- 172.21.15.72:0/3383950990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19700c12f0 0x7f19701516c0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f19700c1780 tx=0x7f1960009b20 comp rx=0 tx=0).stop 2023-07-27T20:33:31.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.792+0000 7f19787ff700 1 -- 172.21.15.72:0/3383950990 shutdown_connections 2023-07-27T20:33:31.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.792+0000 7f19787ff700 1 --2- 172.21.15.72:0/3383950990 >> v2:172.21.15.173:3300/0 conn(0x7f19700716f0 0x7f1970071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:31.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.792+0000 7f19787ff700 1 --2- 172.21.15.72:0/3383950990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19700c12f0 0x7f19701516c0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:31.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.792+0000 7f19787ff700 1 -- 172.21.15.72:0/3383950990 >> 172.21.15.72:0/3383950990 conn(0x7f197006a190 msgr2=0x7f197006a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:31.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.792+0000 7f19787ff700 1 -- 172.21.15.72:0/3383950990 shutdown_connections 2023-07-27T20:33:31.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.792+0000 7f19787ff700 1 -- 172.21.15.72:0/3383950990 wait complete. 2023-07-27T20:33:31.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.793+0000 7f19787ff700 1 Processor -- start 2023-07-27T20:33:31.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.793+0000 7f19787ff700 1 -- start start 2023-07-27T20:33:31.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.794+0000 7f19787ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f19700716f0 0x7f1970142db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:31.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.794+0000 7f19787ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19700c12f0 0x7f19701400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:31.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.794+0000 7f19787ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19701475a0 0x7f19701405f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:31.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.794+0000 7f19787ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1970143b10 con 0x7f19700c12f0 2023-07-27T20:33:31.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.794+0000 7f19787ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19700bc500 con 0x7f19701475a0 2023-07-27T20:33:31.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.794+0000 7f19787ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1970140b30 con 0x7f19700716f0 2023-07-27T20:33:31.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.794+0000 7f1975d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19700c12f0 0x7f19701400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:31.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.795+0000 7f1975d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19700c12f0 0x7f19701400b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36040/0 (socket says 172.21.15.72:36040) 2023-07-27T20:33:31.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.795+0000 7f1975d9a700 1 -- 172.21.15.72:0/147597366 learned_addr learned my addr 172.21.15.72:0/147597366 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:31.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.795+0000 7f197659b700 1 --2- 172.21.15.72:0/147597366 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f19700716f0 0x7f1970142db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:31.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.795+0000 7f1976d9c700 1 --2- 172.21.15.72:0/147597366 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19701475a0 0x7f19701405f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:31.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.795+0000 7f1975d9a700 1 -- 172.21.15.72:0/147597366 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f19700716f0 msgr2=0x7f1970142db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:31.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.795+0000 7f1975d9a700 1 --2- 172.21.15.72:0/147597366 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f19700716f0 0x7f1970142db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:31.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.795+0000 7f1975d9a700 1 -- 172.21.15.72:0/147597366 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19701475a0 msgr2=0x7f19701405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:31.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.795+0000 7f1975d9a700 1 --2- 172.21.15.72:0/147597366 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19701475a0 0x7f19701405f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:31.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.795+0000 7f1975d9a700 1 -- 172.21.15.72:0/147597366 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19600094a0 con 0x7f19700c12f0 2023-07-27T20:33:31.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.795+0000 7f1975d9a700 1 --2- 172.21.15.72:0/147597366 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19700c12f0 0x7f19701400b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f19700c2b90 tx=0x7f1960004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:31.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.795+0000 7f1966ffd700 1 -- 172.21.15.72:0/147597366 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19600038a0 con 0x7f19700c12f0 2023-07-27T20:33:31.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.795+0000 7f1966ffd700 1 -- 172.21.15.72:0/147597366 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196001f070 con 0x7f19700c12f0 2023-07-27T20:33:31.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.795+0000 7f19787ff700 1 -- 172.21.15.72:0/147597366 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19701ed790 con 0x7f19700c12f0 2023-07-27T20:33:31.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.795+0000 7f1966ffd700 1 -- 172.21.15.72:0/147597366 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1960003c20 con 0x7f19700c12f0 2023-07-27T20:33:31.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.796+0000 7f19787ff700 1 -- 172.21.15.72:0/147597366 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19700bf270 con 0x7f19700c12f0 2023-07-27T20:33:31.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.797+0000 7f19787ff700 1 -- 172.21.15.72:0/147597366 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19700c6240 con 0x7f19700c12f0 2023-07-27T20:33:31.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.798+0000 7f1966ffd700 1 -- 172.21.15.72:0/147597366 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f196001a430 con 0x7f19700c12f0 2023-07-27T20:33:31.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.799+0000 7f1966ffd700 1 --2- 172.21.15.72:0/147597366 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f195406ace0 0x7f195406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:31.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.799+0000 7f1966ffd700 1 -- 172.21.15.72:0/147597366 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f1960021070 con 0x7f19700c12f0 2023-07-27T20:33:31.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.799+0000 7f197659b700 1 --2- 172.21.15.72:0/147597366 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f195406ace0 0x7f195406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:31.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.800+0000 7f197659b700 1 --2- 172.21.15.72:0/147597366 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f195406ace0 0x7f195406d1a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f196c000f60 tx=0x7f196c007c90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:31.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.803+0000 7f1966ffd700 1 -- 172.21.15.72:0/147597366 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1960055ef0 con 0x7f19700c12f0 2023-07-27T20:33:31.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.997+0000 7f19787ff700 1 -- 172.21.15.72:0/147597366 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f197004e470 con 0x7f19700c12f0 2023-07-27T20:33:31.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:31.998+0000 7f1966ffd700 1 -- 172.21.15.72:0/147597366 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1960059510 con 0x7f19700c12f0 2023-07-27T20:33:31.985 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-27T20:33:31.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.000+0000 7f19787ff700 1 -- 172.21.15.72:0/147597366 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f195406ace0 msgr2=0x7f195406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:31.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.000+0000 7f19787ff700 1 --2- 172.21.15.72:0/147597366 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f195406ace0 0x7f195406d1a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f196c000f60 tx=0x7f196c007c90 comp rx=0 tx=0).stop 2023-07-27T20:33:31.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.000+0000 7f19787ff700 1 -- 172.21.15.72:0/147597366 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19700c12f0 msgr2=0x7f19701400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:31.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.000+0000 7f19787ff700 1 --2- 172.21.15.72:0/147597366 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19700c12f0 0x7f19701400b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f19700c2b90 tx=0x7f1960004750 comp rx=0 tx=0).stop 2023-07-27T20:33:31.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.000+0000 7f19787ff700 1 -- 172.21.15.72:0/147597366 shutdown_connections 2023-07-27T20:33:31.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.000+0000 7f19787ff700 1 --2- 172.21.15.72:0/147597366 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19701475a0 0x7f19701405f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:31.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.000+0000 7f19787ff700 1 --2- 172.21.15.72:0/147597366 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f195406ace0 0x7f195406d1a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:31.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.000+0000 7f19787ff700 1 --2- 172.21.15.72:0/147597366 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f19700716f0 0x7f1970142db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:31.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.000+0000 7f19787ff700 1 --2- 172.21.15.72:0/147597366 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19700c12f0 0x7f19701400b0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:31.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.000+0000 7f19787ff700 1 -- 172.21.15.72:0/147597366 >> 172.21.15.72:0/147597366 conn(0x7f197006a190 msgr2=0x7f19701410a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:31.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.000+0000 7f19787ff700 1 -- 172.21.15.72:0/147597366 shutdown_connections 2023-07-27T20:33:31.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.000+0000 7f19787ff700 1 -- 172.21.15.72:0/147597366 wait complete. 2023-07-27T20:33:32.005 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T20:33:32.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.216+0000 7f0f125ff700 1 Processor -- start 2023-07-27T20:33:32.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.216+0000 7f0f125ff700 1 -- start start 2023-07-27T20:33:32.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.218+0000 7f0f125ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f0c14f3f0 0x7f0f0c1528e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:32.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.218+0000 7f0f125ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0f0c0abb90 0x7f0f0c0a8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:32.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.218+0000 7f0f125ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f0c152e20 con 0x7f0f0c0ab730 2023-07-27T20:33:32.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.218+0000 7f0f125ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f0c0c25f0 con 0x7f0f0c0abb90 2023-07-27T20:33:32.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.218+0000 7f0f125ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c0c1b50 con 0x7f0f0c14f3f0 2023-07-27T20:33:32.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.218+0000 7f0f10b9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0f0c0abb90 0x7f0f0c0a8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:32.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.218+0000 7f0f0b7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0f0c0ab730 0x7f0f0c0a8170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53756/0 (socket says 172.21.15.72:53756) 2023-07-27T20:33:32.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.218+0000 7f0f0b7fe700 1 -- 172.21.15.72:0/2902875584 learned_addr learned my addr 172.21.15.72:0/2902875584 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:32.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.218+0000 7f0f0bfff700 1 --2- 172.21.15.72:0/2902875584 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f0c14f3f0 0x7f0f0c1528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:32.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.218+0000 7f0f0affd700 1 -- 172.21.15.72:0/2902875584 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3470565144 0 0) 0x7f0f00001110 con 0x7f0f0c0ab730 2023-07-27T20:33:32.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.218+0000 7f0f0affd700 1 -- 172.21.15.72:0/2902875584 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ef40035b0 con 0x7f0f0c0ab730 2023-07-27T20:33:32.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.218+0000 7f0f10b9c700 1 -- 172.21.15.72:0/2902875584 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f0c14f3f0 msgr2=0x7f0f0c1528e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:32.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.218+0000 7f0f10b9c700 1 --2- 172.21.15.72:0/2902875584 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f0c14f3f0 0x7f0f0c1528e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:32.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.218+0000 7f0f10b9c700 1 -- 172.21.15.72:0/2902875584 >> v1:172.21.15.72:6789/0 conn(0x7f0f0c0ab730 legacy=0x7f0f0c0a8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:32.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.218+0000 7f0f10b9c700 1 -- 172.21.15.72:0/2902875584 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f0c0c12b0 con 0x7f0f0c0abb90 2023-07-27T20:33:32.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.219+0000 7f0f10b9c700 1 --2- 172.21.15.72:0/2902875584 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f0c0abb90 0x7f0f0c0a8880 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009d90 tx=0x7f0f0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be95bf9b3858c622 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:32.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.219+0000 7f0f0affd700 1 -- 172.21.15.72:0/2902875584 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0400e070 con 0x7f0f0c0abb90 2023-07-27T20:33:32.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.219+0000 7f0f0affd700 1 -- 172.21.15.72:0/2902875584 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f0400bb20 con 0x7f0f0c0abb90 2023-07-27T20:33:32.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.219+0000 7f0f0affd700 1 -- 172.21.15.72:0/2902875584 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f04012430 con 0x7f0f0c0abb90 2023-07-27T20:33:32.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.219+0000 7f0f125ff700 1 -- 172.21.15.72:0/2902875584 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f0c0abb90 msgr2=0x7f0f0c0a8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:32.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.219+0000 7f0f125ff700 1 --2- 172.21.15.72:0/2902875584 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f0c0abb90 0x7f0f0c0a8880 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009d90 tx=0x7f0f0400b330 comp rx=0 tx=0).stop 2023-07-27T20:33:32.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.220+0000 7f0f125ff700 1 -- 172.21.15.72:0/2902875584 shutdown_connections 2023-07-27T20:33:32.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.220+0000 7f0f125ff700 1 --2- 172.21.15.72:0/2902875584 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f0c0abb90 0x7f0f0c0a8880 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:32.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.220+0000 7f0f125ff700 1 --2- 172.21.15.72:0/2902875584 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f0c14f3f0 0x7f0f0c1528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:32.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.220+0000 7f0f125ff700 1 -- 172.21.15.72:0/2902875584 >> 172.21.15.72:0/2902875584 conn(0x7f0f0c0c2fd0 msgr2=0x7f0f0c0c33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:32.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.220+0000 7f0f125ff700 1 -- 172.21.15.72:0/2902875584 shutdown_connections 2023-07-27T20:33:32.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.220+0000 7f0f125ff700 1 -- 172.21.15.72:0/2902875584 wait complete. 2023-07-27T20:33:32.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.221+0000 7f0f125ff700 1 Processor -- start 2023-07-27T20:33:32.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.221+0000 7f0f125ff700 1 -- start start 2023-07-27T20:33:32.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.222+0000 7f0f125ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f0c0ab730 0x7f0f0c1e4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:32.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.222+0000 7f0f125ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f0c0abb90 0x7f0f0c0be200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:32.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.222+0000 7f0f125ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f0c14f3f0 0x7f0f0c0bfc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:32.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.222+0000 7f0f125ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c1e8130 con 0x7f0f0c0abb90 2023-07-27T20:33:32.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.222+0000 7f0f125ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c14b710 con 0x7f0f0c14f3f0 2023-07-27T20:33:32.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.222+0000 7f0f125ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c14b9f0 con 0x7f0f0c0ab730 2023-07-27T20:33:32.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.223+0000 7f0f0b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f0c0abb90 0x7f0f0c0be200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:32.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.223+0000 7f0f0b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f0c0abb90 0x7f0f0c0be200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36048/0 (socket says 172.21.15.72:36048) 2023-07-27T20:33:32.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.223+0000 7f0f0b7fe700 1 -- 172.21.15.72:0/1350244735 learned_addr learned my addr 172.21.15.72:0/1350244735 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:32.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.223+0000 7f0f0bfff700 1 --2- 172.21.15.72:0/1350244735 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f0c0ab730 0x7f0f0c1e4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:32.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.223+0000 7f0f10b9c700 1 --2- 172.21.15.72:0/1350244735 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f0c14f3f0 0x7f0f0c0bfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:32.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.223+0000 7f0f0b7fe700 1 -- 172.21.15.72:0/1350244735 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f0c0ab730 msgr2=0x7f0f0c1e4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:32.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.223+0000 7f0f0b7fe700 1 --2- 172.21.15.72:0/1350244735 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f0c0ab730 0x7f0f0c1e4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:32.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.223+0000 7f0f0b7fe700 1 -- 172.21.15.72:0/1350244735 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f0c14f3f0 msgr2=0x7f0f0c0bfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:32.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.223+0000 7f0f0b7fe700 1 --2- 172.21.15.72:0/1350244735 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f0c14f3f0 0x7f0f0c0bfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:32.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.223+0000 7f0f0b7fe700 1 -- 172.21.15.72:0/1350244735 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f04009a70 con 0x7f0f0c0abb90 2023-07-27T20:33:32.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.223+0000 7f0f0b7fe700 1 --2- 172.21.15.72:0/1350244735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f0c0abb90 0x7f0f0c0be200 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f0f00007fd0 tx=0x7f0f0000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:32.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.223+0000 7f0f08ff9700 1 -- 172.21.15.72:0/1350244735 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f00005d70 con 0x7f0f0c0abb90 2023-07-27T20:33:32.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.224+0000 7f0f08ff9700 1 -- 172.21.15.72:0/1350244735 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f000070d0 con 0x7f0f0c0abb90 2023-07-27T20:33:32.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.224+0000 7f0f125ff700 1 -- 172.21.15.72:0/1350244735 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f0c14bcd0 con 0x7f0f0c0abb90 2023-07-27T20:33:32.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.224+0000 7f0f08ff9700 1 -- 172.21.15.72:0/1350244735 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f00007460 con 0x7f0f0c0abb90 2023-07-27T20:33:32.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.224+0000 7f0f125ff700 1 -- 172.21.15.72:0/1350244735 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f0c1e4f70 con 0x7f0f0c0abb90 2023-07-27T20:33:32.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.225+0000 7f0f125ff700 1 -- 172.21.15.72:0/1350244735 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f0c04e470 con 0x7f0f0c0abb90 2023-07-27T20:33:32.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.225+0000 7f0f08ff9700 1 -- 172.21.15.72:0/1350244735 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0f000075c0 con 0x7f0f0c0abb90 2023-07-27T20:33:32.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.226+0000 7f0f08ff9700 1 --2- 172.21.15.72:0/1350244735 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0ef806ace0 0x7f0ef806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:32.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.226+0000 7f0f08ff9700 1 -- 172.21.15.72:0/1350244735 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f0f00088c50 con 0x7f0f0c0abb90 2023-07-27T20:33:32.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.227+0000 7f0f0bfff700 1 --2- 172.21.15.72:0/1350244735 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0ef806ace0 0x7f0ef806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:32.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.228+0000 7f0f0bfff700 1 --2- 172.21.15.72:0/1350244735 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0ef806ace0 0x7f0ef806d1a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0efc009b40 tx=0x7f0efc009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:32.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.231+0000 7f0f08ff9700 1 -- 172.21.15.72:0/1350244735 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0f00053840 con 0x7f0f0c0abb90 2023-07-27T20:33:32.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.425+0000 7f0f125ff700 1 -- 172.21.15.72:0/1350244735 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0f0c152e20 con 0x7f0f0c0abb90 2023-07-27T20:33:32.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.425+0000 7f0f08ff9700 1 -- 172.21.15.72:0/1350244735 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v47) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0f0c152e20 con 0x7f0f0c0abb90 2023-07-27T20:33:32.413 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-27T20:33:32.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.427+0000 7f0f125ff700 1 -- 172.21.15.72:0/1350244735 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0ef806ace0 msgr2=0x7f0ef806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:32.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.427+0000 7f0f125ff700 1 --2- 172.21.15.72:0/1350244735 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0ef806ace0 0x7f0ef806d1a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0efc009b40 tx=0x7f0efc009210 comp rx=0 tx=0).stop 2023-07-27T20:33:32.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.427+0000 7f0f125ff700 1 -- 172.21.15.72:0/1350244735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f0c0abb90 msgr2=0x7f0f0c0be200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:32.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.427+0000 7f0f125ff700 1 --2- 172.21.15.72:0/1350244735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f0c0abb90 0x7f0f0c0be200 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f0f00007fd0 tx=0x7f0f0000c9e0 comp rx=0 tx=0).stop 2023-07-27T20:33:32.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.427+0000 7f0f125ff700 1 -- 172.21.15.72:0/1350244735 shutdown_connections 2023-07-27T20:33:32.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.427+0000 7f0f125ff700 1 --2- 172.21.15.72:0/1350244735 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f0c14f3f0 0x7f0f0c0bfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:32.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.427+0000 7f0f125ff700 1 --2- 172.21.15.72:0/1350244735 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0ef806ace0 0x7f0ef806d1a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:32.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.427+0000 7f0f125ff700 1 --2- 172.21.15.72:0/1350244735 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f0c0ab730 0x7f0f0c1e4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:32.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.427+0000 7f0f125ff700 1 --2- 172.21.15.72:0/1350244735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f0c0abb90 0x7f0f0c0be200 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:32.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.427+0000 7f0f125ff700 1 -- 172.21.15.72:0/1350244735 >> 172.21.15.72:0/1350244735 conn(0x7f0f0c0c2fd0 msgr2=0x7f0f0c0a8170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:32.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.428+0000 7f0f125ff700 1 -- 172.21.15.72:0/1350244735 shutdown_connections 2023-07-27T20:33:32.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.428+0000 7f0f125ff700 1 -- 172.21.15.72:0/1350244735 wait complete. 2023-07-27T20:33:32.433 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T20:33:32.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.649+0000 7ff9cfbff700 1 Processor -- start 2023-07-27T20:33:32.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.649+0000 7ff9cfbff700 1 -- start start 2023-07-27T20:33:32.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.650+0000 7ff9cfbff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff9c814aab0 0x7ff9c8154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:32.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.650+0000 7ff9cfbff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff9c80c7740 0x7ff9c80c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:32.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.650+0000 7ff9cfbff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9c80c7c50 con 0x7ff9c80c4700 2023-07-27T20:33:32.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.650+0000 7ff9cfbff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9c806bd40 con 0x7ff9c814aab0 2023-07-27T20:33:32.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.650+0000 7ff9cfbff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c80c62f0 con 0x7ff9c80c7740 2023-07-27T20:33:32.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.651+0000 7ff9cd99b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff9c814aab0 0x7ff9c8154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:32.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.651+0000 7ff9cd99b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff9c814aab0 0x7ff9c8154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36056/0 (socket says 172.21.15.72:36056) 2023-07-27T20:33:32.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.651+0000 7ff9cd99b700 1 -- 172.21.15.72:0/3224653359 learned_addr learned my addr 172.21.15.72:0/3224653359 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:32.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.651+0000 7ff9cd19a700 1 --2- 172.21.15.72:0/3224653359 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff9c80c7740 0x7ff9c80c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:32.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.651+0000 7ff9cd99b700 1 -- 172.21.15.72:0/3224653359 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff9c80c7740 msgr2=0x7ff9c80c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:32.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.651+0000 7ff9cd99b700 1 --2- 172.21.15.72:0/3224653359 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff9c80c7740 0x7ff9c80c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:32.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.651+0000 7ff9cd99b700 1 -- 172.21.15.72:0/3224653359 >> v1:172.21.15.173:6789/0 conn(0x7ff9c80c4700 legacy=0x7ff9c806c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:32.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.651+0000 7ff9cd99b700 1 -- 172.21.15.72:0/3224653359 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c8155050 con 0x7ff9c814aab0 2023-07-27T20:33:32.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.651+0000 7ff9cd99b700 1 --2- 172.21.15.72:0/3224653359 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9c814aab0 0x7ff9c8154b10 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff9c40098f0 tx=0x7ff9c4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b87567e56626c04 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:32.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.651+0000 7ff9cc999700 1 -- 172.21.15.72:0/3224653359 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4004230 con 0x7ff9c814aab0 2023-07-27T20:33:32.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.652+0000 7ff9cc999700 1 -- 172.21.15.72:0/3224653359 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c4004390 con 0x7ff9c814aab0 2023-07-27T20:33:32.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.652+0000 7ff9cc999700 1 -- 172.21.15.72:0/3224653359 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c40036a0 con 0x7ff9c814aab0 2023-07-27T20:33:32.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.652+0000 7ff9cfbff700 1 -- 172.21.15.72:0/3224653359 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9c814aab0 msgr2=0x7ff9c8154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:32.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.652+0000 7ff9cfbff700 1 --2- 172.21.15.72:0/3224653359 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9c814aab0 0x7ff9c8154b10 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff9c40098f0 tx=0x7ff9c4009c00 comp rx=0 tx=0).stop 2023-07-27T20:33:32.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.652+0000 7ff9cfbff700 1 -- 172.21.15.72:0/3224653359 shutdown_connections 2023-07-27T20:33:32.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.652+0000 7ff9cfbff700 1 --2- 172.21.15.72:0/3224653359 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9c814aab0 0x7ff9c8154b10 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:32.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.652+0000 7ff9cfbff700 1 --2- 172.21.15.72:0/3224653359 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff9c80c7740 0x7ff9c80c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:32.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.652+0000 7ff9cfbff700 1 -- 172.21.15.72:0/3224653359 >> 172.21.15.72:0/3224653359 conn(0x7ff9c80ab3f0 msgr2=0x7ff9c80ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:32.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.652+0000 7ff9cfbff700 1 -- 172.21.15.72:0/3224653359 shutdown_connections 2023-07-27T20:33:32.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.652+0000 7ff9cfbff700 1 -- 172.21.15.72:0/3224653359 wait complete. 2023-07-27T20:33:32.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.654+0000 7ff9cfbff700 1 Processor -- start 2023-07-27T20:33:32.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.655+0000 7ff9cfbff700 1 -- start start 2023-07-27T20:33:32.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.656+0000 7ff9cfbff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff9c80c4700 0x7ff9c81554b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:32.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.656+0000 7ff9cfbff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9c80c7740 0x7ff9c8156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:32.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.656+0000 7ff9cfbff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9c814aab0 0x7ff9c8156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:32.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.656+0000 7ff9cfbff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c81586c0 con 0x7ff9c80c7740 2023-07-27T20:33:32.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.656+0000 7ff9cfbff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c81ed5f0 con 0x7ff9c814aab0 2023-07-27T20:33:32.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.656+0000 7ff9cfbff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c81ed890 con 0x7ff9c80c4700 2023-07-27T20:33:32.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.656+0000 7ff9cd19a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9c80c7740 0x7ff9c8156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:32.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.656+0000 7ff9cd19a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9c80c7740 0x7ff9c8156050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36062/0 (socket says 172.21.15.72:36062) 2023-07-27T20:33:32.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.656+0000 7ff9cd19a700 1 -- 172.21.15.72:0/584265587 learned_addr learned my addr 172.21.15.72:0/584265587 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:32.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.656+0000 7ff9cd99b700 1 --2- 172.21.15.72:0/584265587 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff9c80c4700 0x7ff9c81554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:32.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.656+0000 7ff9cd19a700 1 -- 172.21.15.72:0/584265587 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff9c80c4700 msgr2=0x7ff9c81554b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:32.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.656+0000 7ff9ce19c700 1 --2- 172.21.15.72:0/584265587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9c814aab0 0x7ff9c8156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:32.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.656+0000 7ff9cd19a700 1 --2- 172.21.15.72:0/584265587 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff9c80c4700 0x7ff9c81554b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:32.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.656+0000 7ff9cd19a700 1 -- 172.21.15.72:0/584265587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9c814aab0 msgr2=0x7ff9c8156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:32.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.656+0000 7ff9cd19a700 1 --2- 172.21.15.72:0/584265587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9c814aab0 0x7ff9c8156590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:32.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.657+0000 7ff9cd19a700 1 -- 172.21.15.72:0/584265587 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c4009550 con 0x7ff9c80c7740 2023-07-27T20:33:32.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.657+0000 7ff9cd99b700 1 --2- 172.21.15.72:0/584265587 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff9c80c4700 0x7ff9c81554b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:33:32.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.657+0000 7ff9ce19c700 1 --2- 172.21.15.72:0/584265587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9c814aab0 0x7ff9c8156590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:33:32.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.657+0000 7ff9cd19a700 1 --2- 172.21.15.72:0/584265587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9c80c7740 0x7ff9c8156050 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff9b800e7e0 tx=0x7ff9b800eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:32.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.657+0000 7ff9be7fc700 1 -- 172.21.15.72:0/584265587 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b8013610 con 0x7ff9c80c7740 2023-07-27T20:33:32.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.657+0000 7ff9be7fc700 1 -- 172.21.15.72:0/584265587 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b8013770 con 0x7ff9c80c7740 2023-07-27T20:33:32.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.657+0000 7ff9be7fc700 1 -- 172.21.15.72:0/584265587 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b8013ae0 con 0x7ff9c80c7740 2023-07-27T20:33:32.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.657+0000 7ff9cfbff700 1 -- 172.21.15.72:0/584265587 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c8157ec0 con 0x7ff9c80c7740 2023-07-27T20:33:32.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.657+0000 7ff9cfbff700 1 -- 172.21.15.72:0/584265587 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c8152140 con 0x7ff9c80c7740 2023-07-27T20:33:32.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.658+0000 7ff9cfbff700 1 -- 172.21.15.72:0/584265587 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9c804e470 con 0x7ff9c80c7740 2023-07-27T20:33:32.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.659+0000 7ff9be7fc700 1 -- 172.21.15.72:0/584265587 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff9b8013c40 con 0x7ff9c80c7740 2023-07-27T20:33:32.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.660+0000 7ff9be7fc700 1 --2- 172.21.15.72:0/584265587 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff9ac06ace0 0x7ff9ac06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:32.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.660+0000 7ff9be7fc700 1 -- 172.21.15.72:0/584265587 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7ff9b80895b0 con 0x7ff9c80c7740 2023-07-27T20:33:32.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.660+0000 7ff9cd99b700 1 --2- 172.21.15.72:0/584265587 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff9ac06ace0 0x7ff9ac06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:32.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.661+0000 7ff9cd99b700 1 --2- 172.21.15.72:0/584265587 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff9ac06ace0 0x7ff9ac06d1a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4009c40 tx=0x7ff9c4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:32.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.664+0000 7ff9be7fc700 1 -- 172.21.15.72:0/584265587 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff9b8057c30 con 0x7ff9c80c7740 2023-07-27T20:33:32.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.856+0000 7ff9cfbff700 1 -- 172.21.15.72:0/584265587 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff9c806cf00 con 0x7ff9c80c7740 2023-07-27T20:33:32.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.856+0000 7ff9be7fc700 1 -- 172.21.15.72:0/584265587 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff9b80577c0 con 0x7ff9c80c7740 2023-07-27T20:33:32.844 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:33:32.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.858+0000 7ff9cfbff700 1 -- 172.21.15.72:0/584265587 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff9ac06ace0 msgr2=0x7ff9ac06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:32.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.858+0000 7ff9cfbff700 1 --2- 172.21.15.72:0/584265587 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff9ac06ace0 0x7ff9ac06d1a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4009c40 tx=0x7ff9c4008030 comp rx=0 tx=0).stop 2023-07-27T20:33:32.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.858+0000 7ff9cfbff700 1 -- 172.21.15.72:0/584265587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9c80c7740 msgr2=0x7ff9c8156050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:32.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.858+0000 7ff9cfbff700 1 --2- 172.21.15.72:0/584265587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9c80c7740 0x7ff9c8156050 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff9b800e7e0 tx=0x7ff9b800eba0 comp rx=0 tx=0).stop 2023-07-27T20:33:32.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.859+0000 7ff9cfbff700 1 -- 172.21.15.72:0/584265587 shutdown_connections 2023-07-27T20:33:32.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.859+0000 7ff9cfbff700 1 --2- 172.21.15.72:0/584265587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9c814aab0 0x7ff9c8156590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:32.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.859+0000 7ff9cfbff700 1 --2- 172.21.15.72:0/584265587 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff9ac06ace0 0x7ff9ac06d1a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:32.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.859+0000 7ff9cfbff700 1 --2- 172.21.15.72:0/584265587 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff9c80c4700 0x7ff9c81554b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:32.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.859+0000 7ff9cfbff700 1 --2- 172.21.15.72:0/584265587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9c80c7740 0x7ff9c8156050 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:32.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.859+0000 7ff9cfbff700 1 -- 172.21.15.72:0/584265587 >> 172.21.15.72:0/584265587 conn(0x7ff9c80ab3f0 msgr2=0x7ff9c806c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:32.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.859+0000 7ff9cfbff700 1 -- 172.21.15.72:0/584265587 shutdown_connections 2023-07-27T20:33:32.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:32.859+0000 7ff9cfbff700 1 -- 172.21.15.72:0/584265587 wait complete. 2023-07-27T20:33:32.864 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T20:33:33.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.076+0000 7f59b63ff700 1 Processor -- start 2023-07-27T20:33:33.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.076+0000 7f59b63ff700 1 -- start start 2023-07-27T20:33:33.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.077+0000 7f59b63ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f59b014aab0 0x7f59b0154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:33.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.077+0000 7f59b63ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f59b00c7740 0x7f59b00c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:33.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.077+0000 7f59b63ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59b00c7c50 con 0x7f59b00c4700 2023-07-27T20:33:33.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.077+0000 7f59b63ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59b006bd40 con 0x7f59b014aab0 2023-07-27T20:33:33.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.077+0000 7f59b63ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b00c62f0 con 0x7f59b00c7740 2023-07-27T20:33:33.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.078+0000 7f59b499c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f59b00c4700 0x7f59b006c1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53770/0 (socket says 172.21.15.72:53770) 2023-07-27T20:33:33.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.078+0000 7f59b499c700 1 -- 172.21.15.72:0/952518817 learned_addr learned my addr 172.21.15.72:0/952518817 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:33.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.078+0000 7f59affff700 1 --2- 172.21.15.72:0/952518817 >> v2:172.21.15.173:3300/0 conn(0x7f59b014aab0 0x7f59b0154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:33.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.078+0000 7f59af7fe700 1 --2- 172.21.15.72:0/952518817 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f59b00c7740 0x7f59b00c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:33.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.078+0000 7f59aeffd700 1 -- 172.21.15.72:0/952518817 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4269368067 0 0) 0x7f59b00c7c50 con 0x7f59b00c4700 2023-07-27T20:33:33.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.078+0000 7f59aeffd700 1 -- 172.21.15.72:0/952518817 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59980035b0 con 0x7f59b00c4700 2023-07-27T20:33:33.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.078+0000 7f59affff700 1 -- 172.21.15.72:0/952518817 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f59b00c7740 msgr2=0x7f59b00c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:33.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.078+0000 7f59affff700 1 --2- 172.21.15.72:0/952518817 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f59b00c7740 0x7f59b00c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:33.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.078+0000 7f59affff700 1 -- 172.21.15.72:0/952518817 >> v1:172.21.15.72:6789/0 conn(0x7f59b00c4700 legacy=0x7f59b006c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:33.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.078+0000 7f59affff700 1 -- 172.21.15.72:0/952518817 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b0155050 con 0x7f59b014aab0 2023-07-27T20:33:33.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.079+0000 7f59affff700 1 --2- 172.21.15.72:0/952518817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59b014aab0 0x7f59b0154b10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f59a0009840 tx=0x7f59a0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c2359fdf946c500 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:33.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.079+0000 7f59aeffd700 1 -- 172.21.15.72:0/952518817 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a0011830 con 0x7f59b014aab0 2023-07-27T20:33:33.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.079+0000 7f59aeffd700 1 -- 172.21.15.72:0/952518817 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a0011990 con 0x7f59b014aab0 2023-07-27T20:33:33.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.079+0000 7f59aeffd700 1 -- 172.21.15.72:0/952518817 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a0011d20 con 0x7f59b014aab0 2023-07-27T20:33:33.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.079+0000 7f59b63ff700 1 -- 172.21.15.72:0/952518817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59b014aab0 msgr2=0x7f59b0154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:33.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.079+0000 7f59b63ff700 1 --2- 172.21.15.72:0/952518817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59b014aab0 0x7f59b0154b10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f59a0009840 tx=0x7f59a0009b50 comp rx=0 tx=0).stop 2023-07-27T20:33:33.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.079+0000 7f59b63ff700 1 -- 172.21.15.72:0/952518817 shutdown_connections 2023-07-27T20:33:33.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.079+0000 7f59b63ff700 1 --2- 172.21.15.72:0/952518817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59b014aab0 0x7f59b0154b10 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:33.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.079+0000 7f59b63ff700 1 --2- 172.21.15.72:0/952518817 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f59b00c7740 0x7f59b00c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:33.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.079+0000 7f59b63ff700 1 -- 172.21.15.72:0/952518817 >> 172.21.15.72:0/952518817 conn(0x7f59b00ab3f0 msgr2=0x7f59b00ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:33.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.079+0000 7f59b63ff700 1 -- 172.21.15.72:0/952518817 shutdown_connections 2023-07-27T20:33:33.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.080+0000 7f59b63ff700 1 -- 172.21.15.72:0/952518817 wait complete. 2023-07-27T20:33:33.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.081+0000 7f59b63ff700 1 Processor -- start 2023-07-27T20:33:33.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.081+0000 7f59b63ff700 1 -- start start 2023-07-27T20:33:33.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.082+0000 7f59b63ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f59b00c4700 0x7f59b0153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:33.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.082+0000 7f59b63ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59b00c7740 0x7f59b01ea520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:33.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.082+0000 7f59b63ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59b014aab0 0x7f59b01eaa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:33.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.082+0000 7f59b63ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b01e90b0 con 0x7f59b00c7740 2023-07-27T20:33:33.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.082+0000 7f59b63ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b01443a0 con 0x7f59b014aab0 2023-07-27T20:33:33.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.082+0000 7f59b63ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b01ed380 con 0x7f59b00c4700 2023-07-27T20:33:33.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.082+0000 7f59af7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59b00c7740 0x7f59b01ea520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:33.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.083+0000 7f59af7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59b00c7740 0x7f59b01ea520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36072/0 (socket says 172.21.15.72:36072) 2023-07-27T20:33:33.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.083+0000 7f59af7fe700 1 -- 172.21.15.72:0/2228320053 learned_addr learned my addr 172.21.15.72:0/2228320053 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:33.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.083+0000 7f59affff700 1 --2- 172.21.15.72:0/2228320053 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f59b00c4700 0x7f59b0153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:33.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.083+0000 7f59af7fe700 1 -- 172.21.15.72:0/2228320053 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f59b00c4700 msgr2=0x7f59b0153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:33.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.083+0000 7f59af7fe700 1 --2- 172.21.15.72:0/2228320053 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f59b00c4700 0x7f59b0153590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:33.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.083+0000 7f59af7fe700 1 -- 172.21.15.72:0/2228320053 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59b014aab0 msgr2=0x7f59b01eaa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:33.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.083+0000 7f59af7fe700 1 --2- 172.21.15.72:0/2228320053 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59b014aab0 0x7f59b01eaa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:33.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.083+0000 7f59af7fe700 1 -- 172.21.15.72:0/2228320053 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a00094a0 con 0x7f59b00c7740 2023-07-27T20:33:33.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.083+0000 7f59af7fe700 1 --2- 172.21.15.72:0/2228320053 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59b00c7740 0x7f59b01ea520 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f59a400e980 tx=0x7f59a400ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:33.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.083+0000 7f59acff9700 1 -- 172.21.15.72:0/2228320053 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a4009710 con 0x7f59b00c7740 2023-07-27T20:33:33.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.083+0000 7f59acff9700 1 -- 172.21.15.72:0/2228320053 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a400c850 con 0x7f59b00c7740 2023-07-27T20:33:33.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.083+0000 7f59acff9700 1 -- 172.21.15.72:0/2228320053 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a400cbe0 con 0x7f59b00c7740 2023-07-27T20:33:33.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.083+0000 7f59b63ff700 1 -- 172.21.15.72:0/2228320053 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b01e9330 con 0x7f59b00c7740 2023-07-27T20:33:33.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.083+0000 7f59b63ff700 1 -- 172.21.15.72:0/2228320053 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b01e98f0 con 0x7f59b00c7740 2023-07-27T20:33:33.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.085+0000 7f59b63ff700 1 -- 172.21.15.72:0/2228320053 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b006d1e0 con 0x7f59b00c7740 2023-07-27T20:33:33.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.085+0000 7f59acff9700 1 -- 172.21.15.72:0/2228320053 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f59a400cd40 con 0x7f59b00c7740 2023-07-27T20:33:33.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.086+0000 7f59acff9700 1 --2- 172.21.15.72:0/2228320053 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f599c06ace0 0x7f599c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:33.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.086+0000 7f59acff9700 1 -- 172.21.15.72:0/2228320053 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f59a4089aa0 con 0x7f59b00c7740 2023-07-27T20:33:33.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.087+0000 7f59affff700 1 --2- 172.21.15.72:0/2228320053 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f599c06ace0 0x7f599c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:33.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.087+0000 7f59affff700 1 --2- 172.21.15.72:0/2228320053 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f599c06ace0 0x7f599c06d1a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f59a00090b0 tx=0x7f59a0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:33.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.090+0000 7f59acff9700 1 -- 172.21.15.72:0/2228320053 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f59b006d1e0 con 0x7f59b00c7740 2023-07-27T20:33:33.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.286+0000 7f59b63ff700 1 -- 172.21.15.72:0/2228320053 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f59b006d1e0 con 0x7f59b00c7740 2023-07-27T20:33:33.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.286+0000 7f59acff9700 1 -- 172.21.15.72:0/2228320053 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) v1 ==== 100+0+11 (secure 0 0 0) 0x7f59b006d1e0 con 0x7f59b00c7740 2023-07-27T20:33:33.274 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-27T20:33:33.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.289+0000 7f59b63ff700 1 -- 172.21.15.72:0/2228320053 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f599c06ace0 msgr2=0x7f599c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:33.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.289+0000 7f59b63ff700 1 --2- 172.21.15.72:0/2228320053 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f599c06ace0 0x7f599c06d1a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f59a00090b0 tx=0x7f59a0008030 comp rx=0 tx=0).stop 2023-07-27T20:33:33.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.289+0000 7f59b63ff700 1 -- 172.21.15.72:0/2228320053 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59b00c7740 msgr2=0x7f59b01ea520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:33.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.289+0000 7f59b63ff700 1 --2- 172.21.15.72:0/2228320053 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59b00c7740 0x7f59b01ea520 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f59a400e980 tx=0x7f59a400ed40 comp rx=0 tx=0).stop 2023-07-27T20:33:33.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.289+0000 7f59b63ff700 1 -- 172.21.15.72:0/2228320053 shutdown_connections 2023-07-27T20:33:33.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.289+0000 7f59b63ff700 1 --2- 172.21.15.72:0/2228320053 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59b014aab0 0x7f59b01eaa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:33.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.289+0000 7f59b63ff700 1 --2- 172.21.15.72:0/2228320053 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f599c06ace0 0x7f599c06d1a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:33.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.289+0000 7f59b63ff700 1 --2- 172.21.15.72:0/2228320053 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f59b00c4700 0x7f59b0153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:33.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.289+0000 7f59b63ff700 1 --2- 172.21.15.72:0/2228320053 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59b00c7740 0x7f59b01ea520 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:33.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.289+0000 7f59b63ff700 1 -- 172.21.15.72:0/2228320053 >> 172.21.15.72:0/2228320053 conn(0x7f59b00ab3f0 msgr2=0x7f59b00c8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:33.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.289+0000 7f59b63ff700 1 -- 172.21.15.72:0/2228320053 shutdown_connections 2023-07-27T20:33:33.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.289+0000 7f59b63ff700 1 -- 172.21.15.72:0/2228320053 wait complete. 2023-07-27T20:33:33.294 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-07-27T20:33:33.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.506+0000 7f49e4bff700 1 Processor -- start 2023-07-27T20:33:33.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.506+0000 7f49e4bff700 1 -- start start 2023-07-27T20:33:33.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.507+0000 7f49e4bff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f49e006c1d0 0x7f49e006c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:33.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.507+0000 7f49e4bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e00c7c50 con 0x7f49e014aab0 2023-07-27T20:33:33.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.507+0000 7f49e4bff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e006bd40 con 0x7f49e00c7740 2023-07-27T20:33:33.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.507+0000 7f49e4bff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e00c62f0 con 0x7f49e006c1d0 2023-07-27T20:33:33.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.507+0000 7f49de59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f49e014aab0 0x7f49e0154b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53782/0 (socket says 172.21.15.72:53782) 2023-07-27T20:33:33.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.507+0000 7f49de59c700 1 -- 172.21.15.72:0/4062605290 learned_addr learned my addr 172.21.15.72:0/4062605290 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:33.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.507+0000 7f49ded9d700 1 --2- 172.21.15.72:0/4062605290 >> v2:172.21.15.173:3300/0 conn(0x7f49e006c1d0 0x7f49e006c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:33.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.507+0000 7f49dd59a700 1 -- 172.21.15.72:0/4062605290 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3053423939 0 0) 0x7f49e00c7c50 con 0x7f49e014aab0 2023-07-27T20:33:33.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.507+0000 7f49dd59a700 1 -- 172.21.15.72:0/4062605290 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49c80035b0 con 0x7f49e014aab0 2023-07-27T20:33:33.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.508+0000 7f49dd59a700 1 -- 172.21.15.72:0/4062605290 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1921275533 0 0) 0x7f49e006bd40 con 0x7f49e00c7740 2023-07-27T20:33:33.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.508+0000 7f49dd59a700 1 -- 172.21.15.72:0/4062605290 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49e00c7c50 con 0x7f49e00c7740 2023-07-27T20:33:33.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.508+0000 7f49dd59a700 1 -- 172.21.15.72:0/4062605290 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 818382749 0 0) 0x7f49c80035b0 con 0x7f49e014aab0 2023-07-27T20:33:33.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.508+0000 7f49dd59a700 1 -- 172.21.15.72:0/4062605290 >> v2:172.21.15.173:3300/0 conn(0x7f49e006c1d0 msgr2=0x7f49e006c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:33.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.508+0000 7f49dd59a700 1 --2- 172.21.15.72:0/4062605290 >> v2:172.21.15.173:3300/0 conn(0x7f49e006c1d0 0x7f49e006c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:33.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.508+0000 7f49dd59a700 1 -- 172.21.15.72:0/4062605290 >> v1:172.21.15.173:6789/0 conn(0x7f49e00c7740 legacy=0x7f49e00c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:33.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.508+0000 7f49dd59a700 1 -- 172.21.15.72:0/4062605290 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e006d200 con 0x7f49e014aab0 2023-07-27T20:33:33.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.508+0000 7f49dd59a700 1 -- 172.21.15.72:0/4062605290 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f49d0001670 con 0x7f49e014aab0 2023-07-27T20:33:33.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.508+0000 7f49dd59a700 1 -- 172.21.15.72:0/4062605290 >> v1:172.21.15.72:6789/0 conn(0x7f49e014aab0 legacy=0x7f49e0154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:33.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.508+0000 7f49dd59a700 1 --2- 172.21.15.72:0/4062605290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49c8003b90 0x7f49c8003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:33.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.508+0000 7f49dd59a700 1 --2- 172.21.15.72:0/4062605290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49c8004850 0x7f49c8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:33.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.508+0000 7f49dd59a700 1 --2- 172.21.15.72:0/4062605290 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f49c8005210 0x7f49c800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:33.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.508+0000 7f49dd59a700 1 -- 172.21.15.72:0/4062605290 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e00c62f0 con 0x7f49c8004850 2023-07-27T20:33:33.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.508+0000 7f49dd59a700 1 -- 172.21.15.72:0/4062605290 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c800c090 con 0x7f49c8003b90 2023-07-27T20:33:33.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.508+0000 7f49dd59a700 1 -- 172.21.15.72:0/4062605290 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c800c250 con 0x7f49c8005210 2023-07-27T20:33:33.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.508+0000 7f49ddd9b700 1 --2- 172.21.15.72:0/4062605290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49c8004850 0x7f49c8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:33.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.508+0000 7f49de59c700 1 --2- 172.21.15.72:0/4062605290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49c8003b90 0x7f49c8003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:33.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.508+0000 7f49ded9d700 1 --2- 172.21.15.72:0/4062605290 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f49c8005210 0x7f49c800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:33.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.509+0000 7f49ddd9b700 1 -- 172.21.15.72:0/4062605290 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f49c8005210 msgr2=0x7f49c800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:33.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.509+0000 7f49ddd9b700 1 --2- 172.21.15.72:0/4062605290 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f49c8005210 0x7f49c800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:33.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.509+0000 7f49ddd9b700 1 -- 172.21.15.72:0/4062605290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49c8003b90 msgr2=0x7f49c8003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:33.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.509+0000 7f49ddd9b700 1 --2- 172.21.15.72:0/4062605290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49c8003b90 0x7f49c8003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:33.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.509+0000 7f49ddd9b700 1 -- 172.21.15.72:0/4062605290 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c80035b0 con 0x7f49c8004850 2023-07-27T20:33:33.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.509+0000 7f49ded9d700 1 -- 172.21.15.72:0/4062605290 reap_dead start 2023-07-27T20:33:33.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.509+0000 7f49ddd9b700 1 --2- 172.21.15.72:0/4062605290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49c8004850 0x7f49c8004cd0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f49d4001940 tx=0x7f49c8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f5e2445bdc7b6a8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:33.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.509+0000 7f49dd59a700 1 -- 172.21.15.72:0/4062605290 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d4001430 con 0x7f49c8004850 2023-07-27T20:33:33.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.509+0000 7f49dd59a700 1 -- 172.21.15.72:0/4062605290 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d4001d70 con 0x7f49c8004850 2023-07-27T20:33:33.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.509+0000 7f49dd59a700 1 -- 172.21.15.72:0/4062605290 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d4005530 con 0x7f49c8004850 2023-07-27T20:33:33.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.510+0000 7f49e4bff700 1 -- 172.21.15.72:0/4062605290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49c8004850 msgr2=0x7f49c8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:33.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.510+0000 7f49e4bff700 1 --2- 172.21.15.72:0/4062605290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49c8004850 0x7f49c8004cd0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f49d4001940 tx=0x7f49c8005880 comp rx=0 tx=0).stop 2023-07-27T20:33:33.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.510+0000 7f49e4bff700 1 -- 172.21.15.72:0/4062605290 shutdown_connections 2023-07-27T20:33:33.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.510+0000 7f49e4bff700 1 --2- 172.21.15.72:0/4062605290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49c8004850 0x7f49c8004cd0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:33.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.510+0000 7f49e4bff700 1 -- 172.21.15.72:0/4062605290 >> 172.21.15.72:0/4062605290 conn(0x7f49e00ab3f0 msgr2=0x7f49e00ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:33.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.510+0000 7f49e4bff700 1 -- 172.21.15.72:0/4062605290 shutdown_connections 2023-07-27T20:33:33.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.510+0000 7f49e4bff700 1 -- 172.21.15.72:0/4062605290 wait complete. 2023-07-27T20:33:33.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.512+0000 7f49e4bff700 1 Processor -- start 2023-07-27T20:33:33.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.512+0000 7f49e4bff700 1 -- start start 2023-07-27T20:33:33.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.513+0000 7f49e4bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49c8004850 0x7f49e0152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:33.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.513+0000 7f49e4bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49e00bce60 0x7f49e00ade50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:33.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.513+0000 7f49e4bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f49e00ae390 0x7f49e00bf370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:33.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.513+0000 7f49e4bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e00c3a20 con 0x7f49e00bce60 2023-07-27T20:33:33.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.513+0000 7f49e4bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e00aee50 con 0x7f49c8004850 2023-07-27T20:33:33.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.513+0000 7f49e4bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e00ae970 con 0x7f49e00ae390 2023-07-27T20:33:33.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.513+0000 7f49ddd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49e00bce60 0x7f49e00ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:33.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.513+0000 7f49ddd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49e00bce60 0x7f49e00ade50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36080/0 (socket says 172.21.15.72:36080) 2023-07-27T20:33:33.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.513+0000 7f49ddd9b700 1 -- 172.21.15.72:0/2317725663 learned_addr learned my addr 172.21.15.72:0/2317725663 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:33.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.513+0000 7f49ddd9b700 1 -- 172.21.15.72:0/2317725663 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f49e00ae390 msgr2=0x7f49e00bf370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:33.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.513+0000 7f49ddd9b700 1 --2- 172.21.15.72:0/2317725663 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f49e00ae390 0x7f49e00bf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:33.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.513+0000 7f49ddd9b700 1 -- 172.21.15.72:0/2317725663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49c8004850 msgr2=0x7f49e0152fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:33.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.513+0000 7f49ddd9b700 1 --2- 172.21.15.72:0/2317725663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49c8004850 0x7f49e0152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:33.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.513+0000 7f49ddd9b700 1 -- 172.21.15.72:0/2317725663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e01ea540 con 0x7f49e00bce60 2023-07-27T20:33:33.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.513+0000 7f49ddd9b700 1 --2- 172.21.15.72:0/2317725663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49e00bce60 0x7f49e00ade50 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f49d4005040 tx=0x7f49d40012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:33.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.514+0000 7f49ceffd700 1 -- 172.21.15.72:0/2317725663 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d4006a70 con 0x7f49e00bce60 2023-07-27T20:33:33.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.514+0000 7f49ceffd700 1 -- 172.21.15.72:0/2317725663 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d4006bd0 con 0x7f49e00bce60 2023-07-27T20:33:33.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.514+0000 7f49ceffd700 1 -- 172.21.15.72:0/2317725663 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d4007040 con 0x7f49e00bce60 2023-07-27T20:33:33.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.514+0000 7f49e4bff700 1 -- 172.21.15.72:0/2317725663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e01534f0 con 0x7f49e00bce60 2023-07-27T20:33:33.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.514+0000 7f49e4bff700 1 -- 172.21.15.72:0/2317725663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e00af330 con 0x7f49e00bce60 2023-07-27T20:33:33.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.515+0000 7f49e4bff700 1 -- 172.21.15.72:0/2317725663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e00af180 con 0x7f49e00bce60 2023-07-27T20:33:33.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.516+0000 7f49ceffd700 1 -- 172.21.15.72:0/2317725663 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f49d40071a0 con 0x7f49e00bce60 2023-07-27T20:33:33.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.517+0000 7f49ceffd700 1 --2- 172.21.15.72:0/2317725663 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f49c006ace0 0x7f49c006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:33.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.517+0000 7f49ceffd700 1 -- 172.21.15.72:0/2317725663 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f49d408a370 con 0x7f49e00bce60 2023-07-27T20:33:33.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.517+0000 7f49de59c700 1 --2- 172.21.15.72:0/2317725663 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f49c006ace0 0x7f49c006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:33.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.518+0000 7f49de59c700 1 --2- 172.21.15.72:0/2317725663 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f49c006ace0 0x7f49c006d1a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f49d0001050 tx=0x7f49d0000fe0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:33.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.521+0000 7f49ceffd700 1 -- 172.21.15.72:0/2317725663 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f49d4054f60 con 0x7f49e00bce60 2023-07-27T20:33:33.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.711+0000 7f49e4bff700 1 -- 172.21.15.72:0/2317725663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f49e00aefc0 con 0x7f49e00bce60 2023-07-27T20:33:33.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.712+0000 7f49ceffd700 1 -- 172.21.15.72:0/2317725663 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v47) v1 ==== 105+0+11 (secure 0 0 0) 0x7f49e00aefc0 con 0x7f49e00bce60 2023-07-27T20:33:33.700 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:33:33.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.714+0000 7f49e4bff700 1 -- 172.21.15.72:0/2317725663 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f49c006ace0 msgr2=0x7f49c006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:33.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.714+0000 7f49e4bff700 1 --2- 172.21.15.72:0/2317725663 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f49c006ace0 0x7f49c006d1a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f49d0001050 tx=0x7f49d0000fe0 comp rx=0 tx=0).stop 2023-07-27T20:33:33.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.714+0000 7f49e4bff700 1 -- 172.21.15.72:0/2317725663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49e00bce60 msgr2=0x7f49e00ade50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:33.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.714+0000 7f49e4bff700 1 --2- 172.21.15.72:0/2317725663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49e00bce60 0x7f49e00ade50 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f49d4005040 tx=0x7f49d40012d0 comp rx=0 tx=0).stop 2023-07-27T20:33:33.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.714+0000 7f49e4bff700 1 -- 172.21.15.72:0/2317725663 shutdown_connections 2023-07-27T20:33:33.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.714+0000 7f49e4bff700 1 --2- 172.21.15.72:0/2317725663 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f49c006ace0 0x7f49c006d1a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:33.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.714+0000 7f49e4bff700 1 --2- 172.21.15.72:0/2317725663 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f49e00ae390 0x7f49e00bf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:33.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.714+0000 7f49e4bff700 1 --2- 172.21.15.72:0/2317725663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49c8004850 0x7f49e0152fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:33.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.714+0000 7f49e4bff700 1 --2- 172.21.15.72:0/2317725663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49e00bce60 0x7f49e00ade50 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:33.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.714+0000 7f49e4bff700 1 -- 172.21.15.72:0/2317725663 >> 172.21.15.72:0/2317725663 conn(0x7f49e00ab3f0 msgr2=0x7f49e00c40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:33.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.714+0000 7f49e4bff700 1 -- 172.21.15.72:0/2317725663 shutdown_connections 2023-07-27T20:33:33.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.714+0000 7f49e4bff700 1 -- 172.21.15.72:0/2317725663 wait complete. 2023-07-27T20:33:33.720 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-07-27T20:33:33.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.931+0000 7f2f56bff700 1 Processor -- start 2023-07-27T20:33:33.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.931+0000 7f2f56bff700 1 -- start start 2023-07-27T20:33:33.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.932+0000 7f2f56bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2f501475a0 0x7f2f501516c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:33.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.932+0000 7f2f56bff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2f500716f0 0x7f2f50071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:33.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.932+0000 7f2f56bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f50154f50 con 0x7f2f500c12f0 2023-07-27T20:33:33.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.932+0000 7f2f56bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f50151c00 con 0x7f2f501475a0 2023-07-27T20:33:33.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.932+0000 7f2f56bff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f50154340 con 0x7f2f500716f0 2023-07-27T20:33:33.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.932+0000 7f2f4ffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2f500c12f0 0x7f2f500c1d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53790/0 (socket says 172.21.15.72:53790) 2023-07-27T20:33:33.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.932+0000 7f2f4ffff700 1 -- 172.21.15.72:0/354697796 learned_addr learned my addr 172.21.15.72:0/354697796 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:33.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.932+0000 7f2f5499b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2f501475a0 0x7f2f501516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:33.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.933+0000 7f2f5519c700 1 --2- 172.21.15.72:0/354697796 >> v2:172.21.15.173:3300/0 conn(0x7f2f500716f0 0x7f2f50071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:33.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.933+0000 7f2f5499b700 1 -- 172.21.15.72:0/354697796 >> v2:172.21.15.173:3300/0 conn(0x7f2f500716f0 msgr2=0x7f2f50071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:33.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.933+0000 7f2f5499b700 1 --2- 172.21.15.72:0/354697796 >> v2:172.21.15.173:3300/0 conn(0x7f2f500716f0 0x7f2f50071b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:33.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.933+0000 7f2f5499b700 1 -- 172.21.15.72:0/354697796 >> v1:172.21.15.72:6789/0 conn(0x7f2f500c12f0 legacy=0x7f2f500c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:33.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.933+0000 7f2f4f7fe700 1 -- 172.21.15.72:0/354697796 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1717284091 0 0) 0x7f2f50154f50 con 0x7f2f500c12f0 2023-07-27T20:33:33.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.933+0000 7f2f5499b700 1 -- 172.21.15.72:0/354697796 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f50154620 con 0x7f2f501475a0 2023-07-27T20:33:33.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.933+0000 7f2f5499b700 1 --2- 172.21.15.72:0/354697796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f501475a0 0x7f2f501516c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f2f500c1780 tx=0x7f2f44009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63e437a92875408f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:33.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.933+0000 7f2f4f7fe700 1 -- 172.21.15.72:0/354697796 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f44011830 con 0x7f2f501475a0 2023-07-27T20:33:33.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.933+0000 7f2f4f7fe700 1 -- 172.21.15.72:0/354697796 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f44011990 con 0x7f2f501475a0 2023-07-27T20:33:33.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.933+0000 7f2f4f7fe700 1 -- 172.21.15.72:0/354697796 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f44011d20 con 0x7f2f501475a0 2023-07-27T20:33:33.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.934+0000 7f2f56bff700 1 -- 172.21.15.72:0/354697796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f501475a0 msgr2=0x7f2f501516c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:33.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.934+0000 7f2f56bff700 1 --2- 172.21.15.72:0/354697796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f501475a0 0x7f2f501516c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f2f500c1780 tx=0x7f2f44009b20 comp rx=0 tx=0).stop 2023-07-27T20:33:33.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.934+0000 7f2f56bff700 1 -- 172.21.15.72:0/354697796 shutdown_connections 2023-07-27T20:33:33.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.934+0000 7f2f56bff700 1 --2- 172.21.15.72:0/354697796 >> v2:172.21.15.173:3300/0 conn(0x7f2f500716f0 0x7f2f50071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:33.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.934+0000 7f2f56bff700 1 --2- 172.21.15.72:0/354697796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f501475a0 0x7f2f501516c0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:33.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.934+0000 7f2f56bff700 1 -- 172.21.15.72:0/354697796 >> 172.21.15.72:0/354697796 conn(0x7f2f5006a190 msgr2=0x7f2f5006a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:33.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.934+0000 7f2f56bff700 1 -- 172.21.15.72:0/354697796 shutdown_connections 2023-07-27T20:33:33.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.934+0000 7f2f56bff700 1 -- 172.21.15.72:0/354697796 wait complete. 2023-07-27T20:33:33.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.936+0000 7f2f56bff700 1 Processor -- start 2023-07-27T20:33:33.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.936+0000 7f2f56bff700 1 -- start start 2023-07-27T20:33:33.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.937+0000 7f2f56bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2f500716f0 0x7f2f500bf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:33.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.937+0000 7f2f56bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f500c12f0 0x7f2f501de920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:33.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.937+0000 7f2f56bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f501475a0 0x7f2f501eae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:33.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.937+0000 7f2f56bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f501e9990 con 0x7f2f500c12f0 2023-07-27T20:33:33.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.937+0000 7f2f56bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f501edc80 con 0x7f2f501475a0 2023-07-27T20:33:33.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.937+0000 7f2f56bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f501e9c50 con 0x7f2f500716f0 2023-07-27T20:33:33.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.937+0000 7f2f4ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f500c12f0 0x7f2f501de920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:33.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.937+0000 7f2f4ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f500c12f0 0x7f2f501de920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36096/0 (socket says 172.21.15.72:36096) 2023-07-27T20:33:33.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.937+0000 7f2f4ffff700 1 -- 172.21.15.72:0/1491431135 learned_addr learned my addr 172.21.15.72:0/1491431135 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:33.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.937+0000 7f2f5499b700 1 --2- 172.21.15.72:0/1491431135 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2f500716f0 0x7f2f500bf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:33.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.937+0000 7f2f5519c700 1 --2- 172.21.15.72:0/1491431135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f501475a0 0x7f2f501eae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:33.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.937+0000 7f2f4ffff700 1 -- 172.21.15.72:0/1491431135 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2f500716f0 msgr2=0x7f2f500bf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:33.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.937+0000 7f2f4ffff700 1 --2- 172.21.15.72:0/1491431135 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2f500716f0 0x7f2f500bf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:33.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.937+0000 7f2f4ffff700 1 -- 172.21.15.72:0/1491431135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f501475a0 msgr2=0x7f2f501eae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:33.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.937+0000 7f2f4ffff700 1 --2- 172.21.15.72:0/1491431135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f501475a0 0x7f2f501eae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:33.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.937+0000 7f2f4ffff700 1 -- 172.21.15.72:0/1491431135 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f440094a0 con 0x7f2f500c12f0 2023-07-27T20:33:33.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.938+0000 7f2f4ffff700 1 --2- 172.21.15.72:0/1491431135 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f500c12f0 0x7f2f501de920 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c0011e0 tx=0x7f2f3c00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:33.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.938+0000 7f2f4d7fa700 1 -- 172.21.15.72:0/1491431135 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c004c80 con 0x7f2f500c12f0 2023-07-27T20:33:33.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.938+0000 7f2f4d7fa700 1 -- 172.21.15.72:0/1491431135 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3c004de0 con 0x7f2f500c12f0 2023-07-27T20:33:33.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.938+0000 7f2f56bff700 1 -- 172.21.15.72:0/1491431135 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f501e9f30 con 0x7f2f500c12f0 2023-07-27T20:33:33.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.938+0000 7f2f4d7fa700 1 -- 172.21.15.72:0/1491431135 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c007310 con 0x7f2f500c12f0 2023-07-27T20:33:33.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.938+0000 7f2f56bff700 1 -- 172.21.15.72:0/1491431135 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f501dee60 con 0x7f2f500c12f0 2023-07-27T20:33:33.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.939+0000 7f2f56bff700 1 -- 172.21.15.72:0/1491431135 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f501ea450 con 0x7f2f500c12f0 2023-07-27T20:33:33.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.940+0000 7f2f4d7fa700 1 -- 172.21.15.72:0/1491431135 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2f3c007470 con 0x7f2f500c12f0 2023-07-27T20:33:33.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.941+0000 7f2f4d7fa700 1 --2- 172.21.15.72:0/1491431135 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f2f3406ace0 0x7f2f3406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:33.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.941+0000 7f2f4d7fa700 1 -- 172.21.15.72:0/1491431135 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f2f3c089670 con 0x7f2f500c12f0 2023-07-27T20:33:33.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.942+0000 7f2f5499b700 1 --2- 172.21.15.72:0/1491431135 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f2f3406ace0 0x7f2f3406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:33.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.942+0000 7f2f5499b700 1 --2- 172.21.15.72:0/1491431135 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f2f3406ace0 0x7f2f3406d1a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2f440090b0 tx=0x7f2f4401c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:33.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:33.945+0000 7f2f4d7fa700 1 -- 172.21.15.72:0/1491431135 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2f3c054260 con 0x7f2f500c12f0 2023-07-27T20:33:34.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.139+0000 7f2f56bff700 1 -- 172.21.15.72:0/1491431135 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f2f5004e470 con 0x7f2f500c12f0 2023-07-27T20:33:34.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.139+0000 7f2f4d7fa700 1 -- 172.21.15.72:0/1491431135 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v47) v1 ==== 101+0+11 (secure 0 0 0) 0x7f2f3c057880 con 0x7f2f500c12f0 2023-07-27T20:33:34.127 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-27T20:33:34.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.142+0000 7f2f56bff700 1 -- 172.21.15.72:0/1491431135 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f2f3406ace0 msgr2=0x7f2f3406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:34.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.142+0000 7f2f56bff700 1 --2- 172.21.15.72:0/1491431135 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f2f3406ace0 0x7f2f3406d1a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2f440090b0 tx=0x7f2f4401c040 comp rx=0 tx=0).stop 2023-07-27T20:33:34.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.142+0000 7f2f56bff700 1 -- 172.21.15.72:0/1491431135 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f500c12f0 msgr2=0x7f2f501de920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:34.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.142+0000 7f2f56bff700 1 --2- 172.21.15.72:0/1491431135 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f500c12f0 0x7f2f501de920 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c0011e0 tx=0x7f2f3c00ca30 comp rx=0 tx=0).stop 2023-07-27T20:33:34.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.142+0000 7f2f56bff700 1 -- 172.21.15.72:0/1491431135 shutdown_connections 2023-07-27T20:33:34.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.142+0000 7f2f56bff700 1 --2- 172.21.15.72:0/1491431135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f501475a0 0x7f2f501eae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:34.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.142+0000 7f2f56bff700 1 --2- 172.21.15.72:0/1491431135 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f2f3406ace0 0x7f2f3406d1a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:34.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.142+0000 7f2f56bff700 1 --2- 172.21.15.72:0/1491431135 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2f500716f0 0x7f2f500bf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:34.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.142+0000 7f2f56bff700 1 --2- 172.21.15.72:0/1491431135 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f500c12f0 0x7f2f501de920 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:34.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.142+0000 7f2f56bff700 1 -- 172.21.15.72:0/1491431135 >> 172.21.15.72:0/1491431135 conn(0x7f2f5006a190 msgr2=0x7f2f50142f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:34.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.142+0000 7f2f56bff700 1 -- 172.21.15.72:0/1491431135 shutdown_connections 2023-07-27T20:33:34.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.142+0000 7f2f56bff700 1 -- 172.21.15.72:0/1491431135 wait complete. 2023-07-27T20:33:34.147 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-27T20:33:34.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.356+0000 7f9fac5ff700 1 Processor -- start 2023-07-27T20:33:34.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.357+0000 7f9fac5ff700 1 -- start start 2023-07-27T20:33:34.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.358+0000 7f9fac5ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9fa40bfd90 0x7f9fa40aab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:34.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.358+0000 7f9fac5ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9fa40a83a0 0x7f9fa40a8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:34.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.358+0000 7f9fac5ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fa4155600 con 0x7f9fa413b2c0 2023-07-27T20:33:34.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.358+0000 7f9fac5ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa40a9620 con 0x7f9fa40a83a0 2023-07-27T20:33:34.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.358+0000 7f9fac5ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa4155320 con 0x7f9fa40bfd90 2023-07-27T20:33:34.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.358+0000 7f9faab9c700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9fa40a83a0 0x7f9fa40a8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:34.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.358+0000 7f9fa9b9a700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9fa40bfd90 0x7f9fa40aab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:34.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.359+0000 7f9faa39b700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f9fa413b2c0 0x7f9fa40aa420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.72:34470/0 (socket says 172.21.15.72:34470) 2023-07-27T20:33:34.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.359+0000 7f9faa39b700 1 -- 172.21.15.72:0/1366283187 learned_addr learned my addr 172.21.15.72:0/1366283187 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:34.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.359+0000 7f9faab9c700 1 -- 172.21.15.72:0/1366283187 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9fa40bfd90 msgr2=0x7f9fa40aab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:34.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.359+0000 7f9faab9c700 1 --2- 172.21.15.72:0/1366283187 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9fa40bfd90 0x7f9fa40aab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:34.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.359+0000 7f9faab9c700 1 -- 172.21.15.72:0/1366283187 >> v1:172.21.15.173:6789/0 conn(0x7f9fa413b2c0 legacy=0x7f9fa40aa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:34.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.359+0000 7f9faab9c700 1 -- 172.21.15.72:0/1366283187 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa4151e40 con 0x7f9fa40a83a0 2023-07-27T20:33:34.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.359+0000 7f9fa9399700 1 -- 172.21.15.72:0/1366283187 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 874484662 0 0) 0x7f9fa4155600 con 0x7f9fa413b2c0 2023-07-27T20:33:34.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.359+0000 7f9faab9c700 1 --2- 172.21.15.72:0/1366283187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fa40a83a0 0x7f9fa40a8820 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c009d90 tx=0x7f9f9c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3646d2b1ee74438 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:34.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.360+0000 7f9fa9399700 1 -- 172.21.15.72:0/1366283187 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c00e070 con 0x7f9fa40a83a0 2023-07-27T20:33:34.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.360+0000 7f9fa9399700 1 -- 172.21.15.72:0/1366283187 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9c00bb20 con 0x7f9fa40a83a0 2023-07-27T20:33:34.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.360+0000 7f9fa9399700 1 -- 172.21.15.72:0/1366283187 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c012430 con 0x7f9fa40a83a0 2023-07-27T20:33:34.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.360+0000 7f9fac5ff700 1 -- 172.21.15.72:0/1366283187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fa40a83a0 msgr2=0x7f9fa40a8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:34.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.360+0000 7f9fac5ff700 1 --2- 172.21.15.72:0/1366283187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fa40a83a0 0x7f9fa40a8820 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c009d90 tx=0x7f9f9c00b330 comp rx=0 tx=0).stop 2023-07-27T20:33:34.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.360+0000 7f9fac5ff700 1 -- 172.21.15.72:0/1366283187 shutdown_connections 2023-07-27T20:33:34.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.360+0000 7f9fac5ff700 1 --2- 172.21.15.72:0/1366283187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fa40a83a0 0x7f9fa40a8820 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:34.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.360+0000 7f9fac5ff700 1 --2- 172.21.15.72:0/1366283187 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9fa40bfd90 0x7f9fa40aab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:34.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.360+0000 7f9fac5ff700 1 -- 172.21.15.72:0/1366283187 >> 172.21.15.72:0/1366283187 conn(0x7f9fa406a190 msgr2=0x7f9fa406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:34.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.360+0000 7f9fac5ff700 1 -- 172.21.15.72:0/1366283187 shutdown_connections 2023-07-27T20:33:34.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.360+0000 7f9fac5ff700 1 -- 172.21.15.72:0/1366283187 wait complete. 2023-07-27T20:33:34.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.362+0000 7f9fac5ff700 1 Processor -- start 2023-07-27T20:33:34.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.362+0000 7f9fac5ff700 1 -- start start 2023-07-27T20:33:34.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.363+0000 7f9fac5ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fa40a83a0 0x7f9fa4150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:34.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.363+0000 7f9fac5ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9fa40bfd90 0x7f9fa41ddbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:34.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.363+0000 7f9fac5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fa413b2c0 0x7f9fa41e9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:34.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.363+0000 7f9fac5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa41e94f0 con 0x7f9fa413b2c0 2023-07-27T20:33:34.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.363+0000 7f9fac5ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa41ed500 con 0x7f9fa40a83a0 2023-07-27T20:33:34.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.363+0000 7f9fac5ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa41e9790 con 0x7f9fa40bfd90 2023-07-27T20:33:34.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.363+0000 7f9faab9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fa413b2c0 0x7f9fa41e9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:34.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.363+0000 7f9faab9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fa413b2c0 0x7f9fa41e9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36104/0 (socket says 172.21.15.72:36104) 2023-07-27T20:33:34.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.363+0000 7f9faab9c700 1 -- 172.21.15.72:0/2457402743 learned_addr learned my addr 172.21.15.72:0/2457402743 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:34.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.363+0000 7f9fa9b9a700 1 --2- 172.21.15.72:0/2457402743 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9fa40bfd90 0x7f9fa41ddbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:34.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.364+0000 7f9faa39b700 1 --2- 172.21.15.72:0/2457402743 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fa40a83a0 0x7f9fa4150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:34.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.364+0000 7f9faab9c700 1 -- 172.21.15.72:0/2457402743 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9fa40bfd90 msgr2=0x7f9fa41ddbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:34.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.364+0000 7f9faab9c700 1 --2- 172.21.15.72:0/2457402743 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9fa40bfd90 0x7f9fa41ddbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:34.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.364+0000 7f9faab9c700 1 -- 172.21.15.72:0/2457402743 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fa40a83a0 msgr2=0x7f9fa4150870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:34.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.364+0000 7f9faab9c700 1 --2- 172.21.15.72:0/2457402743 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fa40a83a0 0x7f9fa4150870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:34.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.364+0000 7f9faab9c700 1 -- 172.21.15.72:0/2457402743 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9c009a70 con 0x7f9fa413b2c0 2023-07-27T20:33:34.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.364+0000 7f9faab9c700 1 --2- 172.21.15.72:0/2457402743 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fa413b2c0 0x7f9fa41e9cb0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f9fa40723d0 tx=0x7f9f9c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:34.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.364+0000 7f9f9affd700 1 -- 172.21.15.72:0/2457402743 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c012430 con 0x7f9fa413b2c0 2023-07-27T20:33:34.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.364+0000 7f9f9affd700 1 -- 172.21.15.72:0/2457402743 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9c020070 con 0x7f9fa413b2c0 2023-07-27T20:33:34.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.364+0000 7f9f9affd700 1 -- 172.21.15.72:0/2457402743 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c004280 con 0x7f9fa413b2c0 2023-07-27T20:33:34.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.364+0000 7f9fac5ff700 1 -- 172.21.15.72:0/2457402743 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa41ed7e0 con 0x7f9fa413b2c0 2023-07-27T20:33:34.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.365+0000 7f9fac5ff700 1 -- 172.21.15.72:0/2457402743 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa40aa980 con 0x7f9fa413b2c0 2023-07-27T20:33:34.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.365+0000 7f9fac5ff700 1 -- 172.21.15.72:0/2457402743 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fa4074310 con 0x7f9fa413b2c0 2023-07-27T20:33:34.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.366+0000 7f9f9affd700 1 -- 172.21.15.72:0/2457402743 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9f9c0043e0 con 0x7f9fa413b2c0 2023-07-27T20:33:34.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.367+0000 7f9f9affd700 1 --2- 172.21.15.72:0/2457402743 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9f8806ace0 0x7f9f8806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:34.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.367+0000 7f9f9affd700 1 -- 172.21.15.72:0/2457402743 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f9f9c022070 con 0x7f9fa413b2c0 2023-07-27T20:33:34.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.368+0000 7f9faa39b700 1 --2- 172.21.15.72:0/2457402743 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9f8806ace0 0x7f9f8806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:34.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.368+0000 7f9faa39b700 1 --2- 172.21.15.72:0/2457402743 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9f8806ace0 0x7f9f8806d1a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0000f60 tx=0x7f9fa0007c90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:34.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.371+0000 7f9f9affd700 1 -- 172.21.15.72:0/2457402743 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9f9c056200 con 0x7f9fa413b2c0 2023-07-27T20:33:34.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.581+0000 7f9fac5ff700 1 -- 172.21.15.72:0/2457402743 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9fa413a800 con 0x7f9fa413b2c0 2023-07-27T20:33:34.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.582+0000 7f9f9affd700 1 -- 172.21.15.72:0/2457402743 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v47) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9f9c059820 con 0x7f9fa413b2c0 2023-07-27T20:33:34.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.584+0000 7f9fac5ff700 1 -- 172.21.15.72:0/2457402743 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9f8806ace0 msgr2=0x7f9f8806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:34.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.584+0000 7f9fac5ff700 1 --2- 172.21.15.72:0/2457402743 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9f8806ace0 0x7f9f8806d1a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0000f60 tx=0x7f9fa0007c90 comp rx=0 tx=0).stop 2023-07-27T20:33:34.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.584+0000 7f9fac5ff700 1 -- 172.21.15.72:0/2457402743 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fa413b2c0 msgr2=0x7f9fa41e9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:34.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.584+0000 7f9fac5ff700 1 --2- 172.21.15.72:0/2457402743 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fa413b2c0 0x7f9fa41e9cb0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f9fa40723d0 tx=0x7f9f9c004ad0 comp rx=0 tx=0).stop 2023-07-27T20:33:34.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.584+0000 7f9fac5ff700 1 -- 172.21.15.72:0/2457402743 shutdown_connections 2023-07-27T20:33:34.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.584+0000 7f9fac5ff700 1 --2- 172.21.15.72:0/2457402743 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fa413b2c0 0x7f9fa41e9cb0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:34.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.584+0000 7f9fac5ff700 1 --2- 172.21.15.72:0/2457402743 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fa40a83a0 0x7f9fa4150870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:34.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.584+0000 7f9fac5ff700 1 --2- 172.21.15.72:0/2457402743 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9f8806ace0 0x7f9f8806d1a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:34.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.584+0000 7f9fac5ff700 1 --2- 172.21.15.72:0/2457402743 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9fa40bfd90 0x7f9fa41ddbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:34.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.584+0000 7f9fac5ff700 1 -- 172.21.15.72:0/2457402743 >> 172.21.15.72:0/2457402743 conn(0x7f9fa406a190 msgr2=0x7f9fa406d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:34.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.584+0000 7f9fac5ff700 1 -- 172.21.15.72:0/2457402743 shutdown_connections 2023-07-27T20:33:34.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:34.585+0000 7f9fac5ff700 1 -- 172.21.15.72:0/2457402743 wait complete. 2023-07-27T20:33:34.574 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-07-27T20:33:34.590 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi173.front.sepia.ceph.com... 2023-07-27T20:33:34.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:34.590 DEBUG:teuthology.orchestra.run.smithi173:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-07-27T20:33:34.664 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi173.stderr:ceph-fuse[148891]: fuse finished with error 0 and tester_r 0 2023-07-27T20:33:34.668 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T20:33:40.769 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi173.front.sepia.ceph.com 2023-07-27T20:33:40.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:40.770 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-27T20:33:40.822 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-07-27T20:33:40.823 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-27T20:33:40.870 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345584k,nr_inodes=4086396,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275012k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 2023-07-27T20:33:40.871 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-27T20:33:41.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.087+0000 7f3c51dff700 1 Processor -- start 2023-07-27T20:33:41.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.088+0000 7f3c51dff700 1 -- start start 2023-07-27T20:33:41.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.089+0000 7f3c51dff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3c4c0c7710 0x7f3c4c1514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:41.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.089+0000 7f3c51dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c4c155100 con 0x7f3c4c0c4400 2023-07-27T20:33:41.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.089+0000 7f3c51dff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c4c0c7af0 con 0x7f3c4c06b150 2023-07-27T20:33:41.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.089+0000 7f3c51dff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c4c1545d0 con 0x7f3c4c0c7710 2023-07-27T20:33:41.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.089+0000 7f3c4b7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3c4c0c4400 0x7f3c4c0c4cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57822/0 (socket says 172.21.15.72:57822) 2023-07-27T20:33:41.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.089+0000 7f3c4b7fe700 1 -- 172.21.15.72:0/2642267209 learned_addr learned my addr 172.21.15.72:0/2642267209 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:41.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.089+0000 7f3c4a7fc700 1 -- 172.21.15.72:0/2642267209 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3185007199 0 0) 0x7f3c4c155100 con 0x7f3c4c0c4400 2023-07-27T20:33:41.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.090+0000 7f3c4a7fc700 1 -- 172.21.15.72:0/2642267209 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c340035b0 con 0x7f3c4c0c4400 2023-07-27T20:33:41.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.090+0000 7f3c4bfff700 1 --2- 172.21.15.72:0/2642267209 >> v2:172.21.15.173:3300/0 conn(0x7f3c4c0c7710 0x7f3c4c1514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:41.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.090+0000 7f3c4a7fc700 1 -- 172.21.15.72:0/2642267209 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1985211018 0 0) 0x7f3c340035b0 con 0x7f3c4c0c4400 2023-07-27T20:33:41.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.090+0000 7f3c4a7fc700 1 -- 172.21.15.72:0/2642267209 >> v2:172.21.15.173:3300/0 conn(0x7f3c4c0c7710 msgr2=0x7f3c4c1514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:41.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.090+0000 7f3c4a7fc700 1 --2- 172.21.15.72:0/2642267209 >> v2:172.21.15.173:3300/0 conn(0x7f3c4c0c7710 0x7f3c4c1514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:41.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.090+0000 7f3c4a7fc700 1 -- 172.21.15.72:0/2642267209 >> v1:172.21.15.173:6789/0 conn(0x7f3c4c06b150 legacy=0x7f3c4c1549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:41.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.090+0000 7f3c4a7fc700 1 -- 172.21.15.72:0/2642267209 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4c06b710 con 0x7f3c4c0c4400 2023-07-27T20:33:41.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.090+0000 7f3c4a7fc700 1 -- 172.21.15.72:0/2642267209 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f3c3c001670 con 0x7f3c4c0c4400 2023-07-27T20:33:41.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.090+0000 7f3c4a7fc700 1 -- 172.21.15.72:0/2642267209 >> v1:172.21.15.72:6789/0 conn(0x7f3c4c0c4400 legacy=0x7f3c4c0c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:41.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.090+0000 7f3c4a7fc700 1 --2- 172.21.15.72:0/2642267209 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3c34003a50 0x7f3c34003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:41.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.090+0000 7f3c4a7fc700 1 --2- 172.21.15.72:0/2642267209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c34004850 0x7f3c34004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:41.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.090+0000 7f3c4a7fc700 1 --2- 172.21.15.72:0/2642267209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c34005330 0x7f3c3400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:41.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.090+0000 7f3c4a7fc700 1 -- 172.21.15.72:0/2642267209 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c1545d0 con 0x7f3c34005330 2023-07-27T20:33:41.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.090+0000 7f3c4a7fc700 1 -- 172.21.15.72:0/2642267209 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3400c230 con 0x7f3c34004850 2023-07-27T20:33:41.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.090+0000 7f3c4a7fc700 1 -- 172.21.15.72:0/2642267209 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3400c3f0 con 0x7f3c34003a50 2023-07-27T20:33:41.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.090+0000 7f3c4bfff700 1 --2- 172.21.15.72:0/2642267209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c34005330 0x7f3c3400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:41.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.090+0000 7f3c4b7fe700 1 --2- 172.21.15.72:0/2642267209 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3c34003a50 0x7f3c34003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:41.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.090+0000 7f3c4affd700 1 --2- 172.21.15.72:0/2642267209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c34004850 0x7f3c34004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:41.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.091+0000 7f3c4bfff700 1 -- 172.21.15.72:0/2642267209 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3c34003a50 msgr2=0x7f3c34003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:41.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.091+0000 7f3c4bfff700 1 --2- 172.21.15.72:0/2642267209 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3c34003a50 0x7f3c34003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:41.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.091+0000 7f3c4bfff700 1 -- 172.21.15.72:0/2642267209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c34004850 msgr2=0x7f3c34004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:41.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.091+0000 7f3c4bfff700 1 --2- 172.21.15.72:0/2642267209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c34004850 0x7f3c34004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:41.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.091+0000 7f3c4bfff700 1 -- 172.21.15.72:0/2642267209 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c340035b0 con 0x7f3c34005330 2023-07-27T20:33:41.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.091+0000 7f3c4bfff700 1 -- 172.21.15.72:0/2642267209 reap_dead start 2023-07-27T20:33:41.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.091+0000 7f3c4bfff700 1 --2- 172.21.15.72:0/2642267209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c34005330 0x7f3c3400ba10 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f3c44009fc0 tx=0x7f3c34005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc67ddd11c8b2182 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:41.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.091+0000 7f3c4a7fc700 1 -- 172.21.15.72:0/2642267209 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c44003a20 con 0x7f3c34005330 2023-07-27T20:33:41.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.091+0000 7f3c4a7fc700 1 -- 172.21.15.72:0/2642267209 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4400f040 con 0x7f3c34005330 2023-07-27T20:33:41.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.091+0000 7f3c4a7fc700 1 -- 172.21.15.72:0/2642267209 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c44003da0 con 0x7f3c34005330 2023-07-27T20:33:41.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.092+0000 7f3c51dff700 1 -- 172.21.15.72:0/2642267209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c34005330 msgr2=0x7f3c3400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:41.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.092+0000 7f3c51dff700 1 --2- 172.21.15.72:0/2642267209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c34005330 0x7f3c3400ba10 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f3c44009fc0 tx=0x7f3c34005880 comp rx=0 tx=0).stop 2023-07-27T20:33:41.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.092+0000 7f3c51dff700 1 -- 172.21.15.72:0/2642267209 shutdown_connections 2023-07-27T20:33:41.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.092+0000 7f3c51dff700 1 --2- 172.21.15.72:0/2642267209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c34005330 0x7f3c3400ba10 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:41.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.092+0000 7f3c51dff700 1 -- 172.21.15.72:0/2642267209 >> 172.21.15.72:0/2642267209 conn(0x7f3c4c0ab300 msgr2=0x7f3c4c0ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:41.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.092+0000 7f3c51dff700 1 -- 172.21.15.72:0/2642267209 shutdown_connections 2023-07-27T20:33:41.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.092+0000 7f3c51dff700 1 -- 172.21.15.72:0/2642267209 wait complete. 2023-07-27T20:33:41.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.093+0000 7f3c51dff700 1 Processor -- start 2023-07-27T20:33:41.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.094+0000 7f3c51dff700 1 -- start start 2023-07-27T20:33:41.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.094+0000 7f3c51dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c34005330 0x7f3c4c0ae370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:41.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.094+0000 7f3c51dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c4c14a190 0x7f3c4c0c0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:41.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.094+0000 7f3c51dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3c4c0c0fd0 0x7f3c4c1ec9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:41.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.094+0000 7f3c51dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c0c2260 con 0x7f3c34005330 2023-07-27T20:33:41.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.094+0000 7f3c51dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c0c34a0 con 0x7f3c4c14a190 2023-07-27T20:33:41.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.094+0000 7f3c51dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c0c2500 con 0x7f3c4c0c0fd0 2023-07-27T20:33:41.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.095+0000 7f3c4b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c34005330 0x7f3c4c0ae370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:41.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.095+0000 7f3c4b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c34005330 0x7f3c4c0ae370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38444/0 (socket says 172.21.15.72:38444) 2023-07-27T20:33:41.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.095+0000 7f3c4b7fe700 1 -- 172.21.15.72:0/3205288876 learned_addr learned my addr 172.21.15.72:0/3205288876 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:41.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.095+0000 7f3c4affd700 1 --2- 172.21.15.72:0/3205288876 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c4c14a190 0x7f3c4c0c0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:41.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.095+0000 7f3c4bfff700 1 --2- 172.21.15.72:0/3205288876 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3c4c0c0fd0 0x7f3c4c1ec9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:41.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.095+0000 7f3c4b7fe700 1 -- 172.21.15.72:0/3205288876 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3c4c0c0fd0 msgr2=0x7f3c4c1ec9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:41.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.095+0000 7f3c4b7fe700 1 --2- 172.21.15.72:0/3205288876 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3c4c0c0fd0 0x7f3c4c1ec9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:41.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.095+0000 7f3c4b7fe700 1 -- 172.21.15.72:0/3205288876 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c4c14a190 msgr2=0x7f3c4c0c0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:41.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.095+0000 7f3c4b7fe700 1 --2- 172.21.15.72:0/3205288876 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c4c14a190 0x7f3c4c0c0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:41.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.095+0000 7f3c4b7fe700 1 -- 172.21.15.72:0/3205288876 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4c0af640 con 0x7f3c34005330 2023-07-27T20:33:41.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.095+0000 7f3c4b7fe700 1 --2- 172.21.15.72:0/3205288876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c34005330 0x7f3c4c0ae370 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c004f80 tx=0x7f3c3c007340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:41.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.096+0000 7f3c33fff700 1 -- 172.21.15.72:0/3205288876 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c012560 con 0x7f3c34005330 2023-07-27T20:33:41.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.096+0000 7f3c33fff700 1 -- 172.21.15.72:0/3205288876 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3c0126c0 con 0x7f3c34005330 2023-07-27T20:33:41.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.096+0000 7f3c33fff700 1 -- 172.21.15.72:0/3205288876 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c012a30 con 0x7f3c34005330 2023-07-27T20:33:41.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.096+0000 7f3c51dff700 1 -- 172.21.15.72:0/3205288876 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c4c0c3780 con 0x7f3c34005330 2023-07-27T20:33:41.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.096+0000 7f3c51dff700 1 -- 172.21.15.72:0/3205288876 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c4c0c3130 con 0x7f3c34005330 2023-07-27T20:33:41.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.097+0000 7f3c51dff700 1 -- 172.21.15.72:0/3205288876 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c4c0c08c0 con 0x7f3c34005330 2023-07-27T20:33:41.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.098+0000 7f3c33fff700 1 -- 172.21.15.72:0/3205288876 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3c3c012b90 con 0x7f3c34005330 2023-07-27T20:33:41.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.098+0000 7f3c33fff700 1 --2- 172.21.15.72:0/3205288876 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3c3806ace0 0x7f3c3806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:41.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.099+0000 7f3c33fff700 1 -- 172.21.15.72:0/3205288876 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f3c3c0898c0 con 0x7f3c34005330 2023-07-27T20:33:41.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.099+0000 7f3c4affd700 1 --2- 172.21.15.72:0/3205288876 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3c3806ace0 0x7f3c3806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:41.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.099+0000 7f3c4affd700 1 --2- 172.21.15.72:0/3205288876 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3c3806ace0 0x7f3c3806d1a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c0aec90 tx=0x7f3c40009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:41.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.103+0000 7f3c33fff700 1 -- 172.21.15.72:0/3205288876 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3c3c0544b0 con 0x7f3c34005330 2023-07-27T20:33:41.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.344+0000 7f3c51dff700 1 -- 172.21.15.72:0/3205288876 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3c4c074310 con 0x7f3c34005330 2023-07-27T20:33:41.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.344+0000 7f3c33fff700 1 -- 172.21.15.72:0/3205288876 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) v1 ==== 53+0+149 (secure 0 0 0) 0x7f3c3c057ad0 con 0x7f3c34005330 2023-07-27T20:33:41.333 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-27T20:33:41.333 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-07-27T20:33:41.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.346+0000 7f3c51dff700 1 -- 172.21.15.72:0/3205288876 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3c3806ace0 msgr2=0x7f3c3806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:41.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.346+0000 7f3c51dff700 1 --2- 172.21.15.72:0/3205288876 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3c3806ace0 0x7f3c3806d1a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c0aec90 tx=0x7f3c40009040 comp rx=0 tx=0).stop 2023-07-27T20:33:41.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.346+0000 7f3c51dff700 1 -- 172.21.15.72:0/3205288876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c34005330 msgr2=0x7f3c4c0ae370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:41.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.346+0000 7f3c51dff700 1 --2- 172.21.15.72:0/3205288876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c34005330 0x7f3c4c0ae370 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c004f80 tx=0x7f3c3c007340 comp rx=0 tx=0).stop 2023-07-27T20:33:41.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.346+0000 7f3c51dff700 1 -- 172.21.15.72:0/3205288876 shutdown_connections 2023-07-27T20:33:41.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.346+0000 7f3c51dff700 1 --2- 172.21.15.72:0/3205288876 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3c3806ace0 0x7f3c3806d1a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:41.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.346+0000 7f3c51dff700 1 --2- 172.21.15.72:0/3205288876 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3c4c0c0fd0 0x7f3c4c1ec9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:41.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.346+0000 7f3c51dff700 1 --2- 172.21.15.72:0/3205288876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c34005330 0x7f3c4c0ae370 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:41.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.346+0000 7f3c51dff700 1 --2- 172.21.15.72:0/3205288876 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c4c14a190 0x7f3c4c0c0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:41.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.346+0000 7f3c51dff700 1 -- 172.21.15.72:0/3205288876 >> 172.21.15.72:0/3205288876 conn(0x7f3c4c0ab300 msgr2=0x7f3c4c150a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:41.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.346+0000 7f3c51dff700 1 -- 172.21.15.72:0/3205288876 shutdown_connections 2023-07-27T20:33:41.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:41.346+0000 7f3c51dff700 1 -- 172.21.15.72:0/3205288876 wait complete. 2023-07-27T20:33:41.352 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-07-27T20:33:41.353 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T20:33:41.353 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi173.front.sepia.ceph.com 2023-07-27T20:33:41.353 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-27T20:33:41.354 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-27T20:33:41.354 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-07-27T20:33:41.355 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-27T20:33:41.355 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-27T20:33:41.355 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-27T20:33:41.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:41.356 DEBUG:teuthology.orchestra.run.smithi173:> ip addr 2023-07-27T20:33:41.405 INFO:teuthology.orchestra.run.smithi173.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T20:33:41.405 INFO:teuthology.orchestra.run.smithi173.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T20:33:41.405 INFO:teuthology.orchestra.run.smithi173.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T20:33:41.405 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:33:41.406 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 ::1/128 scope host 2023-07-27T20:33:41.406 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:33:41.406 INFO:teuthology.orchestra.run.smithi173.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T20:33:41.406 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6a brd ff:ff:ff:ff:ff:ff 2023-07-27T20:33:41.406 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f0 2023-07-27T20:33:41.407 INFO:teuthology.orchestra.run.smithi173.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T20:33:41.407 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6b brd ff:ff:ff:ff:ff:ff 2023-07-27T20:33:41.407 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f1 2023-07-27T20:33:41.407 INFO:teuthology.orchestra.run.smithi173.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T20:33:41.408 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:58 brd ff:ff:ff:ff:ff:ff 2023-07-27T20:33:41.408 INFO:teuthology.orchestra.run.smithi173.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T20:33:41.408 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:59 brd ff:ff:ff:ff:ff:ff 2023-07-27T20:33:41.409 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.21.15.173/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T20:33:41.409 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft 39894sec preferred_lft 39894sec 2023-07-27T20:33:41.409 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::ec4:7aff:fe88:7259/64 scope link 2023-07-27T20:33:41.409 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:33:41.410 INFO:teuthology.orchestra.run.smithi173.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-27T20:33:41.410 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether f2:7f:58:8c:3b:de brd ff:ff:ff:ff:ff:ff 2023-07-27T20:33:41.410 INFO:teuthology.orchestra.run.smithi173.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-27T20:33:41.410 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:33:41.411 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::84ab:86ff:fec2:f207/64 scope link 2023-07-27T20:33:41.411 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:33:41.411 INFO:teuthology.orchestra.run.smithi173.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T20:33:41.412 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether f2:7f:58:8c:3b:de brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-27T20:33:41.412 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::f07f:58ff:fe8c:3bde/64 scope link 2023-07-27T20:33:41.412 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:33:41.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:41.414 DEBUG:teuthology.orchestra.run.smithi173:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T20:33:41.482 INFO:teuthology.orchestra.run.smithi173.stdout:1 2023-07-27T20:33:41.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:41.485 DEBUG:teuthology.orchestra.run.smithi173:> route 2023-07-27T20:33:41.534 INFO:teuthology.orchestra.run.smithi173.stdout:Kernel IP routing table 2023-07-27T20:33:41.534 INFO:teuthology.orchestra.run.smithi173.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T20:33:41.534 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T20:33:41.534 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T20:33:41.535 INFO:teuthology.orchestra.run.smithi173.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T20:33:41.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:41.536 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2023-07-27T20:33:41.536 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2023-07-27T20:33:41.537 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T20:33:41.537 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T20:33:41.537 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T20:33:41.537 DEBUG:teuthology.orchestra.run.smithi173:> ') 2023-07-27T20:33:41.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:41.705 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list 2023-07-27T20:33:41.750 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-27T20:33:41.751 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-27T20:33:41.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:41.752 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set brx.0 up 2023-07-27T20:33:41.821 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-07-27T20:33:41.822 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-27T20:33:41.822 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-27T20:33:41.868 INFO:teuthology.orchestra.run.smithi173.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-27T20:33:41.868 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-27T20:33:41.869 DEBUG:teuthology.orchestra.run.smithi173:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-27T20:33:41.953 DEBUG:teuthology.orchestra.run.smithi173:> sudo modprobe fuse 2023-07-27T20:33:42.062 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-27T20:33:42.063 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-27T20:33:42.130 INFO:teuthology.orchestra.run.smithi173.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-27T20:33:42.133 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-27T20:33:42.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:42.134 DEBUG:teuthology.orchestra.run.smithi173:> ls /sys/fs/fuse/connections 2023-07-27T20:33:42.179 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-27T20:33:42.180 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1 --client_fs=cephfs2) 2023-07-27T20:33:42.223 DEBUG:teuthology.orchestra.run.smithi173:> sudo modprobe fuse 2023-07-27T20:33:42.295 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-27T20:33:42.295 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-27T20:33:42.367 INFO:teuthology.orchestra.run.smithi173.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-27T20:33:42.369 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-27T20:33:42.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:42.370 DEBUG:teuthology.orchestra.run.smithi173:> ls /sys/fs/fuse/connections 2023-07-27T20:33:42.392 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi173.stderr:2023-07-27T20:33:42.405+0000 7f61c46375c0 -1 init, newargv = 0x55b419978eb0 newargc=15 2023-07-27T20:33:42.393 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi173.stderr:ceph-fuse[149537]: starting ceph client 2023-07-27T20:33:42.403 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi173.stderr:ceph-fuse[149537]: starting fuse 2023-07-27T20:33:42.420 INFO:teuthology.orchestra.run.smithi173.stdout:43 2023-07-27T20:33:42.421 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-07-27T20:33:42.421 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-27T20:33:42.422 DEBUG:teuthology.orchestra.run.smithi173:> import glob 2023-07-27T20:33:42.422 DEBUG:teuthology.orchestra.run.smithi173:> import re 2023-07-27T20:33:42.422 DEBUG:teuthology.orchestra.run.smithi173:> import os 2023-07-27T20:33:42.423 DEBUG:teuthology.orchestra.run.smithi173:> import subprocess 2023-07-27T20:33:42.423 DEBUG:teuthology.orchestra.run.smithi173:> 2023-07-27T20:33:42.423 DEBUG:teuthology.orchestra.run.smithi173:> def _find_admin_socket(client_name): 2023-07-27T20:33:42.423 DEBUG:teuthology.orchestra.run.smithi173:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-07-27T20:33:42.424 DEBUG:teuthology.orchestra.run.smithi173:> files = glob.glob(asok_path) 2023-07-27T20:33:42.424 DEBUG:teuthology.orchestra.run.smithi173:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-07-27T20:33:42.424 DEBUG:teuthology.orchestra.run.smithi173:> 2023-07-27T20:33:42.425 DEBUG:teuthology.orchestra.run.smithi173:> # Given a non-glob path, it better be there 2023-07-27T20:33:42.425 DEBUG:teuthology.orchestra.run.smithi173:> if "*" not in asok_path: 2023-07-27T20:33:42.425 DEBUG:teuthology.orchestra.run.smithi173:> assert(len(files) == 1) 2023-07-27T20:33:42.426 DEBUG:teuthology.orchestra.run.smithi173:> return files[0] 2023-07-27T20:33:42.426 DEBUG:teuthology.orchestra.run.smithi173:> 2023-07-27T20:33:42.426 DEBUG:teuthology.orchestra.run.smithi173:> for f in files: 2023-07-27T20:33:42.426 DEBUG:teuthology.orchestra.run.smithi173:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-27T20:33:42.427 DEBUG:teuthology.orchestra.run.smithi173:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-27T20:33:42.427 DEBUG:teuthology.orchestra.run.smithi173:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-27T20:33:42.427 DEBUG:teuthology.orchestra.run.smithi173:> contents = proc_f.read() 2023-07-27T20:33:42.428 DEBUG:teuthology.orchestra.run.smithi173:> if mountpoint in contents: 2023-07-27T20:33:42.428 DEBUG:teuthology.orchestra.run.smithi173:> return f 2023-07-27T20:33:42.428 DEBUG:teuthology.orchestra.run.smithi173:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-27T20:33:42.429 DEBUG:teuthology.orchestra.run.smithi173:> 2023-07-27T20:33:42.429 DEBUG:teuthology.orchestra.run.smithi173:> print(_find_admin_socket("client.1")) 2023-07-27T20:33:42.429 DEBUG:teuthology.orchestra.run.smithi173:> ' 2023-07-27T20:33:42.605 INFO:teuthology.orchestra.run.smithi173.stdout:/var/run/ceph/ceph-client.1.149537.asok 2023-07-27T20:33:42.782 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.149537.asok 2023-07-27T20:33:42.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:42.783 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.149537.asok status 2023-07-27T20:33:43.007 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2023-07-27T20:33:43.007 INFO:teuthology.orchestra.run.smithi173.stdout: "metadata": { 2023-07-27T20:33:43.007 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_sha1": "a5d48e8c688c2543997a98b8acbae2ce9635578c", 2023-07-27T20:33:43.007 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_version": "ceph version 18.0.0-5128-ga5d48e8c (a5d48e8c688c2543997a98b8acbae2ce9635578c) reef (dev)", 2023-07-27T20:33:43.008 INFO:teuthology.orchestra.run.smithi173.stdout: "entity_id": "1", 2023-07-27T20:33:43.008 INFO:teuthology.orchestra.run.smithi173.stdout: "hostname": "smithi173", 2023-07-27T20:33:43.008 INFO:teuthology.orchestra.run.smithi173.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-07-27T20:33:43.008 INFO:teuthology.orchestra.run.smithi173.stdout: "pid": "149537", 2023-07-27T20:33:43.008 INFO:teuthology.orchestra.run.smithi173.stdout: "root": "/" 2023-07-27T20:33:43.008 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-07-27T20:33:43.008 INFO:teuthology.orchestra.run.smithi173.stdout: "dentry_count": 0, 2023-07-27T20:33:43.009 INFO:teuthology.orchestra.run.smithi173.stdout: "dentry_pinned_count": 0, 2023-07-27T20:33:43.009 INFO:teuthology.orchestra.run.smithi173.stdout: "id": 5698, 2023-07-27T20:33:43.009 INFO:teuthology.orchestra.run.smithi173.stdout: "inst": { 2023-07-27T20:33:43.009 INFO:teuthology.orchestra.run.smithi173.stdout: "name": { 2023-07-27T20:33:43.009 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "client", 2023-07-27T20:33:43.009 INFO:teuthology.orchestra.run.smithi173.stdout: "num": 5698 2023-07-27T20:33:43.009 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-07-27T20:33:43.010 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": { 2023-07-27T20:33:43.010 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "v1", 2023-07-27T20:33:43.010 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": "192.168.0.1:0", 2023-07-27T20:33:43.010 INFO:teuthology.orchestra.run.smithi173.stdout: "nonce": 1865440438 2023-07-27T20:33:43.010 INFO:teuthology.orchestra.run.smithi173.stdout: } 2023-07-27T20:33:43.010 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-07-27T20:33:43.010 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": { 2023-07-27T20:33:43.011 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "v1", 2023-07-27T20:33:43.011 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": "192.168.0.1:0", 2023-07-27T20:33:43.011 INFO:teuthology.orchestra.run.smithi173.stdout: "nonce": 1865440438 2023-07-27T20:33:43.011 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-07-27T20:33:43.011 INFO:teuthology.orchestra.run.smithi173.stdout: "inst_str": "client.5698 192.168.0.1:0/1865440438", 2023-07-27T20:33:43.011 INFO:teuthology.orchestra.run.smithi173.stdout: "addr_str": "192.168.0.1:0/1865440438", 2023-07-27T20:33:43.011 INFO:teuthology.orchestra.run.smithi173.stdout: "inode_count": 1, 2023-07-27T20:33:43.011 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_epoch": 22, 2023-07-27T20:33:43.012 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_epoch": 47, 2023-07-27T20:33:43.012 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_epoch_barrier": 0, 2023-07-27T20:33:43.012 INFO:teuthology.orchestra.run.smithi173.stdout: "blocklisted": false, 2023-07-27T20:33:43.012 INFO:teuthology.orchestra.run.smithi173.stdout: "fs_name": "cephfs2" 2023-07-27T20:33:43.012 INFO:teuthology.orchestra.run.smithi173.stdout:} 2023-07-27T20:33:43.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:43.021 DEBUG:teuthology.orchestra.run.smithi173:> stat --file-system '--printf=%T 2023-07-27T20:33:43.021 DEBUG:teuthology.orchestra.run.smithi173:> ' -- /home/ubuntu/cephtest/mnt.1 2023-07-27T20:33:43.068 INFO:teuthology.orchestra.run.smithi173.stdout:fuseblk 2023-07-27T20:33:43.069 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-07-27T20:33:43.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:43.070 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-27T20:33:43.180 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs authorize cephfs client.testuser / rw 2023-07-27T20:33:43.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.401+0000 7fa1c5dff700 1 Processor -- start 2023-07-27T20:33:43.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.401+0000 7fa1c5dff700 1 -- start start 2023-07-27T20:33:43.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.402+0000 7fa1c5dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa1c00c17d0 0x7fa1c006cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:43.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.402+0000 7fa1c5dff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa1c00a8d90 0x7fa1c006d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:43.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.402+0000 7fa1c5dff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1c0152f30 con 0x7fa1c006a400 2023-07-27T20:33:43.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.402+0000 7fa1c5dff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1c0151fa0 con 0x7fa1c00a8d90 2023-07-27T20:33:43.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.402+0000 7fa1c5dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c01521b0 con 0x7fa1c00c17d0 2023-07-27T20:33:43.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.403+0000 7fa1bffff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa1c00a8d90 0x7fa1c006d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:43.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.403+0000 7fa1beffd700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa1c00c17d0 0x7fa1c006cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:43.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.403+0000 7fa1bffff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa1c00a8d90 0x7fa1c006d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.72:41308/0 (socket says 172.21.15.72:41308) 2023-07-27T20:33:43.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.403+0000 7fa1bffff700 1 -- 172.21.15.72:0/938464235 learned_addr learned my addr 172.21.15.72:0/938464235 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:43.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.403+0000 7fa1bffff700 1 -- 172.21.15.72:0/938464235 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa1c00c17d0 msgr2=0x7fa1c006cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:43.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.403+0000 7fa1bffff700 1 --2- 172.21.15.72:0/938464235 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa1c00c17d0 0x7fa1c006cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:43.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.403+0000 7fa1bffff700 1 -- 172.21.15.72:0/938464235 >> v1:172.21.15.173:6789/0 conn(0x7fa1c006a400 legacy=0x7fa1c014f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:43.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.403+0000 7fa1bffff700 1 -- 172.21.15.72:0/938464235 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c00a9350 con 0x7fa1c00a8d90 2023-07-27T20:33:43.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.403+0000 7fa1beffd700 1 --2- 172.21.15.72:0/938464235 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa1c00c17d0 0x7fa1c006cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:33:43.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.403+0000 7fa1be7fc700 1 -- 172.21.15.72:0/938464235 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2313242583 0 0) 0x7fa1b0001110 con 0x7fa1c006a400 2023-07-27T20:33:43.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.404+0000 7fa1bffff700 1 --2- 172.21.15.72:0/938464235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1c00a8d90 0x7fa1c006d440 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8009e50 tx=0x7fa1b800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c4a23a99daeabd0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:43.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.404+0000 7fa1be7fc700 1 -- 172.21.15.72:0/938464235 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b800e070 con 0x7fa1c00a8d90 2023-07-27T20:33:43.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.404+0000 7fa1be7fc700 1 -- 172.21.15.72:0/938464235 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b800b910 con 0x7fa1c00a8d90 2023-07-27T20:33:43.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.404+0000 7fa1be7fc700 1 -- 172.21.15.72:0/938464235 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b800bcc0 con 0x7fa1c00a8d90 2023-07-27T20:33:43.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.404+0000 7fa1c5dff700 1 -- 172.21.15.72:0/938464235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1c00a8d90 msgr2=0x7fa1c006d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:43.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.404+0000 7fa1c5dff700 1 --2- 172.21.15.72:0/938464235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1c00a8d90 0x7fa1c006d440 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8009e50 tx=0x7fa1b800b330 comp rx=0 tx=0).stop 2023-07-27T20:33:43.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.404+0000 7fa1c5dff700 1 -- 172.21.15.72:0/938464235 shutdown_connections 2023-07-27T20:33:43.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.404+0000 7fa1c5dff700 1 --2- 172.21.15.72:0/938464235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1c00a8d90 0x7fa1c006d440 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:43.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.404+0000 7fa1c5dff700 1 --2- 172.21.15.72:0/938464235 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa1c00c17d0 0x7fa1c006cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:43.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.404+0000 7fa1c5dff700 1 -- 172.21.15.72:0/938464235 >> 172.21.15.72:0/938464235 conn(0x7fa1c00c53e0 msgr2=0x7fa1c00c57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:43.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.405+0000 7fa1c5dff700 1 -- 172.21.15.72:0/938464235 shutdown_connections 2023-07-27T20:33:43.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.405+0000 7fa1c5dff700 1 -- 172.21.15.72:0/938464235 wait complete. 2023-07-27T20:33:43.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.406+0000 7fa1c5dff700 1 Processor -- start 2023-07-27T20:33:43.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.406+0000 7fa1c5dff700 1 -- start start 2023-07-27T20:33:43.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.407+0000 7fa1c5dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa1c006a400 0x7fa1c014bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:43.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.407+0000 7fa1c5dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1c00a8d90 0x7fa1c014c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:43.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.407+0000 7fa1c5dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1c00c17d0 0x7fa1c01e7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:43.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.407+0000 7fa1c5dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c01d8cc0 con 0x7fa1c00a8d90 2023-07-27T20:33:43.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.407+0000 7fa1c5dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c0149b20 con 0x7fa1c00c17d0 2023-07-27T20:33:43.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.407+0000 7fa1c5dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c0147af0 con 0x7fa1c006a400 2023-07-27T20:33:43.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.407+0000 7fa1beffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1c00a8d90 0x7fa1c014c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:43.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.408+0000 7fa1beffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1c00a8d90 0x7fa1c014c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38450/0 (socket says 172.21.15.72:38450) 2023-07-27T20:33:43.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.408+0000 7fa1beffd700 1 -- 172.21.15.72:0/2682433734 learned_addr learned my addr 172.21.15.72:0/2682433734 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:43.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.408+0000 7fa1bffff700 1 --2- 172.21.15.72:0/2682433734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1c00c17d0 0x7fa1c01e7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:43.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.408+0000 7fa1bf7fe700 1 --2- 172.21.15.72:0/2682433734 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa1c006a400 0x7fa1c014bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:43.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.408+0000 7fa1beffd700 1 -- 172.21.15.72:0/2682433734 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa1c006a400 msgr2=0x7fa1c014bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:43.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.408+0000 7fa1beffd700 1 --2- 172.21.15.72:0/2682433734 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa1c006a400 0x7fa1c014bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:43.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.408+0000 7fa1beffd700 1 -- 172.21.15.72:0/2682433734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1c00c17d0 msgr2=0x7fa1c01e7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:43.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.408+0000 7fa1beffd700 1 --2- 172.21.15.72:0/2682433734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1c00c17d0 0x7fa1c01e7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:43.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.408+0000 7fa1beffd700 1 -- 172.21.15.72:0/2682433734 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b40094a0 con 0x7fa1c00a8d90 2023-07-27T20:33:43.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.408+0000 7fa1bffff700 1 --2- 172.21.15.72:0/2682433734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1c00c17d0 0x7fa1c01e7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:33:43.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.408+0000 7fa1bf7fe700 1 --2- 172.21.15.72:0/2682433734 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa1c006a400 0x7fa1c014bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:33:43.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.408+0000 7fa1beffd700 1 --2- 172.21.15.72:0/2682433734 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1c00a8d90 0x7fa1c014c4d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fa1b400ec10 tx=0x7fa1b4009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:43.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.408+0000 7fa1a7fff700 1 -- 172.21.15.72:0/2682433734 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b400c8e0 con 0x7fa1c00a8d90 2023-07-27T20:33:43.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.408+0000 7fa1a7fff700 1 -- 172.21.15.72:0/2682433734 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b400ca40 con 0x7fa1c00a8d90 2023-07-27T20:33:43.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.408+0000 7fa1c5dff700 1 -- 172.21.15.72:0/2682433734 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b8009b30 con 0x7fa1c00a8d90 2023-07-27T20:33:43.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.408+0000 7fa1a7fff700 1 -- 172.21.15.72:0/2682433734 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b400cdd0 con 0x7fa1c00a8d90 2023-07-27T20:33:43.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.409+0000 7fa1c5dff700 1 -- 172.21.15.72:0/2682433734 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1c01480b0 con 0x7fa1c00a8d90 2023-07-27T20:33:43.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.410+0000 7fa1c5dff700 1 -- 172.21.15.72:0/2682433734 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1c0149cd0 con 0x7fa1c00a8d90 2023-07-27T20:33:43.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.411+0000 7fa1a7fff700 1 -- 172.21.15.72:0/2682433734 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa1b4013470 con 0x7fa1c00a8d90 2023-07-27T20:33:43.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.411+0000 7fa1a7fff700 1 --2- 172.21.15.72:0/2682433734 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa1ac06ace0 0x7fa1ac06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:43.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.412+0000 7fa1a7fff700 1 -- 172.21.15.72:0/2682433734 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7fa1b4089ae0 con 0x7fa1c00a8d90 2023-07-27T20:33:43.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.412+0000 7fa1bf7fe700 1 --2- 172.21.15.72:0/2682433734 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa1ac06ace0 0x7fa1ac06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:43.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.412+0000 7fa1bf7fe700 1 --2- 172.21.15.72:0/2682433734 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa1ac06ace0 0x7fa1ac06d1a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0000f60 tx=0x7fa1b0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:43.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.416+0000 7fa1a7fff700 1 -- 172.21.15.72:0/2682433734 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa1c0149cd0 con 0x7fa1c00a8d90 2023-07-27T20:33:43.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.654+0000 7fa1c5dff700 1 -- 172.21.15.72:0/2682433734 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]} v 0) v1 -- 0x7fa1c0149cd0 con 0x7fa1c00a8d90 2023-07-27T20:33:43.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.658+0000 7fa1a7fff700 1 -- 172.21.15.72:0/2682433734 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]}]=0 v13) v1 ==== 134+0+185 (secure 0 0 0) 0x7fa1c0149cd0 con 0x7fa1c00a8d90 2023-07-27T20:33:43.647 INFO:teuthology.orchestra.run.smithi072.stdout:[client.testuser] 2023-07-27T20:33:43.648 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCn1MJkAGojJxAA55AIUV1ozmpefEQJz6pu4Q== 2023-07-27T20:33:43.648 INFO:teuthology.orchestra.run.smithi072.stdout: caps mds = "allow rw fsname=cephfs" 2023-07-27T20:33:43.648 INFO:teuthology.orchestra.run.smithi072.stdout: caps mon = "allow r fsname=cephfs" 2023-07-27T20:33:43.648 INFO:teuthology.orchestra.run.smithi072.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-27T20:33:43.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.661+0000 7fa1c5dff700 1 -- 172.21.15.72:0/2682433734 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa1ac06ace0 msgr2=0x7fa1ac06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:43.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.661+0000 7fa1c5dff700 1 --2- 172.21.15.72:0/2682433734 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa1ac06ace0 0x7fa1ac06d1a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0000f60 tx=0x7fa1b0009040 comp rx=0 tx=0).stop 2023-07-27T20:33:43.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.661+0000 7fa1c5dff700 1 -- 172.21.15.72:0/2682433734 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1c00a8d90 msgr2=0x7fa1c014c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:43.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.661+0000 7fa1c5dff700 1 --2- 172.21.15.72:0/2682433734 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1c00a8d90 0x7fa1c014c4d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fa1b400ec10 tx=0x7fa1b4009e20 comp rx=0 tx=0).stop 2023-07-27T20:33:43.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.661+0000 7fa1c5dff700 1 -- 172.21.15.72:0/2682433734 shutdown_connections 2023-07-27T20:33:43.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.661+0000 7fa1c5dff700 1 --2- 172.21.15.72:0/2682433734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1c00c17d0 0x7fa1c01e7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:43.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.661+0000 7fa1c5dff700 1 --2- 172.21.15.72:0/2682433734 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa1ac06ace0 0x7fa1ac06d1a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:43.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.661+0000 7fa1c5dff700 1 --2- 172.21.15.72:0/2682433734 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa1c006a400 0x7fa1c014bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:43.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.661+0000 7fa1c5dff700 1 --2- 172.21.15.72:0/2682433734 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1c00a8d90 0x7fa1c014c4d0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:43.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.661+0000 7fa1c5dff700 1 -- 172.21.15.72:0/2682433734 >> 172.21.15.72:0/2682433734 conn(0x7fa1c00c53e0 msgr2=0x7fa1c006d750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:43.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.661+0000 7fa1c5dff700 1 -- 172.21.15.72:0/2682433734 shutdown_connections 2023-07-27T20:33:43.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:43.661+0000 7fa1c5dff700 1 -- 172.21.15.72:0/2682433734 wait complete. 2023-07-27T20:33:43.667 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2023-07-27T20:33:43.712 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.tsDiA5H6Cu 2023-07-27T20:33:43.712 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-27T20:33:43.713 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/tmp/tmp.tsDiA5H6Cu 2023-07-27T20:33:43.797 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-27T20:33:43.798 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-27T20:33:43.884 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:33:44.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.131+0000 7fa042bff700 1 Processor -- start 2023-07-27T20:33:44.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.131+0000 7fa042bff700 1 -- start start 2023-07-27T20:33:44.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.132+0000 7fa042bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa03c0c1fb0 0x7fa03c0c39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:44.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.133+0000 7fa042bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa03c0a9570 0x7fa03c157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:44.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.133+0000 7fa042bff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa03c154ba0 con 0x7fa03c0a9190 2023-07-27T20:33:44.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.133+0000 7fa042bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa03c0c2ea0 con 0x7fa03c0a9570 2023-07-27T20:33:44.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.133+0000 7fa042bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c0a9a20 con 0x7fa03c0c1fb0 2023-07-27T20:33:44.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.133+0000 7fa04119c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa03c0a9570 0x7fa03c157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:44.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.133+0000 7fa04119c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa03c0a9570 0x7fa03c157dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38458/0 (socket says 172.21.15.72:38458) 2023-07-27T20:33:44.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.133+0000 7fa04119c700 1 -- 172.21.15.72:0/1557252949 learned_addr learned my addr 172.21.15.72:0/1557252949 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:44.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.133+0000 7fa03bfff700 1 --2- 172.21.15.72:0/1557252949 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa03c0c1fb0 0x7fa03c0c39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:44.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.133+0000 7fa04119c700 1 -- 172.21.15.72:0/1557252949 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa03c0c1fb0 msgr2=0x7fa03c0c39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:44.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.133+0000 7fa04119c700 1 --2- 172.21.15.72:0/1557252949 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa03c0c1fb0 0x7fa03c0c39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:44.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.133+0000 7fa04119c700 1 -- 172.21.15.72:0/1557252949 >> v1:172.21.15.173:6789/0 conn(0x7fa03c0a9190 legacy=0x7fa03c1576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:44.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.133+0000 7fa04119c700 1 -- 172.21.15.72:0/1557252949 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03c154e80 con 0x7fa03c0a9570 2023-07-27T20:33:44.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.134+0000 7fa04119c700 1 --2- 172.21.15.72:0/1557252949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa03c0a9570 0x7fa03c157dd0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fa034009e50 tx=0x7fa03400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d45d0d5b02e193 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:44.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.134+0000 7fa03b7fe700 1 -- 172.21.15.72:0/1557252949 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03400e070 con 0x7fa03c0a9570 2023-07-27T20:33:44.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.134+0000 7fa03b7fe700 1 -- 172.21.15.72:0/1557252949 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03400b910 con 0x7fa03c0a9570 2023-07-27T20:33:44.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.134+0000 7fa03b7fe700 1 -- 172.21.15.72:0/1557252949 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03400bcc0 con 0x7fa03c0a9570 2023-07-27T20:33:44.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.134+0000 7fa042bff700 1 -- 172.21.15.72:0/1557252949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa03c0a9570 msgr2=0x7fa03c157dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:44.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.134+0000 7fa042bff700 1 --2- 172.21.15.72:0/1557252949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa03c0a9570 0x7fa03c157dd0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fa034009e50 tx=0x7fa03400b330 comp rx=0 tx=0).stop 2023-07-27T20:33:44.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.134+0000 7fa042bff700 1 -- 172.21.15.72:0/1557252949 shutdown_connections 2023-07-27T20:33:44.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.134+0000 7fa042bff700 1 --2- 172.21.15.72:0/1557252949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa03c0a9570 0x7fa03c157dd0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:44.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.134+0000 7fa042bff700 1 --2- 172.21.15.72:0/1557252949 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa03c0c1fb0 0x7fa03c0c39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:44.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.134+0000 7fa042bff700 1 -- 172.21.15.72:0/1557252949 >> 172.21.15.72:0/1557252949 conn(0x7fa03c06a7c0 msgr2=0x7fa03c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:44.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.134+0000 7fa042bff700 1 -- 172.21.15.72:0/1557252949 shutdown_connections 2023-07-27T20:33:44.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.135+0000 7fa042bff700 1 -- 172.21.15.72:0/1557252949 wait complete. 2023-07-27T20:33:44.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.136+0000 7fa042bff700 1 Processor -- start 2023-07-27T20:33:44.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.136+0000 7fa042bff700 1 -- start start 2023-07-27T20:33:44.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.137+0000 7fa042bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa03c0a9190 0x7fa03c14c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:44.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.137+0000 7fa042bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa03c0a9570 0x7fa03c1ecfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:44.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.137+0000 7fa042bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa03c1ed500 0x7fa03c152e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:44.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.137+0000 7fa042bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c155af0 con 0x7fa03c1ed500 2023-07-27T20:33:44.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.137+0000 7fa042bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c0bf030 con 0x7fa03c0a9190 2023-07-27T20:33:44.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.137+0000 7fa042bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c0bf310 con 0x7fa03c0a9570 2023-07-27T20:33:44.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.138+0000 7fa04119c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa03c1ed500 0x7fa03c152e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:44.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.138+0000 7fa04119c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa03c1ed500 0x7fa03c152e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38470/0 (socket says 172.21.15.72:38470) 2023-07-27T20:33:44.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.138+0000 7fa04119c700 1 -- 172.21.15.72:0/2150693449 learned_addr learned my addr 172.21.15.72:0/2150693449 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:44.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.138+0000 7fa03bfff700 1 --2- 172.21.15.72:0/2150693449 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa03c0a9570 0x7fa03c1ecfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:44.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.138+0000 7fa04099b700 1 --2- 172.21.15.72:0/2150693449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa03c0a9190 0x7fa03c14c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:44.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.138+0000 7fa04119c700 1 -- 172.21.15.72:0/2150693449 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa03c0a9570 msgr2=0x7fa03c1ecfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:44.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.138+0000 7fa04119c700 1 --2- 172.21.15.72:0/2150693449 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa03c0a9570 0x7fa03c1ecfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:44.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.138+0000 7fa04119c700 1 -- 172.21.15.72:0/2150693449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa03c0a9190 msgr2=0x7fa03c14c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:44.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.138+0000 7fa04119c700 1 --2- 172.21.15.72:0/2150693449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa03c0a9190 0x7fa03c14c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:44.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.138+0000 7fa04119c700 1 -- 172.21.15.72:0/2150693449 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa034009b30 con 0x7fa03c1ed500 2023-07-27T20:33:44.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.138+0000 7fa04119c700 1 --2- 172.21.15.72:0/2150693449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa03c1ed500 0x7fa03c152e90 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fa03c0a9f90 tx=0x7fa034004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:44.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.138+0000 7fa0397fa700 1 -- 172.21.15.72:0/2150693449 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa034004840 con 0x7fa03c1ed500 2023-07-27T20:33:44.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.139+0000 7fa0397fa700 1 -- 172.21.15.72:0/2150693449 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0340092e0 con 0x7fa03c1ed500 2023-07-27T20:33:44.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.139+0000 7fa042bff700 1 -- 172.21.15.72:0/2150693449 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa03c1554a0 con 0x7fa03c1ed500 2023-07-27T20:33:44.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.139+0000 7fa0397fa700 1 -- 172.21.15.72:0/2150693449 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03401c660 con 0x7fa03c1ed500 2023-07-27T20:33:44.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.139+0000 7fa042bff700 1 -- 172.21.15.72:0/2150693449 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa03c0c0270 con 0x7fa03c1ed500 2023-07-27T20:33:44.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.140+0000 7fa042bff700 1 -- 172.21.15.72:0/2150693449 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa03c074310 con 0x7fa03c1ed500 2023-07-27T20:33:44.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.141+0000 7fa0397fa700 1 -- 172.21.15.72:0/2150693449 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa03401c7c0 con 0x7fa03c1ed500 2023-07-27T20:33:44.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.142+0000 7fa0397fa700 1 --2- 172.21.15.72:0/2150693449 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa02006ad10 0x7fa02006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:44.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.142+0000 7fa0397fa700 1 -- 172.21.15.72:0/2150693449 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7fa03408b580 con 0x7fa03c1ed500 2023-07-27T20:33:44.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.142+0000 7fa04099b700 1 --2- 172.21.15.72:0/2150693449 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa02006ad10 0x7fa02006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:44.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.143+0000 7fa04099b700 1 --2- 172.21.15.72:0/2150693449 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa02006ad10 0x7fa02006d1d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa030007fd0 tx=0x7fa030009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:44.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.146+0000 7fa0397fa700 1 -- 172.21.15.72:0/2150693449 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa034056170 con 0x7fa03c1ed500 2023-07-27T20:33:44.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.345+0000 7fa042bff700 1 -- 172.21.15.72:0/2150693449 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa03c155c30 con 0x7fa03c1ed500 2023-07-27T20:33:44.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.346+0000 7fa0397fa700 1 -- 172.21.15.72:0/2150693449 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+22308 (secure 0 0 0) 0x7fa03c155c30 con 0x7fa03c1ed500 2023-07-27T20:33:44.335 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:33:44.335 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":47,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:33:23.191066+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:32:58.242890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-27T20:32:59.032110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_metadata","create_time":"2023-07-27T20:33:20.125785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs2_data","create_time":"2023-07-27T20:33:20.647929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2c","mappings":[{"from":0,"to":4}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:33:44.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.349+0000 7fa042bff700 1 -- 172.21.15.72:0/2150693449 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa02006ad10 msgr2=0x7fa02006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:44.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.349+0000 7fa042bff700 1 --2- 172.21.15.72:0/2150693449 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa02006ad10 0x7fa02006d1d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa030007fd0 tx=0x7fa030009040 comp rx=0 tx=0).stop 2023-07-27T20:33:44.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.349+0000 7fa042bff700 1 -- 172.21.15.72:0/2150693449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa03c1ed500 msgr2=0x7fa03c152e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:44.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.349+0000 7fa042bff700 1 --2- 172.21.15.72:0/2150693449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa03c1ed500 0x7fa03c152e90 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fa03c0a9f90 tx=0x7fa034004ad0 comp rx=0 tx=0).stop 2023-07-27T20:33:44.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.349+0000 7fa042bff700 1 -- 172.21.15.72:0/2150693449 shutdown_connections 2023-07-27T20:33:44.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.349+0000 7fa042bff700 1 --2- 172.21.15.72:0/2150693449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa03c1ed500 0x7fa03c152e90 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:44.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.349+0000 7fa042bff700 1 --2- 172.21.15.72:0/2150693449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa03c0a9190 0x7fa03c14c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:44.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.349+0000 7fa042bff700 1 --2- 172.21.15.72:0/2150693449 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa02006ad10 0x7fa02006d1d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:44.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.349+0000 7fa042bff700 1 --2- 172.21.15.72:0/2150693449 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa03c0a9570 0x7fa03c1ecfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:44.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.349+0000 7fa042bff700 1 -- 172.21.15.72:0/2150693449 >> 172.21.15.72:0/2150693449 conn(0x7fa03c06a7c0 msgr2=0x7fa03c150230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:44.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.349+0000 7fa042bff700 1 -- 172.21.15.72:0/2150693449 shutdown_connections 2023-07-27T20:33:44.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.349+0000 7fa042bff700 1 -- 172.21.15.72:0/2150693449 wait complete. 2023-07-27T20:33:44.355 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-27T20:31:14.581785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T20:31:21.077941+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T20:32:58.242890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T20:32:59.032110+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-07-27T20:33:20.125785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs2_data', 'create_time': '2023-07-27T20:33:20.647929+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-27T20:33:44.356 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-27T20:33:44.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.566+0000 7ff9363ff700 1 Processor -- start 2023-07-27T20:33:44.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.567+0000 7ff9363ff700 1 -- start start 2023-07-27T20:33:44.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.568+0000 7ff9363ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff93014aab0 0x7ff930154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:44.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.568+0000 7ff9363ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff9300c7740 0x7ff9300c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:44.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.568+0000 7ff9363ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9300c7c50 con 0x7ff9300c4700 2023-07-27T20:33:44.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.568+0000 7ff9363ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff93006bd40 con 0x7ff93014aab0 2023-07-27T20:33:44.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.568+0000 7ff9363ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9300c62f0 con 0x7ff9300c7740 2023-07-27T20:33:44.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.568+0000 7ff93499c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff9300c4700 0x7ff93006c1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57834/0 (socket says 172.21.15.72:57834) 2023-07-27T20:33:44.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.568+0000 7ff93499c700 1 -- 172.21.15.72:0/3949694092 learned_addr learned my addr 172.21.15.72:0/3949694092 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:44.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.568+0000 7ff92ffff700 1 --2- 172.21.15.72:0/3949694092 >> v2:172.21.15.72:3300/0 conn(0x7ff93014aab0 0x7ff930154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:44.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.568+0000 7ff92f7fe700 1 --2- 172.21.15.72:0/3949694092 >> v2:172.21.15.173:3300/0 conn(0x7ff9300c7740 0x7ff9300c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:44.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.568+0000 7ff92effd700 1 -- 172.21.15.72:0/3949694092 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 759160805 0 0) 0x7ff9300c7c50 con 0x7ff9300c4700 2023-07-27T20:33:44.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.568+0000 7ff92effd700 1 -- 172.21.15.72:0/3949694092 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9180035b0 con 0x7ff9300c4700 2023-07-27T20:33:44.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.568+0000 7ff92ffff700 1 -- 172.21.15.72:0/3949694092 >> v2:172.21.15.173:3300/0 conn(0x7ff9300c7740 msgr2=0x7ff9300c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:44.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.568+0000 7ff92ffff700 1 --2- 172.21.15.72:0/3949694092 >> v2:172.21.15.173:3300/0 conn(0x7ff9300c7740 0x7ff9300c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:44.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.568+0000 7ff92ffff700 1 -- 172.21.15.72:0/3949694092 >> v1:172.21.15.72:6789/0 conn(0x7ff9300c4700 legacy=0x7ff93006c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:44.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.569+0000 7ff92ffff700 1 -- 172.21.15.72:0/3949694092 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff930155050 con 0x7ff93014aab0 2023-07-27T20:33:44.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.569+0000 7ff92ffff700 1 --2- 172.21.15.72:0/3949694092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff93014aab0 0x7ff930154b10 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ff9300a9090 tx=0x7ff920009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b827c87b971f52f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:44.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.569+0000 7ff92effd700 1 -- 172.21.15.72:0/3949694092 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff920011830 con 0x7ff93014aab0 2023-07-27T20:33:44.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.569+0000 7ff92effd700 1 -- 172.21.15.72:0/3949694092 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff920011990 con 0x7ff93014aab0 2023-07-27T20:33:44.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.569+0000 7ff92effd700 1 -- 172.21.15.72:0/3949694092 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff920011d20 con 0x7ff93014aab0 2023-07-27T20:33:44.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.570+0000 7ff9363ff700 1 -- 172.21.15.72:0/3949694092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff93014aab0 msgr2=0x7ff930154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:44.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.570+0000 7ff9363ff700 1 --2- 172.21.15.72:0/3949694092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff93014aab0 0x7ff930154b10 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ff9300a9090 tx=0x7ff920009b20 comp rx=0 tx=0).stop 2023-07-27T20:33:44.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.570+0000 7ff9363ff700 1 -- 172.21.15.72:0/3949694092 shutdown_connections 2023-07-27T20:33:44.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.570+0000 7ff9363ff700 1 --2- 172.21.15.72:0/3949694092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff93014aab0 0x7ff930154b10 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:44.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.570+0000 7ff9363ff700 1 --2- 172.21.15.72:0/3949694092 >> v2:172.21.15.173:3300/0 conn(0x7ff9300c7740 0x7ff9300c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:44.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.570+0000 7ff9363ff700 1 -- 172.21.15.72:0/3949694092 >> 172.21.15.72:0/3949694092 conn(0x7ff9300ab3f0 msgr2=0x7ff9300ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:44.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.570+0000 7ff9363ff700 1 -- 172.21.15.72:0/3949694092 shutdown_connections 2023-07-27T20:33:44.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.570+0000 7ff9363ff700 1 -- 172.21.15.72:0/3949694092 wait complete. 2023-07-27T20:33:44.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.571+0000 7ff9363ff700 1 Processor -- start 2023-07-27T20:33:44.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.572+0000 7ff9363ff700 1 -- start start 2023-07-27T20:33:44.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.572+0000 7ff9363ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9300c4700 0x7ff9301457a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:44.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.572+0000 7ff9363ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9300c7740 0x7ff9300c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:44.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.572+0000 7ff9363ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff93014aab0 0x7ff9300c2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:44.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.573+0000 7ff9363ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9300c3160 con 0x7ff9300c4700 2023-07-27T20:33:44.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.573+0000 7ff9363ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9300c3a00 con 0x7ff9300c7740 2023-07-27T20:33:44.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.573+0000 7ff9363ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff930143460 con 0x7ff93014aab0 2023-07-27T20:33:44.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.573+0000 7ff92ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9300c4700 0x7ff9301457a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:44.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.573+0000 7ff92ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9300c4700 0x7ff9301457a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38488/0 (socket says 172.21.15.72:38488) 2023-07-27T20:33:44.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.573+0000 7ff92ffff700 1 -- 172.21.15.72:0/813906406 learned_addr learned my addr 172.21.15.72:0/813906406 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:44.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.573+0000 7ff92ffff700 1 -- 172.21.15.72:0/813906406 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff93014aab0 msgr2=0x7ff9300c2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:44.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.573+0000 7ff92ffff700 1 --2- 172.21.15.72:0/813906406 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff93014aab0 0x7ff9300c2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:44.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.573+0000 7ff92ffff700 1 -- 172.21.15.72:0/813906406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9300c7740 msgr2=0x7ff9300c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:44.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.573+0000 7ff92ffff700 1 --2- 172.21.15.72:0/813906406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9300c7740 0x7ff9300c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:44.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.573+0000 7ff92ffff700 1 -- 172.21.15.72:0/813906406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9200094a0 con 0x7ff9300c4700 2023-07-27T20:33:44.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.573+0000 7ff92ffff700 1 --2- 172.21.15.72:0/813906406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9300c4700 0x7ff9301457a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff920000c00 tx=0x7ff920004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:44.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.574+0000 7ff92cff9700 1 -- 172.21.15.72:0/813906406 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9200036a0 con 0x7ff9300c4700 2023-07-27T20:33:44.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.574+0000 7ff92cff9700 1 -- 172.21.15.72:0/813906406 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92001e070 con 0x7ff9300c4700 2023-07-27T20:33:44.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.574+0000 7ff9363ff700 1 -- 172.21.15.72:0/813906406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff930143c70 con 0x7ff9300c4700 2023-07-27T20:33:44.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.574+0000 7ff92cff9700 1 -- 172.21.15.72:0/813906406 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff920003a60 con 0x7ff9300c4700 2023-07-27T20:33:44.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.574+0000 7ff9363ff700 1 -- 172.21.15.72:0/813906406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9301436b0 con 0x7ff9300c4700 2023-07-27T20:33:44.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.575+0000 7ff9363ff700 1 -- 172.21.15.72:0/813906406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff93004e470 con 0x7ff9300c4700 2023-07-27T20:33:44.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.576+0000 7ff92cff9700 1 -- 172.21.15.72:0/813906406 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff920003bc0 con 0x7ff9300c4700 2023-07-27T20:33:44.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.576+0000 7ff92cff9700 1 --2- 172.21.15.72:0/813906406 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff91c06ace0 0x7ff91c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:44.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.577+0000 7ff92cff9700 1 -- 172.21.15.72:0/813906406 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7ff92008a9b0 con 0x7ff9300c4700 2023-07-27T20:33:44.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.577+0000 7ff92f7fe700 1 --2- 172.21.15.72:0/813906406 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff91c06ace0 0x7ff91c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:44.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.578+0000 7ff92f7fe700 1 --2- 172.21.15.72:0/813906406 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff91c06ace0 0x7ff91c06d1a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff9300bc7e0 tx=0x7ff924008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:44.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.581+0000 7ff92cff9700 1 -- 172.21.15.72:0/813906406 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff9200555a0 con 0x7ff9300c4700 2023-07-27T20:33:44.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.775+0000 7ff9363ff700 1 -- 172.21.15.72:0/813906406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff93006cf00 con 0x7ff9300c4700 2023-07-27T20:33:44.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.775+0000 7ff92cff9700 1 -- 172.21.15.72:0/813906406 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff920058bc0 con 0x7ff9300c4700 2023-07-27T20:33:44.765 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-27T20:33:44.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.778+0000 7ff9363ff700 1 -- 172.21.15.72:0/813906406 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff91c06ace0 msgr2=0x7ff91c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:44.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.778+0000 7ff9363ff700 1 --2- 172.21.15.72:0/813906406 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff91c06ace0 0x7ff91c06d1a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff9300bc7e0 tx=0x7ff924008040 comp rx=0 tx=0).stop 2023-07-27T20:33:44.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.778+0000 7ff9363ff700 1 -- 172.21.15.72:0/813906406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9300c4700 msgr2=0x7ff9301457a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:44.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.778+0000 7ff9363ff700 1 --2- 172.21.15.72:0/813906406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9300c4700 0x7ff9301457a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff920000c00 tx=0x7ff920004750 comp rx=0 tx=0).stop 2023-07-27T20:33:44.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.778+0000 7ff9363ff700 1 -- 172.21.15.72:0/813906406 shutdown_connections 2023-07-27T20:33:44.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.778+0000 7ff9363ff700 1 --2- 172.21.15.72:0/813906406 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff91c06ace0 0x7ff91c06d1a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:44.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.778+0000 7ff9363ff700 1 --2- 172.21.15.72:0/813906406 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff93014aab0 0x7ff9300c2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:44.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.778+0000 7ff9363ff700 1 --2- 172.21.15.72:0/813906406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9300c4700 0x7ff9301457a0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:44.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.778+0000 7ff9363ff700 1 --2- 172.21.15.72:0/813906406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9300c7740 0x7ff9300c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:44.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.778+0000 7ff9363ff700 1 -- 172.21.15.72:0/813906406 >> 172.21.15.72:0/813906406 conn(0x7ff9300ab3f0 msgr2=0x7ff9300a9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:44.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.778+0000 7ff9363ff700 1 -- 172.21.15.72:0/813906406 shutdown_connections 2023-07-27T20:33:44.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.778+0000 7ff9363ff700 1 -- 172.21.15.72:0/813906406 wait complete. 2023-07-27T20:33:44.784 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T20:33:44.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.993+0000 7f71d53ff700 1 Processor -- start 2023-07-27T20:33:44.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.993+0000 7f71d53ff700 1 -- start start 2023-07-27T20:33:44.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.994+0000 7f71d53ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f71d00c6e20 0x7f71d00c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:44.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.994+0000 7f71d53ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d006d1c0 con 0x7f71d006ffc0 2023-07-27T20:33:44.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.994+0000 7f71d53ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d0155070 con 0x7f71d00c77c0 2023-07-27T20:33:44.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.994+0000 7f71d53ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d006ce90 con 0x7f71d00c6e20 2023-07-27T20:33:44.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.994+0000 7f71ce7fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f71d006ffc0 0x7f71d00c6710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57846/0 (socket says 172.21.15.72:57846) 2023-07-27T20:33:44.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.994+0000 7f71ce7fc700 1 -- 172.21.15.72:0/1742547108 learned_addr learned my addr 172.21.15.72:0/1742547108 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:44.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.994+0000 7f71cf7fe700 1 --2- 172.21.15.72:0/1742547108 >> v2:172.21.15.72:3300/0 conn(0x7f71d00c6e20 0x7f71d00c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:44.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.995+0000 7f71cdffb700 1 -- 172.21.15.72:0/1742547108 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1407042387 0 0) 0x7f71d006d1c0 con 0x7f71d006ffc0 2023-07-27T20:33:44.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.995+0000 7f71cdffb700 1 -- 172.21.15.72:0/1742547108 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71b80035b0 con 0x7f71d006ffc0 2023-07-27T20:33:44.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.995+0000 7f71cf7fe700 1 -- 172.21.15.72:0/1742547108 >> v1:172.21.15.173:6789/0 conn(0x7f71d00c77c0 legacy=0x7f71d0151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:44.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.995+0000 7f71cf7fe700 1 -- 172.21.15.72:0/1742547108 >> v1:172.21.15.72:6789/0 conn(0x7f71d006ffc0 legacy=0x7f71d00c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:44.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.995+0000 7f71cf7fe700 1 -- 172.21.15.72:0/1742547108 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d0154d90 con 0x7f71d00c6e20 2023-07-27T20:33:44.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.995+0000 7f71cf7fe700 1 --2- 172.21.15.72:0/1742547108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71d00c6e20 0x7f71d00c3e90 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f71c8009d90 tx=0x7f71c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=121cbfcef276b311 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:44.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.995+0000 7f71cdffb700 1 -- 172.21.15.72:0/1742547108 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c800e070 con 0x7f71d00c6e20 2023-07-27T20:33:44.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.995+0000 7f71cdffb700 1 -- 172.21.15.72:0/1742547108 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c800bb20 con 0x7f71d00c6e20 2023-07-27T20:33:44.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.995+0000 7f71cdffb700 1 -- 172.21.15.72:0/1742547108 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c8012430 con 0x7f71d00c6e20 2023-07-27T20:33:44.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.996+0000 7f71d53ff700 1 -- 172.21.15.72:0/1742547108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71d00c6e20 msgr2=0x7f71d00c3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:44.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.996+0000 7f71d53ff700 1 --2- 172.21.15.72:0/1742547108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71d00c6e20 0x7f71d00c3e90 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f71c8009d90 tx=0x7f71c800b330 comp rx=0 tx=0).stop 2023-07-27T20:33:44.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.996+0000 7f71d53ff700 1 -- 172.21.15.72:0/1742547108 shutdown_connections 2023-07-27T20:33:44.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.996+0000 7f71d53ff700 1 --2- 172.21.15.72:0/1742547108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71d00c6e20 0x7f71d00c3e90 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:44.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.996+0000 7f71d53ff700 1 -- 172.21.15.72:0/1742547108 >> 172.21.15.72:0/1742547108 conn(0x7f71d006a190 msgr2=0x7f71d006a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:44.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.996+0000 7f71d53ff700 1 -- 172.21.15.72:0/1742547108 shutdown_connections 2023-07-27T20:33:44.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.996+0000 7f71d53ff700 1 -- 172.21.15.72:0/1742547108 wait complete. 2023-07-27T20:33:44.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.998+0000 7f71d53ff700 1 Processor -- start 2023-07-27T20:33:44.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:44.999+0000 7f71d53ff700 1 -- start start 2023-07-27T20:33:44.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.000+0000 7f71d53ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f71d006ffc0 0x7f71d01e9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:44.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.000+0000 7f71d53ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71d00c6e20 0x7f71d01e9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:44.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.000+0000 7f71d53ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71d00c77c0 0x7f71d00bfba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:44.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.000+0000 7f71d53ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d00c0ae0 con 0x7f71d00c6e20 2023-07-27T20:33:44.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.000+0000 7f71d53ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d00ada10 con 0x7f71d00c77c0 2023-07-27T20:33:44.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.000+0000 7f71d53ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d01e9ed0 con 0x7f71d006ffc0 2023-07-27T20:33:44.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.000+0000 7f71ce7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71d00c6e20 0x7f71d01e9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:44.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.000+0000 7f71ce7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71d00c6e20 0x7f71d01e9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38494/0 (socket says 172.21.15.72:38494) 2023-07-27T20:33:44.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.000+0000 7f71ce7fc700 1 -- 172.21.15.72:0/2581998522 learned_addr learned my addr 172.21.15.72:0/2581998522 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:44.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.000+0000 7f71cf7fe700 1 --2- 172.21.15.72:0/2581998522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71d00c77c0 0x7f71d00bfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:44.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.000+0000 7f71ceffd700 1 --2- 172.21.15.72:0/2581998522 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f71d006ffc0 0x7f71d01e9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:44.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.000+0000 7f71ce7fc700 1 -- 172.21.15.72:0/2581998522 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f71d006ffc0 msgr2=0x7f71d01e9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:44.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.000+0000 7f71ce7fc700 1 --2- 172.21.15.72:0/2581998522 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f71d006ffc0 0x7f71d01e9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:44.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.000+0000 7f71ce7fc700 1 -- 172.21.15.72:0/2581998522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71d00c77c0 msgr2=0x7f71d00bfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:44.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.000+0000 7f71ce7fc700 1 --2- 172.21.15.72:0/2581998522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71d00c77c0 0x7f71d00bfba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:44.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.000+0000 7f71ce7fc700 1 -- 172.21.15.72:0/2581998522 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c8009a70 con 0x7f71d00c6e20 2023-07-27T20:33:44.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.000+0000 7f71ceffd700 1 --2- 172.21.15.72:0/2581998522 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f71d006ffc0 0x7f71d01e9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:33:44.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.001+0000 7f71ce7fc700 1 --2- 172.21.15.72:0/2581998522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71d00c6e20 0x7f71d01e9990 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f71c4005910 tx=0x7f71c400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:44.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.001+0000 7f71b77fe700 1 -- 172.21.15.72:0/2581998522 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c4005d70 con 0x7f71d00c6e20 2023-07-27T20:33:44.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.001+0000 7f71b77fe700 1 -- 172.21.15.72:0/2581998522 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c40070d0 con 0x7f71d00c6e20 2023-07-27T20:33:44.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.001+0000 7f71d53ff700 1 -- 172.21.15.72:0/2581998522 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d00ad730 con 0x7f71d00c6e20 2023-07-27T20:33:44.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.001+0000 7f71b77fe700 1 -- 172.21.15.72:0/2581998522 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c4007440 con 0x7f71d00c6e20 2023-07-27T20:33:44.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.001+0000 7f71d53ff700 1 -- 172.21.15.72:0/2581998522 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d0157990 con 0x7f71d00c6e20 2023-07-27T20:33:44.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.002+0000 7f71d53ff700 1 -- 172.21.15.72:0/2581998522 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d0157510 con 0x7f71d00c6e20 2023-07-27T20:33:44.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.003+0000 7f71b77fe700 1 -- 172.21.15.72:0/2581998522 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f71c40075a0 con 0x7f71d00c6e20 2023-07-27T20:33:44.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.004+0000 7f71b77fe700 1 --2- 172.21.15.72:0/2581998522 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f71bc06ace0 0x7f71bc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:44.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.004+0000 7f71b77fe700 1 -- 172.21.15.72:0/2581998522 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f71c4088c50 con 0x7f71d00c6e20 2023-07-27T20:33:44.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.005+0000 7f71ceffd700 1 --2- 172.21.15.72:0/2581998522 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f71bc06ace0 0x7f71bc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:44.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.005+0000 7f71ceffd700 1 --2- 172.21.15.72:0/2581998522 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f71bc06ace0 0x7f71bc06d1a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f71c0000f60 tx=0x7f71c0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:44.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.008+0000 7f71b77fe700 1 -- 172.21.15.72:0/2581998522 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f71d0157510 con 0x7f71d00c6e20 2023-07-27T20:33:45.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.267+0000 7f71d53ff700 1 -- 172.21.15.72:0/2581998522 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f71d0155d70 con 0x7f71d00c6e20 2023-07-27T20:33:45.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.268+0000 7f71b77fe700 1 -- 172.21.15.72:0/2581998522 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v47) v1 ==== 92+0+10 (secure 0 0 0) 0x7f71d0155d70 con 0x7f71d00c6e20 2023-07-27T20:33:45.257 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-27T20:33:45.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.270+0000 7f71d53ff700 1 -- 172.21.15.72:0/2581998522 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f71bc06ace0 msgr2=0x7f71bc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:45.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.270+0000 7f71d53ff700 1 --2- 172.21.15.72:0/2581998522 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f71bc06ace0 0x7f71bc06d1a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f71c0000f60 tx=0x7f71c0009040 comp rx=0 tx=0).stop 2023-07-27T20:33:45.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.270+0000 7f71d53ff700 1 -- 172.21.15.72:0/2581998522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71d00c6e20 msgr2=0x7f71d01e9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:45.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.270+0000 7f71d53ff700 1 --2- 172.21.15.72:0/2581998522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71d00c6e20 0x7f71d01e9990 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f71c4005910 tx=0x7f71c400c9e0 comp rx=0 tx=0).stop 2023-07-27T20:33:45.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.270+0000 7f71d53ff700 1 -- 172.21.15.72:0/2581998522 shutdown_connections 2023-07-27T20:33:45.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.270+0000 7f71d53ff700 1 --2- 172.21.15.72:0/2581998522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71d00c77c0 0x7f71d00bfba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:45.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.270+0000 7f71d53ff700 1 --2- 172.21.15.72:0/2581998522 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f71bc06ace0 0x7f71bc06d1a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:45.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.270+0000 7f71d53ff700 1 --2- 172.21.15.72:0/2581998522 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f71d006ffc0 0x7f71d01e9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:45.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.270+0000 7f71d53ff700 1 --2- 172.21.15.72:0/2581998522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71d00c6e20 0x7f71d01e9990 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:45.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.270+0000 7f71d53ff700 1 -- 172.21.15.72:0/2581998522 >> 172.21.15.72:0/2581998522 conn(0x7f71d006a190 msgr2=0x7f71d00a9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:45.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.271+0000 7f71d53ff700 1 -- 172.21.15.72:0/2581998522 shutdown_connections 2023-07-27T20:33:45.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.271+0000 7f71d53ff700 1 -- 172.21.15.72:0/2581998522 wait complete. 2023-07-27T20:33:45.277 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T20:33:45.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.487+0000 7f47ba9ff700 1 Processor -- start 2023-07-27T20:33:45.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.487+0000 7f47ba9ff700 1 -- start start 2023-07-27T20:33:45.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.488+0000 7f47ba9ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f47b4071190 0x7f47b4158100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:45.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.488+0000 7f47ba9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f47b40a8aa0 0x7f47b406b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:45.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.488+0000 7f47ba9ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b40a8ec0 con 0x7f47b40a86c0 2023-07-27T20:33:45.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.488+0000 7f47ba9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b40c3e30 con 0x7f47b40a8aa0 2023-07-27T20:33:45.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.488+0000 7f47ba9ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b40c2ca0 con 0x7f47b4071190 2023-07-27T20:33:45.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.489+0000 7f47b8f9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f47b40a8aa0 0x7f47b406b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:45.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.489+0000 7f47b8f9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f47b40a8aa0 0x7f47b406b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38506/0 (socket says 172.21.15.72:38506) 2023-07-27T20:33:45.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.489+0000 7f47b8f9c700 1 -- 172.21.15.72:0/4186912377 learned_addr learned my addr 172.21.15.72:0/4186912377 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:45.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.489+0000 7f47b37fe700 1 --2- 172.21.15.72:0/4186912377 >> v2:172.21.15.173:3300/0 conn(0x7f47b4071190 0x7f47b4158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:45.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.489+0000 7f47b8f9c700 1 -- 172.21.15.72:0/4186912377 >> v2:172.21.15.173:3300/0 conn(0x7f47b4071190 msgr2=0x7f47b4158100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:45.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.489+0000 7f47b8f9c700 1 --2- 172.21.15.72:0/4186912377 >> v2:172.21.15.173:3300/0 conn(0x7f47b4071190 0x7f47b4158100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:45.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.489+0000 7f47b8f9c700 1 -- 172.21.15.72:0/4186912377 >> v1:172.21.15.173:6789/0 conn(0x7f47b40a86c0 legacy=0x7f47b4154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:45.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.489+0000 7f47b8f9c700 1 -- 172.21.15.72:0/4186912377 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b4071700 con 0x7f47b40a8aa0 2023-07-27T20:33:45.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.489+0000 7f47b8f9c700 1 --2- 172.21.15.72:0/4186912377 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47b40a8aa0 0x7f47b406b2b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f47b406e0b0 tx=0x7f47ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5259eb1a514de03b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:45.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.490+0000 7f47b2ffd700 1 -- 172.21.15.72:0/4186912377 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ac00e070 con 0x7f47b40a8aa0 2023-07-27T20:33:45.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.490+0000 7f47b2ffd700 1 -- 172.21.15.72:0/4186912377 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ac00b910 con 0x7f47b40a8aa0 2023-07-27T20:33:45.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.490+0000 7f47b2ffd700 1 -- 172.21.15.72:0/4186912377 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ac00bcc0 con 0x7f47b40a8aa0 2023-07-27T20:33:45.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.490+0000 7f47ba9ff700 1 -- 172.21.15.72:0/4186912377 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47b40a8aa0 msgr2=0x7f47b406b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:45.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.490+0000 7f47ba9ff700 1 --2- 172.21.15.72:0/4186912377 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47b40a8aa0 0x7f47b406b2b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f47b406e0b0 tx=0x7f47ac00b330 comp rx=0 tx=0).stop 2023-07-27T20:33:45.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.490+0000 7f47ba9ff700 1 -- 172.21.15.72:0/4186912377 shutdown_connections 2023-07-27T20:33:45.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.490+0000 7f47ba9ff700 1 --2- 172.21.15.72:0/4186912377 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47b40a8aa0 0x7f47b406b2b0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:45.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.490+0000 7f47ba9ff700 1 --2- 172.21.15.72:0/4186912377 >> v2:172.21.15.173:3300/0 conn(0x7f47b4071190 0x7f47b4158100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:45.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.490+0000 7f47ba9ff700 1 -- 172.21.15.72:0/4186912377 >> 172.21.15.72:0/4186912377 conn(0x7f47b40c2fd0 msgr2=0x7f47b40c33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:45.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.490+0000 7f47ba9ff700 1 -- 172.21.15.72:0/4186912377 shutdown_connections 2023-07-27T20:33:45.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.490+0000 7f47ba9ff700 1 -- 172.21.15.72:0/4186912377 wait complete. 2023-07-27T20:33:45.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.492+0000 7f47ba9ff700 1 Processor -- start 2023-07-27T20:33:45.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.492+0000 7f47ba9ff700 1 -- start start 2023-07-27T20:33:45.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.493+0000 7f47ba9ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47b4071190 0x7f47b4151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:45.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.493+0000 7f47ba9ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f47b40a86c0 0x7f47b40bb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:45.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.493+0000 7f47ba9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47b40a8aa0 0x7f47b40bbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:45.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.493+0000 7f47ba9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b40bd620 con 0x7f47b40a8aa0 2023-07-27T20:33:45.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.493+0000 7f47ba9ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b41edb40 con 0x7f47b4071190 2023-07-27T20:33:45.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.493+0000 7f47ba9ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b40bd870 con 0x7f47b40a86c0 2023-07-27T20:33:45.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.493+0000 7f47b8f9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47b40a8aa0 0x7f47b40bbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:45.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.493+0000 7f47b8f9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47b40a8aa0 0x7f47b40bbb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38516/0 (socket says 172.21.15.72:38516) 2023-07-27T20:33:45.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.493+0000 7f47b8f9c700 1 -- 172.21.15.72:0/1840034787 learned_addr learned my addr 172.21.15.72:0/1840034787 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:45.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.493+0000 7f47b37fe700 1 --2- 172.21.15.72:0/1840034787 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f47b40a86c0 0x7f47b40bb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:45.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.493+0000 7f47b3fff700 1 --2- 172.21.15.72:0/1840034787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47b4071190 0x7f47b4151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:45.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.494+0000 7f47b8f9c700 1 -- 172.21.15.72:0/1840034787 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f47b40a86c0 msgr2=0x7f47b40bb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:45.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.494+0000 7f47b8f9c700 1 --2- 172.21.15.72:0/1840034787 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f47b40a86c0 0x7f47b40bb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:45.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.494+0000 7f47b8f9c700 1 -- 172.21.15.72:0/1840034787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47b4071190 msgr2=0x7f47b4151d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:45.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.494+0000 7f47b8f9c700 1 --2- 172.21.15.72:0/1840034787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47b4071190 0x7f47b4151d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:45.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.494+0000 7f47b8f9c700 1 -- 172.21.15.72:0/1840034787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ac009b30 con 0x7f47b40a8aa0 2023-07-27T20:33:45.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.494+0000 7f47b8f9c700 1 --2- 172.21.15.72:0/1840034787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47b40a8aa0 0x7f47b40bbb80 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f47b406f3b0 tx=0x7f47ac004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:45.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.494+0000 7f47b0ff9700 1 -- 172.21.15.72:0/1840034787 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ac004880 con 0x7f47b40a8aa0 2023-07-27T20:33:45.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.494+0000 7f47b0ff9700 1 -- 172.21.15.72:0/1840034787 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ac0099b0 con 0x7f47b40a8aa0 2023-07-27T20:33:45.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.494+0000 7f47b0ff9700 1 -- 172.21.15.72:0/1840034787 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ac01c680 con 0x7f47b40a8aa0 2023-07-27T20:33:45.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.494+0000 7f47ba9ff700 1 -- 172.21.15.72:0/1840034787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47b40bdb50 con 0x7f47b40a8aa0 2023-07-27T20:33:45.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.495+0000 7f47ba9ff700 1 -- 172.21.15.72:0/1840034787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b4152250 con 0x7f47b40a8aa0 2023-07-27T20:33:45.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.495+0000 7f47ba9ff700 1 -- 172.21.15.72:0/1840034787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47b41575c0 con 0x7f47b40a8aa0 2023-07-27T20:33:45.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.496+0000 7f47b0ff9700 1 -- 172.21.15.72:0/1840034787 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f47ac01c7e0 con 0x7f47b40a8aa0 2023-07-27T20:33:45.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.497+0000 7f47b0ff9700 1 --2- 172.21.15.72:0/1840034787 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f47a006ace0 0x7f47a006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:45.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.497+0000 7f47b0ff9700 1 -- 172.21.15.72:0/1840034787 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f47ac08b4c0 con 0x7f47b40a8aa0 2023-07-27T20:33:45.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.498+0000 7f47b3fff700 1 --2- 172.21.15.72:0/1840034787 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f47a006ace0 0x7f47a006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:45.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.498+0000 7f47b3fff700 1 --2- 172.21.15.72:0/1840034787 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f47a006ace0 0x7f47a006d1a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f47a4007fd0 tx=0x7f47a4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:45.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.502+0000 7f47b0ff9700 1 -- 172.21.15.72:0/1840034787 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f47ac056130 con 0x7f47b40a8aa0 2023-07-27T20:33:45.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.697+0000 7f47ba9ff700 1 -- 172.21.15.72:0/1840034787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f47b404e470 con 0x7f47b40a8aa0 2023-07-27T20:33:45.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.698+0000 7f47b0ff9700 1 -- 172.21.15.72:0/1840034787 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) v1 ==== 104+0+11 (secure 0 0 0) 0x7f47ac059750 con 0x7f47b40a8aa0 2023-07-27T20:33:45.687 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:33:45.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.700+0000 7f47ba9ff700 1 -- 172.21.15.72:0/1840034787 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f47a006ace0 msgr2=0x7f47a006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:45.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.700+0000 7f47ba9ff700 1 --2- 172.21.15.72:0/1840034787 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f47a006ace0 0x7f47a006d1a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f47a4007fd0 tx=0x7f47a4009040 comp rx=0 tx=0).stop 2023-07-27T20:33:45.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.700+0000 7f47ba9ff700 1 -- 172.21.15.72:0/1840034787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47b40a8aa0 msgr2=0x7f47b40bbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:45.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.700+0000 7f47ba9ff700 1 --2- 172.21.15.72:0/1840034787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47b40a8aa0 0x7f47b40bbb80 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f47b406f3b0 tx=0x7f47ac004ad0 comp rx=0 tx=0).stop 2023-07-27T20:33:45.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.701+0000 7f47ba9ff700 1 -- 172.21.15.72:0/1840034787 shutdown_connections 2023-07-27T20:33:45.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.701+0000 7f47ba9ff700 1 --2- 172.21.15.72:0/1840034787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47b40a8aa0 0x7f47b40bbb80 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:45.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.701+0000 7f47ba9ff700 1 --2- 172.21.15.72:0/1840034787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47b4071190 0x7f47b4151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:45.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.701+0000 7f47ba9ff700 1 --2- 172.21.15.72:0/1840034787 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f47a006ace0 0x7f47a006d1a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:45.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.701+0000 7f47ba9ff700 1 --2- 172.21.15.72:0/1840034787 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f47b40a86c0 0x7f47b40bb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:45.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.701+0000 7f47ba9ff700 1 -- 172.21.15.72:0/1840034787 >> 172.21.15.72:0/1840034787 conn(0x7f47b40c2fd0 msgr2=0x7f47b40c33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:45.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.701+0000 7f47ba9ff700 1 -- 172.21.15.72:0/1840034787 shutdown_connections 2023-07-27T20:33:45.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.701+0000 7f47ba9ff700 1 -- 172.21.15.72:0/1840034787 wait complete. 2023-07-27T20:33:45.706 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T20:33:45.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.916+0000 7f5c463ff700 1 Processor -- start 2023-07-27T20:33:45.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.916+0000 7f5c463ff700 1 -- start start 2023-07-27T20:33:45.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.917+0000 7f5c463ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f5c400c6e20 0x7f5c400c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:45.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.917+0000 7f5c463ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c4006d1c0 con 0x7f5c400c77c0 2023-07-27T20:33:45.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.917+0000 7f5c463ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c40155070 con 0x7f5c4006ffc0 2023-07-27T20:33:45.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.917+0000 7f5c463ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c4006ce90 con 0x7f5c400c6e20 2023-07-27T20:33:45.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.917+0000 7f5c3ffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5c400c77c0 0x7f5c40151210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57860/0 (socket says 172.21.15.72:57860) 2023-07-27T20:33:45.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.917+0000 7f5c3ffff700 1 -- 172.21.15.72:0/1347685458 learned_addr learned my addr 172.21.15.72:0/1347685458 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:45.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.917+0000 7f5c4499c700 1 --2- 172.21.15.72:0/1347685458 >> v2:172.21.15.173:3300/0 conn(0x7f5c400c6e20 0x7f5c400c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:45.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.918+0000 7f5c3effd700 1 -- 172.21.15.72:0/1347685458 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1862957177 0 0) 0x7f5c4006d1c0 con 0x7f5c400c77c0 2023-07-27T20:33:45.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.918+0000 7f5c3effd700 1 -- 172.21.15.72:0/1347685458 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c280035b0 con 0x7f5c400c77c0 2023-07-27T20:33:45.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.918+0000 7f5c3effd700 1 -- 172.21.15.72:0/1347685458 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3276447521 0 0) 0x7f5c40155070 con 0x7f5c4006ffc0 2023-07-27T20:33:45.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.918+0000 7f5c3effd700 1 -- 172.21.15.72:0/1347685458 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c4006d1c0 con 0x7f5c4006ffc0 2023-07-27T20:33:45.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.918+0000 7f5c3effd700 1 -- 172.21.15.72:0/1347685458 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1125068661 0 0) 0x7f5c280035b0 con 0x7f5c400c77c0 2023-07-27T20:33:45.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.918+0000 7f5c4499c700 1 -- 172.21.15.72:0/1347685458 >> v1:172.21.15.173:6789/0 conn(0x7f5c4006ffc0 legacy=0x7f5c400c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:45.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.918+0000 7f5c4499c700 1 -- 172.21.15.72:0/1347685458 >> v1:172.21.15.72:6789/0 conn(0x7f5c400c77c0 legacy=0x7f5c40151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:45.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.918+0000 7f5c4499c700 1 -- 172.21.15.72:0/1347685458 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c40154d90 con 0x7f5c400c6e20 2023-07-27T20:33:45.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.918+0000 7f5c4499c700 1 --2- 172.21.15.72:0/1347685458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c400c6e20 0x7f5c400c3e90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5c38009d90 tx=0x7f5c3800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74ca0201216cd754 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:45.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.919+0000 7f5c3effd700 1 -- 172.21.15.72:0/1347685458 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3800e070 con 0x7f5c400c6e20 2023-07-27T20:33:45.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.919+0000 7f5c3effd700 1 -- 172.21.15.72:0/1347685458 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c38003a20 con 0x7f5c400c6e20 2023-07-27T20:33:45.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.919+0000 7f5c3effd700 1 -- 172.21.15.72:0/1347685458 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c30001670 con 0x7f5c400c6e20 2023-07-27T20:33:45.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.919+0000 7f5c463ff700 1 -- 172.21.15.72:0/1347685458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c400c6e20 msgr2=0x7f5c400c3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:45.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.919+0000 7f5c463ff700 1 --2- 172.21.15.72:0/1347685458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c400c6e20 0x7f5c400c3e90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5c38009d90 tx=0x7f5c3800b330 comp rx=0 tx=0).stop 2023-07-27T20:33:45.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.919+0000 7f5c463ff700 1 -- 172.21.15.72:0/1347685458 shutdown_connections 2023-07-27T20:33:45.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.919+0000 7f5c463ff700 1 --2- 172.21.15.72:0/1347685458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c400c6e20 0x7f5c400c3e90 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:45.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.919+0000 7f5c463ff700 1 -- 172.21.15.72:0/1347685458 >> 172.21.15.72:0/1347685458 conn(0x7f5c4006a190 msgr2=0x7f5c4006a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:45.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.919+0000 7f5c463ff700 1 -- 172.21.15.72:0/1347685458 shutdown_connections 2023-07-27T20:33:45.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.919+0000 7f5c463ff700 1 -- 172.21.15.72:0/1347685458 wait complete. 2023-07-27T20:33:45.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.921+0000 7f5c463ff700 1 Processor -- start 2023-07-27T20:33:45.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.921+0000 7f5c463ff700 1 -- start start 2023-07-27T20:33:45.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.922+0000 7f5c463ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5c4006ffc0 0x7f5c401e8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:45.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.922+0000 7f5c463ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c400c6e20 0x7f5c401ecdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:45.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.922+0000 7f5c463ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c400c77c0 0x7f5c400bf980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:45.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.922+0000 7f5c463ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c400c18b0 con 0x7f5c400c6e20 2023-07-27T20:33:45.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.922+0000 7f5c463ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c401ec5c0 con 0x7f5c400c77c0 2023-07-27T20:33:45.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.922+0000 7f5c463ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c401ec8a0 con 0x7f5c4006ffc0 2023-07-27T20:33:45.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.922+0000 7f5c3f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c400c6e20 0x7f5c401ecdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:45.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.922+0000 7f5c3f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c400c6e20 0x7f5c401ecdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38528/0 (socket says 172.21.15.72:38528) 2023-07-27T20:33:45.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.922+0000 7f5c3f7fe700 1 -- 172.21.15.72:0/3050315132 learned_addr learned my addr 172.21.15.72:0/3050315132 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:45.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.922+0000 7f5c4499c700 1 --2- 172.21.15.72:0/3050315132 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c400c77c0 0x7f5c400bf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:45.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.922+0000 7f5c3ffff700 1 --2- 172.21.15.72:0/3050315132 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5c4006ffc0 0x7f5c401e8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:45.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.923+0000 7f5c3f7fe700 1 -- 172.21.15.72:0/3050315132 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5c4006ffc0 msgr2=0x7f5c401e8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:45.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.923+0000 7f5c3f7fe700 1 --2- 172.21.15.72:0/3050315132 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5c4006ffc0 0x7f5c401e8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:45.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.923+0000 7f5c3f7fe700 1 -- 172.21.15.72:0/3050315132 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c400c77c0 msgr2=0x7f5c400bf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:45.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.923+0000 7f5c3f7fe700 1 --2- 172.21.15.72:0/3050315132 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c400c77c0 0x7f5c400bf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:45.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.923+0000 7f5c3f7fe700 1 -- 172.21.15.72:0/3050315132 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c38009a70 con 0x7f5c400c6e20 2023-07-27T20:33:45.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.923+0000 7f5c4499c700 1 --2- 172.21.15.72:0/3050315132 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c400c77c0 0x7f5c400bf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:33:45.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.923+0000 7f5c3f7fe700 1 --2- 172.21.15.72:0/3050315132 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c400c6e20 0x7f5c401ecdc0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f5c3400c490 tx=0x7f5c3400c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:45.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.923+0000 7f5c3cff9700 1 -- 172.21.15.72:0/3050315132 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c340052d0 con 0x7f5c400c6e20 2023-07-27T20:33:45.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.923+0000 7f5c3cff9700 1 -- 172.21.15.72:0/3050315132 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c34005450 con 0x7f5c400c6e20 2023-07-27T20:33:45.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.923+0000 7f5c463ff700 1 -- 172.21.15.72:0/3050315132 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c400c1b90 con 0x7f5c400c6e20 2023-07-27T20:33:45.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.923+0000 7f5c3cff9700 1 -- 172.21.15.72:0/3050315132 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c340038c0 con 0x7f5c400c6e20 2023-07-27T20:33:45.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.923+0000 7f5c463ff700 1 -- 172.21.15.72:0/3050315132 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c400bd170 con 0x7f5c400c6e20 2023-07-27T20:33:45.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.924+0000 7f5c463ff700 1 -- 172.21.15.72:0/3050315132 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c40154a40 con 0x7f5c400c6e20 2023-07-27T20:33:45.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.925+0000 7f5c3cff9700 1 -- 172.21.15.72:0/3050315132 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5c34003a20 con 0x7f5c400c6e20 2023-07-27T20:33:45.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.926+0000 7f5c3cff9700 1 --2- 172.21.15.72:0/3050315132 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5c2c06ace0 0x7f5c2c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:45.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.927+0000 7f5c3cff9700 1 -- 172.21.15.72:0/3050315132 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f5c34088de0 con 0x7f5c400c6e20 2023-07-27T20:33:45.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.927+0000 7f5c3ffff700 1 --2- 172.21.15.72:0/3050315132 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5c2c06ace0 0x7f5c2c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:45.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.928+0000 7f5c3ffff700 1 --2- 172.21.15.72:0/3050315132 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5c2c06ace0 0x7f5c2c06d1a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5c30007fd0 tx=0x7f5c30007dd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:45.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:45.931+0000 7f5c3cff9700 1 -- 172.21.15.72:0/3050315132 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5c40154a40 con 0x7f5c400c6e20 2023-07-27T20:33:46.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.127+0000 7f5c463ff700 1 -- 172.21.15.72:0/3050315132 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5c40154a40 con 0x7f5c400c6e20 2023-07-27T20:33:46.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.127+0000 7f5c3cff9700 1 -- 172.21.15.72:0/3050315132 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5c34017020 con 0x7f5c400c6e20 2023-07-27T20:33:46.116 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-27T20:33:46.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.129+0000 7f5c463ff700 1 -- 172.21.15.72:0/3050315132 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5c2c06ace0 msgr2=0x7f5c2c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:46.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.129+0000 7f5c463ff700 1 --2- 172.21.15.72:0/3050315132 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5c2c06ace0 0x7f5c2c06d1a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5c30007fd0 tx=0x7f5c30007dd0 comp rx=0 tx=0).stop 2023-07-27T20:33:46.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.129+0000 7f5c463ff700 1 -- 172.21.15.72:0/3050315132 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c400c6e20 msgr2=0x7f5c401ecdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:46.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.129+0000 7f5c463ff700 1 --2- 172.21.15.72:0/3050315132 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c400c6e20 0x7f5c401ecdc0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f5c3400c490 tx=0x7f5c3400c7a0 comp rx=0 tx=0).stop 2023-07-27T20:33:46.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.129+0000 7f5c463ff700 1 -- 172.21.15.72:0/3050315132 shutdown_connections 2023-07-27T20:33:46.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.129+0000 7f5c463ff700 1 --2- 172.21.15.72:0/3050315132 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c400c77c0 0x7f5c400bf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:46.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.129+0000 7f5c463ff700 1 --2- 172.21.15.72:0/3050315132 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5c2c06ace0 0x7f5c2c06d1a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:46.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.129+0000 7f5c463ff700 1 --2- 172.21.15.72:0/3050315132 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5c4006ffc0 0x7f5c401e8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:46.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.129+0000 7f5c463ff700 1 --2- 172.21.15.72:0/3050315132 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c400c6e20 0x7f5c401ecdc0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:46.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.129+0000 7f5c463ff700 1 -- 172.21.15.72:0/3050315132 >> 172.21.15.72:0/3050315132 conn(0x7f5c4006a190 msgr2=0x7f5c4006bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:46.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.129+0000 7f5c463ff700 1 -- 172.21.15.72:0/3050315132 shutdown_connections 2023-07-27T20:33:46.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.130+0000 7f5c463ff700 1 -- 172.21.15.72:0/3050315132 wait complete. 2023-07-27T20:33:46.136 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-07-27T20:33:46.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.351+0000 7f43595ff700 1 Processor -- start 2023-07-27T20:33:46.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.352+0000 7f43595ff700 1 -- start start 2023-07-27T20:33:46.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.353+0000 7f43595ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f435414aab0 0x7f4354154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:46.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.353+0000 7f43595ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f435406c1d0 0x7f435406c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:46.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.353+0000 7f43595ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43540c7c50 con 0x7f43540c7740 2023-07-27T20:33:46.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.353+0000 7f43595ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f435406bd40 con 0x7f435406c1d0 2023-07-27T20:33:46.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.353+0000 7f43595ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43540c62f0 con 0x7f435414aab0 2023-07-27T20:33:46.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.353+0000 7f43527fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f43540c7740 0x7f43540c41c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57868/0 (socket says 172.21.15.72:57868) 2023-07-27T20:33:46.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.353+0000 7f43527fc700 1 -- 172.21.15.72:0/1722334577 learned_addr learned my addr 172.21.15.72:0/1722334577 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:46.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.353+0000 7f43537fe700 1 --2- 172.21.15.72:0/1722334577 >> v2:172.21.15.173:3300/0 conn(0x7f435406c1d0 0x7f435406c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:46.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.353+0000 7f4352ffd700 1 --2- 172.21.15.72:0/1722334577 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f435414aab0 0x7f4354154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:46.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.353+0000 7f4351ffb700 1 -- 172.21.15.72:0/1722334577 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1684765780 0 0) 0x7f43540c7c50 con 0x7f43540c7740 2023-07-27T20:33:46.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.353+0000 7f4351ffb700 1 -- 172.21.15.72:0/1722334577 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f433c0035b0 con 0x7f43540c7740 2023-07-27T20:33:46.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.354+0000 7f4351ffb700 1 -- 172.21.15.72:0/1722334577 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3764138449 0 0) 0x7f433c0035b0 con 0x7f43540c7740 2023-07-27T20:33:46.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.354+0000 7f4352ffd700 1 -- 172.21.15.72:0/1722334577 >> v2:172.21.15.173:3300/0 conn(0x7f435406c1d0 msgr2=0x7f435406c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:46.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.354+0000 7f4352ffd700 1 --2- 172.21.15.72:0/1722334577 >> v2:172.21.15.173:3300/0 conn(0x7f435406c1d0 0x7f435406c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:46.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.354+0000 7f4352ffd700 1 -- 172.21.15.72:0/1722334577 >> v1:172.21.15.72:6789/0 conn(0x7f43540c7740 legacy=0x7f43540c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:46.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.354+0000 7f4352ffd700 1 -- 172.21.15.72:0/1722334577 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4354155050 con 0x7f435414aab0 2023-07-27T20:33:46.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.354+0000 7f43537fe700 1 --2- 172.21.15.72:0/1722334577 >> v2:172.21.15.173:3300/0 conn(0x7f435406c1d0 0x7f435406c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:33:46.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.354+0000 7f4352ffd700 1 --2- 172.21.15.72:0/1722334577 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f435414aab0 0x7f4354154b10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4344009840 tx=0x7f4344009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7e2c26411091ce6 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:46.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.354+0000 7f4351ffb700 1 -- 172.21.15.72:0/1722334577 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4348001670 con 0x7f435414aab0 2023-07-27T20:33:46.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.354+0000 7f4351ffb700 1 -- 172.21.15.72:0/1722334577 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4344004030 con 0x7f435414aab0 2023-07-27T20:33:46.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.354+0000 7f4351ffb700 1 -- 172.21.15.72:0/1722334577 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43440043c0 con 0x7f435414aab0 2023-07-27T20:33:46.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.355+0000 7f43595ff700 1 -- 172.21.15.72:0/1722334577 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f435414aab0 msgr2=0x7f4354154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:46.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.355+0000 7f43595ff700 1 --2- 172.21.15.72:0/1722334577 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f435414aab0 0x7f4354154b10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4344009840 tx=0x7f4344009b50 comp rx=0 tx=0).stop 2023-07-27T20:33:46.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.355+0000 7f43595ff700 1 -- 172.21.15.72:0/1722334577 shutdown_connections 2023-07-27T20:33:46.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.355+0000 7f43595ff700 1 --2- 172.21.15.72:0/1722334577 >> v2:172.21.15.173:3300/0 conn(0x7f435406c1d0 0x7f435406c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:46.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.355+0000 7f43595ff700 1 --2- 172.21.15.72:0/1722334577 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f435414aab0 0x7f4354154b10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:46.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.355+0000 7f43595ff700 1 -- 172.21.15.72:0/1722334577 >> 172.21.15.72:0/1722334577 conn(0x7f43540ab3f0 msgr2=0x7f43540ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:46.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.355+0000 7f43595ff700 1 -- 172.21.15.72:0/1722334577 shutdown_connections 2023-07-27T20:33:46.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.355+0000 7f43595ff700 1 -- 172.21.15.72:0/1722334577 wait complete. 2023-07-27T20:33:46.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.357+0000 7f43595ff700 1 Processor -- start 2023-07-27T20:33:46.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.357+0000 7f43595ff700 1 -- start start 2023-07-27T20:33:46.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.358+0000 7f43595ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f435406c1d0 0x7f43540c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:46.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.358+0000 7f43595ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f43540c7740 0x7f43541e9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:46.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.358+0000 7f43595ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f435414aab0 0x7f43540c7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:46.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.358+0000 7f43595ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43541ec8c0 con 0x7f435406c1d0 2023-07-27T20:33:46.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.358+0000 7f43595ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43541ecba0 con 0x7f435414aab0 2023-07-27T20:33:46.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.358+0000 7f43595ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435414b080 con 0x7f43540c7740 2023-07-27T20:33:46.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.358+0000 7f4352ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f435406c1d0 0x7f43540c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:46.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.358+0000 7f4352ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f435406c1d0 0x7f43540c8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38542/0 (socket says 172.21.15.72:38542) 2023-07-27T20:33:46.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.358+0000 7f4352ffd700 1 -- 172.21.15.72:0/1645686618 learned_addr learned my addr 172.21.15.72:0/1645686618 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:46.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.358+0000 7f43537fe700 1 --2- 172.21.15.72:0/1645686618 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f435414aab0 0x7f43540c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:46.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.358+0000 7f43527fc700 1 --2- 172.21.15.72:0/1645686618 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f43540c7740 0x7f43541e9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:46.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.358+0000 7f4352ffd700 1 -- 172.21.15.72:0/1645686618 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f43540c7740 msgr2=0x7f43541e9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:46.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.358+0000 7f4352ffd700 1 --2- 172.21.15.72:0/1645686618 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f43540c7740 0x7f43541e9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:46.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.358+0000 7f4352ffd700 1 -- 172.21.15.72:0/1645686618 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f435414aab0 msgr2=0x7f43540c7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:46.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.358+0000 7f4352ffd700 1 --2- 172.21.15.72:0/1645686618 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f435414aab0 0x7f43540c7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:46.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.358+0000 7f4352ffd700 1 -- 172.21.15.72:0/1645686618 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f434c009a70 con 0x7f435406c1d0 2023-07-27T20:33:46.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.358+0000 7f43537fe700 1 --2- 172.21.15.72:0/1645686618 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f435414aab0 0x7f43540c7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:33:46.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.358+0000 7f43527fc700 1 --2- 172.21.15.72:0/1645686618 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f43540c7740 0x7f43541e9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:33:46.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.358+0000 7f4352ffd700 1 --2- 172.21.15.72:0/1645686618 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f435406c1d0 0x7f43540c8f10 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f43440090b0 tx=0x7f4344004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:46.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.359+0000 7f433b7fe700 1 -- 172.21.15.72:0/1645686618 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4344003c00 con 0x7f435406c1d0 2023-07-27T20:33:46.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.359+0000 7f433b7fe700 1 -- 172.21.15.72:0/1645686618 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434401f070 con 0x7f435406c1d0 2023-07-27T20:33:46.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.359+0000 7f43595ff700 1 -- 172.21.15.72:0/1645686618 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43440094a0 con 0x7f435406c1d0 2023-07-27T20:33:46.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.359+0000 7f433b7fe700 1 -- 172.21.15.72:0/1645686618 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4344011630 con 0x7f435406c1d0 2023-07-27T20:33:46.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.359+0000 7f43595ff700 1 -- 172.21.15.72:0/1645686618 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f435414b600 con 0x7f435406c1d0 2023-07-27T20:33:46.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.360+0000 7f43595ff700 1 -- 172.21.15.72:0/1645686618 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f435404e470 con 0x7f435406c1d0 2023-07-27T20:33:46.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.361+0000 7f433b7fe700 1 -- 172.21.15.72:0/1645686618 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4344021030 con 0x7f435406c1d0 2023-07-27T20:33:46.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.362+0000 7f433b7fe700 1 --2- 172.21.15.72:0/1645686618 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f434006ace0 0x7f434006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:46.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.362+0000 7f433b7fe700 1 -- 172.21.15.72:0/1645686618 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f434408ac10 con 0x7f435406c1d0 2023-07-27T20:33:46.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.362+0000 7f43527fc700 1 --2- 172.21.15.72:0/1645686618 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f434006ace0 0x7f434006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:46.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.363+0000 7f43527fc700 1 --2- 172.21.15.72:0/1645686618 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f434006ace0 0x7f434006d1a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4348001eb0 tx=0x7f4348001d80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:46.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.366+0000 7f433b7fe700 1 -- 172.21.15.72:0/1645686618 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f43440559a0 con 0x7f435406c1d0 2023-07-27T20:33:46.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.562+0000 7f43595ff700 1 -- 172.21.15.72:0/1645686618 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f435406cf00 con 0x7f435406c1d0 2023-07-27T20:33:46.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.562+0000 7f433b7fe700 1 -- 172.21.15.72:0/1645686618 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v47) v1 ==== 105+0+11 (secure 0 0 0) 0x7f4344058fc0 con 0x7f435406c1d0 2023-07-27T20:33:46.551 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:33:46.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.564+0000 7f43595ff700 1 -- 172.21.15.72:0/1645686618 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f434006ace0 msgr2=0x7f434006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:46.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.564+0000 7f43595ff700 1 --2- 172.21.15.72:0/1645686618 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f434006ace0 0x7f434006d1a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4348001eb0 tx=0x7f4348001d80 comp rx=0 tx=0).stop 2023-07-27T20:33:46.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.564+0000 7f43595ff700 1 -- 172.21.15.72:0/1645686618 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f435406c1d0 msgr2=0x7f43540c8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:46.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.564+0000 7f43595ff700 1 --2- 172.21.15.72:0/1645686618 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f435406c1d0 0x7f43540c8f10 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f43440090b0 tx=0x7f4344004750 comp rx=0 tx=0).stop 2023-07-27T20:33:46.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.564+0000 7f43595ff700 1 -- 172.21.15.72:0/1645686618 shutdown_connections 2023-07-27T20:33:46.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.564+0000 7f43595ff700 1 --2- 172.21.15.72:0/1645686618 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f435414aab0 0x7f43540c7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:46.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.564+0000 7f43595ff700 1 --2- 172.21.15.72:0/1645686618 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f435406c1d0 0x7f43540c8f10 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:46.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.564+0000 7f43595ff700 1 --2- 172.21.15.72:0/1645686618 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f434006ace0 0x7f434006d1a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:46.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.564+0000 7f43595ff700 1 --2- 172.21.15.72:0/1645686618 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f43540c7740 0x7f43541e9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:46.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.564+0000 7f43595ff700 1 -- 172.21.15.72:0/1645686618 >> 172.21.15.72:0/1645686618 conn(0x7f43540ab3f0 msgr2=0x7f43540c40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:46.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.565+0000 7f43595ff700 1 -- 172.21.15.72:0/1645686618 shutdown_connections 2023-07-27T20:33:46.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.565+0000 7f43595ff700 1 -- 172.21.15.72:0/1645686618 wait complete. 2023-07-27T20:33:46.572 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-07-27T20:33:46.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.784+0000 7fa75a7ff700 1 Processor -- start 2023-07-27T20:33:46.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.784+0000 7fa75a7ff700 1 -- start start 2023-07-27T20:33:46.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.785+0000 7fa75a7ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa7540c12f0 0x7fa7541516c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:46.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.785+0000 7fa75a7ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa7540716f0 0x7fa754071b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:46.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.785+0000 7fa75a7ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa754154f50 con 0x7fa7541475a0 2023-07-27T20:33:46.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.785+0000 7fa75a7ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa754151c00 con 0x7fa7540c12f0 2023-07-27T20:33:46.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.785+0000 7fa75a7ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa754154340 con 0x7fa7540716f0 2023-07-27T20:33:46.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.785+0000 7fa7537fe700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa7540c12f0 0x7fa7541516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:46.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.785+0000 7fa758d9c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa7540716f0 0x7fa754071b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:46.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.786+0000 7fa758d9c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa7540716f0 0x7fa754071b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.72:38518/0 (socket says 172.21.15.72:38518) 2023-07-27T20:33:46.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.786+0000 7fa7537fe700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa7540c12f0 0x7fa7541516c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.72:41424/0 (socket says 172.21.15.72:41424) 2023-07-27T20:33:46.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.786+0000 7fa758d9c700 1 -- 172.21.15.72:0/1734995543 learned_addr learned my addr 172.21.15.72:0/1734995543 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:46.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.786+0000 7fa753fff700 1 --1- 172.21.15.72:0/1734995543 >> v1:172.21.15.173:6789/0 conn(0x7fa7541475a0 0x7fa7540c1d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.72:47746/0 (socket says 172.21.15.72:47746) 2023-07-27T20:33:46.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.786+0000 7fa758d9c700 1 -- 172.21.15.72:0/1734995543 >> v2:172.21.15.173:3300/0 conn(0x7fa7540c12f0 msgr2=0x7fa7541516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:46.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.786+0000 7fa758d9c700 1 --2- 172.21.15.72:0/1734995543 >> v2:172.21.15.173:3300/0 conn(0x7fa7540c12f0 0x7fa7541516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:46.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.786+0000 7fa758d9c700 1 -- 172.21.15.72:0/1734995543 >> v1:172.21.15.173:6789/0 conn(0x7fa7541475a0 legacy=0x7fa7540c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:46.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.786+0000 7fa758d9c700 1 -- 172.21.15.72:0/1734995543 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa754154620 con 0x7fa7540716f0 2023-07-27T20:33:46.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.786+0000 7fa7537fe700 1 --2- 172.21.15.72:0/1734995543 >> v2:172.21.15.173:3300/0 conn(0x7fa7540c12f0 0x7fa7541516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:33:46.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.786+0000 7fa752ffd700 1 -- 172.21.15.72:0/1734995543 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2490738354 0 0) 0x7fa754154f50 con 0x7fa7541475a0 2023-07-27T20:33:46.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.786+0000 7fa758d9c700 1 --2- 172.21.15.72:0/1734995543 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa7540716f0 0x7fa754071b40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa74c009e50 tx=0x7fa74c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3235d3210e99a157 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:46.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.787+0000 7fa752ffd700 1 -- 172.21.15.72:0/1734995543 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c00e070 con 0x7fa7540716f0 2023-07-27T20:33:46.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.787+0000 7fa752ffd700 1 -- 172.21.15.72:0/1734995543 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74c00b910 con 0x7fa7540716f0 2023-07-27T20:33:46.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.787+0000 7fa752ffd700 1 -- 172.21.15.72:0/1734995543 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c00bcc0 con 0x7fa7540716f0 2023-07-27T20:33:46.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.787+0000 7fa75a7ff700 1 -- 172.21.15.72:0/1734995543 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa7540716f0 msgr2=0x7fa754071b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:46.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.787+0000 7fa75a7ff700 1 --2- 172.21.15.72:0/1734995543 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa7540716f0 0x7fa754071b40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa74c009e50 tx=0x7fa74c00b330 comp rx=0 tx=0).stop 2023-07-27T20:33:46.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.787+0000 7fa75a7ff700 1 -- 172.21.15.72:0/1734995543 shutdown_connections 2023-07-27T20:33:46.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.787+0000 7fa75a7ff700 1 --2- 172.21.15.72:0/1734995543 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa7540716f0 0x7fa754071b40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:46.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.787+0000 7fa75a7ff700 1 --2- 172.21.15.72:0/1734995543 >> v2:172.21.15.173:3300/0 conn(0x7fa7540c12f0 0x7fa7541516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:46.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.787+0000 7fa75a7ff700 1 -- 172.21.15.72:0/1734995543 >> 172.21.15.72:0/1734995543 conn(0x7fa75406a190 msgr2=0x7fa75406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:46.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.787+0000 7fa75a7ff700 1 -- 172.21.15.72:0/1734995543 shutdown_connections 2023-07-27T20:33:46.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.787+0000 7fa75a7ff700 1 -- 172.21.15.72:0/1734995543 wait complete. 2023-07-27T20:33:46.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.789+0000 7fa75a7ff700 1 Processor -- start 2023-07-27T20:33:46.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.789+0000 7fa75a7ff700 1 -- start start 2023-07-27T20:33:46.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.790+0000 7fa75a7ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa7540716f0 0x7fa75406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:46.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.790+0000 7fa75a7ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7540c12f0 0x7fa75413ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:46.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.790+0000 7fa75a7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7541475a0 0x7fa7540ba9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:46.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.790+0000 7fa75a7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7540ba5b0 con 0x7fa7541475a0 2023-07-27T20:33:46.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.790+0000 7fa75a7ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7540c4360 con 0x7fa7540c12f0 2023-07-27T20:33:46.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.790+0000 7fa75a7ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7540c3a10 con 0x7fa7540716f0 2023-07-27T20:33:46.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.790+0000 7fa758d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7541475a0 0x7fa7540ba9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:46.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.790+0000 7fa758d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7541475a0 0x7fa7540ba9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38546/0 (socket says 172.21.15.72:38546) 2023-07-27T20:33:46.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.790+0000 7fa758d9c700 1 -- 172.21.15.72:0/3692401445 learned_addr learned my addr 172.21.15.72:0/3692401445 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:46.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.791+0000 7fa753fff700 1 --2- 172.21.15.72:0/3692401445 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa7540716f0 0x7fa75406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:46.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.791+0000 7fa7537fe700 1 --2- 172.21.15.72:0/3692401445 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7540c12f0 0x7fa75413ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:46.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.791+0000 7fa758d9c700 1 -- 172.21.15.72:0/3692401445 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa7540716f0 msgr2=0x7fa75406d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:46.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.791+0000 7fa758d9c700 1 --2- 172.21.15.72:0/3692401445 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa7540716f0 0x7fa75406d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:46.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.791+0000 7fa758d9c700 1 -- 172.21.15.72:0/3692401445 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7540c12f0 msgr2=0x7fa75413ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:46.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.791+0000 7fa758d9c700 1 --2- 172.21.15.72:0/3692401445 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7540c12f0 0x7fa75413ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:46.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.791+0000 7fa758d9c700 1 -- 172.21.15.72:0/3692401445 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7480094a0 con 0x7fa7541475a0 2023-07-27T20:33:46.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.791+0000 7fa758d9c700 1 --2- 172.21.15.72:0/3692401445 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7541475a0 0x7fa7540ba9d0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa74c004270 tx=0x7fa74c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:46.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.791+0000 7fa750ff9700 1 -- 172.21.15.72:0/3692401445 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c0099b0 con 0x7fa7541475a0 2023-07-27T20:33:46.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.791+0000 7fa750ff9700 1 -- 172.21.15.72:0/3692401445 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74c0092e0 con 0x7fa7541475a0 2023-07-27T20:33:46.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.791+0000 7fa75a7ff700 1 -- 172.21.15.72:0/3692401445 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa74c009b30 con 0x7fa7541475a0 2023-07-27T20:33:46.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.791+0000 7fa750ff9700 1 -- 172.21.15.72:0/3692401445 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c01b650 con 0x7fa7541475a0 2023-07-27T20:33:46.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.791+0000 7fa75a7ff700 1 -- 172.21.15.72:0/3692401445 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7541eb850 con 0x7fa7541475a0 2023-07-27T20:33:46.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.792+0000 7fa75a7ff700 1 -- 172.21.15.72:0/3692401445 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa754070900 con 0x7fa7541475a0 2023-07-27T20:33:46.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.793+0000 7fa750ff9700 1 -- 172.21.15.72:0/3692401445 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa74c01b7b0 con 0x7fa7541475a0 2023-07-27T20:33:46.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.794+0000 7fa750ff9700 1 --2- 172.21.15.72:0/3692401445 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa74006ace0 0x7fa74006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:46.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.794+0000 7fa750ff9700 1 -- 172.21.15.72:0/3692401445 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7fa74c08b300 con 0x7fa7541475a0 2023-07-27T20:33:46.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.795+0000 7fa753fff700 1 --2- 172.21.15.72:0/3692401445 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa74006ace0 0x7fa74006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:46.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.796+0000 7fa753fff700 1 --2- 172.21.15.72:0/3692401445 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa74006ace0 0x7fa74006d1a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa744000f60 tx=0x7fa744007c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:46.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.799+0000 7fa750ff9700 1 -- 172.21.15.72:0/3692401445 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa74c055ef0 con 0x7fa7541475a0 2023-07-27T20:33:46.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.993+0000 7fa75a7ff700 1 -- 172.21.15.72:0/3692401445 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fa7540ba6f0 con 0x7fa7541475a0 2023-07-27T20:33:46.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.993+0000 7fa750ff9700 1 -- 172.21.15.72:0/3692401445 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v47) v1 ==== 101+0+11 (secure 0 0 0) 0x7fa7540ba6f0 con 0x7fa7541475a0 2023-07-27T20:33:46.982 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-27T20:33:46.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.996+0000 7fa75a7ff700 1 -- 172.21.15.72:0/3692401445 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa74006ace0 msgr2=0x7fa74006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:46.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.996+0000 7fa75a7ff700 1 --2- 172.21.15.72:0/3692401445 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa74006ace0 0x7fa74006d1a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa744000f60 tx=0x7fa744007c00 comp rx=0 tx=0).stop 2023-07-27T20:33:46.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.996+0000 7fa75a7ff700 1 -- 172.21.15.72:0/3692401445 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7541475a0 msgr2=0x7fa7540ba9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:46.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.996+0000 7fa75a7ff700 1 --2- 172.21.15.72:0/3692401445 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7541475a0 0x7fa7540ba9d0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa74c004270 tx=0x7fa74c004ad0 comp rx=0 tx=0).stop 2023-07-27T20:33:46.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.996+0000 7fa75a7ff700 1 -- 172.21.15.72:0/3692401445 shutdown_connections 2023-07-27T20:33:46.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.996+0000 7fa75a7ff700 1 --2- 172.21.15.72:0/3692401445 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7541475a0 0x7fa7540ba9d0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:46.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.996+0000 7fa75a7ff700 1 --2- 172.21.15.72:0/3692401445 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa74006ace0 0x7fa74006d1a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:46.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.996+0000 7fa75a7ff700 1 --2- 172.21.15.72:0/3692401445 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa7540716f0 0x7fa75406d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:46.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.996+0000 7fa75a7ff700 1 --2- 172.21.15.72:0/3692401445 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7540c12f0 0x7fa75413ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:46.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.996+0000 7fa75a7ff700 1 -- 172.21.15.72:0/3692401445 >> 172.21.15.72:0/3692401445 conn(0x7fa75406a190 msgr2=0x7fa7541dc6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:46.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.996+0000 7fa75a7ff700 1 -- 172.21.15.72:0/3692401445 shutdown_connections 2023-07-27T20:33:46.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:46.996+0000 7fa75a7ff700 1 -- 172.21.15.72:0/3692401445 wait complete. 2023-07-27T20:33:47.002 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-27T20:33:47.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.211+0000 7f6a213ff700 1 Processor -- start 2023-07-27T20:33:47.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.211+0000 7f6a213ff700 1 -- start start 2023-07-27T20:33:47.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.212+0000 7f6a213ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6a1c13b2c0 0x7f6a1c0aa420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:47.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.212+0000 7f6a213ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6a1c0bfd90 0x7f6a1c0aa960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:47.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.212+0000 7f6a213ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6a1c0a83a0 0x7f6a1c0a8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:47.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.212+0000 7f6a213ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a1c0a9620 con 0x7f6a1c13b2c0 2023-07-27T20:33:47.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.212+0000 7f6a213ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a1c0aaea0 con 0x7f6a1c0a83a0 2023-07-27T20:33:47.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.212+0000 7f6a213ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c155600 con 0x7f6a1c0bfd90 2023-07-27T20:33:47.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.212+0000 7f6a1affd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6a1c13b2c0 0x7f6a1c0aa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:47.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.212+0000 7f6a1affd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6a1c13b2c0 0x7f6a1c0aa420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38554/0 (socket says 172.21.15.72:38554) 2023-07-27T20:33:47.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.212+0000 7f6a1affd700 1 -- 172.21.15.72:0/3420331553 learned_addr learned my addr 172.21.15.72:0/3420331553 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:47.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.212+0000 7f6a1a7fc700 1 --2- 172.21.15.72:0/3420331553 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6a1c0bfd90 0x7f6a1c0aa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:47.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.212+0000 7f6a1b7fe700 1 --2- 172.21.15.72:0/3420331553 >> v2:172.21.15.173:3300/0 conn(0x7f6a1c0a83a0 0x7f6a1c0a8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:47.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.213+0000 7f6a1affd700 1 -- 172.21.15.72:0/3420331553 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6a1c0bfd90 msgr2=0x7f6a1c0aa960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:47.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.213+0000 7f6a1affd700 1 --2- 172.21.15.72:0/3420331553 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6a1c0bfd90 0x7f6a1c0aa960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:47.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.213+0000 7f6a1affd700 1 -- 172.21.15.72:0/3420331553 >> v2:172.21.15.173:3300/0 conn(0x7f6a1c0a83a0 msgr2=0x7f6a1c0a8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:47.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.213+0000 7f6a1affd700 1 --2- 172.21.15.72:0/3420331553 >> v2:172.21.15.173:3300/0 conn(0x7f6a1c0a83a0 0x7f6a1c0a8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:47.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.213+0000 7f6a1affd700 1 -- 172.21.15.72:0/3420331553 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1c155320 con 0x7f6a1c13b2c0 2023-07-27T20:33:47.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.213+0000 7f6a1affd700 1 --2- 172.21.15.72:0/3420331553 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a1c13b2c0 0x7f6a1c0aa420 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c14f940 tx=0x7f6a0c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55ed520c47977bda server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:47.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.213+0000 7f6a19ffb700 1 -- 172.21.15.72:0/3420331553 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0c011830 con 0x7f6a1c13b2c0 2023-07-27T20:33:47.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.213+0000 7f6a19ffb700 1 -- 172.21.15.72:0/3420331553 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0c011990 con 0x7f6a1c13b2c0 2023-07-27T20:33:47.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.213+0000 7f6a19ffb700 1 -- 172.21.15.72:0/3420331553 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0c011d20 con 0x7f6a1c13b2c0 2023-07-27T20:33:47.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.214+0000 7f6a213ff700 1 -- 172.21.15.72:0/3420331553 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a1c13b2c0 msgr2=0x7f6a1c0aa420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:47.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.214+0000 7f6a213ff700 1 --2- 172.21.15.72:0/3420331553 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a1c13b2c0 0x7f6a1c0aa420 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c14f940 tx=0x7f6a0c009bd0 comp rx=0 tx=0).stop 2023-07-27T20:33:47.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.214+0000 7f6a213ff700 1 -- 172.21.15.72:0/3420331553 shutdown_connections 2023-07-27T20:33:47.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.214+0000 7f6a213ff700 1 --2- 172.21.15.72:0/3420331553 >> v2:172.21.15.173:3300/0 conn(0x7f6a1c0a83a0 0x7f6a1c0a8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:47.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.214+0000 7f6a213ff700 1 --2- 172.21.15.72:0/3420331553 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a1c13b2c0 0x7f6a1c0aa420 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:47.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.214+0000 7f6a213ff700 1 --2- 172.21.15.72:0/3420331553 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6a1c0bfd90 0x7f6a1c0aa960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:47.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.214+0000 7f6a213ff700 1 -- 172.21.15.72:0/3420331553 >> 172.21.15.72:0/3420331553 conn(0x7f6a1c06a190 msgr2=0x7f6a1c06a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:47.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.214+0000 7f6a213ff700 1 -- 172.21.15.72:0/3420331553 shutdown_connections 2023-07-27T20:33:47.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.214+0000 7f6a213ff700 1 -- 172.21.15.72:0/3420331553 wait complete. 2023-07-27T20:33:47.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.216+0000 7f6a213ff700 1 Processor -- start 2023-07-27T20:33:47.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.216+0000 7f6a213ff700 1 -- start start 2023-07-27T20:33:47.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.217+0000 7f6a213ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6a1c0a83a0 0x7f6a1c0c2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:47.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.217+0000 7f6a213ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a1c0bfd90 0x7f6a1c1ed950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:47.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.217+0000 7f6a213ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a1c13b2c0 0x7f6a1c0c3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:47.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.217+0000 7f6a213ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c1ed4c0 con 0x7f6a1c0bfd90 2023-07-27T20:33:47.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.217+0000 7f6a213ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c1ede90 con 0x7f6a1c13b2c0 2023-07-27T20:33:47.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.217+0000 7f6a213ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c0c3bb0 con 0x7f6a1c0a83a0 2023-07-27T20:33:47.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.217+0000 7f6a1a7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a1c0bfd90 0x7f6a1c1ed950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:47.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.217+0000 7f6a1a7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a1c0bfd90 0x7f6a1c1ed950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38562/0 (socket says 172.21.15.72:38562) 2023-07-27T20:33:47.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.217+0000 7f6a1a7fc700 1 -- 172.21.15.72:0/565532416 learned_addr learned my addr 172.21.15.72:0/565532416 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:47.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.217+0000 7f6a1affd700 1 --2- 172.21.15.72:0/565532416 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6a1c0a83a0 0x7f6a1c0c2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:47.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.217+0000 7f6a1b7fe700 1 --2- 172.21.15.72:0/565532416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a1c13b2c0 0x7f6a1c0c3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:47.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.217+0000 7f6a1a7fc700 1 -- 172.21.15.72:0/565532416 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6a1c0a83a0 msgr2=0x7f6a1c0c2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:47.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.217+0000 7f6a1a7fc700 1 --2- 172.21.15.72:0/565532416 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6a1c0a83a0 0x7f6a1c0c2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:47.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.217+0000 7f6a1a7fc700 1 -- 172.21.15.72:0/565532416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a1c13b2c0 msgr2=0x7f6a1c0c3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:47.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.217+0000 7f6a1a7fc700 1 --2- 172.21.15.72:0/565532416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a1c13b2c0 0x7f6a1c0c3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:47.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.217+0000 7f6a1a7fc700 1 -- 172.21.15.72:0/565532416 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a0c009550 con 0x7f6a1c0bfd90 2023-07-27T20:33:47.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.218+0000 7f6a1a7fc700 1 --2- 172.21.15.72:0/565532416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a1c0bfd90 0x7f6a1c1ed950 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f6a1000e980 tx=0x7f6a1000ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:47.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.218+0000 7f6a037fe700 1 -- 172.21.15.72:0/565532416 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a10009710 con 0x7f6a1c0bfd90 2023-07-27T20:33:47.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.218+0000 7f6a037fe700 1 -- 172.21.15.72:0/565532416 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1000c690 con 0x7f6a1c0bfd90 2023-07-27T20:33:47.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.218+0000 7f6a037fe700 1 -- 172.21.15.72:0/565532416 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1000ca40 con 0x7f6a1c0bfd90 2023-07-27T20:33:47.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.218+0000 7f6a213ff700 1 -- 172.21.15.72:0/565532416 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a1c151780 con 0x7f6a1c0bfd90 2023-07-27T20:33:47.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.218+0000 7f6a213ff700 1 -- 172.21.15.72:0/565532416 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a1c1ed150 con 0x7f6a1c0bfd90 2023-07-27T20:33:47.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.219+0000 7f6a213ff700 1 -- 172.21.15.72:0/565532416 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a1c1ecfb0 con 0x7f6a1c0bfd90 2023-07-27T20:33:47.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.220+0000 7f6a037fe700 1 -- 172.21.15.72:0/565532416 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6a1000cba0 con 0x7f6a1c0bfd90 2023-07-27T20:33:47.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.221+0000 7f6a037fe700 1 --2- 172.21.15.72:0/565532416 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f6a0806ad10 0x7f6a0806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:47.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.221+0000 7f6a037fe700 1 -- 172.21.15.72:0/565532416 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f6a100898d0 con 0x7f6a1c0bfd90 2023-07-27T20:33:47.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.221+0000 7f6a1affd700 1 --2- 172.21.15.72:0/565532416 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f6a0806ad10 0x7f6a0806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:47.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.222+0000 7f6a1affd700 1 --2- 172.21.15.72:0/565532416 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f6a0806ad10 0x7f6a0806d1d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c014040 tx=0x7f6a0c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:47.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.225+0000 7f6a037fe700 1 -- 172.21.15.72:0/565532416 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6a1c1ecfb0 con 0x7f6a1c0bfd90 2023-07-27T20:33:47.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.436+0000 7f6a213ff700 1 -- 172.21.15.72:0/565532416 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6a1c1ecfb0 con 0x7f6a1c0bfd90 2023-07-27T20:33:47.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.436+0000 7f6a037fe700 1 -- 172.21.15.72:0/565532416 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v47) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6a1c1ecfb0 con 0x7f6a1c0bfd90 2023-07-27T20:33:47.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.438+0000 7f6a213ff700 1 -- 172.21.15.72:0/565532416 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f6a0806ad10 msgr2=0x7f6a0806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:47.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.438+0000 7f6a213ff700 1 --2- 172.21.15.72:0/565532416 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f6a0806ad10 0x7f6a0806d1d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c014040 tx=0x7f6a0c008030 comp rx=0 tx=0).stop 2023-07-27T20:33:47.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.439+0000 7f6a213ff700 1 -- 172.21.15.72:0/565532416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a1c0bfd90 msgr2=0x7f6a1c1ed950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:47.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.439+0000 7f6a213ff700 1 --2- 172.21.15.72:0/565532416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a1c0bfd90 0x7f6a1c1ed950 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f6a1000e980 tx=0x7f6a1000ec90 comp rx=0 tx=0).stop 2023-07-27T20:33:47.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.439+0000 7f6a213ff700 1 -- 172.21.15.72:0/565532416 shutdown_connections 2023-07-27T20:33:47.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.439+0000 7f6a213ff700 1 --2- 172.21.15.72:0/565532416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a1c13b2c0 0x7f6a1c0c3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:47.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.439+0000 7f6a213ff700 1 --2- 172.21.15.72:0/565532416 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f6a0806ad10 0x7f6a0806d1d0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:47.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.439+0000 7f6a213ff700 1 --2- 172.21.15.72:0/565532416 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6a1c0a83a0 0x7f6a1c0c2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:47.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.439+0000 7f6a213ff700 1 --2- 172.21.15.72:0/565532416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a1c0bfd90 0x7f6a1c1ed950 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:47.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.439+0000 7f6a213ff700 1 -- 172.21.15.72:0/565532416 >> 172.21.15.72:0/565532416 conn(0x7f6a1c06a190 msgr2=0x7f6a1c06a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:47.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.439+0000 7f6a213ff700 1 -- 172.21.15.72:0/565532416 shutdown_connections 2023-07-27T20:33:47.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.439+0000 7f6a213ff700 1 -- 172.21.15.72:0/565532416 wait complete. 2023-07-27T20:33:47.429 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-07-27T20:33:47.445 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-27T20:33:47.446 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-27T20:33:47.492 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:33:47.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.740+0000 7fc65e5ff700 1 Processor -- start 2023-07-27T20:33:47.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.740+0000 7fc65e5ff700 1 -- start start 2023-07-27T20:33:47.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.741+0000 7fc65e5ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc658139960 0x7fc6580c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:47.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.741+0000 7fc65e5ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc6581542e0 0x7fc658154710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:47.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.741+0000 7fc65e5ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6580c1810 con 0x7fc658139f80 2023-07-27T20:33:47.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.741+0000 7fc65e5ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6580c0ee0 con 0x7fc658139960 2023-07-27T20:33:47.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.741+0000 7fc65e5ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc658139d40 con 0x7fc6581542e0 2023-07-27T20:33:47.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.742+0000 7fc6577fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc658139f80 0x7fc6580c1e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57870/0 (socket says 172.21.15.72:57870) 2023-07-27T20:33:47.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.742+0000 7fc6577fe700 1 -- 172.21.15.72:0/4086610232 learned_addr learned my addr 172.21.15.72:0/4086610232 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:47.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.742+0000 7fc657fff700 1 --2- 172.21.15.72:0/4086610232 >> v2:172.21.15.72:3300/0 conn(0x7fc658139960 0x7fc6580c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:47.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.742+0000 7fc65cb9c700 1 --2- 172.21.15.72:0/4086610232 >> v2:172.21.15.173:3300/0 conn(0x7fc6581542e0 0x7fc658154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:47.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.742+0000 7fc656ffd700 1 -- 172.21.15.72:0/4086610232 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1033792787 0 0) 0x7fc6580c1810 con 0x7fc658139f80 2023-07-27T20:33:47.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.742+0000 7fc656ffd700 1 -- 172.21.15.72:0/4086610232 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6400035b0 con 0x7fc658139f80 2023-07-27T20:33:47.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.742+0000 7fc657fff700 1 -- 172.21.15.72:0/4086610232 >> v2:172.21.15.173:3300/0 conn(0x7fc6581542e0 msgr2=0x7fc658154710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:47.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.742+0000 7fc657fff700 1 --2- 172.21.15.72:0/4086610232 >> v2:172.21.15.173:3300/0 conn(0x7fc6581542e0 0x7fc658154710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:47.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.742+0000 7fc657fff700 1 -- 172.21.15.72:0/4086610232 >> v1:172.21.15.72:6789/0 conn(0x7fc658139f80 legacy=0x7fc6580c1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:47.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.742+0000 7fc657fff700 1 -- 172.21.15.72:0/4086610232 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc658151060 con 0x7fc658139960 2023-07-27T20:33:47.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.743+0000 7fc657fff700 1 --2- 172.21.15.72:0/4086610232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc658139960 0x7fc6580c12d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc65806e5f0 tx=0x7fc648009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3b1f50b61d8aea server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:47.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.743+0000 7fc656ffd700 1 -- 172.21.15.72:0/4086610232 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc648011830 con 0x7fc658139960 2023-07-27T20:33:47.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.743+0000 7fc656ffd700 1 -- 172.21.15.72:0/4086610232 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc648011990 con 0x7fc658139960 2023-07-27T20:33:47.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.743+0000 7fc656ffd700 1 -- 172.21.15.72:0/4086610232 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc648011d20 con 0x7fc658139960 2023-07-27T20:33:47.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.743+0000 7fc65e5ff700 1 -- 172.21.15.72:0/4086610232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc658139960 msgr2=0x7fc6580c12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:47.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.743+0000 7fc65e5ff700 1 --2- 172.21.15.72:0/4086610232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc658139960 0x7fc6580c12d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc65806e5f0 tx=0x7fc648009b20 comp rx=0 tx=0).stop 2023-07-27T20:33:47.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.743+0000 7fc65e5ff700 1 -- 172.21.15.72:0/4086610232 shutdown_connections 2023-07-27T20:33:47.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.743+0000 7fc65e5ff700 1 --2- 172.21.15.72:0/4086610232 >> v2:172.21.15.173:3300/0 conn(0x7fc6581542e0 0x7fc658154710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:47.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.743+0000 7fc65e5ff700 1 --2- 172.21.15.72:0/4086610232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc658139960 0x7fc6580c12d0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:47.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.743+0000 7fc65e5ff700 1 -- 172.21.15.72:0/4086610232 >> 172.21.15.72:0/4086610232 conn(0x7fc65806a190 msgr2=0x7fc65806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:47.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.743+0000 7fc65e5ff700 1 -- 172.21.15.72:0/4086610232 shutdown_connections 2023-07-27T20:33:47.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.743+0000 7fc65e5ff700 1 -- 172.21.15.72:0/4086610232 wait complete. 2023-07-27T20:33:47.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.745+0000 7fc65e5ff700 1 Processor -- start 2023-07-27T20:33:47.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.745+0000 7fc65e5ff700 1 -- start start 2023-07-27T20:33:47.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.746+0000 7fc65e5ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc658139960 0x7fc658136000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:47.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.746+0000 7fc65e5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc658139f80 0x7fc6581ea610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:47.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.746+0000 7fc65e5ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6581542e0 0x7fc6581ed450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:47.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.746+0000 7fc65e5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6581e9ee0 con 0x7fc658139f80 2023-07-27T20:33:47.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.746+0000 7fc65e5ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc658133d90 con 0x7fc658139960 2023-07-27T20:33:47.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.746+0000 7fc65e5ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6580c2f90 con 0x7fc6581542e0 2023-07-27T20:33:47.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.746+0000 7fc6577fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc658139f80 0x7fc6581ea610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:47.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.746+0000 7fc6577fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc658139f80 0x7fc6581ea610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38568/0 (socket says 172.21.15.72:38568) 2023-07-27T20:33:47.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.746+0000 7fc6577fe700 1 -- 172.21.15.72:0/1603401994 learned_addr learned my addr 172.21.15.72:0/1603401994 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:47.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.746+0000 7fc657fff700 1 --2- 172.21.15.72:0/1603401994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc658139960 0x7fc658136000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:47.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.746+0000 7fc65cb9c700 1 --2- 172.21.15.72:0/1603401994 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6581542e0 0x7fc6581ed450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:47.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.747+0000 7fc6577fe700 1 -- 172.21.15.72:0/1603401994 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6581542e0 msgr2=0x7fc6581ed450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:47.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.747+0000 7fc6577fe700 1 --2- 172.21.15.72:0/1603401994 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6581542e0 0x7fc6581ed450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:47.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.747+0000 7fc6577fe700 1 -- 172.21.15.72:0/1603401994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc658139960 msgr2=0x7fc658136000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:47.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.747+0000 7fc6577fe700 1 --2- 172.21.15.72:0/1603401994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc658139960 0x7fc658136000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:47.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.747+0000 7fc6577fe700 1 -- 172.21.15.72:0/1603401994 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6480094a0 con 0x7fc658139f80 2023-07-27T20:33:47.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.747+0000 7fc65cb9c700 1 --2- 172.21.15.72:0/1603401994 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6581542e0 0x7fc6581ed450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:33:47.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.747+0000 7fc6577fe700 1 --2- 172.21.15.72:0/1603401994 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc658139f80 0x7fc6581ea610 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc64c00c700 tx=0x7fc64c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:47.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.747+0000 7fc654ff9700 1 -- 172.21.15.72:0/1603401994 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c005d70 con 0x7fc658139f80 2023-07-27T20:33:47.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.747+0000 7fc654ff9700 1 -- 172.21.15.72:0/1603401994 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64c0070d0 con 0x7fc658139f80 2023-07-27T20:33:47.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.747+0000 7fc654ff9700 1 -- 172.21.15.72:0/1603401994 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c007460 con 0x7fc658139f80 2023-07-27T20:33:47.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.747+0000 7fc65e5ff700 1 -- 172.21.15.72:0/1603401994 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6580c3270 con 0x7fc658139f80 2023-07-27T20:33:47.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.747+0000 7fc65e5ff700 1 -- 172.21.15.72:0/1603401994 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6581ea0f0 con 0x7fc658139f80 2023-07-27T20:33:47.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.748+0000 7fc65e5ff700 1 -- 172.21.15.72:0/1603401994 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6580c3790 con 0x7fc658139f80 2023-07-27T20:33:47.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.749+0000 7fc654ff9700 1 -- 172.21.15.72:0/1603401994 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc64c0075c0 con 0x7fc658139f80 2023-07-27T20:33:47.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.750+0000 7fc654ff9700 1 --2- 172.21.15.72:0/1603401994 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc64406ace0 0x7fc64406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:47.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.750+0000 7fc654ff9700 1 -- 172.21.15.72:0/1603401994 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7fc64c088fa0 con 0x7fc658139f80 2023-07-27T20:33:47.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.751+0000 7fc657fff700 1 --2- 172.21.15.72:0/1603401994 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc64406ace0 0x7fc64406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:47.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.751+0000 7fc657fff700 1 --2- 172.21.15.72:0/1603401994 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc64406ace0 0x7fc64406d1a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc6480090b0 tx=0x7fc64801c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:47.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.754+0000 7fc654ff9700 1 -- 172.21.15.72:0/1603401994 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc6580c3790 con 0x7fc658139f80 2023-07-27T20:33:47.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.953+0000 7fc65e5ff700 1 -- 172.21.15.72:0/1603401994 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6580c3790 con 0x7fc658139f80 2023-07-27T20:33:47.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.954+0000 7fc654ff9700 1 -- 172.21.15.72:0/1603401994 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+22308 (secure 0 0 0) 0x7fc6580c3790 con 0x7fc658139f80 2023-07-27T20:33:47.943 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:33:47.943 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":47,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:33:23.191066+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:32:58.242890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-27T20:32:59.032110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_metadata","create_time":"2023-07-27T20:33:20.125785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs2_data","create_time":"2023-07-27T20:33:20.647929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2c","mappings":[{"from":0,"to":4}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:33:47.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.957+0000 7fc65e5ff700 1 -- 172.21.15.72:0/1603401994 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc64406ace0 msgr2=0x7fc64406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:47.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.957+0000 7fc65e5ff700 1 --2- 172.21.15.72:0/1603401994 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc64406ace0 0x7fc64406d1a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc6480090b0 tx=0x7fc64801c040 comp rx=0 tx=0).stop 2023-07-27T20:33:47.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.957+0000 7fc65e5ff700 1 -- 172.21.15.72:0/1603401994 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc658139f80 msgr2=0x7fc6581ea610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:47.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.957+0000 7fc65e5ff700 1 --2- 172.21.15.72:0/1603401994 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc658139f80 0x7fc6581ea610 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc64c00c700 tx=0x7fc64c00ca10 comp rx=0 tx=0).stop 2023-07-27T20:33:47.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.957+0000 7fc65e5ff700 1 -- 172.21.15.72:0/1603401994 shutdown_connections 2023-07-27T20:33:47.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.957+0000 7fc65e5ff700 1 --2- 172.21.15.72:0/1603401994 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc64406ace0 0x7fc64406d1a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:47.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.957+0000 7fc65e5ff700 1 --2- 172.21.15.72:0/1603401994 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6581542e0 0x7fc6581ed450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:47.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.957+0000 7fc65e5ff700 1 --2- 172.21.15.72:0/1603401994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc658139960 0x7fc658136000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:47.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.957+0000 7fc65e5ff700 1 --2- 172.21.15.72:0/1603401994 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc658139f80 0x7fc6581ea610 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:47.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.957+0000 7fc65e5ff700 1 -- 172.21.15.72:0/1603401994 >> 172.21.15.72:0/1603401994 conn(0x7fc65806a190 msgr2=0x7fc658137bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:47.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.957+0000 7fc65e5ff700 1 -- 172.21.15.72:0/1603401994 shutdown_connections 2023-07-27T20:33:47.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:47.957+0000 7fc65e5ff700 1 -- 172.21.15.72:0/1603401994 wait complete. 2023-07-27T20:33:47.963 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-27T20:31:14.581785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T20:31:21.077941+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T20:32:58.242890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T20:32:59.032110+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-07-27T20:33:20.125785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs2_data', 'create_time': '2023-07-27T20:33:20.647929+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-27T20:33:47.964 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-27T20:33:48.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.174+0000 7f66f17ff700 1 Processor -- start 2023-07-27T20:33:48.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.174+0000 7f66f17ff700 1 -- start start 2023-07-27T20:33:48.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.175+0000 7f66f17ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f66ec14aab0 0x7f66ec154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:48.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.176+0000 7f66f17ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66ec0c7c50 con 0x7f66ec06c1d0 2023-07-27T20:33:48.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.176+0000 7f66f17ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66ec06bd40 con 0x7f66ec0c7740 2023-07-27T20:33:48.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.176+0000 7f66f17ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec06cd50 con 0x7f66ec14aab0 2023-07-27T20:33:48.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.176+0000 7f66eb7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f66ec06c1d0 0x7f66ec06c640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57876/0 (socket says 172.21.15.72:57876) 2023-07-27T20:33:48.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.176+0000 7f66eb7fe700 1 -- 172.21.15.72:0/621515761 learned_addr learned my addr 172.21.15.72:0/621515761 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:48.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.176+0000 7f66eaffd700 1 --2- 172.21.15.72:0/621515761 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f66ec14aab0 0x7f66ec154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:48.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.176+0000 7f66ea7fc700 1 -- 172.21.15.72:0/621515761 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4124706946 0 0) 0x7f66ec0c7c50 con 0x7f66ec06c1d0 2023-07-27T20:33:48.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.176+0000 7f66ea7fc700 1 -- 172.21.15.72:0/621515761 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66d80035b0 con 0x7f66ec06c1d0 2023-07-27T20:33:48.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.177+0000 7f66eaffd700 1 -- 172.21.15.72:0/621515761 >> v1:172.21.15.173:6789/0 conn(0x7f66ec0c7740 legacy=0x7f66ec0c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:48.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.177+0000 7f66ea7fc700 1 -- 172.21.15.72:0/621515761 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 987393238 0 0) 0x7f66d80035b0 con 0x7f66ec06c1d0 2023-07-27T20:33:48.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.177+0000 7f66eaffd700 1 -- 172.21.15.72:0/621515761 >> v1:172.21.15.72:6789/0 conn(0x7f66ec06c1d0 legacy=0x7f66ec06c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:48.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.177+0000 7f66eaffd700 1 -- 172.21.15.72:0/621515761 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ec0c62f0 con 0x7f66ec14aab0 2023-07-27T20:33:48.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.177+0000 7f66eaffd700 1 --2- 172.21.15.72:0/621515761 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f66ec14aab0 0x7f66ec154b10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f66dc009870 tx=0x7f66dc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b993b54f3a7ce307 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:48.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.177+0000 7f66ea7fc700 1 -- 172.21.15.72:0/621515761 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e40019f0 con 0x7f66ec14aab0 2023-07-27T20:33:48.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.177+0000 7f66ea7fc700 1 -- 172.21.15.72:0/621515761 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66dc004030 con 0x7f66ec14aab0 2023-07-27T20:33:48.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.177+0000 7f66ea7fc700 1 -- 172.21.15.72:0/621515761 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66dc0043c0 con 0x7f66ec14aab0 2023-07-27T20:33:48.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.178+0000 7f66f17ff700 1 -- 172.21.15.72:0/621515761 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f66ec14aab0 msgr2=0x7f66ec154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:48.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.178+0000 7f66f17ff700 1 --2- 172.21.15.72:0/621515761 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f66ec14aab0 0x7f66ec154b10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f66dc009870 tx=0x7f66dc009b80 comp rx=0 tx=0).stop 2023-07-27T20:33:48.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.178+0000 7f66f17ff700 1 -- 172.21.15.72:0/621515761 shutdown_connections 2023-07-27T20:33:48.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.178+0000 7f66f17ff700 1 --2- 172.21.15.72:0/621515761 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f66ec14aab0 0x7f66ec154b10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:48.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.178+0000 7f66f17ff700 1 -- 172.21.15.72:0/621515761 >> 172.21.15.72:0/621515761 conn(0x7f66ec0ab3f0 msgr2=0x7f66ec0ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:48.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.178+0000 7f66f17ff700 1 -- 172.21.15.72:0/621515761 shutdown_connections 2023-07-27T20:33:48.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.178+0000 7f66f17ff700 1 -- 172.21.15.72:0/621515761 wait complete. 2023-07-27T20:33:48.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.180+0000 7f66f17ff700 1 Processor -- start 2023-07-27T20:33:48.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.180+0000 7f66f17ff700 1 -- start start 2023-07-27T20:33:48.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.181+0000 7f66f17ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f66ec06c1d0 0x7f66ec0beb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:48.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.181+0000 7f66f17ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66ec0c7740 0x7f66ec151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:48.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.181+0000 7f66f17ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f66ec14aab0 0x7f66ec14d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:48.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.181+0000 7f66f17ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec0bdf30 con 0x7f66ec0c7740 2023-07-27T20:33:48.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.181+0000 7f66f17ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec14e020 con 0x7f66ec14aab0 2023-07-27T20:33:48.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.181+0000 7f66f17ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec0bd6d0 con 0x7f66ec06c1d0 2023-07-27T20:33:48.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.181+0000 7f66e3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66ec0c7740 0x7f66ec151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:48.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.181+0000 7f66e3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66ec0c7740 0x7f66ec151d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38576/0 (socket says 172.21.15.72:38576) 2023-07-27T20:33:48.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.181+0000 7f66e3fff700 1 -- 172.21.15.72:0/36135877 learned_addr learned my addr 172.21.15.72:0/36135877 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:48.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.181+0000 7f66eaffd700 1 --2- 172.21.15.72:0/36135877 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f66ec06c1d0 0x7f66ec0beb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:48.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.181+0000 7f66eb7fe700 1 --2- 172.21.15.72:0/36135877 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f66ec14aab0 0x7f66ec14d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:48.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.182+0000 7f66e3fff700 1 -- 172.21.15.72:0/36135877 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f66ec06c1d0 msgr2=0x7f66ec0beb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:48.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.182+0000 7f66e3fff700 1 --2- 172.21.15.72:0/36135877 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f66ec06c1d0 0x7f66ec0beb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:48.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.182+0000 7f66e3fff700 1 -- 172.21.15.72:0/36135877 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f66ec14aab0 msgr2=0x7f66ec14d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:48.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.182+0000 7f66e3fff700 1 --2- 172.21.15.72:0/36135877 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f66ec14aab0 0x7f66ec14d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:48.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.182+0000 7f66e3fff700 1 -- 172.21.15.72:0/36135877 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66dc0094a0 con 0x7f66ec0c7740 2023-07-27T20:33:48.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.182+0000 7f66e3fff700 1 --2- 172.21.15.72:0/36135877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66ec0c7740 0x7f66ec151d90 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f66d400c780 tx=0x7f66d400ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:48.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.182+0000 7f66e37fe700 1 -- 172.21.15.72:0/36135877 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d40054e0 con 0x7f66ec0c7740 2023-07-27T20:33:48.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.182+0000 7f66e37fe700 1 -- 172.21.15.72:0/36135877 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d4003680 con 0x7f66ec0c7740 2023-07-27T20:33:48.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.182+0000 7f66f17ff700 1 -- 172.21.15.72:0/36135877 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66ec0bd970 con 0x7f66ec0c7740 2023-07-27T20:33:48.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.182+0000 7f66e37fe700 1 -- 172.21.15.72:0/36135877 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d4003a30 con 0x7f66ec0c7740 2023-07-27T20:33:48.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.182+0000 7f66f17ff700 1 -- 172.21.15.72:0/36135877 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66ec14d030 con 0x7f66ec0c7740 2023-07-27T20:33:48.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.183+0000 7f66f17ff700 1 -- 172.21.15.72:0/36135877 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66ec14ce90 con 0x7f66ec0c7740 2023-07-27T20:33:48.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.184+0000 7f66e37fe700 1 -- 172.21.15.72:0/36135877 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f66d4003b90 con 0x7f66ec0c7740 2023-07-27T20:33:48.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.185+0000 7f66e37fe700 1 --2- 172.21.15.72:0/36135877 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f66cc06ad10 0x7f66cc06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:48.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.185+0000 7f66e37fe700 1 -- 172.21.15.72:0/36135877 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f66d4088d60 con 0x7f66ec0c7740 2023-07-27T20:33:48.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.185+0000 7f66eaffd700 1 --2- 172.21.15.72:0/36135877 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f66cc06ad10 0x7f66cc06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:48.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.186+0000 7f66eaffd700 1 --2- 172.21.15.72:0/36135877 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f66cc06ad10 0x7f66cc06d1d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f66dc000c00 tx=0x7f66dc008000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:48.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.189+0000 7f66e37fe700 1 -- 172.21.15.72:0/36135877 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f66ec14ce90 con 0x7f66ec0c7740 2023-07-27T20:33:48.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.384+0000 7f66f17ff700 1 -- 172.21.15.72:0/36135877 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f66ec14ce90 con 0x7f66ec0c7740 2023-07-27T20:33:48.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.385+0000 7f66e37fe700 1 -- 172.21.15.72:0/36135877 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7f66ec14ce90 con 0x7f66ec0c7740 2023-07-27T20:33:48.373 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-27T20:33:48.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.387+0000 7f66f17ff700 1 -- 172.21.15.72:0/36135877 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f66cc06ad10 msgr2=0x7f66cc06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:48.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.387+0000 7f66f17ff700 1 --2- 172.21.15.72:0/36135877 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f66cc06ad10 0x7f66cc06d1d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f66dc000c00 tx=0x7f66dc008000 comp rx=0 tx=0).stop 2023-07-27T20:33:48.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.387+0000 7f66f17ff700 1 -- 172.21.15.72:0/36135877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66ec0c7740 msgr2=0x7f66ec151d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:48.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.387+0000 7f66f17ff700 1 --2- 172.21.15.72:0/36135877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66ec0c7740 0x7f66ec151d90 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f66d400c780 tx=0x7f66d400ca90 comp rx=0 tx=0).stop 2023-07-27T20:33:48.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.387+0000 7f66f17ff700 1 -- 172.21.15.72:0/36135877 shutdown_connections 2023-07-27T20:33:48.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.387+0000 7f66f17ff700 1 --2- 172.21.15.72:0/36135877 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f66ec14aab0 0x7f66ec14d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:48.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.387+0000 7f66f17ff700 1 --2- 172.21.15.72:0/36135877 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f66cc06ad10 0x7f66cc06d1d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:48.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.387+0000 7f66f17ff700 1 --2- 172.21.15.72:0/36135877 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f66ec06c1d0 0x7f66ec0beb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:48.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.387+0000 7f66f17ff700 1 --2- 172.21.15.72:0/36135877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66ec0c7740 0x7f66ec151d90 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:48.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.387+0000 7f66f17ff700 1 -- 172.21.15.72:0/36135877 >> 172.21.15.72:0/36135877 conn(0x7f66ec0ab3f0 msgr2=0x7f66ec149df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:48.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.387+0000 7f66f17ff700 1 -- 172.21.15.72:0/36135877 shutdown_connections 2023-07-27T20:33:48.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.387+0000 7f66f17ff700 1 -- 172.21.15.72:0/36135877 wait complete. 2023-07-27T20:33:48.393 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T20:33:48.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.605+0000 7f9dfe9ff700 1 Processor -- start 2023-07-27T20:33:48.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.605+0000 7f9dfe9ff700 1 -- start start 2023-07-27T20:33:48.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.607+0000 7f9dfe9ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9df8154150 0x7f9df815bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:48.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.607+0000 7f9dfe9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9df80baf20 con 0x7f9df814db30 2023-07-27T20:33:48.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.607+0000 7f9dfe9ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9df814df10 con 0x7f9df80c0f80 2023-07-27T20:33:48.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.607+0000 7f9dfe9ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df80bbd40 con 0x7f9df8154150 2023-07-27T20:33:48.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.607+0000 7f9df7fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9df814db30 0x7f9df80bb2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57882/0 (socket says 172.21.15.72:57882) 2023-07-27T20:33:48.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.607+0000 7f9df7fff700 1 -- 172.21.15.72:0/2104023335 learned_addr learned my addr 172.21.15.72:0/2104023335 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:48.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.607+0000 7f9dfcf9c700 1 --2- 172.21.15.72:0/2104023335 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9df8154150 0x7f9df815bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:48.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.607+0000 7f9df77fe700 1 -- 172.21.15.72:0/2104023335 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1266321973 0 0) 0x7f9df80baf20 con 0x7f9df814db30 2023-07-27T20:33:48.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.607+0000 7f9df77fe700 1 -- 172.21.15.72:0/2104023335 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9de40046c0 con 0x7f9df814db30 2023-07-27T20:33:48.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.608+0000 7f9df77fe700 1 -- 172.21.15.72:0/2104023335 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3061789355 0 0) 0x7f9de40046c0 con 0x7f9df814db30 2023-07-27T20:33:48.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.608+0000 7f9df77fe700 1 -- 172.21.15.72:0/2104023335 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9df8154150 msgr2=0x7f9df815bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:48.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.608+0000 7f9df77fe700 1 --2- 172.21.15.72:0/2104023335 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9df8154150 0x7f9df815bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:48.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.608+0000 7f9df77fe700 1 -- 172.21.15.72:0/2104023335 >> v1:172.21.15.173:6789/0 conn(0x7f9df80c0f80 legacy=0x7f9df8153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:48.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.608+0000 7f9df77fe700 1 -- 172.21.15.72:0/2104023335 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df80ba440 con 0x7f9df814db30 2023-07-27T20:33:48.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.608+0000 7f9df77fe700 1 -- 172.21.15.72:0/2104023335 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f9de8001670 con 0x7f9df814db30 2023-07-27T20:33:48.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.608+0000 7f9df77fe700 1 -- 172.21.15.72:0/2104023335 >> v1:172.21.15.72:6789/0 conn(0x7f9df814db30 legacy=0x7f9df80bb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:48.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.608+0000 7f9df77fe700 1 --2- 172.21.15.72:0/2104023335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9de4004b40 0x7f9de4004f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:48.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.608+0000 7f9df77fe700 1 --2- 172.21.15.72:0/2104023335 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9df8154150 0x7f9de4005960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:48.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.608+0000 7f9df77fe700 1 --2- 172.21.15.72:0/2104023335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9de4005ea0 0x7f9de4006320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:48.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.608+0000 7f9df77fe700 1 -- 172.21.15.72:0/2104023335 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de400ccb0 con 0x7f9de4005ea0 2023-07-27T20:33:48.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.608+0000 7f9df77fe700 1 -- 172.21.15.72:0/2104023335 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de400cdf0 con 0x7f9de4004b40 2023-07-27T20:33:48.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.608+0000 7f9df77fe700 1 -- 172.21.15.72:0/2104023335 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9de4003630 con 0x7f9df8154150 2023-07-27T20:33:48.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.608+0000 7f9dfcf9c700 1 --2- 172.21.15.72:0/2104023335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9de4005ea0 0x7f9de4006320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:48.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.608+0000 7f9df7fff700 1 --2- 172.21.15.72:0/2104023335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9de4004b40 0x7f9de4004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:48.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.608+0000 7f9deffff700 1 --2- 172.21.15.72:0/2104023335 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9df8154150 0x7f9de4005960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:48.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.608+0000 7f9dfcf9c700 1 -- 172.21.15.72:0/2104023335 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9df8154150 msgr2=0x7f9de4005960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:48.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.608+0000 7f9dfcf9c700 1 --2- 172.21.15.72:0/2104023335 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9df8154150 0x7f9de4005960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:48.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.608+0000 7f9dfcf9c700 1 -- 172.21.15.72:0/2104023335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9de4004b40 msgr2=0x7f9de4004f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:48.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.608+0000 7f9dfcf9c700 1 --2- 172.21.15.72:0/2104023335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9de4004b40 0x7f9de4004f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:48.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.608+0000 7f9dfcf9c700 1 -- 172.21.15.72:0/2104023335 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de40046c0 con 0x7f9de4005ea0 2023-07-27T20:33:48.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.609+0000 7f9dfcf9c700 1 --2- 172.21.15.72:0/2104023335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9de4005ea0 0x7f9de4006320 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f9df0009fc0 tx=0x7f9de4006990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e83bc9dbb9ac738 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:48.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.609+0000 7f9df77fe700 1 -- 172.21.15.72:0/2104023335 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df000ec30 con 0x7f9de4005ea0 2023-07-27T20:33:48.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.609+0000 7f9df77fe700 1 -- 172.21.15.72:0/2104023335 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df000f040 con 0x7f9de4005ea0 2023-07-27T20:33:48.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.609+0000 7f9df77fe700 1 -- 172.21.15.72:0/2104023335 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df0014480 con 0x7f9de4005ea0 2023-07-27T20:33:48.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.609+0000 7f9dfe9ff700 1 -- 172.21.15.72:0/2104023335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9de4005ea0 msgr2=0x7f9de4006320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:48.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.609+0000 7f9dfe9ff700 1 --2- 172.21.15.72:0/2104023335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9de4005ea0 0x7f9de4006320 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f9df0009fc0 tx=0x7f9de4006990 comp rx=0 tx=0).stop 2023-07-27T20:33:48.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.609+0000 7f9dfcf9c700 1 -- 172.21.15.72:0/2104023335 reap_dead start 2023-07-27T20:33:48.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.610+0000 7f9dfe9ff700 1 -- 172.21.15.72:0/2104023335 shutdown_connections 2023-07-27T20:33:48.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.610+0000 7f9dfe9ff700 1 -- 172.21.15.72:0/2104023335 >> 172.21.15.72:0/2104023335 conn(0x7f9df806a190 msgr2=0x7f9df806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:48.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.610+0000 7f9dfe9ff700 1 -- 172.21.15.72:0/2104023335 shutdown_connections 2023-07-27T20:33:48.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.610+0000 7f9dfe9ff700 1 -- 172.21.15.72:0/2104023335 wait complete. 2023-07-27T20:33:48.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.612+0000 7f9dfe9ff700 1 Processor -- start 2023-07-27T20:33:48.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.612+0000 7f9dfe9ff700 1 -- start start 2023-07-27T20:33:48.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.613+0000 7f9dfe9ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9de4005ea0 0x7f9df81526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:48.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.613+0000 7f9dfe9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9df8149e30 0x7f9df80c3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:48.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.613+0000 7f9dfe9ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9df8151c00 0x7f9df80c3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:48.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.613+0000 7f9dfe9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df8149810 con 0x7f9df8149e30 2023-07-27T20:33:48.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.613+0000 7f9dfe9ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df8150d50 con 0x7f9de4005ea0 2023-07-27T20:33:48.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.613+0000 7f9dfe9ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df80c44c0 con 0x7f9df8151c00 2023-07-27T20:33:48.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.613+0000 7f9deffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9df8149e30 0x7f9df80c3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:48.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.614+0000 7f9deffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9df8149e30 0x7f9df80c3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38584/0 (socket says 172.21.15.72:38584) 2023-07-27T20:33:48.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.614+0000 7f9deffff700 1 -- 172.21.15.72:0/1463998377 learned_addr learned my addr 172.21.15.72:0/1463998377 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:48.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.614+0000 7f9df7fff700 1 --2- 172.21.15.72:0/1463998377 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9de4005ea0 0x7f9df81526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:48.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.614+0000 7f9dfcf9c700 1 --2- 172.21.15.72:0/1463998377 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9df8151c00 0x7f9df80c3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:48.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.614+0000 7f9deffff700 1 -- 172.21.15.72:0/1463998377 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9df8151c00 msgr2=0x7f9df80c3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:48.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.614+0000 7f9deffff700 1 --2- 172.21.15.72:0/1463998377 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9df8151c00 0x7f9df80c3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:48.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.614+0000 7f9deffff700 1 -- 172.21.15.72:0/1463998377 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9de4005ea0 msgr2=0x7f9df81526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:48.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.614+0000 7f9deffff700 1 --2- 172.21.15.72:0/1463998377 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9de4005ea0 0x7f9df81526f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:48.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.614+0000 7f9deffff700 1 -- 172.21.15.72:0/1463998377 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df8151230 con 0x7f9df8149e30 2023-07-27T20:33:48.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.614+0000 7f9dfcf9c700 1 --2- 172.21.15.72:0/1463998377 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9df8151c00 0x7f9df80c3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:33:48.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.614+0000 7f9deffff700 1 --2- 172.21.15.72:0/1463998377 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9df8149e30 0x7f9df80c3a40 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f9de000e780 tx=0x7f9de000eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:48.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.614+0000 7f9df57fa700 1 -- 172.21.15.72:0/1463998377 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de00052e0 con 0x7f9df8149e30 2023-07-27T20:33:48.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.614+0000 7f9df57fa700 1 -- 172.21.15.72:0/1463998377 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de0005440 con 0x7f9df8149e30 2023-07-27T20:33:48.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.614+0000 7f9dfe9ff700 1 -- 172.21.15.72:0/1463998377 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9df81517a0 con 0x7f9df8149e30 2023-07-27T20:33:48.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.614+0000 7f9df57fa700 1 -- 172.21.15.72:0/1463998377 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de00038c0 con 0x7f9df8149e30 2023-07-27T20:33:48.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.614+0000 7f9dfe9ff700 1 -- 172.21.15.72:0/1463998377 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9df81e5dd0 con 0x7f9df8149e30 2023-07-27T20:33:48.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.616+0000 7f9dfe9ff700 1 -- 172.21.15.72:0/1463998377 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9df8150f50 con 0x7f9df8149e30 2023-07-27T20:33:48.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.616+0000 7f9df57fa700 1 -- 172.21.15.72:0/1463998377 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9de0003a20 con 0x7f9df8149e30 2023-07-27T20:33:48.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.617+0000 7f9df57fa700 1 --2- 172.21.15.72:0/1463998377 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9dd806ace0 0x7f9dd806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:48.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.617+0000 7f9df57fa700 1 -- 172.21.15.72:0/1463998377 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f9de0089770 con 0x7f9df8149e30 2023-07-27T20:33:48.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.618+0000 7f9df7fff700 1 --2- 172.21.15.72:0/1463998377 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9dd806ace0 0x7f9dd806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:48.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.618+0000 7f9df7fff700 1 --2- 172.21.15.72:0/1463998377 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9dd806ace0 0x7f9dd806d1a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9de8000c00 tx=0x7f9de8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:48.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.621+0000 7f9df57fa700 1 -- 172.21.15.72:0/1463998377 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9df8150f50 con 0x7f9df8149e30 2023-07-27T20:33:48.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.812+0000 7f9dfe9ff700 1 -- 172.21.15.72:0/1463998377 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9df81e5930 con 0x7f9df8149e30 2023-07-27T20:33:48.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.812+0000 7f9df57fa700 1 -- 172.21.15.72:0/1463998377 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v47) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9de00542e0 con 0x7f9df8149e30 2023-07-27T20:33:48.801 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-27T20:33:48.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.814+0000 7f9dfe9ff700 1 -- 172.21.15.72:0/1463998377 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9dd806ace0 msgr2=0x7f9dd806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:48.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.814+0000 7f9dfe9ff700 1 --2- 172.21.15.72:0/1463998377 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9dd806ace0 0x7f9dd806d1a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9de8000c00 tx=0x7f9de8009040 comp rx=0 tx=0).stop 2023-07-27T20:33:48.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.814+0000 7f9dfe9ff700 1 -- 172.21.15.72:0/1463998377 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9df8149e30 msgr2=0x7f9df80c3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:48.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.814+0000 7f9dfe9ff700 1 --2- 172.21.15.72:0/1463998377 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9df8149e30 0x7f9df80c3a40 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f9de000e780 tx=0x7f9de000eb40 comp rx=0 tx=0).stop 2023-07-27T20:33:48.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.814+0000 7f9dfe9ff700 1 -- 172.21.15.72:0/1463998377 shutdown_connections 2023-07-27T20:33:48.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.815+0000 7f9dfe9ff700 1 --2- 172.21.15.72:0/1463998377 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9dd806ace0 0x7f9dd806d1a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:48.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.815+0000 7f9dfe9ff700 1 --2- 172.21.15.72:0/1463998377 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9df8151c00 0x7f9df80c3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:48.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.815+0000 7f9dfe9ff700 1 --2- 172.21.15.72:0/1463998377 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9de4005ea0 0x7f9df81526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:48.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.815+0000 7f9dfe9ff700 1 --2- 172.21.15.72:0/1463998377 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9df8149e30 0x7f9df80c3a40 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:48.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.815+0000 7f9dfe9ff700 1 -- 172.21.15.72:0/1463998377 >> 172.21.15.72:0/1463998377 conn(0x7f9df806a190 msgr2=0x7f9df814a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:48.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.815+0000 7f9dfe9ff700 1 -- 172.21.15.72:0/1463998377 shutdown_connections 2023-07-27T20:33:48.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:48.815+0000 7f9dfe9ff700 1 -- 172.21.15.72:0/1463998377 wait complete. 2023-07-27T20:33:48.821 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T20:33:49.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.031+0000 7fab1a7ff700 1 Processor -- start 2023-07-27T20:33:49.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.031+0000 7fab1a7ff700 1 -- start start 2023-07-27T20:33:49.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.032+0000 7fab1a7ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fab140c7740 0x7fab140c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:49.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.032+0000 7fab1a7ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab140c7c50 con 0x7fab140c4700 2023-07-27T20:33:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.032+0000 7fab1a7ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab1406bd40 con 0x7fab1414aab0 2023-07-27T20:33:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.032+0000 7fab1a7ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab140c62f0 con 0x7fab140c7740 2023-07-27T20:33:49.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.032+0000 7fab18d9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fab140c4700 0x7fab1406c1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57888/0 (socket says 172.21.15.72:57888) 2023-07-27T20:33:49.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.032+0000 7fab18d9c700 1 -- 172.21.15.72:0/1364690367 learned_addr learned my addr 172.21.15.72:0/1364690367 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:49.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.033+0000 7fab137fe700 1 --2- 172.21.15.72:0/1364690367 >> v2:172.21.15.173:3300/0 conn(0x7fab140c7740 0x7fab140c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:49.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.033+0000 7fab12ffd700 1 -- 172.21.15.72:0/1364690367 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3183078950 0 0) 0x7fab140c7c50 con 0x7fab140c4700 2023-07-27T20:33:49.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.033+0000 7fab12ffd700 1 -- 172.21.15.72:0/1364690367 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faafc0035b0 con 0x7fab140c4700 2023-07-27T20:33:49.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.033+0000 7fab12ffd700 1 -- 172.21.15.72:0/1364690367 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1104664413 0 0) 0x7fab1406bd40 con 0x7fab1414aab0 2023-07-27T20:33:49.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.033+0000 7fab12ffd700 1 -- 172.21.15.72:0/1364690367 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab140c7c50 con 0x7fab1414aab0 2023-07-27T20:33:49.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.033+0000 7fab12ffd700 1 -- 172.21.15.72:0/1364690367 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 981060368 0 0) 0x7faafc0035b0 con 0x7fab140c4700 2023-07-27T20:33:49.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.033+0000 7fab12ffd700 1 -- 172.21.15.72:0/1364690367 >> v2:172.21.15.173:3300/0 conn(0x7fab140c7740 msgr2=0x7fab140c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:49.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.033+0000 7fab12ffd700 1 --2- 172.21.15.72:0/1364690367 >> v2:172.21.15.173:3300/0 conn(0x7fab140c7740 0x7fab140c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:49.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.033+0000 7fab12ffd700 1 -- 172.21.15.72:0/1364690367 >> v1:172.21.15.173:6789/0 conn(0x7fab1414aab0 legacy=0x7fab14154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:49.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.033+0000 7fab12ffd700 1 -- 172.21.15.72:0/1364690367 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab1406d200 con 0x7fab140c4700 2023-07-27T20:33:49.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.033+0000 7fab12ffd700 1 -- 172.21.15.72:0/1364690367 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7fab0c0019f0 con 0x7fab140c4700 2023-07-27T20:33:49.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.033+0000 7fab12ffd700 1 -- 172.21.15.72:0/1364690367 >> v1:172.21.15.72:6789/0 conn(0x7fab140c4700 legacy=0x7fab1406c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:49.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.033+0000 7fab12ffd700 1 --2- 172.21.15.72:0/1364690367 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faafc003be0 0x7faafc003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:49.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.033+0000 7fab12ffd700 1 --2- 172.21.15.72:0/1364690367 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faafc004850 0x7faafc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:49.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.033+0000 7fab12ffd700 1 --2- 172.21.15.72:0/1364690367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faafc005210 0x7faafc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:49.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.033+0000 7fab12ffd700 1 -- 172.21.15.72:0/1364690367 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab140c62f0 con 0x7faafc004850 2023-07-27T20:33:49.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.033+0000 7fab12ffd700 1 -- 172.21.15.72:0/1364690367 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faafc00c0e0 con 0x7faafc005210 2023-07-27T20:33:49.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.033+0000 7fab12ffd700 1 -- 172.21.15.72:0/1364690367 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faafc00c2a0 con 0x7faafc003be0 2023-07-27T20:33:49.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.034+0000 7fab137fe700 1 --2- 172.21.15.72:0/1364690367 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faafc004850 0x7faafc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:49.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.034+0000 7fab13fff700 1 --2- 172.21.15.72:0/1364690367 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faafc003be0 0x7faafc003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:49.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.034+0000 7fab18d9c700 1 --2- 172.21.15.72:0/1364690367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faafc005210 0x7faafc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:49.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.034+0000 7fab137fe700 1 -- 172.21.15.72:0/1364690367 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faafc003be0 msgr2=0x7faafc003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:49.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.034+0000 7fab137fe700 1 --2- 172.21.15.72:0/1364690367 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faafc003be0 0x7faafc003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:49.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.034+0000 7fab137fe700 1 -- 172.21.15.72:0/1364690367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faafc005210 msgr2=0x7faafc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:49.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.034+0000 7fab137fe700 1 --2- 172.21.15.72:0/1364690367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faafc005210 0x7faafc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:49.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.034+0000 7fab137fe700 1 -- 172.21.15.72:0/1364690367 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faafc0035b0 con 0x7faafc004850 2023-07-27T20:33:49.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.034+0000 7fab18d9c700 1 -- 172.21.15.72:0/1364690367 reap_dead start 2023-07-27T20:33:49.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.034+0000 7fab137fe700 1 --2- 172.21.15.72:0/1364690367 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faafc004850 0x7faafc004cd0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fab08009b60 tx=0x7faafc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb846be597d4de server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:49.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.034+0000 7fab12ffd700 1 -- 172.21.15.72:0/1364690367 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0800e6c0 con 0x7faafc004850 2023-07-27T20:33:49.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.035+0000 7fab12ffd700 1 -- 172.21.15.72:0/1364690367 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab0800e820 con 0x7faafc004850 2023-07-27T20:33:49.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.035+0000 7fab12ffd700 1 -- 172.21.15.72:0/1364690367 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0800eb90 con 0x7faafc004850 2023-07-27T20:33:49.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.035+0000 7fab1a7ff700 1 -- 172.21.15.72:0/1364690367 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faafc004850 msgr2=0x7faafc004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:49.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.035+0000 7fab1a7ff700 1 --2- 172.21.15.72:0/1364690367 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faafc004850 0x7faafc004cd0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fab08009b60 tx=0x7faafc005880 comp rx=0 tx=0).stop 2023-07-27T20:33:49.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.035+0000 7fab1a7ff700 1 -- 172.21.15.72:0/1364690367 shutdown_connections 2023-07-27T20:33:49.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.035+0000 7fab1a7ff700 1 --2- 172.21.15.72:0/1364690367 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faafc004850 0x7faafc004cd0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:49.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.035+0000 7fab1a7ff700 1 -- 172.21.15.72:0/1364690367 >> 172.21.15.72:0/1364690367 conn(0x7fab140ab3f0 msgr2=0x7fab140ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:49.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.035+0000 7fab1a7ff700 1 -- 172.21.15.72:0/1364690367 shutdown_connections 2023-07-27T20:33:49.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.035+0000 7fab1a7ff700 1 -- 172.21.15.72:0/1364690367 wait complete. 2023-07-27T20:33:49.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.037+0000 7fab1a7ff700 1 Processor -- start 2023-07-27T20:33:49.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.038+0000 7fab1a7ff700 1 -- start start 2023-07-27T20:33:49.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.039+0000 7fab1a7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faafc004850 0x7fab1414f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:49.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.039+0000 7fab1a7ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab140beca0 0x7fab1414e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:49.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.039+0000 7fab1a7ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fab140bf3b0 0x7fab140bf830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:49.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.039+0000 7fab1a7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab140af550 con 0x7faafc004850 2023-07-27T20:33:49.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.039+0000 7fab1a7ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab14151a00 con 0x7fab140beca0 2023-07-27T20:33:49.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.039+0000 7fab1a7ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab1414f9d0 con 0x7fab140bf3b0 2023-07-27T20:33:49.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.039+0000 7fab13fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faafc004850 0x7fab1414f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:49.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.039+0000 7fab13fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faafc004850 0x7fab1414f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38594/0 (socket says 172.21.15.72:38594) 2023-07-27T20:33:49.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.039+0000 7fab13fff700 1 -- 172.21.15.72:0/1468996647 learned_addr learned my addr 172.21.15.72:0/1468996647 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:49.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.039+0000 7fab13fff700 1 -- 172.21.15.72:0/1468996647 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fab140bf3b0 msgr2=0x7fab140bf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:49.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.039+0000 7fab13fff700 1 --2- 172.21.15.72:0/1468996647 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fab140bf3b0 0x7fab140bf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:49.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.039+0000 7fab13fff700 1 -- 172.21.15.72:0/1468996647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab140beca0 msgr2=0x7fab1414e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:49.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.039+0000 7fab137fe700 1 --2- 172.21.15.72:0/1468996647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab140beca0 0x7fab1414e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:49.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.040+0000 7fab13fff700 1 --2- 172.21.15.72:0/1468996647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab140beca0 0x7fab1414e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:49.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.040+0000 7fab13fff700 1 -- 172.21.15.72:0/1468996647 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab141513b0 con 0x7faafc004850 2023-07-27T20:33:49.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.040+0000 7fab137fe700 1 --2- 172.21.15.72:0/1468996647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab140beca0 0x7fab1414e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:33:49.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.040+0000 7fab13fff700 1 --2- 172.21.15.72:0/1468996647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faafc004850 0x7fab1414f2d0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fab0400f7a0 tx=0x7fab0400fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:49.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.040+0000 7fab10ff9700 1 -- 172.21.15.72:0/1468996647 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab04005320 con 0x7faafc004850 2023-07-27T20:33:49.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.040+0000 7fab10ff9700 1 -- 172.21.15.72:0/1468996647 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab040054a0 con 0x7faafc004850 2023-07-27T20:33:49.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.040+0000 7fab1a7ff700 1 -- 172.21.15.72:0/1468996647 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab14151690 con 0x7faafc004850 2023-07-27T20:33:49.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.040+0000 7fab10ff9700 1 -- 172.21.15.72:0/1468996647 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab04006aa0 con 0x7faafc004850 2023-07-27T20:33:49.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.040+0000 7fab1a7ff700 1 -- 172.21.15.72:0/1468996647 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab1414ee50 con 0x7faafc004850 2023-07-27T20:33:49.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.041+0000 7fab1a7ff700 1 -- 172.21.15.72:0/1468996647 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab140af7a0 con 0x7faafc004850 2023-07-27T20:33:49.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.042+0000 7fab10ff9700 1 -- 172.21.15.72:0/1468996647 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fab04006c00 con 0x7faafc004850 2023-07-27T20:33:49.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.043+0000 7fab10ff9700 1 --2- 172.21.15.72:0/1468996647 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fab0006ace0 0x7fab0006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:49.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.043+0000 7fab10ff9700 1 -- 172.21.15.72:0/1468996647 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7fab04089170 con 0x7faafc004850 2023-07-27T20:33:49.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.044+0000 7fab137fe700 1 --2- 172.21.15.72:0/1468996647 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fab0006ace0 0x7fab0006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:49.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.044+0000 7fab137fe700 1 --2- 172.21.15.72:0/1468996647 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fab0006ace0 0x7fab0006d1a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fab140bf280 tx=0x7fab08008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:49.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.048+0000 7fab10ff9700 1 -- 172.21.15.72:0/1468996647 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fab04053d60 con 0x7faafc004850 2023-07-27T20:33:49.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.241+0000 7fab1a7ff700 1 -- 172.21.15.72:0/1468996647 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fab140c9410 con 0x7faafc004850 2023-07-27T20:33:49.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.241+0000 7fab10ff9700 1 -- 172.21.15.72:0/1468996647 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) v1 ==== 104+0+11 (secure 0 0 0) 0x7fab04057380 con 0x7faafc004850 2023-07-27T20:33:49.230 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:33:49.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.243+0000 7fab1a7ff700 1 -- 172.21.15.72:0/1468996647 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fab0006ace0 msgr2=0x7fab0006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:49.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.243+0000 7fab1a7ff700 1 --2- 172.21.15.72:0/1468996647 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fab0006ace0 0x7fab0006d1a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fab140bf280 tx=0x7fab08008030 comp rx=0 tx=0).stop 2023-07-27T20:33:49.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.243+0000 7fab1a7ff700 1 -- 172.21.15.72:0/1468996647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faafc004850 msgr2=0x7fab1414f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:49.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.243+0000 7fab1a7ff700 1 --2- 172.21.15.72:0/1468996647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faafc004850 0x7fab1414f2d0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fab0400f7a0 tx=0x7fab0400fb60 comp rx=0 tx=0).stop 2023-07-27T20:33:49.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.243+0000 7fab1a7ff700 1 -- 172.21.15.72:0/1468996647 shutdown_connections 2023-07-27T20:33:49.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.243+0000 7fab1a7ff700 1 --2- 172.21.15.72:0/1468996647 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fab0006ace0 0x7fab0006d1a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:49.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.243+0000 7fab1a7ff700 1 --2- 172.21.15.72:0/1468996647 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fab140bf3b0 0x7fab140bf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:49.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.243+0000 7fab1a7ff700 1 --2- 172.21.15.72:0/1468996647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faafc004850 0x7fab1414f2d0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:49.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.243+0000 7fab1a7ff700 1 --2- 172.21.15.72:0/1468996647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab140beca0 0x7fab1414e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:49.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.243+0000 7fab1a7ff700 1 -- 172.21.15.72:0/1468996647 >> 172.21.15.72:0/1468996647 conn(0x7fab140ab3f0 msgr2=0x7fab14152c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:49.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.244+0000 7fab1a7ff700 1 -- 172.21.15.72:0/1468996647 shutdown_connections 2023-07-27T20:33:49.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.244+0000 7fab1a7ff700 1 -- 172.21.15.72:0/1468996647 wait complete. 2023-07-27T20:33:49.250 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T20:33:49.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.461+0000 7f8c691ff700 1 Processor -- start 2023-07-27T20:33:49.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.461+0000 7f8c691ff700 1 -- start start 2023-07-27T20:33:49.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.463+0000 7f8c691ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8c640a86c0 0x7f8c64158100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:49.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.463+0000 7f8c691ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c640a8ec0 con 0x7f8c640a8aa0 2023-07-27T20:33:49.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.463+0000 7f8c691ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c64071700 con 0x7f8c64071190 2023-07-27T20:33:49.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.463+0000 7f8c691ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c640c3e30 con 0x7f8c640a86c0 2023-07-27T20:33:49.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.463+0000 7f8c62d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8c640a86c0 0x7f8c64158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:49.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.463+0000 7f8c6359e700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8c640a8aa0 0x7f8c6406b2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57896/0 (socket says 172.21.15.72:57896) 2023-07-27T20:33:49.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.463+0000 7f8c6359e700 1 -- 172.21.15.72:0/80385006 learned_addr learned my addr 172.21.15.72:0/80385006 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:49.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.463+0000 7f8c62d9d700 1 -- 172.21.15.72:0/80385006 >> v1:172.21.15.173:6789/0 conn(0x7f8c64071190 legacy=0x7f8c64154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:49.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.463+0000 7f8c62d9d700 1 -- 172.21.15.72:0/80385006 >> v1:172.21.15.72:6789/0 conn(0x7f8c640a8aa0 legacy=0x7f8c6406b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:49.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.463+0000 7f8c62d9d700 1 -- 172.21.15.72:0/80385006 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c640719e0 con 0x7f8c640a86c0 2023-07-27T20:33:49.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.463+0000 7f8c6259c700 1 -- 172.21.15.72:0/80385006 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1961550240 0 0) 0x7f8c640a8ec0 con 0x7f8c640a8aa0 2023-07-27T20:33:49.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.464+0000 7f8c62d9d700 1 --2- 172.21.15.72:0/80385006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c640a86c0 0x7f8c64158100 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f8c54009840 tx=0x7f8c54009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=901a394312e435b9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:49.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.464+0000 7f8c6259c700 1 -- 172.21.15.72:0/80385006 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c54004230 con 0x7f8c640a86c0 2023-07-27T20:33:49.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.464+0000 7f8c6259c700 1 -- 172.21.15.72:0/80385006 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c54004390 con 0x7f8c640a86c0 2023-07-27T20:33:49.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.464+0000 7f8c6259c700 1 -- 172.21.15.72:0/80385006 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c540036a0 con 0x7f8c640a86c0 2023-07-27T20:33:49.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.464+0000 7f8c691ff700 1 -- 172.21.15.72:0/80385006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c640a86c0 msgr2=0x7f8c64158100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:49.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.464+0000 7f8c691ff700 1 --2- 172.21.15.72:0/80385006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c640a86c0 0x7f8c64158100 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f8c54009840 tx=0x7f8c54009b50 comp rx=0 tx=0).stop 2023-07-27T20:33:49.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.464+0000 7f8c691ff700 1 -- 172.21.15.72:0/80385006 shutdown_connections 2023-07-27T20:33:49.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.464+0000 7f8c691ff700 1 --2- 172.21.15.72:0/80385006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c640a86c0 0x7f8c64158100 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:49.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.464+0000 7f8c691ff700 1 -- 172.21.15.72:0/80385006 >> 172.21.15.72:0/80385006 conn(0x7f8c640c2fd0 msgr2=0x7f8c640c33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:49.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.464+0000 7f8c691ff700 1 -- 172.21.15.72:0/80385006 shutdown_connections 2023-07-27T20:33:49.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.465+0000 7f8c691ff700 1 -- 172.21.15.72:0/80385006 wait complete. 2023-07-27T20:33:49.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.466+0000 7f8c691ff700 1 Processor -- start 2023-07-27T20:33:49.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.466+0000 7f8c691ff700 1 -- start start 2023-07-27T20:33:49.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.467+0000 7f8c691ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8c64071190 0x7f8c640bdf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:49.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.467+0000 7f8c691ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c640a86c0 0x7f8c6414c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:49.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.467+0000 7f8c691ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c640a8aa0 0x7f8c640becd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:49.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.467+0000 7f8c691ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c640be880 con 0x7f8c640a8aa0 2023-07-27T20:33:49.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.467+0000 7f8c691ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c640be4c0 con 0x7f8c640a86c0 2023-07-27T20:33:49.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.467+0000 7f8c691ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6414d950 con 0x7f8c64071190 2023-07-27T20:33:49.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.467+0000 7f8c6359e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c640a8aa0 0x7f8c640becd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:49.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.467+0000 7f8c6359e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c640a8aa0 0x7f8c640becd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38614/0 (socket says 172.21.15.72:38614) 2023-07-27T20:33:49.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.467+0000 7f8c6359e700 1 -- 172.21.15.72:0/1149785287 learned_addr learned my addr 172.21.15.72:0/1149785287 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:49.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.468+0000 7f8c62d9d700 1 --2- 172.21.15.72:0/1149785287 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8c64071190 0x7f8c640bdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:49.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.468+0000 7f8c5bfff700 1 --2- 172.21.15.72:0/1149785287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c640a86c0 0x7f8c6414c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:49.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.468+0000 7f8c6359e700 1 -- 172.21.15.72:0/1149785287 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8c64071190 msgr2=0x7f8c640bdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:49.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.468+0000 7f8c6359e700 1 --2- 172.21.15.72:0/1149785287 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8c64071190 0x7f8c640bdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:49.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.468+0000 7f8c6359e700 1 -- 172.21.15.72:0/1149785287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c640a86c0 msgr2=0x7f8c6414c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:49.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.468+0000 7f8c6359e700 1 --2- 172.21.15.72:0/1149785287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c640a86c0 0x7f8c6414c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:49.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.468+0000 7f8c6359e700 1 -- 172.21.15.72:0/1149785287 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c540094a0 con 0x7f8c640a8aa0 2023-07-27T20:33:49.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.468+0000 7f8c5bfff700 1 --2- 172.21.15.72:0/1149785287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c640a86c0 0x7f8c6414c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:33:49.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.468+0000 7f8c6359e700 1 --2- 172.21.15.72:0/1149785287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c640a8aa0 0x7f8c640becd0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c00cca0 tx=0x7f8c5c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:49.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.468+0000 7f8c5b7fe700 1 -- 172.21.15.72:0/1149785287 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c00cea0 con 0x7f8c640a8aa0 2023-07-27T20:33:49.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.468+0000 7f8c5b7fe700 1 -- 172.21.15.72:0/1149785287 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c5c00ade0 con 0x7f8c640a8aa0 2023-07-27T20:33:49.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.468+0000 7f8c5b7fe700 1 -- 172.21.15.72:0/1149785287 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c007310 con 0x7f8c640a8aa0 2023-07-27T20:33:49.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.468+0000 7f8c691ff700 1 -- 172.21.15.72:0/1149785287 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c6414dba0 con 0x7f8c640a8aa0 2023-07-27T20:33:49.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.468+0000 7f8c691ff700 1 -- 172.21.15.72:0/1149785287 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c641ed830 con 0x7f8c640a8aa0 2023-07-27T20:33:49.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.469+0000 7f8c691ff700 1 -- 172.21.15.72:0/1149785287 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c640be9f0 con 0x7f8c640a8aa0 2023-07-27T20:33:49.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.470+0000 7f8c5b7fe700 1 -- 172.21.15.72:0/1149785287 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8c5c007470 con 0x7f8c640a8aa0 2023-07-27T20:33:49.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.471+0000 7f8c5b7fe700 1 --2- 172.21.15.72:0/1149785287 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8c4406ace0 0x7f8c4406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:49.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.471+0000 7f8c5b7fe700 1 -- 172.21.15.72:0/1149785287 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f8c5c089740 con 0x7f8c640a8aa0 2023-07-27T20:33:49.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.472+0000 7f8c62d9d700 1 --2- 172.21.15.72:0/1149785287 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8c4406ace0 0x7f8c4406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:49.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.473+0000 7f8c62d9d700 1 --2- 172.21.15.72:0/1149785287 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8c4406ace0 0x7f8c4406d1a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8c640bd2d0 tx=0x7f8c5401c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:49.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.476+0000 7f8c5b7fe700 1 -- 172.21.15.72:0/1149785287 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8c5c054220 con 0x7f8c640a8aa0 2023-07-27T20:33:49.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.670+0000 7f8c691ff700 1 -- 172.21.15.72:0/1149785287 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8c6404e470 con 0x7f8c640a8aa0 2023-07-27T20:33:49.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.671+0000 7f8c5b7fe700 1 -- 172.21.15.72:0/1149785287 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8c5c057840 con 0x7f8c640a8aa0 2023-07-27T20:33:49.660 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-27T20:33:49.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.673+0000 7f8c691ff700 1 -- 172.21.15.72:0/1149785287 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8c4406ace0 msgr2=0x7f8c4406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:49.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.673+0000 7f8c691ff700 1 --2- 172.21.15.72:0/1149785287 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8c4406ace0 0x7f8c4406d1a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8c640bd2d0 tx=0x7f8c5401c040 comp rx=0 tx=0).stop 2023-07-27T20:33:49.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.673+0000 7f8c691ff700 1 -- 172.21.15.72:0/1149785287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c640a8aa0 msgr2=0x7f8c640becd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:49.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.673+0000 7f8c691ff700 1 --2- 172.21.15.72:0/1149785287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c640a8aa0 0x7f8c640becd0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c00cca0 tx=0x7f8c5c00a340 comp rx=0 tx=0).stop 2023-07-27T20:33:49.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.673+0000 7f8c691ff700 1 -- 172.21.15.72:0/1149785287 shutdown_connections 2023-07-27T20:33:49.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.674+0000 7f8c691ff700 1 --2- 172.21.15.72:0/1149785287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c640a8aa0 0x7f8c640becd0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:49.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.674+0000 7f8c691ff700 1 --2- 172.21.15.72:0/1149785287 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8c4406ace0 0x7f8c4406d1a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:49.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.674+0000 7f8c691ff700 1 --2- 172.21.15.72:0/1149785287 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8c64071190 0x7f8c640bdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:49.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.674+0000 7f8c691ff700 1 --2- 172.21.15.72:0/1149785287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c640a86c0 0x7f8c6414c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:49.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.674+0000 7f8c691ff700 1 -- 172.21.15.72:0/1149785287 >> 172.21.15.72:0/1149785287 conn(0x7f8c640c2fd0 msgr2=0x7f8c640c0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:49.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.674+0000 7f8c691ff700 1 -- 172.21.15.72:0/1149785287 shutdown_connections 2023-07-27T20:33:49.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.674+0000 7f8c691ff700 1 -- 172.21.15.72:0/1149785287 wait complete. 2023-07-27T20:33:49.680 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-07-27T20:33:49.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.889+0000 7fd1cdfff700 1 Processor -- start 2023-07-27T20:33:49.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.890+0000 7fd1cdfff700 1 -- start start 2023-07-27T20:33:49.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.891+0000 7fd1cdfff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd1c813b150 0x7fd1c8151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:49.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.891+0000 7fd1cdfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd1c806e140 0x7fd1c80ba310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:49.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.891+0000 7fd1cdfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1c80ba850 0x7fd1c806d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:49.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.891+0000 7fd1cdfff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c806ce10 con 0x7fd1c806e140 2023-07-27T20:33:49.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.891+0000 7fd1cdfff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c8152680 con 0x7fd1c813b150 2023-07-27T20:33:49.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.891+0000 7fd1cdfff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c8152960 con 0x7fd1c80ba850 2023-07-27T20:33:49.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.891+0000 7fd1c6ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd1c806e140 0x7fd1c80ba310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:49.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.891+0000 7fd1c6ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd1c806e140 0x7fd1c80ba310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57396/0 (socket says 172.21.15.72:57396) 2023-07-27T20:33:49.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.891+0000 7fd1c6ffd700 1 -- 172.21.15.72:0/3734888848 learned_addr learned my addr 172.21.15.72:0/3734888848 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:49.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.891+0000 7fd1c7fff700 1 --2- 172.21.15.72:0/3734888848 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1c80ba850 0x7fd1c806d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:49.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.891+0000 7fd1c77fe700 1 --2- 172.21.15.72:0/3734888848 >> v2:172.21.15.173:3300/0 conn(0x7fd1c813b150 0x7fd1c8151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:49.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.892+0000 7fd1c6ffd700 1 -- 172.21.15.72:0/3734888848 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1c80ba850 msgr2=0x7fd1c806d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:49.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.892+0000 7fd1c6ffd700 1 --2- 172.21.15.72:0/3734888848 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1c80ba850 0x7fd1c806d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:49.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.892+0000 7fd1c6ffd700 1 -- 172.21.15.72:0/3734888848 >> v2:172.21.15.173:3300/0 conn(0x7fd1c813b150 msgr2=0x7fd1c8151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:49.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.892+0000 7fd1c6ffd700 1 --2- 172.21.15.72:0/3734888848 >> v2:172.21.15.173:3300/0 conn(0x7fd1c813b150 0x7fd1c8151dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:49.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.892+0000 7fd1c6ffd700 1 -- 172.21.15.72:0/3734888848 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c8152c40 con 0x7fd1c806e140 2023-07-27T20:33:49.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.892+0000 7fd1c6ffd700 1 --2- 172.21.15.72:0/3734888848 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1c806e140 0x7fd1c80ba310 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd1c806b1b0 tx=0x7fd1bc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d65f8cf4dcc38a34 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:49.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.892+0000 7fd1c67fc700 1 -- 172.21.15.72:0/3734888848 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc00b870 con 0x7fd1c806e140 2023-07-27T20:33:49.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.892+0000 7fd1c67fc700 1 -- 172.21.15.72:0/3734888848 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1bc00b9d0 con 0x7fd1c806e140 2023-07-27T20:33:49.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.892+0000 7fd1c67fc700 1 -- 172.21.15.72:0/3734888848 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc00bd60 con 0x7fd1c806e140 2023-07-27T20:33:49.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.893+0000 7fd1cdfff700 1 -- 172.21.15.72:0/3734888848 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1c806e140 msgr2=0x7fd1c80ba310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:49.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.893+0000 7fd1cdfff700 1 --2- 172.21.15.72:0/3734888848 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1c806e140 0x7fd1c80ba310 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd1c806b1b0 tx=0x7fd1bc009bd0 comp rx=0 tx=0).stop 2023-07-27T20:33:49.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.893+0000 7fd1cdfff700 1 -- 172.21.15.72:0/3734888848 shutdown_connections 2023-07-27T20:33:49.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.893+0000 7fd1cdfff700 1 --2- 172.21.15.72:0/3734888848 >> v2:172.21.15.173:3300/0 conn(0x7fd1c813b150 0x7fd1c8151dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:49.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.893+0000 7fd1cdfff700 1 --2- 172.21.15.72:0/3734888848 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1c80ba850 0x7fd1c806d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:49.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.893+0000 7fd1cdfff700 1 --2- 172.21.15.72:0/3734888848 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1c806e140 0x7fd1c80ba310 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:49.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.893+0000 7fd1cdfff700 1 -- 172.21.15.72:0/3734888848 >> 172.21.15.72:0/3734888848 conn(0x7fd1c806a190 msgr2=0x7fd1c806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:49.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.893+0000 7fd1cdfff700 1 -- 172.21.15.72:0/3734888848 shutdown_connections 2023-07-27T20:33:49.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.893+0000 7fd1cdfff700 1 -- 172.21.15.72:0/3734888848 wait complete. 2023-07-27T20:33:49.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.894+0000 7fd1cdfff700 1 Processor -- start 2023-07-27T20:33:49.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.895+0000 7fd1cdfff700 1 -- start start 2023-07-27T20:33:49.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.895+0000 7fd1cdfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1c806e140 0x7fd1c8070080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:49.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.895+0000 7fd1cdfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1c80ba850 0x7fd1c80aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:49.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.896+0000 7fd1cdfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1c813b150 0x7fd1c81ed0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:49.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.896+0000 7fd1cdfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c80a9480 con 0x7fd1c80ba850 2023-07-27T20:33:49.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.896+0000 7fd1cdfff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c81edb50 con 0x7fd1c813b150 2023-07-27T20:33:49.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.896+0000 7fd1cdfff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c814c690 con 0x7fd1c806e140 2023-07-27T20:33:49.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.896+0000 7fd1c6ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1c80ba850 0x7fd1c80aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:49.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.896+0000 7fd1c6ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1c80ba850 0x7fd1c80aa4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57408/0 (socket says 172.21.15.72:57408) 2023-07-27T20:33:49.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.896+0000 7fd1c6ffd700 1 -- 172.21.15.72:0/142677160 learned_addr learned my addr 172.21.15.72:0/142677160 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:49.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.896+0000 7fd1c6ffd700 1 -- 172.21.15.72:0/142677160 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1c806e140 msgr2=0x7fd1c8070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:49.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.896+0000 7fd1c6ffd700 1 --2- 172.21.15.72:0/142677160 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1c806e140 0x7fd1c8070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:49.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.896+0000 7fd1c6ffd700 1 -- 172.21.15.72:0/142677160 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1c813b150 msgr2=0x7fd1c81ed0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:49.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.896+0000 7fd1c6ffd700 1 --2- 172.21.15.72:0/142677160 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1c813b150 0x7fd1c81ed0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:49.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.896+0000 7fd1c6ffd700 1 -- 172.21.15.72:0/142677160 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1bc009550 con 0x7fd1c80ba850 2023-07-27T20:33:49.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.896+0000 7fd1c6ffd700 1 --2- 172.21.15.72:0/142677160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1c80ba850 0x7fd1c80aa4d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc000c00 tx=0x7fd1bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:49.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.897+0000 7fd1affff700 1 -- 172.21.15.72:0/142677160 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc004520 con 0x7fd1c80ba850 2023-07-27T20:33:49.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.897+0000 7fd1affff700 1 -- 172.21.15.72:0/142677160 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1bc01e070 con 0x7fd1c80ba850 2023-07-27T20:33:49.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.897+0000 7fd1cdfff700 1 -- 172.21.15.72:0/142677160 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c814c970 con 0x7fd1c80ba850 2023-07-27T20:33:49.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.897+0000 7fd1affff700 1 -- 172.21.15.72:0/142677160 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc0038c0 con 0x7fd1c80ba850 2023-07-27T20:33:49.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.897+0000 7fd1cdfff700 1 -- 172.21.15.72:0/142677160 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c80ab280 con 0x7fd1c80ba850 2023-07-27T20:33:49.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.898+0000 7fd1cdfff700 1 -- 172.21.15.72:0/142677160 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1c804e470 con 0x7fd1c80ba850 2023-07-27T20:33:49.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.899+0000 7fd1affff700 1 -- 172.21.15.72:0/142677160 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd1bc003a20 con 0x7fd1c80ba850 2023-07-27T20:33:49.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.899+0000 7fd1affff700 1 --2- 172.21.15.72:0/142677160 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd1b406ace0 0x7fd1b406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:49.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.900+0000 7fd1affff700 1 -- 172.21.15.72:0/142677160 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7fd1bc020070 con 0x7fd1c80ba850 2023-07-27T20:33:49.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.900+0000 7fd1c77fe700 1 --2- 172.21.15.72:0/142677160 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd1b406ace0 0x7fd1b406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:49.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.901+0000 7fd1c77fe700 1 --2- 172.21.15.72:0/142677160 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd1b406ace0 0x7fd1b406d1a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd1b80098d0 tx=0x7fd1b8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:49.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:49.903+0000 7fd1affff700 1 -- 172.21.15.72:0/142677160 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd1bc055af0 con 0x7fd1c80ba850 2023-07-27T20:33:50.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.099+0000 7fd1cdfff700 1 -- 172.21.15.72:0/142677160 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd1c814fd30 con 0x7fd1c80ba850 2023-07-27T20:33:50.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.100+0000 7fd1affff700 1 -- 172.21.15.72:0/142677160 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v47) v1 ==== 105+0+11 (secure 0 0 0) 0x7fd1bc059110 con 0x7fd1c80ba850 2023-07-27T20:33:50.088 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:33:50.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.102+0000 7fd1cdfff700 1 -- 172.21.15.72:0/142677160 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd1b406ace0 msgr2=0x7fd1b406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:50.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.102+0000 7fd1cdfff700 1 --2- 172.21.15.72:0/142677160 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd1b406ace0 0x7fd1b406d1a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd1b80098d0 tx=0x7fd1b8008040 comp rx=0 tx=0).stop 2023-07-27T20:33:50.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.102+0000 7fd1cdfff700 1 -- 172.21.15.72:0/142677160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1c80ba850 msgr2=0x7fd1c80aa4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:50.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.102+0000 7fd1cdfff700 1 --2- 172.21.15.72:0/142677160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1c80ba850 0x7fd1c80aa4d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc000c00 tx=0x7fd1bc004750 comp rx=0 tx=0).stop 2023-07-27T20:33:50.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.102+0000 7fd1cdfff700 1 -- 172.21.15.72:0/142677160 shutdown_connections 2023-07-27T20:33:50.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.102+0000 7fd1cdfff700 1 --2- 172.21.15.72:0/142677160 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1c813b150 0x7fd1c81ed0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:50.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.102+0000 7fd1cdfff700 1 --2- 172.21.15.72:0/142677160 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd1b406ace0 0x7fd1b406d1a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:50.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.102+0000 7fd1cdfff700 1 --2- 172.21.15.72:0/142677160 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1c806e140 0x7fd1c8070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:50.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.102+0000 7fd1cdfff700 1 --2- 172.21.15.72:0/142677160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1c80ba850 0x7fd1c80aa4d0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:50.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.102+0000 7fd1cdfff700 1 -- 172.21.15.72:0/142677160 >> 172.21.15.72:0/142677160 conn(0x7fd1c806a190 msgr2=0x7fd1c8155cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:50.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.102+0000 7fd1cdfff700 1 -- 172.21.15.72:0/142677160 shutdown_connections 2023-07-27T20:33:50.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.102+0000 7fd1cdfff700 1 -- 172.21.15.72:0/142677160 wait complete. 2023-07-27T20:33:50.108 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-07-27T20:33:50.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.321+0000 7f1c7e3ff700 1 Processor -- start 2023-07-27T20:33:50.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.321+0000 7f1c7e3ff700 1 -- start start 2023-07-27T20:33:50.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.322+0000 7f1c7e3ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1c7806e140 0x7f1c780ba310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:50.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.322+0000 7f1c7e3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1c780ba850 0x7f1c7806d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:50.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.322+0000 7f1c7e3ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c7806ce10 con 0x7f1c7813b150 2023-07-27T20:33:50.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.322+0000 7f1c7e3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c78152680 con 0x7f1c780ba850 2023-07-27T20:33:50.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.322+0000 7f1c7e3ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c78152960 con 0x7f1c7806e140 2023-07-27T20:33:50.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.322+0000 7f1c7c99c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1c780ba850 0x7f1c7806d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:50.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.322+0000 7f1c7c99c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1c780ba850 0x7f1c7806d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57420/0 (socket says 172.21.15.72:57420) 2023-07-27T20:33:50.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.322+0000 7f1c7c99c700 1 -- 172.21.15.72:0/438588805 learned_addr learned my addr 172.21.15.72:0/438588805 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:50.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.323+0000 7f1c777fe700 1 --2- 172.21.15.72:0/438588805 >> v2:172.21.15.173:3300/0 conn(0x7f1c7806e140 0x7f1c780ba310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:50.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.323+0000 7f1c7c99c700 1 -- 172.21.15.72:0/438588805 >> v2:172.21.15.173:3300/0 conn(0x7f1c7806e140 msgr2=0x7f1c780ba310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:50.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.323+0000 7f1c7c99c700 1 --2- 172.21.15.72:0/438588805 >> v2:172.21.15.173:3300/0 conn(0x7f1c7806e140 0x7f1c780ba310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:50.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.323+0000 7f1c7c99c700 1 -- 172.21.15.72:0/438588805 >> v1:172.21.15.173:6789/0 conn(0x7f1c7813b150 legacy=0x7f1c78151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:50.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.323+0000 7f1c7c99c700 1 -- 172.21.15.72:0/438588805 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c78152c40 con 0x7f1c780ba850 2023-07-27T20:33:50.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.323+0000 7f1c7c99c700 1 --2- 172.21.15.72:0/438588805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c780ba850 0x7f1c7806d5d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f1c7806e0d0 tx=0x7f1c7000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=712e01ef424bda12 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:50.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.323+0000 7f1c76ffd700 1 -- 172.21.15.72:0/438588805 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7000e070 con 0x7f1c780ba850 2023-07-27T20:33:50.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.323+0000 7f1c76ffd700 1 -- 172.21.15.72:0/438588805 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c70003a20 con 0x7f1c780ba850 2023-07-27T20:33:50.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.323+0000 7f1c76ffd700 1 -- 172.21.15.72:0/438588805 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c70003dd0 con 0x7f1c780ba850 2023-07-27T20:33:50.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.324+0000 7f1c7e3ff700 1 -- 172.21.15.72:0/438588805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c780ba850 msgr2=0x7f1c7806d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:50.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.324+0000 7f1c7e3ff700 1 --2- 172.21.15.72:0/438588805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c780ba850 0x7f1c7806d5d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f1c7806e0d0 tx=0x7f1c7000b330 comp rx=0 tx=0).stop 2023-07-27T20:33:50.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.324+0000 7f1c7e3ff700 1 -- 172.21.15.72:0/438588805 shutdown_connections 2023-07-27T20:33:50.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.324+0000 7f1c7e3ff700 1 --2- 172.21.15.72:0/438588805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c780ba850 0x7f1c7806d5d0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:50.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.324+0000 7f1c7e3ff700 1 --2- 172.21.15.72:0/438588805 >> v2:172.21.15.173:3300/0 conn(0x7f1c7806e140 0x7f1c780ba310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:50.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.324+0000 7f1c7e3ff700 1 -- 172.21.15.72:0/438588805 >> 172.21.15.72:0/438588805 conn(0x7f1c7806a190 msgr2=0x7f1c7806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:50.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.324+0000 7f1c7e3ff700 1 -- 172.21.15.72:0/438588805 shutdown_connections 2023-07-27T20:33:50.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.324+0000 7f1c7e3ff700 1 -- 172.21.15.72:0/438588805 wait complete. 2023-07-27T20:33:50.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.326+0000 7f1c7e3ff700 1 Processor -- start 2023-07-27T20:33:50.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.326+0000 7f1c7e3ff700 1 -- start start 2023-07-27T20:33:50.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.327+0000 7f1c7e3ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c7806e140 0x7f1c78139dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:50.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.327+0000 7f1c7e3ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c780ba850 0x7f1c780aa7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:50.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.327+0000 7f1c7e3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c7813b150 0x7f1c780aad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:50.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.327+0000 7f1c7e3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c781ec810 con 0x7f1c7813b150 2023-07-27T20:33:50.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.327+0000 7f1c7e3ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c781ed670 con 0x7f1c7806e140 2023-07-27T20:33:50.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.327+0000 7f1c7e3ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c780ab240 con 0x7f1c780ba850 2023-07-27T20:33:50.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.327+0000 7f1c7c99c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c7813b150 0x7f1c780aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:50.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.327+0000 7f1c7c99c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c7813b150 0x7f1c780aad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57436/0 (socket says 172.21.15.72:57436) 2023-07-27T20:33:50.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.327+0000 7f1c7c99c700 1 -- 172.21.15.72:0/3296672997 learned_addr learned my addr 172.21.15.72:0/3296672997 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:50.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.327+0000 7f1c77fff700 1 --2- 172.21.15.72:0/3296672997 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c7806e140 0x7f1c78139dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:50.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.327+0000 7f1c777fe700 1 --2- 172.21.15.72:0/3296672997 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c780ba850 0x7f1c780aa7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:50.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.327+0000 7f1c7c99c700 1 -- 172.21.15.72:0/3296672997 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c780ba850 msgr2=0x7f1c780aa7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:50.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.327+0000 7f1c7c99c700 1 --2- 172.21.15.72:0/3296672997 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c780ba850 0x7f1c780aa7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:50.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.327+0000 7f1c7c99c700 1 -- 172.21.15.72:0/3296672997 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c7806e140 msgr2=0x7f1c78139dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:50.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.327+0000 7f1c7c99c700 1 --2- 172.21.15.72:0/3296672997 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c7806e140 0x7f1c78139dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:50.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.327+0000 7f1c7c99c700 1 -- 172.21.15.72:0/3296672997 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c70009b30 con 0x7f1c7813b150 2023-07-27T20:33:50.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.328+0000 7f1c7c99c700 1 --2- 172.21.15.72:0/3296672997 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c7813b150 0x7f1c780aad00 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f1c7000b370 tx=0x7f1c70004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:50.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.328+0000 7f1c74ff9700 1 -- 172.21.15.72:0/3296672997 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c70004440 con 0x7f1c7813b150 2023-07-27T20:33:50.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.328+0000 7f1c74ff9700 1 -- 172.21.15.72:0/3296672997 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c700092e0 con 0x7f1c7813b150 2023-07-27T20:33:50.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.328+0000 7f1c7e3ff700 1 -- 172.21.15.72:0/3296672997 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c781eca60 con 0x7f1c7813b150 2023-07-27T20:33:50.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.328+0000 7f1c74ff9700 1 -- 172.21.15.72:0/3296672997 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c70004800 con 0x7f1c7813b150 2023-07-27T20:33:50.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.328+0000 7f1c7e3ff700 1 -- 172.21.15.72:0/3296672997 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c781ed020 con 0x7f1c7813b150 2023-07-27T20:33:50.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.329+0000 7f1c7e3ff700 1 -- 172.21.15.72:0/3296672997 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c7804e470 con 0x7f1c7813b150 2023-07-27T20:33:50.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.330+0000 7f1c74ff9700 1 -- 172.21.15.72:0/3296672997 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1c70012430 con 0x7f1c7813b150 2023-07-27T20:33:50.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.331+0000 7f1c74ff9700 1 --2- 172.21.15.72:0/3296672997 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1c6406ace0 0x7f1c6406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:50.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.331+0000 7f1c74ff9700 1 -- 172.21.15.72:0/3296672997 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f1c7008ac40 con 0x7f1c7813b150 2023-07-27T20:33:50.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.332+0000 7f1c77fff700 1 --2- 172.21.15.72:0/3296672997 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1c6406ace0 0x7f1c6406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:50.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.332+0000 7f1c77fff700 1 --2- 172.21.15.72:0/3296672997 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1c6406ace0 0x7f1c6406d1a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1c7813a670 tx=0x7f1c680090e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:50.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.335+0000 7f1c74ff9700 1 -- 172.21.15.72:0/3296672997 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1c70055830 con 0x7f1c7813b150 2023-07-27T20:33:50.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.529+0000 7f1c7e3ff700 1 -- 172.21.15.72:0/3296672997 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f1c780bfdb0 con 0x7f1c7813b150 2023-07-27T20:33:50.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.530+0000 7f1c74ff9700 1 -- 172.21.15.72:0/3296672997 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v47) v1 ==== 101+0+11 (secure 0 0 0) 0x7f1c70007310 con 0x7f1c7813b150 2023-07-27T20:33:50.518 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-27T20:33:50.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.532+0000 7f1c7e3ff700 1 -- 172.21.15.72:0/3296672997 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1c6406ace0 msgr2=0x7f1c6406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:50.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.532+0000 7f1c7e3ff700 1 --2- 172.21.15.72:0/3296672997 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1c6406ace0 0x7f1c6406d1a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1c7813a670 tx=0x7f1c680090e0 comp rx=0 tx=0).stop 2023-07-27T20:33:50.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.532+0000 7f1c7e3ff700 1 -- 172.21.15.72:0/3296672997 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c7813b150 msgr2=0x7f1c780aad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:50.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.532+0000 7f1c7e3ff700 1 --2- 172.21.15.72:0/3296672997 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c7813b150 0x7f1c780aad00 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f1c7000b370 tx=0x7f1c70004ad0 comp rx=0 tx=0).stop 2023-07-27T20:33:50.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.532+0000 7f1c7e3ff700 1 -- 172.21.15.72:0/3296672997 shutdown_connections 2023-07-27T20:33:50.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.532+0000 7f1c7e3ff700 1 --2- 172.21.15.72:0/3296672997 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c7813b150 0x7f1c780aad00 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:50.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.532+0000 7f1c7e3ff700 1 --2- 172.21.15.72:0/3296672997 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c7806e140 0x7f1c78139dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:50.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.532+0000 7f1c7e3ff700 1 --2- 172.21.15.72:0/3296672997 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1c6406ace0 0x7f1c6406d1a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:50.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.532+0000 7f1c7e3ff700 1 --2- 172.21.15.72:0/3296672997 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c780ba850 0x7f1c780aa7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:50.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.532+0000 7f1c7e3ff700 1 -- 172.21.15.72:0/3296672997 >> 172.21.15.72:0/3296672997 conn(0x7f1c7806a190 msgr2=0x7f1c7806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:50.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.532+0000 7f1c7e3ff700 1 -- 172.21.15.72:0/3296672997 shutdown_connections 2023-07-27T20:33:50.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.532+0000 7f1c7e3ff700 1 -- 172.21.15.72:0/3296672997 wait complete. 2023-07-27T20:33:50.538 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-27T20:33:50.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.746+0000 7f5dca5ff700 1 Processor -- start 2023-07-27T20:33:50.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.746+0000 7f5dca5ff700 1 -- start start 2023-07-27T20:33:50.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.748+0000 7f5dca5ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f5dc40c12d0 0x7f5dc41549f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:50.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.748+0000 7f5dca5ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dc4139d40 con 0x7f5dc4139960 2023-07-27T20:33:50.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.748+0000 7f5dca5ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dc4151060 con 0x7f5dc4139f80 2023-07-27T20:33:50.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.748+0000 7f5dca5ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc40c0ee0 con 0x7f5dc40c12d0 2023-07-27T20:33:50.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.748+0000 7f5dc3fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5dc4139960 0x7f5dc40c1e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42322/0 (socket says 172.21.15.72:42322) 2023-07-27T20:33:50.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.748+0000 7f5dc3fff700 1 -- 172.21.15.72:0/2944342555 learned_addr learned my addr 172.21.15.72:0/2944342555 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:50.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.748+0000 7f5dc8b9c700 1 --2- 172.21.15.72:0/2944342555 >> v2:172.21.15.173:3300/0 conn(0x7f5dc40c12d0 0x7f5dc41549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:50.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.748+0000 7f5dc2ffd700 1 -- 172.21.15.72:0/2944342555 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1540029108 0 0) 0x7f5dc4139d40 con 0x7f5dc4139960 2023-07-27T20:33:50.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.748+0000 7f5dc2ffd700 1 -- 172.21.15.72:0/2944342555 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dac0035b0 con 0x7f5dc4139960 2023-07-27T20:33:50.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.749+0000 7f5dc2ffd700 1 -- 172.21.15.72:0/2944342555 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4282534967 0 0) 0x7f5dac0035b0 con 0x7f5dc4139960 2023-07-27T20:33:50.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.749+0000 7f5dc2ffd700 1 -- 172.21.15.72:0/2944342555 >> v2:172.21.15.173:3300/0 conn(0x7f5dc40c12d0 msgr2=0x7f5dc41549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:50.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.749+0000 7f5dc2ffd700 1 --2- 172.21.15.72:0/2944342555 >> v2:172.21.15.173:3300/0 conn(0x7f5dc40c12d0 0x7f5dc41549f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:50.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.749+0000 7f5dc2ffd700 1 -- 172.21.15.72:0/2944342555 >> v1:172.21.15.173:6789/0 conn(0x7f5dc4139f80 legacy=0x7f5dc41542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:50.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.749+0000 7f5dc2ffd700 1 -- 172.21.15.72:0/2944342555 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc4151340 con 0x7f5dc4139960 2023-07-27T20:33:50.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.749+0000 7f5dc2ffd700 1 -- 172.21.15.72:0/2944342555 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f5db4001670 con 0x7f5dc4139960 2023-07-27T20:33:50.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.749+0000 7f5dc2ffd700 1 -- 172.21.15.72:0/2944342555 >> v1:172.21.15.72:6789/0 conn(0x7f5dc4139960 legacy=0x7f5dc40c1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:50.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.749+0000 7f5dc2ffd700 1 --2- 172.21.15.72:0/2944342555 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5dac003a50 0x7f5dac003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:50.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.749+0000 7f5dc2ffd700 1 --2- 172.21.15.72:0/2944342555 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5dac004850 0x7f5dac004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:50.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.749+0000 7f5dc2ffd700 1 --2- 172.21.15.72:0/2944342555 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dac005260 0x7f5dac00dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:50.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.749+0000 7f5dc2ffd700 1 -- 172.21.15.72:0/2944342555 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc40c0ee0 con 0x7f5dac005260 2023-07-27T20:33:50.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.749+0000 7f5dc2ffd700 1 -- 172.21.15.72:0/2944342555 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac00e3c0 con 0x7f5dac004850 2023-07-27T20:33:50.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.749+0000 7f5dc2ffd700 1 -- 172.21.15.72:0/2944342555 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac00e580 con 0x7f5dac003a50 2023-07-27T20:33:50.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.749+0000 7f5dc8b9c700 1 --2- 172.21.15.72:0/2944342555 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dac005260 0x7f5dac00dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:50.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.749+0000 7f5dc3fff700 1 --2- 172.21.15.72:0/2944342555 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5dac003a50 0x7f5dac003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:50.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.749+0000 7f5dc37fe700 1 --2- 172.21.15.72:0/2944342555 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5dac004850 0x7f5dac004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:50.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.750+0000 7f5dc8b9c700 1 -- 172.21.15.72:0/2944342555 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5dac003a50 msgr2=0x7f5dac003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:50.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.750+0000 7f5dc8b9c700 1 --2- 172.21.15.72:0/2944342555 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5dac003a50 0x7f5dac003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:50.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.750+0000 7f5dc8b9c700 1 -- 172.21.15.72:0/2944342555 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5dac004850 msgr2=0x7f5dac004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:50.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.750+0000 7f5dc8b9c700 1 --2- 172.21.15.72:0/2944342555 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5dac004850 0x7f5dac004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:50.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.750+0000 7f5dc8b9c700 1 -- 172.21.15.72:0/2944342555 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dac0035b0 con 0x7f5dac005260 2023-07-27T20:33:50.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.750+0000 7f5dc8b9c700 1 -- 172.21.15.72:0/2944342555 reap_dead start 2023-07-27T20:33:50.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.750+0000 7f5dc8b9c700 1 --2- 172.21.15.72:0/2944342555 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dac005260 0x7f5dac00dc20 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc009f90 tx=0x7f5dac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=376e8fe59998c4ff server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:50.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.750+0000 7f5dc2ffd700 1 -- 172.21.15.72:0/2944342555 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc003a20 con 0x7f5dac005260 2023-07-27T20:33:50.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.750+0000 7f5dc2ffd700 1 -- 172.21.15.72:0/2944342555 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dbc00f040 con 0x7f5dac005260 2023-07-27T20:33:50.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.750+0000 7f5dc2ffd700 1 -- 172.21.15.72:0/2944342555 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc003de0 con 0x7f5dac005260 2023-07-27T20:33:50.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.750+0000 7f5dca5ff700 1 -- 172.21.15.72:0/2944342555 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dac005260 msgr2=0x7f5dac00dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:50.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.750+0000 7f5dca5ff700 1 --2- 172.21.15.72:0/2944342555 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dac005260 0x7f5dac00dc20 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc009f90 tx=0x7f5dac005880 comp rx=0 tx=0).stop 2023-07-27T20:33:50.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.751+0000 7f5dca5ff700 1 -- 172.21.15.72:0/2944342555 shutdown_connections 2023-07-27T20:33:50.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.751+0000 7f5dca5ff700 1 --2- 172.21.15.72:0/2944342555 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dac005260 0x7f5dac00dc20 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:50.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.751+0000 7f5dca5ff700 1 -- 172.21.15.72:0/2944342555 >> 172.21.15.72:0/2944342555 conn(0x7f5dc406a190 msgr2=0x7f5dc406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:50.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.751+0000 7f5dca5ff700 1 -- 172.21.15.72:0/2944342555 shutdown_connections 2023-07-27T20:33:50.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.751+0000 7f5dca5ff700 1 -- 172.21.15.72:0/2944342555 wait complete. 2023-07-27T20:33:50.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.752+0000 7f5dca5ff700 1 Processor -- start 2023-07-27T20:33:50.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.753+0000 7f5dca5ff700 1 -- start start 2023-07-27T20:33:50.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.753+0000 7f5dca5ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5dac005260 0x7f5dc40aa8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:50.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.753+0000 7f5dca5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dc414dc30 0x7f5dc414fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:50.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.753+0000 7f5dca5ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5dc412ecb0 0x7f5dc41e8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:50.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.753+0000 7f5dca5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc40aa430 con 0x7f5dc414dc30 2023-07-27T20:33:50.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.753+0000 7f5dca5ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc414e180 con 0x7f5dac005260 2023-07-27T20:33:50.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.753+0000 7f5dca5ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc4130b20 con 0x7f5dc412ecb0 2023-07-27T20:33:50.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.754+0000 7f5dc37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dc414dc30 0x7f5dc414fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:50.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.754+0000 7f5dc37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dc414dc30 0x7f5dc414fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57448/0 (socket says 172.21.15.72:57448) 2023-07-27T20:33:50.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.754+0000 7f5dc37fe700 1 -- 172.21.15.72:0/3509171013 learned_addr learned my addr 172.21.15.72:0/3509171013 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:50.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.754+0000 7f5dc3fff700 1 --2- 172.21.15.72:0/3509171013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5dac005260 0x7f5dc40aa8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:50.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.754+0000 7f5dc8b9c700 1 --2- 172.21.15.72:0/3509171013 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5dc412ecb0 0x7f5dc41e8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:50.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.754+0000 7f5dc37fe700 1 -- 172.21.15.72:0/3509171013 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5dc412ecb0 msgr2=0x7f5dc41e8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:50.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.754+0000 7f5dc37fe700 1 --2- 172.21.15.72:0/3509171013 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5dc412ecb0 0x7f5dc41e8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:50.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.754+0000 7f5dc37fe700 1 -- 172.21.15.72:0/3509171013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5dac005260 msgr2=0x7f5dc40aa8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:50.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.754+0000 7f5dc37fe700 1 --2- 172.21.15.72:0/3509171013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5dac005260 0x7f5dc40aa8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:50.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.754+0000 7f5dc37fe700 1 -- 172.21.15.72:0/3509171013 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc40a9b00 con 0x7f5dc414dc30 2023-07-27T20:33:50.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.754+0000 7f5dc3fff700 1 --2- 172.21.15.72:0/3509171013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5dac005260 0x7f5dc40aa8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:33:50.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.754+0000 7f5dc37fe700 1 --2- 172.21.15.72:0/3509171013 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dc414dc30 0x7f5dc414fa00 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f5db800f610 tx=0x7f5db800f9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:50.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.755+0000 7f5dc0ff9700 1 -- 172.21.15.72:0/3509171013 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db80052e0 con 0x7f5dc414dc30 2023-07-27T20:33:50.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.755+0000 7f5dc0ff9700 1 -- 172.21.15.72:0/3509171013 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db8005440 con 0x7f5dc414dc30 2023-07-27T20:33:50.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.755+0000 7f5dc0ff9700 1 -- 172.21.15.72:0/3509171013 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db80038a0 con 0x7f5dc414dc30 2023-07-27T20:33:50.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.755+0000 7f5dca5ff700 1 -- 172.21.15.72:0/3509171013 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dc40a9de0 con 0x7f5dc414dc30 2023-07-27T20:33:50.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.755+0000 7f5dca5ff700 1 -- 172.21.15.72:0/3509171013 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc414ff40 con 0x7f5dc414dc30 2023-07-27T20:33:50.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.756+0000 7f5dca5ff700 1 -- 172.21.15.72:0/3509171013 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dc4074310 con 0x7f5dc414dc30 2023-07-27T20:33:50.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.757+0000 7f5dc0ff9700 1 -- 172.21.15.72:0/3509171013 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5db8003a00 con 0x7f5dc414dc30 2023-07-27T20:33:50.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.757+0000 7f5dc0ff9700 1 --2- 172.21.15.72:0/3509171013 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5db006ace0 0x7f5db006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:50.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.758+0000 7f5dc0ff9700 1 -- 172.21.15.72:0/3509171013 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f5db80895e0 con 0x7f5dc414dc30 2023-07-27T20:33:50.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.758+0000 7f5dc3fff700 1 --2- 172.21.15.72:0/3509171013 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5db006ace0 0x7f5db006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:50.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.759+0000 7f5dc3fff700 1 --2- 172.21.15.72:0/3509171013 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5db006ace0 0x7f5db006d1a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5db4000c00 tx=0x7f5db4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:50.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.762+0000 7f5dc0ff9700 1 -- 172.21.15.72:0/3509171013 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5db8054250 con 0x7f5dc414dc30 2023-07-27T20:33:50.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.970+0000 7f5dca5ff700 1 -- 172.21.15.72:0/3509171013 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5dc40bf570 con 0x7f5dc414dc30 2023-07-27T20:33:50.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.970+0000 7f5dc0ff9700 1 -- 172.21.15.72:0/3509171013 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v47) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5db8003cb0 con 0x7f5dc414dc30 2023-07-27T20:33:50.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.972+0000 7f5dca5ff700 1 -- 172.21.15.72:0/3509171013 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5db006ace0 msgr2=0x7f5db006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:50.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.972+0000 7f5dca5ff700 1 --2- 172.21.15.72:0/3509171013 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5db006ace0 0x7f5db006d1a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5db4000c00 tx=0x7f5db4009040 comp rx=0 tx=0).stop 2023-07-27T20:33:50.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.972+0000 7f5dca5ff700 1 -- 172.21.15.72:0/3509171013 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dc414dc30 msgr2=0x7f5dc414fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:50.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.972+0000 7f5dca5ff700 1 --2- 172.21.15.72:0/3509171013 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dc414dc30 0x7f5dc414fa00 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f5db800f610 tx=0x7f5db800f9d0 comp rx=0 tx=0).stop 2023-07-27T20:33:50.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.972+0000 7f5dca5ff700 1 -- 172.21.15.72:0/3509171013 shutdown_connections 2023-07-27T20:33:50.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.972+0000 7f5dca5ff700 1 --2- 172.21.15.72:0/3509171013 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5db006ace0 0x7f5db006d1a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:50.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.972+0000 7f5dca5ff700 1 --2- 172.21.15.72:0/3509171013 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5dc412ecb0 0x7f5dc41e8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:50.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.972+0000 7f5dca5ff700 1 --2- 172.21.15.72:0/3509171013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5dac005260 0x7f5dc40aa8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:50.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.972+0000 7f5dca5ff700 1 --2- 172.21.15.72:0/3509171013 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dc414dc30 0x7f5dc414fa00 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:50.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.972+0000 7f5dca5ff700 1 -- 172.21.15.72:0/3509171013 >> 172.21.15.72:0/3509171013 conn(0x7f5dc406a190 msgr2=0x7f5dc406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:50.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.973+0000 7f5dca5ff700 1 -- 172.21.15.72:0/3509171013 shutdown_connections 2023-07-27T20:33:50.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:50.973+0000 7f5dca5ff700 1 -- 172.21.15.72:0/3509171013 wait complete. 2023-07-27T20:33:50.963 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-07-27T20:33:50.980 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi072.front.sepia.ceph.com... 2023-07-27T20:33:50.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:50.981 DEBUG:teuthology.orchestra.run.smithi072:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-07-27T20:33:51.049 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:ceph-fuse[159444]: fuse finished with error 0 and tester_r 0 2023-07-27T20:33:51.052 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T20:33:51.610 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:33:51.615 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:33:57.154 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2023-07-27T20:33:57.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:57.155 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-27T20:33:57.207 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-27T20:33:57.208 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-27T20:33:57.256 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345404k,nr_inodes=4086351,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=37,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3274976k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 2023-07-27T20:33:57.256 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-27T20:33:57.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.505+0000 7f45bc3ff700 1 Processor -- start 2023-07-27T20:33:57.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.505+0000 7f45bc3ff700 1 -- start start 2023-07-27T20:33:57.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.506+0000 7f45bc3ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f45b4139960 0x7f45b40c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:57.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.506+0000 7f45bc3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f45b4139f80 0x7f45b40c1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:57.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.506+0000 7f45bc3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45b40c1810 con 0x7f45b40c2340 2023-07-27T20:33:57.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.506+0000 7f45bc3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45b40c0ee0 con 0x7f45b4139f80 2023-07-27T20:33:57.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.506+0000 7f45bc3ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b4139d40 con 0x7f45b4139960 2023-07-27T20:33:57.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.507+0000 7f45b999a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f45b4139f80 0x7f45b40c1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:57.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.507+0000 7f45ba99c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f45b40c2340 0x7f45b41542e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42330/0 (socket says 172.21.15.72:42330) 2023-07-27T20:33:57.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.507+0000 7f45ba99c700 1 -- 172.21.15.72:0/1161146611 learned_addr learned my addr 172.21.15.72:0/1161146611 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:33:57.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.507+0000 7f45ba19b700 1 --2- 172.21.15.72:0/1161146611 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f45b4139960 0x7f45b40c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:57.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.507+0000 7f45b999a700 1 -- 172.21.15.72:0/1161146611 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f45b4139960 msgr2=0x7f45b40c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:33:57.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.507+0000 7f45b999a700 1 --2- 172.21.15.72:0/1161146611 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f45b4139960 0x7f45b40c12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:57.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.507+0000 7f45b9199700 1 -- 172.21.15.72:0/1161146611 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1122448140 0 0) 0x7f45b40c1810 con 0x7f45b40c2340 2023-07-27T20:33:57.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.507+0000 7f45b999a700 1 -- 172.21.15.72:0/1161146611 >> v1:172.21.15.72:6789/0 conn(0x7f45b40c2340 legacy=0x7f45b41542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:57.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.507+0000 7f45b999a700 1 -- 172.21.15.72:0/1161146611 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b4151060 con 0x7f45b4139f80 2023-07-27T20:33:57.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.507+0000 7f45ba19b700 1 --2- 172.21.15.72:0/1161146611 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f45b4139960 0x7f45b40c12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:33:57.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.508+0000 7f45b999a700 1 --2- 172.21.15.72:0/1161146611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45b4139f80 0x7f45b40c1e00 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f45a4009840 tx=0x7f45a4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaa34d52e3c88f37 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:57.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.508+0000 7f45b9199700 1 -- 172.21.15.72:0/1161146611 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a4011830 con 0x7f45b4139f80 2023-07-27T20:33:57.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.508+0000 7f45b9199700 1 -- 172.21.15.72:0/1161146611 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a4011990 con 0x7f45b4139f80 2023-07-27T20:33:57.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.508+0000 7f45b9199700 1 -- 172.21.15.72:0/1161146611 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a4011d20 con 0x7f45b4139f80 2023-07-27T20:33:57.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.508+0000 7f45bc3ff700 1 -- 172.21.15.72:0/1161146611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45b4139f80 msgr2=0x7f45b40c1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:57.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.508+0000 7f45bc3ff700 1 --2- 172.21.15.72:0/1161146611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45b4139f80 0x7f45b40c1e00 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f45a4009840 tx=0x7f45a4009b50 comp rx=0 tx=0).stop 2023-07-27T20:33:57.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.508+0000 7f45bc3ff700 1 -- 172.21.15.72:0/1161146611 shutdown_connections 2023-07-27T20:33:57.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.508+0000 7f45bc3ff700 1 --2- 172.21.15.72:0/1161146611 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f45b4139960 0x7f45b40c12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:57.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.508+0000 7f45bc3ff700 1 --2- 172.21.15.72:0/1161146611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45b4139f80 0x7f45b40c1e00 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:57.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.508+0000 7f45bc3ff700 1 -- 172.21.15.72:0/1161146611 >> 172.21.15.72:0/1161146611 conn(0x7f45b406a190 msgr2=0x7f45b406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:57.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.509+0000 7f45bc3ff700 1 -- 172.21.15.72:0/1161146611 shutdown_connections 2023-07-27T20:33:57.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.509+0000 7f45bc3ff700 1 -- 172.21.15.72:0/1161146611 wait complete. 2023-07-27T20:33:57.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.510+0000 7f45bc3ff700 1 Processor -- start 2023-07-27T20:33:57.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.510+0000 7f45bc3ff700 1 -- start start 2023-07-27T20:33:57.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.511+0000 7f45bc3ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f45b40c2340 0x7f45b40c4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:57.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.511+0000 7f45bc3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45b4139960 0x7f45b4131120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:57.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.511+0000 7f45bc3ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45b4139f80 0x7f45b4133ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:57.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.511+0000 7f45bc3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b4135080 con 0x7f45b4139960 2023-07-27T20:33:57.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.511+0000 7f45bc3ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b4134e70 con 0x7f45b4139f80 2023-07-27T20:33:57.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.511+0000 7f45bc3ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b40ab450 con 0x7f45b40c2340 2023-07-27T20:33:57.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.511+0000 7f45b999a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45b4139960 0x7f45b4131120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:57.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.511+0000 7f45b999a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45b4139960 0x7f45b4131120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57464/0 (socket says 172.21.15.72:57464) 2023-07-27T20:33:57.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.511+0000 7f45b999a700 1 -- 172.21.15.72:0/1736599960 learned_addr learned my addr 172.21.15.72:0/1736599960 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:33:57.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.512+0000 7f45ba19b700 1 --2- 172.21.15.72:0/1736599960 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f45b40c2340 0x7f45b40c4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:57.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.512+0000 7f45ba99c700 1 --2- 172.21.15.72:0/1736599960 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45b4139f80 0x7f45b4133ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:57.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.512+0000 7f45b999a700 1 -- 172.21.15.72:0/1736599960 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f45b40c2340 msgr2=0x7f45b40c4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:57.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.512+0000 7f45b999a700 1 --2- 172.21.15.72:0/1736599960 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f45b40c2340 0x7f45b40c4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:57.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.512+0000 7f45b999a700 1 -- 172.21.15.72:0/1736599960 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45b4139f80 msgr2=0x7f45b4133ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:57.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.512+0000 7f45b999a700 1 --2- 172.21.15.72:0/1736599960 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45b4139f80 0x7f45b4133ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:57.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.512+0000 7f45b999a700 1 -- 172.21.15.72:0/1736599960 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a40094a0 con 0x7f45b4139960 2023-07-27T20:33:57.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.512+0000 7f45ba19b700 1 --2- 172.21.15.72:0/1736599960 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f45b40c2340 0x7f45b40c4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:33:57.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.512+0000 7f45ba99c700 1 --2- 172.21.15.72:0/1736599960 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45b4139f80 0x7f45b4133ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:33:57.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.512+0000 7f45b999a700 1 --2- 172.21.15.72:0/1736599960 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45b4139960 0x7f45b4131120 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f45a40090b0 tx=0x7f45a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:57.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.512+0000 7f45aaffd700 1 -- 172.21.15.72:0/1736599960 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a40038a0 con 0x7f45b4139960 2023-07-27T20:33:57.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.512+0000 7f45aaffd700 1 -- 172.21.15.72:0/1736599960 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a4003a00 con 0x7f45b4139960 2023-07-27T20:33:57.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.512+0000 7f45bc3ff700 1 -- 172.21.15.72:0/1736599960 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45b40aadd0 con 0x7f45b4139960 2023-07-27T20:33:57.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.512+0000 7f45aaffd700 1 -- 172.21.15.72:0/1736599960 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a4003d90 con 0x7f45b4139960 2023-07-27T20:33:57.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.512+0000 7f45bc3ff700 1 -- 172.21.15.72:0/1736599960 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45b414df60 con 0x7f45b4139960 2023-07-27T20:33:57.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.513+0000 7f45bc3ff700 1 -- 172.21.15.72:0/1736599960 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45b4133c00 con 0x7f45b4139960 2023-07-27T20:33:57.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.514+0000 7f45aaffd700 1 -- 172.21.15.72:0/1736599960 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f45a401a420 con 0x7f45b4139960 2023-07-27T20:33:57.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.515+0000 7f45aaffd700 1 --2- 172.21.15.72:0/1736599960 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f459806ace0 0x7f459806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:33:57.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.515+0000 7f45aaffd700 1 -- 172.21.15.72:0/1736599960 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f45a408ae90 con 0x7f45b4139960 2023-07-27T20:33:57.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.516+0000 7f45ba19b700 1 --2- 172.21.15.72:0/1736599960 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f459806ace0 0x7f459806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:33:57.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.516+0000 7f45ba19b700 1 --2- 172.21.15.72:0/1736599960 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f459806ace0 0x7f459806d1a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f45b0008910 tx=0x7f45b0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:33:57.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.520+0000 7f45aaffd700 1 -- 172.21.15.72:0/1736599960 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f45b4133c00 con 0x7f45b4139960 2023-07-27T20:33:57.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.756+0000 7f45bc3ff700 1 -- 172.21.15.72:0/1736599960 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f45b4133c00 con 0x7f45b4139960 2023-07-27T20:33:57.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.756+0000 7f45aaffd700 1 -- 172.21.15.72:0/1736599960 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) v1 ==== 53+0+149 (secure 0 0 0) 0x7f45a408c0b0 con 0x7f45b4139960 2023-07-27T20:33:57.744 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-27T20:33:57.744 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-07-27T20:33:57.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.758+0000 7f45bc3ff700 1 -- 172.21.15.72:0/1736599960 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f459806ace0 msgr2=0x7f459806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:57.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.759+0000 7f45bc3ff700 1 --2- 172.21.15.72:0/1736599960 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f459806ace0 0x7f459806d1a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f45b0008910 tx=0x7f45b0008040 comp rx=0 tx=0).stop 2023-07-27T20:33:57.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.759+0000 7f45bc3ff700 1 -- 172.21.15.72:0/1736599960 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45b4139960 msgr2=0x7f45b4131120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:33:57.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.759+0000 7f45bc3ff700 1 --2- 172.21.15.72:0/1736599960 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45b4139960 0x7f45b4131120 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f45a40090b0 tx=0x7f45a4004750 comp rx=0 tx=0).stop 2023-07-27T20:33:57.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.759+0000 7f45bc3ff700 1 -- 172.21.15.72:0/1736599960 shutdown_connections 2023-07-27T20:33:57.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.759+0000 7f45bc3ff700 1 --2- 172.21.15.72:0/1736599960 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45b4139f80 0x7f45b4133ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:57.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.759+0000 7f45bc3ff700 1 --2- 172.21.15.72:0/1736599960 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f459806ace0 0x7f459806d1a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:57.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.759+0000 7f45bc3ff700 1 --2- 172.21.15.72:0/1736599960 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f45b40c2340 0x7f45b40c4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:57.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.759+0000 7f45bc3ff700 1 --2- 172.21.15.72:0/1736599960 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45b4139960 0x7f45b4131120 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:33:57.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.759+0000 7f45bc3ff700 1 -- 172.21.15.72:0/1736599960 >> 172.21.15.72:0/1736599960 conn(0x7f45b406a190 msgr2=0x7f45b406ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:33:57.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.759+0000 7f45bc3ff700 1 -- 172.21.15.72:0/1736599960 shutdown_connections 2023-07-27T20:33:57.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:33:57.759+0000 7f45bc3ff700 1 -- 172.21.15.72:0/1736599960 wait complete. 2023-07-27T20:33:57.764 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-07-27T20:33:57.764 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T20:33:57.764 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2023-07-27T20:33:57.765 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-07-27T20:33:57.765 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-27T20:33:57.765 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-07-27T20:33:57.766 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-27T20:33:57.766 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.tsDiA5H6Cu 2023-07-27T20:33:57.766 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2023-07-27T20:33:57.812 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.2FxT0Zr02f 2023-07-27T20:33:57.812 DEBUG:teuthology.orchestra.run.smithi072:> sudo cp /tmp/tmp.tsDiA5H6Cu /tmp/tmp.2FxT0Zr02f 2023-07-27T20:33:57.922 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.2FxT0Zr02f 2023-07-27T20:33:58.043 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.2FxT0Zr02f is 185B 2023-07-27T20:33:58.095 DEBUG:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.2FxT0Zr02f 2023-07-27T20:33:58.139 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQCn1MJkAGojJxAA55AIUV1ozmpefEQJz6pu4Q== caps mds = "allow rw fsname=cephfs" caps mon = "allow r fsname=cephfs" caps osd = "allow rw tag cephfs data=cephfs" 2023-07-27T20:33:58.140 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-27T20:33:58.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:58.141 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2023-07-27T20:33:58.226 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T20:33:58.227 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T20:33:58.227 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T20:33:58.227 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:33:58.227 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-07-27T20:33:58.227 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:33:58.227 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T20:33:58.227 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2023-07-27T20:33:58.228 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f0 2023-07-27T20:33:58.228 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T20:33:58.228 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2023-07-27T20:33:58.228 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f1 2023-07-27T20:33:58.228 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T20:33:58.228 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2023-07-27T20:33:58.229 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T20:33:58.229 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2023-07-27T20:33:58.229 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T20:33:58.229 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 39846sec preferred_lft 39846sec 2023-07-27T20:33:58.229 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2023-07-27T20:33:58.229 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:33:58.229 INFO:teuthology.orchestra.run.smithi072.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-27T20:33:58.229 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0a:3b:6c:6f:2b:36 brd ff:ff:ff:ff:ff:ff 2023-07-27T20:33:58.230 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-27T20:33:58.230 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:33:58.230 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::f80c:f1ff:fe0e:35f4/64 scope link 2023-07-27T20:33:58.230 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:33:58.230 INFO:teuthology.orchestra.run.smithi072.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T20:33:58.230 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0a:3b:6c:6f:2b:36 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-27T20:33:58.230 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::83b:6cff:fe6f:2b36/64 scope link 2023-07-27T20:33:58.231 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:33:58.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:58.232 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T20:33:58.299 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-07-27T20:33:58.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:58.303 DEBUG:teuthology.orchestra.run.smithi072:> route 2023-07-27T20:33:58.351 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2023-07-27T20:33:58.351 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T20:33:58.351 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T20:33:58.352 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T20:33:58.352 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T20:33:58.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:58.354 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-07-27T20:33:58.354 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-07-27T20:33:58.354 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T20:33:58.354 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T20:33:58.355 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T20:33:58.355 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-07-27T20:33:58.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:58.524 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-07-27T20:33:58.571 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-27T20:33:58.573 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-27T20:33:58.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:58.574 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2023-07-27T20:33:58.645 INFO:tasks.cephfs.fuse_mount:Client client.testuser config is {} 2023-07-27T20:33:58.645 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-27T20:33:58.646 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-27T20:33:58.692 INFO:teuthology.orchestra.run.smithi072.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-27T20:33:58.692 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-27T20:33:58.693 DEBUG:teuthology.orchestra.run.smithi072:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-27T20:33:58.777 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-07-27T20:33:58.887 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-27T20:33:58.887 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-27T20:33:58.955 INFO:teuthology.orchestra.run.smithi072.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-27T20:33:58.958 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-27T20:33:58.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:58.959 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-07-27T20:33:59.005 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-27T20:33:59.005 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id testuser -k /tmp/tmp.tsDiA5H6Cu --client_fs=cephfs2) 2023-07-27T20:33:59.049 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-07-27T20:33:59.119 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-27T20:33:59.120 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-27T20:33:59.189 INFO:teuthology.orchestra.run.smithi072.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-27T20:33:59.191 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-27T20:33:59.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:33:59.192 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-07-27T20:33:59.216 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:2023-07-27T20:33:59.228+0000 7f907e6e25c0 -1 init, newargv = 0x557db7cdd5b0 newargc=15 2023-07-27T20:33:59.216 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:ceph-fuse[163011]: starting ceph client 2023-07-27T20:33:59.219 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:ceph-fuse[2023-07-27T20:33:59.232+0000 7f907e6e25c0 -1 client.6000 mdsmap subscription failed: (2) No such file or directory 2023-07-27T20:33:59.219 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:163011]: ceph mount failed with (2) No such file or directory 2023-07-27T20:33:59.386 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:daemon-helper: command failed with exit status 1 2023-07-27T20:34:00.341 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-07-27T20:34:00.417 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-27T20:34:00.418 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-27T20:34:00.486 INFO:teuthology.orchestra.run.smithi072.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-27T20:34:00.488 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-27T20:34:00.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:34:00.489 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-07-27T20:34:00.535 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-27T20:34:00.535 INFO:tasks.cephfs.fuse_mount:mount command failed. 2023-07-27T20:34:00.536 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-27T20:34:00.537 DEBUG:teuthology.orchestra.run.smithi072:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T20:34:00.669 DEBUG:teuthology.orchestra.run.smithi173:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T20:34:00.769 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-27T20:34:00.770 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-27T20:34:00.770 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-27T20:34:00.816 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345404k,nr_inodes=4086351,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=37,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3274976k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 2023-07-27T20:34:00.816 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2023-07-27T20:34:00.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:34:00.817 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-27T20:34:00.903 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-07-27T20:34:00.903 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-27T20:34:00.953 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:34:01.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.163+0000 7fa567bff700 1 Processor -- start 2023-07-27T20:34:01.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.163+0000 7fa567bff700 1 -- start start 2023-07-27T20:34:01.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.164+0000 7fa567bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa56013b2c0 0x7fa5600aa420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:01.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.164+0000 7fa567bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5600bfd90 0x7fa5600aa960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:01.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.164+0000 7fa567bff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5600aaea0 con 0x7fa5600a83a0 2023-07-27T20:34:01.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.164+0000 7fa567bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5600a9620 con 0x7fa56013b2c0 2023-07-27T20:34:01.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.164+0000 7fa567bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa560155600 con 0x7fa5600bfd90 2023-07-27T20:34:01.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.165+0000 7fa56599b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa56013b2c0 0x7fa5600aa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:01.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.165+0000 7fa56599b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa56013b2c0 0x7fa5600aa420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40956/0 (socket says 172.21.15.72:40956) 2023-07-27T20:34:01.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.165+0000 7fa56599b700 1 -- 172.21.15.72:0/1922224827 learned_addr learned my addr 172.21.15.72:0/1922224827 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:01.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.165+0000 7fa56519a700 1 --2- 172.21.15.72:0/1922224827 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5600bfd90 0x7fa5600aa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:01.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.165+0000 7fa56599b700 1 -- 172.21.15.72:0/1922224827 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5600bfd90 msgr2=0x7fa5600aa960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:01.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.165+0000 7fa56599b700 1 --2- 172.21.15.72:0/1922224827 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5600bfd90 0x7fa5600aa960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:01.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.165+0000 7fa56599b700 1 -- 172.21.15.72:0/1922224827 >> v1:172.21.15.173:6789/0 conn(0x7fa5600a83a0 legacy=0x7fa5600a8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:01.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.165+0000 7fa56599b700 1 -- 172.21.15.72:0/1922224827 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa560155320 con 0x7fa56013b2c0 2023-07-27T20:34:01.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.165+0000 7fa56519a700 1 --2- 172.21.15.72:0/1922224827 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5600bfd90 0x7fa5600aa960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:01.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.165+0000 7fa56599b700 1 --2- 172.21.15.72:0/1922224827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa56013b2c0 0x7fa5600aa420 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fa55c0098f0 tx=0x7fa55c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=592f7f7515f518e6 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:01.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.165+0000 7fa564999700 1 -- 172.21.15.72:0/1922224827 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c004230 con 0x7fa56013b2c0 2023-07-27T20:34:01.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.166+0000 7fa564999700 1 -- 172.21.15.72:0/1922224827 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55c004390 con 0x7fa56013b2c0 2023-07-27T20:34:01.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.166+0000 7fa564999700 1 -- 172.21.15.72:0/1922224827 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c0036a0 con 0x7fa56013b2c0 2023-07-27T20:34:01.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.166+0000 7fa567bff700 1 -- 172.21.15.72:0/1922224827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa56013b2c0 msgr2=0x7fa5600aa420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:01.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.166+0000 7fa567bff700 1 --2- 172.21.15.72:0/1922224827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa56013b2c0 0x7fa5600aa420 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fa55c0098f0 tx=0x7fa55c009c00 comp rx=0 tx=0).stop 2023-07-27T20:34:01.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.166+0000 7fa567bff700 1 -- 172.21.15.72:0/1922224827 shutdown_connections 2023-07-27T20:34:01.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.166+0000 7fa567bff700 1 --2- 172.21.15.72:0/1922224827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa56013b2c0 0x7fa5600aa420 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:01.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.166+0000 7fa567bff700 1 --2- 172.21.15.72:0/1922224827 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5600bfd90 0x7fa5600aa960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:01.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.166+0000 7fa567bff700 1 -- 172.21.15.72:0/1922224827 >> 172.21.15.72:0/1922224827 conn(0x7fa56006a190 msgr2=0x7fa56006a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:01.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.166+0000 7fa567bff700 1 -- 172.21.15.72:0/1922224827 shutdown_connections 2023-07-27T20:34:01.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.166+0000 7fa567bff700 1 -- 172.21.15.72:0/1922224827 wait complete. 2023-07-27T20:34:01.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.168+0000 7fa567bff700 1 Processor -- start 2023-07-27T20:34:01.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.168+0000 7fa567bff700 1 -- start start 2023-07-27T20:34:01.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.169+0000 7fa567bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5600a83a0 0x7fa560071340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:01.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.169+0000 7fa567bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5600bfd90 0x7fa560136cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:01.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.169+0000 7fa567bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa56013b2c0 0x7fa5601371f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:01.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.169+0000 7fa567bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5600c2400 con 0x7fa5600a83a0 2023-07-27T20:34:01.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.169+0000 7fa567bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa560137c90 con 0x7fa56013b2c0 2023-07-27T20:34:01.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.169+0000 7fa567bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5600c1270 con 0x7fa5600bfd90 2023-07-27T20:34:01.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.169+0000 7fa56599b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5600a83a0 0x7fa560071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:01.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.169+0000 7fa56599b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5600a83a0 0x7fa560071340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40966/0 (socket says 172.21.15.72:40966) 2023-07-27T20:34:01.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.169+0000 7fa56599b700 1 -- 172.21.15.72:0/2631561610 learned_addr learned my addr 172.21.15.72:0/2631561610 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:01.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.169+0000 7fa56519a700 1 --2- 172.21.15.72:0/2631561610 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5600bfd90 0x7fa560136cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:01.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.169+0000 7fa56619c700 1 --2- 172.21.15.72:0/2631561610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa56013b2c0 0x7fa5601371f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:01.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.169+0000 7fa56599b700 1 -- 172.21.15.72:0/2631561610 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5600bfd90 msgr2=0x7fa560136cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:01.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.169+0000 7fa56599b700 1 --2- 172.21.15.72:0/2631561610 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5600bfd90 0x7fa560136cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:01.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.170+0000 7fa56599b700 1 -- 172.21.15.72:0/2631561610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa56013b2c0 msgr2=0x7fa5601371f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:01.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.170+0000 7fa56599b700 1 --2- 172.21.15.72:0/2631561610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa56013b2c0 0x7fa5601371f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:01.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.170+0000 7fa56599b700 1 -- 172.21.15.72:0/2631561610 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c009550 con 0x7fa5600a83a0 2023-07-27T20:34:01.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.170+0000 7fa56519a700 1 --2- 172.21.15.72:0/2631561610 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5600bfd90 0x7fa560136cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:01.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.170+0000 7fa56619c700 1 --2- 172.21.15.72:0/2631561610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa56013b2c0 0x7fa5601371f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:01.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.170+0000 7fa56599b700 1 --2- 172.21.15.72:0/2631561610 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5600a83a0 0x7fa560071340 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fa55c009130 tx=0x7fa55c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:01.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.170+0000 7fa5567fc700 1 -- 172.21.15.72:0/2631561610 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c00b860 con 0x7fa5600a83a0 2023-07-27T20:34:01.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.170+0000 7fa5567fc700 1 -- 172.21.15.72:0/2631561610 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55c00b9c0 con 0x7fa5600a83a0 2023-07-27T20:34:01.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.170+0000 7fa5567fc700 1 -- 172.21.15.72:0/2631561610 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c00bd70 con 0x7fa5600a83a0 2023-07-27T20:34:01.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.170+0000 7fa567bff700 1 -- 172.21.15.72:0/2631561610 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa560137730 con 0x7fa5600a83a0 2023-07-27T20:34:01.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.170+0000 7fa567bff700 1 -- 172.21.15.72:0/2631561610 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5600c1d40 con 0x7fa5600a83a0 2023-07-27T20:34:01.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.171+0000 7fa567bff700 1 -- 172.21.15.72:0/2631561610 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa560074310 con 0x7fa5600a83a0 2023-07-27T20:34:01.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.172+0000 7fa5567fc700 1 -- 172.21.15.72:0/2631561610 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa55c01b440 con 0x7fa5600a83a0 2023-07-27T20:34:01.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.173+0000 7fa5567fc700 1 --2- 172.21.15.72:0/2631561610 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa54406ace0 0x7fa54406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:01.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.173+0000 7fa5567fc700 1 -- 172.21.15.72:0/2631561610 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7fa55c08b360 con 0x7fa5600a83a0 2023-07-27T20:34:01.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.173+0000 7fa56519a700 1 --2- 172.21.15.72:0/2631561610 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa54406ace0 0x7fa54406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:01.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.174+0000 7fa56519a700 1 --2- 172.21.15.72:0/2631561610 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa54406ace0 0x7fa54406d1a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa5601e1190 tx=0x7fa550008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:01.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.178+0000 7fa5567fc700 1 -- 172.21.15.72:0/2631561610 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa55c055f50 con 0x7fa5600a83a0 2023-07-27T20:34:01.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.374+0000 7fa567bff700 1 -- 172.21.15.72:0/2631561610 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5600c28f0 con 0x7fa5600a83a0 2023-07-27T20:34:01.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.375+0000 7fa5567fc700 1 -- 172.21.15.72:0/2631561610 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+22308 (secure 0 0 0) 0x7fa55c059570 con 0x7fa5600a83a0 2023-07-27T20:34:01.363 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:34:01.363 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":47,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:33:23.191066+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:32:58.242890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-27T20:32:59.032110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_metadata","create_time":"2023-07-27T20:33:20.125785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs2_data","create_time":"2023-07-27T20:33:20.647929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2c","mappings":[{"from":0,"to":4}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:34:01.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.378+0000 7fa567bff700 1 -- 172.21.15.72:0/2631561610 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa54406ace0 msgr2=0x7fa54406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:01.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.378+0000 7fa567bff700 1 --2- 172.21.15.72:0/2631561610 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa54406ace0 0x7fa54406d1a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa5601e1190 tx=0x7fa550008040 comp rx=0 tx=0).stop 2023-07-27T20:34:01.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.378+0000 7fa567bff700 1 -- 172.21.15.72:0/2631561610 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5600a83a0 msgr2=0x7fa560071340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:01.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.378+0000 7fa567bff700 1 --2- 172.21.15.72:0/2631561610 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5600a83a0 0x7fa560071340 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fa55c009130 tx=0x7fa55c004750 comp rx=0 tx=0).stop 2023-07-27T20:34:01.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.378+0000 7fa567bff700 1 -- 172.21.15.72:0/2631561610 shutdown_connections 2023-07-27T20:34:01.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.378+0000 7fa567bff700 1 --2- 172.21.15.72:0/2631561610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa56013b2c0 0x7fa5601371f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:01.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.378+0000 7fa567bff700 1 --2- 172.21.15.72:0/2631561610 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5600a83a0 0x7fa560071340 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:01.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.378+0000 7fa567bff700 1 --2- 172.21.15.72:0/2631561610 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa54406ace0 0x7fa54406d1a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:01.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.378+0000 7fa567bff700 1 --2- 172.21.15.72:0/2631561610 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5600bfd90 0x7fa560136cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:01.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.378+0000 7fa567bff700 1 -- 172.21.15.72:0/2631561610 >> 172.21.15.72:0/2631561610 conn(0x7fa56006a190 msgr2=0x7fa560139320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:01.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.378+0000 7fa567bff700 1 -- 172.21.15.72:0/2631561610 shutdown_connections 2023-07-27T20:34:01.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.378+0000 7fa567bff700 1 -- 172.21.15.72:0/2631561610 wait complete. 2023-07-27T20:34:01.384 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-27T20:31:14.581785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T20:31:21.077941+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T20:32:58.242890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T20:32:59.032110+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-07-27T20:33:20.125785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs2_data', 'create_time': '2023-07-27T20:33:20.647929+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-27T20:34:01.385 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-27T20:34:01.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.596+0000 7f836d1ff700 1 Processor -- start 2023-07-27T20:34:01.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.596+0000 7f836d1ff700 1 -- start start 2023-07-27T20:34:01.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.597+0000 7f836d1ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f836814aab0 0x7f8368154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:01.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.597+0000 7f836d1ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f836806c1d0 0x7f836806c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:01.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.597+0000 7f836d1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83680c7c50 con 0x7f83680c7740 2023-07-27T20:34:01.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.597+0000 7f836d1ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f836806bd40 con 0x7f836806c1d0 2023-07-27T20:34:01.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.597+0000 7f836d1ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83680c62f0 con 0x7f836814aab0 2023-07-27T20:34:01.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.597+0000 7f836659c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f83680c7740 0x7f83680c41c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48266/0 (socket says 172.21.15.72:48266) 2023-07-27T20:34:01.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.597+0000 7f836659c700 1 -- 172.21.15.72:0/3682870373 learned_addr learned my addr 172.21.15.72:0/3682870373 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:01.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.598+0000 7f8366d9d700 1 --2- 172.21.15.72:0/3682870373 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f836814aab0 0x7f8368154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:01.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.598+0000 7f836759e700 1 --2- 172.21.15.72:0/3682870373 >> v2:172.21.15.173:3300/0 conn(0x7f836806c1d0 0x7f836806c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:01.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.598+0000 7f8365d9b700 1 -- 172.21.15.72:0/3682870373 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1796082296 0 0) 0x7f83680c7c50 con 0x7f83680c7740 2023-07-27T20:34:01.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.598+0000 7f8365d9b700 1 -- 172.21.15.72:0/3682870373 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83500035b0 con 0x7f83680c7740 2023-07-27T20:34:01.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.598+0000 7f8365d9b700 1 -- 172.21.15.72:0/3682870373 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2799900969 0 0) 0x7f83500035b0 con 0x7f83680c7740 2023-07-27T20:34:01.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.598+0000 7f8365d9b700 1 -- 172.21.15.72:0/3682870373 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f836814aab0 msgr2=0x7f8368154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:01.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.598+0000 7f8365d9b700 1 --2- 172.21.15.72:0/3682870373 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f836814aab0 0x7f8368154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:01.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.598+0000 7f8365d9b700 1 -- 172.21.15.72:0/3682870373 >> v2:172.21.15.173:3300/0 conn(0x7f836806c1d0 msgr2=0x7f836806c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:01.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.598+0000 7f8365d9b700 1 --2- 172.21.15.72:0/3682870373 >> v2:172.21.15.173:3300/0 conn(0x7f836806c1d0 0x7f836806c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:01.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.598+0000 7f8365d9b700 1 -- 172.21.15.72:0/3682870373 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8368155050 con 0x7f83680c7740 2023-07-27T20:34:01.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.598+0000 7f8365d9b700 1 -- 172.21.15.72:0/3682870373 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f835c001670 con 0x7f83680c7740 2023-07-27T20:34:01.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.598+0000 7f8365d9b700 1 -- 172.21.15.72:0/3682870373 >> v1:172.21.15.72:6789/0 conn(0x7f83680c7740 legacy=0x7f83680c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:01.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.598+0000 7f8365d9b700 1 --2- 172.21.15.72:0/3682870373 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f836814aab0 0x7f8350003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:01.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.598+0000 7f8365d9b700 1 --2- 172.21.15.72:0/3682870373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8350003fd0 0x7f8350004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:01.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.598+0000 7f8365d9b700 1 --2- 172.21.15.72:0/3682870373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8350004d90 0x7f8350005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:01.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.598+0000 7f8365d9b700 1 -- 172.21.15.72:0/3682870373 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836806bd40 con 0x7f8350004d90 2023-07-27T20:34:01.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.598+0000 7f8365d9b700 1 -- 172.21.15.72:0/3682870373 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83680c62f0 con 0x7f8350003fd0 2023-07-27T20:34:01.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.598+0000 7f8365d9b700 1 -- 172.21.15.72:0/3682870373 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f835000ba10 con 0x7f836814aab0 2023-07-27T20:34:01.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.599+0000 7f836759e700 1 --2- 172.21.15.72:0/3682870373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8350004d90 0x7f8350005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:01.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.599+0000 7f836659c700 1 --2- 172.21.15.72:0/3682870373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8350003fd0 0x7f8350004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:01.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.599+0000 7f8366d9d700 1 --2- 172.21.15.72:0/3682870373 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f836814aab0 0x7f8350003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:01.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.599+0000 7f836759e700 1 -- 172.21.15.72:0/3682870373 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f836814aab0 msgr2=0x7f8350003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:01.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.599+0000 7f836759e700 1 --2- 172.21.15.72:0/3682870373 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f836814aab0 0x7f8350003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:01.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.599+0000 7f836759e700 1 -- 172.21.15.72:0/3682870373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8350003fd0 msgr2=0x7f8350004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:01.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.599+0000 7f836759e700 1 --2- 172.21.15.72:0/3682870373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8350003fd0 0x7f8350004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:01.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.599+0000 7f836759e700 1 -- 172.21.15.72:0/3682870373 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83500035b0 con 0x7f8350004d90 2023-07-27T20:34:01.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.599+0000 7f8366d9d700 1 --2- 172.21.15.72:0/3682870373 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f836814aab0 0x7f8350003a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:01.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.599+0000 7f836759e700 1 --2- 172.21.15.72:0/3682870373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8350004d90 0x7f8350005210 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f836000e170 tx=0x7f8350005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7048d42db9a25912 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:01.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.599+0000 7f8365d9b700 1 -- 172.21.15.72:0/3682870373 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836000ec90 con 0x7f8350004d90 2023-07-27T20:34:01.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.599+0000 7f8365d9b700 1 -- 172.21.15.72:0/3682870373 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836000f040 con 0x7f8350004d90 2023-07-27T20:34:01.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.599+0000 7f8365d9b700 1 -- 172.21.15.72:0/3682870373 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8360014480 con 0x7f8350004d90 2023-07-27T20:34:01.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.600+0000 7f836d1ff700 1 -- 172.21.15.72:0/3682870373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8350004d90 msgr2=0x7f8350005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:01.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.600+0000 7f836d1ff700 1 --2- 172.21.15.72:0/3682870373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8350004d90 0x7f8350005210 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f836000e170 tx=0x7f8350005880 comp rx=0 tx=0).stop 2023-07-27T20:34:01.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.600+0000 7f836759e700 1 -- 172.21.15.72:0/3682870373 reap_dead start 2023-07-27T20:34:01.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.600+0000 7f836d1ff700 1 -- 172.21.15.72:0/3682870373 shutdown_connections 2023-07-27T20:34:01.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.600+0000 7f836d1ff700 1 -- 172.21.15.72:0/3682870373 >> 172.21.15.72:0/3682870373 conn(0x7f83680ab3f0 msgr2=0x7f83680ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:01.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.600+0000 7f836d1ff700 1 -- 172.21.15.72:0/3682870373 shutdown_connections 2023-07-27T20:34:01.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.600+0000 7f836d1ff700 1 -- 172.21.15.72:0/3682870373 wait complete. 2023-07-27T20:34:01.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.602+0000 7f836d1ff700 1 Processor -- start 2023-07-27T20:34:01.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.602+0000 7f836d1ff700 1 -- start start 2023-07-27T20:34:01.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.603+0000 7f836d1ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f83681ed120 0x7f83681ed500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:01.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.603+0000 7f836d1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83681eda40 0x7f8368156340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:01.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.603+0000 7f836d1ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8368156880 0x7f83681475e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:01.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.603+0000 7f836d1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8368157b40 con 0x7f83681eda40 2023-07-27T20:34:01.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.603+0000 7f836d1ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83681ee020 con 0x7f83681ed120 2023-07-27T20:34:01.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.603+0000 7f836d1ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8368156d10 con 0x7f8368156880 2023-07-27T20:34:01.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.603+0000 7f836659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83681eda40 0x7f8368156340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:01.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.603+0000 7f836659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83681eda40 0x7f8368156340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40988/0 (socket says 172.21.15.72:40988) 2023-07-27T20:34:01.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.603+0000 7f836659c700 1 -- 172.21.15.72:0/3181601517 learned_addr learned my addr 172.21.15.72:0/3181601517 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:01.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.603+0000 7f8366d9d700 1 --2- 172.21.15.72:0/3181601517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f83681ed120 0x7f83681ed500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:01.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.603+0000 7f836759e700 1 --2- 172.21.15.72:0/3181601517 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8368156880 0x7f83681475e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:01.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.603+0000 7f836659c700 1 -- 172.21.15.72:0/3181601517 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8368156880 msgr2=0x7f83681475e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:01.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.603+0000 7f836659c700 1 --2- 172.21.15.72:0/3181601517 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8368156880 0x7f83681475e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:01.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.603+0000 7f836659c700 1 -- 172.21.15.72:0/3181601517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f83681ed120 msgr2=0x7f83681ed500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:01.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.603+0000 7f836659c700 1 --2- 172.21.15.72:0/3181601517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f83681ed120 0x7f83681ed500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:01.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.603+0000 7f836659c700 1 -- 172.21.15.72:0/3181601517 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8368157fa0 con 0x7f83681eda40 2023-07-27T20:34:01.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.604+0000 7f836659c700 1 --2- 172.21.15.72:0/3181601517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83681eda40 0x7f8368156340 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f835c0048d0 tx=0x7f835c00edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:01.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.604+0000 7f834f7fe700 1 -- 172.21.15.72:0/3181601517 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c0016c0 con 0x7f83681eda40 2023-07-27T20:34:01.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.604+0000 7f834f7fe700 1 -- 172.21.15.72:0/3181601517 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835c00c5d0 con 0x7f83681eda40 2023-07-27T20:34:01.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.604+0000 7f836d1ff700 1 -- 172.21.15.72:0/3181601517 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8368158280 con 0x7f83681eda40 2023-07-27T20:34:01.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.604+0000 7f834f7fe700 1 -- 172.21.15.72:0/3181601517 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c00c9a0 con 0x7f83681eda40 2023-07-27T20:34:01.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.604+0000 7f836d1ff700 1 -- 172.21.15.72:0/3181601517 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8368155e20 con 0x7f83681eda40 2023-07-27T20:34:01.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.605+0000 7f836d1ff700 1 -- 172.21.15.72:0/3181601517 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8368154e70 con 0x7f83681eda40 2023-07-27T20:34:01.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.606+0000 7f834f7fe700 1 -- 172.21.15.72:0/3181601517 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f835c00cb00 con 0x7f83681eda40 2023-07-27T20:34:01.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.607+0000 7f834f7fe700 1 --2- 172.21.15.72:0/3181601517 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f835406ace0 0x7f835406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:01.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.607+0000 7f834f7fe700 1 -- 172.21.15.72:0/3181601517 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f835c089610 con 0x7f83681eda40 2023-07-27T20:34:01.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.607+0000 7f8366d9d700 1 --2- 172.21.15.72:0/3181601517 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f835406ace0 0x7f835406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:01.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.608+0000 7f8366d9d700 1 --2- 172.21.15.72:0/3181601517 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f835406ace0 0x7f835406d1a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f83680bc890 tx=0x7f8358008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:01.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.611+0000 7f834f7fe700 1 -- 172.21.15.72:0/3181601517 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f835c0542b0 con 0x7f83681eda40 2023-07-27T20:34:01.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.804+0000 7f836d1ff700 1 -- 172.21.15.72:0/3181601517 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f836804e470 con 0x7f83681eda40 2023-07-27T20:34:01.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.804+0000 7f834f7fe700 1 -- 172.21.15.72:0/3181601517 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7f835c00cdb0 con 0x7f83681eda40 2023-07-27T20:34:01.792 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-27T20:34:01.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.807+0000 7f836d1ff700 1 -- 172.21.15.72:0/3181601517 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f835406ace0 msgr2=0x7f835406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:01.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.807+0000 7f836d1ff700 1 --2- 172.21.15.72:0/3181601517 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f835406ace0 0x7f835406d1a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f83680bc890 tx=0x7f8358008040 comp rx=0 tx=0).stop 2023-07-27T20:34:01.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.807+0000 7f836d1ff700 1 -- 172.21.15.72:0/3181601517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83681eda40 msgr2=0x7f8368156340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:01.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.807+0000 7f836d1ff700 1 --2- 172.21.15.72:0/3181601517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83681eda40 0x7f8368156340 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f835c0048d0 tx=0x7f835c00edd0 comp rx=0 tx=0).stop 2023-07-27T20:34:01.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.807+0000 7f836d1ff700 1 -- 172.21.15.72:0/3181601517 shutdown_connections 2023-07-27T20:34:01.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.807+0000 7f836d1ff700 1 --2- 172.21.15.72:0/3181601517 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f835406ace0 0x7f835406d1a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:01.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.807+0000 7f836d1ff700 1 --2- 172.21.15.72:0/3181601517 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8368156880 0x7f83681475e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:01.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.807+0000 7f836d1ff700 1 --2- 172.21.15.72:0/3181601517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f83681ed120 0x7f83681ed500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:01.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.807+0000 7f836d1ff700 1 --2- 172.21.15.72:0/3181601517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83681eda40 0x7f8368156340 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:01.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.807+0000 7f836d1ff700 1 -- 172.21.15.72:0/3181601517 >> 172.21.15.72:0/3181601517 conn(0x7f83680ab3f0 msgr2=0x7f83680c8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:01.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.807+0000 7f836d1ff700 1 -- 172.21.15.72:0/3181601517 shutdown_connections 2023-07-27T20:34:01.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:01.807+0000 7f836d1ff700 1 -- 172.21.15.72:0/3181601517 wait complete. 2023-07-27T20:34:01.812 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T20:34:02.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.023+0000 7f838e5ff700 1 Processor -- start 2023-07-27T20:34:02.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.024+0000 7f838e5ff700 1 -- start start 2023-07-27T20:34:02.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.025+0000 7f838e5ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f83880c7740 0x7f83880c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:02.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.025+0000 7f838e5ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83880c7c50 con 0x7f83880c4700 2023-07-27T20:34:02.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.025+0000 7f838e5ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f838806bd40 con 0x7f838814aab0 2023-07-27T20:34:02.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.025+0000 7f838e5ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83880c62f0 con 0x7f83880c7740 2023-07-27T20:34:02.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.025+0000 7f838cb9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f83880c4700 0x7f838806c1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48274/0 (socket says 172.21.15.72:48274) 2023-07-27T20:34:02.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.025+0000 7f838cb9c700 1 -- 172.21.15.72:0/4289577428 learned_addr learned my addr 172.21.15.72:0/4289577428 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:02.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.025+0000 7f83877fe700 1 --2- 172.21.15.72:0/4289577428 >> v2:172.21.15.173:3300/0 conn(0x7f83880c7740 0x7f83880c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:02.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.025+0000 7f8386ffd700 1 -- 172.21.15.72:0/4289577428 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 159714525 0 0) 0x7f83880c7c50 con 0x7f83880c4700 2023-07-27T20:34:02.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.025+0000 7f8386ffd700 1 -- 172.21.15.72:0/4289577428 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83700035b0 con 0x7f83880c4700 2023-07-27T20:34:02.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.026+0000 7f8386ffd700 1 -- 172.21.15.72:0/4289577428 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1116201548 0 0) 0x7f83700035b0 con 0x7f83880c4700 2023-07-27T20:34:02.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.026+0000 7f8386ffd700 1 -- 172.21.15.72:0/4289577428 >> v2:172.21.15.173:3300/0 conn(0x7f83880c7740 msgr2=0x7f83880c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:02.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.026+0000 7f8386ffd700 1 --2- 172.21.15.72:0/4289577428 >> v2:172.21.15.173:3300/0 conn(0x7f83880c7740 0x7f83880c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:02.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.026+0000 7f8386ffd700 1 -- 172.21.15.72:0/4289577428 >> v1:172.21.15.173:6789/0 conn(0x7f838814aab0 legacy=0x7f8388154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:02.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.026+0000 7f8386ffd700 1 -- 172.21.15.72:0/4289577428 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f838806d200 con 0x7f83880c4700 2023-07-27T20:34:02.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.026+0000 7f8386ffd700 1 -- 172.21.15.72:0/4289577428 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f83800019f0 con 0x7f83880c4700 2023-07-27T20:34:02.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.026+0000 7f8386ffd700 1 -- 172.21.15.72:0/4289577428 >> v1:172.21.15.72:6789/0 conn(0x7f83880c4700 legacy=0x7f838806c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:02.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.026+0000 7f8386ffd700 1 --2- 172.21.15.72:0/4289577428 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8370003a00 0x7f8370003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:02.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.026+0000 7f8386ffd700 1 --2- 172.21.15.72:0/4289577428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8370004850 0x7f8370004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:02.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.026+0000 7f8386ffd700 1 --2- 172.21.15.72:0/4289577428 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8370005210 0x7f837000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:02.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.026+0000 7f8386ffd700 1 -- 172.21.15.72:0/4289577428 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83880c62f0 con 0x7f8370005210 2023-07-27T20:34:02.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.026+0000 7f8386ffd700 1 -- 172.21.15.72:0/4289577428 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837000c0b0 con 0x7f8370004850 2023-07-27T20:34:02.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.026+0000 7f8386ffd700 1 -- 172.21.15.72:0/4289577428 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f837000c270 con 0x7f8370003a00 2023-07-27T20:34:02.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.026+0000 7f838cb9c700 1 --2- 172.21.15.72:0/4289577428 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8370005210 0x7f837000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:02.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.026+0000 7f8387fff700 1 --2- 172.21.15.72:0/4289577428 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8370003a00 0x7f8370003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:02.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.026+0000 7f83877fe700 1 --2- 172.21.15.72:0/4289577428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8370004850 0x7f8370004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:02.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.027+0000 7f838cb9c700 1 -- 172.21.15.72:0/4289577428 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8370003a00 msgr2=0x7f8370003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:02.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.027+0000 7f838cb9c700 1 --2- 172.21.15.72:0/4289577428 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8370003a00 0x7f8370003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:02.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.027+0000 7f838cb9c700 1 -- 172.21.15.72:0/4289577428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8370004850 msgr2=0x7f8370004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:02.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.027+0000 7f838cb9c700 1 --2- 172.21.15.72:0/4289577428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8370004850 0x7f8370004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:02.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.027+0000 7f838cb9c700 1 -- 172.21.15.72:0/4289577428 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83700035b0 con 0x7f8370005210 2023-07-27T20:34:02.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.027+0000 7f83877fe700 1 --2- 172.21.15.72:0/4289577428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8370004850 0x7f8370004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:02.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.027+0000 7f838cb9c700 1 -- 172.21.15.72:0/4289577428 reap_dead start 2023-07-27T20:34:02.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.027+0000 7f838cb9c700 1 --2- 172.21.15.72:0/4289577428 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8370005210 0x7f837000ba10 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f838000a800 tx=0x7f8370005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5273e3ef23608d0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:02.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.027+0000 7f8386ffd700 1 -- 172.21.15.72:0/4289577428 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838000a2f0 con 0x7f8370005210 2023-07-27T20:34:02.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.027+0000 7f8386ffd700 1 -- 172.21.15.72:0/4289577428 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8380012640 con 0x7f8370005210 2023-07-27T20:34:02.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.027+0000 7f8386ffd700 1 -- 172.21.15.72:0/4289577428 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83800129f0 con 0x7f8370005210 2023-07-27T20:34:02.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.027+0000 7f838e5ff700 1 -- 172.21.15.72:0/4289577428 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8370005210 msgr2=0x7f837000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:02.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.027+0000 7f838e5ff700 1 --2- 172.21.15.72:0/4289577428 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8370005210 0x7f837000ba10 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f838000a800 tx=0x7f8370005880 comp rx=0 tx=0).stop 2023-07-27T20:34:02.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.028+0000 7f838e5ff700 1 -- 172.21.15.72:0/4289577428 shutdown_connections 2023-07-27T20:34:02.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.028+0000 7f838e5ff700 1 --2- 172.21.15.72:0/4289577428 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8370005210 0x7f837000ba10 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:02.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.028+0000 7f838e5ff700 1 -- 172.21.15.72:0/4289577428 >> 172.21.15.72:0/4289577428 conn(0x7f83880ab3f0 msgr2=0x7f83880ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:02.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.028+0000 7f838e5ff700 1 -- 172.21.15.72:0/4289577428 shutdown_connections 2023-07-27T20:34:02.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.028+0000 7f838e5ff700 1 -- 172.21.15.72:0/4289577428 wait complete. 2023-07-27T20:34:02.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.030+0000 7f838e5ff700 1 Processor -- start 2023-07-27T20:34:02.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.030+0000 7f838e5ff700 1 -- start start 2023-07-27T20:34:02.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.031+0000 7f838e5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8370005210 0x7f8388145850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:02.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.031+0000 7f838e5ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f83880c1550 0x7f83881eceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:02.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.031+0000 7f838e5ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f83880adf80 0x7f83880ae400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:02.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.031+0000 7f838e5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83880c19d0 con 0x7f8370005210 2023-07-27T20:34:02.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.031+0000 7f838e5ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83880ad530 con 0x7f83880c1550 2023-07-27T20:34:02.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.031+0000 7f838e5ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83881ed6f0 con 0x7f83880adf80 2023-07-27T20:34:02.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.032+0000 7f8387fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8370005210 0x7f8388145850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:02.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.032+0000 7f8387fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8370005210 0x7f8388145850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41006/0 (socket says 172.21.15.72:41006) 2023-07-27T20:34:02.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.032+0000 7f8387fff700 1 -- 172.21.15.72:0/259241246 learned_addr learned my addr 172.21.15.72:0/259241246 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:02.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.032+0000 7f83877fe700 1 --2- 172.21.15.72:0/259241246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f83880c1550 0x7f83881eceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:02.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.032+0000 7f8387fff700 1 -- 172.21.15.72:0/259241246 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f83880adf80 msgr2=0x7f83880ae400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:02.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.032+0000 7f838cb9c700 1 --2- 172.21.15.72:0/259241246 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f83880adf80 0x7f83880ae400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:02.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.032+0000 7f8387fff700 1 --2- 172.21.15.72:0/259241246 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f83880adf80 0x7f83880ae400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:02.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.032+0000 7f8387fff700 1 -- 172.21.15.72:0/259241246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f83880c1550 msgr2=0x7f83881eceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:02.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.032+0000 7f8387fff700 1 --2- 172.21.15.72:0/259241246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f83880c1550 0x7f83881eceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:02.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.032+0000 7f8387fff700 1 -- 172.21.15.72:0/259241246 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83881ed9d0 con 0x7f8370005210 2023-07-27T20:34:02.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.032+0000 7f83877fe700 1 --2- 172.21.15.72:0/259241246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f83880c1550 0x7f83881eceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:02.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.032+0000 7f838cb9c700 1 --2- 172.21.15.72:0/259241246 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f83880adf80 0x7f83880ae400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:02.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.032+0000 7f8387fff700 1 --2- 172.21.15.72:0/259241246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8370005210 0x7f8388145850 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f837800f820 tx=0x7f837800fbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:02.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.033+0000 7f8384ff9700 1 -- 172.21.15.72:0/259241246 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83780052e0 con 0x7f8370005210 2023-07-27T20:34:02.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.033+0000 7f8384ff9700 1 -- 172.21.15.72:0/259241246 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8378005440 con 0x7f8370005210 2023-07-27T20:34:02.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.033+0000 7f8384ff9700 1 -- 172.21.15.72:0/259241246 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83780038a0 con 0x7f8370005210 2023-07-27T20:34:02.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.033+0000 7f838e5ff700 1 -- 172.21.15.72:0/259241246 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83880ad780 con 0x7f8370005210 2023-07-27T20:34:02.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.033+0000 7f838e5ff700 1 -- 172.21.15.72:0/259241246 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83880a9700 con 0x7f8370005210 2023-07-27T20:34:02.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.034+0000 7f838e5ff700 1 -- 172.21.15.72:0/259241246 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83881edb60 con 0x7f8370005210 2023-07-27T20:34:02.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.035+0000 7f8384ff9700 1 -- 172.21.15.72:0/259241246 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8378003a00 con 0x7f8370005210 2023-07-27T20:34:02.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.035+0000 7f8384ff9700 1 --2- 172.21.15.72:0/259241246 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f837406ace0 0x7f837406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:02.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.036+0000 7f8384ff9700 1 -- 172.21.15.72:0/259241246 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f8378089720 con 0x7f8370005210 2023-07-27T20:34:02.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.036+0000 7f83877fe700 1 --2- 172.21.15.72:0/259241246 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f837406ace0 0x7f837406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:02.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.037+0000 7f83877fe700 1 --2- 172.21.15.72:0/259241246 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f837406ace0 0x7f837406d1a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f838814a080 tx=0x7f837c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:02.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.040+0000 7f8384ff9700 1 -- 172.21.15.72:0/259241246 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8378054280 con 0x7f8370005210 2023-07-27T20:34:02.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.239+0000 7f838e5ff700 1 -- 172.21.15.72:0/259241246 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f838804e470 con 0x7f8370005210 2023-07-27T20:34:02.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.239+0000 7f8384ff9700 1 -- 172.21.15.72:0/259241246 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v47) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8378003cb0 con 0x7f8370005210 2023-07-27T20:34:02.227 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-27T20:34:02.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.241+0000 7f838e5ff700 1 -- 172.21.15.72:0/259241246 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f837406ace0 msgr2=0x7f837406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:02.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.241+0000 7f838e5ff700 1 --2- 172.21.15.72:0/259241246 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f837406ace0 0x7f837406d1a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f838814a080 tx=0x7f837c008040 comp rx=0 tx=0).stop 2023-07-27T20:34:02.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.241+0000 7f838e5ff700 1 -- 172.21.15.72:0/259241246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8370005210 msgr2=0x7f8388145850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:02.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.241+0000 7f838e5ff700 1 --2- 172.21.15.72:0/259241246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8370005210 0x7f8388145850 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f837800f820 tx=0x7f837800fbe0 comp rx=0 tx=0).stop 2023-07-27T20:34:02.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.241+0000 7f838e5ff700 1 -- 172.21.15.72:0/259241246 shutdown_connections 2023-07-27T20:34:02.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.241+0000 7f838e5ff700 1 --2- 172.21.15.72:0/259241246 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f837406ace0 0x7f837406d1a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:02.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.241+0000 7f838e5ff700 1 --2- 172.21.15.72:0/259241246 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f83880adf80 0x7f83880ae400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:02.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.241+0000 7f838e5ff700 1 --2- 172.21.15.72:0/259241246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8370005210 0x7f8388145850 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:02.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.241+0000 7f838e5ff700 1 --2- 172.21.15.72:0/259241246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f83880c1550 0x7f83881eceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:02.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.241+0000 7f838e5ff700 1 -- 172.21.15.72:0/259241246 >> 172.21.15.72:0/259241246 conn(0x7f83880ab3f0 msgr2=0x7f8388153590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:02.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.242+0000 7f838e5ff700 1 -- 172.21.15.72:0/259241246 shutdown_connections 2023-07-27T20:34:02.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.242+0000 7f838e5ff700 1 -- 172.21.15.72:0/259241246 wait complete. 2023-07-27T20:34:02.247 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T20:34:02.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.457+0000 7fefbf9ff700 1 Processor -- start 2023-07-27T20:34:02.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.457+0000 7fefbf9ff700 1 -- start start 2023-07-27T20:34:02.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.458+0000 7fefbf9ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fefb80c12f0 0x7fefb81516c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:02.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.458+0000 7fefbf9ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fefb80716f0 0x7fefb8071b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:02.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.458+0000 7fefbf9ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefb8154f50 con 0x7fefb81475a0 2023-07-27T20:34:02.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.458+0000 7fefbf9ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefb8151c00 con 0x7fefb80716f0 2023-07-27T20:34:02.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.458+0000 7fefbf9ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb8154340 con 0x7fefb80c12f0 2023-07-27T20:34:02.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.459+0000 7fefbdf9c700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fefb80716f0 0x7fefb8071b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:02.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.459+0000 7fefbcf9a700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fefb80c12f0 0x7fefb81516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:02.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.459+0000 7fefbcf9a700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fefb80c12f0 0x7fefb81516c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.72:45312/0 (socket says 172.21.15.72:45312) 2023-07-27T20:34:02.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.459+0000 7fefbcf9a700 1 -- 172.21.15.72:0/1264966456 learned_addr learned my addr 172.21.15.72:0/1264966456 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:02.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.459+0000 7fefbdf9c700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fefb80716f0 0x7fefb8071b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.72:36584/0 (socket says 172.21.15.72:36584) 2023-07-27T20:34:02.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.459+0000 7fefbcf9a700 1 -- 172.21.15.72:0/1264966456 >> v2:172.21.15.173:3300/0 conn(0x7fefb80716f0 msgr2=0x7fefb8071b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:02.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.459+0000 7fefbcf9a700 1 --2- 172.21.15.72:0/1264966456 >> v2:172.21.15.173:3300/0 conn(0x7fefb80716f0 0x7fefb8071b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:02.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.459+0000 7fefbcf9a700 1 -- 172.21.15.72:0/1264966456 >> v1:172.21.15.173:6789/0 conn(0x7fefb81475a0 legacy=0x7fefb80c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:02.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.459+0000 7fefbcf9a700 1 -- 172.21.15.72:0/1264966456 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb8154620 con 0x7fefb80c12f0 2023-07-27T20:34:02.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.460+0000 7fefbcf9a700 1 --2- 172.21.15.72:0/1264966456 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fefb80c12f0 0x7fefb81516c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fefa800bb90 tx=0x7fefa800bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=772ccda56030e4d4 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:02.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.460+0000 7fefaffff700 1 -- 172.21.15.72:0/1264966456 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa800dd30 con 0x7fefb80c12f0 2023-07-27T20:34:02.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.460+0000 7fefaffff700 1 -- 172.21.15.72:0/1264966456 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa800de90 con 0x7fefb80c12f0 2023-07-27T20:34:02.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.460+0000 7fefaffff700 1 -- 172.21.15.72:0/1264966456 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa8010690 con 0x7fefb80c12f0 2023-07-27T20:34:02.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.461+0000 7fefbf9ff700 1 -- 172.21.15.72:0/1264966456 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fefb80c12f0 msgr2=0x7fefb81516c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:02.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.461+0000 7fefbf9ff700 1 --2- 172.21.15.72:0/1264966456 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fefb80c12f0 0x7fefb81516c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fefa800bb90 tx=0x7fefa800bea0 comp rx=0 tx=0).stop 2023-07-27T20:34:02.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.461+0000 7fefbf9ff700 1 -- 172.21.15.72:0/1264966456 shutdown_connections 2023-07-27T20:34:02.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.461+0000 7fefbf9ff700 1 --2- 172.21.15.72:0/1264966456 >> v2:172.21.15.173:3300/0 conn(0x7fefb80716f0 0x7fefb8071b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:02.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.461+0000 7fefbf9ff700 1 --2- 172.21.15.72:0/1264966456 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fefb80c12f0 0x7fefb81516c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:02.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.461+0000 7fefbf9ff700 1 -- 172.21.15.72:0/1264966456 >> 172.21.15.72:0/1264966456 conn(0x7fefb806a190 msgr2=0x7fefb806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:02.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.461+0000 7fefbf9ff700 1 -- 172.21.15.72:0/1264966456 shutdown_connections 2023-07-27T20:34:02.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.461+0000 7fefbf9ff700 1 -- 172.21.15.72:0/1264966456 wait complete. 2023-07-27T20:34:02.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.462+0000 7fefbf9ff700 1 Processor -- start 2023-07-27T20:34:02.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.463+0000 7fefbf9ff700 1 -- start start 2023-07-27T20:34:02.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.463+0000 7fefbf9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefb80716f0 0x7fefb814c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:02.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.463+0000 7fefbf9ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefb80c12f0 0x7fefb81ed2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:02.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.463+0000 7fefbf9ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fefb81475a0 0x7fefb81ed800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:02.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.463+0000 7fefbf9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb8143020 con 0x7fefb80716f0 2023-07-27T20:34:02.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.463+0000 7fefbf9ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb8152840 con 0x7fefb80c12f0 2023-07-27T20:34:02.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.463+0000 7fefbf9ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb81edd40 con 0x7fefb81475a0 2023-07-27T20:34:02.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.464+0000 7fefbd79b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefb80716f0 0x7fefb814c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:02.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.464+0000 7fefbd79b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefb80716f0 0x7fefb814c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41020/0 (socket says 172.21.15.72:41020) 2023-07-27T20:34:02.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.464+0000 7fefbd79b700 1 -- 172.21.15.72:0/2759459283 learned_addr learned my addr 172.21.15.72:0/2759459283 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:02.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.464+0000 7fefbdf9c700 1 --2- 172.21.15.72:0/2759459283 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fefb81475a0 0x7fefb81ed800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:02.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.464+0000 7fefbcf9a700 1 --2- 172.21.15.72:0/2759459283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefb80c12f0 0x7fefb81ed2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:02.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.464+0000 7fefbd79b700 1 -- 172.21.15.72:0/2759459283 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fefb81475a0 msgr2=0x7fefb81ed800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:02.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.464+0000 7fefbd79b700 1 --2- 172.21.15.72:0/2759459283 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fefb81475a0 0x7fefb81ed800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:02.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.464+0000 7fefbd79b700 1 -- 172.21.15.72:0/2759459283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefb80c12f0 msgr2=0x7fefb81ed2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:02.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.464+0000 7fefbd79b700 1 --2- 172.21.15.72:0/2759459283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefb80c12f0 0x7fefb81ed2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:02.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.464+0000 7fefbd79b700 1 -- 172.21.15.72:0/2759459283 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa800b7f0 con 0x7fefb80716f0 2023-07-27T20:34:02.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.464+0000 7fefbd79b700 1 --2- 172.21.15.72:0/2759459283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefb80716f0 0x7fefb814c9d0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fefb400c450 tx=0x7fefb400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:02.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.465+0000 7fefadffb700 1 -- 172.21.15.72:0/2759459283 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb40052d0 con 0x7fefb80716f0 2023-07-27T20:34:02.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.465+0000 7fefadffb700 1 -- 172.21.15.72:0/2759459283 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb4005430 con 0x7fefb80716f0 2023-07-27T20:34:02.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.465+0000 7fefbf9ff700 1 -- 172.21.15.72:0/2759459283 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb8153b90 con 0x7fefb80716f0 2023-07-27T20:34:02.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.465+0000 7fefadffb700 1 -- 172.21.15.72:0/2759459283 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb40038c0 con 0x7fefb80716f0 2023-07-27T20:34:02.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.465+0000 7fefbf9ff700 1 -- 172.21.15.72:0/2759459283 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb8142d40 con 0x7fefb80716f0 2023-07-27T20:34:02.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.466+0000 7fefbf9ff700 1 -- 172.21.15.72:0/2759459283 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefb804e470 con 0x7fefb80716f0 2023-07-27T20:34:02.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.467+0000 7fefadffb700 1 -- 172.21.15.72:0/2759459283 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fefb4003a20 con 0x7fefb80716f0 2023-07-27T20:34:02.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.468+0000 7fefadffb700 1 --2- 172.21.15.72:0/2759459283 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fef9c06ace0 0x7fef9c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:02.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.468+0000 7fefadffb700 1 -- 172.21.15.72:0/2759459283 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7fefb4088ce0 con 0x7fefb80716f0 2023-07-27T20:34:02.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.468+0000 7fefbcf9a700 1 --2- 172.21.15.72:0/2759459283 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fef9c06ace0 0x7fef9c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:02.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.469+0000 7fefbcf9a700 1 --2- 172.21.15.72:0/2759459283 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fef9c06ace0 0x7fef9c06d1a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fefa800bee0 tx=0x7fefa801c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:02.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.472+0000 7fefadffb700 1 -- 172.21.15.72:0/2759459283 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fefb4053850 con 0x7fefb80716f0 2023-07-27T20:34:02.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.668+0000 7fefbf9ff700 1 -- 172.21.15.72:0/2759459283 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fefb8144ec0 con 0x7fefb80716f0 2023-07-27T20:34:02.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.668+0000 7fefadffb700 1 -- 172.21.15.72:0/2759459283 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) v1 ==== 104+0+11 (secure 0 0 0) 0x7fefb400ce60 con 0x7fefb80716f0 2023-07-27T20:34:02.656 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:34:02.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.670+0000 7fefbf9ff700 1 -- 172.21.15.72:0/2759459283 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fef9c06ace0 msgr2=0x7fef9c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:02.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.670+0000 7fefbf9ff700 1 --2- 172.21.15.72:0/2759459283 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fef9c06ace0 0x7fef9c06d1a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fefa800bee0 tx=0x7fefa801c040 comp rx=0 tx=0).stop 2023-07-27T20:34:02.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.670+0000 7fefbf9ff700 1 -- 172.21.15.72:0/2759459283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefb80716f0 msgr2=0x7fefb814c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:02.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.670+0000 7fefbf9ff700 1 --2- 172.21.15.72:0/2759459283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefb80716f0 0x7fefb814c9d0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fefb400c450 tx=0x7fefb400c760 comp rx=0 tx=0).stop 2023-07-27T20:34:02.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.670+0000 7fefbf9ff700 1 -- 172.21.15.72:0/2759459283 shutdown_connections 2023-07-27T20:34:02.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.670+0000 7fefbf9ff700 1 --2- 172.21.15.72:0/2759459283 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fef9c06ace0 0x7fef9c06d1a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:02.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.670+0000 7fefbf9ff700 1 --2- 172.21.15.72:0/2759459283 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fefb81475a0 0x7fefb81ed800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:02.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.670+0000 7fefbf9ff700 1 --2- 172.21.15.72:0/2759459283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefb80716f0 0x7fefb814c9d0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:02.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.670+0000 7fefbf9ff700 1 --2- 172.21.15.72:0/2759459283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefb80c12f0 0x7fefb81ed2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:02.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.670+0000 7fefbf9ff700 1 -- 172.21.15.72:0/2759459283 >> 172.21.15.72:0/2759459283 conn(0x7fefb806a190 msgr2=0x7fefb81446e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:02.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.670+0000 7fefbf9ff700 1 -- 172.21.15.72:0/2759459283 shutdown_connections 2023-07-27T20:34:02.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.671+0000 7fefbf9ff700 1 -- 172.21.15.72:0/2759459283 wait complete. 2023-07-27T20:34:02.676 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T20:34:02.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.888+0000 7f948f9ff700 1 Processor -- start 2023-07-27T20:34:02.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.888+0000 7f948f9ff700 1 -- start start 2023-07-27T20:34:02.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.889+0000 7f948f9ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94880c7740 0x7f94880c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:02.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.889+0000 7f948f9ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f94880c4700 0x7f948806c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:02.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.889+0000 7f948f9ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94880c7c50 con 0x7f948814aab0 2023-07-27T20:34:02.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.889+0000 7f948f9ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f948806bd40 con 0x7f94880c4700 2023-07-27T20:34:02.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.889+0000 7f948f9ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94880c62f0 con 0x7f94880c7740 2023-07-27T20:34:02.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.889+0000 7f948cf9a700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94880c7740 0x7f94880c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:02.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.889+0000 7f948d79b700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f948814aab0 0x7f9488154b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.72:42786/0 (socket says 172.21.15.72:42786) 2023-07-27T20:34:02.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.889+0000 7f948d79b700 1 -- 172.21.15.72:0/3488917945 learned_addr learned my addr 172.21.15.72:0/3488917945 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:02.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.889+0000 7f948df9c700 1 --2- 172.21.15.72:0/3488917945 >> v2:172.21.15.173:3300/0 conn(0x7f94880c4700 0x7f948806c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:02.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.889+0000 7f947ffff700 1 -- 172.21.15.72:0/3488917945 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1566842689 0 0) 0x7f94880c7c50 con 0x7f948814aab0 2023-07-27T20:34:02.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.890+0000 7f947ffff700 1 -- 172.21.15.72:0/3488917945 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94740035b0 con 0x7f948814aab0 2023-07-27T20:34:02.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.890+0000 7f948cf9a700 1 -- 172.21.15.72:0/3488917945 >> v2:172.21.15.173:3300/0 conn(0x7f94880c4700 msgr2=0x7f948806c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:02.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.890+0000 7f948cf9a700 1 --2- 172.21.15.72:0/3488917945 >> v2:172.21.15.173:3300/0 conn(0x7f94880c4700 0x7f948806c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:02.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.890+0000 7f948cf9a700 1 -- 172.21.15.72:0/3488917945 >> v1:172.21.15.173:6789/0 conn(0x7f948814aab0 legacy=0x7f9488154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:02.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.890+0000 7f948cf9a700 1 -- 172.21.15.72:0/3488917945 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948806d200 con 0x7f94880c7740 2023-07-27T20:34:02.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.890+0000 7f948cf9a700 1 --2- 172.21.15.72:0/3488917945 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94880c7740 0x7f94880c41c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9478009840 tx=0x7f9478009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd043f0f4f82fea6 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:02.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.890+0000 7f947ffff700 1 -- 172.21.15.72:0/3488917945 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9478011830 con 0x7f94880c7740 2023-07-27T20:34:02.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.890+0000 7f947ffff700 1 -- 172.21.15.72:0/3488917945 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9478011990 con 0x7f94880c7740 2023-07-27T20:34:02.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.890+0000 7f947ffff700 1 -- 172.21.15.72:0/3488917945 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9478011d20 con 0x7f94880c7740 2023-07-27T20:34:02.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.891+0000 7f948f9ff700 1 -- 172.21.15.72:0/3488917945 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94880c7740 msgr2=0x7f94880c41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:02.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.891+0000 7f948f9ff700 1 --2- 172.21.15.72:0/3488917945 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94880c7740 0x7f94880c41c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9478009840 tx=0x7f9478009b50 comp rx=0 tx=0).stop 2023-07-27T20:34:02.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.891+0000 7f948f9ff700 1 -- 172.21.15.72:0/3488917945 shutdown_connections 2023-07-27T20:34:02.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.891+0000 7f948f9ff700 1 --2- 172.21.15.72:0/3488917945 >> v2:172.21.15.173:3300/0 conn(0x7f94880c4700 0x7f948806c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:02.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.891+0000 7f948f9ff700 1 --2- 172.21.15.72:0/3488917945 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94880c7740 0x7f94880c41c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:02.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.891+0000 7f948f9ff700 1 -- 172.21.15.72:0/3488917945 >> 172.21.15.72:0/3488917945 conn(0x7f94880ab3f0 msgr2=0x7f94880ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:02.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.891+0000 7f948f9ff700 1 -- 172.21.15.72:0/3488917945 shutdown_connections 2023-07-27T20:34:02.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.891+0000 7f948f9ff700 1 -- 172.21.15.72:0/3488917945 wait complete. 2023-07-27T20:34:02.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.892+0000 7f948f9ff700 1 Processor -- start 2023-07-27T20:34:02.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.893+0000 7f948f9ff700 1 -- start start 2023-07-27T20:34:02.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.893+0000 7f948f9ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94880c4700 0x7f9488155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:02.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.893+0000 7f948f9ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94880c7740 0x7f9488148a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:02.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.893+0000 7f948f9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f948814aab0 0x7f9488148f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:02.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.894+0000 7f948f9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94881494c0 con 0x7f948814aab0 2023-07-27T20:34:02.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.894+0000 7f948f9ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94880a9cb0 con 0x7f94880c7740 2023-07-27T20:34:02.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.894+0000 7f948f9ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94881eae00 con 0x7f94880c4700 2023-07-27T20:34:02.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.894+0000 7f948df9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f948814aab0 0x7f9488148f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:02.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.894+0000 7f948df9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f948814aab0 0x7f9488148f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41034/0 (socket says 172.21.15.72:41034) 2023-07-27T20:34:02.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.894+0000 7f948df9c700 1 -- 172.21.15.72:0/1834107947 learned_addr learned my addr 172.21.15.72:0/1834107947 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:02.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.894+0000 7f948d79b700 1 --2- 172.21.15.72:0/1834107947 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94880c4700 0x7f9488155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:02.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.894+0000 7f948cf9a700 1 --2- 172.21.15.72:0/1834107947 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94880c7740 0x7f9488148a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:02.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.894+0000 7f948df9c700 1 -- 172.21.15.72:0/1834107947 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94880c4700 msgr2=0x7f9488155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:02.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.894+0000 7f948df9c700 1 --2- 172.21.15.72:0/1834107947 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94880c4700 0x7f9488155760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:02.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.894+0000 7f948df9c700 1 -- 172.21.15.72:0/1834107947 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94880c7740 msgr2=0x7f9488148a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:02.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.894+0000 7f948df9c700 1 --2- 172.21.15.72:0/1834107947 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94880c7740 0x7f9488148a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:02.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.894+0000 7f948df9c700 1 -- 172.21.15.72:0/1834107947 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94780094a0 con 0x7f948814aab0 2023-07-27T20:34:02.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.895+0000 7f948df9c700 1 --2- 172.21.15.72:0/1834107947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f948814aab0 0x7f9488148f80 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f9480009dd0 tx=0x7f948000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:02.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.895+0000 7f947dffb700 1 -- 172.21.15.72:0/1834107947 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9480009c40 con 0x7f948814aab0 2023-07-27T20:34:02.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.895+0000 7f947dffb700 1 -- 172.21.15.72:0/1834107947 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948000f040 con 0x7f948814aab0 2023-07-27T20:34:02.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.895+0000 7f947dffb700 1 -- 172.21.15.72:0/1834107947 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948000ceb0 con 0x7f948814aab0 2023-07-27T20:34:02.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.895+0000 7f948f9ff700 1 -- 172.21.15.72:0/1834107947 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94881eaad0 con 0x7f948814aab0 2023-07-27T20:34:02.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.895+0000 7f948f9ff700 1 -- 172.21.15.72:0/1834107947 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94880a99d0 con 0x7f948814aab0 2023-07-27T20:34:02.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.896+0000 7f948f9ff700 1 -- 172.21.15.72:0/1834107947 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94881ea930 con 0x7f948814aab0 2023-07-27T20:34:02.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.897+0000 7f947dffb700 1 -- 172.21.15.72:0/1834107947 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9480014480 con 0x7f948814aab0 2023-07-27T20:34:02.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.898+0000 7f947dffb700 1 --2- 172.21.15.72:0/1834107947 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f946c06ad10 0x7f946c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:02.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.898+0000 7f947dffb700 1 -- 172.21.15.72:0/1834107947 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f948008a1f0 con 0x7f948814aab0 2023-07-27T20:34:02.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.898+0000 7f948d79b700 1 --2- 172.21.15.72:0/1834107947 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f946c06ad10 0x7f946c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:02.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.899+0000 7f948d79b700 1 --2- 172.21.15.72:0/1834107947 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f946c06ad10 0x7f946c06d1d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9484007fd0 tx=0x7f9484007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:02.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:02.902+0000 7f947dffb700 1 -- 172.21.15.72:0/1834107947 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f94881ea930 con 0x7f948814aab0 2023-07-27T20:34:03.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.094+0000 7f948f9ff700 1 -- 172.21.15.72:0/1834107947 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f94881ea930 con 0x7f948814aab0 2023-07-27T20:34:03.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.094+0000 7f947dffb700 1 -- 172.21.15.72:0/1834107947 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) v1 ==== 100+0+11 (secure 0 0 0) 0x7f94881ea930 con 0x7f948814aab0 2023-07-27T20:34:03.083 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-27T20:34:03.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.097+0000 7f948f9ff700 1 -- 172.21.15.72:0/1834107947 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f946c06ad10 msgr2=0x7f946c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:03.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.097+0000 7f948f9ff700 1 --2- 172.21.15.72:0/1834107947 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f946c06ad10 0x7f946c06d1d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9484007fd0 tx=0x7f9484007dc0 comp rx=0 tx=0).stop 2023-07-27T20:34:03.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.097+0000 7f948f9ff700 1 -- 172.21.15.72:0/1834107947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f948814aab0 msgr2=0x7f9488148f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:03.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.097+0000 7f948f9ff700 1 --2- 172.21.15.72:0/1834107947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f948814aab0 0x7f9488148f80 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f9480009dd0 tx=0x7f948000c3a0 comp rx=0 tx=0).stop 2023-07-27T20:34:03.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.097+0000 7f948f9ff700 1 -- 172.21.15.72:0/1834107947 shutdown_connections 2023-07-27T20:34:03.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.097+0000 7f948f9ff700 1 --2- 172.21.15.72:0/1834107947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f948814aab0 0x7f9488148f80 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:03.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.097+0000 7f948f9ff700 1 --2- 172.21.15.72:0/1834107947 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f946c06ad10 0x7f946c06d1d0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:03.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.097+0000 7f948f9ff700 1 --2- 172.21.15.72:0/1834107947 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94880c4700 0x7f9488155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:03.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.097+0000 7f948f9ff700 1 --2- 172.21.15.72:0/1834107947 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94880c7740 0x7f9488148a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:03.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.097+0000 7f948f9ff700 1 -- 172.21.15.72:0/1834107947 >> 172.21.15.72:0/1834107947 conn(0x7f94880ab3f0 msgr2=0x7f948806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:03.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.097+0000 7f948f9ff700 1 -- 172.21.15.72:0/1834107947 shutdown_connections 2023-07-27T20:34:03.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.097+0000 7f948f9ff700 1 -- 172.21.15.72:0/1834107947 wait complete. 2023-07-27T20:34:03.102 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-07-27T20:34:03.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.314+0000 7efd453ff700 1 Processor -- start 2023-07-27T20:34:03.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.314+0000 7efd453ff700 1 -- start start 2023-07-27T20:34:03.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.316+0000 7efd453ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd4013b150 0x7efd40151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:03.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.316+0000 7efd453ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efd4006e140 0x7efd400ba310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:03.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.316+0000 7efd453ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd4006ce10 con 0x7efd400ba850 2023-07-27T20:34:03.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.316+0000 7efd453ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd40152680 con 0x7efd4006e140 2023-07-27T20:34:03.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.316+0000 7efd453ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd40152960 con 0x7efd4013b150 2023-07-27T20:34:03.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.316+0000 7efd3e7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efd4006e140 0x7efd400ba310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:03.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.316+0000 7efd3f7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7efd400ba850 0x7efd4006d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48288/0 (socket says 172.21.15.72:48288) 2023-07-27T20:34:03.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.316+0000 7efd3e7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efd4006e140 0x7efd400ba310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41042/0 (socket says 172.21.15.72:41042) 2023-07-27T20:34:03.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.316+0000 7efd3f7fe700 1 -- 172.21.15.72:0/420940228 learned_addr learned my addr 172.21.15.72:0/420940228 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:03.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.316+0000 7efd3effd700 1 --2- 172.21.15.72:0/420940228 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd4013b150 0x7efd40151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:03.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.316+0000 7efd3e7fc700 1 -- 172.21.15.72:0/420940228 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd4013b150 msgr2=0x7efd40151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:03.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.316+0000 7efd3e7fc700 1 --2- 172.21.15.72:0/420940228 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd4013b150 0x7efd40151dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:03.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.316+0000 7efd3e7fc700 1 -- 172.21.15.72:0/420940228 >> v1:172.21.15.72:6789/0 conn(0x7efd400ba850 legacy=0x7efd4006d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:03.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.316+0000 7efd3e7fc700 1 -- 172.21.15.72:0/420940228 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd40152c40 con 0x7efd4006e140 2023-07-27T20:34:03.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.316+0000 7efd3dffb700 1 -- 172.21.15.72:0/420940228 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1204450098 0 0) 0x7efd4006ce10 con 0x7efd400ba850 2023-07-27T20:34:03.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.317+0000 7efd3e7fc700 1 --2- 172.21.15.72:0/420940228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd4006e140 0x7efd400ba310 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7efd34009840 tx=0x7efd34009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3936db641c20968a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:03.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.317+0000 7efd3dffb700 1 -- 172.21.15.72:0/420940228 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd34011830 con 0x7efd4006e140 2023-07-27T20:34:03.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.317+0000 7efd3dffb700 1 -- 172.21.15.72:0/420940228 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd34011990 con 0x7efd4006e140 2023-07-27T20:34:03.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.317+0000 7efd3dffb700 1 -- 172.21.15.72:0/420940228 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd34011d20 con 0x7efd4006e140 2023-07-27T20:34:03.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.317+0000 7efd453ff700 1 -- 172.21.15.72:0/420940228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd4006e140 msgr2=0x7efd400ba310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:03.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.317+0000 7efd453ff700 1 --2- 172.21.15.72:0/420940228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd4006e140 0x7efd400ba310 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7efd34009840 tx=0x7efd34009b50 comp rx=0 tx=0).stop 2023-07-27T20:34:03.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.317+0000 7efd453ff700 1 -- 172.21.15.72:0/420940228 shutdown_connections 2023-07-27T20:34:03.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.317+0000 7efd453ff700 1 --2- 172.21.15.72:0/420940228 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd4013b150 0x7efd40151dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:03.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.317+0000 7efd453ff700 1 --2- 172.21.15.72:0/420940228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd4006e140 0x7efd400ba310 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:03.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.318+0000 7efd453ff700 1 -- 172.21.15.72:0/420940228 >> 172.21.15.72:0/420940228 conn(0x7efd4006a190 msgr2=0x7efd4006a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:03.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.318+0000 7efd453ff700 1 -- 172.21.15.72:0/420940228 shutdown_connections 2023-07-27T20:34:03.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.318+0000 7efd453ff700 1 -- 172.21.15.72:0/420940228 wait complete. 2023-07-27T20:34:03.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.319+0000 7efd453ff700 1 Processor -- start 2023-07-27T20:34:03.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.319+0000 7efd453ff700 1 -- start start 2023-07-27T20:34:03.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.320+0000 7efd453ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd4006e140 0x7efd400a9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:03.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.320+0000 7efd453ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd400ba850 0x7efd400c3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:03.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.320+0000 7efd453ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd4013b150 0x7efd40137330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:03.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.320+0000 7efd453ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4014d1f0 con 0x7efd4006e140 2023-07-27T20:34:03.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.320+0000 7efd453ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd400aab20 con 0x7efd4013b150 2023-07-27T20:34:03.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.320+0000 7efd453ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd400aa280 con 0x7efd400ba850 2023-07-27T20:34:03.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.320+0000 7efd3effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd4006e140 0x7efd400a9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:03.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.320+0000 7efd3effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd4006e140 0x7efd400a9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41056/0 (socket says 172.21.15.72:41056) 2023-07-27T20:34:03.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.320+0000 7efd3effd700 1 -- 172.21.15.72:0/196666782 learned_addr learned my addr 172.21.15.72:0/196666782 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:03.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.321+0000 7efd3effd700 1 -- 172.21.15.72:0/196666782 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd400ba850 msgr2=0x7efd400c3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:03.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.321+0000 7efd3effd700 1 --2- 172.21.15.72:0/196666782 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd400ba850 0x7efd400c3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:03.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.321+0000 7efd3effd700 1 -- 172.21.15.72:0/196666782 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd4013b150 msgr2=0x7efd40137330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:03.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.321+0000 7efd3effd700 1 --2- 172.21.15.72:0/196666782 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd4013b150 0x7efd40137330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:03.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.321+0000 7efd3effd700 1 -- 172.21.15.72:0/196666782 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd340094a0 con 0x7efd4006e140 2023-07-27T20:34:03.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.321+0000 7efd3effd700 1 --2- 172.21.15.72:0/196666782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd4006e140 0x7efd400a9ba0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7efd3000e9b0 tx=0x7efd3000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:03.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.321+0000 7efd277fe700 1 -- 172.21.15.72:0/196666782 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3000c850 con 0x7efd4006e140 2023-07-27T20:34:03.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.321+0000 7efd277fe700 1 -- 172.21.15.72:0/196666782 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd3000c9b0 con 0x7efd4006e140 2023-07-27T20:34:03.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.321+0000 7efd277fe700 1 -- 172.21.15.72:0/196666782 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3000cd20 con 0x7efd4006e140 2023-07-27T20:34:03.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.321+0000 7efd453ff700 1 -- 172.21.15.72:0/196666782 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd400aa560 con 0x7efd4006e140 2023-07-27T20:34:03.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.321+0000 7efd453ff700 1 -- 172.21.15.72:0/196666782 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd401ea930 con 0x7efd4006e140 2023-07-27T20:34:03.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.322+0000 7efd453ff700 1 -- 172.21.15.72:0/196666782 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd4004e470 con 0x7efd4006e140 2023-07-27T20:34:03.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.323+0000 7efd277fe700 1 -- 172.21.15.72:0/196666782 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efd30013470 con 0x7efd4006e140 2023-07-27T20:34:03.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.325+0000 7efd277fe700 1 --2- 172.21.15.72:0/196666782 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7efd2c06ace0 0x7efd2c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:03.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.325+0000 7efd277fe700 1 -- 172.21.15.72:0/196666782 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7efd30089a80 con 0x7efd4006e140 2023-07-27T20:34:03.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.325+0000 7efd3e7fc700 1 --2- 172.21.15.72:0/196666782 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7efd2c06ace0 0x7efd2c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:03.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.326+0000 7efd3e7fc700 1 --2- 172.21.15.72:0/196666782 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7efd2c06ace0 0x7efd2c06d1a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7efd400ba660 tx=0x7efd34010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:03.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.329+0000 7efd277fe700 1 -- 172.21.15.72:0/196666782 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7efd30054670 con 0x7efd4006e140 2023-07-27T20:34:03.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.522+0000 7efd453ff700 1 -- 172.21.15.72:0/196666782 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7efd400bfdb0 con 0x7efd4006e140 2023-07-27T20:34:03.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.522+0000 7efd277fe700 1 -- 172.21.15.72:0/196666782 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v47) v1 ==== 105+0+11 (secure 0 0 0) 0x7efd30057c90 con 0x7efd4006e140 2023-07-27T20:34:03.510 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:34:03.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.524+0000 7efd453ff700 1 -- 172.21.15.72:0/196666782 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7efd2c06ace0 msgr2=0x7efd2c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:03.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.524+0000 7efd453ff700 1 --2- 172.21.15.72:0/196666782 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7efd2c06ace0 0x7efd2c06d1a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7efd400ba660 tx=0x7efd34010000 comp rx=0 tx=0).stop 2023-07-27T20:34:03.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.524+0000 7efd453ff700 1 -- 172.21.15.72:0/196666782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd4006e140 msgr2=0x7efd400a9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:03.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.524+0000 7efd453ff700 1 --2- 172.21.15.72:0/196666782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd4006e140 0x7efd400a9ba0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7efd3000e9b0 tx=0x7efd3000ed70 comp rx=0 tx=0).stop 2023-07-27T20:34:03.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.524+0000 7efd453ff700 1 -- 172.21.15.72:0/196666782 shutdown_connections 2023-07-27T20:34:03.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.524+0000 7efd453ff700 1 --2- 172.21.15.72:0/196666782 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd4013b150 0x7efd40137330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:03.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.524+0000 7efd453ff700 1 --2- 172.21.15.72:0/196666782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd4006e140 0x7efd400a9ba0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:03.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.524+0000 7efd453ff700 1 --2- 172.21.15.72:0/196666782 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7efd2c06ace0 0x7efd2c06d1a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:03.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.524+0000 7efd453ff700 1 --2- 172.21.15.72:0/196666782 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd400ba850 0x7efd400c3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:03.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.524+0000 7efd453ff700 1 -- 172.21.15.72:0/196666782 >> 172.21.15.72:0/196666782 conn(0x7efd4006a190 msgr2=0x7efd40151be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:03.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.525+0000 7efd453ff700 1 -- 172.21.15.72:0/196666782 shutdown_connections 2023-07-27T20:34:03.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.525+0000 7efd453ff700 1 -- 172.21.15.72:0/196666782 wait complete. 2023-07-27T20:34:03.530 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-07-27T20:34:03.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.742+0000 7f69175ff700 1 Processor -- start 2023-07-27T20:34:03.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.743+0000 7f69175ff700 1 -- start start 2023-07-27T20:34:03.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.744+0000 7f69175ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f691014aab0 0x7f6910154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:03.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.744+0000 7f69175ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69100c7c50 con 0x7f69100c7740 2023-07-27T20:34:03.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.744+0000 7f69175ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f691006bd40 con 0x7f691006c1d0 2023-07-27T20:34:03.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.744+0000 7f69175ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f691006cd50 con 0x7f691014aab0 2023-07-27T20:34:03.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.744+0000 7f6914b9a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f69100c7740 0x7f69100c41c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48292/0 (socket says 172.21.15.72:48292) 2023-07-27T20:34:03.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.745+0000 7f6914b9a700 1 -- 172.21.15.72:0/757324647 learned_addr learned my addr 172.21.15.72:0/757324647 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:03.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.745+0000 7f691539b700 1 --2- 172.21.15.72:0/757324647 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f691014aab0 0x7f6910154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:03.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.745+0000 7f6907fff700 1 -- 172.21.15.72:0/757324647 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1038559494 0 0) 0x7f69100c7c50 con 0x7f69100c7740 2023-07-27T20:34:03.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.745+0000 7f6907fff700 1 -- 172.21.15.72:0/757324647 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68fc0035b0 con 0x7f69100c7740 2023-07-27T20:34:03.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.745+0000 7f6907fff700 1 -- 172.21.15.72:0/757324647 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3404056973 0 0) 0x7f68fc0035b0 con 0x7f69100c7740 2023-07-27T20:34:03.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.745+0000 7f6907fff700 1 -- 172.21.15.72:0/757324647 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f691014aab0 msgr2=0x7f6910154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:03.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.745+0000 7f6907fff700 1 --2- 172.21.15.72:0/757324647 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f691014aab0 0x7f6910154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:03.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.745+0000 7f6907fff700 1 -- 172.21.15.72:0/757324647 >> v1:172.21.15.173:6789/0 conn(0x7f691006c1d0 legacy=0x7f691006c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:03.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.745+0000 7f6907fff700 1 -- 172.21.15.72:0/757324647 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69100c62f0 con 0x7f69100c7740 2023-07-27T20:34:03.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.745+0000 7f6907fff700 1 -- 172.21.15.72:0/757324647 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f6900001670 con 0x7f69100c7740 2023-07-27T20:34:03.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.745+0000 7f6907fff700 1 -- 172.21.15.72:0/757324647 >> v1:172.21.15.72:6789/0 conn(0x7f69100c7740 legacy=0x7f69100c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:03.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.745+0000 7f6907fff700 1 --2- 172.21.15.72:0/757324647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68fc003a30 0x7f68fc003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:03.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.745+0000 7f6907fff700 1 --2- 172.21.15.72:0/757324647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68fc004850 0x7f68fc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:03.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.745+0000 7f6907fff700 1 --2- 172.21.15.72:0/757324647 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f691014aab0 0x7f68fc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:03.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.745+0000 7f6907fff700 1 -- 172.21.15.72:0/757324647 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691006cd50 con 0x7f68fc003a30 2023-07-27T20:34:03.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.745+0000 7f6907fff700 1 -- 172.21.15.72:0/757324647 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc00bac0 con 0x7f68fc004850 2023-07-27T20:34:03.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.745+0000 7f6907fff700 1 -- 172.21.15.72:0/757324647 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc00bc80 con 0x7f691014aab0 2023-07-27T20:34:03.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.746+0000 7f691539b700 1 --2- 172.21.15.72:0/757324647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68fc003a30 0x7f68fc003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:03.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.746+0000 7f6914b9a700 1 --2- 172.21.15.72:0/757324647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68fc004850 0x7f68fc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:03.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.746+0000 7f6915b9c700 1 --2- 172.21.15.72:0/757324647 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f691014aab0 0x7f68fc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:03.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.746+0000 7f691539b700 1 -- 172.21.15.72:0/757324647 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f691014aab0 msgr2=0x7f68fc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:03.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.746+0000 7f691539b700 1 --2- 172.21.15.72:0/757324647 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f691014aab0 0x7f68fc005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:03.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.746+0000 7f691539b700 1 -- 172.21.15.72:0/757324647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68fc004850 msgr2=0x7f68fc004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:03.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.746+0000 7f691539b700 1 --2- 172.21.15.72:0/757324647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68fc004850 0x7f68fc004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:03.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.746+0000 7f691539b700 1 -- 172.21.15.72:0/757324647 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68fc0035b0 con 0x7f68fc003a30 2023-07-27T20:34:03.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.746+0000 7f6914b9a700 1 --2- 172.21.15.72:0/757324647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68fc004850 0x7f68fc004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:03.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.746+0000 7f691539b700 1 --2- 172.21.15.72:0/757324647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68fc003a30 0x7f68fc003e50 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f690c009b30 tx=0x7f68fc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2610d67b1e9f9ae6 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:03.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.746+0000 7f6907fff700 1 -- 172.21.15.72:0/757324647 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690c00e6c0 con 0x7f68fc003a30 2023-07-27T20:34:03.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.747+0000 7f6907fff700 1 -- 172.21.15.72:0/757324647 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690c00e820 con 0x7f68fc003a30 2023-07-27T20:34:03.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.747+0000 7f6907fff700 1 -- 172.21.15.72:0/757324647 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690c00eb90 con 0x7f68fc003a30 2023-07-27T20:34:03.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.747+0000 7f69175ff700 1 -- 172.21.15.72:0/757324647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68fc003a30 msgr2=0x7f68fc003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:03.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.747+0000 7f69175ff700 1 --2- 172.21.15.72:0/757324647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68fc003a30 0x7f68fc003e50 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f690c009b30 tx=0x7f68fc005880 comp rx=0 tx=0).stop 2023-07-27T20:34:03.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.747+0000 7f6915b9c700 1 -- 172.21.15.72:0/757324647 reap_dead start 2023-07-27T20:34:03.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.747+0000 7f69175ff700 1 -- 172.21.15.72:0/757324647 shutdown_connections 2023-07-27T20:34:03.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.747+0000 7f69175ff700 1 -- 172.21.15.72:0/757324647 >> 172.21.15.72:0/757324647 conn(0x7f69100ab3f0 msgr2=0x7f69100ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:03.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.747+0000 7f69175ff700 1 -- 172.21.15.72:0/757324647 shutdown_connections 2023-07-27T20:34:03.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.747+0000 7f69175ff700 1 -- 172.21.15.72:0/757324647 wait complete. 2023-07-27T20:34:03.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.749+0000 7f69175ff700 1 Processor -- start 2023-07-27T20:34:03.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.749+0000 7f69175ff700 1 -- start start 2023-07-27T20:34:03.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.750+0000 7f69175ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68fc003a30 0x7f691014e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:03.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.750+0000 7f69175ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f69101eb1d0 0x7f691014d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:03.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.750+0000 7f69175ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f691014d590 0x7f6910145a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:03.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.750+0000 7f69175ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691014f220 con 0x7f68fc003a30 2023-07-27T20:34:03.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.750+0000 7f69175ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691014cbc0 con 0x7f691014d590 2023-07-27T20:34:03.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.750+0000 7f69175ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f691014bff0 con 0x7f69101eb1d0 2023-07-27T20:34:03.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.750+0000 7f691539b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68fc003a30 0x7f691014e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:03.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.750+0000 7f691539b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68fc003a30 0x7f691014e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41074/0 (socket says 172.21.15.72:41074) 2023-07-27T20:34:03.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.750+0000 7f691539b700 1 -- 172.21.15.72:0/1221048416 learned_addr learned my addr 172.21.15.72:0/1221048416 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:03.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.750+0000 7f6914b9a700 1 --2- 172.21.15.72:0/1221048416 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f69101eb1d0 0x7f691014d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:03.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.750+0000 7f6915b9c700 1 --2- 172.21.15.72:0/1221048416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f691014d590 0x7f6910145a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:03.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.750+0000 7f691539b700 1 -- 172.21.15.72:0/1221048416 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f69101eb1d0 msgr2=0x7f691014d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:03.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.750+0000 7f691539b700 1 --2- 172.21.15.72:0/1221048416 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f69101eb1d0 0x7f691014d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:03.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.751+0000 7f691539b700 1 -- 172.21.15.72:0/1221048416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f691014d590 msgr2=0x7f6910145a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:03.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.751+0000 7f691539b700 1 --2- 172.21.15.72:0/1221048416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f691014d590 0x7f6910145a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:03.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.751+0000 7f691539b700 1 -- 172.21.15.72:0/1221048416 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f691014c290 con 0x7f68fc003a30 2023-07-27T20:34:03.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.751+0000 7f6915b9c700 1 --2- 172.21.15.72:0/1221048416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f691014d590 0x7f6910145a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:03.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.751+0000 7f691539b700 1 --2- 172.21.15.72:0/1221048416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68fc003a30 0x7f691014e9a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f68fc0047b0 tx=0x7f690c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:03.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.751+0000 7f6905ffb700 1 -- 172.21.15.72:0/1221048416 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690c00e6c0 con 0x7f68fc003a30 2023-07-27T20:34:03.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.751+0000 7f6905ffb700 1 -- 172.21.15.72:0/1221048416 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690c0038a0 con 0x7f68fc003a30 2023-07-27T20:34:03.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.751+0000 7f69175ff700 1 -- 172.21.15.72:0/1221048416 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f691014c570 con 0x7f68fc003a30 2023-07-27T20:34:03.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.751+0000 7f6905ffb700 1 -- 172.21.15.72:0/1221048416 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690c003c50 con 0x7f68fc003a30 2023-07-27T20:34:03.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.751+0000 7f69175ff700 1 -- 172.21.15.72:0/1221048416 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f691014eee0 con 0x7f68fc003a30 2023-07-27T20:34:03.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.752+0000 7f69175ff700 1 -- 172.21.15.72:0/1221048416 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f691014cea0 con 0x7f68fc003a30 2023-07-27T20:34:03.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.753+0000 7f6905ffb700 1 -- 172.21.15.72:0/1221048416 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f690c013470 con 0x7f68fc003a30 2023-07-27T20:34:03.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.754+0000 7f6905ffb700 1 --2- 172.21.15.72:0/1221048416 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f68f406ace0 0x7f68f406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:03.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.754+0000 7f6905ffb700 1 -- 172.21.15.72:0/1221048416 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f690c08b0d0 con 0x7f68fc003a30 2023-07-27T20:34:03.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.754+0000 7f6914b9a700 1 --2- 172.21.15.72:0/1221048416 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f68f406ace0 0x7f68f406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:03.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.755+0000 7f6914b9a700 1 --2- 172.21.15.72:0/1221048416 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f68f406ace0 0x7f68f406d1a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f69000017a0 tx=0x7f6900007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:03.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.758+0000 7f6905ffb700 1 -- 172.21.15.72:0/1221048416 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f690c055cc0 con 0x7f68fc003a30 2023-07-27T20:34:03.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.951+0000 7f69175ff700 1 -- 172.21.15.72:0/1221048416 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f691004e470 con 0x7f68fc003a30 2023-07-27T20:34:03.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.951+0000 7f6905ffb700 1 -- 172.21.15.72:0/1221048416 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v47) v1 ==== 101+0+11 (secure 0 0 0) 0x7f690c0592e0 con 0x7f68fc003a30 2023-07-27T20:34:03.939 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-27T20:34:03.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.954+0000 7f69175ff700 1 -- 172.21.15.72:0/1221048416 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f68f406ace0 msgr2=0x7f68f406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:03.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.954+0000 7f69175ff700 1 --2- 172.21.15.72:0/1221048416 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f68f406ace0 0x7f68f406d1a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f69000017a0 tx=0x7f6900007040 comp rx=0 tx=0).stop 2023-07-27T20:34:03.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.954+0000 7f69175ff700 1 -- 172.21.15.72:0/1221048416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68fc003a30 msgr2=0x7f691014e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:03.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.954+0000 7f69175ff700 1 --2- 172.21.15.72:0/1221048416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68fc003a30 0x7f691014e9a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f68fc0047b0 tx=0x7f690c0047c0 comp rx=0 tx=0).stop 2023-07-27T20:34:03.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.954+0000 7f69175ff700 1 -- 172.21.15.72:0/1221048416 shutdown_connections 2023-07-27T20:34:03.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.954+0000 7f69175ff700 1 --2- 172.21.15.72:0/1221048416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f691014d590 0x7f6910145a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:03.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.954+0000 7f69175ff700 1 --2- 172.21.15.72:0/1221048416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68fc003a30 0x7f691014e9a0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:03.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.954+0000 7f69175ff700 1 --2- 172.21.15.72:0/1221048416 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f68f406ace0 0x7f68f406d1a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:03.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.954+0000 7f69175ff700 1 --2- 172.21.15.72:0/1221048416 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f69101eb1d0 0x7f691014d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:03.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.954+0000 7f69175ff700 1 -- 172.21.15.72:0/1221048416 >> 172.21.15.72:0/1221048416 conn(0x7f69100ab3f0 msgr2=0x7f69100c8760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:03.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.954+0000 7f69175ff700 1 -- 172.21.15.72:0/1221048416 shutdown_connections 2023-07-27T20:34:03.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:03.954+0000 7f69175ff700 1 -- 172.21.15.72:0/1221048416 wait complete. 2023-07-27T20:34:03.959 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-27T20:34:04.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.170+0000 7f70a3bff700 1 Processor -- start 2023-07-27T20:34:04.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.170+0000 7f70a3bff700 1 -- start start 2023-07-27T20:34:04.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.171+0000 7f70a3bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f709c139f80 0x7f709c0c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:04.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.171+0000 7f70a3bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f709c1542e0 0x7f709c154730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:04.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.171+0000 7f70a3bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f709c0c1810 con 0x7f709c139960 2023-07-27T20:34:04.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.171+0000 7f70a3bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f709c0c0ee0 con 0x7f709c1542e0 2023-07-27T20:34:04.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.171+0000 7f70a3bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f709c139d40 con 0x7f709c139f80 2023-07-27T20:34:04.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.171+0000 7f70a219c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f709c1542e0 0x7f709c154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:04.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.171+0000 7f70a199b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f709c139960 0x7f709c0c1e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48300/0 (socket says 172.21.15.72:48300) 2023-07-27T20:34:04.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.171+0000 7f70a219c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f709c1542e0 0x7f709c154730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41088/0 (socket says 172.21.15.72:41088) 2023-07-27T20:34:04.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.171+0000 7f70a199b700 1 -- 172.21.15.72:0/241877721 learned_addr learned my addr 172.21.15.72:0/241877721 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:04.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.171+0000 7f70a119a700 1 --2- 172.21.15.72:0/241877721 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f709c139f80 0x7f709c0c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:04.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.172+0000 7f70a219c700 1 -- 172.21.15.72:0/241877721 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f709c139f80 msgr2=0x7f709c0c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:04.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.172+0000 7f70a219c700 1 --2- 172.21.15.72:0/241877721 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f709c139f80 0x7f709c0c12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:04.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.172+0000 7f70a219c700 1 -- 172.21.15.72:0/241877721 >> v1:172.21.15.72:6789/0 conn(0x7f709c139960 legacy=0x7f709c0c1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:04.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.172+0000 7f70a219c700 1 -- 172.21.15.72:0/241877721 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f709c151060 con 0x7f709c1542e0 2023-07-27T20:34:04.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.172+0000 7f70a0999700 1 -- 172.21.15.72:0/241877721 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1695067164 0 0) 0x7f709c0c1810 con 0x7f709c139960 2023-07-27T20:34:04.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.172+0000 7f70a219c700 1 --2- 172.21.15.72:0/241877721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f709c1542e0 0x7f709c154730 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f7094009d90 tx=0x7f709400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba8a5732b6b0072 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:04.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.172+0000 7f70a0999700 1 -- 172.21.15.72:0/241877721 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709400e070 con 0x7f709c1542e0 2023-07-27T20:34:04.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.172+0000 7f70a0999700 1 -- 172.21.15.72:0/241877721 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709400bb20 con 0x7f709c1542e0 2023-07-27T20:34:04.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.172+0000 7f70a0999700 1 -- 172.21.15.72:0/241877721 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7094012430 con 0x7f709c1542e0 2023-07-27T20:34:04.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.173+0000 7f70a3bff700 1 -- 172.21.15.72:0/241877721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f709c1542e0 msgr2=0x7f709c154730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:04.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.173+0000 7f70a3bff700 1 --2- 172.21.15.72:0/241877721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f709c1542e0 0x7f709c154730 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f7094009d90 tx=0x7f709400b330 comp rx=0 tx=0).stop 2023-07-27T20:34:04.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.173+0000 7f70a3bff700 1 -- 172.21.15.72:0/241877721 shutdown_connections 2023-07-27T20:34:04.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.173+0000 7f70a3bff700 1 --2- 172.21.15.72:0/241877721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f709c1542e0 0x7f709c154730 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:04.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.173+0000 7f70a3bff700 1 --2- 172.21.15.72:0/241877721 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f709c139f80 0x7f709c0c12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:04.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.173+0000 7f70a3bff700 1 -- 172.21.15.72:0/241877721 >> 172.21.15.72:0/241877721 conn(0x7f709c06a190 msgr2=0x7f709c06a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:04.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.173+0000 7f70a3bff700 1 -- 172.21.15.72:0/241877721 shutdown_connections 2023-07-27T20:34:04.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.173+0000 7f70a3bff700 1 -- 172.21.15.72:0/241877721 wait complete. 2023-07-27T20:34:04.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.175+0000 7f70a3bff700 1 Processor -- start 2023-07-27T20:34:04.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.175+0000 7f70a3bff700 1 -- start start 2023-07-27T20:34:04.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.175+0000 7f70a3bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f709c139960 0x7f709c153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:04.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.175+0000 7f70a3bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f709c139f80 0x7f709c133230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:04.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.176+0000 7f70a3bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f709c1542e0 0x7f709c0aa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:04.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.176+0000 7f70a3bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c14ab20 con 0x7f709c139f80 2023-07-27T20:34:04.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.176+0000 7f70a3bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c0c3660 con 0x7f709c139960 2023-07-27T20:34:04.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.176+0000 7f70a3bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f709c138d80 con 0x7f709c1542e0 2023-07-27T20:34:04.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.176+0000 7f70a119a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f709c139f80 0x7f709c133230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:04.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.176+0000 7f70a119a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f709c139f80 0x7f709c133230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41096/0 (socket says 172.21.15.72:41096) 2023-07-27T20:34:04.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.176+0000 7f70a119a700 1 -- 172.21.15.72:0/1186270041 learned_addr learned my addr 172.21.15.72:0/1186270041 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:04.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.176+0000 7f70a219c700 1 --2- 172.21.15.72:0/1186270041 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f709c1542e0 0x7f709c0aa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:04.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.176+0000 7f70a119a700 1 -- 172.21.15.72:0/1186270041 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f709c1542e0 msgr2=0x7f709c0aa6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:04.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.176+0000 7f70a199b700 1 --2- 172.21.15.72:0/1186270041 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f709c139960 0x7f709c153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:04.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.176+0000 7f70a119a700 1 --2- 172.21.15.72:0/1186270041 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f709c1542e0 0x7f709c0aa6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.176+0000 7f70a119a700 1 -- 172.21.15.72:0/1186270041 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f709c139960 msgr2=0x7f709c153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.176+0000 7f70a119a700 1 --2- 172.21.15.72:0/1186270041 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f709c139960 0x7f709c153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.176+0000 7f70a119a700 1 -- 172.21.15.72:0/1186270041 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7094009a70 con 0x7f709c139f80 2023-07-27T20:34:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.176+0000 7f70a219c700 1 --2- 172.21.15.72:0/1186270041 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f709c1542e0 0x7f709c0aa6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.176+0000 7f70a199b700 1 --2- 172.21.15.72:0/1186270041 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f709c139960 0x7f709c153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.176+0000 7f70a119a700 1 --2- 172.21.15.72:0/1186270041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f709c139f80 0x7f709c133230 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f708c00e850 tx=0x7f708c00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.177+0000 7f70927fc700 1 -- 172.21.15.72:0/1186270041 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c0095b0 con 0x7f709c139f80 2023-07-27T20:34:04.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.177+0000 7f70927fc700 1 -- 172.21.15.72:0/1186270041 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708c00ee50 con 0x7f709c139f80 2023-07-27T20:34:04.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.177+0000 7f70a3bff700 1 -- 172.21.15.72:0/1186270041 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f709c0c3fe0 con 0x7f709c139f80 2023-07-27T20:34:04.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.177+0000 7f70927fc700 1 -- 172.21.15.72:0/1186270041 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c00ca10 con 0x7f709c139f80 2023-07-27T20:34:04.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.177+0000 7f70a3bff700 1 -- 172.21.15.72:0/1186270041 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f709c0c45a0 con 0x7f709c139f80 2023-07-27T20:34:04.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.178+0000 7f70a3bff700 1 -- 172.21.15.72:0/1186270041 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f709c074310 con 0x7f709c139f80 2023-07-27T20:34:04.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.179+0000 7f70927fc700 1 -- 172.21.15.72:0/1186270041 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f708c00cb70 con 0x7f709c139f80 2023-07-27T20:34:04.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.180+0000 7f70927fc700 1 --2- 172.21.15.72:0/1186270041 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f708006ace0 0x7f708006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:04.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.180+0000 7f70927fc700 1 -- 172.21.15.72:0/1186270041 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f708c0898a0 con 0x7f709c139f80 2023-07-27T20:34:04.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.181+0000 7f70a199b700 1 --2- 172.21.15.72:0/1186270041 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f708006ace0 0x7f708006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:04.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.181+0000 7f70a199b700 1 --2- 172.21.15.72:0/1186270041 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f708006ace0 0x7f708006d1a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7098000f60 tx=0x7f7098009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:04.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.185+0000 7f70927fc700 1 -- 172.21.15.72:0/1186270041 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f708c057fa0 con 0x7f709c139f80 2023-07-27T20:34:04.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.395+0000 7f70a3bff700 1 -- 172.21.15.72:0/1186270041 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f709c14e760 con 0x7f709c139f80 2023-07-27T20:34:04.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.395+0000 7f70927fc700 1 -- 172.21.15.72:0/1186270041 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v47) v1 ==== 80+0+0 (secure 0 0 0) 0x7f708c057b30 con 0x7f709c139f80 2023-07-27T20:34:04.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.398+0000 7f70a3bff700 1 -- 172.21.15.72:0/1186270041 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f708006ace0 msgr2=0x7f708006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:04.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.398+0000 7f70a3bff700 1 --2- 172.21.15.72:0/1186270041 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f708006ace0 0x7f708006d1a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7098000f60 tx=0x7f7098009040 comp rx=0 tx=0).stop 2023-07-27T20:34:04.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.398+0000 7f70a3bff700 1 -- 172.21.15.72:0/1186270041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f709c139f80 msgr2=0x7f709c133230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:04.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.398+0000 7f70a3bff700 1 --2- 172.21.15.72:0/1186270041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f709c139f80 0x7f709c133230 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f708c00e850 tx=0x7f708c00ec10 comp rx=0 tx=0).stop 2023-07-27T20:34:04.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.398+0000 7f70a3bff700 1 -- 172.21.15.72:0/1186270041 shutdown_connections 2023-07-27T20:34:04.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.398+0000 7f70a3bff700 1 --2- 172.21.15.72:0/1186270041 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f708006ace0 0x7f708006d1a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:04.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.398+0000 7f70a3bff700 1 --2- 172.21.15.72:0/1186270041 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f709c1542e0 0x7f709c0aa6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:04.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.398+0000 7f70a3bff700 1 --2- 172.21.15.72:0/1186270041 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f709c139960 0x7f709c153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:04.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.398+0000 7f70a3bff700 1 --2- 172.21.15.72:0/1186270041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f709c139f80 0x7f709c133230 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:04.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.398+0000 7f70a3bff700 1 -- 172.21.15.72:0/1186270041 >> 172.21.15.72:0/1186270041 conn(0x7f709c06a190 msgr2=0x7f709c06d100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:04.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.398+0000 7f70a3bff700 1 -- 172.21.15.72:0/1186270041 shutdown_connections 2023-07-27T20:34:04.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.398+0000 7f70a3bff700 1 -- 172.21.15.72:0/1186270041 wait complete. 2023-07-27T20:34:04.387 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-07-27T20:34:04.404 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi173.front.sepia.ceph.com... 2023-07-27T20:34:04.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:34:04.404 DEBUG:teuthology.orchestra.run.smithi173:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-07-27T20:34:04.478 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi173.stderr:ceph-fuse[149537]: fuse finished with error 0 and tester_r 0 2023-07-27T20:34:04.481 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi173.front.sepia.ceph.com 2023-07-27T20:34:04.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:34:04.482 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-27T20:34:04.607 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T20:34:04.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.815+0000 7f683a7ff700 1 Processor -- start 2023-07-27T20:34:04.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.815+0000 7f683a7ff700 1 -- start start 2023-07-27T20:34:04.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.817+0000 7f683a7ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6834139960 0x7f68340c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:04.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.817+0000 7f683a7ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6834139f80 0x7f68340c1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:04.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.817+0000 7f683a7ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f68340c2340 0x7f68341542e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:04.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.817+0000 7f683a7ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68340c0ee0 con 0x7f6834139f80 2023-07-27T20:34:04.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.817+0000 7f683a7ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68340c1810 con 0x7f68340c2340 2023-07-27T20:34:04.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.817+0000 7f683a7ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6834139d40 con 0x7f6834139960 2023-07-27T20:34:04.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.817+0000 7f68337fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6834139f80 0x7f68340c1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:04.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.817+0000 7f68337fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6834139f80 0x7f68340c1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41110/0 (socket says 172.21.15.72:41110) 2023-07-27T20:34:04.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.817+0000 7f68337fe700 1 -- 172.21.15.72:0/3864448984 learned_addr learned my addr 172.21.15.72:0/3864448984 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:04.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.817+0000 7f6833fff700 1 --2- 172.21.15.72:0/3864448984 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6834139960 0x7f68340c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:04.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.817+0000 7f6838d9c700 1 --2- 172.21.15.72:0/3864448984 >> v2:172.21.15.173:3300/0 conn(0x7f68340c2340 0x7f68341542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:04.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.817+0000 7f68337fe700 1 -- 172.21.15.72:0/3864448984 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6834139960 msgr2=0x7f68340c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:04.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.817+0000 7f68337fe700 1 --2- 172.21.15.72:0/3864448984 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6834139960 0x7f68340c12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:04.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.817+0000 7f68337fe700 1 -- 172.21.15.72:0/3864448984 >> v2:172.21.15.173:3300/0 conn(0x7f68340c2340 msgr2=0x7f68341542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:04.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.817+0000 7f68337fe700 1 --2- 172.21.15.72:0/3864448984 >> v2:172.21.15.173:3300/0 conn(0x7f68340c2340 0x7f68341542e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:04.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.817+0000 7f68337fe700 1 -- 172.21.15.72:0/3864448984 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6834151060 con 0x7f6834139f80 2023-07-27T20:34:04.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.818+0000 7f68337fe700 1 --2- 172.21.15.72:0/3864448984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6834139f80 0x7f68340c1e00 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f68340c28a0 tx=0x7f6828009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3a22fc36b56a50e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:04.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.818+0000 7f6832ffd700 1 -- 172.21.15.72:0/3864448984 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6828011830 con 0x7f6834139f80 2023-07-27T20:34:04.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.818+0000 7f6832ffd700 1 -- 172.21.15.72:0/3864448984 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6828011990 con 0x7f6834139f80 2023-07-27T20:34:04.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.818+0000 7f6832ffd700 1 -- 172.21.15.72:0/3864448984 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6828011d20 con 0x7f6834139f80 2023-07-27T20:34:04.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.818+0000 7f683a7ff700 1 -- 172.21.15.72:0/3864448984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6834139f80 msgr2=0x7f68340c1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:04.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.818+0000 7f683a7ff700 1 --2- 172.21.15.72:0/3864448984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6834139f80 0x7f68340c1e00 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f68340c28a0 tx=0x7f6828009bd0 comp rx=0 tx=0).stop 2023-07-27T20:34:04.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.818+0000 7f683a7ff700 1 -- 172.21.15.72:0/3864448984 shutdown_connections 2023-07-27T20:34:04.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.818+0000 7f683a7ff700 1 --2- 172.21.15.72:0/3864448984 >> v2:172.21.15.173:3300/0 conn(0x7f68340c2340 0x7f68341542e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:04.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.818+0000 7f683a7ff700 1 --2- 172.21.15.72:0/3864448984 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6834139960 0x7f68340c12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:04.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.818+0000 7f683a7ff700 1 --2- 172.21.15.72:0/3864448984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6834139f80 0x7f68340c1e00 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:04.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.818+0000 7f683a7ff700 1 -- 172.21.15.72:0/3864448984 >> 172.21.15.72:0/3864448984 conn(0x7f683406a190 msgr2=0x7f683406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:04.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.819+0000 7f683a7ff700 1 -- 172.21.15.72:0/3864448984 shutdown_connections 2023-07-27T20:34:04.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.819+0000 7f683a7ff700 1 -- 172.21.15.72:0/3864448984 wait complete. 2023-07-27T20:34:04.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.821+0000 7f683a7ff700 1 Processor -- start 2023-07-27T20:34:04.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.821+0000 7f683a7ff700 1 -- start start 2023-07-27T20:34:04.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.822+0000 7f683a7ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f68340c2340 0x7f6834137180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:04.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.822+0000 7f683a7ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6834139960 0x7f68340c3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:04.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.822+0000 7f683a7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6834139f80 0x7f68341eb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:04.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.822+0000 7f683a7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68341ebf90 con 0x7f6834139f80 2023-07-27T20:34:04.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.822+0000 7f683a7ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6834135000 con 0x7f6834139960 2023-07-27T20:34:04.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.822+0000 7f683a7ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68341352e0 con 0x7f68340c2340 2023-07-27T20:34:04.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.823+0000 7f6838d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6834139f80 0x7f68341eb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:04.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.823+0000 7f6838d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6834139f80 0x7f68341eb480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41122/0 (socket says 172.21.15.72:41122) 2023-07-27T20:34:04.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.823+0000 7f6838d9c700 1 -- 172.21.15.72:0/2995251872 learned_addr learned my addr 172.21.15.72:0/2995251872 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:04.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.823+0000 7f6833fff700 1 --2- 172.21.15.72:0/2995251872 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f68340c2340 0x7f6834137180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:04.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.823+0000 7f68337fe700 1 --2- 172.21.15.72:0/2995251872 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6834139960 0x7f68340c3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:04.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.823+0000 7f6838d9c700 1 -- 172.21.15.72:0/2995251872 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f68340c2340 msgr2=0x7f6834137180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:04.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.823+0000 7f6838d9c700 1 --2- 172.21.15.72:0/2995251872 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f68340c2340 0x7f6834137180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:04.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.823+0000 7f6838d9c700 1 -- 172.21.15.72:0/2995251872 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6834139960 msgr2=0x7f68340c3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:04.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.823+0000 7f6838d9c700 1 --2- 172.21.15.72:0/2995251872 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6834139960 0x7f68340c3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:04.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.823+0000 7f6838d9c700 1 -- 172.21.15.72:0/2995251872 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6828009550 con 0x7f6834139f80 2023-07-27T20:34:04.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.823+0000 7f68337fe700 1 --2- 172.21.15.72:0/2995251872 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6834139960 0x7f68340c3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:04.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.823+0000 7f6838d9c700 1 --2- 172.21.15.72:0/2995251872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6834139f80 0x7f68341eb480 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f682c00efc0 tx=0x7f682c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:04.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.823+0000 7f6830ff9700 1 -- 172.21.15.72:0/2995251872 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682c009ba0 con 0x7f6834139f80 2023-07-27T20:34:04.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.823+0000 7f6830ff9700 1 -- 172.21.15.72:0/2995251872 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682c00f040 con 0x7f6834139f80 2023-07-27T20:34:04.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.823+0000 7f683a7ff700 1 -- 172.21.15.72:0/2995251872 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68341355c0 con 0x7f6834139f80 2023-07-27T20:34:04.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.823+0000 7f6830ff9700 1 -- 172.21.15.72:0/2995251872 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682c014480 con 0x7f6834139f80 2023-07-27T20:34:04.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.824+0000 7f683a7ff700 1 -- 172.21.15.72:0/2995251872 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6834135c40 con 0x7f6834139f80 2023-07-27T20:34:04.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.825+0000 7f683a7ff700 1 -- 172.21.15.72:0/2995251872 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68340c3c30 con 0x7f6834139f80 2023-07-27T20:34:04.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.825+0000 7f6830ff9700 1 -- 172.21.15.72:0/2995251872 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f682c0145e0 con 0x7f6834139f80 2023-07-27T20:34:04.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.826+0000 7f6830ff9700 1 --2- 172.21.15.72:0/2995251872 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f682006ace0 0x7f682006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:04.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.826+0000 7f6830ff9700 1 -- 172.21.15.72:0/2995251872 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f682c08a200 con 0x7f6834139f80 2023-07-27T20:34:04.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.827+0000 7f6833fff700 1 --2- 172.21.15.72:0/2995251872 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f682006ace0 0x7f682006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:04.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.827+0000 7f6833fff700 1 --2- 172.21.15.72:0/2995251872 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f682006ace0 0x7f682006d1a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f68340a97e0 tx=0x7f6824008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:04.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:04.831+0000 7f6830ff9700 1 -- 172.21.15.72:0/2995251872 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f68340c3c30 con 0x7f6834139f80 2023-07-27T20:34:05.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.065+0000 7f683a7ff700 1 -- 172.21.15.72:0/2995251872 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68340c3c30 con 0x7f6834139f80 2023-07-27T20:34:05.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.066+0000 7f6830ff9700 1 -- 172.21.15.72:0/2995251872 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+5816 (secure 0 0 0) 0x7f68340c3c30 con 0x7f6834139f80 2023-07-27T20:34:05.055 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:34:05.056 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/1685903768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1685903768},{"type":"v1","addr":"172.21.15.173:6836","nonce":1685903768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5269,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/43862591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":43862591},{"type":"v1","addr":"172.21.15.173:6837","nonce":43862591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T20:33:00.054239+0000","modified":"2023-07-27T20:33:03.586058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5409},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5409":{"gid":5409,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.72:6834/1959104268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":1959104268},{"type":"v1","addr":"172.21.15.72:6834","nonce":1959104268}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T20:33:21.678859+0000","modified":"2023-07-27T20:33:25.206336+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5281":{"gid":5281,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.72:6835/1644610738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1644610738},{"type":"v1","addr":"172.21.15.72:6835","nonce":1644610738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-27T20:34:05.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.068+0000 7f683a7ff700 1 -- 172.21.15.72:0/2995251872 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f682006ace0 msgr2=0x7f682006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:05.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.068+0000 7f683a7ff700 1 --2- 172.21.15.72:0/2995251872 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f682006ace0 0x7f682006d1a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f68340a97e0 tx=0x7f6824008040 comp rx=0 tx=0).stop 2023-07-27T20:34:05.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.068+0000 7f683a7ff700 1 -- 172.21.15.72:0/2995251872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6834139f80 msgr2=0x7f68341eb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:05.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.068+0000 7f683a7ff700 1 --2- 172.21.15.72:0/2995251872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6834139f80 0x7f68341eb480 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f682c00efc0 tx=0x7f682c00c3a0 comp rx=0 tx=0).stop 2023-07-27T20:34:05.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.068+0000 7f683a7ff700 1 -- 172.21.15.72:0/2995251872 shutdown_connections 2023-07-27T20:34:05.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.068+0000 7f683a7ff700 1 --2- 172.21.15.72:0/2995251872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6834139f80 0x7f68341eb480 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:05.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.068+0000 7f683a7ff700 1 --2- 172.21.15.72:0/2995251872 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f682006ace0 0x7f682006d1a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:05.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.068+0000 7f683a7ff700 1 --2- 172.21.15.72:0/2995251872 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f68340c2340 0x7f6834137180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:05.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.068+0000 7f683a7ff700 1 --2- 172.21.15.72:0/2995251872 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6834139960 0x7f68340c3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:05.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.068+0000 7f683a7ff700 1 -- 172.21.15.72:0/2995251872 >> 172.21.15.72:0/2995251872 conn(0x7f683406a190 msgr2=0x7f68340c5360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:05.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.068+0000 7f683a7ff700 1 -- 172.21.15.72:0/2995251872 shutdown_connections 2023-07-27T20:34:05.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.068+0000 7f683a7ff700 1 -- 172.21.15.72:0/2995251872 wait complete. 2023-07-27T20:34:05.060 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 22 2023-07-27T20:34:05.074 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:34:05.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.283+0000 7f96fadff700 1 Processor -- start 2023-07-27T20:34:05.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.283+0000 7f96fadff700 1 -- start start 2023-07-27T20:34:05.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.285+0000 7f96fadff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f96f40c7710 0x7f96f41514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:05.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.285+0000 7f96fadff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96f4155100 con 0x7f96f406b150 2023-07-27T20:34:05.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.285+0000 7f96fadff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96f40c7af0 con 0x7f96f40c4400 2023-07-27T20:34:05.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.285+0000 7f96fadff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96f41545d0 con 0x7f96f40c7710 2023-07-27T20:34:05.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.285+0000 7f96f939c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f96f40c7710 0x7f96f41514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:05.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.285+0000 7f96f3fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f96f406b150 0x7f96f41549f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48308/0 (socket says 172.21.15.72:48308) 2023-07-27T20:34:05.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.285+0000 7f96f3fff700 1 -- 172.21.15.72:0/409773516 learned_addr learned my addr 172.21.15.72:0/409773516 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:05.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.285+0000 7f96f939c700 1 -- 172.21.15.72:0/409773516 >> v1:172.21.15.173:6789/0 conn(0x7f96f40c4400 legacy=0x7f96f40c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:05.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.285+0000 7f96f939c700 1 -- 172.21.15.72:0/409773516 >> v1:172.21.15.72:6789/0 conn(0x7f96f406b150 legacy=0x7f96f41549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:05.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.285+0000 7f96f939c700 1 -- 172.21.15.72:0/409773516 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f406b710 con 0x7f96f40c7710 2023-07-27T20:34:05.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.285+0000 7f96f939c700 1 --2- 172.21.15.72:0/409773516 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96f40c7710 0x7f96f41514a0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f96ec009d90 tx=0x7f96ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=526bf1b88fe6a3f9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:05.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.286+0000 7f96f37fe700 1 -- 172.21.15.72:0/409773516 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ec00e070 con 0x7f96f40c7710 2023-07-27T20:34:05.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.286+0000 7f96f37fe700 1 -- 172.21.15.72:0/409773516 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96ec00bbd0 con 0x7f96f40c7710 2023-07-27T20:34:05.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.286+0000 7f96f37fe700 1 -- 172.21.15.72:0/409773516 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ec012430 con 0x7f96f40c7710 2023-07-27T20:34:05.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.286+0000 7f96fadff700 1 -- 172.21.15.72:0/409773516 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96f40c7710 msgr2=0x7f96f41514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:05.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.286+0000 7f96fadff700 1 --2- 172.21.15.72:0/409773516 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96f40c7710 0x7f96f41514a0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f96ec009d90 tx=0x7f96ec00b330 comp rx=0 tx=0).stop 2023-07-27T20:34:05.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.286+0000 7f96fadff700 1 -- 172.21.15.72:0/409773516 shutdown_connections 2023-07-27T20:34:05.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.286+0000 7f96fadff700 1 --2- 172.21.15.72:0/409773516 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96f40c7710 0x7f96f41514a0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:05.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.286+0000 7f96fadff700 1 -- 172.21.15.72:0/409773516 >> 172.21.15.72:0/409773516 conn(0x7f96f40ab300 msgr2=0x7f96f40ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:05.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.286+0000 7f96fadff700 1 -- 172.21.15.72:0/409773516 shutdown_connections 2023-07-27T20:34:05.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.286+0000 7f96fadff700 1 -- 172.21.15.72:0/409773516 wait complete. 2023-07-27T20:34:05.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.288+0000 7f96fadff700 1 Processor -- start 2023-07-27T20:34:05.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.288+0000 7f96fadff700 1 -- start start 2023-07-27T20:34:05.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.289+0000 7f96fadff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96f406b150 0x7f96f41ecf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:05.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.289+0000 7f96fadff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f96f40c4400 0x7f96f40c2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:05.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.289+0000 7f96fadff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96f40c7710 0x7f96f414fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:05.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.289+0000 7f96fadff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f41ed490 con 0x7f96f406b150 2023-07-27T20:34:05.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.289+0000 7f96fadff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f41ec500 con 0x7f96f40c7710 2023-07-27T20:34:05.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.289+0000 7f96fadff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f40c3790 con 0x7f96f40c4400 2023-07-27T20:34:05.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.289+0000 7f96f8b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96f406b150 0x7f96f41ecf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:05.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.289+0000 7f96f8b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96f406b150 0x7f96f41ecf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41132/0 (socket says 172.21.15.72:41132) 2023-07-27T20:34:05.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.289+0000 7f96f8b9b700 1 -- 172.21.15.72:0/2207867422 learned_addr learned my addr 172.21.15.72:0/2207867422 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:05.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.290+0000 7f96f3fff700 1 --2- 172.21.15.72:0/2207867422 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f96f40c4400 0x7f96f40c2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:05.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.290+0000 7f96f939c700 1 --2- 172.21.15.72:0/2207867422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96f40c7710 0x7f96f414fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:05.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.290+0000 7f96f8b9b700 1 -- 172.21.15.72:0/2207867422 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f96f40c4400 msgr2=0x7f96f40c2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:05.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.290+0000 7f96f8b9b700 1 --2- 172.21.15.72:0/2207867422 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f96f40c4400 0x7f96f40c2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:05.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.290+0000 7f96f8b9b700 1 -- 172.21.15.72:0/2207867422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96f40c7710 msgr2=0x7f96f414fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:05.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.290+0000 7f96f8b9b700 1 --2- 172.21.15.72:0/2207867422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96f40c7710 0x7f96f414fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:05.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.290+0000 7f96f8b9b700 1 -- 172.21.15.72:0/2207867422 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96ec009a70 con 0x7f96f406b150 2023-07-27T20:34:05.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.290+0000 7f96f939c700 1 --2- 172.21.15.72:0/2207867422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96f40c7710 0x7f96f414fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:05.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.290+0000 7f96f8b9b700 1 --2- 172.21.15.72:0/2207867422 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96f406b150 0x7f96f41ecf50 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f96e800c4e0 tx=0x7f96e800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:05.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.290+0000 7f96f17fa700 1 -- 172.21.15.72:0/2207867422 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e80052d0 con 0x7f96f406b150 2023-07-27T20:34:05.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.290+0000 7f96f17fa700 1 -- 172.21.15.72:0/2207867422 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e8005430 con 0x7f96f406b150 2023-07-27T20:34:05.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.290+0000 7f96f17fa700 1 -- 172.21.15.72:0/2207867422 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e80038c0 con 0x7f96f406b150 2023-07-27T20:34:05.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.290+0000 7f96fadff700 1 -- 172.21.15.72:0/2207867422 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96f40c3a70 con 0x7f96f406b150 2023-07-27T20:34:05.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.290+0000 7f96fadff700 1 -- 172.21.15.72:0/2207867422 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96f41eca30 con 0x7f96f406b150 2023-07-27T20:34:05.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.292+0000 7f96fadff700 1 -- 172.21.15.72:0/2207867422 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96f40c3c60 con 0x7f96f406b150 2023-07-27T20:34:05.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.292+0000 7f96f17fa700 1 -- 172.21.15.72:0/2207867422 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f96e8003a20 con 0x7f96f406b150 2023-07-27T20:34:05.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.293+0000 7f96f17fa700 1 --2- 172.21.15.72:0/2207867422 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f96d806ace0 0x7f96d806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:05.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.294+0000 7f96f17fa700 1 -- 172.21.15.72:0/2207867422 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f96e8088eb0 con 0x7f96f406b150 2023-07-27T20:34:05.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.294+0000 7f96f3fff700 1 --2- 172.21.15.72:0/2207867422 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f96d806ace0 0x7f96d806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:05.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.295+0000 7f96f3fff700 1 --2- 172.21.15.72:0/2207867422 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f96d806ace0 0x7f96d806d1a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f96f4150b40 tx=0x7f96e0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:05.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.297+0000 7f96f17fa700 1 -- 172.21.15.72:0/2207867422 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f96e8053aa0 con 0x7f96f406b150 2023-07-27T20:34:05.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.490+0000 7f96fadff700 1 -- 172.21.15.72:0/2207867422 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96f40742f0 con 0x7f96f406b150 2023-07-27T20:34:05.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.491+0000 7f96f17fa700 1 -- 172.21.15.72:0/2207867422 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+22308 (secure 0 0 0) 0x7f96e80570c0 con 0x7f96f406b150 2023-07-27T20:34:05.479 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:34:05.479 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":47,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:33:23.191066+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:32:58.242890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-27T20:32:59.032110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_metadata","create_time":"2023-07-27T20:33:20.125785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs2_data","create_time":"2023-07-27T20:33:20.647929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2c","mappings":[{"from":0,"to":4}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:34:05.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.493+0000 7f96fadff700 1 -- 172.21.15.72:0/2207867422 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f96d806ace0 msgr2=0x7f96d806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:05.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.493+0000 7f96fadff700 1 --2- 172.21.15.72:0/2207867422 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f96d806ace0 0x7f96d806d1a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f96f4150b40 tx=0x7f96e0009040 comp rx=0 tx=0).stop 2023-07-27T20:34:05.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.494+0000 7f96fadff700 1 -- 172.21.15.72:0/2207867422 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96f406b150 msgr2=0x7f96f41ecf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:05.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.494+0000 7f96fadff700 1 --2- 172.21.15.72:0/2207867422 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96f406b150 0x7f96f41ecf50 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f96e800c4e0 tx=0x7f96e800c8a0 comp rx=0 tx=0).stop 2023-07-27T20:34:05.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.494+0000 7f96fadff700 1 -- 172.21.15.72:0/2207867422 shutdown_connections 2023-07-27T20:34:05.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.494+0000 7f96fadff700 1 --2- 172.21.15.72:0/2207867422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96f40c7710 0x7f96f414fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:05.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.494+0000 7f96fadff700 1 --2- 172.21.15.72:0/2207867422 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96f406b150 0x7f96f41ecf50 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:05.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.494+0000 7f96fadff700 1 --2- 172.21.15.72:0/2207867422 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f96d806ace0 0x7f96d806d1a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:05.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.494+0000 7f96fadff700 1 --2- 172.21.15.72:0/2207867422 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f96f40c4400 0x7f96f40c2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:05.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.494+0000 7f96fadff700 1 -- 172.21.15.72:0/2207867422 >> 172.21.15.72:0/2207867422 conn(0x7f96f40ab300 msgr2=0x7f96f41548f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:05.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.494+0000 7f96fadff700 1 -- 172.21.15.72:0/2207867422 shutdown_connections 2023-07-27T20:34:05.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.494+0000 7f96fadff700 1 -- 172.21.15.72:0/2207867422 wait complete. 2023-07-27T20:34:05.499 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-27T20:31:14.581785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T20:31:21.077941+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T20:32:58.242890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T20:32:59.032110+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-07-27T20:33:20.125785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs2_data', 'create_time': '2023-07-27T20:33:20.647929+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-27T20:34:05.500 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-27T20:34:05.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.711+0000 7f80fa3ff700 1 Processor -- start 2023-07-27T20:34:05.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.711+0000 7f80fa3ff700 1 -- start start 2023-07-27T20:34:05.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.713+0000 7f80fa3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f80f414aab0 0x7f80f4154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:05.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.713+0000 7f80fa3ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f80f40c7740 0x7f80f40c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:05.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.713+0000 7f80fa3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80f40c7c50 con 0x7f80f40c4700 2023-07-27T20:34:05.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.713+0000 7f80fa3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80f406bd40 con 0x7f80f414aab0 2023-07-27T20:34:05.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.713+0000 7f80fa3ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80f40c62f0 con 0x7f80f40c7740 2023-07-27T20:34:05.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.713+0000 7f80f3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f80f414aab0 0x7f80f4154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:05.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.713+0000 7f80f3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f80f414aab0 0x7f80f4154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41146/0 (socket says 172.21.15.72:41146) 2023-07-27T20:34:05.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.713+0000 7f80f899c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f80f40c4700 0x7f80f406c1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48310/0 (socket says 172.21.15.72:48310) 2023-07-27T20:34:05.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.713+0000 7f80f3fff700 1 -- 172.21.15.72:0/1318363545 learned_addr learned my addr 172.21.15.72:0/1318363545 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:05.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.713+0000 7f80f37fe700 1 --2- 172.21.15.72:0/1318363545 >> v2:172.21.15.173:3300/0 conn(0x7f80f40c7740 0x7f80f40c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:05.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.713+0000 7f80f3fff700 1 -- 172.21.15.72:0/1318363545 >> v2:172.21.15.173:3300/0 conn(0x7f80f40c7740 msgr2=0x7f80f40c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:05.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.713+0000 7f80f3fff700 1 --2- 172.21.15.72:0/1318363545 >> v2:172.21.15.173:3300/0 conn(0x7f80f40c7740 0x7f80f40c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:05.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.713+0000 7f80f3fff700 1 -- 172.21.15.72:0/1318363545 >> v1:172.21.15.72:6789/0 conn(0x7f80f40c4700 legacy=0x7f80f406c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:05.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.713+0000 7f80f3fff700 1 -- 172.21.15.72:0/1318363545 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f4155050 con 0x7f80f414aab0 2023-07-27T20:34:05.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.713+0000 7f80f2ffd700 1 -- 172.21.15.72:0/1318363545 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1814675775 0 0) 0x7f80f40c7c50 con 0x7f80f40c4700 2023-07-27T20:34:05.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.714+0000 7f80f3fff700 1 --2- 172.21.15.72:0/1318363545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80f414aab0 0x7f80f4154b10 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f80f40a9090 tx=0x7f80e4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6693837ba2ede5a9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:05.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.714+0000 7f80f2ffd700 1 -- 172.21.15.72:0/1318363545 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e400b870 con 0x7f80f414aab0 2023-07-27T20:34:05.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.714+0000 7f80f2ffd700 1 -- 172.21.15.72:0/1318363545 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e400b9d0 con 0x7f80f414aab0 2023-07-27T20:34:05.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.714+0000 7f80f2ffd700 1 -- 172.21.15.72:0/1318363545 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e400bd60 con 0x7f80f414aab0 2023-07-27T20:34:05.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.714+0000 7f80fa3ff700 1 -- 172.21.15.72:0/1318363545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80f414aab0 msgr2=0x7f80f4154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:05.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.714+0000 7f80fa3ff700 1 --2- 172.21.15.72:0/1318363545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80f414aab0 0x7f80f4154b10 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f80f40a9090 tx=0x7f80e4009bd0 comp rx=0 tx=0).stop 2023-07-27T20:34:05.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.714+0000 7f80fa3ff700 1 -- 172.21.15.72:0/1318363545 shutdown_connections 2023-07-27T20:34:05.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.714+0000 7f80fa3ff700 1 --2- 172.21.15.72:0/1318363545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80f414aab0 0x7f80f4154b10 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:05.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.715+0000 7f80fa3ff700 1 --2- 172.21.15.72:0/1318363545 >> v2:172.21.15.173:3300/0 conn(0x7f80f40c7740 0x7f80f40c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:05.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.715+0000 7f80fa3ff700 1 -- 172.21.15.72:0/1318363545 >> 172.21.15.72:0/1318363545 conn(0x7f80f40ab3f0 msgr2=0x7f80f40ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:05.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.715+0000 7f80fa3ff700 1 -- 172.21.15.72:0/1318363545 shutdown_connections 2023-07-27T20:34:05.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.715+0000 7f80fa3ff700 1 -- 172.21.15.72:0/1318363545 wait complete. 2023-07-27T20:34:05.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.716+0000 7f80fa3ff700 1 Processor -- start 2023-07-27T20:34:05.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.716+0000 7f80fa3ff700 1 -- start start 2023-07-27T20:34:05.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.717+0000 7f80fa3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80f40c4700 0x7f80f4150140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:05.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.717+0000 7f80fa3ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80f40c7740 0x7f80f41ea340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:05.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.717+0000 7f80fa3ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80f414aab0 0x7f80f4149a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:05.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.717+0000 7f80fa3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f414f730 con 0x7f80f40c4700 2023-07-27T20:34:05.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.717+0000 7f80fa3ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f4150680 con 0x7f80f414aab0 2023-07-27T20:34:05.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.717+0000 7f80fa3ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f41ea880 con 0x7f80f40c7740 2023-07-27T20:34:05.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.717+0000 7f80f3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80f40c4700 0x7f80f4150140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:05.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.718+0000 7f80f3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80f40c4700 0x7f80f4150140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41148/0 (socket says 172.21.15.72:41148) 2023-07-27T20:34:05.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.718+0000 7f80f3fff700 1 -- 172.21.15.72:0/2983849693 learned_addr learned my addr 172.21.15.72:0/2983849693 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:05.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.718+0000 7f80f37fe700 1 --2- 172.21.15.72:0/2983849693 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80f40c7740 0x7f80f41ea340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:05.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.718+0000 7f80f899c700 1 --2- 172.21.15.72:0/2983849693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80f414aab0 0x7f80f4149a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:05.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.718+0000 7f80f3fff700 1 -- 172.21.15.72:0/2983849693 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80f40c7740 msgr2=0x7f80f41ea340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:05.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.718+0000 7f80f3fff700 1 --2- 172.21.15.72:0/2983849693 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80f40c7740 0x7f80f41ea340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:05.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.718+0000 7f80f3fff700 1 -- 172.21.15.72:0/2983849693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80f414aab0 msgr2=0x7f80f4149a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:05.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.718+0000 7f80f3fff700 1 --2- 172.21.15.72:0/2983849693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80f414aab0 0x7f80f4149a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:05.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.718+0000 7f80f3fff700 1 -- 172.21.15.72:0/2983849693 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e4009550 con 0x7f80f40c4700 2023-07-27T20:34:05.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.718+0000 7f80f3fff700 1 --2- 172.21.15.72:0/2983849693 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80f40c4700 0x7f80f4150140 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f80e4000c00 tx=0x7f80e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:05.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.718+0000 7f80f0ff9700 1 -- 172.21.15.72:0/2983849693 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e4004520 con 0x7f80f40c4700 2023-07-27T20:34:05.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.718+0000 7f80f0ff9700 1 -- 172.21.15.72:0/2983849693 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e401e070 con 0x7f80f40c4700 2023-07-27T20:34:05.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.718+0000 7f80f0ff9700 1 -- 172.21.15.72:0/2983849693 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e40038a0 con 0x7f80f40c4700 2023-07-27T20:34:05.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.718+0000 7f80fa3ff700 1 -- 172.21.15.72:0/2983849693 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80f4151540 con 0x7f80f40c4700 2023-07-27T20:34:05.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.719+0000 7f80fa3ff700 1 -- 172.21.15.72:0/2983849693 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f414f940 con 0x7f80f40c4700 2023-07-27T20:34:05.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.720+0000 7f80fa3ff700 1 -- 172.21.15.72:0/2983849693 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80f404e470 con 0x7f80f40c4700 2023-07-27T20:34:05.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.720+0000 7f80f0ff9700 1 -- 172.21.15.72:0/2983849693 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f80e4003a00 con 0x7f80f40c4700 2023-07-27T20:34:05.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.721+0000 7f80f0ff9700 1 --2- 172.21.15.72:0/2983849693 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f80e006ace0 0x7f80e006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:05.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.721+0000 7f80f0ff9700 1 -- 172.21.15.72:0/2983849693 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f80e4020070 con 0x7f80f40c4700 2023-07-27T20:34:05.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.722+0000 7f80f37fe700 1 --2- 172.21.15.72:0/2983849693 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f80e006ace0 0x7f80e006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:05.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.723+0000 7f80f37fe700 1 --2- 172.21.15.72:0/2983849693 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f80e006ace0 0x7f80e006d1a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f80f4154160 tx=0x7f80e8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:05.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.725+0000 7f80f0ff9700 1 -- 172.21.15.72:0/2983849693 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f80e4055b00 con 0x7f80f40c4700 2023-07-27T20:34:05.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.918+0000 7f80fa3ff700 1 -- 172.21.15.72:0/2983849693 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f80f406cf00 con 0x7f80f40c4700 2023-07-27T20:34:05.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.918+0000 7f80f0ff9700 1 -- 172.21.15.72:0/2983849693 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7f80e40150a0 con 0x7f80f40c4700 2023-07-27T20:34:05.906 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-27T20:34:05.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.920+0000 7f80fa3ff700 1 -- 172.21.15.72:0/2983849693 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f80e006ace0 msgr2=0x7f80e006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:05.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.920+0000 7f80fa3ff700 1 --2- 172.21.15.72:0/2983849693 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f80e006ace0 0x7f80e006d1a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f80f4154160 tx=0x7f80e8008040 comp rx=0 tx=0).stop 2023-07-27T20:34:05.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.920+0000 7f80fa3ff700 1 -- 172.21.15.72:0/2983849693 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80f40c4700 msgr2=0x7f80f4150140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:05.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.920+0000 7f80fa3ff700 1 --2- 172.21.15.72:0/2983849693 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80f40c4700 0x7f80f4150140 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f80e4000c00 tx=0x7f80e4004750 comp rx=0 tx=0).stop 2023-07-27T20:34:05.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.920+0000 7f80fa3ff700 1 -- 172.21.15.72:0/2983849693 shutdown_connections 2023-07-27T20:34:05.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.920+0000 7f80fa3ff700 1 --2- 172.21.15.72:0/2983849693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80f414aab0 0x7f80f4149a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:05.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.920+0000 7f80fa3ff700 1 --2- 172.21.15.72:0/2983849693 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80f40c4700 0x7f80f4150140 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:05.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.920+0000 7f80fa3ff700 1 --2- 172.21.15.72:0/2983849693 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f80e006ace0 0x7f80e006d1a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:05.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.920+0000 7f80fa3ff700 1 --2- 172.21.15.72:0/2983849693 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80f40c7740 0x7f80f41ea340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:05.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.920+0000 7f80fa3ff700 1 -- 172.21.15.72:0/2983849693 >> 172.21.15.72:0/2983849693 conn(0x7f80f40ab3f0 msgr2=0x7f80f4151bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:05.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.920+0000 7f80fa3ff700 1 -- 172.21.15.72:0/2983849693 shutdown_connections 2023-07-27T20:34:05.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:05.921+0000 7f80fa3ff700 1 -- 172.21.15.72:0/2983849693 wait complete. 2023-07-27T20:34:05.926 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T20:34:06.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.137+0000 7fec06fff700 1 Processor -- start 2023-07-27T20:34:06.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.137+0000 7fec06fff700 1 -- start start 2023-07-27T20:34:06.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.138+0000 7fec06fff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fec0014aab0 0x7fec00154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:06.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.138+0000 7fec06fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fec000c7740 0x7fec000c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:06.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.138+0000 7fec06fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec000c7c50 con 0x7fec000c4700 2023-07-27T20:34:06.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.138+0000 7fec06fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec0006bd40 con 0x7fec000c7740 2023-07-27T20:34:06.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.138+0000 7fec06fff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec000c62f0 con 0x7fec0014aab0 2023-07-27T20:34:06.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.138+0000 7febfffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fec000c7740 0x7fec000c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:06.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.138+0000 7febfffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fec000c7740 0x7fec000c41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41164/0 (socket says 172.21.15.72:41164) 2023-07-27T20:34:06.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.138+0000 7febfffff700 1 -- 172.21.15.72:0/2036951149 learned_addr learned my addr 172.21.15.72:0/2036951149 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:06.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.138+0000 7fec0559c700 1 --1- 172.21.15.72:0/2036951149 >> v1:172.21.15.72:6789/0 conn(0x7fec000c4700 0x7fec0006c1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48314/0 (socket says 172.21.15.72:48314) 2023-07-27T20:34:06.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.139+0000 7fec04d9b700 1 --2- 172.21.15.72:0/2036951149 >> v2:172.21.15.173:3300/0 conn(0x7fec0014aab0 0x7fec00154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:06.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.139+0000 7febfffff700 1 -- 172.21.15.72:0/2036951149 >> v2:172.21.15.173:3300/0 conn(0x7fec0014aab0 msgr2=0x7fec00154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:06.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.139+0000 7febfffff700 1 --2- 172.21.15.72:0/2036951149 >> v2:172.21.15.173:3300/0 conn(0x7fec0014aab0 0x7fec00154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:06.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.139+0000 7febfffff700 1 -- 172.21.15.72:0/2036951149 >> v1:172.21.15.72:6789/0 conn(0x7fec000c4700 legacy=0x7fec0006c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:06.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.139+0000 7febfffff700 1 -- 172.21.15.72:0/2036951149 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec00155050 con 0x7fec000c7740 2023-07-27T20:34:06.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.139+0000 7febff7fe700 1 -- 172.21.15.72:0/2036951149 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4247294918 0 0) 0x7fec000c7c50 con 0x7fec000c4700 2023-07-27T20:34:06.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.139+0000 7febfffff700 1 --2- 172.21.15.72:0/2036951149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec000c7740 0x7fec000c41c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fec0006ad20 tx=0x7febec009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36c45de650d0d39b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:06.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.139+0000 7febff7fe700 1 -- 172.21.15.72:0/2036951149 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec00b870 con 0x7fec000c7740 2023-07-27T20:34:06.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.139+0000 7febff7fe700 1 -- 172.21.15.72:0/2036951149 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febec00b9d0 con 0x7fec000c7740 2023-07-27T20:34:06.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.139+0000 7febff7fe700 1 -- 172.21.15.72:0/2036951149 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec00bd60 con 0x7fec000c7740 2023-07-27T20:34:06.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.140+0000 7fec06fff700 1 -- 172.21.15.72:0/2036951149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec000c7740 msgr2=0x7fec000c41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:06.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.140+0000 7fec06fff700 1 --2- 172.21.15.72:0/2036951149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec000c7740 0x7fec000c41c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fec0006ad20 tx=0x7febec009bd0 comp rx=0 tx=0).stop 2023-07-27T20:34:06.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.140+0000 7fec06fff700 1 -- 172.21.15.72:0/2036951149 shutdown_connections 2023-07-27T20:34:06.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.140+0000 7fec06fff700 1 --2- 172.21.15.72:0/2036951149 >> v2:172.21.15.173:3300/0 conn(0x7fec0014aab0 0x7fec00154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:06.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.140+0000 7fec06fff700 1 --2- 172.21.15.72:0/2036951149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec000c7740 0x7fec000c41c0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:06.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.140+0000 7fec06fff700 1 -- 172.21.15.72:0/2036951149 >> 172.21.15.72:0/2036951149 conn(0x7fec000ab3f0 msgr2=0x7fec000ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:06.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.140+0000 7fec06fff700 1 -- 172.21.15.72:0/2036951149 shutdown_connections 2023-07-27T20:34:06.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.140+0000 7fec06fff700 1 -- 172.21.15.72:0/2036951149 wait complete. 2023-07-27T20:34:06.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.142+0000 7fec06fff700 1 Processor -- start 2023-07-27T20:34:06.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.142+0000 7fec06fff700 1 -- start start 2023-07-27T20:34:06.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.143+0000 7fec06fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fec000c4700 0x7fec001ea210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:06.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.143+0000 7fec06fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec000c7740 0x7fec001ed710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:06.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.143+0000 7fec06fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec0014aab0 0x7fec000c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:06.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.143+0000 7fec06fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec001ea750 con 0x7fec0014aab0 2023-07-27T20:34:06.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.143+0000 7fec06fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec001edc50 con 0x7fec000c7740 2023-07-27T20:34:06.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.143+0000 7fec06fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec001e9750 con 0x7fec000c4700 2023-07-27T20:34:06.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.143+0000 7fec0559c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec0014aab0 0x7fec000c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:06.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.143+0000 7fec0559c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec0014aab0 0x7fec000c8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41166/0 (socket says 172.21.15.72:41166) 2023-07-27T20:34:06.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.143+0000 7fec0559c700 1 -- 172.21.15.72:0/3579647418 learned_addr learned my addr 172.21.15.72:0/3579647418 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:06.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.143+0000 7fec04d9b700 1 --2- 172.21.15.72:0/3579647418 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fec000c4700 0x7fec001ea210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:06.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.143+0000 7febfffff700 1 --2- 172.21.15.72:0/3579647418 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec000c7740 0x7fec001ed710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:06.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.143+0000 7fec0559c700 1 -- 172.21.15.72:0/3579647418 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fec000c4700 msgr2=0x7fec001ea210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:06.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.143+0000 7fec0559c700 1 --2- 172.21.15.72:0/3579647418 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fec000c4700 0x7fec001ea210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:06.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.143+0000 7fec0559c700 1 -- 172.21.15.72:0/3579647418 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec000c7740 msgr2=0x7fec001ed710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:06.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.143+0000 7fec0559c700 1 --2- 172.21.15.72:0/3579647418 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec000c7740 0x7fec001ed710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:06.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.143+0000 7fec0559c700 1 -- 172.21.15.72:0/3579647418 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febec009550 con 0x7fec0014aab0 2023-07-27T20:34:06.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.143+0000 7fec0559c700 1 --2- 172.21.15.72:0/3579647418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec0014aab0 0x7fec000c8f10 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7febf800cca0 tx=0x7febf800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:06.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.144+0000 7febfd7fa700 1 -- 172.21.15.72:0/3579647418 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf800cea0 con 0x7fec0014aab0 2023-07-27T20:34:06.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.144+0000 7febfd7fa700 1 -- 172.21.15.72:0/3579647418 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf800ade0 con 0x7fec0014aab0 2023-07-27T20:34:06.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.144+0000 7febfd7fa700 1 -- 172.21.15.72:0/3579647418 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf8007310 con 0x7fec0014aab0 2023-07-27T20:34:06.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.144+0000 7fec06fff700 1 -- 172.21.15.72:0/3579647418 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec0014d160 con 0x7fec0014aab0 2023-07-27T20:34:06.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.144+0000 7fec06fff700 1 -- 172.21.15.72:0/3579647418 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec0014d720 con 0x7fec0014aab0 2023-07-27T20:34:06.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.145+0000 7fec06fff700 1 -- 172.21.15.72:0/3579647418 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec0004e470 con 0x7fec0014aab0 2023-07-27T20:34:06.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.146+0000 7febfd7fa700 1 -- 172.21.15.72:0/3579647418 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7febf8007470 con 0x7fec0014aab0 2023-07-27T20:34:06.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.147+0000 7febfd7fa700 1 --2- 172.21.15.72:0/3579647418 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7febe406ace0 0x7febe406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:06.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.147+0000 7febfd7fa700 1 -- 172.21.15.72:0/3579647418 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7febf80895b0 con 0x7fec0014aab0 2023-07-27T20:34:06.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.147+0000 7fec04d9b700 1 --2- 172.21.15.72:0/3579647418 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7febe406ace0 0x7febe406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:06.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.148+0000 7fec04d9b700 1 --2- 172.21.15.72:0/3579647418 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7febe406ace0 0x7febe406d1a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7febf400b9b0 tx=0x7febf4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:06.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.151+0000 7febfd7fa700 1 -- 172.21.15.72:0/3579647418 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7febf8054220 con 0x7fec0014aab0 2023-07-27T20:34:06.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.344+0000 7fec06fff700 1 -- 172.21.15.72:0/3579647418 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fec0006cf00 con 0x7fec0014aab0 2023-07-27T20:34:06.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.345+0000 7febfd7fa700 1 -- 172.21.15.72:0/3579647418 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v47) v1 ==== 92+0+10 (secure 0 0 0) 0x7febf8057840 con 0x7fec0014aab0 2023-07-27T20:34:06.333 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-27T20:34:06.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.347+0000 7fec06fff700 1 -- 172.21.15.72:0/3579647418 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7febe406ace0 msgr2=0x7febe406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:06.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.347+0000 7fec06fff700 1 --2- 172.21.15.72:0/3579647418 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7febe406ace0 0x7febe406d1a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7febf400b9b0 tx=0x7febf4008040 comp rx=0 tx=0).stop 2023-07-27T20:34:06.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.347+0000 7fec06fff700 1 -- 172.21.15.72:0/3579647418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec0014aab0 msgr2=0x7fec000c8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:06.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.347+0000 7fec06fff700 1 --2- 172.21.15.72:0/3579647418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec0014aab0 0x7fec000c8f10 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7febf800cca0 tx=0x7febf800a340 comp rx=0 tx=0).stop 2023-07-27T20:34:06.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.347+0000 7fec06fff700 1 -- 172.21.15.72:0/3579647418 shutdown_connections 2023-07-27T20:34:06.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.347+0000 7fec06fff700 1 --2- 172.21.15.72:0/3579647418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec0014aab0 0x7fec000c8f10 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:06.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.347+0000 7fec06fff700 1 --2- 172.21.15.72:0/3579647418 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7febe406ace0 0x7febe406d1a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:06.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.347+0000 7fec06fff700 1 --2- 172.21.15.72:0/3579647418 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fec000c4700 0x7fec001ea210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:06.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.347+0000 7fec06fff700 1 --2- 172.21.15.72:0/3579647418 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec000c7740 0x7fec001ed710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:06.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.347+0000 7fec06fff700 1 -- 172.21.15.72:0/3579647418 >> 172.21.15.72:0/3579647418 conn(0x7fec000ab3f0 msgr2=0x7fec00152600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:06.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.348+0000 7fec06fff700 1 -- 172.21.15.72:0/3579647418 shutdown_connections 2023-07-27T20:34:06.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.348+0000 7fec06fff700 1 -- 172.21.15.72:0/3579647418 wait complete. 2023-07-27T20:34:06.353 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T20:34:06.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.563+0000 7f7a0b3ff700 1 Processor -- start 2023-07-27T20:34:06.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.563+0000 7f7a0b3ff700 1 -- start start 2023-07-27T20:34:06.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.565+0000 7f7a0b3ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7a041475a0 0x7f7a041516c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:06.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.565+0000 7f7a0b3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7a040716f0 0x7f7a04071b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:06.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.565+0000 7f7a0b3ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a04154f50 con 0x7f7a040c12f0 2023-07-27T20:34:06.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.565+0000 7f7a0b3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a04151c00 con 0x7f7a040716f0 2023-07-27T20:34:06.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.565+0000 7f7a0b3ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a04154340 con 0x7f7a041475a0 2023-07-27T20:34:06.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.565+0000 7f7a0999c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7a040716f0 0x7f7a04071b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:06.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.565+0000 7f7a0999c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7a040716f0 0x7f7a04071b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41182/0 (socket says 172.21.15.72:41182) 2023-07-27T20:34:06.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.565+0000 7f7a0999c700 1 -- 172.21.15.72:0/4262498311 learned_addr learned my addr 172.21.15.72:0/4262498311 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:06.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.565+0000 7f7a0919b700 1 --2- 172.21.15.72:0/4262498311 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7a041475a0 0x7f7a041516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:06.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.565+0000 7f7a0999c700 1 -- 172.21.15.72:0/4262498311 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7a041475a0 msgr2=0x7f7a041516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:06.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.565+0000 7f7a0999c700 1 --2- 172.21.15.72:0/4262498311 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7a041475a0 0x7f7a041516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:06.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.565+0000 7f7a0999c700 1 -- 172.21.15.72:0/4262498311 >> v1:172.21.15.173:6789/0 conn(0x7f7a040c12f0 legacy=0x7f7a040c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:06.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.565+0000 7f7a0999c700 1 -- 172.21.15.72:0/4262498311 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a04154620 con 0x7f7a040716f0 2023-07-27T20:34:06.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.566+0000 7f7a0999c700 1 --2- 172.21.15.72:0/4262498311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a040716f0 0x7f7a04071b60 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f79fc009e50 tx=0x7f79fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8429e42fa416646 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:06.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.566+0000 7f79fbfff700 1 -- 172.21.15.72:0/4262498311 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc00e070 con 0x7f7a040716f0 2023-07-27T20:34:06.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.566+0000 7f79fbfff700 1 -- 172.21.15.72:0/4262498311 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79fc00b9c0 con 0x7f7a040716f0 2023-07-27T20:34:06.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.566+0000 7f79fbfff700 1 -- 172.21.15.72:0/4262498311 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc00bd70 con 0x7f7a040716f0 2023-07-27T20:34:06.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.566+0000 7f7a0b3ff700 1 -- 172.21.15.72:0/4262498311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a040716f0 msgr2=0x7f7a04071b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:06.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.566+0000 7f7a0b3ff700 1 --2- 172.21.15.72:0/4262498311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a040716f0 0x7f7a04071b60 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f79fc009e50 tx=0x7f79fc00b330 comp rx=0 tx=0).stop 2023-07-27T20:34:06.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.567+0000 7f7a0b3ff700 1 -- 172.21.15.72:0/4262498311 shutdown_connections 2023-07-27T20:34:06.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.567+0000 7f7a0b3ff700 1 --2- 172.21.15.72:0/4262498311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a040716f0 0x7f7a04071b60 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:06.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.567+0000 7f7a0b3ff700 1 --2- 172.21.15.72:0/4262498311 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7a041475a0 0x7f7a041516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:06.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.567+0000 7f7a0b3ff700 1 -- 172.21.15.72:0/4262498311 >> 172.21.15.72:0/4262498311 conn(0x7f7a0406a190 msgr2=0x7f7a0406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:06.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.567+0000 7f7a0b3ff700 1 -- 172.21.15.72:0/4262498311 shutdown_connections 2023-07-27T20:34:06.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.567+0000 7f7a0b3ff700 1 -- 172.21.15.72:0/4262498311 wait complete. 2023-07-27T20:34:06.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.568+0000 7f7a0b3ff700 1 Processor -- start 2023-07-27T20:34:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.568+0000 7f7a0b3ff700 1 -- start start 2023-07-27T20:34:06.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.569+0000 7f7a0b3ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a040716f0 0x7f7a0414d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:06.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.569+0000 7f7a0b3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a040c12f0 0x7f7a041ee040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:06.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.569+0000 7f7a0b3ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7a041475a0 0x7f7a041397c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:06.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.569+0000 7f7a0b3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a04152900 con 0x7f7a040c12f0 2023-07-27T20:34:06.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.569+0000 7f7a0b3ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a040bc0a0 con 0x7f7a040716f0 2023-07-27T20:34:06.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.569+0000 7f7a0b3ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a04151f70 con 0x7f7a041475a0 2023-07-27T20:34:06.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.569+0000 7f7a0899a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a040c12f0 0x7f7a041ee040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:06.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.570+0000 7f7a0899a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a040c12f0 0x7f7a041ee040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41194/0 (socket says 172.21.15.72:41194) 2023-07-27T20:34:06.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.570+0000 7f7a0899a700 1 -- 172.21.15.72:0/3423298040 learned_addr learned my addr 172.21.15.72:0/3423298040 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:06.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.570+0000 7f7a0919b700 1 --2- 172.21.15.72:0/3423298040 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a040716f0 0x7f7a0414d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:06.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.570+0000 7f7a0999c700 1 --2- 172.21.15.72:0/3423298040 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7a041475a0 0x7f7a041397c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:06.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.570+0000 7f7a0899a700 1 -- 172.21.15.72:0/3423298040 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7a041475a0 msgr2=0x7f7a041397c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:06.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.570+0000 7f7a0899a700 1 --2- 172.21.15.72:0/3423298040 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7a041475a0 0x7f7a041397c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:06.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.570+0000 7f7a0899a700 1 -- 172.21.15.72:0/3423298040 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a040716f0 msgr2=0x7f7a0414d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:06.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.570+0000 7f7a0899a700 1 --2- 172.21.15.72:0/3423298040 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a040716f0 0x7f7a0414d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:06.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.570+0000 7f7a0899a700 1 -- 172.21.15.72:0/3423298040 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79fc009b30 con 0x7f7a040c12f0 2023-07-27T20:34:06.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.570+0000 7f7a0899a700 1 --2- 172.21.15.72:0/3423298040 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a040c12f0 0x7f7a041ee040 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f79f400c4e0 tx=0x7f79f400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:06.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.570+0000 7f79f9ffb700 1 -- 172.21.15.72:0/3423298040 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f40052d0 con 0x7f7a040c12f0 2023-07-27T20:34:06.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.570+0000 7f79f9ffb700 1 -- 172.21.15.72:0/3423298040 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f4005430 con 0x7f7a040c12f0 2023-07-27T20:34:06.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.570+0000 7f7a0b3ff700 1 -- 172.21.15.72:0/3423298040 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a041edb20 con 0x7f7a040c12f0 2023-07-27T20:34:06.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.570+0000 7f79f9ffb700 1 -- 172.21.15.72:0/3423298040 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f40038c0 con 0x7f7a040c12f0 2023-07-27T20:34:06.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.571+0000 7f7a0b3ff700 1 -- 172.21.15.72:0/3423298040 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a0414dc80 con 0x7f7a040c12f0 2023-07-27T20:34:06.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.572+0000 7f7a0b3ff700 1 -- 172.21.15.72:0/3423298040 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a04151dd0 con 0x7f7a040c12f0 2023-07-27T20:34:06.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.572+0000 7f79f9ffb700 1 -- 172.21.15.72:0/3423298040 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f79f4003a20 con 0x7f7a040c12f0 2023-07-27T20:34:06.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.574+0000 7f79f9ffb700 1 --2- 172.21.15.72:0/3423298040 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f79e806ace0 0x7f79e806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:06.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.574+0000 7f79f9ffb700 1 -- 172.21.15.72:0/3423298040 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f79f4088ce0 con 0x7f7a040c12f0 2023-07-27T20:34:06.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.574+0000 7f7a0919b700 1 --2- 172.21.15.72:0/3423298040 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f79e806ace0 0x7f79e806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:06.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.575+0000 7f7a0919b700 1 --2- 172.21.15.72:0/3423298040 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f79e806ace0 0x7f79e806d1a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7a040ab610 tx=0x7f7a00008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:06.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.578+0000 7f79f9ffb700 1 -- 172.21.15.72:0/3423298040 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7a04151dd0 con 0x7f7a040c12f0 2023-07-27T20:34:06.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.769+0000 7f7a0b3ff700 1 -- 172.21.15.72:0/3423298040 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7a041ed980 con 0x7f7a040c12f0 2023-07-27T20:34:06.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.770+0000 7f79f9ffb700 1 -- 172.21.15.72:0/3423298040 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7a041ed980 con 0x7f7a040c12f0 2023-07-27T20:34:06.758 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:34:06.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.772+0000 7f7a0b3ff700 1 -- 172.21.15.72:0/3423298040 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f79e806ace0 msgr2=0x7f79e806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:06.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.772+0000 7f7a0b3ff700 1 --2- 172.21.15.72:0/3423298040 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f79e806ace0 0x7f79e806d1a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7a040ab610 tx=0x7f7a00008040 comp rx=0 tx=0).stop 2023-07-27T20:34:06.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.772+0000 7f7a0b3ff700 1 -- 172.21.15.72:0/3423298040 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a040c12f0 msgr2=0x7f7a041ee040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:06.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.772+0000 7f7a0b3ff700 1 --2- 172.21.15.72:0/3423298040 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a040c12f0 0x7f7a041ee040 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f79f400c4e0 tx=0x7f79f400c7f0 comp rx=0 tx=0).stop 2023-07-27T20:34:06.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.772+0000 7f7a0b3ff700 1 -- 172.21.15.72:0/3423298040 shutdown_connections 2023-07-27T20:34:06.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.772+0000 7f7a0b3ff700 1 --2- 172.21.15.72:0/3423298040 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f79e806ace0 0x7f79e806d1a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:06.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.772+0000 7f7a0b3ff700 1 --2- 172.21.15.72:0/3423298040 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7a041475a0 0x7f7a041397c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:06.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.772+0000 7f7a0b3ff700 1 --2- 172.21.15.72:0/3423298040 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a040716f0 0x7f7a0414d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:06.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.772+0000 7f7a0b3ff700 1 --2- 172.21.15.72:0/3423298040 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a040c12f0 0x7f7a041ee040 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:06.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.772+0000 7f7a0b3ff700 1 -- 172.21.15.72:0/3423298040 >> 172.21.15.72:0/3423298040 conn(0x7f7a0406a190 msgr2=0x7f7a04143e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:06.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.772+0000 7f7a0b3ff700 1 -- 172.21.15.72:0/3423298040 shutdown_connections 2023-07-27T20:34:06.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.772+0000 7f7a0b3ff700 1 -- 172.21.15.72:0/3423298040 wait complete. 2023-07-27T20:34:06.778 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T20:34:06.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.988+0000 7fa8195ff700 1 Processor -- start 2023-07-27T20:34:06.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.989+0000 7fa8195ff700 1 -- start start 2023-07-27T20:34:06.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.990+0000 7fa8195ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa8140c77c0 0x7fa814151210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:06.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.990+0000 7fa8195ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa81406ffc0 0x7fa814151750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:06.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.990+0000 7fa8195ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa8140c6710 0x7fa8140c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:06.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.990+0000 7fa8195ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa81406d1c0 con 0x7fa8140c6710 2023-07-27T20:34:06.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.990+0000 7fa8195ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa814155070 con 0x7fa8140c77c0 2023-07-27T20:34:06.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.990+0000 7fa8195ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa81406ce90 con 0x7fa81406ffc0 2023-07-27T20:34:06.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.990+0000 7fa8137fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa8140c6710 0x7fa8140c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:06.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.990+0000 7fa8137fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa8140c6710 0x7fa8140c6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41204/0 (socket says 172.21.15.72:41204) 2023-07-27T20:34:06.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.990+0000 7fa8137fe700 1 -- 172.21.15.72:0/1561600210 learned_addr learned my addr 172.21.15.72:0/1561600210 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:06.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.990+0000 7fa812ffd700 1 --2- 172.21.15.72:0/1561600210 >> v2:172.21.15.173:3300/0 conn(0x7fa8140c77c0 0x7fa814151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:06.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.990+0000 7fa80bfff700 1 --2- 172.21.15.72:0/1561600210 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa81406ffc0 0x7fa814151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:06.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.990+0000 7fa8137fe700 1 -- 172.21.15.72:0/1561600210 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa81406ffc0 msgr2=0x7fa814151750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:06.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.990+0000 7fa8137fe700 1 --2- 172.21.15.72:0/1561600210 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa81406ffc0 0x7fa814151750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:06.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.990+0000 7fa8137fe700 1 -- 172.21.15.72:0/1561600210 >> v2:172.21.15.173:3300/0 conn(0x7fa8140c77c0 msgr2=0x7fa814151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:06.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.991+0000 7fa8137fe700 1 --2- 172.21.15.72:0/1561600210 >> v2:172.21.15.173:3300/0 conn(0x7fa8140c77c0 0x7fa814151210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:06.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.991+0000 7fa8137fe700 1 -- 172.21.15.72:0/1561600210 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa814154d90 con 0x7fa8140c6710 2023-07-27T20:34:06.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.991+0000 7fa80bfff700 1 --2- 172.21.15.72:0/1561600210 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa81406ffc0 0x7fa814151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:06.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.991+0000 7fa8137fe700 1 --2- 172.21.15.72:0/1561600210 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8140c6710 0x7fa8140c6ba0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fa8140c8500 tx=0x7fa80c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c65af503e1b3d8d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:06.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.991+0000 7fa8127fc700 1 -- 172.21.15.72:0/1561600210 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c00e070 con 0x7fa8140c6710 2023-07-27T20:34:06.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.991+0000 7fa8127fc700 1 -- 172.21.15.72:0/1561600210 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80c00b910 con 0x7fa8140c6710 2023-07-27T20:34:06.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.991+0000 7fa8127fc700 1 -- 172.21.15.72:0/1561600210 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c00bcc0 con 0x7fa8140c6710 2023-07-27T20:34:06.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.992+0000 7fa8195ff700 1 -- 172.21.15.72:0/1561600210 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8140c6710 msgr2=0x7fa8140c6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:06.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.992+0000 7fa8195ff700 1 --2- 172.21.15.72:0/1561600210 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8140c6710 0x7fa8140c6ba0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fa8140c8500 tx=0x7fa80c00b330 comp rx=0 tx=0).stop 2023-07-27T20:34:06.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.992+0000 7fa8195ff700 1 -- 172.21.15.72:0/1561600210 shutdown_connections 2023-07-27T20:34:06.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.992+0000 7fa8195ff700 1 --2- 172.21.15.72:0/1561600210 >> v2:172.21.15.173:3300/0 conn(0x7fa8140c77c0 0x7fa814151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:06.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.992+0000 7fa8195ff700 1 --2- 172.21.15.72:0/1561600210 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8140c6710 0x7fa8140c6ba0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:06.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.992+0000 7fa8195ff700 1 --2- 172.21.15.72:0/1561600210 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa81406ffc0 0x7fa814151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:06.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.992+0000 7fa8195ff700 1 -- 172.21.15.72:0/1561600210 >> 172.21.15.72:0/1561600210 conn(0x7fa81406a190 msgr2=0x7fa81406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:06.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.992+0000 7fa8195ff700 1 -- 172.21.15.72:0/1561600210 shutdown_connections 2023-07-27T20:34:06.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.992+0000 7fa8195ff700 1 -- 172.21.15.72:0/1561600210 wait complete. 2023-07-27T20:34:06.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.993+0000 7fa8195ff700 1 Processor -- start 2023-07-27T20:34:06.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.994+0000 7fa8195ff700 1 -- start start 2023-07-27T20:34:06.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.994+0000 7fa8195ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa81406ffc0 0x7fa8140c0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:06.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.994+0000 7fa8195ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8140c6710 0x7fa814153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:06.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.994+0000 7fa8195ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa8140c77c0 0x7fa81414d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:06.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.994+0000 7fa8195ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81414d410 con 0x7fa8140c6710 2023-07-27T20:34:06.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.994+0000 7fa8195ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8140c0c90 con 0x7fa81406ffc0 2023-07-27T20:34:06.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.994+0000 7fa8195ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8140c0f70 con 0x7fa8140c77c0 2023-07-27T20:34:06.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.995+0000 7fa80bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8140c6710 0x7fa814153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:06.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.995+0000 7fa80bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8140c6710 0x7fa814153c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41220/0 (socket says 172.21.15.72:41220) 2023-07-27T20:34:06.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.995+0000 7fa80bfff700 1 -- 172.21.15.72:0/2134625295 learned_addr learned my addr 172.21.15.72:0/2134625295 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:06.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.995+0000 7fa812ffd700 1 --2- 172.21.15.72:0/2134625295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa81406ffc0 0x7fa8140c0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:06.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.995+0000 7fa8137fe700 1 --2- 172.21.15.72:0/2134625295 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa8140c77c0 0x7fa81414d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:06.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.995+0000 7fa80bfff700 1 -- 172.21.15.72:0/2134625295 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa8140c77c0 msgr2=0x7fa81414d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:06.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.995+0000 7fa80bfff700 1 --2- 172.21.15.72:0/2134625295 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa8140c77c0 0x7fa81414d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:06.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.995+0000 7fa80bfff700 1 -- 172.21.15.72:0/2134625295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa81406ffc0 msgr2=0x7fa8140c0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:06.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.995+0000 7fa80bfff700 1 --2- 172.21.15.72:0/2134625295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa81406ffc0 0x7fa8140c0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:06.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.995+0000 7fa80bfff700 1 -- 172.21.15.72:0/2134625295 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa80c009b30 con 0x7fa8140c6710 2023-07-27T20:34:06.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.995+0000 7fa80bfff700 1 --2- 172.21.15.72:0/2134625295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8140c6710 0x7fa814153c10 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc00d7d0 tx=0x7fa7fc00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:06.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.995+0000 7fa80b7fe700 1 -- 172.21.15.72:0/2134625295 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc004030 con 0x7fa8140c6710 2023-07-27T20:34:06.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.996+0000 7fa80b7fe700 1 -- 172.21.15.72:0/2134625295 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7fc004190 con 0x7fa8140c6710 2023-07-27T20:34:06.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.996+0000 7fa8195ff700 1 -- 172.21.15.72:0/2134625295 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8140c1250 con 0x7fa8140c6710 2023-07-27T20:34:06.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.996+0000 7fa80b7fe700 1 -- 172.21.15.72:0/2134625295 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc004540 con 0x7fa8140c6710 2023-07-27T20:34:06.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.996+0000 7fa8195ff700 1 -- 172.21.15.72:0/2134625295 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa81414d0a0 con 0x7fa8140c6710 2023-07-27T20:34:06.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.997+0000 7fa8195ff700 1 -- 172.21.15.72:0/2134625295 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa814154a40 con 0x7fa8140c6710 2023-07-27T20:34:06.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.998+0000 7fa80b7fe700 1 -- 172.21.15.72:0/2134625295 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa7fc0036a0 con 0x7fa8140c6710 2023-07-27T20:34:06.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.999+0000 7fa80b7fe700 1 --2- 172.21.15.72:0/2134625295 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa7f406ace0 0x7fa7f406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:06.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:06.999+0000 7fa80b7fe700 1 -- 172.21.15.72:0/2134625295 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7fa7fc089d90 con 0x7fa8140c6710 2023-07-27T20:34:06.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.000+0000 7fa812ffd700 1 --2- 172.21.15.72:0/2134625295 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa7f406ace0 0x7fa7f406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:06.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.000+0000 7fa812ffd700 1 --2- 172.21.15.72:0/2134625295 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa7f406ace0 0x7fa7f406d1a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa804009b40 tx=0x7fa804009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:06.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.004+0000 7fa80b7fe700 1 -- 172.21.15.72:0/2134625295 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa814154a40 con 0x7fa8140c6710 2023-07-27T20:34:07.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.197+0000 7fa8195ff700 1 -- 172.21.15.72:0/2134625295 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa814154a40 con 0x7fa8140c6710 2023-07-27T20:34:07.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.197+0000 7fa80b7fe700 1 -- 172.21.15.72:0/2134625295 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa814154a40 con 0x7fa8140c6710 2023-07-27T20:34:07.185 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-27T20:34:07.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.200+0000 7fa8195ff700 1 -- 172.21.15.72:0/2134625295 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa7f406ace0 msgr2=0x7fa7f406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:07.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.200+0000 7fa8195ff700 1 --2- 172.21.15.72:0/2134625295 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa7f406ace0 0x7fa7f406d1a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa804009b40 tx=0x7fa804009210 comp rx=0 tx=0).stop 2023-07-27T20:34:07.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.200+0000 7fa8195ff700 1 -- 172.21.15.72:0/2134625295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8140c6710 msgr2=0x7fa814153c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:07.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.200+0000 7fa8195ff700 1 --2- 172.21.15.72:0/2134625295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8140c6710 0x7fa814153c10 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc00d7d0 tx=0x7fa7fc00dae0 comp rx=0 tx=0).stop 2023-07-27T20:34:07.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.200+0000 7fa8195ff700 1 -- 172.21.15.72:0/2134625295 shutdown_connections 2023-07-27T20:34:07.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.200+0000 7fa8195ff700 1 --2- 172.21.15.72:0/2134625295 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa7f406ace0 0x7fa7f406d1a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:07.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.200+0000 7fa8195ff700 1 --2- 172.21.15.72:0/2134625295 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa8140c77c0 0x7fa81414d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:07.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.200+0000 7fa8195ff700 1 --2- 172.21.15.72:0/2134625295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa81406ffc0 0x7fa8140c0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:07.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.200+0000 7fa8195ff700 1 --2- 172.21.15.72:0/2134625295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8140c6710 0x7fa814153c10 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:07.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.200+0000 7fa8195ff700 1 -- 172.21.15.72:0/2134625295 >> 172.21.15.72:0/2134625295 conn(0x7fa81406a190 msgr2=0x7fa8140a75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:07.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.200+0000 7fa8195ff700 1 -- 172.21.15.72:0/2134625295 shutdown_connections 2023-07-27T20:34:07.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.200+0000 7fa8195ff700 1 -- 172.21.15.72:0/2134625295 wait complete. 2023-07-27T20:34:07.205 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-07-27T20:34:07.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.416+0000 7f1dce5ff700 1 Processor -- start 2023-07-27T20:34:07.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.416+0000 7f1dce5ff700 1 -- start start 2023-07-27T20:34:07.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.417+0000 7f1dce5ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1dc80c7740 0x7f1dc80c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:07.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.417+0000 7f1dce5ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1dc80c4700 0x7f1dc806c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:07.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.417+0000 7f1dce5ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dc80c7c50 con 0x7f1dc814aab0 2023-07-27T20:34:07.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.417+0000 7f1dce5ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dc806bd40 con 0x7f1dc80c4700 2023-07-27T20:34:07.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.417+0000 7f1dce5ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dc80c62f0 con 0x7f1dc80c7740 2023-07-27T20:34:07.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.418+0000 7f1dccb9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1dc80c4700 0x7f1dc806c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:07.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.418+0000 7f1dc7fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1dc814aab0 0x7f1dc8154b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48322/0 (socket says 172.21.15.72:48322) 2023-07-27T20:34:07.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.418+0000 7f1dc7fff700 1 -- 172.21.15.72:0/459733317 learned_addr learned my addr 172.21.15.72:0/459733317 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:07.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.418+0000 7f1dc77fe700 1 --2- 172.21.15.72:0/459733317 >> v2:172.21.15.173:3300/0 conn(0x7f1dc80c7740 0x7f1dc80c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:07.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.418+0000 7f1dc6ffd700 1 -- 172.21.15.72:0/459733317 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 429689694 0 0) 0x7f1dc80c7c50 con 0x7f1dc814aab0 2023-07-27T20:34:07.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.418+0000 7f1dccb9c700 1 -- 172.21.15.72:0/459733317 >> v2:172.21.15.173:3300/0 conn(0x7f1dc80c7740 msgr2=0x7f1dc80c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:07.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.418+0000 7f1dccb9c700 1 --2- 172.21.15.72:0/459733317 >> v2:172.21.15.173:3300/0 conn(0x7f1dc80c7740 0x7f1dc80c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:07.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.418+0000 7f1dccb9c700 1 -- 172.21.15.72:0/459733317 >> v1:172.21.15.72:6789/0 conn(0x7f1dc814aab0 legacy=0x7f1dc8154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:07.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.418+0000 7f1dccb9c700 1 -- 172.21.15.72:0/459733317 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc806d200 con 0x7f1dc80c4700 2023-07-27T20:34:07.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.418+0000 7f1dccb9c700 1 --2- 172.21.15.72:0/459733317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dc80c4700 0x7f1dc806c1d0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f1dc80a9090 tx=0x7f1dc000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f857647b81b20f12 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:07.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.418+0000 7f1dc6ffd700 1 -- 172.21.15.72:0/459733317 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc000e070 con 0x7f1dc80c4700 2023-07-27T20:34:07.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.419+0000 7f1dc6ffd700 1 -- 172.21.15.72:0/459733317 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc000bbd0 con 0x7f1dc80c4700 2023-07-27T20:34:07.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.419+0000 7f1dc6ffd700 1 -- 172.21.15.72:0/459733317 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc0012430 con 0x7f1dc80c4700 2023-07-27T20:34:07.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.419+0000 7f1dce5ff700 1 -- 172.21.15.72:0/459733317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dc80c4700 msgr2=0x7f1dc806c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:07.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.419+0000 7f1dce5ff700 1 --2- 172.21.15.72:0/459733317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dc80c4700 0x7f1dc806c1d0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f1dc80a9090 tx=0x7f1dc000b330 comp rx=0 tx=0).stop 2023-07-27T20:34:07.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.419+0000 7f1dce5ff700 1 -- 172.21.15.72:0/459733317 shutdown_connections 2023-07-27T20:34:07.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.419+0000 7f1dce5ff700 1 --2- 172.21.15.72:0/459733317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dc80c4700 0x7f1dc806c1d0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:07.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.419+0000 7f1dce5ff700 1 --2- 172.21.15.72:0/459733317 >> v2:172.21.15.173:3300/0 conn(0x7f1dc80c7740 0x7f1dc80c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:07.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.419+0000 7f1dce5ff700 1 -- 172.21.15.72:0/459733317 >> 172.21.15.72:0/459733317 conn(0x7f1dc80ab3f0 msgr2=0x7f1dc80ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:07.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.419+0000 7f1dce5ff700 1 -- 172.21.15.72:0/459733317 shutdown_connections 2023-07-27T20:34:07.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.419+0000 7f1dce5ff700 1 -- 172.21.15.72:0/459733317 wait complete. 2023-07-27T20:34:07.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.421+0000 7f1dce5ff700 1 Processor -- start 2023-07-27T20:34:07.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.421+0000 7f1dce5ff700 1 -- start start 2023-07-27T20:34:07.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.422+0000 7f1dce5ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1dc80c4700 0x7f1dc81e9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:07.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.422+0000 7f1dce5ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1dc80c7740 0x7f1dc814c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:07.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.422+0000 7f1dce5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dc814aab0 0x7f1dc814b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:07.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.422+0000 7f1dce5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc80bfd90 con 0x7f1dc814aab0 2023-07-27T20:34:07.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.422+0000 7f1dce5ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc80bdb90 con 0x7f1dc80c4700 2023-07-27T20:34:07.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.422+0000 7f1dce5ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc80bdde0 con 0x7f1dc80c7740 2023-07-27T20:34:07.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.422+0000 7f1dccb9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dc814aab0 0x7f1dc814b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:07.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.422+0000 7f1dccb9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dc814aab0 0x7f1dc814b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41230/0 (socket says 172.21.15.72:41230) 2023-07-27T20:34:07.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.422+0000 7f1dccb9c700 1 -- 172.21.15.72:0/3394284456 learned_addr learned my addr 172.21.15.72:0/3394284456 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:07.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.422+0000 7f1dc7fff700 1 --2- 172.21.15.72:0/3394284456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1dc80c4700 0x7f1dc81e9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:07.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.422+0000 7f1dccb9c700 1 -- 172.21.15.72:0/3394284456 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1dc80c7740 msgr2=0x7f1dc814c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:07.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.422+0000 7f1dccb9c700 1 --2- 172.21.15.72:0/3394284456 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1dc80c7740 0x7f1dc814c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:07.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.422+0000 7f1dccb9c700 1 -- 172.21.15.72:0/3394284456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1dc80c4700 msgr2=0x7f1dc81e9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:07.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.422+0000 7f1dccb9c700 1 --2- 172.21.15.72:0/3394284456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1dc80c4700 0x7f1dc81e9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:07.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.422+0000 7f1dccb9c700 1 -- 172.21.15.72:0/3394284456 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc0009a70 con 0x7f1dc814aab0 2023-07-27T20:34:07.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.422+0000 7f1dc7fff700 1 --2- 172.21.15.72:0/3394284456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1dc80c4700 0x7f1dc81e9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:07.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.423+0000 7f1dccb9c700 1 --2- 172.21.15.72:0/3394284456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dc814aab0 0x7f1dc814b1b0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f1dc80a9200 tx=0x7f1dc0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:07.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.423+0000 7f1dc4ff9700 1 -- 172.21.15.72:0/3394284456 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc0012430 con 0x7f1dc814aab0 2023-07-27T20:34:07.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.423+0000 7f1dc4ff9700 1 -- 172.21.15.72:0/3394284456 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc0020070 con 0x7f1dc814aab0 2023-07-27T20:34:07.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.423+0000 7f1dc4ff9700 1 -- 172.21.15.72:0/3394284456 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc0004280 con 0x7f1dc814aab0 2023-07-27T20:34:07.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.423+0000 7f1dce5ff700 1 -- 172.21.15.72:0/3394284456 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dc80be0c0 con 0x7f1dc814aab0 2023-07-27T20:34:07.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.423+0000 7f1dce5ff700 1 -- 172.21.15.72:0/3394284456 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dc80be680 con 0x7f1dc814aab0 2023-07-27T20:34:07.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.424+0000 7f1dce5ff700 1 -- 172.21.15.72:0/3394284456 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dc804e470 con 0x7f1dc814aab0 2023-07-27T20:34:07.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.425+0000 7f1dc4ff9700 1 -- 172.21.15.72:0/3394284456 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1dc00043e0 con 0x7f1dc814aab0 2023-07-27T20:34:07.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.426+0000 7f1dc4ff9700 1 --2- 172.21.15.72:0/3394284456 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1db406ace0 0x7f1db406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:07.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.426+0000 7f1dc4ff9700 1 -- 172.21.15.72:0/3394284456 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f1dc0022070 con 0x7f1dc814aab0 2023-07-27T20:34:07.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.427+0000 7f1dc7fff700 1 --2- 172.21.15.72:0/3394284456 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1db406ace0 0x7f1db406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:07.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.428+0000 7f1dc7fff700 1 --2- 172.21.15.72:0/3394284456 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1db406ace0 0x7f1db406d1a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1db8007fd0 tx=0x7f1db8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:07.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.431+0000 7f1dc4ff9700 1 -- 172.21.15.72:0/3394284456 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1dc0056740 con 0x7f1dc814aab0 2023-07-27T20:34:07.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.623+0000 7f1dce5ff700 1 -- 172.21.15.72:0/3394284456 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1dc806cf00 con 0x7f1dc814aab0 2023-07-27T20:34:07.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.624+0000 7f1dc4ff9700 1 -- 172.21.15.72:0/3394284456 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v47) v1 ==== 105+0+11 (secure 0 0 0) 0x7f1dc0059d60 con 0x7f1dc814aab0 2023-07-27T20:34:07.611 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:34:07.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.626+0000 7f1dce5ff700 1 -- 172.21.15.72:0/3394284456 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1db406ace0 msgr2=0x7f1db406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:07.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.626+0000 7f1dce5ff700 1 --2- 172.21.15.72:0/3394284456 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1db406ace0 0x7f1db406d1a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1db8007fd0 tx=0x7f1db8009040 comp rx=0 tx=0).stop 2023-07-27T20:34:07.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.626+0000 7f1dce5ff700 1 -- 172.21.15.72:0/3394284456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dc814aab0 msgr2=0x7f1dc814b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:07.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.626+0000 7f1dce5ff700 1 --2- 172.21.15.72:0/3394284456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dc814aab0 0x7f1dc814b1b0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f1dc80a9200 tx=0x7f1dc0004ad0 comp rx=0 tx=0).stop 2023-07-27T20:34:07.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.626+0000 7f1dce5ff700 1 -- 172.21.15.72:0/3394284456 shutdown_connections 2023-07-27T20:34:07.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.626+0000 7f1dce5ff700 1 --2- 172.21.15.72:0/3394284456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dc814aab0 0x7f1dc814b1b0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:07.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.626+0000 7f1dce5ff700 1 --2- 172.21.15.72:0/3394284456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1dc80c4700 0x7f1dc81e9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:07.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.626+0000 7f1dce5ff700 1 --2- 172.21.15.72:0/3394284456 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1db406ace0 0x7f1db406d1a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:07.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.626+0000 7f1dce5ff700 1 --2- 172.21.15.72:0/3394284456 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1dc80c7740 0x7f1dc814c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:07.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.626+0000 7f1dce5ff700 1 -- 172.21.15.72:0/3394284456 >> 172.21.15.72:0/3394284456 conn(0x7f1dc80ab3f0 msgr2=0x7f1dc81531b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:07.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.626+0000 7f1dce5ff700 1 -- 172.21.15.72:0/3394284456 shutdown_connections 2023-07-27T20:34:07.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.626+0000 7f1dce5ff700 1 -- 172.21.15.72:0/3394284456 wait complete. 2023-07-27T20:34:07.631 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-07-27T20:34:07.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.842+0000 7f2e383ff700 1 Processor -- start 2023-07-27T20:34:07.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.842+0000 7f2e383ff700 1 -- start start 2023-07-27T20:34:07.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.843+0000 7f2e383ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2e301475a0 0x7f2e301516c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:07.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.843+0000 7f2e383ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2e300c12f0 0x7f2e300c1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:07.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.843+0000 7f2e383ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2e300c2240 0x7f2e300716f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:07.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.843+0000 7f2e383ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e30151c00 con 0x7f2e301475a0 2023-07-27T20:34:07.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.843+0000 7f2e383ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e30154f50 con 0x7f2e300c2240 2023-07-27T20:34:07.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.843+0000 7f2e383ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e30154340 con 0x7f2e300c12f0 2023-07-27T20:34:07.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.843+0000 7f2e3619b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2e301475a0 0x7f2e301516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:07.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.843+0000 7f2e3619b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2e301475a0 0x7f2e301516c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41242/0 (socket says 172.21.15.72:41242) 2023-07-27T20:34:07.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.843+0000 7f2e3619b700 1 -- 172.21.15.72:0/3751971780 learned_addr learned my addr 172.21.15.72:0/3751971780 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:07.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.843+0000 7f2e3699c700 1 --2- 172.21.15.72:0/3751971780 >> v2:172.21.15.173:3300/0 conn(0x7f2e300c2240 0x7f2e300716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:07.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.843+0000 7f2e3599a700 1 --2- 172.21.15.72:0/3751971780 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2e300c12f0 0x7f2e300c1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:07.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.844+0000 7f2e3619b700 1 -- 172.21.15.72:0/3751971780 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2e300c12f0 msgr2=0x7f2e300c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:07.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.844+0000 7f2e3619b700 1 --2- 172.21.15.72:0/3751971780 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2e300c12f0 0x7f2e300c1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:07.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.844+0000 7f2e3619b700 1 -- 172.21.15.72:0/3751971780 >> v2:172.21.15.173:3300/0 conn(0x7f2e300c2240 msgr2=0x7f2e300716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:07.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.844+0000 7f2e3619b700 1 --2- 172.21.15.72:0/3751971780 >> v2:172.21.15.173:3300/0 conn(0x7f2e300c2240 0x7f2e300716f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:07.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.844+0000 7f2e3619b700 1 -- 172.21.15.72:0/3751971780 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e30154620 con 0x7f2e301475a0 2023-07-27T20:34:07.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.844+0000 7f2e3599a700 1 --2- 172.21.15.72:0/3751971780 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2e300c12f0 0x7f2e300c1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:07.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.844+0000 7f2e3619b700 1 --2- 172.21.15.72:0/3751971780 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e301475a0 0x7f2e301516c0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f2e3006e620 tx=0x7f2e2c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed7873854834a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:07.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.844+0000 7f2e35199700 1 -- 172.21.15.72:0/3751971780 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c011830 con 0x7f2e301475a0 2023-07-27T20:34:07.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.844+0000 7f2e35199700 1 -- 172.21.15.72:0/3751971780 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e2c011990 con 0x7f2e301475a0 2023-07-27T20:34:07.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.844+0000 7f2e35199700 1 -- 172.21.15.72:0/3751971780 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c011d20 con 0x7f2e301475a0 2023-07-27T20:34:07.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.845+0000 7f2e383ff700 1 -- 172.21.15.72:0/3751971780 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e301475a0 msgr2=0x7f2e301516c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:07.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.845+0000 7f2e383ff700 1 --2- 172.21.15.72:0/3751971780 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e301475a0 0x7f2e301516c0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f2e3006e620 tx=0x7f2e2c009bd0 comp rx=0 tx=0).stop 2023-07-27T20:34:07.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.845+0000 7f2e383ff700 1 -- 172.21.15.72:0/3751971780 shutdown_connections 2023-07-27T20:34:07.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.845+0000 7f2e383ff700 1 --2- 172.21.15.72:0/3751971780 >> v2:172.21.15.173:3300/0 conn(0x7f2e300c2240 0x7f2e300716f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:07.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.845+0000 7f2e383ff700 1 --2- 172.21.15.72:0/3751971780 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e301475a0 0x7f2e301516c0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:07.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.845+0000 7f2e383ff700 1 --2- 172.21.15.72:0/3751971780 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2e300c12f0 0x7f2e300c1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:07.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.845+0000 7f2e383ff700 1 -- 172.21.15.72:0/3751971780 >> 172.21.15.72:0/3751971780 conn(0x7f2e3006a190 msgr2=0x7f2e3006a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:07.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.845+0000 7f2e383ff700 1 -- 172.21.15.72:0/3751971780 shutdown_connections 2023-07-27T20:34:07.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.845+0000 7f2e383ff700 1 -- 172.21.15.72:0/3751971780 wait complete. 2023-07-27T20:34:07.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.847+0000 7f2e383ff700 1 Processor -- start 2023-07-27T20:34:07.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.847+0000 7f2e383ff700 1 -- start start 2023-07-27T20:34:07.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.848+0000 7f2e383ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e300c12f0 0x7f2e300c37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:07.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.848+0000 7f2e383ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2e300c2240 0x7f2e30153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:07.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.848+0000 7f2e383ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e301475a0 0x7f2e300bb780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:07.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.848+0000 7f2e383ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e301532f0 con 0x7f2e301475a0 2023-07-27T20:34:07.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.848+0000 7f2e383ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e300c3cf0 con 0x7f2e300c12f0 2023-07-27T20:34:07.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.849+0000 7f2e383ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e301394b0 con 0x7f2e300c2240 2023-07-27T20:34:07.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.849+0000 7f2e3699c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e301475a0 0x7f2e300bb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:07.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.849+0000 7f2e3699c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e301475a0 0x7f2e300bb780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41256/0 (socket says 172.21.15.72:41256) 2023-07-27T20:34:07.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.849+0000 7f2e3699c700 1 -- 172.21.15.72:0/868302963 learned_addr learned my addr 172.21.15.72:0/868302963 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:07.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.849+0000 7f2e3619b700 1 --2- 172.21.15.72:0/868302963 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e300c12f0 0x7f2e300c37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:07.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.849+0000 7f2e3599a700 1 --2- 172.21.15.72:0/868302963 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2e300c2240 0x7f2e30153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:07.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.849+0000 7f2e3699c700 1 -- 172.21.15.72:0/868302963 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2e300c2240 msgr2=0x7f2e30153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:07.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.849+0000 7f2e3699c700 1 --2- 172.21.15.72:0/868302963 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2e300c2240 0x7f2e30153a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:07.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.849+0000 7f2e3699c700 1 -- 172.21.15.72:0/868302963 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e300c12f0 msgr2=0x7f2e300c37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:07.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.849+0000 7f2e3699c700 1 --2- 172.21.15.72:0/868302963 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e300c12f0 0x7f2e300c37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:07.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.849+0000 7f2e3699c700 1 -- 172.21.15.72:0/868302963 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e2c009550 con 0x7f2e301475a0 2023-07-27T20:34:07.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.849+0000 7f2e3699c700 1 --2- 172.21.15.72:0/868302963 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e301475a0 0x7f2e300bb780 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f2e2800efc0 tx=0x7f2e2800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:07.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.849+0000 7f2e26ffd700 1 -- 172.21.15.72:0/868302963 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2800cb80 con 0x7f2e301475a0 2023-07-27T20:34:07.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.850+0000 7f2e26ffd700 1 -- 172.21.15.72:0/868302963 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e2800f040 con 0x7f2e301475a0 2023-07-27T20:34:07.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.850+0000 7f2e383ff700 1 -- 172.21.15.72:0/868302963 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e301eb180 con 0x7f2e301475a0 2023-07-27T20:34:07.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.850+0000 7f2e26ffd700 1 -- 172.21.15.72:0/868302963 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e28014480 con 0x7f2e301475a0 2023-07-27T20:34:07.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.850+0000 7f2e383ff700 1 -- 172.21.15.72:0/868302963 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e30153fc0 con 0x7f2e301475a0 2023-07-27T20:34:07.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.851+0000 7f2e383ff700 1 -- 172.21.15.72:0/868302963 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e3004e470 con 0x7f2e301475a0 2023-07-27T20:34:07.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.852+0000 7f2e26ffd700 1 -- 172.21.15.72:0/868302963 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2e280145e0 con 0x7f2e301475a0 2023-07-27T20:34:07.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.852+0000 7f2e26ffd700 1 --2- 172.21.15.72:0/868302963 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f2e1406ace0 0x7f2e1406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:07.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.853+0000 7f2e26ffd700 1 -- 172.21.15.72:0/868302963 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f2e2808a3a0 con 0x7f2e301475a0 2023-07-27T20:34:07.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.853+0000 7f2e3619b700 1 --2- 172.21.15.72:0/868302963 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f2e1406ace0 0x7f2e1406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:07.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.854+0000 7f2e3619b700 1 --2- 172.21.15.72:0/868302963 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f2e1406ace0 0x7f2e1406d1a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c014040 tx=0x7f2e2c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:07.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:07.857+0000 7f2e26ffd700 1 -- 172.21.15.72:0/868302963 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2e28054f90 con 0x7f2e301475a0 2023-07-27T20:34:08.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.051+0000 7f2e383ff700 1 -- 172.21.15.72:0/868302963 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f2e300c10d0 con 0x7f2e301475a0 2023-07-27T20:34:08.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.052+0000 7f2e26ffd700 1 -- 172.21.15.72:0/868302963 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v47) v1 ==== 101+0+11 (secure 0 0 0) 0x7f2e280585b0 con 0x7f2e301475a0 2023-07-27T20:34:08.040 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-27T20:34:08.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.054+0000 7f2e383ff700 1 -- 172.21.15.72:0/868302963 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f2e1406ace0 msgr2=0x7f2e1406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:08.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.054+0000 7f2e383ff700 1 --2- 172.21.15.72:0/868302963 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f2e1406ace0 0x7f2e1406d1a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c014040 tx=0x7f2e2c008030 comp rx=0 tx=0).stop 2023-07-27T20:34:08.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.054+0000 7f2e383ff700 1 -- 172.21.15.72:0/868302963 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e301475a0 msgr2=0x7f2e300bb780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:08.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.054+0000 7f2e383ff700 1 --2- 172.21.15.72:0/868302963 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e301475a0 0x7f2e300bb780 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f2e2800efc0 tx=0x7f2e2800c0c0 comp rx=0 tx=0).stop 2023-07-27T20:34:08.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.054+0000 7f2e383ff700 1 -- 172.21.15.72:0/868302963 shutdown_connections 2023-07-27T20:34:08.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.054+0000 7f2e383ff700 1 --2- 172.21.15.72:0/868302963 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e301475a0 0x7f2e300bb780 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:08.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.054+0000 7f2e383ff700 1 --2- 172.21.15.72:0/868302963 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e300c12f0 0x7f2e300c37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:08.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.054+0000 7f2e383ff700 1 --2- 172.21.15.72:0/868302963 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f2e1406ace0 0x7f2e1406d1a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:08.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.054+0000 7f2e383ff700 1 --2- 172.21.15.72:0/868302963 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2e300c2240 0x7f2e30153a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:08.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.054+0000 7f2e383ff700 1 -- 172.21.15.72:0/868302963 >> 172.21.15.72:0/868302963 conn(0x7f2e3006a190 msgr2=0x7f2e30146490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:08.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.054+0000 7f2e383ff700 1 -- 172.21.15.72:0/868302963 shutdown_connections 2023-07-27T20:34:08.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.054+0000 7f2e383ff700 1 -- 172.21.15.72:0/868302963 wait complete. 2023-07-27T20:34:08.060 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T20:34:08.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.269+0000 7f64019ff700 1 Processor -- start 2023-07-27T20:34:08.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.269+0000 7f64019ff700 1 -- start start 2023-07-27T20:34:08.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.270+0000 7f64019ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63fc0c4400 0x7f63fc0c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:08.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.270+0000 7f64019ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f63fc06b150 0x7f63fc0c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:08.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.270+0000 7f64019ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63fc0c5230 con 0x7f63fc1549f0 2023-07-27T20:34:08.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.270+0000 7f64019ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63fc1545d0 con 0x7f63fc06b150 2023-07-27T20:34:08.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.270+0000 7f64019ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc06c860 con 0x7f63fc0c4400 2023-07-27T20:34:08.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.270+0000 7f63f3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f63fc06b150 0x7f63fc0c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:08.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.270+0000 7f63f3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f63fc06b150 0x7f63fc0c4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41268/0 (socket says 172.21.15.72:41268) 2023-07-27T20:34:08.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.270+0000 7f63f3fff700 1 -- 172.21.15.72:0/394195204 learned_addr learned my addr 172.21.15.72:0/394195204 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:08.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.270+0000 7f63faffd700 1 --2- 172.21.15.72:0/394195204 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63fc0c4400 0x7f63fc0c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:08.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.271+0000 7f63f3fff700 1 -- 172.21.15.72:0/394195204 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63fc0c4400 msgr2=0x7f63fc0c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:08.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.271+0000 7f63f3fff700 1 --2- 172.21.15.72:0/394195204 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63fc0c4400 0x7f63fc0c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:08.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.271+0000 7f63f3fff700 1 -- 172.21.15.72:0/394195204 >> v1:172.21.15.173:6789/0 conn(0x7f63fc1549f0 legacy=0x7f63fc1514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:08.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.271+0000 7f63f3fff700 1 -- 172.21.15.72:0/394195204 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63fc06b710 con 0x7f63fc06b150 2023-07-27T20:34:08.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.271+0000 7f63faffd700 1 --2- 172.21.15.72:0/394195204 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63fc0c4400 0x7f63fc0c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:08.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.271+0000 7f63f3fff700 1 --2- 172.21.15.72:0/394195204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63fc06b150 0x7f63fc0c4cf0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f63e4009920 tx=0x7f63e4009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3cdbe5ba1e48e29 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:08.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.271+0000 7f63fa7fc700 1 -- 172.21.15.72:0/394195204 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e400ba20 con 0x7f63fc06b150 2023-07-27T20:34:08.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.271+0000 7f63fa7fc700 1 -- 172.21.15.72:0/394195204 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e400bb80 con 0x7f63fc06b150 2023-07-27T20:34:08.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.271+0000 7f63fa7fc700 1 -- 172.21.15.72:0/394195204 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e4009e70 con 0x7f63fc06b150 2023-07-27T20:34:08.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.272+0000 7f64019ff700 1 -- 172.21.15.72:0/394195204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63fc06b150 msgr2=0x7f63fc0c4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:08.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.272+0000 7f64019ff700 1 --2- 172.21.15.72:0/394195204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63fc06b150 0x7f63fc0c4cf0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f63e4009920 tx=0x7f63e4009c30 comp rx=0 tx=0).stop 2023-07-27T20:34:08.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.272+0000 7f64019ff700 1 -- 172.21.15.72:0/394195204 shutdown_connections 2023-07-27T20:34:08.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.272+0000 7f64019ff700 1 --2- 172.21.15.72:0/394195204 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63fc0c4400 0x7f63fc0c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:08.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.272+0000 7f64019ff700 1 --2- 172.21.15.72:0/394195204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63fc06b150 0x7f63fc0c4cf0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:08.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.272+0000 7f64019ff700 1 -- 172.21.15.72:0/394195204 >> 172.21.15.72:0/394195204 conn(0x7f63fc0ab300 msgr2=0x7f63fc0ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:08.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.272+0000 7f64019ff700 1 -- 172.21.15.72:0/394195204 shutdown_connections 2023-07-27T20:34:08.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.272+0000 7f64019ff700 1 -- 172.21.15.72:0/394195204 wait complete. 2023-07-27T20:34:08.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.273+0000 7f64019ff700 1 Processor -- start 2023-07-27T20:34:08.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.274+0000 7f64019ff700 1 -- start start 2023-07-27T20:34:08.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.274+0000 7f64019ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63fc06b150 0x7f63fc0c1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:08.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.274+0000 7f64019ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63fc0c4400 0x7f63fc0c25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:08.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.274+0000 7f64019ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63fc1549f0 0x7f63fc1494b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:08.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.274+0000 7f64019ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc0c08e0 con 0x7f63fc0c4400 2023-07-27T20:34:08.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.274+0000 7f64019ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc14a840 con 0x7f63fc1549f0 2023-07-27T20:34:08.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.275+0000 7f64019ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc0c0d30 con 0x7f63fc06b150 2023-07-27T20:34:08.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.275+0000 7f63f3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63fc0c4400 0x7f63fc0c25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:08.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.275+0000 7f63f3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63fc0c4400 0x7f63fc0c25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41270/0 (socket says 172.21.15.72:41270) 2023-07-27T20:34:08.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.275+0000 7f63f3fff700 1 -- 172.21.15.72:0/2895087647 learned_addr learned my addr 172.21.15.72:0/2895087647 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:08.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.275+0000 7f63f3fff700 1 -- 172.21.15.72:0/2895087647 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63fc06b150 msgr2=0x7f63fc0c1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:08.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.275+0000 7f63f3fff700 1 --2- 172.21.15.72:0/2895087647 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63fc06b150 0x7f63fc0c1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:08.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.275+0000 7f63f3fff700 1 -- 172.21.15.72:0/2895087647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63fc1549f0 msgr2=0x7f63fc1494b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:08.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.275+0000 7f63f3fff700 1 --2- 172.21.15.72:0/2895087647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63fc1549f0 0x7f63fc1494b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:08.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.275+0000 7f63f3fff700 1 -- 172.21.15.72:0/2895087647 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e4009550 con 0x7f63fc0c4400 2023-07-27T20:34:08.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.275+0000 7f63f3fff700 1 --2- 172.21.15.72:0/2895087647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63fc0c4400 0x7f63fc0c25e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f63e4009870 tx=0x7f63e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:08.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.276+0000 7f63f8ff9700 1 -- 172.21.15.72:0/2895087647 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e4004400 con 0x7f63fc0c4400 2023-07-27T20:34:08.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.276+0000 7f63f8ff9700 1 -- 172.21.15.72:0/2895087647 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e401f070 con 0x7f63fc0c4400 2023-07-27T20:34:08.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.276+0000 7f64019ff700 1 -- 172.21.15.72:0/2895087647 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63fc0c2fd0 con 0x7f63fc0c4400 2023-07-27T20:34:08.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.276+0000 7f63f8ff9700 1 -- 172.21.15.72:0/2895087647 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e40038e0 con 0x7f63fc0c4400 2023-07-27T20:34:08.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.276+0000 7f64019ff700 1 -- 172.21.15.72:0/2895087647 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63fc14a110 con 0x7f63fc0c4400 2023-07-27T20:34:08.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.277+0000 7f64019ff700 1 -- 172.21.15.72:0/2895087647 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63fc149f70 con 0x7f63fc0c4400 2023-07-27T20:34:08.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.278+0000 7f63f8ff9700 1 -- 172.21.15.72:0/2895087647 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f63e4021030 con 0x7f63fc0c4400 2023-07-27T20:34:08.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.279+0000 7f63f8ff9700 1 --2- 172.21.15.72:0/2895087647 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f63dc06ace0 0x7f63dc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:08.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.279+0000 7f63f8ff9700 1 -- 172.21.15.72:0/2895087647 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f63e408aec0 con 0x7f63fc0c4400 2023-07-27T20:34:08.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.279+0000 7f63faffd700 1 --2- 172.21.15.72:0/2895087647 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f63dc06ace0 0x7f63dc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:08.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.280+0000 7f63faffd700 1 --2- 172.21.15.72:0/2895087647 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f63dc06ace0 0x7f63dc06d1a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f63ec006fd0 tx=0x7f63ec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:08.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.283+0000 7f63f8ff9700 1 -- 172.21.15.72:0/2895087647 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f63fc149f70 con 0x7f63fc0c4400 2023-07-27T20:34:08.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.517+0000 7f64019ff700 1 -- 172.21.15.72:0/2895087647 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63fc149f70 con 0x7f63fc0c4400 2023-07-27T20:34:08.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.518+0000 7f63f8ff9700 1 -- 172.21.15.72:0/2895087647 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+5816 (secure 0 0 0) 0x7f63fc149f70 con 0x7f63fc0c4400 2023-07-27T20:34:08.505 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:34:08.505 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/1685903768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1685903768},{"type":"v1","addr":"172.21.15.173:6836","nonce":1685903768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5269,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/43862591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":43862591},{"type":"v1","addr":"172.21.15.173:6837","nonce":43862591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T20:33:00.054239+0000","modified":"2023-07-27T20:33:03.586058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5409},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5409":{"gid":5409,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.72:6834/1959104268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":1959104268},{"type":"v1","addr":"172.21.15.72:6834","nonce":1959104268}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T20:33:21.678859+0000","modified":"2023-07-27T20:33:25.206336+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5281":{"gid":5281,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.72:6835/1644610738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1644610738},{"type":"v1","addr":"172.21.15.72:6835","nonce":1644610738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-27T20:34:08.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.520+0000 7f64019ff700 1 -- 172.21.15.72:0/2895087647 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f63dc06ace0 msgr2=0x7f63dc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:08.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.520+0000 7f64019ff700 1 --2- 172.21.15.72:0/2895087647 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f63dc06ace0 0x7f63dc06d1a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f63ec006fd0 tx=0x7f63ec008040 comp rx=0 tx=0).stop 2023-07-27T20:34:08.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.520+0000 7f64019ff700 1 -- 172.21.15.72:0/2895087647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63fc0c4400 msgr2=0x7f63fc0c25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:08.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.520+0000 7f64019ff700 1 --2- 172.21.15.72:0/2895087647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63fc0c4400 0x7f63fc0c25e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f63e4009870 tx=0x7f63e4004750 comp rx=0 tx=0).stop 2023-07-27T20:34:08.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.520+0000 7f64019ff700 1 -- 172.21.15.72:0/2895087647 shutdown_connections 2023-07-27T20:34:08.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.520+0000 7f64019ff700 1 --2- 172.21.15.72:0/2895087647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63fc1549f0 0x7f63fc1494b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:08.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.520+0000 7f64019ff700 1 --2- 172.21.15.72:0/2895087647 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f63dc06ace0 0x7f63dc06d1a0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:08.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.520+0000 7f64019ff700 1 --2- 172.21.15.72:0/2895087647 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63fc06b150 0x7f63fc0c1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:08.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.520+0000 7f64019ff700 1 --2- 172.21.15.72:0/2895087647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63fc0c4400 0x7f63fc0c25e0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:08.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.520+0000 7f64019ff700 1 -- 172.21.15.72:0/2895087647 >> 172.21.15.72:0/2895087647 conn(0x7f63fc0ab300 msgr2=0x7f63fc154e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:08.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.520+0000 7f64019ff700 1 -- 172.21.15.72:0/2895087647 shutdown_connections 2023-07-27T20:34:08.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.520+0000 7f64019ff700 1 -- 172.21.15.72:0/2895087647 wait complete. 2023-07-27T20:34:08.510 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 22 2023-07-27T20:34:08.525 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:34:08.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.734+0000 7fc763bff700 1 Processor -- start 2023-07-27T20:34:08.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.734+0000 7fc763bff700 1 -- start start 2023-07-27T20:34:08.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.735+0000 7fc763bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc75c06b150 0x7fc75c0c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:08.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.735+0000 7fc763bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc75c06b710 con 0x7fc75c0c4400 2023-07-27T20:34:08.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.735+0000 7fc763bff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc75c06b9f0 con 0x7fc75c1549f0 2023-07-27T20:34:08.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.735+0000 7fc763bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c1545d0 con 0x7fc75c06b150 2023-07-27T20:34:08.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.735+0000 7fc76199b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc75c0c4400 0x7fc75c0c4cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48334/0 (socket says 172.21.15.72:48334) 2023-07-27T20:34:08.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.735+0000 7fc76199b700 1 -- 172.21.15.72:0/3258443540 learned_addr learned my addr 172.21.15.72:0/3258443540 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:08.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.736+0000 7fc76119a700 1 --2- 172.21.15.72:0/3258443540 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc75c06b150 0x7fc75c0c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:08.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.736+0000 7fc760999700 1 -- 172.21.15.72:0/3258443540 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3285351882 0 0) 0x7fc75c06b710 con 0x7fc75c0c4400 2023-07-27T20:34:08.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.736+0000 7fc760999700 1 -- 172.21.15.72:0/3258443540 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7480035b0 con 0x7fc75c0c4400 2023-07-27T20:34:08.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.736+0000 7fc760999700 1 -- 172.21.15.72:0/3258443540 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4196961830 0 0) 0x7fc7480035b0 con 0x7fc75c0c4400 2023-07-27T20:34:08.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.736+0000 7fc760999700 1 -- 172.21.15.72:0/3258443540 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc75c06b150 msgr2=0x7fc75c0c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:08.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.736+0000 7fc760999700 1 --2- 172.21.15.72:0/3258443540 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc75c06b150 0x7fc75c0c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:08.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.736+0000 7fc760999700 1 -- 172.21.15.72:0/3258443540 >> v1:172.21.15.173:6789/0 conn(0x7fc75c1549f0 legacy=0x7fc75c1514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:08.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.736+0000 7fc760999700 1 -- 172.21.15.72:0/3258443540 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75c06bcd0 con 0x7fc75c0c4400 2023-07-27T20:34:08.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.736+0000 7fc760999700 1 -- 172.21.15.72:0/3258443540 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7fc758001670 con 0x7fc75c0c4400 2023-07-27T20:34:08.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.736+0000 7fc760999700 1 -- 172.21.15.72:0/3258443540 >> v1:172.21.15.72:6789/0 conn(0x7fc75c0c4400 legacy=0x7fc75c0c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:08.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.736+0000 7fc760999700 1 --2- 172.21.15.72:0/3258443540 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc75c06b150 0x7fc748003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:08.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.736+0000 7fc760999700 1 --2- 172.21.15.72:0/3258443540 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc748004000 0x7fc748004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:08.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.736+0000 7fc760999700 1 --2- 172.21.15.72:0/3258443540 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc748004d90 0x7fc748005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:08.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.736+0000 7fc760999700 1 -- 172.21.15.72:0/3258443540 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c1545d0 con 0x7fc748004000 2023-07-27T20:34:08.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.736+0000 7fc760999700 1 -- 172.21.15.72:0/3258443540 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74800bc00 con 0x7fc748004d90 2023-07-27T20:34:08.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.736+0000 7fc760999700 1 -- 172.21.15.72:0/3258443540 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74800bdc0 con 0x7fc75c06b150 2023-07-27T20:34:08.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.736+0000 7fc76119a700 1 --2- 172.21.15.72:0/3258443540 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc748004000 0x7fc748004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:08.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.736+0000 7fc76199b700 1 --2- 172.21.15.72:0/3258443540 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc75c06b150 0x7fc748003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:08.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.736+0000 7fc76219c700 1 --2- 172.21.15.72:0/3258443540 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc748004d90 0x7fc748005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:08.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.737+0000 7fc76119a700 1 -- 172.21.15.72:0/3258443540 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc75c06b150 msgr2=0x7fc748003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:08.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.737+0000 7fc76119a700 1 --2- 172.21.15.72:0/3258443540 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc75c06b150 0x7fc748003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:08.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.737+0000 7fc76119a700 1 -- 172.21.15.72:0/3258443540 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc748004d90 msgr2=0x7fc748005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:08.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.737+0000 7fc76119a700 1 --2- 172.21.15.72:0/3258443540 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc748004d90 0x7fc748005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:08.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.737+0000 7fc76119a700 1 -- 172.21.15.72:0/3258443540 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7480035b0 con 0x7fc748004000 2023-07-27T20:34:08.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.737+0000 7fc76119a700 1 --2- 172.21.15.72:0/3258443540 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc748004000 0x7fc748004850 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fc74c009b60 tx=0x7fc748005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b74c3cb87f1ec00a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:08.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.737+0000 7fc760999700 1 -- 172.21.15.72:0/3258443540 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c00e6c0 con 0x7fc748004000 2023-07-27T20:34:08.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.737+0000 7fc760999700 1 -- 172.21.15.72:0/3258443540 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74c00e820 con 0x7fc748004000 2023-07-27T20:34:08.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.737+0000 7fc760999700 1 -- 172.21.15.72:0/3258443540 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c00eb90 con 0x7fc748004000 2023-07-27T20:34:08.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.738+0000 7fc763bff700 1 -- 172.21.15.72:0/3258443540 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc748004000 msgr2=0x7fc748004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:08.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.738+0000 7fc763bff700 1 --2- 172.21.15.72:0/3258443540 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc748004000 0x7fc748004850 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fc74c009b60 tx=0x7fc748005880 comp rx=0 tx=0).stop 2023-07-27T20:34:08.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.738+0000 7fc76219c700 1 -- 172.21.15.72:0/3258443540 reap_dead start 2023-07-27T20:34:08.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.738+0000 7fc763bff700 1 -- 172.21.15.72:0/3258443540 shutdown_connections 2023-07-27T20:34:08.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.738+0000 7fc763bff700 1 -- 172.21.15.72:0/3258443540 >> 172.21.15.72:0/3258443540 conn(0x7fc75c0ab300 msgr2=0x7fc75c0ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:08.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.738+0000 7fc763bff700 1 -- 172.21.15.72:0/3258443540 shutdown_connections 2023-07-27T20:34:08.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.738+0000 7fc763bff700 1 -- 172.21.15.72:0/3258443540 wait complete. 2023-07-27T20:34:08.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.740+0000 7fc763bff700 1 Processor -- start 2023-07-27T20:34:08.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.740+0000 7fc763bff700 1 -- start start 2023-07-27T20:34:08.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.742+0000 7fc763bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc748004000 0x7fc75c152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:08.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.742+0000 7fc763bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc75c1479f0 0x7fc75c0ae520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:08.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.742+0000 7fc763bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc75c0aea60 0x7fc75c146840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:08.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.742+0000 7fc763bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c0af100 con 0x7fc75c1479f0 2023-07-27T20:34:08.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.742+0000 7fc763bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c1ed410 con 0x7fc75c0aea60 2023-07-27T20:34:08.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.742+0000 7fc763bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c147710 con 0x7fc748004000 2023-07-27T20:34:08.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.742+0000 7fc76119a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc75c1479f0 0x7fc75c0ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:08.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.742+0000 7fc76199b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc748004000 0x7fc75c152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:08.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.742+0000 7fc76119a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc75c1479f0 0x7fc75c0ae520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41274/0 (socket says 172.21.15.72:41274) 2023-07-27T20:34:08.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.742+0000 7fc76119a700 1 -- 172.21.15.72:0/2829417370 learned_addr learned my addr 172.21.15.72:0/2829417370 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:08.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.742+0000 7fc76219c700 1 --2- 172.21.15.72:0/2829417370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc75c0aea60 0x7fc75c146840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:08.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.742+0000 7fc76119a700 1 -- 172.21.15.72:0/2829417370 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc748004000 msgr2=0x7fc75c152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:08.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.742+0000 7fc76119a700 1 --2- 172.21.15.72:0/2829417370 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc748004000 0x7fc75c152d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:08.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.742+0000 7fc76119a700 1 -- 172.21.15.72:0/2829417370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc75c0aea60 msgr2=0x7fc75c146840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:08.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.742+0000 7fc76119a700 1 --2- 172.21.15.72:0/2829417370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc75c0aea60 0x7fc75c146840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:08.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.742+0000 7fc76119a700 1 -- 172.21.15.72:0/2829417370 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75c0af310 con 0x7fc75c1479f0 2023-07-27T20:34:08.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.743+0000 7fc76119a700 1 --2- 172.21.15.72:0/2829417370 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc75c1479f0 0x7fc75c0ae520 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fc74c0090b0 tx=0x7fc74c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:08.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.743+0000 7fc7527fc700 1 -- 172.21.15.72:0/2829417370 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c00e6c0 con 0x7fc75c1479f0 2023-07-27T20:34:08.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.743+0000 7fc7527fc700 1 -- 172.21.15.72:0/2829417370 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74c003ad0 con 0x7fc75c1479f0 2023-07-27T20:34:08.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.743+0000 7fc7527fc700 1 -- 172.21.15.72:0/2829417370 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c003e80 con 0x7fc75c1479f0 2023-07-27T20:34:08.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.743+0000 7fc763bff700 1 -- 172.21.15.72:0/2829417370 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc75c1ed880 con 0x7fc75c1479f0 2023-07-27T20:34:08.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.743+0000 7fc763bff700 1 -- 172.21.15.72:0/2829417370 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc75c14bde0 con 0x7fc75c1479f0 2023-07-27T20:34:08.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.744+0000 7fc763bff700 1 -- 172.21.15.72:0/2829417370 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc75c0af4a0 con 0x7fc75c1479f0 2023-07-27T20:34:08.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.745+0000 7fc7527fc700 1 -- 172.21.15.72:0/2829417370 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc74c013470 con 0x7fc75c1479f0 2023-07-27T20:34:08.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.747+0000 7fc7527fc700 1 --2- 172.21.15.72:0/2829417370 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc74006ace0 0x7fc74006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:08.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.747+0000 7fc7527fc700 1 -- 172.21.15.72:0/2829417370 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7fc74c08b8b0 con 0x7fc75c1479f0 2023-07-27T20:34:08.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.747+0000 7fc76199b700 1 --2- 172.21.15.72:0/2829417370 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc74006ace0 0x7fc74006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:08.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.748+0000 7fc76199b700 1 --2- 172.21.15.72:0/2829417370 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc74006ace0 0x7fc74006d1a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc75c0ae4b0 tx=0x7fc758000fc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:08.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.750+0000 7fc7527fc700 1 -- 172.21.15.72:0/2829417370 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc74c056520 con 0x7fc75c1479f0 2023-07-27T20:34:08.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.944+0000 7fc763bff700 1 -- 172.21.15.72:0/2829417370 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc75c074310 con 0x7fc75c1479f0 2023-07-27T20:34:08.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.945+0000 7fc7527fc700 1 -- 172.21.15.72:0/2829417370 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+22308 (secure 0 0 0) 0x7fc74c017090 con 0x7fc75c1479f0 2023-07-27T20:34:08.933 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:34:08.933 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":47,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:33:23.191066+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:32:58.242890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-27T20:32:59.032110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_metadata","create_time":"2023-07-27T20:33:20.125785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs2_data","create_time":"2023-07-27T20:33:20.647929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2c","mappings":[{"from":0,"to":4}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:34:08.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.948+0000 7fc763bff700 1 -- 172.21.15.72:0/2829417370 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc74006ace0 msgr2=0x7fc74006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:08.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.948+0000 7fc763bff700 1 --2- 172.21.15.72:0/2829417370 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc74006ace0 0x7fc74006d1a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc75c0ae4b0 tx=0x7fc758000fc0 comp rx=0 tx=0).stop 2023-07-27T20:34:08.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.948+0000 7fc763bff700 1 -- 172.21.15.72:0/2829417370 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc75c1479f0 msgr2=0x7fc75c0ae520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:08.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.948+0000 7fc763bff700 1 --2- 172.21.15.72:0/2829417370 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc75c1479f0 0x7fc75c0ae520 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fc74c0090b0 tx=0x7fc74c0047c0 comp rx=0 tx=0).stop 2023-07-27T20:34:08.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.948+0000 7fc763bff700 1 -- 172.21.15.72:0/2829417370 shutdown_connections 2023-07-27T20:34:08.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.948+0000 7fc763bff700 1 --2- 172.21.15.72:0/2829417370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc75c0aea60 0x7fc75c146840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:08.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.948+0000 7fc763bff700 1 --2- 172.21.15.72:0/2829417370 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc74006ace0 0x7fc74006d1a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:08.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.948+0000 7fc763bff700 1 --2- 172.21.15.72:0/2829417370 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc748004000 0x7fc75c152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:08.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.948+0000 7fc763bff700 1 --2- 172.21.15.72:0/2829417370 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc75c1479f0 0x7fc75c0ae520 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:08.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.948+0000 7fc763bff700 1 -- 172.21.15.72:0/2829417370 >> 172.21.15.72:0/2829417370 conn(0x7fc75c0ab300 msgr2=0x7fc75c0c5a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:08.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.948+0000 7fc763bff700 1 -- 172.21.15.72:0/2829417370 shutdown_connections 2023-07-27T20:34:08.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:08.948+0000 7fc763bff700 1 -- 172.21.15.72:0/2829417370 wait complete. 2023-07-27T20:34:08.954 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-27T20:34:08.954 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T20:34:09.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.162+0000 7fdd6b3ff700 1 Processor -- start 2023-07-27T20:34:09.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.162+0000 7fdd6b3ff700 1 -- start start 2023-07-27T20:34:09.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.163+0000 7fdd6b3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdd640c4400 0x7fdd640c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:09.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.163+0000 7fdd6b3ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdd6406b150 0x7fdd640c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:09.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.163+0000 7fdd6b3ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fdd641549f0 0x7fdd641514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:09.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.163+0000 7fdd6b3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd641545d0 con 0x7fdd640c4400 2023-07-27T20:34:09.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.163+0000 7fdd6b3ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd6406c860 con 0x7fdd641549f0 2023-07-27T20:34:09.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.163+0000 7fdd6b3ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd640c5230 con 0x7fdd6406b150 2023-07-27T20:34:09.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.164+0000 7fdd6919b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdd640c4400 0x7fdd640c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:09.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.164+0000 7fdd6919b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdd640c4400 0x7fdd640c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41280/0 (socket says 172.21.15.72:41280) 2023-07-27T20:34:09.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.164+0000 7fdd6919b700 1 -- 172.21.15.72:0/151271983 learned_addr learned my addr 172.21.15.72:0/151271983 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:09.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.164+0000 7fdd6899a700 1 --2- 172.21.15.72:0/151271983 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdd6406b150 0x7fdd640c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:09.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.164+0000 7fdd6999c700 1 --2- 172.21.15.72:0/151271983 >> v2:172.21.15.173:3300/0 conn(0x7fdd641549f0 0x7fdd641514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:09.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.164+0000 7fdd6919b700 1 -- 172.21.15.72:0/151271983 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdd6406b150 msgr2=0x7fdd640c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:09.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.164+0000 7fdd6919b700 1 --2- 172.21.15.72:0/151271983 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdd6406b150 0x7fdd640c4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:09.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.164+0000 7fdd6919b700 1 -- 172.21.15.72:0/151271983 >> v2:172.21.15.173:3300/0 conn(0x7fdd641549f0 msgr2=0x7fdd641514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:09.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.164+0000 7fdd6919b700 1 --2- 172.21.15.72:0/151271983 >> v2:172.21.15.173:3300/0 conn(0x7fdd641549f0 0x7fdd641514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:09.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.164+0000 7fdd6919b700 1 -- 172.21.15.72:0/151271983 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd6406b710 con 0x7fdd640c4400 2023-07-27T20:34:09.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.164+0000 7fdd6899a700 1 --2- 172.21.15.72:0/151271983 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdd6406b150 0x7fdd640c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:09.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.164+0000 7fdd6999c700 1 --2- 172.21.15.72:0/151271983 >> v2:172.21.15.173:3300/0 conn(0x7fdd641549f0 0x7fdd641514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:09.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.164+0000 7fdd6919b700 1 --2- 172.21.15.72:0/151271983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd640c4400 0x7fdd640c7710 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fdd640c3df0 tx=0x7fdd60009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17dd5ffaae1b89b0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:09.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.164+0000 7fdd5bfff700 1 -- 172.21.15.72:0/151271983 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6000b870 con 0x7fdd640c4400 2023-07-27T20:34:09.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.164+0000 7fdd5bfff700 1 -- 172.21.15.72:0/151271983 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd6000b9d0 con 0x7fdd640c4400 2023-07-27T20:34:09.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.165+0000 7fdd5bfff700 1 -- 172.21.15.72:0/151271983 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6000bd60 con 0x7fdd640c4400 2023-07-27T20:34:09.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.165+0000 7fdd6b3ff700 1 -- 172.21.15.72:0/151271983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd640c4400 msgr2=0x7fdd640c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:09.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.165+0000 7fdd6b3ff700 1 --2- 172.21.15.72:0/151271983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd640c4400 0x7fdd640c7710 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fdd640c3df0 tx=0x7fdd60009bd0 comp rx=0 tx=0).stop 2023-07-27T20:34:09.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.165+0000 7fdd6b3ff700 1 -- 172.21.15.72:0/151271983 shutdown_connections 2023-07-27T20:34:09.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.165+0000 7fdd6b3ff700 1 --2- 172.21.15.72:0/151271983 >> v2:172.21.15.173:3300/0 conn(0x7fdd641549f0 0x7fdd641514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:09.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.165+0000 7fdd6b3ff700 1 --2- 172.21.15.72:0/151271983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd640c4400 0x7fdd640c7710 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:09.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.165+0000 7fdd6b3ff700 1 --2- 172.21.15.72:0/151271983 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdd6406b150 0x7fdd640c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:09.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.165+0000 7fdd6b3ff700 1 -- 172.21.15.72:0/151271983 >> 172.21.15.72:0/151271983 conn(0x7fdd640ab300 msgr2=0x7fdd640ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:09.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.165+0000 7fdd6b3ff700 1 -- 172.21.15.72:0/151271983 shutdown_connections 2023-07-27T20:34:09.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.165+0000 7fdd6b3ff700 1 -- 172.21.15.72:0/151271983 wait complete. 2023-07-27T20:34:09.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.167+0000 7fdd6b3ff700 1 Processor -- start 2023-07-27T20:34:09.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.167+0000 7fdd6b3ff700 1 -- start start 2023-07-27T20:34:09.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.168+0000 7fdd6b3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd6406b150 0x7fdd640bdc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:09.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.168+0000 7fdd6b3ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd640c4400 0x7fdd640c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:09.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.168+0000 7fdd6b3ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdd641549f0 0x7fdd640c08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:09.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.168+0000 7fdd6b3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd640bf950 con 0x7fdd6406b150 2023-07-27T20:34:09.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.168+0000 7fdd6b3ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd640bfc30 con 0x7fdd640c4400 2023-07-27T20:34:09.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.168+0000 7fdd6b3ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd640bff10 con 0x7fdd641549f0 2023-07-27T20:34:09.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.168+0000 7fdd6919b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd6406b150 0x7fdd640bdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:09.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.168+0000 7fdd6919b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd6406b150 0x7fdd640bdc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41290/0 (socket says 172.21.15.72:41290) 2023-07-27T20:34:09.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.168+0000 7fdd6919b700 1 -- 172.21.15.72:0/1191416511 learned_addr learned my addr 172.21.15.72:0/1191416511 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:09.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.168+0000 7fdd6999c700 1 --2- 172.21.15.72:0/1191416511 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdd641549f0 0x7fdd640c08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:09.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.168+0000 7fdd6899a700 1 --2- 172.21.15.72:0/1191416511 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd640c4400 0x7fdd640c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:09.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.168+0000 7fdd6919b700 1 -- 172.21.15.72:0/1191416511 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdd641549f0 msgr2=0x7fdd640c08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:09.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.168+0000 7fdd6919b700 1 --2- 172.21.15.72:0/1191416511 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdd641549f0 0x7fdd640c08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:09.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.168+0000 7fdd6919b700 1 -- 172.21.15.72:0/1191416511 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd640c4400 msgr2=0x7fdd640c1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:09.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.168+0000 7fdd6919b700 1 --2- 172.21.15.72:0/1191416511 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd640c4400 0x7fdd640c1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:09.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.168+0000 7fdd6919b700 1 -- 172.21.15.72:0/1191416511 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd60009550 con 0x7fdd6406b150 2023-07-27T20:34:09.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.169+0000 7fdd6919b700 1 --2- 172.21.15.72:0/1191416511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd6406b150 0x7fdd640bdc10 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fdd6408b450 tx=0x7fdd60004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:09.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.169+0000 7fdd59ffb700 1 -- 172.21.15.72:0/1191416511 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd60004310 con 0x7fdd6406b150 2023-07-27T20:34:09.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.169+0000 7fdd59ffb700 1 -- 172.21.15.72:0/1191416511 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd6001f070 con 0x7fdd6406b150 2023-07-27T20:34:09.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.169+0000 7fdd6b3ff700 1 -- 172.21.15.72:0/1191416511 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd640c01f0 con 0x7fdd6406b150 2023-07-27T20:34:09.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.169+0000 7fdd59ffb700 1 -- 172.21.15.72:0/1191416511 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd600036a0 con 0x7fdd6406b150 2023-07-27T20:34:09.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.169+0000 7fdd6b3ff700 1 -- 172.21.15.72:0/1191416511 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd6414f6f0 con 0x7fdd6406b150 2023-07-27T20:34:09.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.170+0000 7fdd6b3ff700 1 -- 172.21.15.72:0/1191416511 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd64074310 con 0x7fdd6406b150 2023-07-27T20:34:09.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.171+0000 7fdd59ffb700 1 -- 172.21.15.72:0/1191416511 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdd60021030 con 0x7fdd6406b150 2023-07-27T20:34:09.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.172+0000 7fdd59ffb700 1 --2- 172.21.15.72:0/1191416511 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fdd4806ace0 0x7fdd4806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:09.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.172+0000 7fdd59ffb700 1 -- 172.21.15.72:0/1191416511 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7fdd6008ad60 con 0x7fdd6406b150 2023-07-27T20:34:09.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.172+0000 7fdd6899a700 1 --2- 172.21.15.72:0/1191416511 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fdd4806ace0 0x7fdd4806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:09.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.173+0000 7fdd6899a700 1 --2- 172.21.15.72:0/1191416511 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fdd4806ace0 0x7fdd4806d1a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fdd54006ba0 tx=0x7fdd54008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:09.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.176+0000 7fdd59ffb700 1 -- 172.21.15.72:0/1191416511 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdd60055950 con 0x7fdd6406b150 2023-07-27T20:34:09.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.414+0000 7fdd6b3ff700 1 -- 172.21.15.72:0/1191416511 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdd64155100 con 0x7fdd6406b150 2023-07-27T20:34:09.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.415+0000 7fdd59ffb700 1 -- 172.21.15.72:0/1191416511 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+5816 (secure 0 0 0) 0x7fdd60058f70 con 0x7fdd6406b150 2023-07-27T20:34:09.402 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:34:09.403 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/1685903768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1685903768},{"type":"v1","addr":"172.21.15.173:6836","nonce":1685903768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5269,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/43862591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":43862591},{"type":"v1","addr":"172.21.15.173:6837","nonce":43862591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T20:33:00.054239+0000","modified":"2023-07-27T20:33:03.586058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5409},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5409":{"gid":5409,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.72:6834/1959104268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":1959104268},{"type":"v1","addr":"172.21.15.72:6834","nonce":1959104268}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T20:33:21.678859+0000","modified":"2023-07-27T20:33:25.206336+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5281":{"gid":5281,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.72:6835/1644610738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1644610738},{"type":"v1","addr":"172.21.15.72:6835","nonce":1644610738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-27T20:34:09.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.417+0000 7fdd6b3ff700 1 -- 172.21.15.72:0/1191416511 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fdd4806ace0 msgr2=0x7fdd4806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:09.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.417+0000 7fdd6b3ff700 1 --2- 172.21.15.72:0/1191416511 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fdd4806ace0 0x7fdd4806d1a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fdd54006ba0 tx=0x7fdd54008040 comp rx=0 tx=0).stop 2023-07-27T20:34:09.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.417+0000 7fdd6b3ff700 1 -- 172.21.15.72:0/1191416511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd6406b150 msgr2=0x7fdd640bdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:09.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.417+0000 7fdd6b3ff700 1 --2- 172.21.15.72:0/1191416511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd6406b150 0x7fdd640bdc10 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fdd6408b450 tx=0x7fdd60004750 comp rx=0 tx=0).stop 2023-07-27T20:34:09.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.417+0000 7fdd6b3ff700 1 -- 172.21.15.72:0/1191416511 shutdown_connections 2023-07-27T20:34:09.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.417+0000 7fdd6b3ff700 1 --2- 172.21.15.72:0/1191416511 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fdd4806ace0 0x7fdd4806d1a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:09.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.417+0000 7fdd6b3ff700 1 --2- 172.21.15.72:0/1191416511 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdd641549f0 0x7fdd640c08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:09.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.417+0000 7fdd6b3ff700 1 --2- 172.21.15.72:0/1191416511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd6406b150 0x7fdd640bdc10 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:09.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.417+0000 7fdd6b3ff700 1 --2- 172.21.15.72:0/1191416511 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd640c4400 0x7fdd640c1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:09.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.417+0000 7fdd6b3ff700 1 -- 172.21.15.72:0/1191416511 >> 172.21.15.72:0/1191416511 conn(0x7fdd640ab300 msgr2=0x7fdd64151690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:09.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.417+0000 7fdd6b3ff700 1 -- 172.21.15.72:0/1191416511 shutdown_connections 2023-07-27T20:34:09.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.417+0000 7fdd6b3ff700 1 -- 172.21.15.72:0/1191416511 wait complete. 2023-07-27T20:34:09.407 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 22 2023-07-27T20:34:09.422 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T20:34:09.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.631+0000 7f27bffff700 1 Processor -- start 2023-07-27T20:34:09.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.631+0000 7f27bffff700 1 -- start start 2023-07-27T20:34:09.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.632+0000 7f27bffff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f27b80c4400 0x7f27b80c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:09.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.632+0000 7f27bffff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27b81549f0 0x7f27b81514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:09.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.632+0000 7f27bffff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27b806b710 con 0x7f27b806b150 2023-07-27T20:34:09.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.632+0000 7f27bffff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27b81545d0 con 0x7f27b80c4400 2023-07-27T20:34:09.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.632+0000 7f27bffff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b806c860 con 0x7f27b81549f0 2023-07-27T20:34:09.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.633+0000 7f27bd59a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f27b806b150 0x7f27b80c4cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48348/0 (socket says 172.21.15.72:48348) 2023-07-27T20:34:09.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.633+0000 7f27bd59a700 1 -- 172.21.15.72:0/3213862115 learned_addr learned my addr 172.21.15.72:0/3213862115 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:09.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.633+0000 7f27bdd9b700 1 --2- 172.21.15.72:0/3213862115 >> v2:172.21.15.173:3300/0 conn(0x7f27b80c4400 0x7f27b80c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:09.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.633+0000 7f27be59c700 1 --2- 172.21.15.72:0/3213862115 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27b81549f0 0x7f27b81514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:09.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.633+0000 7f27bcd99700 1 -- 172.21.15.72:0/3213862115 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 859042226 0 0) 0x7f27b806b710 con 0x7f27b806b150 2023-07-27T20:34:09.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.633+0000 7f27bcd99700 1 -- 172.21.15.72:0/3213862115 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27a40035b0 con 0x7f27b806b150 2023-07-27T20:34:09.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.633+0000 7f27bdd9b700 1 -- 172.21.15.72:0/3213862115 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27b81549f0 msgr2=0x7f27b81514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:09.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.633+0000 7f27bdd9b700 1 --2- 172.21.15.72:0/3213862115 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27b81549f0 0x7f27b81514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:09.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.633+0000 7f27bdd9b700 1 -- 172.21.15.72:0/3213862115 >> v1:172.21.15.72:6789/0 conn(0x7f27b806b150 legacy=0x7f27b80c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:09.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.633+0000 7f27bdd9b700 1 -- 172.21.15.72:0/3213862115 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b806b9f0 con 0x7f27b80c4400 2023-07-27T20:34:09.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.634+0000 7f27bdd9b700 1 --2- 172.21.15.72:0/3213862115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27b80c4400 0x7f27b80c7710 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f27b4009840 tx=0x7f27b4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b1fe3b968c186a9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:09.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.634+0000 7f27bcd99700 1 -- 172.21.15.72:0/3213862115 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b4011830 con 0x7f27b80c4400 2023-07-27T20:34:09.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.634+0000 7f27bcd99700 1 -- 172.21.15.72:0/3213862115 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b4011990 con 0x7f27b80c4400 2023-07-27T20:34:09.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.634+0000 7f27bcd99700 1 -- 172.21.15.72:0/3213862115 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b4011d20 con 0x7f27b80c4400 2023-07-27T20:34:09.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.634+0000 7f27bffff700 1 -- 172.21.15.72:0/3213862115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27b80c4400 msgr2=0x7f27b80c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:09.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.634+0000 7f27bffff700 1 --2- 172.21.15.72:0/3213862115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27b80c4400 0x7f27b80c7710 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f27b4009840 tx=0x7f27b4009b50 comp rx=0 tx=0).stop 2023-07-27T20:34:09.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.634+0000 7f27bffff700 1 -- 172.21.15.72:0/3213862115 shutdown_connections 2023-07-27T20:34:09.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.634+0000 7f27bffff700 1 --2- 172.21.15.72:0/3213862115 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27b81549f0 0x7f27b81514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:09.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.634+0000 7f27bffff700 1 --2- 172.21.15.72:0/3213862115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27b80c4400 0x7f27b80c7710 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:09.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.634+0000 7f27bffff700 1 -- 172.21.15.72:0/3213862115 >> 172.21.15.72:0/3213862115 conn(0x7f27b80ab300 msgr2=0x7f27b80ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:09.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.635+0000 7f27bffff700 1 -- 172.21.15.72:0/3213862115 shutdown_connections 2023-07-27T20:34:09.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.635+0000 7f27bffff700 1 -- 172.21.15.72:0/3213862115 wait complete. 2023-07-27T20:34:09.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.636+0000 7f27bffff700 1 Processor -- start 2023-07-27T20:34:09.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.636+0000 7f27bffff700 1 -- start start 2023-07-27T20:34:09.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.637+0000 7f27bffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27b806b150 0x7f27b81ed120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:09.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.637+0000 7f27bffff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27b80c4400 0x7f27b8147f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:09.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.637+0000 7f27bffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27b81549f0 0x7f27b81e98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:09.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.637+0000 7f27bffff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b81469c0 con 0x7f27b81549f0 2023-07-27T20:34:09.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.637+0000 7f27bffff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b81e91a0 con 0x7f27b806b150 2023-07-27T20:34:09.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.637+0000 7f27bffff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b81ed660 con 0x7f27b80c4400 2023-07-27T20:34:09.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.637+0000 7f27be59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27b81549f0 0x7f27b81e98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:09.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.638+0000 7f27be59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27b81549f0 0x7f27b81e98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41302/0 (socket says 172.21.15.72:41302) 2023-07-27T20:34:09.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.638+0000 7f27be59c700 1 -- 172.21.15.72:0/2875336098 learned_addr learned my addr 172.21.15.72:0/2875336098 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:09.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.638+0000 7f27bdd9b700 1 --2- 172.21.15.72:0/2875336098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27b806b150 0x7f27b81ed120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:09.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.638+0000 7f27bd59a700 1 --2- 172.21.15.72:0/2875336098 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27b80c4400 0x7f27b8147f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:09.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.638+0000 7f27be59c700 1 -- 172.21.15.72:0/2875336098 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27b80c4400 msgr2=0x7f27b8147f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:09.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.638+0000 7f27be59c700 1 --2- 172.21.15.72:0/2875336098 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27b80c4400 0x7f27b8147f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:09.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.638+0000 7f27be59c700 1 -- 172.21.15.72:0/2875336098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27b806b150 msgr2=0x7f27b81ed120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:09.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.638+0000 7f27be59c700 1 --2- 172.21.15.72:0/2875336098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27b806b150 0x7f27b81ed120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:09.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.638+0000 7f27be59c700 1 -- 172.21.15.72:0/2875336098 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b40094a0 con 0x7f27b81549f0 2023-07-27T20:34:09.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.638+0000 7f27be59c700 1 --2- 172.21.15.72:0/2875336098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27b81549f0 0x7f27b81e98d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f27b0009d30 tx=0x7f27b000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:09.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.638+0000 7f27ae7fc700 1 -- 172.21.15.72:0/2875336098 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b000cc30 con 0x7f27b81549f0 2023-07-27T20:34:09.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.638+0000 7f27ae7fc700 1 -- 172.21.15.72:0/2875336098 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b000f040 con 0x7f27b81549f0 2023-07-27T20:34:09.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.638+0000 7f27ae7fc700 1 -- 172.21.15.72:0/2875336098 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b0009e80 con 0x7f27b81549f0 2023-07-27T20:34:09.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.638+0000 7f27bffff700 1 -- 172.21.15.72:0/2875336098 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27b81e9440 con 0x7f27b81549f0 2023-07-27T20:34:09.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.639+0000 7f27bffff700 1 -- 172.21.15.72:0/2875336098 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27b8145d50 con 0x7f27b81549f0 2023-07-27T20:34:09.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.640+0000 7f27bffff700 1 -- 172.21.15.72:0/2875336098 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27b804e470 con 0x7f27b81549f0 2023-07-27T20:34:09.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.641+0000 7f27ae7fc700 1 -- 172.21.15.72:0/2875336098 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f27b0014480 con 0x7f27b81549f0 2023-07-27T20:34:09.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.642+0000 7f27ae7fc700 1 --2- 172.21.15.72:0/2875336098 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f279c06ad10 0x7f279c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:09.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.642+0000 7f27ae7fc700 1 -- 172.21.15.72:0/2875336098 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f27b008a160 con 0x7f27b81549f0 2023-07-27T20:34:09.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.642+0000 7f27bdd9b700 1 --2- 172.21.15.72:0/2875336098 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f279c06ad10 0x7f279c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:09.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.643+0000 7f27bdd9b700 1 --2- 172.21.15.72:0/2875336098 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f279c06ad10 0x7f279c06d1d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f27b4000c00 tx=0x7f27b4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:09.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.646+0000 7f27ae7fc700 1 -- 172.21.15.72:0/2875336098 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f27b0054c30 con 0x7f27b81549f0 2023-07-27T20:34:09.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.878+0000 7f27bffff700 1 -- 172.21.15.72:0/2875336098 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27b81e95d0 con 0x7f27b81549f0 2023-07-27T20:34:09.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.878+0000 7f27ae7fc700 1 -- 172.21.15.72:0/2875336098 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+5816 (secure 0 0 0) 0x7f27b0018090 con 0x7f27b81549f0 2023-07-27T20:34:09.866 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:34:09.866 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/1685903768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1685903768},{"type":"v1","addr":"172.21.15.173:6836","nonce":1685903768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5269,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/43862591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":43862591},{"type":"v1","addr":"172.21.15.173:6837","nonce":43862591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T20:33:00.054239+0000","modified":"2023-07-27T20:33:03.586058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5409},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5409":{"gid":5409,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.72:6834/1959104268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":1959104268},{"type":"v1","addr":"172.21.15.72:6834","nonce":1959104268}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T20:33:21.678859+0000","modified":"2023-07-27T20:33:25.206336+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5281":{"gid":5281,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.72:6835/1644610738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1644610738},{"type":"v1","addr":"172.21.15.72:6835","nonce":1644610738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-27T20:34:09.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.881+0000 7f27bffff700 1 -- 172.21.15.72:0/2875336098 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f279c06ad10 msgr2=0x7f279c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:09.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.881+0000 7f27bffff700 1 --2- 172.21.15.72:0/2875336098 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f279c06ad10 0x7f279c06d1d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f27b4000c00 tx=0x7f27b4008030 comp rx=0 tx=0).stop 2023-07-27T20:34:09.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.881+0000 7f27bffff700 1 -- 172.21.15.72:0/2875336098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27b81549f0 msgr2=0x7f27b81e98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:09.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.881+0000 7f27bffff700 1 --2- 172.21.15.72:0/2875336098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27b81549f0 0x7f27b81e98d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f27b0009d30 tx=0x7f27b000c3a0 comp rx=0 tx=0).stop 2023-07-27T20:34:09.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.881+0000 7f27bffff700 1 -- 172.21.15.72:0/2875336098 shutdown_connections 2023-07-27T20:34:09.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.881+0000 7f27bffff700 1 --2- 172.21.15.72:0/2875336098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27b81549f0 0x7f27b81e98d0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:09.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.881+0000 7f27bffff700 1 --2- 172.21.15.72:0/2875336098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27b806b150 0x7f27b81ed120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:09.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.881+0000 7f27bffff700 1 --2- 172.21.15.72:0/2875336098 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f279c06ad10 0x7f279c06d1d0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:09.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.881+0000 7f27bffff700 1 --2- 172.21.15.72:0/2875336098 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27b80c4400 0x7f27b8147f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:09.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.881+0000 7f27bffff700 1 -- 172.21.15.72:0/2875336098 >> 172.21.15.72:0/2875336098 conn(0x7f27b80ab300 msgr2=0x7f27b81decd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:09.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.881+0000 7f27bffff700 1 -- 172.21.15.72:0/2875336098 shutdown_connections 2023-07-27T20:34:09.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:09.881+0000 7f27bffff700 1 -- 172.21.15.72:0/2875336098 wait complete. 2023-07-27T20:34:09.870 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 22 2023-07-27T20:34:09.886 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:34:10.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.096+0000 7fa779dff700 1 Processor -- start 2023-07-27T20:34:10.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.096+0000 7fa779dff700 1 -- start start 2023-07-27T20:34:10.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.097+0000 7fa779dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa77406b150 0x7fa7740c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:10.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.097+0000 7fa779dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa77406b710 con 0x7fa7740c4400 2023-07-27T20:34:10.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.097+0000 7fa779dff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa77406b9f0 con 0x7fa7741549f0 2023-07-27T20:34:10.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.097+0000 7fa779dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7741545d0 con 0x7fa77406b150 2023-07-27T20:34:10.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.097+0000 7fa76bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa77406b150 0x7fa7740c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:10.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.097+0000 7fa76bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa77406b150 0x7fa7740c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46462/0 (socket says 172.21.15.72:46462) 2023-07-27T20:34:10.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.097+0000 7fa76bfff700 1 -- 172.21.15.72:0/880710822 learned_addr learned my addr 172.21.15.72:0/880710822 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:10.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.098+0000 7fa76bfff700 1 -- 172.21.15.72:0/880710822 >> v1:172.21.15.173:6789/0 conn(0x7fa7741549f0 legacy=0x7fa7741514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:10.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.098+0000 7fa76bfff700 1 -- 172.21.15.72:0/880710822 >> v1:172.21.15.72:6789/0 conn(0x7fa7740c4400 legacy=0x7fa7740c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:10.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.098+0000 7fa76bfff700 1 -- 172.21.15.72:0/880710822 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa77406bcd0 con 0x7fa77406b150 2023-07-27T20:34:10.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.098+0000 7fa76bfff700 1 --2- 172.21.15.72:0/880710822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa77406b150 0x7fa7740c7710 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0098f0 tx=0x7fa75c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=922ede5c3d57fdbb server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:10.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.098+0000 7fa772ffd700 1 -- 172.21.15.72:0/880710822 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c004230 con 0x7fa77406b150 2023-07-27T20:34:10.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.098+0000 7fa772ffd700 1 -- 172.21.15.72:0/880710822 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75c004390 con 0x7fa77406b150 2023-07-27T20:34:10.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.098+0000 7fa772ffd700 1 -- 172.21.15.72:0/880710822 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c0036a0 con 0x7fa77406b150 2023-07-27T20:34:10.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.099+0000 7fa779dff700 1 -- 172.21.15.72:0/880710822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa77406b150 msgr2=0x7fa7740c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:10.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.099+0000 7fa779dff700 1 --2- 172.21.15.72:0/880710822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa77406b150 0x7fa7740c7710 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0098f0 tx=0x7fa75c009c00 comp rx=0 tx=0).stop 2023-07-27T20:34:10.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.099+0000 7fa779dff700 1 -- 172.21.15.72:0/880710822 shutdown_connections 2023-07-27T20:34:10.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.099+0000 7fa779dff700 1 --2- 172.21.15.72:0/880710822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa77406b150 0x7fa7740c7710 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:10.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.099+0000 7fa779dff700 1 -- 172.21.15.72:0/880710822 >> 172.21.15.72:0/880710822 conn(0x7fa7740ab300 msgr2=0x7fa7740ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:10.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.099+0000 7fa779dff700 1 -- 172.21.15.72:0/880710822 shutdown_connections 2023-07-27T20:34:10.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.099+0000 7fa779dff700 1 -- 172.21.15.72:0/880710822 wait complete. 2023-07-27T20:34:10.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.101+0000 7fa779dff700 1 Processor -- start 2023-07-27T20:34:10.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.101+0000 7fa779dff700 1 -- start start 2023-07-27T20:34:10.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.102+0000 7fa779dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa77406b150 0x7fa7740ac860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:10.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.102+0000 7fa779dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7740c4400 0x7fa7740a9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:10.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.102+0000 7fa779dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa7741549f0 0x7fa774149bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:10.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.103+0000 7fa779dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77414eb70 con 0x7fa7740c4400 2023-07-27T20:34:10.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.103+0000 7fa779dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7741496c0 con 0x7fa77406b150 2023-07-27T20:34:10.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.103+0000 7fa779dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa77414a8f0 con 0x7fa7741549f0 2023-07-27T20:34:10.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.103+0000 7fa76bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7740c4400 0x7fa7740a9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:10.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.103+0000 7fa76bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7740c4400 0x7fa7740a9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46466/0 (socket says 172.21.15.72:46466) 2023-07-27T20:34:10.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.103+0000 7fa76bfff700 1 -- 172.21.15.72:0/3425436937 learned_addr learned my addr 172.21.15.72:0/3425436937 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:10.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.103+0000 7fa7737fe700 1 --2- 172.21.15.72:0/3425436937 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa77406b150 0x7fa7740ac860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:10.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.103+0000 7fa773fff700 1 --2- 172.21.15.72:0/3425436937 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa7741549f0 0x7fa774149bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:10.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.103+0000 7fa76bfff700 1 -- 172.21.15.72:0/3425436937 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa7741549f0 msgr2=0x7fa774149bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:10.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.103+0000 7fa76bfff700 1 --2- 172.21.15.72:0/3425436937 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa7741549f0 0x7fa774149bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:10.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.103+0000 7fa76bfff700 1 -- 172.21.15.72:0/3425436937 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa77406b150 msgr2=0x7fa7740ac860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:10.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.103+0000 7fa76bfff700 1 --2- 172.21.15.72:0/3425436937 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa77406b150 0x7fa7740ac860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:10.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.103+0000 7fa76bfff700 1 -- 172.21.15.72:0/3425436937 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75c009550 con 0x7fa7740c4400 2023-07-27T20:34:10.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.103+0000 7fa773fff700 1 --2- 172.21.15.72:0/3425436937 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa7741549f0 0x7fa774149bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:10.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.103+0000 7fa76bfff700 1 --2- 172.21.15.72:0/3425436937 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7740c4400 0x7fa7740a9b80 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fa77408b450 tx=0x7fa75c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:10.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.104+0000 7fa770ff9700 1 -- 172.21.15.72:0/3425436937 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c00b660 con 0x7fa7740c4400 2023-07-27T20:34:10.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.104+0000 7fa770ff9700 1 -- 172.21.15.72:0/3425436937 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75c00b7e0 con 0x7fa7740c4400 2023-07-27T20:34:10.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.104+0000 7fa770ff9700 1 -- 172.21.15.72:0/3425436937 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c00bb90 con 0x7fa7740c4400 2023-07-27T20:34:10.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.104+0000 7fa779dff700 1 -- 172.21.15.72:0/3425436937 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa774149390 con 0x7fa7740c4400 2023-07-27T20:34:10.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.104+0000 7fa779dff700 1 -- 172.21.15.72:0/3425436937 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7740aa0c0 con 0x7fa7740c4400 2023-07-27T20:34:10.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.105+0000 7fa779dff700 1 -- 172.21.15.72:0/3425436937 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa774149830 con 0x7fa7740c4400 2023-07-27T20:34:10.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.106+0000 7fa770ff9700 1 -- 172.21.15.72:0/3425436937 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa75c00bcf0 con 0x7fa7740c4400 2023-07-27T20:34:10.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.106+0000 7fa770ff9700 1 --2- 172.21.15.72:0/3425436937 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa75406ace0 0x7fa75406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:10.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.107+0000 7fa770ff9700 1 -- 172.21.15.72:0/3425436937 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7fa75c08b210 con 0x7fa7740c4400 2023-07-27T20:34:10.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.107+0000 7fa7737fe700 1 --2- 172.21.15.72:0/3425436937 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa75406ace0 0x7fa75406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:10.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.107+0000 7fa7737fe700 1 --2- 172.21.15.72:0/3425436937 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa75406ace0 0x7fa75406d1a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa77414b230 tx=0x7fa764009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:10.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.111+0000 7fa770ff9700 1 -- 172.21.15.72:0/3425436937 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa75c055e80 con 0x7fa7740c4400 2023-07-27T20:34:10.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.316+0000 7fa779dff700 1 -- 172.21.15.72:0/3425436937 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa774074310 con 0x7fa7740c4400 2023-07-27T20:34:10.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.317+0000 7fa770ff9700 1 -- 172.21.15.72:0/3425436937 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+22308 (secure 0 0 0) 0x7fa75c0594a0 con 0x7fa7740c4400 2023-07-27T20:34:10.305 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:34:10.305 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":47,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:33:23.191066+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:32:58.242890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-27T20:32:59.032110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_metadata","create_time":"2023-07-27T20:33:20.125785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs2_data","create_time":"2023-07-27T20:33:20.647929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2c","mappings":[{"from":0,"to":4}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:34:10.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.320+0000 7fa779dff700 1 -- 172.21.15.72:0/3425436937 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa75406ace0 msgr2=0x7fa75406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:10.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.320+0000 7fa779dff700 1 --2- 172.21.15.72:0/3425436937 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa75406ace0 0x7fa75406d1a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa77414b230 tx=0x7fa764009040 comp rx=0 tx=0).stop 2023-07-27T20:34:10.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.320+0000 7fa779dff700 1 -- 172.21.15.72:0/3425436937 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7740c4400 msgr2=0x7fa7740a9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:10.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.320+0000 7fa779dff700 1 --2- 172.21.15.72:0/3425436937 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7740c4400 0x7fa7740a9b80 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fa77408b450 tx=0x7fa75c004750 comp rx=0 tx=0).stop 2023-07-27T20:34:10.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.320+0000 7fa779dff700 1 -- 172.21.15.72:0/3425436937 shutdown_connections 2023-07-27T20:34:10.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.320+0000 7fa779dff700 1 --2- 172.21.15.72:0/3425436937 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa75406ace0 0x7fa75406d1a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:10.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.320+0000 7fa779dff700 1 --2- 172.21.15.72:0/3425436937 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa7741549f0 0x7fa774149bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:10.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.320+0000 7fa779dff700 1 --2- 172.21.15.72:0/3425436937 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa77406b150 0x7fa7740ac860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:10.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.320+0000 7fa779dff700 1 --2- 172.21.15.72:0/3425436937 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7740c4400 0x7fa7740a9b80 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:10.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.320+0000 7fa779dff700 1 -- 172.21.15.72:0/3425436937 >> 172.21.15.72:0/3425436937 conn(0x7fa7740ab300 msgr2=0x7fa77414f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:10.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.320+0000 7fa779dff700 1 -- 172.21.15.72:0/3425436937 shutdown_connections 2023-07-27T20:34:10.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.320+0000 7fa779dff700 1 -- 172.21.15.72:0/3425436937 wait complete. 2023-07-27T20:34:10.326 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-27T20:34:10.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.534+0000 7f76643ff700 1 Processor -- start 2023-07-27T20:34:10.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.534+0000 7f76643ff700 1 -- start start 2023-07-27T20:34:10.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.536+0000 7f76643ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f765c0c7710 0x7f765c1514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:10.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.536+0000 7f76643ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f765c155100 con 0x7f765c0c4400 2023-07-27T20:34:10.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.536+0000 7f76643ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f765c0c7b20 con 0x7f765c06b150 2023-07-27T20:34:10.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.536+0000 7f76643ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f765c1545d0 con 0x7f765c0c7710 2023-07-27T20:34:10.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.536+0000 7f766219b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f765c0c4400 0x7f765c0c4cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51312/0 (socket says 172.21.15.72:51312) 2023-07-27T20:34:10.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.536+0000 7f766219b700 1 -- 172.21.15.72:0/167533439 learned_addr learned my addr 172.21.15.72:0/167533439 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:10.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.536+0000 7f766299c700 1 --2- 172.21.15.72:0/167533439 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f765c0c7710 0x7f765c1514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:10.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.536+0000 7f7661199700 1 -- 172.21.15.72:0/167533439 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 711072287 0 0) 0x7f765c155100 con 0x7f765c0c4400 2023-07-27T20:34:10.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.536+0000 7f7661199700 1 -- 172.21.15.72:0/167533439 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76480035b0 con 0x7f765c0c4400 2023-07-27T20:34:10.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.536+0000 7f7661199700 1 -- 172.21.15.72:0/167533439 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2945784156 0 0) 0x7f765c0c7b20 con 0x7f765c06b150 2023-07-27T20:34:10.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.536+0000 7f7661199700 1 -- 172.21.15.72:0/167533439 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f765c155100 con 0x7f765c06b150 2023-07-27T20:34:10.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.537+0000 7f7661199700 1 -- 172.21.15.72:0/167533439 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1182885293 0 0) 0x7f76480035b0 con 0x7f765c0c4400 2023-07-27T20:34:10.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.537+0000 7f7661199700 1 -- 172.21.15.72:0/167533439 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f765c0c7710 msgr2=0x7f765c1514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:10.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.537+0000 7f7661199700 1 --2- 172.21.15.72:0/167533439 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f765c0c7710 0x7f765c1514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:10.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.537+0000 7f7661199700 1 -- 172.21.15.72:0/167533439 >> v1:172.21.15.173:6789/0 conn(0x7f765c06b150 legacy=0x7f765c1549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:10.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.537+0000 7f7661199700 1 -- 172.21.15.72:0/167533439 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f765c06b710 con 0x7f765c0c4400 2023-07-27T20:34:10.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.537+0000 7f7661199700 1 -- 172.21.15.72:0/167533439 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f7658001670 con 0x7f765c0c4400 2023-07-27T20:34:10.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.537+0000 7f7661199700 1 -- 172.21.15.72:0/167533439 >> v1:172.21.15.72:6789/0 conn(0x7f765c0c4400 legacy=0x7f765c0c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:10.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.537+0000 7f7661199700 1 --2- 172.21.15.72:0/167533439 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7648003bc0 0x7f7648003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:10.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.537+0000 7f7661199700 1 --2- 172.21.15.72:0/167533439 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7648004850 0x7f7648004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:10.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.537+0000 7f7661199700 1 --2- 172.21.15.72:0/167533439 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7648005210 0x7f764800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:10.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.537+0000 7f7661199700 1 -- 172.21.15.72:0/167533439 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765c1545d0 con 0x7f7648004850 2023-07-27T20:34:10.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.537+0000 7f7661199700 1 -- 172.21.15.72:0/167533439 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764800c140 con 0x7f7648005210 2023-07-27T20:34:10.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.537+0000 7f7661199700 1 -- 172.21.15.72:0/167533439 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764800c300 con 0x7f7648003bc0 2023-07-27T20:34:10.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.537+0000 7f766199a700 1 --2- 172.21.15.72:0/167533439 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7648004850 0x7f7648004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:10.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.537+0000 7f766219b700 1 --2- 172.21.15.72:0/167533439 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7648003bc0 0x7f7648003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:10.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.537+0000 7f766299c700 1 --2- 172.21.15.72:0/167533439 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7648005210 0x7f764800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:10.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.537+0000 7f766199a700 1 -- 172.21.15.72:0/167533439 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7648003bc0 msgr2=0x7f7648003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:10.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.537+0000 7f766199a700 1 --2- 172.21.15.72:0/167533439 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7648003bc0 0x7f7648003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:10.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.537+0000 7f766199a700 1 -- 172.21.15.72:0/167533439 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7648005210 msgr2=0x7f764800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:10.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.537+0000 7f766199a700 1 --2- 172.21.15.72:0/167533439 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7648005210 0x7f764800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:10.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.537+0000 7f766199a700 1 -- 172.21.15.72:0/167533439 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76480035b0 con 0x7f7648004850 2023-07-27T20:34:10.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.538+0000 7f766199a700 1 --2- 172.21.15.72:0/167533439 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7648004850 0x7f7648004cd0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f764c001940 tx=0x7f7648005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64021657fa0b2c44 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:10.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.538+0000 7f7661199700 1 -- 172.21.15.72:0/167533439 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c001430 con 0x7f7648004850 2023-07-27T20:34:10.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.538+0000 7f7661199700 1 -- 172.21.15.72:0/167533439 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764c001d70 con 0x7f7648004850 2023-07-27T20:34:10.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.538+0000 7f7661199700 1 -- 172.21.15.72:0/167533439 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c005510 con 0x7f7648004850 2023-07-27T20:34:10.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.538+0000 7f76643ff700 1 -- 172.21.15.72:0/167533439 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7648004850 msgr2=0x7f7648004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:10.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.538+0000 7f76643ff700 1 --2- 172.21.15.72:0/167533439 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7648004850 0x7f7648004cd0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f764c001940 tx=0x7f7648005880 comp rx=0 tx=0).stop 2023-07-27T20:34:10.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.538+0000 7f766299c700 1 -- 172.21.15.72:0/167533439 reap_dead start 2023-07-27T20:34:10.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.539+0000 7f76643ff700 1 -- 172.21.15.72:0/167533439 shutdown_connections 2023-07-27T20:34:10.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.539+0000 7f76643ff700 1 -- 172.21.15.72:0/167533439 >> 172.21.15.72:0/167533439 conn(0x7f765c0ab300 msgr2=0x7f765c0ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:10.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.539+0000 7f76643ff700 1 -- 172.21.15.72:0/167533439 shutdown_connections 2023-07-27T20:34:10.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.539+0000 7f76643ff700 1 -- 172.21.15.72:0/167533439 wait complete. 2023-07-27T20:34:10.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.540+0000 7f76643ff700 1 Processor -- start 2023-07-27T20:34:10.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.540+0000 7f76643ff700 1 -- start start 2023-07-27T20:34:10.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.541+0000 7f76643ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7648004850 0x7f765c0aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:10.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.541+0000 7f76643ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f765c0c0d70 0x7f765c0c11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:10.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.541+0000 7f76643ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f765c1ec920 0x7f765c1ecdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:10.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.541+0000 7f76643ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765c14d330 con 0x7f765c1ec920 2023-07-27T20:34:10.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.541+0000 7f76643ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765c0c08e0 con 0x7f7648004850 2023-07-27T20:34:10.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.541+0000 7f76643ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f765c14ba40 con 0x7f765c0c0d70 2023-07-27T20:34:10.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.541+0000 7f766299c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f765c1ec920 0x7f765c1ecdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:10.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.542+0000 7f766299c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f765c1ec920 0x7f765c1ecdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46490/0 (socket says 172.21.15.72:46490) 2023-07-27T20:34:10.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.542+0000 7f766299c700 1 -- 172.21.15.72:0/807476058 learned_addr learned my addr 172.21.15.72:0/807476058 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:10.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.542+0000 7f766219b700 1 --2- 172.21.15.72:0/807476058 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7648004850 0x7f765c0aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:10.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.542+0000 7f766299c700 1 -- 172.21.15.72:0/807476058 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f765c0c0d70 msgr2=0x7f765c0c11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:10.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.542+0000 7f766199a700 1 --2- 172.21.15.72:0/807476058 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f765c0c0d70 0x7f765c0c11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:10.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.542+0000 7f766299c700 1 --2- 172.21.15.72:0/807476058 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f765c0c0d70 0x7f765c0c11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:10.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.542+0000 7f766299c700 1 -- 172.21.15.72:0/807476058 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7648004850 msgr2=0x7f765c0aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:10.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.542+0000 7f766299c700 1 --2- 172.21.15.72:0/807476058 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7648004850 0x7f765c0aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:10.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.542+0000 7f766299c700 1 -- 172.21.15.72:0/807476058 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f765c14c1a0 con 0x7f765c1ec920 2023-07-27T20:34:10.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.542+0000 7f766219b700 1 --2- 172.21.15.72:0/807476058 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7648004850 0x7f765c0aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:10.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.542+0000 7f766199a700 1 --2- 172.21.15.72:0/807476058 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f765c0c0d70 0x7f765c0c11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:10.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.542+0000 7f766299c700 1 --2- 172.21.15.72:0/807476058 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f765c1ec920 0x7f765c1ecdb0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f765c0c3df0 tx=0x7f7654009990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:10.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.542+0000 7f7652ffd700 1 -- 172.21.15.72:0/807476058 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765400e040 con 0x7f765c1ec920 2023-07-27T20:34:10.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.542+0000 7f7652ffd700 1 -- 172.21.15.72:0/807476058 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765400f040 con 0x7f765c1ec920 2023-07-27T20:34:10.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.542+0000 7f76643ff700 1 -- 172.21.15.72:0/807476058 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f765c14c480 con 0x7f765c1ec920 2023-07-27T20:34:10.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.542+0000 7f7652ffd700 1 -- 172.21.15.72:0/807476058 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765400f9a0 con 0x7f765c1ec920 2023-07-27T20:34:10.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.543+0000 7f76643ff700 1 -- 172.21.15.72:0/807476058 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f765c14ca40 con 0x7f765c1ec920 2023-07-27T20:34:10.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.544+0000 7f76643ff700 1 -- 172.21.15.72:0/807476058 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f765c0c0a90 con 0x7f765c1ec920 2023-07-27T20:34:10.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.545+0000 7f7652ffd700 1 -- 172.21.15.72:0/807476058 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f765400fb00 con 0x7f765c1ec920 2023-07-27T20:34:10.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.546+0000 7f7652ffd700 1 --2- 172.21.15.72:0/807476058 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f764006ace0 0x7f764006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:10.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.546+0000 7f7652ffd700 1 -- 172.21.15.72:0/807476058 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7296+0+0 (secure 0 0 0) 0x7f7654089fb0 con 0x7f765c1ec920 2023-07-27T20:34:10.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.546+0000 7f766219b700 1 --2- 172.21.15.72:0/807476058 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f764006ace0 0x7f764006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:10.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.547+0000 7f766219b700 1 --2- 172.21.15.72:0/807476058 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f764006ace0 0x7f764006d1a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7658001200 tx=0x7f7658009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:10.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.550+0000 7f7652ffd700 1 -- 172.21.15.72:0/807476058 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f765c0c0a90 con 0x7f765c1ec920 2023-07-27T20:34:10.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.789+0000 7f76643ff700 1 -- 172.21.15.72:0/807476058 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f765c0c73e0 con 0x7f765c1ec920 2023-07-27T20:34:10.777 INFO:tasks.ceph.mon.a.smithi072.stderr:2023-07-27T20:34:10.789+0000 7f82f93f4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-27T20:34:10.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.795+0000 7f7652ffd700 1 -- 172.21.15.72:0/807476058 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7654058630 con 0x7f765c1ec920 2023-07-27T20:34:10.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.798+0000 7f76643ff700 1 -- 172.21.15.72:0/807476058 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f764006ace0 msgr2=0x7f764006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:10.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.798+0000 7f76643ff700 1 --2- 172.21.15.72:0/807476058 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f764006ace0 0x7f764006d1a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7658001200 tx=0x7f7658009040 comp rx=0 tx=0).stop 2023-07-27T20:34:10.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.798+0000 7f76643ff700 1 -- 172.21.15.72:0/807476058 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f765c1ec920 msgr2=0x7f765c1ecdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:10.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.798+0000 7f76643ff700 1 --2- 172.21.15.72:0/807476058 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f765c1ec920 0x7f765c1ecdb0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f765c0c3df0 tx=0x7f7654009990 comp rx=0 tx=0).stop 2023-07-27T20:34:10.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.798+0000 7f76643ff700 1 -- 172.21.15.72:0/807476058 shutdown_connections 2023-07-27T20:34:10.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.798+0000 7f76643ff700 1 --2- 172.21.15.72:0/807476058 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f765c1ec920 0x7f765c1ecdb0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:10.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.798+0000 7f76643ff700 1 --2- 172.21.15.72:0/807476058 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7648004850 0x7f765c0aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:10.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.798+0000 7f76643ff700 1 --2- 172.21.15.72:0/807476058 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f764006ace0 0x7f764006d1a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:10.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.798+0000 7f76643ff700 1 --2- 172.21.15.72:0/807476058 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f765c0c0d70 0x7f765c0c11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:10.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.798+0000 7f76643ff700 1 -- 172.21.15.72:0/807476058 >> 172.21.15.72:0/807476058 conn(0x7f765c0ab300 msgr2=0x7f765c150920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:10.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.798+0000 7f76643ff700 1 -- 172.21.15.72:0/807476058 shutdown_connections 2023-07-27T20:34:10.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:10.798+0000 7f76643ff700 1 -- 172.21.15.72:0/807476058 wait complete. 2023-07-27T20:34:10.790 INFO:teuthology.orchestra.run.smithi072.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-27T20:34:10.790 INFO:tasks.ceph.mds.c.smithi072.stderr: -2786> 2023-07-27T20:33:03.475+0000 7fd699df1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-27T20:34:10.806 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-27T20:34:10.839 INFO:tasks.ceph.mds.c.smithi072.stdout:starting mds.c at 2023-07-27T20:34:11.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.018+0000 7f4745fff700 1 Processor -- start 2023-07-27T20:34:11.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.018+0000 7f4745fff700 1 -- start start 2023-07-27T20:34:11.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.019+0000 7f4745fff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f47400c0f80 0x7f4740153a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:11.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.019+0000 7f4745fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47400baf20 con 0x7f474014db30 2023-07-27T20:34:11.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.019+0000 7f4745fff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f474014df10 con 0x7f4740153f80 2023-07-27T20:34:11.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.019+0000 7f4745fff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47400bbd40 con 0x7f47400c0f80 2023-07-27T20:34:11.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.020+0000 7f473f7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f474014db30 0x7f47400bb2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51322/0 (socket says 172.21.15.72:51322) 2023-07-27T20:34:11.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.020+0000 7f473f7fe700 1 -- 172.21.15.72:0/1138319517 learned_addr learned my addr 172.21.15.72:0/1138319517 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:11.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.020+0000 7f473effd700 1 --2- 172.21.15.72:0/1138319517 >> v2:172.21.15.173:3300/0 conn(0x7f47400c0f80 0x7f4740153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:11.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.020+0000 7f473e7fc700 1 -- 172.21.15.72:0/1138319517 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 899529308 0 0) 0x7f47400baf20 con 0x7f474014db30 2023-07-27T20:34:11.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.020+0000 7f473e7fc700 1 -- 172.21.15.72:0/1138319517 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47280035b0 con 0x7f474014db30 2023-07-27T20:34:11.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.020+0000 7f473e7fc700 1 -- 172.21.15.72:0/1138319517 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2368290145 0 0) 0x7f474014df10 con 0x7f4740153f80 2023-07-27T20:34:11.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.020+0000 7f473e7fc700 1 -- 172.21.15.72:0/1138319517 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47400baf20 con 0x7f4740153f80 2023-07-27T20:34:11.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.020+0000 7f473effd700 1 -- 172.21.15.72:0/1138319517 >> v1:172.21.15.173:6789/0 conn(0x7f4740153f80 legacy=0x7f474015ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:11.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.020+0000 7f473effd700 1 -- 172.21.15.72:0/1138319517 >> v1:172.21.15.72:6789/0 conn(0x7f474014db30 legacy=0x7f47400bb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:11.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.020+0000 7f473e7fc700 1 -- 172.21.15.72:0/1138319517 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4096636927 0 0) 0x7f47280035b0 con 0x7f474014db30 2023-07-27T20:34:11.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.020+0000 7f473effd700 1 -- 172.21.15.72:0/1138319517 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47400ba440 con 0x7f47400c0f80 2023-07-27T20:34:11.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.021+0000 7f473effd700 1 --2- 172.21.15.72:0/1138319517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47400c0f80 0x7f4740153a40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4734009840 tx=0x7f4734009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42f90ad2cc8823a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:11.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.021+0000 7f473e7fc700 1 -- 172.21.15.72:0/1138319517 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4730001670 con 0x7f47400c0f80 2023-07-27T20:34:11.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.021+0000 7f473e7fc700 1 -- 172.21.15.72:0/1138319517 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4734004030 con 0x7f47400c0f80 2023-07-27T20:34:11.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.021+0000 7f473e7fc700 1 -- 172.21.15.72:0/1138319517 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47340043c0 con 0x7f47400c0f80 2023-07-27T20:34:11.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.021+0000 7f4745fff700 1 -- 172.21.15.72:0/1138319517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47400c0f80 msgr2=0x7f4740153a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:11.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.021+0000 7f4745fff700 1 --2- 172.21.15.72:0/1138319517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47400c0f80 0x7f4740153a40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4734009840 tx=0x7f4734009b50 comp rx=0 tx=0).stop 2023-07-27T20:34:11.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.021+0000 7f4745fff700 1 -- 172.21.15.72:0/1138319517 shutdown_connections 2023-07-27T20:34:11.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.021+0000 7f4745fff700 1 --2- 172.21.15.72:0/1138319517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47400c0f80 0x7f4740153a40 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:11.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.021+0000 7f4745fff700 1 -- 172.21.15.72:0/1138319517 >> 172.21.15.72:0/1138319517 conn(0x7f474006a190 msgr2=0x7f474006a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:11.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.022+0000 7f4745fff700 1 -- 172.21.15.72:0/1138319517 shutdown_connections 2023-07-27T20:34:11.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.022+0000 7f4745fff700 1 -- 172.21.15.72:0/1138319517 wait complete. 2023-07-27T20:34:11.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.023+0000 7f4745fff700 1 Processor -- start 2023-07-27T20:34:11.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.023+0000 7f4745fff700 1 -- start start 2023-07-27T20:34:11.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.024+0000 7f4745fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47400c0f80 0x7f47400c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:11.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.024+0000 7f4745fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f474014db30 0x7f47400c4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:11.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.024+0000 7f4745fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4740153f80 0x7f47401e53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:11.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.024+0000 7f4745fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4740149c50 con 0x7f4740153f80 2023-07-27T20:34:11.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.024+0000 7f4745fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47400aa3f0 con 0x7f47400c0f80 2023-07-27T20:34:11.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.024+0000 7f4745fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47400aaf50 con 0x7f474014db30 2023-07-27T20:34:11.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.024+0000 7f473ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4740153f80 0x7f47401e53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:11.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.024+0000 7f473ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4740153f80 0x7f47401e53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46516/0 (socket says 172.21.15.72:46516) 2023-07-27T20:34:11.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.024+0000 7f473ffff700 1 -- 172.21.15.72:0/3919598095 learned_addr learned my addr 172.21.15.72:0/3919598095 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:11.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.025+0000 7f473effd700 1 --2- 172.21.15.72:0/3919598095 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f474014db30 0x7f47400c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:11.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.025+0000 7f473f7fe700 1 --2- 172.21.15.72:0/3919598095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47400c0f80 0x7f47400c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:11.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.025+0000 7f473ffff700 1 -- 172.21.15.72:0/3919598095 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f474014db30 msgr2=0x7f47400c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:11.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.025+0000 7f473ffff700 1 --2- 172.21.15.72:0/3919598095 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f474014db30 0x7f47400c4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:11.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.025+0000 7f473ffff700 1 -- 172.21.15.72:0/3919598095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47400c0f80 msgr2=0x7f47400c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:11.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.025+0000 7f473ffff700 1 --2- 172.21.15.72:0/3919598095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47400c0f80 0x7f47400c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:11.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.025+0000 7f473ffff700 1 -- 172.21.15.72:0/3919598095 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47340094a0 con 0x7f4740153f80 2023-07-27T20:34:11.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.025+0000 7f473ffff700 1 --2- 172.21.15.72:0/3919598095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4740153f80 0x7f47401e53c0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f473800cbc0 tx=0x7f473800cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:11.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.025+0000 7f4727fff700 1 -- 172.21.15.72:0/3919598095 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4738003c00 con 0x7f4740153f80 2023-07-27T20:34:11.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.025+0000 7f4727fff700 1 -- 172.21.15.72:0/3919598095 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4738003d60 con 0x7f4740153f80 2023-07-27T20:34:11.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.025+0000 7f4727fff700 1 -- 172.21.15.72:0/3919598095 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473800abb0 con 0x7f4740153f80 2023-07-27T20:34:11.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.025+0000 7f4745fff700 1 -- 172.21.15.72:0/3919598095 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47400aa620 con 0x7f4740153f80 2023-07-27T20:34:11.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.025+0000 7f4745fff700 1 -- 172.21.15.72:0/3919598095 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47400aabe0 con 0x7f4740153f80 2023-07-27T20:34:11.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.026+0000 7f4745fff700 1 -- 172.21.15.72:0/3919598095 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47400ab0c0 con 0x7f4740153f80 2023-07-27T20:34:11.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.027+0000 7f4727fff700 1 -- 172.21.15.72:0/3919598095 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f473800ad10 con 0x7f4740153f80 2023-07-27T20:34:11.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.028+0000 7f4727fff700 1 --2- 172.21.15.72:0/3919598095 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f472c06ace0 0x7f472c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:11.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.028+0000 7f4727fff700 1 -- 172.21.15.72:0/3919598095 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 7382+0+0 (secure 0 0 0) 0x7f4738089bb0 con 0x7f4740153f80 2023-07-27T20:34:11.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.029+0000 7f473f7fe700 1 --2- 172.21.15.72:0/3919598095 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f472c06ace0 0x7f472c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:11.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.029+0000 7f473f7fe700 1 --2- 172.21.15.72:0/3919598095 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f472c06ace0 0x7f472c06d1a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f47300011e0 tx=0x7f4730001490 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:11.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.032+0000 7f4727fff700 1 -- 172.21.15.72:0/3919598095 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4738054690 con 0x7f4740153f80 2023-07-27T20:34:11.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.275+0000 7f4745fff700 1 -- 172.21.15.72:0/3919598095 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f47400ba6f0 con 0x7f4740153f80 2023-07-27T20:34:11.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.795+0000 7f4727fff700 1 -- 172.21.15.72:0/3919598095 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4738057cb0 con 0x7f4740153f80 2023-07-27T20:34:11.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.798+0000 7f4745fff700 1 -- 172.21.15.72:0/3919598095 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f472c06ace0 msgr2=0x7f472c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:11.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.798+0000 7f4745fff700 1 --2- 172.21.15.72:0/3919598095 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f472c06ace0 0x7f472c06d1a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f47300011e0 tx=0x7f4730001490 comp rx=0 tx=0).stop 2023-07-27T20:34:11.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.798+0000 7f4745fff700 1 -- 172.21.15.72:0/3919598095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4740153f80 msgr2=0x7f47401e53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:11.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.798+0000 7f4745fff700 1 --2- 172.21.15.72:0/3919598095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4740153f80 0x7f47401e53c0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f473800cbc0 tx=0x7f473800cf80 comp rx=0 tx=0).stop 2023-07-27T20:34:11.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.798+0000 7f4745fff700 1 -- 172.21.15.72:0/3919598095 shutdown_connections 2023-07-27T20:34:11.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.798+0000 7f4745fff700 1 --2- 172.21.15.72:0/3919598095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4740153f80 0x7f47401e53c0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:11.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.798+0000 7f4745fff700 1 --2- 172.21.15.72:0/3919598095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47400c0f80 0x7f47400c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:11.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.798+0000 7f4745fff700 1 --2- 172.21.15.72:0/3919598095 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f472c06ace0 0x7f472c06d1a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:11.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.798+0000 7f4745fff700 1 --2- 172.21.15.72:0/3919598095 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f474014db30 0x7f47400c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:11.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.798+0000 7f4745fff700 1 -- 172.21.15.72:0/3919598095 >> 172.21.15.72:0/3919598095 conn(0x7f474006a190 msgr2=0x7f474014c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:11.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.799+0000 7f4745fff700 1 -- 172.21.15.72:0/3919598095 shutdown_connections 2023-07-27T20:34:11.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:11.799+0000 7f4745fff700 1 -- 172.21.15.72:0/3919598095 wait complete. 2023-07-27T20:34:11.805 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-27T20:34:12.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.058+0000 7f3ffd7ff700 1 Processor -- start 2023-07-27T20:34:12.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.058+0000 7f3ffd7ff700 1 -- start start 2023-07-27T20:34:12.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.059+0000 7f3ffd7ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ff8151600 0x7f3ff80c5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:12.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.059+0000 7f3ffd7ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3ff80c4180 0x7f3ff80c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:12.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.059+0000 7f3ffd7ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ff80c59f0 con 0x7f3ff80c7700 2023-07-27T20:34:12.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.059+0000 7f3ffd7ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ff8155090 con 0x7f3ff80c4180 2023-07-27T20:34:12.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.059+0000 7f3ffd7ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff80c7b80 con 0x7f3ff8151600 2023-07-27T20:34:12.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.060+0000 7f3ff67fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3ff80c7700 0x7f3ff8154980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51330/0 (socket says 172.21.15.72:51330) 2023-07-27T20:34:12.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.060+0000 7f3ff67fc700 1 -- 172.21.15.72:0/1086395018 learned_addr learned my addr 172.21.15.72:0/1086395018 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:12.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.060+0000 7f3ff77fe700 1 --2- 172.21.15.72:0/1086395018 >> v2:172.21.15.173:3300/0 conn(0x7f3ff80c4180 0x7f3ff80c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:12.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.060+0000 7f3ff6ffd700 1 --2- 172.21.15.72:0/1086395018 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ff8151600 0x7f3ff80c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:12.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.060+0000 7f3ff5ffb700 1 -- 172.21.15.72:0/1086395018 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3010817303 0 0) 0x7f3ff80c59f0 con 0x7f3ff80c7700 2023-07-27T20:34:12.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.060+0000 7f3ff5ffb700 1 -- 172.21.15.72:0/1086395018 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fe00035b0 con 0x7f3ff80c7700 2023-07-27T20:34:12.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.060+0000 7f3ff5ffb700 1 -- 172.21.15.72:0/1086395018 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4090870173 0 0) 0x7f3fe00035b0 con 0x7f3ff80c7700 2023-07-27T20:34:12.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.060+0000 7f3ff77fe700 1 -- 172.21.15.72:0/1086395018 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ff8151600 msgr2=0x7f3ff80c5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:12.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.060+0000 7f3ff77fe700 1 --2- 172.21.15.72:0/1086395018 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ff8151600 0x7f3ff80c5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:12.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.060+0000 7f3ff77fe700 1 -- 172.21.15.72:0/1086395018 >> v1:172.21.15.72:6789/0 conn(0x7f3ff80c7700 legacy=0x7f3ff8154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:12.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.060+0000 7f3ff77fe700 1 -- 172.21.15.72:0/1086395018 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff80c5cd0 con 0x7f3ff80c4180 2023-07-27T20:34:12.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.061+0000 7f3ff77fe700 1 --2- 172.21.15.72:0/1086395018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ff80c4180 0x7f3ff80c45f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0009d90 tx=0x7f3ff000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eba7193ba03a818e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:12.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.061+0000 7f3ff5ffb700 1 -- 172.21.15.72:0/1086395018 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff000e070 con 0x7f3ff80c4180 2023-07-27T20:34:12.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.061+0000 7f3ff5ffb700 1 -- 172.21.15.72:0/1086395018 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff0003a20 con 0x7f3ff80c4180 2023-07-27T20:34:12.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.061+0000 7f3ff5ffb700 1 -- 172.21.15.72:0/1086395018 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fec001670 con 0x7f3ff80c4180 2023-07-27T20:34:12.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.062+0000 7f3ffd7ff700 1 -- 172.21.15.72:0/1086395018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ff80c4180 msgr2=0x7f3ff80c45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:12.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.062+0000 7f3ffd7ff700 1 --2- 172.21.15.72:0/1086395018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ff80c4180 0x7f3ff80c45f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0009d90 tx=0x7f3ff000b330 comp rx=0 tx=0).stop 2023-07-27T20:34:12.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.062+0000 7f3ffd7ff700 1 -- 172.21.15.72:0/1086395018 shutdown_connections 2023-07-27T20:34:12.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.062+0000 7f3ffd7ff700 1 --2- 172.21.15.72:0/1086395018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ff80c4180 0x7f3ff80c45f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:12.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.062+0000 7f3ffd7ff700 1 --2- 172.21.15.72:0/1086395018 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ff8151600 0x7f3ff80c5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:12.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.062+0000 7f3ffd7ff700 1 -- 172.21.15.72:0/1086395018 >> 172.21.15.72:0/1086395018 conn(0x7f3ff80c9800 msgr2=0x7f3ff80c9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:12.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.062+0000 7f3ffd7ff700 1 -- 172.21.15.72:0/1086395018 shutdown_connections 2023-07-27T20:34:12.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.062+0000 7f3ffd7ff700 1 -- 172.21.15.72:0/1086395018 wait complete. 2023-07-27T20:34:12.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.063+0000 7f3ffd7ff700 1 Processor -- start 2023-07-27T20:34:12.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.064+0000 7f3ffd7ff700 1 -- start start 2023-07-27T20:34:12.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.064+0000 7f3ffd7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ff80c4180 0x7f3ff814cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:12.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.064+0000 7f3ffd7ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ff80c7700 0x7f3ff8146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:12.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.064+0000 7f3ffd7ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ff8151600 0x7f3ff8147500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:12.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.064+0000 7f3ffd7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff80c3150 con 0x7f3ff80c4180 2023-07-27T20:34:12.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.064+0000 7f3ffd7ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff80c36b0 con 0x7f3ff8151600 2023-07-27T20:34:12.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.064+0000 7f3ffd7ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff80c3360 con 0x7f3ff80c7700 2023-07-27T20:34:12.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.065+0000 7f3ff6ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ff80c4180 0x7f3ff814cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:12.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.065+0000 7f3ff6ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ff80c4180 0x7f3ff814cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46532/0 (socket says 172.21.15.72:46532) 2023-07-27T20:34:12.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.065+0000 7f3ff6ffd700 1 -- 172.21.15.72:0/1828289424 learned_addr learned my addr 172.21.15.72:0/1828289424 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:12.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.065+0000 7f3ff67fc700 1 --2- 172.21.15.72:0/1828289424 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ff80c7700 0x7f3ff8146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:12.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.065+0000 7f3ff77fe700 1 --2- 172.21.15.72:0/1828289424 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ff8151600 0x7f3ff8147500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:12.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.065+0000 7f3ff6ffd700 1 -- 172.21.15.72:0/1828289424 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ff80c7700 msgr2=0x7f3ff8146fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:12.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.065+0000 7f3ff6ffd700 1 --2- 172.21.15.72:0/1828289424 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ff80c7700 0x7f3ff8146fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:12.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.065+0000 7f3ff6ffd700 1 -- 172.21.15.72:0/1828289424 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ff8151600 msgr2=0x7f3ff8147500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:12.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.065+0000 7f3ff6ffd700 1 --2- 172.21.15.72:0/1828289424 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ff8151600 0x7f3ff8147500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:12.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.065+0000 7f3ff6ffd700 1 -- 172.21.15.72:0/1828289424 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff0009a70 con 0x7f3ff80c4180 2023-07-27T20:34:12.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.065+0000 7f3ff77fe700 1 --2- 172.21.15.72:0/1828289424 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ff8151600 0x7f3ff8147500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:12.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.065+0000 7f3ff67fc700 1 --2- 172.21.15.72:0/1828289424 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ff80c7700 0x7f3ff8146fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:12.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.065+0000 7f3ff6ffd700 1 --2- 172.21.15.72:0/1828289424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ff80c4180 0x7f3ff814cd90 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f3fe800e870 tx=0x7f3fe800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:12.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.065+0000 7f3fdf7fe700 1 -- 172.21.15.72:0/1828289424 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8009590 con 0x7f3ff80c4180 2023-07-27T20:34:12.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.065+0000 7f3fdf7fe700 1 -- 172.21.15.72:0/1828289424 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe800ee70 con 0x7f3ff80c4180 2023-07-27T20:34:12.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.065+0000 7f3ffd7ff700 1 -- 172.21.15.72:0/1828289424 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ff81ed300 con 0x7f3ff80c4180 2023-07-27T20:34:12.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.066+0000 7f3fdf7fe700 1 -- 172.21.15.72:0/1828289424 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe800ca50 con 0x7f3ff80c4180 2023-07-27T20:34:12.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.066+0000 7f3ffd7ff700 1 -- 172.21.15.72:0/1828289424 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ff814d2d0 con 0x7f3ff80c4180 2023-07-27T20:34:12.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.067+0000 7f3ffd7ff700 1 -- 172.21.15.72:0/1828289424 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ff804e470 con 0x7f3ff80c4180 2023-07-27T20:34:12.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.068+0000 7f3fdf7fe700 1 -- 172.21.15.72:0/1828289424 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3fe800cbb0 con 0x7f3ff80c4180 2023-07-27T20:34:12.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.069+0000 7f3fdf7fe700 1 --2- 172.21.15.72:0/1828289424 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3fe406ace0 0x7f3fe406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:12.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.069+0000 7f3fdf7fe700 1 -- 172.21.15.72:0/1828289424 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 7382+0+0 (secure 0 0 0) 0x7f3fe8089990 con 0x7f3ff80c4180 2023-07-27T20:34:12.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.069+0000 7f3ff67fc700 1 --2- 172.21.15.72:0/1828289424 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3fe406ace0 0x7f3fe406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:12.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.070+0000 7f3ff67fc700 1 --2- 172.21.15.72:0/1828289424 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3fe406ace0 0x7f3fe406d1a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3ff80af8f0 tx=0x7f3fec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:12.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.073+0000 7f3fdf7fe700 1 -- 172.21.15.72:0/1828289424 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3fe8057f90 con 0x7f3ff80c4180 2023-07-27T20:34:12.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:12.271+0000 7f3ffd7ff700 1 -- 172.21.15.72:0/1828289424 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3ff80c34d0 con 0x7f3ff80c4180 2023-07-27T20:34:13.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.163+0000 7f3fdf7fe700 1 -- 172.21.15.72:0/1828289424 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v49) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3fe8021070 con 0x7f3ff80c4180 2023-07-27T20:34:13.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.168+0000 7f3ffd7ff700 1 -- 172.21.15.72:0/1828289424 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3fe406ace0 msgr2=0x7f3fe406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:13.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.168+0000 7f3ffd7ff700 1 --2- 172.21.15.72:0/1828289424 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3fe406ace0 0x7f3fe406d1a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3ff80af8f0 tx=0x7f3fec009040 comp rx=0 tx=0).stop 2023-07-27T20:34:13.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.168+0000 7f3ffd7ff700 1 -- 172.21.15.72:0/1828289424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ff80c4180 msgr2=0x7f3ff814cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:13.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.168+0000 7f3ffd7ff700 1 --2- 172.21.15.72:0/1828289424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ff80c4180 0x7f3ff814cd90 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f3fe800e870 tx=0x7f3fe800ec30 comp rx=0 tx=0).stop 2023-07-27T20:34:13.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.168+0000 7f3ffd7ff700 1 -- 172.21.15.72:0/1828289424 shutdown_connections 2023-07-27T20:34:13.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.168+0000 7f3ffd7ff700 1 --2- 172.21.15.72:0/1828289424 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ff8151600 0x7f3ff8147500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:13.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.168+0000 7f3ffd7ff700 1 --2- 172.21.15.72:0/1828289424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ff80c4180 0x7f3ff814cd90 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:13.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.168+0000 7f3ffd7ff700 1 --2- 172.21.15.72:0/1828289424 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3fe406ace0 0x7f3fe406d1a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:13.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.168+0000 7f3ffd7ff700 1 --2- 172.21.15.72:0/1828289424 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ff80c7700 0x7f3ff8146fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:13.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.168+0000 7f3ffd7ff700 1 -- 172.21.15.72:0/1828289424 >> 172.21.15.72:0/1828289424 conn(0x7f3ff80c9800 msgr2=0x7f3ff8154880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:13.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.168+0000 7f3ffd7ff700 1 -- 172.21.15.72:0/1828289424 shutdown_connections 2023-07-27T20:34:13.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.169+0000 7f3ffd7ff700 1 -- 172.21.15.72:0/1828289424 wait complete. 2023-07-27T20:34:13.158 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' removed 2023-07-27T20:34:13.178 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-27T20:34:13.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.394+0000 7ff8371ff700 1 Processor -- start 2023-07-27T20:34:13.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.394+0000 7ff8371ff700 1 -- start start 2023-07-27T20:34:13.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.395+0000 7ff8371ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff830151600 0x7ff8300c5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:13.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.395+0000 7ff8371ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8300c7700 0x7ff830154980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:13.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.395+0000 7ff8371ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8300c59f0 con 0x7ff8300c4180 2023-07-27T20:34:13.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.395+0000 7ff8371ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8300c7b60 con 0x7ff830151600 2023-07-27T20:34:13.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.395+0000 7ff8371ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8300c5cd0 con 0x7ff8300c7700 2023-07-27T20:34:13.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.396+0000 7ff834f9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff830151600 0x7ff8300c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:13.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.396+0000 7ff834f9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff830151600 0x7ff8300c5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46534/0 (socket says 172.21.15.72:46534) 2023-07-27T20:34:13.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.396+0000 7ff834f9b700 1 -- 172.21.15.72:0/19850897 learned_addr learned my addr 172.21.15.72:0/19850897 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:13.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.396+0000 7ff83579c700 1 --1- 172.21.15.72:0/19850897 >> v1:172.21.15.72:6789/0 conn(0x7ff8300c4180 0x7ff8300c45f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51346/0 (socket says 172.21.15.72:51346) 2023-07-27T20:34:13.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.396+0000 7ff82ffff700 1 --2- 172.21.15.72:0/19850897 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8300c7700 0x7ff830154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:13.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.396+0000 7ff834f9b700 1 -- 172.21.15.72:0/19850897 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8300c7700 msgr2=0x7ff830154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:13.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.396+0000 7ff834f9b700 1 --2- 172.21.15.72:0/19850897 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8300c7700 0x7ff830154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:13.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.396+0000 7ff834f9b700 1 -- 172.21.15.72:0/19850897 >> v1:172.21.15.72:6789/0 conn(0x7ff8300c4180 legacy=0x7ff8300c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:13.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.396+0000 7ff82f7fe700 1 -- 172.21.15.72:0/19850897 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 321275568 0 0) 0x7ff8300c59f0 con 0x7ff8300c4180 2023-07-27T20:34:13.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.396+0000 7ff834f9b700 1 -- 172.21.15.72:0/19850897 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff830154180 con 0x7ff830151600 2023-07-27T20:34:13.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.396+0000 7ff82ffff700 1 --2- 172.21.15.72:0/19850897 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8300c7700 0x7ff830154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:13.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.396+0000 7ff834f9b700 1 --2- 172.21.15.72:0/19850897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff830151600 0x7ff8300c5410 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff8240098f0 tx=0x7ff824009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9589f376d1b3e72 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:13.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.397+0000 7ff82f7fe700 1 -- 172.21.15.72:0/19850897 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82400b8a0 con 0x7ff830151600 2023-07-27T20:34:13.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.397+0000 7ff82f7fe700 1 -- 172.21.15.72:0/19850897 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82400ba00 con 0x7ff830151600 2023-07-27T20:34:13.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.397+0000 7ff82f7fe700 1 -- 172.21.15.72:0/19850897 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82400bd90 con 0x7ff830151600 2023-07-27T20:34:13.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.397+0000 7ff8371ff700 1 -- 172.21.15.72:0/19850897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff830151600 msgr2=0x7ff8300c5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:13.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.397+0000 7ff8371ff700 1 --2- 172.21.15.72:0/19850897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff830151600 0x7ff8300c5410 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff8240098f0 tx=0x7ff824009c00 comp rx=0 tx=0).stop 2023-07-27T20:34:13.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.397+0000 7ff8371ff700 1 -- 172.21.15.72:0/19850897 shutdown_connections 2023-07-27T20:34:13.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.397+0000 7ff8371ff700 1 --2- 172.21.15.72:0/19850897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff830151600 0x7ff8300c5410 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:13.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.397+0000 7ff8371ff700 1 --2- 172.21.15.72:0/19850897 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8300c7700 0x7ff830154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:13.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.397+0000 7ff8371ff700 1 -- 172.21.15.72:0/19850897 >> 172.21.15.72:0/19850897 conn(0x7ff8300c9800 msgr2=0x7ff8300c9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:13.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.397+0000 7ff8371ff700 1 -- 172.21.15.72:0/19850897 shutdown_connections 2023-07-27T20:34:13.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.397+0000 7ff8371ff700 1 -- 172.21.15.72:0/19850897 wait complete. 2023-07-27T20:34:13.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.399+0000 7ff8371ff700 1 Processor -- start 2023-07-27T20:34:13.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.399+0000 7ff8371ff700 1 -- start start 2023-07-27T20:34:13.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.400+0000 7ff8371ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8300c4180 0x7ff83014a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:13.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.400+0000 7ff8371ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8300c7700 0x7ff830157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:13.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.400+0000 7ff8371ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff830151600 0x7ff830157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:13.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.400+0000 7ff8371ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff830156200 con 0x7ff830151600 2023-07-27T20:34:13.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.400+0000 7ff8371ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8301e9ad0 con 0x7ff8300c4180 2023-07-27T20:34:13.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.400+0000 7ff8371ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8300c08d0 con 0x7ff8300c7700 2023-07-27T20:34:13.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.400+0000 7ff83579c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff830151600 0x7ff830157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:13.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.400+0000 7ff83579c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff830151600 0x7ff830157540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46540/0 (socket says 172.21.15.72:46540) 2023-07-27T20:34:13.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.400+0000 7ff83579c700 1 -- 172.21.15.72:0/1289942391 learned_addr learned my addr 172.21.15.72:0/1289942391 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:13.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.400+0000 7ff82ffff700 1 --2- 172.21.15.72:0/1289942391 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8300c7700 0x7ff830157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:13.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.400+0000 7ff834f9b700 1 --2- 172.21.15.72:0/1289942391 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8300c4180 0x7ff83014a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:13.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.400+0000 7ff83579c700 1 -- 172.21.15.72:0/1289942391 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8300c7700 msgr2=0x7ff830157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:13.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.400+0000 7ff83579c700 1 --2- 172.21.15.72:0/1289942391 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8300c7700 0x7ff830157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:13.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.400+0000 7ff83579c700 1 -- 172.21.15.72:0/1289942391 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8300c4180 msgr2=0x7ff83014a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:13.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.400+0000 7ff83579c700 1 --2- 172.21.15.72:0/1289942391 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8300c4180 0x7ff83014a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:13.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.400+0000 7ff83579c700 1 -- 172.21.15.72:0/1289942391 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff824009550 con 0x7ff830151600 2023-07-27T20:34:13.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.401+0000 7ff83579c700 1 --2- 172.21.15.72:0/1289942391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff830151600 0x7ff830157540 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7ff82800cba0 tx=0x7ff82800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:13.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.401+0000 7ff82d7fa700 1 -- 172.21.15.72:0/1289942391 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82800ab80 con 0x7ff830151600 2023-07-27T20:34:13.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.401+0000 7ff82d7fa700 1 -- 172.21.15.72:0/1289942391 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82800ad00 con 0x7ff830151600 2023-07-27T20:34:13.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.401+0000 7ff82d7fa700 1 -- 172.21.15.72:0/1289942391 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff828007310 con 0x7ff830151600 2023-07-27T20:34:13.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.401+0000 7ff8371ff700 1 -- 172.21.15.72:0/1289942391 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff830155290 con 0x7ff830151600 2023-07-27T20:34:13.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.401+0000 7ff8371ff700 1 -- 172.21.15.72:0/1289942391 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff830154d70 con 0x7ff830151600 2023-07-27T20:34:13.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.402+0000 7ff8371ff700 1 -- 172.21.15.72:0/1289942391 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8301e9c40 con 0x7ff830151600 2023-07-27T20:34:13.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.403+0000 7ff82d7fa700 1 -- 172.21.15.72:0/1289942391 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff828007470 con 0x7ff830151600 2023-07-27T20:34:13.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.404+0000 7ff82d7fa700 1 --2- 172.21.15.72:0/1289942391 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff81406ace0 0x7ff81406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:13.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.404+0000 7ff82d7fa700 1 -- 172.21.15.72:0/1289942391 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6944+0+0 (secure 0 0 0) 0x7ff828089340 con 0x7ff830151600 2023-07-27T20:34:13.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.404+0000 7ff834f9b700 1 --2- 172.21.15.72:0/1289942391 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff81406ace0 0x7ff81406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:13.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.405+0000 7ff834f9b700 1 --2- 172.21.15.72:0/1289942391 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff81406ace0 0x7ff81406d1a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff824000c00 tx=0x7ff824008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:13.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.408+0000 7ff82d7fa700 1 -- 172.21.15.72:0/1289942391 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff8301e9c40 con 0x7ff830151600 2023-07-27T20:34:13.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:13.604+0000 7ff8371ff700 1 -- 172.21.15.72:0/1289942391 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff8301e9c40 con 0x7ff830151600 2023-07-27T20:34:14.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.168+0000 7ff82d7fa700 1 -- 172.21.15.72:0/1289942391 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v50) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff8301e9c40 con 0x7ff830151600 2023-07-27T20:34:14.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.172+0000 7ff8371ff700 1 -- 172.21.15.72:0/1289942391 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff81406ace0 msgr2=0x7ff81406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:14.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.172+0000 7ff8371ff700 1 --2- 172.21.15.72:0/1289942391 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff81406ace0 0x7ff81406d1a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff824000c00 tx=0x7ff824008030 comp rx=0 tx=0).stop 2023-07-27T20:34:14.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.172+0000 7ff8371ff700 1 -- 172.21.15.72:0/1289942391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff830151600 msgr2=0x7ff830157540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:14.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.172+0000 7ff8371ff700 1 --2- 172.21.15.72:0/1289942391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff830151600 0x7ff830157540 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7ff82800cba0 tx=0x7ff82800cf60 comp rx=0 tx=0).stop 2023-07-27T20:34:14.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.173+0000 7ff8371ff700 1 -- 172.21.15.72:0/1289942391 shutdown_connections 2023-07-27T20:34:14.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.173+0000 7ff8371ff700 1 --2- 172.21.15.72:0/1289942391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff830151600 0x7ff830157540 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:14.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.173+0000 7ff8371ff700 1 --2- 172.21.15.72:0/1289942391 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8300c4180 0x7ff83014a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:14.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.173+0000 7ff8371ff700 1 --2- 172.21.15.72:0/1289942391 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff81406ace0 0x7ff81406d1a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:14.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.173+0000 7ff8371ff700 1 --2- 172.21.15.72:0/1289942391 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8300c7700 0x7ff830157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:14.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.173+0000 7ff8371ff700 1 -- 172.21.15.72:0/1289942391 >> 172.21.15.72:0/1289942391 conn(0x7ff8300c9800 msgr2=0x7ff8300c9dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:14.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.174+0000 7ff8371ff700 1 -- 172.21.15.72:0/1289942391 shutdown_connections 2023-07-27T20:34:14.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.174+0000 7ff8371ff700 1 -- 172.21.15.72:0/1289942391 wait complete. 2023-07-27T20:34:14.165 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' removed 2023-07-27T20:34:14.193 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:34:14.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.402+0000 7fb06f7ff700 1 Processor -- start 2023-07-27T20:34:14.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.402+0000 7fb06f7ff700 1 -- start start 2023-07-27T20:34:14.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.403+0000 7fb06f7ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb068139960 0x7fb0680c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:14.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.403+0000 7fb06f7ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb068139f80 0x7fb0680c1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:14.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.403+0000 7fb06f7ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb0680c2340 0x7fb0681542e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:14.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.403+0000 7fb06f7ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0680c0ee0 con 0x7fb068139960 2023-07-27T20:34:14.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.403+0000 7fb06f7ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0680c1810 con 0x7fb068139f80 2023-07-27T20:34:14.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.403+0000 7fb06f7ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb068139d40 con 0x7fb0680c2340 2023-07-27T20:34:14.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.403+0000 7fb06d59b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb068139960 0x7fb0680c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:14.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.403+0000 7fb06d59b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb068139960 0x7fb0680c12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46546/0 (socket says 172.21.15.72:46546) 2023-07-27T20:34:14.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.403+0000 7fb06d59b700 1 -- 172.21.15.72:0/690489281 learned_addr learned my addr 172.21.15.72:0/690489281 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:14.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.403+0000 7fb06cd9a700 1 --2- 172.21.15.72:0/690489281 >> v2:172.21.15.173:3300/0 conn(0x7fb068139f80 0x7fb0680c1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:14.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.403+0000 7fb06dd9c700 1 --2- 172.21.15.72:0/690489281 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb0680c2340 0x7fb0681542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:14.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.404+0000 7fb06d59b700 1 -- 172.21.15.72:0/690489281 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb0680c2340 msgr2=0x7fb0681542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:14.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.404+0000 7fb06d59b700 1 --2- 172.21.15.72:0/690489281 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb0680c2340 0x7fb0681542e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:14.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.404+0000 7fb06d59b700 1 -- 172.21.15.72:0/690489281 >> v2:172.21.15.173:3300/0 conn(0x7fb068139f80 msgr2=0x7fb0680c1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:14.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.404+0000 7fb06d59b700 1 --2- 172.21.15.72:0/690489281 >> v2:172.21.15.173:3300/0 conn(0x7fb068139f80 0x7fb0680c1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:14.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.404+0000 7fb06d59b700 1 -- 172.21.15.72:0/690489281 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb068151060 con 0x7fb068139960 2023-07-27T20:34:14.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.404+0000 7fb06d59b700 1 --2- 172.21.15.72:0/690489281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb068139960 0x7fb0680c12d0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fb0680c28a0 tx=0x7fb064009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cccf38fd3e1c8e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:14.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.404+0000 7fb05ffff700 1 -- 172.21.15.72:0/690489281 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb064011830 con 0x7fb068139960 2023-07-27T20:34:14.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.404+0000 7fb05ffff700 1 -- 172.21.15.72:0/690489281 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb064011990 con 0x7fb068139960 2023-07-27T20:34:14.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.404+0000 7fb05ffff700 1 -- 172.21.15.72:0/690489281 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb064011d20 con 0x7fb068139960 2023-07-27T20:34:14.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.405+0000 7fb06f7ff700 1 -- 172.21.15.72:0/690489281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb068139960 msgr2=0x7fb0680c12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:14.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.405+0000 7fb06f7ff700 1 --2- 172.21.15.72:0/690489281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb068139960 0x7fb0680c12d0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fb0680c28a0 tx=0x7fb064009bd0 comp rx=0 tx=0).stop 2023-07-27T20:34:14.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.405+0000 7fb06f7ff700 1 -- 172.21.15.72:0/690489281 shutdown_connections 2023-07-27T20:34:14.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.405+0000 7fb06f7ff700 1 --2- 172.21.15.72:0/690489281 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb0680c2340 0x7fb0681542e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:14.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.405+0000 7fb06f7ff700 1 --2- 172.21.15.72:0/690489281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb068139960 0x7fb0680c12d0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:14.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.405+0000 7fb06f7ff700 1 --2- 172.21.15.72:0/690489281 >> v2:172.21.15.173:3300/0 conn(0x7fb068139f80 0x7fb0680c1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:14.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.405+0000 7fb06f7ff700 1 -- 172.21.15.72:0/690489281 >> 172.21.15.72:0/690489281 conn(0x7fb06806a190 msgr2=0x7fb06806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:14.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.405+0000 7fb06f7ff700 1 -- 172.21.15.72:0/690489281 shutdown_connections 2023-07-27T20:34:14.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.405+0000 7fb06f7ff700 1 -- 172.21.15.72:0/690489281 wait complete. 2023-07-27T20:34:14.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.407+0000 7fb06f7ff700 1 Processor -- start 2023-07-27T20:34:14.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.407+0000 7fb06f7ff700 1 -- start start 2023-07-27T20:34:14.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.408+0000 7fb06f7ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0680c2340 0x7fb0681dc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:14.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.408+0000 7fb06f7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb068139960 0x7fb0681dac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:14.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.408+0000 7fb06f7ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb068139f80 0x7fb0681db1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:14.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.408+0000 7fb06f7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb068150030 con 0x7fb068139960 2023-07-27T20:34:14.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.408+0000 7fb06f7ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0681da910 con 0x7fb0680c2340 2023-07-27T20:34:14.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.408+0000 7fb06f7ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0681da350 con 0x7fb068139f80 2023-07-27T20:34:14.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.408+0000 7fb06cd9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb068139960 0x7fb0681dac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:14.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.408+0000 7fb06cd9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb068139960 0x7fb0681dac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46554/0 (socket says 172.21.15.72:46554) 2023-07-27T20:34:14.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.408+0000 7fb06cd9a700 1 -- 172.21.15.72:0/185045689 learned_addr learned my addr 172.21.15.72:0/185045689 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:14.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.408+0000 7fb06d59b700 1 --2- 172.21.15.72:0/185045689 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0680c2340 0x7fb0681dc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:14.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.408+0000 7fb06dd9c700 1 --2- 172.21.15.72:0/185045689 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb068139f80 0x7fb0681db1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:14.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.408+0000 7fb06cd9a700 1 -- 172.21.15.72:0/185045689 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb068139f80 msgr2=0x7fb0681db1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:14.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.408+0000 7fb06cd9a700 1 --2- 172.21.15.72:0/185045689 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb068139f80 0x7fb0681db1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:14.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.408+0000 7fb06cd9a700 1 -- 172.21.15.72:0/185045689 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0680c2340 msgr2=0x7fb0681dc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:14.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.408+0000 7fb06cd9a700 1 --2- 172.21.15.72:0/185045689 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0680c2340 0x7fb0681dc8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:14.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.408+0000 7fb06cd9a700 1 -- 172.21.15.72:0/185045689 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb064009550 con 0x7fb068139960 2023-07-27T20:34:14.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.408+0000 7fb06dd9c700 1 --2- 172.21.15.72:0/185045689 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb068139f80 0x7fb0681db1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:14.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.409+0000 7fb06cd9a700 1 --2- 172.21.15.72:0/185045689 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb068139960 0x7fb0681dac80 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fb05800e980 tx=0x7fb05800ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:14.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.409+0000 7fb05dffb700 1 -- 172.21.15.72:0/185045689 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb058009710 con 0x7fb068139960 2023-07-27T20:34:14.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.409+0000 7fb05dffb700 1 -- 172.21.15.72:0/185045689 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb05800c850 con 0x7fb068139960 2023-07-27T20:34:14.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.409+0000 7fb05dffb700 1 -- 172.21.15.72:0/185045689 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05800cbe0 con 0x7fb068139960 2023-07-27T20:34:14.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.409+0000 7fb06f7ff700 1 -- 172.21.15.72:0/185045689 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0681da630 con 0x7fb068139960 2023-07-27T20:34:14.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.409+0000 7fb06f7ff700 1 -- 172.21.15.72:0/185045689 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0681e8f20 con 0x7fb068139960 2023-07-27T20:34:14.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.410+0000 7fb06f7ff700 1 -- 172.21.15.72:0/185045689 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0681e8aa0 con 0x7fb068139960 2023-07-27T20:34:14.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.411+0000 7fb05dffb700 1 -- 172.21.15.72:0/185045689 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb05800cd40 con 0x7fb068139960 2023-07-27T20:34:14.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.412+0000 7fb05dffb700 1 --2- 172.21.15.72:0/185045689 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb04c06ace0 0x7fb04c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:14.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.412+0000 7fb05dffb700 1 -- 172.21.15.72:0/185045689 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6472+0+0 (secure 0 0 0) 0x7fb0580896a0 con 0x7fb068139960 2023-07-27T20:34:14.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.412+0000 7fb06d59b700 1 --2- 172.21.15.72:0/185045689 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb04c06ace0 0x7fb04c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:14.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.413+0000 7fb06d59b700 1 --2- 172.21.15.72:0/185045689 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb04c06ace0 0x7fb04c06d1a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb064009c10 tx=0x7fb064008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:14.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.416+0000 7fb05dffb700 1 -- 172.21.15.72:0/185045689 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb0681e8aa0 con 0x7fb068139960 2023-07-27T20:34:14.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.617+0000 7fb06f7ff700 1 -- 172.21.15.72:0/185045689 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0681e8aa0 con 0x7fb068139960 2023-07-27T20:34:14.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.618+0000 7fb05dffb700 1 -- 172.21.15.72:0/185045689 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+18685 (secure 0 0 0) 0x7fb0681e8aa0 con 0x7fb068139960 2023-07-27T20:34:14.606 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:34:14.606 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":50,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:34:14.161563+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_metadata","create_time":"2023-07-27T20:33:20.125785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs2_data","create_time":"2023-07-27T20:33:20.647929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:6834/1959104268":"2023-07-28T20:34:10.790274+0000","172.21.15.72:6833/1959104268":"2023-07-28T20:34:10.790274+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:34:14.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.621+0000 7fb06f7ff700 1 -- 172.21.15.72:0/185045689 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb04c06ace0 msgr2=0x7fb04c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:14.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.621+0000 7fb06f7ff700 1 --2- 172.21.15.72:0/185045689 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb04c06ace0 0x7fb04c06d1a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb064009c10 tx=0x7fb064008030 comp rx=0 tx=0).stop 2023-07-27T20:34:14.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.621+0000 7fb06f7ff700 1 -- 172.21.15.72:0/185045689 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb068139960 msgr2=0x7fb0681dac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:14.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.621+0000 7fb06f7ff700 1 --2- 172.21.15.72:0/185045689 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb068139960 0x7fb0681dac80 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fb05800e980 tx=0x7fb05800ed40 comp rx=0 tx=0).stop 2023-07-27T20:34:14.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.621+0000 7fb06f7ff700 1 -- 172.21.15.72:0/185045689 shutdown_connections 2023-07-27T20:34:14.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.621+0000 7fb06f7ff700 1 --2- 172.21.15.72:0/185045689 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb04c06ace0 0x7fb04c06d1a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:14.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.621+0000 7fb06f7ff700 1 --2- 172.21.15.72:0/185045689 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb068139f80 0x7fb0681db1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:14.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.621+0000 7fb06f7ff700 1 --2- 172.21.15.72:0/185045689 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0680c2340 0x7fb0681dc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:14.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.621+0000 7fb06f7ff700 1 --2- 172.21.15.72:0/185045689 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb068139960 0x7fb0681dac80 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:14.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.621+0000 7fb06f7ff700 1 -- 172.21.15.72:0/185045689 >> 172.21.15.72:0/185045689 conn(0x7fb06806a190 msgr2=0x7fb06806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:14.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.621+0000 7fb06f7ff700 1 -- 172.21.15.72:0/185045689 shutdown_connections 2023-07-27T20:34:14.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.621+0000 7fb06f7ff700 1 -- 172.21.15.72:0/185045689 wait complete. 2023-07-27T20:34:14.627 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-27T20:31:14.581785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T20:31:21.077941+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-07-27T20:33:20.125785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs2_data', 'create_time': '2023-07-27T20:33:20.647929+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-27T20:34:14.627 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-27T20:34:14.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.838+0000 7f05d65ff700 1 Processor -- start 2023-07-27T20:34:14.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.839+0000 7f05d65ff700 1 -- start start 2023-07-27T20:34:14.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.840+0000 7f05d65ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f05d014db30 0x7f05d00bb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:14.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.840+0000 7f05d65ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f05d00c0f80 0x7f05d0154150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:14.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.840+0000 7f05d65ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05d00baf20 con 0x7f05d00bb7e0 2023-07-27T20:34:14.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.840+0000 7f05d65ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d00bbd40 con 0x7f05d00c0f80 2023-07-27T20:34:14.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.840+0000 7f05d65ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d00baa00 con 0x7f05d014db30 2023-07-27T20:34:14.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.840+0000 7f05d4b9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f05d00c0f80 0x7f05d0154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:14.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.840+0000 7f05d4b9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f05d00c0f80 0x7f05d0154150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46568/0 (socket says 172.21.15.72:46568) 2023-07-27T20:34:14.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.840+0000 7f05d4b9c700 1 -- 172.21.15.72:0/2305660082 learned_addr learned my addr 172.21.15.72:0/2305660082 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:14.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.840+0000 7f05cffff700 1 --2- 172.21.15.72:0/2305660082 >> v2:172.21.15.173:3300/0 conn(0x7f05d014db30 0x7f05d00bb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:14.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.841+0000 7f05d4b9c700 1 -- 172.21.15.72:0/2305660082 >> v2:172.21.15.173:3300/0 conn(0x7f05d014db30 msgr2=0x7f05d00bb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:14.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.841+0000 7f05d4b9c700 1 --2- 172.21.15.72:0/2305660082 >> v2:172.21.15.173:3300/0 conn(0x7f05d014db30 0x7f05d00bb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:14.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.841+0000 7f05d4b9c700 1 -- 172.21.15.72:0/2305660082 >> v1:172.21.15.173:6789/0 conn(0x7f05d00bb7e0 legacy=0x7f05d0153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:14.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.841+0000 7f05d4b9c700 1 -- 172.21.15.72:0/2305660082 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d014df10 con 0x7f05d00c0f80 2023-07-27T20:34:14.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.841+0000 7f05d4b9c700 1 --2- 172.21.15.72:0/2305660082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05d00c0f80 0x7f05d0154150 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f05d00c0f50 tx=0x7f05c800d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d13b9015f5f64f78 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:14.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.841+0000 7f05ceffd700 1 -- 172.21.15.72:0/2305660082 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c8010070 con 0x7f05d00c0f80 2023-07-27T20:34:14.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.841+0000 7f05ceffd700 1 -- 172.21.15.72:0/2305660082 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c800dce0 con 0x7f05d00c0f80 2023-07-27T20:34:14.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.841+0000 7f05ceffd700 1 -- 172.21.15.72:0/2305660082 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c800b310 con 0x7f05d00c0f80 2023-07-27T20:34:14.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.842+0000 7f05d65ff700 1 -- 172.21.15.72:0/2305660082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05d00c0f80 msgr2=0x7f05d0154150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:14.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.842+0000 7f05d65ff700 1 --2- 172.21.15.72:0/2305660082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05d00c0f80 0x7f05d0154150 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f05d00c0f50 tx=0x7f05c800d430 comp rx=0 tx=0).stop 2023-07-27T20:34:14.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.842+0000 7f05d65ff700 1 -- 172.21.15.72:0/2305660082 shutdown_connections 2023-07-27T20:34:14.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.842+0000 7f05d65ff700 1 --2- 172.21.15.72:0/2305660082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05d00c0f80 0x7f05d0154150 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:14.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.842+0000 7f05d65ff700 1 --2- 172.21.15.72:0/2305660082 >> v2:172.21.15.173:3300/0 conn(0x7f05d014db30 0x7f05d00bb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:14.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.842+0000 7f05d65ff700 1 -- 172.21.15.72:0/2305660082 >> 172.21.15.72:0/2305660082 conn(0x7f05d006a190 msgr2=0x7f05d006a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:14.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.842+0000 7f05d65ff700 1 -- 172.21.15.72:0/2305660082 shutdown_connections 2023-07-27T20:34:14.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.842+0000 7f05d65ff700 1 -- 172.21.15.72:0/2305660082 wait complete. 2023-07-27T20:34:14.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.844+0000 7f05d65ff700 1 Processor -- start 2023-07-27T20:34:14.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.844+0000 7f05d65ff700 1 -- start start 2023-07-27T20:34:14.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.845+0000 7f05d65ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05d00bb7e0 0x7f05d00aa750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:14.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.845+0000 7f05d65ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05d00c0f80 0x7f05d00c4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:14.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.845+0000 7f05d65ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05d014db30 0x7f05d01e9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:14.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.845+0000 7f05d65ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d00aac90 con 0x7f05d014db30 2023-07-27T20:34:14.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.846+0000 7f05d65ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d01ec890 con 0x7f05d00bb7e0 2023-07-27T20:34:14.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.846+0000 7f05d65ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d01ed6f0 con 0x7f05d00c0f80 2023-07-27T20:34:14.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.846+0000 7f05d4b9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05d014db30 0x7f05d01e9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:14.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.846+0000 7f05d4b9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05d014db30 0x7f05d01e9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46572/0 (socket says 172.21.15.72:46572) 2023-07-27T20:34:14.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.846+0000 7f05d4b9c700 1 -- 172.21.15.72:0/1332784381 learned_addr learned my addr 172.21.15.72:0/1332784381 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:14.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.846+0000 7f05cffff700 1 --2- 172.21.15.72:0/1332784381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05d00bb7e0 0x7f05d00aa750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:14.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.846+0000 7f05cf7fe700 1 --2- 172.21.15.72:0/1332784381 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05d00c0f80 0x7f05d00c4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:14.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.846+0000 7f05d4b9c700 1 -- 172.21.15.72:0/1332784381 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05d00c0f80 msgr2=0x7f05d00c4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:14.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.846+0000 7f05d4b9c700 1 --2- 172.21.15.72:0/1332784381 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05d00c0f80 0x7f05d00c4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:14.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.846+0000 7f05d4b9c700 1 -- 172.21.15.72:0/1332784381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05d00bb7e0 msgr2=0x7f05d00aa750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:14.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.846+0000 7f05d4b9c700 1 --2- 172.21.15.72:0/1332784381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05d00bb7e0 0x7f05d00aa750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:14.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.846+0000 7f05d4b9c700 1 -- 172.21.15.72:0/1332784381 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c800bd40 con 0x7f05d014db30 2023-07-27T20:34:14.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.846+0000 7f05cf7fe700 1 --2- 172.21.15.72:0/1332784381 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05d00c0f80 0x7f05d00c4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:14.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.846+0000 7f05d4b9c700 1 --2- 172.21.15.72:0/1332784381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05d014db30 0x7f05d01e9590 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f05c800d780 tx=0x7f05c8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:14.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.847+0000 7f05ccff9700 1 -- 172.21.15.72:0/1332784381 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c8009a10 con 0x7f05d014db30 2023-07-27T20:34:14.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.847+0000 7f05ccff9700 1 -- 172.21.15.72:0/1332784381 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c8009b70 con 0x7f05d014db30 2023-07-27T20:34:14.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.847+0000 7f05ccff9700 1 -- 172.21.15.72:0/1332784381 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c8004040 con 0x7f05d014db30 2023-07-27T20:34:14.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.847+0000 7f05d65ff700 1 -- 172.21.15.72:0/1332784381 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d01ecae0 con 0x7f05d014db30 2023-07-27T20:34:14.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.847+0000 7f05d65ff700 1 -- 172.21.15.72:0/1332784381 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d01ed0a0 con 0x7f05d014db30 2023-07-27T20:34:14.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.848+0000 7f05d65ff700 1 -- 172.21.15.72:0/1332784381 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05d01e9390 con 0x7f05d014db30 2023-07-27T20:34:14.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.849+0000 7f05ccff9700 1 -- 172.21.15.72:0/1332784381 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f05c80041a0 con 0x7f05d014db30 2023-07-27T20:34:14.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.850+0000 7f05ccff9700 1 --2- 172.21.15.72:0/1332784381 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f05bc06ace0 0x7f05bc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:14.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.850+0000 7f05ccff9700 1 -- 172.21.15.72:0/1332784381 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6472+0+0 (secure 0 0 0) 0x7f05c808ad20 con 0x7f05d014db30 2023-07-27T20:34:14.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.850+0000 7f05cffff700 1 --2- 172.21.15.72:0/1332784381 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f05bc06ace0 0x7f05bc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:14.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.851+0000 7f05cffff700 1 --2- 172.21.15.72:0/1332784381 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f05bc06ace0 0x7f05bc06d1a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f05d014a750 tx=0x7f05c0009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:14.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:14.854+0000 7f05ccff9700 1 -- 172.21.15.72:0/1332784381 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f05c8055c20 con 0x7f05d014db30 2023-07-27T20:34:15.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.043+0000 7f05d65ff700 1 -- 172.21.15.72:0/1332784381 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f05d004e470 con 0x7f05d014db30 2023-07-27T20:34:15.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.044+0000 7f05ccff9700 1 -- 172.21.15.72:0/1332784381 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) v1 ==== 93+0+10 (secure 0 0 0) 0x7f05c800b540 con 0x7f05d014db30 2023-07-27T20:34:15.032 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-27T20:34:15.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.046+0000 7f05d65ff700 1 -- 172.21.15.72:0/1332784381 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f05bc06ace0 msgr2=0x7f05bc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:15.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.046+0000 7f05d65ff700 1 --2- 172.21.15.72:0/1332784381 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f05bc06ace0 0x7f05bc06d1a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f05d014a750 tx=0x7f05c0009210 comp rx=0 tx=0).stop 2023-07-27T20:34:15.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.046+0000 7f05d65ff700 1 -- 172.21.15.72:0/1332784381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05d014db30 msgr2=0x7f05d01e9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:15.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.046+0000 7f05d65ff700 1 --2- 172.21.15.72:0/1332784381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05d014db30 0x7f05d01e9590 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f05c800d780 tx=0x7f05c8004ad0 comp rx=0 tx=0).stop 2023-07-27T20:34:15.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.046+0000 7f05d65ff700 1 -- 172.21.15.72:0/1332784381 shutdown_connections 2023-07-27T20:34:15.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.046+0000 7f05d65ff700 1 --2- 172.21.15.72:0/1332784381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05d014db30 0x7f05d01e9590 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:15.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.046+0000 7f05d65ff700 1 --2- 172.21.15.72:0/1332784381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05d00bb7e0 0x7f05d00aa750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:15.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.046+0000 7f05d65ff700 1 --2- 172.21.15.72:0/1332784381 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f05bc06ace0 0x7f05bc06d1a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:15.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.046+0000 7f05d65ff700 1 --2- 172.21.15.72:0/1332784381 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05d00c0f80 0x7f05d00c4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:15.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.046+0000 7f05d65ff700 1 -- 172.21.15.72:0/1332784381 >> 172.21.15.72:0/1332784381 conn(0x7f05d006a190 msgr2=0x7f05d0071500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:15.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.046+0000 7f05d65ff700 1 -- 172.21.15.72:0/1332784381 shutdown_connections 2023-07-27T20:34:15.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.046+0000 7f05d65ff700 1 -- 172.21.15.72:0/1332784381 wait complete. 2023-07-27T20:34:15.052 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T20:34:15.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.266+0000 7fb275bff700 1 Processor -- start 2023-07-27T20:34:15.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.266+0000 7fb275bff700 1 -- start start 2023-07-27T20:34:15.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.268+0000 7fb275bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb27006e140 0x7fb2700ba310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:15.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.268+0000 7fb275bff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb2700ba850 0x7fb27006d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:15.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.268+0000 7fb275bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb27006ce10 con 0x7fb27013b150 2023-07-27T20:34:15.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.268+0000 7fb275bff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb270152680 con 0x7fb2700ba850 2023-07-27T20:34:15.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.268+0000 7fb275bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb270152960 con 0x7fb27006e140 2023-07-27T20:34:15.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.268+0000 7fb26f7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb27013b150 0x7fb270151dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51356/0 (socket says 172.21.15.72:51356) 2023-07-27T20:34:15.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.268+0000 7fb26f7fe700 1 -- 172.21.15.72:0/1754813078 learned_addr learned my addr 172.21.15.72:0/1754813078 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:15.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.268+0000 7fb26ffff700 1 --2- 172.21.15.72:0/1754813078 >> v2:172.21.15.173:3300/0 conn(0x7fb2700ba850 0x7fb27006d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:15.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.268+0000 7fb26effd700 1 --2- 172.21.15.72:0/1754813078 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb27006e140 0x7fb2700ba310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:15.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.268+0000 7fb26e7fc700 1 -- 172.21.15.72:0/1754813078 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2038996246 0 0) 0x7fb27006ce10 con 0x7fb27013b150 2023-07-27T20:34:15.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.268+0000 7fb26e7fc700 1 -- 172.21.15.72:0/1754813078 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2580035b0 con 0x7fb27013b150 2023-07-27T20:34:15.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.269+0000 7fb26ffff700 1 -- 172.21.15.72:0/1754813078 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb27006e140 msgr2=0x7fb2700ba310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:15.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.269+0000 7fb26ffff700 1 --2- 172.21.15.72:0/1754813078 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb27006e140 0x7fb2700ba310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:15.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.269+0000 7fb26ffff700 1 -- 172.21.15.72:0/1754813078 >> v1:172.21.15.72:6789/0 conn(0x7fb27013b150 legacy=0x7fb270151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:15.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.269+0000 7fb26ffff700 1 -- 172.21.15.72:0/1754813078 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb270152c40 con 0x7fb2700ba850 2023-07-27T20:34:15.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.269+0000 7fb26ffff700 1 --2- 172.21.15.72:0/1754813078 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2700ba850 0x7fb27006d5d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb268009d90 tx=0x7fb26800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b979377924700110 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:15.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.269+0000 7fb26e7fc700 1 -- 172.21.15.72:0/1754813078 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26800e070 con 0x7fb2700ba850 2023-07-27T20:34:15.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.269+0000 7fb26e7fc700 1 -- 172.21.15.72:0/1754813078 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26800bb20 con 0x7fb2700ba850 2023-07-27T20:34:15.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.269+0000 7fb26e7fc700 1 -- 172.21.15.72:0/1754813078 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb268012430 con 0x7fb2700ba850 2023-07-27T20:34:15.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.270+0000 7fb275bff700 1 -- 172.21.15.72:0/1754813078 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2700ba850 msgr2=0x7fb27006d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:15.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.270+0000 7fb275bff700 1 --2- 172.21.15.72:0/1754813078 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2700ba850 0x7fb27006d5d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb268009d90 tx=0x7fb26800b330 comp rx=0 tx=0).stop 2023-07-27T20:34:15.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.270+0000 7fb275bff700 1 -- 172.21.15.72:0/1754813078 shutdown_connections 2023-07-27T20:34:15.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.270+0000 7fb275bff700 1 --2- 172.21.15.72:0/1754813078 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2700ba850 0x7fb27006d5d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:15.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.270+0000 7fb275bff700 1 --2- 172.21.15.72:0/1754813078 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb27006e140 0x7fb2700ba310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:15.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.270+0000 7fb275bff700 1 -- 172.21.15.72:0/1754813078 >> 172.21.15.72:0/1754813078 conn(0x7fb27006a190 msgr2=0x7fb27006a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:15.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.270+0000 7fb275bff700 1 -- 172.21.15.72:0/1754813078 shutdown_connections 2023-07-27T20:34:15.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.270+0000 7fb275bff700 1 -- 172.21.15.72:0/1754813078 wait complete. 2023-07-27T20:34:15.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.271+0000 7fb275bff700 1 Processor -- start 2023-07-27T20:34:15.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.272+0000 7fb275bff700 1 -- start start 2023-07-27T20:34:15.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.272+0000 7fb275bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb27006e140 0x7fb27014edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:15.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.272+0000 7fb275bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2700ba850 0x7fb27014f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:15.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.272+0000 7fb275bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb27013b150 0x7fb270071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:15.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.272+0000 7fb275bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2700c34e0 con 0x7fb27013b150 2023-07-27T20:34:15.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.272+0000 7fb275bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2700c37c0 con 0x7fb2700ba850 2023-07-27T20:34:15.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.272+0000 7fb275bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2700c3aa0 con 0x7fb27006e140 2023-07-27T20:34:15.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.273+0000 7fb26ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb27013b150 0x7fb270071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:15.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.273+0000 7fb26ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb27013b150 0x7fb270071050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46582/0 (socket says 172.21.15.72:46582) 2023-07-27T20:34:15.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.273+0000 7fb26ffff700 1 -- 172.21.15.72:0/1466811506 learned_addr learned my addr 172.21.15.72:0/1466811506 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:15.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.273+0000 7fb26effd700 1 --2- 172.21.15.72:0/1466811506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2700ba850 0x7fb27014f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:15.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.273+0000 7fb26f7fe700 1 --2- 172.21.15.72:0/1466811506 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb27006e140 0x7fb27014edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:15.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.273+0000 7fb26ffff700 1 -- 172.21.15.72:0/1466811506 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb27006e140 msgr2=0x7fb27014edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:15.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.273+0000 7fb26ffff700 1 --2- 172.21.15.72:0/1466811506 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb27006e140 0x7fb27014edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:15.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.273+0000 7fb26ffff700 1 -- 172.21.15.72:0/1466811506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2700ba850 msgr2=0x7fb27014f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:15.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.273+0000 7fb26ffff700 1 --2- 172.21.15.72:0/1466811506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2700ba850 0x7fb27014f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:15.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.273+0000 7fb26ffff700 1 -- 172.21.15.72:0/1466811506 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb268009a70 con 0x7fb27013b150 2023-07-27T20:34:15.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.273+0000 7fb26effd700 1 --2- 172.21.15.72:0/1466811506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2700ba850 0x7fb27014f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:15.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.273+0000 7fb26f7fe700 1 --2- 172.21.15.72:0/1466811506 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb27006e140 0x7fb27014edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:15.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.273+0000 7fb26ffff700 1 --2- 172.21.15.72:0/1466811506 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb27013b150 0x7fb270071050 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fb268014040 tx=0x7fb268004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:15.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.274+0000 7fb257fff700 1 -- 172.21.15.72:0/1466811506 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2680129f0 con 0x7fb27013b150 2023-07-27T20:34:15.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.274+0000 7fb257fff700 1 -- 172.21.15.72:0/1466811506 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb268020070 con 0x7fb27013b150 2023-07-27T20:34:15.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.274+0000 7fb275bff700 1 -- 172.21.15.72:0/1466811506 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb270070b30 con 0x7fb27013b150 2023-07-27T20:34:15.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.274+0000 7fb257fff700 1 -- 172.21.15.72:0/1466811506 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb268012db0 con 0x7fb27013b150 2023-07-27T20:34:15.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.274+0000 7fb275bff700 1 -- 172.21.15.72:0/1466811506 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb27014d880 con 0x7fb27013b150 2023-07-27T20:34:15.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.275+0000 7fb275bff700 1 -- 172.21.15.72:0/1466811506 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb270070d70 con 0x7fb27013b150 2023-07-27T20:34:15.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.276+0000 7fb257fff700 1 -- 172.21.15.72:0/1466811506 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb268004040 con 0x7fb27013b150 2023-07-27T20:34:15.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.277+0000 7fb257fff700 1 --2- 172.21.15.72:0/1466811506 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb25c06ace0 0x7fb25c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:15.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.277+0000 7fb257fff700 1 -- 172.21.15.72:0/1466811506 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6472+0+0 (secure 0 0 0) 0x7fb268022070 con 0x7fb27013b150 2023-07-27T20:34:15.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.277+0000 7fb26f7fe700 1 --2- 172.21.15.72:0/1466811506 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb25c06ace0 0x7fb25c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:15.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.278+0000 7fb26f7fe700 1 --2- 172.21.15.72:0/1466811506 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb25c06ace0 0x7fb25c06d1a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb2600011e0 tx=0x7fb260009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:15.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.281+0000 7fb257fff700 1 -- 172.21.15.72:0/1466811506 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb270070d70 con 0x7fb27013b150 2023-07-27T20:34:15.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.472+0000 7fb275bff700 1 -- 172.21.15.72:0/1466811506 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb270070d70 con 0x7fb27013b150 2023-07-27T20:34:15.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.473+0000 7fb257fff700 1 -- 172.21.15.72:0/1466811506 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v50) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb270070d70 con 0x7fb27013b150 2023-07-27T20:34:15.461 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-27T20:34:15.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.475+0000 7fb275bff700 1 -- 172.21.15.72:0/1466811506 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb25c06ace0 msgr2=0x7fb25c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:15.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.475+0000 7fb275bff700 1 --2- 172.21.15.72:0/1466811506 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb25c06ace0 0x7fb25c06d1a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb2600011e0 tx=0x7fb260009040 comp rx=0 tx=0).stop 2023-07-27T20:34:15.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.475+0000 7fb275bff700 1 -- 172.21.15.72:0/1466811506 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb27013b150 msgr2=0x7fb270071050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:15.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.475+0000 7fb275bff700 1 --2- 172.21.15.72:0/1466811506 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb27013b150 0x7fb270071050 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fb268014040 tx=0x7fb268004ad0 comp rx=0 tx=0).stop 2023-07-27T20:34:15.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.475+0000 7fb275bff700 1 -- 172.21.15.72:0/1466811506 shutdown_connections 2023-07-27T20:34:15.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.475+0000 7fb275bff700 1 --2- 172.21.15.72:0/1466811506 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb27013b150 0x7fb270071050 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:15.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.475+0000 7fb275bff700 1 --2- 172.21.15.72:0/1466811506 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb25c06ace0 0x7fb25c06d1a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:15.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.475+0000 7fb275bff700 1 --2- 172.21.15.72:0/1466811506 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb27006e140 0x7fb27014edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:15.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.475+0000 7fb275bff700 1 --2- 172.21.15.72:0/1466811506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2700ba850 0x7fb27014f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:15.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.475+0000 7fb275bff700 1 -- 172.21.15.72:0/1466811506 >> 172.21.15.72:0/1466811506 conn(0x7fb27006a190 msgr2=0x7fb2700bffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:15.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.475+0000 7fb275bff700 1 -- 172.21.15.72:0/1466811506 shutdown_connections 2023-07-27T20:34:15.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.475+0000 7fb275bff700 1 -- 172.21.15.72:0/1466811506 wait complete. 2023-07-27T20:34:15.480 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-07-27T20:34:15.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.690+0000 7f4eb65ff700 1 Processor -- start 2023-07-27T20:34:15.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.690+0000 7f4eb65ff700 1 -- start start 2023-07-27T20:34:15.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.691+0000 7f4eb65ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4eb01475a0 0x7f4eb01516c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:15.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.691+0000 7f4eb65ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4eb00c12f0 0x7f4eb00c1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:15.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.691+0000 7f4eb65ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eb0154f50 con 0x7f4eb00c2240 2023-07-27T20:34:15.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.691+0000 7f4eb65ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eb0151c00 con 0x7f4eb01475a0 2023-07-27T20:34:15.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.691+0000 7f4eb65ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eb0154340 con 0x7f4eb00c12f0 2023-07-27T20:34:15.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.691+0000 7f4eaffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4eb01475a0 0x7f4eb01516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:15.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.691+0000 7f4eaffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4eb01475a0 0x7f4eb01516c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46598/0 (socket says 172.21.15.72:46598) 2023-07-27T20:34:15.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.691+0000 7f4eb4b9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4eb00c2240 0x7f4eb00716f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51372/0 (socket says 172.21.15.72:51372) 2023-07-27T20:34:15.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.691+0000 7f4eaffff700 1 -- 172.21.15.72:0/1159358606 learned_addr learned my addr 172.21.15.72:0/1159358606 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:15.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.692+0000 7f4eaf7fe700 1 --2- 172.21.15.72:0/1159358606 >> v2:172.21.15.173:3300/0 conn(0x7f4eb00c12f0 0x7f4eb00c1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:15.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.692+0000 7f4eaffff700 1 -- 172.21.15.72:0/1159358606 >> v2:172.21.15.173:3300/0 conn(0x7f4eb00c12f0 msgr2=0x7f4eb00c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:15.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.692+0000 7f4eaffff700 1 --2- 172.21.15.72:0/1159358606 >> v2:172.21.15.173:3300/0 conn(0x7f4eb00c12f0 0x7f4eb00c1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:15.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.692+0000 7f4eaffff700 1 -- 172.21.15.72:0/1159358606 >> v1:172.21.15.72:6789/0 conn(0x7f4eb00c2240 legacy=0x7f4eb00716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:15.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.692+0000 7f4eaffff700 1 -- 172.21.15.72:0/1159358606 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb0154620 con 0x7f4eb01475a0 2023-07-27T20:34:15.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.692+0000 7f4eaeffd700 1 -- 172.21.15.72:0/1159358606 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3702158962 0 0) 0x7f4eb0154f50 con 0x7f4eb00c2240 2023-07-27T20:34:15.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.692+0000 7f4eaffff700 1 --2- 172.21.15.72:0/1159358606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb01475a0 0x7f4eb01516c0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f4eb014e780 tx=0x7f4ea0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee923190c5a30c1e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:15.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.692+0000 7f4eaeffd700 1 -- 172.21.15.72:0/1159358606 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea000b870 con 0x7f4eb01475a0 2023-07-27T20:34:15.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.692+0000 7f4eaeffd700 1 -- 172.21.15.72:0/1159358606 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea000b9d0 con 0x7f4eb01475a0 2023-07-27T20:34:15.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.692+0000 7f4eaeffd700 1 -- 172.21.15.72:0/1159358606 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea000bd60 con 0x7f4eb01475a0 2023-07-27T20:34:15.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.693+0000 7f4eb65ff700 1 -- 172.21.15.72:0/1159358606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb01475a0 msgr2=0x7f4eb01516c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:15.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.693+0000 7f4eb65ff700 1 --2- 172.21.15.72:0/1159358606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb01475a0 0x7f4eb01516c0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f4eb014e780 tx=0x7f4ea0009bd0 comp rx=0 tx=0).stop 2023-07-27T20:34:15.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.693+0000 7f4eb65ff700 1 -- 172.21.15.72:0/1159358606 shutdown_connections 2023-07-27T20:34:15.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.693+0000 7f4eb65ff700 1 --2- 172.21.15.72:0/1159358606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb01475a0 0x7f4eb01516c0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:15.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.693+0000 7f4eb65ff700 1 --2- 172.21.15.72:0/1159358606 >> v2:172.21.15.173:3300/0 conn(0x7f4eb00c12f0 0x7f4eb00c1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:15.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.693+0000 7f4eb65ff700 1 -- 172.21.15.72:0/1159358606 >> 172.21.15.72:0/1159358606 conn(0x7f4eb006a190 msgr2=0x7f4eb006a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:15.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.693+0000 7f4eb65ff700 1 -- 172.21.15.72:0/1159358606 shutdown_connections 2023-07-27T20:34:15.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.693+0000 7f4eb65ff700 1 -- 172.21.15.72:0/1159358606 wait complete. 2023-07-27T20:34:15.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.695+0000 7f4eb65ff700 1 Processor -- start 2023-07-27T20:34:15.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.695+0000 7f4eb65ff700 1 -- start start 2023-07-27T20:34:15.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.696+0000 7f4eb65ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4eb00c12f0 0x7f4eb01eca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:15.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.696+0000 7f4eb65ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4eb00c2240 0x7f4eb01eab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:15.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.696+0000 7f4eb65ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb01475a0 0x7f4eb01eb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:15.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.696+0000 7f4eb65ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb014da10 con 0x7f4eb01475a0 2023-07-27T20:34:15.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.696+0000 7f4eb65ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb00bf530 con 0x7f4eb00c12f0 2023-07-27T20:34:15.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.696+0000 7f4eb65ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb01ed540 con 0x7f4eb00c2240 2023-07-27T20:34:15.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.696+0000 7f4eb4b9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb01475a0 0x7f4eb01eb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:15.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.696+0000 7f4eb4b9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb01475a0 0x7f4eb01eb0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46612/0 (socket says 172.21.15.72:46612) 2023-07-27T20:34:15.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.696+0000 7f4eb4b9c700 1 -- 172.21.15.72:0/2728612611 learned_addr learned my addr 172.21.15.72:0/2728612611 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:15.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.696+0000 7f4eaffff700 1 --2- 172.21.15.72:0/2728612611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4eb00c12f0 0x7f4eb01eca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:15.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.696+0000 7f4eaf7fe700 1 --2- 172.21.15.72:0/2728612611 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4eb00c2240 0x7f4eb01eab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:15.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.696+0000 7f4eb4b9c700 1 -- 172.21.15.72:0/2728612611 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4eb00c2240 msgr2=0x7f4eb01eab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:15.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.696+0000 7f4eb4b9c700 1 --2- 172.21.15.72:0/2728612611 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4eb00c2240 0x7f4eb01eab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:15.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.696+0000 7f4eb4b9c700 1 -- 172.21.15.72:0/2728612611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4eb00c12f0 msgr2=0x7f4eb01eca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:15.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.696+0000 7f4eb4b9c700 1 --2- 172.21.15.72:0/2728612611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4eb00c12f0 0x7f4eb01eca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:15.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.696+0000 7f4eb4b9c700 1 -- 172.21.15.72:0/2728612611 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea0009550 con 0x7f4eb01475a0 2023-07-27T20:34:15.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.697+0000 7f4eb4b9c700 1 --2- 172.21.15.72:0/2728612611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb01475a0 0x7f4eb01eb0b0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8002230 tx=0x7f4ea800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:15.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.697+0000 7f4eacff9700 1 -- 172.21.15.72:0/2728612611 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea800ab70 con 0x7f4eb01475a0 2023-07-27T20:34:15.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.697+0000 7f4eacff9700 1 -- 172.21.15.72:0/2728612611 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea800acf0 con 0x7f4eb01475a0 2023-07-27T20:34:15.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.697+0000 7f4eb65ff700 1 -- 172.21.15.72:0/2728612611 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eb00bec80 con 0x7f4eb01475a0 2023-07-27T20:34:15.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.697+0000 7f4eacff9700 1 -- 172.21.15.72:0/2728612611 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8007310 con 0x7f4eb01475a0 2023-07-27T20:34:15.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.697+0000 7f4eb65ff700 1 -- 172.21.15.72:0/2728612611 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eb0143ea0 con 0x7f4eb01475a0 2023-07-27T20:34:15.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.698+0000 7f4eb65ff700 1 -- 172.21.15.72:0/2728612611 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eb00bf1a0 con 0x7f4eb01475a0 2023-07-27T20:34:15.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.699+0000 7f4eacff9700 1 -- 172.21.15.72:0/2728612611 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4ea8007470 con 0x7f4eb01475a0 2023-07-27T20:34:15.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.700+0000 7f4eacff9700 1 --2- 172.21.15.72:0/2728612611 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4e9c06ace0 0x7f4e9c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:15.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.700+0000 7f4eacff9700 1 -- 172.21.15.72:0/2728612611 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6472+0+0 (secure 0 0 0) 0x7f4ea8089100 con 0x7f4eb01475a0 2023-07-27T20:34:15.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.700+0000 7f4eaffff700 1 --2- 172.21.15.72:0/2728612611 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4e9c06ace0 0x7f4e9c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:15.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.701+0000 7f4eaffff700 1 --2- 172.21.15.72:0/2728612611 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4e9c06ace0 0x7f4e9c06d1a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0014040 tx=0x7f4ea0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:15.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.704+0000 7f4eacff9700 1 -- 172.21.15.72:0/2728612611 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4eb00bf1a0 con 0x7f4eb01475a0 2023-07-27T20:34:15.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.898+0000 7f4eb65ff700 1 -- 172.21.15.72:0/2728612611 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4eb00bf1a0 con 0x7f4eb01475a0 2023-07-27T20:34:15.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.899+0000 7f4eacff9700 1 -- 172.21.15.72:0/2728612611 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v50) v1 ==== 105+0+11 (secure 0 0 0) 0x7f4eb00bf1a0 con 0x7f4eb01475a0 2023-07-27T20:34:15.886 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:34:15.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.901+0000 7f4eb65ff700 1 -- 172.21.15.72:0/2728612611 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4e9c06ace0 msgr2=0x7f4e9c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:15.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.901+0000 7f4eb65ff700 1 --2- 172.21.15.72:0/2728612611 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4e9c06ace0 0x7f4e9c06d1a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0014040 tx=0x7f4ea0008030 comp rx=0 tx=0).stop 2023-07-27T20:34:15.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.901+0000 7f4eb65ff700 1 -- 172.21.15.72:0/2728612611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb01475a0 msgr2=0x7f4eb01eb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:15.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.901+0000 7f4eb65ff700 1 --2- 172.21.15.72:0/2728612611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb01475a0 0x7f4eb01eb0b0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8002230 tx=0x7f4ea800cf50 comp rx=0 tx=0).stop 2023-07-27T20:34:15.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.901+0000 7f4eb65ff700 1 -- 172.21.15.72:0/2728612611 shutdown_connections 2023-07-27T20:34:15.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.901+0000 7f4eb65ff700 1 --2- 172.21.15.72:0/2728612611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb01475a0 0x7f4eb01eb0b0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:15.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.901+0000 7f4eb65ff700 1 --2- 172.21.15.72:0/2728612611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4eb00c12f0 0x7f4eb01eca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:15.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.901+0000 7f4eb65ff700 1 --2- 172.21.15.72:0/2728612611 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4e9c06ace0 0x7f4e9c06d1a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:15.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.901+0000 7f4eb65ff700 1 --2- 172.21.15.72:0/2728612611 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4eb00c2240 0x7f4eb01eab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:15.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.901+0000 7f4eb65ff700 1 -- 172.21.15.72:0/2728612611 >> 172.21.15.72:0/2728612611 conn(0x7f4eb006a190 msgr2=0x7f4eb0141110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:15.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.901+0000 7f4eb65ff700 1 -- 172.21.15.72:0/2728612611 shutdown_connections 2023-07-27T20:34:15.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:15.901+0000 7f4eb65ff700 1 -- 172.21.15.72:0/2728612611 wait complete. 2023-07-27T20:34:15.906 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-07-27T20:34:16.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.116+0000 7ff543fff700 1 Processor -- start 2023-07-27T20:34:16.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.116+0000 7ff543fff700 1 -- start start 2023-07-27T20:34:16.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.117+0000 7ff543fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff53c13b150 0x7ff53c151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:16.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.117+0000 7ff543fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff53c06e140 0x7ff53c0ba310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:16.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.117+0000 7ff543fff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff53c0ba850 0x7ff53c06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:16.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.117+0000 7ff543fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff53c06ce10 con 0x7ff53c13b150 2023-07-27T20:34:16.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.117+0000 7ff543fff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff53c152680 con 0x7ff53c0ba850 2023-07-27T20:34:16.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.117+0000 7ff543fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c152960 con 0x7ff53c06e140 2023-07-27T20:34:16.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.118+0000 7ff541d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff53c13b150 0x7ff53c151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:16.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.118+0000 7ff541d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff53c13b150 0x7ff53c151dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46622/0 (socket says 172.21.15.72:46622) 2023-07-27T20:34:16.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.118+0000 7ff541d9b700 1 -- 172.21.15.72:0/1006955379 learned_addr learned my addr 172.21.15.72:0/1006955379 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:16.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.118+0000 7ff54159a700 1 --2- 172.21.15.72:0/1006955379 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff53c06e140 0x7ff53c0ba310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:16.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.118+0000 7ff54259c700 1 --2- 172.21.15.72:0/1006955379 >> v2:172.21.15.173:3300/0 conn(0x7ff53c0ba850 0x7ff53c06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:16.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.118+0000 7ff541d9b700 1 -- 172.21.15.72:0/1006955379 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff53c06e140 msgr2=0x7ff53c0ba310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:16.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.118+0000 7ff541d9b700 1 --2- 172.21.15.72:0/1006955379 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff53c06e140 0x7ff53c0ba310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:16.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.118+0000 7ff541d9b700 1 -- 172.21.15.72:0/1006955379 >> v2:172.21.15.173:3300/0 conn(0x7ff53c0ba850 msgr2=0x7ff53c06d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:16.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.118+0000 7ff541d9b700 1 --2- 172.21.15.72:0/1006955379 >> v2:172.21.15.173:3300/0 conn(0x7ff53c0ba850 0x7ff53c06d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:16.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.118+0000 7ff541d9b700 1 -- 172.21.15.72:0/1006955379 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53c152c40 con 0x7ff53c13b150 2023-07-27T20:34:16.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.118+0000 7ff54259c700 1 --2- 172.21.15.72:0/1006955379 >> v2:172.21.15.173:3300/0 conn(0x7ff53c0ba850 0x7ff53c06d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:16.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.118+0000 7ff541d9b700 1 --2- 172.21.15.72:0/1006955379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff53c13b150 0x7ff53c151dc0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7ff53c0c0370 tx=0x7ff538009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f55aeb7e72d0afb server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:16.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.119+0000 7ff540d99700 1 -- 172.21.15.72:0/1006955379 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53800b870 con 0x7ff53c13b150 2023-07-27T20:34:16.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.119+0000 7ff540d99700 1 -- 172.21.15.72:0/1006955379 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53800b9d0 con 0x7ff53c13b150 2023-07-27T20:34:16.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.119+0000 7ff540d99700 1 -- 172.21.15.72:0/1006955379 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53800bd60 con 0x7ff53c13b150 2023-07-27T20:34:16.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.120+0000 7ff543fff700 1 -- 172.21.15.72:0/1006955379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff53c13b150 msgr2=0x7ff53c151dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:16.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.120+0000 7ff543fff700 1 --2- 172.21.15.72:0/1006955379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff53c13b150 0x7ff53c151dc0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7ff53c0c0370 tx=0x7ff538009bd0 comp rx=0 tx=0).stop 2023-07-27T20:34:16.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.120+0000 7ff543fff700 1 -- 172.21.15.72:0/1006955379 shutdown_connections 2023-07-27T20:34:16.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.120+0000 7ff543fff700 1 --2- 172.21.15.72:0/1006955379 >> v2:172.21.15.173:3300/0 conn(0x7ff53c0ba850 0x7ff53c06d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:16.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.120+0000 7ff543fff700 1 --2- 172.21.15.72:0/1006955379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff53c13b150 0x7ff53c151dc0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:16.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.120+0000 7ff543fff700 1 --2- 172.21.15.72:0/1006955379 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff53c06e140 0x7ff53c0ba310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:16.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.120+0000 7ff543fff700 1 -- 172.21.15.72:0/1006955379 >> 172.21.15.72:0/1006955379 conn(0x7ff53c06a190 msgr2=0x7ff53c06a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:16.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.120+0000 7ff543fff700 1 -- 172.21.15.72:0/1006955379 shutdown_connections 2023-07-27T20:34:16.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.120+0000 7ff543fff700 1 -- 172.21.15.72:0/1006955379 wait complete. 2023-07-27T20:34:16.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.122+0000 7ff543fff700 1 Processor -- start 2023-07-27T20:34:16.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.122+0000 7ff543fff700 1 -- start start 2023-07-27T20:34:16.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.123+0000 7ff543fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff53c06e140 0x7ff53c14da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:16.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.123+0000 7ff543fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff53c0ba850 0x7ff53c0c3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:16.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.123+0000 7ff543fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff53c13b150 0x7ff53c0709b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:16.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.123+0000 7ff543fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c0720f0 con 0x7ff53c0ba850 2023-07-27T20:34:16.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.123+0000 7ff543fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c14f120 con 0x7ff53c13b150 2023-07-27T20:34:16.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.123+0000 7ff543fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c14eb60 con 0x7ff53c06e140 2023-07-27T20:34:16.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.123+0000 7ff54159a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff53c0ba850 0x7ff53c0c3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:16.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.123+0000 7ff541d9b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff53c06e140 0x7ff53c14da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:16.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.123+0000 7ff541d9b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff53c06e140 0x7ff53c14da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.72:51916/0 (socket says 172.21.15.72:51916) 2023-07-27T20:34:16.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.123+0000 7ff541d9b700 1 -- 172.21.15.72:0/1733642484 learned_addr learned my addr 172.21.15.72:0/1733642484 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:16.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.123+0000 7ff54259c700 1 --2- 172.21.15.72:0/1733642484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff53c13b150 0x7ff53c0709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:16.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.123+0000 7ff54159a700 1 -- 172.21.15.72:0/1733642484 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff53c06e140 msgr2=0x7ff53c14da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:16.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.123+0000 7ff54159a700 1 --2- 172.21.15.72:0/1733642484 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff53c06e140 0x7ff53c14da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:16.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.123+0000 7ff54159a700 1 -- 172.21.15.72:0/1733642484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff53c13b150 msgr2=0x7ff53c0709b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:16.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.123+0000 7ff54159a700 1 --2- 172.21.15.72:0/1733642484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff53c13b150 0x7ff53c0709b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:16.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.123+0000 7ff54159a700 1 -- 172.21.15.72:0/1733642484 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff538009550 con 0x7ff53c0ba850 2023-07-27T20:34:16.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.124+0000 7ff54159a700 1 --2- 172.21.15.72:0/1733642484 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff53c0ba850 0x7ff53c0c3520 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00d5d0 tx=0x7ff52c00d8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:16.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.124+0000 7ff5327fc700 1 -- 172.21.15.72:0/1733642484 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c0125f0 con 0x7ff53c0ba850 2023-07-27T20:34:16.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.124+0000 7ff5327fc700 1 -- 172.21.15.72:0/1733642484 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52c012750 con 0x7ff53c0ba850 2023-07-27T20:34:16.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.124+0000 7ff5327fc700 1 -- 172.21.15.72:0/1733642484 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c012ae0 con 0x7ff53c0ba850 2023-07-27T20:34:16.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.124+0000 7ff543fff700 1 -- 172.21.15.72:0/1733642484 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff53c14ee40 con 0x7ff53c0ba850 2023-07-27T20:34:16.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.124+0000 7ff543fff700 1 -- 172.21.15.72:0/1733642484 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff53c070490 con 0x7ff53c0ba850 2023-07-27T20:34:16.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.125+0000 7ff543fff700 1 -- 172.21.15.72:0/1733642484 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff53c04e470 con 0x7ff53c0ba850 2023-07-27T20:34:16.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.126+0000 7ff5327fc700 1 -- 172.21.15.72:0/1733642484 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff52c012c40 con 0x7ff53c0ba850 2023-07-27T20:34:16.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.127+0000 7ff5327fc700 1 --2- 172.21.15.72:0/1733642484 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff52006ace0 0x7ff52006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:16.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.127+0000 7ff5327fc700 1 -- 172.21.15.72:0/1733642484 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6472+0+0 (secure 0 0 0) 0x7ff52c089730 con 0x7ff53c0ba850 2023-07-27T20:34:16.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.128+0000 7ff541d9b700 1 --2- 172.21.15.72:0/1733642484 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff52006ace0 0x7ff52006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:16.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.128+0000 7ff541d9b700 1 --2- 172.21.15.72:0/1733642484 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff52006ace0 0x7ff52006d1a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff538009130 tx=0x7ff538008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:16.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.132+0000 7ff5327fc700 1 -- 172.21.15.72:0/1733642484 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff52c054630 con 0x7ff53c0ba850 2023-07-27T20:34:16.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.325+0000 7ff543fff700 1 -- 172.21.15.72:0/1733642484 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7ff53c0bfdb0 con 0x7ff53c0ba850 2023-07-27T20:34:16.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.325+0000 7ff5327fc700 1 -- 172.21.15.72:0/1733642484 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v50) v1 ==== 101+0+11 (secure 0 0 0) 0x7ff52c057c50 con 0x7ff53c0ba850 2023-07-27T20:34:16.313 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-27T20:34:16.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.328+0000 7ff543fff700 1 -- 172.21.15.72:0/1733642484 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff52006ace0 msgr2=0x7ff52006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:16.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.328+0000 7ff543fff700 1 --2- 172.21.15.72:0/1733642484 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff52006ace0 0x7ff52006d1a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff538009130 tx=0x7ff538008030 comp rx=0 tx=0).stop 2023-07-27T20:34:16.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.328+0000 7ff543fff700 1 -- 172.21.15.72:0/1733642484 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff53c0ba850 msgr2=0x7ff53c0c3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:16.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.328+0000 7ff543fff700 1 --2- 172.21.15.72:0/1733642484 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff53c0ba850 0x7ff53c0c3520 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00d5d0 tx=0x7ff52c00d8e0 comp rx=0 tx=0).stop 2023-07-27T20:34:16.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.328+0000 7ff543fff700 1 -- 172.21.15.72:0/1733642484 shutdown_connections 2023-07-27T20:34:16.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.328+0000 7ff543fff700 1 --2- 172.21.15.72:0/1733642484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff53c13b150 0x7ff53c0709b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:16.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.328+0000 7ff543fff700 1 --2- 172.21.15.72:0/1733642484 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff52006ace0 0x7ff52006d1a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:16.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.328+0000 7ff543fff700 1 --2- 172.21.15.72:0/1733642484 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff53c06e140 0x7ff53c14da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:16.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.328+0000 7ff543fff700 1 --2- 172.21.15.72:0/1733642484 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff53c0ba850 0x7ff53c0c3520 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:16.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.328+0000 7ff543fff700 1 -- 172.21.15.72:0/1733642484 >> 172.21.15.72:0/1733642484 conn(0x7ff53c06a190 msgr2=0x7ff53c14bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:16.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.328+0000 7ff543fff700 1 -- 172.21.15.72:0/1733642484 shutdown_connections 2023-07-27T20:34:16.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.328+0000 7ff543fff700 1 -- 172.21.15.72:0/1733642484 wait complete. 2023-07-27T20:34:16.333 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T20:34:16.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.542+0000 7fee63fff700 1 Processor -- start 2023-07-27T20:34:16.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.542+0000 7fee63fff700 1 -- start start 2023-07-27T20:34:16.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.543+0000 7fee63fff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fee5c0c4400 0x7fee5c0c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:16.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.543+0000 7fee63fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fee5c1549f0 0x7fee5c1514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:16.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.543+0000 7fee63fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee5c06b710 con 0x7fee5c06b150 2023-07-27T20:34:16.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.543+0000 7fee63fff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee5c1545d0 con 0x7fee5c0c4400 2023-07-27T20:34:16.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.543+0000 7fee63fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c06c860 con 0x7fee5c1549f0 2023-07-27T20:34:16.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.543+0000 7fee6159a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fee5c06b150 0x7fee5c0c4cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51386/0 (socket says 172.21.15.72:51386) 2023-07-27T20:34:16.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.543+0000 7fee6159a700 1 -- 172.21.15.72:0/627487092 learned_addr learned my addr 172.21.15.72:0/627487092 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:16.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.544+0000 7fee61d9b700 1 --2- 172.21.15.72:0/627487092 >> v2:172.21.15.173:3300/0 conn(0x7fee5c0c4400 0x7fee5c0c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:16.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.544+0000 7fee6259c700 1 --2- 172.21.15.72:0/627487092 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fee5c1549f0 0x7fee5c1514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:16.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.544+0000 7fee60d99700 1 -- 172.21.15.72:0/627487092 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1834049703 0 0) 0x7fee5c06b710 con 0x7fee5c06b150 2023-07-27T20:34:16.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.544+0000 7fee60d99700 1 -- 172.21.15.72:0/627487092 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee480035b0 con 0x7fee5c06b150 2023-07-27T20:34:16.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.544+0000 7fee6259c700 1 -- 172.21.15.72:0/627487092 >> v2:172.21.15.173:3300/0 conn(0x7fee5c0c4400 msgr2=0x7fee5c0c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:16.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.544+0000 7fee6259c700 1 --2- 172.21.15.72:0/627487092 >> v2:172.21.15.173:3300/0 conn(0x7fee5c0c4400 0x7fee5c0c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:16.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.544+0000 7fee6259c700 1 -- 172.21.15.72:0/627487092 >> v1:172.21.15.72:6789/0 conn(0x7fee5c06b150 legacy=0x7fee5c0c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:16.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.544+0000 7fee6259c700 1 -- 172.21.15.72:0/627487092 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee5c06b9f0 con 0x7fee5c1549f0 2023-07-27T20:34:16.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.544+0000 7fee6259c700 1 --2- 172.21.15.72:0/627487092 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fee5c1549f0 0x7fee5c1514a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fee54009d90 tx=0x7fee5400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cceea8e35d92515 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:16.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.545+0000 7fee60d99700 1 -- 172.21.15.72:0/627487092 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5400e070 con 0x7fee5c1549f0 2023-07-27T20:34:16.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.545+0000 7fee60d99700 1 -- 172.21.15.72:0/627487092 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5400bb20 con 0x7fee5c1549f0 2023-07-27T20:34:16.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.545+0000 7fee60d99700 1 -- 172.21.15.72:0/627487092 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5400be90 con 0x7fee5c1549f0 2023-07-27T20:34:16.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.545+0000 7fee63fff700 1 -- 172.21.15.72:0/627487092 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fee5c1549f0 msgr2=0x7fee5c1514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:16.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.545+0000 7fee63fff700 1 --2- 172.21.15.72:0/627487092 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fee5c1549f0 0x7fee5c1514a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fee54009d90 tx=0x7fee5400b330 comp rx=0 tx=0).stop 2023-07-27T20:34:16.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.545+0000 7fee63fff700 1 -- 172.21.15.72:0/627487092 shutdown_connections 2023-07-27T20:34:16.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.545+0000 7fee63fff700 1 --2- 172.21.15.72:0/627487092 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fee5c1549f0 0x7fee5c1514a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:16.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.545+0000 7fee63fff700 1 --2- 172.21.15.72:0/627487092 >> v2:172.21.15.173:3300/0 conn(0x7fee5c0c4400 0x7fee5c0c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:16.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.545+0000 7fee63fff700 1 -- 172.21.15.72:0/627487092 >> 172.21.15.72:0/627487092 conn(0x7fee5c0ab300 msgr2=0x7fee5c0ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:16.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.545+0000 7fee63fff700 1 -- 172.21.15.72:0/627487092 shutdown_connections 2023-07-27T20:34:16.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.545+0000 7fee63fff700 1 -- 172.21.15.72:0/627487092 wait complete. 2023-07-27T20:34:16.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.547+0000 7fee63fff700 1 Processor -- start 2023-07-27T20:34:16.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.547+0000 7fee63fff700 1 -- start start 2023-07-27T20:34:16.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.548+0000 7fee63fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee5c06b150 0x7fee5c149d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:16.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.548+0000 7fee63fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee5c0c4400 0x7fee5c14b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:16.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.548+0000 7fee63fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fee5c1549f0 0x7fee5c0aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:16.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.548+0000 7fee63fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c0c2e50 con 0x7fee5c0c4400 2023-07-27T20:34:16.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.548+0000 7fee63fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c0c6060 con 0x7fee5c06b150 2023-07-27T20:34:16.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.548+0000 7fee63fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c0c30d0 con 0x7fee5c1549f0 2023-07-27T20:34:16.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.548+0000 7fee6159a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee5c0c4400 0x7fee5c14b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:16.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.548+0000 7fee6159a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee5c0c4400 0x7fee5c14b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46636/0 (socket says 172.21.15.72:46636) 2023-07-27T20:34:16.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.548+0000 7fee6159a700 1 -- 172.21.15.72:0/3271555108 learned_addr learned my addr 172.21.15.72:0/3271555108 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:16.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.548+0000 7fee6259c700 1 --2- 172.21.15.72:0/3271555108 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fee5c1549f0 0x7fee5c0aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:16.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.548+0000 7fee61d9b700 1 --2- 172.21.15.72:0/3271555108 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee5c06b150 0x7fee5c149d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:16.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.549+0000 7fee6159a700 1 -- 172.21.15.72:0/3271555108 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fee5c1549f0 msgr2=0x7fee5c0aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:16.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.549+0000 7fee6159a700 1 --2- 172.21.15.72:0/3271555108 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fee5c1549f0 0x7fee5c0aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:16.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.549+0000 7fee6159a700 1 -- 172.21.15.72:0/3271555108 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee5c06b150 msgr2=0x7fee5c149d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:16.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.549+0000 7fee6159a700 1 --2- 172.21.15.72:0/3271555108 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee5c06b150 0x7fee5c149d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:16.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.549+0000 7fee6159a700 1 -- 172.21.15.72:0/3271555108 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee54009a70 con 0x7fee5c0c4400 2023-07-27T20:34:16.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.549+0000 7fee6159a700 1 --2- 172.21.15.72:0/3271555108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee5c0c4400 0x7fee5c14b9b0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fee4c00c420 tx=0x7fee4c00c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:16.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.549+0000 7fee527fc700 1 -- 172.21.15.72:0/3271555108 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c005d70 con 0x7fee5c0c4400 2023-07-27T20:34:16.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.549+0000 7fee527fc700 1 -- 172.21.15.72:0/3271555108 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4c00ce30 con 0x7fee5c0c4400 2023-07-27T20:34:16.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.549+0000 7fee63fff700 1 -- 172.21.15.72:0/3271555108 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee5c14e5c0 con 0x7fee5c0c4400 2023-07-27T20:34:16.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.549+0000 7fee527fc700 1 -- 172.21.15.72:0/3271555108 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c0072d0 con 0x7fee5c0c4400 2023-07-27T20:34:16.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.549+0000 7fee63fff700 1 -- 172.21.15.72:0/3271555108 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee5c0aefc0 con 0x7fee5c0c4400 2023-07-27T20:34:16.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.550+0000 7fee63fff700 1 -- 172.21.15.72:0/3271555108 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee5c14eae0 con 0x7fee5c0c4400 2023-07-27T20:34:16.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.551+0000 7fee527fc700 1 -- 172.21.15.72:0/3271555108 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fee4c007430 con 0x7fee5c0c4400 2023-07-27T20:34:16.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.552+0000 7fee527fc700 1 --2- 172.21.15.72:0/3271555108 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fee4006ace0 0x7fee4006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:16.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.552+0000 7fee527fc700 1 -- 172.21.15.72:0/3271555108 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6472+0+0 (secure 0 0 0) 0x7fee4c0887a0 con 0x7fee5c0c4400 2023-07-27T20:34:16.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.553+0000 7fee61d9b700 1 --2- 172.21.15.72:0/3271555108 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fee4006ace0 0x7fee4006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:16.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.553+0000 7fee61d9b700 1 --2- 172.21.15.72:0/3271555108 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fee4006ace0 0x7fee4006d1a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fee58009be0 tx=0x7fee58009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:16.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.556+0000 7fee527fc700 1 -- 172.21.15.72:0/3271555108 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fee5c14eae0 con 0x7fee5c0c4400 2023-07-27T20:34:16.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.793+0000 7fee63fff700 1 -- 172.21.15.72:0/3271555108 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee5c14eae0 con 0x7fee5c0c4400 2023-07-27T20:34:16.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.794+0000 7fee527fc700 1 -- 172.21.15.72:0/3271555108 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4670 (secure 0 0 0) 0x7fee5c14eae0 con 0x7fee5c0c4400 2023-07-27T20:34:16.781 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:34:16.781 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/1685903768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1685903768},{"type":"v1","addr":"172.21.15.173:6836","nonce":1685903768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5269,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/43862591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":43862591},{"type":"v1","addr":"172.21.15.173:6837","nonce":43862591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":6153,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/409311051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":409311051},{"type":"v1","addr":"172.21.15.72:6834","nonce":409311051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T20:33:21.678859+0000","modified":"2023-07-27T20:33:25.206336+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5281":{"gid":5281,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.72:6835/1644610738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1644610738},{"type":"v1","addr":"172.21.15.72:6835","nonce":1644610738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-27T20:34:16.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.796+0000 7fee63fff700 1 -- 172.21.15.72:0/3271555108 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fee4006ace0 msgr2=0x7fee4006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:16.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.796+0000 7fee63fff700 1 --2- 172.21.15.72:0/3271555108 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fee4006ace0 0x7fee4006d1a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fee58009be0 tx=0x7fee58009210 comp rx=0 tx=0).stop 2023-07-27T20:34:16.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.796+0000 7fee63fff700 1 -- 172.21.15.72:0/3271555108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee5c0c4400 msgr2=0x7fee5c14b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:16.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.796+0000 7fee63fff700 1 --2- 172.21.15.72:0/3271555108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee5c0c4400 0x7fee5c14b9b0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fee4c00c420 tx=0x7fee4c00c730 comp rx=0 tx=0).stop 2023-07-27T20:34:16.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.796+0000 7fee63fff700 1 -- 172.21.15.72:0/3271555108 shutdown_connections 2023-07-27T20:34:16.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.796+0000 7fee63fff700 1 --2- 172.21.15.72:0/3271555108 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fee4006ace0 0x7fee4006d1a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:16.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.796+0000 7fee63fff700 1 --2- 172.21.15.72:0/3271555108 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fee5c1549f0 0x7fee5c0aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:16.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.796+0000 7fee63fff700 1 --2- 172.21.15.72:0/3271555108 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee5c06b150 0x7fee5c149d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:16.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.796+0000 7fee63fff700 1 --2- 172.21.15.72:0/3271555108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee5c0c4400 0x7fee5c14b9b0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:16.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.796+0000 7fee63fff700 1 -- 172.21.15.72:0/3271555108 >> 172.21.15.72:0/3271555108 conn(0x7fee5c0ab300 msgr2=0x7fee5c0ab6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:16.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.796+0000 7fee63fff700 1 -- 172.21.15.72:0/3271555108 shutdown_connections 2023-07-27T20:34:16.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:16.796+0000 7fee63fff700 1 -- 172.21.15.72:0/3271555108 wait complete. 2023-07-27T20:34:16.785 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 24 2023-07-27T20:34:16.802 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:34:17.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.013+0000 7fcd281ff700 1 Processor -- start 2023-07-27T20:34:17.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.013+0000 7fcd281ff700 1 -- start start 2023-07-27T20:34:17.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.014+0000 7fcd281ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcd200c3960 0x7fcd200c1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:17.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.014+0000 7fcd281ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcd20150e10 0x7fcd201512c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:17.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.014+0000 7fcd281ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd20070a30 con 0x7fcd200c6ea0 2023-07-27T20:34:17.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.014+0000 7fcd281ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd200c3e80 con 0x7fcd20150e10 2023-07-27T20:34:17.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.014+0000 7fcd281ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd200c2b50 con 0x7fcd200c3960 2023-07-27T20:34:17.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.014+0000 7fcd2679c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcd20150e10 0x7fcd201512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:17.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.014+0000 7fcd25f9b700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fcd200c6ea0 0x7fcd200a9190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.72:51162/0 (socket says 172.21.15.72:51162) 2023-07-27T20:34:17.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.014+0000 7fcd25f9b700 1 -- 172.21.15.72:0/785396755 learned_addr learned my addr 172.21.15.72:0/785396755 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:17.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.014+0000 7fcd2579a700 1 --2- 172.21.15.72:0/785396755 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcd200c3960 0x7fcd200c1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:17.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.015+0000 7fcd24f99700 1 -- 172.21.15.72:0/785396755 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4067508224 0 0) 0x7fcd20070a30 con 0x7fcd200c6ea0 2023-07-27T20:34:17.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.015+0000 7fcd24f99700 1 -- 172.21.15.72:0/785396755 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd0c0035b0 con 0x7fcd200c6ea0 2023-07-27T20:34:17.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.015+0000 7fcd2579a700 1 -- 172.21.15.72:0/785396755 >> v2:172.21.15.72:3300/0 conn(0x7fcd20150e10 msgr2=0x7fcd201512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:17.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.015+0000 7fcd2579a700 1 --2- 172.21.15.72:0/785396755 >> v2:172.21.15.72:3300/0 conn(0x7fcd20150e10 0x7fcd201512c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:17.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.015+0000 7fcd2579a700 1 -- 172.21.15.72:0/785396755 >> v1:172.21.15.173:6789/0 conn(0x7fcd200c6ea0 legacy=0x7fcd200a9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:17.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.015+0000 7fcd2579a700 1 -- 172.21.15.72:0/785396755 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd20070700 con 0x7fcd200c3960 2023-07-27T20:34:17.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.015+0000 7fcd2679c700 1 --2- 172.21.15.72:0/785396755 >> v2:172.21.15.72:3300/0 conn(0x7fcd20150e10 0x7fcd201512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:34:17.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.015+0000 7fcd2579a700 1 --2- 172.21.15.72:0/785396755 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcd200c3960 0x7fcd200c1fb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcd10009870 tx=0x7fcd10009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a97bbade4e665935 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:17.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.015+0000 7fcd24f99700 1 -- 172.21.15.72:0/785396755 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd10011830 con 0x7fcd200c3960 2023-07-27T20:34:17.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.015+0000 7fcd24f99700 1 -- 172.21.15.72:0/785396755 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd10011990 con 0x7fcd200c3960 2023-07-27T20:34:17.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.015+0000 7fcd24f99700 1 -- 172.21.15.72:0/785396755 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd10011d20 con 0x7fcd200c3960 2023-07-27T20:34:17.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.016+0000 7fcd281ff700 1 -- 172.21.15.72:0/785396755 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcd200c3960 msgr2=0x7fcd200c1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:17.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.016+0000 7fcd281ff700 1 --2- 172.21.15.72:0/785396755 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcd200c3960 0x7fcd200c1fb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcd10009870 tx=0x7fcd10009b80 comp rx=0 tx=0).stop 2023-07-27T20:34:17.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.016+0000 7fcd281ff700 1 -- 172.21.15.72:0/785396755 shutdown_connections 2023-07-27T20:34:17.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.016+0000 7fcd281ff700 1 --2- 172.21.15.72:0/785396755 >> v2:172.21.15.72:3300/0 conn(0x7fcd20150e10 0x7fcd201512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:17.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.016+0000 7fcd281ff700 1 --2- 172.21.15.72:0/785396755 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcd200c3960 0x7fcd200c1fb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:17.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.016+0000 7fcd281ff700 1 -- 172.21.15.72:0/785396755 >> 172.21.15.72:0/785396755 conn(0x7fcd2006a7c0 msgr2=0x7fcd200c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:17.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.016+0000 7fcd281ff700 1 -- 172.21.15.72:0/785396755 shutdown_connections 2023-07-27T20:34:17.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.016+0000 7fcd281ff700 1 -- 172.21.15.72:0/785396755 wait complete. 2023-07-27T20:34:17.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.018+0000 7fcd281ff700 1 Processor -- start 2023-07-27T20:34:17.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.018+0000 7fcd281ff700 1 -- start start 2023-07-27T20:34:17.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.019+0000 7fcd281ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcd200c3960 0x7fcd201e6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:17.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.019+0000 7fcd281ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd200c6ea0 0x7fcd201e6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:17.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.019+0000 7fcd281ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd20150e10 0x7fcd201559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:17.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.019+0000 7fcd281ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd200aa9c0 con 0x7fcd20150e10 2023-07-27T20:34:17.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.019+0000 7fcd281ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd200ab900 con 0x7fcd200c6ea0 2023-07-27T20:34:17.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.019+0000 7fcd281ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2014c320 con 0x7fcd200c3960 2023-07-27T20:34:17.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.019+0000 7fcd2679c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd20150e10 0x7fcd201559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:17.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.019+0000 7fcd2679c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd20150e10 0x7fcd201559f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46650/0 (socket says 172.21.15.72:46650) 2023-07-27T20:34:17.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.019+0000 7fcd2679c700 1 -- 172.21.15.72:0/2769909002 learned_addr learned my addr 172.21.15.72:0/2769909002 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:17.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.019+0000 7fcd25f9b700 1 --2- 172.21.15.72:0/2769909002 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcd200c3960 0x7fcd201e6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:17.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.019+0000 7fcd2579a700 1 --2- 172.21.15.72:0/2769909002 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd200c6ea0 0x7fcd201e6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:17.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.020+0000 7fcd2679c700 1 -- 172.21.15.72:0/2769909002 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcd200c3960 msgr2=0x7fcd201e6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:17.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.020+0000 7fcd2679c700 1 --2- 172.21.15.72:0/2769909002 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcd200c3960 0x7fcd201e6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:17.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.020+0000 7fcd2679c700 1 -- 172.21.15.72:0/2769909002 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd200c6ea0 msgr2=0x7fcd201e6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:17.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.020+0000 7fcd2679c700 1 --2- 172.21.15.72:0/2769909002 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd200c6ea0 0x7fcd201e6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:17.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.020+0000 7fcd2679c700 1 -- 172.21.15.72:0/2769909002 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd18009a70 con 0x7fcd20150e10 2023-07-27T20:34:17.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.020+0000 7fcd2679c700 1 --2- 172.21.15.72:0/2769909002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd20150e10 0x7fcd201559f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fcd1800efc0 tx=0x7fcd1800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:17.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.020+0000 7fcd167fc700 1 -- 172.21.15.72:0/2769909002 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1800ca90 con 0x7fcd20150e10 2023-07-27T20:34:17.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.020+0000 7fcd167fc700 1 -- 172.21.15.72:0/2769909002 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1800f040 con 0x7fcd20150e10 2023-07-27T20:34:17.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.020+0000 7fcd281ff700 1 -- 172.21.15.72:0/2769909002 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd100094a0 con 0x7fcd20150e10 2023-07-27T20:34:17.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.020+0000 7fcd167fc700 1 -- 172.21.15.72:0/2769909002 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1800ce10 con 0x7fcd20150e10 2023-07-27T20:34:17.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.020+0000 7fcd281ff700 1 -- 172.21.15.72:0/2769909002 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd201ea2d0 con 0x7fcd20150e10 2023-07-27T20:34:17.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.021+0000 7fcd281ff700 1 -- 172.21.15.72:0/2769909002 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd201e9e50 con 0x7fcd20150e10 2023-07-27T20:34:17.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.022+0000 7fcd167fc700 1 -- 172.21.15.72:0/2769909002 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcd18014480 con 0x7fcd20150e10 2023-07-27T20:34:17.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.023+0000 7fcd167fc700 1 --2- 172.21.15.72:0/2769909002 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcd0406ace0 0x7fcd0406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:17.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.023+0000 7fcd167fc700 1 -- 172.21.15.72:0/2769909002 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6472+0+0 (secure 0 0 0) 0x7fcd18089ce0 con 0x7fcd20150e10 2023-07-27T20:34:17.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.024+0000 7fcd25f9b700 1 --2- 172.21.15.72:0/2769909002 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcd0406ace0 0x7fcd0406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:17.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.025+0000 7fcd25f9b700 1 --2- 172.21.15.72:0/2769909002 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcd0406ace0 0x7fcd0406d1a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c007fd0 tx=0x7fcd1c007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:17.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.027+0000 7fcd167fc700 1 -- 172.21.15.72:0/2769909002 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcd201e9e50 con 0x7fcd20150e10 2023-07-27T20:34:17.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.229+0000 7fcd281ff700 1 -- 172.21.15.72:0/2769909002 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd201e9e50 con 0x7fcd20150e10 2023-07-27T20:34:17.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.230+0000 7fcd167fc700 1 -- 172.21.15.72:0/2769909002 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+18685 (secure 0 0 0) 0x7fcd201e9e50 con 0x7fcd20150e10 2023-07-27T20:34:17.218 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:34:17.218 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":50,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:34:14.161563+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_metadata","create_time":"2023-07-27T20:33:20.125785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs2_data","create_time":"2023-07-27T20:33:20.647929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:6834/1959104268":"2023-07-28T20:34:10.790274+0000","172.21.15.72:6833/1959104268":"2023-07-28T20:34:10.790274+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:34:17.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.232+0000 7fcd281ff700 1 -- 172.21.15.72:0/2769909002 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcd0406ace0 msgr2=0x7fcd0406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:17.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.232+0000 7fcd281ff700 1 --2- 172.21.15.72:0/2769909002 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcd0406ace0 0x7fcd0406d1a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c007fd0 tx=0x7fcd1c007dc0 comp rx=0 tx=0).stop 2023-07-27T20:34:17.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.233+0000 7fcd281ff700 1 -- 172.21.15.72:0/2769909002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd20150e10 msgr2=0x7fcd201559f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:17.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.233+0000 7fcd281ff700 1 --2- 172.21.15.72:0/2769909002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd20150e10 0x7fcd201559f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fcd1800efc0 tx=0x7fcd1800c3a0 comp rx=0 tx=0).stop 2023-07-27T20:34:17.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.233+0000 7fcd281ff700 1 -- 172.21.15.72:0/2769909002 shutdown_connections 2023-07-27T20:34:17.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.233+0000 7fcd281ff700 1 --2- 172.21.15.72:0/2769909002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd20150e10 0x7fcd201559f0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:17.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.233+0000 7fcd281ff700 1 --2- 172.21.15.72:0/2769909002 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fcd0406ace0 0x7fcd0406d1a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:17.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.233+0000 7fcd281ff700 1 --2- 172.21.15.72:0/2769909002 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcd200c3960 0x7fcd201e6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:17.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.233+0000 7fcd281ff700 1 --2- 172.21.15.72:0/2769909002 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd200c6ea0 0x7fcd201e6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:17.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.233+0000 7fcd281ff700 1 -- 172.21.15.72:0/2769909002 >> 172.21.15.72:0/2769909002 conn(0x7fcd2006a7c0 msgr2=0x7fcd2014f300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:17.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.233+0000 7fcd281ff700 1 -- 172.21.15.72:0/2769909002 shutdown_connections 2023-07-27T20:34:17.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.233+0000 7fcd281ff700 1 -- 172.21.15.72:0/2769909002 wait complete. 2023-07-27T20:34:17.238 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-07-27T20:34:17.239 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T20:34:17.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.447+0000 7fc6d27ff700 1 Processor -- start 2023-07-27T20:34:17.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.447+0000 7fc6d27ff700 1 -- start start 2023-07-27T20:34:17.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.448+0000 7fc6d27ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6cc06b150 0x7fc6cc0c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:17.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.448+0000 7fc6d27ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc6cc1549f0 0x7fc6cc1514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:17.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.449+0000 7fc6d27ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6cc06b710 con 0x7fc6cc0c4400 2023-07-27T20:34:17.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.449+0000 7fc6d27ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6cc1545d0 con 0x7fc6cc1549f0 2023-07-27T20:34:17.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.449+0000 7fc6d27ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc06c860 con 0x7fc6cc06b150 2023-07-27T20:34:17.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.449+0000 7fc6cb7fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6cc06b150 0x7fc6cc0c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:17.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.449+0000 7fc6d0d9c700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc6cc1549f0 0x7fc6cc1514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:17.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.449+0000 7fc6cbfff700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fc6cc0c4400 0x7fc6cc0c4cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.72:51176/0 (socket says 172.21.15.72:51176) 2023-07-27T20:34:17.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.449+0000 7fc6cbfff700 1 -- 172.21.15.72:0/2905196503 learned_addr learned my addr 172.21.15.72:0/2905196503 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:17.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.449+0000 7fc6caffd700 1 -- 172.21.15.72:0/2905196503 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1271342252 0 0) 0x7fc6cc06b710 con 0x7fc6cc0c4400 2023-07-27T20:34:17.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.450+0000 7fc6caffd700 1 -- 172.21.15.72:0/2905196503 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6b40035b0 con 0x7fc6cc0c4400 2023-07-27T20:34:17.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.450+0000 7fc6d0d9c700 1 -- 172.21.15.72:0/2905196503 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6cc06b150 msgr2=0x7fc6cc0c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:17.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.450+0000 7fc6d0d9c700 1 --2- 172.21.15.72:0/2905196503 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6cc06b150 0x7fc6cc0c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:17.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.450+0000 7fc6d0d9c700 1 -- 172.21.15.72:0/2905196503 >> v1:172.21.15.173:6789/0 conn(0x7fc6cc0c4400 legacy=0x7fc6cc0c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:17.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.450+0000 7fc6d0d9c700 1 -- 172.21.15.72:0/2905196503 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6cc06b9f0 con 0x7fc6cc1549f0 2023-07-27T20:34:17.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.450+0000 7fc6cb7fe700 1 --2- 172.21.15.72:0/2905196503 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6cc06b150 0x7fc6cc0c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:34:17.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.450+0000 7fc6d0d9c700 1 --2- 172.21.15.72:0/2905196503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6cc1549f0 0x7fc6cc1514a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4009d90 tx=0x7fc6c400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=747ff41426e48986 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:17.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.450+0000 7fc6caffd700 1 -- 172.21.15.72:0/2905196503 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c400e070 con 0x7fc6cc1549f0 2023-07-27T20:34:17.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.450+0000 7fc6caffd700 1 -- 172.21.15.72:0/2905196503 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c400bb20 con 0x7fc6cc1549f0 2023-07-27T20:34:17.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.450+0000 7fc6caffd700 1 -- 172.21.15.72:0/2905196503 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c4012430 con 0x7fc6cc1549f0 2023-07-27T20:34:17.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.451+0000 7fc6d27ff700 1 -- 172.21.15.72:0/2905196503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6cc1549f0 msgr2=0x7fc6cc1514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:17.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.451+0000 7fc6d27ff700 1 --2- 172.21.15.72:0/2905196503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6cc1549f0 0x7fc6cc1514a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4009d90 tx=0x7fc6c400b330 comp rx=0 tx=0).stop 2023-07-27T20:34:17.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.451+0000 7fc6d27ff700 1 -- 172.21.15.72:0/2905196503 shutdown_connections 2023-07-27T20:34:17.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.451+0000 7fc6d27ff700 1 --2- 172.21.15.72:0/2905196503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6cc1549f0 0x7fc6cc1514a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:17.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.451+0000 7fc6d27ff700 1 --2- 172.21.15.72:0/2905196503 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6cc06b150 0x7fc6cc0c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:17.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.451+0000 7fc6d27ff700 1 -- 172.21.15.72:0/2905196503 >> 172.21.15.72:0/2905196503 conn(0x7fc6cc0ab300 msgr2=0x7fc6cc0ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:17.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.451+0000 7fc6d27ff700 1 -- 172.21.15.72:0/2905196503 shutdown_connections 2023-07-27T20:34:17.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.451+0000 7fc6d27ff700 1 -- 172.21.15.72:0/2905196503 wait complete. 2023-07-27T20:34:17.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.453+0000 7fc6d27ff700 1 Processor -- start 2023-07-27T20:34:17.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.453+0000 7fc6d27ff700 1 -- start start 2023-07-27T20:34:17.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.454+0000 7fc6d27ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6cc06b150 0x7fc6cc147820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:17.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.454+0000 7fc6d27ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6cc0c4400 0x7fc6cc1dd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:17.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.454+0000 7fc6d27ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6cc1549f0 0x7fc6cc1ddd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:17.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.454+0000 7fc6d27ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc144620 con 0x7fc6cc06b150 2023-07-27T20:34:17.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.454+0000 7fc6d27ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc0a9640 con 0x7fc6cc1549f0 2023-07-27T20:34:17.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.454+0000 7fc6d27ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc1dc110 con 0x7fc6cc0c4400 2023-07-27T20:34:17.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.454+0000 7fc6cbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6cc06b150 0x7fc6cc147820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:17.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.454+0000 7fc6cbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6cc06b150 0x7fc6cc147820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46656/0 (socket says 172.21.15.72:46656) 2023-07-27T20:34:17.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.454+0000 7fc6cbfff700 1 -- 172.21.15.72:0/858910924 learned_addr learned my addr 172.21.15.72:0/858910924 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:17.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.454+0000 7fc6d0d9c700 1 --2- 172.21.15.72:0/858910924 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6cc1549f0 0x7fc6cc1ddd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:17.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.454+0000 7fc6cb7fe700 1 --2- 172.21.15.72:0/858910924 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6cc0c4400 0x7fc6cc1dd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:17.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.454+0000 7fc6cbfff700 1 -- 172.21.15.72:0/858910924 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6cc0c4400 msgr2=0x7fc6cc1dd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:17.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.454+0000 7fc6cbfff700 1 --2- 172.21.15.72:0/858910924 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6cc0c4400 0x7fc6cc1dd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:17.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.454+0000 7fc6cbfff700 1 -- 172.21.15.72:0/858910924 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6cc1549f0 msgr2=0x7fc6cc1ddd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:17.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.454+0000 7fc6cbfff700 1 --2- 172.21.15.72:0/858910924 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6cc1549f0 0x7fc6cc1ddd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:17.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.454+0000 7fc6cbfff700 1 -- 172.21.15.72:0/858910924 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c00094a0 con 0x7fc6cc06b150 2023-07-27T20:34:17.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.454+0000 7fc6d0d9c700 1 --2- 172.21.15.72:0/858910924 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6cc1549f0 0x7fc6cc1ddd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:17.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.454+0000 7fc6cb7fe700 1 --2- 172.21.15.72:0/858910924 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6cc0c4400 0x7fc6cc1dd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:17.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.455+0000 7fc6cbfff700 1 --2- 172.21.15.72:0/858910924 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6cc06b150 0x7fc6cc147820 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00c730 tx=0x7fc6bc00caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:17.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.455+0000 7fc6c8ff9700 1 -- 172.21.15.72:0/858910924 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc005d70 con 0x7fc6cc06b150 2023-07-27T20:34:17.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.455+0000 7fc6c8ff9700 1 -- 172.21.15.72:0/858910924 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6bc0070d0 con 0x7fc6cc06b150 2023-07-27T20:34:17.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.455+0000 7fc6c8ff9700 1 -- 172.21.15.72:0/858910924 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc007440 con 0x7fc6cc06b150 2023-07-27T20:34:17.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.455+0000 7fc6d27ff700 1 -- 172.21.15.72:0/858910924 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c4009a70 con 0x7fc6cc06b150 2023-07-27T20:34:17.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.455+0000 7fc6d27ff700 1 -- 172.21.15.72:0/858910924 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6cc144840 con 0x7fc6cc06b150 2023-07-27T20:34:17.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.456+0000 7fc6d27ff700 1 -- 172.21.15.72:0/858910924 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6cc144a60 con 0x7fc6cc06b150 2023-07-27T20:34:17.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.457+0000 7fc6c8ff9700 1 -- 172.21.15.72:0/858910924 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc6bc0075a0 con 0x7fc6cc06b150 2023-07-27T20:34:17.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.458+0000 7fc6c8ff9700 1 --2- 172.21.15.72:0/858910924 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc6b806ace0 0x7fc6b806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:17.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.458+0000 7fc6c8ff9700 1 -- 172.21.15.72:0/858910924 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6472+0+0 (secure 0 0 0) 0x7fc6bc088b90 con 0x7fc6cc06b150 2023-07-27T20:34:17.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.458+0000 7fc6cb7fe700 1 --2- 172.21.15.72:0/858910924 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc6b806ace0 0x7fc6b806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:17.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.459+0000 7fc6cb7fe700 1 --2- 172.21.15.72:0/858910924 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc6b806ace0 0x7fc6b806d1a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc0c0570 tx=0x7fc6c0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:17.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.462+0000 7fc6c8ff9700 1 -- 172.21.15.72:0/858910924 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc6bc053a30 con 0x7fc6cc06b150 2023-07-27T20:34:17.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.695+0000 7fc6d27ff700 1 -- 172.21.15.72:0/858910924 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc6cc06a190 con 0x7fc6cc06b150 2023-07-27T20:34:17.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.695+0000 7fc6c8ff9700 1 -- 172.21.15.72:0/858910924 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4670 (secure 0 0 0) 0x7fc6bc057050 con 0x7fc6cc06b150 2023-07-27T20:34:17.683 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:34:17.683 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/1685903768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1685903768},{"type":"v1","addr":"172.21.15.173:6836","nonce":1685903768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5269,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/43862591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":43862591},{"type":"v1","addr":"172.21.15.173:6837","nonce":43862591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":6153,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/409311051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":409311051},{"type":"v1","addr":"172.21.15.72:6834","nonce":409311051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T20:33:21.678859+0000","modified":"2023-07-27T20:33:25.206336+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5281":{"gid":5281,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.72:6835/1644610738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1644610738},{"type":"v1","addr":"172.21.15.72:6835","nonce":1644610738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-27T20:34:17.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.698+0000 7fc6d27ff700 1 -- 172.21.15.72:0/858910924 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc6b806ace0 msgr2=0x7fc6b806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:17.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.698+0000 7fc6d27ff700 1 --2- 172.21.15.72:0/858910924 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc6b806ace0 0x7fc6b806d1a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc0c0570 tx=0x7fc6c0008040 comp rx=0 tx=0).stop 2023-07-27T20:34:17.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.698+0000 7fc6d27ff700 1 -- 172.21.15.72:0/858910924 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6cc06b150 msgr2=0x7fc6cc147820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:17.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.698+0000 7fc6d27ff700 1 --2- 172.21.15.72:0/858910924 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6cc06b150 0x7fc6cc147820 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00c730 tx=0x7fc6bc00caf0 comp rx=0 tx=0).stop 2023-07-27T20:34:17.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.698+0000 7fc6d27ff700 1 -- 172.21.15.72:0/858910924 shutdown_connections 2023-07-27T20:34:17.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.698+0000 7fc6d27ff700 1 --2- 172.21.15.72:0/858910924 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6cc1549f0 0x7fc6cc1ddd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:17.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.698+0000 7fc6d27ff700 1 --2- 172.21.15.72:0/858910924 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6cc06b150 0x7fc6cc147820 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:17.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.698+0000 7fc6d27ff700 1 --2- 172.21.15.72:0/858910924 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc6b806ace0 0x7fc6b806d1a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:17.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.698+0000 7fc6d27ff700 1 --2- 172.21.15.72:0/858910924 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6cc0c4400 0x7fc6cc1dd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:17.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.698+0000 7fc6d27ff700 1 -- 172.21.15.72:0/858910924 >> 172.21.15.72:0/858910924 conn(0x7fc6cc0ab300 msgr2=0x7fc6cc149ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:17.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.698+0000 7fc6d27ff700 1 -- 172.21.15.72:0/858910924 shutdown_connections 2023-07-27T20:34:17.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.698+0000 7fc6d27ff700 1 -- 172.21.15.72:0/858910924 wait complete. 2023-07-27T20:34:17.687 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 24 2023-07-27T20:34:17.703 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T20:34:17.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.911+0000 7fe4423ff700 1 Processor -- start 2023-07-27T20:34:17.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.911+0000 7fe4423ff700 1 -- start start 2023-07-27T20:34:17.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.913+0000 7fe4423ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe43c139f80 0x7fe43c0c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:17.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.913+0000 7fe4423ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe43c0c1810 con 0x7fe43c1542e0 2023-07-27T20:34:17.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.913+0000 7fe4423ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe43c139d40 con 0x7fe43c139960 2023-07-27T20:34:17.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.913+0000 7fe4423ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c0c0ee0 con 0x7fe43c139f80 2023-07-27T20:34:17.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.913+0000 7fe44099c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe43c1542e0 0x7fe43c154730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51394/0 (socket says 172.21.15.72:51394) 2023-07-27T20:34:17.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.913+0000 7fe44099c700 1 -- 172.21.15.72:0/1562338296 learned_addr learned my addr 172.21.15.72:0/1562338296 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:17.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.913+0000 7fe433fff700 1 --2- 172.21.15.72:0/1562338296 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe43c139f80 0x7fe43c0c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:17.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.913+0000 7fe43b7fe700 1 -- 172.21.15.72:0/1562338296 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4233141481 0 0) 0x7fe43c0c1810 con 0x7fe43c1542e0 2023-07-27T20:34:17.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.913+0000 7fe43b7fe700 1 -- 172.21.15.72:0/1562338296 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4280057c0 con 0x7fe43c1542e0 2023-07-27T20:34:17.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.914+0000 7fe43b7fe700 1 -- 172.21.15.72:0/1562338296 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3734401183 0 0) 0x7fe43c139d40 con 0x7fe43c139960 2023-07-27T20:34:17.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.914+0000 7fe43b7fe700 1 -- 172.21.15.72:0/1562338296 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe43c0c1810 con 0x7fe43c139960 2023-07-27T20:34:17.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.914+0000 7fe433fff700 1 -- 172.21.15.72:0/1562338296 >> v1:172.21.15.173:6789/0 conn(0x7fe43c139960 legacy=0x7fe43c0c1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:17.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.914+0000 7fe433fff700 1 -- 172.21.15.72:0/1562338296 >> v1:172.21.15.72:6789/0 conn(0x7fe43c1542e0 legacy=0x7fe43c154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:17.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.914+0000 7fe433fff700 1 -- 172.21.15.72:0/1562338296 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe43c151060 con 0x7fe43c139f80 2023-07-27T20:34:17.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.914+0000 7fe433fff700 1 --2- 172.21.15.72:0/1562338296 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe43c139f80 0x7fe43c0c12d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe424009870 tx=0x7fe424009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=213f033a5ade422a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:17.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.914+0000 7fe43b7fe700 1 -- 172.21.15.72:0/1562338296 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe424011830 con 0x7fe43c139f80 2023-07-27T20:34:17.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.914+0000 7fe43b7fe700 1 -- 172.21.15.72:0/1562338296 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe424011990 con 0x7fe43c139f80 2023-07-27T20:34:17.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.914+0000 7fe43b7fe700 1 -- 172.21.15.72:0/1562338296 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe424011d20 con 0x7fe43c139f80 2023-07-27T20:34:17.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.915+0000 7fe4423ff700 1 -- 172.21.15.72:0/1562338296 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe43c139f80 msgr2=0x7fe43c0c12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:17.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.915+0000 7fe4423ff700 1 --2- 172.21.15.72:0/1562338296 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe43c139f80 0x7fe43c0c12d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe424009870 tx=0x7fe424009b80 comp rx=0 tx=0).stop 2023-07-27T20:34:17.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.915+0000 7fe4423ff700 1 -- 172.21.15.72:0/1562338296 shutdown_connections 2023-07-27T20:34:17.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.915+0000 7fe4423ff700 1 --2- 172.21.15.72:0/1562338296 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe43c139f80 0x7fe43c0c12d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:17.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.915+0000 7fe4423ff700 1 -- 172.21.15.72:0/1562338296 >> 172.21.15.72:0/1562338296 conn(0x7fe43c06a190 msgr2=0x7fe43c06a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:17.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.915+0000 7fe4423ff700 1 -- 172.21.15.72:0/1562338296 shutdown_connections 2023-07-27T20:34:17.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.915+0000 7fe4423ff700 1 -- 172.21.15.72:0/1562338296 wait complete. 2023-07-27T20:34:17.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.917+0000 7fe4423ff700 1 Processor -- start 2023-07-27T20:34:17.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.917+0000 7fe4423ff700 1 -- start start 2023-07-27T20:34:17.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.918+0000 7fe4423ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe43c139960 0x7fe43c150270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:17.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.918+0000 7fe4423ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe43c139f80 0x7fe43c0a9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:17.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.918+0000 7fe4423ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe43c1542e0 0x7fe43c14f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:17.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.918+0000 7fe4423ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c0c0890 con 0x7fe43c139960 2023-07-27T20:34:17.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.918+0000 7fe4423ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c135e30 con 0x7fe43c1542e0 2023-07-27T20:34:17.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.918+0000 7fe4423ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c1507b0 con 0x7fe43c139f80 2023-07-27T20:34:17.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.918+0000 7fe43bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe43c139960 0x7fe43c150270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:17.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.918+0000 7fe43bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe43c139960 0x7fe43c150270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46672/0 (socket says 172.21.15.72:46672) 2023-07-27T20:34:17.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.918+0000 7fe43bfff700 1 -- 172.21.15.72:0/461839231 learned_addr learned my addr 172.21.15.72:0/461839231 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:17.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.918+0000 7fe433fff700 1 --2- 172.21.15.72:0/461839231 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe43c139f80 0x7fe43c0a9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:17.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.918+0000 7fe44099c700 1 --2- 172.21.15.72:0/461839231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe43c1542e0 0x7fe43c14f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:17.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.918+0000 7fe43bfff700 1 -- 172.21.15.72:0/461839231 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe43c139f80 msgr2=0x7fe43c0a9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:17.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.918+0000 7fe43bfff700 1 --2- 172.21.15.72:0/461839231 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe43c139f80 0x7fe43c0a9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:17.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.918+0000 7fe43bfff700 1 -- 172.21.15.72:0/461839231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe43c1542e0 msgr2=0x7fe43c14f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:17.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.918+0000 7fe43bfff700 1 --2- 172.21.15.72:0/461839231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe43c1542e0 0x7fe43c14f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:17.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.918+0000 7fe43bfff700 1 -- 172.21.15.72:0/461839231 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4240094a0 con 0x7fe43c139960 2023-07-27T20:34:17.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.918+0000 7fe43bfff700 1 --2- 172.21.15.72:0/461839231 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe43c139960 0x7fe43c150270 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fe42c00c500 tx=0x7fe42c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:17.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.919+0000 7fe4397fa700 1 -- 172.21.15.72:0/461839231 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c0052d0 con 0x7fe43c139960 2023-07-27T20:34:17.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.919+0000 7fe4397fa700 1 -- 172.21.15.72:0/461839231 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42c005450 con 0x7fe43c139960 2023-07-27T20:34:17.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.919+0000 7fe4423ff700 1 -- 172.21.15.72:0/461839231 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe43c1359a0 con 0x7fe43c139960 2023-07-27T20:34:17.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.919+0000 7fe4397fa700 1 -- 172.21.15.72:0/461839231 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c0038c0 con 0x7fe43c139960 2023-07-27T20:34:17.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.919+0000 7fe4423ff700 1 -- 172.21.15.72:0/461839231 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe43c135350 con 0x7fe43c139960 2023-07-27T20:34:17.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.920+0000 7fe4423ff700 1 -- 172.21.15.72:0/461839231 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe43c135190 con 0x7fe43c139960 2023-07-27T20:34:17.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.921+0000 7fe4397fa700 1 -- 172.21.15.72:0/461839231 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe42c003a20 con 0x7fe43c139960 2023-07-27T20:34:17.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.922+0000 7fe4397fa700 1 --2- 172.21.15.72:0/461839231 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe41c06ace0 0x7fe41c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:17.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.922+0000 7fe4397fa700 1 -- 172.21.15.72:0/461839231 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6472+0+0 (secure 0 0 0) 0x7fe42c088a80 con 0x7fe43c139960 2023-07-27T20:34:17.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.922+0000 7fe433fff700 1 --2- 172.21.15.72:0/461839231 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe41c06ace0 0x7fe41c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:17.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.923+0000 7fe433fff700 1 --2- 172.21.15.72:0/461839231 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe41c06ace0 0x7fe41c06d1a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe4240097c0 tx=0x7fe42401c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:17.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:17.926+0000 7fe4397fa700 1 -- 172.21.15.72:0/461839231 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe42c053a20 con 0x7fe43c139960 2023-07-27T20:34:18.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.160+0000 7fe4423ff700 1 -- 172.21.15.72:0/461839231 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe43c135c80 con 0x7fe43c139960 2023-07-27T20:34:18.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.161+0000 7fe4397fa700 1 -- 172.21.15.72:0/461839231 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4670 (secure 0 0 0) 0x7fe42c057040 con 0x7fe43c139960 2023-07-27T20:34:18.149 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:34:18.149 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/1685903768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1685903768},{"type":"v1","addr":"172.21.15.173:6836","nonce":1685903768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5269,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/43862591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":43862591},{"type":"v1","addr":"172.21.15.173:6837","nonce":43862591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":6153,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/409311051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":409311051},{"type":"v1","addr":"172.21.15.72:6834","nonce":409311051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T20:33:21.678859+0000","modified":"2023-07-27T20:33:25.206336+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5281":{"gid":5281,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.72:6835/1644610738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1644610738},{"type":"v1","addr":"172.21.15.72:6835","nonce":1644610738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-27T20:34:18.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.163+0000 7fe4423ff700 1 -- 172.21.15.72:0/461839231 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe41c06ace0 msgr2=0x7fe41c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:18.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.163+0000 7fe4423ff700 1 --2- 172.21.15.72:0/461839231 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe41c06ace0 0x7fe41c06d1a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe4240097c0 tx=0x7fe42401c040 comp rx=0 tx=0).stop 2023-07-27T20:34:18.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.163+0000 7fe4423ff700 1 -- 172.21.15.72:0/461839231 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe43c139960 msgr2=0x7fe43c150270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:18.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.163+0000 7fe4423ff700 1 --2- 172.21.15.72:0/461839231 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe43c139960 0x7fe43c150270 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fe42c00c500 tx=0x7fe42c00c8c0 comp rx=0 tx=0).stop 2023-07-27T20:34:18.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.163+0000 7fe4423ff700 1 -- 172.21.15.72:0/461839231 shutdown_connections 2023-07-27T20:34:18.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.163+0000 7fe4423ff700 1 --2- 172.21.15.72:0/461839231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe43c1542e0 0x7fe43c14f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:18.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.163+0000 7fe4423ff700 1 --2- 172.21.15.72:0/461839231 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe43c139960 0x7fe43c150270 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:18.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.163+0000 7fe4423ff700 1 --2- 172.21.15.72:0/461839231 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe41c06ace0 0x7fe41c06d1a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:18.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.163+0000 7fe4423ff700 1 --2- 172.21.15.72:0/461839231 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe43c139f80 0x7fe43c0a9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:18.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.163+0000 7fe4423ff700 1 -- 172.21.15.72:0/461839231 >> 172.21.15.72:0/461839231 conn(0x7fe43c06a190 msgr2=0x7fe43c1362b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:18.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.163+0000 7fe4423ff700 1 -- 172.21.15.72:0/461839231 shutdown_connections 2023-07-27T20:34:18.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.163+0000 7fe4423ff700 1 -- 172.21.15.72:0/461839231 wait complete. 2023-07-27T20:34:18.152 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 24 2023-07-27T20:34:18.169 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:34:18.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.379+0000 7f54599ff700 1 Processor -- start 2023-07-27T20:34:18.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.380+0000 7f54599ff700 1 -- start start 2023-07-27T20:34:18.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.381+0000 7f54599ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f545413b2c0 0x7f54540aa420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:18.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.381+0000 7f54599ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54540bfd90 0x7f54540aa960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:18.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.381+0000 7f54599ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f54540a83a0 0x7f54540a8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:18.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.381+0000 7f54599ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54540a9620 con 0x7f54540a83a0 2023-07-27T20:34:18.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.381+0000 7f54599ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54540aaea0 con 0x7f545413b2c0 2023-07-27T20:34:18.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.381+0000 7f54599ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5454155600 con 0x7f54540bfd90 2023-07-27T20:34:18.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.381+0000 7f54537fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f54540a83a0 0x7f54540a8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:18.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.381+0000 7f54537fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f54540a83a0 0x7f54540a8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46682/0 (socket says 172.21.15.72:46682) 2023-07-27T20:34:18.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.381+0000 7f54537fe700 1 -- 172.21.15.72:0/432765183 learned_addr learned my addr 172.21.15.72:0/432765183 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:18.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.381+0000 7f544bfff700 1 --2- 172.21.15.72:0/432765183 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54540bfd90 0x7f54540aa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:18.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.381+0000 7f5452ffd700 1 --2- 172.21.15.72:0/432765183 >> v2:172.21.15.173:3300/0 conn(0x7f545413b2c0 0x7f54540aa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:18.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.381+0000 7f54537fe700 1 -- 172.21.15.72:0/432765183 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54540bfd90 msgr2=0x7f54540aa960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:18.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.381+0000 7f54537fe700 1 --2- 172.21.15.72:0/432765183 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54540bfd90 0x7f54540aa960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:18.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.381+0000 7f54537fe700 1 -- 172.21.15.72:0/432765183 >> v2:172.21.15.173:3300/0 conn(0x7f545413b2c0 msgr2=0x7f54540aa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:18.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.381+0000 7f54537fe700 1 --2- 172.21.15.72:0/432765183 >> v2:172.21.15.173:3300/0 conn(0x7f545413b2c0 0x7f54540aa420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:18.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.382+0000 7f54537fe700 1 -- 172.21.15.72:0/432765183 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5454155320 con 0x7f54540a83a0 2023-07-27T20:34:18.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.382+0000 7f54537fe700 1 --2- 172.21.15.72:0/432765183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54540a83a0 0x7f54540a8820 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f54540c64a0 tx=0x7f544c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4147951e0000be3b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:18.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.382+0000 7f54527fc700 1 -- 172.21.15.72:0/432765183 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c00e070 con 0x7f54540a83a0 2023-07-27T20:34:18.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.382+0000 7f54527fc700 1 -- 172.21.15.72:0/432765183 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544c00b9c0 con 0x7f54540a83a0 2023-07-27T20:34:18.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.382+0000 7f54527fc700 1 -- 172.21.15.72:0/432765183 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c00bd70 con 0x7f54540a83a0 2023-07-27T20:34:18.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.382+0000 7f54599ff700 1 -- 172.21.15.72:0/432765183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54540a83a0 msgr2=0x7f54540a8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:18.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.382+0000 7f54599ff700 1 --2- 172.21.15.72:0/432765183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54540a83a0 0x7f54540a8820 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f54540c64a0 tx=0x7f544c00b330 comp rx=0 tx=0).stop 2023-07-27T20:34:18.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.383+0000 7f54599ff700 1 -- 172.21.15.72:0/432765183 shutdown_connections 2023-07-27T20:34:18.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.383+0000 7f54599ff700 1 --2- 172.21.15.72:0/432765183 >> v2:172.21.15.173:3300/0 conn(0x7f545413b2c0 0x7f54540aa420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:18.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.383+0000 7f54599ff700 1 --2- 172.21.15.72:0/432765183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54540a83a0 0x7f54540a8820 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:18.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.383+0000 7f54599ff700 1 --2- 172.21.15.72:0/432765183 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54540bfd90 0x7f54540aa960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:18.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.383+0000 7f54599ff700 1 -- 172.21.15.72:0/432765183 >> 172.21.15.72:0/432765183 conn(0x7f545406a190 msgr2=0x7f545406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:18.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.383+0000 7f54599ff700 1 -- 172.21.15.72:0/432765183 shutdown_connections 2023-07-27T20:34:18.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.383+0000 7f54599ff700 1 -- 172.21.15.72:0/432765183 wait complete. 2023-07-27T20:34:18.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.384+0000 7f54599ff700 1 Processor -- start 2023-07-27T20:34:18.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.385+0000 7f54599ff700 1 -- start start 2023-07-27T20:34:18.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.385+0000 7f54599ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54540a83a0 0x7f54540be990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:18.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.385+0000 7f54599ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54540bfd90 0x7f5454071a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:18.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.386+0000 7f54599ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f545413b2c0 0x7f5454137b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:18.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.386+0000 7f54599ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54541ea960 con 0x7f54540bfd90 2023-07-27T20:34:18.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.386+0000 7f54599ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54541e9d50 con 0x7f54540a83a0 2023-07-27T20:34:18.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.386+0000 7f54599ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54541ea030 con 0x7f545413b2c0 2023-07-27T20:34:18.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.386+0000 7f544bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54540bfd90 0x7f5454071a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:18.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.386+0000 7f544bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54540bfd90 0x7f5454071a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46692/0 (socket says 172.21.15.72:46692) 2023-07-27T20:34:18.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.386+0000 7f544bfff700 1 -- 172.21.15.72:0/1674827219 learned_addr learned my addr 172.21.15.72:0/1674827219 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:18.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.386+0000 7f5452ffd700 1 --2- 172.21.15.72:0/1674827219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54540a83a0 0x7f54540be990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:18.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.386+0000 7f544bfff700 1 -- 172.21.15.72:0/1674827219 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f545413b2c0 msgr2=0x7f5454137b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:18.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.386+0000 7f544bfff700 1 --2- 172.21.15.72:0/1674827219 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f545413b2c0 0x7f5454137b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:18.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.386+0000 7f544bfff700 1 -- 172.21.15.72:0/1674827219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54540a83a0 msgr2=0x7f54540be990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:18.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.386+0000 7f544bfff700 1 --2- 172.21.15.72:0/1674827219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54540a83a0 0x7f54540be990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:18.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.386+0000 7f544bfff700 1 -- 172.21.15.72:0/1674827219 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f544c009b30 con 0x7f54540bfd90 2023-07-27T20:34:18.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.386+0000 7f5452ffd700 1 --2- 172.21.15.72:0/1674827219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54540a83a0 0x7f54540be990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:18.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.386+0000 7f544bfff700 1 --2- 172.21.15.72:0/1674827219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54540bfd90 0x7f5454071a90 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f543c00e7e0 tx=0x7f543c00eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:18.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.387+0000 7f5450ff9700 1 -- 172.21.15.72:0/1674827219 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543c013610 con 0x7f54540bfd90 2023-07-27T20:34:18.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.387+0000 7f5450ff9700 1 -- 172.21.15.72:0/1674827219 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f543c013770 con 0x7f54540bfd90 2023-07-27T20:34:18.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.387+0000 7f54599ff700 1 -- 172.21.15.72:0/1674827219 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54541ea310 con 0x7f54540bfd90 2023-07-27T20:34:18.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.387+0000 7f5450ff9700 1 -- 172.21.15.72:0/1674827219 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543c013b00 con 0x7f54540bfd90 2023-07-27T20:34:18.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.387+0000 7f54599ff700 1 -- 172.21.15.72:0/1674827219 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54540beed0 con 0x7f54540bfd90 2023-07-27T20:34:18.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.388+0000 7f54599ff700 1 -- 172.21.15.72:0/1674827219 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54540c13d0 con 0x7f54540bfd90 2023-07-27T20:34:18.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.389+0000 7f5450ff9700 1 -- 172.21.15.72:0/1674827219 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f543c013c60 con 0x7f54540bfd90 2023-07-27T20:34:18.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.390+0000 7f5450ff9700 1 --2- 172.21.15.72:0/1674827219 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f543406ace0 0x7f543406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:18.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.390+0000 7f5450ff9700 1 -- 172.21.15.72:0/1674827219 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6472+0+0 (secure 0 0 0) 0x7f543c089190 con 0x7f54540bfd90 2023-07-27T20:34:18.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.390+0000 7f5452ffd700 1 --2- 172.21.15.72:0/1674827219 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f543406ace0 0x7f543406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:18.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.391+0000 7f5452ffd700 1 --2- 172.21.15.72:0/1674827219 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f543406ace0 0x7f543406d1a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5444009820 tx=0x7f5444008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:18.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.394+0000 7f5450ff9700 1 -- 172.21.15.72:0/1674827219 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f54540c13d0 con 0x7f54540bfd90 2023-07-27T20:34:18.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.594+0000 7f54599ff700 1 -- 172.21.15.72:0/1674827219 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54540c13d0 con 0x7f54540bfd90 2023-07-27T20:34:18.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.595+0000 7f5450ff9700 1 -- 172.21.15.72:0/1674827219 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+18685 (secure 0 0 0) 0x7f54540c13d0 con 0x7f54540bfd90 2023-07-27T20:34:18.583 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:34:18.583 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":50,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:34:14.161563+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_metadata","create_time":"2023-07-27T20:33:20.125785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs2_data","create_time":"2023-07-27T20:33:20.647929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:6834/1959104268":"2023-07-28T20:34:10.790274+0000","172.21.15.72:6833/1959104268":"2023-07-28T20:34:10.790274+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:34:18.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.597+0000 7f54599ff700 1 -- 172.21.15.72:0/1674827219 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f543406ace0 msgr2=0x7f543406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:18.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.597+0000 7f54599ff700 1 --2- 172.21.15.72:0/1674827219 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f543406ace0 0x7f543406d1a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5444009820 tx=0x7f5444008040 comp rx=0 tx=0).stop 2023-07-27T20:34:18.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.597+0000 7f54599ff700 1 -- 172.21.15.72:0/1674827219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54540bfd90 msgr2=0x7f5454071a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:18.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.597+0000 7f54599ff700 1 --2- 172.21.15.72:0/1674827219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54540bfd90 0x7f5454071a90 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f543c00e7e0 tx=0x7f543c00eba0 comp rx=0 tx=0).stop 2023-07-27T20:34:18.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.597+0000 7f54599ff700 1 -- 172.21.15.72:0/1674827219 shutdown_connections 2023-07-27T20:34:18.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.597+0000 7f54599ff700 1 --2- 172.21.15.72:0/1674827219 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f543406ace0 0x7f543406d1a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:18.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.597+0000 7f54599ff700 1 --2- 172.21.15.72:0/1674827219 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f545413b2c0 0x7f5454137b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:18.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.597+0000 7f54599ff700 1 --2- 172.21.15.72:0/1674827219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54540a83a0 0x7f54540be990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:18.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.597+0000 7f54599ff700 1 --2- 172.21.15.72:0/1674827219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54540bfd90 0x7f5454071a90 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:18.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.597+0000 7f54599ff700 1 -- 172.21.15.72:0/1674827219 >> 172.21.15.72:0/1674827219 conn(0x7f545406a190 msgr2=0x7f5454154ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:18.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.597+0000 7f54599ff700 1 -- 172.21.15.72:0/1674827219 shutdown_connections 2023-07-27T20:34:18.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.598+0000 7f54599ff700 1 -- 172.21.15.72:0/1674827219 wait complete. 2023-07-27T20:34:18.603 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-07-27T20:34:18.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.811+0000 7f83c8fff700 1 Processor -- start 2023-07-27T20:34:18.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.812+0000 7f83c8fff700 1 -- start start 2023-07-27T20:34:18.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.813+0000 7f83c8fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f83c40c4400 0x7f83c40c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:18.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.813+0000 7f83c8fff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f83c406b150 0x7f83c40c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:18.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.813+0000 7f83c8fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f83c41549f0 0x7f83c41514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:18.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.813+0000 7f83c8fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83c41545d0 con 0x7f83c41549f0 2023-07-27T20:34:18.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.813+0000 7f83c8fff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83c406c860 con 0x7f83c406b150 2023-07-27T20:34:18.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.813+0000 7f83c8fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c40c5230 con 0x7f83c40c4400 2023-07-27T20:34:18.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.814+0000 7f83c2d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f83c41549f0 0x7f83c41514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:18.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.814+0000 7f83c2d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f83c41549f0 0x7f83c41514a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46694/0 (socket says 172.21.15.72:46694) 2023-07-27T20:34:18.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.814+0000 7f83c2d9d700 1 -- 172.21.15.72:0/148677648 learned_addr learned my addr 172.21.15.72:0/148677648 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:18.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.814+0000 7f83c259c700 1 --2- 172.21.15.72:0/148677648 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f83c40c4400 0x7f83c40c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:18.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.814+0000 7f83bbfff700 1 --2- 172.21.15.72:0/148677648 >> v2:172.21.15.173:3300/0 conn(0x7f83c406b150 0x7f83c40c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:18.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.814+0000 7f83c2d9d700 1 -- 172.21.15.72:0/148677648 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f83c40c4400 msgr2=0x7f83c40c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:18.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.814+0000 7f83c2d9d700 1 --2- 172.21.15.72:0/148677648 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f83c40c4400 0x7f83c40c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:18.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.814+0000 7f83c2d9d700 1 -- 172.21.15.72:0/148677648 >> v2:172.21.15.173:3300/0 conn(0x7f83c406b150 msgr2=0x7f83c40c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:18.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.814+0000 7f83c2d9d700 1 --2- 172.21.15.72:0/148677648 >> v2:172.21.15.173:3300/0 conn(0x7f83c406b150 0x7f83c40c4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:18.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.814+0000 7f83c2d9d700 1 -- 172.21.15.72:0/148677648 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c406b710 con 0x7f83c41549f0 2023-07-27T20:34:18.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.814+0000 7f83c2d9d700 1 --2- 172.21.15.72:0/148677648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83c41549f0 0x7f83c41514a0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f83c408b480 tx=0x7f83bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b1d183939d0d7c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:18.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.814+0000 7f83c1d9b700 1 -- 172.21.15.72:0/148677648 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc00e070 con 0x7f83c41549f0 2023-07-27T20:34:18.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.815+0000 7f83c1d9b700 1 -- 172.21.15.72:0/148677648 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83bc00b9c0 con 0x7f83c41549f0 2023-07-27T20:34:18.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.815+0000 7f83c1d9b700 1 -- 172.21.15.72:0/148677648 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc00bd70 con 0x7f83c41549f0 2023-07-27T20:34:18.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.815+0000 7f83c8fff700 1 -- 172.21.15.72:0/148677648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83c41549f0 msgr2=0x7f83c41514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:18.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.815+0000 7f83c8fff700 1 --2- 172.21.15.72:0/148677648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83c41549f0 0x7f83c41514a0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f83c408b480 tx=0x7f83bc00b330 comp rx=0 tx=0).stop 2023-07-27T20:34:18.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.815+0000 7f83c8fff700 1 -- 172.21.15.72:0/148677648 shutdown_connections 2023-07-27T20:34:18.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.815+0000 7f83c8fff700 1 --2- 172.21.15.72:0/148677648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83c41549f0 0x7f83c41514a0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:18.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.815+0000 7f83c8fff700 1 --2- 172.21.15.72:0/148677648 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f83c40c4400 0x7f83c40c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:18.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.815+0000 7f83c8fff700 1 --2- 172.21.15.72:0/148677648 >> v2:172.21.15.173:3300/0 conn(0x7f83c406b150 0x7f83c40c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:18.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.815+0000 7f83c8fff700 1 -- 172.21.15.72:0/148677648 >> 172.21.15.72:0/148677648 conn(0x7f83c40ab300 msgr2=0x7f83c40ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:18.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.815+0000 7f83c8fff700 1 -- 172.21.15.72:0/148677648 shutdown_connections 2023-07-27T20:34:18.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.815+0000 7f83c8fff700 1 -- 172.21.15.72:0/148677648 wait complete. 2023-07-27T20:34:18.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.817+0000 7f83c8fff700 1 Processor -- start 2023-07-27T20:34:18.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.817+0000 7f83c8fff700 1 -- start start 2023-07-27T20:34:18.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.818+0000 7f83c8fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83c406b150 0x7f83c414aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:18.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.818+0000 7f83c8fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f83c40c4400 0x7f83c41dd970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:18.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.818+0000 7f83c8fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f83c41549f0 0x7f83c41e9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:18.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.818+0000 7f83c8fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c4147840 con 0x7f83c406b150 2023-07-27T20:34:18.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.818+0000 7f83c8fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c41de4a0 con 0x7f83c40c4400 2023-07-27T20:34:18.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.818+0000 7f83c8fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c41ed030 con 0x7f83c41549f0 2023-07-27T20:34:18.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.818+0000 7f83c259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83c406b150 0x7f83c414aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:18.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.818+0000 7f83c259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83c406b150 0x7f83c414aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46698/0 (socket says 172.21.15.72:46698) 2023-07-27T20:34:18.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.818+0000 7f83c259c700 1 -- 172.21.15.72:0/1259730669 learned_addr learned my addr 172.21.15.72:0/1259730669 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:18.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.818+0000 7f83c259c700 1 -- 172.21.15.72:0/1259730669 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f83c41549f0 msgr2=0x7f83c41e9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:18.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.818+0000 7f83c259c700 1 --2- 172.21.15.72:0/1259730669 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f83c41549f0 0x7f83c41e9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:18.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.818+0000 7f83c259c700 1 -- 172.21.15.72:0/1259730669 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f83c40c4400 msgr2=0x7f83c41dd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:18.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.818+0000 7f83c259c700 1 --2- 172.21.15.72:0/1259730669 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f83c40c4400 0x7f83c41dd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:18.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.818+0000 7f83c259c700 1 -- 172.21.15.72:0/1259730669 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83bc009b30 con 0x7f83c406b150 2023-07-27T20:34:18.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.819+0000 7f83c259c700 1 --2- 172.21.15.72:0/1259730669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83c406b150 0x7f83c414aa50 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f83b400e810 tx=0x7f83b400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:18.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.819+0000 7f83baffd700 1 -- 172.21.15.72:0/1259730669 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b4013610 con 0x7f83c406b150 2023-07-27T20:34:18.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.819+0000 7f83baffd700 1 -- 172.21.15.72:0/1259730669 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b4013770 con 0x7f83c406b150 2023-07-27T20:34:18.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.819+0000 7f83c8fff700 1 -- 172.21.15.72:0/1259730669 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c41eca20 con 0x7f83c406b150 2023-07-27T20:34:18.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.819+0000 7f83baffd700 1 -- 172.21.15.72:0/1259730669 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b4013b20 con 0x7f83c406b150 2023-07-27T20:34:18.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.819+0000 7f83c8fff700 1 -- 172.21.15.72:0/1259730669 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c41eccc0 con 0x7f83c406b150 2023-07-27T20:34:18.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.820+0000 7f83c8fff700 1 -- 172.21.15.72:0/1259730669 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c41ec880 con 0x7f83c406b150 2023-07-27T20:34:18.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.821+0000 7f83baffd700 1 -- 172.21.15.72:0/1259730669 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f83b4013c80 con 0x7f83c406b150 2023-07-27T20:34:18.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.822+0000 7f83baffd700 1 --2- 172.21.15.72:0/1259730669 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f83a406ace0 0x7f83a406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:18.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.822+0000 7f83baffd700 1 -- 172.21.15.72:0/1259730669 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6472+0+0 (secure 0 0 0) 0x7f83b4089370 con 0x7f83c406b150 2023-07-27T20:34:18.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.822+0000 7f83bbfff700 1 --2- 172.21.15.72:0/1259730669 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f83a406ace0 0x7f83a406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:18.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.823+0000 7f83bbfff700 1 --2- 172.21.15.72:0/1259730669 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f83a406ace0 0x7f83a406d1a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f83c41ea440 tx=0x7f83ac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:18.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:18.826+0000 7f83baffd700 1 -- 172.21.15.72:0/1259730669 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f83c41ec880 con 0x7f83c406b150 2023-07-27T20:34:19.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.062+0000 7f83c8fff700 1 -- 172.21.15.72:0/1259730669 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7f83c41ec880 con 0x7f83c406b150 2023-07-27T20:34:19.050 INFO:tasks.ceph.mon.a.smithi072.stderr:2023-07-27T20:34:19.063+0000 7f82f93f4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-27T20:34:19.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.068+0000 7f83baffd700 1 -- 172.21.15.72:0/1259730669 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) v1 ==== 163+0+0 (secure 0 0 0) 0x7f83c41ec880 con 0x7f83c406b150 2023-07-27T20:34:19.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.071+0000 7f83c8fff700 1 -- 172.21.15.72:0/1259730669 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f83a406ace0 msgr2=0x7f83a406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:19.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.072+0000 7f83c8fff700 1 --2- 172.21.15.72:0/1259730669 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f83a406ace0 0x7f83a406d1a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f83c41ea440 tx=0x7f83ac008040 comp rx=0 tx=0).stop 2023-07-27T20:34:19.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.072+0000 7f83c8fff700 1 -- 172.21.15.72:0/1259730669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83c406b150 msgr2=0x7f83c414aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:19.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.072+0000 7f83c8fff700 1 --2- 172.21.15.72:0/1259730669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83c406b150 0x7f83c414aa50 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f83b400e810 tx=0x7f83b400ebd0 comp rx=0 tx=0).stop 2023-07-27T20:34:19.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.072+0000 7f83c8fff700 1 -- 172.21.15.72:0/1259730669 shutdown_connections 2023-07-27T20:34:19.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.072+0000 7f83c8fff700 1 --2- 172.21.15.72:0/1259730669 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f83a406ace0 0x7f83a406d1a0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:19.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.072+0000 7f83c8fff700 1 --2- 172.21.15.72:0/1259730669 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f83c41549f0 0x7f83c41e9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:19.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.072+0000 7f83c8fff700 1 --2- 172.21.15.72:0/1259730669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83c406b150 0x7f83c414aa50 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:19.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.072+0000 7f83c8fff700 1 --2- 172.21.15.72:0/1259730669 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f83c40c4400 0x7f83c41dd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:19.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.072+0000 7f83c8fff700 1 -- 172.21.15.72:0/1259730669 >> 172.21.15.72:0/1259730669 conn(0x7f83c40ab300 msgr2=0x7f83c40730d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:19.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.072+0000 7f83c8fff700 1 -- 172.21.15.72:0/1259730669 shutdown_connections 2023-07-27T20:34:19.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.072+0000 7f83c8fff700 1 -- 172.21.15.72:0/1259730669 wait complete. 2023-07-27T20:34:19.061 INFO:teuthology.orchestra.run.smithi072.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-27T20:34:19.063 INFO:tasks.ceph.mds.a.smithi072.stderr: -1882> 2023-07-27T20:33:23.477+0000 7f34821f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-27T20:34:19.078 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-07-27T20:34:19.110 INFO:tasks.ceph.mds.a.smithi072.stdout:starting mds.a at 2023-07-27T20:34:19.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.293+0000 7f40cf59e700 1 Processor -- start 2023-07-27T20:34:19.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.293+0000 7f40cf59e700 1 -- start start 2023-07-27T20:34:19.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.294+0000 7f40cf59e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f40d0154990 0x7f40d00c6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:19.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.294+0000 7f40cf59e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40d00c7650 con 0x7f40d006cef0 2023-07-27T20:34:19.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.294+0000 7f40cf59e700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40d00c4970 con 0x7f40d00c6160 2023-07-27T20:34:19.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.294+0000 7f40cf59e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d0154e20 con 0x7f40d0154990 2023-07-27T20:34:19.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.294+0000 7f40cdd9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f40d006cef0 0x7f40d015c880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51410/0 (socket says 172.21.15.72:51410) 2023-07-27T20:34:19.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.294+0000 7f40cdd9b700 1 -- 172.21.15.72:0/341724864 learned_addr learned my addr 172.21.15.72:0/341724864 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:19.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.294+0000 7f40ced9d700 1 --2- 172.21.15.72:0/341724864 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f40d0154990 0x7f40d00c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:19.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.295+0000 7f40cd59a700 1 -- 172.21.15.72:0/341724864 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3249654413 0 0) 0x7f40d00c7650 con 0x7f40d006cef0 2023-07-27T20:34:19.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.295+0000 7f40cd59a700 1 -- 172.21.15.72:0/341724864 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40b80035b0 con 0x7f40d006cef0 2023-07-27T20:34:19.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.295+0000 7f40cd59a700 1 -- 172.21.15.72:0/341724864 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1373562820 0 0) 0x7f40d00c4970 con 0x7f40d00c6160 2023-07-27T20:34:19.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.295+0000 7f40cd59a700 1 -- 172.21.15.72:0/341724864 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40d00c7650 con 0x7f40d00c6160 2023-07-27T20:34:19.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.295+0000 7f40ced9d700 1 -- 172.21.15.72:0/341724864 >> v1:172.21.15.173:6789/0 conn(0x7f40d00c6160 legacy=0x7f40d0157500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:19.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.295+0000 7f40ced9d700 1 -- 172.21.15.72:0/341724864 >> v1:172.21.15.72:6789/0 conn(0x7f40d006cef0 legacy=0x7f40d015c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:19.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.295+0000 7f40ced9d700 1 -- 172.21.15.72:0/341724864 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d00c78a0 con 0x7f40d0154990 2023-07-27T20:34:19.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.295+0000 7f40ced9d700 1 --2- 172.21.15.72:0/341724864 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f40d0154990 0x7f40d00c6540 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f40c8009dc0 tx=0x7f40c800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42dcb687c53564d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:19.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.295+0000 7f40cd59a700 1 -- 172.21.15.72:0/341724864 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c800e070 con 0x7f40d0154990 2023-07-27T20:34:19.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.296+0000 7f40cd59a700 1 -- 172.21.15.72:0/341724864 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c800bb20 con 0x7f40d0154990 2023-07-27T20:34:19.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.296+0000 7f40cd59a700 1 -- 172.21.15.72:0/341724864 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c8012430 con 0x7f40d0154990 2023-07-27T20:34:19.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.296+0000 7f40cf59e700 1 -- 172.21.15.72:0/341724864 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f40d0154990 msgr2=0x7f40d00c6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:19.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.296+0000 7f40cf59e700 1 --2- 172.21.15.72:0/341724864 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f40d0154990 0x7f40d00c6540 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f40c8009dc0 tx=0x7f40c800b330 comp rx=0 tx=0).stop 2023-07-27T20:34:19.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.296+0000 7f40cf59e700 1 -- 172.21.15.72:0/341724864 shutdown_connections 2023-07-27T20:34:19.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.296+0000 7f40cf59e700 1 --2- 172.21.15.72:0/341724864 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f40d0154990 0x7f40d00c6540 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:19.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.296+0000 7f40cf59e700 1 -- 172.21.15.72:0/341724864 >> 172.21.15.72:0/341724864 conn(0x7f40d00ab340 msgr2=0x7f40d00ab720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:19.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.296+0000 7f40cf59e700 1 -- 172.21.15.72:0/341724864 shutdown_connections 2023-07-27T20:34:19.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.296+0000 7f40cf59e700 1 -- 172.21.15.72:0/341724864 wait complete. 2023-07-27T20:34:19.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.298+0000 7f40cf59e700 1 Processor -- start 2023-07-27T20:34:19.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.298+0000 7f40cf59e700 1 -- start start 2023-07-27T20:34:19.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.299+0000 7f40cf59e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f40d006cef0 0x7f40d01ecea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:19.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.299+0000 7f40cf59e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40d00c6160 0x7f40d01e98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:19.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.299+0000 7f40cf59e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40d0154990 0x7f40d0157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:19.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.299+0000 7f40cf59e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d00afd90 con 0x7f40d0154990 2023-07-27T20:34:19.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.299+0000 7f40cf59e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d0157db0 con 0x7f40d00c6160 2023-07-27T20:34:19.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.299+0000 7f40cf59e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d0157fe0 con 0x7f40d006cef0 2023-07-27T20:34:19.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.299+0000 7f40ced9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40d0154990 0x7f40d0157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:19.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.299+0000 7f40ced9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40d0154990 0x7f40d0157870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46738/0 (socket says 172.21.15.72:46738) 2023-07-27T20:34:19.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.299+0000 7f40ced9d700 1 -- 172.21.15.72:0/352887427 learned_addr learned my addr 172.21.15.72:0/352887427 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:19.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.299+0000 7f40ce59c700 1 --2- 172.21.15.72:0/352887427 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f40d006cef0 0x7f40d01ecea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:19.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.299+0000 7f40cdd9b700 1 --2- 172.21.15.72:0/352887427 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40d00c6160 0x7f40d01e98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:19.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.299+0000 7f40ced9d700 1 -- 172.21.15.72:0/352887427 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f40d006cef0 msgr2=0x7f40d01ecea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:19.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.299+0000 7f40ced9d700 1 --2- 172.21.15.72:0/352887427 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f40d006cef0 0x7f40d01ecea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:19.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.299+0000 7f40ced9d700 1 -- 172.21.15.72:0/352887427 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40d00c6160 msgr2=0x7f40d01e98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:19.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.299+0000 7f40ced9d700 1 --2- 172.21.15.72:0/352887427 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40d00c6160 0x7f40d01e98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:19.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.299+0000 7f40ced9d700 1 -- 172.21.15.72:0/352887427 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c8009a70 con 0x7f40d0154990 2023-07-27T20:34:19.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.299+0000 7f40ce59c700 1 --2- 172.21.15.72:0/352887427 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f40d006cef0 0x7f40d01ecea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:19.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.300+0000 7f40ced9d700 1 --2- 172.21.15.72:0/352887427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40d0154990 0x7f40d0157870 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f40d00a9090 tx=0x7f40c8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:19.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.300+0000 7f40beffd700 1 -- 172.21.15.72:0/352887427 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c801c810 con 0x7f40d0154990 2023-07-27T20:34:19.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.300+0000 7f40beffd700 1 -- 172.21.15.72:0/352887427 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c8020070 con 0x7f40d0154990 2023-07-27T20:34:19.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.300+0000 7f40cf59e700 1 -- 172.21.15.72:0/352887427 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d01ec3c0 con 0x7f40d0154990 2023-07-27T20:34:19.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.300+0000 7f40beffd700 1 -- 172.21.15.72:0/352887427 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c801cbd0 con 0x7f40d0154990 2023-07-27T20:34:19.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.300+0000 7f40cf59e700 1 -- 172.21.15.72:0/352887427 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d01582c0 con 0x7f40d0154990 2023-07-27T20:34:19.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.301+0000 7f40cf59e700 1 -- 172.21.15.72:0/352887427 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d01ecbc0 con 0x7f40d0154990 2023-07-27T20:34:19.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.302+0000 7f40beffd700 1 -- 172.21.15.72:0/352887427 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f40c801cd30 con 0x7f40d0154990 2023-07-27T20:34:19.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.303+0000 7f40beffd700 1 --2- 172.21.15.72:0/352887427 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f40b006ace0 0x7f40b006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:19.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.303+0000 7f40beffd700 1 -- 172.21.15.72:0/352887427 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6558+0+0 (secure 0 0 0) 0x7f40c8022070 con 0x7f40d0154990 2023-07-27T20:34:19.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.303+0000 7f40ce59c700 1 --2- 172.21.15.72:0/352887427 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f40b006ace0 0x7f40b006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:19.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.304+0000 7f40ce59c700 1 --2- 172.21.15.72:0/352887427 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f40b006ace0 0x7f40b006d1a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f40c0007fd0 tx=0x7f40c0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:19.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.307+0000 7f40beffd700 1 -- 172.21.15.72:0/352887427 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f40c8056cf0 con 0x7f40d0154990 2023-07-27T20:34:19.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:19.543+0000 7f40cf59e700 1 -- 172.21.15.72:0/352887427 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f40d00742a0 con 0x7f40d0154990 2023-07-27T20:34:20.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.069+0000 7f40beffd700 1 -- 172.21.15.72:0/352887427 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 105+0+0 (secure 0 0 0) 0x7f40c805a310 con 0x7f40d0154990 2023-07-27T20:34:20.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.072+0000 7f40cf59e700 1 -- 172.21.15.72:0/352887427 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f40b006ace0 msgr2=0x7f40b006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:20.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.072+0000 7f40cf59e700 1 --2- 172.21.15.72:0/352887427 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f40b006ace0 0x7f40b006d1a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f40c0007fd0 tx=0x7f40c0009040 comp rx=0 tx=0).stop 2023-07-27T20:34:20.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.072+0000 7f40cf59e700 1 -- 172.21.15.72:0/352887427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40d0154990 msgr2=0x7f40d0157870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:20.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.072+0000 7f40cf59e700 1 --2- 172.21.15.72:0/352887427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40d0154990 0x7f40d0157870 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f40d00a9090 tx=0x7f40c8004ad0 comp rx=0 tx=0).stop 2023-07-27T20:34:20.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.072+0000 7f40cf59e700 1 -- 172.21.15.72:0/352887427 shutdown_connections 2023-07-27T20:34:20.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.072+0000 7f40cf59e700 1 --2- 172.21.15.72:0/352887427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40d0154990 0x7f40d0157870 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:20.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.072+0000 7f40cf59e700 1 --2- 172.21.15.72:0/352887427 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f40b006ace0 0x7f40b006d1a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:20.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.072+0000 7f40cf59e700 1 --2- 172.21.15.72:0/352887427 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f40d006cef0 0x7f40d01ecea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:20.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.072+0000 7f40cf59e700 1 --2- 172.21.15.72:0/352887427 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40d00c6160 0x7f40d01e98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:20.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.072+0000 7f40cf59e700 1 -- 172.21.15.72:0/352887427 >> 172.21.15.72:0/352887427 conn(0x7f40d00ab340 msgr2=0x7f40d006bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:20.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.072+0000 7f40cf59e700 1 -- 172.21.15.72:0/352887427 shutdown_connections 2023-07-27T20:34:20.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.072+0000 7f40cf59e700 1 -- 172.21.15.72:0/352887427 wait complete. 2023-07-27T20:34:20.078 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-07-27T20:34:20.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.330+0000 7f5dcdbff700 1 Processor -- start 2023-07-27T20:34:20.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.330+0000 7f5dcdbff700 1 -- start start 2023-07-27T20:34:20.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.331+0000 7f5dcdbff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f5dc80c5410 0x7f5dc80c7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:20.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.331+0000 7f5dcdbff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5dc80c4180 0x7f5dc80c4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:20.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.331+0000 7f5dcdbff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dc80c59f0 con 0x7f5dc8151600 2023-07-27T20:34:20.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.331+0000 7f5dcdbff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc8155090 con 0x7f5dc80c4180 2023-07-27T20:34:20.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.331+0000 7f5dcdbff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc80c5cd0 con 0x7f5dc80c5410 2023-07-27T20:34:20.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.332+0000 7f5dc7fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5dc80c4180 0x7f5dc80c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:20.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.332+0000 7f5dc77fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5dc8151600 0x7f5dc8154980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54538/0 (socket says 172.21.15.72:54538) 2023-07-27T20:34:20.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.332+0000 7f5dc77fe700 1 -- 172.21.15.72:0/760510523 learned_addr learned my addr 172.21.15.72:0/760510523 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:20.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.332+0000 7f5dbffff700 1 --2- 172.21.15.72:0/760510523 >> v2:172.21.15.173:3300/0 conn(0x7f5dc80c5410 0x7f5dc80c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:20.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.332+0000 7f5dc7fff700 1 -- 172.21.15.72:0/760510523 >> v2:172.21.15.173:3300/0 conn(0x7f5dc80c5410 msgr2=0x7f5dc80c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:20.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.332+0000 7f5dc7fff700 1 --2- 172.21.15.72:0/760510523 >> v2:172.21.15.173:3300/0 conn(0x7f5dc80c5410 0x7f5dc80c7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:20.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.332+0000 7f5dc7fff700 1 -- 172.21.15.72:0/760510523 >> v1:172.21.15.72:6789/0 conn(0x7f5dc8151600 legacy=0x7f5dc8154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:20.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.332+0000 7f5dc7fff700 1 -- 172.21.15.72:0/760510523 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc8154180 con 0x7f5dc80c4180 2023-07-27T20:34:20.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.332+0000 7f5dc6ffd700 1 -- 172.21.15.72:0/760510523 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1400582766 0 0) 0x7f5dc80c59f0 con 0x7f5dc8151600 2023-07-27T20:34:20.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.332+0000 7f5dbffff700 1 --2- 172.21.15.72:0/760510523 >> v2:172.21.15.173:3300/0 conn(0x7f5dc80c5410 0x7f5dc80c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:20.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.332+0000 7f5dc7fff700 1 --2- 172.21.15.72:0/760510523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dc80c4180 0x7f5dc80c4590 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f5dc808ba50 tx=0x7f5dc000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cc0fdf471bedb81 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:20.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.333+0000 7f5dc6ffd700 1 -- 172.21.15.72:0/760510523 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc000e070 con 0x7f5dc80c4180 2023-07-27T20:34:20.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.333+0000 7f5dc6ffd700 1 -- 172.21.15.72:0/760510523 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc000bbd0 con 0x7f5dc80c4180 2023-07-27T20:34:20.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.333+0000 7f5dc6ffd700 1 -- 172.21.15.72:0/760510523 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0012430 con 0x7f5dc80c4180 2023-07-27T20:34:20.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.333+0000 7f5dcdbff700 1 -- 172.21.15.72:0/760510523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dc80c4180 msgr2=0x7f5dc80c4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:20.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.333+0000 7f5dcdbff700 1 --2- 172.21.15.72:0/760510523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dc80c4180 0x7f5dc80c4590 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f5dc808ba50 tx=0x7f5dc000b330 comp rx=0 tx=0).stop 2023-07-27T20:34:20.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.333+0000 7f5dcdbff700 1 -- 172.21.15.72:0/760510523 shutdown_connections 2023-07-27T20:34:20.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.333+0000 7f5dcdbff700 1 --2- 172.21.15.72:0/760510523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dc80c4180 0x7f5dc80c4590 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:20.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.333+0000 7f5dcdbff700 1 --2- 172.21.15.72:0/760510523 >> v2:172.21.15.173:3300/0 conn(0x7f5dc80c5410 0x7f5dc80c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:20.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.333+0000 7f5dcdbff700 1 -- 172.21.15.72:0/760510523 >> 172.21.15.72:0/760510523 conn(0x7f5dc80c9800 msgr2=0x7f5dc80c9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:20.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.333+0000 7f5dcdbff700 1 -- 172.21.15.72:0/760510523 shutdown_connections 2023-07-27T20:34:20.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.333+0000 7f5dcdbff700 1 -- 172.21.15.72:0/760510523 wait complete. 2023-07-27T20:34:20.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.335+0000 7f5dcdbff700 1 Processor -- start 2023-07-27T20:34:20.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.335+0000 7f5dcdbff700 1 -- start start 2023-07-27T20:34:20.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.336+0000 7f5dcdbff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5dc80c4180 0x7f5dc8152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:20.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.336+0000 7f5dcdbff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dc80c5410 0x7f5dc81ed3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:20.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.336+0000 7f5dcdbff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5dc8151600 0x7f5dc80aa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:20.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.336+0000 7f5dcdbff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc80c2fe0 con 0x7f5dc80c5410 2023-07-27T20:34:20.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.336+0000 7f5dcdbff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc80ab0c0 con 0x7f5dc80c4180 2023-07-27T20:34:20.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.336+0000 7f5dcdbff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc81ed910 con 0x7f5dc8151600 2023-07-27T20:34:20.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.336+0000 7f5dbffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dc80c5410 0x7f5dc81ed3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:20.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.336+0000 7f5dbffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dc80c5410 0x7f5dc81ed3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52064/0 (socket says 172.21.15.72:52064) 2023-07-27T20:34:20.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.336+0000 7f5dbffff700 1 -- 172.21.15.72:0/3119154904 learned_addr learned my addr 172.21.15.72:0/3119154904 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:20.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.337+0000 7f5dc77fe700 1 --2- 172.21.15.72:0/3119154904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5dc80c4180 0x7f5dc8152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:20.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.337+0000 7f5dc7fff700 1 --2- 172.21.15.72:0/3119154904 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5dc8151600 0x7f5dc80aa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:20.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.337+0000 7f5dbffff700 1 -- 172.21.15.72:0/3119154904 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5dc8151600 msgr2=0x7f5dc80aa3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:20.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.337+0000 7f5dbffff700 1 --2- 172.21.15.72:0/3119154904 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5dc8151600 0x7f5dc80aa3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:20.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.337+0000 7f5dbffff700 1 -- 172.21.15.72:0/3119154904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5dc80c4180 msgr2=0x7f5dc8152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:20.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.337+0000 7f5dbffff700 1 --2- 172.21.15.72:0/3119154904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5dc80c4180 0x7f5dc8152a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:20.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.337+0000 7f5dbffff700 1 -- 172.21.15.72:0/3119154904 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc0009a70 con 0x7f5dc80c5410 2023-07-27T20:34:20.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.337+0000 7f5dc77fe700 1 --2- 172.21.15.72:0/3119154904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5dc80c4180 0x7f5dc8152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:20.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.337+0000 7f5dbffff700 1 --2- 172.21.15.72:0/3119154904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dc80c5410 0x7f5dc81ed3d0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f5db000c750 tx=0x7f5db000cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:20.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.337+0000 7f5dc4ff9700 1 -- 172.21.15.72:0/3119154904 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db0011800 con 0x7f5dc80c5410 2023-07-27T20:34:20.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.337+0000 7f5dc4ff9700 1 -- 172.21.15.72:0/3119154904 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db0011960 con 0x7f5dc80c5410 2023-07-27T20:34:20.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.337+0000 7f5dcdbff700 1 -- 172.21.15.72:0/3119154904 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dc81537f0 con 0x7f5dc80c5410 2023-07-27T20:34:20.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.337+0000 7f5dc4ff9700 1 -- 172.21.15.72:0/3119154904 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db0011cd0 con 0x7f5dc80c5410 2023-07-27T20:34:20.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.337+0000 7f5dcdbff700 1 -- 172.21.15.72:0/3119154904 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc8151f80 con 0x7f5dc80c5410 2023-07-27T20:34:20.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.338+0000 7f5dcdbff700 1 -- 172.21.15.72:0/3119154904 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dc804e470 con 0x7f5dc80c5410 2023-07-27T20:34:20.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.339+0000 7f5dc4ff9700 1 -- 172.21.15.72:0/3119154904 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5db0021350 con 0x7f5dc80c5410 2023-07-27T20:34:20.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.340+0000 7f5dc4ff9700 1 --2- 172.21.15.72:0/3119154904 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5da806ace0 0x7f5da806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:20.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.340+0000 7f5dc4ff9700 1 -- 172.21.15.72:0/3119154904 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6558+0+0 (secure 0 0 0) 0x7f5db0089660 con 0x7f5dc80c5410 2023-07-27T20:34:20.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.341+0000 7f5dc77fe700 1 --2- 172.21.15.72:0/3119154904 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5da806ace0 0x7f5da806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:20.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.342+0000 7f5dc77fe700 1 --2- 172.21.15.72:0/3119154904 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5da806ace0 0x7f5da806d1a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5db8000f60 tx=0x7f5db8007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:20.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.345+0000 7f5dc4ff9700 1 -- 172.21.15.72:0/3119154904 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5db0057fa0 con 0x7f5dc80c5410 2023-07-27T20:34:20.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:20.538+0000 7f5dcdbff700 1 -- 172.21.15.72:0/3119154904 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5dc80ca650 con 0x7f5dc80c5410 2023-07-27T20:34:21.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.202+0000 7f5dc4ff9700 1 -- 172.21.15.72:0/3119154904 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v52) v1 ==== 184+0+0 (secure 0 0 0) 0x7f5db0057b30 con 0x7f5dc80c5410 2023-07-27T20:34:21.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.206+0000 7f5dcdbff700 1 -- 172.21.15.72:0/3119154904 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5da806ace0 msgr2=0x7f5da806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:21.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.206+0000 7f5dcdbff700 1 --2- 172.21.15.72:0/3119154904 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5da806ace0 0x7f5da806d1a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5db8000f60 tx=0x7f5db8007d30 comp rx=0 tx=0).stop 2023-07-27T20:34:21.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.206+0000 7f5dcdbff700 1 -- 172.21.15.72:0/3119154904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dc80c5410 msgr2=0x7f5dc81ed3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:21.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.206+0000 7f5dcdbff700 1 --2- 172.21.15.72:0/3119154904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dc80c5410 0x7f5dc81ed3d0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f5db000c750 tx=0x7f5db000cb10 comp rx=0 tx=0).stop 2023-07-27T20:34:21.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.206+0000 7f5dcdbff700 1 -- 172.21.15.72:0/3119154904 shutdown_connections 2023-07-27T20:34:21.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.206+0000 7f5dcdbff700 1 --2- 172.21.15.72:0/3119154904 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5da806ace0 0x7f5da806d1a0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:21.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.206+0000 7f5dcdbff700 1 --2- 172.21.15.72:0/3119154904 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5dc8151600 0x7f5dc80aa3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:21.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.206+0000 7f5dcdbff700 1 --2- 172.21.15.72:0/3119154904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5dc80c4180 0x7f5dc8152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:21.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.206+0000 7f5dcdbff700 1 --2- 172.21.15.72:0/3119154904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dc80c5410 0x7f5dc81ed3d0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:21.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.206+0000 7f5dcdbff700 1 -- 172.21.15.72:0/3119154904 >> 172.21.15.72:0/3119154904 conn(0x7f5dc80c9800 msgr2=0x7f5dc8154820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:21.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.206+0000 7f5dcdbff700 1 -- 172.21.15.72:0/3119154904 shutdown_connections 2023-07-27T20:34:21.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.206+0000 7f5dcdbff700 1 -- 172.21.15.72:0/3119154904 wait complete. 2023-07-27T20:34:21.196 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs2_metadata' removed 2023-07-27T20:34:21.215 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-07-27T20:34:21.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.428+0000 7f2a153ff700 1 Processor -- start 2023-07-27T20:34:21.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.428+0000 7f2a153ff700 1 -- start start 2023-07-27T20:34:21.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.429+0000 7f2a153ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2a100c7700 0x7f2a100c4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:21.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.429+0000 7f2a153ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a100c59f0 con 0x7f2a100c5410 2023-07-27T20:34:21.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.429+0000 7f2a153ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a100c5cd0 con 0x7f2a10151600 2023-07-27T20:34:21.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.429+0000 7f2a153ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a10155090 con 0x7f2a100c7700 2023-07-27T20:34:21.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.429+0000 7f2a0e7fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2a100c5410 0x7f2a100c4180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54540/0 (socket says 172.21.15.72:54540) 2023-07-27T20:34:21.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.429+0000 7f2a0e7fc700 1 -- 172.21.15.72:0/3362107321 learned_addr learned my addr 172.21.15.72:0/3362107321 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:21.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.429+0000 7f2a0f7fe700 1 --2- 172.21.15.72:0/3362107321 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2a100c7700 0x7f2a100c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:21.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.429+0000 7f2a0dffb700 1 -- 172.21.15.72:0/3362107321 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4038043983 0 0) 0x7f2a100c59f0 con 0x7f2a100c5410 2023-07-27T20:34:21.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.430+0000 7f2a0dffb700 1 -- 172.21.15.72:0/3362107321 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29f80035b0 con 0x7f2a100c5410 2023-07-27T20:34:21.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.430+0000 7f2a0dffb700 1 -- 172.21.15.72:0/3362107321 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1496715834 0 0) 0x7f29f80035b0 con 0x7f2a100c5410 2023-07-27T20:34:21.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.430+0000 7f2a0dffb700 1 -- 172.21.15.72:0/3362107321 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2a100c7700 msgr2=0x7f2a100c4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:21.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.430+0000 7f2a0dffb700 1 --2- 172.21.15.72:0/3362107321 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2a100c7700 0x7f2a100c4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:21.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.430+0000 7f2a0dffb700 1 -- 172.21.15.72:0/3362107321 >> v1:172.21.15.173:6789/0 conn(0x7f2a10151600 legacy=0x7f2a10154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:21.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.430+0000 7f2a0dffb700 1 -- 172.21.15.72:0/3362107321 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a10154180 con 0x7f2a100c5410 2023-07-27T20:34:21.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.430+0000 7f2a0dffb700 1 -- 172.21.15.72:0/3362107321 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f2a04001670 con 0x7f2a100c5410 2023-07-27T20:34:21.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.430+0000 7f2a0dffb700 1 -- 172.21.15.72:0/3362107321 >> v1:172.21.15.72:6789/0 conn(0x7f2a100c5410 legacy=0x7f2a100c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:21.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.430+0000 7f2a0dffb700 1 --2- 172.21.15.72:0/3362107321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29f8003a30 0x7f29f8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:21.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.430+0000 7f2a0dffb700 1 --2- 172.21.15.72:0/3362107321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29f80043e0 0x7f29f80048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:21.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.430+0000 7f2a0dffb700 1 --2- 172.21.15.72:0/3362107321 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2a100c7700 0x7f29f80051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:21.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.430+0000 7f2a0dffb700 1 -- 172.21.15.72:0/3362107321 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a10155090 con 0x7f29f8003a30 2023-07-27T20:34:21.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.430+0000 7f2a0dffb700 1 -- 172.21.15.72:0/3362107321 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f800bac0 con 0x7f29f80043e0 2023-07-27T20:34:21.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.430+0000 7f2a0dffb700 1 -- 172.21.15.72:0/3362107321 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29f800bc80 con 0x7f2a100c7700 2023-07-27T20:34:21.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.430+0000 7f2a0effd700 1 --2- 172.21.15.72:0/3362107321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29f8003a30 0x7f29f8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:21.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.430+0000 7f2a0e7fc700 1 --2- 172.21.15.72:0/3362107321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29f80043e0 0x7f29f80048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:21.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.430+0000 7f2a0f7fe700 1 --2- 172.21.15.72:0/3362107321 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2a100c7700 0x7f29f80051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:21.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.431+0000 7f2a0effd700 1 -- 172.21.15.72:0/3362107321 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2a100c7700 msgr2=0x7f29f80051b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:21.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.431+0000 7f2a0effd700 1 --2- 172.21.15.72:0/3362107321 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2a100c7700 0x7f29f80051b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:21.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.431+0000 7f2a0effd700 1 -- 172.21.15.72:0/3362107321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29f80043e0 msgr2=0x7f29f80048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:21.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.431+0000 7f2a0effd700 1 --2- 172.21.15.72:0/3362107321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29f80043e0 0x7f29f80048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:21.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.431+0000 7f2a0effd700 1 -- 172.21.15.72:0/3362107321 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f80035b0 con 0x7f29f8003a30 2023-07-27T20:34:21.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.431+0000 7f2a0f7fe700 1 --2- 172.21.15.72:0/3362107321 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2a100c7700 0x7f29f80051b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:21.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.431+0000 7f2a0effd700 1 --2- 172.21.15.72:0/3362107321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29f8003a30 0x7f29f8003e10 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f2a000018d0 tx=0x7f29f8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2efeb7256d59d4d8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:21.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.431+0000 7f2a0dffb700 1 -- 172.21.15.72:0/3362107321 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0000c690 con 0x7f29f8003a30 2023-07-27T20:34:21.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.431+0000 7f2a0dffb700 1 -- 172.21.15.72:0/3362107321 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0000c810 con 0x7f29f8003a30 2023-07-27T20:34:21.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.431+0000 7f2a0dffb700 1 -- 172.21.15.72:0/3362107321 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0000cbc0 con 0x7f29f8003a30 2023-07-27T20:34:21.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.432+0000 7f2a153ff700 1 -- 172.21.15.72:0/3362107321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29f8003a30 msgr2=0x7f29f8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:21.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.432+0000 7f2a153ff700 1 --2- 172.21.15.72:0/3362107321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29f8003a30 0x7f29f8003e10 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f2a000018d0 tx=0x7f29f8005880 comp rx=0 tx=0).stop 2023-07-27T20:34:21.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.432+0000 7f2a0f7fe700 1 -- 172.21.15.72:0/3362107321 reap_dead start 2023-07-27T20:34:21.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.432+0000 7f2a153ff700 1 -- 172.21.15.72:0/3362107321 shutdown_connections 2023-07-27T20:34:21.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.432+0000 7f2a153ff700 1 -- 172.21.15.72:0/3362107321 >> 172.21.15.72:0/3362107321 conn(0x7f2a100c9800 msgr2=0x7f2a100c9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:21.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.432+0000 7f2a153ff700 1 -- 172.21.15.72:0/3362107321 shutdown_connections 2023-07-27T20:34:21.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.432+0000 7f2a153ff700 1 -- 172.21.15.72:0/3362107321 wait complete. 2023-07-27T20:34:21.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.434+0000 7f2a153ff700 1 Processor -- start 2023-07-27T20:34:21.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.434+0000 7f2a153ff700 1 -- start start 2023-07-27T20:34:21.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.435+0000 7f2a153ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f29f8003a30 0x7f2a101ded60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:21.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.435+0000 7f2a153ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a10153090 0x7f2a10149b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:21.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.435+0000 7f2a153ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a1014a050 0x7f2a10155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:21.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.435+0000 7f2a153ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a101ed720 con 0x7f2a1014a050 2023-07-27T20:34:21.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.435+0000 7f2a153ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a101ecba0 con 0x7f2a10153090 2023-07-27T20:34:21.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.435+0000 7f2a153ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a101ece80 con 0x7f29f8003a30 2023-07-27T20:34:21.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.436+0000 7f2a0f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a1014a050 0x7f2a10155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:21.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.436+0000 7f2a0f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a1014a050 0x7f2a10155af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52070/0 (socket says 172.21.15.72:52070) 2023-07-27T20:34:21.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.436+0000 7f2a0f7fe700 1 -- 172.21.15.72:0/1060089038 learned_addr learned my addr 172.21.15.72:0/1060089038 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:21.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.436+0000 7f2a0effd700 1 --2- 172.21.15.72:0/1060089038 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f29f8003a30 0x7f2a101ded60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:21.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.436+0000 7f2a0e7fc700 1 --2- 172.21.15.72:0/1060089038 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a10153090 0x7f2a10149b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:21.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.436+0000 7f2a0f7fe700 1 -- 172.21.15.72:0/1060089038 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f29f8003a30 msgr2=0x7f2a101ded60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:21.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.436+0000 7f2a0f7fe700 1 --2- 172.21.15.72:0/1060089038 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f29f8003a30 0x7f2a101ded60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:21.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.436+0000 7f2a0f7fe700 1 -- 172.21.15.72:0/1060089038 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a10153090 msgr2=0x7f2a10149b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:21.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.436+0000 7f2a0f7fe700 1 --2- 172.21.15.72:0/1060089038 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a10153090 0x7f2a10149b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:21.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.436+0000 7f2a0f7fe700 1 -- 172.21.15.72:0/1060089038 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a101ed160 con 0x7f2a1014a050 2023-07-27T20:34:21.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.436+0000 7f2a0e7fc700 1 --2- 172.21.15.72:0/1060089038 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a10153090 0x7f2a10149b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:21.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.436+0000 7f2a0effd700 1 --2- 172.21.15.72:0/1060089038 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f29f8003a30 0x7f2a101ded60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:21.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.436+0000 7f2a0f7fe700 1 --2- 172.21.15.72:0/1060089038 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a1014a050 0x7f2a10155af0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f2a100c94e0 tx=0x7f2a080104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:21.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.437+0000 7f29f77fe700 1 -- 172.21.15.72:0/1060089038 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0801b070 con 0x7f2a1014a050 2023-07-27T20:34:21.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.437+0000 7f29f77fe700 1 -- 172.21.15.72:0/1060089038 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0800f040 con 0x7f2a1014a050 2023-07-27T20:34:21.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.437+0000 7f29f77fe700 1 -- 172.21.15.72:0/1060089038 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0800e050 con 0x7f2a1014a050 2023-07-27T20:34:21.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.437+0000 7f2a153ff700 1 -- 172.21.15.72:0/1060089038 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a101ed440 con 0x7f2a1014a050 2023-07-27T20:34:21.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.437+0000 7f2a153ff700 1 -- 172.21.15.72:0/1060089038 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a101ec7c0 con 0x7f2a1014a050 2023-07-27T20:34:21.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.438+0000 7f2a153ff700 1 -- 172.21.15.72:0/1060089038 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a10156800 con 0x7f2a1014a050 2023-07-27T20:34:21.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.439+0000 7f29f77fe700 1 -- 172.21.15.72:0/1060089038 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2a08015440 con 0x7f2a1014a050 2023-07-27T20:34:21.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.439+0000 7f29f77fe700 1 --2- 172.21.15.72:0/1060089038 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f29fc06ad10 0x7f29fc06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:21.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.440+0000 7f29f77fe700 1 -- 172.21.15.72:0/1060089038 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f2a080895b0 con 0x7f2a1014a050 2023-07-27T20:34:21.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.440+0000 7f2a0effd700 1 --2- 172.21.15.72:0/1060089038 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f29fc06ad10 0x7f29fc06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:21.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.441+0000 7f2a0effd700 1 --2- 172.21.15.72:0/1060089038 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f29fc06ad10 0x7f29fc06d1d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f2a00014040 tx=0x7f2a00005040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:21.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.444+0000 7f29f77fe700 1 -- 172.21.15.72:0/1060089038 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2a10156800 con 0x7f2a1014a050 2023-07-27T20:34:21.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:21.643+0000 7f2a153ff700 1 -- 172.21.15.72:0/1060089038 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2a10156800 con 0x7f2a1014a050 2023-07-27T20:34:21.987 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:34:21.992 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:34:22.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.203+0000 7f29f77fe700 1 -- 172.21.15.72:0/1060089038 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v53) v1 ==== 172+0+0 (secure 0 0 0) 0x7f2a10156800 con 0x7f2a1014a050 2023-07-27T20:34:22.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.206+0000 7f2a153ff700 1 -- 172.21.15.72:0/1060089038 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f29fc06ad10 msgr2=0x7f29fc06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:22.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.206+0000 7f2a153ff700 1 --2- 172.21.15.72:0/1060089038 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f29fc06ad10 0x7f29fc06d1d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f2a00014040 tx=0x7f2a00005040 comp rx=0 tx=0).stop 2023-07-27T20:34:22.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.206+0000 7f2a153ff700 1 -- 172.21.15.72:0/1060089038 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a1014a050 msgr2=0x7f2a10155af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:22.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.206+0000 7f2a153ff700 1 --2- 172.21.15.72:0/1060089038 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a1014a050 0x7f2a10155af0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f2a100c94e0 tx=0x7f2a080104a0 comp rx=0 tx=0).stop 2023-07-27T20:34:22.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.206+0000 7f2a153ff700 1 -- 172.21.15.72:0/1060089038 shutdown_connections 2023-07-27T20:34:22.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.206+0000 7f2a153ff700 1 --2- 172.21.15.72:0/1060089038 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a1014a050 0x7f2a10155af0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:22.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.206+0000 7f2a153ff700 1 --2- 172.21.15.72:0/1060089038 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f29fc06ad10 0x7f29fc06d1d0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:22.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.206+0000 7f2a153ff700 1 --2- 172.21.15.72:0/1060089038 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f29f8003a30 0x7f2a101ded60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:22.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.206+0000 7f2a153ff700 1 --2- 172.21.15.72:0/1060089038 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a10153090 0x7f2a10149b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:22.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.206+0000 7f2a153ff700 1 -- 172.21.15.72:0/1060089038 >> 172.21.15.72:0/1060089038 conn(0x7f2a100c9800 msgr2=0x7f2a10154880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:22.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.206+0000 7f2a153ff700 1 -- 172.21.15.72:0/1060089038 shutdown_connections 2023-07-27T20:34:22.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.206+0000 7f2a153ff700 1 -- 172.21.15.72:0/1060089038 wait complete. 2023-07-27T20:34:22.195 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs2_data' removed 2023-07-27T20:34:22.214 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-27T20:34:22.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.427+0000 7fedcebff700 1 Processor -- start 2023-07-27T20:34:22.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.428+0000 7fedcebff700 1 -- start start 2023-07-27T20:34:22.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.429+0000 7fedcebff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fedc814aab0 0x7fedc8154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:22.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.429+0000 7fedcebff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedc80c7c50 con 0x7fedc80c7740 2023-07-27T20:34:22.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.429+0000 7fedcebff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedc806bd40 con 0x7fedc806c1d0 2023-07-27T20:34:22.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.429+0000 7fedcebff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc806cd50 con 0x7fedc814aab0 2023-07-27T20:34:22.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.429+0000 7fedc7fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fedc80c7740 0x7fedc80c41c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54544/0 (socket says 172.21.15.72:54544) 2023-07-27T20:34:22.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.429+0000 7fedc7fff700 1 -- 172.21.15.72:0/995387913 learned_addr learned my addr 172.21.15.72:0/995387913 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:22.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.429+0000 7fedcc99b700 1 --2- 172.21.15.72:0/995387913 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fedc814aab0 0x7fedc8154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:22.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.429+0000 7fedc77fe700 1 -- 172.21.15.72:0/995387913 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1602626363 0 0) 0x7fedc80c7c50 con 0x7fedc80c7740 2023-07-27T20:34:22.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.429+0000 7fedc77fe700 1 -- 172.21.15.72:0/995387913 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedb80035b0 con 0x7fedc80c7740 2023-07-27T20:34:22.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.430+0000 7fedc77fe700 1 -- 172.21.15.72:0/995387913 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2215262277 0 0) 0x7fedc806bd40 con 0x7fedc806c1d0 2023-07-27T20:34:22.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.430+0000 7fedc77fe700 1 -- 172.21.15.72:0/995387913 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedc80c7c50 con 0x7fedc806c1d0 2023-07-27T20:34:22.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.430+0000 7fedcc99b700 1 -- 172.21.15.72:0/995387913 >> v1:172.21.15.173:6789/0 conn(0x7fedc806c1d0 legacy=0x7fedc806c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:22.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.430+0000 7fedcc99b700 1 -- 172.21.15.72:0/995387913 >> v1:172.21.15.72:6789/0 conn(0x7fedc80c7740 legacy=0x7fedc80c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:22.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.430+0000 7fedcc99b700 1 -- 172.21.15.72:0/995387913 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc80c62f0 con 0x7fedc814aab0 2023-07-27T20:34:22.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.430+0000 7fedcc99b700 1 --2- 172.21.15.72:0/995387913 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fedc814aab0 0x7fedc8154b10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fedbc009870 tx=0x7fedbc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d71f178f180e697c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:22.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.430+0000 7fedc77fe700 1 -- 172.21.15.72:0/995387913 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedbc011830 con 0x7fedc814aab0 2023-07-27T20:34:22.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.430+0000 7fedc77fe700 1 -- 172.21.15.72:0/995387913 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedbc011990 con 0x7fedc814aab0 2023-07-27T20:34:22.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.430+0000 7fedc77fe700 1 -- 172.21.15.72:0/995387913 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedbc011d20 con 0x7fedc814aab0 2023-07-27T20:34:22.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.431+0000 7fedcebff700 1 -- 172.21.15.72:0/995387913 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fedc814aab0 msgr2=0x7fedc8154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:22.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.431+0000 7fedcebff700 1 --2- 172.21.15.72:0/995387913 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fedc814aab0 0x7fedc8154b10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fedbc009870 tx=0x7fedbc009b80 comp rx=0 tx=0).stop 2023-07-27T20:34:22.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.431+0000 7fedcebff700 1 -- 172.21.15.72:0/995387913 shutdown_connections 2023-07-27T20:34:22.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.431+0000 7fedcebff700 1 --2- 172.21.15.72:0/995387913 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fedc814aab0 0x7fedc8154b10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:22.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.431+0000 7fedcebff700 1 -- 172.21.15.72:0/995387913 >> 172.21.15.72:0/995387913 conn(0x7fedc80ab3f0 msgr2=0x7fedc80ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:22.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.431+0000 7fedcebff700 1 -- 172.21.15.72:0/995387913 shutdown_connections 2023-07-27T20:34:22.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.431+0000 7fedcebff700 1 -- 172.21.15.72:0/995387913 wait complete. 2023-07-27T20:34:22.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.433+0000 7fedcebff700 1 Processor -- start 2023-07-27T20:34:22.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.433+0000 7fedcebff700 1 -- start start 2023-07-27T20:34:22.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.435+0000 7fedcebff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fedc806c1d0 0x7fedc81ed2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:22.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.435+0000 7fedcebff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fedc80c7740 0x7fedc80a9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:22.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.435+0000 7fedcebff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fedc814aab0 0x7fedc8147a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:22.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.435+0000 7fedcebff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc8157a90 con 0x7fedc814aab0 2023-07-27T20:34:22.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.435+0000 7fedcebff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc81585c0 con 0x7fedc806c1d0 2023-07-27T20:34:22.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.435+0000 7fedcebff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc8157c90 con 0x7fedc80c7740 2023-07-27T20:34:22.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.435+0000 7fedcd19c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fedc814aab0 0x7fedc8147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:22.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.435+0000 7fedcd19c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fedc814aab0 0x7fedc8147a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52076/0 (socket says 172.21.15.72:52076) 2023-07-27T20:34:22.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.435+0000 7fedcd19c700 1 -- 172.21.15.72:0/2004418486 learned_addr learned my addr 172.21.15.72:0/2004418486 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:22.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.435+0000 7fedcc99b700 1 --2- 172.21.15.72:0/2004418486 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fedc806c1d0 0x7fedc81ed2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:22.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.435+0000 7fedc7fff700 1 --2- 172.21.15.72:0/2004418486 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fedc80c7740 0x7fedc80a9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:22.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.435+0000 7fedcd19c700 1 -- 172.21.15.72:0/2004418486 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fedc80c7740 msgr2=0x7fedc80a9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:22.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.435+0000 7fedcd19c700 1 --2- 172.21.15.72:0/2004418486 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fedc80c7740 0x7fedc80a9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:22.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.435+0000 7fedcd19c700 1 -- 172.21.15.72:0/2004418486 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fedc806c1d0 msgr2=0x7fedc81ed2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:22.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.435+0000 7fedcd19c700 1 --2- 172.21.15.72:0/2004418486 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fedc806c1d0 0x7fedc81ed2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:22.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.435+0000 7fedcd19c700 1 -- 172.21.15.72:0/2004418486 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedbc0094a0 con 0x7fedc814aab0 2023-07-27T20:34:22.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.436+0000 7fedcd19c700 1 --2- 172.21.15.72:0/2004418486 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fedc814aab0 0x7fedc8147a30 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fedc000cc50 tx=0x7fedc000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:22.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.436+0000 7fedc57fa700 1 -- 172.21.15.72:0/2004418486 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc0003c00 con 0x7fedc814aab0 2023-07-27T20:34:22.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.436+0000 7fedc57fa700 1 -- 172.21.15.72:0/2004418486 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc0003d60 con 0x7fedc814aab0 2023-07-27T20:34:22.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.436+0000 7fedcebff700 1 -- 172.21.15.72:0/2004418486 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedc8157f70 con 0x7fedc814aab0 2023-07-27T20:34:22.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.436+0000 7fedc57fa700 1 -- 172.21.15.72:0/2004418486 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc000aad0 con 0x7fedc814aab0 2023-07-27T20:34:22.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.436+0000 7fedcebff700 1 -- 172.21.15.72:0/2004418486 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc80aa4e0 con 0x7fedc814aab0 2023-07-27T20:34:22.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.437+0000 7fedcebff700 1 -- 172.21.15.72:0/2004418486 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedc804e470 con 0x7fedc814aab0 2023-07-27T20:34:22.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.438+0000 7fedc57fa700 1 -- 172.21.15.72:0/2004418486 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fedc000ac30 con 0x7fedc814aab0 2023-07-27T20:34:22.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.439+0000 7fedc57fa700 1 --2- 172.21.15.72:0/2004418486 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fedac06ace0 0x7fedac06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:22.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.439+0000 7fedc57fa700 1 -- 172.21.15.72:0/2004418486 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fedc0089390 con 0x7fedc814aab0 2023-07-27T20:34:22.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.440+0000 7fedcc99b700 1 --2- 172.21.15.72:0/2004418486 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fedac06ace0 0x7fedac06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:22.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.441+0000 7fedcc99b700 1 --2- 172.21.15.72:0/2004418486 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fedac06ace0 0x7fedac06d1a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fedbc0090b0 tx=0x7fedbc01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:22.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.443+0000 7fedc57fa700 1 -- 172.21.15.72:0/2004418486 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fedc0054590 con 0x7fedc814aab0 2023-07-27T20:34:22.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.643+0000 7fedcebff700 1 -- 172.21.15.72:0/2004418486 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fedc806cf00 con 0x7fedc814aab0 2023-07-27T20:34:22.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.647+0000 7fedc57fa700 1 -- 172.21.15.72:0/2004418486 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fedc0057bb0 con 0x7fedc814aab0 2023-07-27T20:34:22.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.649+0000 7fedcebff700 1 -- 172.21.15.72:0/2004418486 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fedac06ace0 msgr2=0x7fedac06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:22.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.649+0000 7fedcebff700 1 --2- 172.21.15.72:0/2004418486 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fedac06ace0 0x7fedac06d1a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fedbc0090b0 tx=0x7fedbc01c040 comp rx=0 tx=0).stop 2023-07-27T20:34:22.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.649+0000 7fedcebff700 1 -- 172.21.15.72:0/2004418486 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fedc814aab0 msgr2=0x7fedc8147a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:22.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.650+0000 7fedcebff700 1 --2- 172.21.15.72:0/2004418486 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fedc814aab0 0x7fedc8147a30 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fedc000cc50 tx=0x7fedc000cf60 comp rx=0 tx=0).stop 2023-07-27T20:34:22.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.650+0000 7fedcebff700 1 -- 172.21.15.72:0/2004418486 shutdown_connections 2023-07-27T20:34:22.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.650+0000 7fedcebff700 1 --2- 172.21.15.72:0/2004418486 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fedc814aab0 0x7fedc8147a30 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:22.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.650+0000 7fedcebff700 1 --2- 172.21.15.72:0/2004418486 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fedc806c1d0 0x7fedc81ed2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:22.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.650+0000 7fedcebff700 1 --2- 172.21.15.72:0/2004418486 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fedac06ace0 0x7fedac06d1a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:22.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.650+0000 7fedcebff700 1 --2- 172.21.15.72:0/2004418486 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fedc80c7740 0x7fedc80a9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:22.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.650+0000 7fedcebff700 1 -- 172.21.15.72:0/2004418486 >> 172.21.15.72:0/2004418486 conn(0x7fedc80ab3f0 msgr2=0x7fedc806c640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:22.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.650+0000 7fedcebff700 1 -- 172.21.15.72:0/2004418486 shutdown_connections 2023-07-27T20:34:22.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.650+0000 7fedcebff700 1 -- 172.21.15.72:0/2004418486 wait complete. 2023-07-27T20:34:22.656 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2023-07-27T20:34:22.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.864+0000 7f42059ff700 1 Processor -- start 2023-07-27T20:34:22.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.864+0000 7f42059ff700 1 -- start start 2023-07-27T20:34:22.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.865+0000 7f42059ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f42000c4400 0x7f42000c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:22.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.865+0000 7f42059ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f42001549f0 0x7f42001514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:22.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.865+0000 7f42059ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f420006b710 con 0x7f420006b150 2023-07-27T20:34:22.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.865+0000 7f42059ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42001545d0 con 0x7f42000c4400 2023-07-27T20:34:22.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.865+0000 7f42059ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420006c860 con 0x7f42001549f0 2023-07-27T20:34:22.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.866+0000 7f41feffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f42000c4400 0x7f42000c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:22.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.866+0000 7f41feffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f42000c4400 0x7f42000c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52084/0 (socket says 172.21.15.72:52084) 2023-07-27T20:34:22.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.866+0000 7f41feffd700 1 -- 172.21.15.72:0/4077002956 learned_addr learned my addr 172.21.15.72:0/4077002956 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:22.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.866+0000 7f41ff7fe700 1 --2- 172.21.15.72:0/4077002956 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f42001549f0 0x7f42001514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:22.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.866+0000 7f41feffd700 1 -- 172.21.15.72:0/4077002956 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f42001549f0 msgr2=0x7f42001514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:22.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.866+0000 7f41feffd700 1 --2- 172.21.15.72:0/4077002956 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f42001549f0 0x7f42001514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:22.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.866+0000 7f41feffd700 1 -- 172.21.15.72:0/4077002956 >> v1:172.21.15.173:6789/0 conn(0x7f420006b150 legacy=0x7f42000c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:22.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.866+0000 7f41feffd700 1 -- 172.21.15.72:0/4077002956 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420006b9f0 con 0x7f42000c4400 2023-07-27T20:34:22.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.866+0000 7f41feffd700 1 --2- 172.21.15.72:0/4077002956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42000c4400 0x7f42000c7710 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f41f00098f0 tx=0x7f41f0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=129a1e5bbe162f54 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:22.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.866+0000 7f41fdffb700 1 -- 172.21.15.72:0/4077002956 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f000b8a0 con 0x7f42000c4400 2023-07-27T20:34:22.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.866+0000 7f41fdffb700 1 -- 172.21.15.72:0/4077002956 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f000ba00 con 0x7f42000c4400 2023-07-27T20:34:22.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.867+0000 7f41fdffb700 1 -- 172.21.15.72:0/4077002956 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f000bd90 con 0x7f42000c4400 2023-07-27T20:34:22.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.867+0000 7f42059ff700 1 -- 172.21.15.72:0/4077002956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42000c4400 msgr2=0x7f42000c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:22.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.867+0000 7f42059ff700 1 --2- 172.21.15.72:0/4077002956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42000c4400 0x7f42000c7710 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f41f00098f0 tx=0x7f41f0009c00 comp rx=0 tx=0).stop 2023-07-27T20:34:22.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.867+0000 7f42059ff700 1 -- 172.21.15.72:0/4077002956 shutdown_connections 2023-07-27T20:34:22.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.867+0000 7f42059ff700 1 --2- 172.21.15.72:0/4077002956 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f42001549f0 0x7f42001514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:22.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.867+0000 7f42059ff700 1 --2- 172.21.15.72:0/4077002956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42000c4400 0x7f42000c7710 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:22.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.867+0000 7f42059ff700 1 -- 172.21.15.72:0/4077002956 >> 172.21.15.72:0/4077002956 conn(0x7f42000ab300 msgr2=0x7f42000ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:22.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.867+0000 7f42059ff700 1 -- 172.21.15.72:0/4077002956 shutdown_connections 2023-07-27T20:34:22.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.867+0000 7f42059ff700 1 -- 172.21.15.72:0/4077002956 wait complete. 2023-07-27T20:34:22.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.869+0000 7f42059ff700 1 Processor -- start 2023-07-27T20:34:22.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.869+0000 7f42059ff700 1 -- start start 2023-07-27T20:34:22.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.870+0000 7f42059ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f420006b150 0x7f42000c32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:22.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.870+0000 7f42059ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42000c4400 0x7f42000c23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:22.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.870+0000 7f42059ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f42001549f0 0x7f42000c0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:22.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.870+0000 7f42059ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42000bef50 con 0x7f420006b150 2023-07-27T20:34:22.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.870+0000 7f42059ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42000ae250 con 0x7f42000c4400 2023-07-27T20:34:22.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.870+0000 7f42059ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42000ae530 con 0x7f42001549f0 2023-07-27T20:34:22.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.870+0000 7f41feffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f420006b150 0x7f42000c32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:22.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.870+0000 7f41feffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f420006b150 0x7f42000c32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52086/0 (socket says 172.21.15.72:52086) 2023-07-27T20:34:22.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.870+0000 7f41feffd700 1 -- 172.21.15.72:0/1866690769 learned_addr learned my addr 172.21.15.72:0/1866690769 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:22.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.870+0000 7f41fe7fc700 1 --2- 172.21.15.72:0/1866690769 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42000c4400 0x7f42000c23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:22.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.870+0000 7f41ff7fe700 1 --2- 172.21.15.72:0/1866690769 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f42001549f0 0x7f42000c0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:22.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.871+0000 7f41feffd700 1 -- 172.21.15.72:0/1866690769 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f42001549f0 msgr2=0x7f42000c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:22.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.871+0000 7f41feffd700 1 --2- 172.21.15.72:0/1866690769 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f42001549f0 0x7f42000c0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:22.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.871+0000 7f41feffd700 1 -- 172.21.15.72:0/1866690769 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42000c4400 msgr2=0x7f42000c23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:22.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.871+0000 7f41feffd700 1 --2- 172.21.15.72:0/1866690769 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42000c4400 0x7f42000c23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:22.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.871+0000 7f41feffd700 1 -- 172.21.15.72:0/1866690769 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f0009550 con 0x7f420006b150 2023-07-27T20:34:22.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.871+0000 7f41feffd700 1 --2- 172.21.15.72:0/1866690769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f420006b150 0x7f42000c32c0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f41f0000c00 tx=0x7f41f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:22.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.871+0000 7f41e7fff700 1 -- 172.21.15.72:0/1866690769 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f0004380 con 0x7f420006b150 2023-07-27T20:34:22.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.871+0000 7f41e7fff700 1 -- 172.21.15.72:0/1866690769 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f001f070 con 0x7f420006b150 2023-07-27T20:34:22.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.871+0000 7f41e7fff700 1 -- 172.21.15.72:0/1866690769 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f00036a0 con 0x7f420006b150 2023-07-27T20:34:22.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.871+0000 7f42059ff700 1 -- 172.21.15.72:0/1866690769 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42000ae810 con 0x7f420006b150 2023-07-27T20:34:22.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.871+0000 7f42059ff700 1 -- 172.21.15.72:0/1866690769 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42000af250 con 0x7f420006b150 2023-07-27T20:34:22.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.872+0000 7f42059ff700 1 -- 172.21.15.72:0/1866690769 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42000aeb80 con 0x7f420006b150 2023-07-27T20:34:22.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.873+0000 7f41e7fff700 1 -- 172.21.15.72:0/1866690769 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f41f0021030 con 0x7f420006b150 2023-07-27T20:34:22.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.874+0000 7f41e7fff700 1 --2- 172.21.15.72:0/1866690769 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f41ec06ace0 0x7f41ec06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:22.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.874+0000 7f41e7fff700 1 -- 172.21.15.72:0/1866690769 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f41f008a610 con 0x7f420006b150 2023-07-27T20:34:22.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.875+0000 7f41fe7fc700 1 --2- 172.21.15.72:0/1866690769 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f41ec06ace0 0x7f41ec06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:22.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.875+0000 7f41fe7fc700 1 --2- 172.21.15.72:0/1866690769 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f41ec06ace0 0x7f41ec06d1a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f41f4007fd0 tx=0x7f41f4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:22.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:22.878+0000 7f41e7fff700 1 -- 172.21.15.72:0/1866690769 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f41f0055810 con 0x7f420006b150 2023-07-27T20:34:23.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.154+0000 7f42059ff700 1 -- 172.21.15.72:0/1866690769 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7f4200074310 con 0x7f420006b150 2023-07-27T20:34:23.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.219+0000 7f41e7fff700 1 -- 172.21.15.72:0/1866690769 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v184) v1 ==== 159+0+0 (secure 0 0 0) 0x7f41f0058e30 con 0x7f420006b150 2023-07-27T20:34:23.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.221+0000 7f42059ff700 1 -- 172.21.15.72:0/1866690769 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f41ec06ace0 msgr2=0x7f41ec06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:23.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.221+0000 7f42059ff700 1 --2- 172.21.15.72:0/1866690769 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f41ec06ace0 0x7f41ec06d1a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f41f4007fd0 tx=0x7f41f4009040 comp rx=0 tx=0).stop 2023-07-27T20:34:23.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.221+0000 7f42059ff700 1 -- 172.21.15.72:0/1866690769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f420006b150 msgr2=0x7f42000c32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:23.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.221+0000 7f42059ff700 1 --2- 172.21.15.72:0/1866690769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f420006b150 0x7f42000c32c0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f41f0000c00 tx=0x7f41f0004750 comp rx=0 tx=0).stop 2023-07-27T20:34:23.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.221+0000 7f42059ff700 1 -- 172.21.15.72:0/1866690769 shutdown_connections 2023-07-27T20:34:23.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.221+0000 7f42059ff700 1 --2- 172.21.15.72:0/1866690769 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f41ec06ace0 0x7f41ec06d1a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:23.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.221+0000 7f42059ff700 1 --2- 172.21.15.72:0/1866690769 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f42001549f0 0x7f42000c0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:23.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.221+0000 7f42059ff700 1 --2- 172.21.15.72:0/1866690769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f420006b150 0x7f42000c32c0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:23.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.221+0000 7f42059ff700 1 --2- 172.21.15.72:0/1866690769 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42000c4400 0x7f42000c23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:23.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.221+0000 7f42059ff700 1 -- 172.21.15.72:0/1866690769 >> 172.21.15.72:0/1866690769 conn(0x7f42000ab300 msgr2=0x7f4200153a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:23.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.222+0000 7f42059ff700 1 -- 172.21.15.72:0/1866690769 shutdown_connections 2023-07-27T20:34:23.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.222+0000 7f42059ff700 1 -- 172.21.15.72:0/1866690769 wait complete. 2023-07-27T20:34:23.227 INFO:tasks.cephfs_test_runner:test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) ... ok 2023-07-27T20:34:23.228 INFO:tasks.cephfs_test_runner:Starting test: test_mount_mon_and_osd_caps_present_mds_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2023-07-27T20:34:23.229 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent' 2023-07-27T20:34:23.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.438+0000 7f7a9fbff700 1 Processor -- start 2023-07-27T20:34:23.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.438+0000 7f7a9fbff700 1 -- start start 2023-07-27T20:34:23.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.439+0000 7f7a9fbff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7a9813d5d0 0x7f7a98154b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:23.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.439+0000 7f7a9fbff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7a980c7810 0x7f7a980c4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:23.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.439+0000 7f7a9fbff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a981550b0 con 0x7f7a980c47d0 2023-07-27T20:34:23.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.439+0000 7f7a9fbff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a980c5010 con 0x7f7a980c7810 2023-07-27T20:34:23.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.439+0000 7f7a9fbff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9813d9b0 con 0x7f7a9813d5d0 2023-07-27T20:34:23.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.439+0000 7f7a9d19a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7a980c7810 0x7f7a980c4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:23.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.439+0000 7f7a9d19a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7a980c7810 0x7f7a980c4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52088/0 (socket says 172.21.15.72:52088) 2023-07-27T20:34:23.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.439+0000 7f7a9d19a700 1 -- 172.21.15.72:0/3274247417 learned_addr learned my addr 172.21.15.72:0/3274247417 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:23.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.440+0000 7f7a9d99b700 1 --2- 172.21.15.72:0/3274247417 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7a9813d5d0 0x7f7a98154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:23.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.440+0000 7f7a9d19a700 1 -- 172.21.15.72:0/3274247417 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7a9813d5d0 msgr2=0x7f7a98154b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:23.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.440+0000 7f7a9d19a700 1 --2- 172.21.15.72:0/3274247417 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7a9813d5d0 0x7f7a98154b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:23.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.440+0000 7f7a9d19a700 1 -- 172.21.15.72:0/3274247417 >> v1:172.21.15.173:6789/0 conn(0x7f7a980c47d0 legacy=0x7f7a9806c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:23.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.440+0000 7f7a9d19a700 1 -- 172.21.15.72:0/3274247417 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a980c6450 con 0x7f7a980c7810 2023-07-27T20:34:23.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.440+0000 7f7a9d19a700 1 --2- 172.21.15.72:0/3274247417 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a980c7810 0x7f7a980c4290 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f7a880098f0 tx=0x7f7a88009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cc6786e81011343 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:23.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.440+0000 7f7a9c999700 1 -- 172.21.15.72:0/3274247417 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8800b8a0 con 0x7f7a980c7810 2023-07-27T20:34:23.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.440+0000 7f7a9c999700 1 -- 172.21.15.72:0/3274247417 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8800ba00 con 0x7f7a980c7810 2023-07-27T20:34:23.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.440+0000 7f7a9c999700 1 -- 172.21.15.72:0/3274247417 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8800bd90 con 0x7f7a980c7810 2023-07-27T20:34:23.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.441+0000 7f7a9fbff700 1 -- 172.21.15.72:0/3274247417 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a980c7810 msgr2=0x7f7a980c4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:23.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.441+0000 7f7a9fbff700 1 --2- 172.21.15.72:0/3274247417 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a980c7810 0x7f7a980c4290 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f7a880098f0 tx=0x7f7a88009c00 comp rx=0 tx=0).stop 2023-07-27T20:34:23.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.441+0000 7f7a9fbff700 1 -- 172.21.15.72:0/3274247417 shutdown_connections 2023-07-27T20:34:23.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.441+0000 7f7a9fbff700 1 --2- 172.21.15.72:0/3274247417 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7a9813d5d0 0x7f7a98154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:23.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.441+0000 7f7a9fbff700 1 --2- 172.21.15.72:0/3274247417 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a980c7810 0x7f7a980c4290 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:23.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.441+0000 7f7a9fbff700 1 -- 172.21.15.72:0/3274247417 >> 172.21.15.72:0/3274247417 conn(0x7f7a980ab540 msgr2=0x7f7a980ab920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:23.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.441+0000 7f7a9fbff700 1 -- 172.21.15.72:0/3274247417 shutdown_connections 2023-07-27T20:34:23.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.441+0000 7f7a9fbff700 1 -- 172.21.15.72:0/3274247417 wait complete. 2023-07-27T20:34:23.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.442+0000 7f7a9fbff700 1 Processor -- start 2023-07-27T20:34:23.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.443+0000 7f7a9fbff700 1 -- start start 2023-07-27T20:34:23.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.443+0000 7f7a9fbff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7a980c47d0 0x7f7a981ec990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:23.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.443+0000 7f7a9fbff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a980c7810 0x7f7a980c3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:23.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.443+0000 7f7a9fbff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a9813d5d0 0x7f7a981e9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:23.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.443+0000 7f7a9fbff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a980c39a0 con 0x7f7a9813d5d0 2023-07-27T20:34:23.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.443+0000 7f7a9fbff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a981dee40 con 0x7f7a980c7810 2023-07-27T20:34:23.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.443+0000 7f7a9fbff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a981df120 con 0x7f7a980c47d0 2023-07-27T20:34:23.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.444+0000 7f7a9e19c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a9813d5d0 0x7f7a981e9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:23.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.444+0000 7f7a9e19c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a9813d5d0 0x7f7a981e9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52100/0 (socket says 172.21.15.72:52100) 2023-07-27T20:34:23.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.444+0000 7f7a9e19c700 1 -- 172.21.15.72:0/2436235339 learned_addr learned my addr 172.21.15.72:0/2436235339 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:23.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.444+0000 7f7a9d99b700 1 --2- 172.21.15.72:0/2436235339 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7a980c47d0 0x7f7a981ec990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:23.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.444+0000 7f7a9d19a700 1 --2- 172.21.15.72:0/2436235339 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a980c7810 0x7f7a980c3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:23.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.444+0000 7f7a9e19c700 1 -- 172.21.15.72:0/2436235339 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7a980c47d0 msgr2=0x7f7a981ec990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:23.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.444+0000 7f7a9e19c700 1 --2- 172.21.15.72:0/2436235339 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7a980c47d0 0x7f7a981ec990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:23.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.444+0000 7f7a9e19c700 1 -- 172.21.15.72:0/2436235339 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a980c7810 msgr2=0x7f7a980c3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:23.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.444+0000 7f7a9e19c700 1 --2- 172.21.15.72:0/2436235339 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a980c7810 0x7f7a980c3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:23.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.444+0000 7f7a9e19c700 1 -- 172.21.15.72:0/2436235339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a88009550 con 0x7f7a9813d5d0 2023-07-27T20:34:23.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.444+0000 7f7a9d19a700 1 --2- 172.21.15.72:0/2436235339 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a980c7810 0x7f7a980c3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:23.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.444+0000 7f7a9e19c700 1 --2- 172.21.15.72:0/2436235339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a9813d5d0 0x7f7a981e9c70 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f7a9000cc50 tx=0x7f7a9000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:23.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.445+0000 7f7a8e7fc700 1 -- 172.21.15.72:0/2436235339 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a90003c00 con 0x7f7a9813d5d0 2023-07-27T20:34:23.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.445+0000 7f7a8e7fc700 1 -- 172.21.15.72:0/2436235339 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a90003d60 con 0x7f7a9813d5d0 2023-07-27T20:34:23.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.445+0000 7f7a8e7fc700 1 -- 172.21.15.72:0/2436235339 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9000ab60 con 0x7f7a9813d5d0 2023-07-27T20:34:23.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.445+0000 7f7a9fbff700 1 -- 172.21.15.72:0/2436235339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a981df400 con 0x7f7a9813d5d0 2023-07-27T20:34:23.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.445+0000 7f7a9fbff700 1 -- 172.21.15.72:0/2436235339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a981deb10 con 0x7f7a9813d5d0 2023-07-27T20:34:23.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.446+0000 7f7a9fbff700 1 -- 172.21.15.72:0/2436235339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a9804e470 con 0x7f7a9813d5d0 2023-07-27T20:34:23.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.447+0000 7f7a8e7fc700 1 -- 172.21.15.72:0/2436235339 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7a9000acc0 con 0x7f7a9813d5d0 2023-07-27T20:34:23.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.448+0000 7f7a8e7fc700 1 --2- 172.21.15.72:0/2436235339 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f7a7c06ace0 0x7f7a7c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:23.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.448+0000 7f7a8e7fc700 1 -- 172.21.15.72:0/2436235339 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f7a900893f0 con 0x7f7a9813d5d0 2023-07-27T20:34:23.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.449+0000 7f7a9d99b700 1 --2- 172.21.15.72:0/2436235339 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f7a7c06ace0 0x7f7a7c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:23.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.449+0000 7f7a9d99b700 1 --2- 172.21.15.72:0/2436235339 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f7a7c06ace0 0x7f7a7c06d1a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7a981ea550 tx=0x7f7a94008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:23.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.452+0000 7f7a8e7fc700 1 -- 172.21.15.72:0/2436235339 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7a900545f0 con 0x7f7a9813d5d0 2023-07-27T20:34:23.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:23.725+0000 7f7a9fbff700 1 -- 172.21.15.72:0/2436235339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]} v 0) v1 -- 0x7f7a981e9990 con 0x7f7a9813d5d0 2023-07-27T20:34:24.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.221+0000 7f7a8e7fc700 1 -- 172.21.15.72:0/2436235339 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]}]=0 v185) v1 ==== 187+0+0 (secure 0 0 0) 0x7f7a981e9990 con 0x7f7a9813d5d0 2023-07-27T20:34:24.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.223+0000 7f7a9fbff700 1 -- 172.21.15.72:0/2436235339 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f7a7c06ace0 msgr2=0x7f7a7c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:24.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.223+0000 7f7a9fbff700 1 --2- 172.21.15.72:0/2436235339 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f7a7c06ace0 0x7f7a7c06d1a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7a981ea550 tx=0x7f7a94008040 comp rx=0 tx=0).stop 2023-07-27T20:34:24.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.223+0000 7f7a9fbff700 1 -- 172.21.15.72:0/2436235339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a9813d5d0 msgr2=0x7f7a981e9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:24.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.223+0000 7f7a9fbff700 1 --2- 172.21.15.72:0/2436235339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a9813d5d0 0x7f7a981e9c70 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f7a9000cc50 tx=0x7f7a9000cf60 comp rx=0 tx=0).stop 2023-07-27T20:34:24.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.223+0000 7f7a9fbff700 1 -- 172.21.15.72:0/2436235339 shutdown_connections 2023-07-27T20:34:24.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.223+0000 7f7a9fbff700 1 --2- 172.21.15.72:0/2436235339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a9813d5d0 0x7f7a981e9c70 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:24.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.223+0000 7f7a9fbff700 1 --2- 172.21.15.72:0/2436235339 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f7a7c06ace0 0x7f7a7c06d1a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:24.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.223+0000 7f7a9fbff700 1 --2- 172.21.15.72:0/2436235339 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7a980c47d0 0x7f7a981ec990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:24.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.223+0000 7f7a9fbff700 1 --2- 172.21.15.72:0/2436235339 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a980c7810 0x7f7a980c3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:24.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.223+0000 7f7a9fbff700 1 -- 172.21.15.72:0/2436235339 >> 172.21.15.72:0/2436235339 conn(0x7f7a980ab540 msgr2=0x7f7a9813a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:24.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.224+0000 7f7a9fbff700 1 -- 172.21.15.72:0/2436235339 shutdown_connections 2023-07-27T20:34:24.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.224+0000 7f7a9fbff700 1 -- 172.21.15.72:0/2436235339 wait complete. 2023-07-27T20:34:24.229 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:34:24.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.440+0000 7fdc877ff700 1 Processor -- start 2023-07-27T20:34:24.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.441+0000 7fdc877ff700 1 -- start start 2023-07-27T20:34:24.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.442+0000 7fdc877ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdc800c7710 0x7fdc801514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:24.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.442+0000 7fdc877ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc80155100 con 0x7fdc800c4400 2023-07-27T20:34:24.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.442+0000 7fdc877ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc800c7b20 con 0x7fdc8006b150 2023-07-27T20:34:24.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.442+0000 7fdc877ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc801545d0 con 0x7fdc800c7710 2023-07-27T20:34:24.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.442+0000 7fdc8559b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fdc800c4400 0x7fdc800c4cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54546/0 (socket says 172.21.15.72:54546) 2023-07-27T20:34:24.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.442+0000 7fdc8559b700 1 -- 172.21.15.72:0/1981334984 learned_addr learned my addr 172.21.15.72:0/1981334984 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:24.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.442+0000 7fdc77fff700 1 -- 172.21.15.72:0/1981334984 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 527053286 0 0) 0x7fdc80155100 con 0x7fdc800c4400 2023-07-27T20:34:24.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.442+0000 7fdc77fff700 1 -- 172.21.15.72:0/1981334984 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc6c0035b0 con 0x7fdc800c4400 2023-07-27T20:34:24.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.442+0000 7fdc85d9c700 1 --2- 172.21.15.72:0/1981334984 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdc800c7710 0x7fdc801514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:24.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.443+0000 7fdc77fff700 1 -- 172.21.15.72:0/1981334984 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4173073136 0 0) 0x7fdc6c0035b0 con 0x7fdc800c4400 2023-07-27T20:34:24.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.443+0000 7fdc77fff700 1 -- 172.21.15.72:0/1981334984 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdc800c7710 msgr2=0x7fdc801514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:24.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.443+0000 7fdc77fff700 1 --2- 172.21.15.72:0/1981334984 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdc800c7710 0x7fdc801514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:24.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.443+0000 7fdc77fff700 1 -- 172.21.15.72:0/1981334984 >> v1:172.21.15.173:6789/0 conn(0x7fdc8006b150 legacy=0x7fdc801549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:24.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.443+0000 7fdc77fff700 1 -- 172.21.15.72:0/1981334984 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc8006b710 con 0x7fdc800c4400 2023-07-27T20:34:24.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.443+0000 7fdc77fff700 1 -- 172.21.15.72:0/1981334984 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7fdc7c001670 con 0x7fdc800c4400 2023-07-27T20:34:24.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.443+0000 7fdc77fff700 1 -- 172.21.15.72:0/1981334984 >> v1:172.21.15.72:6789/0 conn(0x7fdc800c4400 legacy=0x7fdc800c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:24.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.443+0000 7fdc77fff700 1 --2- 172.21.15.72:0/1981334984 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc6c003a30 0x7fdc6c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:24.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.443+0000 7fdc77fff700 1 --2- 172.21.15.72:0/1981334984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc6c004850 0x7fdc6c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:24.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.443+0000 7fdc77fff700 1 --2- 172.21.15.72:0/1981334984 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdc800c7710 0x7fdc6c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:24.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.443+0000 7fdc77fff700 1 -- 172.21.15.72:0/1981334984 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc801545d0 con 0x7fdc6c004850 2023-07-27T20:34:24.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.443+0000 7fdc77fff700 1 -- 172.21.15.72:0/1981334984 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6c005570 con 0x7fdc6c003a30 2023-07-27T20:34:24.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.443+0000 7fdc77fff700 1 -- 172.21.15.72:0/1981334984 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6c00bf50 con 0x7fdc800c7710 2023-07-27T20:34:24.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.443+0000 7fdc84d9a700 1 --2- 172.21.15.72:0/1981334984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc6c004850 0x7fdc6c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:24.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.443+0000 7fdc8559b700 1 --2- 172.21.15.72:0/1981334984 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc6c003a30 0x7fdc6c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:24.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.443+0000 7fdc85d9c700 1 --2- 172.21.15.72:0/1981334984 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdc800c7710 0x7fdc6c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:24.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.443+0000 7fdc84d9a700 1 -- 172.21.15.72:0/1981334984 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdc800c7710 msgr2=0x7fdc6c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:24.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.443+0000 7fdc84d9a700 1 --2- 172.21.15.72:0/1981334984 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdc800c7710 0x7fdc6c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:24.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.443+0000 7fdc84d9a700 1 -- 172.21.15.72:0/1981334984 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc6c003a30 msgr2=0x7fdc6c003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:24.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.443+0000 7fdc84d9a700 1 --2- 172.21.15.72:0/1981334984 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc6c003a30 0x7fdc6c003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:24.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.443+0000 7fdc84d9a700 1 -- 172.21.15.72:0/1981334984 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6c0035b0 con 0x7fdc6c004850 2023-07-27T20:34:24.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.443+0000 7fdc85d9c700 1 --2- 172.21.15.72:0/1981334984 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdc800c7710 0x7fdc6c00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:24.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.444+0000 7fdc84d9a700 1 --2- 172.21.15.72:0/1981334984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc6c004850 0x7fdc6c004cd0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fdc700017c0 tx=0x7fdc6c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=514bdfc0536f8922 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:24.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.444+0000 7fdc77fff700 1 -- 172.21.15.72:0/1981334984 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc700052d0 con 0x7fdc6c004850 2023-07-27T20:34:24.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.444+0000 7fdc77fff700 1 -- 172.21.15.72:0/1981334984 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc70005430 con 0x7fdc6c004850 2023-07-27T20:34:24.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.444+0000 7fdc77fff700 1 -- 172.21.15.72:0/1981334984 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc700038c0 con 0x7fdc6c004850 2023-07-27T20:34:24.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.444+0000 7fdc877ff700 1 -- 172.21.15.72:0/1981334984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc6c004850 msgr2=0x7fdc6c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:24.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.444+0000 7fdc877ff700 1 --2- 172.21.15.72:0/1981334984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc6c004850 0x7fdc6c004cd0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fdc700017c0 tx=0x7fdc6c005880 comp rx=0 tx=0).stop 2023-07-27T20:34:24.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.444+0000 7fdc85d9c700 1 -- 172.21.15.72:0/1981334984 reap_dead start 2023-07-27T20:34:24.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.444+0000 7fdc877ff700 1 -- 172.21.15.72:0/1981334984 shutdown_connections 2023-07-27T20:34:24.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.444+0000 7fdc877ff700 1 -- 172.21.15.72:0/1981334984 >> 172.21.15.72:0/1981334984 conn(0x7fdc800ab300 msgr2=0x7fdc800ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:24.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.445+0000 7fdc877ff700 1 -- 172.21.15.72:0/1981334984 shutdown_connections 2023-07-27T20:34:24.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.445+0000 7fdc877ff700 1 -- 172.21.15.72:0/1981334984 wait complete. 2023-07-27T20:34:24.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.447+0000 7fdc877ff700 1 Processor -- start 2023-07-27T20:34:24.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.447+0000 7fdc877ff700 1 -- start start 2023-07-27T20:34:24.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.448+0000 7fdc877ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdc6c004850 0x7fdc800c3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:24.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.448+0000 7fdc877ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc800c12c0 0x7fdc800aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:24.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.448+0000 7fdc877ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc801ea820 0x7fdc80149120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:24.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.448+0000 7fdc877ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc800c1780 con 0x7fdc800c12c0 2023-07-27T20:34:24.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.448+0000 7fdc877ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8014eae0 con 0x7fdc801ea820 2023-07-27T20:34:24.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.448+0000 7fdc877ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc800c2720 con 0x7fdc6c004850 2023-07-27T20:34:24.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.448+0000 7fdc84d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc800c12c0 0x7fdc800aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:24.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.448+0000 7fdc84d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc800c12c0 0x7fdc800aea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52122/0 (socket says 172.21.15.72:52122) 2023-07-27T20:34:24.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.449+0000 7fdc84d9a700 1 -- 172.21.15.72:0/3066561714 learned_addr learned my addr 172.21.15.72:0/3066561714 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:24.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.449+0000 7fdc8559b700 1 --2- 172.21.15.72:0/3066561714 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdc6c004850 0x7fdc800c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:24.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.449+0000 7fdc85d9c700 1 --2- 172.21.15.72:0/3066561714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc801ea820 0x7fdc80149120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:24.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.449+0000 7fdc84d9a700 1 -- 172.21.15.72:0/3066561714 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdc6c004850 msgr2=0x7fdc800c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:24.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.449+0000 7fdc84d9a700 1 --2- 172.21.15.72:0/3066561714 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdc6c004850 0x7fdc800c3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:24.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.449+0000 7fdc84d9a700 1 -- 172.21.15.72:0/3066561714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc801ea820 msgr2=0x7fdc80149120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:24.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.449+0000 7fdc84d9a700 1 --2- 172.21.15.72:0/3066561714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc801ea820 0x7fdc80149120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:24.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.449+0000 7fdc84d9a700 1 -- 172.21.15.72:0/3066561714 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc8014e800 con 0x7fdc800c12c0 2023-07-27T20:34:24.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.449+0000 7fdc84d9a700 1 --2- 172.21.15.72:0/3066561714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc800c12c0 0x7fdc800aea80 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c005540 tx=0x7fdc70001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:24.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.449+0000 7fdc75ffb700 1 -- 172.21.15.72:0/3066561714 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc70007240 con 0x7fdc800c12c0 2023-07-27T20:34:24.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.449+0000 7fdc75ffb700 1 -- 172.21.15.72:0/3066561714 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc700073a0 con 0x7fdc800c12c0 2023-07-27T20:34:24.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.449+0000 7fdc877ff700 1 -- 172.21.15.72:0/3066561714 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc800c2d00 con 0x7fdc800c12c0 2023-07-27T20:34:24.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.449+0000 7fdc75ffb700 1 -- 172.21.15.72:0/3066561714 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc70007730 con 0x7fdc800c12c0 2023-07-27T20:34:24.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.450+0000 7fdc877ff700 1 -- 172.21.15.72:0/3066561714 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc800aefc0 con 0x7fdc800c12c0 2023-07-27T20:34:24.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.451+0000 7fdc877ff700 1 -- 172.21.15.72:0/3066561714 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc800c2b40 con 0x7fdc800c12c0 2023-07-27T20:34:24.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.451+0000 7fdc75ffb700 1 -- 172.21.15.72:0/3066561714 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdc70003680 con 0x7fdc800c12c0 2023-07-27T20:34:24.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.452+0000 7fdc75ffb700 1 --2- 172.21.15.72:0/3066561714 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fdc6406ace0 0x7fdc6406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:24.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.452+0000 7fdc75ffb700 1 -- 172.21.15.72:0/3066561714 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fdc7008a2d0 con 0x7fdc800c12c0 2023-07-27T20:34:24.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.452+0000 7fdc8559b700 1 --2- 172.21.15.72:0/3066561714 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fdc6406ace0 0x7fdc6406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:24.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.453+0000 7fdc8559b700 1 --2- 172.21.15.72:0/3066561714 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fdc6406ace0 0x7fdc6406d1a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdc8014a770 tx=0x7fdc7c000fa0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:24.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.456+0000 7fdc75ffb700 1 -- 172.21.15.72:0/3066561714 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdc700554d0 con 0x7fdc800c12c0 2023-07-27T20:34:24.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.656+0000 7fdc877ff700 1 -- 172.21.15.72:0/3066561714 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc80074310 con 0x7fdc800c12c0 2023-07-27T20:34:24.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.657+0000 7fdc75ffb700 1 -- 172.21.15.72:0/3066561714 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+15103 (secure 0 0 0) 0x7fdc70058af0 con 0x7fdc800c12c0 2023-07-27T20:34:24.645 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:34:24.645 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":53,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:34:22.199484+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:6832/1644610738":"2023-07-28T20:34:19.063944+0000","172.21.15.72:6835/1644610738":"2023-07-28T20:34:19.063944+0000","172.21.15.72:6833/1959104268":"2023-07-28T20:34:10.790274+0000","172.21.15.72:6834/1959104268":"2023-07-28T20:34:10.790274+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:34:24.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.659+0000 7fdc877ff700 1 -- 172.21.15.72:0/3066561714 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fdc6406ace0 msgr2=0x7fdc6406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:24.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.659+0000 7fdc877ff700 1 --2- 172.21.15.72:0/3066561714 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fdc6406ace0 0x7fdc6406d1a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdc8014a770 tx=0x7fdc7c000fa0 comp rx=0 tx=0).stop 2023-07-27T20:34:24.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.659+0000 7fdc877ff700 1 -- 172.21.15.72:0/3066561714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc800c12c0 msgr2=0x7fdc800aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:24.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.659+0000 7fdc877ff700 1 --2- 172.21.15.72:0/3066561714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc800c12c0 0x7fdc800aea80 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c005540 tx=0x7fdc70001120 comp rx=0 tx=0).stop 2023-07-27T20:34:24.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.659+0000 7fdc877ff700 1 -- 172.21.15.72:0/3066561714 shutdown_connections 2023-07-27T20:34:24.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.659+0000 7fdc877ff700 1 --2- 172.21.15.72:0/3066561714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc801ea820 0x7fdc80149120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:24.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.659+0000 7fdc877ff700 1 --2- 172.21.15.72:0/3066561714 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fdc6406ace0 0x7fdc6406d1a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:24.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.659+0000 7fdc877ff700 1 --2- 172.21.15.72:0/3066561714 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdc6c004850 0x7fdc800c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:24.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.659+0000 7fdc877ff700 1 --2- 172.21.15.72:0/3066561714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc800c12c0 0x7fdc800aea80 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:24.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.659+0000 7fdc877ff700 1 -- 172.21.15.72:0/3066561714 >> 172.21.15.72:0/3066561714 conn(0x7fdc800ab300 msgr2=0x7fdc80150940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:24.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.659+0000 7fdc877ff700 1 -- 172.21.15.72:0/3066561714 shutdown_connections 2023-07-27T20:34:24.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.660+0000 7fdc877ff700 1 -- 172.21.15.72:0/3066561714 wait complete. 2023-07-27T20:34:24.665 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-27T20:31:14.581785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T20:31:21.077941+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-27T20:34:24.666 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-27T20:34:24.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.876+0000 7f836a5ff700 1 Processor -- start 2023-07-27T20:34:24.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.876+0000 7f836a5ff700 1 -- start start 2023-07-27T20:34:24.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.877+0000 7f836a5ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f836414aab0 0x7f8364154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:24.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.877+0000 7f836a5ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83640c7c50 con 0x7f836406c1d0 2023-07-27T20:34:24.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.877+0000 7f836a5ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f836406bd40 con 0x7f83640c7740 2023-07-27T20:34:24.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.877+0000 7f836a5ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836406cd50 con 0x7f836414aab0 2023-07-27T20:34:24.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.878+0000 7f8368b9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f836406c1d0 0x7f836406c640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54558/0 (socket says 172.21.15.72:54558) 2023-07-27T20:34:24.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.878+0000 7f8368b9c700 1 -- 172.21.15.72:0/2152399136 learned_addr learned my addr 172.21.15.72:0/2152399136 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:24.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.878+0000 7f8363fff700 1 --2- 172.21.15.72:0/2152399136 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f836414aab0 0x7f8364154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:24.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.878+0000 7f83637fe700 1 -- 172.21.15.72:0/2152399136 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107453910 0 0) 0x7f83640c7c50 con 0x7f836406c1d0 2023-07-27T20:34:24.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.878+0000 7f83637fe700 1 -- 172.21.15.72:0/2152399136 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83500035b0 con 0x7f836406c1d0 2023-07-27T20:34:24.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.878+0000 7f83637fe700 1 -- 172.21.15.72:0/2152399136 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2879988408 0 0) 0x7f836406bd40 con 0x7f83640c7740 2023-07-27T20:34:24.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.878+0000 7f83637fe700 1 -- 172.21.15.72:0/2152399136 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83640c7c50 con 0x7f83640c7740 2023-07-27T20:34:24.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.878+0000 7f83637fe700 1 -- 172.21.15.72:0/2152399136 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3495777320 0 0) 0x7f83500035b0 con 0x7f836406c1d0 2023-07-27T20:34:24.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.878+0000 7f83637fe700 1 -- 172.21.15.72:0/2152399136 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f836414aab0 msgr2=0x7f8364154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:24.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.878+0000 7f83637fe700 1 --2- 172.21.15.72:0/2152399136 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f836414aab0 0x7f8364154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:24.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.878+0000 7f83637fe700 1 -- 172.21.15.72:0/2152399136 >> v1:172.21.15.173:6789/0 conn(0x7f83640c7740 legacy=0x7f83640c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:24.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.878+0000 7f83637fe700 1 -- 172.21.15.72:0/2152399136 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83640c62f0 con 0x7f836406c1d0 2023-07-27T20:34:24.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.878+0000 7f83637fe700 1 -- 172.21.15.72:0/2152399136 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f835c001970 con 0x7f836406c1d0 2023-07-27T20:34:24.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.878+0000 7f83637fe700 1 -- 172.21.15.72:0/2152399136 >> v1:172.21.15.72:6789/0 conn(0x7f836406c1d0 legacy=0x7f836406c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:24.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.878+0000 7f83637fe700 1 --2- 172.21.15.72:0/2152399136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8350003bc0 0x7f8350003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:24.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.878+0000 7f83637fe700 1 --2- 172.21.15.72:0/2152399136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8350004850 0x7f8350004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:24.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.878+0000 7f83637fe700 1 --2- 172.21.15.72:0/2152399136 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f836414aab0 0x7f8350005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:24.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.878+0000 7f83637fe700 1 -- 172.21.15.72:0/2152399136 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836406cd50 con 0x7f8350003bc0 2023-07-27T20:34:24.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.878+0000 7f83637fe700 1 -- 172.21.15.72:0/2152399136 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835000bac0 con 0x7f8350004850 2023-07-27T20:34:24.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.878+0000 7f83637fe700 1 -- 172.21.15.72:0/2152399136 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f835000bc80 con 0x7f836414aab0 2023-07-27T20:34:24.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.879+0000 7f8363fff700 1 --2- 172.21.15.72:0/2152399136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8350003bc0 0x7f8350003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:24.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.879+0000 7f835bfff700 1 --2- 172.21.15.72:0/2152399136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8350004850 0x7f8350004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:24.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.879+0000 7f8368b9c700 1 --2- 172.21.15.72:0/2152399136 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f836414aab0 0x7f8350005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:24.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.879+0000 7f8363fff700 1 -- 172.21.15.72:0/2152399136 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f836414aab0 msgr2=0x7f8350005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:24.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.879+0000 7f8363fff700 1 --2- 172.21.15.72:0/2152399136 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f836414aab0 0x7f8350005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:24.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.879+0000 7f8363fff700 1 -- 172.21.15.72:0/2152399136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8350004850 msgr2=0x7f8350004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:24.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.879+0000 7f8363fff700 1 --2- 172.21.15.72:0/2152399136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8350004850 0x7f8350004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:24.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.879+0000 7f8363fff700 1 -- 172.21.15.72:0/2152399136 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83500035b0 con 0x7f8350003bc0 2023-07-27T20:34:24.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.879+0000 7f8363fff700 1 --2- 172.21.15.72:0/2152399136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8350003bc0 0x7f8350003fc0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f8354009b60 tx=0x7f8350005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdc4c69f2c882a84 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:24.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.879+0000 7f83637fe700 1 -- 172.21.15.72:0/2152399136 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835400e6c0 con 0x7f8350003bc0 2023-07-27T20:34:24.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.880+0000 7f83637fe700 1 -- 172.21.15.72:0/2152399136 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835400e820 con 0x7f8350003bc0 2023-07-27T20:34:24.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.880+0000 7f83637fe700 1 -- 172.21.15.72:0/2152399136 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835400eb90 con 0x7f8350003bc0 2023-07-27T20:34:24.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.880+0000 7f836a5ff700 1 -- 172.21.15.72:0/2152399136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8350003bc0 msgr2=0x7f8350003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:24.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.880+0000 7f836a5ff700 1 --2- 172.21.15.72:0/2152399136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8350003bc0 0x7f8350003fc0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f8354009b60 tx=0x7f8350005880 comp rx=0 tx=0).stop 2023-07-27T20:34:24.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.880+0000 7f8368b9c700 1 -- 172.21.15.72:0/2152399136 reap_dead start 2023-07-27T20:34:24.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.880+0000 7f836a5ff700 1 -- 172.21.15.72:0/2152399136 shutdown_connections 2023-07-27T20:34:24.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.880+0000 7f836a5ff700 1 -- 172.21.15.72:0/2152399136 >> 172.21.15.72:0/2152399136 conn(0x7f83640ab3f0 msgr2=0x7f83640ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:24.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.880+0000 7f836a5ff700 1 -- 172.21.15.72:0/2152399136 shutdown_connections 2023-07-27T20:34:24.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.880+0000 7f836a5ff700 1 -- 172.21.15.72:0/2152399136 wait complete. 2023-07-27T20:34:24.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.882+0000 7f836a5ff700 1 Processor -- start 2023-07-27T20:34:24.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.882+0000 7f836a5ff700 1 -- start start 2023-07-27T20:34:24.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.883+0000 7f836a5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8350003bc0 0x7f83641ec580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:24.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.883+0000 7f836a5ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f83641ecac0 0x7f8364150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:24.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.883+0000 7f836a5ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8364147c50 0x7f83641eb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:24.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.883+0000 7f836a5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836414f140 con 0x7f8350003bc0 2023-07-27T20:34:24.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.883+0000 7f836a5ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836414f390 con 0x7f8364147c50 2023-07-27T20:34:24.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.883+0000 7f836a5ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836414f670 con 0x7f83641ecac0 2023-07-27T20:34:24.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.883+0000 7f8363fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8350003bc0 0x7f83641ec580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:24.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.883+0000 7f8363fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8350003bc0 0x7f83641ec580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52146/0 (socket says 172.21.15.72:52146) 2023-07-27T20:34:24.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.883+0000 7f8363fff700 1 -- 172.21.15.72:0/677555381 learned_addr learned my addr 172.21.15.72:0/677555381 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:24.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.883+0000 7f835bfff700 1 --2- 172.21.15.72:0/677555381 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f83641ecac0 0x7f8364150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:24.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.883+0000 7f8368b9c700 1 --2- 172.21.15.72:0/677555381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8364147c50 0x7f83641eb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:24.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.883+0000 7f8363fff700 1 -- 172.21.15.72:0/677555381 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f83641ecac0 msgr2=0x7f8364150fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:24.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.883+0000 7f8363fff700 1 --2- 172.21.15.72:0/677555381 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f83641ecac0 0x7f8364150fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:24.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.883+0000 7f8363fff700 1 -- 172.21.15.72:0/677555381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8364147c50 msgr2=0x7f83641eb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:24.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.883+0000 7f8363fff700 1 --2- 172.21.15.72:0/677555381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8364147c50 0x7f83641eb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:24.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.883+0000 7f8363fff700 1 -- 172.21.15.72:0/677555381 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836414f950 con 0x7f8350003bc0 2023-07-27T20:34:24.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.883+0000 7f8368b9c700 1 --2- 172.21.15.72:0/677555381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8364147c50 0x7f83641eb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:24.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.883+0000 7f835bfff700 1 --2- 172.21.15.72:0/677555381 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f83641ecac0 0x7f8364150fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:24.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.884+0000 7f8363fff700 1 --2- 172.21.15.72:0/677555381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8350003bc0 0x7f83641ec580 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f8350005830 tx=0x7f83540047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:24.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.884+0000 7f83617fa700 1 -- 172.21.15.72:0/677555381 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835400e6c0 con 0x7f8350003bc0 2023-07-27T20:34:24.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.884+0000 7f83617fa700 1 -- 172.21.15.72:0/677555381 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8354003ad0 con 0x7f8350003bc0 2023-07-27T20:34:24.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.884+0000 7f836a5ff700 1 -- 172.21.15.72:0/677555381 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f836414fc30 con 0x7f8350003bc0 2023-07-27T20:34:24.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.884+0000 7f83617fa700 1 -- 172.21.15.72:0/677555381 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8354003e80 con 0x7f8350003bc0 2023-07-27T20:34:24.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.884+0000 7f836a5ff700 1 -- 172.21.15.72:0/677555381 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f836414e140 con 0x7f8350003bc0 2023-07-27T20:34:24.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.885+0000 7f836a5ff700 1 -- 172.21.15.72:0/677555381 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83641eafd0 con 0x7f8350003bc0 2023-07-27T20:34:24.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.886+0000 7f83617fa700 1 -- 172.21.15.72:0/677555381 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8354013470 con 0x7f8350003bc0 2023-07-27T20:34:24.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.887+0000 7f83617fa700 1 --2- 172.21.15.72:0/677555381 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f834406ace0 0x7f834406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:24.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.887+0000 7f83617fa700 1 -- 172.21.15.72:0/677555381 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f835408ab50 con 0x7f8350003bc0 2023-07-27T20:34:24.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.887+0000 7f835bfff700 1 --2- 172.21.15.72:0/677555381 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f834406ace0 0x7f834406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:24.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.888+0000 7f835bfff700 1 --2- 172.21.15.72:0/677555381 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f834406ace0 0x7f834406d1a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f834c007fd0 tx=0x7f834c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:24.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:24.891+0000 7f83617fa700 1 -- 172.21.15.72:0/677555381 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8354055f10 con 0x7f8350003bc0 2023-07-27T20:34:25.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.082+0000 7f836a5ff700 1 -- 172.21.15.72:0/677555381 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f836414f140 con 0x7f8350003bc0 2023-07-27T20:34:25.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.083+0000 7f83617fa700 1 -- 172.21.15.72:0/677555381 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8354059530 con 0x7f8350003bc0 2023-07-27T20:34:25.070 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-27T20:34:25.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.085+0000 7f836a5ff700 1 -- 172.21.15.72:0/677555381 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f834406ace0 msgr2=0x7f834406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:25.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.085+0000 7f836a5ff700 1 --2- 172.21.15.72:0/677555381 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f834406ace0 0x7f834406d1a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f834c007fd0 tx=0x7f834c009040 comp rx=0 tx=0).stop 2023-07-27T20:34:25.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.085+0000 7f836a5ff700 1 -- 172.21.15.72:0/677555381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8350003bc0 msgr2=0x7f83641ec580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:25.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.085+0000 7f836a5ff700 1 --2- 172.21.15.72:0/677555381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8350003bc0 0x7f83641ec580 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f8350005830 tx=0x7f83540047c0 comp rx=0 tx=0).stop 2023-07-27T20:34:25.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.085+0000 7f836a5ff700 1 -- 172.21.15.72:0/677555381 shutdown_connections 2023-07-27T20:34:25.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.085+0000 7f836a5ff700 1 --2- 172.21.15.72:0/677555381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8364147c50 0x7f83641eb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:25.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.085+0000 7f836a5ff700 1 --2- 172.21.15.72:0/677555381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8350003bc0 0x7f83641ec580 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:25.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.085+0000 7f836a5ff700 1 --2- 172.21.15.72:0/677555381 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f834406ace0 0x7f834406d1a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:25.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.085+0000 7f836a5ff700 1 --2- 172.21.15.72:0/677555381 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f83641ecac0 0x7f8364150fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:25.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.085+0000 7f836a5ff700 1 -- 172.21.15.72:0/677555381 >> 172.21.15.72:0/677555381 conn(0x7f83640ab3f0 msgr2=0x7f83640c40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:25.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.085+0000 7f836a5ff700 1 -- 172.21.15.72:0/677555381 shutdown_connections 2023-07-27T20:34:25.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.085+0000 7f836a5ff700 1 -- 172.21.15.72:0/677555381 wait complete. 2023-07-27T20:34:25.090 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T20:34:25.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.306+0000 7feeb05ff700 1 Processor -- start 2023-07-27T20:34:25.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.306+0000 7feeb05ff700 1 -- start start 2023-07-27T20:34:25.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.307+0000 7feeb05ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feea80c7740 0x7feea80c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:25.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.307+0000 7feeb05ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7feea80c4700 0x7feea806c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:25.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.307+0000 7feeb05ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea80c7c50 con 0x7feea814aab0 2023-07-27T20:34:25.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.307+0000 7feeb05ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea806bd40 con 0x7feea80c7740 2023-07-27T20:34:25.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.307+0000 7feeb05ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea80c62f0 con 0x7feea80c4700 2023-07-27T20:34:25.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.308+0000 7feeadb9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feea80c7740 0x7feea80c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:25.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.308+0000 7feeadb9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feea80c7740 0x7feea80c41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52148/0 (socket says 172.21.15.72:52148) 2023-07-27T20:34:25.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.308+0000 7feeadb9a700 1 -- 172.21.15.72:0/2785413015 learned_addr learned my addr 172.21.15.72:0/2785413015 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:25.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.308+0000 7feeadb9a700 1 -- 172.21.15.72:0/2785413015 >> v2:172.21.15.173:3300/0 conn(0x7feea80c4700 msgr2=0x7feea806c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:25.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.308+0000 7feeadb9a700 1 --2- 172.21.15.72:0/2785413015 >> v2:172.21.15.173:3300/0 conn(0x7feea80c4700 0x7feea806c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:25.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.308+0000 7feeadb9a700 1 -- 172.21.15.72:0/2785413015 >> v1:172.21.15.173:6789/0 conn(0x7feea814aab0 legacy=0x7feea8154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:25.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.308+0000 7feeadb9a700 1 -- 172.21.15.72:0/2785413015 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea806d200 con 0x7feea80c7740 2023-07-27T20:34:25.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.308+0000 7feeadb9a700 1 --2- 172.21.15.72:0/2785413015 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feea80c7740 0x7feea80c41c0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7feea80c96f0 tx=0x7fee98009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=334ec39f22dfa0e3 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:25.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.309+0000 7feead399700 1 -- 172.21.15.72:0/2785413015 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee98004230 con 0x7feea80c7740 2023-07-27T20:34:25.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.309+0000 7feead399700 1 -- 172.21.15.72:0/2785413015 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee98004390 con 0x7feea80c7740 2023-07-27T20:34:25.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.309+0000 7feead399700 1 -- 172.21.15.72:0/2785413015 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee980036a0 con 0x7feea80c7740 2023-07-27T20:34:25.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.309+0000 7feeb05ff700 1 -- 172.21.15.72:0/2785413015 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feea80c7740 msgr2=0x7feea80c41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:25.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.309+0000 7feeb05ff700 1 --2- 172.21.15.72:0/2785413015 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feea80c7740 0x7feea80c41c0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7feea80c96f0 tx=0x7fee98009bd0 comp rx=0 tx=0).stop 2023-07-27T20:34:25.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.309+0000 7feeb05ff700 1 -- 172.21.15.72:0/2785413015 shutdown_connections 2023-07-27T20:34:25.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.309+0000 7feeb05ff700 1 --2- 172.21.15.72:0/2785413015 >> v2:172.21.15.173:3300/0 conn(0x7feea80c4700 0x7feea806c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:25.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.309+0000 7feeb05ff700 1 --2- 172.21.15.72:0/2785413015 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feea80c7740 0x7feea80c41c0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:25.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.309+0000 7feeb05ff700 1 -- 172.21.15.72:0/2785413015 >> 172.21.15.72:0/2785413015 conn(0x7feea80ab3f0 msgr2=0x7feea80ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:25.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.309+0000 7feeb05ff700 1 -- 172.21.15.72:0/2785413015 shutdown_connections 2023-07-27T20:34:25.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.310+0000 7feeb05ff700 1 -- 172.21.15.72:0/2785413015 wait complete. 2023-07-27T20:34:25.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.312+0000 7feeb05ff700 1 Processor -- start 2023-07-27T20:34:25.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.312+0000 7feeb05ff700 1 -- start start 2023-07-27T20:34:25.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.313+0000 7feeb05ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feea80c4700 0x7feea81ea3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:25.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.313+0000 7feeb05ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feea80c7740 0x7feea80ad820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:25.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.313+0000 7feeb05ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feea814aab0 0x7feea814cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:25.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.313+0000 7feeb05ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea80bd400 con 0x7feea814aab0 2023-07-27T20:34:25.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.313+0000 7feeb05ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea81ea920 con 0x7feea80c4700 2023-07-27T20:34:25.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.313+0000 7feeb05ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea80be3e0 con 0x7feea80c7740 2023-07-27T20:34:25.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.314+0000 7feeaeb9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feea814aab0 0x7feea814cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:25.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.314+0000 7feeaeb9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feea814aab0 0x7feea814cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52162/0 (socket says 172.21.15.72:52162) 2023-07-27T20:34:25.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.314+0000 7feeaeb9c700 1 -- 172.21.15.72:0/2960301822 learned_addr learned my addr 172.21.15.72:0/2960301822 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:25.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.314+0000 7feeae39b700 1 --2- 172.21.15.72:0/2960301822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feea80c4700 0x7feea81ea3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:25.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.314+0000 7feeadb9a700 1 --2- 172.21.15.72:0/2960301822 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feea80c7740 0x7feea80ad820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:25.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.314+0000 7feeaeb9c700 1 -- 172.21.15.72:0/2960301822 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feea80c7740 msgr2=0x7feea80ad820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:25.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.314+0000 7feeaeb9c700 1 --2- 172.21.15.72:0/2960301822 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feea80c7740 0x7feea80ad820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:25.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.314+0000 7feeaeb9c700 1 -- 172.21.15.72:0/2960301822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feea80c4700 msgr2=0x7feea81ea3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:25.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.314+0000 7feeaeb9c700 1 --2- 172.21.15.72:0/2960301822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feea80c4700 0x7feea81ea3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:25.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.314+0000 7feeaeb9c700 1 -- 172.21.15.72:0/2960301822 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee98009550 con 0x7feea814aab0 2023-07-27T20:34:25.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.314+0000 7feeae39b700 1 --2- 172.21.15.72:0/2960301822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feea80c4700 0x7feea81ea3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:25.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.314+0000 7feeadb9a700 1 --2- 172.21.15.72:0/2960301822 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feea80c7740 0x7feea80ad820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:25.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.314+0000 7feeaeb9c700 1 --2- 172.21.15.72:0/2960301822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feea814aab0 0x7feea814cb70 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7feea000b970 tx=0x7feea000bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:25.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.314+0000 7fee9effd700 1 -- 172.21.15.72:0/2960301822 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea000c950 con 0x7feea814aab0 2023-07-27T20:34:25.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.315+0000 7fee9effd700 1 -- 172.21.15.72:0/2960301822 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea000cad0 con 0x7feea814aab0 2023-07-27T20:34:25.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.315+0000 7fee9effd700 1 -- 172.21.15.72:0/2960301822 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea000ce80 con 0x7feea814aab0 2023-07-27T20:34:25.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.315+0000 7feeb05ff700 1 -- 172.21.15.72:0/2960301822 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea80ac4e0 con 0x7feea814aab0 2023-07-27T20:34:25.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.315+0000 7feeb05ff700 1 -- 172.21.15.72:0/2960301822 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea80addb0 con 0x7feea814aab0 2023-07-27T20:34:25.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.316+0000 7feeb05ff700 1 -- 172.21.15.72:0/2960301822 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea80ac700 con 0x7feea814aab0 2023-07-27T20:34:25.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.317+0000 7fee9effd700 1 -- 172.21.15.72:0/2960301822 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feea001d3b0 con 0x7feea814aab0 2023-07-27T20:34:25.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.317+0000 7fee9effd700 1 --2- 172.21.15.72:0/2960301822 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fee8c06ace0 0x7fee8c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:25.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.317+0000 7fee9effd700 1 -- 172.21.15.72:0/2960301822 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5702+0+0 (secure 0 0 0) 0x7feea0006e40 con 0x7feea814aab0 2023-07-27T20:34:25.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.318+0000 7feeae39b700 1 --2- 172.21.15.72:0/2960301822 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fee8c06ace0 0x7fee8c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:25.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.319+0000 7feeae39b700 1 --2- 172.21.15.72:0/2960301822 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fee8c06ace0 0x7fee8c06d1a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7feea4006fd0 tx=0x7feea4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:25.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.322+0000 7fee9effd700 1 -- 172.21.15.72:0/2960301822 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7feea80ac700 con 0x7feea814aab0 2023-07-27T20:34:25.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.515+0000 7feeb05ff700 1 -- 172.21.15.72:0/2960301822 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7feea80c6af0 con 0x7feea814aab0 2023-07-27T20:34:25.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.515+0000 7fee9effd700 1 -- 172.21.15.72:0/2960301822 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v53) v1 ==== 92+0+10 (secure 0 0 0) 0x7feea00190a0 con 0x7feea814aab0 2023-07-27T20:34:25.503 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-27T20:34:25.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.517+0000 7feeb05ff700 1 -- 172.21.15.72:0/2960301822 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fee8c06ace0 msgr2=0x7fee8c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:25.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.517+0000 7feeb05ff700 1 --2- 172.21.15.72:0/2960301822 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fee8c06ace0 0x7fee8c06d1a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7feea4006fd0 tx=0x7feea4008040 comp rx=0 tx=0).stop 2023-07-27T20:34:25.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.517+0000 7feeb05ff700 1 -- 172.21.15.72:0/2960301822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feea814aab0 msgr2=0x7feea814cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:25.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.517+0000 7feeb05ff700 1 --2- 172.21.15.72:0/2960301822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feea814aab0 0x7feea814cb70 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7feea000b970 tx=0x7feea000bd30 comp rx=0 tx=0).stop 2023-07-27T20:34:25.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.517+0000 7feeb05ff700 1 -- 172.21.15.72:0/2960301822 shutdown_connections 2023-07-27T20:34:25.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.517+0000 7feeb05ff700 1 --2- 172.21.15.72:0/2960301822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feea814aab0 0x7feea814cb70 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:25.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.517+0000 7feeb05ff700 1 --2- 172.21.15.72:0/2960301822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feea80c4700 0x7feea81ea3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:25.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.517+0000 7feeb05ff700 1 --2- 172.21.15.72:0/2960301822 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fee8c06ace0 0x7fee8c06d1a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:25.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.517+0000 7feeb05ff700 1 --2- 172.21.15.72:0/2960301822 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feea80c7740 0x7feea80ad820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:25.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.518+0000 7feeb05ff700 1 -- 172.21.15.72:0/2960301822 >> 172.21.15.72:0/2960301822 conn(0x7feea80ab3f0 msgr2=0x7feea806c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:25.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.518+0000 7feeb05ff700 1 -- 172.21.15.72:0/2960301822 shutdown_connections 2023-07-27T20:34:25.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.518+0000 7feeb05ff700 1 -- 172.21.15.72:0/2960301822 wait complete. 2023-07-27T20:34:25.523 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-27T20:34:25.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.735+0000 7f0ff6dff700 1 Processor -- start 2023-07-27T20:34:25.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.735+0000 7f0ff6dff700 1 -- start start 2023-07-27T20:34:25.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.736+0000 7f0ff6dff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0ff00c38d0 0x7f0ff0154050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:25.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.736+0000 7f0ff6dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ff006af00 0x7f0ff0154590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:25.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.736+0000 7f0ff6dff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff00c0760 con 0x7f0ff00bbf20 2023-07-27T20:34:25.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.736+0000 7f0ff6dff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff00a52e0 con 0x7f0ff00c38d0 2023-07-27T20:34:25.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.736+0000 7f0ff6dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff0158000 con 0x7f0ff006af00 2023-07-27T20:34:25.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.737+0000 7f0feffff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0ff00c38d0 0x7f0ff0154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:25.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.737+0000 7f0ff4b9b700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f0ff00bbf20 0x7f0ff006a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.72:50572/0 (socket says 172.21.15.72:50572) 2023-07-27T20:34:25.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.737+0000 7f0ff539c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ff006af00 0x7f0ff0154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:25.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.737+0000 7f0ff4b9b700 1 -- 172.21.15.72:0/117928102 learned_addr learned my addr 172.21.15.72:0/117928102 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:25.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.737+0000 7f0fef7fe700 1 -- 172.21.15.72:0/117928102 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1987655450 0 0) 0x7f0ff00c0760 con 0x7f0ff00bbf20 2023-07-27T20:34:25.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.737+0000 7f0fef7fe700 1 -- 172.21.15.72:0/117928102 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fe00035b0 con 0x7f0ff00bbf20 2023-07-27T20:34:25.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.737+0000 7f0feffff700 1 -- 172.21.15.72:0/117928102 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ff006af00 msgr2=0x7f0ff0154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:25.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.737+0000 7f0feffff700 1 --2- 172.21.15.72:0/117928102 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ff006af00 0x7f0ff0154590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:25.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.737+0000 7f0feffff700 1 -- 172.21.15.72:0/117928102 >> v1:172.21.15.173:6789/0 conn(0x7f0ff00bbf20 legacy=0x7f0ff006a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:25.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.737+0000 7f0feffff700 1 -- 172.21.15.72:0/117928102 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff01581f0 con 0x7f0ff00c38d0 2023-07-27T20:34:25.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.737+0000 7f0ff539c700 1 --2- 172.21.15.72:0/117928102 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ff006af00 0x7f0ff0154590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:34:25.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.738+0000 7f0feffff700 1 --2- 172.21.15.72:0/117928102 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ff00c38d0 0x7f0ff0154050 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc009840 tx=0x7f0fdc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffc2946b00358069 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:25.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.738+0000 7f0fef7fe700 1 -- 172.21.15.72:0/117928102 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc011830 con 0x7f0ff00c38d0 2023-07-27T20:34:25.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.738+0000 7f0fef7fe700 1 -- 172.21.15.72:0/117928102 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fdc011990 con 0x7f0ff00c38d0 2023-07-27T20:34:25.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.738+0000 7f0fef7fe700 1 -- 172.21.15.72:0/117928102 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc011d20 con 0x7f0ff00c38d0 2023-07-27T20:34:25.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.738+0000 7f0ff6dff700 1 -- 172.21.15.72:0/117928102 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ff00c38d0 msgr2=0x7f0ff0154050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:25.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.738+0000 7f0ff6dff700 1 --2- 172.21.15.72:0/117928102 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ff00c38d0 0x7f0ff0154050 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc009840 tx=0x7f0fdc009b50 comp rx=0 tx=0).stop 2023-07-27T20:34:25.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.739+0000 7f0ff6dff700 1 -- 172.21.15.72:0/117928102 shutdown_connections 2023-07-27T20:34:25.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.739+0000 7f0ff6dff700 1 --2- 172.21.15.72:0/117928102 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ff006af00 0x7f0ff0154590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:25.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.739+0000 7f0ff6dff700 1 --2- 172.21.15.72:0/117928102 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ff00c38d0 0x7f0ff0154050 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:25.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.739+0000 7f0ff6dff700 1 -- 172.21.15.72:0/117928102 >> 172.21.15.72:0/117928102 conn(0x7f0ff00c59d0 msgr2=0x7f0ff00c5de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:25.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.739+0000 7f0ff6dff700 1 -- 172.21.15.72:0/117928102 shutdown_connections 2023-07-27T20:34:25.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.739+0000 7f0ff6dff700 1 -- 172.21.15.72:0/117928102 wait complete. 2023-07-27T20:34:25.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.740+0000 7f0ff6dff700 1 Processor -- start 2023-07-27T20:34:25.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.740+0000 7f0ff6dff700 1 -- start start 2023-07-27T20:34:25.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.741+0000 7f0ff6dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ff006af00 0x7f0ff00bd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:25.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.741+0000 7f0ff6dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ff00bbf20 0x7f0ff01e9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:25.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.741+0000 7f0ff6dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ff00c38d0 0x7f0ff00bb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:25.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.741+0000 7f0ff6dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff0146c40 con 0x7f0ff00bbf20 2023-07-27T20:34:25.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.741+0000 7f0ff6dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff0148310 con 0x7f0ff006af00 2023-07-27T20:34:25.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.741+0000 7f0ff6dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff01ea1f0 con 0x7f0ff00c38d0 2023-07-27T20:34:25.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.742+0000 7f0feffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ff00bbf20 0x7f0ff01e9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:25.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.742+0000 7f0feffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ff00bbf20 0x7f0ff01e9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52174/0 (socket says 172.21.15.72:52174) 2023-07-27T20:34:25.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.742+0000 7f0feffff700 1 -- 172.21.15.72:0/3762291331 learned_addr learned my addr 172.21.15.72:0/3762291331 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:25.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.742+0000 7f0ff4b9b700 1 --2- 172.21.15.72:0/3762291331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ff006af00 0x7f0ff00bd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:25.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.742+0000 7f0ff539c700 1 --2- 172.21.15.72:0/3762291331 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ff00c38d0 0x7f0ff00bb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:25.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.742+0000 7f0feffff700 1 -- 172.21.15.72:0/3762291331 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ff00c38d0 msgr2=0x7f0ff00bb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:25.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.742+0000 7f0feffff700 1 --2- 172.21.15.72:0/3762291331 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ff00c38d0 0x7f0ff00bb0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:25.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.742+0000 7f0feffff700 1 -- 172.21.15.72:0/3762291331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ff006af00 msgr2=0x7f0ff00bd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:25.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.742+0000 7f0feffff700 1 --2- 172.21.15.72:0/3762291331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ff006af00 0x7f0ff00bd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:25.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.742+0000 7f0feffff700 1 -- 172.21.15.72:0/3762291331 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe80094a0 con 0x7f0ff00bbf20 2023-07-27T20:34:25.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.742+0000 7f0ff4b9b700 1 --2- 172.21.15.72:0/3762291331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ff006af00 0x7f0ff00bd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:25.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.742+0000 7f0ff539c700 1 --2- 172.21.15.72:0/3762291331 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ff00c38d0 0x7f0ff00bb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:25.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.742+0000 7f0feffff700 1 --2- 172.21.15.72:0/3762291331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ff00bbf20 0x7f0ff01e9cb0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc0090b0 tx=0x7f0fdc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:25.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.742+0000 7f0fed7fa700 1 -- 172.21.15.72:0/3762291331 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc0036a0 con 0x7f0ff00bbf20 2023-07-27T20:34:25.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.742+0000 7f0fed7fa700 1 -- 172.21.15.72:0/3762291331 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fdc01f070 con 0x7f0ff00bbf20 2023-07-27T20:34:25.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.742+0000 7f0ff6dff700 1 -- 172.21.15.72:0/3762291331 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fdc0094a0 con 0x7f0ff00bbf20 2023-07-27T20:34:25.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.743+0000 7f0fed7fa700 1 -- 172.21.15.72:0/3762291331 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc003a40 con 0x7f0ff00bbf20 2023-07-27T20:34:25.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.743+0000 7f0ff6dff700 1 -- 172.21.15.72:0/3762291331 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff0147a70 con 0x7f0ff00bbf20 2023-07-27T20:34:25.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.744+0000 7f0ff6dff700 1 -- 172.21.15.72:0/3762291331 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff0148cf0 con 0x7f0ff00bbf20 2023-07-27T20:34:25.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.744+0000 7f0fed7fa700 1 -- 172.21.15.72:0/3762291331 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0fdc003ba0 con 0x7f0ff00bbf20 2023-07-27T20:34:25.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.745+0000 7f0fed7fa700 1 --2- 172.21.15.72:0/3762291331 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0fd406ace0 0x7f0fd406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:25.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.746+0000 7f0fed7fa700 1 -- 172.21.15.72:0/3762291331 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f0fdc021070 con 0x7f0ff00bbf20 2023-07-27T20:34:25.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.746+0000 7f0ff4b9b700 1 --2- 172.21.15.72:0/3762291331 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0fd406ace0 0x7f0fd406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:25.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.747+0000 7f0ff4b9b700 1 --2- 172.21.15.72:0/3762291331 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0fd406ace0 0x7f0fd406d1a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4001560 tx=0x7f0fe4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:25.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.750+0000 7f0fed7fa700 1 -- 172.21.15.72:0/3762291331 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0ff0148cf0 con 0x7f0ff00bbf20 2023-07-27T20:34:25.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.944+0000 7f0ff6dff700 1 -- 172.21.15.72:0/3762291331 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0ff0148cf0 con 0x7f0ff00bbf20 2023-07-27T20:34:25.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.948+0000 7f0fed7fa700 1 -- 172.21.15.72:0/3762291331 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0ff0148cf0 con 0x7f0ff00bbf20 2023-07-27T20:34:25.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.951+0000 7f0ff6dff700 1 -- 172.21.15.72:0/3762291331 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0fd406ace0 msgr2=0x7f0fd406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:25.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.951+0000 7f0ff6dff700 1 --2- 172.21.15.72:0/3762291331 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0fd406ace0 0x7f0fd406d1a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4001560 tx=0x7f0fe4009040 comp rx=0 tx=0).stop 2023-07-27T20:34:25.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.951+0000 7f0ff6dff700 1 -- 172.21.15.72:0/3762291331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ff00bbf20 msgr2=0x7f0ff01e9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:25.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.951+0000 7f0ff6dff700 1 --2- 172.21.15.72:0/3762291331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ff00bbf20 0x7f0ff01e9cb0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc0090b0 tx=0x7f0fdc004750 comp rx=0 tx=0).stop 2023-07-27T20:34:25.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.951+0000 7f0ff6dff700 1 -- 172.21.15.72:0/3762291331 shutdown_connections 2023-07-27T20:34:25.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.951+0000 7f0ff6dff700 1 --2- 172.21.15.72:0/3762291331 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0fd406ace0 0x7f0fd406d1a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:25.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.951+0000 7f0ff6dff700 1 --2- 172.21.15.72:0/3762291331 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ff00c38d0 0x7f0ff00bb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:25.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.951+0000 7f0ff6dff700 1 --2- 172.21.15.72:0/3762291331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ff006af00 0x7f0ff00bd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:25.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.951+0000 7f0ff6dff700 1 --2- 172.21.15.72:0/3762291331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ff00bbf20 0x7f0ff01e9cb0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:25.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.951+0000 7f0ff6dff700 1 -- 172.21.15.72:0/3762291331 >> 172.21.15.72:0/3762291331 conn(0x7f0ff00c59d0 msgr2=0x7f0ff00a59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:25.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.951+0000 7f0ff6dff700 1 -- 172.21.15.72:0/3762291331 shutdown_connections 2023-07-27T20:34:25.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:25.951+0000 7f0ff6dff700 1 -- 172.21.15.72:0/3762291331 wait complete. 2023-07-27T20:34:25.956 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-27T20:34:25.957 DEBUG:teuthology.orchestra.run.smithi072:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T20:34:26.062 DEBUG:teuthology.orchestra.run.smithi173:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T20:34:26.168 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-27T20:34:26.168 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-27T20:34:26.169 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-27T20:34:26.218 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345404k,nr_inodes=4086351,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=37,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3274976k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 2023-07-27T20:34:26.219 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-07-27T20:34:26.219 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-27T20:34:26.266 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345584k,nr_inodes=4086396,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275012k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 2023-07-27T20:34:26.267 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-07-27T20:34:26.267 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T20:34:26.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.476+0000 7f42f2bff700 1 Processor -- start 2023-07-27T20:34:26.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.476+0000 7f42f2bff700 1 -- start start 2023-07-27T20:34:26.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.477+0000 7f42f2bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f42ec0c4400 0x7f42ec0c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:26.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.477+0000 7f42f2bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f42ec06b150 0x7f42ec0c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:26.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.477+0000 7f42f2bff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f42ec1549f0 0x7f42ec1514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:26.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.477+0000 7f42f2bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42ec1545d0 con 0x7f42ec0c4400 2023-07-27T20:34:26.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.477+0000 7f42f2bff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42ec06c860 con 0x7f42ec1549f0 2023-07-27T20:34:26.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.477+0000 7f42f2bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec0c5230 con 0x7f42ec06b150 2023-07-27T20:34:26.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.477+0000 7f42f099b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f42ec0c4400 0x7f42ec0c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:26.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.477+0000 7f42f099b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f42ec0c4400 0x7f42ec0c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52184/0 (socket says 172.21.15.72:52184) 2023-07-27T20:34:26.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.477+0000 7f42f099b700 1 -- 172.21.15.72:0/2701862571 learned_addr learned my addr 172.21.15.72:0/2701862571 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:26.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.478+0000 7f42ebfff700 1 --2- 172.21.15.72:0/2701862571 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f42ec06b150 0x7f42ec0c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:26.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.478+0000 7f42f119c700 1 --2- 172.21.15.72:0/2701862571 >> v2:172.21.15.173:3300/0 conn(0x7f42ec1549f0 0x7f42ec1514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:26.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.478+0000 7f42f099b700 1 -- 172.21.15.72:0/2701862571 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f42ec06b150 msgr2=0x7f42ec0c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:26.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.478+0000 7f42f099b700 1 --2- 172.21.15.72:0/2701862571 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f42ec06b150 0x7f42ec0c4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:26.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.478+0000 7f42f099b700 1 -- 172.21.15.72:0/2701862571 >> v2:172.21.15.173:3300/0 conn(0x7f42ec1549f0 msgr2=0x7f42ec1514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:26.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.478+0000 7f42f099b700 1 --2- 172.21.15.72:0/2701862571 >> v2:172.21.15.173:3300/0 conn(0x7f42ec1549f0 0x7f42ec1514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:26.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.478+0000 7f42f099b700 1 -- 172.21.15.72:0/2701862571 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ec06b710 con 0x7f42ec0c4400 2023-07-27T20:34:26.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.478+0000 7f42ebfff700 1 --2- 172.21.15.72:0/2701862571 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f42ec06b150 0x7f42ec0c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:26.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.478+0000 7f42f099b700 1 --2- 172.21.15.72:0/2701862571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42ec0c4400 0x7f42ec0c7710 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f42ec0c3df0 tx=0x7f42e0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88c3c9f7b92e547 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:26.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.478+0000 7f42eb7fe700 1 -- 172.21.15.72:0/2701862571 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e000b870 con 0x7f42ec0c4400 2023-07-27T20:34:26.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.478+0000 7f42eb7fe700 1 -- 172.21.15.72:0/2701862571 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e000b9d0 con 0x7f42ec0c4400 2023-07-27T20:34:26.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.478+0000 7f42eb7fe700 1 -- 172.21.15.72:0/2701862571 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e000bd60 con 0x7f42ec0c4400 2023-07-27T20:34:26.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.479+0000 7f42f2bff700 1 -- 172.21.15.72:0/2701862571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42ec0c4400 msgr2=0x7f42ec0c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:26.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.479+0000 7f42f2bff700 1 --2- 172.21.15.72:0/2701862571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42ec0c4400 0x7f42ec0c7710 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f42ec0c3df0 tx=0x7f42e0009bd0 comp rx=0 tx=0).stop 2023-07-27T20:34:26.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.479+0000 7f42f2bff700 1 -- 172.21.15.72:0/2701862571 shutdown_connections 2023-07-27T20:34:26.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.479+0000 7f42f2bff700 1 --2- 172.21.15.72:0/2701862571 >> v2:172.21.15.173:3300/0 conn(0x7f42ec1549f0 0x7f42ec1514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:26.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.479+0000 7f42f2bff700 1 --2- 172.21.15.72:0/2701862571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42ec0c4400 0x7f42ec0c7710 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:26.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.479+0000 7f42f2bff700 1 --2- 172.21.15.72:0/2701862571 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f42ec06b150 0x7f42ec0c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:26.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.479+0000 7f42f2bff700 1 -- 172.21.15.72:0/2701862571 >> 172.21.15.72:0/2701862571 conn(0x7f42ec0ab300 msgr2=0x7f42ec0ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:26.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.479+0000 7f42f2bff700 1 -- 172.21.15.72:0/2701862571 shutdown_connections 2023-07-27T20:34:26.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.479+0000 7f42f2bff700 1 -- 172.21.15.72:0/2701862571 wait complete. 2023-07-27T20:34:26.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.481+0000 7f42f2bff700 1 Processor -- start 2023-07-27T20:34:26.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.481+0000 7f42f2bff700 1 -- start start 2023-07-27T20:34:26.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.482+0000 7f42f2bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42ec06b150 0x7f42ec14b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:26.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.482+0000 7f42f2bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f42ec0c4400 0x7f42ec14cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:26.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.482+0000 7f42f2bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42ec1549f0 0x7f42ec1e9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:26.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.482+0000 7f42f2bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec14f370 con 0x7f42ec06b150 2023-07-27T20:34:26.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.482+0000 7f42f2bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec1e8f90 con 0x7f42ec1549f0 2023-07-27T20:34:26.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.482+0000 7f42f2bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec0c1200 con 0x7f42ec0c4400 2023-07-27T20:34:26.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.482+0000 7f42f099b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42ec06b150 0x7f42ec14b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:26.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.482+0000 7f42f099b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42ec06b150 0x7f42ec14b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52200/0 (socket says 172.21.15.72:52200) 2023-07-27T20:34:26.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.482+0000 7f42f099b700 1 -- 172.21.15.72:0/1777047790 learned_addr learned my addr 172.21.15.72:0/1777047790 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:26.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.482+0000 7f42f099b700 1 -- 172.21.15.72:0/1777047790 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f42ec0c4400 msgr2=0x7f42ec14cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:26.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.482+0000 7f42f099b700 1 --2- 172.21.15.72:0/1777047790 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f42ec0c4400 0x7f42ec14cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:26.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.482+0000 7f42f099b700 1 -- 172.21.15.72:0/1777047790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42ec1549f0 msgr2=0x7f42ec1e9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:26.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.482+0000 7f42f119c700 1 --2- 172.21.15.72:0/1777047790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42ec1549f0 0x7f42ec1e9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:26.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.482+0000 7f42f099b700 1 --2- 172.21.15.72:0/1777047790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42ec1549f0 0x7f42ec1e9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:26.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.482+0000 7f42f099b700 1 -- 172.21.15.72:0/1777047790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e0009550 con 0x7f42ec06b150 2023-07-27T20:34:26.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.482+0000 7f42f119c700 1 --2- 172.21.15.72:0/1777047790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42ec1549f0 0x7f42ec1e9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:26.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.483+0000 7f42f099b700 1 --2- 172.21.15.72:0/1777047790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42ec06b150 0x7f42ec14b9b0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f42e0000c00 tx=0x7f42e0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:26.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.483+0000 7f42e97fa700 1 -- 172.21.15.72:0/1777047790 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e0004540 con 0x7f42ec06b150 2023-07-27T20:34:26.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.483+0000 7f42e97fa700 1 -- 172.21.15.72:0/1777047790 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e00036a0 con 0x7f42ec06b150 2023-07-27T20:34:26.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.483+0000 7f42f2bff700 1 -- 172.21.15.72:0/1777047790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42ec0c14e0 con 0x7f42ec06b150 2023-07-27T20:34:26.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.483+0000 7f42e97fa700 1 -- 172.21.15.72:0/1777047790 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e0003a50 con 0x7f42ec06b150 2023-07-27T20:34:26.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.483+0000 7f42f2bff700 1 -- 172.21.15.72:0/1777047790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42ec1e9cb0 con 0x7f42ec06b150 2023-07-27T20:34:26.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.484+0000 7f42f2bff700 1 -- 172.21.15.72:0/1777047790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42ec1e9430 con 0x7f42ec06b150 2023-07-27T20:34:26.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.485+0000 7f42e97fa700 1 -- 172.21.15.72:0/1777047790 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f42e0021070 con 0x7f42ec06b150 2023-07-27T20:34:26.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.487+0000 7f42e97fa700 1 --2- 172.21.15.72:0/1777047790 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f42d006ace0 0x7f42d006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:26.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.487+0000 7f42e97fa700 1 -- 172.21.15.72:0/1777047790 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f42e008aa40 con 0x7f42ec06b150 2023-07-27T20:34:26.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.487+0000 7f42ebfff700 1 --2- 172.21.15.72:0/1777047790 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f42d006ace0 0x7f42d006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:26.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.488+0000 7f42ebfff700 1 --2- 172.21.15.72:0/1777047790 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f42d006ace0 0x7f42d006d1a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f42d8006fd0 tx=0x7f42d8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:26.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.491+0000 7f42e97fa700 1 -- 172.21.15.72:0/1777047790 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f42e0055c40 con 0x7f42ec06b150 2023-07-27T20:34:26.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.726+0000 7f42f2bff700 1 -- 172.21.15.72:0/1777047790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42ec074310 con 0x7f42ec06b150 2023-07-27T20:34:26.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.727+0000 7f42e97fa700 1 -- 172.21.15.72:0/1777047790 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f42e0015090 con 0x7f42ec06b150 2023-07-27T20:34:26.715 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:34:26.715 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/1685903768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1685903768},{"type":"v1","addr":"172.21.15.173:6836","nonce":1685903768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5269,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/43862591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":43862591},{"type":"v1","addr":"172.21.15.173:6837","nonce":43862591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":6153,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/409311051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":409311051},{"type":"v1","addr":"172.21.15.72:6834","nonce":409311051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":6246,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/1712533132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1712533132},{"type":"v1","addr":"172.21.15.72:6835","nonce":1712533132}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[]} 2023-07-27T20:34:26.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.729+0000 7f42f2bff700 1 -- 172.21.15.72:0/1777047790 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f42d006ace0 msgr2=0x7f42d006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:26.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.729+0000 7f42f2bff700 1 --2- 172.21.15.72:0/1777047790 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f42d006ace0 0x7f42d006d1a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f42d8006fd0 tx=0x7f42d8008040 comp rx=0 tx=0).stop 2023-07-27T20:34:26.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.729+0000 7f42f2bff700 1 -- 172.21.15.72:0/1777047790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42ec06b150 msgr2=0x7f42ec14b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:26.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.729+0000 7f42f2bff700 1 --2- 172.21.15.72:0/1777047790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42ec06b150 0x7f42ec14b9b0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f42e0000c00 tx=0x7f42e0004750 comp rx=0 tx=0).stop 2023-07-27T20:34:26.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.729+0000 7f42f2bff700 1 -- 172.21.15.72:0/1777047790 shutdown_connections 2023-07-27T20:34:26.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.729+0000 7f42f2bff700 1 --2- 172.21.15.72:0/1777047790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42ec1549f0 0x7f42ec1e9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:26.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.729+0000 7f42f2bff700 1 --2- 172.21.15.72:0/1777047790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42ec06b150 0x7f42ec14b9b0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:26.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.729+0000 7f42f2bff700 1 --2- 172.21.15.72:0/1777047790 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f42d006ace0 0x7f42d006d1a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:26.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.729+0000 7f42f2bff700 1 --2- 172.21.15.72:0/1777047790 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f42ec0c4400 0x7f42ec14cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:26.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.729+0000 7f42f2bff700 1 -- 172.21.15.72:0/1777047790 >> 172.21.15.72:0/1777047790 conn(0x7f42ec0ab300 msgr2=0x7f42ec1519e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:26.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.729+0000 7f42f2bff700 1 -- 172.21.15.72:0/1777047790 shutdown_connections 2023-07-27T20:34:26.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:26.729+0000 7f42f2bff700 1 -- 172.21.15.72:0/1777047790 wait complete. 2023-07-27T20:34:26.718 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 26 2023-07-27T20:34:26.735 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-27T20:34:26.735 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-27T20:34:26.735 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-27T20:34:26.735 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T20:34:26.736 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-27T20:34:26.736 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-27T20:34:26.736 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-27T20:34:26.737 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T20:34:26.737 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-27T20:34:26.737 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-27T20:34:26.737 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-27T20:34:26.738 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T20:34:26.738 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-27T20:34:26.738 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-27T20:34:26.738 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-27T20:34:26.738 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T20:34:26.749 INFO:tasks.ceph.mds.a:Stopped 2023-07-27T20:34:26.749 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-27T20:34:26.751 INFO:tasks.ceph.mds.c:Stopped 2023-07-27T20:34:26.751 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-27T20:34:26.754 INFO:tasks.ceph.mds.b:Stopped 2023-07-27T20:34:26.755 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-27T20:34:26.755 INFO:tasks.ceph.mds.d:Stopped 2023-07-27T20:34:26.756 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-27T20:34:26.795 INFO:tasks.ceph.mds.a:Started 2023-07-27T20:34:26.796 DEBUG:teuthology.parallel:result is None 2023-07-27T20:34:26.799 INFO:tasks.ceph.mds.c:Started 2023-07-27T20:34:26.799 DEBUG:teuthology.parallel:result is None 2023-07-27T20:34:26.800 INFO:tasks.ceph.mds.b:Started 2023-07-27T20:34:26.801 DEBUG:teuthology.parallel:result is None 2023-07-27T20:34:26.803 INFO:tasks.ceph.mds.d:Started 2023-07-27T20:34:26.803 DEBUG:teuthology.parallel:result is None 2023-07-27T20:34:26.804 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-27T20:34:26.944 INFO:tasks.ceph.mds.a.smithi072.stdout:starting mds.a at 2023-07-27T20:34:26.947 INFO:tasks.ceph.mds.c.smithi072.stdout:starting mds.c at 2023-07-27T20:34:26.952 INFO:tasks.ceph.mds.d.smithi173.stdout:starting mds.d at 2023-07-27T20:34:26.953 INFO:tasks.ceph.mds.b.smithi173.stdout:starting mds.b at 2023-07-27T20:34:27.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.025+0000 7f1cd75ff700 1 Processor -- start 2023-07-27T20:34:27.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.025+0000 7f1cd75ff700 1 -- start start 2023-07-27T20:34:27.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.026+0000 7f1cd75ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1cd0139960 0x7f1cd00c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:27.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.027+0000 7f1cd75ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cd00c1810 con 0x7f1cd01542e0 2023-07-27T20:34:27.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.027+0000 7f1cd75ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cd0139d40 con 0x7f1cd0139f80 2023-07-27T20:34:27.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.027+0000 7f1cd75ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd00c0ee0 con 0x7f1cd0139960 2023-07-27T20:34:27.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.027+0000 7f1cd5b9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1cd01542e0 0x7f1cd0154710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54580/0 (socket says 172.21.15.72:54580) 2023-07-27T20:34:27.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.027+0000 7f1cd5b9c700 1 -- 172.21.15.72:0/811560251 learned_addr learned my addr 172.21.15.72:0/811560251 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:27.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.027+0000 7f1cd539b700 1 --2- 172.21.15.72:0/811560251 >> v2:172.21.15.173:3300/0 conn(0x7f1cd0139960 0x7f1cd00c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:27.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.027+0000 7f1cc7fff700 1 -- 172.21.15.72:0/811560251 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3355392883 0 0) 0x7f1cd00c1810 con 0x7f1cd01542e0 2023-07-27T20:34:27.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.027+0000 7f1cc7fff700 1 -- 172.21.15.72:0/811560251 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cbc0035b0 con 0x7f1cd01542e0 2023-07-27T20:34:27.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.027+0000 7f1cd539b700 1 -- 172.21.15.72:0/811560251 >> v1:172.21.15.173:6789/0 conn(0x7f1cd0139f80 legacy=0x7f1cd00c1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:27.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.027+0000 7f1cd539b700 1 -- 172.21.15.72:0/811560251 >> v1:172.21.15.72:6789/0 conn(0x7f1cd01542e0 legacy=0x7f1cd0154710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:27.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.027+0000 7f1cd539b700 1 -- 172.21.15.72:0/811560251 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd0151060 con 0x7f1cd0139960 2023-07-27T20:34:27.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.028+0000 7f1cd539b700 1 --2- 172.21.15.72:0/811560251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1cd0139960 0x7f1cd00c12d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc009840 tx=0x7f1ccc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b89727e2b53ed18 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:27.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.028+0000 7f1cc7fff700 1 -- 172.21.15.72:0/811560251 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc011830 con 0x7f1cd0139960 2023-07-27T20:34:27.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.028+0000 7f1cc7fff700 1 -- 172.21.15.72:0/811560251 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ccc011990 con 0x7f1cd0139960 2023-07-27T20:34:27.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.028+0000 7f1cc7fff700 1 -- 172.21.15.72:0/811560251 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc011d20 con 0x7f1cd0139960 2023-07-27T20:34:27.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.028+0000 7f1cd75ff700 1 -- 172.21.15.72:0/811560251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1cd0139960 msgr2=0x7f1cd00c12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:27.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.028+0000 7f1cd75ff700 1 --2- 172.21.15.72:0/811560251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1cd0139960 0x7f1cd00c12d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc009840 tx=0x7f1ccc009b50 comp rx=0 tx=0).stop 2023-07-27T20:34:27.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.029+0000 7f1cd75ff700 1 -- 172.21.15.72:0/811560251 shutdown_connections 2023-07-27T20:34:27.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.029+0000 7f1cd75ff700 1 --2- 172.21.15.72:0/811560251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1cd0139960 0x7f1cd00c12d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:27.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.029+0000 7f1cd75ff700 1 -- 172.21.15.72:0/811560251 >> 172.21.15.72:0/811560251 conn(0x7f1cd006a190 msgr2=0x7f1cd006a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:27.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.029+0000 7f1cd75ff700 1 -- 172.21.15.72:0/811560251 shutdown_connections 2023-07-27T20:34:27.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.029+0000 7f1cd75ff700 1 -- 172.21.15.72:0/811560251 wait complete. 2023-07-27T20:34:27.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.030+0000 7f1cd75ff700 1 Processor -- start 2023-07-27T20:34:27.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.030+0000 7f1cd75ff700 1 -- start start 2023-07-27T20:34:27.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.031+0000 7f1cd75ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1cd0139960 0x7f1cd01509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:27.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.031+0000 7f1cd75ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1cd0139f80 0x7f1cd00c34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:27.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.031+0000 7f1cd75ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1cd01542e0 0x7f1cd014fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:27.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.031+0000 7f1cd75ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd014f590 con 0x7f1cd01542e0 2023-07-27T20:34:27.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.031+0000 7f1cd75ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd006aa30 con 0x7f1cd0139f80 2023-07-27T20:34:27.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.031+0000 7f1cd75ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd014eca0 con 0x7f1cd0139960 2023-07-27T20:34:27.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.031+0000 7f1cd5b9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1cd01542e0 0x7f1cd014fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:27.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.032+0000 7f1cd5b9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1cd01542e0 0x7f1cd014fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52222/0 (socket says 172.21.15.72:52222) 2023-07-27T20:34:27.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.032+0000 7f1cd5b9c700 1 -- 172.21.15.72:0/1440362536 learned_addr learned my addr 172.21.15.72:0/1440362536 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:27.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.032+0000 7f1cd539b700 1 --2- 172.21.15.72:0/1440362536 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1cd0139960 0x7f1cd01509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:27.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.032+0000 7f1cd4b9a700 1 --2- 172.21.15.72:0/1440362536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1cd0139f80 0x7f1cd00c34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:27.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.032+0000 7f1cd5b9c700 1 -- 172.21.15.72:0/1440362536 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1cd0139960 msgr2=0x7f1cd01509c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:27.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.032+0000 7f1cd5b9c700 1 --2- 172.21.15.72:0/1440362536 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1cd0139960 0x7f1cd01509c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:27.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.032+0000 7f1cd5b9c700 1 -- 172.21.15.72:0/1440362536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1cd0139f80 msgr2=0x7f1cd00c34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:27.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.032+0000 7f1cd5b9c700 1 --2- 172.21.15.72:0/1440362536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1cd0139f80 0x7f1cd00c34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:27.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.032+0000 7f1cd5b9c700 1 -- 172.21.15.72:0/1440362536 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ccc0094a0 con 0x7f1cd01542e0 2023-07-27T20:34:27.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.032+0000 7f1cd4b9a700 1 --2- 172.21.15.72:0/1440362536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1cd0139f80 0x7f1cd00c34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:27.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.032+0000 7f1cd5b9c700 1 --2- 172.21.15.72:0/1440362536 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1cd01542e0 0x7f1cd014fa20 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f1cc800cb40 tx=0x7f1cc800cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:27.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.032+0000 7f1cc5ffb700 1 -- 172.21.15.72:0/1440362536 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc800ab50 con 0x7f1cd01542e0 2023-07-27T20:34:27.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.032+0000 7f1cc5ffb700 1 -- 172.21.15.72:0/1440362536 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc800acb0 con 0x7f1cd01542e0 2023-07-27T20:34:27.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.032+0000 7f1cd75ff700 1 -- 172.21.15.72:0/1440362536 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cd014ef40 con 0x7f1cd01542e0 2023-07-27T20:34:27.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.032+0000 7f1cc5ffb700 1 -- 172.21.15.72:0/1440362536 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc8012620 con 0x7f1cd01542e0 2023-07-27T20:34:27.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.033+0000 7f1cd75ff700 1 -- 172.21.15.72:0/1440362536 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cd00c39e0 con 0x7f1cd01542e0 2023-07-27T20:34:27.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.034+0000 7f1cd75ff700 1 -- 172.21.15.72:0/1440362536 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cd014f700 con 0x7f1cd01542e0 2023-07-27T20:34:27.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.035+0000 7f1cc5ffb700 1 -- 172.21.15.72:0/1440362536 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1cc801b3b0 con 0x7f1cd01542e0 2023-07-27T20:34:27.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.035+0000 7f1cc5ffb700 1 --2- 172.21.15.72:0/1440362536 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1cb406ace0 0x7f1cb406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:27.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.036+0000 7f1cc5ffb700 1 -- 172.21.15.72:0/1440362536 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f1cc8089150 con 0x7f1cd01542e0 2023-07-27T20:34:27.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.036+0000 7f1cd539b700 1 --2- 172.21.15.72:0/1440362536 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1cb406ace0 0x7f1cb406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:27.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.037+0000 7f1cd539b700 1 --2- 172.21.15.72:0/1440362536 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1cb406ace0 0x7f1cb406d1a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc0090b0 tx=0x7f1ccc01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:27.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.040+0000 7f1cc5ffb700 1 -- 172.21.15.72:0/1440362536 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1cc8054350 con 0x7f1cd01542e0 2023-07-27T20:34:27.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:27.253+0000 7f1cd75ff700 1 -- 172.21.15.72:0/1440362536 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f1cd0074310 con 0x7f1cd01542e0 2023-07-27T20:34:28.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.257+0000 7f1cc5ffb700 1 -- 172.21.15.72:0/1440362536 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v58) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1cc8057970 con 0x7f1cd01542e0 2023-07-27T20:34:28.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.260+0000 7f1cd75ff700 1 -- 172.21.15.72:0/1440362536 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1cb406ace0 msgr2=0x7f1cb406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:28.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.260+0000 7f1cd75ff700 1 --2- 172.21.15.72:0/1440362536 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1cb406ace0 0x7f1cb406d1a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc0090b0 tx=0x7f1ccc01c040 comp rx=0 tx=0).stop 2023-07-27T20:34:28.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.260+0000 7f1cd75ff700 1 -- 172.21.15.72:0/1440362536 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1cd01542e0 msgr2=0x7f1cd014fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:28.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.260+0000 7f1cd75ff700 1 --2- 172.21.15.72:0/1440362536 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1cd01542e0 0x7f1cd014fa20 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f1cc800cb40 tx=0x7f1cc800cf00 comp rx=0 tx=0).stop 2023-07-27T20:34:28.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.260+0000 7f1cd75ff700 1 -- 172.21.15.72:0/1440362536 shutdown_connections 2023-07-27T20:34:28.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.260+0000 7f1cd75ff700 1 --2- 172.21.15.72:0/1440362536 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1cd01542e0 0x7f1cd014fa20 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:28.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.260+0000 7f1cd75ff700 1 --2- 172.21.15.72:0/1440362536 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f1cb406ace0 0x7f1cb406d1a0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:28.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.260+0000 7f1cd75ff700 1 --2- 172.21.15.72:0/1440362536 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1cd0139960 0x7f1cd01509c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:28.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.260+0000 7f1cd75ff700 1 --2- 172.21.15.72:0/1440362536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1cd0139f80 0x7f1cd00c34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:28.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.260+0000 7f1cd75ff700 1 -- 172.21.15.72:0/1440362536 >> 172.21.15.72:0/1440362536 conn(0x7f1cd006a190 msgr2=0x7f1cd0136310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:28.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.260+0000 7f1cd75ff700 1 -- 172.21.15.72:0/1440362536 shutdown_connections 2023-07-27T20:34:28.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.261+0000 7f1cd75ff700 1 -- 172.21.15.72:0/1440362536 wait complete. 2023-07-27T20:34:28.251 INFO:teuthology.orchestra.run.smithi072.stderr: removed all blocklist entries 2023-07-27T20:34:28.269 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-27T20:34:28.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.479+0000 7fc4aafff700 1 Processor -- start 2023-07-27T20:34:28.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.479+0000 7fc4aafff700 1 -- start start 2023-07-27T20:34:28.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.480+0000 7fc4aafff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc4a4139960 0x7fc4a40c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:28.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.480+0000 7fc4aafff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4a4139f80 0x7fc4a40c1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:28.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.480+0000 7fc4aafff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4a40c1810 con 0x7fc4a40c2340 2023-07-27T20:34:28.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.480+0000 7fc4aafff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4a40c0ee0 con 0x7fc4a4139960 2023-07-27T20:34:28.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.480+0000 7fc4aafff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a4139d40 con 0x7fc4a4139f80 2023-07-27T20:34:28.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.481+0000 7fc4a959c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc4a40c2340 0x7fc4a41542e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54590/0 (socket says 172.21.15.72:54590) 2023-07-27T20:34:28.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.481+0000 7fc4a8d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc4a4139960 0x7fc4a40c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:28.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.481+0000 7fc4a959c700 1 -- 172.21.15.72:0/1505877525 learned_addr learned my addr 172.21.15.72:0/1505877525 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:28.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.481+0000 7fc4a3fff700 1 --2- 172.21.15.72:0/1505877525 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4a4139f80 0x7fc4a40c1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:28.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.481+0000 7fc4a37fe700 1 -- 172.21.15.72:0/1505877525 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 498629683 0 0) 0x7fc4a40c1810 con 0x7fc4a40c2340 2023-07-27T20:34:28.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.481+0000 7fc4a8d9b700 1 -- 172.21.15.72:0/1505877525 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4a4139f80 msgr2=0x7fc4a40c1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:28.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.481+0000 7fc4a8d9b700 1 --2- 172.21.15.72:0/1505877525 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4a4139f80 0x7fc4a40c1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:28.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.481+0000 7fc4a8d9b700 1 -- 172.21.15.72:0/1505877525 >> v1:172.21.15.72:6789/0 conn(0x7fc4a40c2340 legacy=0x7fc4a41542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:28.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.481+0000 7fc4a8d9b700 1 -- 172.21.15.72:0/1505877525 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a4151060 con 0x7fc4a4139960 2023-07-27T20:34:28.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.481+0000 7fc4a3fff700 1 --2- 172.21.15.72:0/1505877525 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4a4139f80 0x7fc4a40c1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:28.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.481+0000 7fc4a8d9b700 1 --2- 172.21.15.72:0/1505877525 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc4a4139960 0x7fc4a40c12d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fc498009840 tx=0x7fc498009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44dc321615490997 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:28.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.482+0000 7fc4a37fe700 1 -- 172.21.15.72:0/1505877525 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc498011830 con 0x7fc4a4139960 2023-07-27T20:34:28.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.482+0000 7fc4a37fe700 1 -- 172.21.15.72:0/1505877525 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc498011990 con 0x7fc4a4139960 2023-07-27T20:34:28.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.482+0000 7fc4a37fe700 1 -- 172.21.15.72:0/1505877525 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc498011d20 con 0x7fc4a4139960 2023-07-27T20:34:28.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.482+0000 7fc4aafff700 1 -- 172.21.15.72:0/1505877525 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc4a4139960 msgr2=0x7fc4a40c12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:28.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.482+0000 7fc4aafff700 1 --2- 172.21.15.72:0/1505877525 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc4a4139960 0x7fc4a40c12d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fc498009840 tx=0x7fc498009b50 comp rx=0 tx=0).stop 2023-07-27T20:34:28.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.482+0000 7fc4aafff700 1 -- 172.21.15.72:0/1505877525 shutdown_connections 2023-07-27T20:34:28.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.482+0000 7fc4aafff700 1 --2- 172.21.15.72:0/1505877525 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc4a4139960 0x7fc4a40c12d0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:28.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.482+0000 7fc4aafff700 1 --2- 172.21.15.72:0/1505877525 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4a4139f80 0x7fc4a40c1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:28.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.482+0000 7fc4aafff700 1 -- 172.21.15.72:0/1505877525 >> 172.21.15.72:0/1505877525 conn(0x7fc4a406a190 msgr2=0x7fc4a406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:28.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.482+0000 7fc4aafff700 1 -- 172.21.15.72:0/1505877525 shutdown_connections 2023-07-27T20:34:28.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.482+0000 7fc4aafff700 1 -- 172.21.15.72:0/1505877525 wait complete. 2023-07-27T20:34:28.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.484+0000 7fc4aafff700 1 Processor -- start 2023-07-27T20:34:28.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.484+0000 7fc4aafff700 1 -- start start 2023-07-27T20:34:28.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.485+0000 7fc4aafff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4a40c2340 0x7fc4a41e8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:28.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.485+0000 7fc4aafff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4a4139960 0x7fc4a414cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:28.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.485+0000 7fc4aafff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc4a4139f80 0x7fc4a414d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:28.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.485+0000 7fc4aafff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a40c3c20 con 0x7fc4a4139f80 2023-07-27T20:34:28.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.485+0000 7fc4aafff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a40c3f00 con 0x7fc4a4139960 2023-07-27T20:34:28.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.485+0000 7fc4aafff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a40c38d0 con 0x7fc4a40c2340 2023-07-27T20:34:28.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.485+0000 7fc4a959c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc4a4139f80 0x7fc4a414d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:28.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.485+0000 7fc4a959c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc4a4139f80 0x7fc4a414d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52244/0 (socket says 172.21.15.72:52244) 2023-07-27T20:34:28.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.485+0000 7fc4a959c700 1 -- 172.21.15.72:0/4097035838 learned_addr learned my addr 172.21.15.72:0/4097035838 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:28.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.485+0000 7fc4a3fff700 1 --2- 172.21.15.72:0/4097035838 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4a4139960 0x7fc4a414cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:28.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.485+0000 7fc4a8d9b700 1 --2- 172.21.15.72:0/4097035838 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4a40c2340 0x7fc4a41e8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:28.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.486+0000 7fc4a959c700 1 -- 172.21.15.72:0/4097035838 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4a40c2340 msgr2=0x7fc4a41e8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:28.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.486+0000 7fc4a959c700 1 --2- 172.21.15.72:0/4097035838 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4a40c2340 0x7fc4a41e8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:28.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.486+0000 7fc4a959c700 1 -- 172.21.15.72:0/4097035838 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4a4139960 msgr2=0x7fc4a414cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:28.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.486+0000 7fc4a959c700 1 --2- 172.21.15.72:0/4097035838 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4a4139960 0x7fc4a414cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:28.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.486+0000 7fc4a959c700 1 -- 172.21.15.72:0/4097035838 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4980094a0 con 0x7fc4a4139f80 2023-07-27T20:34:28.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.486+0000 7fc4a959c700 1 --2- 172.21.15.72:0/4097035838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc4a4139f80 0x7fc4a414d280 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fc49c00cba0 tx=0x7fc49c00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:28.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.486+0000 7fc4a17fa700 1 -- 172.21.15.72:0/4097035838 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49c00aaa0 con 0x7fc4a4139f80 2023-07-27T20:34:28.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.486+0000 7fc4a17fa700 1 -- 172.21.15.72:0/4097035838 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49c00ac20 con 0x7fc4a4139f80 2023-07-27T20:34:28.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.486+0000 7fc4aafff700 1 -- 172.21.15.72:0/4097035838 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4a40ab3e0 con 0x7fc4a4139f80 2023-07-27T20:34:28.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.486+0000 7fc4a17fa700 1 -- 172.21.15.72:0/4097035838 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49c0070d0 con 0x7fc4a4139f80 2023-07-27T20:34:28.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.486+0000 7fc4aafff700 1 -- 172.21.15.72:0/4097035838 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a414d890 con 0x7fc4a4139f80 2023-07-27T20:34:28.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.487+0000 7fc4aafff700 1 -- 172.21.15.72:0/4097035838 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4a40c3d60 con 0x7fc4a4139f80 2023-07-27T20:34:28.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.488+0000 7fc4a17fa700 1 -- 172.21.15.72:0/4097035838 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc49c007230 con 0x7fc4a4139f80 2023-07-27T20:34:28.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.489+0000 7fc4a17fa700 1 --2- 172.21.15.72:0/4097035838 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc48806ace0 0x7fc48806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:28.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.489+0000 7fc4a17fa700 1 -- 172.21.15.72:0/4097035838 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fc49c088fc0 con 0x7fc4a4139f80 2023-07-27T20:34:28.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.490+0000 7fc4a8d9b700 1 --2- 172.21.15.72:0/4097035838 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc48806ace0 0x7fc48806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:28.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.491+0000 7fc4a8d9b700 1 --2- 172.21.15.72:0/4097035838 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc48806ace0 0x7fc48806d1a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc4980090b0 tx=0x7fc49801c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:28.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.493+0000 7fc4a17fa700 1 -- 172.21.15.72:0/4097035838 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc4a40c3d60 con 0x7fc4a4139f80 2023-07-27T20:34:28.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.762+0000 7fc4aafff700 1 -- 172.21.15.72:0/4097035838 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc4a40c3d60 con 0x7fc4a4139f80 2023-07-27T20:34:28.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.762+0000 7fc4a17fa700 1 -- 172.21.15.72:0/4097035838 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5021 (secure 0 0 0) 0x7fc4a40c3d60 con 0x7fc4a4139f80 2023-07-27T20:34:28.751 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:34:28.752 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-07-27T20:34:28.752 INFO:teuthology.orchestra.run.smithi072.stdout: "auth_dump": [ 2023-07-27T20:34:28.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:34:28.752 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.a", 2023-07-27T20:34:28.753 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDg08Jk8ukYGhAA6bynYjjz+XXymZB7RuOqyg==", 2023-07-27T20:34:28.753 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:34:28.753 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-07-27T20:34:28.753 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-07-27T20:34:28.753 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-07-27T20:34:28.753 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-27T20:34:28.754 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:34:28.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:34:28.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:34:28.754 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.b", 2023-07-27T20:34:28.754 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDg08Jkowl/MRAAmGDdjr/lGUKHkBQLMdkEzA==", 2023-07-27T20:34:28.754 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:34:28.754 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-07-27T20:34:28.755 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-07-27T20:34:28.755 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-07-27T20:34:28.755 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-27T20:34:28.755 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:34:28.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:34:28.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:34:28.755 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.c", 2023-07-27T20:34:28.755 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDg08JkuNrEJRAAk6SZNv+AQw7s4J3iOVhErQ==", 2023-07-27T20:34:28.756 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:34:28.756 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-07-27T20:34:28.756 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-07-27T20:34:28.756 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-07-27T20:34:28.757 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-27T20:34:28.757 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:34:28.757 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:34:28.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:34:28.758 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.d", 2023-07-27T20:34:28.758 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDh08JkfJacARAAX7dowIhLgEsRPraoAJsqMw==", 2023-07-27T20:34:28.758 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:34:28.759 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-07-27T20:34:28.759 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-07-27T20:34:28.759 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-07-27T20:34:28.759 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-27T20:34:28.760 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:34:28.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:34:28.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:34:28.761 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.0", 2023-07-27T20:34:28.761 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDk08Jk8A5ELxAADkFtWQLUf7i2O+HUYDD6dA==", 2023-07-27T20:34:28.762 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:34:28.762 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-07-27T20:34:28.762 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-07-27T20:34:28.762 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-27T20:34:28.763 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:34:28.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:34:28.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:34:28.764 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.1", 2023-07-27T20:34:28.764 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDn08JkNU47MxAAwT5ryQLH8wuYMZhnm1CgRw==", 2023-07-27T20:34:28.764 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:34:28.764 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-07-27T20:34:28.765 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-07-27T20:34:28.765 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-27T20:34:28.765 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:34:28.765 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:34:28.765 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:34:28.766 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.2", 2023-07-27T20:34:28.766 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDq08JkaR9TNxAAYeAjHwr/HXuVstPh8+nXWw==", 2023-07-27T20:34:28.766 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:34:28.767 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-07-27T20:34:28.767 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-07-27T20:34:28.767 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-27T20:34:28.767 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:34:28.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:34:28.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:34:28.768 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.3", 2023-07-27T20:34:28.768 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDt08JkLWcVOxAAq9DWPQe8RBPGfq2rLl2e/A==", 2023-07-27T20:34:28.768 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:34:28.768 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-07-27T20:34:28.768 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-07-27T20:34:28.769 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-27T20:34:28.769 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:34:28.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:34:28.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:34:28.769 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.4", 2023-07-27T20:34:28.769 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQD008JkwcxvFhAA7qmRzaoSSEBgafwXN4Vnyw==", 2023-07-27T20:34:28.769 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:34:28.769 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-07-27T20:34:28.770 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-07-27T20:34:28.770 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-27T20:34:28.770 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:34:28.770 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:34:28.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:34:28.770 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.5", 2023-07-27T20:34:28.770 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQD308JkBB9tGhAAq2gNYDg2awDX4BvmWZuMVg==", 2023-07-27T20:34:28.771 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:34:28.771 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-07-27T20:34:28.771 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-07-27T20:34:28.771 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-27T20:34:28.771 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:34:28.771 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:34:28.771 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:34:28.772 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.6", 2023-07-27T20:34:28.772 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQD608Jk3FFCHhAA1EWhQfgPRpxC6U+CrjPENw==", 2023-07-27T20:34:28.772 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:34:28.772 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-07-27T20:34:28.772 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-07-27T20:34:28.772 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-27T20:34:28.772 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:34:28.772 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:34:28.773 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:34:28.773 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.7", 2023-07-27T20:34:28.773 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQD908Jk1atrIhAATt3nvk2zvQZSWDbuOcxsqg==", 2023-07-27T20:34:28.773 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:34:28.773 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-07-27T20:34:28.773 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-07-27T20:34:28.773 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-27T20:34:28.774 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:34:28.774 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:34:28.774 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:34:28.774 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.0", 2023-07-27T20:34:28.774 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDh08Jk6SgHDBAAkcBvssFv+WViV/ToWsnLCA==", 2023-07-27T20:34:28.774 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:34:28.774 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-07-27T20:34:28.775 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow r", 2023-07-27T20:34:28.775 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-27T20:34:28.775 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:34:28.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:34:28.775 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:34:28.775 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.1", 2023-07-27T20:34:28.775 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDh08JktvSlExAAay3fDYh/8Ju3iIWOXW8wmw==", 2023-07-27T20:34:28.776 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:34:28.776 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-07-27T20:34:28.776 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow r", 2023-07-27T20:34:28.776 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rw pool=cephfs2_data" 2023-07-27T20:34:28.776 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:34:28.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:34:28.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:34:28.777 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.admin", 2023-07-27T20:34:28.777 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDf08JkSMm7HhAAmZ9hevJ7imP5zGk+/q6UCg==", 2023-07-27T20:34:28.777 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:34:28.777 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-07-27T20:34:28.777 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-07-27T20:34:28.777 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-07-27T20:34:28.777 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-27T20:34:28.778 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:34:28.778 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:34:28.778 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:34:28.778 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.testuser", 2023-07-27T20:34:28.778 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCn1MJkAGojJxAA55AIUV1ozmpefEQJz6pu4Q==", 2023-07-27T20:34:28.778 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:34:28.778 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow rw fsname=cephfs", 2023-07-27T20:34:28.779 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow r fsname=cephfs", 2023-07-27T20:34:28.779 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-27T20:34:28.779 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:34:28.779 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:34:28.779 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:34:28.779 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mgr.x", 2023-07-27T20:34:28.779 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDg08JkkKdiEhAAZL2azzLKEawlPleOomXeAw==", 2023-07-27T20:34:28.780 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:34:28.780 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-07-27T20:34:28.780 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile mgr", 2023-07-27T20:34:28.780 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-27T20:34:28.780 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:34:28.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:34:28.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:34:28.781 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mgr.y", 2023-07-27T20:34:28.781 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDg08Jk66J/ChAAHpdL/KV5FPIhwbDRhkyT8A==", 2023-07-27T20:34:28.781 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-27T20:34:28.781 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-07-27T20:34:28.781 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile mgr", 2023-07-27T20:34:28.781 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-27T20:34:28.781 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:34:28.781 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:34:28.782 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-07-27T20:34:28.782 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-07-27T20:34:28.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.765+0000 7fc4aafff700 1 -- 172.21.15.72:0/4097035838 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc48806ace0 msgr2=0x7fc48806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:28.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.765+0000 7fc4aafff700 1 --2- 172.21.15.72:0/4097035838 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc48806ace0 0x7fc48806d1a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc4980090b0 tx=0x7fc49801c040 comp rx=0 tx=0).stop 2023-07-27T20:34:28.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.765+0000 7fc4aafff700 1 -- 172.21.15.72:0/4097035838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc4a4139f80 msgr2=0x7fc4a414d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:28.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.765+0000 7fc4aafff700 1 --2- 172.21.15.72:0/4097035838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc4a4139f80 0x7fc4a414d280 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fc49c00cba0 tx=0x7fc49c00ceb0 comp rx=0 tx=0).stop 2023-07-27T20:34:28.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.765+0000 7fc4aafff700 1 -- 172.21.15.72:0/4097035838 shutdown_connections 2023-07-27T20:34:28.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.765+0000 7fc4aafff700 1 --2- 172.21.15.72:0/4097035838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc4a4139f80 0x7fc4a414d280 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:28.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.765+0000 7fc4aafff700 1 --2- 172.21.15.72:0/4097035838 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc48806ace0 0x7fc48806d1a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:28.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.765+0000 7fc4aafff700 1 --2- 172.21.15.72:0/4097035838 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4a40c2340 0x7fc4a41e8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:28.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.765+0000 7fc4aafff700 1 --2- 172.21.15.72:0/4097035838 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4a4139960 0x7fc4a414cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:28.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.765+0000 7fc4aafff700 1 -- 172.21.15.72:0/4097035838 >> 172.21.15.72:0/4097035838 conn(0x7fc4a406a190 msgr2=0x7fc4a4132150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:28.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.765+0000 7fc4aafff700 1 -- 172.21.15.72:0/4097035838 shutdown_connections 2023-07-27T20:34:28.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.765+0000 7fc4aafff700 1 -- 172.21.15.72:0/4097035838 wait complete. 2023-07-27T20:34:28.786 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.testuser 2023-07-27T20:34:28.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.993+0000 7ffa8dfff700 1 Processor -- start 2023-07-27T20:34:28.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.993+0000 7ffa8dfff700 1 -- start start 2023-07-27T20:34:28.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.994+0000 7ffa8dfff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ffa880c4400 0x7ffa880c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:28.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.994+0000 7ffa8dfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffa8806b150 0x7ffa880c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:28.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.994+0000 7ffa8dfff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa880c5230 con 0x7ffa881549f0 2023-07-27T20:34:28.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.994+0000 7ffa8dfff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa881545d0 con 0x7ffa880c4400 2023-07-27T20:34:28.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.994+0000 7ffa8dfff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8806c860 con 0x7ffa8806b150 2023-07-27T20:34:28.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.995+0000 7ffa877fe700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ffa880c4400 0x7ffa880c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:28.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.995+0000 7ffa86ffd700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffa8806b150 0x7ffa880c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:28.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.995+0000 7ffa877fe700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ffa880c4400 0x7ffa880c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.72:35532/0 (socket says 172.21.15.72:35532) 2023-07-27T20:34:28.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.995+0000 7ffa86ffd700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffa8806b150 0x7ffa880c4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.72:40922/0 (socket says 172.21.15.72:40922) 2023-07-27T20:34:28.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.995+0000 7ffa877fe700 1 -- 172.21.15.72:0/2578999581 learned_addr learned my addr 172.21.15.72:0/2578999581 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:28.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.995+0000 7ffa877fe700 1 -- 172.21.15.72:0/2578999581 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffa8806b150 msgr2=0x7ffa880c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:28.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.995+0000 7ffa877fe700 1 --2- 172.21.15.72:0/2578999581 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffa8806b150 0x7ffa880c4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:28.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.995+0000 7ffa877fe700 1 -- 172.21.15.72:0/2578999581 >> v1:172.21.15.173:6789/0 conn(0x7ffa881549f0 legacy=0x7ffa881514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:28.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.995+0000 7ffa877fe700 1 -- 172.21.15.72:0/2578999581 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa8806b710 con 0x7ffa880c4400 2023-07-27T20:34:28.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.995+0000 7ffa86ffd700 1 --2- 172.21.15.72:0/2578999581 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffa8806b150 0x7ffa880c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:34:28.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.995+0000 7ffa877fe700 1 --2- 172.21.15.72:0/2578999581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa880c4400 0x7ffa880c7710 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ffa78009920 tx=0x7ffa78009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da7f7ca065a39882 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:28.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.996+0000 7ffa867fc700 1 -- 172.21.15.72:0/2578999581 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa78011830 con 0x7ffa880c4400 2023-07-27T20:34:28.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.996+0000 7ffa867fc700 1 -- 172.21.15.72:0/2578999581 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa78011990 con 0x7ffa880c4400 2023-07-27T20:34:28.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.996+0000 7ffa867fc700 1 -- 172.21.15.72:0/2578999581 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa78011d20 con 0x7ffa880c4400 2023-07-27T20:34:28.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.996+0000 7ffa8dfff700 1 -- 172.21.15.72:0/2578999581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa880c4400 msgr2=0x7ffa880c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:28.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.996+0000 7ffa8dfff700 1 --2- 172.21.15.72:0/2578999581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa880c4400 0x7ffa880c7710 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ffa78009920 tx=0x7ffa78009c30 comp rx=0 tx=0).stop 2023-07-27T20:34:28.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.996+0000 7ffa8dfff700 1 -- 172.21.15.72:0/2578999581 shutdown_connections 2023-07-27T20:34:28.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.996+0000 7ffa8dfff700 1 --2- 172.21.15.72:0/2578999581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa880c4400 0x7ffa880c7710 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:28.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.996+0000 7ffa8dfff700 1 --2- 172.21.15.72:0/2578999581 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffa8806b150 0x7ffa880c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:28.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.996+0000 7ffa8dfff700 1 -- 172.21.15.72:0/2578999581 >> 172.21.15.72:0/2578999581 conn(0x7ffa880ab300 msgr2=0x7ffa880ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:28.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.996+0000 7ffa8dfff700 1 -- 172.21.15.72:0/2578999581 shutdown_connections 2023-07-27T20:34:28.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.997+0000 7ffa8dfff700 1 -- 172.21.15.72:0/2578999581 wait complete. 2023-07-27T20:34:28.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.999+0000 7ffa8dfff700 1 Processor -- start 2023-07-27T20:34:28.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:28.999+0000 7ffa8dfff700 1 -- start start 2023-07-27T20:34:28.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.000+0000 7ffa8dfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa8806b150 0x7ffa880aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:28.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.000+0000 7ffa8dfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa880c4400 0x7ffa88148ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:28.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.000+0000 7ffa8dfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffa881549f0 0x7ffa88149410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:28.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.000+0000 7ffa8dfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa88149f70 con 0x7ffa8806b150 2023-07-27T20:34:28.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.000+0000 7ffa8dfff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa881ed9f0 con 0x7ffa880c4400 2023-07-27T20:34:28.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.000+0000 7ffa8dfff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa880c3b90 con 0x7ffa881549f0 2023-07-27T20:34:28.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.000+0000 7ffa877fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa8806b150 0x7ffa880aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:28.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.000+0000 7ffa877fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa8806b150 0x7ffa880aea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52248/0 (socket says 172.21.15.72:52248) 2023-07-27T20:34:28.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.000+0000 7ffa877fe700 1 -- 172.21.15.72:0/2165266670 learned_addr learned my addr 172.21.15.72:0/2165266670 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:28.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.001+0000 7ffa86ffd700 1 --2- 172.21.15.72:0/2165266670 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa880c4400 0x7ffa88148ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:28.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.001+0000 7ffa87fff700 1 --2- 172.21.15.72:0/2165266670 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffa881549f0 0x7ffa88149410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:28.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.001+0000 7ffa877fe700 1 -- 172.21.15.72:0/2165266670 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffa881549f0 msgr2=0x7ffa88149410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:28.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.001+0000 7ffa877fe700 1 --2- 172.21.15.72:0/2165266670 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffa881549f0 0x7ffa88149410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:28.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.001+0000 7ffa877fe700 1 -- 172.21.15.72:0/2165266670 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa880c4400 msgr2=0x7ffa88148ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:28.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.001+0000 7ffa877fe700 1 --2- 172.21.15.72:0/2165266670 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa880c4400 0x7ffa88148ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:28.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.001+0000 7ffa877fe700 1 -- 172.21.15.72:0/2165266670 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7c0094a0 con 0x7ffa8806b150 2023-07-27T20:34:28.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.001+0000 7ffa877fe700 1 --2- 172.21.15.72:0/2165266670 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa8806b150 0x7ffa880aea80 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7ffa78009870 tx=0x7ffa78004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:28.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.001+0000 7ffa6ffff700 1 -- 172.21.15.72:0/2165266670 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa78004300 con 0x7ffa8806b150 2023-07-27T20:34:28.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.001+0000 7ffa6ffff700 1 -- 172.21.15.72:0/2165266670 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7801f070 con 0x7ffa8806b150 2023-07-27T20:34:28.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.001+0000 7ffa8dfff700 1 -- 172.21.15.72:0/2165266670 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa78009550 con 0x7ffa8806b150 2023-07-27T20:34:28.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.001+0000 7ffa6ffff700 1 -- 172.21.15.72:0/2165266670 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa780036a0 con 0x7ffa8806b150 2023-07-27T20:34:28.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.002+0000 7ffa8dfff700 1 -- 172.21.15.72:0/2165266670 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa881ecf10 con 0x7ffa8806b150 2023-07-27T20:34:28.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.003+0000 7ffa8dfff700 1 -- 172.21.15.72:0/2165266670 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa88074310 con 0x7ffa8806b150 2023-07-27T20:34:28.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.003+0000 7ffa6ffff700 1 -- 172.21.15.72:0/2165266670 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffa78021030 con 0x7ffa8806b150 2023-07-27T20:34:28.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.004+0000 7ffa6ffff700 1 --2- 172.21.15.72:0/2165266670 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ffa7406ace0 0x7ffa7406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:28.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.004+0000 7ffa6ffff700 1 -- 172.21.15.72:0/2165266670 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5530+0+0 (secure 0 0 0) 0x7ffa7808a440 con 0x7ffa8806b150 2023-07-27T20:34:28.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.005+0000 7ffa86ffd700 1 --2- 172.21.15.72:0/2165266670 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ffa7406ace0 0x7ffa7406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:28.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.005+0000 7ffa86ffd700 1 --2- 172.21.15.72:0/2165266670 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ffa7406ace0 0x7ffa7406d1a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ffa880c0890 tx=0x7ffa7c009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:28.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.008+0000 7ffa6ffff700 1 -- 172.21.15.72:0/2165266670 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ffa78055810 con 0x7ffa8806b150 2023-07-27T20:34:29.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.280+0000 7ffa8dfff700 1 -- 172.21.15.72:0/2165266670 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.testuser"} v 0) v1 -- 0x7ffa88149950 con 0x7ffa8806b150 2023-07-27T20:34:29.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.284+0000 7ffa6ffff700 1 -- 172.21.15.72:0/2165266670 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.testuser"}]=0 v14) v1 ==== 85+0+0 (secure 0 0 0) 0x7ffa78058e30 con 0x7ffa8806b150 2023-07-27T20:34:29.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.286+0000 7ffa8dfff700 1 -- 172.21.15.72:0/2165266670 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ffa7406ace0 msgr2=0x7ffa7406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:29.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.286+0000 7ffa8dfff700 1 --2- 172.21.15.72:0/2165266670 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ffa7406ace0 0x7ffa7406d1a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ffa880c0890 tx=0x7ffa7c009210 comp rx=0 tx=0).stop 2023-07-27T20:34:29.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.286+0000 7ffa8dfff700 1 -- 172.21.15.72:0/2165266670 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa8806b150 msgr2=0x7ffa880aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:29.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.286+0000 7ffa8dfff700 1 --2- 172.21.15.72:0/2165266670 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa8806b150 0x7ffa880aea80 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7ffa78009870 tx=0x7ffa78004750 comp rx=0 tx=0).stop 2023-07-27T20:34:29.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.286+0000 7ffa8dfff700 1 -- 172.21.15.72:0/2165266670 shutdown_connections 2023-07-27T20:34:29.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.286+0000 7ffa8dfff700 1 --2- 172.21.15.72:0/2165266670 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ffa7406ace0 0x7ffa7406d1a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:29.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.286+0000 7ffa8dfff700 1 --2- 172.21.15.72:0/2165266670 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffa881549f0 0x7ffa88149410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:29.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.286+0000 7ffa8dfff700 1 --2- 172.21.15.72:0/2165266670 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa8806b150 0x7ffa880aea80 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:29.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.286+0000 7ffa8dfff700 1 --2- 172.21.15.72:0/2165266670 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa880c4400 0x7ffa88148ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:29.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.286+0000 7ffa8dfff700 1 -- 172.21.15.72:0/2165266670 >> 172.21.15.72:0/2165266670 conn(0x7ffa880ab300 msgr2=0x7ffa88151270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:29.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.286+0000 7ffa8dfff700 1 -- 172.21.15.72:0/2165266670 shutdown_connections 2023-07-27T20:34:29.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.286+0000 7ffa8dfff700 1 -- 172.21.15.72:0/2165266670 wait complete. 2023-07-27T20:34:29.293 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:34:29.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.498+0000 7f151c3ff700 1 Processor -- start 2023-07-27T20:34:29.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.499+0000 7f151c3ff700 1 -- start start 2023-07-27T20:34:29.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.500+0000 7f151c3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f15140bfd90 0x7f15140aab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:29.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.500+0000 7f151c3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1514155600 con 0x7f151413b2c0 2023-07-27T20:34:29.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.500+0000 7f151c3ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1514155320 con 0x7f15140a83a0 2023-07-27T20:34:29.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.500+0000 7f151c3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15140a9620 con 0x7f15140bfd90 2023-07-27T20:34:29.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.500+0000 7f151999a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f15140bfd90 0x7f15140aab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:29.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.500+0000 7f151a19b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f151413b2c0 0x7f15140aa420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54598/0 (socket says 172.21.15.72:54598) 2023-07-27T20:34:29.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.500+0000 7f151a19b700 1 -- 172.21.15.72:0/2850097555 learned_addr learned my addr 172.21.15.72:0/2850097555 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:29.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.501+0000 7f151999a700 1 -- 172.21.15.72:0/2850097555 >> v1:172.21.15.173:6789/0 conn(0x7f15140a83a0 legacy=0x7f15140a8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:29.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.500+0000 7f1519199700 1 -- 172.21.15.72:0/2850097555 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3402434269 0 0) 0x7f1514155600 con 0x7f151413b2c0 2023-07-27T20:34:29.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.501+0000 7f151999a700 1 -- 172.21.15.72:0/2850097555 >> v1:172.21.15.72:6789/0 conn(0x7f151413b2c0 legacy=0x7f15140aa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:29.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.501+0000 7f151999a700 1 -- 172.21.15.72:0/2850097555 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1514151e40 con 0x7f15140bfd90 2023-07-27T20:34:29.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.501+0000 7f151999a700 1 --2- 172.21.15.72:0/2850097555 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15140bfd90 0x7f15140aab30 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f1504009840 tx=0x7f1504009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19a76b76168fae9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:29.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.501+0000 7f1519199700 1 -- 172.21.15.72:0/2850097555 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1504004230 con 0x7f15140bfd90 2023-07-27T20:34:29.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.501+0000 7f1519199700 1 -- 172.21.15.72:0/2850097555 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1504004390 con 0x7f15140bfd90 2023-07-27T20:34:29.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.501+0000 7f1519199700 1 -- 172.21.15.72:0/2850097555 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15040036a0 con 0x7f15140bfd90 2023-07-27T20:34:29.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.501+0000 7f151c3ff700 1 -- 172.21.15.72:0/2850097555 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15140bfd90 msgr2=0x7f15140aab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:29.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.501+0000 7f151c3ff700 1 --2- 172.21.15.72:0/2850097555 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15140bfd90 0x7f15140aab30 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f1504009840 tx=0x7f1504009b50 comp rx=0 tx=0).stop 2023-07-27T20:34:29.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.502+0000 7f151c3ff700 1 -- 172.21.15.72:0/2850097555 shutdown_connections 2023-07-27T20:34:29.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.502+0000 7f151c3ff700 1 --2- 172.21.15.72:0/2850097555 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15140bfd90 0x7f15140aab30 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:29.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.502+0000 7f151c3ff700 1 -- 172.21.15.72:0/2850097555 >> 172.21.15.72:0/2850097555 conn(0x7f151406a190 msgr2=0x7f151406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:29.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.502+0000 7f151c3ff700 1 -- 172.21.15.72:0/2850097555 shutdown_connections 2023-07-27T20:34:29.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.502+0000 7f151c3ff700 1 -- 172.21.15.72:0/2850097555 wait complete. 2023-07-27T20:34:29.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.503+0000 7f151c3ff700 1 Processor -- start 2023-07-27T20:34:29.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.503+0000 7f151c3ff700 1 -- start start 2023-07-27T20:34:29.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.504+0000 7f151c3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15140a83a0 0x7f15140c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:29.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.504+0000 7f151c3ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15140bfd90 0x7f1514136e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:29.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.504+0000 7f151c3ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f151413b2c0 0x7f15141373c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:29.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.504+0000 7f151c3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15140a8f20 con 0x7f15140a83a0 2023-07-27T20:34:29.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.504+0000 7f151c3ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15141db740 con 0x7f15140bfd90 2023-07-27T20:34:29.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.504+0000 7f151c3ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1514137900 con 0x7f151413b2c0 2023-07-27T20:34:29.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.504+0000 7f151a19b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15140a83a0 0x7f15140c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:29.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.505+0000 7f151a19b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15140a83a0 0x7f15140c43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52268/0 (socket says 172.21.15.72:52268) 2023-07-27T20:34:29.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.505+0000 7f151a19b700 1 -- 172.21.15.72:0/1432357748 learned_addr learned my addr 172.21.15.72:0/1432357748 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:29.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.505+0000 7f151a19b700 1 -- 172.21.15.72:0/1432357748 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f151413b2c0 msgr2=0x7f15141373c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:29.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.505+0000 7f151a19b700 1 --2- 172.21.15.72:0/1432357748 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f151413b2c0 0x7f15141373c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:29.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.505+0000 7f151a19b700 1 -- 172.21.15.72:0/1432357748 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15140bfd90 msgr2=0x7f1514136e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:29.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.505+0000 7f151a19b700 1 --2- 172.21.15.72:0/1432357748 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15140bfd90 0x7f1514136e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:29.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.505+0000 7f151a19b700 1 -- 172.21.15.72:0/1432357748 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15040094a0 con 0x7f15140a83a0 2023-07-27T20:34:29.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.505+0000 7f151a19b700 1 --2- 172.21.15.72:0/1432357748 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15140a83a0 0x7f15140c43d0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f151000c580 tx=0x7f151000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:29.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.505+0000 7f150affd700 1 -- 172.21.15.72:0/1432357748 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1510004c80 con 0x7f15140a83a0 2023-07-27T20:34:29.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.505+0000 7f150affd700 1 -- 172.21.15.72:0/1432357748 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1510004e00 con 0x7f15140a83a0 2023-07-27T20:34:29.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.505+0000 7f151c3ff700 1 -- 172.21.15.72:0/1432357748 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1514137a80 con 0x7f15140a83a0 2023-07-27T20:34:29.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.505+0000 7f150affd700 1 -- 172.21.15.72:0/1432357748 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1510007310 con 0x7f15140a83a0 2023-07-27T20:34:29.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.505+0000 7f151c3ff700 1 -- 172.21.15.72:0/1432357748 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15141eceb0 con 0x7f15140a83a0 2023-07-27T20:34:29.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.506+0000 7f151c3ff700 1 -- 172.21.15.72:0/1432357748 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1514073820 con 0x7f15140a83a0 2023-07-27T20:34:29.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.507+0000 7f150affd700 1 -- 172.21.15.72:0/1432357748 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1510007470 con 0x7f15140a83a0 2023-07-27T20:34:29.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.508+0000 7f150affd700 1 --2- 172.21.15.72:0/1432357748 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f14f806ace0 0x7f14f806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:29.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.508+0000 7f150affd700 1 -- 172.21.15.72:0/1432357748 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f1510088ff0 con 0x7f15140a83a0 2023-07-27T20:34:29.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.509+0000 7f151999a700 1 --2- 172.21.15.72:0/1432357748 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f14f806ace0 0x7f14f806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:29.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.509+0000 7f151999a700 1 --2- 172.21.15.72:0/1432357748 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f14f806ace0 0x7f14f806d1a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f15140c01b0 tx=0x7f1504010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:29.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.512+0000 7f150affd700 1 -- 172.21.15.72:0/1432357748 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1510054210 con 0x7f15140a83a0 2023-07-27T20:34:29.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.710+0000 7f151c3ff700 1 -- 172.21.15.72:0/1432357748 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1514074310 con 0x7f15140a83a0 2023-07-27T20:34:29.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.711+0000 7f150affd700 1 -- 172.21.15.72:0/1432357748 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+14844 (secure 0 0 0) 0x7f1510057830 con 0x7f15140a83a0 2023-07-27T20:34:29.699 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:34:29.700 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":58,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:34:28.254191+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:34:29.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.713+0000 7f151c3ff700 1 -- 172.21.15.72:0/1432357748 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f14f806ace0 msgr2=0x7f14f806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:29.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.713+0000 7f151c3ff700 1 --2- 172.21.15.72:0/1432357748 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f14f806ace0 0x7f14f806d1a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f15140c01b0 tx=0x7f1504010000 comp rx=0 tx=0).stop 2023-07-27T20:34:29.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.713+0000 7f151c3ff700 1 -- 172.21.15.72:0/1432357748 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15140a83a0 msgr2=0x7f15140c43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:29.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.713+0000 7f151c3ff700 1 --2- 172.21.15.72:0/1432357748 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15140a83a0 0x7f15140c43d0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f151000c580 tx=0x7f151000c940 comp rx=0 tx=0).stop 2023-07-27T20:34:29.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.713+0000 7f151c3ff700 1 -- 172.21.15.72:0/1432357748 shutdown_connections 2023-07-27T20:34:29.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.713+0000 7f151c3ff700 1 --2- 172.21.15.72:0/1432357748 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f14f806ace0 0x7f14f806d1a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:29.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.713+0000 7f151c3ff700 1 --2- 172.21.15.72:0/1432357748 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f151413b2c0 0x7f15141373c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:29.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.713+0000 7f151c3ff700 1 --2- 172.21.15.72:0/1432357748 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15140a83a0 0x7f15140c43d0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:29.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.713+0000 7f151c3ff700 1 --2- 172.21.15.72:0/1432357748 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15140bfd90 0x7f1514136e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:29.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.713+0000 7f151c3ff700 1 -- 172.21.15.72:0/1432357748 >> 172.21.15.72:0/1432357748 conn(0x7f151406a190 msgr2=0x7f15140aa400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:29.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.713+0000 7f151c3ff700 1 -- 172.21.15.72:0/1432357748 shutdown_connections 2023-07-27T20:34:29.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.713+0000 7f151c3ff700 1 -- 172.21.15.72:0/1432357748 wait complete. 2023-07-27T20:34:29.720 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-27T20:31:14.581785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T20:31:21.077941+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-27T20:34:29.721 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-27T20:34:29.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.933+0000 7f3995dff700 1 Processor -- start 2023-07-27T20:34:29.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.933+0000 7f3995dff700 1 -- start start 2023-07-27T20:34:29.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.934+0000 7f3995dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f399014aab0 0x7f3990154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:29.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.934+0000 7f3995dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39900c7c50 con 0x7f39900c7740 2023-07-27T20:34:29.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.934+0000 7f3995dff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f399006bd40 con 0x7f399006c1d0 2023-07-27T20:34:29.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.934+0000 7f3995dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f399006cd50 con 0x7f399014aab0 2023-07-27T20:34:29.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.934+0000 7f398effd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f39900c7740 0x7f39900c41c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60586/0 (socket says 172.21.15.72:60586) 2023-07-27T20:34:29.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.934+0000 7f398effd700 1 -- 172.21.15.72:0/1970775801 learned_addr learned my addr 172.21.15.72:0/1970775801 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:29.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.934+0000 7f398f7fe700 1 --2- 172.21.15.72:0/1970775801 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f399014aab0 0x7f3990154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:29.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.935+0000 7f398e7fc700 1 -- 172.21.15.72:0/1970775801 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2525605934 0 0) 0x7f39900c7c50 con 0x7f39900c7740 2023-07-27T20:34:29.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.935+0000 7f398e7fc700 1 -- 172.21.15.72:0/1970775801 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39780035b0 con 0x7f39900c7740 2023-07-27T20:34:29.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.935+0000 7f398e7fc700 1 -- 172.21.15.72:0/1970775801 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2025254725 0 0) 0x7f399006bd40 con 0x7f399006c1d0 2023-07-27T20:34:29.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.935+0000 7f398e7fc700 1 -- 172.21.15.72:0/1970775801 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39900c7c50 con 0x7f399006c1d0 2023-07-27T20:34:29.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.935+0000 7f398e7fc700 1 -- 172.21.15.72:0/1970775801 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1041783953 0 0) 0x7f39780035b0 con 0x7f39900c7740 2023-07-27T20:34:29.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.935+0000 7f398e7fc700 1 -- 172.21.15.72:0/1970775801 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f399014aab0 msgr2=0x7f3990154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:29.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.935+0000 7f398e7fc700 1 --2- 172.21.15.72:0/1970775801 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f399014aab0 0x7f3990154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:29.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.935+0000 7f398e7fc700 1 -- 172.21.15.72:0/1970775801 >> v1:172.21.15.173:6789/0 conn(0x7f399006c1d0 legacy=0x7f399006c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:29.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.935+0000 7f398e7fc700 1 -- 172.21.15.72:0/1970775801 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39900c62f0 con 0x7f39900c7740 2023-07-27T20:34:29.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.935+0000 7f398e7fc700 1 -- 172.21.15.72:0/1970775801 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f3984001670 con 0x7f39900c7740 2023-07-27T20:34:29.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.935+0000 7f398e7fc700 1 -- 172.21.15.72:0/1970775801 >> v1:172.21.15.72:6789/0 conn(0x7f39900c7740 legacy=0x7f39900c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:29.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.935+0000 7f398e7fc700 1 --2- 172.21.15.72:0/1970775801 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3978003bc0 0x7f3978003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:29.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.935+0000 7f398e7fc700 1 --2- 172.21.15.72:0/1970775801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3978004850 0x7f3978004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:29.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.935+0000 7f398e7fc700 1 --2- 172.21.15.72:0/1970775801 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3978005210 0x7f397800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:29.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.935+0000 7f398e7fc700 1 -- 172.21.15.72:0/1970775801 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399006cd50 con 0x7f3978004850 2023-07-27T20:34:29.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.935+0000 7f398e7fc700 1 -- 172.21.15.72:0/1970775801 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397800c030 con 0x7f3978003bc0 2023-07-27T20:34:29.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.935+0000 7f398e7fc700 1 -- 172.21.15.72:0/1970775801 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f397800c1f0 con 0x7f3978005210 2023-07-27T20:34:29.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.935+0000 7f398f7fe700 1 --2- 172.21.15.72:0/1970775801 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f399014aab0 0x7f3990154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:34:29.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.935+0000 7f398effd700 1 --2- 172.21.15.72:0/1970775801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3978004850 0x7f3978004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:29.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.935+0000 7f398ffff700 1 --2- 172.21.15.72:0/1970775801 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3978005210 0x7f397800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:29.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.936+0000 7f398f7fe700 1 --2- 172.21.15.72:0/1970775801 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3978003bc0 0x7f3978003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:29.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.936+0000 7f398effd700 1 -- 172.21.15.72:0/1970775801 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3978005210 msgr2=0x7f397800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:29.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.936+0000 7f398effd700 1 --2- 172.21.15.72:0/1970775801 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3978005210 0x7f397800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:29.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.936+0000 7f398effd700 1 -- 172.21.15.72:0/1970775801 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3978003bc0 msgr2=0x7f3978003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:29.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.936+0000 7f398effd700 1 --2- 172.21.15.72:0/1970775801 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3978003bc0 0x7f3978003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:29.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.936+0000 7f398effd700 1 -- 172.21.15.72:0/1970775801 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39780035b0 con 0x7f3978004850 2023-07-27T20:34:29.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.936+0000 7f398f7fe700 1 --2- 172.21.15.72:0/1970775801 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3978003bc0 0x7f3978003fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:29.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.936+0000 7f398effd700 1 --2- 172.21.15.72:0/1970775801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3978004850 0x7f3978004cd0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f398400c0e0 tx=0x7f3978005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c7cd6edde13b2bc server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:29.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.936+0000 7f398e7fc700 1 -- 172.21.15.72:0/1970775801 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398400cc80 con 0x7f3978004850 2023-07-27T20:34:29.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.936+0000 7f398e7fc700 1 -- 172.21.15.72:0/1970775801 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398400cde0 con 0x7f3978004850 2023-07-27T20:34:29.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.936+0000 7f398e7fc700 1 -- 172.21.15.72:0/1970775801 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3984005ba0 con 0x7f3978004850 2023-07-27T20:34:29.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.937+0000 7f3995dff700 1 -- 172.21.15.72:0/1970775801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3978004850 msgr2=0x7f3978004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:29.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.937+0000 7f3995dff700 1 --2- 172.21.15.72:0/1970775801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3978004850 0x7f3978004cd0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f398400c0e0 tx=0x7f3978005880 comp rx=0 tx=0).stop 2023-07-27T20:34:29.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.937+0000 7f398ffff700 1 -- 172.21.15.72:0/1970775801 reap_dead start 2023-07-27T20:34:29.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.937+0000 7f3995dff700 1 -- 172.21.15.72:0/1970775801 shutdown_connections 2023-07-27T20:34:29.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.937+0000 7f3995dff700 1 -- 172.21.15.72:0/1970775801 >> 172.21.15.72:0/1970775801 conn(0x7f39900ab3f0 msgr2=0x7f39900ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:29.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.937+0000 7f3995dff700 1 -- 172.21.15.72:0/1970775801 shutdown_connections 2023-07-27T20:34:29.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.937+0000 7f3995dff700 1 -- 172.21.15.72:0/1970775801 wait complete. 2023-07-27T20:34:29.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.939+0000 7f3995dff700 1 Processor -- start 2023-07-27T20:34:29.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.940+0000 7f3995dff700 1 -- start start 2023-07-27T20:34:29.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.941+0000 7f3995dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3978004850 0x7f39900ac980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:29.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.941+0000 7f3995dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39900ad330 0x7f399014f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:29.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.941+0000 7f3995dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39900aec90 0x7f39900af110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:29.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.941+0000 7f3995dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39900af650 con 0x7f39900ad330 2023-07-27T20:34:29.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.941+0000 7f3995dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3990158030 con 0x7f39900aec90 2023-07-27T20:34:29.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.941+0000 7f3995dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39901ea2a0 con 0x7f3978004850 2023-07-27T20:34:29.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.941+0000 7f398effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39900ad330 0x7f399014f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:29.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.941+0000 7f398effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39900ad330 0x7f399014f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52266/0 (socket says 172.21.15.72:52266) 2023-07-27T20:34:29.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.941+0000 7f398effd700 1 -- 172.21.15.72:0/1095872034 learned_addr learned my addr 172.21.15.72:0/1095872034 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:29.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.941+0000 7f398f7fe700 1 --2- 172.21.15.72:0/1095872034 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3978004850 0x7f39900ac980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:29.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.941+0000 7f398ffff700 1 --2- 172.21.15.72:0/1095872034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39900aec90 0x7f39900af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:29.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.941+0000 7f398effd700 1 -- 172.21.15.72:0/1095872034 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3978004850 msgr2=0x7f39900ac980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:29.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.941+0000 7f398effd700 1 --2- 172.21.15.72:0/1095872034 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3978004850 0x7f39900ac980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:29.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.941+0000 7f398effd700 1 -- 172.21.15.72:0/1095872034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39900aec90 msgr2=0x7f39900af110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:29.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.941+0000 7f398effd700 1 --2- 172.21.15.72:0/1095872034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39900aec90 0x7f39900af110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:29.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.941+0000 7f398effd700 1 -- 172.21.15.72:0/1095872034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39901582d0 con 0x7f39900ad330 2023-07-27T20:34:29.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.941+0000 7f398ffff700 1 --2- 172.21.15.72:0/1095872034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39900aec90 0x7f39900af110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:29.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.942+0000 7f398effd700 1 --2- 172.21.15.72:0/1095872034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39900ad330 0x7f399014f120 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f397800c000 tx=0x7f39900c5140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:29.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.942+0000 7f3977fff700 1 -- 172.21.15.72:0/1095872034 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39840072d0 con 0x7f39900ad330 2023-07-27T20:34:29.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.942+0000 7f3977fff700 1 -- 172.21.15.72:0/1095872034 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3984007430 con 0x7f39900ad330 2023-07-27T20:34:29.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.942+0000 7f3995dff700 1 -- 172.21.15.72:0/1095872034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39901585b0 con 0x7f39900ad330 2023-07-27T20:34:29.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.942+0000 7f3977fff700 1 -- 172.21.15.72:0/1095872034 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39840077a0 con 0x7f39900ad330 2023-07-27T20:34:29.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.942+0000 7f3995dff700 1 -- 172.21.15.72:0/1095872034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39900acec0 con 0x7f39900ad330 2023-07-27T20:34:29.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.943+0000 7f3995dff700 1 -- 172.21.15.72:0/1095872034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39900c1a90 con 0x7f39900ad330 2023-07-27T20:34:29.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.944+0000 7f3977fff700 1 -- 172.21.15.72:0/1095872034 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3984027450 con 0x7f39900ad330 2023-07-27T20:34:29.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.945+0000 7f3977fff700 1 --2- 172.21.15.72:0/1095872034 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f397c06ace0 0x7f397c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:29.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.945+0000 7f3977fff700 1 -- 172.21.15.72:0/1095872034 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f398408a3c0 con 0x7f39900ad330 2023-07-27T20:34:29.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.945+0000 7f398f7fe700 1 --2- 172.21.15.72:0/1095872034 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f397c06ace0 0x7f397c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:29.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.946+0000 7f398f7fe700 1 --2- 172.21.15.72:0/1095872034 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f397c06ace0 0x7f397c06d1a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3980009470 tx=0x7f3980008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:29.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:29.949+0000 7f3977fff700 1 -- 172.21.15.72:0/1095872034 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3984055670 con 0x7f39900ad330 2023-07-27T20:34:30.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.145+0000 7f3995dff700 1 -- 172.21.15.72:0/1095872034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f39900c92a0 con 0x7f39900ad330 2023-07-27T20:34:30.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.145+0000 7f3977fff700 1 -- 172.21.15.72:0/1095872034 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3984058c90 con 0x7f39900ad330 2023-07-27T20:34:30.134 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-27T20:34:30.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.147+0000 7f3995dff700 1 -- 172.21.15.72:0/1095872034 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f397c06ace0 msgr2=0x7f397c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:30.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.147+0000 7f3995dff700 1 --2- 172.21.15.72:0/1095872034 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f397c06ace0 0x7f397c06d1a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3980009470 tx=0x7f3980008040 comp rx=0 tx=0).stop 2023-07-27T20:34:30.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.147+0000 7f3995dff700 1 -- 172.21.15.72:0/1095872034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39900ad330 msgr2=0x7f399014f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:30.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.147+0000 7f3995dff700 1 --2- 172.21.15.72:0/1095872034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39900ad330 0x7f399014f120 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f397800c000 tx=0x7f39900c5140 comp rx=0 tx=0).stop 2023-07-27T20:34:30.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.148+0000 7f3995dff700 1 -- 172.21.15.72:0/1095872034 shutdown_connections 2023-07-27T20:34:30.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.148+0000 7f3995dff700 1 --2- 172.21.15.72:0/1095872034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39900aec90 0x7f39900af110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:30.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.148+0000 7f3995dff700 1 --2- 172.21.15.72:0/1095872034 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f397c06ace0 0x7f397c06d1a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:30.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.148+0000 7f3995dff700 1 --2- 172.21.15.72:0/1095872034 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3978004850 0x7f39900ac980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:30.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.148+0000 7f3995dff700 1 --2- 172.21.15.72:0/1095872034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39900ad330 0x7f399014f120 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:30.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.148+0000 7f3995dff700 1 -- 172.21.15.72:0/1095872034 >> 172.21.15.72:0/1095872034 conn(0x7f39900ab3f0 msgr2=0x7f39900c40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:30.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.148+0000 7f3995dff700 1 -- 172.21.15.72:0/1095872034 shutdown_connections 2023-07-27T20:34:30.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.148+0000 7f3995dff700 1 -- 172.21.15.72:0/1095872034 wait complete. 2023-07-27T20:34:30.153 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T20:34:30.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.365+0000 7fd5b89ff700 1 Processor -- start 2023-07-27T20:34:30.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.365+0000 7fd5b89ff700 1 -- start start 2023-07-27T20:34:30.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.367+0000 7fd5b89ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd5b413b150 0x7fd5b4151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:30.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.367+0000 7fd5b89ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd5b406e140 0x7fd5b40ba310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:30.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.367+0000 7fd5b89ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd5b40ba850 0x7fd5b406d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:30.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.367+0000 7fd5b89ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5b406ce10 con 0x7fd5b40ba850 2023-07-27T20:34:30.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.367+0000 7fd5b89ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5b4152680 con 0x7fd5b413b150 2023-07-27T20:34:30.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.367+0000 7fd5b89ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b4152960 con 0x7fd5b406e140 2023-07-27T20:34:30.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.367+0000 7fd5b2d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd5b40ba850 0x7fd5b406d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:30.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.367+0000 7fd5b2d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd5b40ba850 0x7fd5b406d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52282/0 (socket says 172.21.15.72:52282) 2023-07-27T20:34:30.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.367+0000 7fd5b2d9d700 1 -- 172.21.15.72:0/2887067647 learned_addr learned my addr 172.21.15.72:0/2887067647 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:30.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.367+0000 7fd5abfff700 1 --2- 172.21.15.72:0/2887067647 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd5b406e140 0x7fd5b40ba310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:30.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.367+0000 7fd5b259c700 1 --2- 172.21.15.72:0/2887067647 >> v2:172.21.15.173:3300/0 conn(0x7fd5b413b150 0x7fd5b4151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:30.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.367+0000 7fd5b2d9d700 1 -- 172.21.15.72:0/2887067647 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd5b406e140 msgr2=0x7fd5b40ba310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:30.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.367+0000 7fd5b2d9d700 1 --2- 172.21.15.72:0/2887067647 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd5b406e140 0x7fd5b40ba310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:30.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.367+0000 7fd5b2d9d700 1 -- 172.21.15.72:0/2887067647 >> v2:172.21.15.173:3300/0 conn(0x7fd5b413b150 msgr2=0x7fd5b4151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:30.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.367+0000 7fd5b2d9d700 1 --2- 172.21.15.72:0/2887067647 >> v2:172.21.15.173:3300/0 conn(0x7fd5b413b150 0x7fd5b4151dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:30.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.367+0000 7fd5b2d9d700 1 -- 172.21.15.72:0/2887067647 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b4152c40 con 0x7fd5b40ba850 2023-07-27T20:34:30.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.367+0000 7fd5b259c700 1 --2- 172.21.15.72:0/2887067647 >> v2:172.21.15.173:3300/0 conn(0x7fd5b413b150 0x7fd5b4151dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:30.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.368+0000 7fd5b2d9d700 1 --2- 172.21.15.72:0/2887067647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5b40ba850 0x7fd5b406d5d0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fd5b406b1b0 tx=0x7fd5ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40123a9cd9444f0e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:30.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.368+0000 7fd5b1d9b700 1 -- 172.21.15.72:0/2887067647 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac00e070 con 0x7fd5b40ba850 2023-07-27T20:34:30.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.368+0000 7fd5b1d9b700 1 -- 172.21.15.72:0/2887067647 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5ac00b910 con 0x7fd5b40ba850 2023-07-27T20:34:30.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.368+0000 7fd5b1d9b700 1 -- 172.21.15.72:0/2887067647 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac00bcc0 con 0x7fd5b40ba850 2023-07-27T20:34:30.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.368+0000 7fd5b89ff700 1 -- 172.21.15.72:0/2887067647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5b40ba850 msgr2=0x7fd5b406d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:30.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.368+0000 7fd5b89ff700 1 --2- 172.21.15.72:0/2887067647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5b40ba850 0x7fd5b406d5d0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fd5b406b1b0 tx=0x7fd5ac00b330 comp rx=0 tx=0).stop 2023-07-27T20:34:30.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.369+0000 7fd5b89ff700 1 -- 172.21.15.72:0/2887067647 shutdown_connections 2023-07-27T20:34:30.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.369+0000 7fd5b89ff700 1 --2- 172.21.15.72:0/2887067647 >> v2:172.21.15.173:3300/0 conn(0x7fd5b413b150 0x7fd5b4151dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:30.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.369+0000 7fd5b89ff700 1 --2- 172.21.15.72:0/2887067647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5b40ba850 0x7fd5b406d5d0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:30.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.369+0000 7fd5b89ff700 1 --2- 172.21.15.72:0/2887067647 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd5b406e140 0x7fd5b40ba310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:30.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.369+0000 7fd5b89ff700 1 -- 172.21.15.72:0/2887067647 >> 172.21.15.72:0/2887067647 conn(0x7fd5b406a190 msgr2=0x7fd5b406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:30.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.369+0000 7fd5b89ff700 1 -- 172.21.15.72:0/2887067647 shutdown_connections 2023-07-27T20:34:30.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.369+0000 7fd5b89ff700 1 -- 172.21.15.72:0/2887067647 wait complete. 2023-07-27T20:34:30.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.370+0000 7fd5b89ff700 1 Processor -- start 2023-07-27T20:34:30.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.371+0000 7fd5b89ff700 1 -- start start 2023-07-27T20:34:30.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.371+0000 7fd5b89ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5b406e140 0x7fd5b41ecff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:30.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.372+0000 7fd5b89ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5b40ba850 0x7fd5b41ed530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:30.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.372+0000 7fd5b89ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd5b413b150 0x7fd5b4137b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:30.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.372+0000 7fd5b89ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b414d450 con 0x7fd5b406e140 2023-07-27T20:34:30.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.372+0000 7fd5b89ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b414cd50 con 0x7fd5b40ba850 2023-07-27T20:34:30.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.372+0000 7fd5b89ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b414d6c0 con 0x7fd5b413b150 2023-07-27T20:34:30.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.372+0000 7fd5b259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5b406e140 0x7fd5b41ecff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:30.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.372+0000 7fd5b259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5b406e140 0x7fd5b41ecff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52294/0 (socket says 172.21.15.72:52294) 2023-07-27T20:34:30.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.372+0000 7fd5b259c700 1 -- 172.21.15.72:0/119186283 learned_addr learned my addr 172.21.15.72:0/119186283 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:30.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.372+0000 7fd5abfff700 1 --2- 172.21.15.72:0/119186283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5b40ba850 0x7fd5b41ed530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:30.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.372+0000 7fd5b2d9d700 1 --2- 172.21.15.72:0/119186283 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd5b413b150 0x7fd5b4137b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:30.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.372+0000 7fd5b259c700 1 -- 172.21.15.72:0/119186283 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd5b413b150 msgr2=0x7fd5b4137b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:30.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.372+0000 7fd5b259c700 1 --2- 172.21.15.72:0/119186283 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd5b413b150 0x7fd5b4137b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:30.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.372+0000 7fd5b259c700 1 -- 172.21.15.72:0/119186283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5b40ba850 msgr2=0x7fd5b41ed530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:30.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.372+0000 7fd5b259c700 1 --2- 172.21.15.72:0/119186283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5b40ba850 0x7fd5b41ed530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:30.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.372+0000 7fd5b259c700 1 -- 172.21.15.72:0/119186283 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ac009b30 con 0x7fd5b406e140 2023-07-27T20:34:30.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.372+0000 7fd5b259c700 1 --2- 172.21.15.72:0/119186283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5b406e140 0x7fd5b41ecff0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fd5a400e810 tx=0x7fd5a400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:30.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.373+0000 7fd5aaffd700 1 -- 172.21.15.72:0/119186283 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4004230 con 0x7fd5b406e140 2023-07-27T20:34:30.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.373+0000 7fd5aaffd700 1 -- 172.21.15.72:0/119186283 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a4004390 con 0x7fd5b406e140 2023-07-27T20:34:30.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.373+0000 7fd5aaffd700 1 -- 172.21.15.72:0/119186283 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a40036a0 con 0x7fd5b406e140 2023-07-27T20:34:30.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.373+0000 7fd5b89ff700 1 -- 172.21.15.72:0/119186283 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5b414d9a0 con 0x7fd5b406e140 2023-07-27T20:34:30.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.373+0000 7fd5b89ff700 1 -- 172.21.15.72:0/119186283 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5b414df60 con 0x7fd5b406e140 2023-07-27T20:34:30.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.374+0000 7fd5b89ff700 1 -- 172.21.15.72:0/119186283 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5b404e470 con 0x7fd5b406e140 2023-07-27T20:34:30.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.375+0000 7fd5aaffd700 1 -- 172.21.15.72:0/119186283 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd5a4003800 con 0x7fd5b406e140 2023-07-27T20:34:30.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.376+0000 7fd5aaffd700 1 --2- 172.21.15.72:0/119186283 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd59406ace0 0x7fd59406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:30.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.376+0000 7fd5aaffd700 1 -- 172.21.15.72:0/119186283 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fd5a4088e50 con 0x7fd5b406e140 2023-07-27T20:34:30.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.376+0000 7fd5abfff700 1 --2- 172.21.15.72:0/119186283 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd59406ace0 0x7fd59406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:30.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.377+0000 7fd5abfff700 1 --2- 172.21.15.72:0/119186283 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd59406ace0 0x7fd59406d1a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd5b41ea940 tx=0x7fd59c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:30.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.380+0000 7fd5aaffd700 1 -- 172.21.15.72:0/119186283 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd5a4054070 con 0x7fd5b406e140 2023-07-27T20:34:30.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.575+0000 7fd5b89ff700 1 -- 172.21.15.72:0/119186283 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd5b414e2d0 con 0x7fd5b406e140 2023-07-27T20:34:30.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.575+0000 7fd5aaffd700 1 -- 172.21.15.72:0/119186283 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v58) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd5a4057690 con 0x7fd5b406e140 2023-07-27T20:34:30.564 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-27T20:34:30.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.578+0000 7fd5b89ff700 1 -- 172.21.15.72:0/119186283 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd59406ace0 msgr2=0x7fd59406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:30.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.578+0000 7fd5b89ff700 1 --2- 172.21.15.72:0/119186283 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd59406ace0 0x7fd59406d1a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd5b41ea940 tx=0x7fd59c008040 comp rx=0 tx=0).stop 2023-07-27T20:34:30.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.578+0000 7fd5b89ff700 1 -- 172.21.15.72:0/119186283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5b406e140 msgr2=0x7fd5b41ecff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:30.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.578+0000 7fd5b89ff700 1 --2- 172.21.15.72:0/119186283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5b406e140 0x7fd5b41ecff0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fd5a400e810 tx=0x7fd5a400ebd0 comp rx=0 tx=0).stop 2023-07-27T20:34:30.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.578+0000 7fd5b89ff700 1 -- 172.21.15.72:0/119186283 shutdown_connections 2023-07-27T20:34:30.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.578+0000 7fd5b89ff700 1 --2- 172.21.15.72:0/119186283 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd59406ace0 0x7fd59406d1a0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:30.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.578+0000 7fd5b89ff700 1 --2- 172.21.15.72:0/119186283 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd5b413b150 0x7fd5b4137b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:30.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.578+0000 7fd5b89ff700 1 --2- 172.21.15.72:0/119186283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5b406e140 0x7fd5b41ecff0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:30.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.578+0000 7fd5b89ff700 1 --2- 172.21.15.72:0/119186283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5b40ba850 0x7fd5b41ed530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:30.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.578+0000 7fd5b89ff700 1 -- 172.21.15.72:0/119186283 >> 172.21.15.72:0/119186283 conn(0x7fd5b406a190 msgr2=0x7fd5b41389b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:30.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.578+0000 7fd5b89ff700 1 -- 172.21.15.72:0/119186283 shutdown_connections 2023-07-27T20:34:30.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.578+0000 7fd5b89ff700 1 -- 172.21.15.72:0/119186283 wait complete. 2023-07-27T20:34:30.584 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-27T20:34:30.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.791+0000 7fd1cc5ff700 1 Processor -- start 2023-07-27T20:34:30.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.791+0000 7fd1cc5ff700 1 -- start start 2023-07-27T20:34:30.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.792+0000 7fd1cc5ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd1c4151800 0x7fd1c40c1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:30.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.792+0000 7fd1cc5ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c40706f0 con 0x7fd1c40c5c00 2023-07-27T20:34:30.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.792+0000 7fd1cc5ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c41585d0 con 0x7fd1c4154960 2023-07-27T20:34:30.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.792+0000 7fd1cc5ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c4154510 con 0x7fd1c4151800 2023-07-27T20:34:30.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.792+0000 7fd1c9b9a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd1c40c5c00 0x7fd1c40a9190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60592/0 (socket says 172.21.15.72:60592) 2023-07-27T20:34:30.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.793+0000 7fd1c9b9a700 1 -- 172.21.15.72:0/3618302151 learned_addr learned my addr 172.21.15.72:0/3618302151 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:30.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.793+0000 7fd1ca39b700 1 --2- 172.21.15.72:0/3618302151 >> v2:172.21.15.173:3300/0 conn(0x7fd1c4151800 0x7fd1c40c1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:30.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.793+0000 7fd1c9399700 1 -- 172.21.15.72:0/3618302151 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 185777038 0 0) 0x7fd1c40706f0 con 0x7fd1c40c5c00 2023-07-27T20:34:30.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.793+0000 7fd1c9399700 1 -- 172.21.15.72:0/3618302151 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1b00035b0 con 0x7fd1c40c5c00 2023-07-27T20:34:30.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.793+0000 7fd1ca39b700 1 -- 172.21.15.72:0/3618302151 >> v1:172.21.15.173:6789/0 conn(0x7fd1c4154960 legacy=0x7fd1c415eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:30.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.793+0000 7fd1ca39b700 1 -- 172.21.15.72:0/3618302151 >> v1:172.21.15.72:6789/0 conn(0x7fd1c40c5c00 legacy=0x7fd1c40a9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:30.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.793+0000 7fd1ca39b700 1 -- 172.21.15.72:0/3618302151 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c40709b0 con 0x7fd1c4151800 2023-07-27T20:34:30.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.793+0000 7fd1ca39b700 1 --2- 172.21.15.72:0/3618302151 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1c4151800 0x7fd1c40c1fb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0009840 tx=0x7fd1c0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a6b51072d7cafd5 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:30.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.794+0000 7fd1c9399700 1 -- 172.21.15.72:0/3618302151 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c0011830 con 0x7fd1c4151800 2023-07-27T20:34:30.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.794+0000 7fd1c9399700 1 -- 172.21.15.72:0/3618302151 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c0011990 con 0x7fd1c4151800 2023-07-27T20:34:30.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.794+0000 7fd1c9399700 1 -- 172.21.15.72:0/3618302151 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c0011d20 con 0x7fd1c4151800 2023-07-27T20:34:30.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.794+0000 7fd1cc5ff700 1 -- 172.21.15.72:0/3618302151 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1c4151800 msgr2=0x7fd1c40c1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:30.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.794+0000 7fd1cc5ff700 1 --2- 172.21.15.72:0/3618302151 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1c4151800 0x7fd1c40c1fb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0009840 tx=0x7fd1c0009b50 comp rx=0 tx=0).stop 2023-07-27T20:34:30.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.794+0000 7fd1cc5ff700 1 -- 172.21.15.72:0/3618302151 shutdown_connections 2023-07-27T20:34:30.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.794+0000 7fd1cc5ff700 1 --2- 172.21.15.72:0/3618302151 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1c4151800 0x7fd1c40c1fb0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:30.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.794+0000 7fd1cc5ff700 1 -- 172.21.15.72:0/3618302151 >> 172.21.15.72:0/3618302151 conn(0x7fd1c406a7c0 msgr2=0x7fd1c40c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:30.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.794+0000 7fd1cc5ff700 1 -- 172.21.15.72:0/3618302151 shutdown_connections 2023-07-27T20:34:30.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.794+0000 7fd1cc5ff700 1 -- 172.21.15.72:0/3618302151 wait complete. 2023-07-27T20:34:30.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.796+0000 7fd1cc5ff700 1 Processor -- start 2023-07-27T20:34:30.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.796+0000 7fd1cc5ff700 1 -- start start 2023-07-27T20:34:30.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.797+0000 7fd1cc5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1c40c5c00 0x7fd1c41ed150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:30.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.797+0000 7fd1cc5ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1c4151800 0x7fd1c40bca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:30.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.797+0000 7fd1cc5ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1c4154960 0x7fd1c40bcf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:30.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.797+0000 7fd1cc5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c40bb400 con 0x7fd1c40c5c00 2023-07-27T20:34:30.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.797+0000 7fd1cc5ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c40bc0f0 con 0x7fd1c4154960 2023-07-27T20:34:30.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.797+0000 7fd1cc5ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c40beb50 con 0x7fd1c4151800 2023-07-27T20:34:30.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.797+0000 7fd1ca39b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1c40c5c00 0x7fd1c41ed150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:30.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.797+0000 7fd1ca39b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1c40c5c00 0x7fd1c41ed150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52298/0 (socket says 172.21.15.72:52298) 2023-07-27T20:34:30.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.797+0000 7fd1ca39b700 1 -- 172.21.15.72:0/3273524970 learned_addr learned my addr 172.21.15.72:0/3273524970 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:30.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.798+0000 7fd1ca39b700 1 -- 172.21.15.72:0/3273524970 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1c4151800 msgr2=0x7fd1c40bca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:30.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.798+0000 7fd1c9b9a700 1 --2- 172.21.15.72:0/3273524970 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1c4151800 0x7fd1c40bca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:30.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.798+0000 7fd1cab9c700 1 --2- 172.21.15.72:0/3273524970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1c4154960 0x7fd1c40bcf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:30.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.798+0000 7fd1ca39b700 1 --2- 172.21.15.72:0/3273524970 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1c4151800 0x7fd1c40bca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:30.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.798+0000 7fd1ca39b700 1 -- 172.21.15.72:0/3273524970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1c4154960 msgr2=0x7fd1c40bcf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:30.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.798+0000 7fd1ca39b700 1 --2- 172.21.15.72:0/3273524970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1c4154960 0x7fd1c40bcf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:30.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.798+0000 7fd1ca39b700 1 -- 172.21.15.72:0/3273524970 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c00094a0 con 0x7fd1c40c5c00 2023-07-27T20:34:30.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.798+0000 7fd1cab9c700 1 --2- 172.21.15.72:0/3273524970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1c4154960 0x7fd1c40bcf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:30.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.798+0000 7fd1c9b9a700 1 --2- 172.21.15.72:0/3273524970 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1c4151800 0x7fd1c40bca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:30.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.798+0000 7fd1ca39b700 1 --2- 172.21.15.72:0/3273524970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1c40c5c00 0x7fd1c41ed150 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0009fd0 tx=0x7fd1c0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:30.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.798+0000 7fd1baffd700 1 -- 172.21.15.72:0/3273524970 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c00038a0 con 0x7fd1c40c5c00 2023-07-27T20:34:30.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.798+0000 7fd1baffd700 1 -- 172.21.15.72:0/3273524970 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c001f070 con 0x7fd1c40c5c00 2023-07-27T20:34:30.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.798+0000 7fd1baffd700 1 -- 172.21.15.72:0/3273524970 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c0003c40 con 0x7fd1c40c5c00 2023-07-27T20:34:30.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.798+0000 7fd1cc5ff700 1 -- 172.21.15.72:0/3273524970 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c41ed990 con 0x7fd1c40c5c00 2023-07-27T20:34:30.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.798+0000 7fd1cc5ff700 1 -- 172.21.15.72:0/3273524970 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c40bc4f0 con 0x7fd1c40c5c00 2023-07-27T20:34:30.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.799+0000 7fd1cc5ff700 1 -- 172.21.15.72:0/3273524970 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1c4070c90 con 0x7fd1c40c5c00 2023-07-27T20:34:30.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.800+0000 7fd1baffd700 1 -- 172.21.15.72:0/3273524970 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd1c0026480 con 0x7fd1c40c5c00 2023-07-27T20:34:30.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.801+0000 7fd1baffd700 1 --2- 172.21.15.72:0/3273524970 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd1a806ace0 0x7fd1a806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:30.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.801+0000 7fd1baffd700 1 -- 172.21.15.72:0/3273524970 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fd1c0021070 con 0x7fd1c40c5c00 2023-07-27T20:34:30.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.801+0000 7fd1c9b9a700 1 --2- 172.21.15.72:0/3273524970 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd1a806ace0 0x7fd1a806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:30.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.802+0000 7fd1c9b9a700 1 --2- 172.21.15.72:0/3273524970 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd1a806ace0 0x7fd1a806d1a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd1b40011e0 tx=0x7fd1b4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:30.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:30.805+0000 7fd1baffd700 1 -- 172.21.15.72:0/3273524970 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd1c0055f00 con 0x7fd1c40c5c00 2023-07-27T20:34:30.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.006+0000 7fd1cc5ff700 1 -- 172.21.15.72:0/3273524970 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd1c4074310 con 0x7fd1c40c5c00 2023-07-27T20:34:30.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.006+0000 7fd1baffd700 1 -- 172.21.15.72:0/3273524970 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v58) v1 ==== 84+0+126 (secure 0 0 0) 0x7fd1c002b090 con 0x7fd1c40c5c00 2023-07-27T20:34:30.995 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:34:30.995 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2023-07-27T20:34:30.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:34:30.995 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 1, 2023-07-27T20:34:30.995 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": ".mgr" 2023-07-27T20:34:30.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:34:30.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:34:30.996 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 2, 2023-07-27T20:34:30.996 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "rbd" 2023-07-27T20:34:30.996 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:34:30.996 INFO:teuthology.orchestra.run.smithi072.stdout:] 2023-07-27T20:34:30.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.008+0000 7fd1cc5ff700 1 -- 172.21.15.72:0/3273524970 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd1a806ace0 msgr2=0x7fd1a806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:30.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.008+0000 7fd1cc5ff700 1 --2- 172.21.15.72:0/3273524970 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd1a806ace0 0x7fd1a806d1a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd1b40011e0 tx=0x7fd1b4009040 comp rx=0 tx=0).stop 2023-07-27T20:34:30.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.008+0000 7fd1cc5ff700 1 -- 172.21.15.72:0/3273524970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1c40c5c00 msgr2=0x7fd1c41ed150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:30.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.008+0000 7fd1cc5ff700 1 --2- 172.21.15.72:0/3273524970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1c40c5c00 0x7fd1c41ed150 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0009fd0 tx=0x7fd1c0004750 comp rx=0 tx=0).stop 2023-07-27T20:34:30.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.009+0000 7fd1cc5ff700 1 -- 172.21.15.72:0/3273524970 shutdown_connections 2023-07-27T20:34:30.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.009+0000 7fd1cc5ff700 1 --2- 172.21.15.72:0/3273524970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1c4154960 0x7fd1c40bcf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:30.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.009+0000 7fd1cc5ff700 1 --2- 172.21.15.72:0/3273524970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1c40c5c00 0x7fd1c41ed150 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:30.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.009+0000 7fd1cc5ff700 1 --2- 172.21.15.72:0/3273524970 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd1a806ace0 0x7fd1a806d1a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:30.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.009+0000 7fd1cc5ff700 1 --2- 172.21.15.72:0/3273524970 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1c4151800 0x7fd1c40bca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:30.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.009+0000 7fd1cc5ff700 1 -- 172.21.15.72:0/3273524970 >> 172.21.15.72:0/3273524970 conn(0x7fd1c406a7c0 msgr2=0x7fd1c406b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:30.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.009+0000 7fd1cc5ff700 1 -- 172.21.15.72:0/3273524970 shutdown_connections 2023-07-27T20:34:30.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.009+0000 7fd1cc5ff700 1 -- 172.21.15.72:0/3273524970 wait complete. 2023-07-27T20:34:31.015 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-27T20:34:31.015 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-27T20:34:31.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.227+0000 7f9a52fff700 1 Processor -- start 2023-07-27T20:34:31.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.228+0000 7f9a52fff700 1 -- start start 2023-07-27T20:34:31.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.229+0000 7f9a52fff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9a4c154240 0x7f9a4c1546f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:31.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.229+0000 7f9a52fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a4c1584e0 con 0x7f9a4c13c9f0 2023-07-27T20:34:31.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.229+0000 7f9a52fff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a4c13d6d0 con 0x7f9a4c0c02b0 2023-07-27T20:34:31.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.229+0000 7f9a52fff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a4c1578d0 con 0x7f9a4c154240 2023-07-27T20:34:31.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.229+0000 7f9a50d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9a4c13c9f0 0x7f9a4c13cfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60596/0 (socket says 172.21.15.72:60596) 2023-07-27T20:34:31.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.229+0000 7f9a50d9b700 1 -- 172.21.15.72:0/4116070143 learned_addr learned my addr 172.21.15.72:0/4116070143 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:31.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.229+0000 7f9a5159c700 1 --2- 172.21.15.72:0/4116070143 >> v2:172.21.15.173:3300/0 conn(0x7f9a4c154240 0x7f9a4c1546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:31.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.229+0000 7f9a4b7fe700 1 -- 172.21.15.72:0/4116070143 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2779020995 0 0) 0x7f9a4c1584e0 con 0x7f9a4c13c9f0 2023-07-27T20:34:31.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.229+0000 7f9a4b7fe700 1 -- 172.21.15.72:0/4116070143 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a3c0035b0 con 0x7f9a4c13c9f0 2023-07-27T20:34:31.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.230+0000 7f9a4b7fe700 1 -- 172.21.15.72:0/4116070143 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 848953072 0 0) 0x7f9a3c0035b0 con 0x7f9a4c13c9f0 2023-07-27T20:34:31.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.230+0000 7f9a4b7fe700 1 -- 172.21.15.72:0/4116070143 >> v2:172.21.15.173:3300/0 conn(0x7f9a4c154240 msgr2=0x7f9a4c1546f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:31.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.230+0000 7f9a4b7fe700 1 --2- 172.21.15.72:0/4116070143 >> v2:172.21.15.173:3300/0 conn(0x7f9a4c154240 0x7f9a4c1546f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:31.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.230+0000 7f9a4b7fe700 1 -- 172.21.15.72:0/4116070143 >> v1:172.21.15.173:6789/0 conn(0x7f9a4c0c02b0 legacy=0x7f9a4c0c0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:31.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.230+0000 7f9a4b7fe700 1 -- 172.21.15.72:0/4116070143 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a4c157bb0 con 0x7f9a4c13c9f0 2023-07-27T20:34:31.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.230+0000 7f9a4b7fe700 1 -- 172.21.15.72:0/4116070143 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f9a40001670 con 0x7f9a4c13c9f0 2023-07-27T20:34:31.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.230+0000 7f9a4b7fe700 1 -- 172.21.15.72:0/4116070143 >> v1:172.21.15.72:6789/0 conn(0x7f9a4c13c9f0 legacy=0x7f9a4c13cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:31.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.230+0000 7f9a4b7fe700 1 --2- 172.21.15.72:0/4116070143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a3c003a00 0x7f9a3c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:31.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.230+0000 7f9a4b7fe700 1 --2- 172.21.15.72:0/4116070143 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9a3c004400 0x7f9a3c0048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:31.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.230+0000 7f9a4b7fe700 1 --2- 172.21.15.72:0/4116070143 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a3c005170 0x7f9a3c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:31.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.230+0000 7f9a4b7fe700 1 -- 172.21.15.72:0/4116070143 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c1578d0 con 0x7f9a3c003a00 2023-07-27T20:34:31.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.230+0000 7f9a4b7fe700 1 -- 172.21.15.72:0/4116070143 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c00c0b0 con 0x7f9a3c005170 2023-07-27T20:34:31.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.230+0000 7f9a4b7fe700 1 -- 172.21.15.72:0/4116070143 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c00c270 con 0x7f9a3c004400 2023-07-27T20:34:31.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.230+0000 7f9a50d9b700 1 --2- 172.21.15.72:0/4116070143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a3c003a00 0x7f9a3c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:31.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.230+0000 7f9a5159c700 1 --2- 172.21.15.72:0/4116070143 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a3c005170 0x7f9a3c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:31.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.230+0000 7f9a4bfff700 1 --2- 172.21.15.72:0/4116070143 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9a3c004400 0x7f9a3c0048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:31.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.231+0000 7f9a50d9b700 1 -- 172.21.15.72:0/4116070143 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9a3c004400 msgr2=0x7f9a3c0048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:31.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.231+0000 7f9a50d9b700 1 --2- 172.21.15.72:0/4116070143 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9a3c004400 0x7f9a3c0048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:31.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.231+0000 7f9a50d9b700 1 -- 172.21.15.72:0/4116070143 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a3c005170 msgr2=0x7f9a3c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:31.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.231+0000 7f9a50d9b700 1 --2- 172.21.15.72:0/4116070143 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a3c005170 0x7f9a3c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:31.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.231+0000 7f9a50d9b700 1 -- 172.21.15.72:0/4116070143 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a3c0035b0 con 0x7f9a3c003a00 2023-07-27T20:34:31.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.231+0000 7f9a5159c700 1 -- 172.21.15.72:0/4116070143 reap_dead start 2023-07-27T20:34:31.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.231+0000 7f9a50d9b700 1 --2- 172.21.15.72:0/4116070143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a3c003a00 0x7f9a3c003de0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f9a40005150 tx=0x7f9a3c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40898cec8ae10aa9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:31.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.231+0000 7f9a4b7fe700 1 -- 172.21.15.72:0/4116070143 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a40004bf0 con 0x7f9a3c003a00 2023-07-27T20:34:31.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.231+0000 7f9a4b7fe700 1 -- 172.21.15.72:0/4116070143 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a40005b60 con 0x7f9a3c003a00 2023-07-27T20:34:31.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.231+0000 7f9a4b7fe700 1 -- 172.21.15.72:0/4116070143 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a400080d0 con 0x7f9a3c003a00 2023-07-27T20:34:31.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.232+0000 7f9a52fff700 1 -- 172.21.15.72:0/4116070143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a3c003a00 msgr2=0x7f9a3c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:31.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.232+0000 7f9a52fff700 1 --2- 172.21.15.72:0/4116070143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a3c003a00 0x7f9a3c003de0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f9a40005150 tx=0x7f9a3c005880 comp rx=0 tx=0).stop 2023-07-27T20:34:31.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.232+0000 7f9a52fff700 1 -- 172.21.15.72:0/4116070143 shutdown_connections 2023-07-27T20:34:31.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.232+0000 7f9a52fff700 1 --2- 172.21.15.72:0/4116070143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a3c003a00 0x7f9a3c003de0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:31.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.232+0000 7f9a52fff700 1 -- 172.21.15.72:0/4116070143 >> 172.21.15.72:0/4116070143 conn(0x7f9a4c0a7b10 msgr2=0x7f9a4c06e230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:31.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.232+0000 7f9a52fff700 1 -- 172.21.15.72:0/4116070143 shutdown_connections 2023-07-27T20:34:31.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.232+0000 7f9a52fff700 1 -- 172.21.15.72:0/4116070143 wait complete. 2023-07-27T20:34:31.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.233+0000 7f9a52fff700 1 Processor -- start 2023-07-27T20:34:31.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.234+0000 7f9a52fff700 1 -- start start 2023-07-27T20:34:31.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.234+0000 7f9a52fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9a3c003a00 0x7f9a4c06bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:31.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.234+0000 7f9a52fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a4c1568f0 0x7f9a4c136c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:31.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.234+0000 7f9a52fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a4c1371d0 0x7f9a4c1507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:31.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.234+0000 7f9a52fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c137a50 con 0x7f9a4c1568f0 2023-07-27T20:34:31.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.234+0000 7f9a52fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c06aba0 con 0x7f9a4c1371d0 2023-07-27T20:34:31.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.234+0000 7f9a52fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c1515d0 con 0x7f9a3c003a00 2023-07-27T20:34:31.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.235+0000 7f9a4bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a4c1568f0 0x7f9a4c136c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:31.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.235+0000 7f9a4bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a4c1568f0 0x7f9a4c136c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52314/0 (socket says 172.21.15.72:52314) 2023-07-27T20:34:31.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.235+0000 7f9a4bfff700 1 -- 172.21.15.72:0/4187063469 learned_addr learned my addr 172.21.15.72:0/4187063469 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:31.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.235+0000 7f9a5159c700 1 --2- 172.21.15.72:0/4187063469 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a4c1371d0 0x7f9a4c1507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:31.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.235+0000 7f9a50d9b700 1 --2- 172.21.15.72:0/4187063469 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9a3c003a00 0x7f9a4c06bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:31.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.235+0000 7f9a4bfff700 1 -- 172.21.15.72:0/4187063469 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9a3c003a00 msgr2=0x7f9a4c06bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:31.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.235+0000 7f9a4bfff700 1 --2- 172.21.15.72:0/4187063469 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9a3c003a00 0x7f9a4c06bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:31.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.235+0000 7f9a4bfff700 1 -- 172.21.15.72:0/4187063469 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a4c1371d0 msgr2=0x7f9a4c1507a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:31.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.235+0000 7f9a4bfff700 1 --2- 172.21.15.72:0/4187063469 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a4c1371d0 0x7f9a4c1507a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:31.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.235+0000 7f9a4bfff700 1 -- 172.21.15.72:0/4187063469 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a4c06adf0 con 0x7f9a4c1568f0 2023-07-27T20:34:31.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.235+0000 7f9a5159c700 1 --2- 172.21.15.72:0/4187063469 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a4c1371d0 0x7f9a4c1507a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:31.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.235+0000 7f9a4bfff700 1 --2- 172.21.15.72:0/4187063469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a4c1568f0 0x7f9a4c136c90 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f9a3800e490 tx=0x7f9a3800e850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:31.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.235+0000 7f9a497fa700 1 -- 172.21.15.72:0/4187063469 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a380052e0 con 0x7f9a4c1568f0 2023-07-27T20:34:31.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.236+0000 7f9a497fa700 1 -- 172.21.15.72:0/4187063469 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a38005440 con 0x7f9a4c1568f0 2023-07-27T20:34:31.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.236+0000 7f9a52fff700 1 -- 172.21.15.72:0/4187063469 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a4c06b0d0 con 0x7f9a4c1568f0 2023-07-27T20:34:31.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.236+0000 7f9a497fa700 1 -- 172.21.15.72:0/4187063469 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a38003880 con 0x7f9a4c1568f0 2023-07-27T20:34:31.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.236+0000 7f9a52fff700 1 -- 172.21.15.72:0/4187063469 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a4c138920 con 0x7f9a4c1568f0 2023-07-27T20:34:31.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.237+0000 7f9a52fff700 1 -- 172.21.15.72:0/4187063469 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a4c04e470 con 0x7f9a4c1568f0 2023-07-27T20:34:31.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.238+0000 7f9a497fa700 1 -- 172.21.15.72:0/4187063469 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9a380039e0 con 0x7f9a4c1568f0 2023-07-27T20:34:31.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.239+0000 7f9a497fa700 1 --2- 172.21.15.72:0/4187063469 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9a3006ace0 0x7f9a3006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:31.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.239+0000 7f9a497fa700 1 -- 172.21.15.72:0/4187063469 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f9a380888f0 con 0x7f9a4c1568f0 2023-07-27T20:34:31.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.239+0000 7f9a50d9b700 1 --2- 172.21.15.72:0/4187063469 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9a3006ace0 0x7f9a3006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:31.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.240+0000 7f9a50d9b700 1 --2- 172.21.15.72:0/4187063469 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9a3006ace0 0x7f9a3006d1a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9a40005150 tx=0x7f9a4000a070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:31.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.243+0000 7f9a497fa700 1 -- 172.21.15.72:0/4187063469 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9a38053c50 con 0x7f9a4c1568f0 2023-07-27T20:34:31.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:31.439+0000 7f9a52fff700 1 -- 172.21.15.72:0/4187063469 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9a4c0bffb0 con 0x7f9a4c1568f0 2023-07-27T20:34:32.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.271+0000 7f9a497fa700 1 -- 172.21.15.72:0/4187063469 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v59) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9a380190b0 con 0x7f9a4c1568f0 2023-07-27T20:34:32.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.276+0000 7f9a52fff700 1 -- 172.21.15.72:0/4187063469 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9a3006ace0 msgr2=0x7f9a3006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:32.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.276+0000 7f9a52fff700 1 --2- 172.21.15.72:0/4187063469 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9a3006ace0 0x7f9a3006d1a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9a40005150 tx=0x7f9a4000a070 comp rx=0 tx=0).stop 2023-07-27T20:34:32.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.276+0000 7f9a52fff700 1 -- 172.21.15.72:0/4187063469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a4c1568f0 msgr2=0x7f9a4c136c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:32.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.276+0000 7f9a52fff700 1 --2- 172.21.15.72:0/4187063469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a4c1568f0 0x7f9a4c136c90 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f9a3800e490 tx=0x7f9a3800e850 comp rx=0 tx=0).stop 2023-07-27T20:34:32.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.276+0000 7f9a52fff700 1 -- 172.21.15.72:0/4187063469 shutdown_connections 2023-07-27T20:34:32.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.276+0000 7f9a52fff700 1 --2- 172.21.15.72:0/4187063469 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a4c1371d0 0x7f9a4c1507a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:32.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.276+0000 7f9a52fff700 1 --2- 172.21.15.72:0/4187063469 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f9a3006ace0 0x7f9a3006d1a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:32.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.276+0000 7f9a52fff700 1 --2- 172.21.15.72:0/4187063469 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9a3c003a00 0x7f9a4c06bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:32.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.276+0000 7f9a52fff700 1 --2- 172.21.15.72:0/4187063469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a4c1568f0 0x7f9a4c136c90 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:32.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.276+0000 7f9a52fff700 1 -- 172.21.15.72:0/4187063469 >> 172.21.15.72:0/4187063469 conn(0x7f9a4c0a7b10 msgr2=0x7f9a4c154bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:32.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.277+0000 7f9a52fff700 1 -- 172.21.15.72:0/4187063469 shutdown_connections 2023-07-27T20:34:32.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.277+0000 7f9a52fff700 1 -- 172.21.15.72:0/4187063469 wait complete. 2023-07-27T20:34:32.267 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' created 2023-07-27T20:34:32.288 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-27T20:34:32.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.506+0000 7f517a7ff700 1 Processor -- start 2023-07-27T20:34:32.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.506+0000 7f517a7ff700 1 -- start start 2023-07-27T20:34:32.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.507+0000 7f517a7ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f517406c6f0 0x7f5174154be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:32.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.507+0000 7f517a7ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f5174155120 0x7f5174152490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:32.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.507+0000 7f517a7ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51740c0ae0 con 0x7f5174154800 2023-07-27T20:34:32.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.507+0000 7f517a7ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51740c0900 con 0x7f517406c6f0 2023-07-27T20:34:32.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.507+0000 7f517a7ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5174155570 con 0x7f5174155120 2023-07-27T20:34:32.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.507+0000 7f516bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f517406c6f0 0x7f5174154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:32.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.507+0000 7f516bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f517406c6f0 0x7f5174154be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52320/0 (socket says 172.21.15.72:52320) 2023-07-27T20:34:32.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.507+0000 7f516bfff700 1 -- 172.21.15.72:0/2599292337 learned_addr learned my addr 172.21.15.72:0/2599292337 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:32.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.508+0000 7f5178d9c700 1 --2- 172.21.15.72:0/2599292337 >> v2:172.21.15.173:3300/0 conn(0x7f5174155120 0x7f5174152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:32.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.508+0000 7f516bfff700 1 -- 172.21.15.72:0/2599292337 >> v2:172.21.15.173:3300/0 conn(0x7f5174155120 msgr2=0x7f5174152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:32.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.508+0000 7f516bfff700 1 --2- 172.21.15.72:0/2599292337 >> v2:172.21.15.173:3300/0 conn(0x7f5174155120 0x7f5174152490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:32.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.508+0000 7f516bfff700 1 -- 172.21.15.72:0/2599292337 >> v1:172.21.15.173:6789/0 conn(0x7f5174154800 legacy=0x7f517414abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:32.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.508+0000 7f516bfff700 1 -- 172.21.15.72:0/2599292337 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51740c0dc0 con 0x7f517406c6f0 2023-07-27T20:34:32.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.508+0000 7f516bfff700 1 --2- 172.21.15.72:0/2599292337 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f517406c6f0 0x7f5174154be0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f51740724f0 tx=0x7f515c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef6dddf86e99a6b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:32.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.508+0000 7f51737fe700 1 -- 172.21.15.72:0/2599292337 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c004230 con 0x7f517406c6f0 2023-07-27T20:34:32.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.508+0000 7f51737fe700 1 -- 172.21.15.72:0/2599292337 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f515c004390 con 0x7f517406c6f0 2023-07-27T20:34:32.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.508+0000 7f51737fe700 1 -- 172.21.15.72:0/2599292337 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c0036a0 con 0x7f517406c6f0 2023-07-27T20:34:32.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.509+0000 7f517a7ff700 1 -- 172.21.15.72:0/2599292337 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f517406c6f0 msgr2=0x7f5174154be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:32.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.509+0000 7f517a7ff700 1 --2- 172.21.15.72:0/2599292337 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f517406c6f0 0x7f5174154be0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f51740724f0 tx=0x7f515c009bd0 comp rx=0 tx=0).stop 2023-07-27T20:34:32.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.509+0000 7f517a7ff700 1 -- 172.21.15.72:0/2599292337 shutdown_connections 2023-07-27T20:34:32.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.509+0000 7f517a7ff700 1 --2- 172.21.15.72:0/2599292337 >> v2:172.21.15.173:3300/0 conn(0x7f5174155120 0x7f5174152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:32.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.509+0000 7f517a7ff700 1 --2- 172.21.15.72:0/2599292337 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f517406c6f0 0x7f5174154be0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:32.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.509+0000 7f517a7ff700 1 -- 172.21.15.72:0/2599292337 >> 172.21.15.72:0/2599292337 conn(0x7f51740c55b0 msgr2=0x7f51740c59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:32.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.509+0000 7f517a7ff700 1 -- 172.21.15.72:0/2599292337 shutdown_connections 2023-07-27T20:34:32.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.509+0000 7f517a7ff700 1 -- 172.21.15.72:0/2599292337 wait complete. 2023-07-27T20:34:32.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.511+0000 7f517a7ff700 1 Processor -- start 2023-07-27T20:34:32.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.511+0000 7f517a7ff700 1 -- start start 2023-07-27T20:34:32.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.511+0000 7f517a7ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f517406c6f0 0x7f51740712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:32.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.512+0000 7f517a7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5174154800 0x7f51741eaf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:32.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.512+0000 7f517a7ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5174155120 0x7f51741eb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:32.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.512+0000 7f517a7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51741edc30 con 0x7f5174154800 2023-07-27T20:34:32.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.512+0000 7f517a7ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517414f3b0 con 0x7f517406c6f0 2023-07-27T20:34:32.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.512+0000 7f517a7ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51741ed020 con 0x7f5174155120 2023-07-27T20:34:32.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.512+0000 7f516bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5174154800 0x7f51741eaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:32.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.512+0000 7f516bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5174154800 0x7f51741eaf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52322/0 (socket says 172.21.15.72:52322) 2023-07-27T20:34:32.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.512+0000 7f516bfff700 1 -- 172.21.15.72:0/3245169753 learned_addr learned my addr 172.21.15.72:0/3245169753 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:32.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.512+0000 7f5173fff700 1 --2- 172.21.15.72:0/3245169753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f517406c6f0 0x7f51740712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:32.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.512+0000 7f5178d9c700 1 --2- 172.21.15.72:0/3245169753 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5174155120 0x7f51741eb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:32.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.512+0000 7f516bfff700 1 -- 172.21.15.72:0/3245169753 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5174155120 msgr2=0x7f51741eb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:32.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.512+0000 7f516bfff700 1 --2- 172.21.15.72:0/3245169753 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5174155120 0x7f51741eb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:32.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.512+0000 7f516bfff700 1 -- 172.21.15.72:0/3245169753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f517406c6f0 msgr2=0x7f51740712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:32.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.512+0000 7f516bfff700 1 --2- 172.21.15.72:0/3245169753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f517406c6f0 0x7f51740712d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:32.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.512+0000 7f516bfff700 1 -- 172.21.15.72:0/3245169753 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f515c009550 con 0x7f5174154800 2023-07-27T20:34:32.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.513+0000 7f516bfff700 1 --2- 172.21.15.72:0/3245169753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5174154800 0x7f51741eaf90 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f515c009130 tx=0x7f515c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:32.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.513+0000 7f51717fa700 1 -- 172.21.15.72:0/3245169753 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c003da0 con 0x7f5174154800 2023-07-27T20:34:32.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.513+0000 7f51717fa700 1 -- 172.21.15.72:0/3245169753 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f515c011630 con 0x7f5174154800 2023-07-27T20:34:32.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.513+0000 7f51717fa700 1 -- 172.21.15.72:0/3245169753 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c0119e0 con 0x7f5174154800 2023-07-27T20:34:32.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.513+0000 7f517a7ff700 1 -- 172.21.15.72:0/3245169753 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51741ed300 con 0x7f5174154800 2023-07-27T20:34:32.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.513+0000 7f517a7ff700 1 -- 172.21.15.72:0/3245169753 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51741ed8c0 con 0x7f5174154800 2023-07-27T20:34:32.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.514+0000 7f517a7ff700 1 -- 172.21.15.72:0/3245169753 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51741eacb0 con 0x7f5174154800 2023-07-27T20:34:32.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.516+0000 7f51717fa700 1 -- 172.21.15.72:0/3245169753 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f515c011b40 con 0x7f5174154800 2023-07-27T20:34:32.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.517+0000 7f51717fa700 1 --2- 172.21.15.72:0/3245169753 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f515406ace0 0x7f515406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:32.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.517+0000 7f51717fa700 1 -- 172.21.15.72:0/3245169753 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f515c08a9f0 con 0x7f5174154800 2023-07-27T20:34:32.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.517+0000 7f5173fff700 1 --2- 172.21.15.72:0/3245169753 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f515406ace0 0x7f515406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:32.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.518+0000 7f5173fff700 1 --2- 172.21.15.72:0/3245169753 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f515406ace0 0x7f515406d1a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5174073830 tx=0x7f5164007ec0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:32.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.521+0000 7f51717fa700 1 -- 172.21.15.72:0/3245169753 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f515c055b30 con 0x7f5174154800 2023-07-27T20:34:32.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:32.715+0000 7f517a7ff700 1 -- 172.21.15.72:0/3245169753 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f51741eacb0 con 0x7f5174154800 2023-07-27T20:34:33.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.279+0000 7f51717fa700 1 -- 172.21.15.72:0/3245169753 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v60) v1 ==== 170+0+0 (secure 0 0 0) 0x7f51741eacb0 con 0x7f5174154800 2023-07-27T20:34:33.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.283+0000 7f517a7ff700 1 -- 172.21.15.72:0/3245169753 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f515406ace0 msgr2=0x7f515406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:33.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.283+0000 7f517a7ff700 1 --2- 172.21.15.72:0/3245169753 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f515406ace0 0x7f515406d1a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5174073830 tx=0x7f5164007ec0 comp rx=0 tx=0).stop 2023-07-27T20:34:33.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.283+0000 7f517a7ff700 1 -- 172.21.15.72:0/3245169753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5174154800 msgr2=0x7f51741eaf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:33.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.283+0000 7f517a7ff700 1 --2- 172.21.15.72:0/3245169753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5174154800 0x7f51741eaf90 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f515c009130 tx=0x7f515c004750 comp rx=0 tx=0).stop 2023-07-27T20:34:33.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.283+0000 7f517a7ff700 1 -- 172.21.15.72:0/3245169753 shutdown_connections 2023-07-27T20:34:33.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.283+0000 7f517a7ff700 1 --2- 172.21.15.72:0/3245169753 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f515406ace0 0x7f515406d1a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:33.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.283+0000 7f517a7ff700 1 --2- 172.21.15.72:0/3245169753 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5174155120 0x7f51741eb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:33.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.283+0000 7f517a7ff700 1 --2- 172.21.15.72:0/3245169753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f517406c6f0 0x7f51740712d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:33.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.283+0000 7f517a7ff700 1 --2- 172.21.15.72:0/3245169753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5174154800 0x7f51741eaf90 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:33.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.283+0000 7f517a7ff700 1 -- 172.21.15.72:0/3245169753 >> 172.21.15.72:0/3245169753 conn(0x7f51740c55b0 msgr2=0x7f51740c3180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:33.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.283+0000 7f517a7ff700 1 -- 172.21.15.72:0/3245169753 shutdown_connections 2023-07-27T20:34:33.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.283+0000 7f517a7ff700 1 -- 172.21.15.72:0/3245169753 wait complete. 2023-07-27T20:34:33.275 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' created 2023-07-27T20:34:33.301 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-27T20:34:33.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.512+0000 7ff161fff700 1 Processor -- start 2023-07-27T20:34:33.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.512+0000 7ff161fff700 1 -- start start 2023-07-27T20:34:33.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.513+0000 7ff161fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff15c0c7740 0x7ff15c0c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:33.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.513+0000 7ff161fff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff15c0c4700 0x7ff15c06c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:33.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.513+0000 7ff161fff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff15c0c7c50 con 0x7ff15c14aab0 2023-07-27T20:34:33.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.513+0000 7ff161fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff15c06bd40 con 0x7ff15c0c7740 2023-07-27T20:34:33.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.513+0000 7ff161fff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff15c0c62f0 con 0x7ff15c0c4700 2023-07-27T20:34:33.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.513+0000 7ff15affd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff15c0c7740 0x7ff15c0c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:33.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.513+0000 7ff15affd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff15c0c7740 0x7ff15c0c41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52328/0 (socket says 172.21.15.72:52328) 2023-07-27T20:34:33.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.513+0000 7ff15affd700 1 -- 172.21.15.72:0/1052018395 learned_addr learned my addr 172.21.15.72:0/1052018395 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:33.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.514+0000 7ff15bfff700 1 --2- 172.21.15.72:0/1052018395 >> v2:172.21.15.173:3300/0 conn(0x7ff15c0c4700 0x7ff15c06c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:33.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.514+0000 7ff15affd700 1 -- 172.21.15.72:0/1052018395 >> v2:172.21.15.173:3300/0 conn(0x7ff15c0c4700 msgr2=0x7ff15c06c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:33.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.514+0000 7ff15affd700 1 --2- 172.21.15.72:0/1052018395 >> v2:172.21.15.173:3300/0 conn(0x7ff15c0c4700 0x7ff15c06c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:33.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.514+0000 7ff15affd700 1 -- 172.21.15.72:0/1052018395 >> v1:172.21.15.173:6789/0 conn(0x7ff15c14aab0 legacy=0x7ff15c154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:33.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.514+0000 7ff15affd700 1 -- 172.21.15.72:0/1052018395 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff15c06d200 con 0x7ff15c0c7740 2023-07-27T20:34:33.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.514+0000 7ff15affd700 1 --2- 172.21.15.72:0/1052018395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff15c0c7740 0x7ff15c0c41c0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ff15c0c96f0 tx=0x7ff150009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2673e9816dff6ead server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:33.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.514+0000 7ff15a7fc700 1 -- 172.21.15.72:0/1052018395 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff150011830 con 0x7ff15c0c7740 2023-07-27T20:34:33.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.514+0000 7ff15a7fc700 1 -- 172.21.15.72:0/1052018395 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff150011990 con 0x7ff15c0c7740 2023-07-27T20:34:33.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.514+0000 7ff15a7fc700 1 -- 172.21.15.72:0/1052018395 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff150011d20 con 0x7ff15c0c7740 2023-07-27T20:34:33.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.515+0000 7ff161fff700 1 -- 172.21.15.72:0/1052018395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff15c0c7740 msgr2=0x7ff15c0c41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:33.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.515+0000 7ff161fff700 1 --2- 172.21.15.72:0/1052018395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff15c0c7740 0x7ff15c0c41c0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ff15c0c96f0 tx=0x7ff150009bd0 comp rx=0 tx=0).stop 2023-07-27T20:34:33.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.515+0000 7ff161fff700 1 -- 172.21.15.72:0/1052018395 shutdown_connections 2023-07-27T20:34:33.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.515+0000 7ff161fff700 1 --2- 172.21.15.72:0/1052018395 >> v2:172.21.15.173:3300/0 conn(0x7ff15c0c4700 0x7ff15c06c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:33.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.515+0000 7ff161fff700 1 --2- 172.21.15.72:0/1052018395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff15c0c7740 0x7ff15c0c41c0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:33.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.515+0000 7ff161fff700 1 -- 172.21.15.72:0/1052018395 >> 172.21.15.72:0/1052018395 conn(0x7ff15c0ab3f0 msgr2=0x7ff15c0ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:33.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.515+0000 7ff161fff700 1 -- 172.21.15.72:0/1052018395 shutdown_connections 2023-07-27T20:34:33.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.515+0000 7ff161fff700 1 -- 172.21.15.72:0/1052018395 wait complete. 2023-07-27T20:34:33.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.517+0000 7ff161fff700 1 Processor -- start 2023-07-27T20:34:33.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.517+0000 7ff161fff700 1 -- start start 2023-07-27T20:34:33.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.518+0000 7ff161fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff15c0c4700 0x7ff15c1489d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:33.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.518+0000 7ff161fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff15c0c7740 0x7ff15c0acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:33.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.518+0000 7ff161fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff15c14aab0 0x7ff15c0bea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:33.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.518+0000 7ff161fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15c0be450 con 0x7ff15c14aab0 2023-07-27T20:34:33.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.518+0000 7ff161fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15c156a60 con 0x7ff15c0c4700 2023-07-27T20:34:33.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.518+0000 7ff161fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff15c156d40 con 0x7ff15c0c7740 2023-07-27T20:34:33.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.518+0000 7ff15bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff15c14aab0 0x7ff15c0bea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:33.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.518+0000 7ff15b7fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff15c0c4700 0x7ff15c1489d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:33.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.518+0000 7ff15b7fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff15c0c4700 0x7ff15c1489d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.72:41384/0 (socket says 172.21.15.72:41384) 2023-07-27T20:34:33.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.518+0000 7ff15b7fe700 1 -- 172.21.15.72:0/90754313 learned_addr learned my addr 172.21.15.72:0/90754313 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:33.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.518+0000 7ff15bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff15c14aab0 0x7ff15c0bea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52340/0 (socket says 172.21.15.72:52340) 2023-07-27T20:34:33.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.518+0000 7ff15affd700 1 --2- 172.21.15.72:0/90754313 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff15c0c7740 0x7ff15c0acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:33.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.518+0000 7ff15b7fe700 1 -- 172.21.15.72:0/90754313 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff15c0c7740 msgr2=0x7ff15c0acb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:33.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.518+0000 7ff15b7fe700 1 --2- 172.21.15.72:0/90754313 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff15c0c7740 0x7ff15c0acb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:33.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.519+0000 7ff15b7fe700 1 -- 172.21.15.72:0/90754313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff15c14aab0 msgr2=0x7ff15c0bea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:33.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.519+0000 7ff15b7fe700 1 --2- 172.21.15.72:0/90754313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff15c14aab0 0x7ff15c0bea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:33.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.519+0000 7ff15b7fe700 1 -- 172.21.15.72:0/90754313 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff150009550 con 0x7ff15c0c4700 2023-07-27T20:34:33.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.519+0000 7ff15bfff700 1 --2- 172.21.15.72:0/90754313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff15c14aab0 0x7ff15c0bea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:34:33.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.519+0000 7ff15b7fe700 1 --2- 172.21.15.72:0/90754313 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff15c0c4700 0x7ff15c1489d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff14c00c450 tx=0x7ff14c00c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:33.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.519+0000 7ff143fff700 1 -- 172.21.15.72:0/90754313 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c0052d0 con 0x7ff15c0c4700 2023-07-27T20:34:33.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.519+0000 7ff143fff700 1 -- 172.21.15.72:0/90754313 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14c005430 con 0x7ff15c0c4700 2023-07-27T20:34:33.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.519+0000 7ff161fff700 1 -- 172.21.15.72:0/90754313 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff15c157020 con 0x7ff15c0c4700 2023-07-27T20:34:33.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.519+0000 7ff143fff700 1 -- 172.21.15.72:0/90754313 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c0038c0 con 0x7ff15c0c4700 2023-07-27T20:34:33.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.519+0000 7ff161fff700 1 -- 172.21.15.72:0/90754313 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff15c1575e0 con 0x7ff15c0c4700 2023-07-27T20:34:33.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.520+0000 7ff161fff700 1 -- 172.21.15.72:0/90754313 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff15c0be890 con 0x7ff15c0c4700 2023-07-27T20:34:33.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.521+0000 7ff143fff700 1 -- 172.21.15.72:0/90754313 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff14c003a20 con 0x7ff15c0c4700 2023-07-27T20:34:33.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.522+0000 7ff143fff700 1 --2- 172.21.15.72:0/90754313 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff14806ace0 0x7ff14806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:33.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.522+0000 7ff143fff700 1 -- 172.21.15.72:0/90754313 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6282+0+0 (secure 0 0 0) 0x7ff14c088b20 con 0x7ff15c0c4700 2023-07-27T20:34:33.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.523+0000 7ff15affd700 1 --2- 172.21.15.72:0/90754313 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff14806ace0 0x7ff14806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:33.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.523+0000 7ff15affd700 1 --2- 172.21.15.72:0/90754313 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff14806ace0 0x7ff14806d1a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff150009c10 tx=0x7ff150008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:33.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.527+0000 7ff143fff700 1 -- 172.21.15.72:0/90754313 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff14c053b60 con 0x7ff15c0c4700 2023-07-27T20:34:33.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:33.763+0000 7ff161fff700 1 -- 172.21.15.72:0/90754313 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff15c1577a0 con 0x7ff15c0c4700 2023-07-27T20:34:34.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.284+0000 7ff143fff700 1 -- 172.21.15.72:0/90754313 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v29) v1 ==== 174+0+0 (secure 0 0 0) 0x7ff14c00ce60 con 0x7ff15c0c4700 2023-07-27T20:34:34.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.292+0000 7ff161fff700 1 -- 172.21.15.72:0/90754313 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff14806ace0 msgr2=0x7ff14806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:34.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.292+0000 7ff161fff700 1 --2- 172.21.15.72:0/90754313 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff14806ace0 0x7ff14806d1a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff150009c10 tx=0x7ff150008030 comp rx=0 tx=0).stop 2023-07-27T20:34:34.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.292+0000 7ff161fff700 1 -- 172.21.15.72:0/90754313 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff15c0c4700 msgr2=0x7ff15c1489d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:34.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.292+0000 7ff161fff700 1 --2- 172.21.15.72:0/90754313 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff15c0c4700 0x7ff15c1489d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff14c00c450 tx=0x7ff14c00c760 comp rx=0 tx=0).stop 2023-07-27T20:34:34.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.297+0000 7ff161fff700 1 -- 172.21.15.72:0/90754313 shutdown_connections 2023-07-27T20:34:34.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.297+0000 7ff161fff700 1 --2- 172.21.15.72:0/90754313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff15c14aab0 0x7ff15c0bea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:34.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.297+0000 7ff161fff700 1 --2- 172.21.15.72:0/90754313 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff15c0c4700 0x7ff15c1489d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:34.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.297+0000 7ff161fff700 1 --2- 172.21.15.72:0/90754313 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff14806ace0 0x7ff14806d1a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:34.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.297+0000 7ff161fff700 1 --2- 172.21.15.72:0/90754313 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff15c0c7740 0x7ff15c0acb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:34.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.297+0000 7ff161fff700 1 -- 172.21.15.72:0/90754313 >> 172.21.15.72:0/90754313 conn(0x7ff15c0ab3f0 msgr2=0x7ff15c153d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:34.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.299+0000 7ff161fff700 1 -- 172.21.15.72:0/90754313 shutdown_connections 2023-07-27T20:34:34.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.300+0000 7ff161fff700 1 -- 172.21.15.72:0/90754313 wait complete. 2023-07-27T20:34:34.293 INFO:teuthology.orchestra.run.smithi072.stderr:new fs with metadata pool 10 and data pool 11 2023-07-27T20:34:34.317 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:34:34.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.524+0000 7f33ae9ff700 1 Processor -- start 2023-07-27T20:34:34.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.524+0000 7f33ae9ff700 1 -- start start 2023-07-27T20:34:34.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.525+0000 7f33ae9ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f33a80a9190 0x7f33a80c39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:34.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.525+0000 7f33ae9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f33a80c1fb0 0x7f33a80a9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:34.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.525+0000 7f33ae9ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33a8154ba0 con 0x7f33a81576c0 2023-07-27T20:34:34.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.525+0000 7f33ae9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33a80c2ea0 con 0x7f33a80c1fb0 2023-07-27T20:34:34.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.525+0000 7f33ae9ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33a8154e80 con 0x7f33a80a9190 2023-07-27T20:34:34.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.525+0000 7f33a77fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f33a80c1fb0 0x7f33a80a9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:34.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.525+0000 7f33a77fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f33a80c1fb0 0x7f33a80a9570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52344/0 (socket says 172.21.15.72:52344) 2023-07-27T20:34:34.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.525+0000 7f33a77fe700 1 -- 172.21.15.72:0/1745209229 learned_addr learned my addr 172.21.15.72:0/1745209229 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:34.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.526+0000 7f33a7fff700 1 --2- 172.21.15.72:0/1745209229 >> v2:172.21.15.173:3300/0 conn(0x7f33a80a9190 0x7f33a80c39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:34.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.526+0000 7f33a77fe700 1 -- 172.21.15.72:0/1745209229 >> v2:172.21.15.173:3300/0 conn(0x7f33a80a9190 msgr2=0x7f33a80c39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:34.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.526+0000 7f33a77fe700 1 --2- 172.21.15.72:0/1745209229 >> v2:172.21.15.173:3300/0 conn(0x7f33a80a9190 0x7f33a80c39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:34.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.526+0000 7f33a77fe700 1 -- 172.21.15.72:0/1745209229 >> v1:172.21.15.173:6789/0 conn(0x7f33a81576c0 legacy=0x7f33a8157b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:34.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.526+0000 7f33a77fe700 1 -- 172.21.15.72:0/1745209229 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a80706f0 con 0x7f33a80c1fb0 2023-07-27T20:34:34.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.526+0000 7f33a77fe700 1 --2- 172.21.15.72:0/1745209229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33a80c1fb0 0x7f33a80a9570 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f33a80c7ff0 tx=0x7f339c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64009760b5a3d237 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:34.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.526+0000 7f33a6ffd700 1 -- 172.21.15.72:0/1745209229 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339c011830 con 0x7f33a80c1fb0 2023-07-27T20:34:34.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.526+0000 7f33a6ffd700 1 -- 172.21.15.72:0/1745209229 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f339c011990 con 0x7f33a80c1fb0 2023-07-27T20:34:34.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.526+0000 7f33a6ffd700 1 -- 172.21.15.72:0/1745209229 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339c011d20 con 0x7f33a80c1fb0 2023-07-27T20:34:34.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.527+0000 7f33ae9ff700 1 -- 172.21.15.72:0/1745209229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33a80c1fb0 msgr2=0x7f33a80a9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:34.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.527+0000 7f33ae9ff700 1 --2- 172.21.15.72:0/1745209229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33a80c1fb0 0x7f33a80a9570 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f33a80c7ff0 tx=0x7f339c009bd0 comp rx=0 tx=0).stop 2023-07-27T20:34:34.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.527+0000 7f33ae9ff700 1 -- 172.21.15.72:0/1745209229 shutdown_connections 2023-07-27T20:34:34.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.527+0000 7f33ae9ff700 1 --2- 172.21.15.72:0/1745209229 >> v2:172.21.15.173:3300/0 conn(0x7f33a80a9190 0x7f33a80c39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:34.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.527+0000 7f33ae9ff700 1 --2- 172.21.15.72:0/1745209229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33a80c1fb0 0x7f33a80a9570 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:34.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.527+0000 7f33ae9ff700 1 -- 172.21.15.72:0/1745209229 >> 172.21.15.72:0/1745209229 conn(0x7f33a806a7c0 msgr2=0x7f33a80c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:34.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.527+0000 7f33ae9ff700 1 -- 172.21.15.72:0/1745209229 shutdown_connections 2023-07-27T20:34:34.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.527+0000 7f33ae9ff700 1 -- 172.21.15.72:0/1745209229 wait complete. 2023-07-27T20:34:34.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.529+0000 7f33ae9ff700 1 Processor -- start 2023-07-27T20:34:34.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.529+0000 7f33ae9ff700 1 -- start start 2023-07-27T20:34:34.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.530+0000 7f33ae9ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33a80a9190 0x7f33a80c11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:34.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.530+0000 7f33ae9ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f33a81576c0 0x7f33a81ed0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:34.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.530+0000 7f33ae9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33a81e0ca0 0x7f33a814d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:34.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.530+0000 7f33ae9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a81e1a30 con 0x7f33a81e0ca0 2023-07-27T20:34:34.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.530+0000 7f33ae9ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a80c16e0 con 0x7f33a80a9190 2023-07-27T20:34:34.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.530+0000 7f33ae9ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a81ed600 con 0x7f33a81576c0 2023-07-27T20:34:34.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.530+0000 7f33acf9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33a81e0ca0 0x7f33a814d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:34.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.530+0000 7f33acf9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33a81e0ca0 0x7f33a814d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52360/0 (socket says 172.21.15.72:52360) 2023-07-27T20:34:34.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.530+0000 7f33acf9c700 1 -- 172.21.15.72:0/2620439662 learned_addr learned my addr 172.21.15.72:0/2620439662 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:34.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.530+0000 7f33a7fff700 1 --2- 172.21.15.72:0/2620439662 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33a80a9190 0x7f33a80c11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:34.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.530+0000 7f33a77fe700 1 --2- 172.21.15.72:0/2620439662 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f33a81576c0 0x7f33a81ed0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:34.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.530+0000 7f33acf9c700 1 -- 172.21.15.72:0/2620439662 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f33a81576c0 msgr2=0x7f33a81ed0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:34.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.530+0000 7f33acf9c700 1 --2- 172.21.15.72:0/2620439662 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f33a81576c0 0x7f33a81ed0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:34.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.530+0000 7f33acf9c700 1 -- 172.21.15.72:0/2620439662 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33a80a9190 msgr2=0x7f33a80c11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:34.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.530+0000 7f33acf9c700 1 --2- 172.21.15.72:0/2620439662 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33a80a9190 0x7f33a80c11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:34.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.530+0000 7f33acf9c700 1 -- 172.21.15.72:0/2620439662 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f339c009550 con 0x7f33a81e0ca0 2023-07-27T20:34:34.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.531+0000 7f33acf9c700 1 --2- 172.21.15.72:0/2620439662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33a81e0ca0 0x7f33a814d4c0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f33a000cb50 tx=0x7f33a000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:34.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.531+0000 7f33a4ff9700 1 -- 172.21.15.72:0/2620439662 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a0003c00 con 0x7f33a81e0ca0 2023-07-27T20:34:34.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.531+0000 7f33a4ff9700 1 -- 172.21.15.72:0/2620439662 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a0003d60 con 0x7f33a81e0ca0 2023-07-27T20:34:34.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.531+0000 7f33ae9ff700 1 -- 172.21.15.72:0/2620439662 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33a80bef90 con 0x7f33a81e0ca0 2023-07-27T20:34:34.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.531+0000 7f33a4ff9700 1 -- 172.21.15.72:0/2620439662 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a000aa20 con 0x7f33a81e0ca0 2023-07-27T20:34:34.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.531+0000 7f33ae9ff700 1 -- 172.21.15.72:0/2620439662 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a80bf550 con 0x7f33a81e0ca0 2023-07-27T20:34:34.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.532+0000 7f33ae9ff700 1 -- 172.21.15.72:0/2620439662 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33a80bf710 con 0x7f33a81e0ca0 2023-07-27T20:34:34.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.534+0000 7f33a4ff9700 1 -- 172.21.15.72:0/2620439662 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f33a000ab80 con 0x7f33a81e0ca0 2023-07-27T20:34:34.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.535+0000 7f33a4ff9700 1 --2- 172.21.15.72:0/2620439662 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f339406ace0 0x7f339406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:34.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.535+0000 7f33a4ff9700 1 -- 172.21.15.72:0/2620439662 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f33a0089ff0 con 0x7f33a81e0ca0 2023-07-27T20:34:34.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.536+0000 7f33a7fff700 1 --2- 172.21.15.72:0/2620439662 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f339406ace0 0x7f339406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:34.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.536+0000 7f33a7fff700 1 --2- 172.21.15.72:0/2620439662 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f339406ace0 0x7f339406d1a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f33a8157600 tx=0x7f3398009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:34.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.539+0000 7f33a4ff9700 1 -- 172.21.15.72:0/2620439662 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f33a0058ac0 con 0x7f33a81e0ca0 2023-07-27T20:34:34.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.737+0000 7f33ae9ff700 1 -- 172.21.15.72:0/2620439662 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33a8074310 con 0x7f33a81e0ca0 2023-07-27T20:34:34.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.738+0000 7f33a4ff9700 1 -- 172.21.15.72:0/2620439662 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+18568 (secure 0 0 0) 0x7f33a0058650 con 0x7f33a81e0ca0 2023-07-27T20:34:34.727 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:34:34.727 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":61,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:34:33.766299+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:34:31.480063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-07-27T20:34:32.755579+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:34:34.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.741+0000 7f33ae9ff700 1 -- 172.21.15.72:0/2620439662 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f339406ace0 msgr2=0x7f339406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:34.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.741+0000 7f33ae9ff700 1 --2- 172.21.15.72:0/2620439662 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f339406ace0 0x7f339406d1a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f33a8157600 tx=0x7f3398009210 comp rx=0 tx=0).stop 2023-07-27T20:34:34.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.741+0000 7f33ae9ff700 1 -- 172.21.15.72:0/2620439662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33a81e0ca0 msgr2=0x7f33a814d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:34.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.741+0000 7f33ae9ff700 1 --2- 172.21.15.72:0/2620439662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33a81e0ca0 0x7f33a814d4c0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f33a000cb50 tx=0x7f33a000ce60 comp rx=0 tx=0).stop 2023-07-27T20:34:34.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.741+0000 7f33ae9ff700 1 -- 172.21.15.72:0/2620439662 shutdown_connections 2023-07-27T20:34:34.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.741+0000 7f33ae9ff700 1 --2- 172.21.15.72:0/2620439662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33a81e0ca0 0x7f33a814d4c0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:34.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.741+0000 7f33ae9ff700 1 --2- 172.21.15.72:0/2620439662 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33a80a9190 0x7f33a80c11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:34.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.741+0000 7f33ae9ff700 1 --2- 172.21.15.72:0/2620439662 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f339406ace0 0x7f339406d1a0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:34.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.741+0000 7f33ae9ff700 1 --2- 172.21.15.72:0/2620439662 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f33a81576c0 0x7f33a81ed0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:34.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.741+0000 7f33ae9ff700 1 -- 172.21.15.72:0/2620439662 >> 172.21.15.72:0/2620439662 conn(0x7f33a806a7c0 msgr2=0x7f33a8157b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:34.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.741+0000 7f33ae9ff700 1 -- 172.21.15.72:0/2620439662 shutdown_connections 2023-07-27T20:34:34.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.741+0000 7f33ae9ff700 1 -- 172.21.15.72:0/2620439662 wait complete. 2023-07-27T20:34:34.748 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:34:34.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.955+0000 7f908a3ff700 1 Processor -- start 2023-07-27T20:34:34.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.955+0000 7f908a3ff700 1 -- start start 2023-07-27T20:34:34.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.956+0000 7f908a3ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f908413b2c0 0x7f90840aa420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:34.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.956+0000 7f908a3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9084155600 con 0x7f90840bfd90 2023-07-27T20:34:34.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.956+0000 7f908a3ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9084155320 con 0x7f90840a83a0 2023-07-27T20:34:34.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.956+0000 7f908a3ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90840a9620 con 0x7f908413b2c0 2023-07-27T20:34:34.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.956+0000 7f90837fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f90840bfd90 0x7f90840aa960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60608/0 (socket says 172.21.15.72:60608) 2023-07-27T20:34:34.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.956+0000 7f90837fe700 1 -- 172.21.15.72:0/2135683128 learned_addr learned my addr 172.21.15.72:0/2135683128 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:34.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.957+0000 7f9082ffd700 1 -- 172.21.15.72:0/2135683128 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3352471110 0 0) 0x7f9084155600 con 0x7f90840bfd90 2023-07-27T20:34:34.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.957+0000 7f9082ffd700 1 -- 172.21.15.72:0/2135683128 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f906c0035b0 con 0x7f90840bfd90 2023-07-27T20:34:34.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.957+0000 7f9083fff700 1 --2- 172.21.15.72:0/2135683128 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f908413b2c0 0x7f90840aa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:34.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.957+0000 7f9082ffd700 1 -- 172.21.15.72:0/2135683128 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3513871767 0 0) 0x7f906c0035b0 con 0x7f90840bfd90 2023-07-27T20:34:34.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.957+0000 7f9082ffd700 1 -- 172.21.15.72:0/2135683128 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f908413b2c0 msgr2=0x7f90840aa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:34.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.957+0000 7f9082ffd700 1 --2- 172.21.15.72:0/2135683128 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f908413b2c0 0x7f90840aa420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:34.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.957+0000 7f9082ffd700 1 -- 172.21.15.72:0/2135683128 >> v1:172.21.15.173:6789/0 conn(0x7f90840a83a0 legacy=0x7f90840a8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:34.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.957+0000 7f9082ffd700 1 -- 172.21.15.72:0/2135683128 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9084151e40 con 0x7f90840bfd90 2023-07-27T20:34:34.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.957+0000 7f9082ffd700 1 -- 172.21.15.72:0/2135683128 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f9078001670 con 0x7f90840bfd90 2023-07-27T20:34:34.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.957+0000 7f9082ffd700 1 -- 172.21.15.72:0/2135683128 >> v1:172.21.15.72:6789/0 conn(0x7f90840bfd90 legacy=0x7f90840aa960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:34.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.957+0000 7f9082ffd700 1 --2- 172.21.15.72:0/2135683128 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f906c003a30 0x7f906c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:34.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.957+0000 7f9082ffd700 1 --2- 172.21.15.72:0/2135683128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f906c004850 0x7f906c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:34.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.957+0000 7f9082ffd700 1 --2- 172.21.15.72:0/2135683128 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f908413b2c0 0x7f906c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:34.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.957+0000 7f9082ffd700 1 -- 172.21.15.72:0/2135683128 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90840a9620 con 0x7f906c004850 2023-07-27T20:34:34.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.957+0000 7f9082ffd700 1 -- 172.21.15.72:0/2135683128 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906c00bac0 con 0x7f906c003a30 2023-07-27T20:34:34.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.957+0000 7f9082ffd700 1 -- 172.21.15.72:0/2135683128 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f906c00bc80 con 0x7f908413b2c0 2023-07-27T20:34:34.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.957+0000 7f90837fe700 1 --2- 172.21.15.72:0/2135683128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f906c004850 0x7f906c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:34.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.958+0000 7f9083fff700 1 --2- 172.21.15.72:0/2135683128 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f906c003a30 0x7f906c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:34.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.958+0000 7f908899c700 1 --2- 172.21.15.72:0/2135683128 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f908413b2c0 0x7f906c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:34.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.958+0000 7f90837fe700 1 -- 172.21.15.72:0/2135683128 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f908413b2c0 msgr2=0x7f906c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:34.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.958+0000 7f90837fe700 1 --2- 172.21.15.72:0/2135683128 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f908413b2c0 0x7f906c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:34.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.958+0000 7f90837fe700 1 -- 172.21.15.72:0/2135683128 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f906c003a30 msgr2=0x7f906c003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:34.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.958+0000 7f90837fe700 1 --2- 172.21.15.72:0/2135683128 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f906c003a30 0x7f906c003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:34.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.958+0000 7f90837fe700 1 -- 172.21.15.72:0/2135683128 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f906c0035b0 con 0x7f906c004850 2023-07-27T20:34:34.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.958+0000 7f90837fe700 1 --2- 172.21.15.72:0/2135683128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f906c004850 0x7f906c004cd0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f9078001eb0 tx=0x7f906c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8aeb6fbaa26516a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:34.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.958+0000 7f9082ffd700 1 -- 172.21.15.72:0/2135683128 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907800cd50 con 0x7f906c004850 2023-07-27T20:34:34.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.958+0000 7f9082ffd700 1 -- 172.21.15.72:0/2135683128 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9078005960 con 0x7f906c004850 2023-07-27T20:34:34.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.958+0000 7f9082ffd700 1 -- 172.21.15.72:0/2135683128 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9078005d10 con 0x7f906c004850 2023-07-27T20:34:34.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.959+0000 7f908a3ff700 1 -- 172.21.15.72:0/2135683128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f906c004850 msgr2=0x7f906c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:34.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.959+0000 7f908a3ff700 1 --2- 172.21.15.72:0/2135683128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f906c004850 0x7f906c004cd0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f9078001eb0 tx=0x7f906c005880 comp rx=0 tx=0).stop 2023-07-27T20:34:34.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.959+0000 7f908899c700 1 -- 172.21.15.72:0/2135683128 reap_dead start 2023-07-27T20:34:34.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.959+0000 7f908a3ff700 1 -- 172.21.15.72:0/2135683128 shutdown_connections 2023-07-27T20:34:34.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.959+0000 7f908a3ff700 1 -- 172.21.15.72:0/2135683128 >> 172.21.15.72:0/2135683128 conn(0x7f908406a190 msgr2=0x7f908406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:34.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.959+0000 7f908a3ff700 1 -- 172.21.15.72:0/2135683128 shutdown_connections 2023-07-27T20:34:34.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.959+0000 7f908a3ff700 1 -- 172.21.15.72:0/2135683128 wait complete. 2023-07-27T20:34:34.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.961+0000 7f908a3ff700 1 Processor -- start 2023-07-27T20:34:34.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.961+0000 7f908a3ff700 1 -- start start 2023-07-27T20:34:34.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.962+0000 7f908a3ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f906c004850 0x7f9084133c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:34.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.962+0000 7f908a3ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9084131e70 0x7f90840c1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:34.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.962+0000 7f908a3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90840c4e60 0x7f90840c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:34.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.962+0000 7f908a3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9084135570 con 0x7f90840c4e60 2023-07-27T20:34:34.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.962+0000 7f908a3ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9084134140 con 0x7f906c004850 2023-07-27T20:34:34.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.962+0000 7f908a3ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9084151660 con 0x7f9084131e70 2023-07-27T20:34:34.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.962+0000 7f908899c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90840c4e60 0x7f90840c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:34.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.962+0000 7f908899c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90840c4e60 0x7f90840c52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52384/0 (socket says 172.21.15.72:52384) 2023-07-27T20:34:34.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.962+0000 7f908899c700 1 -- 172.21.15.72:0/3805599639 learned_addr learned my addr 172.21.15.72:0/3805599639 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:34.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.962+0000 7f9083fff700 1 --2- 172.21.15.72:0/3805599639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f906c004850 0x7f9084133c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:34.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.962+0000 7f90837fe700 1 --2- 172.21.15.72:0/3805599639 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9084131e70 0x7f90840c1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:34.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.962+0000 7f908899c700 1 -- 172.21.15.72:0/3805599639 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9084131e70 msgr2=0x7f90840c1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:34.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.962+0000 7f908899c700 1 --2- 172.21.15.72:0/3805599639 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9084131e70 0x7f90840c1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:34.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.962+0000 7f908899c700 1 -- 172.21.15.72:0/3805599639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f906c004850 msgr2=0x7f9084133c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:34.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.962+0000 7f908899c700 1 --2- 172.21.15.72:0/3805599639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f906c004850 0x7f9084133c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:34.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.962+0000 7f908899c700 1 -- 172.21.15.72:0/3805599639 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9084134960 con 0x7f90840c4e60 2023-07-27T20:34:34.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.962+0000 7f9083fff700 1 --2- 172.21.15.72:0/3805599639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f906c004850 0x7f9084133c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:34.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.963+0000 7f908899c700 1 --2- 172.21.15.72:0/3805599639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90840c4e60 0x7f90840c52e0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f90840c64a0 tx=0x7f907c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:34.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.963+0000 7f9080ff9700 1 -- 172.21.15.72:0/3805599639 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c003c10 con 0x7f90840c4e60 2023-07-27T20:34:34.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.963+0000 7f9080ff9700 1 -- 172.21.15.72:0/3805599639 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907c003d70 con 0x7f90840c4e60 2023-07-27T20:34:34.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.963+0000 7f908a3ff700 1 -- 172.21.15.72:0/3805599639 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9084134c40 con 0x7f90840c4e60 2023-07-27T20:34:34.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.963+0000 7f9080ff9700 1 -- 172.21.15.72:0/3805599639 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c005310 con 0x7f90840c4e60 2023-07-27T20:34:34.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.963+0000 7f908a3ff700 1 -- 172.21.15.72:0/3805599639 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9084135200 con 0x7f90840c4e60 2023-07-27T20:34:34.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.964+0000 7f908a3ff700 1 -- 172.21.15.72:0/3805599639 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9084135390 con 0x7f90840c4e60 2023-07-27T20:34:34.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.965+0000 7f9080ff9700 1 -- 172.21.15.72:0/3805599639 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f907c005470 con 0x7f90840c4e60 2023-07-27T20:34:34.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.966+0000 7f9080ff9700 1 --2- 172.21.15.72:0/3805599639 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f907006ace0 0x7f907006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:34.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.966+0000 7f9080ff9700 1 -- 172.21.15.72:0/3805599639 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f907c0896d0 con 0x7f90840c4e60 2023-07-27T20:34:34.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.966+0000 7f9083fff700 1 --2- 172.21.15.72:0/3805599639 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f907006ace0 0x7f907006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:34.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.967+0000 7f9083fff700 1 --2- 172.21.15.72:0/3805599639 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f907006ace0 0x7f907006d1a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9074009c60 tx=0x7f9074008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:34.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:34.970+0000 7f9080ff9700 1 -- 172.21.15.72:0/3805599639 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f907c054630 con 0x7f90840c4e60 2023-07-27T20:34:35.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.165+0000 7f908a3ff700 1 -- 172.21.15.72:0/3805599639 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9084074310 con 0x7f90840c4e60 2023-07-27T20:34:35.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.166+0000 7f9080ff9700 1 -- 172.21.15.72:0/3805599639 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+18568 (secure 0 0 0) 0x7f907c057c50 con 0x7f90840c4e60 2023-07-27T20:34:35.156 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:34:35.156 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":61,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:34:33.766299+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:34:31.480063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-07-27T20:34:32.755579+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:34:35.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.169+0000 7f908a3ff700 1 -- 172.21.15.72:0/3805599639 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f907006ace0 msgr2=0x7f907006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:35.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.169+0000 7f908a3ff700 1 --2- 172.21.15.72:0/3805599639 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f907006ace0 0x7f907006d1a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9074009c60 tx=0x7f9074008040 comp rx=0 tx=0).stop 2023-07-27T20:34:35.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.169+0000 7f908a3ff700 1 -- 172.21.15.72:0/3805599639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90840c4e60 msgr2=0x7f90840c52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:35.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.169+0000 7f908a3ff700 1 --2- 172.21.15.72:0/3805599639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90840c4e60 0x7f90840c52e0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f90840c64a0 tx=0x7f907c00ee80 comp rx=0 tx=0).stop 2023-07-27T20:34:35.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.169+0000 7f908a3ff700 1 -- 172.21.15.72:0/3805599639 shutdown_connections 2023-07-27T20:34:35.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.169+0000 7f908a3ff700 1 --2- 172.21.15.72:0/3805599639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90840c4e60 0x7f90840c52e0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:35.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.169+0000 7f908a3ff700 1 --2- 172.21.15.72:0/3805599639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f906c004850 0x7f9084133c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:35.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.169+0000 7f908a3ff700 1 --2- 172.21.15.72:0/3805599639 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f907006ace0 0x7f907006d1a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:35.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.169+0000 7f908a3ff700 1 --2- 172.21.15.72:0/3805599639 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9084131e70 0x7f90840c1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:35.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.169+0000 7f908a3ff700 1 -- 172.21.15.72:0/3805599639 >> 172.21.15.72:0/3805599639 conn(0x7f908406a190 msgr2=0x7f90840aa370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:35.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.169+0000 7f908a3ff700 1 -- 172.21.15.72:0/3805599639 shutdown_connections 2023-07-27T20:34:35.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.169+0000 7f908a3ff700 1 -- 172.21.15.72:0/3805599639 wait complete. 2023-07-27T20:34:35.176 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-27T20:34:35.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.391+0000 7f19823ff700 1 Processor -- start 2023-07-27T20:34:35.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.391+0000 7f19823ff700 1 -- start start 2023-07-27T20:34:35.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.392+0000 7f19823ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f197c071190 0x7f197c158100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:35.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.393+0000 7f19823ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f197c0a8aa0 0x7f197c06b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:35.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.393+0000 7f19823ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f197c0a8ec0 con 0x7f197c0a86c0 2023-07-27T20:34:35.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.393+0000 7f19823ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f197c0c3e30 con 0x7f197c071190 2023-07-27T20:34:35.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.393+0000 7f19823ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f197c0c2ca0 con 0x7f197c0a8aa0 2023-07-27T20:34:35.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.393+0000 7f1973fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f197c071190 0x7f197c158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:35.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.393+0000 7f1973fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f197c071190 0x7f197c158100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52386/0 (socket says 172.21.15.72:52386) 2023-07-27T20:34:35.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.393+0000 7f1973fff700 1 -- 172.21.15.72:0/3485679284 learned_addr learned my addr 172.21.15.72:0/3485679284 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:35.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.393+0000 7f198099c700 1 --2- 172.21.15.72:0/3485679284 >> v2:172.21.15.173:3300/0 conn(0x7f197c0a8aa0 0x7f197c06b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:35.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.393+0000 7f1973fff700 1 -- 172.21.15.72:0/3485679284 >> v2:172.21.15.173:3300/0 conn(0x7f197c0a8aa0 msgr2=0x7f197c06b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:35.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.393+0000 7f1973fff700 1 --2- 172.21.15.72:0/3485679284 >> v2:172.21.15.173:3300/0 conn(0x7f197c0a8aa0 0x7f197c06b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:35.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.393+0000 7f1973fff700 1 -- 172.21.15.72:0/3485679284 >> v1:172.21.15.173:6789/0 conn(0x7f197c0a86c0 legacy=0x7f197c154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:35.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.393+0000 7f1973fff700 1 -- 172.21.15.72:0/3485679284 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f197c071700 con 0x7f197c071190 2023-07-27T20:34:35.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.394+0000 7f1973fff700 1 --2- 172.21.15.72:0/3485679284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f197c071190 0x7f197c158100 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f197c071ed0 tx=0x7f1964009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8280534f63f0e88 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:35.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.394+0000 7f197b7fe700 1 -- 172.21.15.72:0/3485679284 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1964011830 con 0x7f197c071190 2023-07-27T20:34:35.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.394+0000 7f197b7fe700 1 -- 172.21.15.72:0/3485679284 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1964011990 con 0x7f197c071190 2023-07-27T20:34:35.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.394+0000 7f197b7fe700 1 -- 172.21.15.72:0/3485679284 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1964011d20 con 0x7f197c071190 2023-07-27T20:34:35.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.394+0000 7f19823ff700 1 -- 172.21.15.72:0/3485679284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f197c071190 msgr2=0x7f197c158100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:35.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.394+0000 7f19823ff700 1 --2- 172.21.15.72:0/3485679284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f197c071190 0x7f197c158100 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f197c071ed0 tx=0x7f1964009bd0 comp rx=0 tx=0).stop 2023-07-27T20:34:35.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.394+0000 7f19823ff700 1 -- 172.21.15.72:0/3485679284 shutdown_connections 2023-07-27T20:34:35.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.394+0000 7f19823ff700 1 --2- 172.21.15.72:0/3485679284 >> v2:172.21.15.173:3300/0 conn(0x7f197c0a8aa0 0x7f197c06b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:35.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.394+0000 7f19823ff700 1 --2- 172.21.15.72:0/3485679284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f197c071190 0x7f197c158100 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:35.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.394+0000 7f19823ff700 1 -- 172.21.15.72:0/3485679284 >> 172.21.15.72:0/3485679284 conn(0x7f197c0c2fd0 msgr2=0x7f197c0c33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:35.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.395+0000 7f19823ff700 1 -- 172.21.15.72:0/3485679284 shutdown_connections 2023-07-27T20:34:35.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.395+0000 7f19823ff700 1 -- 172.21.15.72:0/3485679284 wait complete. 2023-07-27T20:34:35.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.396+0000 7f19823ff700 1 Processor -- start 2023-07-27T20:34:35.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.397+0000 7f19823ff700 1 -- start start 2023-07-27T20:34:35.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.398+0000 7f19823ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f197c071190 0x7f197c0c1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:35.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.398+0000 7f19823ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f197c0a86c0 0x7f197c156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:35.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.398+0000 7f19823ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f197c0a8aa0 0x7f197c156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:35.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.398+0000 7f19823ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197c1ed790 con 0x7f197c0a86c0 2023-07-27T20:34:35.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.398+0000 7f19823ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197c1574e0 con 0x7f197c0a8aa0 2023-07-27T20:34:35.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.398+0000 7f19823ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f197c14cad0 con 0x7f197c071190 2023-07-27T20:34:35.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.398+0000 7f1973fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f197c0a86c0 0x7f197c156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:35.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.398+0000 7f1973fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f197c0a86c0 0x7f197c156a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52394/0 (socket says 172.21.15.72:52394) 2023-07-27T20:34:35.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.398+0000 7f1973fff700 1 -- 172.21.15.72:0/785308093 learned_addr learned my addr 172.21.15.72:0/785308093 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:35.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.398+0000 7f197bfff700 1 --2- 172.21.15.72:0/785308093 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f197c071190 0x7f197c0c1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:35.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.398+0000 7f198099c700 1 --2- 172.21.15.72:0/785308093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f197c0a8aa0 0x7f197c156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:35.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.398+0000 7f1973fff700 1 -- 172.21.15.72:0/785308093 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f197c071190 msgr2=0x7f197c0c1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:35.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.398+0000 7f1973fff700 1 --2- 172.21.15.72:0/785308093 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f197c071190 0x7f197c0c1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:35.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.398+0000 7f1973fff700 1 -- 172.21.15.72:0/785308093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f197c0a8aa0 msgr2=0x7f197c156fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:35.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.398+0000 7f1973fff700 1 --2- 172.21.15.72:0/785308093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f197c0a8aa0 0x7f197c156fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:35.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.398+0000 7f1973fff700 1 -- 172.21.15.72:0/785308093 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1964009550 con 0x7f197c0a86c0 2023-07-27T20:34:35.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.399+0000 7f1973fff700 1 --2- 172.21.15.72:0/785308093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f197c0a86c0 0x7f197c156a60 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f1964014040 tx=0x7f1964004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:35.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.399+0000 7f19797fa700 1 -- 172.21.15.72:0/785308093 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1964004510 con 0x7f197c0a86c0 2023-07-27T20:34:35.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.399+0000 7f19797fa700 1 -- 172.21.15.72:0/785308093 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196401e070 con 0x7f197c0a86c0 2023-07-27T20:34:35.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.399+0000 7f19823ff700 1 -- 172.21.15.72:0/785308093 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f197c14c1a0 con 0x7f197c0a86c0 2023-07-27T20:34:35.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.399+0000 7f19797fa700 1 -- 172.21.15.72:0/785308093 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19640038e0 con 0x7f197c0a86c0 2023-07-27T20:34:35.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.399+0000 7f19823ff700 1 -- 172.21.15.72:0/785308093 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f197c14c760 con 0x7f197c0a86c0 2023-07-27T20:34:35.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.400+0000 7f19823ff700 1 -- 172.21.15.72:0/785308093 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f197c04e470 con 0x7f197c0a86c0 2023-07-27T20:34:35.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.401+0000 7f19797fa700 1 -- 172.21.15.72:0/785308093 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1964003a40 con 0x7f197c0a86c0 2023-07-27T20:34:35.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.402+0000 7f19797fa700 1 --2- 172.21.15.72:0/785308093 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f195c06ace0 0x7f195c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:35.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.402+0000 7f19797fa700 1 -- 172.21.15.72:0/785308093 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f196408a360 con 0x7f197c0a86c0 2023-07-27T20:34:35.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.403+0000 7f197bfff700 1 --2- 172.21.15.72:0/785308093 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f195c06ace0 0x7f195c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:35.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.403+0000 7f197bfff700 1 --2- 172.21.15.72:0/785308093 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f195c06ace0 0x7f195c06d1a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f196c007fd0 tx=0x7f196c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:35.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.407+0000 7f19797fa700 1 -- 172.21.15.72:0/785308093 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f19640552c0 con 0x7f197c0a86c0 2023-07-27T20:34:35.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:35.644+0000 7f19823ff700 1 -- 172.21.15.72:0/785308093 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f197c072360 con 0x7f197c0a86c0 2023-07-27T20:34:36.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.311+0000 7f19797fa700 1 -- 172.21.15.72:0/785308093 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v32) v1 ==== 118+0+0 (secure 0 0 0) 0x7f19640588e0 con 0x7f197c0a86c0 2023-07-27T20:34:36.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.314+0000 7f19823ff700 1 -- 172.21.15.72:0/785308093 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f195c06ace0 msgr2=0x7f195c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:36.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.314+0000 7f19823ff700 1 --2- 172.21.15.72:0/785308093 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f195c06ace0 0x7f195c06d1a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f196c007fd0 tx=0x7f196c009040 comp rx=0 tx=0).stop 2023-07-27T20:34:36.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.314+0000 7f19823ff700 1 -- 172.21.15.72:0/785308093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f197c0a86c0 msgr2=0x7f197c156a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:36.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.314+0000 7f19823ff700 1 --2- 172.21.15.72:0/785308093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f197c0a86c0 0x7f197c156a60 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f1964014040 tx=0x7f1964004750 comp rx=0 tx=0).stop 2023-07-27T20:34:36.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.314+0000 7f19823ff700 1 -- 172.21.15.72:0/785308093 shutdown_connections 2023-07-27T20:34:36.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.314+0000 7f19823ff700 1 --2- 172.21.15.72:0/785308093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f197c0a8aa0 0x7f197c156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:36.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.314+0000 7f19823ff700 1 --2- 172.21.15.72:0/785308093 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f195c06ace0 0x7f195c06d1a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:36.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.314+0000 7f19823ff700 1 --2- 172.21.15.72:0/785308093 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f197c071190 0x7f197c0c1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:36.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.314+0000 7f19823ff700 1 --2- 172.21.15.72:0/785308093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f197c0a86c0 0x7f197c156a60 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:36.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.314+0000 7f19823ff700 1 -- 172.21.15.72:0/785308093 >> 172.21.15.72:0/785308093 conn(0x7f197c0c2fd0 msgr2=0x7f197c06b750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:36.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.314+0000 7f19823ff700 1 -- 172.21.15.72:0/785308093 shutdown_connections 2023-07-27T20:34:36.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.314+0000 7f19823ff700 1 -- 172.21.15.72:0/785308093 wait complete. 2023-07-27T20:34:36.322 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-27T20:34:36.322 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-27T20:34:36.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.532+0000 7f7804fff700 1 Processor -- start 2023-07-27T20:34:36.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.532+0000 7f7804fff700 1 -- start start 2023-07-27T20:34:36.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.533+0000 7f7804fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f78000c7740 0x7f78000c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:36.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.533+0000 7f7804fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78000c7c50 con 0x7f78000c4700 2023-07-27T20:34:36.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.534+0000 7f7804fff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f780006bd40 con 0x7f780014aab0 2023-07-27T20:34:36.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.534+0000 7f7804fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78000c62f0 con 0x7f78000c7740 2023-07-27T20:34:36.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.534+0000 7f77fed9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f78000c4700 0x7f780006c1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60622/0 (socket says 172.21.15.72:60622) 2023-07-27T20:34:36.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.534+0000 7f77fed9d700 1 -- 172.21.15.72:0/2674265961 learned_addr learned my addr 172.21.15.72:0/2674265961 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:36.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.534+0000 7f77f7fff700 1 --2- 172.21.15.72:0/2674265961 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f78000c7740 0x7f78000c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:36.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.534+0000 7f77fdd9b700 1 -- 172.21.15.72:0/2674265961 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 618452298 0 0) 0x7f78000c7c50 con 0x7f78000c4700 2023-07-27T20:34:36.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.534+0000 7f77fdd9b700 1 -- 172.21.15.72:0/2674265961 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77ec0035b0 con 0x7f78000c4700 2023-07-27T20:34:36.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.534+0000 7f77fdd9b700 1 -- 172.21.15.72:0/2674265961 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3987295610 0 0) 0x7f780006bd40 con 0x7f780014aab0 2023-07-27T20:34:36.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.534+0000 7f77fdd9b700 1 -- 172.21.15.72:0/2674265961 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78000c7c50 con 0x7f780014aab0 2023-07-27T20:34:36.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.534+0000 7f77fdd9b700 1 -- 172.21.15.72:0/2674265961 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2060031529 0 0) 0x7f77ec0035b0 con 0x7f78000c4700 2023-07-27T20:34:36.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.535+0000 7f77f7fff700 1 -- 172.21.15.72:0/2674265961 >> v1:172.21.15.173:6789/0 conn(0x7f780014aab0 legacy=0x7f7800154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:36.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.535+0000 7f77f7fff700 1 -- 172.21.15.72:0/2674265961 >> v1:172.21.15.72:6789/0 conn(0x7f78000c4700 legacy=0x7f780006c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:36.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.535+0000 7f77f7fff700 1 -- 172.21.15.72:0/2674265961 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780006d200 con 0x7f78000c7740 2023-07-27T20:34:36.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.535+0000 7f77f7fff700 1 --2- 172.21.15.72:0/2674265961 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f78000c7740 0x7f78000c41c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f77e8009870 tx=0x7f77e8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2c64f5067ec8776 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:36.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.535+0000 7f77fdd9b700 1 -- 172.21.15.72:0/2674265961 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f80019f0 con 0x7f78000c7740 2023-07-27T20:34:36.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.535+0000 7f77fdd9b700 1 -- 172.21.15.72:0/2674265961 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e8004030 con 0x7f78000c7740 2023-07-27T20:34:36.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.535+0000 7f77fdd9b700 1 -- 172.21.15.72:0/2674265961 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e80043c0 con 0x7f78000c7740 2023-07-27T20:34:36.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.536+0000 7f7804fff700 1 -- 172.21.15.72:0/2674265961 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f78000c7740 msgr2=0x7f78000c41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:36.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.536+0000 7f7804fff700 1 --2- 172.21.15.72:0/2674265961 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f78000c7740 0x7f78000c41c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f77e8009870 tx=0x7f77e8009b80 comp rx=0 tx=0).stop 2023-07-27T20:34:36.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.536+0000 7f7804fff700 1 -- 172.21.15.72:0/2674265961 shutdown_connections 2023-07-27T20:34:36.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.536+0000 7f7804fff700 1 --2- 172.21.15.72:0/2674265961 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f78000c7740 0x7f78000c41c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:36.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.536+0000 7f7804fff700 1 -- 172.21.15.72:0/2674265961 >> 172.21.15.72:0/2674265961 conn(0x7f78000ab3f0 msgr2=0x7f78000ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:36.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.536+0000 7f7804fff700 1 -- 172.21.15.72:0/2674265961 shutdown_connections 2023-07-27T20:34:36.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.536+0000 7f7804fff700 1 -- 172.21.15.72:0/2674265961 wait complete. 2023-07-27T20:34:36.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.537+0000 7f7804fff700 1 Processor -- start 2023-07-27T20:34:36.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.538+0000 7f7804fff700 1 -- start start 2023-07-27T20:34:36.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.538+0000 7f7804fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78000c4700 0x7f78001574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:36.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.538+0000 7f7804fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78000c7740 0x7f78000a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:36.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.538+0000 7f7804fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f780014aab0 0x7f78000bf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:36.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.538+0000 7f7804fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78000bed90 con 0x7f78000c4700 2023-07-27T20:34:36.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.538+0000 7f7804fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7800157a30 con 0x7f78000c7740 2023-07-27T20:34:36.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.538+0000 7f7804fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78000a9fa0 con 0x7f780014aab0 2023-07-27T20:34:36.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.539+0000 7f77fe59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78000c4700 0x7f78001574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:36.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.539+0000 7f77fe59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78000c4700 0x7f78001574f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52400/0 (socket says 172.21.15.72:52400) 2023-07-27T20:34:36.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.539+0000 7f77fe59c700 1 -- 172.21.15.72:0/1257146636 learned_addr learned my addr 172.21.15.72:0/1257146636 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:36.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.539+0000 7f77f7fff700 1 --2- 172.21.15.72:0/1257146636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78000c7740 0x7f78000a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:36.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.539+0000 7f77fe59c700 1 -- 172.21.15.72:0/1257146636 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f780014aab0 msgr2=0x7f78000bf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:36.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.539+0000 7f77fe59c700 1 --2- 172.21.15.72:0/1257146636 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f780014aab0 0x7f78000bf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:36.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.539+0000 7f77fe59c700 1 -- 172.21.15.72:0/1257146636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78000c7740 msgr2=0x7f78000a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:36.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.539+0000 7f77fe59c700 1 --2- 172.21.15.72:0/1257146636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78000c7740 0x7f78000a94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:36.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.539+0000 7f77fe59c700 1 -- 172.21.15.72:0/1257146636 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e80094a0 con 0x7f78000c4700 2023-07-27T20:34:36.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.539+0000 7f77fe59c700 1 --2- 172.21.15.72:0/1257146636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78000c4700 0x7f78001574f0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f77f000c500 tx=0x7f77f000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:36.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.539+0000 7f77f6ffd700 1 -- 172.21.15.72:0/1257146636 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f00052d0 con 0x7f78000c4700 2023-07-27T20:34:36.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.539+0000 7f77f6ffd700 1 -- 172.21.15.72:0/1257146636 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f0005450 con 0x7f78000c4700 2023-07-27T20:34:36.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.539+0000 7f77f6ffd700 1 -- 172.21.15.72:0/1257146636 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f00038c0 con 0x7f78000c4700 2023-07-27T20:34:36.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.539+0000 7f7804fff700 1 -- 172.21.15.72:0/1257146636 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7800157ce0 con 0x7f78000c4700 2023-07-27T20:34:36.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.540+0000 7f7804fff700 1 -- 172.21.15.72:0/1257146636 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7800157fc0 con 0x7f78000c4700 2023-07-27T20:34:36.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.541+0000 7f7804fff700 1 -- 172.21.15.72:0/1257146636 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f780004e470 con 0x7f78000c4700 2023-07-27T20:34:36.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.542+0000 7f77f6ffd700 1 -- 172.21.15.72:0/1257146636 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f77f0003a20 con 0x7f78000c4700 2023-07-27T20:34:36.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.543+0000 7f77f6ffd700 1 --2- 172.21.15.72:0/1257146636 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f77e006ace0 0x7f77e006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:36.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.543+0000 7f77f6ffd700 1 -- 172.21.15.72:0/1257146636 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f77f0088ae0 con 0x7f78000c4700 2023-07-27T20:34:36.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.543+0000 7f77f7fff700 1 --2- 172.21.15.72:0/1257146636 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f77e006ace0 0x7f77e006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:36.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.544+0000 7f77f7fff700 1 --2- 172.21.15.72:0/1257146636 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f77e006ace0 0x7f77e006d1a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f77e8009870 tx=0x7f77e8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:36.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.547+0000 7f77f6ffd700 1 -- 172.21.15.72:0/1257146636 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f77f0053a50 con 0x7f78000c4700 2023-07-27T20:34:36.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:36.784+0000 7f7804fff700 1 -- 172.21.15.72:0/1257146636 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7800151c30 con 0x7f78000c4700 2023-07-27T20:34:37.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.317+0000 7f77f6ffd700 1 -- 172.21.15.72:0/1257146636 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v33) v1 ==== 122+0+0 (secure 0 0 0) 0x7f77f0057070 con 0x7f78000c4700 2023-07-27T20:34:37.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.320+0000 7f7804fff700 1 -- 172.21.15.72:0/1257146636 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f77e006ace0 msgr2=0x7f77e006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:37.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.320+0000 7f7804fff700 1 --2- 172.21.15.72:0/1257146636 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f77e006ace0 0x7f77e006d1a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f77e8009870 tx=0x7f77e8008030 comp rx=0 tx=0).stop 2023-07-27T20:34:37.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.320+0000 7f7804fff700 1 -- 172.21.15.72:0/1257146636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78000c4700 msgr2=0x7f78001574f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:37.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.320+0000 7f7804fff700 1 --2- 172.21.15.72:0/1257146636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78000c4700 0x7f78001574f0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f77f000c500 tx=0x7f77f000c8c0 comp rx=0 tx=0).stop 2023-07-27T20:34:37.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.320+0000 7f7804fff700 1 -- 172.21.15.72:0/1257146636 shutdown_connections 2023-07-27T20:34:37.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.320+0000 7f7804fff700 1 --2- 172.21.15.72:0/1257146636 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f77e006ace0 0x7f77e006d1a0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:37.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.320+0000 7f7804fff700 1 --2- 172.21.15.72:0/1257146636 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f780014aab0 0x7f78000bf8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:37.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.320+0000 7f7804fff700 1 --2- 172.21.15.72:0/1257146636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78000c4700 0x7f78001574f0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:37.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.320+0000 7f7804fff700 1 --2- 172.21.15.72:0/1257146636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78000c7740 0x7f78000a94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:37.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.320+0000 7f7804fff700 1 -- 172.21.15.72:0/1257146636 >> 172.21.15.72:0/1257146636 conn(0x7f78000ab3f0 msgr2=0x7f780006c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:37.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.320+0000 7f7804fff700 1 -- 172.21.15.72:0/1257146636 shutdown_connections 2023-07-27T20:34:37.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.320+0000 7f7804fff700 1 -- 172.21.15.72:0/1257146636 wait complete. 2023-07-27T20:34:37.328 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-27T20:34:37.329 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T20:34:37.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.537+0000 7f771a9ff700 1 Processor -- start 2023-07-27T20:34:37.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.537+0000 7f771a9ff700 1 -- start start 2023-07-27T20:34:37.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.538+0000 7f771a9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7714139960 0x7f77140c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:37.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.538+0000 7f771a9ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77141542e0 0x7f7714154750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:37.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.538+0000 7f771a9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77140c1810 con 0x7f7714139f80 2023-07-27T20:34:37.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.538+0000 7f771a9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77140c0ee0 con 0x7f7714139960 2023-07-27T20:34:37.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.538+0000 7f771a9ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7714139d40 con 0x7f77141542e0 2023-07-27T20:34:37.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.538+0000 7f77137fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7714139f80 0x7f77140c1e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60636/0 (socket says 172.21.15.72:60636) 2023-07-27T20:34:37.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.538+0000 7f77137fe700 1 -- 172.21.15.72:0/3009420827 learned_addr learned my addr 172.21.15.72:0/3009420827 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:37.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.538+0000 7f7713fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7714139960 0x7f77140c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:37.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.539+0000 7f7718f9c700 1 --2- 172.21.15.72:0/3009420827 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77141542e0 0x7f7714154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:37.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.539+0000 7f7713fff700 1 -- 172.21.15.72:0/3009420827 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77141542e0 msgr2=0x7f7714154750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:37.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.539+0000 7f7712ffd700 1 -- 172.21.15.72:0/3009420827 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1353724411 0 0) 0x7f77140c1810 con 0x7f7714139f80 2023-07-27T20:34:37.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.539+0000 7f7713fff700 1 --2- 172.21.15.72:0/3009420827 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77141542e0 0x7f7714154750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:37.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.539+0000 7f7713fff700 1 -- 172.21.15.72:0/3009420827 >> v1:172.21.15.72:6789/0 conn(0x7f7714139f80 legacy=0x7f77140c1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:37.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.539+0000 7f7713fff700 1 -- 172.21.15.72:0/3009420827 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7714151060 con 0x7f7714139960 2023-07-27T20:34:37.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.539+0000 7f7718f9c700 1 --2- 172.21.15.72:0/3009420827 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77141542e0 0x7f7714154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:37.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.539+0000 7f7713fff700 1 --2- 172.21.15.72:0/3009420827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7714139960 0x7f77140c12d0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f7704009840 tx=0x7f7704009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2cdb2c3f1f3c3d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:37.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.539+0000 7f7712ffd700 1 -- 172.21.15.72:0/3009420827 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7704011830 con 0x7f7714139960 2023-07-27T20:34:37.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.539+0000 7f7712ffd700 1 -- 172.21.15.72:0/3009420827 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7704011990 con 0x7f7714139960 2023-07-27T20:34:37.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.539+0000 7f7712ffd700 1 -- 172.21.15.72:0/3009420827 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7704011d20 con 0x7f7714139960 2023-07-27T20:34:37.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.540+0000 7f771a9ff700 1 -- 172.21.15.72:0/3009420827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7714139960 msgr2=0x7f77140c12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:37.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.540+0000 7f771a9ff700 1 --2- 172.21.15.72:0/3009420827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7714139960 0x7f77140c12d0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f7704009840 tx=0x7f7704009b50 comp rx=0 tx=0).stop 2023-07-27T20:34:37.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.540+0000 7f771a9ff700 1 -- 172.21.15.72:0/3009420827 shutdown_connections 2023-07-27T20:34:37.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.540+0000 7f771a9ff700 1 --2- 172.21.15.72:0/3009420827 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77141542e0 0x7f7714154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:37.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.540+0000 7f771a9ff700 1 --2- 172.21.15.72:0/3009420827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7714139960 0x7f77140c12d0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:37.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.540+0000 7f771a9ff700 1 -- 172.21.15.72:0/3009420827 >> 172.21.15.72:0/3009420827 conn(0x7f771406a190 msgr2=0x7f771406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:37.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.540+0000 7f771a9ff700 1 -- 172.21.15.72:0/3009420827 shutdown_connections 2023-07-27T20:34:37.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.540+0000 7f771a9ff700 1 -- 172.21.15.72:0/3009420827 wait complete. 2023-07-27T20:34:37.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.542+0000 7f771a9ff700 1 Processor -- start 2023-07-27T20:34:37.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.542+0000 7f771a9ff700 1 -- start start 2023-07-27T20:34:37.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.543+0000 7f771a9ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7714139960 0x7f771414fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:37.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.543+0000 7f771a9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7714139f80 0x7f77140a9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:37.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.543+0000 7f771a9ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77141542e0 0x7f77141ecfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:37.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.543+0000 7f771a9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77140ab1a0 con 0x7f7714139f80 2023-07-27T20:34:37.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.543+0000 7f771a9ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77141507d0 con 0x7f7714139960 2023-07-27T20:34:37.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.543+0000 7f771a9ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7714150ab0 con 0x7f77141542e0 2023-07-27T20:34:37.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.543+0000 7f77137fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7714139f80 0x7f77140a9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:37.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.543+0000 7f77137fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7714139f80 0x7f77140a9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52424/0 (socket says 172.21.15.72:52424) 2023-07-27T20:34:37.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.543+0000 7f77137fe700 1 -- 172.21.15.72:0/1252749759 learned_addr learned my addr 172.21.15.72:0/1252749759 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:37.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.543+0000 7f7718f9c700 1 --2- 172.21.15.72:0/1252749759 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77141542e0 0x7f77141ecfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:37.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.543+0000 7f7713fff700 1 --2- 172.21.15.72:0/1252749759 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7714139960 0x7f771414fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:37.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.543+0000 7f77137fe700 1 -- 172.21.15.72:0/1252749759 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77141542e0 msgr2=0x7f77141ecfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:37.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.543+0000 7f77137fe700 1 --2- 172.21.15.72:0/1252749759 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77141542e0 0x7f77141ecfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:37.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.543+0000 7f77137fe700 1 -- 172.21.15.72:0/1252749759 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7714139960 msgr2=0x7f771414fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:37.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.543+0000 7f77137fe700 1 --2- 172.21.15.72:0/1252749759 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7714139960 0x7f771414fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:37.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.543+0000 7f77137fe700 1 -- 172.21.15.72:0/1252749759 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77040094a0 con 0x7f7714139f80 2023-07-27T20:34:37.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.544+0000 7f77137fe700 1 --2- 172.21.15.72:0/1252749759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7714139f80 0x7f77140a9370 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f770800c520 tx=0x7f770800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:37.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.544+0000 7f7710ff9700 1 -- 172.21.15.72:0/1252749759 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7708004c80 con 0x7f7714139f80 2023-07-27T20:34:37.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.544+0000 7f7710ff9700 1 -- 172.21.15.72:0/1252749759 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7708004de0 con 0x7f7714139f80 2023-07-27T20:34:37.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.544+0000 7f7710ff9700 1 -- 172.21.15.72:0/1252749759 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77080072d0 con 0x7f7714139f80 2023-07-27T20:34:37.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.544+0000 7f771a9ff700 1 -- 172.21.15.72:0/1252749759 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77141eda50 con 0x7f7714139f80 2023-07-27T20:34:37.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.544+0000 7f771a9ff700 1 -- 172.21.15.72:0/1252749759 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77140a98b0 con 0x7f7714139f80 2023-07-27T20:34:37.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.545+0000 7f771a9ff700 1 -- 172.21.15.72:0/1252749759 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77141edc70 con 0x7f7714139f80 2023-07-27T20:34:37.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.546+0000 7f7710ff9700 1 -- 172.21.15.72:0/1252749759 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7708007430 con 0x7f7714139f80 2023-07-27T20:34:37.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.547+0000 7f7710ff9700 1 --2- 172.21.15.72:0/1252749759 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f770006ace0 0x7f770006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:37.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.547+0000 7f7710ff9700 1 -- 172.21.15.72:0/1252749759 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f77080893d0 con 0x7f7714139f80 2023-07-27T20:34:37.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.547+0000 7f7713fff700 1 --2- 172.21.15.72:0/1252749759 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f770006ace0 0x7f770006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:37.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.548+0000 7f7713fff700 1 --2- 172.21.15.72:0/1252749759 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f770006ace0 0x7f770006d1a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f77040090b0 tx=0x7f770401c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:37.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.551+0000 7f7710ff9700 1 -- 172.21.15.72:0/1252749759 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f77080542a0 con 0x7f7714139f80 2023-07-27T20:34:37.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.787+0000 7f771a9ff700 1 -- 172.21.15.72:0/1252749759 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7714074310 con 0x7f7714139f80 2023-07-27T20:34:37.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.788+0000 7f7710ff9700 1 -- 172.21.15.72:0/1252749759 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4676 (secure 0 0 0) 0x7f77080578c0 con 0x7f7714139f80 2023-07-27T20:34:37.776 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:34:37.776 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5498,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/2320540781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":2320540781},{"type":"v1","addr":"172.21.15.72:6833","nonce":2320540781}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5507,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/4181385736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4181385736},{"type":"v1","addr":"172.21.15.173:6836","nonce":4181385736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6333,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/1617909802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1617909802},{"type":"v1","addr":"172.21.15.72:6835","nonce":1617909802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T20:34:33.766750+0000","modified":"2023-07-27T20:34:37.312198+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6336},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6336":{"gid":6336,"name":"b","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/591656642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":591656642},{"type":"v1","addr":"172.21.15.173:6837","nonce":591656642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-27T20:34:37.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.790+0000 7f771a9ff700 1 -- 172.21.15.72:0/1252749759 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f770006ace0 msgr2=0x7f770006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:37.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.790+0000 7f771a9ff700 1 --2- 172.21.15.72:0/1252749759 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f770006ace0 0x7f770006d1a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f77040090b0 tx=0x7f770401c040 comp rx=0 tx=0).stop 2023-07-27T20:34:37.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.790+0000 7f771a9ff700 1 -- 172.21.15.72:0/1252749759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7714139f80 msgr2=0x7f77140a9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:37.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.790+0000 7f771a9ff700 1 --2- 172.21.15.72:0/1252749759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7714139f80 0x7f77140a9370 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f770800c520 tx=0x7f770800c8e0 comp rx=0 tx=0).stop 2023-07-27T20:34:37.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.790+0000 7f771a9ff700 1 -- 172.21.15.72:0/1252749759 shutdown_connections 2023-07-27T20:34:37.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.790+0000 7f771a9ff700 1 --2- 172.21.15.72:0/1252749759 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f770006ace0 0x7f770006d1a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:37.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.790+0000 7f771a9ff700 1 --2- 172.21.15.72:0/1252749759 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77141542e0 0x7f77141ecfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:37.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.790+0000 7f771a9ff700 1 --2- 172.21.15.72:0/1252749759 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7714139960 0x7f771414fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:37.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.790+0000 7f771a9ff700 1 --2- 172.21.15.72:0/1252749759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7714139f80 0x7f77140a9370 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:37.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.790+0000 7f771a9ff700 1 -- 172.21.15.72:0/1252749759 >> 172.21.15.72:0/1252749759 conn(0x7f771406a190 msgr2=0x7f77140c1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:37.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.790+0000 7f771a9ff700 1 -- 172.21.15.72:0/1252749759 shutdown_connections 2023-07-27T20:34:37.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:37.790+0000 7f771a9ff700 1 -- 172.21.15.72:0/1252749759 wait complete. 2023-07-27T20:34:37.780 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 33 2023-07-27T20:34:37.796 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:34:37.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.004+0000 7f39867ff700 1 Processor -- start 2023-07-27T20:34:37.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.004+0000 7f39867ff700 1 -- start start 2023-07-27T20:34:37.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.005+0000 7f39867ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f398006b150 0x7f39800c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:37.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.005+0000 7f39867ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f39801549f0 0x7f39801514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:37.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.005+0000 7f39867ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398006b710 con 0x7f39800c4400 2023-07-27T20:34:37.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.005+0000 7f39867ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39801545d0 con 0x7f39801549f0 2023-07-27T20:34:37.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.005+0000 7f39867ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f398006c860 con 0x7f398006b150 2023-07-27T20:34:37.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.005+0000 7f397ffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f39800c4400 0x7f39800c4cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60650/0 (socket says 172.21.15.72:60650) 2023-07-27T20:34:37.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.005+0000 7f397ffff700 1 -- 172.21.15.72:0/752537469 learned_addr learned my addr 172.21.15.72:0/752537469 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:37.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.005+0000 7f3984d9c700 1 --2- 172.21.15.72:0/752537469 >> v2:172.21.15.72:3300/0 conn(0x7f39801549f0 0x7f39801514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:37.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.006+0000 7f397f7fe700 1 --2- 172.21.15.72:0/752537469 >> v2:172.21.15.173:3300/0 conn(0x7f398006b150 0x7f39800c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:37.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.006+0000 7f397effd700 1 -- 172.21.15.72:0/752537469 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4136174943 0 0) 0x7f398006b710 con 0x7f39800c4400 2023-07-27T20:34:37.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.006+0000 7f397effd700 1 -- 172.21.15.72:0/752537469 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39680035b0 con 0x7f39800c4400 2023-07-27T20:34:37.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.006+0000 7f3984d9c700 1 -- 172.21.15.72:0/752537469 >> v2:172.21.15.173:3300/0 conn(0x7f398006b150 msgr2=0x7f39800c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:37.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.006+0000 7f3984d9c700 1 --2- 172.21.15.72:0/752537469 >> v2:172.21.15.173:3300/0 conn(0x7f398006b150 0x7f39800c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:37.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.006+0000 7f3984d9c700 1 -- 172.21.15.72:0/752537469 >> v1:172.21.15.72:6789/0 conn(0x7f39800c4400 legacy=0x7f39800c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:37.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.006+0000 7f3984d9c700 1 -- 172.21.15.72:0/752537469 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398006b9f0 con 0x7f39801549f0 2023-07-27T20:34:37.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.006+0000 7f397f7fe700 1 --2- 172.21.15.72:0/752537469 >> v2:172.21.15.173:3300/0 conn(0x7f398006b150 0x7f39800c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:37.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.006+0000 7f3984d9c700 1 --2- 172.21.15.72:0/752537469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39801549f0 0x7f39801514a0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f39800c0870 tx=0x7f397800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d868ba162582bc7a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:37.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.006+0000 7f397effd700 1 -- 172.21.15.72:0/752537469 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397800e070 con 0x7f39801549f0 2023-07-27T20:34:37.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.006+0000 7f397effd700 1 -- 172.21.15.72:0/752537469 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397800bb20 con 0x7f39801549f0 2023-07-27T20:34:37.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.006+0000 7f397effd700 1 -- 172.21.15.72:0/752537469 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3978012430 con 0x7f39801549f0 2023-07-27T20:34:37.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.007+0000 7f39867ff700 1 -- 172.21.15.72:0/752537469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39801549f0 msgr2=0x7f39801514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:37.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.007+0000 7f39867ff700 1 --2- 172.21.15.72:0/752537469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39801549f0 0x7f39801514a0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f39800c0870 tx=0x7f397800b330 comp rx=0 tx=0).stop 2023-07-27T20:34:37.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.007+0000 7f39867ff700 1 -- 172.21.15.72:0/752537469 shutdown_connections 2023-07-27T20:34:37.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.007+0000 7f39867ff700 1 --2- 172.21.15.72:0/752537469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39801549f0 0x7f39801514a0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:37.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.007+0000 7f39867ff700 1 --2- 172.21.15.72:0/752537469 >> v2:172.21.15.173:3300/0 conn(0x7f398006b150 0x7f39800c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:37.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.007+0000 7f39867ff700 1 -- 172.21.15.72:0/752537469 >> 172.21.15.72:0/752537469 conn(0x7f39800ab300 msgr2=0x7f39800ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:37.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.007+0000 7f39867ff700 1 -- 172.21.15.72:0/752537469 shutdown_connections 2023-07-27T20:34:37.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.007+0000 7f39867ff700 1 -- 172.21.15.72:0/752537469 wait complete. 2023-07-27T20:34:38.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.009+0000 7f39867ff700 1 Processor -- start 2023-07-27T20:34:38.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.009+0000 7f39867ff700 1 -- start start 2023-07-27T20:34:38.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.010+0000 7f39867ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f398006b150 0x7f39801e9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:38.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.010+0000 7f39867ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39800c4400 0x7f39801ecfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:38.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.010+0000 7f39867ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39801549f0 0x7f39801508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:38.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.010+0000 7f39867ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39801ed4e0 con 0x7f39801549f0 2023-07-27T20:34:38.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.010+0000 7f39867ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39801dc530 con 0x7f39800c4400 2023-07-27T20:34:38.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.010+0000 7f39867ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39801e9780 con 0x7f398006b150 2023-07-27T20:34:38.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.010+0000 7f3984d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39801549f0 0x7f39801508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:38.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.010+0000 7f3984d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39801549f0 0x7f39801508f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52432/0 (socket says 172.21.15.72:52432) 2023-07-27T20:34:38.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.010+0000 7f3984d9c700 1 -- 172.21.15.72:0/3088817159 learned_addr learned my addr 172.21.15.72:0/3088817159 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:38.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.010+0000 7f397ffff700 1 --2- 172.21.15.72:0/3088817159 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f398006b150 0x7f39801e9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:38.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.010+0000 7f397f7fe700 1 --2- 172.21.15.72:0/3088817159 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39800c4400 0x7f39801ecfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:38.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.010+0000 7f3984d9c700 1 -- 172.21.15.72:0/3088817159 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f398006b150 msgr2=0x7f39801e9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:38.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.010+0000 7f3984d9c700 1 --2- 172.21.15.72:0/3088817159 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f398006b150 0x7f39801e9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:38.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.010+0000 7f3984d9c700 1 -- 172.21.15.72:0/3088817159 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39800c4400 msgr2=0x7f39801ecfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:38.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.010+0000 7f3984d9c700 1 --2- 172.21.15.72:0/3088817159 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39800c4400 0x7f39801ecfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:38.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.010+0000 7f3984d9c700 1 -- 172.21.15.72:0/3088817159 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3978009a70 con 0x7f39801549f0 2023-07-27T20:34:38.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.010+0000 7f397ffff700 1 --2- 172.21.15.72:0/3088817159 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f398006b150 0x7f39801e9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:38.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.011+0000 7f3984d9c700 1 --2- 172.21.15.72:0/3088817159 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39801549f0 0x7f39801508f0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f3978014040 tx=0x7f3978004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:38.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.011+0000 7f397cff9700 1 -- 172.21.15.72:0/3088817159 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3978012430 con 0x7f39801549f0 2023-07-27T20:34:38.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.011+0000 7f397cff9700 1 -- 172.21.15.72:0/3088817159 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3978020070 con 0x7f39801549f0 2023-07-27T20:34:38.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.011+0000 7f39867ff700 1 -- 172.21.15.72:0/3088817159 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39801dc780 con 0x7f39801549f0 2023-07-27T20:34:38.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.011+0000 7f397cff9700 1 -- 172.21.15.72:0/3088817159 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3978004280 con 0x7f39801549f0 2023-07-27T20:34:38.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.011+0000 7f39867ff700 1 -- 172.21.15.72:0/3088817159 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39801e9410 con 0x7f39801549f0 2023-07-27T20:34:38.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.012+0000 7f39867ff700 1 -- 172.21.15.72:0/3088817159 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39801e95a0 con 0x7f39801549f0 2023-07-27T20:34:38.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.013+0000 7f397cff9700 1 -- 172.21.15.72:0/3088817159 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f39780043e0 con 0x7f39801549f0 2023-07-27T20:34:38.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.014+0000 7f397cff9700 1 --2- 172.21.15.72:0/3088817159 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f396c06ace0 0x7f396c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:38.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.014+0000 7f397cff9700 1 -- 172.21.15.72:0/3088817159 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3978022070 con 0x7f39801549f0 2023-07-27T20:34:38.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.014+0000 7f397ffff700 1 --2- 172.21.15.72:0/3088817159 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f396c06ace0 0x7f396c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:38.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.015+0000 7f397ffff700 1 --2- 172.21.15.72:0/3088817159 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f396c06ace0 0x7f396c06d1a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f39700011e0 tx=0x7f3970009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:38.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.018+0000 7f397cff9700 1 -- 172.21.15.72:0/3088817159 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3978056220 con 0x7f39801549f0 2023-07-27T20:34:38.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.211+0000 7f39867ff700 1 -- 172.21.15.72:0/3088817159 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f398006bcd0 con 0x7f39801549f0 2023-07-27T20:34:38.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.212+0000 7f397cff9700 1 -- 172.21.15.72:0/3088817159 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+18555 (secure 0 0 0) 0x7f3978059840 con 0x7f39801549f0 2023-07-27T20:34:38.201 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:34:38.202 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":62,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:34:35.293038+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:34:31.480063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-07-27T20:34:32.755579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:34:38.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.215+0000 7f39867ff700 1 -- 172.21.15.72:0/3088817159 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f396c06ace0 msgr2=0x7f396c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:38.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.215+0000 7f39867ff700 1 --2- 172.21.15.72:0/3088817159 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f396c06ace0 0x7f396c06d1a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f39700011e0 tx=0x7f3970009040 comp rx=0 tx=0).stop 2023-07-27T20:34:38.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.215+0000 7f39867ff700 1 -- 172.21.15.72:0/3088817159 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39801549f0 msgr2=0x7f39801508f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:38.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.215+0000 7f39867ff700 1 --2- 172.21.15.72:0/3088817159 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39801549f0 0x7f39801508f0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f3978014040 tx=0x7f3978004ad0 comp rx=0 tx=0).stop 2023-07-27T20:34:38.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.215+0000 7f39867ff700 1 -- 172.21.15.72:0/3088817159 shutdown_connections 2023-07-27T20:34:38.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.215+0000 7f39867ff700 1 --2- 172.21.15.72:0/3088817159 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39801549f0 0x7f39801508f0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:38.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.215+0000 7f39867ff700 1 --2- 172.21.15.72:0/3088817159 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f396c06ace0 0x7f396c06d1a0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:38.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.215+0000 7f39867ff700 1 --2- 172.21.15.72:0/3088817159 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f398006b150 0x7f39801e9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:38.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.215+0000 7f39867ff700 1 --2- 172.21.15.72:0/3088817159 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39800c4400 0x7f39801ecfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:38.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.215+0000 7f39867ff700 1 -- 172.21.15.72:0/3088817159 >> 172.21.15.72:0/3088817159 conn(0x7f39800ab300 msgr2=0x7f39801de6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:38.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.215+0000 7f39867ff700 1 -- 172.21.15.72:0/3088817159 shutdown_connections 2023-07-27T20:34:38.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.215+0000 7f39867ff700 1 -- 172.21.15.72:0/3088817159 wait complete. 2023-07-27T20:34:38.221 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-27T20:34:38.222 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T20:34:38.238 INFO:tasks.ceph.mds.b.smithi173.stderr:2023-07-27T20:34:38.250+0000 7f02f3df1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-27T20:34:38.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.431+0000 7feef39ff700 1 Processor -- start 2023-07-27T20:34:38.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.431+0000 7feef39ff700 1 -- start start 2023-07-27T20:34:38.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.433+0000 7feef39ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7feeec0c1930 0x7feeec0aad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:38.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.433+0000 7feef39ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeec070080 con 0x7feeec1504b0 2023-07-27T20:34:38.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.433+0000 7feef39ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeec0ab330 con 0x7feeec14da10 2023-07-27T20:34:38.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.433+0000 7feef39ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeec0702d0 con 0x7feeec0c1930 2023-07-27T20:34:38.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.433+0000 7feef1f9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7feeec1504b0 0x7feeec150960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60658/0 (socket says 172.21.15.72:60658) 2023-07-27T20:34:38.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.433+0000 7feef1f9c700 1 -- 172.21.15.72:0/3809664392 learned_addr learned my addr 172.21.15.72:0/3809664392 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:38.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.433+0000 7feef0f9a700 1 --2- 172.21.15.72:0/3809664392 >> v2:172.21.15.173:3300/0 conn(0x7feeec0c1930 0x7feeec0aad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:38.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.433+0000 7feee3fff700 1 -- 172.21.15.72:0/3809664392 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2679642423 0 0) 0x7feeec070080 con 0x7feeec1504b0 2023-07-27T20:34:38.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.433+0000 7feee3fff700 1 -- 172.21.15.72:0/3809664392 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feed80035b0 con 0x7feeec1504b0 2023-07-27T20:34:38.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.433+0000 7feef0f9a700 1 -- 172.21.15.72:0/3809664392 >> v1:172.21.15.173:6789/0 conn(0x7feeec14da10 legacy=0x7feeec06d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:38.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.434+0000 7feef0f9a700 1 -- 172.21.15.72:0/3809664392 >> v1:172.21.15.72:6789/0 conn(0x7feeec1504b0 legacy=0x7feeec150960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:38.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.434+0000 7feef0f9a700 1 -- 172.21.15.72:0/3809664392 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeec0705b0 con 0x7feeec0c1930 2023-07-27T20:34:38.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.434+0000 7feef0f9a700 1 --2- 172.21.15.72:0/3809664392 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feeec0c1930 0x7feeec0aad50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7feedc00bae0 tx=0x7feedc00bdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b93f7e690a0e9a8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:38.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.434+0000 7feee3fff700 1 -- 172.21.15.72:0/3809664392 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feedc00db60 con 0x7feeec0c1930 2023-07-27T20:34:38.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.434+0000 7feee3fff700 1 -- 172.21.15.72:0/3809664392 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feedc00dce0 con 0x7feeec0c1930 2023-07-27T20:34:38.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.434+0000 7feee3fff700 1 -- 172.21.15.72:0/3809664392 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feedc017650 con 0x7feeec0c1930 2023-07-27T20:34:38.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.435+0000 7feef39ff700 1 -- 172.21.15.72:0/3809664392 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feeec0c1930 msgr2=0x7feeec0aad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:38.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.435+0000 7feef39ff700 1 --2- 172.21.15.72:0/3809664392 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feeec0c1930 0x7feeec0aad50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7feedc00bae0 tx=0x7feedc00bdf0 comp rx=0 tx=0).stop 2023-07-27T20:34:38.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.435+0000 7feef39ff700 1 -- 172.21.15.72:0/3809664392 shutdown_connections 2023-07-27T20:34:38.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.435+0000 7feef39ff700 1 --2- 172.21.15.72:0/3809664392 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feeec0c1930 0x7feeec0aad50 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:38.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.435+0000 7feef39ff700 1 -- 172.21.15.72:0/3809664392 >> 172.21.15.72:0/3809664392 conn(0x7feeec06a190 msgr2=0x7feeec06a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:38.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.435+0000 7feef39ff700 1 -- 172.21.15.72:0/3809664392 shutdown_connections 2023-07-27T20:34:38.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.435+0000 7feef39ff700 1 -- 172.21.15.72:0/3809664392 wait complete. 2023-07-27T20:34:38.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.437+0000 7feef39ff700 1 Processor -- start 2023-07-27T20:34:38.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.437+0000 7feef39ff700 1 -- start start 2023-07-27T20:34:38.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.438+0000 7feef39ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feeec0c1930 0x7feeec0c4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:38.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.438+0000 7feef39ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feeec14da10 0x7feeec151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:38.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.438+0000 7feef39ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feeec1504b0 0x7feeec0a9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:38.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.438+0000 7feef39ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeec0c32f0 con 0x7feeec0c1930 2023-07-27T20:34:38.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.438+0000 7feef39ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeec0c35d0 con 0x7feeec1504b0 2023-07-27T20:34:38.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.438+0000 7feef39ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeec0c38b0 con 0x7feeec14da10 2023-07-27T20:34:38.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.439+0000 7feef179b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feeec0c1930 0x7feeec0c4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:38.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.439+0000 7feef179b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feeec0c1930 0x7feeec0c4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52438/0 (socket says 172.21.15.72:52438) 2023-07-27T20:34:38.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.439+0000 7feef179b700 1 -- 172.21.15.72:0/702791489 learned_addr learned my addr 172.21.15.72:0/702791489 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:38.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.439+0000 7feef1f9c700 1 --2- 172.21.15.72:0/702791489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feeec1504b0 0x7feeec0a9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:38.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.439+0000 7feef0f9a700 1 --2- 172.21.15.72:0/702791489 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feeec14da10 0x7feeec151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:38.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.439+0000 7feef179b700 1 -- 172.21.15.72:0/702791489 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feeec14da10 msgr2=0x7feeec151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:38.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.439+0000 7feef179b700 1 --2- 172.21.15.72:0/702791489 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feeec14da10 0x7feeec151da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:38.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.439+0000 7feef179b700 1 -- 172.21.15.72:0/702791489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feeec1504b0 msgr2=0x7feeec0a9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:38.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.439+0000 7feef179b700 1 --2- 172.21.15.72:0/702791489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feeec1504b0 0x7feeec0a9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:38.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.439+0000 7feef179b700 1 -- 172.21.15.72:0/702791489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feedc00b740 con 0x7feeec0c1930 2023-07-27T20:34:38.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.439+0000 7feef1f9c700 1 --2- 172.21.15.72:0/702791489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feeec1504b0 0x7feeec0a9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:38.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.439+0000 7feef179b700 1 --2- 172.21.15.72:0/702791489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feeec0c1930 0x7feeec0c4320 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7feee800c4e0 tx=0x7feee800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:38.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.440+0000 7feee1ffb700 1 -- 172.21.15.72:0/702791489 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee80052d0 con 0x7feeec0c1930 2023-07-27T20:34:38.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.440+0000 7feee1ffb700 1 -- 172.21.15.72:0/702791489 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee8005430 con 0x7feeec0c1930 2023-07-27T20:34:38.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.440+0000 7feef39ff700 1 -- 172.21.15.72:0/702791489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeec0a95a0 con 0x7feeec0c1930 2023-07-27T20:34:38.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.440+0000 7feee1ffb700 1 -- 172.21.15.72:0/702791489 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee80038c0 con 0x7feeec0c1930 2023-07-27T20:34:38.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.440+0000 7feef39ff700 1 -- 172.21.15.72:0/702791489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeec0aa000 con 0x7feeec0c1930 2023-07-27T20:34:38.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.441+0000 7feef39ff700 1 -- 172.21.15.72:0/702791489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeec0a9400 con 0x7feeec0c1930 2023-07-27T20:34:38.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.442+0000 7feee1ffb700 1 -- 172.21.15.72:0/702791489 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feee8003a20 con 0x7feeec0c1930 2023-07-27T20:34:38.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.443+0000 7feee1ffb700 1 --2- 172.21.15.72:0/702791489 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7feed006ace0 0x7feed006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:38.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.443+0000 7feee1ffb700 1 -- 172.21.15.72:0/702791489 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7feee80889d0 con 0x7feeec0c1930 2023-07-27T20:34:38.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.443+0000 7feef0f9a700 1 --2- 172.21.15.72:0/702791489 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7feed006ace0 0x7feed006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:38.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.444+0000 7feef0f9a700 1 --2- 172.21.15.72:0/702791489 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7feed006ace0 0x7feed006d1a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7feedc00bae0 tx=0x7feedc014000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:38.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.447+0000 7feee1ffb700 1 -- 172.21.15.72:0/702791489 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7feeec0a9400 con 0x7feeec0c1930 2023-07-27T20:34:38.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.639+0000 7feef39ff700 1 -- 172.21.15.72:0/702791489 --> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feeec0aa7d0 con 0x7feed006ace0 2023-07-27T20:34:38.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.649+0000 7feee1ffb700 1 -- 172.21.15.72:0/702791489 <== mgr.4107 v2:172.21.15.173:6832/910681537 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311359 (secure 0 0 0) 0x7feeec0aa7d0 con 0x7feed006ace0 2023-07-27T20:34:38.641 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:34:38.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.654+0000 7feef39ff700 1 -- 172.21.15.72:0/702791489 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7feed006ace0 msgr2=0x7feed006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:38.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.654+0000 7feef39ff700 1 --2- 172.21.15.72:0/702791489 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7feed006ace0 0x7feed006d1a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7feedc00bae0 tx=0x7feedc014000 comp rx=0 tx=0).stop 2023-07-27T20:34:38.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.654+0000 7feef39ff700 1 -- 172.21.15.72:0/702791489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feeec0c1930 msgr2=0x7feeec0c4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:38.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.654+0000 7feef39ff700 1 --2- 172.21.15.72:0/702791489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feeec0c1930 0x7feeec0c4320 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7feee800c4e0 tx=0x7feee800c7f0 comp rx=0 tx=0).stop 2023-07-27T20:34:38.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.654+0000 7feef39ff700 1 -- 172.21.15.72:0/702791489 shutdown_connections 2023-07-27T20:34:38.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.654+0000 7feef39ff700 1 --2- 172.21.15.72:0/702791489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feeec1504b0 0x7feeec0a9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:38.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.654+0000 7feef39ff700 1 --2- 172.21.15.72:0/702791489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feeec0c1930 0x7feeec0c4320 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:38.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.654+0000 7feef39ff700 1 --2- 172.21.15.72:0/702791489 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7feed006ace0 0x7feed006d1a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:38.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.654+0000 7feef39ff700 1 --2- 172.21.15.72:0/702791489 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feeec14da10 0x7feeec151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:38.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.654+0000 7feef39ff700 1 -- 172.21.15.72:0/702791489 >> 172.21.15.72:0/702791489 conn(0x7feeec06a190 msgr2=0x7feeec14f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:38.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.654+0000 7feef39ff700 1 -- 172.21.15.72:0/702791489 shutdown_connections 2023-07-27T20:34:38.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.654+0000 7feef39ff700 1 -- 172.21.15.72:0/702791489 wait complete. 2023-07-27T20:34:38.645 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-07-27T20:34:38.660 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":157,"stamp":"2023-07-27T20:34:38.575707+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223064,"kb_used_data":6880,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754751656,"statfs":{"total":773094113280,"available":772865695744,"internally_reserved":0,"allocated":7045120,"data_stored":3950222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001376"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.322376+0000","last_change":"2023-07-27T20:34:34.316234+0000","last_active":"2023-07-27T20:34:34.322376+0000","last_peered":"2023-07-27T20:34:34.322376+0000","last_clean":"2023-07-27T20:34:34.322376+0000","last_became_active":"2023-07-27T20:34:34.315976+0000","last_became_peered":"2023-07-27T20:34:34.315976+0000","last_unstale":"2023-07-27T20:34:34.322376+0000","last_undegraded":"2023-07-27T20:34:34.322376+0000","last_fullsized":"2023-07-27T20:34:34.322376+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:56:21.202404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.318687+0000","last_change":"2023-07-27T20:34:34.314798+0000","last_active":"2023-07-27T20:34:34.318687+0000","last_peered":"2023-07-27T20:34:34.318687+0000","last_clean":"2023-07-27T20:34:34.318687+0000","last_became_active":"2023-07-27T20:34:34.314515+0000","last_became_peered":"2023-07-27T20:34:34.314515+0000","last_unstale":"2023-07-27T20:34:34.318687+0000","last_undegraded":"2023-07-27T20:34:34.318687+0000","last_fullsized":"2023-07-27T20:34:34.318687+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:30:04.257382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.302509+0000","last_change":"2023-07-27T20:34:34.296875+0000","last_active":"2023-07-27T20:34:34.302509+0000","last_peered":"2023-07-27T20:34:34.302509+0000","last_clean":"2023-07-27T20:34:34.302509+0000","last_became_active":"2023-07-27T20:34:34.296594+0000","last_became_peered":"2023-07-27T20:34:34.296594+0000","last_unstale":"2023-07-27T20:34:34.302509+0000","last_undegraded":"2023-07-27T20:34:34.302509+0000","last_fullsized":"2023-07-27T20:34:34.302509+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:38:01.406191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.319849+0000","last_change":"2023-07-27T20:34:34.316000+0000","last_active":"2023-07-27T20:34:34.319849+0000","last_peered":"2023-07-27T20:34:34.319849+0000","last_clean":"2023-07-27T20:34:34.319849+0000","last_became_active":"2023-07-27T20:34:34.315494+0000","last_became_peered":"2023-07-27T20:34:34.315494+0000","last_unstale":"2023-07-27T20:34:34.319849+0000","last_undegraded":"2023-07-27T20:34:34.319849+0000","last_fullsized":"2023-07-27T20:34:34.319849+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:47:41.800748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.314730+0000","last_change":"2023-07-27T20:34:34.310257+0000","last_active":"2023-07-27T20:34:34.314730+0000","last_peered":"2023-07-27T20:34:34.314730+0000","last_clean":"2023-07-27T20:34:34.314730+0000","last_became_active":"2023-07-27T20:34:34.309918+0000","last_became_peered":"2023-07-27T20:34:34.309918+0000","last_unstale":"2023-07-27T20:34:34.314730+0000","last_undegraded":"2023-07-27T20:34:34.314730+0000","last_fullsized":"2023-07-27T20:34:34.314730+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:27:45.027570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.324957+0000","last_change":"2023-07-27T20:34:34.319670+0000","last_active":"2023-07-27T20:34:34.324957+0000","last_peered":"2023-07-27T20:34:34.324957+0000","last_clean":"2023-07-27T20:34:34.324957+0000","last_became_active":"2023-07-27T20:34:34.319356+0000","last_became_peered":"2023-07-27T20:34:34.319356+0000","last_unstale":"2023-07-27T20:34:34.324957+0000","last_undegraded":"2023-07-27T20:34:34.324957+0000","last_fullsized":"2023-07-27T20:34:34.324957+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:07:27.286710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.306494+0000","last_change":"2023-07-27T20:34:34.300907+0000","last_active":"2023-07-27T20:34:34.306494+0000","last_peered":"2023-07-27T20:34:34.306494+0000","last_clean":"2023-07-27T20:34:34.306494+0000","last_became_active":"2023-07-27T20:34:34.300633+0000","last_became_peered":"2023-07-27T20:34:34.300633+0000","last_unstale":"2023-07-27T20:34:34.306494+0000","last_undegraded":"2023-07-27T20:34:34.306494+0000","last_fullsized":"2023-07-27T20:34:34.306494+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:22:40.149672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.325047+0000","last_change":"2023-07-27T20:34:34.320735+0000","last_active":"2023-07-27T20:34:34.325047+0000","last_peered":"2023-07-27T20:34:34.325047+0000","last_clean":"2023-07-27T20:34:34.325047+0000","last_became_active":"2023-07-27T20:34:34.320086+0000","last_became_peered":"2023-07-27T20:34:34.320086+0000","last_unstale":"2023-07-27T20:34:34.325047+0000","last_undegraded":"2023-07-27T20:34:34.325047+0000","last_fullsized":"2023-07-27T20:34:34.325047+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:27:35.353575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.309342+0000","last_change":"2023-07-27T20:34:34.304314+0000","last_active":"2023-07-27T20:34:34.309342+0000","last_peered":"2023-07-27T20:34:34.309342+0000","last_clean":"2023-07-27T20:34:34.309342+0000","last_became_active":"2023-07-27T20:34:34.304042+0000","last_became_peered":"2023-07-27T20:34:34.304042+0000","last_unstale":"2023-07-27T20:34:34.309342+0000","last_undegraded":"2023-07-27T20:34:34.309342+0000","last_fullsized":"2023-07-27T20:34:34.309342+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:58:51.019748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.310780+0000","last_change":"2023-07-27T20:34:34.302549+0000","last_active":"2023-07-27T20:34:34.310780+0000","last_peered":"2023-07-27T20:34:34.310780+0000","last_clean":"2023-07-27T20:34:34.310780+0000","last_became_active":"2023-07-27T20:34:34.301699+0000","last_became_peered":"2023-07-27T20:34:34.301699+0000","last_unstale":"2023-07-27T20:34:34.310780+0000","last_undegraded":"2023-07-27T20:34:34.310780+0000","last_fullsized":"2023-07-27T20:34:34.310780+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:32:34.109715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.319647+0000","last_change":"2023-07-27T20:34:34.313419+0000","last_active":"2023-07-27T20:34:34.319647+0000","last_peered":"2023-07-27T20:34:34.319647+0000","last_clean":"2023-07-27T20:34:34.319647+0000","last_became_active":"2023-07-27T20:34:34.313089+0000","last_became_peered":"2023-07-27T20:34:34.313089+0000","last_unstale":"2023-07-27T20:34:34.319647+0000","last_undegraded":"2023-07-27T20:34:34.319647+0000","last_fullsized":"2023-07-27T20:34:34.319647+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:09:19.279175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.304811+0000","last_change":"2023-07-27T20:34:34.298435+0000","last_active":"2023-07-27T20:34:34.304811+0000","last_peered":"2023-07-27T20:34:34.304811+0000","last_clean":"2023-07-27T20:34:34.304811+0000","last_became_active":"2023-07-27T20:34:34.298143+0000","last_became_peered":"2023-07-27T20:34:34.298143+0000","last_unstale":"2023-07-27T20:34:34.304811+0000","last_undegraded":"2023-07-27T20:34:34.304811+0000","last_fullsized":"2023-07-27T20:34:34.304811+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:51:18.716696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.319623+0000","last_change":"2023-07-27T20:34:34.316878+0000","last_active":"2023-07-27T20:34:34.319623+0000","last_peered":"2023-07-27T20:34:34.319623+0000","last_clean":"2023-07-27T20:34:34.319623+0000","last_became_active":"2023-07-27T20:34:34.316610+0000","last_became_peered":"2023-07-27T20:34:34.316610+0000","last_unstale":"2023-07-27T20:34:34.319623+0000","last_undegraded":"2023-07-27T20:34:34.319623+0000","last_fullsized":"2023-07-27T20:34:34.319623+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:48:26.078073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.301067+0000","last_change":"2023-07-27T20:34:34.297203+0000","last_active":"2023-07-27T20:34:34.301067+0000","last_peered":"2023-07-27T20:34:34.301067+0000","last_clean":"2023-07-27T20:34:34.301067+0000","last_became_active":"2023-07-27T20:34:34.296957+0000","last_became_peered":"2023-07-27T20:34:34.296957+0000","last_unstale":"2023-07-27T20:34:34.301067+0000","last_undegraded":"2023-07-27T20:34:34.301067+0000","last_fullsized":"2023-07-27T20:34:34.301067+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:20:54.991712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.299053+0000","last_change":"2023-07-27T20:34:34.294995+0000","last_active":"2023-07-27T20:34:34.299053+0000","last_peered":"2023-07-27T20:34:34.299053+0000","last_clean":"2023-07-27T20:34:34.299053+0000","last_became_active":"2023-07-27T20:34:34.294646+0000","last_became_peered":"2023-07-27T20:34:34.294646+0000","last_unstale":"2023-07-27T20:34:34.299053+0000","last_undegraded":"2023-07-27T20:34:34.299053+0000","last_fullsized":"2023-07-27T20:34:34.299053+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:23:24.266770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.317415+0000","last_change":"2023-07-27T20:34:34.309167+0000","last_active":"2023-07-27T20:34:34.317415+0000","last_peered":"2023-07-27T20:34:34.317415+0000","last_clean":"2023-07-27T20:34:34.317415+0000","last_became_active":"2023-07-27T20:34:34.308831+0000","last_became_peered":"2023-07-27T20:34:34.308831+0000","last_unstale":"2023-07-27T20:34:34.317415+0000","last_undegraded":"2023-07-27T20:34:34.317415+0000","last_fullsized":"2023-07-27T20:34:34.317415+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:08:36.259118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.300413+0000","last_change":"2023-07-27T20:34:34.298405+0000","last_active":"2023-07-27T20:34:34.300413+0000","last_peered":"2023-07-27T20:34:34.300413+0000","last_clean":"2023-07-27T20:34:34.300413+0000","last_became_active":"2023-07-27T20:34:34.298150+0000","last_became_peered":"2023-07-27T20:34:34.298150+0000","last_unstale":"2023-07-27T20:34:34.300413+0000","last_undegraded":"2023-07-27T20:34:34.300413+0000","last_fullsized":"2023-07-27T20:34:34.300413+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:13:32.621066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.319716+0000","last_change":"2023-07-27T20:34:34.316418+0000","last_active":"2023-07-27T20:34:34.319716+0000","last_peered":"2023-07-27T20:34:34.319716+0000","last_clean":"2023-07-27T20:34:34.319716+0000","last_became_active":"2023-07-27T20:34:34.316164+0000","last_became_peered":"2023-07-27T20:34:34.316164+0000","last_unstale":"2023-07-27T20:34:34.319716+0000","last_undegraded":"2023-07-27T20:34:34.319716+0000","last_fullsized":"2023-07-27T20:34:34.319716+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:55:56.569306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.325292+0000","last_change":"2023-07-27T20:34:34.322046+0000","last_active":"2023-07-27T20:34:34.325292+0000","last_peered":"2023-07-27T20:34:34.325292+0000","last_clean":"2023-07-27T20:34:34.325292+0000","last_became_active":"2023-07-27T20:34:34.321751+0000","last_became_peered":"2023-07-27T20:34:34.321751+0000","last_unstale":"2023-07-27T20:34:34.325292+0000","last_undegraded":"2023-07-27T20:34:34.325292+0000","last_fullsized":"2023-07-27T20:34:34.325292+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:39:00.995893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.300998+0000","last_change":"2023-07-27T20:34:34.298450+0000","last_active":"2023-07-27T20:34:34.300998+0000","last_peered":"2023-07-27T20:34:34.300998+0000","last_clean":"2023-07-27T20:34:34.300998+0000","last_became_active":"2023-07-27T20:34:34.298194+0000","last_became_peered":"2023-07-27T20:34:34.298194+0000","last_unstale":"2023-07-27T20:34:34.300998+0000","last_undegraded":"2023-07-27T20:34:34.300998+0000","last_fullsized":"2023-07-27T20:34:34.300998+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:59:03.811289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.306458+0000","last_change":"2023-07-27T20:34:34.295428+0000","last_active":"2023-07-27T20:34:34.306458+0000","last_peered":"2023-07-27T20:34:34.306458+0000","last_clean":"2023-07-27T20:34:34.306458+0000","last_became_active":"2023-07-27T20:34:34.295069+0000","last_became_peered":"2023-07-27T20:34:34.295069+0000","last_unstale":"2023-07-27T20:34:34.306458+0000","last_undegraded":"2023-07-27T20:34:34.306458+0000","last_fullsized":"2023-07-27T20:34:34.306458+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:17:50.314957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.310621+0000","last_change":"2023-07-27T20:34:34.300794+0000","last_active":"2023-07-27T20:34:34.310621+0000","last_peered":"2023-07-27T20:34:34.310621+0000","last_clean":"2023-07-27T20:34:34.310621+0000","last_became_active":"2023-07-27T20:34:34.300470+0000","last_became_peered":"2023-07-27T20:34:34.300470+0000","last_unstale":"2023-07-27T20:34:34.310621+0000","last_undegraded":"2023-07-27T20:34:34.310621+0000","last_fullsized":"2023-07-27T20:34:34.310621+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:03:34.765797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.313705+0000","last_change":"2023-07-27T20:34:34.306170+0000","last_active":"2023-07-27T20:34:34.313705+0000","last_peered":"2023-07-27T20:34:34.313705+0000","last_clean":"2023-07-27T20:34:34.313705+0000","last_became_active":"2023-07-27T20:34:34.305895+0000","last_became_peered":"2023-07-27T20:34:34.305895+0000","last_unstale":"2023-07-27T20:34:34.313705+0000","last_undegraded":"2023-07-27T20:34:34.313705+0000","last_fullsized":"2023-07-27T20:34:34.313705+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:14:23.090548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.326636+0000","last_change":"2023-07-27T20:34:34.324172+0000","last_active":"2023-07-27T20:34:34.326636+0000","last_peered":"2023-07-27T20:34:34.326636+0000","last_clean":"2023-07-27T20:34:34.326636+0000","last_became_active":"2023-07-27T20:34:34.323886+0000","last_became_peered":"2023-07-27T20:34:34.323886+0000","last_unstale":"2023-07-27T20:34:34.326636+0000","last_undegraded":"2023-07-27T20:34:34.326636+0000","last_fullsized":"2023-07-27T20:34:34.326636+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:54:22.772526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.318146+0000","last_change":"2023-07-27T20:34:34.312549+0000","last_active":"2023-07-27T20:34:34.318146+0000","last_peered":"2023-07-27T20:34:34.318146+0000","last_clean":"2023-07-27T20:34:34.318146+0000","last_became_active":"2023-07-27T20:34:34.311940+0000","last_became_peered":"2023-07-27T20:34:34.311940+0000","last_unstale":"2023-07-27T20:34:34.318146+0000","last_undegraded":"2023-07-27T20:34:34.318146+0000","last_fullsized":"2023-07-27T20:34:34.318146+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:19:39.819865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.320228+0000","last_change":"2023-07-27T20:34:34.315088+0000","last_active":"2023-07-27T20:34:34.320228+0000","last_peered":"2023-07-27T20:34:34.320228+0000","last_clean":"2023-07-27T20:34:34.320228+0000","last_became_active":"2023-07-27T20:34:34.314823+0000","last_became_peered":"2023-07-27T20:34:34.314823+0000","last_unstale":"2023-07-27T20:34:34.320228+0000","last_undegraded":"2023-07-27T20:34:34.320228+0000","last_fullsized":"2023-07-27T20:34:34.320228+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:32:34.483782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.312043+0000","last_change":"2023-07-27T20:34:34.309744+0000","last_active":"2023-07-27T20:34:34.312043+0000","last_peered":"2023-07-27T20:34:34.312043+0000","last_clean":"2023-07-27T20:34:34.312043+0000","last_became_active":"2023-07-27T20:34:34.309438+0000","last_became_peered":"2023-07-27T20:34:34.309438+0000","last_unstale":"2023-07-27T20:34:34.312043+0000","last_undegraded":"2023-07-27T20:34:34.312043+0000","last_fullsized":"2023-07-27T20:34:34.312043+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:20:56.148671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.311018+0000","last_change":"2023-07-27T20:34:34.300111+0000","last_active":"2023-07-27T20:34:34.311018+0000","last_peered":"2023-07-27T20:34:34.311018+0000","last_clean":"2023-07-27T20:34:34.311018+0000","last_became_active":"2023-07-27T20:34:34.298555+0000","last_became_peered":"2023-07-27T20:34:34.298555+0000","last_unstale":"2023-07-27T20:34:34.311018+0000","last_undegraded":"2023-07-27T20:34:34.311018+0000","last_fullsized":"2023-07-27T20:34:34.311018+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:54:08.697054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.303765+0000","last_change":"2023-07-27T20:34:34.299682+0000","last_active":"2023-07-27T20:34:34.303765+0000","last_peered":"2023-07-27T20:34:34.303765+0000","last_clean":"2023-07-27T20:34:34.303765+0000","last_became_active":"2023-07-27T20:34:34.299402+0000","last_became_peered":"2023-07-27T20:34:34.299402+0000","last_unstale":"2023-07-27T20:34:34.303765+0000","last_undegraded":"2023-07-27T20:34:34.303765+0000","last_fullsized":"2023-07-27T20:34:34.303765+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:55:19.530682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.322884+0000","last_change":"2023-07-27T20:34:34.320185+0000","last_active":"2023-07-27T20:34:34.322884+0000","last_peered":"2023-07-27T20:34:34.322884+0000","last_clean":"2023-07-27T20:34:34.322884+0000","last_became_active":"2023-07-27T20:34:34.319865+0000","last_became_peered":"2023-07-27T20:34:34.319865+0000","last_unstale":"2023-07-27T20:34:34.322884+0000","last_undegraded":"2023-07-27T20:34:34.322884+0000","last_fullsized":"2023-07-27T20:34:34.322884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:27:45.938304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.303713+0000","last_change":"2023-07-27T20:34:34.297379+0000","last_active":"2023-07-27T20:34:34.303713+0000","last_peered":"2023-07-27T20:34:34.303713+0000","last_clean":"2023-07-27T20:34:34.303713+0000","last_became_active":"2023-07-27T20:34:34.297105+0000","last_became_peered":"2023-07-27T20:34:34.297105+0000","last_unstale":"2023-07-27T20:34:34.303713+0000","last_undegraded":"2023-07-27T20:34:34.303713+0000","last_fullsized":"2023-07-27T20:34:34.303713+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:11:08.017243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.325099+0000","last_change":"2023-07-27T20:34:34.321045+0000","last_active":"2023-07-27T20:34:34.325099+0000","last_peered":"2023-07-27T20:34:34.325099+0000","last_clean":"2023-07-27T20:34:34.325099+0000","last_became_active":"2023-07-27T20:34:34.320433+0000","last_became_peered":"2023-07-27T20:34:34.320433+0000","last_unstale":"2023-07-27T20:34:34.325099+0000","last_undegraded":"2023-07-27T20:34:34.325099+0000","last_fullsized":"2023-07-27T20:34:34.325099+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:07:41.809462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.329447+0000","last_change":"2023-07-27T20:34:34.325790+0000","last_active":"2023-07-27T20:34:34.329447+0000","last_peered":"2023-07-27T20:34:34.329447+0000","last_clean":"2023-07-27T20:34:34.329447+0000","last_became_active":"2023-07-27T20:34:34.325387+0000","last_became_peered":"2023-07-27T20:34:34.325387+0000","last_unstale":"2023-07-27T20:34:34.329447+0000","last_undegraded":"2023-07-27T20:34:34.329447+0000","last_fullsized":"2023-07-27T20:34:34.329447+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:02:09.194367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"61'4","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.313253+0000","last_change":"2023-07-27T20:34:33.303138+0000","last_active":"2023-07-27T20:34:34.313253+0000","last_peered":"2023-07-27T20:34:34.313253+0000","last_clean":"2023-07-27T20:34:34.313253+0000","last_became_active":"2023-07-27T20:34:33.302808+0000","last_became_peered":"2023-07-27T20:34:33.302808+0000","last_unstale":"2023-07-27T20:34:34.313253+0000","last_undegraded":"2023-07-27T20:34:34.313253+0000","last_fullsized":"2023-07-27T20:34:34.313253+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:35:21.613222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.300431+0000","last_change":"2023-07-27T20:34:34.298335+0000","last_active":"2023-07-27T20:34:34.300431+0000","last_peered":"2023-07-27T20:34:34.300431+0000","last_clean":"2023-07-27T20:34:34.300431+0000","last_became_active":"2023-07-27T20:34:34.298050+0000","last_became_peered":"2023-07-27T20:34:34.298050+0000","last_unstale":"2023-07-27T20:34:34.300431+0000","last_undegraded":"2023-07-27T20:34:34.300431+0000","last_fullsized":"2023-07-27T20:34:34.300431+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:25:25.213499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.310632+0000","last_change":"2023-07-27T20:34:33.298365+0000","last_active":"2023-07-27T20:34:34.310632+0000","last_peered":"2023-07-27T20:34:34.310632+0000","last_clean":"2023-07-27T20:34:34.310632+0000","last_became_active":"2023-07-27T20:34:33.298105+0000","last_became_peered":"2023-07-27T20:34:33.298105+0000","last_unstale":"2023-07-27T20:34:34.310632+0000","last_undegraded":"2023-07-27T20:34:34.310632+0000","last_fullsized":"2023-07-27T20:34:34.310632+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:05:27.680904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.326537+0000","last_change":"2023-07-27T20:34:34.323261+0000","last_active":"2023-07-27T20:34:34.326537+0000","last_peered":"2023-07-27T20:34:34.326537+0000","last_clean":"2023-07-27T20:34:34.326537+0000","last_became_active":"2023-07-27T20:34:34.322945+0000","last_became_peered":"2023-07-27T20:34:34.322945+0000","last_unstale":"2023-07-27T20:34:34.326537+0000","last_undegraded":"2023-07-27T20:34:34.326537+0000","last_fullsized":"2023-07-27T20:34:34.326537+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:24:53.428471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.318246+0000","last_change":"2023-07-27T20:34:33.303171+0000","last_active":"2023-07-27T20:34:34.318246+0000","last_peered":"2023-07-27T20:34:34.318246+0000","last_clean":"2023-07-27T20:34:34.318246+0000","last_became_active":"2023-07-27T20:34:33.302865+0000","last_became_peered":"2023-07-27T20:34:33.302865+0000","last_unstale":"2023-07-27T20:34:34.318246+0000","last_undegraded":"2023-07-27T20:34:34.318246+0000","last_fullsized":"2023-07-27T20:34:34.318246+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:43:39.750093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.319724+0000","last_change":"2023-07-27T20:34:34.314330+0000","last_active":"2023-07-27T20:34:34.319724+0000","last_peered":"2023-07-27T20:34:34.319724+0000","last_clean":"2023-07-27T20:34:34.319724+0000","last_became_active":"2023-07-27T20:34:34.314054+0000","last_became_peered":"2023-07-27T20:34:34.314054+0000","last_unstale":"2023-07-27T20:34:34.319724+0000","last_undegraded":"2023-07-27T20:34:34.319724+0000","last_fullsized":"2023-07-27T20:34:34.319724+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:43:18.721841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.321587+0000","last_change":"2023-07-27T20:34:33.307004+0000","last_active":"2023-07-27T20:34:34.321587+0000","last_peered":"2023-07-27T20:34:34.321587+0000","last_clean":"2023-07-27T20:34:34.321587+0000","last_became_active":"2023-07-27T20:34:33.306710+0000","last_became_peered":"2023-07-27T20:34:33.306710+0000","last_unstale":"2023-07-27T20:34:34.321587+0000","last_undegraded":"2023-07-27T20:34:34.321587+0000","last_fullsized":"2023-07-27T20:34:34.321587+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:25:28.190661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.306503+0000","last_change":"2023-07-27T20:34:34.304872+0000","last_active":"2023-07-27T20:34:34.306503+0000","last_peered":"2023-07-27T20:34:34.306503+0000","last_clean":"2023-07-27T20:34:34.306503+0000","last_became_active":"2023-07-27T20:34:34.304583+0000","last_became_peered":"2023-07-27T20:34:34.304583+0000","last_unstale":"2023-07-27T20:34:34.306503+0000","last_undegraded":"2023-07-27T20:34:34.306503+0000","last_fullsized":"2023-07-27T20:34:34.306503+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:34:11.006264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.303071+0000","last_change":"2023-07-27T20:34:33.303472+0000","last_active":"2023-07-27T20:34:34.303071+0000","last_peered":"2023-07-27T20:34:34.303071+0000","last_clean":"2023-07-27T20:34:34.303071+0000","last_became_active":"2023-07-27T20:34:33.303211+0000","last_became_peered":"2023-07-27T20:34:33.303211+0000","last_unstale":"2023-07-27T20:34:34.303071+0000","last_undegraded":"2023-07-27T20:34:34.303071+0000","last_fullsized":"2023-07-27T20:34:34.303071+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:09:11.155306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.317232+0000","last_change":"2023-07-27T20:34:34.309855+0000","last_active":"2023-07-27T20:34:34.317232+0000","last_peered":"2023-07-27T20:34:34.317232+0000","last_clean":"2023-07-27T20:34:34.317232+0000","last_became_active":"2023-07-27T20:34:34.309553+0000","last_became_peered":"2023-07-27T20:34:34.309553+0000","last_unstale":"2023-07-27T20:34:34.317232+0000","last_undegraded":"2023-07-27T20:34:34.317232+0000","last_fullsized":"2023-07-27T20:34:34.317232+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:28:15.952872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.324865+0000","last_change":"2023-07-27T20:34:33.307265+0000","last_active":"2023-07-27T20:34:34.324865+0000","last_peered":"2023-07-27T20:34:34.324865+0000","last_clean":"2023-07-27T20:34:34.324865+0000","last_became_active":"2023-07-27T20:34:33.306583+0000","last_became_peered":"2023-07-27T20:34:33.306583+0000","last_unstale":"2023-07-27T20:34:34.324865+0000","last_undegraded":"2023-07-27T20:34:34.324865+0000","last_fullsized":"2023-07-27T20:34:34.324865+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:59:28.375439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.308994+0000","last_change":"2023-07-27T20:34:34.305104+0000","last_active":"2023-07-27T20:34:34.308994+0000","last_peered":"2023-07-27T20:34:34.308994+0000","last_clean":"2023-07-27T20:34:34.308994+0000","last_became_active":"2023-07-27T20:34:34.304828+0000","last_became_peered":"2023-07-27T20:34:34.304828+0000","last_unstale":"2023-07-27T20:34:34.308994+0000","last_undegraded":"2023-07-27T20:34:34.308994+0000","last_fullsized":"2023-07-27T20:34:34.308994+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:29:45.191052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.287931+0000","last_change":"2023-07-27T20:34:33.304005+0000","last_active":"2023-07-27T20:34:34.287931+0000","last_peered":"2023-07-27T20:34:34.287931+0000","last_clean":"2023-07-27T20:34:34.287931+0000","last_became_active":"2023-07-27T20:34:33.303744+0000","last_became_peered":"2023-07-27T20:34:33.303744+0000","last_unstale":"2023-07-27T20:34:34.287931+0000","last_undegraded":"2023-07-27T20:34:34.287931+0000","last_fullsized":"2023-07-27T20:34:34.287931+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:26:21.597794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.312079+0000","last_change":"2023-07-27T20:34:34.310350+0000","last_active":"2023-07-27T20:34:34.312079+0000","last_peered":"2023-07-27T20:34:34.312079+0000","last_clean":"2023-07-27T20:34:34.312079+0000","last_became_active":"2023-07-27T20:34:34.310068+0000","last_became_peered":"2023-07-27T20:34:34.310068+0000","last_unstale":"2023-07-27T20:34:34.312079+0000","last_undegraded":"2023-07-27T20:34:34.312079+0000","last_fullsized":"2023-07-27T20:34:34.312079+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:56:21.202404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.286707+0000","last_change":"2023-07-27T20:34:33.299254+0000","last_active":"2023-07-27T20:34:34.286707+0000","last_peered":"2023-07-27T20:34:34.286707+0000","last_clean":"2023-07-27T20:34:34.286707+0000","last_became_active":"2023-07-27T20:34:33.298978+0000","last_became_peered":"2023-07-27T20:34:33.298978+0000","last_unstale":"2023-07-27T20:34:34.286707+0000","last_undegraded":"2023-07-27T20:34:34.286707+0000","last_fullsized":"2023-07-27T20:34:34.286707+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:30:20.159074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.316837+0000","last_change":"2023-07-27T20:34:34.313397+0000","last_active":"2023-07-27T20:34:34.316837+0000","last_peered":"2023-07-27T20:34:34.316837+0000","last_clean":"2023-07-27T20:34:34.316837+0000","last_became_active":"2023-07-27T20:34:34.313128+0000","last_became_peered":"2023-07-27T20:34:34.313128+0000","last_unstale":"2023-07-27T20:34:34.316837+0000","last_undegraded":"2023-07-27T20:34:34.316837+0000","last_fullsized":"2023-07-27T20:34:34.316837+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:51:51.396043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.289433+0000","last_change":"2023-07-27T20:34:33.299760+0000","last_active":"2023-07-27T20:34:34.289433+0000","last_peered":"2023-07-27T20:34:34.289433+0000","last_clean":"2023-07-27T20:34:34.289433+0000","last_became_active":"2023-07-27T20:34:33.299488+0000","last_became_peered":"2023-07-27T20:34:33.299488+0000","last_unstale":"2023-07-27T20:34:34.289433+0000","last_undegraded":"2023-07-27T20:34:34.289433+0000","last_fullsized":"2023-07-27T20:34:34.289433+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:45:09.997270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.326646+0000","last_change":"2023-07-27T20:34:34.324198+0000","last_active":"2023-07-27T20:34:34.326646+0000","last_peered":"2023-07-27T20:34:34.326646+0000","last_clean":"2023-07-27T20:34:34.326646+0000","last_became_active":"2023-07-27T20:34:34.323865+0000","last_became_peered":"2023-07-27T20:34:34.323865+0000","last_unstale":"2023-07-27T20:34:34.326646+0000","last_undegraded":"2023-07-27T20:34:34.326646+0000","last_fullsized":"2023-07-27T20:34:34.326646+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:59:03.811289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.304715+0000","last_change":"2023-07-27T20:34:33.309943+0000","last_active":"2023-07-27T20:34:34.304715+0000","last_peered":"2023-07-27T20:34:34.304715+0000","last_clean":"2023-07-27T20:34:34.304715+0000","last_became_active":"2023-07-27T20:34:33.309650+0000","last_became_peered":"2023-07-27T20:34:33.309650+0000","last_unstale":"2023-07-27T20:34:34.304715+0000","last_undegraded":"2023-07-27T20:34:34.304715+0000","last_fullsized":"2023-07-27T20:34:34.304715+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:00:17.079273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.319208+0000","last_change":"2023-07-27T20:34:34.313276+0000","last_active":"2023-07-27T20:34:34.319208+0000","last_peered":"2023-07-27T20:34:34.319208+0000","last_clean":"2023-07-27T20:34:34.319208+0000","last_became_active":"2023-07-27T20:34:34.310175+0000","last_became_peered":"2023-07-27T20:34:34.310175+0000","last_unstale":"2023-07-27T20:34:34.319208+0000","last_undegraded":"2023-07-27T20:34:34.319208+0000","last_fullsized":"2023-07-27T20:34:34.319208+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:43:35.590795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"61'3","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.305514+0000","last_change":"2023-07-27T20:34:33.302814+0000","last_active":"2023-07-27T20:34:34.305514+0000","last_peered":"2023-07-27T20:34:34.305514+0000","last_clean":"2023-07-27T20:34:34.305514+0000","last_became_active":"2023-07-27T20:34:33.302504+0000","last_became_peered":"2023-07-27T20:34:33.302504+0000","last_unstale":"2023-07-27T20:34:34.305514+0000","last_undegraded":"2023-07-27T20:34:34.305514+0000","last_fullsized":"2023-07-27T20:34:34.305514+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:45:31.732057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.308902+0000","last_change":"2023-07-27T20:34:34.302062+0000","last_active":"2023-07-27T20:34:34.308902+0000","last_peered":"2023-07-27T20:34:34.308902+0000","last_clean":"2023-07-27T20:34:34.308902+0000","last_became_active":"2023-07-27T20:34:34.301760+0000","last_became_peered":"2023-07-27T20:34:34.301760+0000","last_unstale":"2023-07-27T20:34:34.308902+0000","last_undegraded":"2023-07-27T20:34:34.308902+0000","last_fullsized":"2023-07-27T20:34:34.308902+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:28:01.650281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"61'6","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.318509+0000","last_change":"2023-07-27T20:34:33.300792+0000","last_active":"2023-07-27T20:34:34.318509+0000","last_peered":"2023-07-27T20:34:34.318509+0000","last_clean":"2023-07-27T20:34:34.318509+0000","last_became_active":"2023-07-27T20:34:33.300452+0000","last_became_peered":"2023-07-27T20:34:33.300452+0000","last_unstale":"2023-07-27T20:34:34.318509+0000","last_undegraded":"2023-07-27T20:34:34.318509+0000","last_fullsized":"2023-07-27T20:34:34.318509+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:54:24.466200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.315743+0000","last_change":"2023-07-27T20:34:34.309848+0000","last_active":"2023-07-27T20:34:34.315743+0000","last_peered":"2023-07-27T20:34:34.315743+0000","last_clean":"2023-07-27T20:34:34.315743+0000","last_became_active":"2023-07-27T20:34:34.309567+0000","last_became_peered":"2023-07-27T20:34:34.309567+0000","last_unstale":"2023-07-27T20:34:34.315743+0000","last_undegraded":"2023-07-27T20:34:34.315743+0000","last_fullsized":"2023-07-27T20:34:34.315743+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:23:24.266770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.320219+0000","last_change":"2023-07-27T20:34:33.303304+0000","last_active":"2023-07-27T20:34:34.320219+0000","last_peered":"2023-07-27T20:34:34.320219+0000","last_clean":"2023-07-27T20:34:34.320219+0000","last_became_active":"2023-07-27T20:34:33.303051+0000","last_became_peered":"2023-07-27T20:34:33.303051+0000","last_unstale":"2023-07-27T20:34:34.320219+0000","last_undegraded":"2023-07-27T20:34:34.320219+0000","last_fullsized":"2023-07-27T20:34:34.320219+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:31:29.763920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.303849+0000","last_change":"2023-07-27T20:34:34.297996+0000","last_active":"2023-07-27T20:34:34.303849+0000","last_peered":"2023-07-27T20:34:34.303849+0000","last_clean":"2023-07-27T20:34:34.303849+0000","last_became_active":"2023-07-27T20:34:34.297650+0000","last_became_peered":"2023-07-27T20:34:34.297650+0000","last_unstale":"2023-07-27T20:34:34.303849+0000","last_undegraded":"2023-07-27T20:34:34.303849+0000","last_fullsized":"2023-07-27T20:34:34.303849+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:07:42.706156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.311511+0000","last_change":"2023-07-27T20:34:33.307281+0000","last_active":"2023-07-27T20:34:34.311511+0000","last_peered":"2023-07-27T20:34:34.311511+0000","last_clean":"2023-07-27T20:34:34.311511+0000","last_became_active":"2023-07-27T20:34:33.306983+0000","last_became_peered":"2023-07-27T20:34:33.306983+0000","last_unstale":"2023-07-27T20:34:34.311511+0000","last_undegraded":"2023-07-27T20:34:34.311511+0000","last_fullsized":"2023-07-27T20:34:34.311511+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:21:11.541389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.319898+0000","last_change":"2023-07-27T20:34:34.317382+0000","last_active":"2023-07-27T20:34:34.319898+0000","last_peered":"2023-07-27T20:34:34.319898+0000","last_clean":"2023-07-27T20:34:34.319898+0000","last_became_active":"2023-07-27T20:34:34.317102+0000","last_became_peered":"2023-07-27T20:34:34.317102+0000","last_unstale":"2023-07-27T20:34:34.319898+0000","last_undegraded":"2023-07-27T20:34:34.319898+0000","last_fullsized":"2023-07-27T20:34:34.319898+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:17:02.646055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.288918+0000","last_change":"2023-07-27T20:34:33.301597+0000","last_active":"2023-07-27T20:34:34.288918+0000","last_peered":"2023-07-27T20:34:34.288918+0000","last_clean":"2023-07-27T20:34:34.288918+0000","last_became_active":"2023-07-27T20:34:33.301302+0000","last_became_peered":"2023-07-27T20:34:33.301302+0000","last_unstale":"2023-07-27T20:34:34.288918+0000","last_undegraded":"2023-07-27T20:34:34.288918+0000","last_fullsized":"2023-07-27T20:34:34.288918+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:03:14.811435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.302382+0000","last_change":"2023-07-27T20:34:34.299216+0000","last_active":"2023-07-27T20:34:34.302382+0000","last_peered":"2023-07-27T20:34:34.302382+0000","last_clean":"2023-07-27T20:34:34.302382+0000","last_became_active":"2023-07-27T20:34:34.298877+0000","last_became_peered":"2023-07-27T20:34:34.298877+0000","last_unstale":"2023-07-27T20:34:34.302382+0000","last_undegraded":"2023-07-27T20:34:34.302382+0000","last_fullsized":"2023-07-27T20:34:34.302382+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:52:45.049280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"61'8","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.318129+0000","last_change":"2023-07-27T20:34:33.301967+0000","last_active":"2023-07-27T20:34:34.318129+0000","last_peered":"2023-07-27T20:34:34.318129+0000","last_clean":"2023-07-27T20:34:34.318129+0000","last_became_active":"2023-07-27T20:34:33.301702+0000","last_became_peered":"2023-07-27T20:34:33.301702+0000","last_unstale":"2023-07-27T20:34:34.318129+0000","last_undegraded":"2023-07-27T20:34:34.318129+0000","last_fullsized":"2023-07-27T20:34:34.318129+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:07:29.199708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.299032+0000","last_change":"2023-07-27T20:34:34.294954+0000","last_active":"2023-07-27T20:34:34.299032+0000","last_peered":"2023-07-27T20:34:34.299032+0000","last_clean":"2023-07-27T20:34:34.299032+0000","last_became_active":"2023-07-27T20:34:34.294073+0000","last_became_peered":"2023-07-27T20:34:34.294073+0000","last_unstale":"2023-07-27T20:34:34.299032+0000","last_undegraded":"2023-07-27T20:34:34.299032+0000","last_fullsized":"2023-07-27T20:34:34.299032+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:02:09.194367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.320774+0000","last_change":"2023-07-27T20:34:33.308165+0000","last_active":"2023-07-27T20:34:34.320774+0000","last_peered":"2023-07-27T20:34:34.320774+0000","last_clean":"2023-07-27T20:34:34.320774+0000","last_became_active":"2023-07-27T20:34:33.307868+0000","last_became_peered":"2023-07-27T20:34:33.307868+0000","last_unstale":"2023-07-27T20:34:34.320774+0000","last_undegraded":"2023-07-27T20:34:34.320774+0000","last_fullsized":"2023-07-27T20:34:34.320774+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:14:12.091870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.312245+0000","last_change":"2023-07-27T20:34:34.307218+0000","last_active":"2023-07-27T20:34:34.312245+0000","last_peered":"2023-07-27T20:34:34.312245+0000","last_clean":"2023-07-27T20:34:34.312245+0000","last_became_active":"2023-07-27T20:34:34.306781+0000","last_became_peered":"2023-07-27T20:34:34.306781+0000","last_unstale":"2023-07-27T20:34:34.312245+0000","last_undegraded":"2023-07-27T20:34:34.312245+0000","last_fullsized":"2023-07-27T20:34:34.312245+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:10:43.821958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.290750+0000","last_change":"2023-07-27T20:34:33.301802+0000","last_active":"2023-07-27T20:34:34.290750+0000","last_peered":"2023-07-27T20:34:34.290750+0000","last_clean":"2023-07-27T20:34:34.290750+0000","last_became_active":"2023-07-27T20:34:33.301453+0000","last_became_peered":"2023-07-27T20:34:33.301453+0000","last_unstale":"2023-07-27T20:34:34.290750+0000","last_undegraded":"2023-07-27T20:34:34.290750+0000","last_fullsized":"2023-07-27T20:34:34.290750+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:26:04.782458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.329437+0000","last_change":"2023-07-27T20:34:34.325646+0000","last_active":"2023-07-27T20:34:34.329437+0000","last_peered":"2023-07-27T20:34:34.329437+0000","last_clean":"2023-07-27T20:34:34.329437+0000","last_became_active":"2023-07-27T20:34:34.325379+0000","last_became_peered":"2023-07-27T20:34:34.325379+0000","last_unstale":"2023-07-27T20:34:34.329437+0000","last_undegraded":"2023-07-27T20:34:34.329437+0000","last_fullsized":"2023-07-27T20:34:34.329437+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:17:02.646055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.286597+0000","last_change":"2023-07-27T20:34:33.297891+0000","last_active":"2023-07-27T20:34:34.286597+0000","last_peered":"2023-07-27T20:34:34.286597+0000","last_clean":"2023-07-27T20:34:34.286597+0000","last_became_active":"2023-07-27T20:34:33.297052+0000","last_became_peered":"2023-07-27T20:34:33.297052+0000","last_unstale":"2023-07-27T20:34:34.286597+0000","last_undegraded":"2023-07-27T20:34:34.286597+0000","last_fullsized":"2023-07-27T20:34:34.286597+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:58:22.048069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.322451+0000","last_change":"2023-07-27T20:34:34.315817+0000","last_active":"2023-07-27T20:34:34.322451+0000","last_peered":"2023-07-27T20:34:34.322451+0000","last_clean":"2023-07-27T20:34:34.322451+0000","last_became_active":"2023-07-27T20:34:34.315521+0000","last_became_peered":"2023-07-27T20:34:34.315521+0000","last_unstale":"2023-07-27T20:34:34.322451+0000","last_undegraded":"2023-07-27T20:34:34.322451+0000","last_fullsized":"2023-07-27T20:34:34.322451+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:21:45.497838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.283961+0000","last_change":"2023-07-27T20:34:33.303481+0000","last_active":"2023-07-27T20:34:34.283961+0000","last_peered":"2023-07-27T20:34:34.283961+0000","last_clean":"2023-07-27T20:34:34.283961+0000","last_became_active":"2023-07-27T20:34:33.303145+0000","last_became_peered":"2023-07-27T20:34:33.303145+0000","last_unstale":"2023-07-27T20:34:34.283961+0000","last_undegraded":"2023-07-27T20:34:34.283961+0000","last_fullsized":"2023-07-27T20:34:34.283961+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:35:21.613222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.309038+0000","last_change":"2023-07-27T20:34:34.304160+0000","last_active":"2023-07-27T20:34:34.309038+0000","last_peered":"2023-07-27T20:34:34.309038+0000","last_clean":"2023-07-27T20:34:34.309038+0000","last_became_active":"2023-07-27T20:34:34.303895+0000","last_became_peered":"2023-07-27T20:34:34.303895+0000","last_unstale":"2023-07-27T20:34:34.309038+0000","last_undegraded":"2023-07-27T20:34:34.309038+0000","last_fullsized":"2023-07-27T20:34:34.309038+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:12:27.476800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.286778+0000","last_change":"2023-07-27T20:34:33.308129+0000","last_active":"2023-07-27T20:34:34.286778+0000","last_peered":"2023-07-27T20:34:34.286778+0000","last_clean":"2023-07-27T20:34:34.286778+0000","last_became_active":"2023-07-27T20:34:33.307849+0000","last_became_peered":"2023-07-27T20:34:33.307849+0000","last_unstale":"2023-07-27T20:34:34.286778+0000","last_undegraded":"2023-07-27T20:34:34.286778+0000","last_fullsized":"2023-07-27T20:34:34.286778+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:21:38.209651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.326513+0000","last_change":"2023-07-27T20:34:34.323167+0000","last_active":"2023-07-27T20:34:34.326513+0000","last_peered":"2023-07-27T20:34:34.326513+0000","last_clean":"2023-07-27T20:34:34.326513+0000","last_became_active":"2023-07-27T20:34:34.322891+0000","last_became_peered":"2023-07-27T20:34:34.322891+0000","last_unstale":"2023-07-27T20:34:34.326513+0000","last_undegraded":"2023-07-27T20:34:34.326513+0000","last_fullsized":"2023-07-27T20:34:34.326513+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:26:30.304005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.288597+0000","last_change":"2023-07-27T20:34:33.303415+0000","last_active":"2023-07-27T20:34:34.288597+0000","last_peered":"2023-07-27T20:34:34.288597+0000","last_clean":"2023-07-27T20:34:34.288597+0000","last_became_active":"2023-07-27T20:34:33.303145+0000","last_became_peered":"2023-07-27T20:34:33.303145+0000","last_unstale":"2023-07-27T20:34:34.288597+0000","last_undegraded":"2023-07-27T20:34:34.288597+0000","last_fullsized":"2023-07-27T20:34:34.288597+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:14:49.830528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.304776+0000","last_change":"2023-07-27T20:34:34.298297+0000","last_active":"2023-07-27T20:34:34.304776+0000","last_peered":"2023-07-27T20:34:34.304776+0000","last_clean":"2023-07-27T20:34:34.304776+0000","last_became_active":"2023-07-27T20:34:34.297997+0000","last_became_peered":"2023-07-27T20:34:34.297997+0000","last_unstale":"2023-07-27T20:34:34.304776+0000","last_undegraded":"2023-07-27T20:34:34.304776+0000","last_fullsized":"2023-07-27T20:34:34.304776+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:28:11.560691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.286548+0000","last_change":"2023-07-27T20:34:33.301354+0000","last_active":"2023-07-27T20:34:34.286548+0000","last_peered":"2023-07-27T20:34:34.286548+0000","last_clean":"2023-07-27T20:34:34.286548+0000","last_became_active":"2023-07-27T20:34:33.301082+0000","last_became_peered":"2023-07-27T20:34:33.301082+0000","last_unstale":"2023-07-27T20:34:34.286548+0000","last_undegraded":"2023-07-27T20:34:34.286548+0000","last_fullsized":"2023-07-27T20:34:34.286548+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:32:31.509897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.325279+0000","last_change":"2023-07-27T20:34:34.321962+0000","last_active":"2023-07-27T20:34:34.325279+0000","last_peered":"2023-07-27T20:34:34.325279+0000","last_clean":"2023-07-27T20:34:34.325279+0000","last_became_active":"2023-07-27T20:34:34.321611+0000","last_became_peered":"2023-07-27T20:34:34.321611+0000","last_unstale":"2023-07-27T20:34:34.325279+0000","last_undegraded":"2023-07-27T20:34:34.325279+0000","last_fullsized":"2023-07-27T20:34:34.325279+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:04:33.468676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.306552+0000","last_change":"2023-07-27T20:34:33.305936+0000","last_active":"2023-07-27T20:34:34.306552+0000","last_peered":"2023-07-27T20:34:34.306552+0000","last_clean":"2023-07-27T20:34:34.306552+0000","last_became_active":"2023-07-27T20:34:33.305405+0000","last_became_peered":"2023-07-27T20:34:33.305405+0000","last_unstale":"2023-07-27T20:34:34.306552+0000","last_undegraded":"2023-07-27T20:34:34.306552+0000","last_fullsized":"2023-07-27T20:34:34.306552+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:14:13.977192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.310800+0000","last_change":"2023-07-27T20:34:34.306247+0000","last_active":"2023-07-27T20:34:34.310800+0000","last_peered":"2023-07-27T20:34:34.310800+0000","last_clean":"2023-07-27T20:34:34.310800+0000","last_became_active":"2023-07-27T20:34:34.305974+0000","last_became_peered":"2023-07-27T20:34:34.305974+0000","last_unstale":"2023-07-27T20:34:34.310800+0000","last_undegraded":"2023-07-27T20:34:34.310800+0000","last_fullsized":"2023-07-27T20:34:34.310800+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:34:56.933539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.320714+0000","last_change":"2023-07-27T20:34:33.308128+0000","last_active":"2023-07-27T20:34:34.320714+0000","last_peered":"2023-07-27T20:34:34.320714+0000","last_clean":"2023-07-27T20:34:34.320714+0000","last_became_active":"2023-07-27T20:34:33.307832+0000","last_became_peered":"2023-07-27T20:34:33.307832+0000","last_unstale":"2023-07-27T20:34:34.320714+0000","last_undegraded":"2023-07-27T20:34:34.320714+0000","last_fullsized":"2023-07-27T20:34:34.320714+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:13:23.865414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.293655+0000","last_change":"2023-07-27T20:31:22.846540+0000","last_active":"2023-07-27T20:34:34.293655+0000","last_peered":"2023-07-27T20:34:34.293655+0000","last_clean":"2023-07-27T20:34:34.293655+0000","last_became_active":"2023-07-27T20:31:22.846128+0000","last_became_peered":"2023-07-27T20:31:22.846128+0000","last_unstale":"2023-07-27T20:34:34.293655+0000","last_undegraded":"2023-07-27T20:34:34.293655+0000","last_fullsized":"2023-07-27T20:34:34.293655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:01:11.796940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.315436+0000","last_change":"2023-07-27T20:34:34.311641+0000","last_active":"2023-07-27T20:34:34.315436+0000","last_peered":"2023-07-27T20:34:34.315436+0000","last_clean":"2023-07-27T20:34:34.315436+0000","last_became_active":"2023-07-27T20:34:34.311381+0000","last_became_peered":"2023-07-27T20:34:34.311381+0000","last_unstale":"2023-07-27T20:34:34.315436+0000","last_undegraded":"2023-07-27T20:34:34.315436+0000","last_fullsized":"2023-07-27T20:34:34.315436+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:05:28.688422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.319409+0000","last_change":"2023-07-27T20:34:33.303573+0000","last_active":"2023-07-27T20:34:34.319409+0000","last_peered":"2023-07-27T20:34:34.319409+0000","last_clean":"2023-07-27T20:34:34.319409+0000","last_became_active":"2023-07-27T20:34:33.303293+0000","last_became_peered":"2023-07-27T20:34:33.303293+0000","last_unstale":"2023-07-27T20:34:34.319409+0000","last_undegraded":"2023-07-27T20:34:34.319409+0000","last_fullsized":"2023-07-27T20:34:34.319409+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:07:45.690447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.288942+0000","last_change":"2023-07-27T20:31:22.845641+0000","last_active":"2023-07-27T20:34:34.288942+0000","last_peered":"2023-07-27T20:34:34.288942+0000","last_clean":"2023-07-27T20:34:34.288942+0000","last_became_active":"2023-07-27T20:31:22.845368+0000","last_became_peered":"2023-07-27T20:31:22.845368+0000","last_unstale":"2023-07-27T20:34:34.288942+0000","last_undegraded":"2023-07-27T20:34:34.288942+0000","last_fullsized":"2023-07-27T20:34:34.288942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:29:33.977286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.304791+0000","last_change":"2023-07-27T20:34:34.296863+0000","last_active":"2023-07-27T20:34:34.304791+0000","last_peered":"2023-07-27T20:34:34.304791+0000","last_clean":"2023-07-27T20:34:34.304791+0000","last_became_active":"2023-07-27T20:34:34.296556+0000","last_became_peered":"2023-07-27T20:34:34.296556+0000","last_unstale":"2023-07-27T20:34:34.304791+0000","last_undegraded":"2023-07-27T20:34:34.304791+0000","last_fullsized":"2023-07-27T20:34:34.304791+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:14:47.785611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.316290+0000","last_change":"2023-07-27T20:34:33.303035+0000","last_active":"2023-07-27T20:34:34.316290+0000","last_peered":"2023-07-27T20:34:34.316290+0000","last_clean":"2023-07-27T20:34:34.316290+0000","last_became_active":"2023-07-27T20:34:33.302764+0000","last_became_peered":"2023-07-27T20:34:33.302764+0000","last_unstale":"2023-07-27T20:34:34.316290+0000","last_undegraded":"2023-07-27T20:34:34.316290+0000","last_fullsized":"2023-07-27T20:34:34.316290+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:25:33.904459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.307144+0000","last_change":"2023-07-27T20:31:22.848025+0000","last_active":"2023-07-27T20:34:34.307144+0000","last_peered":"2023-07-27T20:34:34.307144+0000","last_clean":"2023-07-27T20:34:34.307144+0000","last_became_active":"2023-07-27T20:31:22.847603+0000","last_became_peered":"2023-07-27T20:31:22.847603+0000","last_unstale":"2023-07-27T20:34:34.307144+0000","last_undegraded":"2023-07-27T20:34:34.307144+0000","last_fullsized":"2023-07-27T20:34:34.307144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:09:35.963326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.320272+0000","last_change":"2023-07-27T20:34:34.315837+0000","last_active":"2023-07-27T20:34:34.320272+0000","last_peered":"2023-07-27T20:34:34.320272+0000","last_clean":"2023-07-27T20:34:34.320272+0000","last_became_active":"2023-07-27T20:34:34.315452+0000","last_became_peered":"2023-07-27T20:34:34.315452+0000","last_unstale":"2023-07-27T20:34:34.320272+0000","last_undegraded":"2023-07-27T20:34:34.320272+0000","last_fullsized":"2023-07-27T20:34:34.320272+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:56:42.150862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.282181+0000","last_change":"2023-07-27T20:34:33.298534+0000","last_active":"2023-07-27T20:34:34.282181+0000","last_peered":"2023-07-27T20:34:34.282181+0000","last_clean":"2023-07-27T20:34:34.282181+0000","last_became_active":"2023-07-27T20:34:33.298170+0000","last_became_peered":"2023-07-27T20:34:33.298170+0000","last_unstale":"2023-07-27T20:34:34.282181+0000","last_undegraded":"2023-07-27T20:34:34.282181+0000","last_fullsized":"2023-07-27T20:34:34.282181+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:14:22.083030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.292321+0000","last_change":"2023-07-27T20:31:22.848181+0000","last_active":"2023-07-27T20:34:34.292321+0000","last_peered":"2023-07-27T20:34:34.292321+0000","last_clean":"2023-07-27T20:34:34.292321+0000","last_became_active":"2023-07-27T20:31:22.847865+0000","last_became_peered":"2023-07-27T20:31:22.847865+0000","last_unstale":"2023-07-27T20:34:34.292321+0000","last_undegraded":"2023-07-27T20:34:34.292321+0000","last_fullsized":"2023-07-27T20:34:34.292321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:13:10.801898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.323866+0000","last_change":"2023-07-27T20:34:34.320803+0000","last_active":"2023-07-27T20:34:34.323866+0000","last_peered":"2023-07-27T20:34:34.323866+0000","last_clean":"2023-07-27T20:34:34.323866+0000","last_became_active":"2023-07-27T20:34:34.320444+0000","last_became_peered":"2023-07-27T20:34:34.320444+0000","last_unstale":"2023-07-27T20:34:34.323866+0000","last_undegraded":"2023-07-27T20:34:34.323866+0000","last_fullsized":"2023-07-27T20:34:34.323866+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:46:52.049065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.321060+0000","last_change":"2023-07-27T20:34:33.306873+0000","last_active":"2023-07-27T20:34:34.321060+0000","last_peered":"2023-07-27T20:34:34.321060+0000","last_clean":"2023-07-27T20:34:34.321060+0000","last_became_active":"2023-07-27T20:34:33.306519+0000","last_became_peered":"2023-07-27T20:34:33.306519+0000","last_unstale":"2023-07-27T20:34:34.321060+0000","last_undegraded":"2023-07-27T20:34:34.321060+0000","last_fullsized":"2023-07-27T20:34:34.321060+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:27:44.351248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":246,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.292842+0000","last_change":"2023-07-27T20:31:15.812727+0000","last_active":"2023-07-27T20:34:34.292842+0000","last_peered":"2023-07-27T20:34:34.292842+0000","last_clean":"2023-07-27T20:34:34.292842+0000","last_became_active":"2023-07-27T20:31:15.811803+0000","last_became_peered":"2023-07-27T20:31:15.811803+0000","last_unstale":"2023-07-27T20:34:34.292842+0000","last_undegraded":"2023-07-27T20:34:34.292842+0000","last_fullsized":"2023-07-27T20:34:34.292842+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:14.789257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:14.789257+0000","last_clean_scrub_stamp":"2023-07-27T20:31:14.789257+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:54:08.738278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":84,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.290127+0000","last_change":"2023-07-27T20:31:22.847766+0000","last_active":"2023-07-27T20:34:34.290127+0000","last_peered":"2023-07-27T20:34:34.290127+0000","last_clean":"2023-07-27T20:34:34.290127+0000","last_became_active":"2023-07-27T20:31:22.847396+0000","last_became_peered":"2023-07-27T20:31:22.847396+0000","last_unstale":"2023-07-27T20:34:34.290127+0000","last_undegraded":"2023-07-27T20:34:34.290127+0000","last_fullsized":"2023-07-27T20:34:34.290127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:42:31.232372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.323851+0000","last_change":"2023-07-27T20:34:34.320690+0000","last_active":"2023-07-27T20:34:34.323851+0000","last_peered":"2023-07-27T20:34:34.323851+0000","last_clean":"2023-07-27T20:34:34.323851+0000","last_became_active":"2023-07-27T20:34:34.320232+0000","last_became_peered":"2023-07-27T20:34:34.320232+0000","last_unstale":"2023-07-27T20:34:34.323851+0000","last_undegraded":"2023-07-27T20:34:34.323851+0000","last_fullsized":"2023-07-27T20:34:34.323851+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:12:23.304991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.289091+0000","last_change":"2023-07-27T20:34:33.308050+0000","last_active":"2023-07-27T20:34:34.289091+0000","last_peered":"2023-07-27T20:34:34.289091+0000","last_clean":"2023-07-27T20:34:34.289091+0000","last_became_active":"2023-07-27T20:34:33.307761+0000","last_became_peered":"2023-07-27T20:34:33.307761+0000","last_unstale":"2023-07-27T20:34:34.289091+0000","last_undegraded":"2023-07-27T20:34:34.289091+0000","last_fullsized":"2023-07-27T20:34:34.289091+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:47:41.714760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":84,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.286647+0000","last_change":"2023-07-27T20:31:22.959811+0000","last_active":"2023-07-27T20:34:34.286647+0000","last_peered":"2023-07-27T20:34:34.286647+0000","last_clean":"2023-07-27T20:34:34.286647+0000","last_became_active":"2023-07-27T20:31:22.959449+0000","last_became_peered":"2023-07-27T20:31:22.959449+0000","last_unstale":"2023-07-27T20:34:34.286647+0000","last_undegraded":"2023-07-27T20:34:34.286647+0000","last_fullsized":"2023-07-27T20:34:34.286647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:17:22.777317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.307279+0000","last_change":"2023-07-27T20:34:34.301811+0000","last_active":"2023-07-27T20:34:34.307279+0000","last_peered":"2023-07-27T20:34:34.307279+0000","last_clean":"2023-07-27T20:34:34.307279+0000","last_became_active":"2023-07-27T20:34:34.301525+0000","last_became_peered":"2023-07-27T20:34:34.301525+0000","last_unstale":"2023-07-27T20:34:34.307279+0000","last_undegraded":"2023-07-27T20:34:34.307279+0000","last_fullsized":"2023-07-27T20:34:34.307279+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:11:10.950594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.311652+0000","last_change":"2023-07-27T20:34:33.301467+0000","last_active":"2023-07-27T20:34:34.311652+0000","last_peered":"2023-07-27T20:34:34.311652+0000","last_clean":"2023-07-27T20:34:34.311652+0000","last_became_active":"2023-07-27T20:34:33.301160+0000","last_became_peered":"2023-07-27T20:34:33.301160+0000","last_unstale":"2023-07-27T20:34:34.311652+0000","last_undegraded":"2023-07-27T20:34:34.311652+0000","last_fullsized":"2023-07-27T20:34:34.311652+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:42:47.032613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":84,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.289751+0000","last_change":"2023-07-27T20:31:22.849178+0000","last_active":"2023-07-27T20:34:34.289751+0000","last_peered":"2023-07-27T20:34:34.289751+0000","last_clean":"2023-07-27T20:34:34.289751+0000","last_became_active":"2023-07-27T20:31:22.848856+0000","last_became_peered":"2023-07-27T20:31:22.848856+0000","last_unstale":"2023-07-27T20:34:34.289751+0000","last_undegraded":"2023-07-27T20:34:34.289751+0000","last_fullsized":"2023-07-27T20:34:34.289751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:21:36.623008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.300538+0000","last_change":"2023-07-27T20:34:34.296711+0000","last_active":"2023-07-27T20:34:34.300538+0000","last_peered":"2023-07-27T20:34:34.300538+0000","last_clean":"2023-07-27T20:34:34.300538+0000","last_became_active":"2023-07-27T20:34:34.296442+0000","last_became_peered":"2023-07-27T20:34:34.296442+0000","last_unstale":"2023-07-27T20:34:34.300538+0000","last_undegraded":"2023-07-27T20:34:34.300538+0000","last_fullsized":"2023-07-27T20:34:34.300538+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:24:31.176079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.295975+0000","last_change":"2023-07-27T20:34:33.304301+0000","last_active":"2023-07-27T20:34:34.295975+0000","last_peered":"2023-07-27T20:34:34.295975+0000","last_clean":"2023-07-27T20:34:34.295975+0000","last_became_active":"2023-07-27T20:34:33.303739+0000","last_became_peered":"2023-07-27T20:34:33.303739+0000","last_unstale":"2023-07-27T20:34:34.295975+0000","last_undegraded":"2023-07-27T20:34:34.295975+0000","last_fullsized":"2023-07-27T20:34:34.295975+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:48:25.070555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.289027+0000","last_change":"2023-07-27T20:31:22.848698+0000","last_active":"2023-07-27T20:34:34.289027+0000","last_peered":"2023-07-27T20:34:34.289027+0000","last_clean":"2023-07-27T20:34:34.289027+0000","last_became_active":"2023-07-27T20:31:22.848346+0000","last_became_peered":"2023-07-27T20:31:22.848346+0000","last_unstale":"2023-07-27T20:34:34.289027+0000","last_undegraded":"2023-07-27T20:34:34.289027+0000","last_fullsized":"2023-07-27T20:34:34.289027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:00:10.424812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28332,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343508,"statfs":{"total":96636764160,"available":96607752192,"internally_reserved":0,"allocated":1339392,"data_stored":941725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.75800000000000001,"15min":0.80300000000000005},"min":{"1min":0.42499999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90000000000000002,"5min":3.5609999999999999,"15min":3.5609999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.70799999999999996,"15min":0.72699999999999998},"min":{"1min":0.39500000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88800000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.67900000000000005}]},{"osd":1,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.69599999999999995,"15min":0.71599999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.84999999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.81000000000000005,"15min":0.86399999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.86699999999999999,"5min":3.927,"15min":3.927},"last":0.749}]},{"osd":2,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.80200000000000005,"15min":0.84099999999999997},"min":{"1min":0.47099999999999997,"5min":0.443,"15min":0.443},"max":{"1min":0.86699999999999999,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":0.62},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.76500000000000001,"15min":0.80900000000000005},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85799999999999998,"5min":2.093,"15min":2.093},"last":0.79600000000000004}]},{"osd":3,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.76000000000000001,"15min":0.81200000000000006},"min":{"1min":0.46000000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.76600000000000001,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.85099999999999998,"15min":0.90100000000000002},"min":{"1min":0.57399999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.94099999999999995,"5min":3.1080000000000001,"15min":3.1080000000000001},"last":0.67000000000000004}]},{"osd":4,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.754,"15min":0.78800000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.91100000000000003,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.79800000000000004,"15min":0.83399999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.85799999999999998,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.69199999999999995}]},{"osd":5,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.90600000000000003,"15min":0.999},"min":{"1min":0.47899999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.91400000000000003,"5min":6.1619999999999999,"15min":6.1619999999999999},"last":0.497},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.94299999999999995,"15min":1.042},"min":{"1min":0.432,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96499999999999997,"5min":6.2729999999999997,"15min":6.2729999999999997},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.81799999999999995,"15min":0.84599999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.075,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.84699999999999998,"15min":0.90500000000000003},"min":{"1min":0.52900000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93799999999999994,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":0.59799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":745472,"data_stored":350833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.67700000000000005,"15min":0.68899999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.871,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.66300000000000003,"15min":0.66800000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.85499999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.67700000000000005}]},{"osd":1,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69999999999999996,"15min":0.72199999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84399999999999997,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70099999999999996,"15min":0.70799999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.85499999999999998,"5min":1.266,"15min":1.266},"last":0.56000000000000005}]},{"osd":2,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.69499999999999995,"15min":0.71799999999999997},"min":{"1min":0.51100000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83899999999999997,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.439},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.747,"15min":0.76300000000000001},"min":{"1min":0.56499999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.90200000000000002,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.72899999999999998,"15min":0.745},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.84199999999999997,"5min":1.377,"15min":1.377},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.73299999999999998,"15min":0.75700000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92800000000000005,"5min":1.736,"15min":1.736},"last":0.52200000000000002}]},{"osd":4,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69599999999999995,"15min":0.69799999999999995},"min":{"1min":0.47099999999999997,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90300000000000002,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69699999999999995,"15min":0.69299999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.95599999999999996,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.61799999999999999}]},{"osd":5,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.67100000000000004,"15min":0.66500000000000004},"min":{"1min":0.47799999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.88600000000000001,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.74099999999999999,"15min":0.73199999999999998},"min":{"1min":0.45100000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93700000000000006,"5min":1.081,"15min":1.081},"last":0.60599999999999998}]},{"osd":7,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.749,"15min":0.753},"min":{"1min":0.496,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.94699999999999995,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.73999999999999999,"15min":0.73599999999999999},"min":{"1min":0.59499999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97599999999999998,"5min":1.119,"15min":1.119},"last":0.58999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":724992,"data_stored":343293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40899999999999997,"15min":0.40600000000000003},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47199999999999998,"15min":0.47899999999999998},"min":{"1min":0.32300000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44,"15min":0.436},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.47599999999999998,"15min":0.47399999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.47899999999999998}]},{"osd":3,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53400000000000003,"15min":0.53200000000000003},"min":{"1min":0.39400000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.502,"15min":0.504},"min":{"1min":0.374,"5min":0.31,"15min":0.31},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.498}]},{"osd":4,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73499999999999999,"15min":0.745},"min":{"1min":0.56699999999999995,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73599999999999999,"15min":0.73199999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.72499999999999998}]},{"osd":5,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72299999999999998,"15min":0.73199999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.76200000000000001,"15min":0.75700000000000001},"min":{"1min":0.623,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.9630000000000001,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":0.94199999999999995}]},{"osd":6,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.77500000000000002,"15min":0.79500000000000004},"min":{"1min":0.53600000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1419999999999999,"5min":1.347,"15min":1.347},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.80400000000000005,"15min":0.81999999999999995},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.206,"5min":1.409,"15min":1.409},"last":0.86499999999999999}]},{"osd":7,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.77100000000000002,"15min":0.77700000000000002},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.95099999999999996,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78800000000000003,"15min":0.80300000000000005},"min":{"1min":0.55400000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.90900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574892,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28312,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343528,"statfs":{"total":96636764160,"available":96607772672,"internally_reserved":0,"allocated":1318912,"data_stored":933661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.38700000000000001,"15min":0.39100000000000001},"min":{"1min":0.27700000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.46000000000000002,"15min":0.46400000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.314}]},{"osd":2,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47999999999999998,"15min":0.48899999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.60399999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.44800000000000001,"15min":0.45400000000000001},"min":{"1min":0.34200000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.439}]},{"osd":3,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46600000000000003,"15min":0.47099999999999997},"min":{"1min":0.35299999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.65900000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53200000000000003,"15min":0.54200000000000004},"min":{"1min":0.40699999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.63400000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.46100000000000002}]},{"osd":4,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70499999999999996,"15min":0.71199999999999997},"min":{"1min":0.55900000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0529999999999999,"5min":1.069,"15min":1.069},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.71799999999999997,"15min":0.73199999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97799999999999998,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.70499999999999996}]},{"osd":5,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.73099999999999998,"15min":0.745},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.90000000000000002,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.73499999999999999,"15min":0.751},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0940000000000001,"5min":1.196,"15min":1.196},"last":0.71999999999999997}]},{"osd":6,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.72199999999999998,"15min":0.73599999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0129999999999999,"5min":1.05,"15min":1.05},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.755,"15min":0.77600000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.88400000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.80200000000000005}]},{"osd":7,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.752,"15min":0.76900000000000002},"min":{"1min":0.54800000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.755,"15min":0.77200000000000002},"min":{"1min":0.58199999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.73199999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":724992,"data_stored":343293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45700000000000002,"15min":0.48099999999999998},"min":{"1min":0.29799999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.54700000000000004,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.624,"15min":0.70999999999999996},"min":{"1min":0.32500000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70099999999999996,"5min":3.2999999999999998,"15min":3.2999999999999998},"last":0.38300000000000001}]},{"osd":1,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.56000000000000005,"15min":0.61499999999999999},"min":{"1min":0.309,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.67200000000000004,"5min":3.0600000000000001,"15min":3.0600000000000001},"last":0.435},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.60999999999999999,"15min":0.67000000000000004},"min":{"1min":0.36499999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.623,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.42499999999999999}]},{"osd":3,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.86399999999999999,"15min":1.036},"min":{"1min":0.40000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72099999999999997,"5min":9.2200000000000006,"15min":9.2200000000000006},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.57099999999999995,"15min":0.59499999999999997},"min":{"1min":0.40799999999999997,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.66600000000000004,"5min":1.552,"15min":1.552},"last":0.40799999999999997}]},{"osd":4,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.85999999999999999,"15min":0.92600000000000005},"min":{"1min":0.52200000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0049999999999999,"5min":4.2930000000000001,"15min":4.2930000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.75600000000000001,"15min":0.77900000000000003},"min":{"1min":0.55400000000000005,"5min":0.499,"15min":0.499},"max":{"1min":0.93999999999999995,"5min":1.24,"15min":1.24},"last":0.56899999999999995}]},{"osd":5,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.754,"15min":0.76900000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98399999999999999,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.627},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.84699999999999998,"15min":0.90700000000000003},"min":{"1min":0.53800000000000003,"5min":0.5,"15min":0.5},"max":{"1min":0.90700000000000003,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.88300000000000001,"15min":0.94399999999999995},"min":{"1min":0.55300000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.024,"5min":3.3999999999999999,"15min":3.3999999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.91300000000000003,"15min":0.99099999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.97199999999999998,"5min":3.4990000000000001,"15min":3.4990000000000001},"last":0.71399999999999997}]},{"osd":7,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.81100000000000005,"15min":0.84499999999999997},"min":{"1min":0.58199999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.95199999999999996,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.86099999999999999,"15min":0.89700000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.95999999999999996,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.73699999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":724992,"data_stored":343293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.44900000000000001,"15min":0.47099999999999997},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.626,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.51600000000000001,"15min":0.54400000000000004},"min":{"1min":0.309,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.627,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":0.315}]},{"osd":1,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.47699999999999998,"15min":0.5},"min":{"1min":0.33400000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.55400000000000005,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.498},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.52900000000000003,"15min":0.56699999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.63,"5min":1.788,"15min":1.788},"last":0.38700000000000001}]},{"osd":2,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.56200000000000006,"15min":0.59199999999999997},"min":{"1min":0.41699999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.73299999999999998,"5min":2.117,"15min":2.117},"last":0.443},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59999999999999998,"15min":0.63400000000000001},"min":{"1min":0.42999999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.68400000000000005,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71899999999999997,"15min":0.72199999999999998},"min":{"1min":0.53800000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0249999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.79000000000000004,"15min":0.81399999999999995},"min":{"1min":0.53000000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.95199999999999996,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.66400000000000003}]},{"osd":5,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.72499999999999998,"15min":0.73299999999999998},"min":{"1min":0.505,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92200000000000004,"5min":1.125,"15min":1.125},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.79400000000000004,"15min":0.82799999999999996},"min":{"1min":0.54200000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0569999999999999,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.78600000000000003,"15min":0.81299999999999994},"min":{"1min":0.59199999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93100000000000005,"5min":1.758,"15min":1.758},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.80900000000000005,"15min":0.83499999999999996},"min":{"1min":0.55000000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.095,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.81599999999999995,"15min":0.84799999999999998},"min":{"1min":0.55400000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0289999999999999,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.625},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.75800000000000001,"15min":0.76700000000000002},"min":{"1min":0.59099999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.99199999999999999,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.68700000000000006}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":724992,"data_stored":343293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.69699999999999995,"15min":0.69799999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.84299999999999997,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70699999999999996,"15min":0.71199999999999997},"min":{"1min":0.53900000000000003,"5min":0.5,"15min":0.5},"max":{"1min":0.86499999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.59999999999999998}]},{"osd":1,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.52200000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.874,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73499999999999999,"15min":0.73799999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88900000000000001,"5min":1.002,"15min":1.002},"last":0.754}]},{"osd":2,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.67500000000000004,"15min":0.66900000000000004},"min":{"1min":0.504,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81899999999999995,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68899999999999995,"15min":0.69499999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.93700000000000006,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.64000000000000001}]},{"osd":3,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.73099999999999998,"15min":0.751},"min":{"1min":0.49299999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91300000000000003,"5min":1.645,"15min":1.645},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.747,"15min":0.75900000000000001},"min":{"1min":0.51700000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96899999999999997,"5min":1.708,"15min":1.708},"last":0.68999999999999995}]},{"osd":5,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61799999999999999,"15min":0.61699999999999999},"min":{"1min":0.41499999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84499999999999997,"5min":1.113,"15min":1.113},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68799999999999994,"15min":0.69499999999999995},"min":{"1min":0.502,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91200000000000003,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70599999999999996,"15min":0.70699999999999996},"min":{"1min":0.48299999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.92100000000000004,"5min":1.127,"15min":1.127},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.74099999999999999,"15min":0.74199999999999999},"min":{"1min":0.442,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0009999999999999,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.78300000000000003}]},{"osd":7,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.54700000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.98499999999999999,"5min":1.198,"15min":1.198},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.81299999999999994,"15min":0.81699999999999995},"min":{"1min":0.65300000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":0.96299999999999997,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.73699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":741376,"data_stored":350831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.65300000000000002,"15min":0.629},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.85499999999999998,"5min":4.0510000000000002,"15min":4.0510000000000002},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.71299999999999997,"15min":0.67900000000000005},"min":{"1min":0.39300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.94899999999999995,"5min":6.431,"15min":6.431},"last":0.70499999999999996}]},{"osd":1,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.68300000000000005,"15min":0.65500000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.91300000000000003,"5min":5.3330000000000002,"15min":5.3330000000000002},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.69499999999999995,"15min":0.67100000000000004},"min":{"1min":0.47299999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.81299999999999994,"5min":4.2169999999999996,"15min":4.2169999999999996},"last":0.751}]},{"osd":2,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.70699999999999996,"15min":0.66500000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.94799999999999995,"5min":6.4850000000000003,"15min":6.4850000000000003},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.68200000000000005,"15min":0.66200000000000003},"min":{"1min":0.48099999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.80800000000000005,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":0.73299999999999998}]},{"osd":3,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.749,"15min":0.73899999999999999},"min":{"1min":0.44900000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89500000000000002,"5min":4.7809999999999997,"15min":4.7809999999999997},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.76100000000000001,"15min":0.73799999999999999},"min":{"1min":0.55100000000000005,"5min":0.503,"15min":0.503},"max":{"1min":0.86299999999999999,"5min":5.423,"15min":5.423},"last":0.79100000000000004}]},{"osd":4,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.67200000000000004,"15min":0.65500000000000003},"min":{"1min":0.432,"5min":0.375,"15min":0.375},"max":{"1min":0.879,"5min":3.988,"15min":3.988},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.749,"15min":0.72699999999999998},"min":{"1min":0.46100000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.84599999999999997,"5min":4.827,"15min":4.827},"last":0.502}]},{"osd":6,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.77800000000000002,"15min":0.73199999999999998},"min":{"1min":0.53600000000000003,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.92000000000000004,"5min":7.7000000000000002,"15min":7.7000000000000002},"last":0.63},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.75,"15min":0.72799999999999998},"min":{"1min":0.53000000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91900000000000004,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":0.53600000000000003}]},{"osd":7,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.83199999999999996,"15min":0.78000000000000003},"min":{"1min":0.52300000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.91900000000000004,"5min":9.1180000000000003,"15min":9.1180000000000003},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.82699999999999996,"15min":0.80100000000000005},"min":{"1min":0.53700000000000003,"5min":0.505,"15min":0.505},"max":{"1min":0.91900000000000004,"5min":5.2880000000000003,"15min":5.2880000000000003},"last":0.68100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T20:34:38.668 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T20:34:38.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.907+0000 7fa57adff700 1 Processor -- start 2023-07-27T20:34:38.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.907+0000 7fa57adff700 1 -- start start 2023-07-27T20:34:38.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.908+0000 7fa57adff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa57413b2c0 0x7fa5740aa420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:38.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.908+0000 7fa57adff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5740bfd90 0x7fa5740aa960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:38.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.908+0000 7fa57adff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5740aaea0 con 0x7fa5740a83a0 2023-07-27T20:34:38.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.908+0000 7fa57adff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5740a9620 con 0x7fa57413b2c0 2023-07-27T20:34:38.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.908+0000 7fa57adff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa574155600 con 0x7fa5740bfd90 2023-07-27T20:34:38.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.908+0000 7fa578b9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa57413b2c0 0x7fa5740aa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:38.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.909+0000 7fa578b9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa57413b2c0 0x7fa5740aa420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52440/0 (socket says 172.21.15.72:52440) 2023-07-27T20:34:38.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.909+0000 7fa578b9b700 1 -- 172.21.15.72:0/866556170 learned_addr learned my addr 172.21.15.72:0/866556170 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:38.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.909+0000 7fa573fff700 1 --2- 172.21.15.72:0/866556170 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5740bfd90 0x7fa5740aa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:38.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.909+0000 7fa578b9b700 1 -- 172.21.15.72:0/866556170 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5740bfd90 msgr2=0x7fa5740aa960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:38.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.909+0000 7fa578b9b700 1 --2- 172.21.15.72:0/866556170 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5740bfd90 0x7fa5740aa960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:38.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.909+0000 7fa578b9b700 1 -- 172.21.15.72:0/866556170 >> v1:172.21.15.173:6789/0 conn(0x7fa5740a83a0 legacy=0x7fa5740a8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:38.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.909+0000 7fa578b9b700 1 -- 172.21.15.72:0/866556170 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa574155320 con 0x7fa57413b2c0 2023-07-27T20:34:38.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.909+0000 7fa573fff700 1 --2- 172.21.15.72:0/866556170 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5740bfd90 0x7fa5740aa960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:38.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.909+0000 7fa578b9b700 1 --2- 172.21.15.72:0/866556170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa57413b2c0 0x7fa5740aa420 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fa568009e50 tx=0x7fa56800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b08dfbe7b10de9a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:38.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.909+0000 7fa5737fe700 1 -- 172.21.15.72:0/866556170 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56800e070 con 0x7fa57413b2c0 2023-07-27T20:34:38.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.909+0000 7fa5737fe700 1 -- 172.21.15.72:0/866556170 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56800b9c0 con 0x7fa57413b2c0 2023-07-27T20:34:38.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.909+0000 7fa5737fe700 1 -- 172.21.15.72:0/866556170 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56800bd70 con 0x7fa57413b2c0 2023-07-27T20:34:38.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.910+0000 7fa57adff700 1 -- 172.21.15.72:0/866556170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa57413b2c0 msgr2=0x7fa5740aa420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:38.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.910+0000 7fa57adff700 1 --2- 172.21.15.72:0/866556170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa57413b2c0 0x7fa5740aa420 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fa568009e50 tx=0x7fa56800b330 comp rx=0 tx=0).stop 2023-07-27T20:34:38.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.910+0000 7fa57adff700 1 -- 172.21.15.72:0/866556170 shutdown_connections 2023-07-27T20:34:38.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.910+0000 7fa57adff700 1 --2- 172.21.15.72:0/866556170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa57413b2c0 0x7fa5740aa420 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:38.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.910+0000 7fa57adff700 1 --2- 172.21.15.72:0/866556170 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5740bfd90 0x7fa5740aa960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:38.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.910+0000 7fa57adff700 1 -- 172.21.15.72:0/866556170 >> 172.21.15.72:0/866556170 conn(0x7fa57406a190 msgr2=0x7fa57406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:38.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.910+0000 7fa57adff700 1 -- 172.21.15.72:0/866556170 shutdown_connections 2023-07-27T20:34:38.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.910+0000 7fa57adff700 1 -- 172.21.15.72:0/866556170 wait complete. 2023-07-27T20:34:38.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.912+0000 7fa57adff700 1 Processor -- start 2023-07-27T20:34:38.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.912+0000 7fa57adff700 1 -- start start 2023-07-27T20:34:38.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.913+0000 7fa57adff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5740a83a0 0x7fa5741dc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:38.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.913+0000 7fa57adff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5740bfd90 0x7fa5740c1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:38.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.913+0000 7fa57adff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa57413b2c0 0x7fa5741dcc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:38.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.913+0000 7fa57adff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5741db390 con 0x7fa5740a83a0 2023-07-27T20:34:38.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.913+0000 7fa57adff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5741dbc30 con 0x7fa57413b2c0 2023-07-27T20:34:38.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.913+0000 7fa57adff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5740bf500 con 0x7fa5740bfd90 2023-07-27T20:34:38.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.913+0000 7fa578b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5740a83a0 0x7fa5741dc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:38.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.913+0000 7fa578b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5740a83a0 0x7fa5741dc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52446/0 (socket says 172.21.15.72:52446) 2023-07-27T20:34:38.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.913+0000 7fa578b9b700 1 -- 172.21.15.72:0/1500799352 learned_addr learned my addr 172.21.15.72:0/1500799352 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:38.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.914+0000 7fa573fff700 1 --2- 172.21.15.72:0/1500799352 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5740bfd90 0x7fa5740c1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:38.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.914+0000 7fa578b9b700 1 -- 172.21.15.72:0/1500799352 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5740bfd90 msgr2=0x7fa5740c1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:38.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.914+0000 7fa578b9b700 1 --2- 172.21.15.72:0/1500799352 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5740bfd90 0x7fa5740c1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:38.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.914+0000 7fa57939c700 1 --2- 172.21.15.72:0/1500799352 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa57413b2c0 0x7fa5741dcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:38.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.914+0000 7fa578b9b700 1 -- 172.21.15.72:0/1500799352 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa57413b2c0 msgr2=0x7fa5741dcc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:38.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.914+0000 7fa578b9b700 1 --2- 172.21.15.72:0/1500799352 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa57413b2c0 0x7fa5741dcc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:38.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.914+0000 7fa578b9b700 1 -- 172.21.15.72:0/1500799352 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa568009b30 con 0x7fa5740a83a0 2023-07-27T20:34:38.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.914+0000 7fa573fff700 1 --2- 172.21.15.72:0/1500799352 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5740bfd90 0x7fa5740c1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:38.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.914+0000 7fa57939c700 1 --2- 172.21.15.72:0/1500799352 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa57413b2c0 0x7fa5741dcc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:38.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.914+0000 7fa578b9b700 1 --2- 172.21.15.72:0/1500799352 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5740a83a0 0x7fa5741dc0c0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fa56800b370 tx=0x7fa568004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:38.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.914+0000 7fa5717fa700 1 -- 172.21.15.72:0/1500799352 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5680092e0 con 0x7fa5740a83a0 2023-07-27T20:34:38.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.914+0000 7fa5717fa700 1 -- 172.21.15.72:0/1500799352 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa568004960 con 0x7fa5740a83a0 2023-07-27T20:34:38.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.914+0000 7fa5717fa700 1 -- 172.21.15.72:0/1500799352 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56801b650 con 0x7fa5740a83a0 2023-07-27T20:34:38.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.914+0000 7fa57adff700 1 -- 172.21.15.72:0/1500799352 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5741db5e0 con 0x7fa5740a83a0 2023-07-27T20:34:38.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.914+0000 7fa57adff700 1 -- 172.21.15.72:0/1500799352 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5740c1b80 con 0x7fa5740a83a0 2023-07-27T20:34:38.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.915+0000 7fa57adff700 1 -- 172.21.15.72:0/1500799352 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5741dbf10 con 0x7fa5740a83a0 2023-07-27T20:34:38.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.916+0000 7fa5717fa700 1 -- 172.21.15.72:0/1500799352 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa56801b7b0 con 0x7fa5740a83a0 2023-07-27T20:34:38.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.917+0000 7fa5717fa700 1 --2- 172.21.15.72:0/1500799352 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa55806ace0 0x7fa55806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:38.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.917+0000 7fa5717fa700 1 -- 172.21.15.72:0/1500799352 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa56808afa0 con 0x7fa5740a83a0 2023-07-27T20:34:38.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.918+0000 7fa573fff700 1 --2- 172.21.15.72:0/1500799352 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa55806ace0 0x7fa55806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:38.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.918+0000 7fa573fff700 1 --2- 172.21.15.72:0/1500799352 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa55806ace0 0x7fa55806d1a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa5741dc810 tx=0x7fa560008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:38.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:38.921+0000 7fa5717fa700 1 -- 172.21.15.72:0/1500799352 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa568055f00 con 0x7fa5740a83a0 2023-07-27T20:34:39.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.112+0000 7fa57adff700 1 -- 172.21.15.72:0/1500799352 --> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa574152120 con 0x7fa55806ace0 2023-07-27T20:34:39.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.122+0000 7fa5717fa700 1 -- 172.21.15.72:0/1500799352 <== mgr.4107 v2:172.21.15.173:6832/910681537 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311359 (secure 0 0 0) 0x7fa560009630 con 0x7fa55806ace0 2023-07-27T20:34:39.113 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:34:39.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.126+0000 7fa57adff700 1 -- 172.21.15.72:0/1500799352 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa55806ace0 msgr2=0x7fa55806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:39.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.126+0000 7fa57adff700 1 --2- 172.21.15.72:0/1500799352 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa55806ace0 0x7fa55806d1a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa5741dc810 tx=0x7fa560008040 comp rx=0 tx=0).stop 2023-07-27T20:34:39.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.126+0000 7fa57adff700 1 -- 172.21.15.72:0/1500799352 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5740a83a0 msgr2=0x7fa5741dc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:39.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.126+0000 7fa57adff700 1 --2- 172.21.15.72:0/1500799352 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5740a83a0 0x7fa5741dc0c0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fa56800b370 tx=0x7fa568004ad0 comp rx=0 tx=0).stop 2023-07-27T20:34:39.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.126+0000 7fa57adff700 1 -- 172.21.15.72:0/1500799352 shutdown_connections 2023-07-27T20:34:39.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.126+0000 7fa57adff700 1 --2- 172.21.15.72:0/1500799352 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa57413b2c0 0x7fa5741dcc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:39.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.126+0000 7fa57adff700 1 --2- 172.21.15.72:0/1500799352 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5740a83a0 0x7fa5741dc0c0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:39.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.126+0000 7fa57adff700 1 --2- 172.21.15.72:0/1500799352 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fa55806ace0 0x7fa55806d1a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:39.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.126+0000 7fa57adff700 1 --2- 172.21.15.72:0/1500799352 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5740bfd90 0x7fa5740c1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:39.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.126+0000 7fa57adff700 1 -- 172.21.15.72:0/1500799352 >> 172.21.15.72:0/1500799352 conn(0x7fa57406a190 msgr2=0x7fa5740aa370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:39.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.126+0000 7fa57adff700 1 -- 172.21.15.72:0/1500799352 shutdown_connections 2023-07-27T20:34:39.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.126+0000 7fa57adff700 1 -- 172.21.15.72:0/1500799352 wait complete. 2023-07-27T20:34:39.117 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-07-27T20:34:39.132 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":157,"stamp":"2023-07-27T20:34:38.575707+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223064,"kb_used_data":6880,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754751656,"statfs":{"total":773094113280,"available":772865695744,"internally_reserved":0,"allocated":7045120,"data_stored":3950222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001376"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.322376+0000","last_change":"2023-07-27T20:34:34.316234+0000","last_active":"2023-07-27T20:34:34.322376+0000","last_peered":"2023-07-27T20:34:34.322376+0000","last_clean":"2023-07-27T20:34:34.322376+0000","last_became_active":"2023-07-27T20:34:34.315976+0000","last_became_peered":"2023-07-27T20:34:34.315976+0000","last_unstale":"2023-07-27T20:34:34.322376+0000","last_undegraded":"2023-07-27T20:34:34.322376+0000","last_fullsized":"2023-07-27T20:34:34.322376+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:56:21.202404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.318687+0000","last_change":"2023-07-27T20:34:34.314798+0000","last_active":"2023-07-27T20:34:34.318687+0000","last_peered":"2023-07-27T20:34:34.318687+0000","last_clean":"2023-07-27T20:34:34.318687+0000","last_became_active":"2023-07-27T20:34:34.314515+0000","last_became_peered":"2023-07-27T20:34:34.314515+0000","last_unstale":"2023-07-27T20:34:34.318687+0000","last_undegraded":"2023-07-27T20:34:34.318687+0000","last_fullsized":"2023-07-27T20:34:34.318687+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:30:04.257382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.302509+0000","last_change":"2023-07-27T20:34:34.296875+0000","last_active":"2023-07-27T20:34:34.302509+0000","last_peered":"2023-07-27T20:34:34.302509+0000","last_clean":"2023-07-27T20:34:34.302509+0000","last_became_active":"2023-07-27T20:34:34.296594+0000","last_became_peered":"2023-07-27T20:34:34.296594+0000","last_unstale":"2023-07-27T20:34:34.302509+0000","last_undegraded":"2023-07-27T20:34:34.302509+0000","last_fullsized":"2023-07-27T20:34:34.302509+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:38:01.406191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.319849+0000","last_change":"2023-07-27T20:34:34.316000+0000","last_active":"2023-07-27T20:34:34.319849+0000","last_peered":"2023-07-27T20:34:34.319849+0000","last_clean":"2023-07-27T20:34:34.319849+0000","last_became_active":"2023-07-27T20:34:34.315494+0000","last_became_peered":"2023-07-27T20:34:34.315494+0000","last_unstale":"2023-07-27T20:34:34.319849+0000","last_undegraded":"2023-07-27T20:34:34.319849+0000","last_fullsized":"2023-07-27T20:34:34.319849+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:47:41.800748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.314730+0000","last_change":"2023-07-27T20:34:34.310257+0000","last_active":"2023-07-27T20:34:34.314730+0000","last_peered":"2023-07-27T20:34:34.314730+0000","last_clean":"2023-07-27T20:34:34.314730+0000","last_became_active":"2023-07-27T20:34:34.309918+0000","last_became_peered":"2023-07-27T20:34:34.309918+0000","last_unstale":"2023-07-27T20:34:34.314730+0000","last_undegraded":"2023-07-27T20:34:34.314730+0000","last_fullsized":"2023-07-27T20:34:34.314730+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:27:45.027570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.324957+0000","last_change":"2023-07-27T20:34:34.319670+0000","last_active":"2023-07-27T20:34:34.324957+0000","last_peered":"2023-07-27T20:34:34.324957+0000","last_clean":"2023-07-27T20:34:34.324957+0000","last_became_active":"2023-07-27T20:34:34.319356+0000","last_became_peered":"2023-07-27T20:34:34.319356+0000","last_unstale":"2023-07-27T20:34:34.324957+0000","last_undegraded":"2023-07-27T20:34:34.324957+0000","last_fullsized":"2023-07-27T20:34:34.324957+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:07:27.286710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.306494+0000","last_change":"2023-07-27T20:34:34.300907+0000","last_active":"2023-07-27T20:34:34.306494+0000","last_peered":"2023-07-27T20:34:34.306494+0000","last_clean":"2023-07-27T20:34:34.306494+0000","last_became_active":"2023-07-27T20:34:34.300633+0000","last_became_peered":"2023-07-27T20:34:34.300633+0000","last_unstale":"2023-07-27T20:34:34.306494+0000","last_undegraded":"2023-07-27T20:34:34.306494+0000","last_fullsized":"2023-07-27T20:34:34.306494+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:22:40.149672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.325047+0000","last_change":"2023-07-27T20:34:34.320735+0000","last_active":"2023-07-27T20:34:34.325047+0000","last_peered":"2023-07-27T20:34:34.325047+0000","last_clean":"2023-07-27T20:34:34.325047+0000","last_became_active":"2023-07-27T20:34:34.320086+0000","last_became_peered":"2023-07-27T20:34:34.320086+0000","last_unstale":"2023-07-27T20:34:34.325047+0000","last_undegraded":"2023-07-27T20:34:34.325047+0000","last_fullsized":"2023-07-27T20:34:34.325047+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:27:35.353575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.309342+0000","last_change":"2023-07-27T20:34:34.304314+0000","last_active":"2023-07-27T20:34:34.309342+0000","last_peered":"2023-07-27T20:34:34.309342+0000","last_clean":"2023-07-27T20:34:34.309342+0000","last_became_active":"2023-07-27T20:34:34.304042+0000","last_became_peered":"2023-07-27T20:34:34.304042+0000","last_unstale":"2023-07-27T20:34:34.309342+0000","last_undegraded":"2023-07-27T20:34:34.309342+0000","last_fullsized":"2023-07-27T20:34:34.309342+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:58:51.019748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.310780+0000","last_change":"2023-07-27T20:34:34.302549+0000","last_active":"2023-07-27T20:34:34.310780+0000","last_peered":"2023-07-27T20:34:34.310780+0000","last_clean":"2023-07-27T20:34:34.310780+0000","last_became_active":"2023-07-27T20:34:34.301699+0000","last_became_peered":"2023-07-27T20:34:34.301699+0000","last_unstale":"2023-07-27T20:34:34.310780+0000","last_undegraded":"2023-07-27T20:34:34.310780+0000","last_fullsized":"2023-07-27T20:34:34.310780+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:32:34.109715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.319647+0000","last_change":"2023-07-27T20:34:34.313419+0000","last_active":"2023-07-27T20:34:34.319647+0000","last_peered":"2023-07-27T20:34:34.319647+0000","last_clean":"2023-07-27T20:34:34.319647+0000","last_became_active":"2023-07-27T20:34:34.313089+0000","last_became_peered":"2023-07-27T20:34:34.313089+0000","last_unstale":"2023-07-27T20:34:34.319647+0000","last_undegraded":"2023-07-27T20:34:34.319647+0000","last_fullsized":"2023-07-27T20:34:34.319647+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:09:19.279175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.304811+0000","last_change":"2023-07-27T20:34:34.298435+0000","last_active":"2023-07-27T20:34:34.304811+0000","last_peered":"2023-07-27T20:34:34.304811+0000","last_clean":"2023-07-27T20:34:34.304811+0000","last_became_active":"2023-07-27T20:34:34.298143+0000","last_became_peered":"2023-07-27T20:34:34.298143+0000","last_unstale":"2023-07-27T20:34:34.304811+0000","last_undegraded":"2023-07-27T20:34:34.304811+0000","last_fullsized":"2023-07-27T20:34:34.304811+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:51:18.716696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.319623+0000","last_change":"2023-07-27T20:34:34.316878+0000","last_active":"2023-07-27T20:34:34.319623+0000","last_peered":"2023-07-27T20:34:34.319623+0000","last_clean":"2023-07-27T20:34:34.319623+0000","last_became_active":"2023-07-27T20:34:34.316610+0000","last_became_peered":"2023-07-27T20:34:34.316610+0000","last_unstale":"2023-07-27T20:34:34.319623+0000","last_undegraded":"2023-07-27T20:34:34.319623+0000","last_fullsized":"2023-07-27T20:34:34.319623+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:48:26.078073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.301067+0000","last_change":"2023-07-27T20:34:34.297203+0000","last_active":"2023-07-27T20:34:34.301067+0000","last_peered":"2023-07-27T20:34:34.301067+0000","last_clean":"2023-07-27T20:34:34.301067+0000","last_became_active":"2023-07-27T20:34:34.296957+0000","last_became_peered":"2023-07-27T20:34:34.296957+0000","last_unstale":"2023-07-27T20:34:34.301067+0000","last_undegraded":"2023-07-27T20:34:34.301067+0000","last_fullsized":"2023-07-27T20:34:34.301067+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:20:54.991712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.299053+0000","last_change":"2023-07-27T20:34:34.294995+0000","last_active":"2023-07-27T20:34:34.299053+0000","last_peered":"2023-07-27T20:34:34.299053+0000","last_clean":"2023-07-27T20:34:34.299053+0000","last_became_active":"2023-07-27T20:34:34.294646+0000","last_became_peered":"2023-07-27T20:34:34.294646+0000","last_unstale":"2023-07-27T20:34:34.299053+0000","last_undegraded":"2023-07-27T20:34:34.299053+0000","last_fullsized":"2023-07-27T20:34:34.299053+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:23:24.266770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.317415+0000","last_change":"2023-07-27T20:34:34.309167+0000","last_active":"2023-07-27T20:34:34.317415+0000","last_peered":"2023-07-27T20:34:34.317415+0000","last_clean":"2023-07-27T20:34:34.317415+0000","last_became_active":"2023-07-27T20:34:34.308831+0000","last_became_peered":"2023-07-27T20:34:34.308831+0000","last_unstale":"2023-07-27T20:34:34.317415+0000","last_undegraded":"2023-07-27T20:34:34.317415+0000","last_fullsized":"2023-07-27T20:34:34.317415+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:08:36.259118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.300413+0000","last_change":"2023-07-27T20:34:34.298405+0000","last_active":"2023-07-27T20:34:34.300413+0000","last_peered":"2023-07-27T20:34:34.300413+0000","last_clean":"2023-07-27T20:34:34.300413+0000","last_became_active":"2023-07-27T20:34:34.298150+0000","last_became_peered":"2023-07-27T20:34:34.298150+0000","last_unstale":"2023-07-27T20:34:34.300413+0000","last_undegraded":"2023-07-27T20:34:34.300413+0000","last_fullsized":"2023-07-27T20:34:34.300413+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:13:32.621066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.319716+0000","last_change":"2023-07-27T20:34:34.316418+0000","last_active":"2023-07-27T20:34:34.319716+0000","last_peered":"2023-07-27T20:34:34.319716+0000","last_clean":"2023-07-27T20:34:34.319716+0000","last_became_active":"2023-07-27T20:34:34.316164+0000","last_became_peered":"2023-07-27T20:34:34.316164+0000","last_unstale":"2023-07-27T20:34:34.319716+0000","last_undegraded":"2023-07-27T20:34:34.319716+0000","last_fullsized":"2023-07-27T20:34:34.319716+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:55:56.569306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.325292+0000","last_change":"2023-07-27T20:34:34.322046+0000","last_active":"2023-07-27T20:34:34.325292+0000","last_peered":"2023-07-27T20:34:34.325292+0000","last_clean":"2023-07-27T20:34:34.325292+0000","last_became_active":"2023-07-27T20:34:34.321751+0000","last_became_peered":"2023-07-27T20:34:34.321751+0000","last_unstale":"2023-07-27T20:34:34.325292+0000","last_undegraded":"2023-07-27T20:34:34.325292+0000","last_fullsized":"2023-07-27T20:34:34.325292+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:39:00.995893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.300998+0000","last_change":"2023-07-27T20:34:34.298450+0000","last_active":"2023-07-27T20:34:34.300998+0000","last_peered":"2023-07-27T20:34:34.300998+0000","last_clean":"2023-07-27T20:34:34.300998+0000","last_became_active":"2023-07-27T20:34:34.298194+0000","last_became_peered":"2023-07-27T20:34:34.298194+0000","last_unstale":"2023-07-27T20:34:34.300998+0000","last_undegraded":"2023-07-27T20:34:34.300998+0000","last_fullsized":"2023-07-27T20:34:34.300998+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:59:03.811289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.306458+0000","last_change":"2023-07-27T20:34:34.295428+0000","last_active":"2023-07-27T20:34:34.306458+0000","last_peered":"2023-07-27T20:34:34.306458+0000","last_clean":"2023-07-27T20:34:34.306458+0000","last_became_active":"2023-07-27T20:34:34.295069+0000","last_became_peered":"2023-07-27T20:34:34.295069+0000","last_unstale":"2023-07-27T20:34:34.306458+0000","last_undegraded":"2023-07-27T20:34:34.306458+0000","last_fullsized":"2023-07-27T20:34:34.306458+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:17:50.314957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.310621+0000","last_change":"2023-07-27T20:34:34.300794+0000","last_active":"2023-07-27T20:34:34.310621+0000","last_peered":"2023-07-27T20:34:34.310621+0000","last_clean":"2023-07-27T20:34:34.310621+0000","last_became_active":"2023-07-27T20:34:34.300470+0000","last_became_peered":"2023-07-27T20:34:34.300470+0000","last_unstale":"2023-07-27T20:34:34.310621+0000","last_undegraded":"2023-07-27T20:34:34.310621+0000","last_fullsized":"2023-07-27T20:34:34.310621+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:03:34.765797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.313705+0000","last_change":"2023-07-27T20:34:34.306170+0000","last_active":"2023-07-27T20:34:34.313705+0000","last_peered":"2023-07-27T20:34:34.313705+0000","last_clean":"2023-07-27T20:34:34.313705+0000","last_became_active":"2023-07-27T20:34:34.305895+0000","last_became_peered":"2023-07-27T20:34:34.305895+0000","last_unstale":"2023-07-27T20:34:34.313705+0000","last_undegraded":"2023-07-27T20:34:34.313705+0000","last_fullsized":"2023-07-27T20:34:34.313705+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:14:23.090548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.326636+0000","last_change":"2023-07-27T20:34:34.324172+0000","last_active":"2023-07-27T20:34:34.326636+0000","last_peered":"2023-07-27T20:34:34.326636+0000","last_clean":"2023-07-27T20:34:34.326636+0000","last_became_active":"2023-07-27T20:34:34.323886+0000","last_became_peered":"2023-07-27T20:34:34.323886+0000","last_unstale":"2023-07-27T20:34:34.326636+0000","last_undegraded":"2023-07-27T20:34:34.326636+0000","last_fullsized":"2023-07-27T20:34:34.326636+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:54:22.772526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.318146+0000","last_change":"2023-07-27T20:34:34.312549+0000","last_active":"2023-07-27T20:34:34.318146+0000","last_peered":"2023-07-27T20:34:34.318146+0000","last_clean":"2023-07-27T20:34:34.318146+0000","last_became_active":"2023-07-27T20:34:34.311940+0000","last_became_peered":"2023-07-27T20:34:34.311940+0000","last_unstale":"2023-07-27T20:34:34.318146+0000","last_undegraded":"2023-07-27T20:34:34.318146+0000","last_fullsized":"2023-07-27T20:34:34.318146+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:19:39.819865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.320228+0000","last_change":"2023-07-27T20:34:34.315088+0000","last_active":"2023-07-27T20:34:34.320228+0000","last_peered":"2023-07-27T20:34:34.320228+0000","last_clean":"2023-07-27T20:34:34.320228+0000","last_became_active":"2023-07-27T20:34:34.314823+0000","last_became_peered":"2023-07-27T20:34:34.314823+0000","last_unstale":"2023-07-27T20:34:34.320228+0000","last_undegraded":"2023-07-27T20:34:34.320228+0000","last_fullsized":"2023-07-27T20:34:34.320228+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:32:34.483782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.312043+0000","last_change":"2023-07-27T20:34:34.309744+0000","last_active":"2023-07-27T20:34:34.312043+0000","last_peered":"2023-07-27T20:34:34.312043+0000","last_clean":"2023-07-27T20:34:34.312043+0000","last_became_active":"2023-07-27T20:34:34.309438+0000","last_became_peered":"2023-07-27T20:34:34.309438+0000","last_unstale":"2023-07-27T20:34:34.312043+0000","last_undegraded":"2023-07-27T20:34:34.312043+0000","last_fullsized":"2023-07-27T20:34:34.312043+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:20:56.148671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.311018+0000","last_change":"2023-07-27T20:34:34.300111+0000","last_active":"2023-07-27T20:34:34.311018+0000","last_peered":"2023-07-27T20:34:34.311018+0000","last_clean":"2023-07-27T20:34:34.311018+0000","last_became_active":"2023-07-27T20:34:34.298555+0000","last_became_peered":"2023-07-27T20:34:34.298555+0000","last_unstale":"2023-07-27T20:34:34.311018+0000","last_undegraded":"2023-07-27T20:34:34.311018+0000","last_fullsized":"2023-07-27T20:34:34.311018+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:54:08.697054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.303765+0000","last_change":"2023-07-27T20:34:34.299682+0000","last_active":"2023-07-27T20:34:34.303765+0000","last_peered":"2023-07-27T20:34:34.303765+0000","last_clean":"2023-07-27T20:34:34.303765+0000","last_became_active":"2023-07-27T20:34:34.299402+0000","last_became_peered":"2023-07-27T20:34:34.299402+0000","last_unstale":"2023-07-27T20:34:34.303765+0000","last_undegraded":"2023-07-27T20:34:34.303765+0000","last_fullsized":"2023-07-27T20:34:34.303765+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:55:19.530682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.322884+0000","last_change":"2023-07-27T20:34:34.320185+0000","last_active":"2023-07-27T20:34:34.322884+0000","last_peered":"2023-07-27T20:34:34.322884+0000","last_clean":"2023-07-27T20:34:34.322884+0000","last_became_active":"2023-07-27T20:34:34.319865+0000","last_became_peered":"2023-07-27T20:34:34.319865+0000","last_unstale":"2023-07-27T20:34:34.322884+0000","last_undegraded":"2023-07-27T20:34:34.322884+0000","last_fullsized":"2023-07-27T20:34:34.322884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:27:45.938304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.303713+0000","last_change":"2023-07-27T20:34:34.297379+0000","last_active":"2023-07-27T20:34:34.303713+0000","last_peered":"2023-07-27T20:34:34.303713+0000","last_clean":"2023-07-27T20:34:34.303713+0000","last_became_active":"2023-07-27T20:34:34.297105+0000","last_became_peered":"2023-07-27T20:34:34.297105+0000","last_unstale":"2023-07-27T20:34:34.303713+0000","last_undegraded":"2023-07-27T20:34:34.303713+0000","last_fullsized":"2023-07-27T20:34:34.303713+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:11:08.017243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.325099+0000","last_change":"2023-07-27T20:34:34.321045+0000","last_active":"2023-07-27T20:34:34.325099+0000","last_peered":"2023-07-27T20:34:34.325099+0000","last_clean":"2023-07-27T20:34:34.325099+0000","last_became_active":"2023-07-27T20:34:34.320433+0000","last_became_peered":"2023-07-27T20:34:34.320433+0000","last_unstale":"2023-07-27T20:34:34.325099+0000","last_undegraded":"2023-07-27T20:34:34.325099+0000","last_fullsized":"2023-07-27T20:34:34.325099+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:07:41.809462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.329447+0000","last_change":"2023-07-27T20:34:34.325790+0000","last_active":"2023-07-27T20:34:34.329447+0000","last_peered":"2023-07-27T20:34:34.329447+0000","last_clean":"2023-07-27T20:34:34.329447+0000","last_became_active":"2023-07-27T20:34:34.325387+0000","last_became_peered":"2023-07-27T20:34:34.325387+0000","last_unstale":"2023-07-27T20:34:34.329447+0000","last_undegraded":"2023-07-27T20:34:34.329447+0000","last_fullsized":"2023-07-27T20:34:34.329447+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:02:09.194367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"61'4","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.313253+0000","last_change":"2023-07-27T20:34:33.303138+0000","last_active":"2023-07-27T20:34:34.313253+0000","last_peered":"2023-07-27T20:34:34.313253+0000","last_clean":"2023-07-27T20:34:34.313253+0000","last_became_active":"2023-07-27T20:34:33.302808+0000","last_became_peered":"2023-07-27T20:34:33.302808+0000","last_unstale":"2023-07-27T20:34:34.313253+0000","last_undegraded":"2023-07-27T20:34:34.313253+0000","last_fullsized":"2023-07-27T20:34:34.313253+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:35:21.613222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.300431+0000","last_change":"2023-07-27T20:34:34.298335+0000","last_active":"2023-07-27T20:34:34.300431+0000","last_peered":"2023-07-27T20:34:34.300431+0000","last_clean":"2023-07-27T20:34:34.300431+0000","last_became_active":"2023-07-27T20:34:34.298050+0000","last_became_peered":"2023-07-27T20:34:34.298050+0000","last_unstale":"2023-07-27T20:34:34.300431+0000","last_undegraded":"2023-07-27T20:34:34.300431+0000","last_fullsized":"2023-07-27T20:34:34.300431+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:25:25.213499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.310632+0000","last_change":"2023-07-27T20:34:33.298365+0000","last_active":"2023-07-27T20:34:34.310632+0000","last_peered":"2023-07-27T20:34:34.310632+0000","last_clean":"2023-07-27T20:34:34.310632+0000","last_became_active":"2023-07-27T20:34:33.298105+0000","last_became_peered":"2023-07-27T20:34:33.298105+0000","last_unstale":"2023-07-27T20:34:34.310632+0000","last_undegraded":"2023-07-27T20:34:34.310632+0000","last_fullsized":"2023-07-27T20:34:34.310632+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:05:27.680904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.326537+0000","last_change":"2023-07-27T20:34:34.323261+0000","last_active":"2023-07-27T20:34:34.326537+0000","last_peered":"2023-07-27T20:34:34.326537+0000","last_clean":"2023-07-27T20:34:34.326537+0000","last_became_active":"2023-07-27T20:34:34.322945+0000","last_became_peered":"2023-07-27T20:34:34.322945+0000","last_unstale":"2023-07-27T20:34:34.326537+0000","last_undegraded":"2023-07-27T20:34:34.326537+0000","last_fullsized":"2023-07-27T20:34:34.326537+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:24:53.428471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.318246+0000","last_change":"2023-07-27T20:34:33.303171+0000","last_active":"2023-07-27T20:34:34.318246+0000","last_peered":"2023-07-27T20:34:34.318246+0000","last_clean":"2023-07-27T20:34:34.318246+0000","last_became_active":"2023-07-27T20:34:33.302865+0000","last_became_peered":"2023-07-27T20:34:33.302865+0000","last_unstale":"2023-07-27T20:34:34.318246+0000","last_undegraded":"2023-07-27T20:34:34.318246+0000","last_fullsized":"2023-07-27T20:34:34.318246+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:43:39.750093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.319724+0000","last_change":"2023-07-27T20:34:34.314330+0000","last_active":"2023-07-27T20:34:34.319724+0000","last_peered":"2023-07-27T20:34:34.319724+0000","last_clean":"2023-07-27T20:34:34.319724+0000","last_became_active":"2023-07-27T20:34:34.314054+0000","last_became_peered":"2023-07-27T20:34:34.314054+0000","last_unstale":"2023-07-27T20:34:34.319724+0000","last_undegraded":"2023-07-27T20:34:34.319724+0000","last_fullsized":"2023-07-27T20:34:34.319724+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:43:18.721841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.321587+0000","last_change":"2023-07-27T20:34:33.307004+0000","last_active":"2023-07-27T20:34:34.321587+0000","last_peered":"2023-07-27T20:34:34.321587+0000","last_clean":"2023-07-27T20:34:34.321587+0000","last_became_active":"2023-07-27T20:34:33.306710+0000","last_became_peered":"2023-07-27T20:34:33.306710+0000","last_unstale":"2023-07-27T20:34:34.321587+0000","last_undegraded":"2023-07-27T20:34:34.321587+0000","last_fullsized":"2023-07-27T20:34:34.321587+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:25:28.190661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.306503+0000","last_change":"2023-07-27T20:34:34.304872+0000","last_active":"2023-07-27T20:34:34.306503+0000","last_peered":"2023-07-27T20:34:34.306503+0000","last_clean":"2023-07-27T20:34:34.306503+0000","last_became_active":"2023-07-27T20:34:34.304583+0000","last_became_peered":"2023-07-27T20:34:34.304583+0000","last_unstale":"2023-07-27T20:34:34.306503+0000","last_undegraded":"2023-07-27T20:34:34.306503+0000","last_fullsized":"2023-07-27T20:34:34.306503+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:34:11.006264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.303071+0000","last_change":"2023-07-27T20:34:33.303472+0000","last_active":"2023-07-27T20:34:34.303071+0000","last_peered":"2023-07-27T20:34:34.303071+0000","last_clean":"2023-07-27T20:34:34.303071+0000","last_became_active":"2023-07-27T20:34:33.303211+0000","last_became_peered":"2023-07-27T20:34:33.303211+0000","last_unstale":"2023-07-27T20:34:34.303071+0000","last_undegraded":"2023-07-27T20:34:34.303071+0000","last_fullsized":"2023-07-27T20:34:34.303071+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:09:11.155306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.317232+0000","last_change":"2023-07-27T20:34:34.309855+0000","last_active":"2023-07-27T20:34:34.317232+0000","last_peered":"2023-07-27T20:34:34.317232+0000","last_clean":"2023-07-27T20:34:34.317232+0000","last_became_active":"2023-07-27T20:34:34.309553+0000","last_became_peered":"2023-07-27T20:34:34.309553+0000","last_unstale":"2023-07-27T20:34:34.317232+0000","last_undegraded":"2023-07-27T20:34:34.317232+0000","last_fullsized":"2023-07-27T20:34:34.317232+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:28:15.952872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.324865+0000","last_change":"2023-07-27T20:34:33.307265+0000","last_active":"2023-07-27T20:34:34.324865+0000","last_peered":"2023-07-27T20:34:34.324865+0000","last_clean":"2023-07-27T20:34:34.324865+0000","last_became_active":"2023-07-27T20:34:33.306583+0000","last_became_peered":"2023-07-27T20:34:33.306583+0000","last_unstale":"2023-07-27T20:34:34.324865+0000","last_undegraded":"2023-07-27T20:34:34.324865+0000","last_fullsized":"2023-07-27T20:34:34.324865+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:59:28.375439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.308994+0000","last_change":"2023-07-27T20:34:34.305104+0000","last_active":"2023-07-27T20:34:34.308994+0000","last_peered":"2023-07-27T20:34:34.308994+0000","last_clean":"2023-07-27T20:34:34.308994+0000","last_became_active":"2023-07-27T20:34:34.304828+0000","last_became_peered":"2023-07-27T20:34:34.304828+0000","last_unstale":"2023-07-27T20:34:34.308994+0000","last_undegraded":"2023-07-27T20:34:34.308994+0000","last_fullsized":"2023-07-27T20:34:34.308994+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:29:45.191052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.287931+0000","last_change":"2023-07-27T20:34:33.304005+0000","last_active":"2023-07-27T20:34:34.287931+0000","last_peered":"2023-07-27T20:34:34.287931+0000","last_clean":"2023-07-27T20:34:34.287931+0000","last_became_active":"2023-07-27T20:34:33.303744+0000","last_became_peered":"2023-07-27T20:34:33.303744+0000","last_unstale":"2023-07-27T20:34:34.287931+0000","last_undegraded":"2023-07-27T20:34:34.287931+0000","last_fullsized":"2023-07-27T20:34:34.287931+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:26:21.597794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.312079+0000","last_change":"2023-07-27T20:34:34.310350+0000","last_active":"2023-07-27T20:34:34.312079+0000","last_peered":"2023-07-27T20:34:34.312079+0000","last_clean":"2023-07-27T20:34:34.312079+0000","last_became_active":"2023-07-27T20:34:34.310068+0000","last_became_peered":"2023-07-27T20:34:34.310068+0000","last_unstale":"2023-07-27T20:34:34.312079+0000","last_undegraded":"2023-07-27T20:34:34.312079+0000","last_fullsized":"2023-07-27T20:34:34.312079+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:56:21.202404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.286707+0000","last_change":"2023-07-27T20:34:33.299254+0000","last_active":"2023-07-27T20:34:34.286707+0000","last_peered":"2023-07-27T20:34:34.286707+0000","last_clean":"2023-07-27T20:34:34.286707+0000","last_became_active":"2023-07-27T20:34:33.298978+0000","last_became_peered":"2023-07-27T20:34:33.298978+0000","last_unstale":"2023-07-27T20:34:34.286707+0000","last_undegraded":"2023-07-27T20:34:34.286707+0000","last_fullsized":"2023-07-27T20:34:34.286707+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:30:20.159074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.316837+0000","last_change":"2023-07-27T20:34:34.313397+0000","last_active":"2023-07-27T20:34:34.316837+0000","last_peered":"2023-07-27T20:34:34.316837+0000","last_clean":"2023-07-27T20:34:34.316837+0000","last_became_active":"2023-07-27T20:34:34.313128+0000","last_became_peered":"2023-07-27T20:34:34.313128+0000","last_unstale":"2023-07-27T20:34:34.316837+0000","last_undegraded":"2023-07-27T20:34:34.316837+0000","last_fullsized":"2023-07-27T20:34:34.316837+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:51:51.396043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.289433+0000","last_change":"2023-07-27T20:34:33.299760+0000","last_active":"2023-07-27T20:34:34.289433+0000","last_peered":"2023-07-27T20:34:34.289433+0000","last_clean":"2023-07-27T20:34:34.289433+0000","last_became_active":"2023-07-27T20:34:33.299488+0000","last_became_peered":"2023-07-27T20:34:33.299488+0000","last_unstale":"2023-07-27T20:34:34.289433+0000","last_undegraded":"2023-07-27T20:34:34.289433+0000","last_fullsized":"2023-07-27T20:34:34.289433+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:45:09.997270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.326646+0000","last_change":"2023-07-27T20:34:34.324198+0000","last_active":"2023-07-27T20:34:34.326646+0000","last_peered":"2023-07-27T20:34:34.326646+0000","last_clean":"2023-07-27T20:34:34.326646+0000","last_became_active":"2023-07-27T20:34:34.323865+0000","last_became_peered":"2023-07-27T20:34:34.323865+0000","last_unstale":"2023-07-27T20:34:34.326646+0000","last_undegraded":"2023-07-27T20:34:34.326646+0000","last_fullsized":"2023-07-27T20:34:34.326646+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:59:03.811289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.304715+0000","last_change":"2023-07-27T20:34:33.309943+0000","last_active":"2023-07-27T20:34:34.304715+0000","last_peered":"2023-07-27T20:34:34.304715+0000","last_clean":"2023-07-27T20:34:34.304715+0000","last_became_active":"2023-07-27T20:34:33.309650+0000","last_became_peered":"2023-07-27T20:34:33.309650+0000","last_unstale":"2023-07-27T20:34:34.304715+0000","last_undegraded":"2023-07-27T20:34:34.304715+0000","last_fullsized":"2023-07-27T20:34:34.304715+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:00:17.079273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.319208+0000","last_change":"2023-07-27T20:34:34.313276+0000","last_active":"2023-07-27T20:34:34.319208+0000","last_peered":"2023-07-27T20:34:34.319208+0000","last_clean":"2023-07-27T20:34:34.319208+0000","last_became_active":"2023-07-27T20:34:34.310175+0000","last_became_peered":"2023-07-27T20:34:34.310175+0000","last_unstale":"2023-07-27T20:34:34.319208+0000","last_undegraded":"2023-07-27T20:34:34.319208+0000","last_fullsized":"2023-07-27T20:34:34.319208+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:43:35.590795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"61'3","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.305514+0000","last_change":"2023-07-27T20:34:33.302814+0000","last_active":"2023-07-27T20:34:34.305514+0000","last_peered":"2023-07-27T20:34:34.305514+0000","last_clean":"2023-07-27T20:34:34.305514+0000","last_became_active":"2023-07-27T20:34:33.302504+0000","last_became_peered":"2023-07-27T20:34:33.302504+0000","last_unstale":"2023-07-27T20:34:34.305514+0000","last_undegraded":"2023-07-27T20:34:34.305514+0000","last_fullsized":"2023-07-27T20:34:34.305514+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:45:31.732057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.308902+0000","last_change":"2023-07-27T20:34:34.302062+0000","last_active":"2023-07-27T20:34:34.308902+0000","last_peered":"2023-07-27T20:34:34.308902+0000","last_clean":"2023-07-27T20:34:34.308902+0000","last_became_active":"2023-07-27T20:34:34.301760+0000","last_became_peered":"2023-07-27T20:34:34.301760+0000","last_unstale":"2023-07-27T20:34:34.308902+0000","last_undegraded":"2023-07-27T20:34:34.308902+0000","last_fullsized":"2023-07-27T20:34:34.308902+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:28:01.650281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"61'6","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.318509+0000","last_change":"2023-07-27T20:34:33.300792+0000","last_active":"2023-07-27T20:34:34.318509+0000","last_peered":"2023-07-27T20:34:34.318509+0000","last_clean":"2023-07-27T20:34:34.318509+0000","last_became_active":"2023-07-27T20:34:33.300452+0000","last_became_peered":"2023-07-27T20:34:33.300452+0000","last_unstale":"2023-07-27T20:34:34.318509+0000","last_undegraded":"2023-07-27T20:34:34.318509+0000","last_fullsized":"2023-07-27T20:34:34.318509+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:54:24.466200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.315743+0000","last_change":"2023-07-27T20:34:34.309848+0000","last_active":"2023-07-27T20:34:34.315743+0000","last_peered":"2023-07-27T20:34:34.315743+0000","last_clean":"2023-07-27T20:34:34.315743+0000","last_became_active":"2023-07-27T20:34:34.309567+0000","last_became_peered":"2023-07-27T20:34:34.309567+0000","last_unstale":"2023-07-27T20:34:34.315743+0000","last_undegraded":"2023-07-27T20:34:34.315743+0000","last_fullsized":"2023-07-27T20:34:34.315743+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:23:24.266770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.320219+0000","last_change":"2023-07-27T20:34:33.303304+0000","last_active":"2023-07-27T20:34:34.320219+0000","last_peered":"2023-07-27T20:34:34.320219+0000","last_clean":"2023-07-27T20:34:34.320219+0000","last_became_active":"2023-07-27T20:34:33.303051+0000","last_became_peered":"2023-07-27T20:34:33.303051+0000","last_unstale":"2023-07-27T20:34:34.320219+0000","last_undegraded":"2023-07-27T20:34:34.320219+0000","last_fullsized":"2023-07-27T20:34:34.320219+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:31:29.763920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.303849+0000","last_change":"2023-07-27T20:34:34.297996+0000","last_active":"2023-07-27T20:34:34.303849+0000","last_peered":"2023-07-27T20:34:34.303849+0000","last_clean":"2023-07-27T20:34:34.303849+0000","last_became_active":"2023-07-27T20:34:34.297650+0000","last_became_peered":"2023-07-27T20:34:34.297650+0000","last_unstale":"2023-07-27T20:34:34.303849+0000","last_undegraded":"2023-07-27T20:34:34.303849+0000","last_fullsized":"2023-07-27T20:34:34.303849+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:07:42.706156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.311511+0000","last_change":"2023-07-27T20:34:33.307281+0000","last_active":"2023-07-27T20:34:34.311511+0000","last_peered":"2023-07-27T20:34:34.311511+0000","last_clean":"2023-07-27T20:34:34.311511+0000","last_became_active":"2023-07-27T20:34:33.306983+0000","last_became_peered":"2023-07-27T20:34:33.306983+0000","last_unstale":"2023-07-27T20:34:34.311511+0000","last_undegraded":"2023-07-27T20:34:34.311511+0000","last_fullsized":"2023-07-27T20:34:34.311511+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:21:11.541389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.319898+0000","last_change":"2023-07-27T20:34:34.317382+0000","last_active":"2023-07-27T20:34:34.319898+0000","last_peered":"2023-07-27T20:34:34.319898+0000","last_clean":"2023-07-27T20:34:34.319898+0000","last_became_active":"2023-07-27T20:34:34.317102+0000","last_became_peered":"2023-07-27T20:34:34.317102+0000","last_unstale":"2023-07-27T20:34:34.319898+0000","last_undegraded":"2023-07-27T20:34:34.319898+0000","last_fullsized":"2023-07-27T20:34:34.319898+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:17:02.646055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.288918+0000","last_change":"2023-07-27T20:34:33.301597+0000","last_active":"2023-07-27T20:34:34.288918+0000","last_peered":"2023-07-27T20:34:34.288918+0000","last_clean":"2023-07-27T20:34:34.288918+0000","last_became_active":"2023-07-27T20:34:33.301302+0000","last_became_peered":"2023-07-27T20:34:33.301302+0000","last_unstale":"2023-07-27T20:34:34.288918+0000","last_undegraded":"2023-07-27T20:34:34.288918+0000","last_fullsized":"2023-07-27T20:34:34.288918+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:03:14.811435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.302382+0000","last_change":"2023-07-27T20:34:34.299216+0000","last_active":"2023-07-27T20:34:34.302382+0000","last_peered":"2023-07-27T20:34:34.302382+0000","last_clean":"2023-07-27T20:34:34.302382+0000","last_became_active":"2023-07-27T20:34:34.298877+0000","last_became_peered":"2023-07-27T20:34:34.298877+0000","last_unstale":"2023-07-27T20:34:34.302382+0000","last_undegraded":"2023-07-27T20:34:34.302382+0000","last_fullsized":"2023-07-27T20:34:34.302382+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:52:45.049280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"61'8","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.318129+0000","last_change":"2023-07-27T20:34:33.301967+0000","last_active":"2023-07-27T20:34:34.318129+0000","last_peered":"2023-07-27T20:34:34.318129+0000","last_clean":"2023-07-27T20:34:34.318129+0000","last_became_active":"2023-07-27T20:34:33.301702+0000","last_became_peered":"2023-07-27T20:34:33.301702+0000","last_unstale":"2023-07-27T20:34:34.318129+0000","last_undegraded":"2023-07-27T20:34:34.318129+0000","last_fullsized":"2023-07-27T20:34:34.318129+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:07:29.199708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.299032+0000","last_change":"2023-07-27T20:34:34.294954+0000","last_active":"2023-07-27T20:34:34.299032+0000","last_peered":"2023-07-27T20:34:34.299032+0000","last_clean":"2023-07-27T20:34:34.299032+0000","last_became_active":"2023-07-27T20:34:34.294073+0000","last_became_peered":"2023-07-27T20:34:34.294073+0000","last_unstale":"2023-07-27T20:34:34.299032+0000","last_undegraded":"2023-07-27T20:34:34.299032+0000","last_fullsized":"2023-07-27T20:34:34.299032+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:02:09.194367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.320774+0000","last_change":"2023-07-27T20:34:33.308165+0000","last_active":"2023-07-27T20:34:34.320774+0000","last_peered":"2023-07-27T20:34:34.320774+0000","last_clean":"2023-07-27T20:34:34.320774+0000","last_became_active":"2023-07-27T20:34:33.307868+0000","last_became_peered":"2023-07-27T20:34:33.307868+0000","last_unstale":"2023-07-27T20:34:34.320774+0000","last_undegraded":"2023-07-27T20:34:34.320774+0000","last_fullsized":"2023-07-27T20:34:34.320774+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:14:12.091870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.312245+0000","last_change":"2023-07-27T20:34:34.307218+0000","last_active":"2023-07-27T20:34:34.312245+0000","last_peered":"2023-07-27T20:34:34.312245+0000","last_clean":"2023-07-27T20:34:34.312245+0000","last_became_active":"2023-07-27T20:34:34.306781+0000","last_became_peered":"2023-07-27T20:34:34.306781+0000","last_unstale":"2023-07-27T20:34:34.312245+0000","last_undegraded":"2023-07-27T20:34:34.312245+0000","last_fullsized":"2023-07-27T20:34:34.312245+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:10:43.821958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.290750+0000","last_change":"2023-07-27T20:34:33.301802+0000","last_active":"2023-07-27T20:34:34.290750+0000","last_peered":"2023-07-27T20:34:34.290750+0000","last_clean":"2023-07-27T20:34:34.290750+0000","last_became_active":"2023-07-27T20:34:33.301453+0000","last_became_peered":"2023-07-27T20:34:33.301453+0000","last_unstale":"2023-07-27T20:34:34.290750+0000","last_undegraded":"2023-07-27T20:34:34.290750+0000","last_fullsized":"2023-07-27T20:34:34.290750+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:26:04.782458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.329437+0000","last_change":"2023-07-27T20:34:34.325646+0000","last_active":"2023-07-27T20:34:34.329437+0000","last_peered":"2023-07-27T20:34:34.329437+0000","last_clean":"2023-07-27T20:34:34.329437+0000","last_became_active":"2023-07-27T20:34:34.325379+0000","last_became_peered":"2023-07-27T20:34:34.325379+0000","last_unstale":"2023-07-27T20:34:34.329437+0000","last_undegraded":"2023-07-27T20:34:34.329437+0000","last_fullsized":"2023-07-27T20:34:34.329437+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:17:02.646055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.286597+0000","last_change":"2023-07-27T20:34:33.297891+0000","last_active":"2023-07-27T20:34:34.286597+0000","last_peered":"2023-07-27T20:34:34.286597+0000","last_clean":"2023-07-27T20:34:34.286597+0000","last_became_active":"2023-07-27T20:34:33.297052+0000","last_became_peered":"2023-07-27T20:34:33.297052+0000","last_unstale":"2023-07-27T20:34:34.286597+0000","last_undegraded":"2023-07-27T20:34:34.286597+0000","last_fullsized":"2023-07-27T20:34:34.286597+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:58:22.048069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.322451+0000","last_change":"2023-07-27T20:34:34.315817+0000","last_active":"2023-07-27T20:34:34.322451+0000","last_peered":"2023-07-27T20:34:34.322451+0000","last_clean":"2023-07-27T20:34:34.322451+0000","last_became_active":"2023-07-27T20:34:34.315521+0000","last_became_peered":"2023-07-27T20:34:34.315521+0000","last_unstale":"2023-07-27T20:34:34.322451+0000","last_undegraded":"2023-07-27T20:34:34.322451+0000","last_fullsized":"2023-07-27T20:34:34.322451+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:21:45.497838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.283961+0000","last_change":"2023-07-27T20:34:33.303481+0000","last_active":"2023-07-27T20:34:34.283961+0000","last_peered":"2023-07-27T20:34:34.283961+0000","last_clean":"2023-07-27T20:34:34.283961+0000","last_became_active":"2023-07-27T20:34:33.303145+0000","last_became_peered":"2023-07-27T20:34:33.303145+0000","last_unstale":"2023-07-27T20:34:34.283961+0000","last_undegraded":"2023-07-27T20:34:34.283961+0000","last_fullsized":"2023-07-27T20:34:34.283961+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:35:21.613222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.309038+0000","last_change":"2023-07-27T20:34:34.304160+0000","last_active":"2023-07-27T20:34:34.309038+0000","last_peered":"2023-07-27T20:34:34.309038+0000","last_clean":"2023-07-27T20:34:34.309038+0000","last_became_active":"2023-07-27T20:34:34.303895+0000","last_became_peered":"2023-07-27T20:34:34.303895+0000","last_unstale":"2023-07-27T20:34:34.309038+0000","last_undegraded":"2023-07-27T20:34:34.309038+0000","last_fullsized":"2023-07-27T20:34:34.309038+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:12:27.476800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.286778+0000","last_change":"2023-07-27T20:34:33.308129+0000","last_active":"2023-07-27T20:34:34.286778+0000","last_peered":"2023-07-27T20:34:34.286778+0000","last_clean":"2023-07-27T20:34:34.286778+0000","last_became_active":"2023-07-27T20:34:33.307849+0000","last_became_peered":"2023-07-27T20:34:33.307849+0000","last_unstale":"2023-07-27T20:34:34.286778+0000","last_undegraded":"2023-07-27T20:34:34.286778+0000","last_fullsized":"2023-07-27T20:34:34.286778+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:21:38.209651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.326513+0000","last_change":"2023-07-27T20:34:34.323167+0000","last_active":"2023-07-27T20:34:34.326513+0000","last_peered":"2023-07-27T20:34:34.326513+0000","last_clean":"2023-07-27T20:34:34.326513+0000","last_became_active":"2023-07-27T20:34:34.322891+0000","last_became_peered":"2023-07-27T20:34:34.322891+0000","last_unstale":"2023-07-27T20:34:34.326513+0000","last_undegraded":"2023-07-27T20:34:34.326513+0000","last_fullsized":"2023-07-27T20:34:34.326513+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:26:30.304005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.288597+0000","last_change":"2023-07-27T20:34:33.303415+0000","last_active":"2023-07-27T20:34:34.288597+0000","last_peered":"2023-07-27T20:34:34.288597+0000","last_clean":"2023-07-27T20:34:34.288597+0000","last_became_active":"2023-07-27T20:34:33.303145+0000","last_became_peered":"2023-07-27T20:34:33.303145+0000","last_unstale":"2023-07-27T20:34:34.288597+0000","last_undegraded":"2023-07-27T20:34:34.288597+0000","last_fullsized":"2023-07-27T20:34:34.288597+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:14:49.830528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.304776+0000","last_change":"2023-07-27T20:34:34.298297+0000","last_active":"2023-07-27T20:34:34.304776+0000","last_peered":"2023-07-27T20:34:34.304776+0000","last_clean":"2023-07-27T20:34:34.304776+0000","last_became_active":"2023-07-27T20:34:34.297997+0000","last_became_peered":"2023-07-27T20:34:34.297997+0000","last_unstale":"2023-07-27T20:34:34.304776+0000","last_undegraded":"2023-07-27T20:34:34.304776+0000","last_fullsized":"2023-07-27T20:34:34.304776+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:28:11.560691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.286548+0000","last_change":"2023-07-27T20:34:33.301354+0000","last_active":"2023-07-27T20:34:34.286548+0000","last_peered":"2023-07-27T20:34:34.286548+0000","last_clean":"2023-07-27T20:34:34.286548+0000","last_became_active":"2023-07-27T20:34:33.301082+0000","last_became_peered":"2023-07-27T20:34:33.301082+0000","last_unstale":"2023-07-27T20:34:34.286548+0000","last_undegraded":"2023-07-27T20:34:34.286548+0000","last_fullsized":"2023-07-27T20:34:34.286548+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:32:31.509897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.325279+0000","last_change":"2023-07-27T20:34:34.321962+0000","last_active":"2023-07-27T20:34:34.325279+0000","last_peered":"2023-07-27T20:34:34.325279+0000","last_clean":"2023-07-27T20:34:34.325279+0000","last_became_active":"2023-07-27T20:34:34.321611+0000","last_became_peered":"2023-07-27T20:34:34.321611+0000","last_unstale":"2023-07-27T20:34:34.325279+0000","last_undegraded":"2023-07-27T20:34:34.325279+0000","last_fullsized":"2023-07-27T20:34:34.325279+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:04:33.468676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.306552+0000","last_change":"2023-07-27T20:34:33.305936+0000","last_active":"2023-07-27T20:34:34.306552+0000","last_peered":"2023-07-27T20:34:34.306552+0000","last_clean":"2023-07-27T20:34:34.306552+0000","last_became_active":"2023-07-27T20:34:33.305405+0000","last_became_peered":"2023-07-27T20:34:33.305405+0000","last_unstale":"2023-07-27T20:34:34.306552+0000","last_undegraded":"2023-07-27T20:34:34.306552+0000","last_fullsized":"2023-07-27T20:34:34.306552+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:14:13.977192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.310800+0000","last_change":"2023-07-27T20:34:34.306247+0000","last_active":"2023-07-27T20:34:34.310800+0000","last_peered":"2023-07-27T20:34:34.310800+0000","last_clean":"2023-07-27T20:34:34.310800+0000","last_became_active":"2023-07-27T20:34:34.305974+0000","last_became_peered":"2023-07-27T20:34:34.305974+0000","last_unstale":"2023-07-27T20:34:34.310800+0000","last_undegraded":"2023-07-27T20:34:34.310800+0000","last_fullsized":"2023-07-27T20:34:34.310800+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:34:56.933539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.320714+0000","last_change":"2023-07-27T20:34:33.308128+0000","last_active":"2023-07-27T20:34:34.320714+0000","last_peered":"2023-07-27T20:34:34.320714+0000","last_clean":"2023-07-27T20:34:34.320714+0000","last_became_active":"2023-07-27T20:34:33.307832+0000","last_became_peered":"2023-07-27T20:34:33.307832+0000","last_unstale":"2023-07-27T20:34:34.320714+0000","last_undegraded":"2023-07-27T20:34:34.320714+0000","last_fullsized":"2023-07-27T20:34:34.320714+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:13:23.865414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.293655+0000","last_change":"2023-07-27T20:31:22.846540+0000","last_active":"2023-07-27T20:34:34.293655+0000","last_peered":"2023-07-27T20:34:34.293655+0000","last_clean":"2023-07-27T20:34:34.293655+0000","last_became_active":"2023-07-27T20:31:22.846128+0000","last_became_peered":"2023-07-27T20:31:22.846128+0000","last_unstale":"2023-07-27T20:34:34.293655+0000","last_undegraded":"2023-07-27T20:34:34.293655+0000","last_fullsized":"2023-07-27T20:34:34.293655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:01:11.796940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.315436+0000","last_change":"2023-07-27T20:34:34.311641+0000","last_active":"2023-07-27T20:34:34.315436+0000","last_peered":"2023-07-27T20:34:34.315436+0000","last_clean":"2023-07-27T20:34:34.315436+0000","last_became_active":"2023-07-27T20:34:34.311381+0000","last_became_peered":"2023-07-27T20:34:34.311381+0000","last_unstale":"2023-07-27T20:34:34.315436+0000","last_undegraded":"2023-07-27T20:34:34.315436+0000","last_fullsized":"2023-07-27T20:34:34.315436+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:05:28.688422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.319409+0000","last_change":"2023-07-27T20:34:33.303573+0000","last_active":"2023-07-27T20:34:34.319409+0000","last_peered":"2023-07-27T20:34:34.319409+0000","last_clean":"2023-07-27T20:34:34.319409+0000","last_became_active":"2023-07-27T20:34:33.303293+0000","last_became_peered":"2023-07-27T20:34:33.303293+0000","last_unstale":"2023-07-27T20:34:34.319409+0000","last_undegraded":"2023-07-27T20:34:34.319409+0000","last_fullsized":"2023-07-27T20:34:34.319409+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:07:45.690447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.288942+0000","last_change":"2023-07-27T20:31:22.845641+0000","last_active":"2023-07-27T20:34:34.288942+0000","last_peered":"2023-07-27T20:34:34.288942+0000","last_clean":"2023-07-27T20:34:34.288942+0000","last_became_active":"2023-07-27T20:31:22.845368+0000","last_became_peered":"2023-07-27T20:31:22.845368+0000","last_unstale":"2023-07-27T20:34:34.288942+0000","last_undegraded":"2023-07-27T20:34:34.288942+0000","last_fullsized":"2023-07-27T20:34:34.288942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:29:33.977286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.304791+0000","last_change":"2023-07-27T20:34:34.296863+0000","last_active":"2023-07-27T20:34:34.304791+0000","last_peered":"2023-07-27T20:34:34.304791+0000","last_clean":"2023-07-27T20:34:34.304791+0000","last_became_active":"2023-07-27T20:34:34.296556+0000","last_became_peered":"2023-07-27T20:34:34.296556+0000","last_unstale":"2023-07-27T20:34:34.304791+0000","last_undegraded":"2023-07-27T20:34:34.304791+0000","last_fullsized":"2023-07-27T20:34:34.304791+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:14:47.785611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.316290+0000","last_change":"2023-07-27T20:34:33.303035+0000","last_active":"2023-07-27T20:34:34.316290+0000","last_peered":"2023-07-27T20:34:34.316290+0000","last_clean":"2023-07-27T20:34:34.316290+0000","last_became_active":"2023-07-27T20:34:33.302764+0000","last_became_peered":"2023-07-27T20:34:33.302764+0000","last_unstale":"2023-07-27T20:34:34.316290+0000","last_undegraded":"2023-07-27T20:34:34.316290+0000","last_fullsized":"2023-07-27T20:34:34.316290+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:25:33.904459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.307144+0000","last_change":"2023-07-27T20:31:22.848025+0000","last_active":"2023-07-27T20:34:34.307144+0000","last_peered":"2023-07-27T20:34:34.307144+0000","last_clean":"2023-07-27T20:34:34.307144+0000","last_became_active":"2023-07-27T20:31:22.847603+0000","last_became_peered":"2023-07-27T20:31:22.847603+0000","last_unstale":"2023-07-27T20:34:34.307144+0000","last_undegraded":"2023-07-27T20:34:34.307144+0000","last_fullsized":"2023-07-27T20:34:34.307144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:09:35.963326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.320272+0000","last_change":"2023-07-27T20:34:34.315837+0000","last_active":"2023-07-27T20:34:34.320272+0000","last_peered":"2023-07-27T20:34:34.320272+0000","last_clean":"2023-07-27T20:34:34.320272+0000","last_became_active":"2023-07-27T20:34:34.315452+0000","last_became_peered":"2023-07-27T20:34:34.315452+0000","last_unstale":"2023-07-27T20:34:34.320272+0000","last_undegraded":"2023-07-27T20:34:34.320272+0000","last_fullsized":"2023-07-27T20:34:34.320272+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:56:42.150862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.282181+0000","last_change":"2023-07-27T20:34:33.298534+0000","last_active":"2023-07-27T20:34:34.282181+0000","last_peered":"2023-07-27T20:34:34.282181+0000","last_clean":"2023-07-27T20:34:34.282181+0000","last_became_active":"2023-07-27T20:34:33.298170+0000","last_became_peered":"2023-07-27T20:34:33.298170+0000","last_unstale":"2023-07-27T20:34:34.282181+0000","last_undegraded":"2023-07-27T20:34:34.282181+0000","last_fullsized":"2023-07-27T20:34:34.282181+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:14:22.083030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.292321+0000","last_change":"2023-07-27T20:31:22.848181+0000","last_active":"2023-07-27T20:34:34.292321+0000","last_peered":"2023-07-27T20:34:34.292321+0000","last_clean":"2023-07-27T20:34:34.292321+0000","last_became_active":"2023-07-27T20:31:22.847865+0000","last_became_peered":"2023-07-27T20:31:22.847865+0000","last_unstale":"2023-07-27T20:34:34.292321+0000","last_undegraded":"2023-07-27T20:34:34.292321+0000","last_fullsized":"2023-07-27T20:34:34.292321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:13:10.801898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.323866+0000","last_change":"2023-07-27T20:34:34.320803+0000","last_active":"2023-07-27T20:34:34.323866+0000","last_peered":"2023-07-27T20:34:34.323866+0000","last_clean":"2023-07-27T20:34:34.323866+0000","last_became_active":"2023-07-27T20:34:34.320444+0000","last_became_peered":"2023-07-27T20:34:34.320444+0000","last_unstale":"2023-07-27T20:34:34.323866+0000","last_undegraded":"2023-07-27T20:34:34.323866+0000","last_fullsized":"2023-07-27T20:34:34.323866+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:46:52.049065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.321060+0000","last_change":"2023-07-27T20:34:33.306873+0000","last_active":"2023-07-27T20:34:34.321060+0000","last_peered":"2023-07-27T20:34:34.321060+0000","last_clean":"2023-07-27T20:34:34.321060+0000","last_became_active":"2023-07-27T20:34:33.306519+0000","last_became_peered":"2023-07-27T20:34:33.306519+0000","last_unstale":"2023-07-27T20:34:34.321060+0000","last_undegraded":"2023-07-27T20:34:34.321060+0000","last_fullsized":"2023-07-27T20:34:34.321060+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:27:44.351248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":246,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.292842+0000","last_change":"2023-07-27T20:31:15.812727+0000","last_active":"2023-07-27T20:34:34.292842+0000","last_peered":"2023-07-27T20:34:34.292842+0000","last_clean":"2023-07-27T20:34:34.292842+0000","last_became_active":"2023-07-27T20:31:15.811803+0000","last_became_peered":"2023-07-27T20:31:15.811803+0000","last_unstale":"2023-07-27T20:34:34.292842+0000","last_undegraded":"2023-07-27T20:34:34.292842+0000","last_fullsized":"2023-07-27T20:34:34.292842+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:14.789257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:14.789257+0000","last_clean_scrub_stamp":"2023-07-27T20:31:14.789257+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:54:08.738278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":84,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.290127+0000","last_change":"2023-07-27T20:31:22.847766+0000","last_active":"2023-07-27T20:34:34.290127+0000","last_peered":"2023-07-27T20:34:34.290127+0000","last_clean":"2023-07-27T20:34:34.290127+0000","last_became_active":"2023-07-27T20:31:22.847396+0000","last_became_peered":"2023-07-27T20:31:22.847396+0000","last_unstale":"2023-07-27T20:34:34.290127+0000","last_undegraded":"2023-07-27T20:34:34.290127+0000","last_fullsized":"2023-07-27T20:34:34.290127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:42:31.232372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.323851+0000","last_change":"2023-07-27T20:34:34.320690+0000","last_active":"2023-07-27T20:34:34.323851+0000","last_peered":"2023-07-27T20:34:34.323851+0000","last_clean":"2023-07-27T20:34:34.323851+0000","last_became_active":"2023-07-27T20:34:34.320232+0000","last_became_peered":"2023-07-27T20:34:34.320232+0000","last_unstale":"2023-07-27T20:34:34.323851+0000","last_undegraded":"2023-07-27T20:34:34.323851+0000","last_fullsized":"2023-07-27T20:34:34.323851+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:12:23.304991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.289091+0000","last_change":"2023-07-27T20:34:33.308050+0000","last_active":"2023-07-27T20:34:34.289091+0000","last_peered":"2023-07-27T20:34:34.289091+0000","last_clean":"2023-07-27T20:34:34.289091+0000","last_became_active":"2023-07-27T20:34:33.307761+0000","last_became_peered":"2023-07-27T20:34:33.307761+0000","last_unstale":"2023-07-27T20:34:34.289091+0000","last_undegraded":"2023-07-27T20:34:34.289091+0000","last_fullsized":"2023-07-27T20:34:34.289091+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:47:41.714760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":84,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.286647+0000","last_change":"2023-07-27T20:31:22.959811+0000","last_active":"2023-07-27T20:34:34.286647+0000","last_peered":"2023-07-27T20:34:34.286647+0000","last_clean":"2023-07-27T20:34:34.286647+0000","last_became_active":"2023-07-27T20:31:22.959449+0000","last_became_peered":"2023-07-27T20:31:22.959449+0000","last_unstale":"2023-07-27T20:34:34.286647+0000","last_undegraded":"2023-07-27T20:34:34.286647+0000","last_fullsized":"2023-07-27T20:34:34.286647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:17:22.777317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.307279+0000","last_change":"2023-07-27T20:34:34.301811+0000","last_active":"2023-07-27T20:34:34.307279+0000","last_peered":"2023-07-27T20:34:34.307279+0000","last_clean":"2023-07-27T20:34:34.307279+0000","last_became_active":"2023-07-27T20:34:34.301525+0000","last_became_peered":"2023-07-27T20:34:34.301525+0000","last_unstale":"2023-07-27T20:34:34.307279+0000","last_undegraded":"2023-07-27T20:34:34.307279+0000","last_fullsized":"2023-07-27T20:34:34.307279+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:11:10.950594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.311652+0000","last_change":"2023-07-27T20:34:33.301467+0000","last_active":"2023-07-27T20:34:34.311652+0000","last_peered":"2023-07-27T20:34:34.311652+0000","last_clean":"2023-07-27T20:34:34.311652+0000","last_became_active":"2023-07-27T20:34:33.301160+0000","last_became_peered":"2023-07-27T20:34:33.301160+0000","last_unstale":"2023-07-27T20:34:34.311652+0000","last_undegraded":"2023-07-27T20:34:34.311652+0000","last_fullsized":"2023-07-27T20:34:34.311652+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:42:47.032613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":84,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.289751+0000","last_change":"2023-07-27T20:31:22.849178+0000","last_active":"2023-07-27T20:34:34.289751+0000","last_peered":"2023-07-27T20:34:34.289751+0000","last_clean":"2023-07-27T20:34:34.289751+0000","last_became_active":"2023-07-27T20:31:22.848856+0000","last_became_peered":"2023-07-27T20:31:22.848856+0000","last_unstale":"2023-07-27T20:34:34.289751+0000","last_undegraded":"2023-07-27T20:34:34.289751+0000","last_fullsized":"2023-07-27T20:34:34.289751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:21:36.623008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.300538+0000","last_change":"2023-07-27T20:34:34.296711+0000","last_active":"2023-07-27T20:34:34.300538+0000","last_peered":"2023-07-27T20:34:34.300538+0000","last_clean":"2023-07-27T20:34:34.300538+0000","last_became_active":"2023-07-27T20:34:34.296442+0000","last_became_peered":"2023-07-27T20:34:34.296442+0000","last_unstale":"2023-07-27T20:34:34.300538+0000","last_undegraded":"2023-07-27T20:34:34.300538+0000","last_fullsized":"2023-07-27T20:34:34.300538+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:24:31.176079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.295975+0000","last_change":"2023-07-27T20:34:33.304301+0000","last_active":"2023-07-27T20:34:34.295975+0000","last_peered":"2023-07-27T20:34:34.295975+0000","last_clean":"2023-07-27T20:34:34.295975+0000","last_became_active":"2023-07-27T20:34:33.303739+0000","last_became_peered":"2023-07-27T20:34:33.303739+0000","last_unstale":"2023-07-27T20:34:34.295975+0000","last_undegraded":"2023-07-27T20:34:34.295975+0000","last_fullsized":"2023-07-27T20:34:34.295975+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:48:25.070555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-27T20:34:34.289027+0000","last_change":"2023-07-27T20:31:22.848698+0000","last_active":"2023-07-27T20:34:34.289027+0000","last_peered":"2023-07-27T20:34:34.289027+0000","last_clean":"2023-07-27T20:34:34.289027+0000","last_became_active":"2023-07-27T20:31:22.848346+0000","last_became_peered":"2023-07-27T20:31:22.848346+0000","last_unstale":"2023-07-27T20:34:34.289027+0000","last_undegraded":"2023-07-27T20:34:34.289027+0000","last_fullsized":"2023-07-27T20:34:34.289027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:00:10.424812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28332,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343508,"statfs":{"total":96636764160,"available":96607752192,"internally_reserved":0,"allocated":1339392,"data_stored":941725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.75800000000000001,"15min":0.80300000000000005},"min":{"1min":0.42499999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90000000000000002,"5min":3.5609999999999999,"15min":3.5609999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.70799999999999996,"15min":0.72699999999999998},"min":{"1min":0.39500000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88800000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.67900000000000005}]},{"osd":1,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.69599999999999995,"15min":0.71599999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.84999999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.81000000000000005,"15min":0.86399999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.86699999999999999,"5min":3.927,"15min":3.927},"last":0.749}]},{"osd":2,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.80200000000000005,"15min":0.84099999999999997},"min":{"1min":0.47099999999999997,"5min":0.443,"15min":0.443},"max":{"1min":0.86699999999999999,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":0.62},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.76500000000000001,"15min":0.80900000000000005},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85799999999999998,"5min":2.093,"15min":2.093},"last":0.79600000000000004}]},{"osd":3,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.76000000000000001,"15min":0.81200000000000006},"min":{"1min":0.46000000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.76600000000000001,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.85099999999999998,"15min":0.90100000000000002},"min":{"1min":0.57399999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.94099999999999995,"5min":3.1080000000000001,"15min":3.1080000000000001},"last":0.67000000000000004}]},{"osd":4,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.754,"15min":0.78800000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.91100000000000003,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.79800000000000004,"15min":0.83399999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.85799999999999998,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.69199999999999995}]},{"osd":5,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.90600000000000003,"15min":0.999},"min":{"1min":0.47899999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.91400000000000003,"5min":6.1619999999999999,"15min":6.1619999999999999},"last":0.497},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.94299999999999995,"15min":1.042},"min":{"1min":0.432,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96499999999999997,"5min":6.2729999999999997,"15min":6.2729999999999997},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.81799999999999995,"15min":0.84599999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.075,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.84699999999999998,"15min":0.90500000000000003},"min":{"1min":0.52900000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93799999999999994,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":0.59799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":745472,"data_stored":350833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.67700000000000005,"15min":0.68899999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.871,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.66300000000000003,"15min":0.66800000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.85499999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.67700000000000005}]},{"osd":1,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69999999999999996,"15min":0.72199999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84399999999999997,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70099999999999996,"15min":0.70799999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.85499999999999998,"5min":1.266,"15min":1.266},"last":0.56000000000000005}]},{"osd":2,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.69499999999999995,"15min":0.71799999999999997},"min":{"1min":0.51100000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83899999999999997,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.439},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.747,"15min":0.76300000000000001},"min":{"1min":0.56499999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.90200000000000002,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.72899999999999998,"15min":0.745},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.84199999999999997,"5min":1.377,"15min":1.377},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.73299999999999998,"15min":0.75700000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92800000000000005,"5min":1.736,"15min":1.736},"last":0.52200000000000002}]},{"osd":4,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69599999999999995,"15min":0.69799999999999995},"min":{"1min":0.47099999999999997,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90300000000000002,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69699999999999995,"15min":0.69299999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.95599999999999996,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.61799999999999999}]},{"osd":5,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.67100000000000004,"15min":0.66500000000000004},"min":{"1min":0.47799999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.88600000000000001,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.74099999999999999,"15min":0.73199999999999998},"min":{"1min":0.45100000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93700000000000006,"5min":1.081,"15min":1.081},"last":0.60599999999999998}]},{"osd":7,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.749,"15min":0.753},"min":{"1min":0.496,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.94699999999999995,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.73999999999999999,"15min":0.73599999999999999},"min":{"1min":0.59499999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97599999999999998,"5min":1.119,"15min":1.119},"last":0.58999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":724992,"data_stored":343293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40899999999999997,"15min":0.40600000000000003},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47199999999999998,"15min":0.47899999999999998},"min":{"1min":0.32300000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44,"15min":0.436},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.47599999999999998,"15min":0.47399999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.47899999999999998}]},{"osd":3,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53400000000000003,"15min":0.53200000000000003},"min":{"1min":0.39400000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.502,"15min":0.504},"min":{"1min":0.374,"5min":0.31,"15min":0.31},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.498}]},{"osd":4,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73499999999999999,"15min":0.745},"min":{"1min":0.56699999999999995,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73599999999999999,"15min":0.73199999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.72499999999999998}]},{"osd":5,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72299999999999998,"15min":0.73199999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.76200000000000001,"15min":0.75700000000000001},"min":{"1min":0.623,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.9630000000000001,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":0.94199999999999995}]},{"osd":6,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.77500000000000002,"15min":0.79500000000000004},"min":{"1min":0.53600000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1419999999999999,"5min":1.347,"15min":1.347},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.80400000000000005,"15min":0.81999999999999995},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.206,"5min":1.409,"15min":1.409},"last":0.86499999999999999}]},{"osd":7,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.77100000000000002,"15min":0.77700000000000002},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.95099999999999996,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78800000000000003,"15min":0.80300000000000005},"min":{"1min":0.55400000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.90900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574892,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28312,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343528,"statfs":{"total":96636764160,"available":96607772672,"internally_reserved":0,"allocated":1318912,"data_stored":933661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.38700000000000001,"15min":0.39100000000000001},"min":{"1min":0.27700000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.46000000000000002,"15min":0.46400000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.314}]},{"osd":2,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47999999999999998,"15min":0.48899999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.60399999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.44800000000000001,"15min":0.45400000000000001},"min":{"1min":0.34200000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.439}]},{"osd":3,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46600000000000003,"15min":0.47099999999999997},"min":{"1min":0.35299999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.65900000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53200000000000003,"15min":0.54200000000000004},"min":{"1min":0.40699999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.63400000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.46100000000000002}]},{"osd":4,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70499999999999996,"15min":0.71199999999999997},"min":{"1min":0.55900000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0529999999999999,"5min":1.069,"15min":1.069},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.71799999999999997,"15min":0.73199999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97799999999999998,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.70499999999999996}]},{"osd":5,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.73099999999999998,"15min":0.745},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.90000000000000002,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.73499999999999999,"15min":0.751},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0940000000000001,"5min":1.196,"15min":1.196},"last":0.71999999999999997}]},{"osd":6,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.72199999999999998,"15min":0.73599999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0129999999999999,"5min":1.05,"15min":1.05},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.755,"15min":0.77600000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.88400000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.80200000000000005}]},{"osd":7,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.752,"15min":0.76900000000000002},"min":{"1min":0.54800000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.755,"15min":0.77200000000000002},"min":{"1min":0.58199999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.73199999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":724992,"data_stored":343293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45700000000000002,"15min":0.48099999999999998},"min":{"1min":0.29799999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.54700000000000004,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.624,"15min":0.70999999999999996},"min":{"1min":0.32500000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70099999999999996,"5min":3.2999999999999998,"15min":3.2999999999999998},"last":0.38300000000000001}]},{"osd":1,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.56000000000000005,"15min":0.61499999999999999},"min":{"1min":0.309,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.67200000000000004,"5min":3.0600000000000001,"15min":3.0600000000000001},"last":0.435},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.60999999999999999,"15min":0.67000000000000004},"min":{"1min":0.36499999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.623,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.42499999999999999}]},{"osd":3,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.86399999999999999,"15min":1.036},"min":{"1min":0.40000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72099999999999997,"5min":9.2200000000000006,"15min":9.2200000000000006},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.57099999999999995,"15min":0.59499999999999997},"min":{"1min":0.40799999999999997,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.66600000000000004,"5min":1.552,"15min":1.552},"last":0.40799999999999997}]},{"osd":4,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.85999999999999999,"15min":0.92600000000000005},"min":{"1min":0.52200000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0049999999999999,"5min":4.2930000000000001,"15min":4.2930000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.75600000000000001,"15min":0.77900000000000003},"min":{"1min":0.55400000000000005,"5min":0.499,"15min":0.499},"max":{"1min":0.93999999999999995,"5min":1.24,"15min":1.24},"last":0.56899999999999995}]},{"osd":5,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.754,"15min":0.76900000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98399999999999999,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.627},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.84699999999999998,"15min":0.90700000000000003},"min":{"1min":0.53800000000000003,"5min":0.5,"15min":0.5},"max":{"1min":0.90700000000000003,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.88300000000000001,"15min":0.94399999999999995},"min":{"1min":0.55300000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.024,"5min":3.3999999999999999,"15min":3.3999999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.91300000000000003,"15min":0.99099999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.97199999999999998,"5min":3.4990000000000001,"15min":3.4990000000000001},"last":0.71399999999999997}]},{"osd":7,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.81100000000000005,"15min":0.84499999999999997},"min":{"1min":0.58199999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.95199999999999996,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.86099999999999999,"15min":0.89700000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.95999999999999996,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.73699999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":724992,"data_stored":343293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.44900000000000001,"15min":0.47099999999999997},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.626,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.51600000000000001,"15min":0.54400000000000004},"min":{"1min":0.309,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.627,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":0.315}]},{"osd":1,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.47699999999999998,"15min":0.5},"min":{"1min":0.33400000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.55400000000000005,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.498},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.52900000000000003,"15min":0.56699999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.63,"5min":1.788,"15min":1.788},"last":0.38700000000000001}]},{"osd":2,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.56200000000000006,"15min":0.59199999999999997},"min":{"1min":0.41699999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.73299999999999998,"5min":2.117,"15min":2.117},"last":0.443},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59999999999999998,"15min":0.63400000000000001},"min":{"1min":0.42999999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.68400000000000005,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71899999999999997,"15min":0.72199999999999998},"min":{"1min":0.53800000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0249999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.79000000000000004,"15min":0.81399999999999995},"min":{"1min":0.53000000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.95199999999999996,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.66400000000000003}]},{"osd":5,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.72499999999999998,"15min":0.73299999999999998},"min":{"1min":0.505,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92200000000000004,"5min":1.125,"15min":1.125},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.79400000000000004,"15min":0.82799999999999996},"min":{"1min":0.54200000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0569999999999999,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.78600000000000003,"15min":0.81299999999999994},"min":{"1min":0.59199999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93100000000000005,"5min":1.758,"15min":1.758},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.80900000000000005,"15min":0.83499999999999996},"min":{"1min":0.55000000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.095,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.81599999999999995,"15min":0.84799999999999998},"min":{"1min":0.55400000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0289999999999999,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.625},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.75800000000000001,"15min":0.76700000000000002},"min":{"1min":0.59099999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.99199999999999999,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.68700000000000006}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":724992,"data_stored":343293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.69699999999999995,"15min":0.69799999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.84299999999999997,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70699999999999996,"15min":0.71199999999999997},"min":{"1min":0.53900000000000003,"5min":0.5,"15min":0.5},"max":{"1min":0.86499999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.59999999999999998}]},{"osd":1,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.52200000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.874,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73499999999999999,"15min":0.73799999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88900000000000001,"5min":1.002,"15min":1.002},"last":0.754}]},{"osd":2,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.67500000000000004,"15min":0.66900000000000004},"min":{"1min":0.504,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81899999999999995,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68899999999999995,"15min":0.69499999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.93700000000000006,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.64000000000000001}]},{"osd":3,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.73099999999999998,"15min":0.751},"min":{"1min":0.49299999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91300000000000003,"5min":1.645,"15min":1.645},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.747,"15min":0.75900000000000001},"min":{"1min":0.51700000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96899999999999997,"5min":1.708,"15min":1.708},"last":0.68999999999999995}]},{"osd":5,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61799999999999999,"15min":0.61699999999999999},"min":{"1min":0.41499999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84499999999999997,"5min":1.113,"15min":1.113},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68799999999999994,"15min":0.69499999999999995},"min":{"1min":0.502,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91200000000000003,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70599999999999996,"15min":0.70699999999999996},"min":{"1min":0.48299999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.92100000000000004,"5min":1.127,"15min":1.127},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.74099999999999999,"15min":0.74199999999999999},"min":{"1min":0.442,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0009999999999999,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.78300000000000003}]},{"osd":7,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.54700000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.98499999999999999,"5min":1.198,"15min":1.198},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.81299999999999994,"15min":0.81699999999999995},"min":{"1min":0.65300000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":0.96299999999999997,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.73699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":741376,"data_stored":350831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.65300000000000002,"15min":0.629},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.85499999999999998,"5min":4.0510000000000002,"15min":4.0510000000000002},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.71299999999999997,"15min":0.67900000000000005},"min":{"1min":0.39300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.94899999999999995,"5min":6.431,"15min":6.431},"last":0.70499999999999996}]},{"osd":1,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.68300000000000005,"15min":0.65500000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.91300000000000003,"5min":5.3330000000000002,"15min":5.3330000000000002},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.69499999999999995,"15min":0.67100000000000004},"min":{"1min":0.47299999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.81299999999999994,"5min":4.2169999999999996,"15min":4.2169999999999996},"last":0.751}]},{"osd":2,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.70699999999999996,"15min":0.66500000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.94799999999999995,"5min":6.4850000000000003,"15min":6.4850000000000003},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.68200000000000005,"15min":0.66200000000000003},"min":{"1min":0.48099999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.80800000000000005,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":0.73299999999999998}]},{"osd":3,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.749,"15min":0.73899999999999999},"min":{"1min":0.44900000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89500000000000002,"5min":4.7809999999999997,"15min":4.7809999999999997},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.76100000000000001,"15min":0.73799999999999999},"min":{"1min":0.55100000000000005,"5min":0.503,"15min":0.503},"max":{"1min":0.86299999999999999,"5min":5.423,"15min":5.423},"last":0.79100000000000004}]},{"osd":4,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.67200000000000004,"15min":0.65500000000000003},"min":{"1min":0.432,"5min":0.375,"15min":0.375},"max":{"1min":0.879,"5min":3.988,"15min":3.988},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.749,"15min":0.72699999999999998},"min":{"1min":0.46100000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.84599999999999997,"5min":4.827,"15min":4.827},"last":0.502}]},{"osd":6,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.77800000000000002,"15min":0.73199999999999998},"min":{"1min":0.53600000000000003,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.92000000000000004,"5min":7.7000000000000002,"15min":7.7000000000000002},"last":0.63},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.75,"15min":0.72799999999999998},"min":{"1min":0.53000000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91900000000000004,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":0.53600000000000003}]},{"osd":7,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.83199999999999996,"15min":0.78000000000000003},"min":{"1min":0.52300000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.91900000000000004,"5min":9.1180000000000003,"15min":9.1180000000000003},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.82699999999999996,"15min":0.80100000000000005},"min":{"1min":0.53700000000000003,"5min":0.505,"15min":0.505},"max":{"1min":0.91900000000000004,"5min":5.2880000000000003,"15min":5.2880000000000003},"last":0.68100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T20:34:39.139 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-27T20:34:39.139 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-27T20:34:39.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.387+0000 7f6445bff700 1 Processor -- start 2023-07-27T20:34:39.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.387+0000 7f6445bff700 1 -- start start 2023-07-27T20:34:39.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.388+0000 7f6445bff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f64400c4d60 0x7f64400c45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:39.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.388+0000 7f6445bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f64400c7760 0x7f644015e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:39.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.388+0000 7f6445bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64400ca7f0 con 0x7f64400c41e0 2023-07-27T20:34:39.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.388+0000 7f6445bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6440154060 con 0x7f64400c7760 2023-07-27T20:34:39.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.388+0000 7f6445bff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64400c5990 con 0x7f64400c4d60 2023-07-27T20:34:39.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.389+0000 7f643ffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f64400c7760 0x7f644015e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:39.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.389+0000 7f643f7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f64400c41e0 0x7f6440154770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60668/0 (socket says 172.21.15.72:60668) 2023-07-27T20:34:39.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.389+0000 7f643f7fe700 1 -- 172.21.15.72:0/3535856971 learned_addr learned my addr 172.21.15.72:0/3535856971 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:39.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.389+0000 7f643effd700 1 --2- 172.21.15.72:0/3535856971 >> v2:172.21.15.173:3300/0 conn(0x7f64400c4d60 0x7f64400c45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:39.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.389+0000 7f643e7fc700 1 -- 172.21.15.72:0/3535856971 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1803710965 0 0) 0x7f6430001110 con 0x7f64400c41e0 2023-07-27T20:34:39.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.389+0000 7f643e7fc700 1 -- 172.21.15.72:0/3535856971 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64280035b0 con 0x7f64400c41e0 2023-07-27T20:34:39.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.389+0000 7f643ffff700 1 -- 172.21.15.72:0/3535856971 >> v2:172.21.15.173:3300/0 conn(0x7f64400c4d60 msgr2=0x7f64400c45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:39.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.389+0000 7f643ffff700 1 --2- 172.21.15.72:0/3535856971 >> v2:172.21.15.173:3300/0 conn(0x7f64400c4d60 0x7f64400c45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:39.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.389+0000 7f643ffff700 1 -- 172.21.15.72:0/3535856971 >> v1:172.21.15.72:6789/0 conn(0x7f64400c41e0 legacy=0x7f6440154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:39.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.389+0000 7f643ffff700 1 -- 172.21.15.72:0/3535856971 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64400c5c10 con 0x7f64400c7760 2023-07-27T20:34:39.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.389+0000 7f643ffff700 1 --2- 172.21.15.72:0/3535856971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64400c7760 0x7f644015e900 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f644008a6a0 tx=0x7f643800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c373f04f537f3ccf server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:39.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.390+0000 7f643e7fc700 1 -- 172.21.15.72:0/3535856971 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643800e070 con 0x7f64400c7760 2023-07-27T20:34:39.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.390+0000 7f643e7fc700 1 -- 172.21.15.72:0/3535856971 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643800bb20 con 0x7f64400c7760 2023-07-27T20:34:39.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.390+0000 7f643e7fc700 1 -- 172.21.15.72:0/3535856971 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6438012430 con 0x7f64400c7760 2023-07-27T20:34:39.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.390+0000 7f6445bff700 1 -- 172.21.15.72:0/3535856971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64400c7760 msgr2=0x7f644015e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:39.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.390+0000 7f6445bff700 1 --2- 172.21.15.72:0/3535856971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64400c7760 0x7f644015e900 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f644008a6a0 tx=0x7f643800b330 comp rx=0 tx=0).stop 2023-07-27T20:34:39.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.390+0000 7f6445bff700 1 -- 172.21.15.72:0/3535856971 shutdown_connections 2023-07-27T20:34:39.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.390+0000 7f6445bff700 1 --2- 172.21.15.72:0/3535856971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64400c7760 0x7f644015e900 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:39.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.390+0000 7f6445bff700 1 --2- 172.21.15.72:0/3535856971 >> v2:172.21.15.173:3300/0 conn(0x7f64400c4d60 0x7f64400c45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:39.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.390+0000 7f6445bff700 1 -- 172.21.15.72:0/3535856971 >> 172.21.15.72:0/3535856971 conn(0x7f64400c9860 msgr2=0x7f64400c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:39.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.390+0000 7f6445bff700 1 -- 172.21.15.72:0/3535856971 shutdown_connections 2023-07-27T20:34:39.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.390+0000 7f6445bff700 1 -- 172.21.15.72:0/3535856971 wait complete. 2023-07-27T20:34:39.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.392+0000 7f6445bff700 1 Processor -- start 2023-07-27T20:34:39.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.392+0000 7f6445bff700 1 -- start start 2023-07-27T20:34:39.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.393+0000 7f6445bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64400c41e0 0x7f64401e9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:39.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.393+0000 7f6445bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64400c4d60 0x7f64400c2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:39.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.393+0000 7f6445bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f64400c7760 0x7f64401ed260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:39.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.393+0000 7f6445bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64400c1ef0 con 0x7f64400c4d60 2023-07-27T20:34:39.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.393+0000 7f6445bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644014f7c0 con 0x7f64400c41e0 2023-07-27T20:34:39.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.393+0000 7f6445bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f644014faa0 con 0x7f64400c7760 2023-07-27T20:34:39.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.393+0000 7f643effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64400c4d60 0x7f64400c2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:39.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.393+0000 7f643effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64400c4d60 0x7f64400c2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52472/0 (socket says 172.21.15.72:52472) 2023-07-27T20:34:39.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.393+0000 7f643effd700 1 -- 172.21.15.72:0/3690072913 learned_addr learned my addr 172.21.15.72:0/3690072913 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:39.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.393+0000 7f643f7fe700 1 --2- 172.21.15.72:0/3690072913 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64400c41e0 0x7f64401e9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:39.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.393+0000 7f643ffff700 1 --2- 172.21.15.72:0/3690072913 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f64400c7760 0x7f64401ed260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:39.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.394+0000 7f643effd700 1 -- 172.21.15.72:0/3690072913 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f64400c7760 msgr2=0x7f64401ed260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:39.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.394+0000 7f643effd700 1 --2- 172.21.15.72:0/3690072913 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f64400c7760 0x7f64401ed260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:39.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.394+0000 7f643effd700 1 -- 172.21.15.72:0/3690072913 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64400c41e0 msgr2=0x7f64401e9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:39.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.394+0000 7f643effd700 1 --2- 172.21.15.72:0/3690072913 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64400c41e0 0x7f64401e9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:39.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.394+0000 7f643effd700 1 -- 172.21.15.72:0/3690072913 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6438009a70 con 0x7f64400c4d60 2023-07-27T20:34:39.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.394+0000 7f643effd700 1 --2- 172.21.15.72:0/3690072913 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64400c4d60 0x7f64400c2e60 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f643400e9b0 tx=0x7f643400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:39.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.394+0000 7f6427fff700 1 -- 172.21.15.72:0/3690072913 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6434009710 con 0x7f64400c4d60 2023-07-27T20:34:39.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.394+0000 7f6427fff700 1 -- 172.21.15.72:0/3690072913 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643400ee50 con 0x7f64400c4d60 2023-07-27T20:34:39.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.394+0000 7f6445bff700 1 -- 172.21.15.72:0/3690072913 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f644014fd80 con 0x7f64400c4d60 2023-07-27T20:34:39.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.394+0000 7f6427fff700 1 -- 172.21.15.72:0/3690072913 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643400ca50 con 0x7f64400c4d60 2023-07-27T20:34:39.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.394+0000 7f6445bff700 1 -- 172.21.15.72:0/3690072913 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64401ea530 con 0x7f64400c4d60 2023-07-27T20:34:39.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.395+0000 7f6445bff700 1 -- 172.21.15.72:0/3690072913 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f644014ffc0 con 0x7f64400c4d60 2023-07-27T20:34:39.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.396+0000 7f6427fff700 1 -- 172.21.15.72:0/3690072913 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f643400cbb0 con 0x7f64400c4d60 2023-07-27T20:34:39.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.398+0000 7f6427fff700 1 --2- 172.21.15.72:0/3690072913 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f642c06ace0 0x7f642c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:39.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.398+0000 7f6427fff700 1 -- 172.21.15.72:0/3690072913 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6434089520 con 0x7f64400c4d60 2023-07-27T20:34:39.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.398+0000 7f643f7fe700 1 --2- 172.21.15.72:0/3690072913 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f642c06ace0 0x7f642c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:39.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.399+0000 7f643f7fe700 1 --2- 172.21.15.72:0/3690072913 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f642c06ace0 0x7f642c06d1a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6430007fd0 tx=0x7f6430007c40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:39.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.402+0000 7f6427fff700 1 -- 172.21.15.72:0/3690072913 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f644014ffc0 con 0x7f64400c4d60 2023-07-27T20:34:39.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.672+0000 7f6445bff700 1 -- 172.21.15.72:0/3690072913 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f64401ecba0 con 0x7f64400c4d60 2023-07-27T20:34:39.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.676+0000 7f6427fff700 1 -- 172.21.15.72:0/3690072913 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7f64401ecba0 con 0x7f64400c4d60 2023-07-27T20:34:39.665 INFO:teuthology.orchestra.run.smithi072.stdout:[client.0] 2023-07-27T20:34:39.665 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDh08Jk6SgHDBAAkcBvssFv+WViV/ToWsnLCA== 2023-07-27T20:34:39.665 INFO:teuthology.orchestra.run.smithi072.stdout: caps mds = "allow" 2023-07-27T20:34:39.666 INFO:teuthology.orchestra.run.smithi072.stdout: caps mon = "allow r" 2023-07-27T20:34:39.666 INFO:teuthology.orchestra.run.smithi072.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-27T20:34:39.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.678+0000 7f6445bff700 1 -- 172.21.15.72:0/3690072913 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f642c06ace0 msgr2=0x7f642c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:39.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.678+0000 7f6445bff700 1 --2- 172.21.15.72:0/3690072913 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f642c06ace0 0x7f642c06d1a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6430007fd0 tx=0x7f6430007c40 comp rx=0 tx=0).stop 2023-07-27T20:34:39.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.678+0000 7f6445bff700 1 -- 172.21.15.72:0/3690072913 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64400c4d60 msgr2=0x7f64400c2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:39.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.678+0000 7f6445bff700 1 --2- 172.21.15.72:0/3690072913 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64400c4d60 0x7f64400c2e60 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f643400e9b0 tx=0x7f643400ecc0 comp rx=0 tx=0).stop 2023-07-27T20:34:39.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.678+0000 7f6445bff700 1 -- 172.21.15.72:0/3690072913 shutdown_connections 2023-07-27T20:34:39.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.678+0000 7f6445bff700 1 --2- 172.21.15.72:0/3690072913 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f642c06ace0 0x7f642c06d1a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:39.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.678+0000 7f6445bff700 1 --2- 172.21.15.72:0/3690072913 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f64400c7760 0x7f64401ed260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:39.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.678+0000 7f6445bff700 1 --2- 172.21.15.72:0/3690072913 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64400c41e0 0x7f64401e9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:39.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.678+0000 7f6445bff700 1 --2- 172.21.15.72:0/3690072913 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64400c4d60 0x7f64400c2e60 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:39.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.678+0000 7f6445bff700 1 -- 172.21.15.72:0/3690072913 >> 172.21.15.72:0/3690072913 conn(0x7f64400c9860 msgr2=0x7f644006b880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:39.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.678+0000 7f6445bff700 1 -- 172.21.15.72:0/3690072913 shutdown_connections 2023-07-27T20:34:39.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.678+0000 7f6445bff700 1 -- 172.21.15.72:0/3690072913 wait complete. 2023-07-27T20:34:39.671 INFO:teuthology.orchestra.run.smithi072.stderr:updated caps for client.0 2023-07-27T20:34:39.685 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T20:34:39.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.894+0000 7f442bdff700 1 Processor -- start 2023-07-27T20:34:39.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.894+0000 7f442bdff700 1 -- start start 2023-07-27T20:34:39.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.895+0000 7f442bdff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f442413b2c0 0x7f44240aa420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:39.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.895+0000 7f442bdff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44240a83a0 0x7f44240a8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:39.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.895+0000 7f442bdff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4424155600 con 0x7f44240bfd90 2023-07-27T20:34:39.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.895+0000 7f442bdff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44240a9620 con 0x7f442413b2c0 2023-07-27T20:34:39.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.895+0000 7f442bdff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4424155320 con 0x7f44240a83a0 2023-07-27T20:34:39.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.895+0000 7f4429b9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f442413b2c0 0x7f44240aa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:39.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.895+0000 7f442939a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f44240bfd90 0x7f44240aa960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:44692/0 (socket says 172.21.15.72:44692) 2023-07-27T20:34:39.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.895+0000 7f442939a700 1 -- 172.21.15.72:0/4224622751 learned_addr learned my addr 172.21.15.72:0/4224622751 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:39.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.896+0000 7f442a39c700 1 --2- 172.21.15.72:0/4224622751 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44240a83a0 0x7f44240a8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:39.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.896+0000 7f4428b99700 1 -- 172.21.15.72:0/4224622751 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1055260245 0 0) 0x7f4424155600 con 0x7f44240bfd90 2023-07-27T20:34:39.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.896+0000 7f4428b99700 1 -- 172.21.15.72:0/4224622751 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44100035b0 con 0x7f44240bfd90 2023-07-27T20:34:39.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.896+0000 7f4429b9b700 1 -- 172.21.15.72:0/4224622751 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44240a83a0 msgr2=0x7f44240a8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:39.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.896+0000 7f4429b9b700 1 --2- 172.21.15.72:0/4224622751 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44240a83a0 0x7f44240a8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:39.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.896+0000 7f4429b9b700 1 -- 172.21.15.72:0/4224622751 >> v1:172.21.15.72:6789/0 conn(0x7f44240bfd90 legacy=0x7f44240aa960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:39.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.896+0000 7f4429b9b700 1 -- 172.21.15.72:0/4224622751 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4424151e40 con 0x7f442413b2c0 2023-07-27T20:34:39.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.896+0000 7f4429b9b700 1 --2- 172.21.15.72:0/4224622751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f442413b2c0 0x7f44240aa420 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f4420009840 tx=0x7f4420009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e623740e2aa6743f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:39.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.896+0000 7f4428b99700 1 -- 172.21.15.72:0/4224622751 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4420011830 con 0x7f442413b2c0 2023-07-27T20:34:39.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.896+0000 7f4428b99700 1 -- 172.21.15.72:0/4224622751 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4420011990 con 0x7f442413b2c0 2023-07-27T20:34:39.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.896+0000 7f4428b99700 1 -- 172.21.15.72:0/4224622751 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4420011d20 con 0x7f442413b2c0 2023-07-27T20:34:39.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.897+0000 7f442bdff700 1 -- 172.21.15.72:0/4224622751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f442413b2c0 msgr2=0x7f44240aa420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:39.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.897+0000 7f442bdff700 1 --2- 172.21.15.72:0/4224622751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f442413b2c0 0x7f44240aa420 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f4420009840 tx=0x7f4420009b50 comp rx=0 tx=0).stop 2023-07-27T20:34:39.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.897+0000 7f442bdff700 1 -- 172.21.15.72:0/4224622751 shutdown_connections 2023-07-27T20:34:39.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.897+0000 7f442bdff700 1 --2- 172.21.15.72:0/4224622751 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44240a83a0 0x7f44240a8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:39.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.897+0000 7f442bdff700 1 --2- 172.21.15.72:0/4224622751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f442413b2c0 0x7f44240aa420 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:39.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.897+0000 7f442bdff700 1 -- 172.21.15.72:0/4224622751 >> 172.21.15.72:0/4224622751 conn(0x7f442406a190 msgr2=0x7f442406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:39.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.897+0000 7f442bdff700 1 -- 172.21.15.72:0/4224622751 shutdown_connections 2023-07-27T20:34:39.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.897+0000 7f442bdff700 1 -- 172.21.15.72:0/4224622751 wait complete. 2023-07-27T20:34:39.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.899+0000 7f442bdff700 1 Processor -- start 2023-07-27T20:34:39.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.899+0000 7f442bdff700 1 -- start start 2023-07-27T20:34:39.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.900+0000 7f442bdff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44240a83a0 0x7f44240c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:39.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.900+0000 7f442bdff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44240bfd90 0x7f44240c0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:39.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.900+0000 7f442bdff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f442413b2c0 0x7f44240c0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:39.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.900+0000 7f442bdff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44241eddc0 con 0x7f442413b2c0 2023-07-27T20:34:39.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.900+0000 7f442bdff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44241ea8a0 con 0x7f44240a83a0 2023-07-27T20:34:39.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.900+0000 7f442bdff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44240c1480 con 0x7f44240bfd90 2023-07-27T20:34:39.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.900+0000 7f442a39c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f442413b2c0 0x7f44240c0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:39.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.900+0000 7f442a39c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f442413b2c0 0x7f44240c0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57918/0 (socket says 172.21.15.72:57918) 2023-07-27T20:34:39.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.900+0000 7f442a39c700 1 -- 172.21.15.72:0/1362777354 learned_addr learned my addr 172.21.15.72:0/1362777354 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:39.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.900+0000 7f4429b9b700 1 --2- 172.21.15.72:0/1362777354 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44240a83a0 0x7f44240c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:39.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.900+0000 7f442939a700 1 --2- 172.21.15.72:0/1362777354 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44240bfd90 0x7f44240c0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:39.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.900+0000 7f442a39c700 1 -- 172.21.15.72:0/1362777354 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44240bfd90 msgr2=0x7f44240c0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:39.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.900+0000 7f442a39c700 1 --2- 172.21.15.72:0/1362777354 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44240bfd90 0x7f44240c0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:39.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.900+0000 7f442a39c700 1 -- 172.21.15.72:0/1362777354 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44240a83a0 msgr2=0x7f44240c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:39.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.900+0000 7f442a39c700 1 --2- 172.21.15.72:0/1362777354 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44240a83a0 0x7f44240c47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:39.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.900+0000 7f442a39c700 1 -- 172.21.15.72:0/1362777354 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44200094a0 con 0x7f442413b2c0 2023-07-27T20:34:39.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.901+0000 7f442a39c700 1 --2- 172.21.15.72:0/1362777354 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f442413b2c0 0x7f44240c0f40 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f441c007e60 tx=0x7f441c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:39.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.901+0000 7f441a7fc700 1 -- 172.21.15.72:0/1362777354 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c00ed30 con 0x7f442413b2c0 2023-07-27T20:34:39.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.901+0000 7f441a7fc700 1 -- 172.21.15.72:0/1362777354 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441c014420 con 0x7f442413b2c0 2023-07-27T20:34:39.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.901+0000 7f442bdff700 1 -- 172.21.15.72:0/1362777354 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44241e9ae0 con 0x7f442413b2c0 2023-07-27T20:34:39.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.901+0000 7f441a7fc700 1 -- 172.21.15.72:0/1362777354 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c0147d0 con 0x7f442413b2c0 2023-07-27T20:34:39.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.901+0000 7f442bdff700 1 -- 172.21.15.72:0/1362777354 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44241ea0a0 con 0x7f442413b2c0 2023-07-27T20:34:39.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.902+0000 7f442bdff700 1 -- 172.21.15.72:0/1362777354 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f442406c140 con 0x7f442413b2c0 2023-07-27T20:34:39.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.903+0000 7f441a7fc700 1 -- 172.21.15.72:0/1362777354 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f441c014930 con 0x7f442413b2c0 2023-07-27T20:34:39.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.904+0000 7f441a7fc700 1 --2- 172.21.15.72:0/1362777354 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f440806ace0 0x7f440806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:39.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.904+0000 7f441a7fc700 1 -- 172.21.15.72:0/1362777354 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f441c089bb0 con 0x7f442413b2c0 2023-07-27T20:34:39.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.905+0000 7f4429b9b700 1 --2- 172.21.15.72:0/1362777354 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f440806ace0 0x7f440806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:39.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.905+0000 7f4429b9b700 1 --2- 172.21.15.72:0/1362777354 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f440806ace0 0x7f440806d1a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4420000c00 tx=0x7f4420008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:39.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:39.908+0000 7f441a7fc700 1 -- 172.21.15.72:0/1362777354 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f441c054c60 con 0x7f442413b2c0 2023-07-27T20:34:40.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.147+0000 7f442bdff700 1 -- 172.21.15.72:0/1362777354 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44241393d0 con 0x7f442413b2c0 2023-07-27T20:34:40.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.148+0000 7f441a7fc700 1 -- 172.21.15.72:0/1362777354 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4676 (secure 0 0 0) 0x7f441c058280 con 0x7f442413b2c0 2023-07-27T20:34:40.137 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:34:40.137 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5498,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/2320540781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":2320540781},{"type":"v1","addr":"172.21.15.72:6833","nonce":2320540781}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5507,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/4181385736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4181385736},{"type":"v1","addr":"172.21.15.173:6836","nonce":4181385736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6333,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/1617909802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1617909802},{"type":"v1","addr":"172.21.15.72:6835","nonce":1617909802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T20:34:33.766750+0000","modified":"2023-07-27T20:34:37.312198+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6336},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6336":{"gid":6336,"name":"b","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/591656642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":591656642},{"type":"v1","addr":"172.21.15.173:6837","nonce":591656642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-27T20:34:40.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.150+0000 7f442bdff700 1 -- 172.21.15.72:0/1362777354 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f440806ace0 msgr2=0x7f440806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:40.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.150+0000 7f442bdff700 1 --2- 172.21.15.72:0/1362777354 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f440806ace0 0x7f440806d1a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4420000c00 tx=0x7f4420008030 comp rx=0 tx=0).stop 2023-07-27T20:34:40.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.150+0000 7f442bdff700 1 -- 172.21.15.72:0/1362777354 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f442413b2c0 msgr2=0x7f44240c0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:40.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.150+0000 7f442bdff700 1 --2- 172.21.15.72:0/1362777354 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f442413b2c0 0x7f44240c0f40 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f441c007e60 tx=0x7f441c00e3c0 comp rx=0 tx=0).stop 2023-07-27T20:34:40.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.150+0000 7f442bdff700 1 -- 172.21.15.72:0/1362777354 shutdown_connections 2023-07-27T20:34:40.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.150+0000 7f442bdff700 1 --2- 172.21.15.72:0/1362777354 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f442413b2c0 0x7f44240c0f40 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:40.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.150+0000 7f442bdff700 1 --2- 172.21.15.72:0/1362777354 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44240a83a0 0x7f44240c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:40.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.150+0000 7f442bdff700 1 --2- 172.21.15.72:0/1362777354 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f440806ace0 0x7f440806d1a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:40.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.150+0000 7f442bdff700 1 --2- 172.21.15.72:0/1362777354 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44240bfd90 0x7f44240c0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:40.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.150+0000 7f442bdff700 1 -- 172.21.15.72:0/1362777354 >> 172.21.15.72:0/1362777354 conn(0x7f442406a190 msgr2=0x7f44240730d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:40.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.150+0000 7f442bdff700 1 -- 172.21.15.72:0/1362777354 shutdown_connections 2023-07-27T20:34:40.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.150+0000 7f442bdff700 1 -- 172.21.15.72:0/1362777354 wait complete. 2023-07-27T20:34:40.140 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 33 2023-07-27T20:34:40.558 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 33, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-27T20:34:33.766750+0000', 'modified': '2023-07-27T20:34:37.312198+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6336}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6336': {'gid': 6336, 'name': 'b', 'rank': 0, 'incarnation': 29, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.173:6837/591656642', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6835', 'nonce': 591656642}, {'type': 'v1', 'addr': '172.21.15.173:6837', 'nonce': 591656642}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-27T20:34:40.558 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-27T20:34:40.559 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-07-27T20:34:40.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.769+0000 7f6913dff700 1 Processor -- start 2023-07-27T20:34:40.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.770+0000 7f6913dff700 1 -- start start 2023-07-27T20:34:40.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.771+0000 7f6913dff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f690c0c4400 0x7f690c0c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:40.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.771+0000 7f6913dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f690c1549f0 0x7f690c1514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:40.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.771+0000 7f6913dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f690c06b710 con 0x7f690c06b150 2023-07-27T20:34:40.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.771+0000 7f6913dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f690c1545d0 con 0x7f690c1549f0 2023-07-27T20:34:40.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.771+0000 7f6913dff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f690c06c860 con 0x7f690c0c4400 2023-07-27T20:34:40.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.771+0000 7f691239c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f690c1549f0 0x7f690c1514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:40.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.771+0000 7f691139a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f690c06b150 0x7f690c0c4cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:44708/0 (socket says 172.21.15.72:44708) 2023-07-27T20:34:40.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.771+0000 7f691139a700 1 -- 172.21.15.72:0/51973411 learned_addr learned my addr 172.21.15.72:0/51973411 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:40.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.771+0000 7f6911b9b700 1 --2- 172.21.15.72:0/51973411 >> v2:172.21.15.173:3300/0 conn(0x7f690c0c4400 0x7f690c0c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:40.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.771+0000 7f691239c700 1 -- 172.21.15.72:0/51973411 >> v2:172.21.15.173:3300/0 conn(0x7f690c0c4400 msgr2=0x7f690c0c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:40.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.771+0000 7f691239c700 1 --2- 172.21.15.72:0/51973411 >> v2:172.21.15.173:3300/0 conn(0x7f690c0c4400 0x7f690c0c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:40.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.771+0000 7f691239c700 1 -- 172.21.15.72:0/51973411 >> v1:172.21.15.72:6789/0 conn(0x7f690c06b150 legacy=0x7f690c0c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:40.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.771+0000 7f691239c700 1 -- 172.21.15.72:0/51973411 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f690c06b9f0 con 0x7f690c1549f0 2023-07-27T20:34:40.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.772+0000 7f691239c700 1 --2- 172.21.15.72:0/51973411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f690c1549f0 0x7f690c1514a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f690c08b040 tx=0x7f690400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce8baff6af6f651b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:40.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.772+0000 7f6910b99700 1 -- 172.21.15.72:0/51973411 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690400e070 con 0x7f690c1549f0 2023-07-27T20:34:40.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.772+0000 7f6910b99700 1 -- 172.21.15.72:0/51973411 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690400bbd0 con 0x7f690c1549f0 2023-07-27T20:34:40.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.772+0000 7f6910b99700 1 -- 172.21.15.72:0/51973411 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6904012430 con 0x7f690c1549f0 2023-07-27T20:34:40.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.772+0000 7f6913dff700 1 -- 172.21.15.72:0/51973411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f690c1549f0 msgr2=0x7f690c1514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:40.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.772+0000 7f6913dff700 1 --2- 172.21.15.72:0/51973411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f690c1549f0 0x7f690c1514a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f690c08b040 tx=0x7f690400b330 comp rx=0 tx=0).stop 2023-07-27T20:34:40.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.773+0000 7f6913dff700 1 -- 172.21.15.72:0/51973411 shutdown_connections 2023-07-27T20:34:40.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.773+0000 7f6913dff700 1 --2- 172.21.15.72:0/51973411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f690c1549f0 0x7f690c1514a0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:40.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.773+0000 7f6913dff700 1 --2- 172.21.15.72:0/51973411 >> v2:172.21.15.173:3300/0 conn(0x7f690c0c4400 0x7f690c0c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:40.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.773+0000 7f6913dff700 1 -- 172.21.15.72:0/51973411 >> 172.21.15.72:0/51973411 conn(0x7f690c0ab300 msgr2=0x7f690c0ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:40.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.773+0000 7f6913dff700 1 -- 172.21.15.72:0/51973411 shutdown_connections 2023-07-27T20:34:40.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.773+0000 7f6913dff700 1 -- 172.21.15.72:0/51973411 wait complete. 2023-07-27T20:34:40.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.774+0000 7f6913dff700 1 Processor -- start 2023-07-27T20:34:40.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.774+0000 7f6913dff700 1 -- start start 2023-07-27T20:34:40.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.775+0000 7f6913dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f690c06b150 0x7f690c14a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:40.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.775+0000 7f6913dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f690c0c4400 0x7f690c149a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:40.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.775+0000 7f6913dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f690c1549f0 0x7f690c1e9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:40.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.775+0000 7f6913dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690c14aa90 con 0x7f690c06b150 2023-07-27T20:34:40.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.775+0000 7f6913dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690c14dbe0 con 0x7f690c1549f0 2023-07-27T20:34:40.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.775+0000 7f6913dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690c14dec0 con 0x7f690c0c4400 2023-07-27T20:34:40.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.775+0000 7f6911b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f690c06b150 0x7f690c14a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:40.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.775+0000 7f6911b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f690c06b150 0x7f690c14a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57940/0 (socket says 172.21.15.72:57940) 2023-07-27T20:34:40.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.775+0000 7f6911b9b700 1 -- 172.21.15.72:0/303569792 learned_addr learned my addr 172.21.15.72:0/303569792 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:40.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.776+0000 7f691239c700 1 --2- 172.21.15.72:0/303569792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f690c1549f0 0x7f690c1e9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:40.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.776+0000 7f691139a700 1 --2- 172.21.15.72:0/303569792 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f690c0c4400 0x7f690c149a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:40.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.776+0000 7f6911b9b700 1 -- 172.21.15.72:0/303569792 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f690c0c4400 msgr2=0x7f690c149a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:40.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.776+0000 7f6911b9b700 1 --2- 172.21.15.72:0/303569792 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f690c0c4400 0x7f690c149a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:40.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.776+0000 7f6911b9b700 1 -- 172.21.15.72:0/303569792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f690c1549f0 msgr2=0x7f690c1e9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:40.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.776+0000 7f6911b9b700 1 --2- 172.21.15.72:0/303569792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f690c1549f0 0x7f690c1e9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:40.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.776+0000 7f6911b9b700 1 -- 172.21.15.72:0/303569792 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6904009a70 con 0x7f690c06b150 2023-07-27T20:34:40.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.776+0000 7f691239c700 1 --2- 172.21.15.72:0/303569792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f690c1549f0 0x7f690c1e9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:40.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.776+0000 7f691139a700 1 --2- 172.21.15.72:0/303569792 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f690c0c4400 0x7f690c149a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:40.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.776+0000 7f6911b9b700 1 --2- 172.21.15.72:0/303569792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f690c06b150 0x7f690c14a550 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f690800e810 tx=0x7f690800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:40.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.776+0000 7f69027fc700 1 -- 172.21.15.72:0/303569792 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6908013610 con 0x7f690c06b150 2023-07-27T20:34:40.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.777+0000 7f69027fc700 1 -- 172.21.15.72:0/303569792 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6908013770 con 0x7f690c06b150 2023-07-27T20:34:40.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.777+0000 7f6913dff700 1 -- 172.21.15.72:0/303569792 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f690c14e1a0 con 0x7f690c06b150 2023-07-27T20:34:40.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.777+0000 7f69027fc700 1 -- 172.21.15.72:0/303569792 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6908013b20 con 0x7f690c06b150 2023-07-27T20:34:40.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.777+0000 7f6913dff700 1 -- 172.21.15.72:0/303569792 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f690c149f70 con 0x7f690c06b150 2023-07-27T20:34:40.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.779+0000 7f69027fc700 1 -- 172.21.15.72:0/303569792 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6908013c80 con 0x7f690c06b150 2023-07-27T20:34:40.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.780+0000 7f69027fc700 1 --2- 172.21.15.72:0/303569792 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f68f006ace0 0x7f68f006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:40.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.780+0000 7f69027fc700 1 -- 172.21.15.72:0/303569792 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f69080892e0 con 0x7f690c06b150 2023-07-27T20:34:40.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.780+0000 7f691139a700 1 --2- 172.21.15.72:0/303569792 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f68f006ace0 0x7f68f006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:40.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.781+0000 7f691139a700 1 --2- 172.21.15.72:0/303569792 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f68f006ace0 0x7f68f006d1a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f690c153ab0 tx=0x7f68fc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:40.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.781+0000 7f6927769b80 1 Processor -- start 2023-07-27T20:34:40.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.782+0000 7f6927769b80 1 -- start start 2023-07-27T20:34:40.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.783+0000 7f6927769b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55654d32dd20 0x55654d311280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:40.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.783+0000 7f6927769b80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55654d32e100 0x55654d30adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:40.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.783+0000 7f6927769b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55654d32e580 0x55654d30b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:40.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.783+0000 7f6927769b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55654d284ab0 con 0x55654d32dd20 2023-07-27T20:34:40.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.783+0000 7f6927769b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55654d269440 con 0x55654d32e580 2023-07-27T20:34:40.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.783+0000 7f6927769b80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55654d266ba0 con 0x55654d32e100 2023-07-27T20:34:40.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.783+0000 7f6911b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55654d32dd20 0x55654d311280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:40.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.783+0000 7f6911b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55654d32dd20 0x55654d311280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57954/0 (socket says 172.21.15.72:57954) 2023-07-27T20:34:40.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.783+0000 7f6911b9b700 1 -- 172.21.15.72:0/1107838716 learned_addr learned my addr 172.21.15.72:0/1107838716 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:40.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.783+0000 7f691139a700 1 --2- 172.21.15.72:0/1107838716 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55654d32e100 0x55654d30adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:40.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.783+0000 7f691239c700 1 --2- 172.21.15.72:0/1107838716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55654d32e580 0x55654d30b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:40.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.783+0000 7f6911b9b700 1 -- 172.21.15.72:0/1107838716 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55654d32e100 msgr2=0x55654d30adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:40.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.783+0000 7f6911b9b700 1 --2- 172.21.15.72:0/1107838716 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55654d32e100 0x55654d30adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:40.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.783+0000 7f6911b9b700 1 -- 172.21.15.72:0/1107838716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55654d32e580 msgr2=0x55654d30b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:40.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.783+0000 7f6911b9b700 1 --2- 172.21.15.72:0/1107838716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55654d32e580 0x55654d30b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:40.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.783+0000 7f6911b9b700 1 -- 172.21.15.72:0/1107838716 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55654d055790 con 0x55654d32dd20 2023-07-27T20:34:40.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.783+0000 7f691139a700 1 --2- 172.21.15.72:0/1107838716 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55654d32e100 0x55654d30adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:40.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.783+0000 7f691239c700 1 --2- 172.21.15.72:0/1107838716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55654d32e580 0x55654d30b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:40.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.784+0000 7f6911b9b700 1 --2- 172.21.15.72:0/1107838716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55654d32dd20 0x55654d311280 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f69080874a0 tx=0x7f69080578e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2772047dbf423089 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:40.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.784+0000 7f68ef7fe700 1 -- 172.21.15.72:0/1107838716 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6908056220 con 0x55654d32dd20 2023-07-27T20:34:40.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.784+0000 7f68ef7fe700 1 -- 172.21.15.72:0/1107838716 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690805fd40 con 0x55654d32dd20 2023-07-27T20:34:40.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.784+0000 7f68ef7fe700 1 -- 172.21.15.72:0/1107838716 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6908053c70 con 0x55654d32dd20 2023-07-27T20:34:40.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.784+0000 7f6927769b80 1 -- 172.21.15.72:0/1107838716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55654d32dd20 msgr2=0x55654d311280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:40.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.784+0000 7f6927769b80 1 --2- 172.21.15.72:0/1107838716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55654d32dd20 0x55654d311280 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f69080874a0 tx=0x7f69080578e0 comp rx=0 tx=0).stop 2023-07-27T20:34:40.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.784+0000 7f6927769b80 1 -- 172.21.15.72:0/1107838716 shutdown_connections 2023-07-27T20:34:40.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.784+0000 7f6927769b80 1 --2- 172.21.15.72:0/1107838716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55654d32e580 0x55654d30b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:40.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.784+0000 7f6927769b80 1 --2- 172.21.15.72:0/1107838716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55654d32dd20 0x55654d311280 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:40.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.784+0000 7f6927769b80 1 --2- 172.21.15.72:0/1107838716 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55654d32e100 0x55654d30adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:40.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.784+0000 7f6927769b80 1 -- 172.21.15.72:0/1107838716 >> 172.21.15.72:0/1107838716 conn(0x55654d2703a0 msgr2=0x55654d30dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:40.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.785+0000 7f6927769b80 1 -- 172.21.15.72:0/1107838716 shutdown_connections 2023-07-27T20:34:40.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.785+0000 7f6927769b80 1 -- 172.21.15.72:0/1107838716 wait complete. 2023-07-27T20:34:40.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.785+0000 7f6927769b80 1 -- start start 2023-07-27T20:34:40.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.786+0000 7f6927769b80 1 Processor -- start 2023-07-27T20:34:40.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.787+0000 7f6927769b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55654d32dd20 0x55654d349ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:40.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.787+0000 7f6927769b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55654d32e100 0x55654d34f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:40.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.787+0000 7f6927769b80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55654d32e580 0x55654d322d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:40.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.787+0000 7f6927769b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55654d262490 con 0x55654d32e100 2023-07-27T20:34:40.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.787+0000 7f6927769b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55654d21f5b0 con 0x55654d32dd20 2023-07-27T20:34:40.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.787+0000 7f6927769b80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55654d205910 con 0x55654d32e580 2023-07-27T20:34:40.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.787+0000 7f6927769b80 10 client.0 _ll_register_callbacks cb 0x55654d05ea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-27T20:34:40.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.788+0000 7f691139a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55654d32e100 0x55654d34f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:40.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.788+0000 7f691139a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55654d32e100 0x55654d34f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57966/0 (socket says 172.21.15.72:57966) 2023-07-27T20:34:40.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.788+0000 7f691139a700 1 -- 172.21.15.72:0/3455799580 learned_addr learned my addr 172.21.15.72:0/3455799580 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:40.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.788+0000 7f691239c700 1 --2- 172.21.15.72:0/3455799580 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55654d32e580 0x55654d322d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:40.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.788+0000 7f6911b9b700 1 --2- 172.21.15.72:0/3455799580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55654d32dd20 0x55654d349ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:40.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.788+0000 7f691139a700 1 -- 172.21.15.72:0/3455799580 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55654d32e580 msgr2=0x55654d322d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:40.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.788+0000 7f691139a700 1 --2- 172.21.15.72:0/3455799580 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55654d32e580 0x55654d322d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:40.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.788+0000 7f691139a700 1 -- 172.21.15.72:0/3455799580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55654d32dd20 msgr2=0x55654d349ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:40.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.788+0000 7f691139a700 1 --2- 172.21.15.72:0/3455799580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55654d32dd20 0x55654d349ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:40.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.788+0000 7f691139a700 1 -- 172.21.15.72:0/3455799580 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f690c149f70 con 0x55654d32e100 2023-07-27T20:34:40.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.788+0000 7f691139a700 1 --2- 172.21.15.72:0/3455799580 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55654d32e100 0x55654d34f910 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f68fc007700 tx=0x7f68fc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e2f5030afb70440 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:40.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.788+0000 7f68ecff9700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-07-27T20:34:40.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.788+0000 7f68ecff9700 1 -- 172.21.15.72:0/3455799580 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc005e20 con 0x55654d32e100 2023-07-27T20:34:40.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.789+0000 7f68ecff9700 1 -- 172.21.15.72:0/3455799580 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f68fc021d30 con 0x55654d32e100 2023-07-27T20:34:40.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.789+0000 7f6927769b80 1 -- 172.21.15.72:0/3455799580 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55654d302d80 con 0x55654d32e100 2023-07-27T20:34:40.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.789+0000 7f68ecff9700 1 -- 172.21.15.72:0/3455799580 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68fc014110 con 0x55654d32e100 2023-07-27T20:34:40.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.789+0000 7f6927769b80 10 client.6486 fetch_fsmap learned FSMap version 33 2023-07-27T20:34:40.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.789+0000 7f6927769b80 1 -- 172.21.15.72:0/3455799580 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x55654d1420a0 con 0x55654d32e100 2023-07-27T20:34:40.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.789+0000 7f68ecff9700 1 -- 172.21.15.72:0/3455799580 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55654d302d80 con 0x55654d32e100 2023-07-27T20:34:40.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.789+0000 7f68ecff9700 1 -- 172.21.15.72:0/3455799580 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 33) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f68fc029070 con 0x55654d32e100 2023-07-27T20:34:40.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.789+0000 7f6927769b80 10 client.6486 fetch_fsmap finished waiting for FSMap version 33 2023-07-27T20:34:40.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.789+0000 7f6927769b80 10 client.6486 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-27T20:34:40.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.789+0000 7f6927769b80 20 client.6486 populate_metadata read hostname 'smithi072' 2023-07-27T20:34:40.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.789+0000 7f6927769b80 1 --2- 172.21.15.72:0/3455799580 >> [v2:172.21.15.173:6835/591656642,v1:172.21.15.173:6837/591656642] conn(0x55654d349330 0x55654d35bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:40.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.789+0000 7f6927769b80 4 client.6486 mds_command: new command op to 6336 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-27T20:34:40.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.789+0000 7f6927769b80 1 -- 172.21.15.72:0/3455799580 --> [v2:172.21.15.173:6835/591656642,v1:172.21.15.173:6837/591656642] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55654d2dfb50 con 0x55654d349330 2023-07-27T20:34:40.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.790+0000 7f6911b9b700 1 --2- 172.21.15.72:0/3455799580 >> [v2:172.21.15.173:6835/591656642,v1:172.21.15.173:6837/591656642] conn(0x55654d349330 0x55654d35bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:40.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.790+0000 7f68ecff9700 10 client.6486 ms_handle_connect on v2:172.21.15.173:6835/591656642 2023-07-27T20:34:40.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.790+0000 7f6911b9b700 1 --2- 172.21.15.72:0/3455799580 >> [v2:172.21.15.173:6835/591656642,v1:172.21.15.173:6837/591656642] conn(0x55654d349330 0x55654d35bb40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62814990a205e28e server_cookie=71e604d7a0f969de in_seq=0 out_seq=0 2023-07-27T20:34:40.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.791+0000 7f68ecff9700 1 -- 172.21.15.72:0/3455799580 <== mds.0 v2:172.21.15.173:6835/591656642 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55654d2dfb50 con 0x55654d349330 2023-07-27T20:34:40.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.791+0000 7f68ecff9700 10 client.6486 handle_command_reply: tid=0 2023-07-27T20:34:40.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.791+0000 7f6927769b80 1 client.6486 shutdown 2023-07-27T20:34:40.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.792+0000 7f6927769b80 1 -- 172.21.15.72:0/3455799580 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55654d32e100 msgr2=0x55654d34f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:40.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.792+0000 7f6927769b80 1 --2- 172.21.15.72:0/3455799580 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55654d32e100 0x55654d34f910 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f68fc007700 tx=0x7f68fc000ed0 comp rx=0 tx=0).stop 2023-07-27T20:34:40.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.792+0000 7f6927769b80 1 -- 172.21.15.72:0/3455799580 shutdown_connections 2023-07-27T20:34:40.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.792+0000 7f6927769b80 1 --2- 172.21.15.72:0/3455799580 >> [v2:172.21.15.173:6835/591656642,v1:172.21.15.173:6837/591656642] conn(0x55654d349330 0x55654d35bb40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:40.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.792+0000 7f6927769b80 1 --2- 172.21.15.72:0/3455799580 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55654d32e580 0x55654d322d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:40.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.792+0000 7f6927769b80 1 --2- 172.21.15.72:0/3455799580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55654d32dd20 0x55654d349ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:40.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.792+0000 7f68ecff9700 0 client.6486 ms_handle_reset on v2:172.21.15.173:6835/591656642 2023-07-27T20:34:40.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.792+0000 7f6927769b80 1 --2- 172.21.15.72:0/3455799580 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55654d32e100 0x55654d34f910 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:40.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.792+0000 7f6927769b80 1 -- 172.21.15.72:0/3455799580 >> 172.21.15.72:0/3455799580 conn(0x55654d2703a0 msgr2=0x55654d30a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:40.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.792+0000 7f6927769b80 1 -- 172.21.15.72:0/3455799580 shutdown_connections 2023-07-27T20:34:40.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.792+0000 7f6927769b80 1 -- 172.21.15.72:0/3455799580 wait complete. 2023-07-27T20:34:40.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.792+0000 7f6927769b80 20 client.6486 trim_cache size 0 max 16384 2023-07-27T20:34:40.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.810+0000 7f6927769b80 1 Processor -- start 2023-07-27T20:34:40.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.810+0000 7f6927769b80 1 -- start start 2023-07-27T20:34:40.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.811+0000 7f6927769b80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55654d32dd20 0x55654d30ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:40.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.811+0000 7f6927769b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55654d32e100 0x55654d346f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:40.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.811+0000 7f6927769b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55654d32e580 0x55654d30b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:40.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.811+0000 7f6927769b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55654d056390 con 0x55654d32e100 2023-07-27T20:34:40.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.811+0000 7f6927769b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55654d302b10 con 0x55654d32e580 2023-07-27T20:34:40.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.811+0000 7f6927769b80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55654d34a220 con 0x55654d32dd20 2023-07-27T20:34:40.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.811+0000 7f691139a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55654d32e100 0x55654d346f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:40.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.811+0000 7f691139a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55654d32e100 0x55654d346f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57970/0 (socket says 172.21.15.72:57970) 2023-07-27T20:34:40.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.811+0000 7f691139a700 1 -- 172.21.15.72:0/1189123054 learned_addr learned my addr 172.21.15.72:0/1189123054 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:40.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.811+0000 7f691139a700 1 -- 172.21.15.72:0/1189123054 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55654d32dd20 msgr2=0x55654d30ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:40.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.811+0000 7f691139a700 1 --2- 172.21.15.72:0/1189123054 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55654d32dd20 0x55654d30ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:40.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.811+0000 7f691139a700 1 -- 172.21.15.72:0/1189123054 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55654d32e580 msgr2=0x55654d30b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:40.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.811+0000 7f691139a700 1 --2- 172.21.15.72:0/1189123054 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55654d32e580 0x55654d30b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:40.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.811+0000 7f691139a700 1 -- 172.21.15.72:0/1189123054 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55654d30fa90 con 0x55654d32e100 2023-07-27T20:34:40.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.811+0000 7f691139a700 1 --2- 172.21.15.72:0/1189123054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55654d32e100 0x55654d346f50 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f68fc001490 tx=0x7f68fc01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a3924dfd268016 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:40.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.812+0000 7f68effff700 1 -- 172.21.15.72:0/1189123054 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc005e20 con 0x55654d32e100 2023-07-27T20:34:40.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.812+0000 7f68effff700 1 -- 172.21.15.72:0/1189123054 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68fc0140f0 con 0x55654d32e100 2023-07-27T20:34:40.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.812+0000 7f68effff700 1 -- 172.21.15.72:0/1189123054 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc0149f0 con 0x55654d32e100 2023-07-27T20:34:40.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.812+0000 7f6927769b80 1 -- 172.21.15.72:0/1189123054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55654d32e100 msgr2=0x55654d346f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:40.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.812+0000 7f6927769b80 1 --2- 172.21.15.72:0/1189123054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55654d32e100 0x55654d346f50 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f68fc001490 tx=0x7f68fc01e000 comp rx=0 tx=0).stop 2023-07-27T20:34:40.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.812+0000 7f6927769b80 1 -- 172.21.15.72:0/1189123054 shutdown_connections 2023-07-27T20:34:40.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.812+0000 7f6927769b80 1 --2- 172.21.15.72:0/1189123054 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55654d32e580 0x55654d30b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:40.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.812+0000 7f6927769b80 1 --2- 172.21.15.72:0/1189123054 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55654d32dd20 0x55654d30ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:40.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.812+0000 7f6927769b80 1 --2- 172.21.15.72:0/1189123054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55654d32e100 0x55654d346f50 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:40.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.812+0000 7f6927769b80 1 -- 172.21.15.72:0/1189123054 >> 172.21.15.72:0/1189123054 conn(0x55654d2703a0 msgr2=0x55654d34bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:40.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.812+0000 7f6927769b80 1 -- 172.21.15.72:0/1189123054 shutdown_connections 2023-07-27T20:34:40.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.812+0000 7f6927769b80 1 -- 172.21.15.72:0/1189123054 wait complete. 2023-07-27T20:34:40.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.813+0000 7f6927769b80 1 -- start start 2023-07-27T20:34:40.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.813+0000 7f6927769b80 1 Processor -- start 2023-07-27T20:34:40.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.814+0000 7f6927769b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55654d32dd20 0x55654d34f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:40.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.814+0000 7f6927769b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55654d32e100 0x55654d351270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:40.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.814+0000 7f6927769b80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55654d32e580 0x55654d3b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:40.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.814+0000 7f6927769b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55654d3b7240 con 0x55654d32e100 2023-07-27T20:34:40.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.814+0000 7f6927769b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55654d347590 con 0x55654d32dd20 2023-07-27T20:34:40.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.814+0000 7f6927769b80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55654d350de0 con 0x55654d32e580 2023-07-27T20:34:40.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.814+0000 7f6927769b80 10 client.0 _ll_register_callbacks cb 0x55654d05ea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-27T20:34:40.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.814+0000 7f691139a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55654d32e100 0x55654d351270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:40.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.814+0000 7f691139a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55654d32e100 0x55654d351270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57972/0 (socket says 172.21.15.72:57972) 2023-07-27T20:34:40.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.814+0000 7f691139a700 1 -- 172.21.15.72:0/2914494480 learned_addr learned my addr 172.21.15.72:0/2914494480 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:40.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.814+0000 7f6911b9b700 1 --2- 172.21.15.72:0/2914494480 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55654d32dd20 0x55654d34f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:40.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.814+0000 7f691239c700 1 --2- 172.21.15.72:0/2914494480 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55654d32e580 0x55654d3b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:40.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.815+0000 7f691139a700 1 -- 172.21.15.72:0/2914494480 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55654d32e580 msgr2=0x55654d3b0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:40.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.815+0000 7f691139a700 1 --2- 172.21.15.72:0/2914494480 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55654d32e580 0x55654d3b0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:40.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.815+0000 7f691139a700 1 -- 172.21.15.72:0/2914494480 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55654d32dd20 msgr2=0x55654d34f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:40.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.815+0000 7f691139a700 1 --2- 172.21.15.72:0/2914494480 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55654d32dd20 0x55654d34f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:40.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.815+0000 7f691139a700 1 -- 172.21.15.72:0/2914494480 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55654d1420a0 con 0x55654d32e100 2023-07-27T20:34:40.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.815+0000 7f691239c700 1 --2- 172.21.15.72:0/2914494480 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55654d32e580 0x55654d3b0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:40.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.815+0000 7f691139a700 1 --2- 172.21.15.72:0/2914494480 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55654d32e100 0x55654d351270 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f68fc005910 tx=0x7f68fc007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8547272befd5ca2 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:40.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.815+0000 7f68ecff9700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-07-27T20:34:40.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.815+0000 7f68ecff9700 1 -- 172.21.15.72:0/2914494480 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc021430 con 0x55654d32e100 2023-07-27T20:34:40.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.815+0000 7f68ecff9700 1 -- 172.21.15.72:0/2914494480 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f68fc035d70 con 0x55654d32e100 2023-07-27T20:34:40.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.815+0000 7f6927769b80 1 -- 172.21.15.72:0/2914494480 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f690805fd40 con 0x55654d32e100 2023-07-27T20:34:40.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.815+0000 7f68ecff9700 1 -- 172.21.15.72:0/2914494480 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68fc021590 con 0x55654d32e100 2023-07-27T20:34:40.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.815+0000 7f6927769b80 10 client.6492 fetch_fsmap learned FSMap version 33 2023-07-27T20:34:40.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.815+0000 7f6927769b80 1 -- 172.21.15.72:0/2914494480 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x55654d227b10 con 0x55654d32e100 2023-07-27T20:34:40.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.815+0000 7f68ecff9700 1 -- 172.21.15.72:0/2914494480 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690805fd40 con 0x55654d32e100 2023-07-27T20:34:40.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.816+0000 7f68ecff9700 1 -- 172.21.15.72:0/2914494480 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 33) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f68fc014430 con 0x55654d32e100 2023-07-27T20:34:40.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.816+0000 7f6927769b80 10 client.6492 fetch_fsmap finished waiting for FSMap version 33 2023-07-27T20:34:40.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.816+0000 7f6927769b80 10 client.6492 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-27T20:34:40.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.816+0000 7f6927769b80 20 client.6492 populate_metadata read hostname 'smithi072' 2023-07-27T20:34:40.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.816+0000 7f6927769b80 1 --2- 172.21.15.72:0/2914494480 >> [v2:172.21.15.173:6835/591656642,v1:172.21.15.173:6837/591656642] conn(0x55654d347d40 0x55654d3b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:40.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.816+0000 7f6927769b80 4 client.6492 mds_command: new command op to 6336 tid=0[{"prefix": "status"}] 2023-07-27T20:34:40.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.816+0000 7f6927769b80 1 -- 172.21.15.72:0/2914494480 --> [v2:172.21.15.173:6835/591656642,v1:172.21.15.173:6837/591656642] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55654d25b5d0 con 0x55654d347d40 2023-07-27T20:34:40.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.816+0000 7f6911b9b700 1 --2- 172.21.15.72:0/2914494480 >> [v2:172.21.15.173:6835/591656642,v1:172.21.15.173:6837/591656642] conn(0x55654d347d40 0x55654d3b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:40.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.816+0000 7f6911b9b700 1 --2- 172.21.15.72:0/2914494480 >> [v2:172.21.15.173:6835/591656642,v1:172.21.15.173:6837/591656642] conn(0x55654d347d40 0x55654d3b0f90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30ac375cb21d0b76 server_cookie=6522891468228bc3 in_seq=0 out_seq=0 2023-07-27T20:34:40.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.816+0000 7f68ecff9700 10 client.6492 ms_handle_connect on v2:172.21.15.173:6835/591656642 2023-07-27T20:34:40.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.817+0000 7f68ecff9700 1 -- 172.21.15.72:0/2914494480 <== mds.0 v2:172.21.15.173:6835/591656642 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55654d25b5d0 con 0x55654d347d40 2023-07-27T20:34:40.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.817+0000 7f68ecff9700 10 client.6492 handle_command_reply: tid=0 2023-07-27T20:34:40.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.817+0000 7f6927769b80 1 client.6492 shutdown 2023-07-27T20:34:40.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.817+0000 7f6927769b80 1 -- 172.21.15.72:0/2914494480 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55654d32e100 msgr2=0x55654d351270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:40.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.817+0000 7f6927769b80 1 --2- 172.21.15.72:0/2914494480 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55654d32e100 0x55654d351270 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f68fc005910 tx=0x7f68fc007000 comp rx=0 tx=0).stop 2023-07-27T20:34:40.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.817+0000 7f6927769b80 1 -- 172.21.15.72:0/2914494480 shutdown_connections 2023-07-27T20:34:40.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.817+0000 7f6927769b80 1 --2- 172.21.15.72:0/2914494480 >> [v2:172.21.15.173:6835/591656642,v1:172.21.15.173:6837/591656642] conn(0x55654d347d40 0x55654d3b0f90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:40.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.817+0000 7f6927769b80 1 --2- 172.21.15.72:0/2914494480 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55654d32e580 0x55654d3b0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:40.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.817+0000 7f6927769b80 1 --2- 172.21.15.72:0/2914494480 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55654d32dd20 0x55654d34f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:40.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.817+0000 7f68ecff9700 0 client.6492 ms_handle_reset on v2:172.21.15.173:6835/591656642 2023-07-27T20:34:40.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.817+0000 7f6927769b80 1 --2- 172.21.15.72:0/2914494480 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55654d32e100 0x55654d351270 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:40.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.817+0000 7f6927769b80 1 -- 172.21.15.72:0/2914494480 >> 172.21.15.72:0/2914494480 conn(0x55654d2703a0 msgr2=0x55654d34bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:40.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.817+0000 7f6927769b80 1 -- 172.21.15.72:0/2914494480 shutdown_connections 2023-07-27T20:34:40.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.817+0000 7f6927769b80 1 -- 172.21.15.72:0/2914494480 wait complete. 2023-07-27T20:34:40.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.817+0000 7f6927769b80 20 client.6492 trim_cache size 0 max 16384 2023-07-27T20:34:40.815 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-07-27T20:34:40.815 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "173d349e-573f-4bc7-9f3a-2e1b4345c501", 2023-07-27T20:34:40.815 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 0, 2023-07-27T20:34:40.815 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 6336, 2023-07-27T20:34:40.815 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2023-07-27T20:34:40.815 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2023-07-27T20:34:40.816 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2023-07-27T20:34:40.816 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 6.5377242280000001, 2023-07-27T20:34:40.816 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 33, 2023-07-27T20:34:40.816 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 62, 2023-07-27T20:34:40.816 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 62, 2023-07-27T20:34:40.816 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 13.848133564999999 2023-07-27T20:34:40.816 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-07-27T20:34:40.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.818+0000 7f6913dff700 1 -- 172.21.15.72:0/303569792 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f68f006ace0 msgr2=0x7f68f006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:40.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.818+0000 7f6913dff700 1 --2- 172.21.15.72:0/303569792 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f68f006ace0 0x7f68f006d1a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f690c153ab0 tx=0x7f68fc009040 comp rx=0 tx=0).stop 2023-07-27T20:34:40.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.818+0000 7f6913dff700 1 -- 172.21.15.72:0/303569792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f690c06b150 msgr2=0x7f690c14a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:40.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.818+0000 7f6913dff700 1 --2- 172.21.15.72:0/303569792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f690c06b150 0x7f690c14a550 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f690800e810 tx=0x7f690800ebd0 comp rx=0 tx=0).stop 2023-07-27T20:34:40.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.818+0000 7f6913dff700 1 -- 172.21.15.72:0/303569792 shutdown_connections 2023-07-27T20:34:40.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.818+0000 7f6913dff700 1 --2- 172.21.15.72:0/303569792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f690c1549f0 0x7f690c1e9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:40.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.818+0000 7f6913dff700 1 --2- 172.21.15.72:0/303569792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f690c06b150 0x7f690c14a550 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:40.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.818+0000 7f6913dff700 1 --2- 172.21.15.72:0/303569792 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f68f006ace0 0x7f68f006d1a0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:40.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.818+0000 7f6913dff700 1 --2- 172.21.15.72:0/303569792 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f690c0c4400 0x7f690c149a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:40.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.818+0000 7f6913dff700 1 -- 172.21.15.72:0/303569792 >> 172.21.15.72:0/303569792 conn(0x7f690c0ab300 msgr2=0x7f690c150940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:40.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.818+0000 7f6913dff700 1 -- 172.21.15.72:0/303569792 shutdown_connections 2023-07-27T20:34:40.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:40.818+0000 7f6913dff700 1 -- 172.21.15.72:0/303569792 wait complete. 2023-07-27T20:34:40.823 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-27T20:34:41.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.030+0000 7f4f841ff700 1 Processor -- start 2023-07-27T20:34:41.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.031+0000 7f4f841ff700 1 -- start start 2023-07-27T20:34:41.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.032+0000 7f4f841ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4f7c0c4400 0x7f4f7c0c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:41.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.032+0000 7f4f841ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4f7c1549f0 0x7f4f7c1514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:41.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.032+0000 7f4f841ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f7c06b710 con 0x7f4f7c06b150 2023-07-27T20:34:41.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.032+0000 7f4f841ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f7c1545d0 con 0x7f4f7c1549f0 2023-07-27T20:34:41.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.032+0000 7f4f841ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f7c06c860 con 0x7f4f7c0c4400 2023-07-27T20:34:41.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.032+0000 7f4f8279c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4f7c1549f0 0x7f4f7c1514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:41.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.032+0000 7f4f8179a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4f7c06b150 0x7f4f7c0c4cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:44724/0 (socket says 172.21.15.72:44724) 2023-07-27T20:34:41.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.032+0000 7f4f8179a700 1 -- 172.21.15.72:0/1755480586 learned_addr learned my addr 172.21.15.72:0/1755480586 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:41.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.032+0000 7f4f81f9b700 1 --2- 172.21.15.72:0/1755480586 >> v2:172.21.15.173:3300/0 conn(0x7f4f7c0c4400 0x7f4f7c0c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:41.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.032+0000 7f4f8279c700 1 -- 172.21.15.72:0/1755480586 >> v2:172.21.15.173:3300/0 conn(0x7f4f7c0c4400 msgr2=0x7f4f7c0c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:41.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.033+0000 7f4f8279c700 1 --2- 172.21.15.72:0/1755480586 >> v2:172.21.15.173:3300/0 conn(0x7f4f7c0c4400 0x7f4f7c0c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:41.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.033+0000 7f4f8279c700 1 -- 172.21.15.72:0/1755480586 >> v1:172.21.15.72:6789/0 conn(0x7f4f7c06b150 legacy=0x7f4f7c0c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:41.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.033+0000 7f4f8279c700 1 -- 172.21.15.72:0/1755480586 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f7c06b9f0 con 0x7f4f7c1549f0 2023-07-27T20:34:41.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.033+0000 7f4f80f99700 1 -- 172.21.15.72:0/1755480586 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3967429908 0 0) 0x7f4f7c06b710 con 0x7f4f7c06b150 2023-07-27T20:34:41.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.033+0000 7f4f8279c700 1 --2- 172.21.15.72:0/1755480586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f7c1549f0 0x7f4f7c1514a0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c08b040 tx=0x7f4f7400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a769bada7f308b93 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:41.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.033+0000 7f4f80f99700 1 -- 172.21.15.72:0/1755480586 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7400e070 con 0x7f4f7c1549f0 2023-07-27T20:34:41.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.033+0000 7f4f80f99700 1 -- 172.21.15.72:0/1755480586 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f7400bb20 con 0x7f4f7c1549f0 2023-07-27T20:34:41.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.033+0000 7f4f80f99700 1 -- 172.21.15.72:0/1755480586 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f74012430 con 0x7f4f7c1549f0 2023-07-27T20:34:41.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.033+0000 7f4f841ff700 1 -- 172.21.15.72:0/1755480586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f7c1549f0 msgr2=0x7f4f7c1514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:41.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.033+0000 7f4f841ff700 1 --2- 172.21.15.72:0/1755480586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f7c1549f0 0x7f4f7c1514a0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c08b040 tx=0x7f4f7400b330 comp rx=0 tx=0).stop 2023-07-27T20:34:41.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.034+0000 7f4f841ff700 1 -- 172.21.15.72:0/1755480586 shutdown_connections 2023-07-27T20:34:41.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.034+0000 7f4f841ff700 1 --2- 172.21.15.72:0/1755480586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f7c1549f0 0x7f4f7c1514a0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:41.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.034+0000 7f4f841ff700 1 --2- 172.21.15.72:0/1755480586 >> v2:172.21.15.173:3300/0 conn(0x7f4f7c0c4400 0x7f4f7c0c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:41.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.034+0000 7f4f841ff700 1 -- 172.21.15.72:0/1755480586 >> 172.21.15.72:0/1755480586 conn(0x7f4f7c0ab300 msgr2=0x7f4f7c0ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:41.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.034+0000 7f4f841ff700 1 -- 172.21.15.72:0/1755480586 shutdown_connections 2023-07-27T20:34:41.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.034+0000 7f4f841ff700 1 -- 172.21.15.72:0/1755480586 wait complete. 2023-07-27T20:34:41.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.035+0000 7f4f841ff700 1 Processor -- start 2023-07-27T20:34:41.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.035+0000 7f4f841ff700 1 -- start start 2023-07-27T20:34:41.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.036+0000 7f4f841ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f7c06b150 0x7f4f7c1dc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:41.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.036+0000 7f4f841ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4f7c0c4400 0x7f4f7c1514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:41.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.036+0000 7f4f841ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f7c1549f0 0x7f4f7c1ec780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:41.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.036+0000 7f4f841ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c1dd3a0 con 0x7f4f7c1549f0 2023-07-27T20:34:41.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.036+0000 7f4f841ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c1dce40 con 0x7f4f7c06b150 2023-07-27T20:34:41.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.036+0000 7f4f841ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c1de2c0 con 0x7f4f7c0c4400 2023-07-27T20:34:41.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.037+0000 7f4f8279c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f7c1549f0 0x7f4f7c1ec780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:41.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.037+0000 7f4f8279c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f7c1549f0 0x7f4f7c1ec780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57998/0 (socket says 172.21.15.72:57998) 2023-07-27T20:34:41.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.037+0000 7f4f81f9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f7c06b150 0x7f4f7c1dc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:41.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.037+0000 7f4f8279c700 1 -- 172.21.15.72:0/602251262 learned_addr learned my addr 172.21.15.72:0/602251262 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:41.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.037+0000 7f4f8179a700 1 --2- 172.21.15.72:0/602251262 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4f7c0c4400 0x7f4f7c1514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:41.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.037+0000 7f4f8279c700 1 -- 172.21.15.72:0/602251262 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4f7c0c4400 msgr2=0x7f4f7c1514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:41.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.037+0000 7f4f8279c700 1 --2- 172.21.15.72:0/602251262 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4f7c0c4400 0x7f4f7c1514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:41.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.037+0000 7f4f8279c700 1 -- 172.21.15.72:0/602251262 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f7c06b150 msgr2=0x7f4f7c1dc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:41.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.037+0000 7f4f8279c700 1 --2- 172.21.15.72:0/602251262 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f7c06b150 0x7f4f7c1dc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:41.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.037+0000 7f4f8279c700 1 -- 172.21.15.72:0/602251262 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f74009a70 con 0x7f4f7c1549f0 2023-07-27T20:34:41.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.037+0000 7f4f8279c700 1 --2- 172.21.15.72:0/602251262 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f7c1549f0 0x7f4f7c1ec780 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f4f7400b680 tx=0x7f4f74004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:41.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.038+0000 7f4f727fc700 1 -- 172.21.15.72:0/602251262 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f74012430 con 0x7f4f7c1549f0 2023-07-27T20:34:41.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.038+0000 7f4f727fc700 1 -- 172.21.15.72:0/602251262 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f74020070 con 0x7f4f7c1549f0 2023-07-27T20:34:41.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.038+0000 7f4f727fc700 1 -- 172.21.15.72:0/602251262 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f74004280 con 0x7f4f7c1549f0 2023-07-27T20:34:41.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.038+0000 7f4f841ff700 1 -- 172.21.15.72:0/602251262 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f7c146480 con 0x7f4f7c1549f0 2023-07-27T20:34:41.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.038+0000 7f4f841ff700 1 -- 172.21.15.72:0/602251262 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f7c1ddf50 con 0x7f4f7c1549f0 2023-07-27T20:34:41.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.039+0000 7f4f841ff700 1 -- 172.21.15.72:0/602251262 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f7c1538e0 con 0x7f4f7c1549f0 2023-07-27T20:34:41.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.040+0000 7f4f727fc700 1 -- 172.21.15.72:0/602251262 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4f740043e0 con 0x7f4f7c1549f0 2023-07-27T20:34:41.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.040+0000 7f4f727fc700 1 --2- 172.21.15.72:0/602251262 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4f6006ace0 0x7f4f6006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:41.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.041+0000 7f4f727fc700 1 -- 172.21.15.72:0/602251262 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4f74022070 con 0x7f4f7c1549f0 2023-07-27T20:34:41.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.041+0000 7f4f81f9b700 1 --2- 172.21.15.72:0/602251262 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4f6006ace0 0x7f4f6006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:41.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.042+0000 7f4f81f9b700 1 --2- 172.21.15.72:0/602251262 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4f6006ace0 0x7f4f6006d1a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c1de980 tx=0x7f4f78009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:41.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.045+0000 7f4f727fc700 1 -- 172.21.15.72:0/602251262 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4f740560a0 con 0x7f4f7c1549f0 2023-07-27T20:34:41.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.283+0000 7f4f841ff700 1 -- 172.21.15.72:0/602251262 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4f7c1de0e0 con 0x7f4f7c1549f0 2023-07-27T20:34:41.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.284+0000 7f4f727fc700 1 -- 172.21.15.72:0/602251262 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v33) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4f740596c0 con 0x7f4f7c1549f0 2023-07-27T20:34:41.273 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-27T20:34:41.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.286+0000 7f4f841ff700 1 -- 172.21.15.72:0/602251262 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4f6006ace0 msgr2=0x7f4f6006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:41.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.286+0000 7f4f841ff700 1 --2- 172.21.15.72:0/602251262 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4f6006ace0 0x7f4f6006d1a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c1de980 tx=0x7f4f78009210 comp rx=0 tx=0).stop 2023-07-27T20:34:41.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.286+0000 7f4f841ff700 1 -- 172.21.15.72:0/602251262 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f7c1549f0 msgr2=0x7f4f7c1ec780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:41.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.286+0000 7f4f841ff700 1 --2- 172.21.15.72:0/602251262 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f7c1549f0 0x7f4f7c1ec780 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f4f7400b680 tx=0x7f4f74004ad0 comp rx=0 tx=0).stop 2023-07-27T20:34:41.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.286+0000 7f4f841ff700 1 -- 172.21.15.72:0/602251262 shutdown_connections 2023-07-27T20:34:41.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.286+0000 7f4f841ff700 1 --2- 172.21.15.72:0/602251262 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f7c1549f0 0x7f4f7c1ec780 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:41.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.286+0000 7f4f841ff700 1 --2- 172.21.15.72:0/602251262 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f7c06b150 0x7f4f7c1dc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:41.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.286+0000 7f4f841ff700 1 --2- 172.21.15.72:0/602251262 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4f6006ace0 0x7f4f6006d1a0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:41.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.286+0000 7f4f841ff700 1 --2- 172.21.15.72:0/602251262 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4f7c0c4400 0x7f4f7c1514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:41.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.286+0000 7f4f841ff700 1 -- 172.21.15.72:0/602251262 >> 172.21.15.72:0/602251262 conn(0x7f4f7c0ab300 msgr2=0x7f4f7c152de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:41.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.287+0000 7f4f841ff700 1 -- 172.21.15.72:0/602251262 shutdown_connections 2023-07-27T20:34:41.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:41.287+0000 7f4f841ff700 1 -- 172.21.15.72:0/602251262 wait complete. 2023-07-27T20:34:41.293 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-27T20:34:41.294 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T20:34:41.294 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2023-07-27T20:34:41.295 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-27T20:34:41.295 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-27T20:34:41.295 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-27T20:34:41.295 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-27T20:34:41.296 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-27T20:34:41.296 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-27T20:34:41.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:34:41.298 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2023-07-27T20:34:41.345 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T20:34:41.345 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T20:34:41.345 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T20:34:41.345 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:34:41.346 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-07-27T20:34:41.346 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:34:41.346 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T20:34:41.346 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2023-07-27T20:34:41.346 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f0 2023-07-27T20:34:41.346 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T20:34:41.346 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2023-07-27T20:34:41.347 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f1 2023-07-27T20:34:41.347 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T20:34:41.347 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2023-07-27T20:34:41.347 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T20:34:41.347 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2023-07-27T20:34:41.347 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T20:34:41.347 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 39803sec preferred_lft 39803sec 2023-07-27T20:34:41.347 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2023-07-27T20:34:41.348 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:34:41.348 INFO:teuthology.orchestra.run.smithi072.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-27T20:34:41.348 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0a:3b:6c:6f:2b:36 brd ff:ff:ff:ff:ff:ff 2023-07-27T20:34:41.348 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-27T20:34:41.348 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:34:41.349 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::f80c:f1ff:fe0e:35f4/64 scope link 2023-07-27T20:34:41.349 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:34:41.349 INFO:teuthology.orchestra.run.smithi072.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T20:34:41.349 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0a:3b:6c:6f:2b:36 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-27T20:34:41.349 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::83b:6cff:fe6f:2b36/64 scope link 2023-07-27T20:34:41.349 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:34:41.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:34:41.351 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T20:34:41.458 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-07-27T20:34:41.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:34:41.462 DEBUG:teuthology.orchestra.run.smithi072:> route 2023-07-27T20:34:41.513 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2023-07-27T20:34:41.513 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T20:34:41.513 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T20:34:41.514 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T20:34:41.514 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T20:34:41.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:34:41.515 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-07-27T20:34:41.516 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-07-27T20:34:41.517 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T20:34:41.517 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T20:34:41.517 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T20:34:41.518 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-07-27T20:34:41.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:34:41.686 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-07-27T20:34:41.733 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-27T20:34:41.733 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-27T20:34:41.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:34:41.734 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2023-07-27T20:34:41.843 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-07-27T20:34:41.844 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-27T20:34:41.844 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-27T20:34:41.890 INFO:teuthology.orchestra.run.smithi072.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-27T20:34:41.890 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-27T20:34:41.891 DEBUG:teuthology.orchestra.run.smithi072:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-27T20:34:41.975 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-07-27T20:34:42.086 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-27T20:34:42.087 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-27T20:34:42.155 INFO:teuthology.orchestra.run.smithi072.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-27T20:34:42.157 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-27T20:34:42.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:34:42.158 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-07-27T20:34:42.205 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-27T20:34:42.205 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-07-27T20:34:42.210 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-07-27T20:34:42.283 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-27T20:34:42.283 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-27T20:34:42.354 INFO:teuthology.orchestra.run.smithi072.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-27T20:34:42.356 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-27T20:34:42.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:34:42.358 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-07-27T20:34:42.379 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:2023-07-27T20:34:42.391+0000 7f97720745c0 -1 init, newargv = 0x556e76f6e800 newargc=15 2023-07-27T20:34:42.380 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:ceph-fuse[167175]: starting ceph client 2023-07-27T20:34:42.388 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:ceph-fuse[167175]: starting fuse 2023-07-27T20:34:42.407 INFO:teuthology.orchestra.run.smithi072.stdout:44 2023-07-27T20:34:42.408 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2023-07-27T20:34:42.408 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-27T20:34:42.408 DEBUG:teuthology.orchestra.run.smithi072:> import glob 2023-07-27T20:34:42.409 DEBUG:teuthology.orchestra.run.smithi072:> import re 2023-07-27T20:34:42.409 DEBUG:teuthology.orchestra.run.smithi072:> import os 2023-07-27T20:34:42.409 DEBUG:teuthology.orchestra.run.smithi072:> import subprocess 2023-07-27T20:34:42.410 DEBUG:teuthology.orchestra.run.smithi072:> 2023-07-27T20:34:42.410 DEBUG:teuthology.orchestra.run.smithi072:> def _find_admin_socket(client_name): 2023-07-27T20:34:42.410 DEBUG:teuthology.orchestra.run.smithi072:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-07-27T20:34:42.411 DEBUG:teuthology.orchestra.run.smithi072:> files = glob.glob(asok_path) 2023-07-27T20:34:42.411 DEBUG:teuthology.orchestra.run.smithi072:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-07-27T20:34:42.411 DEBUG:teuthology.orchestra.run.smithi072:> 2023-07-27T20:34:42.412 DEBUG:teuthology.orchestra.run.smithi072:> # Given a non-glob path, it better be there 2023-07-27T20:34:42.412 DEBUG:teuthology.orchestra.run.smithi072:> if "*" not in asok_path: 2023-07-27T20:34:42.412 DEBUG:teuthology.orchestra.run.smithi072:> assert(len(files) == 1) 2023-07-27T20:34:42.413 DEBUG:teuthology.orchestra.run.smithi072:> return files[0] 2023-07-27T20:34:42.413 DEBUG:teuthology.orchestra.run.smithi072:> 2023-07-27T20:34:42.413 DEBUG:teuthology.orchestra.run.smithi072:> for f in files: 2023-07-27T20:34:42.414 DEBUG:teuthology.orchestra.run.smithi072:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-27T20:34:42.414 DEBUG:teuthology.orchestra.run.smithi072:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-27T20:34:42.414 DEBUG:teuthology.orchestra.run.smithi072:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-27T20:34:42.415 DEBUG:teuthology.orchestra.run.smithi072:> contents = proc_f.read() 2023-07-27T20:34:42.415 DEBUG:teuthology.orchestra.run.smithi072:> if mountpoint in contents: 2023-07-27T20:34:42.415 DEBUG:teuthology.orchestra.run.smithi072:> return f 2023-07-27T20:34:42.416 DEBUG:teuthology.orchestra.run.smithi072:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-27T20:34:42.416 DEBUG:teuthology.orchestra.run.smithi072:> 2023-07-27T20:34:42.416 DEBUG:teuthology.orchestra.run.smithi072:> print(_find_admin_socket("client.0")) 2023-07-27T20:34:42.417 DEBUG:teuthology.orchestra.run.smithi072:> ' 2023-07-27T20:34:42.592 INFO:teuthology.orchestra.run.smithi072.stdout:/var/run/ceph/ceph-client.0.167175.asok 2023-07-27T20:34:42.769 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.167175.asok 2023-07-27T20:34:42.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:34:42.770 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.167175.asok status 2023-07-27T20:34:42.995 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-07-27T20:34:42.996 INFO:teuthology.orchestra.run.smithi072.stdout: "metadata": { 2023-07-27T20:34:42.996 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_sha1": "a5d48e8c688c2543997a98b8acbae2ce9635578c", 2023-07-27T20:34:42.996 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_version": "ceph version 18.0.0-5128-ga5d48e8c (a5d48e8c688c2543997a98b8acbae2ce9635578c) reef (dev)", 2023-07-27T20:34:42.996 INFO:teuthology.orchestra.run.smithi072.stdout: "entity_id": "0", 2023-07-27T20:34:42.997 INFO:teuthology.orchestra.run.smithi072.stdout: "hostname": "smithi072", 2023-07-27T20:34:42.997 INFO:teuthology.orchestra.run.smithi072.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-07-27T20:34:42.997 INFO:teuthology.orchestra.run.smithi072.stdout: "pid": "167175", 2023-07-27T20:34:42.998 INFO:teuthology.orchestra.run.smithi072.stdout: "root": "/" 2023-07-27T20:34:42.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:34:42.998 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_count": 0, 2023-07-27T20:34:42.998 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_pinned_count": 0, 2023-07-27T20:34:42.999 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 6507, 2023-07-27T20:34:42.999 INFO:teuthology.orchestra.run.smithi072.stdout: "inst": { 2023-07-27T20:34:42.999 INFO:teuthology.orchestra.run.smithi072.stdout: "name": { 2023-07-27T20:34:42.999 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "client", 2023-07-27T20:34:43.000 INFO:teuthology.orchestra.run.smithi072.stdout: "num": 6507 2023-07-27T20:34:43.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:34:43.000 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2023-07-27T20:34:43.001 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-07-27T20:34:43.001 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "192.168.0.1:0", 2023-07-27T20:34:43.001 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 2966356149 2023-07-27T20:34:43.001 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:34:43.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:34:43.002 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2023-07-27T20:34:43.002 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-07-27T20:34:43.002 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "192.168.0.1:0", 2023-07-27T20:34:43.003 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 2966356149 2023-07-27T20:34:43.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:34:43.003 INFO:teuthology.orchestra.run.smithi072.stdout: "inst_str": "client.6507 192.168.0.1:0/2966356149", 2023-07-27T20:34:43.004 INFO:teuthology.orchestra.run.smithi072.stdout: "addr_str": "192.168.0.1:0/2966356149", 2023-07-27T20:34:43.004 INFO:teuthology.orchestra.run.smithi072.stdout: "inode_count": 1, 2023-07-27T20:34:43.004 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_epoch": 33, 2023-07-27T20:34:43.004 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch": 62, 2023-07-27T20:34:43.005 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch_barrier": 0, 2023-07-27T20:34:43.005 INFO:teuthology.orchestra.run.smithi072.stdout: "blocklisted": false, 2023-07-27T20:34:43.005 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs" 2023-07-27T20:34:43.005 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-07-27T20:34:43.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:34:43.009 DEBUG:teuthology.orchestra.run.smithi072:> stat --file-system '--printf=%T 2023-07-27T20:34:43.010 DEBUG:teuthology.orchestra.run.smithi072:> ' -- /home/ubuntu/cephtest/mnt.0 2023-07-27T20:34:43.057 INFO:teuthology.orchestra.run.smithi072.stdout:fuseblk 2023-07-27T20:34:43.057 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-07-27T20:34:43.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:34:43.058 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-27T20:34:43.129 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-27T20:34:43.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.337+0000 7f93757ff700 1 Processor -- start 2023-07-27T20:34:43.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.337+0000 7f93757ff700 1 -- start start 2023-07-27T20:34:43.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.338+0000 7f93757ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f93700c5c00 0x7f93700c1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:43.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.338+0000 7f93757ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9370154960 0x7f9370154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:43.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.338+0000 7f93757ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93700706f0 con 0x7f9370151800 2023-07-27T20:34:43.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.338+0000 7f93757ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9370154510 con 0x7f9370154960 2023-07-27T20:34:43.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.338+0000 7f93757ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9370070c90 con 0x7f93700c5c00 2023-07-27T20:34:43.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.338+0000 7f936f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9370154960 0x7f9370154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:43.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.338+0000 7f936f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9370154960 0x7f9370154dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58002/0 (socket says 172.21.15.72:58002) 2023-07-27T20:34:43.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.339+0000 7f936f7fe700 1 -- 172.21.15.72:0/1158763535 learned_addr learned my addr 172.21.15.72:0/1158763535 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:43.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.339+0000 7f936e7fc700 1 --2- 172.21.15.72:0/1158763535 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f93700c5c00 0x7f93700c1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:43.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.339+0000 7f936f7fe700 1 -- 172.21.15.72:0/1158763535 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f93700c5c00 msgr2=0x7f93700c1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:43.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.339+0000 7f936f7fe700 1 --2- 172.21.15.72:0/1158763535 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f93700c5c00 0x7f93700c1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:43.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.339+0000 7f936f7fe700 1 -- 172.21.15.72:0/1158763535 >> v1:172.21.15.173:6789/0 conn(0x7f9370151800 legacy=0x7f93700a9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:43.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.339+0000 7f936f7fe700 1 -- 172.21.15.72:0/1158763535 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93701585d0 con 0x7f9370154960 2023-07-27T20:34:43.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.339+0000 7f936f7fe700 1 --2- 172.21.15.72:0/1158763535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9370154960 0x7f9370154dd0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f9368009e50 tx=0x7f936800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee0343747879e374 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:43.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.339+0000 7f936dffb700 1 -- 172.21.15.72:0/1158763535 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936800e070 con 0x7f9370154960 2023-07-27T20:34:43.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.339+0000 7f936dffb700 1 -- 172.21.15.72:0/1158763535 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f936800b9c0 con 0x7f9370154960 2023-07-27T20:34:43.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.339+0000 7f936dffb700 1 -- 172.21.15.72:0/1158763535 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936800bd70 con 0x7f9370154960 2023-07-27T20:34:43.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.340+0000 7f93757ff700 1 -- 172.21.15.72:0/1158763535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9370154960 msgr2=0x7f9370154dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:43.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.340+0000 7f93757ff700 1 --2- 172.21.15.72:0/1158763535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9370154960 0x7f9370154dd0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f9368009e50 tx=0x7f936800b330 comp rx=0 tx=0).stop 2023-07-27T20:34:43.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.340+0000 7f93757ff700 1 -- 172.21.15.72:0/1158763535 shutdown_connections 2023-07-27T20:34:43.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.340+0000 7f93757ff700 1 --2- 172.21.15.72:0/1158763535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9370154960 0x7f9370154dd0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:43.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.340+0000 7f93757ff700 1 --2- 172.21.15.72:0/1158763535 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f93700c5c00 0x7f93700c1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:43.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.340+0000 7f93757ff700 1 -- 172.21.15.72:0/1158763535 >> 172.21.15.72:0/1158763535 conn(0x7f937006a7c0 msgr2=0x7f93700c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:43.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.340+0000 7f93757ff700 1 -- 172.21.15.72:0/1158763535 shutdown_connections 2023-07-27T20:34:43.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.340+0000 7f93757ff700 1 -- 172.21.15.72:0/1158763535 wait complete. 2023-07-27T20:34:43.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.342+0000 7f93757ff700 1 Processor -- start 2023-07-27T20:34:43.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.342+0000 7f93757ff700 1 -- start start 2023-07-27T20:34:43.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.343+0000 7f93757ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f93700c5c00 0x7f93701ed420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:43.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.343+0000 7f93757ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9370151800 0x7f9370152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:43.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.343+0000 7f93757ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9370154960 0x7f9370153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:43.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.343+0000 7f93757ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93700bb6b0 con 0x7f9370151800 2023-07-27T20:34:43.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.343+0000 7f93757ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93700bc790 con 0x7f9370154960 2023-07-27T20:34:43.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.343+0000 7f93757ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93700beef0 con 0x7f93700c5c00 2023-07-27T20:34:43.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.343+0000 7f936e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9370151800 0x7f9370152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:43.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.343+0000 7f936e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9370151800 0x7f9370152dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58014/0 (socket says 172.21.15.72:58014) 2023-07-27T20:34:43.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.343+0000 7f936e7fc700 1 -- 172.21.15.72:0/3506961395 learned_addr learned my addr 172.21.15.72:0/3506961395 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:43.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.343+0000 7f936e7fc700 1 -- 172.21.15.72:0/3506961395 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f93700c5c00 msgr2=0x7f93701ed420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:43.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.343+0000 7f936f7fe700 1 --2- 172.21.15.72:0/3506961395 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9370154960 0x7f9370153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:43.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.343+0000 7f936effd700 1 --2- 172.21.15.72:0/3506961395 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f93700c5c00 0x7f93701ed420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:43.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.343+0000 7f936e7fc700 1 --2- 172.21.15.72:0/3506961395 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f93700c5c00 0x7f93701ed420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:43.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.343+0000 7f936e7fc700 1 -- 172.21.15.72:0/3506961395 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9370154960 msgr2=0x7f9370153310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:43.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.343+0000 7f936e7fc700 1 --2- 172.21.15.72:0/3506961395 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9370154960 0x7f9370153310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:43.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.343+0000 7f936e7fc700 1 -- 172.21.15.72:0/3506961395 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9368009b30 con 0x7f9370151800 2023-07-27T20:34:43.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.343+0000 7f936f7fe700 1 --2- 172.21.15.72:0/3506961395 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9370154960 0x7f9370153310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:43.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.343+0000 7f936effd700 1 --2- 172.21.15.72:0/3506961395 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f93700c5c00 0x7f93701ed420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:43.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.344+0000 7f936e7fc700 1 --2- 172.21.15.72:0/3506961395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9370151800 0x7f9370152dd0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f936400d800 tx=0x7f936400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:43.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.344+0000 7f93577fe700 1 -- 172.21.15.72:0/3506961395 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93640125f0 con 0x7f9370151800 2023-07-27T20:34:43.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.344+0000 7f93577fe700 1 -- 172.21.15.72:0/3506961395 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9364012750 con 0x7f9370151800 2023-07-27T20:34:43.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.344+0000 7f93577fe700 1 -- 172.21.15.72:0/3506961395 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9364012ae0 con 0x7f9370151800 2023-07-27T20:34:43.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.344+0000 7f93757ff700 1 -- 172.21.15.72:0/3506961395 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93701edf30 con 0x7f9370151800 2023-07-27T20:34:43.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.344+0000 7f93757ff700 1 -- 172.21.15.72:0/3506961395 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93700beb80 con 0x7f9370151800 2023-07-27T20:34:43.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.345+0000 7f93757ff700 1 -- 172.21.15.72:0/3506961395 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9370074310 con 0x7f9370151800 2023-07-27T20:34:43.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.346+0000 7f93577fe700 1 -- 172.21.15.72:0/3506961395 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9364012c40 con 0x7f9370151800 2023-07-27T20:34:43.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.347+0000 7f93577fe700 1 --2- 172.21.15.72:0/3506961395 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f935c06ace0 0x7f935c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:43.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.347+0000 7f93577fe700 1 -- 172.21.15.72:0/3506961395 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f93640899a0 con 0x7f9370151800 2023-07-27T20:34:43.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.347+0000 7f936effd700 1 --2- 172.21.15.72:0/3506961395 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f935c06ace0 0x7f935c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:43.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.348+0000 7f936effd700 1 --2- 172.21.15.72:0/3506961395 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f935c06ace0 0x7f935c06d1a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f93700ad770 tx=0x7f9360009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:43.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.351+0000 7f93577fe700 1 -- 172.21.15.72:0/3506961395 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9364054900 con 0x7f9370151800 2023-07-27T20:34:43.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.588+0000 7f93757ff700 1 -- 172.21.15.72:0/3506961395 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f93700704d0 con 0x7f9370151800 2023-07-27T20:34:43.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.589+0000 7f93577fe700 1 -- 172.21.15.72:0/3506961395 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v33) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9364057f20 con 0x7f9370151800 2023-07-27T20:34:43.578 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-27T20:34:43.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.591+0000 7f93757ff700 1 -- 172.21.15.72:0/3506961395 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f935c06ace0 msgr2=0x7f935c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:43.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.591+0000 7f93757ff700 1 --2- 172.21.15.72:0/3506961395 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f935c06ace0 0x7f935c06d1a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f93700ad770 tx=0x7f9360009040 comp rx=0 tx=0).stop 2023-07-27T20:34:43.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.591+0000 7f93757ff700 1 -- 172.21.15.72:0/3506961395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9370151800 msgr2=0x7f9370152dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:43.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.591+0000 7f93757ff700 1 --2- 172.21.15.72:0/3506961395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9370151800 0x7f9370152dd0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f936400d800 tx=0x7f936400dbc0 comp rx=0 tx=0).stop 2023-07-27T20:34:43.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.591+0000 7f93757ff700 1 -- 172.21.15.72:0/3506961395 shutdown_connections 2023-07-27T20:34:43.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.591+0000 7f93757ff700 1 --2- 172.21.15.72:0/3506961395 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9370154960 0x7f9370153310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:43.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.591+0000 7f93757ff700 1 --2- 172.21.15.72:0/3506961395 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f935c06ace0 0x7f935c06d1a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:43.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.591+0000 7f93757ff700 1 --2- 172.21.15.72:0/3506961395 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f93700c5c00 0x7f93701ed420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:43.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.591+0000 7f93757ff700 1 --2- 172.21.15.72:0/3506961395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9370151800 0x7f9370152dd0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:43.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.591+0000 7f93757ff700 1 -- 172.21.15.72:0/3506961395 >> 172.21.15.72:0/3506961395 conn(0x7f937006a7c0 msgr2=0x7f937006c160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:43.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.591+0000 7f93757ff700 1 -- 172.21.15.72:0/3506961395 shutdown_connections 2023-07-27T20:34:43.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:43.592+0000 7f93757ff700 1 -- 172.21.15.72:0/3506961395 wait complete. 2023-07-27T20:34:43.598 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-27T20:34:43.598 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T20:34:43.598 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi173.front.sepia.ceph.com 2023-07-27T20:34:43.599 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-27T20:34:43.599 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-27T20:34:43.599 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-27T20:34:43.599 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-27T20:34:43.600 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-27T20:34:43.600 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-27T20:34:43.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:34:43.601 DEBUG:teuthology.orchestra.run.smithi173:> ip addr 2023-07-27T20:34:43.653 INFO:teuthology.orchestra.run.smithi173.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T20:34:43.654 INFO:teuthology.orchestra.run.smithi173.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T20:34:43.654 INFO:teuthology.orchestra.run.smithi173.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T20:34:43.654 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:34:43.655 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 ::1/128 scope host 2023-07-27T20:34:43.655 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:34:43.655 INFO:teuthology.orchestra.run.smithi173.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T20:34:43.655 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6a brd ff:ff:ff:ff:ff:ff 2023-07-27T20:34:43.656 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f0 2023-07-27T20:34:43.656 INFO:teuthology.orchestra.run.smithi173.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T20:34:43.656 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6b brd ff:ff:ff:ff:ff:ff 2023-07-27T20:34:43.656 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f1 2023-07-27T20:34:43.657 INFO:teuthology.orchestra.run.smithi173.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T20:34:43.657 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:58 brd ff:ff:ff:ff:ff:ff 2023-07-27T20:34:43.657 INFO:teuthology.orchestra.run.smithi173.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T20:34:43.658 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:59 brd ff:ff:ff:ff:ff:ff 2023-07-27T20:34:43.658 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.21.15.173/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T20:34:43.658 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft 39832sec preferred_lft 39832sec 2023-07-27T20:34:43.659 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::ec4:7aff:fe88:7259/64 scope link 2023-07-27T20:34:43.659 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:34:43.659 INFO:teuthology.orchestra.run.smithi173.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-27T20:34:43.659 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether f2:7f:58:8c:3b:de brd ff:ff:ff:ff:ff:ff 2023-07-27T20:34:43.659 INFO:teuthology.orchestra.run.smithi173.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-27T20:34:43.659 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:34:43.659 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::84ab:86ff:fec2:f207/64 scope link 2023-07-27T20:34:43.660 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:34:43.660 INFO:teuthology.orchestra.run.smithi173.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T20:34:43.660 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether f2:7f:58:8c:3b:de brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-27T20:34:43.660 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::f07f:58ff:fe8c:3bde/64 scope link 2023-07-27T20:34:43.660 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:34:43.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:34:43.661 DEBUG:teuthology.orchestra.run.smithi173:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T20:34:43.732 INFO:teuthology.orchestra.run.smithi173.stdout:1 2023-07-27T20:34:43.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:34:43.737 DEBUG:teuthology.orchestra.run.smithi173:> route 2023-07-27T20:34:43.786 INFO:teuthology.orchestra.run.smithi173.stdout:Kernel IP routing table 2023-07-27T20:34:43.786 INFO:teuthology.orchestra.run.smithi173.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T20:34:43.786 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T20:34:43.786 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T20:34:43.786 INFO:teuthology.orchestra.run.smithi173.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T20:34:43.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:34:43.788 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2023-07-27T20:34:43.788 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2023-07-27T20:34:43.788 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T20:34:43.789 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T20:34:43.789 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T20:34:43.789 DEBUG:teuthology.orchestra.run.smithi173:> ') 2023-07-27T20:34:43.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:34:43.958 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list 2023-07-27T20:34:44.004 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-27T20:34:44.005 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-27T20:34:44.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:34:44.006 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set brx.0 up 2023-07-27T20:34:44.077 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-07-27T20:34:44.078 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-27T20:34:44.078 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-27T20:34:44.125 INFO:teuthology.orchestra.run.smithi173.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-27T20:34:44.125 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-27T20:34:44.125 DEBUG:teuthology.orchestra.run.smithi173:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-27T20:34:44.170 DEBUG:teuthology.orchestra.run.smithi173:> sudo modprobe fuse 2023-07-27T20:34:44.280 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-27T20:34:44.281 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-27T20:34:44.348 INFO:teuthology.orchestra.run.smithi173.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-27T20:34:44.351 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-27T20:34:44.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:34:44.352 DEBUG:teuthology.orchestra.run.smithi173:> ls /sys/fs/fuse/connections 2023-07-27T20:34:44.397 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-27T20:34:44.398 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-07-27T20:34:44.402 DEBUG:teuthology.orchestra.run.smithi173:> sudo modprobe fuse 2023-07-27T20:34:44.474 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-27T20:34:44.475 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-27T20:34:44.544 INFO:teuthology.orchestra.run.smithi173.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-27T20:34:44.546 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-27T20:34:44.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:34:44.547 DEBUG:teuthology.orchestra.run.smithi173:> ls /sys/fs/fuse/connections 2023-07-27T20:34:44.572 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi173.stderr:2023-07-27T20:34:44.585+0000 7f5f7e6de5c0 -1 init, newargv = 0x55804d5aa610 newargc=15 2023-07-27T20:34:44.573 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi173.stderr:ceph-fuse[150348]: starting ceph client 2023-07-27T20:34:44.581 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi173.stderr:ceph-fuse[150348]: starting fuse 2023-07-27T20:34:44.596 INFO:teuthology.orchestra.run.smithi173.stdout:43 2023-07-27T20:34:44.597 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-07-27T20:34:44.597 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-27T20:34:44.597 DEBUG:teuthology.orchestra.run.smithi173:> import glob 2023-07-27T20:34:44.598 DEBUG:teuthology.orchestra.run.smithi173:> import re 2023-07-27T20:34:44.598 DEBUG:teuthology.orchestra.run.smithi173:> import os 2023-07-27T20:34:44.598 DEBUG:teuthology.orchestra.run.smithi173:> import subprocess 2023-07-27T20:34:44.599 DEBUG:teuthology.orchestra.run.smithi173:> 2023-07-27T20:34:44.599 DEBUG:teuthology.orchestra.run.smithi173:> def _find_admin_socket(client_name): 2023-07-27T20:34:44.599 DEBUG:teuthology.orchestra.run.smithi173:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-07-27T20:34:44.600 DEBUG:teuthology.orchestra.run.smithi173:> files = glob.glob(asok_path) 2023-07-27T20:34:44.600 DEBUG:teuthology.orchestra.run.smithi173:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-07-27T20:34:44.600 DEBUG:teuthology.orchestra.run.smithi173:> 2023-07-27T20:34:44.601 DEBUG:teuthology.orchestra.run.smithi173:> # Given a non-glob path, it better be there 2023-07-27T20:34:44.601 DEBUG:teuthology.orchestra.run.smithi173:> if "*" not in asok_path: 2023-07-27T20:34:44.601 DEBUG:teuthology.orchestra.run.smithi173:> assert(len(files) == 1) 2023-07-27T20:34:44.602 DEBUG:teuthology.orchestra.run.smithi173:> return files[0] 2023-07-27T20:34:44.602 DEBUG:teuthology.orchestra.run.smithi173:> 2023-07-27T20:34:44.602 DEBUG:teuthology.orchestra.run.smithi173:> for f in files: 2023-07-27T20:34:44.603 DEBUG:teuthology.orchestra.run.smithi173:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-27T20:34:44.603 DEBUG:teuthology.orchestra.run.smithi173:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-27T20:34:44.603 DEBUG:teuthology.orchestra.run.smithi173:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-27T20:34:44.604 DEBUG:teuthology.orchestra.run.smithi173:> contents = proc_f.read() 2023-07-27T20:34:44.604 DEBUG:teuthology.orchestra.run.smithi173:> if mountpoint in contents: 2023-07-27T20:34:44.604 DEBUG:teuthology.orchestra.run.smithi173:> return f 2023-07-27T20:34:44.604 DEBUG:teuthology.orchestra.run.smithi173:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-27T20:34:44.605 DEBUG:teuthology.orchestra.run.smithi173:> 2023-07-27T20:34:44.605 DEBUG:teuthology.orchestra.run.smithi173:> print(_find_admin_socket("client.1")) 2023-07-27T20:34:44.605 DEBUG:teuthology.orchestra.run.smithi173:> ' 2023-07-27T20:34:44.779 INFO:teuthology.orchestra.run.smithi173.stdout:/var/run/ceph/ceph-client.1.150348.asok 2023-07-27T20:34:44.957 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.150348.asok 2023-07-27T20:34:44.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:34:44.958 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.150348.asok status 2023-07-27T20:34:45.183 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2023-07-27T20:34:45.183 INFO:teuthology.orchestra.run.smithi173.stdout: "metadata": { 2023-07-27T20:34:45.183 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_sha1": "a5d48e8c688c2543997a98b8acbae2ce9635578c", 2023-07-27T20:34:45.184 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_version": "ceph version 18.0.0-5128-ga5d48e8c (a5d48e8c688c2543997a98b8acbae2ce9635578c) reef (dev)", 2023-07-27T20:34:45.184 INFO:teuthology.orchestra.run.smithi173.stdout: "entity_id": "1", 2023-07-27T20:34:45.184 INFO:teuthology.orchestra.run.smithi173.stdout: "hostname": "smithi173", 2023-07-27T20:34:45.184 INFO:teuthology.orchestra.run.smithi173.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-07-27T20:34:45.184 INFO:teuthology.orchestra.run.smithi173.stdout: "pid": "150348", 2023-07-27T20:34:45.184 INFO:teuthology.orchestra.run.smithi173.stdout: "root": "/" 2023-07-27T20:34:45.184 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-07-27T20:34:45.185 INFO:teuthology.orchestra.run.smithi173.stdout: "dentry_count": 0, 2023-07-27T20:34:45.185 INFO:teuthology.orchestra.run.smithi173.stdout: "dentry_pinned_count": 0, 2023-07-27T20:34:45.185 INFO:teuthology.orchestra.run.smithi173.stdout: "id": 6217, 2023-07-27T20:34:45.185 INFO:teuthology.orchestra.run.smithi173.stdout: "inst": { 2023-07-27T20:34:45.185 INFO:teuthology.orchestra.run.smithi173.stdout: "name": { 2023-07-27T20:34:45.185 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "client", 2023-07-27T20:34:45.185 INFO:teuthology.orchestra.run.smithi173.stdout: "num": 6217 2023-07-27T20:34:45.186 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-07-27T20:34:45.186 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": { 2023-07-27T20:34:45.186 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "v1", 2023-07-27T20:34:45.186 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": "192.168.0.1:0", 2023-07-27T20:34:45.186 INFO:teuthology.orchestra.run.smithi173.stdout: "nonce": 1136372504 2023-07-27T20:34:45.186 INFO:teuthology.orchestra.run.smithi173.stdout: } 2023-07-27T20:34:45.186 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-07-27T20:34:45.186 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": { 2023-07-27T20:34:45.187 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "v1", 2023-07-27T20:34:45.187 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": "192.168.0.1:0", 2023-07-27T20:34:45.187 INFO:teuthology.orchestra.run.smithi173.stdout: "nonce": 1136372504 2023-07-27T20:34:45.187 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-07-27T20:34:45.187 INFO:teuthology.orchestra.run.smithi173.stdout: "inst_str": "client.6217 192.168.0.1:0/1136372504", 2023-07-27T20:34:45.187 INFO:teuthology.orchestra.run.smithi173.stdout: "addr_str": "192.168.0.1:0/1136372504", 2023-07-27T20:34:45.187 INFO:teuthology.orchestra.run.smithi173.stdout: "inode_count": 1, 2023-07-27T20:34:45.188 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_epoch": 33, 2023-07-27T20:34:45.188 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_epoch": 62, 2023-07-27T20:34:45.188 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_epoch_barrier": 0, 2023-07-27T20:34:45.188 INFO:teuthology.orchestra.run.smithi173.stdout: "blocklisted": false, 2023-07-27T20:34:45.188 INFO:teuthology.orchestra.run.smithi173.stdout: "fs_name": "cephfs" 2023-07-27T20:34:45.189 INFO:teuthology.orchestra.run.smithi173.stdout:} 2023-07-27T20:34:45.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:34:45.198 DEBUG:teuthology.orchestra.run.smithi173:> stat --file-system '--printf=%T 2023-07-27T20:34:45.198 DEBUG:teuthology.orchestra.run.smithi173:> ' -- /home/ubuntu/cephtest/mnt.1 2023-07-27T20:34:45.245 INFO:teuthology.orchestra.run.smithi173.stdout:fuseblk 2023-07-27T20:34:45.246 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-07-27T20:34:45.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:34:45.248 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-27T20:34:45.356 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-07-27T20:34:45.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.574+0000 7f033f5ff700 1 Processor -- start 2023-07-27T20:34:45.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.574+0000 7f033f5ff700 1 -- start start 2023-07-27T20:34:45.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.575+0000 7f033f5ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0338139960 0x7f03380c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:45.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.575+0000 7f033f5ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0338139f80 0x7f03380c1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:45.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.575+0000 7f033f5ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03380c1810 con 0x7f03380c2340 2023-07-27T20:34:45.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.575+0000 7f033f5ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03380c0ee0 con 0x7f0338139960 2023-07-27T20:34:45.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.575+0000 7f033f5ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0338139d40 con 0x7f0338139f80 2023-07-27T20:34:45.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.576+0000 7f033d39b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0338139960 0x7f03380c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:45.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.576+0000 7f033db9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f03380c2340 0x7f03381542e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:44740/0 (socket says 172.21.15.72:44740) 2023-07-27T20:34:45.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.576+0000 7f033db9c700 1 -- 172.21.15.72:0/1841083607 learned_addr learned my addr 172.21.15.72:0/1841083607 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:45.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.576+0000 7f033d39b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0338139960 0x7f03380c12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58028/0 (socket says 172.21.15.72:58028) 2023-07-27T20:34:45.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.576+0000 7f033cb9a700 1 --2- 172.21.15.72:0/1841083607 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0338139f80 0x7f03380c1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:45.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.576+0000 7f033d39b700 1 -- 172.21.15.72:0/1841083607 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0338139f80 msgr2=0x7f03380c1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:45.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.576+0000 7f033d39b700 1 --2- 172.21.15.72:0/1841083607 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0338139f80 0x7f03380c1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:45.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.576+0000 7f033d39b700 1 -- 172.21.15.72:0/1841083607 >> v1:172.21.15.72:6789/0 conn(0x7f03380c2340 legacy=0x7f03381542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:45.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.576+0000 7f033d39b700 1 -- 172.21.15.72:0/1841083607 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0338151060 con 0x7f0338139960 2023-07-27T20:34:45.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.576+0000 7f032ffff700 1 -- 172.21.15.72:0/1841083607 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 345301120 0 0) 0x7f03380c1810 con 0x7f03380c2340 2023-07-27T20:34:45.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.576+0000 7f033d39b700 1 --2- 172.21.15.72:0/1841083607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0338139960 0x7f03380c12d0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f0334009840 tx=0x7f0334009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77c8313c1111b274 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:45.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.577+0000 7f032ffff700 1 -- 172.21.15.72:0/1841083607 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0334011830 con 0x7f0338139960 2023-07-27T20:34:45.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.577+0000 7f032ffff700 1 -- 172.21.15.72:0/1841083607 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0334011990 con 0x7f0338139960 2023-07-27T20:34:45.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.577+0000 7f032ffff700 1 -- 172.21.15.72:0/1841083607 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0334011d20 con 0x7f0338139960 2023-07-27T20:34:45.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.577+0000 7f033f5ff700 1 -- 172.21.15.72:0/1841083607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0338139960 msgr2=0x7f03380c12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:45.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.577+0000 7f033f5ff700 1 --2- 172.21.15.72:0/1841083607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0338139960 0x7f03380c12d0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f0334009840 tx=0x7f0334009b50 comp rx=0 tx=0).stop 2023-07-27T20:34:45.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.577+0000 7f033f5ff700 1 -- 172.21.15.72:0/1841083607 shutdown_connections 2023-07-27T20:34:45.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.577+0000 7f033f5ff700 1 --2- 172.21.15.72:0/1841083607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0338139960 0x7f03380c12d0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:45.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.577+0000 7f033f5ff700 1 --2- 172.21.15.72:0/1841083607 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0338139f80 0x7f03380c1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:45.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.577+0000 7f033f5ff700 1 -- 172.21.15.72:0/1841083607 >> 172.21.15.72:0/1841083607 conn(0x7f033806a190 msgr2=0x7f033806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:45.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.577+0000 7f033f5ff700 1 -- 172.21.15.72:0/1841083607 shutdown_connections 2023-07-27T20:34:45.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.577+0000 7f033f5ff700 1 -- 172.21.15.72:0/1841083607 wait complete. 2023-07-27T20:34:45.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.579+0000 7f033f5ff700 1 Processor -- start 2023-07-27T20:34:45.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.579+0000 7f033f5ff700 1 -- start start 2023-07-27T20:34:45.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.580+0000 7f033f5ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f03380c2340 0x7f03380c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:45.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.580+0000 7f033f5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0338139960 0x7f03380c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:45.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.580+0000 7f033f5ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0338139f80 0x7f03380c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:45.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.580+0000 7f033f5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03380c6050 con 0x7f0338139960 2023-07-27T20:34:45.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.580+0000 7f033f5ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03380c3620 con 0x7f0338139f80 2023-07-27T20:34:45.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.580+0000 7f033f5ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03380c3900 con 0x7f03380c2340 2023-07-27T20:34:45.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.580+0000 7f033cb9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0338139960 0x7f03380c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:45.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.580+0000 7f033cb9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0338139960 0x7f03380c5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58040/0 (socket says 172.21.15.72:58040) 2023-07-27T20:34:45.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.580+0000 7f033cb9a700 1 -- 172.21.15.72:0/1023822337 learned_addr learned my addr 172.21.15.72:0/1023822337 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:45.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.580+0000 7f033d39b700 1 --2- 172.21.15.72:0/1023822337 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f03380c2340 0x7f03380c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:45.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.580+0000 7f033db9c700 1 --2- 172.21.15.72:0/1023822337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0338139f80 0x7f03380c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:45.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.581+0000 7f033cb9a700 1 -- 172.21.15.72:0/1023822337 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f03380c2340 msgr2=0x7f03380c55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:45.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.581+0000 7f033cb9a700 1 --2- 172.21.15.72:0/1023822337 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f03380c2340 0x7f03380c55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:45.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.581+0000 7f033cb9a700 1 -- 172.21.15.72:0/1023822337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0338139f80 msgr2=0x7f03380c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:45.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.581+0000 7f033cb9a700 1 --2- 172.21.15.72:0/1023822337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0338139f80 0x7f03380c46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:45.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.581+0000 7f033cb9a700 1 -- 172.21.15.72:0/1023822337 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03340094a0 con 0x7f0338139960 2023-07-27T20:34:45.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.581+0000 7f033cb9a700 1 --2- 172.21.15.72:0/1023822337 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0338139960 0x7f03380c5b10 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f032800e9b0 tx=0x7f032800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:45.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.581+0000 7f032dffb700 1 -- 172.21.15.72:0/1023822337 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0328009710 con 0x7f0338139960 2023-07-27T20:34:45.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.581+0000 7f032dffb700 1 -- 172.21.15.72:0/1023822337 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032800ee50 con 0x7f0338139960 2023-07-27T20:34:45.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.581+0000 7f033f5ff700 1 -- 172.21.15.72:0/1023822337 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03380c3be0 con 0x7f0338139960 2023-07-27T20:34:45.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.581+0000 7f032dffb700 1 -- 172.21.15.72:0/1023822337 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032800ca50 con 0x7f0338139960 2023-07-27T20:34:45.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.581+0000 7f033f5ff700 1 -- 172.21.15.72:0/1023822337 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03380c41a0 con 0x7f0338139960 2023-07-27T20:34:45.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.582+0000 7f033f5ff700 1 -- 172.21.15.72:0/1023822337 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0338074310 con 0x7f0338139960 2023-07-27T20:34:45.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.583+0000 7f032dffb700 1 -- 172.21.15.72:0/1023822337 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f032800cbb0 con 0x7f0338139960 2023-07-27T20:34:45.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.584+0000 7f032dffb700 1 --2- 172.21.15.72:0/1023822337 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f031c06acb0 0x7f031c06d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:45.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.584+0000 7f032dffb700 1 -- 172.21.15.72:0/1023822337 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f03280895b0 con 0x7f0338139960 2023-07-27T20:34:45.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.584+0000 7f033d39b700 1 --2- 172.21.15.72:0/1023822337 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f031c06acb0 0x7f031c06d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:45.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.585+0000 7f033d39b700 1 --2- 172.21.15.72:0/1023822337 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f031c06acb0 0x7f031c06d170 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f03340090b0 tx=0x7f033401c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:45.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.588+0000 7f032dffb700 1 -- 172.21.15.72:0/1023822337 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0328057fa0 con 0x7f0338139960 2023-07-27T20:34:45.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.858+0000 7f033f5ff700 1 -- 172.21.15.72:0/1023822337 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7f0338136e20 con 0x7f0338139960 2023-07-27T20:34:45.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.859+0000 7f032dffb700 1 -- 172.21.15.72:0/1023822337 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v15) v1 ==== 84+0+0 (secure 0 0 0) 0x7f032800ce60 con 0x7f0338139960 2023-07-27T20:34:45.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.861+0000 7f033f5ff700 1 -- 172.21.15.72:0/1023822337 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f031c06acb0 msgr2=0x7f031c06d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:45.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.861+0000 7f033f5ff700 1 --2- 172.21.15.72:0/1023822337 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f031c06acb0 0x7f031c06d170 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f03340090b0 tx=0x7f033401c040 comp rx=0 tx=0).stop 2023-07-27T20:34:45.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.861+0000 7f033f5ff700 1 -- 172.21.15.72:0/1023822337 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0338139960 msgr2=0x7f03380c5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:45.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.861+0000 7f033f5ff700 1 --2- 172.21.15.72:0/1023822337 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0338139960 0x7f03380c5b10 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f032800e9b0 tx=0x7f032800ecc0 comp rx=0 tx=0).stop 2023-07-27T20:34:45.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.861+0000 7f033f5ff700 1 -- 172.21.15.72:0/1023822337 shutdown_connections 2023-07-27T20:34:45.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.861+0000 7f033f5ff700 1 --2- 172.21.15.72:0/1023822337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0338139f80 0x7f03380c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:45.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.861+0000 7f033f5ff700 1 --2- 172.21.15.72:0/1023822337 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f031c06acb0 0x7f031c06d170 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:45.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.861+0000 7f033f5ff700 1 --2- 172.21.15.72:0/1023822337 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f03380c2340 0x7f03380c55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:45.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.861+0000 7f033f5ff700 1 --2- 172.21.15.72:0/1023822337 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0338139960 0x7f03380c5b10 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:45.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.861+0000 7f033f5ff700 1 -- 172.21.15.72:0/1023822337 >> 172.21.15.72:0/1023822337 conn(0x7f033806a190 msgr2=0x7f03380706c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:45.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.861+0000 7f033f5ff700 1 -- 172.21.15.72:0/1023822337 shutdown_connections 2023-07-27T20:34:45.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:45.861+0000 7f033f5ff700 1 -- 172.21.15.72:0/1023822337 wait complete. 2023-07-27T20:34:45.866 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:34:46.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.074+0000 7f0a083ff700 1 Processor -- start 2023-07-27T20:34:46.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.074+0000 7f0a083ff700 1 -- start start 2023-07-27T20:34:46.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.076+0000 7f0a083ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0a0014da10 0x7f0a000aad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:46.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.076+0000 7f0a083ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a00070080 con 0x7f0a001504b0 2023-07-27T20:34:46.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.076+0000 7f0a083ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a000ab330 con 0x7f0a000c1930 2023-07-27T20:34:46.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.076+0000 7f0a083ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a000702d0 con 0x7f0a0014da10 2023-07-27T20:34:46.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.076+0000 7f0a0619b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0a0014da10 0x7f0a000aad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:46.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.076+0000 7f0a0619b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0a0014da10 0x7f0a000aad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58050/0 (socket says 172.21.15.72:58050) 2023-07-27T20:34:46.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.076+0000 7f0a0619b700 1 -- 172.21.15.72:0/2227736896 learned_addr learned my addr 172.21.15.72:0/2227736896 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:46.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.077+0000 7f0a0619b700 1 -- 172.21.15.72:0/2227736896 >> v1:172.21.15.173:6789/0 conn(0x7f0a000c1930 legacy=0x7f0a0006d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:46.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.077+0000 7f0a0619b700 1 -- 172.21.15.72:0/2227736896 >> v1:172.21.15.72:6789/0 conn(0x7f0a001504b0 legacy=0x7f0a00150960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:46.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.077+0000 7f0a0619b700 1 -- 172.21.15.72:0/2227736896 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a000705b0 con 0x7f0a0014da10 2023-07-27T20:34:46.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.077+0000 7f0a0619b700 1 --2- 172.21.15.72:0/2227736896 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a0014da10 0x7f0a000aad50 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f09fc00bb90 tx=0x7f09fc00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88d813a120836773 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:46.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.077+0000 7f0a05199700 1 -- 172.21.15.72:0/2227736896 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc00dd50 con 0x7f0a0014da10 2023-07-27T20:34:46.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.077+0000 7f0a05199700 1 -- 172.21.15.72:0/2227736896 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09fc010470 con 0x7f0a0014da10 2023-07-27T20:34:46.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.077+0000 7f0a05199700 1 -- 172.21.15.72:0/2227736896 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc010800 con 0x7f0a0014da10 2023-07-27T20:34:46.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.078+0000 7f0a083ff700 1 -- 172.21.15.72:0/2227736896 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a0014da10 msgr2=0x7f0a000aad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:46.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.078+0000 7f0a083ff700 1 --2- 172.21.15.72:0/2227736896 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a0014da10 0x7f0a000aad50 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f09fc00bb90 tx=0x7f09fc00bea0 comp rx=0 tx=0).stop 2023-07-27T20:34:46.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.078+0000 7f0a083ff700 1 -- 172.21.15.72:0/2227736896 shutdown_connections 2023-07-27T20:34:46.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.078+0000 7f0a083ff700 1 --2- 172.21.15.72:0/2227736896 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a0014da10 0x7f0a000aad50 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:46.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.078+0000 7f0a083ff700 1 -- 172.21.15.72:0/2227736896 >> 172.21.15.72:0/2227736896 conn(0x7f0a0006a190 msgr2=0x7f0a0006a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:46.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.078+0000 7f0a083ff700 1 -- 172.21.15.72:0/2227736896 shutdown_connections 2023-07-27T20:34:46.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.078+0000 7f0a083ff700 1 -- 172.21.15.72:0/2227736896 wait complete. 2023-07-27T20:34:46.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.080+0000 7f0a083ff700 1 Processor -- start 2023-07-27T20:34:46.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.080+0000 7f0a083ff700 1 -- start start 2023-07-27T20:34:46.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.080+0000 7f0a083ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a000c1930 0x7f0a001e99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:46.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.080+0000 7f0a083ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0a0014da10 0x7f0a0014c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:46.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.081+0000 7f0a083ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a001504b0 0x7f0a001ed7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:46.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.081+0000 7f0a083ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a00154830 con 0x7f0a001504b0 2023-07-27T20:34:46.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.081+0000 7f0a083ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a001e9f20 con 0x7f0a000c1930 2023-07-27T20:34:46.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.081+0000 7f0a083ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a001ed360 con 0x7f0a0014da10 2023-07-27T20:34:46.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.081+0000 7f0a0699c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a001504b0 0x7f0a001ed7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:46.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.081+0000 7f0a0699c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a001504b0 0x7f0a001ed7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58066/0 (socket says 172.21.15.72:58066) 2023-07-27T20:34:46.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.081+0000 7f0a0699c700 1 -- 172.21.15.72:0/3867676599 learned_addr learned my addr 172.21.15.72:0/3867676599 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:46.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.081+0000 7f0a0619b700 1 --2- 172.21.15.72:0/3867676599 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a000c1930 0x7f0a001e99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:46.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.081+0000 7f0a0599a700 1 --2- 172.21.15.72:0/3867676599 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0a0014da10 0x7f0a0014c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:46.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.081+0000 7f0a0699c700 1 -- 172.21.15.72:0/3867676599 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0a0014da10 msgr2=0x7f0a0014c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:46.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.081+0000 7f0a0699c700 1 --2- 172.21.15.72:0/3867676599 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0a0014da10 0x7f0a0014c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:46.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.081+0000 7f0a0699c700 1 -- 172.21.15.72:0/3867676599 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a000c1930 msgr2=0x7f0a001e99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:46.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.081+0000 7f0a0699c700 1 --2- 172.21.15.72:0/3867676599 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a000c1930 0x7f0a001e99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:46.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.081+0000 7f0a0699c700 1 -- 172.21.15.72:0/3867676599 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09fc00b7f0 con 0x7f0a001504b0 2023-07-27T20:34:46.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.081+0000 7f0a0619b700 1 --2- 172.21.15.72:0/3867676599 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a000c1930 0x7f0a001e99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:46.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.081+0000 7f0a0699c700 1 --2- 172.21.15.72:0/3867676599 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a001504b0 0x7f0a001ed7f0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f09f800cc50 tx=0x7f09f800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:46.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.082+0000 7f09f6ffd700 1 -- 172.21.15.72:0/3867676599 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f800ad80 con 0x7f0a001504b0 2023-07-27T20:34:46.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.082+0000 7f09f6ffd700 1 -- 172.21.15.72:0/3867676599 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f800ce50 con 0x7f0a001504b0 2023-07-27T20:34:46.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.082+0000 7f09f6ffd700 1 -- 172.21.15.72:0/3867676599 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f8003c40 con 0x7f0a001504b0 2023-07-27T20:34:46.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.082+0000 7f0a083ff700 1 -- 172.21.15.72:0/3867676599 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a00149c80 con 0x7f0a001504b0 2023-07-27T20:34:46.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.082+0000 7f0a083ff700 1 -- 172.21.15.72:0/3867676599 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a001ecff0 con 0x7f0a001504b0 2023-07-27T20:34:46.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.083+0000 7f0a083ff700 1 -- 172.21.15.72:0/3867676599 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a00074310 con 0x7f0a001504b0 2023-07-27T20:34:46.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.084+0000 7f09f6ffd700 1 -- 172.21.15.72:0/3867676599 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f09f80050d0 con 0x7f0a001504b0 2023-07-27T20:34:46.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.084+0000 7f09f6ffd700 1 --2- 172.21.15.72:0/3867676599 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f09e406ace0 0x7f09e406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:46.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.085+0000 7f09f6ffd700 1 -- 172.21.15.72:0/3867676599 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f09f8089770 con 0x7f0a001504b0 2023-07-27T20:34:46.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.085+0000 7f0a0619b700 1 --2- 172.21.15.72:0/3867676599 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f09e406ace0 0x7f09e406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:46.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.086+0000 7f0a0619b700 1 --2- 172.21.15.72:0/3867676599 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f09e406ace0 0x7f09e406d1a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f09fc00bee0 tx=0x7f09fc013000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:46.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.089+0000 7f09f6ffd700 1 -- 172.21.15.72:0/3867676599 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f09f8054640 con 0x7f0a001504b0 2023-07-27T20:34:46.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.288+0000 7f0a083ff700 1 -- 172.21.15.72:0/3867676599 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a001ed4a0 con 0x7f0a001504b0 2023-07-27T20:34:46.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.290+0000 7f09f6ffd700 1 -- 172.21.15.72:0/3867676599 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+18555 (secure 0 0 0) 0x7f09f8057c60 con 0x7f0a001504b0 2023-07-27T20:34:46.278 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:34:46.278 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":62,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:34:35.293038+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:34:31.480063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-07-27T20:34:32.755579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:34:46.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.292+0000 7f0a083ff700 1 -- 172.21.15.72:0/3867676599 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f09e406ace0 msgr2=0x7f09e406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:46.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.292+0000 7f0a083ff700 1 --2- 172.21.15.72:0/3867676599 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f09e406ace0 0x7f09e406d1a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f09fc00bee0 tx=0x7f09fc013000 comp rx=0 tx=0).stop 2023-07-27T20:34:46.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.292+0000 7f0a083ff700 1 -- 172.21.15.72:0/3867676599 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a001504b0 msgr2=0x7f0a001ed7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:46.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.292+0000 7f0a083ff700 1 --2- 172.21.15.72:0/3867676599 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a001504b0 0x7f0a001ed7f0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f09f800cc50 tx=0x7f09f800a340 comp rx=0 tx=0).stop 2023-07-27T20:34:46.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.292+0000 7f0a083ff700 1 -- 172.21.15.72:0/3867676599 shutdown_connections 2023-07-27T20:34:46.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.292+0000 7f0a083ff700 1 --2- 172.21.15.72:0/3867676599 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a001504b0 0x7f0a001ed7f0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:46.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.292+0000 7f0a083ff700 1 --2- 172.21.15.72:0/3867676599 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a000c1930 0x7f0a001e99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:46.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.292+0000 7f0a083ff700 1 --2- 172.21.15.72:0/3867676599 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f09e406ace0 0x7f09e406d1a0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:46.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.292+0000 7f0a083ff700 1 --2- 172.21.15.72:0/3867676599 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0a0014da10 0x7f0a0014c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:46.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.292+0000 7f0a083ff700 1 -- 172.21.15.72:0/3867676599 >> 172.21.15.72:0/3867676599 conn(0x7f0a0006a190 msgr2=0x7f0a000be720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:46.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.293+0000 7f0a083ff700 1 -- 172.21.15.72:0/3867676599 shutdown_connections 2023-07-27T20:34:46.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.293+0000 7f0a083ff700 1 -- 172.21.15.72:0/3867676599 wait complete. 2023-07-27T20:34:46.298 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-27T20:31:14.581785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T20:31:21.077941+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T20:34:31.480063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T20:34:32.755579+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-27T20:34:46.299 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-27T20:34:46.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.509+0000 7ff3dbbff700 1 Processor -- start 2023-07-27T20:34:46.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.510+0000 7ff3dbbff700 1 -- start start 2023-07-27T20:34:46.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.511+0000 7ff3dbbff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff3d414aab0 0x7ff3d4154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:46.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.511+0000 7ff3dbbff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff3d406c1d0 0x7ff3d406c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:46.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.511+0000 7ff3dbbff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3d40c7c50 con 0x7ff3d40c7740 2023-07-27T20:34:46.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.511+0000 7ff3dbbff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3d406bd40 con 0x7ff3d414aab0 2023-07-27T20:34:46.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.511+0000 7ff3dbbff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d40c62f0 con 0x7ff3d406c1d0 2023-07-27T20:34:46.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.511+0000 7ff3d999b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff3d414aab0 0x7ff3d4154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:46.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.511+0000 7ff3d919a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff3d40c7740 0x7ff3d40c41c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:44764/0 (socket says 172.21.15.72:44764) 2023-07-27T20:34:46.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.511+0000 7ff3d919a700 1 -- 172.21.15.72:0/79296537 learned_addr learned my addr 172.21.15.72:0/79296537 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:46.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.511+0000 7ff3d999b700 1 -- 172.21.15.72:0/79296537 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff3d406c1d0 msgr2=0x7ff3d406c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:46.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.511+0000 7ff3da19c700 1 --2- 172.21.15.72:0/79296537 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff3d406c1d0 0x7ff3d406c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:46.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.511+0000 7ff3d999b700 1 --2- 172.21.15.72:0/79296537 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff3d406c1d0 0x7ff3d406c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:46.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.511+0000 7ff3d8999700 1 -- 172.21.15.72:0/79296537 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3635742577 0 0) 0x7ff3d40c7c50 con 0x7ff3d40c7740 2023-07-27T20:34:46.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.512+0000 7ff3d999b700 1 -- 172.21.15.72:0/79296537 >> v1:172.21.15.72:6789/0 conn(0x7ff3d40c7740 legacy=0x7ff3d40c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:46.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.512+0000 7ff3d999b700 1 -- 172.21.15.72:0/79296537 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d4155050 con 0x7ff3d414aab0 2023-07-27T20:34:46.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.512+0000 7ff3da19c700 1 --2- 172.21.15.72:0/79296537 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff3d406c1d0 0x7ff3d406c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:46.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.512+0000 7ff3d999b700 1 --2- 172.21.15.72:0/79296537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3d414aab0 0x7ff3d4154b10 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0009840 tx=0x7ff3d0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=195771fe129c4911 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:46.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.512+0000 7ff3d8999700 1 -- 172.21.15.72:0/79296537 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d0011830 con 0x7ff3d414aab0 2023-07-27T20:34:46.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.512+0000 7ff3d8999700 1 -- 172.21.15.72:0/79296537 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d0011990 con 0x7ff3d414aab0 2023-07-27T20:34:46.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.512+0000 7ff3d8999700 1 -- 172.21.15.72:0/79296537 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d0011d20 con 0x7ff3d414aab0 2023-07-27T20:34:46.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.512+0000 7ff3dbbff700 1 -- 172.21.15.72:0/79296537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3d414aab0 msgr2=0x7ff3d4154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:46.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.512+0000 7ff3dbbff700 1 --2- 172.21.15.72:0/79296537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3d414aab0 0x7ff3d4154b10 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0009840 tx=0x7ff3d0009b50 comp rx=0 tx=0).stop 2023-07-27T20:34:46.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.513+0000 7ff3dbbff700 1 -- 172.21.15.72:0/79296537 shutdown_connections 2023-07-27T20:34:46.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.513+0000 7ff3dbbff700 1 --2- 172.21.15.72:0/79296537 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff3d406c1d0 0x7ff3d406c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:46.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.513+0000 7ff3dbbff700 1 --2- 172.21.15.72:0/79296537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3d414aab0 0x7ff3d4154b10 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:46.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.513+0000 7ff3dbbff700 1 -- 172.21.15.72:0/79296537 >> 172.21.15.72:0/79296537 conn(0x7ff3d40ab3f0 msgr2=0x7ff3d40ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:46.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.513+0000 7ff3dbbff700 1 -- 172.21.15.72:0/79296537 shutdown_connections 2023-07-27T20:34:46.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.513+0000 7ff3dbbff700 1 -- 172.21.15.72:0/79296537 wait complete. 2023-07-27T20:34:46.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.514+0000 7ff3dbbff700 1 Processor -- start 2023-07-27T20:34:46.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.514+0000 7ff3dbbff700 1 -- start start 2023-07-27T20:34:46.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.515+0000 7ff3dbbff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3d406c1d0 0x7ff3d41e9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:46.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.515+0000 7ff3dbbff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff3d40c7740 0x7ff3d40bd370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:46.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.515+0000 7ff3dbbff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3d414aab0 0x7ff3d40bebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:46.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.515+0000 7ff3dbbff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d40c2610 con 0x7ff3d414aab0 2023-07-27T20:34:46.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.515+0000 7ff3dbbff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d40c1a00 con 0x7ff3d406c1d0 2023-07-27T20:34:46.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.515+0000 7ff3dbbff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d40c1ce0 con 0x7ff3d40c7740 2023-07-27T20:34:46.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.515+0000 7ff3da19c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3d414aab0 0x7ff3d40bebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:46.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.516+0000 7ff3da19c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3d414aab0 0x7ff3d40bebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58086/0 (socket says 172.21.15.72:58086) 2023-07-27T20:34:46.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.516+0000 7ff3da19c700 1 -- 172.21.15.72:0/1215403137 learned_addr learned my addr 172.21.15.72:0/1215403137 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:46.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.516+0000 7ff3d919a700 1 --2- 172.21.15.72:0/1215403137 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff3d40c7740 0x7ff3d40bd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:46.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.516+0000 7ff3d999b700 1 --2- 172.21.15.72:0/1215403137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3d406c1d0 0x7ff3d41e9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:46.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.516+0000 7ff3da19c700 1 -- 172.21.15.72:0/1215403137 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff3d40c7740 msgr2=0x7ff3d40bd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:46.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.516+0000 7ff3da19c700 1 --2- 172.21.15.72:0/1215403137 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff3d40c7740 0x7ff3d40bd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:46.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.516+0000 7ff3da19c700 1 -- 172.21.15.72:0/1215403137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3d406c1d0 msgr2=0x7ff3d41e9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:46.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.516+0000 7ff3da19c700 1 --2- 172.21.15.72:0/1215403137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3d406c1d0 0x7ff3d41e9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:46.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.516+0000 7ff3da19c700 1 -- 172.21.15.72:0/1215403137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d00094a0 con 0x7ff3d414aab0 2023-07-27T20:34:46.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.516+0000 7ff3da19c700 1 --2- 172.21.15.72:0/1215403137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3d414aab0 0x7ff3d40bebc0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc00cef0 tx=0x7ff3cc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:46.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.516+0000 7ff3ca7fc700 1 -- 172.21.15.72:0/1215403137 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc00ae50 con 0x7ff3d414aab0 2023-07-27T20:34:46.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.516+0000 7ff3ca7fc700 1 -- 172.21.15.72:0/1215403137 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3cc015440 con 0x7ff3d414aab0 2023-07-27T20:34:46.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.516+0000 7ff3dbbff700 1 -- 172.21.15.72:0/1215403137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3d40c1fc0 con 0x7ff3d414aab0 2023-07-27T20:34:46.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.516+0000 7ff3ca7fc700 1 -- 172.21.15.72:0/1215403137 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc0157f0 con 0x7ff3d414aab0 2023-07-27T20:34:46.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.517+0000 7ff3dbbff700 1 -- 172.21.15.72:0/1215403137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3d40c8ee0 con 0x7ff3d414aab0 2023-07-27T20:34:46.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.518+0000 7ff3dbbff700 1 -- 172.21.15.72:0/1215403137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3d406a200 con 0x7ff3d414aab0 2023-07-27T20:34:46.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.519+0000 7ff3ca7fc700 1 -- 172.21.15.72:0/1215403137 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff3cc00d430 con 0x7ff3d414aab0 2023-07-27T20:34:46.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.519+0000 7ff3ca7fc700 1 --2- 172.21.15.72:0/1215403137 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff3b806ace0 0x7ff3b806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:46.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.519+0000 7ff3ca7fc700 1 -- 172.21.15.72:0/1215403137 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff3cc089c60 con 0x7ff3d414aab0 2023-07-27T20:34:46.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.520+0000 7ff3d999b700 1 --2- 172.21.15.72:0/1215403137 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff3b806ace0 0x7ff3b806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:46.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.521+0000 7ff3d999b700 1 --2- 172.21.15.72:0/1215403137 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff3b806ace0 0x7ff3b806d1a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff3d00090b0 tx=0x7ff3d001c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:46.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.524+0000 7ff3ca7fc700 1 -- 172.21.15.72:0/1215403137 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff3cc054b50 con 0x7ff3d414aab0 2023-07-27T20:34:46.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.721+0000 7ff3dbbff700 1 -- 172.21.15.72:0/1215403137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff3d404e470 con 0x7ff3d414aab0 2023-07-27T20:34:46.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.722+0000 7ff3ca7fc700 1 -- 172.21.15.72:0/1215403137 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v62) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff3cc058170 con 0x7ff3d414aab0 2023-07-27T20:34:46.710 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-27T20:34:46.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.724+0000 7ff3dbbff700 1 -- 172.21.15.72:0/1215403137 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff3b806ace0 msgr2=0x7ff3b806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:46.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.724+0000 7ff3dbbff700 1 --2- 172.21.15.72:0/1215403137 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff3b806ace0 0x7ff3b806d1a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff3d00090b0 tx=0x7ff3d001c040 comp rx=0 tx=0).stop 2023-07-27T20:34:46.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.724+0000 7ff3dbbff700 1 -- 172.21.15.72:0/1215403137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3d414aab0 msgr2=0x7ff3d40bebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:46.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.724+0000 7ff3dbbff700 1 --2- 172.21.15.72:0/1215403137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3d414aab0 0x7ff3d40bebc0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc00cef0 tx=0x7ff3cc00a340 comp rx=0 tx=0).stop 2023-07-27T20:34:46.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.724+0000 7ff3dbbff700 1 -- 172.21.15.72:0/1215403137 shutdown_connections 2023-07-27T20:34:46.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.724+0000 7ff3dbbff700 1 --2- 172.21.15.72:0/1215403137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3d414aab0 0x7ff3d40bebc0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:46.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.724+0000 7ff3dbbff700 1 --2- 172.21.15.72:0/1215403137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3d406c1d0 0x7ff3d41e9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:46.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.724+0000 7ff3dbbff700 1 --2- 172.21.15.72:0/1215403137 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff3b806ace0 0x7ff3b806d1a0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:46.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.724+0000 7ff3dbbff700 1 --2- 172.21.15.72:0/1215403137 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff3d40c7740 0x7ff3d40bd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:46.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.724+0000 7ff3dbbff700 1 -- 172.21.15.72:0/1215403137 >> 172.21.15.72:0/1215403137 conn(0x7ff3d40ab3f0 msgr2=0x7ff3d40c40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:46.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.724+0000 7ff3dbbff700 1 -- 172.21.15.72:0/1215403137 shutdown_connections 2023-07-27T20:34:46.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.725+0000 7ff3dbbff700 1 -- 172.21.15.72:0/1215403137 wait complete. 2023-07-27T20:34:46.730 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T20:34:46.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.939+0000 7f86c81ff700 1 Processor -- start 2023-07-27T20:34:46.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.940+0000 7f86c81ff700 1 -- start start 2023-07-27T20:34:46.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.941+0000 7f86c81ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86c014aab0 0x7f86c0154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:46.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.941+0000 7f86c81ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f86c006c1d0 0x7f86c006c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:46.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.941+0000 7f86c81ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c00c7c50 con 0x7f86c00c7740 2023-07-27T20:34:46.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.941+0000 7f86c81ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c006bd40 con 0x7f86c006c1d0 2023-07-27T20:34:46.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.941+0000 7f86c81ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c00c62f0 con 0x7f86c014aab0 2023-07-27T20:34:46.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.941+0000 7f86c679c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f86c006c1d0 0x7f86c006c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:46.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.941+0000 7f86c679c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f86c006c1d0 0x7f86c006c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58088/0 (socket says 172.21.15.72:58088) 2023-07-27T20:34:46.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.941+0000 7f86c679c700 1 -- 172.21.15.72:0/2551868570 learned_addr learned my addr 172.21.15.72:0/2551868570 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:46.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.941+0000 7f86c5f9b700 1 --2- 172.21.15.72:0/2551868570 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86c014aab0 0x7f86c0154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:46.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.941+0000 7f86c679c700 1 -- 172.21.15.72:0/2551868570 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86c014aab0 msgr2=0x7f86c0154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:46.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.941+0000 7f86c679c700 1 --2- 172.21.15.72:0/2551868570 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86c014aab0 0x7f86c0154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:46.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.941+0000 7f86c679c700 1 -- 172.21.15.72:0/2551868570 >> v1:172.21.15.173:6789/0 conn(0x7f86c00c7740 legacy=0x7f86c00c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:46.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.941+0000 7f86c679c700 1 -- 172.21.15.72:0/2551868570 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c0155050 con 0x7f86c006c1d0 2023-07-27T20:34:46.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.942+0000 7f86c679c700 1 --2- 172.21.15.72:0/2551868570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86c006c1d0 0x7f86c006c640 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f86b8009e50 tx=0x7f86b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a18d985027eae56 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:46.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.942+0000 7f86c4f99700 1 -- 172.21.15.72:0/2551868570 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b800e070 con 0x7f86c006c1d0 2023-07-27T20:34:46.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.942+0000 7f86c4f99700 1 -- 172.21.15.72:0/2551868570 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b800b9c0 con 0x7f86c006c1d0 2023-07-27T20:34:46.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.942+0000 7f86c4f99700 1 -- 172.21.15.72:0/2551868570 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b800bd70 con 0x7f86c006c1d0 2023-07-27T20:34:46.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.942+0000 7f86c81ff700 1 -- 172.21.15.72:0/2551868570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86c006c1d0 msgr2=0x7f86c006c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:46.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.942+0000 7f86c81ff700 1 --2- 172.21.15.72:0/2551868570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86c006c1d0 0x7f86c006c640 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f86b8009e50 tx=0x7f86b800b330 comp rx=0 tx=0).stop 2023-07-27T20:34:46.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.942+0000 7f86c81ff700 1 -- 172.21.15.72:0/2551868570 shutdown_connections 2023-07-27T20:34:46.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.942+0000 7f86c81ff700 1 --2- 172.21.15.72:0/2551868570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86c006c1d0 0x7f86c006c640 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:46.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.942+0000 7f86c81ff700 1 --2- 172.21.15.72:0/2551868570 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86c014aab0 0x7f86c0154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:46.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.942+0000 7f86c81ff700 1 -- 172.21.15.72:0/2551868570 >> 172.21.15.72:0/2551868570 conn(0x7f86c00ab3f0 msgr2=0x7f86c00ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:46.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.943+0000 7f86c81ff700 1 -- 172.21.15.72:0/2551868570 shutdown_connections 2023-07-27T20:34:46.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.943+0000 7f86c81ff700 1 -- 172.21.15.72:0/2551868570 wait complete. 2023-07-27T20:34:46.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.944+0000 7f86c81ff700 1 Processor -- start 2023-07-27T20:34:46.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.944+0000 7f86c81ff700 1 -- start start 2023-07-27T20:34:46.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.945+0000 7f86c81ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86c006c1d0 0x7f86c00a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:46.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.945+0000 7f86c81ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86c00c7740 0x7f86c01ed450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:46.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.945+0000 7f86c81ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86c014aab0 0x7f86c01ed990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:46.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.945+0000 7f86c81ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c00aa280 con 0x7f86c014aab0 2023-07-27T20:34:46.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.945+0000 7f86c81ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c0150010 con 0x7f86c006c1d0 2023-07-27T20:34:46.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.945+0000 7f86c81ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c0156070 con 0x7f86c00c7740 2023-07-27T20:34:46.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.946+0000 7f86c679c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86c014aab0 0x7f86c01ed990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:46.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.946+0000 7f86c5f9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86c006c1d0 0x7f86c00a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:46.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.946+0000 7f86c5f9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86c006c1d0 0x7f86c00a94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.72:45456/0 (socket says 172.21.15.72:45456) 2023-07-27T20:34:46.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.946+0000 7f86c679c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86c014aab0 0x7f86c01ed990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58092/0 (socket says 172.21.15.72:58092) 2023-07-27T20:34:46.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.946+0000 7f86c5f9b700 1 -- 172.21.15.72:0/3795489956 learned_addr learned my addr 172.21.15.72:0/3795489956 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:46.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.946+0000 7f86c579a700 1 --2- 172.21.15.72:0/3795489956 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86c00c7740 0x7f86c01ed450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:46.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.946+0000 7f86c679c700 1 -- 172.21.15.72:0/3795489956 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86c00c7740 msgr2=0x7f86c01ed450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:46.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.946+0000 7f86c679c700 1 --2- 172.21.15.72:0/3795489956 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86c00c7740 0x7f86c01ed450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:46.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.946+0000 7f86c679c700 1 -- 172.21.15.72:0/3795489956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86c006c1d0 msgr2=0x7f86c00a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:46.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.946+0000 7f86c679c700 1 --2- 172.21.15.72:0/3795489956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86c006c1d0 0x7f86c00a94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:46.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.946+0000 7f86c679c700 1 -- 172.21.15.72:0/3795489956 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b8009b30 con 0x7f86c014aab0 2023-07-27T20:34:46.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.946+0000 7f86c679c700 1 --2- 172.21.15.72:0/3795489956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86c014aab0 0x7f86c01ed990 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f86b8015000 tx=0x7f86b8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:46.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.946+0000 7f86b67fc700 1 -- 172.21.15.72:0/3795489956 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b80048b0 con 0x7f86c014aab0 2023-07-27T20:34:46.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.946+0000 7f86b67fc700 1 -- 172.21.15.72:0/3795489956 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b80092e0 con 0x7f86c014aab0 2023-07-27T20:34:46.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.946+0000 7f86b67fc700 1 -- 172.21.15.72:0/3795489956 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b801c660 con 0x7f86c014aab0 2023-07-27T20:34:46.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.946+0000 7f86c81ff700 1 -- 172.21.15.72:0/3795489956 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c0156350 con 0x7f86c014aab0 2023-07-27T20:34:46.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.947+0000 7f86c81ff700 1 -- 172.21.15.72:0/3795489956 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c014fca0 con 0x7f86c014aab0 2023-07-27T20:34:46.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.948+0000 7f86c81ff700 1 -- 172.21.15.72:0/3795489956 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c0156540 con 0x7f86c014aab0 2023-07-27T20:34:46.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.948+0000 7f86b67fc700 1 -- 172.21.15.72:0/3795489956 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f86b801c7c0 con 0x7f86c014aab0 2023-07-27T20:34:46.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.949+0000 7f86b67fc700 1 --2- 172.21.15.72:0/3795489956 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f86a406ace0 0x7f86a406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:46.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.949+0000 7f86b67fc700 1 -- 172.21.15.72:0/3795489956 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f86b808af20 con 0x7f86c014aab0 2023-07-27T20:34:46.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.950+0000 7f86c5f9b700 1 --2- 172.21.15.72:0/3795489956 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f86a406ace0 0x7f86a406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:46.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.950+0000 7f86c5f9b700 1 --2- 172.21.15.72:0/3795489956 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f86a406ace0 0x7f86a406d1a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f86c0150360 tx=0x7f86bc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:46.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:46.953+0000 7f86b67fc700 1 -- 172.21.15.72:0/3795489956 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f86b8055e80 con 0x7f86c014aab0 2023-07-27T20:34:47.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.151+0000 7f86c81ff700 1 -- 172.21.15.72:0/3795489956 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f86c014fe30 con 0x7f86c014aab0 2023-07-27T20:34:47.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.151+0000 7f86b67fc700 1 -- 172.21.15.72:0/3795489956 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v62) v1 ==== 92+0+10 (secure 0 0 0) 0x7f86b80594a0 con 0x7f86c014aab0 2023-07-27T20:34:47.139 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-27T20:34:47.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.153+0000 7f86c81ff700 1 -- 172.21.15.72:0/3795489956 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f86a406ace0 msgr2=0x7f86a406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:47.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.153+0000 7f86c81ff700 1 --2- 172.21.15.72:0/3795489956 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f86a406ace0 0x7f86a406d1a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f86c0150360 tx=0x7f86bc008040 comp rx=0 tx=0).stop 2023-07-27T20:34:47.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.154+0000 7f86c81ff700 1 -- 172.21.15.72:0/3795489956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86c014aab0 msgr2=0x7f86c01ed990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:47.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.154+0000 7f86c81ff700 1 --2- 172.21.15.72:0/3795489956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86c014aab0 0x7f86c01ed990 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f86b8015000 tx=0x7f86b8004ad0 comp rx=0 tx=0).stop 2023-07-27T20:34:47.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.154+0000 7f86c81ff700 1 -- 172.21.15.72:0/3795489956 shutdown_connections 2023-07-27T20:34:47.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.154+0000 7f86c81ff700 1 --2- 172.21.15.72:0/3795489956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86c014aab0 0x7f86c01ed990 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:47.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.154+0000 7f86c81ff700 1 --2- 172.21.15.72:0/3795489956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86c006c1d0 0x7f86c00a94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:47.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.154+0000 7f86c81ff700 1 --2- 172.21.15.72:0/3795489956 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f86a406ace0 0x7f86a406d1a0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:47.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.154+0000 7f86c81ff700 1 --2- 172.21.15.72:0/3795489956 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86c00c7740 0x7f86c01ed450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:47.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.154+0000 7f86c81ff700 1 -- 172.21.15.72:0/3795489956 >> 172.21.15.72:0/3795489956 conn(0x7f86c00ab3f0 msgr2=0x7f86c00aac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:47.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.154+0000 7f86c81ff700 1 -- 172.21.15.72:0/3795489956 shutdown_connections 2023-07-27T20:34:47.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.154+0000 7f86c81ff700 1 -- 172.21.15.72:0/3795489956 wait complete. 2023-07-27T20:34:47.159 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T20:34:47.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.371+0000 7ff6587ff700 1 Processor -- start 2023-07-27T20:34:47.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.371+0000 7ff6587ff700 1 -- start start 2023-07-27T20:34:47.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.372+0000 7ff6587ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6501475a0 0x7ff6501516c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:47.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.372+0000 7ff6587ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff6500716f0 0x7ff650071b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:47.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.372+0000 7ff6587ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff650154f50 con 0x7ff6500c12f0 2023-07-27T20:34:47.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.372+0000 7ff6587ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff650151c00 con 0x7ff6500716f0 2023-07-27T20:34:47.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.372+0000 7ff6587ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff650154340 con 0x7ff6501475a0 2023-07-27T20:34:47.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.372+0000 7ff655d9a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff6500c12f0 0x7ff6500c1d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:44780/0 (socket says 172.21.15.72:44780) 2023-07-27T20:34:47.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.372+0000 7ff655d9a700 1 -- 172.21.15.72:0/756109880 learned_addr learned my addr 172.21.15.72:0/756109880 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:47.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.373+0000 7ff656d9c700 1 --2- 172.21.15.72:0/756109880 >> v2:172.21.15.72:3300/0 conn(0x7ff6500716f0 0x7ff650071b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:47.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.373+0000 7ff65659b700 1 --2- 172.21.15.72:0/756109880 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6501475a0 0x7ff6501516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:47.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.373+0000 7ff655599700 1 -- 172.21.15.72:0/756109880 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1716366148 0 0) 0x7ff650154f50 con 0x7ff6500c12f0 2023-07-27T20:34:47.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.373+0000 7ff655599700 1 -- 172.21.15.72:0/756109880 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff63c0057c0 con 0x7ff6500c12f0 2023-07-27T20:34:47.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.373+0000 7ff656d9c700 1 -- 172.21.15.72:0/756109880 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6501475a0 msgr2=0x7ff6501516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:47.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.373+0000 7ff656d9c700 1 --2- 172.21.15.72:0/756109880 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6501475a0 0x7ff6501516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:47.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.373+0000 7ff656d9c700 1 -- 172.21.15.72:0/756109880 >> v1:172.21.15.72:6789/0 conn(0x7ff6500c12f0 legacy=0x7ff6500c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:47.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.373+0000 7ff656d9c700 1 -- 172.21.15.72:0/756109880 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff650154620 con 0x7ff6500716f0 2023-07-27T20:34:47.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.373+0000 7ff656d9c700 1 --2- 172.21.15.72:0/756109880 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6500716f0 0x7ff650071b60 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7ff648009d90 tx=0x7ff64800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a568af2b61e85a49 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:47.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.374+0000 7ff655599700 1 -- 172.21.15.72:0/756109880 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64800e070 con 0x7ff6500716f0 2023-07-27T20:34:47.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.374+0000 7ff655599700 1 -- 172.21.15.72:0/756109880 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff64800bb20 con 0x7ff6500716f0 2023-07-27T20:34:47.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.374+0000 7ff655599700 1 -- 172.21.15.72:0/756109880 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff648012430 con 0x7ff6500716f0 2023-07-27T20:34:47.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.374+0000 7ff6587ff700 1 -- 172.21.15.72:0/756109880 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6500716f0 msgr2=0x7ff650071b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:47.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.374+0000 7ff6587ff700 1 --2- 172.21.15.72:0/756109880 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6500716f0 0x7ff650071b60 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7ff648009d90 tx=0x7ff64800b330 comp rx=0 tx=0).stop 2023-07-27T20:34:47.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.374+0000 7ff6587ff700 1 -- 172.21.15.72:0/756109880 shutdown_connections 2023-07-27T20:34:47.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.374+0000 7ff6587ff700 1 --2- 172.21.15.72:0/756109880 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6500716f0 0x7ff650071b60 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:47.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.374+0000 7ff6587ff700 1 --2- 172.21.15.72:0/756109880 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6501475a0 0x7ff6501516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:47.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.374+0000 7ff6587ff700 1 -- 172.21.15.72:0/756109880 >> 172.21.15.72:0/756109880 conn(0x7ff65006a190 msgr2=0x7ff65006a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:47.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.374+0000 7ff6587ff700 1 -- 172.21.15.72:0/756109880 shutdown_connections 2023-07-27T20:34:47.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.374+0000 7ff6587ff700 1 -- 172.21.15.72:0/756109880 wait complete. 2023-07-27T20:34:47.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.376+0000 7ff6587ff700 1 Processor -- start 2023-07-27T20:34:47.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.376+0000 7ff6587ff700 1 -- start start 2023-07-27T20:34:47.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.377+0000 7ff6587ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6500716f0 0x7ff6500bb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:47.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.377+0000 7ff6587ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6500c12f0 0x7ff65013e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:47.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.377+0000 7ff6587ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6501475a0 0x7ff6501db2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:47.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.377+0000 7ff6587ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6500bbac0 con 0x7ff6501475a0 2023-07-27T20:34:47.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.377+0000 7ff6587ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6501e9900 con 0x7ff6500c12f0 2023-07-27T20:34:47.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.377+0000 7ff6587ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6501e9ba0 con 0x7ff6500716f0 2023-07-27T20:34:47.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.377+0000 7ff656d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6501475a0 0x7ff6501db2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:47.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.377+0000 7ff656d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6501475a0 0x7ff6501db2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58112/0 (socket says 172.21.15.72:58112) 2023-07-27T20:34:47.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.377+0000 7ff656d9c700 1 -- 172.21.15.72:0/1533778566 learned_addr learned my addr 172.21.15.72:0/1533778566 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:47.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.377+0000 7ff655d9a700 1 --2- 172.21.15.72:0/1533778566 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6500c12f0 0x7ff65013e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:47.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.377+0000 7ff65659b700 1 --2- 172.21.15.72:0/1533778566 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6500716f0 0x7ff6500bb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:47.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.377+0000 7ff656d9c700 1 -- 172.21.15.72:0/1533778566 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6500716f0 msgr2=0x7ff6500bb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:47.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.377+0000 7ff656d9c700 1 --2- 172.21.15.72:0/1533778566 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6500716f0 0x7ff6500bb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:47.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.377+0000 7ff656d9c700 1 -- 172.21.15.72:0/1533778566 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6500c12f0 msgr2=0x7ff65013e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:47.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.377+0000 7ff656d9c700 1 --2- 172.21.15.72:0/1533778566 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6500c12f0 0x7ff65013e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:47.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.377+0000 7ff656d9c700 1 -- 172.21.15.72:0/1533778566 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff648009a70 con 0x7ff6501475a0 2023-07-27T20:34:47.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.378+0000 7ff65659b700 1 --2- 172.21.15.72:0/1533778566 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6500716f0 0x7ff6500bb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:47.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.378+0000 7ff656d9c700 1 --2- 172.21.15.72:0/1533778566 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6501475a0 0x7ff6501db2f0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7ff648014040 tx=0x7ff648004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:47.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.378+0000 7ff646ffd700 1 -- 172.21.15.72:0/1533778566 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff648012430 con 0x7ff6501475a0 2023-07-27T20:34:47.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.378+0000 7ff646ffd700 1 -- 172.21.15.72:0/1533778566 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff648020070 con 0x7ff6501475a0 2023-07-27T20:34:47.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.378+0000 7ff646ffd700 1 -- 172.21.15.72:0/1533778566 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff648003ea0 con 0x7ff6501475a0 2023-07-27T20:34:47.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.378+0000 7ff6587ff700 1 -- 172.21.15.72:0/1533778566 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6501e9e80 con 0x7ff6501475a0 2023-07-27T20:34:47.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.378+0000 7ff6587ff700 1 -- 172.21.15.72:0/1533778566 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6500bbcf0 con 0x7ff6501475a0 2023-07-27T20:34:47.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.379+0000 7ff6587ff700 1 -- 172.21.15.72:0/1533778566 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6501ea3a0 con 0x7ff6501475a0 2023-07-27T20:34:47.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.380+0000 7ff646ffd700 1 -- 172.21.15.72:0/1533778566 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff648004280 con 0x7ff6501475a0 2023-07-27T20:34:47.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.381+0000 7ff646ffd700 1 --2- 172.21.15.72:0/1533778566 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff63406ace0 0x7ff63406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:47.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.381+0000 7ff646ffd700 1 -- 172.21.15.72:0/1533778566 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff648022070 con 0x7ff6501475a0 2023-07-27T20:34:47.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.381+0000 7ff65659b700 1 --2- 172.21.15.72:0/1533778566 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff63406ace0 0x7ff63406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:47.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.382+0000 7ff65659b700 1 --2- 172.21.15.72:0/1533778566 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff63406ace0 0x7ff63406d1a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff64c007a50 tx=0x7ff64c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:47.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.385+0000 7ff646ffd700 1 -- 172.21.15.72:0/1533778566 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff6480562c0 con 0x7ff6501475a0 2023-07-27T20:34:47.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.577+0000 7ff6587ff700 1 -- 172.21.15.72:0/1533778566 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff6500c2390 con 0x7ff6501475a0 2023-07-27T20:34:47.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.577+0000 7ff646ffd700 1 -- 172.21.15.72:0/1533778566 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v62) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff6480598e0 con 0x7ff6501475a0 2023-07-27T20:34:47.565 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:34:47.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.580+0000 7ff6587ff700 1 -- 172.21.15.72:0/1533778566 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff63406ace0 msgr2=0x7ff63406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:47.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.580+0000 7ff6587ff700 1 --2- 172.21.15.72:0/1533778566 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff63406ace0 0x7ff63406d1a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff64c007a50 tx=0x7ff64c008040 comp rx=0 tx=0).stop 2023-07-27T20:34:47.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.580+0000 7ff6587ff700 1 -- 172.21.15.72:0/1533778566 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6501475a0 msgr2=0x7ff6501db2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:47.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.580+0000 7ff6587ff700 1 --2- 172.21.15.72:0/1533778566 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6501475a0 0x7ff6501db2f0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7ff648014040 tx=0x7ff648004ad0 comp rx=0 tx=0).stop 2023-07-27T20:34:47.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.580+0000 7ff6587ff700 1 -- 172.21.15.72:0/1533778566 shutdown_connections 2023-07-27T20:34:47.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.580+0000 7ff6587ff700 1 --2- 172.21.15.72:0/1533778566 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6501475a0 0x7ff6501db2f0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:47.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.580+0000 7ff6587ff700 1 --2- 172.21.15.72:0/1533778566 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ff63406ace0 0x7ff63406d1a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:47.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.580+0000 7ff6587ff700 1 --2- 172.21.15.72:0/1533778566 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6500716f0 0x7ff6500bb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:47.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.580+0000 7ff6587ff700 1 --2- 172.21.15.72:0/1533778566 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6500c12f0 0x7ff65013e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:47.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.580+0000 7ff6587ff700 1 -- 172.21.15.72:0/1533778566 >> 172.21.15.72:0/1533778566 conn(0x7ff65006a190 msgr2=0x7ff65006ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:47.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.580+0000 7ff6587ff700 1 -- 172.21.15.72:0/1533778566 shutdown_connections 2023-07-27T20:34:47.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.580+0000 7ff6587ff700 1 -- 172.21.15.72:0/1533778566 wait complete. 2023-07-27T20:34:47.585 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T20:34:47.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.795+0000 7f3d3a3ff700 1 Processor -- start 2023-07-27T20:34:47.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.795+0000 7f3d3a3ff700 1 -- start start 2023-07-27T20:34:47.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.796+0000 7f3d3a3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3d3413b150 0x7f3d34151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:47.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.796+0000 7f3d3a3ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3d3406d5d0 0x7f3d3406da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:47.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.797+0000 7f3d3a3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d3406ce10 con 0x7f3d3406e140 2023-07-27T20:34:47.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.797+0000 7f3d3a3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d3406df40 con 0x7f3d3413b150 2023-07-27T20:34:47.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.797+0000 7f3d3a3ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d34152680 con 0x7f3d3406d5d0 2023-07-27T20:34:47.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.797+0000 7f3d33fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3d3413b150 0x7f3d34151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:47.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.797+0000 7f3d337fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3d3406e140 0x7f3d340ba310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:44784/0 (socket says 172.21.15.72:44784) 2023-07-27T20:34:47.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.797+0000 7f3d337fe700 1 -- 172.21.15.72:0/2286301924 learned_addr learned my addr 172.21.15.72:0/2286301924 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:47.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.797+0000 7f3d3899c700 1 --2- 172.21.15.72:0/2286301924 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3d3406d5d0 0x7f3d3406da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:47.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.797+0000 7f3d33fff700 1 -- 172.21.15.72:0/2286301924 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3d3406d5d0 msgr2=0x7f3d3406da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:47.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.797+0000 7f3d33fff700 1 --2- 172.21.15.72:0/2286301924 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3d3406d5d0 0x7f3d3406da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:47.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.797+0000 7f3d33fff700 1 -- 172.21.15.72:0/2286301924 >> v1:172.21.15.72:6789/0 conn(0x7f3d3406e140 legacy=0x7f3d340ba310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:47.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.797+0000 7f3d33fff700 1 -- 172.21.15.72:0/2286301924 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d34152960 con 0x7f3d3413b150 2023-07-27T20:34:47.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.797+0000 7f3d32ffd700 1 -- 172.21.15.72:0/2286301924 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 210122918 0 0) 0x7f3d3406ce10 con 0x7f3d3406e140 2023-07-27T20:34:47.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.797+0000 7f3d3899c700 1 --2- 172.21.15.72:0/2286301924 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3d3406d5d0 0x7f3d3406da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:47.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.798+0000 7f3d33fff700 1 --2- 172.21.15.72:0/2286301924 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d3413b150 0x7f3d34151dc0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f3d24009840 tx=0x7f3d24009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb03f9eb981d7a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:47.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.798+0000 7f3d32ffd700 1 -- 172.21.15.72:0/2286301924 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d24011830 con 0x7f3d3413b150 2023-07-27T20:34:47.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.798+0000 7f3d32ffd700 1 -- 172.21.15.72:0/2286301924 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d24011990 con 0x7f3d3413b150 2023-07-27T20:34:47.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.798+0000 7f3d32ffd700 1 -- 172.21.15.72:0/2286301924 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d24011d20 con 0x7f3d3413b150 2023-07-27T20:34:47.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.798+0000 7f3d3a3ff700 1 -- 172.21.15.72:0/2286301924 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d3413b150 msgr2=0x7f3d34151dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:47.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.798+0000 7f3d3a3ff700 1 --2- 172.21.15.72:0/2286301924 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d3413b150 0x7f3d34151dc0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f3d24009840 tx=0x7f3d24009b50 comp rx=0 tx=0).stop 2023-07-27T20:34:47.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.798+0000 7f3d3a3ff700 1 -- 172.21.15.72:0/2286301924 shutdown_connections 2023-07-27T20:34:47.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.798+0000 7f3d3a3ff700 1 --2- 172.21.15.72:0/2286301924 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3d3406d5d0 0x7f3d3406da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:47.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.798+0000 7f3d3a3ff700 1 --2- 172.21.15.72:0/2286301924 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d3413b150 0x7f3d34151dc0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:47.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.798+0000 7f3d3a3ff700 1 -- 172.21.15.72:0/2286301924 >> 172.21.15.72:0/2286301924 conn(0x7f3d3406a190 msgr2=0x7f3d3406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:47.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.799+0000 7f3d3a3ff700 1 -- 172.21.15.72:0/2286301924 shutdown_connections 2023-07-27T20:34:47.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.799+0000 7f3d3a3ff700 1 -- 172.21.15.72:0/2286301924 wait complete. 2023-07-27T20:34:47.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.801+0000 7f3d3a3ff700 1 Processor -- start 2023-07-27T20:34:47.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.801+0000 7f3d3a3ff700 1 -- start start 2023-07-27T20:34:47.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.802+0000 7f3d3a3ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3d3406d5d0 0x7f3d341e9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:47.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.802+0000 7f3d3a3ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d3406e140 0x7f3d3414e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:47.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.802+0000 7f3d3a3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d3413b150 0x7f3d340c3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:47.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.802+0000 7f3d3a3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d341ec900 con 0x7f3d3413b150 2023-07-27T20:34:47.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.802+0000 7f3d3a3ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d341e9af0 con 0x7f3d3406e140 2023-07-27T20:34:47.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.802+0000 7f3d3a3ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d340c3610 con 0x7f3d3406d5d0 2023-07-27T20:34:47.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.802+0000 7f3d3899c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d3413b150 0x7f3d340c3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:47.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.802+0000 7f3d3899c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d3413b150 0x7f3d340c3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58134/0 (socket says 172.21.15.72:58134) 2023-07-27T20:34:47.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.802+0000 7f3d3899c700 1 -- 172.21.15.72:0/779732309 learned_addr learned my addr 172.21.15.72:0/779732309 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:47.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.803+0000 7f3d33fff700 1 --2- 172.21.15.72:0/779732309 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3d3406d5d0 0x7f3d341e9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:47.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.803+0000 7f3d337fe700 1 --2- 172.21.15.72:0/779732309 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d3406e140 0x7f3d3414e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:47.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.803+0000 7f3d3899c700 1 -- 172.21.15.72:0/779732309 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3d3406d5d0 msgr2=0x7f3d341e9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:47.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.803+0000 7f3d3899c700 1 --2- 172.21.15.72:0/779732309 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3d3406d5d0 0x7f3d341e9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:47.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.803+0000 7f3d3899c700 1 -- 172.21.15.72:0/779732309 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d3406e140 msgr2=0x7f3d3414e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:47.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.803+0000 7f3d3899c700 1 --2- 172.21.15.72:0/779732309 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d3406e140 0x7f3d3414e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:47.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.803+0000 7f3d3899c700 1 -- 172.21.15.72:0/779732309 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d240094a0 con 0x7f3d3413b150 2023-07-27T20:34:47.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.803+0000 7f3d337fe700 1 --2- 172.21.15.72:0/779732309 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d3406e140 0x7f3d3414e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:47.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.803+0000 7f3d3899c700 1 --2- 172.21.15.72:0/779732309 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d3413b150 0x7f3d340c3ca0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c00cd50 tx=0x7f3d2c00a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:47.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.803+0000 7f3d30ff9700 1 -- 172.21.15.72:0/779732309 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c00cea0 con 0x7f3d3413b150 2023-07-27T20:34:47.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.803+0000 7f3d30ff9700 1 -- 172.21.15.72:0/779732309 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2c00f480 con 0x7f3d3413b150 2023-07-27T20:34:47.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.803+0000 7f3d3a3ff700 1 -- 172.21.15.72:0/779732309 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d341e94a0 con 0x7f3d3413b150 2023-07-27T20:34:47.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.803+0000 7f3d30ff9700 1 -- 172.21.15.72:0/779732309 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c00f810 con 0x7f3d3413b150 2023-07-27T20:34:47.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.804+0000 7f3d3a3ff700 1 -- 172.21.15.72:0/779732309 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d3414eec0 con 0x7f3d3413b150 2023-07-27T20:34:47.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.805+0000 7f3d3a3ff700 1 -- 172.21.15.72:0/779732309 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d341e9ca0 con 0x7f3d3413b150 2023-07-27T20:34:47.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.806+0000 7f3d30ff9700 1 -- 172.21.15.72:0/779732309 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3d2c00b040 con 0x7f3d3413b150 2023-07-27T20:34:47.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.806+0000 7f3d30ff9700 1 --2- 172.21.15.72:0/779732309 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3d2006ace0 0x7f3d2006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:47.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.807+0000 7f3d30ff9700 1 -- 172.21.15.72:0/779732309 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3d2c089cb0 con 0x7f3d3413b150 2023-07-27T20:34:47.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.807+0000 7f3d33fff700 1 --2- 172.21.15.72:0/779732309 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3d2006ace0 0x7f3d2006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:47.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.808+0000 7f3d33fff700 1 --2- 172.21.15.72:0/779732309 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3d2006ace0 0x7f3d2006d1a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3d240090b0 tx=0x7f3d24008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:47.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:47.811+0000 7f3d30ff9700 1 -- 172.21.15.72:0/779732309 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3d341e9ca0 con 0x7f3d3413b150 2023-07-27T20:34:47.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.003+0000 7f3d3a3ff700 1 -- 172.21.15.72:0/779732309 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3d341e9c60 con 0x7f3d3413b150 2023-07-27T20:34:47.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.003+0000 7f3d30ff9700 1 -- 172.21.15.72:0/779732309 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v62) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3d2c01d0a0 con 0x7f3d3413b150 2023-07-27T20:34:47.991 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-27T20:34:47.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.006+0000 7f3d3a3ff700 1 -- 172.21.15.72:0/779732309 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3d2006ace0 msgr2=0x7f3d2006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:47.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.006+0000 7f3d3a3ff700 1 --2- 172.21.15.72:0/779732309 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3d2006ace0 0x7f3d2006d1a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3d240090b0 tx=0x7f3d24008030 comp rx=0 tx=0).stop 2023-07-27T20:34:47.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.006+0000 7f3d3a3ff700 1 -- 172.21.15.72:0/779732309 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d3413b150 msgr2=0x7f3d340c3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:47.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.006+0000 7f3d3a3ff700 1 --2- 172.21.15.72:0/779732309 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d3413b150 0x7f3d340c3ca0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c00cd50 tx=0x7f3d2c00a560 comp rx=0 tx=0).stop 2023-07-27T20:34:47.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.006+0000 7f3d3a3ff700 1 -- 172.21.15.72:0/779732309 shutdown_connections 2023-07-27T20:34:47.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.006+0000 7f3d3a3ff700 1 --2- 172.21.15.72:0/779732309 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d3413b150 0x7f3d340c3ca0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:47.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.006+0000 7f3d3a3ff700 1 --2- 172.21.15.72:0/779732309 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3d2006ace0 0x7f3d2006d1a0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:47.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.006+0000 7f3d3a3ff700 1 --2- 172.21.15.72:0/779732309 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3d3406d5d0 0x7f3d341e9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:47.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.006+0000 7f3d3a3ff700 1 --2- 172.21.15.72:0/779732309 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d3406e140 0x7f3d3414e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:47.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.006+0000 7f3d3a3ff700 1 -- 172.21.15.72:0/779732309 >> 172.21.15.72:0/779732309 conn(0x7f3d3406a190 msgr2=0x7f3d34150840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:47.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.006+0000 7f3d3a3ff700 1 -- 172.21.15.72:0/779732309 shutdown_connections 2023-07-27T20:34:47.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.006+0000 7f3d3a3ff700 1 -- 172.21.15.72:0/779732309 wait complete. 2023-07-27T20:34:48.011 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-27T20:34:48.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.219+0000 7f05a6dff700 1 Processor -- start 2023-07-27T20:34:48.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.219+0000 7f05a6dff700 1 -- start start 2023-07-27T20:34:48.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.220+0000 7f05a6dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f05a00c4400 0x7f05a00c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:48.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.220+0000 7f05a6dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05a006b150 0x7f05a00c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:48.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.220+0000 7f05a6dff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f05a01549f0 0x7f05a01514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:48.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.220+0000 7f05a6dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05a01545d0 con 0x7f05a00c4400 2023-07-27T20:34:48.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.220+0000 7f05a6dff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05a006c860 con 0x7f05a01549f0 2023-07-27T20:34:48.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.220+0000 7f05a6dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05a00c5230 con 0x7f05a006b150 2023-07-27T20:34:48.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.221+0000 7f05a4b9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f05a00c4400 0x7f05a00c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:48.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.221+0000 7f05a4b9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f05a00c4400 0x7f05a00c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58140/0 (socket says 172.21.15.72:58140) 2023-07-27T20:34:48.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.221+0000 7f05a4b9b700 1 -- 172.21.15.72:0/2214797410 learned_addr learned my addr 172.21.15.72:0/2214797410 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:48.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.221+0000 7f059ffff700 1 --2- 172.21.15.72:0/2214797410 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05a006b150 0x7f05a00c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:48.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.221+0000 7f05a539c700 1 --2- 172.21.15.72:0/2214797410 >> v2:172.21.15.173:3300/0 conn(0x7f05a01549f0 0x7f05a01514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:48.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.221+0000 7f05a4b9b700 1 -- 172.21.15.72:0/2214797410 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05a006b150 msgr2=0x7f05a00c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:48.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.221+0000 7f05a4b9b700 1 --2- 172.21.15.72:0/2214797410 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05a006b150 0x7f05a00c4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:48.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.221+0000 7f05a4b9b700 1 -- 172.21.15.72:0/2214797410 >> v2:172.21.15.173:3300/0 conn(0x7f05a01549f0 msgr2=0x7f05a01514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:48.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.221+0000 7f05a4b9b700 1 --2- 172.21.15.72:0/2214797410 >> v2:172.21.15.173:3300/0 conn(0x7f05a01549f0 0x7f05a01514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:48.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.221+0000 7f05a4b9b700 1 -- 172.21.15.72:0/2214797410 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a006b710 con 0x7f05a00c4400 2023-07-27T20:34:48.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.221+0000 7f05a4b9b700 1 --2- 172.21.15.72:0/2214797410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05a00c4400 0x7f05a00c7710 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f05a00c3df0 tx=0x7f0594009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=140ecdbd5f8fc781 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:48.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.222+0000 7f059f7fe700 1 -- 172.21.15.72:0/2214797410 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059400b870 con 0x7f05a00c4400 2023-07-27T20:34:48.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.222+0000 7f059f7fe700 1 -- 172.21.15.72:0/2214797410 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f059400b9d0 con 0x7f05a00c4400 2023-07-27T20:34:48.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.222+0000 7f059f7fe700 1 -- 172.21.15.72:0/2214797410 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059400bd60 con 0x7f05a00c4400 2023-07-27T20:34:48.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.222+0000 7f05a6dff700 1 -- 172.21.15.72:0/2214797410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05a00c4400 msgr2=0x7f05a00c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:48.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.222+0000 7f05a6dff700 1 --2- 172.21.15.72:0/2214797410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05a00c4400 0x7f05a00c7710 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f05a00c3df0 tx=0x7f0594009bd0 comp rx=0 tx=0).stop 2023-07-27T20:34:48.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.222+0000 7f05a6dff700 1 -- 172.21.15.72:0/2214797410 shutdown_connections 2023-07-27T20:34:48.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.222+0000 7f05a6dff700 1 --2- 172.21.15.72:0/2214797410 >> v2:172.21.15.173:3300/0 conn(0x7f05a01549f0 0x7f05a01514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:48.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.222+0000 7f05a6dff700 1 --2- 172.21.15.72:0/2214797410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05a00c4400 0x7f05a00c7710 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:48.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.222+0000 7f05a6dff700 1 --2- 172.21.15.72:0/2214797410 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05a006b150 0x7f05a00c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:48.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.222+0000 7f05a6dff700 1 -- 172.21.15.72:0/2214797410 >> 172.21.15.72:0/2214797410 conn(0x7f05a00ab300 msgr2=0x7f05a00ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:48.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.222+0000 7f05a6dff700 1 -- 172.21.15.72:0/2214797410 shutdown_connections 2023-07-27T20:34:48.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.222+0000 7f05a6dff700 1 -- 172.21.15.72:0/2214797410 wait complete. 2023-07-27T20:34:48.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.224+0000 7f05a6dff700 1 Processor -- start 2023-07-27T20:34:48.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.224+0000 7f05a6dff700 1 -- start start 2023-07-27T20:34:48.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.225+0000 7f05a6dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05a006b150 0x7f05a00af000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:48.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.225+0000 7f05a6dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05a00c4400 0x7f05a014f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:48.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.225+0000 7f05a6dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05a01549f0 0x7f05a014b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:48.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.225+0000 7f05a6dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a01eca90 con 0x7f05a01549f0 2023-07-27T20:34:48.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.225+0000 7f05a6dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a01ecca0 con 0x7f05a006b150 2023-07-27T20:34:48.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.225+0000 7f05a6dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05a01ecf80 con 0x7f05a00c4400 2023-07-27T20:34:48.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.225+0000 7f05a539c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05a01549f0 0x7f05a014b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:48.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.225+0000 7f05a539c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05a01549f0 0x7f05a014b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58154/0 (socket says 172.21.15.72:58154) 2023-07-27T20:34:48.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.225+0000 7f05a539c700 1 -- 172.21.15.72:0/50942360 learned_addr learned my addr 172.21.15.72:0/50942360 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:48.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.226+0000 7f059ffff700 1 --2- 172.21.15.72:0/50942360 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05a00c4400 0x7f05a014f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:48.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.226+0000 7f05a4b9b700 1 --2- 172.21.15.72:0/50942360 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05a006b150 0x7f05a00af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:48.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.226+0000 7f05a539c700 1 -- 172.21.15.72:0/50942360 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05a00c4400 msgr2=0x7f05a014f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:48.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.226+0000 7f05a539c700 1 --2- 172.21.15.72:0/50942360 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05a00c4400 0x7f05a014f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:48.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.226+0000 7f05a539c700 1 -- 172.21.15.72:0/50942360 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05a006b150 msgr2=0x7f05a00af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:48.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.226+0000 7f05a539c700 1 --2- 172.21.15.72:0/50942360 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05a006b150 0x7f05a00af000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:48.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.226+0000 7f05a539c700 1 -- 172.21.15.72:0/50942360 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0594009550 con 0x7f05a01549f0 2023-07-27T20:34:48.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.226+0000 7f05a539c700 1 --2- 172.21.15.72:0/50942360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05a01549f0 0x7f05a014b9b0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f0598007e60 tx=0x7f059800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:48.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.226+0000 7f059d7fa700 1 -- 172.21.15.72:0/50942360 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059800ede0 con 0x7f05a01549f0 2023-07-27T20:34:48.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.226+0000 7f059d7fa700 1 -- 172.21.15.72:0/50942360 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0598014420 con 0x7f05a01549f0 2023-07-27T20:34:48.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.226+0000 7f059d7fa700 1 -- 172.21.15.72:0/50942360 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05980147d0 con 0x7f05a01549f0 2023-07-27T20:34:48.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.226+0000 7f05a6dff700 1 -- 172.21.15.72:0/50942360 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05a01ed260 con 0x7f05a01549f0 2023-07-27T20:34:48.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.226+0000 7f05a6dff700 1 -- 172.21.15.72:0/50942360 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05a014fa20 con 0x7f05a01549f0 2023-07-27T20:34:48.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.227+0000 7f05a6dff700 1 -- 172.21.15.72:0/50942360 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05a01ed780 con 0x7f05a01549f0 2023-07-27T20:34:48.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.228+0000 7f059d7fa700 1 -- 172.21.15.72:0/50942360 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0598014930 con 0x7f05a01549f0 2023-07-27T20:34:48.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.229+0000 7f059d7fa700 1 --2- 172.21.15.72:0/50942360 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f058406ace0 0x7f058406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:48.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.229+0000 7f059d7fa700 1 -- 172.21.15.72:0/50942360 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0598089db0 con 0x7f05a01549f0 2023-07-27T20:34:48.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.230+0000 7f05a4b9b700 1 --2- 172.21.15.72:0/50942360 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f058406ace0 0x7f058406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:48.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.231+0000 7f05a4b9b700 1 --2- 172.21.15.72:0/50942360 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f058406ace0 0x7f058406d1a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0594000c00 tx=0x7f0594008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:48.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.233+0000 7f059d7fa700 1 -- 172.21.15.72:0/50942360 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f05a01ed780 con 0x7f05a01549f0 2023-07-27T20:34:48.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.430+0000 7f05a6dff700 1 -- 172.21.15.72:0/50942360 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f05a01ed780 con 0x7f05a01549f0 2023-07-27T20:34:48.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.430+0000 7f059d7fa700 1 -- 172.21.15.72:0/50942360 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v62) v1 ==== 84+0+270 (secure 0 0 0) 0x7f05a01ed780 con 0x7f05a01549f0 2023-07-27T20:34:48.418 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:34:48.418 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2023-07-27T20:34:48.418 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:34:48.419 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 1, 2023-07-27T20:34:48.419 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": ".mgr" 2023-07-27T20:34:48.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:34:48.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:34:48.419 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 2, 2023-07-27T20:34:48.419 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "rbd" 2023-07-27T20:34:48.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:34:48.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:34:48.420 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 10, 2023-07-27T20:34:48.420 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "cephfs_metadata" 2023-07-27T20:34:48.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-27T20:34:48.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-27T20:34:48.421 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 11, 2023-07-27T20:34:48.421 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "cephfs_data" 2023-07-27T20:34:48.421 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-27T20:34:48.421 INFO:teuthology.orchestra.run.smithi072.stdout:] 2023-07-27T20:34:48.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.433+0000 7f05a6dff700 1 -- 172.21.15.72:0/50942360 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f058406ace0 msgr2=0x7f058406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:48.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.433+0000 7f05a6dff700 1 --2- 172.21.15.72:0/50942360 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f058406ace0 0x7f058406d1a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0594000c00 tx=0x7f0594008030 comp rx=0 tx=0).stop 2023-07-27T20:34:48.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.433+0000 7f05a6dff700 1 -- 172.21.15.72:0/50942360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05a01549f0 msgr2=0x7f05a014b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:48.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.433+0000 7f05a6dff700 1 --2- 172.21.15.72:0/50942360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05a01549f0 0x7f05a014b9b0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f0598007e60 tx=0x7f059800e3c0 comp rx=0 tx=0).stop 2023-07-27T20:34:48.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.433+0000 7f05a6dff700 1 -- 172.21.15.72:0/50942360 shutdown_connections 2023-07-27T20:34:48.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.433+0000 7f05a6dff700 1 --2- 172.21.15.72:0/50942360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05a01549f0 0x7f05a014b9b0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:48.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.433+0000 7f05a6dff700 1 --2- 172.21.15.72:0/50942360 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05a006b150 0x7f05a00af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:48.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.433+0000 7f05a6dff700 1 --2- 172.21.15.72:0/50942360 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f058406ace0 0x7f058406d1a0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:48.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.433+0000 7f05a6dff700 1 --2- 172.21.15.72:0/50942360 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05a00c4400 0x7f05a014f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:48.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.433+0000 7f05a6dff700 1 -- 172.21.15.72:0/50942360 >> 172.21.15.72:0/50942360 conn(0x7f05a00ab300 msgr2=0x7f05a0151610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:48.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.433+0000 7f05a6dff700 1 -- 172.21.15.72:0/50942360 shutdown_connections 2023-07-27T20:34:48.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.433+0000 7f05a6dff700 1 -- 172.21.15.72:0/50942360 wait complete. 2023-07-27T20:34:48.438 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-07-27T20:34:48.438 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-07-27T20:34:48.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.651+0000 7f77091ff700 1 Processor -- start 2023-07-27T20:34:48.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.651+0000 7f77091ff700 1 -- start start 2023-07-27T20:34:48.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.652+0000 7f77091ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f770406a400 0x7f770414f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:48.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.652+0000 7f77091ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f77040c17d0 0x7f770414f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:48.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.652+0000 7f77091ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7704152f30 con 0x7f77040a8d90 2023-07-27T20:34:48.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.652+0000 7f77091ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7704151fa0 con 0x7f77040c17d0 2023-07-27T20:34:48.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.652+0000 7f77091ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77041521b0 con 0x7f770406a400 2023-07-27T20:34:48.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.653+0000 7f770259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f77040c17d0 0x7f770414f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:48.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.653+0000 7f770259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f77040c17d0 0x7f770414f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58170/0 (socket says 172.21.15.72:58170) 2023-07-27T20:34:48.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.653+0000 7f770259c700 1 -- 172.21.15.72:0/1468446510 learned_addr learned my addr 172.21.15.72:0/1468446510 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:48.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.653+0000 7f770359e700 1 --1- 172.21.15.72:0/1468446510 >> v1:172.21.15.72:6789/0 conn(0x7f77040a8d90 0x7f770406cf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:44790/0 (socket says 172.21.15.72:44790) 2023-07-27T20:34:48.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.653+0000 7f7702d9d700 1 --2- 172.21.15.72:0/1468446510 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f770406a400 0x7f770414f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:48.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.653+0000 7f770259c700 1 -- 172.21.15.72:0/1468446510 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f770406a400 msgr2=0x7f770414f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:48.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.653+0000 7f770259c700 1 --2- 172.21.15.72:0/1468446510 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f770406a400 0x7f770414f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:48.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.653+0000 7f770259c700 1 -- 172.21.15.72:0/1468446510 >> v1:172.21.15.72:6789/0 conn(0x7f77040a8d90 legacy=0x7f770406cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:48.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.653+0000 7f770259c700 1 -- 172.21.15.72:0/1468446510 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77040a9350 con 0x7f77040c17d0 2023-07-27T20:34:48.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.653+0000 7f7701d9b700 1 -- 172.21.15.72:0/1468446510 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 321783156 0 0) 0x7f76fc001490 con 0x7f77040a8d90 2023-07-27T20:34:48.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.653+0000 7f770259c700 1 --2- 172.21.15.72:0/1468446510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77040c17d0 0x7f770414f8a0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f76f80098f0 tx=0x7f76f8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2c1025a500276be server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:48.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.653+0000 7f7701d9b700 1 -- 172.21.15.72:0/1468446510 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f8011830 con 0x7f77040c17d0 2023-07-27T20:34:48.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.654+0000 7f7701d9b700 1 -- 172.21.15.72:0/1468446510 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f8011990 con 0x7f77040c17d0 2023-07-27T20:34:48.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.654+0000 7f7701d9b700 1 -- 172.21.15.72:0/1468446510 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f8011d20 con 0x7f77040c17d0 2023-07-27T20:34:48.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.654+0000 7f77091ff700 1 -- 172.21.15.72:0/1468446510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77040c17d0 msgr2=0x7f770414f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:48.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.654+0000 7f77091ff700 1 --2- 172.21.15.72:0/1468446510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77040c17d0 0x7f770414f8a0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f76f80098f0 tx=0x7f76f8009c00 comp rx=0 tx=0).stop 2023-07-27T20:34:48.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.654+0000 7f77091ff700 1 -- 172.21.15.72:0/1468446510 shutdown_connections 2023-07-27T20:34:48.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.654+0000 7f77091ff700 1 --2- 172.21.15.72:0/1468446510 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f770406a400 0x7f770414f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:48.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.654+0000 7f77091ff700 1 --2- 172.21.15.72:0/1468446510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77040c17d0 0x7f770414f8a0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:48.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.654+0000 7f77091ff700 1 -- 172.21.15.72:0/1468446510 >> 172.21.15.72:0/1468446510 conn(0x7f77040c53e0 msgr2=0x7f77040c57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:48.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.654+0000 7f77091ff700 1 -- 172.21.15.72:0/1468446510 shutdown_connections 2023-07-27T20:34:48.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.654+0000 7f77091ff700 1 -- 172.21.15.72:0/1468446510 wait complete. 2023-07-27T20:34:48.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.656+0000 7f77091ff700 1 Processor -- start 2023-07-27T20:34:48.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.656+0000 7f77091ff700 1 -- start start 2023-07-27T20:34:48.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.657+0000 7f77091ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f770406a400 0x7f7704146d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:48.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.657+0000 7f77091ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77040a8d90 0x7f77041de0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:48.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.657+0000 7f77091ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77040c17d0 0x7f77041dc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:48.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.657+0000 7f77091ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77041ea040 con 0x7f770406a400 2023-07-27T20:34:48.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.657+0000 7f77091ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7704151c60 con 0x7f77040c17d0 2023-07-27T20:34:48.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.657+0000 7f77091ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77041e99f0 con 0x7f77040a8d90 2023-07-27T20:34:48.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.657+0000 7f7702d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f770406a400 0x7f7704146d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:48.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.657+0000 7f7702d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f770406a400 0x7f7704146d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58172/0 (socket says 172.21.15.72:58172) 2023-07-27T20:34:48.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.657+0000 7f7702d9d700 1 -- 172.21.15.72:0/3728563281 learned_addr learned my addr 172.21.15.72:0/3728563281 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:48.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.657+0000 7f770359e700 1 --2- 172.21.15.72:0/3728563281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77040c17d0 0x7f77041dc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:48.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.657+0000 7f770259c700 1 --2- 172.21.15.72:0/3728563281 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77040a8d90 0x7f77041de0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:48.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.657+0000 7f7702d9d700 1 -- 172.21.15.72:0/3728563281 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77040a8d90 msgr2=0x7f77041de0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:48.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.657+0000 7f7702d9d700 1 --2- 172.21.15.72:0/3728563281 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77040a8d90 0x7f77041de0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:48.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.657+0000 7f7702d9d700 1 -- 172.21.15.72:0/3728563281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77040c17d0 msgr2=0x7f77041dc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:48.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.657+0000 7f7702d9d700 1 --2- 172.21.15.72:0/3728563281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77040c17d0 0x7f77041dc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:48.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.658+0000 7f7702d9d700 1 -- 172.21.15.72:0/3728563281 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f8009550 con 0x7f770406a400 2023-07-27T20:34:48.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.658+0000 7f770359e700 1 --2- 172.21.15.72:0/3728563281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77040c17d0 0x7f77041dc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:48.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.658+0000 7f770259c700 1 --2- 172.21.15.72:0/3728563281 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77040a8d90 0x7f77041de0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:48.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.658+0000 7f7702d9d700 1 --2- 172.21.15.72:0/3728563281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f770406a400 0x7f7704146d10 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f76f400e9d0 tx=0x7f76f400ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:48.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.658+0000 7f76eb7fe700 1 -- 172.21.15.72:0/3728563281 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f4009730 con 0x7f770406a400 2023-07-27T20:34:48.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.658+0000 7f76eb7fe700 1 -- 172.21.15.72:0/3728563281 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f400c850 con 0x7f770406a400 2023-07-27T20:34:48.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.658+0000 7f77091ff700 1 -- 172.21.15.72:0/3728563281 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77041e9cd0 con 0x7f770406a400 2023-07-27T20:34:48.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.658+0000 7f76eb7fe700 1 -- 172.21.15.72:0/3728563281 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f400cbe0 con 0x7f770406a400 2023-07-27T20:34:48.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.658+0000 7f77091ff700 1 -- 172.21.15.72:0/3728563281 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77041e96a0 con 0x7f770406a400 2023-07-27T20:34:48.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.659+0000 7f77091ff700 1 -- 172.21.15.72:0/3728563281 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f770404e470 con 0x7f770406a400 2023-07-27T20:34:48.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.660+0000 7f76eb7fe700 1 -- 172.21.15.72:0/3728563281 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f76f400cd40 con 0x7f770406a400 2023-07-27T20:34:48.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.661+0000 7f76eb7fe700 1 --2- 172.21.15.72:0/3728563281 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f76f006ace0 0x7f76f006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:48.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.662+0000 7f76eb7fe700 1 -- 172.21.15.72:0/3728563281 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f76f4089750 con 0x7f770406a400 2023-07-27T20:34:48.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.662+0000 7f770259c700 1 --2- 172.21.15.72:0/3728563281 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f76f006ace0 0x7f76f006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:48.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.663+0000 7f770259c700 1 --2- 172.21.15.72:0/3728563281 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f76f006ace0 0x7f76f006d1a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f76f80098f0 tx=0x7f76f8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:48.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.666+0000 7f76eb7fe700 1 -- 172.21.15.72:0/3728563281 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f76f4058140 con 0x7f770406a400 2023-07-27T20:34:48.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:48.861+0000 7f77091ff700 1 -- 172.21.15.72:0/3728563281 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f770406ab60 con 0x7f770406a400 2023-07-27T20:34:49.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.152+0000 7f76eb7fe700 1 -- 172.21.15.72:0/3728563281 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v63) v1 ==== 140+0+0 (secure 0 0 0) 0x7f76f4057cd0 con 0x7f770406a400 2023-07-27T20:34:49.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.157+0000 7f77091ff700 1 -- 172.21.15.72:0/3728563281 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f76f006ace0 msgr2=0x7f76f006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:49.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.157+0000 7f77091ff700 1 --2- 172.21.15.72:0/3728563281 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f76f006ace0 0x7f76f006d1a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f76f80098f0 tx=0x7f76f8008030 comp rx=0 tx=0).stop 2023-07-27T20:34:49.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.157+0000 7f77091ff700 1 -- 172.21.15.72:0/3728563281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f770406a400 msgr2=0x7f7704146d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:49.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.157+0000 7f77091ff700 1 --2- 172.21.15.72:0/3728563281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f770406a400 0x7f7704146d10 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f76f400e9d0 tx=0x7f76f400ed90 comp rx=0 tx=0).stop 2023-07-27T20:34:49.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.158+0000 7f77091ff700 1 -- 172.21.15.72:0/3728563281 shutdown_connections 2023-07-27T20:34:49.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.158+0000 7f77091ff700 1 --2- 172.21.15.72:0/3728563281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77040c17d0 0x7f77041dc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:49.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.158+0000 7f77091ff700 1 --2- 172.21.15.72:0/3728563281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f770406a400 0x7f7704146d10 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:49.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.158+0000 7f77091ff700 1 --2- 172.21.15.72:0/3728563281 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f76f006ace0 0x7f76f006d1a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:49.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.158+0000 7f77091ff700 1 --2- 172.21.15.72:0/3728563281 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77040a8d90 0x7f77041de0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:49.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.158+0000 7f77091ff700 1 -- 172.21.15.72:0/3728563281 >> 172.21.15.72:0/3728563281 conn(0x7f77040c53e0 msgr2=0x7f7704149150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:49.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.159+0000 7f77091ff700 1 -- 172.21.15.72:0/3728563281 shutdown_connections 2023-07-27T20:34:49.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.159+0000 7f77091ff700 1 -- 172.21.15.72:0/3728563281 wait complete. 2023-07-27T20:34:49.151 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs2_metadata' created 2023-07-27T20:34:49.166 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-27T20:34:49.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.384+0000 7f05b17ff700 1 Processor -- start 2023-07-27T20:34:49.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.384+0000 7f05b17ff700 1 -- start start 2023-07-27T20:34:49.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.386+0000 7f05b17ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f05ac14f680 0x7f05ac0c0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:49.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.386+0000 7f05b17ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f05ac0bff30 0x7f05ac0c0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:49.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.386+0000 7f05b17ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05ac0ab300 0x7f05ac0a8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:49.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.386+0000 7f05b17ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05ac151ec0 con 0x7f05ac0bff30 2023-07-27T20:34:49.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.386+0000 7f05b17ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05ac0aae70 con 0x7f05ac14f680 2023-07-27T20:34:49.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.386+0000 7f05b17ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05ac1520b0 con 0x7f05ac0ab300 2023-07-27T20:34:49.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.386+0000 7f05a3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f05ac0bff30 0x7f05ac0c0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:49.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.386+0000 7f05a3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f05ac0bff30 0x7f05ac0c0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58188/0 (socket says 172.21.15.72:58188) 2023-07-27T20:34:49.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.386+0000 7f05a3fff700 1 -- 172.21.15.72:0/2845224397 learned_addr learned my addr 172.21.15.72:0/2845224397 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:49.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.386+0000 7f05a3fff700 1 -- 172.21.15.72:0/2845224397 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05ac0ab300 msgr2=0x7f05ac0a8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:49.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.386+0000 7f05a3fff700 1 --2- 172.21.15.72:0/2845224397 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05ac0ab300 0x7f05ac0a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:49.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.386+0000 7f05aaffd700 1 --2- 172.21.15.72:0/2845224397 >> v2:172.21.15.173:3300/0 conn(0x7f05ac14f680 0x7f05ac0c0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:49.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.386+0000 7f05a3fff700 1 -- 172.21.15.72:0/2845224397 >> v2:172.21.15.173:3300/0 conn(0x7f05ac14f680 msgr2=0x7f05ac0c0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:49.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.386+0000 7f05a3fff700 1 --2- 172.21.15.72:0/2845224397 >> v2:172.21.15.173:3300/0 conn(0x7f05ac14f680 0x7f05ac0c0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:49.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.386+0000 7f05a3fff700 1 -- 172.21.15.72:0/2845224397 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ac0aa540 con 0x7f05ac0bff30 2023-07-27T20:34:49.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.386+0000 7f05aaffd700 1 --2- 172.21.15.72:0/2845224397 >> v2:172.21.15.173:3300/0 conn(0x7f05ac14f680 0x7f05ac0c0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:49.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.387+0000 7f05a3fff700 1 --2- 172.21.15.72:0/2845224397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05ac0bff30 0x7f05ac0c0b40 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f05ac06b460 tx=0x7f0594009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=305b0e7c92bc9a63 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:49.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.387+0000 7f05aa7fc700 1 -- 172.21.15.72:0/2845224397 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059400b870 con 0x7f05ac0bff30 2023-07-27T20:34:49.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.387+0000 7f05aa7fc700 1 -- 172.21.15.72:0/2845224397 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f059400b9d0 con 0x7f05ac0bff30 2023-07-27T20:34:49.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.387+0000 7f05aa7fc700 1 -- 172.21.15.72:0/2845224397 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059400bd60 con 0x7f05ac0bff30 2023-07-27T20:34:49.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.387+0000 7f05b17ff700 1 -- 172.21.15.72:0/2845224397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05ac0bff30 msgr2=0x7f05ac0c0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:49.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.387+0000 7f05b17ff700 1 --2- 172.21.15.72:0/2845224397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05ac0bff30 0x7f05ac0c0b40 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f05ac06b460 tx=0x7f0594009bd0 comp rx=0 tx=0).stop 2023-07-27T20:34:49.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.387+0000 7f05b17ff700 1 -- 172.21.15.72:0/2845224397 shutdown_connections 2023-07-27T20:34:49.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.387+0000 7f05b17ff700 1 --2- 172.21.15.72:0/2845224397 >> v2:172.21.15.173:3300/0 conn(0x7f05ac14f680 0x7f05ac0c0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:49.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.387+0000 7f05b17ff700 1 --2- 172.21.15.72:0/2845224397 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05ac0ab300 0x7f05ac0a8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:49.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.387+0000 7f05b17ff700 1 --2- 172.21.15.72:0/2845224397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05ac0bff30 0x7f05ac0c0b40 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:49.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.387+0000 7f05b17ff700 1 -- 172.21.15.72:0/2845224397 >> 172.21.15.72:0/2845224397 conn(0x7f05ac0c55b0 msgr2=0x7f05ac0c59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:49.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.388+0000 7f05b17ff700 1 -- 172.21.15.72:0/2845224397 shutdown_connections 2023-07-27T20:34:49.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.388+0000 7f05b17ff700 1 -- 172.21.15.72:0/2845224397 wait complete. 2023-07-27T20:34:49.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.389+0000 7f05b17ff700 1 Processor -- start 2023-07-27T20:34:49.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.389+0000 7f05b17ff700 1 -- start start 2023-07-27T20:34:49.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.390+0000 7f05b17ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05ac0ab300 0x7f05ac1db740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:49.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.390+0000 7f05b17ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05ac0bff30 0x7f05ac14da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:49.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.390+0000 7f05b17ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05ac14f680 0x7f05ac1e9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:49.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.390+0000 7f05b17ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ac0c5250 con 0x7f05ac14f680 2023-07-27T20:34:49.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.390+0000 7f05b17ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ac1dc100 con 0x7f05ac0ab300 2023-07-27T20:34:49.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.390+0000 7f05b17ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05ac071db0 con 0x7f05ac0bff30 2023-07-27T20:34:49.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.390+0000 7f05ab7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05ac14f680 0x7f05ac1e9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:49.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.390+0000 7f05ab7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05ac14f680 0x7f05ac1e9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58196/0 (socket says 172.21.15.72:58196) 2023-07-27T20:34:49.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.390+0000 7f05ab7fe700 1 -- 172.21.15.72:0/3665472155 learned_addr learned my addr 172.21.15.72:0/3665472155 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:49.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.391+0000 7f05a3fff700 1 --2- 172.21.15.72:0/3665472155 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05ac0bff30 0x7f05ac14da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:49.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.391+0000 7f05aaffd700 1 --2- 172.21.15.72:0/3665472155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05ac0ab300 0x7f05ac1db740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:49.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.391+0000 7f05ab7fe700 1 -- 172.21.15.72:0/3665472155 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05ac0bff30 msgr2=0x7f05ac14da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:49.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.391+0000 7f05ab7fe700 1 --2- 172.21.15.72:0/3665472155 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05ac0bff30 0x7f05ac14da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:49.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.391+0000 7f05ab7fe700 1 -- 172.21.15.72:0/3665472155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05ac0ab300 msgr2=0x7f05ac1db740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:49.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.391+0000 7f05ab7fe700 1 --2- 172.21.15.72:0/3665472155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05ac0ab300 0x7f05ac1db740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:49.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.391+0000 7f05ab7fe700 1 -- 172.21.15.72:0/3665472155 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0594009550 con 0x7f05ac14f680 2023-07-27T20:34:49.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.391+0000 7f05ab7fe700 1 --2- 172.21.15.72:0/3665472155 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05ac14f680 0x7f05ac1e9a20 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f05a400b970 tx=0x7f05a400bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:49.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.391+0000 7f05a37fe700 1 -- 172.21.15.72:0/3665472155 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a400c950 con 0x7f05ac14f680 2023-07-27T20:34:49.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.391+0000 7f05a37fe700 1 -- 172.21.15.72:0/3665472155 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a400cad0 con 0x7f05ac14f680 2023-07-27T20:34:49.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.391+0000 7f05a37fe700 1 -- 172.21.15.72:0/3665472155 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a400ce80 con 0x7f05ac14f680 2023-07-27T20:34:49.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.391+0000 7f05b17ff700 1 -- 172.21.15.72:0/3665472155 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05ac1487d0 con 0x7f05ac14f680 2023-07-27T20:34:49.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.392+0000 7f05b17ff700 1 -- 172.21.15.72:0/3665472155 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05ac071fc0 con 0x7f05ac14f680 2023-07-27T20:34:49.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.392+0000 7f05b17ff700 1 -- 172.21.15.72:0/3665472155 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05ac04e470 con 0x7f05ac14f680 2023-07-27T20:34:49.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.394+0000 7f05a37fe700 1 -- 172.21.15.72:0/3665472155 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f05a401d3b0 con 0x7f05ac14f680 2023-07-27T20:34:49.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.395+0000 7f05a37fe700 1 --2- 172.21.15.72:0/3665472155 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f058c06ace0 0x7f058c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:49.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.395+0000 7f05a37fe700 1 -- 172.21.15.72:0/3665472155 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6753+0+0 (secure 0 0 0) 0x7f05a4089970 con 0x7f05ac14f680 2023-07-27T20:34:49.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.395+0000 7f05aaffd700 1 --2- 172.21.15.72:0/3665472155 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f058c06ace0 0x7f058c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:49.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.396+0000 7f05aaffd700 1 --2- 172.21.15.72:0/3665472155 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f058c06ace0 0x7f058c06d1a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f059c006fd0 tx=0x7f059c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:49.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.398+0000 7f05a37fe700 1 -- 172.21.15.72:0/3665472155 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f05a4054740 con 0x7f05ac14f680 2023-07-27T20:34:49.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:49.594+0000 7f05b17ff700 1 -- 172.21.15.72:0/3665472155 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f05ac148510 con 0x7f05ac14f680 2023-07-27T20:34:50.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.165+0000 7f05a37fe700 1 -- 172.21.15.72:0/3665472155 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v64) v1 ==== 172+0+0 (secure 0 0 0) 0x7f05a4057d60 con 0x7f05ac14f680 2023-07-27T20:34:50.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.173+0000 7f05b17ff700 1 -- 172.21.15.72:0/3665472155 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f058c06ace0 msgr2=0x7f058c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:50.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.173+0000 7f05b17ff700 1 --2- 172.21.15.72:0/3665472155 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f058c06ace0 0x7f058c06d1a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f059c006fd0 tx=0x7f059c008040 comp rx=0 tx=0).stop 2023-07-27T20:34:50.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.173+0000 7f05b17ff700 1 -- 172.21.15.72:0/3665472155 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05ac14f680 msgr2=0x7f05ac1e9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:50.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.173+0000 7f05b17ff700 1 --2- 172.21.15.72:0/3665472155 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05ac14f680 0x7f05ac1e9a20 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f05a400b970 tx=0x7f05a400bd30 comp rx=0 tx=0).stop 2023-07-27T20:34:50.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.174+0000 7f05b17ff700 1 -- 172.21.15.72:0/3665472155 shutdown_connections 2023-07-27T20:34:50.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.174+0000 7f05b17ff700 1 --2- 172.21.15.72:0/3665472155 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05ac14f680 0x7f05ac1e9a20 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:50.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.174+0000 7f05b17ff700 1 --2- 172.21.15.72:0/3665472155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05ac0ab300 0x7f05ac1db740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:50.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.174+0000 7f05b17ff700 1 --2- 172.21.15.72:0/3665472155 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f058c06ace0 0x7f058c06d1a0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:50.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.174+0000 7f05b17ff700 1 --2- 172.21.15.72:0/3665472155 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05ac0bff30 0x7f05ac14da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:50.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.174+0000 7f05b17ff700 1 -- 172.21.15.72:0/3665472155 >> 172.21.15.72:0/3665472155 conn(0x7f05ac0c55b0 msgr2=0x7f05ac151240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:50.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.176+0000 7f05b17ff700 1 -- 172.21.15.72:0/3665472155 shutdown_connections 2023-07-27T20:34:50.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.176+0000 7f05b17ff700 1 -- 172.21.15.72:0/3665472155 wait complete. 2023-07-27T20:34:50.174 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs2_data' created 2023-07-27T20:34:50.191 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-07-27T20:34:50.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.405+0000 7fbf247ff700 1 Processor -- start 2023-07-27T20:34:50.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.405+0000 7fbf247ff700 1 -- start start 2023-07-27T20:34:50.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.406+0000 7fbf247ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbf1c1475a0 0x7fbf1c1516c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:50.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.406+0000 7fbf247ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbf1c0716f0 0x7fbf1c071b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:50.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.406+0000 7fbf247ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf1c154f50 con 0x7fbf1c0c12f0 2023-07-27T20:34:50.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.406+0000 7fbf247ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf1c151c00 con 0x7fbf1c0716f0 2023-07-27T20:34:50.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.406+0000 7fbf247ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c154340 con 0x7fbf1c1475a0 2023-07-27T20:34:50.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.407+0000 7fbf22d9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbf1c0716f0 0x7fbf1c071b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:50.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.407+0000 7fbf22d9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbf1c0716f0 0x7fbf1c071b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48250/0 (socket says 172.21.15.72:48250) 2023-07-27T20:34:50.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.407+0000 7fbf22d9c700 1 -- 172.21.15.72:0/2289421011 learned_addr learned my addr 172.21.15.72:0/2289421011 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:50.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.407+0000 7fbf2259b700 1 --2- 172.21.15.72:0/2289421011 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbf1c1475a0 0x7fbf1c1516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:50.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.407+0000 7fbf22d9c700 1 -- 172.21.15.72:0/2289421011 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbf1c1475a0 msgr2=0x7fbf1c1516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:50.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.407+0000 7fbf22d9c700 1 --2- 172.21.15.72:0/2289421011 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbf1c1475a0 0x7fbf1c1516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:50.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.407+0000 7fbf22d9c700 1 -- 172.21.15.72:0/2289421011 >> v1:172.21.15.173:6789/0 conn(0x7fbf1c0c12f0 legacy=0x7fbf1c0c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:50.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.407+0000 7fbf22d9c700 1 -- 172.21.15.72:0/2289421011 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1c154620 con 0x7fbf1c0716f0 2023-07-27T20:34:50.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.407+0000 7fbf22d9c700 1 --2- 172.21.15.72:0/2289421011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf1c0716f0 0x7fbf1c071b60 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fbf14009e50 tx=0x7fbf1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27a4bf31c37644c5 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:50.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.407+0000 7fbf21599700 1 -- 172.21.15.72:0/2289421011 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1400bb10 con 0x7fbf1c0716f0 2023-07-27T20:34:50.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.408+0000 7fbf21599700 1 -- 172.21.15.72:0/2289421011 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf1400bc70 con 0x7fbf1c0716f0 2023-07-27T20:34:50.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.408+0000 7fbf21599700 1 -- 172.21.15.72:0/2289421011 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf14011460 con 0x7fbf1c0716f0 2023-07-27T20:34:50.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.408+0000 7fbf247ff700 1 -- 172.21.15.72:0/2289421011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf1c0716f0 msgr2=0x7fbf1c071b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:50.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.408+0000 7fbf247ff700 1 --2- 172.21.15.72:0/2289421011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf1c0716f0 0x7fbf1c071b60 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fbf14009e50 tx=0x7fbf1400b330 comp rx=0 tx=0).stop 2023-07-27T20:34:50.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.408+0000 7fbf247ff700 1 -- 172.21.15.72:0/2289421011 shutdown_connections 2023-07-27T20:34:50.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.408+0000 7fbf247ff700 1 --2- 172.21.15.72:0/2289421011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf1c0716f0 0x7fbf1c071b60 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:50.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.408+0000 7fbf247ff700 1 --2- 172.21.15.72:0/2289421011 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbf1c1475a0 0x7fbf1c1516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:50.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.408+0000 7fbf247ff700 1 -- 172.21.15.72:0/2289421011 >> 172.21.15.72:0/2289421011 conn(0x7fbf1c06a190 msgr2=0x7fbf1c06a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:50.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.408+0000 7fbf247ff700 1 -- 172.21.15.72:0/2289421011 shutdown_connections 2023-07-27T20:34:50.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.408+0000 7fbf247ff700 1 -- 172.21.15.72:0/2289421011 wait complete. 2023-07-27T20:34:50.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.410+0000 7fbf247ff700 1 Processor -- start 2023-07-27T20:34:50.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.410+0000 7fbf247ff700 1 -- start start 2023-07-27T20:34:50.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.411+0000 7fbf247ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf1c0716f0 0x7fbf1c14f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:50.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.411+0000 7fbf247ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf1c0c12f0 0x7fbf1c153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:50.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.411+0000 7fbf247ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbf1c1475a0 0x7fbf1c1e3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:50.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.411+0000 7fbf247ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c14f970 con 0x7fbf1c0c12f0 2023-07-27T20:34:50.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.411+0000 7fbf247ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c1e6040 con 0x7fbf1c0716f0 2023-07-27T20:34:50.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.411+0000 7fbf247ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c154020 con 0x7fbf1c1475a0 2023-07-27T20:34:50.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.411+0000 7fbf21d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf1c0c12f0 0x7fbf1c153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:50.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.411+0000 7fbf21d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf1c0c12f0 0x7fbf1c153090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48258/0 (socket says 172.21.15.72:48258) 2023-07-27T20:34:50.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.411+0000 7fbf21d9a700 1 -- 172.21.15.72:0/312508419 learned_addr learned my addr 172.21.15.72:0/312508419 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:50.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.411+0000 7fbf2259b700 1 --2- 172.21.15.72:0/312508419 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf1c0716f0 0x7fbf1c14f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:50.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.411+0000 7fbf22d9c700 1 --2- 172.21.15.72:0/312508419 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbf1c1475a0 0x7fbf1c1e3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:50.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.411+0000 7fbf21d9a700 1 -- 172.21.15.72:0/312508419 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbf1c1475a0 msgr2=0x7fbf1c1e3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:50.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.411+0000 7fbf21d9a700 1 --2- 172.21.15.72:0/312508419 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbf1c1475a0 0x7fbf1c1e3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:50.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.411+0000 7fbf21d9a700 1 -- 172.21.15.72:0/312508419 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf1c0716f0 msgr2=0x7fbf1c14f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:50.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.411+0000 7fbf21d9a700 1 --2- 172.21.15.72:0/312508419 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf1c0716f0 0x7fbf1c14f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:50.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.412+0000 7fbf21d9a700 1 -- 172.21.15.72:0/312508419 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf14009b30 con 0x7fbf1c0c12f0 2023-07-27T20:34:50.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.412+0000 7fbf21d9a700 1 --2- 172.21.15.72:0/312508419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf1c0c12f0 0x7fbf1c153090 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c00c4e0 tx=0x7fbf0c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:50.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.412+0000 7fbf12ffd700 1 -- 172.21.15.72:0/312508419 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c0052d0 con 0x7fbf1c0c12f0 2023-07-27T20:34:50.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.412+0000 7fbf12ffd700 1 -- 172.21.15.72:0/312508419 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0c005430 con 0x7fbf1c0c12f0 2023-07-27T20:34:50.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.412+0000 7fbf12ffd700 1 -- 172.21.15.72:0/312508419 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c0038c0 con 0x7fbf1c0c12f0 2023-07-27T20:34:50.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.412+0000 7fbf247ff700 1 -- 172.21.15.72:0/312508419 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf1c1e5710 con 0x7fbf1c0c12f0 2023-07-27T20:34:50.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.412+0000 7fbf247ff700 1 -- 172.21.15.72:0/312508419 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf1c1e5cd0 con 0x7fbf1c0c12f0 2023-07-27T20:34:50.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.413+0000 7fbf247ff700 1 -- 172.21.15.72:0/312508419 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf1c1e61f0 con 0x7fbf1c0c12f0 2023-07-27T20:34:50.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.415+0000 7fbf12ffd700 1 -- 172.21.15.72:0/312508419 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbf0c003a20 con 0x7fbf1c0c12f0 2023-07-27T20:34:50.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.416+0000 7fbf12ffd700 1 --2- 172.21.15.72:0/312508419 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fbf0006ace0 0x7fbf0006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:50.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.416+0000 7fbf12ffd700 1 -- 172.21.15.72:0/312508419 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 7136+0+0 (secure 0 0 0) 0x7fbf0c088db0 con 0x7fbf1c0c12f0 2023-07-27T20:34:50.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.417+0000 7fbf2259b700 1 --2- 172.21.15.72:0/312508419 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fbf0006ace0 0x7fbf0006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:50.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.417+0000 7fbf2259b700 1 --2- 172.21.15.72:0/312508419 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fbf0006ace0 0x7fbf0006d1a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fbf18009b40 tx=0x7fbf18009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:50.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.420+0000 7fbf12ffd700 1 -- 172.21.15.72:0/312508419 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbf0c053bc0 con 0x7fbf1c0c12f0 2023-07-27T20:34:50.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:50.658+0000 7fbf247ff700 1 -- 172.21.15.72:0/312508419 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7fbf1c1e63d0 con 0x7fbf1c0c12f0 2023-07-27T20:34:51.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.165+0000 7fbf12ffd700 1 -- 172.21.15.72:0/312508419 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 12 and data pool 13 v34) v1 ==== 177+0+0 (secure 0 0 0) 0x7fbf0c0571e0 con 0x7fbf1c0c12f0 2023-07-27T20:34:51.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.169+0000 7fbf247ff700 1 -- 172.21.15.72:0/312508419 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fbf0006ace0 msgr2=0x7fbf0006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:51.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.169+0000 7fbf247ff700 1 --2- 172.21.15.72:0/312508419 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fbf0006ace0 0x7fbf0006d1a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fbf18009b40 tx=0x7fbf18009210 comp rx=0 tx=0).stop 2023-07-27T20:34:51.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.169+0000 7fbf247ff700 1 -- 172.21.15.72:0/312508419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf1c0c12f0 msgr2=0x7fbf1c153090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:51.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.169+0000 7fbf247ff700 1 --2- 172.21.15.72:0/312508419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf1c0c12f0 0x7fbf1c153090 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c00c4e0 tx=0x7fbf0c00c7f0 comp rx=0 tx=0).stop 2023-07-27T20:34:51.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.169+0000 7fbf247ff700 1 -- 172.21.15.72:0/312508419 shutdown_connections 2023-07-27T20:34:51.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.169+0000 7fbf247ff700 1 --2- 172.21.15.72:0/312508419 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fbf0006ace0 0x7fbf0006d1a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:51.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.169+0000 7fbf247ff700 1 --2- 172.21.15.72:0/312508419 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbf1c1475a0 0x7fbf1c1e3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:51.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.169+0000 7fbf247ff700 1 --2- 172.21.15.72:0/312508419 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf1c0716f0 0x7fbf1c14f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:51.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.169+0000 7fbf247ff700 1 --2- 172.21.15.72:0/312508419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf1c0c12f0 0x7fbf1c153090 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:51.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.169+0000 7fbf247ff700 1 -- 172.21.15.72:0/312508419 >> 172.21.15.72:0/312508419 conn(0x7fbf1c06a190 msgr2=0x7fbf1c0c04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:51.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.169+0000 7fbf247ff700 1 -- 172.21.15.72:0/312508419 shutdown_connections 2023-07-27T20:34:51.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.171+0000 7fbf247ff700 1 -- 172.21.15.72:0/312508419 wait complete. 2023-07-27T20:34:51.165 INFO:teuthology.orchestra.run.smithi072.stderr:new fs with metadata pool 12 and data pool 13 2023-07-27T20:34:51.182 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:34:51.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.390+0000 7f6adbdff700 1 Processor -- start 2023-07-27T20:34:51.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.390+0000 7f6adbdff700 1 -- start start 2023-07-27T20:34:51.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.391+0000 7f6adbdff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6ad40c4400 0x7f6ad40c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:51.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.391+0000 7f6adbdff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ad406b710 con 0x7f6ad406b150 2023-07-27T20:34:51.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.391+0000 7f6adbdff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ad406b9f0 con 0x7f6ad41549f0 2023-07-27T20:34:51.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.391+0000 7f6adbdff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ad41545d0 con 0x7f6ad40c4400 2023-07-27T20:34:51.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.392+0000 7f6ad9b9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6ad40c4400 0x7f6ad40c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:51.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.392+0000 7f6ad939a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6ad406b150 0x7f6ad40c4cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53996/0 (socket says 172.21.15.72:53996) 2023-07-27T20:34:51.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.392+0000 7f6ad939a700 1 -- 172.21.15.72:0/2510677445 learned_addr learned my addr 172.21.15.72:0/2510677445 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:51.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.392+0000 7f6ad9b9b700 1 -- 172.21.15.72:0/2510677445 >> v1:172.21.15.173:6789/0 conn(0x7f6ad41549f0 legacy=0x7f6ad41514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:51.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.392+0000 7f6ad9b9b700 1 -- 172.21.15.72:0/2510677445 >> v1:172.21.15.72:6789/0 conn(0x7f6ad406b150 legacy=0x7f6ad40c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:51.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.392+0000 7f6ad9b9b700 1 -- 172.21.15.72:0/2510677445 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad406bcd0 con 0x7f6ad40c4400 2023-07-27T20:34:51.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.392+0000 7f6ad8b99700 1 -- 172.21.15.72:0/2510677445 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3585001689 0 0) 0x7f6ad406b710 con 0x7f6ad406b150 2023-07-27T20:34:51.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.392+0000 7f6ad9b9b700 1 --2- 172.21.15.72:0/2510677445 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ad40c4400 0x7f6ad40c7710 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0009840 tx=0x7f6ad0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=117d457f28c6674d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:51.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.392+0000 7f6ad8b99700 1 -- 172.21.15.72:0/2510677445 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0004230 con 0x7f6ad40c4400 2023-07-27T20:34:51.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.392+0000 7f6ad8b99700 1 -- 172.21.15.72:0/2510677445 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad0004390 con 0x7f6ad40c4400 2023-07-27T20:34:51.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.392+0000 7f6ad8b99700 1 -- 172.21.15.72:0/2510677445 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad00036a0 con 0x7f6ad40c4400 2023-07-27T20:34:51.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.393+0000 7f6adbdff700 1 -- 172.21.15.72:0/2510677445 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ad40c4400 msgr2=0x7f6ad40c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:51.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.393+0000 7f6adbdff700 1 --2- 172.21.15.72:0/2510677445 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ad40c4400 0x7f6ad40c7710 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0009840 tx=0x7f6ad0009b50 comp rx=0 tx=0).stop 2023-07-27T20:34:51.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.393+0000 7f6adbdff700 1 -- 172.21.15.72:0/2510677445 shutdown_connections 2023-07-27T20:34:51.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.393+0000 7f6adbdff700 1 --2- 172.21.15.72:0/2510677445 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ad40c4400 0x7f6ad40c7710 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:51.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.393+0000 7f6adbdff700 1 -- 172.21.15.72:0/2510677445 >> 172.21.15.72:0/2510677445 conn(0x7f6ad40ab300 msgr2=0x7f6ad40ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:51.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.393+0000 7f6adbdff700 1 -- 172.21.15.72:0/2510677445 shutdown_connections 2023-07-27T20:34:51.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.393+0000 7f6adbdff700 1 -- 172.21.15.72:0/2510677445 wait complete. 2023-07-27T20:34:51.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.395+0000 7f6adbdff700 1 Processor -- start 2023-07-27T20:34:51.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.395+0000 7f6adbdff700 1 -- start start 2023-07-27T20:34:51.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.396+0000 7f6adbdff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ad406b150 0x7f6ad40ae9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:51.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.396+0000 7f6adbdff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6ad40c4400 0x7f6ad40aef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:51.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.396+0000 7f6adbdff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ad41549f0 0x7f6ad414e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:51.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.396+0000 7f6adbdff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad40c35d0 con 0x7f6ad41549f0 2023-07-27T20:34:51.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.396+0000 7f6adbdff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad414c930 con 0x7f6ad406b150 2023-07-27T20:34:51.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.396+0000 7f6adbdff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad41ed3e0 con 0x7f6ad40c4400 2023-07-27T20:34:51.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.396+0000 7f6ada39c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ad41549f0 0x7f6ad414e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:51.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.396+0000 7f6ada39c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ad41549f0 0x7f6ad414e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48276/0 (socket says 172.21.15.72:48276) 2023-07-27T20:34:51.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.396+0000 7f6ada39c700 1 -- 172.21.15.72:0/2675372011 learned_addr learned my addr 172.21.15.72:0/2675372011 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:51.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.396+0000 7f6ad9b9b700 1 --2- 172.21.15.72:0/2675372011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ad406b150 0x7f6ad40ae9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:51.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.396+0000 7f6ad939a700 1 --2- 172.21.15.72:0/2675372011 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6ad40c4400 0x7f6ad40aef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:51.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.397+0000 7f6ada39c700 1 -- 172.21.15.72:0/2675372011 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6ad40c4400 msgr2=0x7f6ad40aef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:51.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.397+0000 7f6ada39c700 1 --2- 172.21.15.72:0/2675372011 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6ad40c4400 0x7f6ad40aef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:51.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.397+0000 7f6ada39c700 1 -- 172.21.15.72:0/2675372011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ad406b150 msgr2=0x7f6ad40ae9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:51.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.397+0000 7f6ada39c700 1 --2- 172.21.15.72:0/2675372011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ad406b150 0x7f6ad40ae9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:51.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.397+0000 7f6ada39c700 1 -- 172.21.15.72:0/2675372011 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad00094a0 con 0x7f6ad41549f0 2023-07-27T20:34:51.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.397+0000 7f6ada39c700 1 --2- 172.21.15.72:0/2675372011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ad41549f0 0x7f6ad414e120 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f6acc00c7a0 tx=0x7f6acc00cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:51.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.397+0000 7f6aca7fc700 1 -- 172.21.15.72:0/2675372011 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc003e10 con 0x7f6ad41549f0 2023-07-27T20:34:51.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.397+0000 7f6aca7fc700 1 -- 172.21.15.72:0/2675372011 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6acc005070 con 0x7f6ad41549f0 2023-07-27T20:34:51.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.397+0000 7f6adbdff700 1 -- 172.21.15.72:0/2675372011 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ad414c370 con 0x7f6ad41549f0 2023-07-27T20:34:51.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.397+0000 7f6aca7fc700 1 -- 172.21.15.72:0/2675372011 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc005420 con 0x7f6ad41549f0 2023-07-27T20:34:51.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.397+0000 7f6adbdff700 1 -- 172.21.15.72:0/2675372011 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ad40c30b0 con 0x7f6ad41549f0 2023-07-27T20:34:51.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.398+0000 7f6adbdff700 1 -- 172.21.15.72:0/2675372011 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ad40c2f10 con 0x7f6ad41549f0 2023-07-27T20:34:51.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.399+0000 7f6aca7fc700 1 -- 172.21.15.72:0/2675372011 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6acc005580 con 0x7f6ad41549f0 2023-07-27T20:34:51.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.400+0000 7f6aca7fc700 1 --2- 172.21.15.72:0/2675372011 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f6ab806ace0 0x7f6ab806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:51.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.400+0000 7f6aca7fc700 1 -- 172.21.15.72:0/2675372011 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f6acc088e50 con 0x7f6ad41549f0 2023-07-27T20:34:51.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.401+0000 7f6ad9b9b700 1 --2- 172.21.15.72:0/2675372011 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f6ab806ace0 0x7f6ab806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:51.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.401+0000 7f6ad9b9b700 1 --2- 172.21.15.72:0/2675372011 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f6ab806ace0 0x7f6ab806d1a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0009b90 tx=0x7f6ad001c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:51.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.404+0000 7f6aca7fc700 1 -- 172.21.15.72:0/2675372011 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6ad40c2f10 con 0x7f6ad41549f0 2023-07-27T20:34:51.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.600+0000 7f6adbdff700 1 -- 172.21.15.72:0/2675372011 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ad40c2f10 con 0x7f6ad41549f0 2023-07-27T20:34:51.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.602+0000 7f6aca7fc700 1 -- 172.21.15.72:0/2675372011 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+22274 (secure 0 0 0) 0x7f6ad40c2f10 con 0x7f6ad41549f0 2023-07-27T20:34:51.589 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:34:51.589 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":65,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:34:50.659278+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:34:31.480063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-07-27T20:34:32.755579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_metadata","create_time":"2023-07-27T20:34:48.900422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs2_data","create_time":"2023-07-27T20:34:49.633712+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:34:51.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.604+0000 7f6adbdff700 1 -- 172.21.15.72:0/2675372011 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f6ab806ace0 msgr2=0x7f6ab806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:51.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.604+0000 7f6adbdff700 1 --2- 172.21.15.72:0/2675372011 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f6ab806ace0 0x7f6ab806d1a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0009b90 tx=0x7f6ad001c040 comp rx=0 tx=0).stop 2023-07-27T20:34:51.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.604+0000 7f6adbdff700 1 -- 172.21.15.72:0/2675372011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ad41549f0 msgr2=0x7f6ad414e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:51.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.604+0000 7f6adbdff700 1 --2- 172.21.15.72:0/2675372011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ad41549f0 0x7f6ad414e120 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f6acc00c7a0 tx=0x7f6acc00cab0 comp rx=0 tx=0).stop 2023-07-27T20:34:51.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.604+0000 7f6adbdff700 1 -- 172.21.15.72:0/2675372011 shutdown_connections 2023-07-27T20:34:51.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.604+0000 7f6adbdff700 1 --2- 172.21.15.72:0/2675372011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ad41549f0 0x7f6ad414e120 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:51.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.604+0000 7f6adbdff700 1 --2- 172.21.15.72:0/2675372011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ad406b150 0x7f6ad40ae9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:51.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.604+0000 7f6adbdff700 1 --2- 172.21.15.72:0/2675372011 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f6ab806ace0 0x7f6ab806d1a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:51.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.604+0000 7f6adbdff700 1 --2- 172.21.15.72:0/2675372011 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6ad40c4400 0x7f6ad40aef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:51.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.604+0000 7f6adbdff700 1 -- 172.21.15.72:0/2675372011 >> 172.21.15.72:0/2675372011 conn(0x7f6ad40ab300 msgr2=0x7f6ad40ab6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:51.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.604+0000 7f6adbdff700 1 -- 172.21.15.72:0/2675372011 shutdown_connections 2023-07-27T20:34:51.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.604+0000 7f6adbdff700 1 -- 172.21.15.72:0/2675372011 wait complete. 2023-07-27T20:34:51.609 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:34:51.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.821+0000 7fc15b59e700 1 Processor -- start 2023-07-27T20:34:51.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.821+0000 7fc15b59e700 1 -- start start 2023-07-27T20:34:51.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.822+0000 7fc15b59e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc15c151530 0x7fc15c0c4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:51.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.822+0000 7fc15b59e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc15c1549f0 0x7fc15c06aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:51.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.822+0000 7fc15b59e700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc15c154560 con 0x7fc15c0c54c0 2023-07-27T20:34:51.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.822+0000 7fc15b59e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc15c0c5940 con 0x7fc15c1549f0 2023-07-27T20:34:51.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.822+0000 7fc15b59e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc15c154e80 con 0x7fc15c151530 2023-07-27T20:34:51.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.822+0000 7fc15ad9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc15c1549f0 0x7fc15c06aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:51.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.822+0000 7fc15ad9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc15c1549f0 0x7fc15c06aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48288/0 (socket says 172.21.15.72:48288) 2023-07-27T20:34:51.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.822+0000 7fc15ad9d700 1 -- 172.21.15.72:0/2381753297 learned_addr learned my addr 172.21.15.72:0/2381753297 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:51.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.822+0000 7fc15a59c700 1 --2- 172.21.15.72:0/2381753297 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc15c151530 0x7fc15c0c4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:51.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.823+0000 7fc15ad9d700 1 -- 172.21.15.72:0/2381753297 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc15c151530 msgr2=0x7fc15c0c4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:51.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.823+0000 7fc15ad9d700 1 --2- 172.21.15.72:0/2381753297 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc15c151530 0x7fc15c0c4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:51.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.823+0000 7fc15ad9d700 1 -- 172.21.15.72:0/2381753297 >> v1:172.21.15.173:6789/0 conn(0x7fc15c0c54c0 legacy=0x7fc15c0c75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:51.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.823+0000 7fc15ad9d700 1 -- 172.21.15.72:0/2381753297 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc15c151910 con 0x7fc15c1549f0 2023-07-27T20:34:51.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.823+0000 7fc15ad9d700 1 --2- 172.21.15.72:0/2381753297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc15c1549f0 0x7fc15c06aff0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fc154009e50 tx=0x7fc15400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e747524d59bef0a0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:51.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.823+0000 7fc15959a700 1 -- 172.21.15.72:0/2381753297 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15400e070 con 0x7fc15c1549f0 2023-07-27T20:34:51.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.823+0000 7fc15959a700 1 -- 172.21.15.72:0/2381753297 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15400b910 con 0x7fc15c1549f0 2023-07-27T20:34:51.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.823+0000 7fc15959a700 1 -- 172.21.15.72:0/2381753297 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15400bcc0 con 0x7fc15c1549f0 2023-07-27T20:34:51.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.824+0000 7fc15b59e700 1 -- 172.21.15.72:0/2381753297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc15c1549f0 msgr2=0x7fc15c06aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:51.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.824+0000 7fc15b59e700 1 --2- 172.21.15.72:0/2381753297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc15c1549f0 0x7fc15c06aff0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fc154009e50 tx=0x7fc15400b330 comp rx=0 tx=0).stop 2023-07-27T20:34:51.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.824+0000 7fc15b59e700 1 -- 172.21.15.72:0/2381753297 shutdown_connections 2023-07-27T20:34:51.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.824+0000 7fc15b59e700 1 --2- 172.21.15.72:0/2381753297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc15c1549f0 0x7fc15c06aff0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:51.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.824+0000 7fc15b59e700 1 --2- 172.21.15.72:0/2381753297 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc15c151530 0x7fc15c0c4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:51.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.824+0000 7fc15b59e700 1 -- 172.21.15.72:0/2381753297 >> 172.21.15.72:0/2381753297 conn(0x7fc15c0c96a0 msgr2=0x7fc15c0c9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:51.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.824+0000 7fc15b59e700 1 -- 172.21.15.72:0/2381753297 shutdown_connections 2023-07-27T20:34:51.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.824+0000 7fc15b59e700 1 -- 172.21.15.72:0/2381753297 wait complete. 2023-07-27T20:34:51.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.826+0000 7fc15b59e700 1 Processor -- start 2023-07-27T20:34:51.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.826+0000 7fc15b59e700 1 -- start start 2023-07-27T20:34:51.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.827+0000 7fc15b59e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc15c0c54c0 0x7fc15c1538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:51.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.827+0000 7fc15b59e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc15c151530 0x7fc15c1e9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:51.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.827+0000 7fc15b59e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc15c1549f0 0x7fc15c1ea1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:51.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.827+0000 7fc15b59e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc15c1ea6e0 con 0x7fc15c1549f0 2023-07-27T20:34:51.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.827+0000 7fc15b59e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc15c1e9760 con 0x7fc15c151530 2023-07-27T20:34:51.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.827+0000 7fc15b59e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc15c1ed1b0 con 0x7fc15c0c54c0 2023-07-27T20:34:51.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.827+0000 7fc15ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc15c1549f0 0x7fc15c1ea1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:51.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.827+0000 7fc15ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc15c1549f0 0x7fc15c1ea1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48292/0 (socket says 172.21.15.72:48292) 2023-07-27T20:34:51.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.827+0000 7fc15ad9d700 1 -- 172.21.15.72:0/122640919 learned_addr learned my addr 172.21.15.72:0/122640919 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:51.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.827+0000 7fc15a59c700 1 --2- 172.21.15.72:0/122640919 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc15c0c54c0 0x7fc15c1538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:51.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.827+0000 7fc159d9b700 1 --2- 172.21.15.72:0/122640919 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc15c151530 0x7fc15c1e9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:51.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.827+0000 7fc15ad9d700 1 -- 172.21.15.72:0/122640919 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc15c0c54c0 msgr2=0x7fc15c1538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:51.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.827+0000 7fc15ad9d700 1 --2- 172.21.15.72:0/122640919 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc15c0c54c0 0x7fc15c1538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:51.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.827+0000 7fc15ad9d700 1 -- 172.21.15.72:0/122640919 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc15c151530 msgr2=0x7fc15c1e9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:51.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.827+0000 7fc15ad9d700 1 --2- 172.21.15.72:0/122640919 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc15c151530 0x7fc15c1e9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:51.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.827+0000 7fc15ad9d700 1 -- 172.21.15.72:0/122640919 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc154009b30 con 0x7fc15c1549f0 2023-07-27T20:34:51.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.827+0000 7fc15a59c700 1 --2- 172.21.15.72:0/122640919 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc15c0c54c0 0x7fc15c1538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:51.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.828+0000 7fc15ad9d700 1 --2- 172.21.15.72:0/122640919 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc15c1549f0 0x7fc15c1ea1a0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fc15c0ca1f0 tx=0x7fc154004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:51.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.828+0000 7fc14affd700 1 -- 172.21.15.72:0/122640919 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc154004960 con 0x7fc15c1549f0 2023-07-27T20:34:51.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.828+0000 7fc14affd700 1 -- 172.21.15.72:0/122640919 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1540099b0 con 0x7fc15c1549f0 2023-07-27T20:34:51.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.828+0000 7fc15b59e700 1 -- 172.21.15.72:0/122640919 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc15c1ed490 con 0x7fc15c1549f0 2023-07-27T20:34:51.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.828+0000 7fc14affd700 1 -- 172.21.15.72:0/122640919 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15401c680 con 0x7fc15c1549f0 2023-07-27T20:34:51.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.828+0000 7fc15b59e700 1 -- 172.21.15.72:0/122640919 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc15c1eda50 con 0x7fc15c1549f0 2023-07-27T20:34:51.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.829+0000 7fc15b59e700 1 -- 172.21.15.72:0/122640919 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc15c1e9980 con 0x7fc15c1549f0 2023-07-27T20:34:51.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.830+0000 7fc14affd700 1 -- 172.21.15.72:0/122640919 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc15401c7e0 con 0x7fc15c1549f0 2023-07-27T20:34:51.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.831+0000 7fc14affd700 1 --2- 172.21.15.72:0/122640919 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc13c06ace0 0x7fc13c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:51.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.831+0000 7fc14affd700 1 -- 172.21.15.72:0/122640919 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7238+0+0 (secure 0 0 0) 0x7fc15408b4f0 con 0x7fc15c1549f0 2023-07-27T20:34:51.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.831+0000 7fc15a59c700 1 --2- 172.21.15.72:0/122640919 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc13c06ace0 0x7fc13c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:51.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.832+0000 7fc15a59c700 1 --2- 172.21.15.72:0/122640919 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc13c06ace0 0x7fc13c06d1a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc14c009c30 tx=0x7fc14c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:51.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:51.836+0000 7fc14affd700 1 -- 172.21.15.72:0/122640919 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc15c1e9980 con 0x7fc15c1549f0 2023-07-27T20:34:52.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.034+0000 7fc15b59e700 1 -- 172.21.15.72:0/122640919 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc15c1e9980 con 0x7fc15c1549f0 2023-07-27T20:34:52.023 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:34:52.023 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":65,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:34:50.659278+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:34:31.480063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-07-27T20:34:32.755579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_metadata","create_time":"2023-07-27T20:34:48.900422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs2_data","create_time":"2023-07-27T20:34:49.633712+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:34:52.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.036+0000 7fc14affd700 1 -- 172.21.15.72:0/122640919 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+22274 (secure 0 0 0) 0x7fc15c1e9980 con 0x7fc15c1549f0 2023-07-27T20:34:52.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.038+0000 7fc15b59e700 1 -- 172.21.15.72:0/122640919 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc13c06ace0 msgr2=0x7fc13c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:52.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.038+0000 7fc15b59e700 1 --2- 172.21.15.72:0/122640919 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc13c06ace0 0x7fc13c06d1a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc14c009c30 tx=0x7fc14c008040 comp rx=0 tx=0).stop 2023-07-27T20:34:52.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.038+0000 7fc15b59e700 1 -- 172.21.15.72:0/122640919 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc15c1549f0 msgr2=0x7fc15c1ea1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:52.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.038+0000 7fc15b59e700 1 --2- 172.21.15.72:0/122640919 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc15c1549f0 0x7fc15c1ea1a0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fc15c0ca1f0 tx=0x7fc154004ad0 comp rx=0 tx=0).stop 2023-07-27T20:34:52.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.038+0000 7fc15b59e700 1 -- 172.21.15.72:0/122640919 shutdown_connections 2023-07-27T20:34:52.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.038+0000 7fc15b59e700 1 --2- 172.21.15.72:0/122640919 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc15c1549f0 0x7fc15c1ea1a0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:52.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.038+0000 7fc15b59e700 1 --2- 172.21.15.72:0/122640919 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fc13c06ace0 0x7fc13c06d1a0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:52.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.038+0000 7fc15b59e700 1 --2- 172.21.15.72:0/122640919 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc15c0c54c0 0x7fc15c1538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:52.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.038+0000 7fc15b59e700 1 --2- 172.21.15.72:0/122640919 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc15c151530 0x7fc15c1e9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:52.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.038+0000 7fc15b59e700 1 -- 172.21.15.72:0/122640919 >> 172.21.15.72:0/122640919 conn(0x7fc15c0c96a0 msgr2=0x7fc15c0c7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:52.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.038+0000 7fc15b59e700 1 -- 172.21.15.72:0/122640919 shutdown_connections 2023-07-27T20:34:52.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.038+0000 7fc15b59e700 1 -- 172.21.15.72:0/122640919 wait complete. 2023-07-27T20:34:52.066 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-07-27T20:34:52.096 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:34:52.118 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:34:52.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.287+0000 7f5d2c9ff700 1 Processor -- start 2023-07-27T20:34:52.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.287+0000 7f5d2c9ff700 1 -- start start 2023-07-27T20:34:52.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.288+0000 7f5d2c9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5d280c7740 0x7f5d280c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:52.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.288+0000 7f5d2c9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d280c7c50 con 0x7f5d2814aab0 2023-07-27T20:34:52.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.288+0000 7f5d2c9ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d2806bd40 con 0x7f5d280c4700 2023-07-27T20:34:52.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.288+0000 7f5d2c9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d280c62f0 con 0x7f5d280c7740 2023-07-27T20:34:52.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.288+0000 7f5d25d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5d280c7740 0x7f5d280c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:52.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.289+0000 7f5d25d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5d280c7740 0x7f5d280c41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48302/0 (socket says 172.21.15.72:48302) 2023-07-27T20:34:52.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.289+0000 7f5d25d9b700 1 -- 172.21.15.72:0/327022128 learned_addr learned my addr 172.21.15.72:0/327022128 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:52.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.289+0000 7f5d25d9b700 1 -- 172.21.15.72:0/327022128 >> v1:172.21.15.173:6789/0 conn(0x7f5d280c4700 legacy=0x7f5d2806c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:52.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.289+0000 7f5d25d9b700 1 -- 172.21.15.72:0/327022128 >> v1:172.21.15.72:6789/0 conn(0x7f5d2814aab0 legacy=0x7f5d28154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:52.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.289+0000 7f5d25d9b700 1 -- 172.21.15.72:0/327022128 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d2806d200 con 0x7f5d280c7740 2023-07-27T20:34:52.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.289+0000 7f5d25d9b700 1 --2- 172.21.15.72:0/327022128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d280c7740 0x7f5d280c41c0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c0098f0 tx=0x7f5d1c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b305ca4db63f6b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:52.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.289+0000 7f5d2559a700 1 -- 172.21.15.72:0/327022128 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c004230 con 0x7f5d280c7740 2023-07-27T20:34:52.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.289+0000 7f5d2559a700 1 -- 172.21.15.72:0/327022128 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1c004390 con 0x7f5d280c7740 2023-07-27T20:34:52.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.290+0000 7f5d2559a700 1 -- 172.21.15.72:0/327022128 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c0036a0 con 0x7f5d280c7740 2023-07-27T20:34:52.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.290+0000 7f5d2c9ff700 1 -- 172.21.15.72:0/327022128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d280c7740 msgr2=0x7f5d280c41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:52.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.290+0000 7f5d2c9ff700 1 --2- 172.21.15.72:0/327022128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d280c7740 0x7f5d280c41c0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c0098f0 tx=0x7f5d1c009c00 comp rx=0 tx=0).stop 2023-07-27T20:34:52.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.290+0000 7f5d2c9ff700 1 -- 172.21.15.72:0/327022128 shutdown_connections 2023-07-27T20:34:52.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.290+0000 7f5d2c9ff700 1 --2- 172.21.15.72:0/327022128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d280c7740 0x7f5d280c41c0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:52.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.290+0000 7f5d2c9ff700 1 -- 172.21.15.72:0/327022128 >> 172.21.15.72:0/327022128 conn(0x7f5d280ab3f0 msgr2=0x7f5d280ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:52.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.290+0000 7f5d2c9ff700 1 -- 172.21.15.72:0/327022128 shutdown_connections 2023-07-27T20:34:52.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.290+0000 7f5d2c9ff700 1 -- 172.21.15.72:0/327022128 wait complete. 2023-07-27T20:34:52.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.292+0000 7f5d2c9ff700 1 Processor -- start 2023-07-27T20:34:52.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.293+0000 7f5d2c9ff700 1 -- start start 2023-07-27T20:34:52.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.294+0000 7f5d2c9ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5d280c4700 0x7f5d281ecfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:52.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.294+0000 7f5d2c9ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d280c7740 0x7f5d2814bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:52.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.294+0000 7f5d2c9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d2814aab0 0x7f5d280c0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:52.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.294+0000 7f5d2c9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2814fa60 con 0x7f5d2814aab0 2023-07-27T20:34:52.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.294+0000 7f5d2c9ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d28150f60 con 0x7f5d280c7740 2023-07-27T20:34:52.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.294+0000 7f5d2c9ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d28150950 con 0x7f5d280c4700 2023-07-27T20:34:52.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.294+0000 7f5d26d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d2814aab0 0x7f5d280c0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:52.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.294+0000 7f5d2659c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5d280c4700 0x7f5d281ecfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:52.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.294+0000 7f5d26d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d2814aab0 0x7f5d280c0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48318/0 (socket says 172.21.15.72:48318) 2023-07-27T20:34:52.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.294+0000 7f5d26d9d700 1 -- 172.21.15.72:0/3895258081 learned_addr learned my addr 172.21.15.72:0/3895258081 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:52.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.294+0000 7f5d25d9b700 1 --2- 172.21.15.72:0/3895258081 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d280c7740 0x7f5d2814bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:52.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.294+0000 7f5d26d9d700 1 -- 172.21.15.72:0/3895258081 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5d280c4700 msgr2=0x7f5d281ecfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:52.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.294+0000 7f5d26d9d700 1 --2- 172.21.15.72:0/3895258081 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5d280c4700 0x7f5d281ecfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:52.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.294+0000 7f5d26d9d700 1 -- 172.21.15.72:0/3895258081 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d280c7740 msgr2=0x7f5d2814bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:52.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.294+0000 7f5d26d9d700 1 --2- 172.21.15.72:0/3895258081 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d280c7740 0x7f5d2814bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:52.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.294+0000 7f5d26d9d700 1 -- 172.21.15.72:0/3895258081 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d1c009550 con 0x7f5d2814aab0 2023-07-27T20:34:52.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.295+0000 7f5d26d9d700 1 --2- 172.21.15.72:0/3895258081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d2814aab0 0x7f5d280c0bb0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f5d2000cc10 tx=0x7f5d2000cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:52.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.295+0000 7f5d16ffd700 1 -- 172.21.15.72:0/3895258081 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2000aa60 con 0x7f5d2814aab0 2023-07-27T20:34:52.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.295+0000 7f5d16ffd700 1 -- 172.21.15.72:0/3895258081 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2000abc0 con 0x7f5d2814aab0 2023-07-27T20:34:52.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.295+0000 7f5d2c9ff700 1 -- 172.21.15.72:0/3895258081 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d281ed900 con 0x7f5d2814aab0 2023-07-27T20:34:52.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.295+0000 7f5d16ffd700 1 -- 172.21.15.72:0/3895258081 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d20012420 con 0x7f5d2814aab0 2023-07-27T20:34:52.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.295+0000 7f5d2c9ff700 1 -- 172.21.15.72:0/3895258081 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d28153e70 con 0x7f5d2814aab0 2023-07-27T20:34:52.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.296+0000 7f5d2c9ff700 1 -- 172.21.15.72:0/3895258081 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d281510f0 con 0x7f5d2814aab0 2023-07-27T20:34:52.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.297+0000 7f5d16ffd700 1 -- 172.21.15.72:0/3895258081 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5d20012580 con 0x7f5d2814aab0 2023-07-27T20:34:52.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.298+0000 7f5d16ffd700 1 --2- 172.21.15.72:0/3895258081 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5d0806ace0 0x7f5d0806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:52.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.298+0000 7f5d16ffd700 1 -- 172.21.15.72:0/3895258081 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f5d20089be0 con 0x7f5d2814aab0 2023-07-27T20:34:52.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.298+0000 7f5d2659c700 1 --2- 172.21.15.72:0/3895258081 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5d0806ace0 0x7f5d0806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:52.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.299+0000 7f5d2659c700 1 --2- 172.21.15.72:0/3895258081 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5d0806ace0 0x7f5d0806d1a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f5d281528a0 tx=0x7f5d18009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:52.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.302+0000 7f5d16ffd700 1 -- 172.21.15.72:0/3895258081 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5d200547e0 con 0x7f5d2814aab0 2023-07-27T20:34:52.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:52.545+0000 7f5d2c9ff700 1 -- 172.21.15.72:0/3895258081 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5d2804e470 con 0x7f5d2814aab0 2023-07-27T20:34:53.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.184+0000 7f5d16ffd700 1 -- 172.21.15.72:0/3895258081 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v37) v1 ==== 119+0+0 (secure 0 0 0) 0x7f5d20057e00 con 0x7f5d2814aab0 2023-07-27T20:34:53.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.187+0000 7f5d2c9ff700 1 -- 172.21.15.72:0/3895258081 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5d0806ace0 msgr2=0x7f5d0806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:53.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.187+0000 7f5d2c9ff700 1 --2- 172.21.15.72:0/3895258081 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5d0806ace0 0x7f5d0806d1a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f5d281528a0 tx=0x7f5d18009040 comp rx=0 tx=0).stop 2023-07-27T20:34:53.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.187+0000 7f5d2c9ff700 1 -- 172.21.15.72:0/3895258081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d2814aab0 msgr2=0x7f5d280c0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:53.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.187+0000 7f5d2c9ff700 1 --2- 172.21.15.72:0/3895258081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d2814aab0 0x7f5d280c0bb0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f5d2000cc10 tx=0x7f5d2000cf20 comp rx=0 tx=0).stop 2023-07-27T20:34:53.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.187+0000 7f5d2c9ff700 1 -- 172.21.15.72:0/3895258081 shutdown_connections 2023-07-27T20:34:53.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.187+0000 7f5d2c9ff700 1 --2- 172.21.15.72:0/3895258081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d2814aab0 0x7f5d280c0bb0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:53.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.187+0000 7f5d2c9ff700 1 --2- 172.21.15.72:0/3895258081 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f5d0806ace0 0x7f5d0806d1a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:53.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.187+0000 7f5d2c9ff700 1 --2- 172.21.15.72:0/3895258081 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5d280c4700 0x7f5d281ecfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:53.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.187+0000 7f5d2c9ff700 1 --2- 172.21.15.72:0/3895258081 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d280c7740 0x7f5d2814bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:53.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.187+0000 7f5d2c9ff700 1 -- 172.21.15.72:0/3895258081 >> 172.21.15.72:0/3895258081 conn(0x7f5d280ab3f0 msgr2=0x7f5d281528d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:53.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.187+0000 7f5d2c9ff700 1 -- 172.21.15.72:0/3895258081 shutdown_connections 2023-07-27T20:34:53.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.187+0000 7f5d2c9ff700 1 -- 172.21.15.72:0/3895258081 wait complete. 2023-07-27T20:34:53.194 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-27T20:34:53.195 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-07-27T20:34:53.237 INFO:tasks.ceph.mds.c.smithi072.stderr:2023-07-27T20:34:53.249+0000 7f8f297f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-27T20:34:53.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.409+0000 7f32c9dff700 1 Processor -- start 2023-07-27T20:34:53.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.409+0000 7f32c9dff700 1 -- start start 2023-07-27T20:34:53.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.411+0000 7f32c9dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f32c413b150 0x7f32c4151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:53.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.411+0000 7f32c9dff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f32c406d5d0 0x7f32c406da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:53.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.411+0000 7f32c9dff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32c406ce10 con 0x7f32c406e140 2023-07-27T20:34:53.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.411+0000 7f32c9dff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32c406df60 con 0x7f32c406d5d0 2023-07-27T20:34:53.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.411+0000 7f32c9dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c4152680 con 0x7f32c413b150 2023-07-27T20:34:53.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.411+0000 7f32c37fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f32c413b150 0x7f32c4151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:53.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.411+0000 7f32c2ffd700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f32c406e140 0x7f32c40ba310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.72:37204/0 (socket says 172.21.15.72:37204) 2023-07-27T20:34:53.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.411+0000 7f32c2ffd700 1 -- 172.21.15.72:0/1648524097 learned_addr learned my addr 172.21.15.72:0/1648524097 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:53.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.411+0000 7f32c3fff700 1 --2- 172.21.15.72:0/1648524097 >> v2:172.21.15.173:3300/0 conn(0x7f32c406d5d0 0x7f32c406da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:53.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.412+0000 7f32c37fe700 1 -- 172.21.15.72:0/1648524097 >> v2:172.21.15.173:3300/0 conn(0x7f32c406d5d0 msgr2=0x7f32c406da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:53.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.412+0000 7f32c37fe700 1 --2- 172.21.15.72:0/1648524097 >> v2:172.21.15.173:3300/0 conn(0x7f32c406d5d0 0x7f32c406da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:53.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.412+0000 7f32c37fe700 1 -- 172.21.15.72:0/1648524097 >> v1:172.21.15.173:6789/0 conn(0x7f32c406e140 legacy=0x7f32c40ba310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:53.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.412+0000 7f32c27fc700 1 -- 172.21.15.72:0/1648524097 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1178248792 0 0) 0x7f32c406ce10 con 0x7f32c406e140 2023-07-27T20:34:53.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.412+0000 7f32c37fe700 1 -- 172.21.15.72:0/1648524097 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c4152960 con 0x7f32c413b150 2023-07-27T20:34:53.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.412+0000 7f32c37fe700 1 --2- 172.21.15.72:0/1648524097 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f32c413b150 0x7f32c4151dc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f32b4009840 tx=0x7f32b4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8b101c47714daf0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:53.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.412+0000 7f32c27fc700 1 -- 172.21.15.72:0/1648524097 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b4011830 con 0x7f32c413b150 2023-07-27T20:34:53.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.412+0000 7f32c27fc700 1 -- 172.21.15.72:0/1648524097 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b4011990 con 0x7f32c413b150 2023-07-27T20:34:53.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.412+0000 7f32c27fc700 1 -- 172.21.15.72:0/1648524097 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b4011d20 con 0x7f32c413b150 2023-07-27T20:34:53.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.413+0000 7f32c9dff700 1 -- 172.21.15.72:0/1648524097 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f32c413b150 msgr2=0x7f32c4151dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:53.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.413+0000 7f32c9dff700 1 --2- 172.21.15.72:0/1648524097 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f32c413b150 0x7f32c4151dc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f32b4009840 tx=0x7f32b4009b50 comp rx=0 tx=0).stop 2023-07-27T20:34:53.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.413+0000 7f32c9dff700 1 -- 172.21.15.72:0/1648524097 shutdown_connections 2023-07-27T20:34:53.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.413+0000 7f32c9dff700 1 --2- 172.21.15.72:0/1648524097 >> v2:172.21.15.173:3300/0 conn(0x7f32c406d5d0 0x7f32c406da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:53.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.413+0000 7f32c9dff700 1 --2- 172.21.15.72:0/1648524097 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f32c413b150 0x7f32c4151dc0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:53.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.413+0000 7f32c9dff700 1 -- 172.21.15.72:0/1648524097 >> 172.21.15.72:0/1648524097 conn(0x7f32c406a190 msgr2=0x7f32c406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:53.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.413+0000 7f32c9dff700 1 -- 172.21.15.72:0/1648524097 shutdown_connections 2023-07-27T20:34:53.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.413+0000 7f32c9dff700 1 -- 172.21.15.72:0/1648524097 wait complete. 2023-07-27T20:34:53.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.415+0000 7f32c9dff700 1 Processor -- start 2023-07-27T20:34:53.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.415+0000 7f32c9dff700 1 -- start start 2023-07-27T20:34:53.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.416+0000 7f32c9dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32c406d5d0 0x7f32c4137dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:53.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.416+0000 7f32c9dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f32c406e140 0x7f32c41ec380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:53.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.416+0000 7f32c9dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32c413b150 0x7f32c41ecd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:53.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.416+0000 7f32c9dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c41eac80 con 0x7f32c413b150 2023-07-27T20:34:53.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.416+0000 7f32c9dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c40bca70 con 0x7f32c406d5d0 2023-07-27T20:34:53.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.416+0000 7f32c9dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c40bcd50 con 0x7f32c406e140 2023-07-27T20:34:53.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.416+0000 7f32c3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32c413b150 0x7f32c41ecd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:53.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.416+0000 7f32c3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32c413b150 0x7f32c41ecd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48322/0 (socket says 172.21.15.72:48322) 2023-07-27T20:34:53.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.416+0000 7f32c3fff700 1 -- 172.21.15.72:0/1989276977 learned_addr learned my addr 172.21.15.72:0/1989276977 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:53.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.416+0000 7f32c2ffd700 1 --2- 172.21.15.72:0/1989276977 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f32c406e140 0x7f32c41ec380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:53.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.416+0000 7f32c37fe700 1 --2- 172.21.15.72:0/1989276977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32c406d5d0 0x7f32c4137dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:53.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.417+0000 7f32c3fff700 1 -- 172.21.15.72:0/1989276977 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f32c406e140 msgr2=0x7f32c41ec380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:53.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.417+0000 7f32c3fff700 1 --2- 172.21.15.72:0/1989276977 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f32c406e140 0x7f32c41ec380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:53.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.417+0000 7f32c3fff700 1 -- 172.21.15.72:0/1989276977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32c406d5d0 msgr2=0x7f32c4137dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:53.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.417+0000 7f32c3fff700 1 --2- 172.21.15.72:0/1989276977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32c406d5d0 0x7f32c4137dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:53.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.417+0000 7f32c3fff700 1 -- 172.21.15.72:0/1989276977 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b40094a0 con 0x7f32c413b150 2023-07-27T20:34:53.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.417+0000 7f32c37fe700 1 --2- 172.21.15.72:0/1989276977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32c406d5d0 0x7f32c4137dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:53.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.417+0000 7f32c3fff700 1 --2- 172.21.15.72:0/1989276977 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32c413b150 0x7f32c41ecd80 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f32bc00efc0 tx=0x7f32bc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:53.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.417+0000 7f32abfff700 1 -- 172.21.15.72:0/1989276977 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32bc009ba0 con 0x7f32c413b150 2023-07-27T20:34:53.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.417+0000 7f32abfff700 1 -- 172.21.15.72:0/1989276977 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32bc00f040 con 0x7f32c413b150 2023-07-27T20:34:53.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.417+0000 7f32c9dff700 1 -- 172.21.15.72:0/1989276977 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c41ed830 con 0x7f32c413b150 2023-07-27T20:34:53.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.417+0000 7f32abfff700 1 -- 172.21.15.72:0/1989276977 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32bc014480 con 0x7f32c413b150 2023-07-27T20:34:53.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.417+0000 7f32c9dff700 1 -- 172.21.15.72:0/1989276977 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c41384d0 con 0x7f32c413b150 2023-07-27T20:34:53.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.418+0000 7f32c9dff700 1 -- 172.21.15.72:0/1989276977 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c41eae30 con 0x7f32c413b150 2023-07-27T20:34:53.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.419+0000 7f32abfff700 1 -- 172.21.15.72:0/1989276977 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f32bc0145e0 con 0x7f32c413b150 2023-07-27T20:34:53.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.420+0000 7f32abfff700 1 --2- 172.21.15.72:0/1989276977 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f32b006ad10 0x7f32b006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:53.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.420+0000 7f32abfff700 1 -- 172.21.15.72:0/1989276977 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f32bc08a370 con 0x7f32c413b150 2023-07-27T20:34:53.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.421+0000 7f32c37fe700 1 --2- 172.21.15.72:0/1989276977 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f32b006ad10 0x7f32b006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:53.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.422+0000 7f32c37fe700 1 --2- 172.21.15.72:0/1989276977 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f32b006ad10 0x7f32b006d1d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f32b4000c00 tx=0x7f32b4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:53.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.425+0000 7f32abfff700 1 -- 172.21.15.72:0/1989276977 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f32c41eae30 con 0x7f32c413b150 2023-07-27T20:34:53.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:53.661+0000 7f32c9dff700 1 -- 172.21.15.72:0/1989276977 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f32c41eae30 con 0x7f32c413b150 2023-07-27T20:34:54.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.190+0000 7f32abfff700 1 -- 172.21.15.72:0/1989276977 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v38) v1 ==== 123+0+0 (secure 0 0 0) 0x7f32c41eae30 con 0x7f32c413b150 2023-07-27T20:34:54.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.193+0000 7f32c9dff700 1 -- 172.21.15.72:0/1989276977 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f32b006ad10 msgr2=0x7f32b006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:54.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.193+0000 7f32c9dff700 1 --2- 172.21.15.72:0/1989276977 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f32b006ad10 0x7f32b006d1d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f32b4000c00 tx=0x7f32b4008030 comp rx=0 tx=0).stop 2023-07-27T20:34:54.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.193+0000 7f32c9dff700 1 -- 172.21.15.72:0/1989276977 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32c413b150 msgr2=0x7f32c41ecd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:54.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.193+0000 7f32c9dff700 1 --2- 172.21.15.72:0/1989276977 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32c413b150 0x7f32c41ecd80 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f32bc00efc0 tx=0x7f32bc00c3a0 comp rx=0 tx=0).stop 2023-07-27T20:34:54.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.193+0000 7f32c9dff700 1 -- 172.21.15.72:0/1989276977 shutdown_connections 2023-07-27T20:34:54.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.193+0000 7f32c9dff700 1 --2- 172.21.15.72:0/1989276977 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32c413b150 0x7f32c41ecd80 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:54.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.193+0000 7f32c9dff700 1 --2- 172.21.15.72:0/1989276977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32c406d5d0 0x7f32c4137dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:54.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.193+0000 7f32c9dff700 1 --2- 172.21.15.72:0/1989276977 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f32b006ad10 0x7f32b006d1d0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:54.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.193+0000 7f32c9dff700 1 --2- 172.21.15.72:0/1989276977 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f32c406e140 0x7f32c41ec380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:54.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.193+0000 7f32c9dff700 1 -- 172.21.15.72:0/1989276977 >> 172.21.15.72:0/1989276977 conn(0x7f32c406a190 msgr2=0x7f32c4151290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:54.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.193+0000 7f32c9dff700 1 -- 172.21.15.72:0/1989276977 shutdown_connections 2023-07-27T20:34:54.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.193+0000 7f32c9dff700 1 -- 172.21.15.72:0/1989276977 wait complete. 2023-07-27T20:34:54.199 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-07-27T20:34:54.200 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T20:34:54.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.449+0000 7f6bf49ff700 1 Processor -- start 2023-07-27T20:34:54.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.449+0000 7f6bf49ff700 1 -- start start 2023-07-27T20:34:54.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.450+0000 7f6bf49ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6bf00a9190 0x7f6bf00c39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:54.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.450+0000 7f6bf49ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bf00c1fb0 0x7f6bf00a9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:54.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.451+0000 7f6bf49ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bf0154ba0 con 0x7f6bf01576c0 2023-07-27T20:34:54.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.451+0000 7f6bf49ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bf00c2ea0 con 0x7f6bf00a9190 2023-07-27T20:34:54.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.451+0000 7f6bf49ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf0154e80 con 0x7f6bf00c1fb0 2023-07-27T20:34:54.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.451+0000 7f6bee59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6bf00a9190 0x7f6bf00c39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:54.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.451+0000 7f6beed9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6bf01576c0 0x7f6bf0157b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54010/0 (socket says 172.21.15.72:54010) 2023-07-27T20:34:54.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.451+0000 7f6beed9d700 1 -- 172.21.15.72:0/221691417 learned_addr learned my addr 172.21.15.72:0/221691417 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:54.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.451+0000 7f6be7fff700 1 --2- 172.21.15.72:0/221691417 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bf00c1fb0 0x7f6bf00a9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:54.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.451+0000 7f6bee59c700 1 -- 172.21.15.72:0/221691417 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bf00c1fb0 msgr2=0x7f6bf00a9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:54.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.451+0000 7f6bee59c700 1 --2- 172.21.15.72:0/221691417 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bf00c1fb0 0x7f6bf00a9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:54.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.451+0000 7f6bee59c700 1 -- 172.21.15.72:0/221691417 >> v1:172.21.15.72:6789/0 conn(0x7f6bf01576c0 legacy=0x7f6bf0157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:54.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.451+0000 7f6bee59c700 1 -- 172.21.15.72:0/221691417 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf00706f0 con 0x7f6bf00a9190 2023-07-27T20:34:54.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.451+0000 7f6be7fff700 1 --2- 172.21.15.72:0/221691417 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bf00c1fb0 0x7f6bf00a9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:54.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.452+0000 7f6bee59c700 1 --2- 172.21.15.72:0/221691417 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bf00a9190 0x7f6bf00c39d0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f6be0009840 tx=0x7f6be0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=432786b2235b50ef server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:54.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.452+0000 7f6bedd9b700 1 -- 172.21.15.72:0/221691417 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be0011830 con 0x7f6bf00a9190 2023-07-27T20:34:54.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.452+0000 7f6bedd9b700 1 -- 172.21.15.72:0/221691417 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be0011990 con 0x7f6bf00a9190 2023-07-27T20:34:54.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.452+0000 7f6bedd9b700 1 -- 172.21.15.72:0/221691417 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be0011d20 con 0x7f6bf00a9190 2023-07-27T20:34:54.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.452+0000 7f6bf49ff700 1 -- 172.21.15.72:0/221691417 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bf00a9190 msgr2=0x7f6bf00c39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:54.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.452+0000 7f6bf49ff700 1 --2- 172.21.15.72:0/221691417 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bf00a9190 0x7f6bf00c39d0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f6be0009840 tx=0x7f6be0009b50 comp rx=0 tx=0).stop 2023-07-27T20:34:54.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.452+0000 7f6bf49ff700 1 -- 172.21.15.72:0/221691417 shutdown_connections 2023-07-27T20:34:54.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.452+0000 7f6bf49ff700 1 --2- 172.21.15.72:0/221691417 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bf00a9190 0x7f6bf00c39d0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:54.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.452+0000 7f6bf49ff700 1 --2- 172.21.15.72:0/221691417 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bf00c1fb0 0x7f6bf00a9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:54.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.452+0000 7f6bf49ff700 1 -- 172.21.15.72:0/221691417 >> 172.21.15.72:0/221691417 conn(0x7f6bf006a7c0 msgr2=0x7f6bf00c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:54.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.452+0000 7f6bf49ff700 1 -- 172.21.15.72:0/221691417 shutdown_connections 2023-07-27T20:34:54.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.452+0000 7f6bf49ff700 1 -- 172.21.15.72:0/221691417 wait complete. 2023-07-27T20:34:54.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.454+0000 7f6bf49ff700 1 Processor -- start 2023-07-27T20:34:54.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.454+0000 7f6bf49ff700 1 -- start start 2023-07-27T20:34:54.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.455+0000 7f6bf49ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bf00a9190 0x7f6bf01e9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:54.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.455+0000 7f6bf49ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bf01576c0 0x7f6bf0155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:54.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.455+0000 7f6bf49ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bf01571c0 0x7f6bf014c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:54.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.455+0000 7f6bf49ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf00a7930 con 0x7f6bf00a9190 2023-07-27T20:34:54.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.455+0000 7f6bf49ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf00a6d20 con 0x7f6bf01571c0 2023-07-27T20:34:54.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.455+0000 7f6bf49ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf00a7000 con 0x7f6bf01576c0 2023-07-27T20:34:54.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.455+0000 7f6bee59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bf00a9190 0x7f6bf01e9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:54.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.455+0000 7f6bee59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bf00a9190 0x7f6bf01e9320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48344/0 (socket says 172.21.15.72:48344) 2023-07-27T20:34:54.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.455+0000 7f6bee59c700 1 -- 172.21.15.72:0/3896723208 learned_addr learned my addr 172.21.15.72:0/3896723208 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:54.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.455+0000 7f6be7fff700 1 --2- 172.21.15.72:0/3896723208 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bf01576c0 0x7f6bf0155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:54.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.455+0000 7f6beed9d700 1 --2- 172.21.15.72:0/3896723208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bf01571c0 0x7f6bf014c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:54.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.456+0000 7f6bee59c700 1 -- 172.21.15.72:0/3896723208 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bf01576c0 msgr2=0x7f6bf0155630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:54.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.456+0000 7f6bee59c700 1 --2- 172.21.15.72:0/3896723208 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bf01576c0 0x7f6bf0155630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:54.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.456+0000 7f6bee59c700 1 -- 172.21.15.72:0/3896723208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bf01571c0 msgr2=0x7f6bf014c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:54.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.456+0000 7f6bee59c700 1 --2- 172.21.15.72:0/3896723208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bf01571c0 0x7f6bf014c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:54.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.456+0000 7f6bee59c700 1 -- 172.21.15.72:0/3896723208 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be00094a0 con 0x7f6bf00a9190 2023-07-27T20:34:54.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.456+0000 7f6bee59c700 1 --2- 172.21.15.72:0/3896723208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bf00a9190 0x7f6bf01e9320 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f6be00090b0 tx=0x7f6be0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:54.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.456+0000 7f6be6ffd700 1 -- 172.21.15.72:0/3896723208 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be00038a0 con 0x7f6bf00a9190 2023-07-27T20:34:54.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.456+0000 7f6be6ffd700 1 -- 172.21.15.72:0/3896723208 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be001f070 con 0x7f6bf00a9190 2023-07-27T20:34:54.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.456+0000 7f6bf49ff700 1 -- 172.21.15.72:0/3896723208 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf00a72e0 con 0x7f6bf00a9190 2023-07-27T20:34:54.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.456+0000 7f6be6ffd700 1 -- 172.21.15.72:0/3896723208 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be0003c40 con 0x7f6bf00a9190 2023-07-27T20:34:54.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.456+0000 7f6bf49ff700 1 -- 172.21.15.72:0/3896723208 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bf006fb20 con 0x7f6bf00a9190 2023-07-27T20:34:54.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.457+0000 7f6bf49ff700 1 -- 172.21.15.72:0/3896723208 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bf0074310 con 0x7f6bf00a9190 2023-07-27T20:34:54.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.458+0000 7f6be6ffd700 1 -- 172.21.15.72:0/3896723208 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6be001a430 con 0x7f6bf00a9190 2023-07-27T20:34:54.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.459+0000 7f6be6ffd700 1 --2- 172.21.15.72:0/3896723208 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f6bd006ad10 0x7f6bd006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:54.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.459+0000 7f6be6ffd700 1 -- 172.21.15.72:0/3896723208 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f6be0021070 con 0x7f6bf00a9190 2023-07-27T20:34:54.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.460+0000 7f6be7fff700 1 --2- 172.21.15.72:0/3896723208 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f6bd006ad10 0x7f6bd006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:54.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.460+0000 7f6be7fff700 1 --2- 172.21.15.72:0/3896723208 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f6bd006ad10 0x7f6bd006d1d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6bf00be2e0 tx=0x7f6bd8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:54.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.463+0000 7f6be6ffd700 1 -- 172.21.15.72:0/3896723208 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6be0056020 con 0x7f6bf00a9190 2023-07-27T20:34:54.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.700+0000 7f6bf49ff700 1 -- 172.21.15.72:0/3896723208 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6bf00c5b60 con 0x7f6bf00a9190 2023-07-27T20:34:54.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.701+0000 7f6be6ffd700 1 -- 172.21.15.72:0/3896723208 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+5823 (secure 0 0 0) 0x7f6be0059640 con 0x7f6bf00a9190 2023-07-27T20:34:54.688 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:34:54.689 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":38,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5498,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/2320540781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":2320540781},{"type":"v1","addr":"172.21.15.72:6833","nonce":2320540781}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5507,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/4181385736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4181385736},{"type":"v1","addr":"172.21.15.173:6836","nonce":4181385736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T20:34:33.766750+0000","modified":"2023-07-27T20:34:37.312198+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6336},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6336":{"gid":6336,"name":"b","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/591656642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":591656642},{"type":"v1","addr":"172.21.15.173:6837","nonce":591656642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T20:34:50.659622+0000","modified":"2023-07-27T20:34:54.183871+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6333},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6333":{"gid":6333,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":8,"addr":"172.21.15.72:6835/1617909802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1617909802},{"type":"v1","addr":"172.21.15.72:6835","nonce":1617909802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-27T20:34:54.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.703+0000 7f6bf49ff700 1 -- 172.21.15.72:0/3896723208 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f6bd006ad10 msgr2=0x7f6bd006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:54.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.703+0000 7f6bf49ff700 1 --2- 172.21.15.72:0/3896723208 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f6bd006ad10 0x7f6bd006d1d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6bf00be2e0 tx=0x7f6bd8008040 comp rx=0 tx=0).stop 2023-07-27T20:34:54.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.703+0000 7f6bf49ff700 1 -- 172.21.15.72:0/3896723208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bf00a9190 msgr2=0x7f6bf01e9320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:54.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.703+0000 7f6bf49ff700 1 --2- 172.21.15.72:0/3896723208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bf00a9190 0x7f6bf01e9320 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f6be00090b0 tx=0x7f6be0004750 comp rx=0 tx=0).stop 2023-07-27T20:34:54.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.703+0000 7f6bf49ff700 1 -- 172.21.15.72:0/3896723208 shutdown_connections 2023-07-27T20:34:54.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.703+0000 7f6bf49ff700 1 --2- 172.21.15.72:0/3896723208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bf01571c0 0x7f6bf014c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:54.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.703+0000 7f6bf49ff700 1 --2- 172.21.15.72:0/3896723208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bf00a9190 0x7f6bf01e9320 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:54.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.703+0000 7f6bf49ff700 1 --2- 172.21.15.72:0/3896723208 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f6bd006ad10 0x7f6bd006d1d0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:54.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.703+0000 7f6bf49ff700 1 --2- 172.21.15.72:0/3896723208 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bf01576c0 0x7f6bf0155630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:54.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.703+0000 7f6bf49ff700 1 -- 172.21.15.72:0/3896723208 >> 172.21.15.72:0/3896723208 conn(0x7f6bf006a7c0 msgr2=0x7f6bf006f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:54.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.704+0000 7f6bf49ff700 1 -- 172.21.15.72:0/3896723208 shutdown_connections 2023-07-27T20:34:54.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.704+0000 7f6bf49ff700 1 -- 172.21.15.72:0/3896723208 wait complete. 2023-07-27T20:34:54.693 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 38 2023-07-27T20:34:54.709 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:34:54.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.997+0000 7fe0237ff700 1 Processor -- start 2023-07-27T20:34:54.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.997+0000 7fe0237ff700 1 -- start start 2023-07-27T20:34:54.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.998+0000 7fe0237ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe01c139960 0x7fe01c0c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:54.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.998+0000 7fe0237ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe01c1542e0 0x7fe01c154730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:54.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.998+0000 7fe0237ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe01c0c1810 con 0x7fe01c139f80 2023-07-27T20:34:54.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.998+0000 7fe0237ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe01c0c0ee0 con 0x7fe01c1542e0 2023-07-27T20:34:54.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.998+0000 7fe0237ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c139d40 con 0x7fe01c139960 2023-07-27T20:34:54.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.998+0000 7fe021d9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe01c1542e0 0x7fe01c154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:54.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.999+0000 7fe021d9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe01c1542e0 0x7fe01c154730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48356/0 (socket says 172.21.15.72:48356) 2023-07-27T20:34:54.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.999+0000 7fe021d9c700 1 -- 172.21.15.72:0/979679768 learned_addr learned my addr 172.21.15.72:0/979679768 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:54.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.999+0000 7fe02159b700 1 --2- 172.21.15.72:0/979679768 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe01c139960 0x7fe01c0c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:54.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.999+0000 7fe021d9c700 1 -- 172.21.15.72:0/979679768 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe01c139960 msgr2=0x7fe01c0c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:54.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.999+0000 7fe021d9c700 1 --2- 172.21.15.72:0/979679768 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe01c139960 0x7fe01c0c12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:54.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.999+0000 7fe021d9c700 1 -- 172.21.15.72:0/979679768 >> v1:172.21.15.173:6789/0 conn(0x7fe01c139f80 legacy=0x7fe01c0c1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:54.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.999+0000 7fe021d9c700 1 -- 172.21.15.72:0/979679768 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01c151060 con 0x7fe01c1542e0 2023-07-27T20:34:54.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.999+0000 7fe02159b700 1 --2- 172.21.15.72:0/979679768 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe01c139960 0x7fe01c0c12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:54.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.999+0000 7fe021d9c700 1 --2- 172.21.15.72:0/979679768 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe01c1542e0 0x7fe01c154730 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fe014009e50 tx=0x7fe01400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92109a9437e90dcc server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:54.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.999+0000 7fe013fff700 1 -- 172.21.15.72:0/979679768 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01400e070 con 0x7fe01c1542e0 2023-07-27T20:34:54.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.999+0000 7fe013fff700 1 -- 172.21.15.72:0/979679768 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe014003a20 con 0x7fe01c1542e0 2023-07-27T20:34:54.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:54.999+0000 7fe013fff700 1 -- 172.21.15.72:0/979679768 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe014003dd0 con 0x7fe01c1542e0 2023-07-27T20:34:54.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.000+0000 7fe0237ff700 1 -- 172.21.15.72:0/979679768 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe01c1542e0 msgr2=0x7fe01c154730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:54.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.000+0000 7fe0237ff700 1 --2- 172.21.15.72:0/979679768 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe01c1542e0 0x7fe01c154730 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fe014009e50 tx=0x7fe01400b330 comp rx=0 tx=0).stop 2023-07-27T20:34:54.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.000+0000 7fe0237ff700 1 -- 172.21.15.72:0/979679768 shutdown_connections 2023-07-27T20:34:54.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.000+0000 7fe0237ff700 1 --2- 172.21.15.72:0/979679768 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe01c1542e0 0x7fe01c154730 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:54.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.000+0000 7fe0237ff700 1 --2- 172.21.15.72:0/979679768 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe01c139960 0x7fe01c0c12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:54.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.000+0000 7fe0237ff700 1 -- 172.21.15.72:0/979679768 >> 172.21.15.72:0/979679768 conn(0x7fe01c06a190 msgr2=0x7fe01c06a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:54.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.000+0000 7fe0237ff700 1 -- 172.21.15.72:0/979679768 shutdown_connections 2023-07-27T20:34:54.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.000+0000 7fe0237ff700 1 -- 172.21.15.72:0/979679768 wait complete. 2023-07-27T20:34:54.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.002+0000 7fe0237ff700 1 Processor -- start 2023-07-27T20:34:54.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.003+0000 7fe0237ff700 1 -- start start 2023-07-27T20:34:54.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.004+0000 7fe0237ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe01c139960 0x7fe01c0be990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:54.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.004+0000 7fe0237ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe01c139f80 0x7fe01c14dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:54.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.004+0000 7fe0237ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe01c1542e0 0x7fe01c14e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:54.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.004+0000 7fe0237ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c1ecd30 con 0x7fe01c139f80 2023-07-27T20:34:54.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.004+0000 7fe0237ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c138ff0 con 0x7fe01c139960 2023-07-27T20:34:54.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.004+0000 7fe0237ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c1ecff0 con 0x7fe01c1542e0 2023-07-27T20:34:54.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.004+0000 7fe020d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe01c139f80 0x7fe01c14dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:54.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.004+0000 7fe020d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe01c139f80 0x7fe01c14dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48370/0 (socket says 172.21.15.72:48370) 2023-07-27T20:34:54.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.004+0000 7fe020d9a700 1 -- 172.21.15.72:0/3760350665 learned_addr learned my addr 172.21.15.72:0/3760350665 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:54.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.004+0000 7fe02159b700 1 --2- 172.21.15.72:0/3760350665 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe01c139960 0x7fe01c0be990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:54.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.004+0000 7fe021d9c700 1 --2- 172.21.15.72:0/3760350665 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe01c1542e0 0x7fe01c14e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:54.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.004+0000 7fe020d9a700 1 -- 172.21.15.72:0/3760350665 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe01c1542e0 msgr2=0x7fe01c14e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:54.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.004+0000 7fe020d9a700 1 --2- 172.21.15.72:0/3760350665 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe01c1542e0 0x7fe01c14e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:54.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.004+0000 7fe020d9a700 1 -- 172.21.15.72:0/3760350665 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe01c139960 msgr2=0x7fe01c0be990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:54.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.004+0000 7fe020d9a700 1 --2- 172.21.15.72:0/3760350665 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe01c139960 0x7fe01c0be990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:54.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.005+0000 7fe020d9a700 1 -- 172.21.15.72:0/3760350665 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe014009b30 con 0x7fe01c139f80 2023-07-27T20:34:54.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.005+0000 7fe020d9a700 1 --2- 172.21.15.72:0/3760350665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe01c139f80 0x7fe01c14dce0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fe00c00c4d0 tx=0x7fe00c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:54.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.005+0000 7fe011ffb700 1 -- 172.21.15.72:0/3760350665 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c011790 con 0x7fe01c139f80 2023-07-27T20:34:54.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.005+0000 7fe011ffb700 1 -- 172.21.15.72:0/3760350665 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00c0118f0 con 0x7fe01c139f80 2023-07-27T20:34:54.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.005+0000 7fe0237ff700 1 -- 172.21.15.72:0/3760350665 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe01c1ed2d0 con 0x7fe01c139f80 2023-07-27T20:34:54.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.005+0000 7fe011ffb700 1 -- 172.21.15.72:0/3760350665 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c011ca0 con 0x7fe01c139f80 2023-07-27T20:34:54.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.005+0000 7fe0237ff700 1 -- 172.21.15.72:0/3760350665 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe01c0beed0 con 0x7fe01c139f80 2023-07-27T20:34:54.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.006+0000 7fe0237ff700 1 -- 172.21.15.72:0/3760350665 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe01c074310 con 0x7fe01c139f80 2023-07-27T20:34:54.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.007+0000 7fe011ffb700 1 -- 172.21.15.72:0/3760350665 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe00c01c460 con 0x7fe01c139f80 2023-07-27T20:34:54.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.008+0000 7fe011ffb700 1 --2- 172.21.15.72:0/3760350665 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe00006ace0 0x7fe00006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:54.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.008+0000 7fe011ffb700 1 -- 172.21.15.72:0/3760350665 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7238+0+0 (secure 0 0 0) 0x7fe00c0896e0 con 0x7fe01c139f80 2023-07-27T20:34:54.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.008+0000 7fe02159b700 1 --2- 172.21.15.72:0/3760350665 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe00006ace0 0x7fe00006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:54.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.009+0000 7fe02159b700 1 --2- 172.21.15.72:0/3760350665 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe00006ace0 0x7fe00006d1a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe018006fd0 tx=0x7fe018008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:54.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.012+0000 7fe011ffb700 1 -- 172.21.15.72:0/3760350665 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe00c0542e0 con 0x7fe01c139f80 2023-07-27T20:34:55.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.209+0000 7fe0237ff700 1 -- 172.21.15.72:0/3760350665 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe01c1515f0 con 0x7fe01c139f80 2023-07-27T20:34:55.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.211+0000 7fe011ffb700 1 -- 172.21.15.72:0/3760350665 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+22261 (secure 0 0 0) 0x7fe00c057900 con 0x7fe01c139f80 2023-07-27T20:34:55.198 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:34:55.199 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":66,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:34:52.125660+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:34:31.480063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-07-27T20:34:32.755579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_metadata","create_time":"2023-07-27T20:34:48.900422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs2_data","create_time":"2023-07-27T20:34:49.633712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:34:55.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.213+0000 7fe0237ff700 1 -- 172.21.15.72:0/3760350665 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe00006ace0 msgr2=0x7fe00006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:55.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.213+0000 7fe0237ff700 1 --2- 172.21.15.72:0/3760350665 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe00006ace0 0x7fe00006d1a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe018006fd0 tx=0x7fe018008040 comp rx=0 tx=0).stop 2023-07-27T20:34:55.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.213+0000 7fe0237ff700 1 -- 172.21.15.72:0/3760350665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe01c139f80 msgr2=0x7fe01c14dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:55.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.213+0000 7fe0237ff700 1 --2- 172.21.15.72:0/3760350665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe01c139f80 0x7fe01c14dce0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fe00c00c4d0 tx=0x7fe00c00c7e0 comp rx=0 tx=0).stop 2023-07-27T20:34:55.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.213+0000 7fe0237ff700 1 -- 172.21.15.72:0/3760350665 shutdown_connections 2023-07-27T20:34:55.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.213+0000 7fe0237ff700 1 --2- 172.21.15.72:0/3760350665 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe00006ace0 0x7fe00006d1a0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:55.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.213+0000 7fe0237ff700 1 --2- 172.21.15.72:0/3760350665 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe01c1542e0 0x7fe01c14e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:55.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.213+0000 7fe0237ff700 1 --2- 172.21.15.72:0/3760350665 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe01c139960 0x7fe01c0be990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:55.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.213+0000 7fe0237ff700 1 --2- 172.21.15.72:0/3760350665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe01c139f80 0x7fe01c14dce0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:55.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.213+0000 7fe0237ff700 1 -- 172.21.15.72:0/3760350665 >> 172.21.15.72:0/3760350665 conn(0x7fe01c06a190 msgr2=0x7fe01c1329e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:55.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.213+0000 7fe0237ff700 1 -- 172.21.15.72:0/3760350665 shutdown_connections 2023-07-27T20:34:55.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.214+0000 7fe0237ff700 1 -- 172.21.15.72:0/3760350665 wait complete. 2023-07-27T20:34:55.219 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-27T20:34:55.219 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T20:34:55.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.429+0000 7f3ed33ff700 1 Processor -- start 2023-07-27T20:34:55.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.429+0000 7f3ed33ff700 1 -- start start 2023-07-27T20:34:55.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.430+0000 7f3ed33ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ecc0aab30 0x7f3ecc0a8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:55.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.430+0000 7f3ed33ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ecc155600 con 0x7f3ecc13b2c0 2023-07-27T20:34:55.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.430+0000 7f3ed33ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ecc155320 con 0x7f3ecc0bfd90 2023-07-27T20:34:55.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.430+0000 7f3ed33ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc0a9620 con 0x7f3ecc0aab30 2023-07-27T20:34:55.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.430+0000 7f3ed119b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3ecc13b2c0 0x7f3ecc0aa420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54018/0 (socket says 172.21.15.72:54018) 2023-07-27T20:34:55.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.430+0000 7f3ed119b700 1 -- 172.21.15.72:0/3152952851 learned_addr learned my addr 172.21.15.72:0/3152952851 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:55.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.431+0000 7f3ed199c700 1 --2- 172.21.15.72:0/3152952851 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ecc0aab30 0x7f3ecc0a8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:55.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.431+0000 7f3ec3fff700 1 -- 172.21.15.72:0/3152952851 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3500762856 0 0) 0x7f3ecc155600 con 0x7f3ecc13b2c0 2023-07-27T20:34:55.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.431+0000 7f3ec3fff700 1 -- 172.21.15.72:0/3152952851 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3eb80035b0 con 0x7f3ecc13b2c0 2023-07-27T20:34:55.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.431+0000 7f3ec3fff700 1 -- 172.21.15.72:0/3152952851 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4263278092 0 0) 0x7f3ecc155320 con 0x7f3ecc0bfd90 2023-07-27T20:34:55.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.431+0000 7f3ec3fff700 1 -- 172.21.15.72:0/3152952851 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ecc155600 con 0x7f3ecc0bfd90 2023-07-27T20:34:55.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.431+0000 7f3ec3fff700 1 -- 172.21.15.72:0/3152952851 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3690295038 0 0) 0x7f3eb80035b0 con 0x7f3ecc13b2c0 2023-07-27T20:34:55.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.431+0000 7f3ec3fff700 1 -- 172.21.15.72:0/3152952851 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ecc0aab30 msgr2=0x7f3ecc0a8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:55.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.431+0000 7f3ec3fff700 1 --2- 172.21.15.72:0/3152952851 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ecc0aab30 0x7f3ecc0a8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:55.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.431+0000 7f3ec3fff700 1 -- 172.21.15.72:0/3152952851 >> v1:172.21.15.173:6789/0 conn(0x7f3ecc0bfd90 legacy=0x7f3ecc0a83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:55.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.431+0000 7f3ec3fff700 1 -- 172.21.15.72:0/3152952851 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ecc151e40 con 0x7f3ecc13b2c0 2023-07-27T20:34:55.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.431+0000 7f3ec3fff700 1 -- 172.21.15.72:0/3152952851 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f3ec8001670 con 0x7f3ecc13b2c0 2023-07-27T20:34:55.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.431+0000 7f3ec3fff700 1 -- 172.21.15.72:0/3152952851 >> v1:172.21.15.72:6789/0 conn(0x7f3ecc13b2c0 legacy=0x7f3ecc0aa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:55.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.431+0000 7f3ec3fff700 1 --2- 172.21.15.72:0/3152952851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb8003bc0 0x7f3eb8003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:55.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.431+0000 7f3ec3fff700 1 --2- 172.21.15.72:0/3152952851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3eb8004850 0x7f3eb8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:55.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.431+0000 7f3ec3fff700 1 --2- 172.21.15.72:0/3152952851 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ecc0aab30 0x7f3eb8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:55.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.431+0000 7f3ec3fff700 1 -- 172.21.15.72:0/3152952851 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc0a9620 con 0x7f3eb8003bc0 2023-07-27T20:34:55.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.431+0000 7f3ec3fff700 1 -- 172.21.15.72:0/3152952851 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb800bac0 con 0x7f3eb8004850 2023-07-27T20:34:55.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.431+0000 7f3ec3fff700 1 -- 172.21.15.72:0/3152952851 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb800bc80 con 0x7f3ecc0aab30 2023-07-27T20:34:55.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.432+0000 7f3ed119b700 1 --2- 172.21.15.72:0/3152952851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb8003bc0 0x7f3eb8003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:55.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.432+0000 7f3ed099a700 1 --2- 172.21.15.72:0/3152952851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3eb8004850 0x7f3eb8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:55.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.432+0000 7f3ed199c700 1 --2- 172.21.15.72:0/3152952851 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ecc0aab30 0x7f3eb8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:55.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.432+0000 7f3ed119b700 1 -- 172.21.15.72:0/3152952851 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ecc0aab30 msgr2=0x7f3eb8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:55.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.432+0000 7f3ed119b700 1 --2- 172.21.15.72:0/3152952851 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ecc0aab30 0x7f3eb8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:55.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.432+0000 7f3ed119b700 1 -- 172.21.15.72:0/3152952851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3eb8004850 msgr2=0x7f3eb8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:55.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.432+0000 7f3ed119b700 1 --2- 172.21.15.72:0/3152952851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3eb8004850 0x7f3eb8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:55.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.432+0000 7f3ed119b700 1 -- 172.21.15.72:0/3152952851 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb80035b0 con 0x7f3eb8003bc0 2023-07-27T20:34:55.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.432+0000 7f3ed119b700 1 --2- 172.21.15.72:0/3152952851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb8003bc0 0x7f3eb8003fc0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f3ec800c110 tx=0x7f3eb8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d2a8edf356a0aad server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:55.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.432+0000 7f3ec3fff700 1 -- 172.21.15.72:0/3152952851 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec800ccb0 con 0x7f3eb8003bc0 2023-07-27T20:34:55.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.432+0000 7f3ec3fff700 1 -- 172.21.15.72:0/3152952851 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec800ce10 con 0x7f3eb8003bc0 2023-07-27T20:34:55.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.432+0000 7f3ec3fff700 1 -- 172.21.15.72:0/3152952851 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec8005ba0 con 0x7f3eb8003bc0 2023-07-27T20:34:55.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.433+0000 7f3ed33ff700 1 -- 172.21.15.72:0/3152952851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb8003bc0 msgr2=0x7f3eb8003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:55.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.433+0000 7f3ed33ff700 1 --2- 172.21.15.72:0/3152952851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb8003bc0 0x7f3eb8003fc0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f3ec800c110 tx=0x7f3eb8005880 comp rx=0 tx=0).stop 2023-07-27T20:34:55.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.433+0000 7f3ed199c700 1 -- 172.21.15.72:0/3152952851 reap_dead start 2023-07-27T20:34:55.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.433+0000 7f3ed33ff700 1 -- 172.21.15.72:0/3152952851 shutdown_connections 2023-07-27T20:34:55.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.433+0000 7f3ed33ff700 1 -- 172.21.15.72:0/3152952851 >> 172.21.15.72:0/3152952851 conn(0x7f3ecc06a190 msgr2=0x7f3ecc06a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:55.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.433+0000 7f3ed33ff700 1 -- 172.21.15.72:0/3152952851 shutdown_connections 2023-07-27T20:34:55.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.433+0000 7f3ed33ff700 1 -- 172.21.15.72:0/3152952851 wait complete. 2023-07-27T20:34:55.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.435+0000 7f3ed33ff700 1 Processor -- start 2023-07-27T20:34:55.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.435+0000 7f3ed33ff700 1 -- start start 2023-07-27T20:34:55.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.436+0000 7f3ed33ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb8003bc0 0x7f3ecc0c1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:55.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.436+0000 7f3ed33ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ecc1ead40 0x7f3ecc1db390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:55.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.436+0000 7f3ed33ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ecc1db8d0 0x7f3ecc153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:55.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.436+0000 7f3ed33ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc1eba10 con 0x7f3eb8003bc0 2023-07-27T20:34:55.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.436+0000 7f3ed33ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc1eb730 con 0x7f3ecc1ead40 2023-07-27T20:34:55.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.436+0000 7f3ed33ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc0c2310 con 0x7f3ecc1db8d0 2023-07-27T20:34:55.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.436+0000 7f3ed119b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb8003bc0 0x7f3ecc0c1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:55.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.436+0000 7f3ed119b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb8003bc0 0x7f3ecc0c1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48384/0 (socket says 172.21.15.72:48384) 2023-07-27T20:34:55.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.436+0000 7f3ed119b700 1 -- 172.21.15.72:0/2865587037 learned_addr learned my addr 172.21.15.72:0/2865587037 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:55.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.436+0000 7f3ed099a700 1 --2- 172.21.15.72:0/2865587037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ecc1ead40 0x7f3ecc1db390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:55.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.436+0000 7f3ed199c700 1 --2- 172.21.15.72:0/2865587037 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ecc1db8d0 0x7f3ecc153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:55.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.436+0000 7f3ed119b700 1 -- 172.21.15.72:0/2865587037 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ecc1db8d0 msgr2=0x7f3ecc153370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:55.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.436+0000 7f3ed119b700 1 --2- 172.21.15.72:0/2865587037 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ecc1db8d0 0x7f3ecc153370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:55.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.436+0000 7f3ed119b700 1 -- 172.21.15.72:0/2865587037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ecc1ead40 msgr2=0x7f3ecc1db390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:55.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.436+0000 7f3ed119b700 1 --2- 172.21.15.72:0/2865587037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ecc1ead40 0x7f3ecc1db390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:55.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.436+0000 7f3ed119b700 1 -- 172.21.15.72:0/2865587037 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ecc0c25f0 con 0x7f3eb8003bc0 2023-07-27T20:34:55.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.436+0000 7f3ed099a700 1 --2- 172.21.15.72:0/2865587037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ecc1ead40 0x7f3ecc1db390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:55.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.437+0000 7f3ed119b700 1 --2- 172.21.15.72:0/2865587037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb8003bc0 0x7f3ecc0c1a30 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8005830 tx=0x7f3ec8001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:55.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.437+0000 7f3ec1ffb700 1 -- 172.21.15.72:0/2865587037 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec80072d0 con 0x7f3eb8003bc0 2023-07-27T20:34:55.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.437+0000 7f3ec1ffb700 1 -- 172.21.15.72:0/2865587037 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec8007430 con 0x7f3eb8003bc0 2023-07-27T20:34:55.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.437+0000 7f3ed33ff700 1 -- 172.21.15.72:0/2865587037 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ecc1eba10 con 0x7f3eb8003bc0 2023-07-27T20:34:55.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.437+0000 7f3ec1ffb700 1 -- 172.21.15.72:0/2865587037 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec80077a0 con 0x7f3eb8003bc0 2023-07-27T20:34:55.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.437+0000 7f3ed33ff700 1 -- 172.21.15.72:0/2865587037 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ecc0c0950 con 0x7f3eb8003bc0 2023-07-27T20:34:55.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.438+0000 7f3ed33ff700 1 -- 172.21.15.72:0/2865587037 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ecc0c1880 con 0x7f3eb8003bc0 2023-07-27T20:34:55.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.439+0000 7f3ec1ffb700 1 -- 172.21.15.72:0/2865587037 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3ec8019030 con 0x7f3eb8003bc0 2023-07-27T20:34:55.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.440+0000 7f3ec1ffb700 1 --2- 172.21.15.72:0/2865587037 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3eb006ace0 0x7f3eb006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:55.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.440+0000 7f3ec1ffb700 1 -- 172.21.15.72:0/2865587037 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f3ec808ae60 con 0x7f3eb8003bc0 2023-07-27T20:34:55.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.440+0000 7f3ed099a700 1 --2- 172.21.15.72:0/2865587037 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3eb006ace0 0x7f3eb006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:55.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.441+0000 7f3ed099a700 1 --2- 172.21.15.72:0/2865587037 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3eb006ace0 0x7f3eb006d1a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc073470 tx=0x7f3ebc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:55.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.444+0000 7f3ec1ffb700 1 -- 172.21.15.72:0/2865587037 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3ec8055c20 con 0x7f3eb8003bc0 2023-07-27T20:34:55.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.632+0000 7f3ed33ff700 1 -- 172.21.15.72:0/2865587037 --> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3ecc152400 con 0x7f3eb006ace0 2023-07-27T20:34:55.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.649+0000 7f3ec1ffb700 1 -- 172.21.15.72:0/2865587037 <== mgr.4107 v2:172.21.15.173:6832/910681537 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+538240 (secure 0 0 0) 0x7f3ebc0052b0 con 0x7f3eb006ace0 2023-07-27T20:34:55.642 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:34:55.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.654+0000 7f3ed33ff700 1 -- 172.21.15.72:0/2865587037 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3eb006ace0 msgr2=0x7f3eb006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:55.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.654+0000 7f3ed33ff700 1 --2- 172.21.15.72:0/2865587037 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3eb006ace0 0x7f3eb006d1a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc073470 tx=0x7f3ebc009040 comp rx=0 tx=0).stop 2023-07-27T20:34:55.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.654+0000 7f3ed33ff700 1 -- 172.21.15.72:0/2865587037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb8003bc0 msgr2=0x7f3ecc0c1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:55.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.654+0000 7f3ed33ff700 1 --2- 172.21.15.72:0/2865587037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb8003bc0 0x7f3ecc0c1a30 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8005830 tx=0x7f3ec8001930 comp rx=0 tx=0).stop 2023-07-27T20:34:55.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.654+0000 7f3ed33ff700 1 -- 172.21.15.72:0/2865587037 shutdown_connections 2023-07-27T20:34:55.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.654+0000 7f3ed33ff700 1 --2- 172.21.15.72:0/2865587037 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3eb006ace0 0x7f3eb006d1a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:55.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.654+0000 7f3ed33ff700 1 --2- 172.21.15.72:0/2865587037 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ecc1db8d0 0x7f3ecc153370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:55.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.654+0000 7f3ed33ff700 1 --2- 172.21.15.72:0/2865587037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb8003bc0 0x7f3ecc0c1a30 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:55.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.654+0000 7f3ed33ff700 1 --2- 172.21.15.72:0/2865587037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ecc1ead40 0x7f3ecc1db390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:55.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.654+0000 7f3ed33ff700 1 -- 172.21.15.72:0/2865587037 >> 172.21.15.72:0/2865587037 conn(0x7f3ecc06a190 msgr2=0x7f3ecc14fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:55.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.654+0000 7f3ed33ff700 1 -- 172.21.15.72:0/2865587037 shutdown_connections 2023-07-27T20:34:55.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.654+0000 7f3ed33ff700 1 -- 172.21.15.72:0/2865587037 wait complete. 2023-07-27T20:34:55.647 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-07-27T20:34:55.660 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":169,"stamp":"2023-07-27T20:34:54.579868+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594427,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":225,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223312,"kb_used_data":7152,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754751408,"statfs":{"total":773094113280,"available":772865441792,"internally_reserved":0,"allocated":7323648,"data_stored":4094630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.429404"},"pg_stats":[{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.154878+0000","last_change":"2023-07-27T20:34:34.316234+0000","last_active":"2023-07-27T20:34:49.154878+0000","last_peered":"2023-07-27T20:34:49.154878+0000","last_clean":"2023-07-27T20:34:49.154878+0000","last_became_active":"2023-07-27T20:34:34.315976+0000","last_became_peered":"2023-07-27T20:34:34.315976+0000","last_unstale":"2023-07-27T20:34:49.154878+0000","last_undegraded":"2023-07-27T20:34:49.154878+0000","last_fullsized":"2023-07-27T20:34:49.154878+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:33:06.823968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.163915+0000","last_change":"2023-07-27T20:34:34.314798+0000","last_active":"2023-07-27T20:34:49.163915+0000","last_peered":"2023-07-27T20:34:49.163915+0000","last_clean":"2023-07-27T20:34:49.163915+0000","last_became_active":"2023-07-27T20:34:34.314515+0000","last_became_peered":"2023-07-27T20:34:34.314515+0000","last_unstale":"2023-07-27T20:34:49.163915+0000","last_undegraded":"2023-07-27T20:34:49.163915+0000","last_fullsized":"2023-07-27T20:34:49.163915+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:41:23.899695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.156360+0000","last_change":"2023-07-27T20:34:34.296875+0000","last_active":"2023-07-27T20:34:49.156360+0000","last_peered":"2023-07-27T20:34:49.156360+0000","last_clean":"2023-07-27T20:34:49.156360+0000","last_became_active":"2023-07-27T20:34:34.296594+0000","last_became_peered":"2023-07-27T20:34:34.296594+0000","last_unstale":"2023-07-27T20:34:49.156360+0000","last_undegraded":"2023-07-27T20:34:49.156360+0000","last_fullsized":"2023-07-27T20:34:49.156360+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:01:48.226485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.158254+0000","last_change":"2023-07-27T20:34:34.316000+0000","last_active":"2023-07-27T20:34:49.158254+0000","last_peered":"2023-07-27T20:34:49.158254+0000","last_clean":"2023-07-27T20:34:49.158254+0000","last_became_active":"2023-07-27T20:34:34.315494+0000","last_became_peered":"2023-07-27T20:34:34.315494+0000","last_unstale":"2023-07-27T20:34:49.158254+0000","last_undegraded":"2023-07-27T20:34:49.158254+0000","last_fullsized":"2023-07-27T20:34:49.158254+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:57:36.260593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.160620+0000","last_change":"2023-07-27T20:34:34.310257+0000","last_active":"2023-07-27T20:34:49.160620+0000","last_peered":"2023-07-27T20:34:49.160620+0000","last_clean":"2023-07-27T20:34:49.160620+0000","last_became_active":"2023-07-27T20:34:34.309918+0000","last_became_peered":"2023-07-27T20:34:34.309918+0000","last_unstale":"2023-07-27T20:34:49.160620+0000","last_undegraded":"2023-07-27T20:34:49.160620+0000","last_fullsized":"2023-07-27T20:34:49.160620+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:26:30.304005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.163089+0000","last_change":"2023-07-27T20:34:34.319670+0000","last_active":"2023-07-27T20:34:49.163089+0000","last_peered":"2023-07-27T20:34:49.163089+0000","last_clean":"2023-07-27T20:34:49.163089+0000","last_became_active":"2023-07-27T20:34:34.319356+0000","last_became_peered":"2023-07-27T20:34:34.319356+0000","last_unstale":"2023-07-27T20:34:49.163089+0000","last_undegraded":"2023-07-27T20:34:49.163089+0000","last_fullsized":"2023-07-27T20:34:49.163089+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:08:06.361073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.154149+0000","last_change":"2023-07-27T20:34:34.300907+0000","last_active":"2023-07-27T20:34:49.154149+0000","last_peered":"2023-07-27T20:34:49.154149+0000","last_clean":"2023-07-27T20:34:49.154149+0000","last_became_active":"2023-07-27T20:34:34.300633+0000","last_became_peered":"2023-07-27T20:34:34.300633+0000","last_unstale":"2023-07-27T20:34:49.154149+0000","last_undegraded":"2023-07-27T20:34:49.154149+0000","last_fullsized":"2023-07-27T20:34:49.154149+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:53:59.110579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.163018+0000","last_change":"2023-07-27T20:34:34.320735+0000","last_active":"2023-07-27T20:34:49.163018+0000","last_peered":"2023-07-27T20:34:49.163018+0000","last_clean":"2023-07-27T20:34:49.163018+0000","last_became_active":"2023-07-27T20:34:34.320086+0000","last_became_peered":"2023-07-27T20:34:34.320086+0000","last_unstale":"2023-07-27T20:34:49.163018+0000","last_undegraded":"2023-07-27T20:34:49.163018+0000","last_fullsized":"2023-07-27T20:34:49.163018+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:37:00.088890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.162009+0000","last_change":"2023-07-27T20:34:34.304314+0000","last_active":"2023-07-27T20:34:49.162009+0000","last_peered":"2023-07-27T20:34:49.162009+0000","last_clean":"2023-07-27T20:34:49.162009+0000","last_became_active":"2023-07-27T20:34:34.304042+0000","last_became_peered":"2023-07-27T20:34:34.304042+0000","last_unstale":"2023-07-27T20:34:49.162009+0000","last_undegraded":"2023-07-27T20:34:49.162009+0000","last_fullsized":"2023-07-27T20:34:49.162009+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:07:41.809462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.159019+0000","last_change":"2023-07-27T20:34:34.302549+0000","last_active":"2023-07-27T20:34:49.159019+0000","last_peered":"2023-07-27T20:34:49.159019+0000","last_clean":"2023-07-27T20:34:49.159019+0000","last_became_active":"2023-07-27T20:34:34.301699+0000","last_became_peered":"2023-07-27T20:34:34.301699+0000","last_unstale":"2023-07-27T20:34:49.159019+0000","last_undegraded":"2023-07-27T20:34:49.159019+0000","last_fullsized":"2023-07-27T20:34:49.159019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:01:48.226485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.154716+0000","last_change":"2023-07-27T20:34:34.313419+0000","last_active":"2023-07-27T20:34:49.154716+0000","last_peered":"2023-07-27T20:34:49.154716+0000","last_clean":"2023-07-27T20:34:49.154716+0000","last_became_active":"2023-07-27T20:34:34.313089+0000","last_became_peered":"2023-07-27T20:34:34.313089+0000","last_unstale":"2023-07-27T20:34:49.154716+0000","last_undegraded":"2023-07-27T20:34:49.154716+0000","last_fullsized":"2023-07-27T20:34:49.154716+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:22:39.673260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.158388+0000","last_change":"2023-07-27T20:34:34.298435+0000","last_active":"2023-07-27T20:34:49.158388+0000","last_peered":"2023-07-27T20:34:49.158388+0000","last_clean":"2023-07-27T20:34:49.158388+0000","last_became_active":"2023-07-27T20:34:34.298143+0000","last_became_peered":"2023-07-27T20:34:34.298143+0000","last_unstale":"2023-07-27T20:34:49.158388+0000","last_undegraded":"2023-07-27T20:34:49.158388+0000","last_fullsized":"2023-07-27T20:34:49.158388+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:59:35.844198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.151966+0000","last_change":"2023-07-27T20:34:34.316878+0000","last_active":"2023-07-27T20:34:49.151966+0000","last_peered":"2023-07-27T20:34:49.151966+0000","last_clean":"2023-07-27T20:34:49.151966+0000","last_became_active":"2023-07-27T20:34:34.316610+0000","last_became_peered":"2023-07-27T20:34:34.316610+0000","last_unstale":"2023-07-27T20:34:49.151966+0000","last_undegraded":"2023-07-27T20:34:49.151966+0000","last_fullsized":"2023-07-27T20:34:49.151966+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:13:03.759838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.160779+0000","last_change":"2023-07-27T20:34:34.297203+0000","last_active":"2023-07-27T20:34:49.160779+0000","last_peered":"2023-07-27T20:34:49.160779+0000","last_clean":"2023-07-27T20:34:49.160779+0000","last_became_active":"2023-07-27T20:34:34.296957+0000","last_became_peered":"2023-07-27T20:34:34.296957+0000","last_unstale":"2023-07-27T20:34:49.160779+0000","last_undegraded":"2023-07-27T20:34:49.160779+0000","last_fullsized":"2023-07-27T20:34:49.160779+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:04:33.468676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.151829+0000","last_change":"2023-07-27T20:34:34.294995+0000","last_active":"2023-07-27T20:34:49.151829+0000","last_peered":"2023-07-27T20:34:49.151829+0000","last_clean":"2023-07-27T20:34:49.151829+0000","last_became_active":"2023-07-27T20:34:34.294646+0000","last_became_peered":"2023-07-27T20:34:34.294646+0000","last_unstale":"2023-07-27T20:34:49.151829+0000","last_undegraded":"2023-07-27T20:34:49.151829+0000","last_fullsized":"2023-07-27T20:34:49.151829+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:25:42.182409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.158094+0000","last_change":"2023-07-27T20:34:34.309167+0000","last_active":"2023-07-27T20:34:49.158094+0000","last_peered":"2023-07-27T20:34:49.158094+0000","last_clean":"2023-07-27T20:34:49.158094+0000","last_became_active":"2023-07-27T20:34:34.308831+0000","last_became_peered":"2023-07-27T20:34:34.308831+0000","last_unstale":"2023-07-27T20:34:49.158094+0000","last_undegraded":"2023-07-27T20:34:49.158094+0000","last_fullsized":"2023-07-27T20:34:49.158094+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:09:19.279175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.162008+0000","last_change":"2023-07-27T20:34:34.298405+0000","last_active":"2023-07-27T20:34:49.162008+0000","last_peered":"2023-07-27T20:34:49.162008+0000","last_clean":"2023-07-27T20:34:49.162008+0000","last_became_active":"2023-07-27T20:34:34.298150+0000","last_became_peered":"2023-07-27T20:34:34.298150+0000","last_unstale":"2023-07-27T20:34:49.162008+0000","last_undegraded":"2023-07-27T20:34:49.162008+0000","last_fullsized":"2023-07-27T20:34:49.162008+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:27:45.358766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.158193+0000","last_change":"2023-07-27T20:34:34.316418+0000","last_active":"2023-07-27T20:34:49.158193+0000","last_peered":"2023-07-27T20:34:49.158193+0000","last_clean":"2023-07-27T20:34:49.158193+0000","last_became_active":"2023-07-27T20:34:34.316164+0000","last_became_peered":"2023-07-27T20:34:34.316164+0000","last_unstale":"2023-07-27T20:34:49.158193+0000","last_undegraded":"2023-07-27T20:34:49.158193+0000","last_fullsized":"2023-07-27T20:34:49.158193+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:57:09.026861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.163708+0000","last_change":"2023-07-27T20:34:34.322046+0000","last_active":"2023-07-27T20:34:49.163708+0000","last_peered":"2023-07-27T20:34:49.163708+0000","last_clean":"2023-07-27T20:34:49.163708+0000","last_became_active":"2023-07-27T20:34:34.321751+0000","last_became_peered":"2023-07-27T20:34:34.321751+0000","last_unstale":"2023-07-27T20:34:49.163708+0000","last_undegraded":"2023-07-27T20:34:49.163708+0000","last_fullsized":"2023-07-27T20:34:49.163708+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:15:19.381194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.152003+0000","last_change":"2023-07-27T20:34:34.298450+0000","last_active":"2023-07-27T20:34:49.152003+0000","last_peered":"2023-07-27T20:34:49.152003+0000","last_clean":"2023-07-27T20:34:49.152003+0000","last_became_active":"2023-07-27T20:34:34.298194+0000","last_became_peered":"2023-07-27T20:34:34.298194+0000","last_unstale":"2023-07-27T20:34:49.152003+0000","last_undegraded":"2023-07-27T20:34:49.152003+0000","last_fullsized":"2023-07-27T20:34:49.152003+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:34:27.632697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.158713+0000","last_change":"2023-07-27T20:34:34.295428+0000","last_active":"2023-07-27T20:34:49.158713+0000","last_peered":"2023-07-27T20:34:49.158713+0000","last_clean":"2023-07-27T20:34:49.158713+0000","last_became_active":"2023-07-27T20:34:34.295069+0000","last_became_peered":"2023-07-27T20:34:34.295069+0000","last_unstale":"2023-07-27T20:34:49.158713+0000","last_undegraded":"2023-07-27T20:34:49.158713+0000","last_fullsized":"2023-07-27T20:34:49.158713+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:54:18.189843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.158699+0000","last_change":"2023-07-27T20:34:34.300794+0000","last_active":"2023-07-27T20:34:49.158699+0000","last_peered":"2023-07-27T20:34:49.158699+0000","last_clean":"2023-07-27T20:34:49.158699+0000","last_became_active":"2023-07-27T20:34:34.300470+0000","last_became_peered":"2023-07-27T20:34:34.300470+0000","last_unstale":"2023-07-27T20:34:49.158699+0000","last_undegraded":"2023-07-27T20:34:49.158699+0000","last_fullsized":"2023-07-27T20:34:49.158699+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:12:47.413814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.153483+0000","last_change":"2023-07-27T20:34:34.306170+0000","last_active":"2023-07-27T20:34:49.153483+0000","last_peered":"2023-07-27T20:34:49.153483+0000","last_clean":"2023-07-27T20:34:49.153483+0000","last_became_active":"2023-07-27T20:34:34.305895+0000","last_became_peered":"2023-07-27T20:34:34.305895+0000","last_unstale":"2023-07-27T20:34:49.153483+0000","last_undegraded":"2023-07-27T20:34:49.153483+0000","last_fullsized":"2023-07-27T20:34:49.153483+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:08:39.732716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.153665+0000","last_change":"2023-07-27T20:34:34.324172+0000","last_active":"2023-07-27T20:34:49.153665+0000","last_peered":"2023-07-27T20:34:49.153665+0000","last_clean":"2023-07-27T20:34:49.153665+0000","last_became_active":"2023-07-27T20:34:34.323886+0000","last_became_peered":"2023-07-27T20:34:34.323886+0000","last_unstale":"2023-07-27T20:34:49.153665+0000","last_undegraded":"2023-07-27T20:34:49.153665+0000","last_fullsized":"2023-07-27T20:34:49.153665+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:06:44.358382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.158777+0000","last_change":"2023-07-27T20:34:34.312549+0000","last_active":"2023-07-27T20:34:49.158777+0000","last_peered":"2023-07-27T20:34:49.158777+0000","last_clean":"2023-07-27T20:34:49.158777+0000","last_became_active":"2023-07-27T20:34:34.311940+0000","last_became_peered":"2023-07-27T20:34:34.311940+0000","last_unstale":"2023-07-27T20:34:49.158777+0000","last_undegraded":"2023-07-27T20:34:49.158777+0000","last_fullsized":"2023-07-27T20:34:49.158777+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:58:23.176880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.155053+0000","last_change":"2023-07-27T20:34:34.315088+0000","last_active":"2023-07-27T20:34:49.155053+0000","last_peered":"2023-07-27T20:34:49.155053+0000","last_clean":"2023-07-27T20:34:49.155053+0000","last_became_active":"2023-07-27T20:34:34.314823+0000","last_became_peered":"2023-07-27T20:34:34.314823+0000","last_unstale":"2023-07-27T20:34:49.155053+0000","last_undegraded":"2023-07-27T20:34:49.155053+0000","last_fullsized":"2023-07-27T20:34:49.155053+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:57:27.220593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.156477+0000","last_change":"2023-07-27T20:34:34.309744+0000","last_active":"2023-07-27T20:34:49.156477+0000","last_peered":"2023-07-27T20:34:49.156477+0000","last_clean":"2023-07-27T20:34:49.156477+0000","last_became_active":"2023-07-27T20:34:34.309438+0000","last_became_peered":"2023-07-27T20:34:34.309438+0000","last_unstale":"2023-07-27T20:34:49.156477+0000","last_undegraded":"2023-07-27T20:34:49.156477+0000","last_fullsized":"2023-07-27T20:34:49.156477+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:32:37.897239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.158923+0000","last_change":"2023-07-27T20:34:34.300111+0000","last_active":"2023-07-27T20:34:49.158923+0000","last_peered":"2023-07-27T20:34:49.158923+0000","last_clean":"2023-07-27T20:34:49.158923+0000","last_became_active":"2023-07-27T20:34:34.298555+0000","last_became_peered":"2023-07-27T20:34:34.298555+0000","last_unstale":"2023-07-27T20:34:49.158923+0000","last_undegraded":"2023-07-27T20:34:49.158923+0000","last_fullsized":"2023-07-27T20:34:49.158923+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:33:33.672903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.156655+0000","last_change":"2023-07-27T20:34:34.299682+0000","last_active":"2023-07-27T20:34:49.156655+0000","last_peered":"2023-07-27T20:34:49.156655+0000","last_clean":"2023-07-27T20:34:49.156655+0000","last_became_active":"2023-07-27T20:34:34.299402+0000","last_became_peered":"2023-07-27T20:34:34.299402+0000","last_unstale":"2023-07-27T20:34:49.156655+0000","last_undegraded":"2023-07-27T20:34:49.156655+0000","last_fullsized":"2023-07-27T20:34:49.156655+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:50:09.306756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.153607+0000","last_change":"2023-07-27T20:34:34.320185+0000","last_active":"2023-07-27T20:34:49.153607+0000","last_peered":"2023-07-27T20:34:49.153607+0000","last_clean":"2023-07-27T20:34:49.153607+0000","last_became_active":"2023-07-27T20:34:34.319865+0000","last_became_peered":"2023-07-27T20:34:34.319865+0000","last_unstale":"2023-07-27T20:34:49.153607+0000","last_undegraded":"2023-07-27T20:34:49.153607+0000","last_fullsized":"2023-07-27T20:34:49.153607+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:52:46.464966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.154330+0000","last_change":"2023-07-27T20:34:34.297379+0000","last_active":"2023-07-27T20:34:49.154330+0000","last_peered":"2023-07-27T20:34:49.154330+0000","last_clean":"2023-07-27T20:34:49.154330+0000","last_became_active":"2023-07-27T20:34:34.297105+0000","last_became_peered":"2023-07-27T20:34:34.297105+0000","last_unstale":"2023-07-27T20:34:49.154330+0000","last_undegraded":"2023-07-27T20:34:49.154330+0000","last_fullsized":"2023-07-27T20:34:49.154330+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:14:10.177189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.163048+0000","last_change":"2023-07-27T20:34:34.321045+0000","last_active":"2023-07-27T20:34:49.163048+0000","last_peered":"2023-07-27T20:34:49.163048+0000","last_clean":"2023-07-27T20:34:49.163048+0000","last_became_active":"2023-07-27T20:34:34.320433+0000","last_became_peered":"2023-07-27T20:34:34.320433+0000","last_unstale":"2023-07-27T20:34:49.163048+0000","last_undegraded":"2023-07-27T20:34:49.163048+0000","last_fullsized":"2023-07-27T20:34:49.163048+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:05:05.214592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.154252+0000","last_change":"2023-07-27T20:34:49.154252+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.154252+0000","last_undegraded":"2023-07-27T20:34:49.154252+0000","last_fullsized":"2023-07-27T20:34:49.154252+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.154639+0000","last_change":"2023-07-27T20:34:34.325790+0000","last_active":"2023-07-27T20:34:49.154639+0000","last_peered":"2023-07-27T20:34:49.154639+0000","last_clean":"2023-07-27T20:34:49.154639+0000","last_became_active":"2023-07-27T20:34:34.325387+0000","last_became_peered":"2023-07-27T20:34:34.325387+0000","last_unstale":"2023-07-27T20:34:49.154639+0000","last_undegraded":"2023-07-27T20:34:49.154639+0000","last_fullsized":"2023-07-27T20:34:49.154639+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:42:19.886381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"61'4","reported_seq":19,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.155258+0000","last_change":"2023-07-27T20:34:33.303138+0000","last_active":"2023-07-27T20:34:49.155258+0000","last_peered":"2023-07-27T20:34:49.155258+0000","last_clean":"2023-07-27T20:34:49.155258+0000","last_became_active":"2023-07-27T20:34:33.302808+0000","last_became_peered":"2023-07-27T20:34:33.302808+0000","last_unstale":"2023-07-27T20:34:49.155258+0000","last_undegraded":"2023-07-27T20:34:49.155258+0000","last_fullsized":"2023-07-27T20:34:49.155258+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:34:47.776999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.156049+0000","last_change":"2023-07-27T20:34:49.156049+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.156049+0000","last_undegraded":"2023-07-27T20:34:49.156049+0000","last_fullsized":"2023-07-27T20:34:49.156049+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.162128+0000","last_change":"2023-07-27T20:34:34.298335+0000","last_active":"2023-07-27T20:34:49.162128+0000","last_peered":"2023-07-27T20:34:49.162128+0000","last_clean":"2023-07-27T20:34:49.162128+0000","last_became_active":"2023-07-27T20:34:34.298050+0000","last_became_peered":"2023-07-27T20:34:34.298050+0000","last_unstale":"2023-07-27T20:34:49.162128+0000","last_undegraded":"2023-07-27T20:34:49.162128+0000","last_fullsized":"2023-07-27T20:34:49.162128+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:27:35.353575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"61'1","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.152203+0000","last_change":"2023-07-27T20:34:33.298365+0000","last_active":"2023-07-27T20:34:49.152203+0000","last_peered":"2023-07-27T20:34:49.152203+0000","last_clean":"2023-07-27T20:34:49.152203+0000","last_became_active":"2023-07-27T20:34:33.298105+0000","last_became_peered":"2023-07-27T20:34:33.298105+0000","last_unstale":"2023-07-27T20:34:49.152203+0000","last_undegraded":"2023-07-27T20:34:49.152203+0000","last_fullsized":"2023-07-27T20:34:49.152203+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:51:16.894541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.157025+0000","last_change":"2023-07-27T20:34:49.157025+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.157025+0000","last_undegraded":"2023-07-27T20:34:49.157025+0000","last_fullsized":"2023-07-27T20:34:49.157025+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.163569+0000","last_change":"2023-07-27T20:34:34.323261+0000","last_active":"2023-07-27T20:34:49.163569+0000","last_peered":"2023-07-27T20:34:49.163569+0000","last_clean":"2023-07-27T20:34:49.163569+0000","last_became_active":"2023-07-27T20:34:34.322945+0000","last_became_peered":"2023-07-27T20:34:34.322945+0000","last_unstale":"2023-07-27T20:34:49.163569+0000","last_undegraded":"2023-07-27T20:34:49.163569+0000","last_fullsized":"2023-07-27T20:34:49.163569+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:14:40.775158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"61'2","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.158956+0000","last_change":"2023-07-27T20:34:33.303171+0000","last_active":"2023-07-27T20:34:49.158956+0000","last_peered":"2023-07-27T20:34:49.158956+0000","last_clean":"2023-07-27T20:34:49.158956+0000","last_became_active":"2023-07-27T20:34:33.302865+0000","last_became_peered":"2023-07-27T20:34:33.302865+0000","last_unstale":"2023-07-27T20:34:49.158956+0000","last_undegraded":"2023-07-27T20:34:49.158956+0000","last_fullsized":"2023-07-27T20:34:49.158956+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:33:01.060593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.157759+0000","last_change":"2023-07-27T20:34:49.157759+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.157759+0000","last_undegraded":"2023-07-27T20:34:49.157759+0000","last_fullsized":"2023-07-27T20:34:49.157759+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.154863+0000","last_change":"2023-07-27T20:34:34.314330+0000","last_active":"2023-07-27T20:34:49.154863+0000","last_peered":"2023-07-27T20:34:49.154863+0000","last_clean":"2023-07-27T20:34:49.154863+0000","last_became_active":"2023-07-27T20:34:34.314054+0000","last_became_peered":"2023-07-27T20:34:34.314054+0000","last_unstale":"2023-07-27T20:34:49.154863+0000","last_undegraded":"2023-07-27T20:34:49.154863+0000","last_fullsized":"2023-07-27T20:34:49.154863+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:26:48.653404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"61'2","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.163826+0000","last_change":"2023-07-27T20:34:33.307004+0000","last_active":"2023-07-27T20:34:49.163826+0000","last_peered":"2023-07-27T20:34:49.163826+0000","last_clean":"2023-07-27T20:34:49.163826+0000","last_became_active":"2023-07-27T20:34:33.306710+0000","last_became_peered":"2023-07-27T20:34:33.306710+0000","last_unstale":"2023-07-27T20:34:49.163826+0000","last_undegraded":"2023-07-27T20:34:49.163826+0000","last_fullsized":"2023-07-27T20:34:49.163826+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:51:29.915647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.154932+0000","last_change":"2023-07-27T20:34:49.154932+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.154932+0000","last_undegraded":"2023-07-27T20:34:49.154932+0000","last_fullsized":"2023-07-27T20:34:49.154932+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.153869+0000","last_change":"2023-07-27T20:34:34.304872+0000","last_active":"2023-07-27T20:34:49.153869+0000","last_peered":"2023-07-27T20:34:49.153869+0000","last_clean":"2023-07-27T20:34:49.153869+0000","last_became_active":"2023-07-27T20:34:34.304583+0000","last_became_peered":"2023-07-27T20:34:34.304583+0000","last_unstale":"2023-07-27T20:34:49.153869+0000","last_undegraded":"2023-07-27T20:34:49.153869+0000","last_fullsized":"2023-07-27T20:34:49.153869+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:16:10.931367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"61'1","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.156957+0000","last_change":"2023-07-27T20:34:33.303472+0000","last_active":"2023-07-27T20:34:49.156957+0000","last_peered":"2023-07-27T20:34:49.156957+0000","last_clean":"2023-07-27T20:34:49.156957+0000","last_became_active":"2023-07-27T20:34:33.303211+0000","last_became_peered":"2023-07-27T20:34:33.303211+0000","last_unstale":"2023-07-27T20:34:49.156957+0000","last_undegraded":"2023-07-27T20:34:49.156957+0000","last_fullsized":"2023-07-27T20:34:49.156957+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:45:42.296046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.155023+0000","last_change":"2023-07-27T20:34:49.155023+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.155023+0000","last_undegraded":"2023-07-27T20:34:49.155023+0000","last_fullsized":"2023-07-27T20:34:49.155023+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.158957+0000","last_change":"2023-07-27T20:34:34.309855+0000","last_active":"2023-07-27T20:34:49.158957+0000","last_peered":"2023-07-27T20:34:49.158957+0000","last_clean":"2023-07-27T20:34:49.158957+0000","last_became_active":"2023-07-27T20:34:34.309553+0000","last_became_peered":"2023-07-27T20:34:34.309553+0000","last_unstale":"2023-07-27T20:34:49.158957+0000","last_undegraded":"2023-07-27T20:34:49.158957+0000","last_fullsized":"2023-07-27T20:34:49.158957+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:45:52.450376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"61'1","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.163193+0000","last_change":"2023-07-27T20:34:33.307265+0000","last_active":"2023-07-27T20:34:49.163193+0000","last_peered":"2023-07-27T20:34:49.163193+0000","last_clean":"2023-07-27T20:34:49.163193+0000","last_became_active":"2023-07-27T20:34:33.306583+0000","last_became_peered":"2023-07-27T20:34:33.306583+0000","last_unstale":"2023-07-27T20:34:49.163193+0000","last_undegraded":"2023-07-27T20:34:49.163193+0000","last_fullsized":"2023-07-27T20:34:49.163193+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:05:02.789753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.162353+0000","last_change":"2023-07-27T20:34:49.162353+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.162353+0000","last_undegraded":"2023-07-27T20:34:49.162353+0000","last_fullsized":"2023-07-27T20:34:49.162353+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.159725+0000","last_change":"2023-07-27T20:34:34.305104+0000","last_active":"2023-07-27T20:34:49.159725+0000","last_peered":"2023-07-27T20:34:49.159725+0000","last_clean":"2023-07-27T20:34:49.159725+0000","last_became_active":"2023-07-27T20:34:34.304828+0000","last_became_peered":"2023-07-27T20:34:34.304828+0000","last_unstale":"2023-07-27T20:34:49.159725+0000","last_undegraded":"2023-07-27T20:34:49.159725+0000","last_fullsized":"2023-07-27T20:34:49.159725+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:28:26.215983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.157532+0000","last_change":"2023-07-27T20:34:33.304005+0000","last_active":"2023-07-27T20:34:49.157532+0000","last_peered":"2023-07-27T20:34:49.157532+0000","last_clean":"2023-07-27T20:34:49.157532+0000","last_became_active":"2023-07-27T20:34:33.303744+0000","last_became_peered":"2023-07-27T20:34:33.303744+0000","last_unstale":"2023-07-27T20:34:49.157532+0000","last_undegraded":"2023-07-27T20:34:49.157532+0000","last_fullsized":"2023-07-27T20:34:49.157532+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:35:04.860322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.156981+0000","last_change":"2023-07-27T20:34:49.156981+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.156981+0000","last_undegraded":"2023-07-27T20:34:49.156981+0000","last_fullsized":"2023-07-27T20:34:49.156981+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.151885+0000","last_change":"2023-07-27T20:34:34.310350+0000","last_active":"2023-07-27T20:34:49.151885+0000","last_peered":"2023-07-27T20:34:49.151885+0000","last_clean":"2023-07-27T20:34:49.151885+0000","last_became_active":"2023-07-27T20:34:34.310068+0000","last_became_peered":"2023-07-27T20:34:34.310068+0000","last_unstale":"2023-07-27T20:34:49.151885+0000","last_undegraded":"2023-07-27T20:34:49.151885+0000","last_fullsized":"2023-07-27T20:34:49.151885+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:59:08.804625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.159915+0000","last_change":"2023-07-27T20:34:33.299254+0000","last_active":"2023-07-27T20:34:49.159915+0000","last_peered":"2023-07-27T20:34:49.159915+0000","last_clean":"2023-07-27T20:34:49.159915+0000","last_became_active":"2023-07-27T20:34:33.298978+0000","last_became_peered":"2023-07-27T20:34:33.298978+0000","last_unstale":"2023-07-27T20:34:49.159915+0000","last_undegraded":"2023-07-27T20:34:49.159915+0000","last_fullsized":"2023-07-27T20:34:49.159915+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:48:52.025296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.153002+0000","last_change":"2023-07-27T20:34:49.153002+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.153002+0000","last_undegraded":"2023-07-27T20:34:49.153002+0000","last_fullsized":"2023-07-27T20:34:49.153002+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.155179+0000","last_change":"2023-07-27T20:34:34.313397+0000","last_active":"2023-07-27T20:34:49.155179+0000","last_peered":"2023-07-27T20:34:49.155179+0000","last_clean":"2023-07-27T20:34:49.155179+0000","last_became_active":"2023-07-27T20:34:34.313128+0000","last_became_peered":"2023-07-27T20:34:34.313128+0000","last_unstale":"2023-07-27T20:34:49.155179+0000","last_undegraded":"2023-07-27T20:34:49.155179+0000","last_fullsized":"2023-07-27T20:34:49.155179+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:23:24.266770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.158958+0000","last_change":"2023-07-27T20:34:33.299760+0000","last_active":"2023-07-27T20:34:49.158958+0000","last_peered":"2023-07-27T20:34:49.158958+0000","last_clean":"2023-07-27T20:34:49.158958+0000","last_became_active":"2023-07-27T20:34:33.299488+0000","last_became_peered":"2023-07-27T20:34:33.299488+0000","last_unstale":"2023-07-27T20:34:49.158958+0000","last_undegraded":"2023-07-27T20:34:49.158958+0000","last_fullsized":"2023-07-27T20:34:49.158958+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:16:26.061594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.154318+0000","last_change":"2023-07-27T20:34:49.154318+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.154318+0000","last_undegraded":"2023-07-27T20:34:49.154318+0000","last_fullsized":"2023-07-27T20:34:49.154318+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.155031+0000","last_change":"2023-07-27T20:34:34.324198+0000","last_active":"2023-07-27T20:34:49.155031+0000","last_peered":"2023-07-27T20:34:49.155031+0000","last_clean":"2023-07-27T20:34:49.155031+0000","last_became_active":"2023-07-27T20:34:34.323865+0000","last_became_peered":"2023-07-27T20:34:34.323865+0000","last_unstale":"2023-07-27T20:34:49.155031+0000","last_undegraded":"2023-07-27T20:34:49.155031+0000","last_fullsized":"2023-07-27T20:34:49.155031+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:36:23.221362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.164171+0000","last_change":"2023-07-27T20:34:33.309943+0000","last_active":"2023-07-27T20:34:49.164171+0000","last_peered":"2023-07-27T20:34:49.164171+0000","last_clean":"2023-07-27T20:34:49.164171+0000","last_became_active":"2023-07-27T20:34:33.309650+0000","last_became_peered":"2023-07-27T20:34:33.309650+0000","last_unstale":"2023-07-27T20:34:49.164171+0000","last_undegraded":"2023-07-27T20:34:49.164171+0000","last_fullsized":"2023-07-27T20:34:49.164171+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:33:12.225937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.155657+0000","last_change":"2023-07-27T20:34:49.155657+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.155657+0000","last_undegraded":"2023-07-27T20:34:49.155657+0000","last_fullsized":"2023-07-27T20:34:49.155657+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.163573+0000","last_change":"2023-07-27T20:34:34.313276+0000","last_active":"2023-07-27T20:34:49.163573+0000","last_peered":"2023-07-27T20:34:49.163573+0000","last_clean":"2023-07-27T20:34:49.163573+0000","last_became_active":"2023-07-27T20:34:34.310175+0000","last_became_peered":"2023-07-27T20:34:34.310175+0000","last_unstale":"2023-07-27T20:34:49.163573+0000","last_undegraded":"2023-07-27T20:34:49.163573+0000","last_fullsized":"2023-07-27T20:34:49.163573+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:02:18.049530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"61'3","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.156602+0000","last_change":"2023-07-27T20:34:33.302814+0000","last_active":"2023-07-27T20:34:49.156602+0000","last_peered":"2023-07-27T20:34:49.156602+0000","last_clean":"2023-07-27T20:34:49.156602+0000","last_became_active":"2023-07-27T20:34:33.302504+0000","last_became_peered":"2023-07-27T20:34:33.302504+0000","last_unstale":"2023-07-27T20:34:49.156602+0000","last_undegraded":"2023-07-27T20:34:49.156602+0000","last_fullsized":"2023-07-27T20:34:49.156602+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:04:04.636272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.157460+0000","last_change":"2023-07-27T20:34:49.157460+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.157460+0000","last_undegraded":"2023-07-27T20:34:49.157460+0000","last_fullsized":"2023-07-27T20:34:49.157460+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.161552+0000","last_change":"2023-07-27T20:34:34.302062+0000","last_active":"2023-07-27T20:34:49.161552+0000","last_peered":"2023-07-27T20:34:49.161552+0000","last_clean":"2023-07-27T20:34:49.161552+0000","last_became_active":"2023-07-27T20:34:34.301760+0000","last_became_peered":"2023-07-27T20:34:34.301760+0000","last_unstale":"2023-07-27T20:34:49.161552+0000","last_undegraded":"2023-07-27T20:34:49.161552+0000","last_fullsized":"2023-07-27T20:34:49.161552+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:13:24.872931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"62'8","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.158634+0000","last_change":"2023-07-27T20:34:33.300792+0000","last_active":"2023-07-27T20:34:49.158634+0000","last_peered":"2023-07-27T20:34:49.158634+0000","last_clean":"2023-07-27T20:34:49.158634+0000","last_became_active":"2023-07-27T20:34:33.300452+0000","last_became_peered":"2023-07-27T20:34:33.300452+0000","last_unstale":"2023-07-27T20:34:49.158634+0000","last_undegraded":"2023-07-27T20:34:49.158634+0000","last_fullsized":"2023-07-27T20:34:49.158634+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:38:59.151258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3261,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.161717+0000","last_change":"2023-07-27T20:34:49.161717+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.161717+0000","last_undegraded":"2023-07-27T20:34:49.161717+0000","last_fullsized":"2023-07-27T20:34:49.161717+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.153513+0000","last_change":"2023-07-27T20:34:34.309848+0000","last_active":"2023-07-27T20:34:49.153513+0000","last_peered":"2023-07-27T20:34:49.153513+0000","last_clean":"2023-07-27T20:34:49.153513+0000","last_became_active":"2023-07-27T20:34:34.309567+0000","last_became_peered":"2023-07-27T20:34:34.309567+0000","last_unstale":"2023-07-27T20:34:49.153513+0000","last_undegraded":"2023-07-27T20:34:49.153513+0000","last_fullsized":"2023-07-27T20:34:49.153513+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:01:37.482193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"61'2","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.159448+0000","last_change":"2023-07-27T20:34:33.303304+0000","last_active":"2023-07-27T20:34:49.159448+0000","last_peered":"2023-07-27T20:34:49.159448+0000","last_clean":"2023-07-27T20:34:49.159448+0000","last_became_active":"2023-07-27T20:34:33.303051+0000","last_became_peered":"2023-07-27T20:34:33.303051+0000","last_unstale":"2023-07-27T20:34:49.159448+0000","last_undegraded":"2023-07-27T20:34:49.159448+0000","last_fullsized":"2023-07-27T20:34:49.159448+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:58:37.721794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.152985+0000","last_change":"2023-07-27T20:34:49.152985+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.152985+0000","last_undegraded":"2023-07-27T20:34:49.152985+0000","last_fullsized":"2023-07-27T20:34:49.152985+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.153780+0000","last_change":"2023-07-27T20:34:34.297996+0000","last_active":"2023-07-27T20:34:49.153780+0000","last_peered":"2023-07-27T20:34:49.153780+0000","last_clean":"2023-07-27T20:34:49.153780+0000","last_became_active":"2023-07-27T20:34:34.297650+0000","last_became_peered":"2023-07-27T20:34:34.297650+0000","last_unstale":"2023-07-27T20:34:49.153780+0000","last_undegraded":"2023-07-27T20:34:49.153780+0000","last_fullsized":"2023-07-27T20:34:49.153780+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:06:47.873925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.163448+0000","last_change":"2023-07-27T20:34:33.307281+0000","last_active":"2023-07-27T20:34:49.163448+0000","last_peered":"2023-07-27T20:34:49.163448+0000","last_clean":"2023-07-27T20:34:49.163448+0000","last_became_active":"2023-07-27T20:34:33.306983+0000","last_became_peered":"2023-07-27T20:34:33.306983+0000","last_unstale":"2023-07-27T20:34:49.163448+0000","last_undegraded":"2023-07-27T20:34:49.163448+0000","last_fullsized":"2023-07-27T20:34:49.163448+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:53:41.579455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.161893+0000","last_change":"2023-07-27T20:34:49.161893+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.161893+0000","last_undegraded":"2023-07-27T20:34:49.161893+0000","last_fullsized":"2023-07-27T20:34:49.161893+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.151755+0000","last_change":"2023-07-27T20:34:34.317382+0000","last_active":"2023-07-27T20:34:49.151755+0000","last_peered":"2023-07-27T20:34:49.151755+0000","last_clean":"2023-07-27T20:34:49.151755+0000","last_became_active":"2023-07-27T20:34:34.317102+0000","last_became_peered":"2023-07-27T20:34:34.317102+0000","last_unstale":"2023-07-27T20:34:49.151755+0000","last_undegraded":"2023-07-27T20:34:49.151755+0000","last_fullsized":"2023-07-27T20:34:49.151755+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:58:19.455457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.154528+0000","last_change":"2023-07-27T20:34:33.301597+0000","last_active":"2023-07-27T20:34:49.154528+0000","last_peered":"2023-07-27T20:34:49.154528+0000","last_clean":"2023-07-27T20:34:49.154528+0000","last_became_active":"2023-07-27T20:34:33.301302+0000","last_became_peered":"2023-07-27T20:34:33.301302+0000","last_unstale":"2023-07-27T20:34:49.154528+0000","last_undegraded":"2023-07-27T20:34:49.154528+0000","last_fullsized":"2023-07-27T20:34:49.154528+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:16:21.244868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.161090+0000","last_change":"2023-07-27T20:34:49.161090+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.161090+0000","last_undegraded":"2023-07-27T20:34:49.161090+0000","last_fullsized":"2023-07-27T20:34:49.161090+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.160159+0000","last_change":"2023-07-27T20:34:34.299216+0000","last_active":"2023-07-27T20:34:49.160159+0000","last_peered":"2023-07-27T20:34:49.160159+0000","last_clean":"2023-07-27T20:34:49.160159+0000","last_became_active":"2023-07-27T20:34:34.298877+0000","last_became_peered":"2023-07-27T20:34:34.298877+0000","last_unstale":"2023-07-27T20:34:49.160159+0000","last_undegraded":"2023-07-27T20:34:49.160159+0000","last_fullsized":"2023-07-27T20:34:49.160159+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:02:51.885628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"61'8","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.158206+0000","last_change":"2023-07-27T20:34:33.301967+0000","last_active":"2023-07-27T20:34:49.158206+0000","last_peered":"2023-07-27T20:34:49.158206+0000","last_clean":"2023-07-27T20:34:49.158206+0000","last_became_active":"2023-07-27T20:34:33.301702+0000","last_became_peered":"2023-07-27T20:34:33.301702+0000","last_unstale":"2023-07-27T20:34:49.158206+0000","last_undegraded":"2023-07-27T20:34:49.158206+0000","last_fullsized":"2023-07-27T20:34:49.158206+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:43:17.714323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.161300+0000","last_change":"2023-07-27T20:34:49.161300+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.161300+0000","last_undegraded":"2023-07-27T20:34:49.161300+0000","last_fullsized":"2023-07-27T20:34:49.161300+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.152222+0000","last_change":"2023-07-27T20:34:34.294954+0000","last_active":"2023-07-27T20:34:49.152222+0000","last_peered":"2023-07-27T20:34:49.152222+0000","last_clean":"2023-07-27T20:34:49.152222+0000","last_became_active":"2023-07-27T20:34:34.294073+0000","last_became_peered":"2023-07-27T20:34:34.294073+0000","last_unstale":"2023-07-27T20:34:49.152222+0000","last_undegraded":"2023-07-27T20:34:49.152222+0000","last_fullsized":"2023-07-27T20:34:49.152222+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:54:12.550947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"61'2","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.164253+0000","last_change":"2023-07-27T20:34:33.308165+0000","last_active":"2023-07-27T20:34:49.164253+0000","last_peered":"2023-07-27T20:34:49.164253+0000","last_clean":"2023-07-27T20:34:49.164253+0000","last_became_active":"2023-07-27T20:34:33.307868+0000","last_became_peered":"2023-07-27T20:34:33.307868+0000","last_unstale":"2023-07-27T20:34:49.164253+0000","last_undegraded":"2023-07-27T20:34:49.164253+0000","last_fullsized":"2023-07-27T20:34:49.164253+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:45:15.282156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.156857+0000","last_change":"2023-07-27T20:34:49.156857+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.156857+0000","last_undegraded":"2023-07-27T20:34:49.156857+0000","last_fullsized":"2023-07-27T20:34:49.156857+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.155053+0000","last_change":"2023-07-27T20:34:34.307218+0000","last_active":"2023-07-27T20:34:49.155053+0000","last_peered":"2023-07-27T20:34:49.155053+0000","last_clean":"2023-07-27T20:34:49.155053+0000","last_became_active":"2023-07-27T20:34:34.306781+0000","last_became_peered":"2023-07-27T20:34:34.306781+0000","last_unstale":"2023-07-27T20:34:49.155053+0000","last_undegraded":"2023-07-27T20:34:49.155053+0000","last_fullsized":"2023-07-27T20:34:49.155053+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:14:23.090548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"62'1","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.155220+0000","last_change":"2023-07-27T20:34:33.301802+0000","last_active":"2023-07-27T20:34:49.155220+0000","last_peered":"2023-07-27T20:34:49.155220+0000","last_clean":"2023-07-27T20:34:49.155220+0000","last_became_active":"2023-07-27T20:34:33.301453+0000","last_became_peered":"2023-07-27T20:34:33.301453+0000","last_unstale":"2023-07-27T20:34:49.155220+0000","last_undegraded":"2023-07-27T20:34:49.155220+0000","last_fullsized":"2023-07-27T20:34:49.155220+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:17:01.638537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.153818+0000","last_change":"2023-07-27T20:34:49.153818+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.153818+0000","last_undegraded":"2023-07-27T20:34:49.153818+0000","last_fullsized":"2023-07-27T20:34:49.153818+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.154077+0000","last_change":"2023-07-27T20:34:34.325646+0000","last_active":"2023-07-27T20:34:49.154077+0000","last_peered":"2023-07-27T20:34:49.154077+0000","last_clean":"2023-07-27T20:34:49.154077+0000","last_became_active":"2023-07-27T20:34:34.325379+0000","last_became_peered":"2023-07-27T20:34:34.325379+0000","last_unstale":"2023-07-27T20:34:49.154077+0000","last_undegraded":"2023-07-27T20:34:49.154077+0000","last_fullsized":"2023-07-27T20:34:49.154077+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:18:57.338563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.161812+0000","last_change":"2023-07-27T20:34:33.297891+0000","last_active":"2023-07-27T20:34:49.161812+0000","last_peered":"2023-07-27T20:34:49.161812+0000","last_clean":"2023-07-27T20:34:49.161812+0000","last_became_active":"2023-07-27T20:34:33.297052+0000","last_became_peered":"2023-07-27T20:34:33.297052+0000","last_unstale":"2023-07-27T20:34:49.161812+0000","last_undegraded":"2023-07-27T20:34:49.161812+0000","last_fullsized":"2023-07-27T20:34:49.161812+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:24:52.420953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.156927+0000","last_change":"2023-07-27T20:34:49.156927+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.156927+0000","last_undegraded":"2023-07-27T20:34:49.156927+0000","last_fullsized":"2023-07-27T20:34:49.156927+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.154983+0000","last_change":"2023-07-27T20:34:34.315817+0000","last_active":"2023-07-27T20:34:49.154983+0000","last_peered":"2023-07-27T20:34:49.154983+0000","last_clean":"2023-07-27T20:34:49.154983+0000","last_became_active":"2023-07-27T20:34:34.315521+0000","last_became_peered":"2023-07-27T20:34:34.315521+0000","last_unstale":"2023-07-27T20:34:49.154983+0000","last_undegraded":"2023-07-27T20:34:49.154983+0000","last_fullsized":"2023-07-27T20:34:49.154983+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:08:10.988771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.152007+0000","last_change":"2023-07-27T20:34:33.303481+0000","last_active":"2023-07-27T20:34:49.152007+0000","last_peered":"2023-07-27T20:34:49.152007+0000","last_clean":"2023-07-27T20:34:49.152007+0000","last_became_active":"2023-07-27T20:34:33.303145+0000","last_became_peered":"2023-07-27T20:34:33.303145+0000","last_unstale":"2023-07-27T20:34:49.152007+0000","last_undegraded":"2023-07-27T20:34:49.152007+0000","last_fullsized":"2023-07-27T20:34:49.152007+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:46:20.023372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.161161+0000","last_change":"2023-07-27T20:34:49.161161+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.161161+0000","last_undegraded":"2023-07-27T20:34:49.161161+0000","last_fullsized":"2023-07-27T20:34:49.161161+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.160910+0000","last_change":"2023-07-27T20:34:34.304160+0000","last_active":"2023-07-27T20:34:49.160910+0000","last_peered":"2023-07-27T20:34:49.160910+0000","last_clean":"2023-07-27T20:34:49.160910+0000","last_became_active":"2023-07-27T20:34:34.303895+0000","last_became_peered":"2023-07-27T20:34:34.303895+0000","last_unstale":"2023-07-27T20:34:49.160910+0000","last_undegraded":"2023-07-27T20:34:49.160910+0000","last_fullsized":"2023-07-27T20:34:49.160910+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:14:13.099388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.160810+0000","last_change":"2023-07-27T20:34:33.308129+0000","last_active":"2023-07-27T20:34:49.160810+0000","last_peered":"2023-07-27T20:34:49.160810+0000","last_clean":"2023-07-27T20:34:49.160810+0000","last_became_active":"2023-07-27T20:34:33.307849+0000","last_became_peered":"2023-07-27T20:34:33.307849+0000","last_unstale":"2023-07-27T20:34:49.160810+0000","last_undegraded":"2023-07-27T20:34:49.160810+0000","last_fullsized":"2023-07-27T20:34:49.160810+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:43:34.583277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.161063+0000","last_change":"2023-07-27T20:34:49.161063+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.161063+0000","last_undegraded":"2023-07-27T20:34:49.161063+0000","last_fullsized":"2023-07-27T20:34:49.161063+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.163240+0000","last_change":"2023-07-27T20:34:34.323167+0000","last_active":"2023-07-27T20:34:49.163240+0000","last_peered":"2023-07-27T20:34:49.163240+0000","last_clean":"2023-07-27T20:34:49.163240+0000","last_became_active":"2023-07-27T20:34:34.322891+0000","last_became_peered":"2023-07-27T20:34:34.322891+0000","last_unstale":"2023-07-27T20:34:49.163240+0000","last_undegraded":"2023-07-27T20:34:49.163240+0000","last_fullsized":"2023-07-27T20:34:49.163240+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:46:36.050164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.157638+0000","last_change":"2023-07-27T20:34:33.303415+0000","last_active":"2023-07-27T20:34:49.157638+0000","last_peered":"2023-07-27T20:34:49.157638+0000","last_clean":"2023-07-27T20:34:49.157638+0000","last_became_active":"2023-07-27T20:34:33.303145+0000","last_became_peered":"2023-07-27T20:34:33.303145+0000","last_unstale":"2023-07-27T20:34:49.157638+0000","last_undegraded":"2023-07-27T20:34:49.157638+0000","last_fullsized":"2023-07-27T20:34:49.157638+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:06:47.373051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.155870+0000","last_change":"2023-07-27T20:34:49.155870+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.155870+0000","last_undegraded":"2023-07-27T20:34:49.155870+0000","last_fullsized":"2023-07-27T20:34:49.155870+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.157244+0000","last_change":"2023-07-27T20:34:34.298297+0000","last_active":"2023-07-27T20:34:49.157244+0000","last_peered":"2023-07-27T20:34:49.157244+0000","last_clean":"2023-07-27T20:34:49.157244+0000","last_became_active":"2023-07-27T20:34:34.297997+0000","last_became_peered":"2023-07-27T20:34:34.297997+0000","last_unstale":"2023-07-27T20:34:49.157244+0000","last_undegraded":"2023-07-27T20:34:49.157244+0000","last_fullsized":"2023-07-27T20:34:49.157244+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:23:46.012307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.158421+0000","last_change":"2023-07-27T20:34:33.301354+0000","last_active":"2023-07-27T20:34:49.158421+0000","last_peered":"2023-07-27T20:34:49.158421+0000","last_clean":"2023-07-27T20:34:49.158421+0000","last_became_active":"2023-07-27T20:34:33.301082+0000","last_became_peered":"2023-07-27T20:34:33.301082+0000","last_unstale":"2023-07-27T20:34:49.158421+0000","last_undegraded":"2023-07-27T20:34:49.158421+0000","last_fullsized":"2023-07-27T20:34:49.158421+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:21:44.490320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.156163+0000","last_change":"2023-07-27T20:34:49.156163+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.156163+0000","last_undegraded":"2023-07-27T20:34:49.156163+0000","last_fullsized":"2023-07-27T20:34:49.156163+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.163364+0000","last_change":"2023-07-27T20:34:34.321962+0000","last_active":"2023-07-27T20:34:49.163364+0000","last_peered":"2023-07-27T20:34:49.163364+0000","last_clean":"2023-07-27T20:34:49.163364+0000","last_became_active":"2023-07-27T20:34:34.321611+0000","last_became_peered":"2023-07-27T20:34:34.321611+0000","last_unstale":"2023-07-27T20:34:49.163364+0000","last_undegraded":"2023-07-27T20:34:49.163364+0000","last_fullsized":"2023-07-27T20:34:49.163364+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:44:42.207766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.163221+0000","last_change":"2023-07-27T20:34:33.305936+0000","last_active":"2023-07-27T20:34:49.163221+0000","last_peered":"2023-07-27T20:34:49.163221+0000","last_clean":"2023-07-27T20:34:49.163221+0000","last_became_active":"2023-07-27T20:34:33.305405+0000","last_became_peered":"2023-07-27T20:34:33.305405+0000","last_unstale":"2023-07-27T20:34:49.163221+0000","last_undegraded":"2023-07-27T20:34:49.163221+0000","last_fullsized":"2023-07-27T20:34:49.163221+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:46:27.154263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.159349+0000","last_change":"2023-07-27T20:34:49.159349+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.159349+0000","last_undegraded":"2023-07-27T20:34:49.159349+0000","last_fullsized":"2023-07-27T20:34:49.159349+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.159175+0000","last_change":"2023-07-27T20:34:34.306247+0000","last_active":"2023-07-27T20:34:49.159175+0000","last_peered":"2023-07-27T20:34:49.159175+0000","last_clean":"2023-07-27T20:34:49.159175+0000","last_became_active":"2023-07-27T20:34:34.305974+0000","last_became_peered":"2023-07-27T20:34:34.305974+0000","last_unstale":"2023-07-27T20:34:49.159175+0000","last_undegraded":"2023-07-27T20:34:49.159175+0000","last_fullsized":"2023-07-27T20:34:49.159175+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:32:37.897239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"61'1","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.164133+0000","last_change":"2023-07-27T20:34:33.308128+0000","last_active":"2023-07-27T20:34:49.164133+0000","last_peered":"2023-07-27T20:34:49.164133+0000","last_clean":"2023-07-27T20:34:49.164133+0000","last_became_active":"2023-07-27T20:34:33.307832+0000","last_became_peered":"2023-07-27T20:34:33.307832+0000","last_unstale":"2023-07-27T20:34:49.164133+0000","last_undegraded":"2023-07-27T20:34:49.164133+0000","last_fullsized":"2023-07-27T20:34:49.164133+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:31:44.429705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":90,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.164091+0000","last_change":"2023-07-27T20:31:22.846540+0000","last_active":"2023-07-27T20:34:49.164091+0000","last_peered":"2023-07-27T20:34:49.164091+0000","last_clean":"2023-07-27T20:34:49.164091+0000","last_became_active":"2023-07-27T20:31:22.846128+0000","last_became_peered":"2023-07-27T20:31:22.846128+0000","last_unstale":"2023-07-27T20:34:49.164091+0000","last_undegraded":"2023-07-27T20:34:49.164091+0000","last_fullsized":"2023-07-27T20:34:49.164091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:48:26.550047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.157032+0000","last_change":"2023-07-27T20:34:49.157032+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.157032+0000","last_undegraded":"2023-07-27T20:34:49.157032+0000","last_fullsized":"2023-07-27T20:34:49.157032+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.155163+0000","last_change":"2023-07-27T20:34:34.311641+0000","last_active":"2023-07-27T20:34:49.155163+0000","last_peered":"2023-07-27T20:34:49.155163+0000","last_clean":"2023-07-27T20:34:49.155163+0000","last_became_active":"2023-07-27T20:34:34.311381+0000","last_became_peered":"2023-07-27T20:34:34.311381+0000","last_unstale":"2023-07-27T20:34:49.155163+0000","last_undegraded":"2023-07-27T20:34:49.155163+0000","last_fullsized":"2023-07-27T20:34:49.155163+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:33:32.123237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"61'2","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.159257+0000","last_change":"2023-07-27T20:34:33.303573+0000","last_active":"2023-07-27T20:34:49.159257+0000","last_peered":"2023-07-27T20:34:49.159257+0000","last_clean":"2023-07-27T20:34:49.159257+0000","last_became_active":"2023-07-27T20:34:33.303293+0000","last_became_peered":"2023-07-27T20:34:33.303293+0000","last_unstale":"2023-07-27T20:34:49.159257+0000","last_undegraded":"2023-07-27T20:34:49.159257+0000","last_fullsized":"2023-07-27T20:34:49.159257+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:04:04.636272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":90,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.158302+0000","last_change":"2023-07-27T20:31:22.845641+0000","last_active":"2023-07-27T20:34:49.158302+0000","last_peered":"2023-07-27T20:34:49.158302+0000","last_clean":"2023-07-27T20:34:49.158302+0000","last_became_active":"2023-07-27T20:31:22.845368+0000","last_became_peered":"2023-07-27T20:31:22.845368+0000","last_unstale":"2023-07-27T20:34:49.158302+0000","last_undegraded":"2023-07-27T20:34:49.158302+0000","last_fullsized":"2023-07-27T20:34:49.158302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:23:53.818080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.156336+0000","last_change":"2023-07-27T20:34:49.156336+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.156336+0000","last_undegraded":"2023-07-27T20:34:49.156336+0000","last_fullsized":"2023-07-27T20:34:49.156336+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.158518+0000","last_change":"2023-07-27T20:34:34.296863+0000","last_active":"2023-07-27T20:34:49.158518+0000","last_peered":"2023-07-27T20:34:49.158518+0000","last_clean":"2023-07-27T20:34:49.158518+0000","last_became_active":"2023-07-27T20:34:34.296556+0000","last_became_peered":"2023-07-27T20:34:34.296556+0000","last_unstale":"2023-07-27T20:34:49.158518+0000","last_undegraded":"2023-07-27T20:34:49.158518+0000","last_fullsized":"2023-07-27T20:34:49.158518+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:28:08.203613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"61'1","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.163717+0000","last_change":"2023-07-27T20:34:33.303035+0000","last_active":"2023-07-27T20:34:49.163717+0000","last_peered":"2023-07-27T20:34:49.163717+0000","last_clean":"2023-07-27T20:34:49.163717+0000","last_became_active":"2023-07-27T20:34:33.302764+0000","last_became_peered":"2023-07-27T20:34:33.302764+0000","last_unstale":"2023-07-27T20:34:49.163717+0000","last_undegraded":"2023-07-27T20:34:49.163717+0000","last_fullsized":"2023-07-27T20:34:49.163717+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:37:40.417036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":94,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.155107+0000","last_change":"2023-07-27T20:31:22.848025+0000","last_active":"2023-07-27T20:34:49.155107+0000","last_peered":"2023-07-27T20:34:49.155107+0000","last_clean":"2023-07-27T20:34:49.155107+0000","last_became_active":"2023-07-27T20:31:22.847603+0000","last_became_peered":"2023-07-27T20:31:22.847603+0000","last_unstale":"2023-07-27T20:34:49.155107+0000","last_undegraded":"2023-07-27T20:34:49.155107+0000","last_fullsized":"2023-07-27T20:34:49.155107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:43:36.260108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.153793+0000","last_change":"2023-07-27T20:34:49.153793+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.153793+0000","last_undegraded":"2023-07-27T20:34:49.153793+0000","last_fullsized":"2023-07-27T20:34:49.153793+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.157216+0000","last_change":"2023-07-27T20:34:34.315837+0000","last_active":"2023-07-27T20:34:49.157216+0000","last_peered":"2023-07-27T20:34:49.157216+0000","last_clean":"2023-07-27T20:34:49.157216+0000","last_became_active":"2023-07-27T20:34:34.315452+0000","last_became_peered":"2023-07-27T20:34:34.315452+0000","last_unstale":"2023-07-27T20:34:49.157216+0000","last_undegraded":"2023-07-27T20:34:49.157216+0000","last_fullsized":"2023-07-27T20:34:49.157216+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:38:15.606270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.151747+0000","last_change":"2023-07-27T20:34:33.298534+0000","last_active":"2023-07-27T20:34:49.151747+0000","last_peered":"2023-07-27T20:34:49.151747+0000","last_clean":"2023-07-27T20:34:49.151747+0000","last_became_active":"2023-07-27T20:34:33.298170+0000","last_became_peered":"2023-07-27T20:34:33.298170+0000","last_unstale":"2023-07-27T20:34:49.151747+0000","last_undegraded":"2023-07-27T20:34:49.151747+0000","last_fullsized":"2023-07-27T20:34:49.151747+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:38:16.744717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":94,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.153521+0000","last_change":"2023-07-27T20:31:22.848181+0000","last_active":"2023-07-27T20:34:49.153521+0000","last_peered":"2023-07-27T20:34:49.153521+0000","last_clean":"2023-07-27T20:34:49.153521+0000","last_became_active":"2023-07-27T20:31:22.847865+0000","last_became_peered":"2023-07-27T20:31:22.847865+0000","last_unstale":"2023-07-27T20:34:49.153521+0000","last_undegraded":"2023-07-27T20:34:49.153521+0000","last_fullsized":"2023-07-27T20:34:49.153521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:00:09.852891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.152852+0000","last_change":"2023-07-27T20:34:49.152852+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.152852+0000","last_undegraded":"2023-07-27T20:34:49.152852+0000","last_fullsized":"2023-07-27T20:34:49.152852+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.159491+0000","last_change":"2023-07-27T20:34:34.320803+0000","last_active":"2023-07-27T20:34:49.159491+0000","last_peered":"2023-07-27T20:34:49.159491+0000","last_clean":"2023-07-27T20:34:49.159491+0000","last_became_active":"2023-07-27T20:34:34.320444+0000","last_became_peered":"2023-07-27T20:34:34.320444+0000","last_unstale":"2023-07-27T20:34:49.159491+0000","last_undegraded":"2023-07-27T20:34:49.159491+0000","last_fullsized":"2023-07-27T20:34:49.159491+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:25:20.209180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"61'2","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.163320+0000","last_change":"2023-07-27T20:34:33.306873+0000","last_active":"2023-07-27T20:34:49.163320+0000","last_peered":"2023-07-27T20:34:49.163320+0000","last_clean":"2023-07-27T20:34:49.163320+0000","last_became_active":"2023-07-27T20:34:33.306519+0000","last_became_peered":"2023-07-27T20:34:33.306519+0000","last_unstale":"2023-07-27T20:34:49.163320+0000","last_undegraded":"2023-07-27T20:34:49.163320+0000","last_fullsized":"2023-07-27T20:34:49.163320+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:05:13.323144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":250,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.153816+0000","last_change":"2023-07-27T20:31:15.812727+0000","last_active":"2023-07-27T20:34:49.153816+0000","last_peered":"2023-07-27T20:34:49.153816+0000","last_clean":"2023-07-27T20:34:49.153816+0000","last_became_active":"2023-07-27T20:31:15.811803+0000","last_became_peered":"2023-07-27T20:31:15.811803+0000","last_unstale":"2023-07-27T20:34:49.153816+0000","last_undegraded":"2023-07-27T20:34:49.153816+0000","last_fullsized":"2023-07-27T20:34:49.153816+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:14.789257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:14.789257+0000","last_clean_scrub_stamp":"2023-07-27T20:31:14.789257+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:27:51.372094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":88,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.153914+0000","last_change":"2023-07-27T20:31:22.847766+0000","last_active":"2023-07-27T20:34:49.153914+0000","last_peered":"2023-07-27T20:34:49.153914+0000","last_clean":"2023-07-27T20:34:49.153914+0000","last_became_active":"2023-07-27T20:31:22.847396+0000","last_became_peered":"2023-07-27T20:31:22.847396+0000","last_unstale":"2023-07-27T20:34:49.153914+0000","last_undegraded":"2023-07-27T20:34:49.153914+0000","last_fullsized":"2023-07-27T20:34:49.153914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:19:28.120599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.161209+0000","last_change":"2023-07-27T20:34:49.161209+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.161209+0000","last_undegraded":"2023-07-27T20:34:49.161209+0000","last_fullsized":"2023-07-27T20:34:49.161209+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.157334+0000","last_change":"2023-07-27T20:34:34.320690+0000","last_active":"2023-07-27T20:34:49.157334+0000","last_peered":"2023-07-27T20:34:49.157334+0000","last_clean":"2023-07-27T20:34:49.157334+0000","last_became_active":"2023-07-27T20:34:34.320232+0000","last_became_peered":"2023-07-27T20:34:34.320232+0000","last_unstale":"2023-07-27T20:34:49.157334+0000","last_undegraded":"2023-07-27T20:34:49.157334+0000","last_fullsized":"2023-07-27T20:34:49.157334+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:24:18.338597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.154659+0000","last_change":"2023-07-27T20:34:33.308050+0000","last_active":"2023-07-27T20:34:49.154659+0000","last_peered":"2023-07-27T20:34:49.154659+0000","last_clean":"2023-07-27T20:34:49.154659+0000","last_became_active":"2023-07-27T20:34:33.307761+0000","last_became_peered":"2023-07-27T20:34:33.307761+0000","last_unstale":"2023-07-27T20:34:49.154659+0000","last_undegraded":"2023-07-27T20:34:49.154659+0000","last_fullsized":"2023-07-27T20:34:49.154659+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:54:21.765008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":88,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.160393+0000","last_change":"2023-07-27T20:31:22.959811+0000","last_active":"2023-07-27T20:34:49.160393+0000","last_peered":"2023-07-27T20:34:49.160393+0000","last_clean":"2023-07-27T20:34:49.160393+0000","last_became_active":"2023-07-27T20:31:22.959449+0000","last_became_peered":"2023-07-27T20:31:22.959449+0000","last_unstale":"2023-07-27T20:34:49.160393+0000","last_undegraded":"2023-07-27T20:34:49.160393+0000","last_fullsized":"2023-07-27T20:34:49.160393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:11:53.979596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.153792+0000","last_change":"2023-07-27T20:34:49.153792+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.153792+0000","last_undegraded":"2023-07-27T20:34:49.153792+0000","last_fullsized":"2023-07-27T20:34:49.153792+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.156801+0000","last_change":"2023-07-27T20:34:34.301811+0000","last_active":"2023-07-27T20:34:49.156801+0000","last_peered":"2023-07-27T20:34:49.156801+0000","last_clean":"2023-07-27T20:34:49.156801+0000","last_became_active":"2023-07-27T20:34:34.301525+0000","last_became_peered":"2023-07-27T20:34:34.301525+0000","last_unstale":"2023-07-27T20:34:49.156801+0000","last_undegraded":"2023-07-27T20:34:49.156801+0000","last_fullsized":"2023-07-27T20:34:49.156801+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:04:52.499591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.163477+0000","last_change":"2023-07-27T20:34:33.301467+0000","last_active":"2023-07-27T20:34:49.163477+0000","last_peered":"2023-07-27T20:34:49.163477+0000","last_clean":"2023-07-27T20:34:49.163477+0000","last_became_active":"2023-07-27T20:34:33.301160+0000","last_became_peered":"2023-07-27T20:34:33.301160+0000","last_unstale":"2023-07-27T20:34:49.163477+0000","last_undegraded":"2023-07-27T20:34:49.163477+0000","last_fullsized":"2023-07-27T20:34:49.163477+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:08:35.154187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":88,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.153742+0000","last_change":"2023-07-27T20:31:22.849178+0000","last_active":"2023-07-27T20:34:49.153742+0000","last_peered":"2023-07-27T20:34:49.153742+0000","last_clean":"2023-07-27T20:34:49.153742+0000","last_became_active":"2023-07-27T20:31:22.848856+0000","last_became_peered":"2023-07-27T20:31:22.848856+0000","last_unstale":"2023-07-27T20:34:49.153742+0000","last_undegraded":"2023-07-27T20:34:49.153742+0000","last_fullsized":"2023-07-27T20:34:49.153742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:19:42.901336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.158747+0000","last_change":"2023-07-27T20:34:49.158747+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.158747+0000","last_undegraded":"2023-07-27T20:34:49.158747+0000","last_fullsized":"2023-07-27T20:34:49.158747+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.161682+0000","last_change":"2023-07-27T20:34:34.296711+0000","last_active":"2023-07-27T20:34:49.161682+0000","last_peered":"2023-07-27T20:34:49.161682+0000","last_clean":"2023-07-27T20:34:49.161682+0000","last_became_active":"2023-07-27T20:34:34.296442+0000","last_became_peered":"2023-07-27T20:34:34.296442+0000","last_unstale":"2023-07-27T20:34:49.161682+0000","last_undegraded":"2023-07-27T20:34:49.161682+0000","last_fullsized":"2023-07-27T20:34:49.161682+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:04:23.247427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.154200+0000","last_change":"2023-07-27T20:34:33.304301+0000","last_active":"2023-07-27T20:34:49.154200+0000","last_peered":"2023-07-27T20:34:49.154200+0000","last_clean":"2023-07-27T20:34:49.154200+0000","last_became_active":"2023-07-27T20:34:33.303739+0000","last_became_peered":"2023-07-27T20:34:33.303739+0000","last_unstale":"2023-07-27T20:34:49.154200+0000","last_undegraded":"2023-07-27T20:34:49.154200+0000","last_fullsized":"2023-07-27T20:34:49.154200+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:37:02.578882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":90,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.158772+0000","last_change":"2023-07-27T20:31:22.848698+0000","last_active":"2023-07-27T20:34:49.158772+0000","last_peered":"2023-07-27T20:34:49.158772+0000","last_clean":"2023-07-27T20:34:49.158772+0000","last_became_active":"2023-07-27T20:31:22.848346+0000","last_became_peered":"2023-07-27T20:31:22.848346+0000","last_unstale":"2023-07-27T20:34:49.158772+0000","last_undegraded":"2023-07-27T20:34:49.158772+0000","last_fullsized":"2023-07-27T20:34:49.158772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:08:27.172282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":4059,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28352,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343488,"statfs":{"total":96636764160,"available":96607731712,"internally_reserved":0,"allocated":1363968,"data_stored":956042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.75800000000000001,"15min":0.80300000000000005},"min":{"1min":0.42499999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90000000000000002,"5min":3.5609999999999999,"15min":3.5609999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.70799999999999996,"15min":0.72699999999999998},"min":{"1min":0.39500000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88800000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.59299999999999997}]},{"osd":1,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.69599999999999995,"15min":0.71599999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.84999999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.81000000000000005,"15min":0.86399999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.86699999999999999,"5min":3.927,"15min":3.927},"last":0.65600000000000003}]},{"osd":2,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.80200000000000005,"15min":0.84099999999999997},"min":{"1min":0.47099999999999997,"5min":0.443,"15min":0.443},"max":{"1min":0.86699999999999999,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.76500000000000001,"15min":0.80900000000000005},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85799999999999998,"5min":2.093,"15min":2.093},"last":0.64300000000000002}]},{"osd":3,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.76000000000000001,"15min":0.81200000000000006},"min":{"1min":0.46000000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.76600000000000001,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.85099999999999998,"15min":0.90100000000000002},"min":{"1min":0.57399999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.94099999999999995,"5min":3.1080000000000001,"15min":3.1080000000000001},"last":0.628}]},{"osd":4,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.754,"15min":0.78800000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.91100000000000003,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.79800000000000004,"15min":0.83399999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.85799999999999998,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.60999999999999999}]},{"osd":5,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.90600000000000003,"15min":0.999},"min":{"1min":0.47899999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.91400000000000003,"5min":6.1619999999999999,"15min":6.1619999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.94299999999999995,"15min":1.042},"min":{"1min":0.432,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96499999999999997,"5min":6.2729999999999997,"15min":6.2729999999999997},"last":0.67800000000000005}]},{"osd":6,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.81799999999999995,"15min":0.84599999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.075,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.84699999999999998,"15min":0.90500000000000003},"min":{"1min":0.52900000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93799999999999994,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":0.54000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":770048,"data_stored":365150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.67700000000000005,"15min":0.68899999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.871,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.66300000000000003,"15min":0.66800000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.85499999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.622}]},{"osd":1,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69999999999999996,"15min":0.72199999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84399999999999997,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70099999999999996,"15min":0.70799999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.85499999999999998,"5min":1.266,"15min":1.266},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.69499999999999995,"15min":0.71799999999999997},"min":{"1min":0.51100000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83899999999999997,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.747,"15min":0.76300000000000001},"min":{"1min":0.56499999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.90200000000000002,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.69199999999999995}]},{"osd":3,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.72899999999999998,"15min":0.745},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.84199999999999997,"5min":1.377,"15min":1.377},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.73299999999999998,"15min":0.75700000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92800000000000005,"5min":1.736,"15min":1.736},"last":0.72399999999999998}]},{"osd":4,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69599999999999995,"15min":0.69799999999999995},"min":{"1min":0.47099999999999997,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90300000000000002,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69699999999999995,"15min":0.69299999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.95599999999999996,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.78600000000000003}]},{"osd":5,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.67100000000000004,"15min":0.66500000000000004},"min":{"1min":0.47799999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.88600000000000001,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.74099999999999999,"15min":0.73199999999999998},"min":{"1min":0.45100000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93700000000000006,"5min":1.081,"15min":1.081},"last":0.80400000000000005}]},{"osd":7,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.749,"15min":0.753},"min":{"1min":0.496,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.94699999999999995,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.749},{"interface":"front","average":{"1min":0.753,"5min":0.73999999999999999,"15min":0.73599999999999999},"min":{"1min":0.59499999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97599999999999998,"5min":1.119,"15min":1.119},"last":0.82199999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":782336,"data_stored":368935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40899999999999997,"15min":0.40600000000000003},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47199999999999998,"15min":0.47899999999999998},"min":{"1min":0.32300000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.39500000000000002}]},{"osd":2,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44,"15min":0.436},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.436},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.47599999999999998,"15min":0.47399999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.45300000000000001}]},{"osd":3,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53400000000000003,"15min":0.53200000000000003},"min":{"1min":0.39400000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.502,"15min":0.504},"min":{"1min":0.374,"5min":0.31,"15min":0.31},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.48699999999999999}]},{"osd":4,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73499999999999999,"15min":0.745},"min":{"1min":0.56699999999999995,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73599999999999999,"15min":0.73199999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72299999999999998,"15min":0.73199999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.76200000000000001,"15min":0.75700000000000001},"min":{"1min":0.623,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.9630000000000001,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":0.64800000000000002}]},{"osd":6,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.77500000000000002,"15min":0.79500000000000004},"min":{"1min":0.53600000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1419999999999999,"5min":1.347,"15min":1.347},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.80400000000000005,"15min":0.81999999999999995},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.206,"5min":1.409,"15min":1.409},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.77100000000000002,"15min":0.77700000000000002},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.95099999999999996,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78800000000000003,"15min":0.80300000000000005},"min":{"1min":0.55400000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.71699999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28344,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343496,"statfs":{"total":96636764160,"available":96607739904,"internally_reserved":0,"allocated":1355776,"data_stored":955426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.38700000000000001,"15min":0.39100000000000001},"min":{"1min":0.27700000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.46000000000000002,"15min":0.46400000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.45100000000000001}]},{"osd":2,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47999999999999998,"15min":0.48899999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.60399999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.44800000000000001,"15min":0.45400000000000001},"min":{"1min":0.34200000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46600000000000003,"15min":0.47099999999999997},"min":{"1min":0.35299999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.65900000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53200000000000003,"15min":0.54200000000000004},"min":{"1min":0.40699999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.63400000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70499999999999996,"15min":0.71199999999999997},"min":{"1min":0.55900000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0529999999999999,"5min":1.069,"15min":1.069},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.71799999999999997,"15min":0.73199999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97799999999999998,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.69099999999999995}]},{"osd":5,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.73099999999999998,"15min":0.745},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.90000000000000002,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.73499999999999999,"15min":0.751},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0940000000000001,"5min":1.196,"15min":1.196},"last":0.73799999999999999}]},{"osd":6,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.72199999999999998,"15min":0.73599999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0129999999999999,"5min":1.05,"15min":1.05},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.755,"15min":0.77600000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.88400000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.72799999999999998}]},{"osd":7,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.752,"15min":0.76900000000000002},"min":{"1min":0.54800000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.755,"15min":0.77200000000000002},"min":{"1min":0.58199999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.751}]}]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":761856,"data_stored":360975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45700000000000002,"15min":0.48099999999999998},"min":{"1min":0.29799999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.54700000000000004,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.624,"15min":0.70999999999999996},"min":{"1min":0.32500000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70099999999999996,"5min":3.2999999999999998,"15min":3.2999999999999998},"last":0.42899999999999999}]},{"osd":1,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.56000000000000005,"15min":0.61499999999999999},"min":{"1min":0.309,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.67200000000000004,"5min":3.0600000000000001,"15min":3.0600000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.60999999999999999,"15min":0.67000000000000004},"min":{"1min":0.36499999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.623,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.86399999999999999,"15min":1.036},"min":{"1min":0.40000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72099999999999997,"5min":9.2200000000000006,"15min":9.2200000000000006},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.57099999999999995,"15min":0.59499999999999997},"min":{"1min":0.40799999999999997,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.66600000000000004,"5min":1.552,"15min":1.552},"last":0.505}]},{"osd":4,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.85999999999999999,"15min":0.92600000000000005},"min":{"1min":0.52200000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0049999999999999,"5min":4.2930000000000001,"15min":4.2930000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.75600000000000001,"15min":0.77900000000000003},"min":{"1min":0.55400000000000005,"5min":0.499,"15min":0.499},"max":{"1min":0.93999999999999995,"5min":1.24,"15min":1.24},"last":0.76300000000000001}]},{"osd":5,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.754,"15min":0.76900000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98399999999999999,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.84699999999999998,"15min":0.90700000000000003},"min":{"1min":0.53800000000000003,"5min":0.5,"15min":0.5},"max":{"1min":0.90700000000000003,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.64900000000000002}]},{"osd":6,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.88300000000000001,"15min":0.94399999999999995},"min":{"1min":0.55300000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.024,"5min":3.3999999999999999,"15min":3.3999999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.91300000000000003,"15min":0.99099999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.97199999999999998,"5min":3.4990000000000001,"15min":3.4990000000000001},"last":0.71899999999999997}]},{"osd":7,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.81100000000000005,"15min":0.84499999999999997},"min":{"1min":0.58199999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.95199999999999996,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.86099999999999999,"15min":0.89700000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.95999999999999996,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.77900000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":770048,"data_stored":365170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.44900000000000001,"15min":0.47099999999999997},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.626,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.51600000000000001,"15min":0.54400000000000004},"min":{"1min":0.309,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.627,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":0.35099999999999998}]},{"osd":1,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.47699999999999998,"15min":0.5},"min":{"1min":0.33400000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.55400000000000005,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.44},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.52900000000000003,"15min":0.56699999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.63,"5min":1.788,"15min":1.788},"last":0.54500000000000004}]},{"osd":2,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.56200000000000006,"15min":0.59199999999999997},"min":{"1min":0.41699999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.73299999999999998,"5min":2.117,"15min":2.117},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59999999999999998,"15min":0.63400000000000001},"min":{"1min":0.42999999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.68400000000000005,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.73199999999999998}]},{"osd":4,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71899999999999997,"15min":0.72199999999999998},"min":{"1min":0.53800000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0249999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.79000000000000004,"15min":0.81399999999999995},"min":{"1min":0.53000000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.95199999999999996,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.69499999999999995}]},{"osd":5,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.72499999999999998,"15min":0.73299999999999998},"min":{"1min":0.505,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92200000000000004,"5min":1.125,"15min":1.125},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.79400000000000004,"15min":0.82799999999999996},"min":{"1min":0.54200000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0569999999999999,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.76900000000000002}]},{"osd":6,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.78600000000000003,"15min":0.81299999999999994},"min":{"1min":0.59199999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93100000000000005,"5min":1.758,"15min":1.758},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.80900000000000005,"15min":0.83499999999999996},"min":{"1min":0.55000000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.095,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.751}]},{"osd":7,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.81599999999999995,"15min":0.84799999999999998},"min":{"1min":0.55400000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0289999999999999,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.75800000000000001,"15min":0.76700000000000002},"min":{"1min":0.59099999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.99199999999999999,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.71499999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":753664,"data_stored":357784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.69699999999999995,"15min":0.69799999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.84299999999999997,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70699999999999996,"15min":0.71199999999999997},"min":{"1min":0.53900000000000003,"5min":0.5,"15min":0.5},"max":{"1min":0.86499999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.65800000000000003}]},{"osd":1,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.52200000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.874,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73499999999999999,"15min":0.73799999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88900000000000001,"5min":1.002,"15min":1.002},"last":0.63300000000000001}]},{"osd":2,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.67500000000000004,"15min":0.66900000000000004},"min":{"1min":0.504,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81899999999999995,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68899999999999995,"15min":0.69499999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.93700000000000006,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.68300000000000005}]},{"osd":3,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.73099999999999998,"15min":0.751},"min":{"1min":0.49299999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91300000000000003,"5min":1.645,"15min":1.645},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.747,"15min":0.75900000000000001},"min":{"1min":0.51700000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96899999999999997,"5min":1.708,"15min":1.708},"last":0.53900000000000003}]},{"osd":5,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61799999999999999,"15min":0.61699999999999999},"min":{"1min":0.41499999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84499999999999997,"5min":1.113,"15min":1.113},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68799999999999994,"15min":0.69499999999999995},"min":{"1min":0.502,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91200000000000003,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.72599999999999998}]},{"osd":6,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70599999999999996,"15min":0.70699999999999996},"min":{"1min":0.48299999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.92100000000000004,"5min":1.127,"15min":1.127},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.74099999999999999,"15min":0.74199999999999999},"min":{"1min":0.442,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0009999999999999,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.81399999999999995}]},{"osd":7,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.54700000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.98499999999999999,"5min":1.198,"15min":1.198},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.81299999999999994,"15min":0.81699999999999995},"min":{"1min":0.65300000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":0.96299999999999997,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.79300000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":765952,"data_stored":365148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.65300000000000002,"15min":0.629},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.85499999999999998,"5min":4.0510000000000002,"15min":4.0510000000000002},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.71299999999999997,"15min":0.67900000000000005},"min":{"1min":0.39300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.94899999999999995,"5min":6.431,"15min":6.431},"last":0.55900000000000005}]},{"osd":1,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.68300000000000005,"15min":0.65500000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.91300000000000003,"5min":5.3330000000000002,"15min":5.3330000000000002},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.69499999999999995,"15min":0.67100000000000004},"min":{"1min":0.47299999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.81299999999999994,"5min":4.2169999999999996,"15min":4.2169999999999996},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.70699999999999996,"15min":0.66500000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.94799999999999995,"5min":6.4850000000000003,"15min":6.4850000000000003},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.68200000000000005,"15min":0.66200000000000003},"min":{"1min":0.48099999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.80800000000000005,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":0.52300000000000002}]},{"osd":3,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.749,"15min":0.73899999999999999},"min":{"1min":0.44900000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89500000000000002,"5min":4.7809999999999997,"15min":4.7809999999999997},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.76100000000000001,"15min":0.73799999999999999},"min":{"1min":0.55100000000000005,"5min":0.503,"15min":0.503},"max":{"1min":0.86299999999999999,"5min":5.423,"15min":5.423},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.67200000000000004,"15min":0.65500000000000003},"min":{"1min":0.432,"5min":0.375,"15min":0.375},"max":{"1min":0.879,"5min":3.988,"15min":3.988},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.749,"15min":0.72699999999999998},"min":{"1min":0.46100000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.84599999999999997,"5min":4.827,"15min":4.827},"last":0.64200000000000002}]},{"osd":6,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.77800000000000002,"15min":0.73199999999999998},"min":{"1min":0.53600000000000003,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.92000000000000004,"5min":7.7000000000000002,"15min":7.7000000000000002},"last":0.747},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.75,"15min":0.72799999999999998},"min":{"1min":0.53000000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91900000000000004,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":0.501}]},{"osd":7,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.83199999999999996,"15min":0.78000000000000003},"min":{"1min":0.52300000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.91900000000000004,"5min":9.1180000000000003,"15min":9.1180000000000003},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.82699999999999996,"15min":0.80100000000000005},"min":{"1min":0.53700000000000003,"5min":0.505,"15min":0.505},"max":{"1min":0.91900000000000004,"5min":5.2880000000000003,"15min":5.2880000000000003},"last":0.78900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T20:34:55.672 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T20:34:55.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.907+0000 7f8e437ff700 1 Processor -- start 2023-07-27T20:34:55.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.908+0000 7f8e437ff700 1 -- start start 2023-07-27T20:34:55.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.909+0000 7f8e437ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e3c0c4400 0x7f8e3c0c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:55.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.909+0000 7f8e437ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8e3c06b150 0x7f8e3c0c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:55.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.909+0000 7f8e437ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8e3c1549f0 0x7f8e3c1514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:55.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.909+0000 7f8e437ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e3c1545d0 con 0x7f8e3c1549f0 2023-07-27T20:34:55.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.909+0000 7f8e437ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e3c06c860 con 0x7f8e3c06b150 2023-07-27T20:34:55.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.909+0000 7f8e437ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3c0c5230 con 0x7f8e3c0c4400 2023-07-27T20:34:55.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.909+0000 7f8e41d9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8e3c1549f0 0x7f8e3c1514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:55.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.909+0000 7f8e41d9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8e3c1549f0 0x7f8e3c1514a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48396/0 (socket says 172.21.15.72:48396) 2023-07-27T20:34:55.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.909+0000 7f8e41d9c700 1 -- 172.21.15.72:0/590340878 learned_addr learned my addr 172.21.15.72:0/590340878 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:55.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.909+0000 7f8e40d9a700 1 --2- 172.21.15.72:0/590340878 >> v2:172.21.15.173:3300/0 conn(0x7f8e3c06b150 0x7f8e3c0c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:55.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.909+0000 7f8e4159b700 1 --2- 172.21.15.72:0/590340878 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e3c0c4400 0x7f8e3c0c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:55.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.909+0000 7f8e41d9c700 1 -- 172.21.15.72:0/590340878 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e3c0c4400 msgr2=0x7f8e3c0c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:55.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.909+0000 7f8e41d9c700 1 --2- 172.21.15.72:0/590340878 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e3c0c4400 0x7f8e3c0c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:55.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.909+0000 7f8e41d9c700 1 -- 172.21.15.72:0/590340878 >> v2:172.21.15.173:3300/0 conn(0x7f8e3c06b150 msgr2=0x7f8e3c0c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:55.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.909+0000 7f8e41d9c700 1 --2- 172.21.15.72:0/590340878 >> v2:172.21.15.173:3300/0 conn(0x7f8e3c06b150 0x7f8e3c0c4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:55.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.909+0000 7f8e41d9c700 1 -- 172.21.15.72:0/590340878 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3c06b710 con 0x7f8e3c1549f0 2023-07-27T20:34:55.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.909+0000 7f8e40d9a700 1 --2- 172.21.15.72:0/590340878 >> v2:172.21.15.173:3300/0 conn(0x7f8e3c06b150 0x7f8e3c0c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:55.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.909+0000 7f8e4159b700 1 --2- 172.21.15.72:0/590340878 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e3c0c4400 0x7f8e3c0c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:34:55.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.910+0000 7f8e41d9c700 1 --2- 172.21.15.72:0/590340878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e3c1549f0 0x7f8e3c1514a0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c08b480 tx=0x7f8e3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a58469039a05dc7b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:55.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.910+0000 7f8e33fff700 1 -- 172.21.15.72:0/590340878 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3400e070 con 0x7f8e3c1549f0 2023-07-27T20:34:55.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.910+0000 7f8e33fff700 1 -- 172.21.15.72:0/590340878 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3400b9c0 con 0x7f8e3c1549f0 2023-07-27T20:34:55.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.910+0000 7f8e33fff700 1 -- 172.21.15.72:0/590340878 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3400bd70 con 0x7f8e3c1549f0 2023-07-27T20:34:55.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.910+0000 7f8e437ff700 1 -- 172.21.15.72:0/590340878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e3c1549f0 msgr2=0x7f8e3c1514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:55.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.910+0000 7f8e437ff700 1 --2- 172.21.15.72:0/590340878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e3c1549f0 0x7f8e3c1514a0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c08b480 tx=0x7f8e3400b330 comp rx=0 tx=0).stop 2023-07-27T20:34:55.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.911+0000 7f8e437ff700 1 -- 172.21.15.72:0/590340878 shutdown_connections 2023-07-27T20:34:55.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.911+0000 7f8e437ff700 1 --2- 172.21.15.72:0/590340878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e3c1549f0 0x7f8e3c1514a0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:55.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.911+0000 7f8e437ff700 1 --2- 172.21.15.72:0/590340878 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e3c0c4400 0x7f8e3c0c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:55.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.911+0000 7f8e437ff700 1 --2- 172.21.15.72:0/590340878 >> v2:172.21.15.173:3300/0 conn(0x7f8e3c06b150 0x7f8e3c0c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:55.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.911+0000 7f8e437ff700 1 -- 172.21.15.72:0/590340878 >> 172.21.15.72:0/590340878 conn(0x7f8e3c0ab300 msgr2=0x7f8e3c0ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:55.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.911+0000 7f8e437ff700 1 -- 172.21.15.72:0/590340878 shutdown_connections 2023-07-27T20:34:55.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.911+0000 7f8e437ff700 1 -- 172.21.15.72:0/590340878 wait complete. 2023-07-27T20:34:55.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.912+0000 7f8e437ff700 1 Processor -- start 2023-07-27T20:34:55.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.912+0000 7f8e437ff700 1 -- start start 2023-07-27T20:34:55.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.913+0000 7f8e437ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e3c06b150 0x7f8e3c1ed120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:55.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.913+0000 7f8e437ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e3c0c4400 0x7f8e3c1e9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:55.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.913+0000 7f8e437ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e3c1549f0 0x7f8e3c1dc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:55.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.913+0000 7f8e437ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3c1e91a0 con 0x7f8e3c1549f0 2023-07-27T20:34:55.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.913+0000 7f8e437ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3c1ed660 con 0x7f8e3c0c4400 2023-07-27T20:34:55.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.913+0000 7f8e437ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3c1e96e0 con 0x7f8e3c06b150 2023-07-27T20:34:55.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.914+0000 7f8e41d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e3c1549f0 0x7f8e3c1dc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:55.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.914+0000 7f8e41d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e3c1549f0 0x7f8e3c1dc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48404/0 (socket says 172.21.15.72:48404) 2023-07-27T20:34:55.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.914+0000 7f8e41d9c700 1 -- 172.21.15.72:0/2514203401 learned_addr learned my addr 172.21.15.72:0/2514203401 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:55.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.914+0000 7f8e40d9a700 1 --2- 172.21.15.72:0/2514203401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e3c0c4400 0x7f8e3c1e9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:55.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.914+0000 7f8e4159b700 1 --2- 172.21.15.72:0/2514203401 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e3c06b150 0x7f8e3c1ed120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:55.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.914+0000 7f8e41d9c700 1 -- 172.21.15.72:0/2514203401 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e3c06b150 msgr2=0x7f8e3c1ed120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:55.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.914+0000 7f8e41d9c700 1 --2- 172.21.15.72:0/2514203401 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e3c06b150 0x7f8e3c1ed120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:55.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.914+0000 7f8e41d9c700 1 -- 172.21.15.72:0/2514203401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e3c0c4400 msgr2=0x7f8e3c1e9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:55.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.914+0000 7f8e41d9c700 1 --2- 172.21.15.72:0/2514203401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e3c0c4400 0x7f8e3c1e9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:55.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.914+0000 7f8e41d9c700 1 -- 172.21.15.72:0/2514203401 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e34009b30 con 0x7f8e3c1549f0 2023-07-27T20:34:55.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.914+0000 7f8e40d9a700 1 --2- 172.21.15.72:0/2514203401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e3c0c4400 0x7f8e3c1e9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:55.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.914+0000 7f8e41d9c700 1 --2- 172.21.15.72:0/2514203401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e3c1549f0 0x7f8e3c1dc530 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c08b450 tx=0x7f8e34004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:55.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.914+0000 7f8e31ffb700 1 -- 172.21.15.72:0/2514203401 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e34004390 con 0x7f8e3c1549f0 2023-07-27T20:34:55.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.914+0000 7f8e31ffb700 1 -- 172.21.15.72:0/2514203401 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e34004510 con 0x7f8e3c1549f0 2023-07-27T20:34:55.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.914+0000 7f8e437ff700 1 -- 172.21.15.72:0/2514203401 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e3c1ea0b0 con 0x7f8e3c1549f0 2023-07-27T20:34:55.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.914+0000 7f8e31ffb700 1 -- 172.21.15.72:0/2514203401 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e340048c0 con 0x7f8e3c1549f0 2023-07-27T20:34:55.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.915+0000 7f8e437ff700 1 -- 172.21.15.72:0/2514203401 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e3c1de0a0 con 0x7f8e3c1549f0 2023-07-27T20:34:55.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.916+0000 7f8e437ff700 1 -- 172.21.15.72:0/2514203401 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e3c074310 con 0x7f8e3c1549f0 2023-07-27T20:34:55.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.917+0000 7f8e31ffb700 1 -- 172.21.15.72:0/2514203401 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8e3401b430 con 0x7f8e3c1549f0 2023-07-27T20:34:55.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.917+0000 7f8e31ffb700 1 --2- 172.21.15.72:0/2514203401 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8e2006ace0 0x7f8e2006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:55.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.917+0000 7f8e31ffb700 1 -- 172.21.15.72:0/2514203401 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f8e3408aea0 con 0x7f8e3c1549f0 2023-07-27T20:34:55.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.918+0000 7f8e4159b700 1 --2- 172.21.15.72:0/2514203401 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8e2006ace0 0x7f8e2006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:55.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.919+0000 7f8e4159b700 1 --2- 172.21.15.72:0/2514203401 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8e2006ace0 0x7f8e2006d1a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f8e38006fd0 tx=0x7f8e38008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:55.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:55.922+0000 7f8e31ffb700 1 -- 172.21.15.72:0/2514203401 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8e34055b40 con 0x7f8e3c1549f0 2023-07-27T20:34:56.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.111+0000 7f8e437ff700 1 -- 172.21.15.72:0/2514203401 --> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8e3c06bcd0 con 0x7f8e2006ace0 2023-07-27T20:34:56.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.126+0000 7f8e31ffb700 1 -- 172.21.15.72:0/2514203401 <== mgr.4107 v2:172.21.15.173:6832/910681537 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+538240 (secure 0 0 0) 0x7f8e3800c050 con 0x7f8e2006ace0 2023-07-27T20:34:56.120 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:34:56.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.132+0000 7f8e437ff700 1 -- 172.21.15.72:0/2514203401 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8e2006ace0 msgr2=0x7f8e2006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:56.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.132+0000 7f8e437ff700 1 --2- 172.21.15.72:0/2514203401 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8e2006ace0 0x7f8e2006d1a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f8e38006fd0 tx=0x7f8e38008040 comp rx=0 tx=0).stop 2023-07-27T20:34:56.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.132+0000 7f8e437ff700 1 -- 172.21.15.72:0/2514203401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e3c1549f0 msgr2=0x7f8e3c1dc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:56.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.132+0000 7f8e437ff700 1 --2- 172.21.15.72:0/2514203401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e3c1549f0 0x7f8e3c1dc530 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c08b450 tx=0x7f8e34004ad0 comp rx=0 tx=0).stop 2023-07-27T20:34:56.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.133+0000 7f8e437ff700 1 -- 172.21.15.72:0/2514203401 shutdown_connections 2023-07-27T20:34:56.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.133+0000 7f8e437ff700 1 --2- 172.21.15.72:0/2514203401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e3c1549f0 0x7f8e3c1dc530 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:56.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.133+0000 7f8e437ff700 1 --2- 172.21.15.72:0/2514203401 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f8e2006ace0 0x7f8e2006d1a0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:56.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.133+0000 7f8e437ff700 1 --2- 172.21.15.72:0/2514203401 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e3c06b150 0x7f8e3c1ed120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:56.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.133+0000 7f8e437ff700 1 --2- 172.21.15.72:0/2514203401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e3c0c4400 0x7f8e3c1e9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:56.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.133+0000 7f8e437ff700 1 -- 172.21.15.72:0/2514203401 >> 172.21.15.72:0/2514203401 conn(0x7f8e3c0ab300 msgr2=0x7f8e3c152dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:56.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.133+0000 7f8e437ff700 1 -- 172.21.15.72:0/2514203401 shutdown_connections 2023-07-27T20:34:56.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.133+0000 7f8e437ff700 1 -- 172.21.15.72:0/2514203401 wait complete. 2023-07-27T20:34:56.129 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-07-27T20:34:56.138 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":169,"stamp":"2023-07-27T20:34:54.579868+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594427,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":225,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223312,"kb_used_data":7152,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754751408,"statfs":{"total":773094113280,"available":772865441792,"internally_reserved":0,"allocated":7323648,"data_stored":4094630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.429404"},"pg_stats":[{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.154878+0000","last_change":"2023-07-27T20:34:34.316234+0000","last_active":"2023-07-27T20:34:49.154878+0000","last_peered":"2023-07-27T20:34:49.154878+0000","last_clean":"2023-07-27T20:34:49.154878+0000","last_became_active":"2023-07-27T20:34:34.315976+0000","last_became_peered":"2023-07-27T20:34:34.315976+0000","last_unstale":"2023-07-27T20:34:49.154878+0000","last_undegraded":"2023-07-27T20:34:49.154878+0000","last_fullsized":"2023-07-27T20:34:49.154878+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:33:06.823968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.163915+0000","last_change":"2023-07-27T20:34:34.314798+0000","last_active":"2023-07-27T20:34:49.163915+0000","last_peered":"2023-07-27T20:34:49.163915+0000","last_clean":"2023-07-27T20:34:49.163915+0000","last_became_active":"2023-07-27T20:34:34.314515+0000","last_became_peered":"2023-07-27T20:34:34.314515+0000","last_unstale":"2023-07-27T20:34:49.163915+0000","last_undegraded":"2023-07-27T20:34:49.163915+0000","last_fullsized":"2023-07-27T20:34:49.163915+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:41:23.899695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.156360+0000","last_change":"2023-07-27T20:34:34.296875+0000","last_active":"2023-07-27T20:34:49.156360+0000","last_peered":"2023-07-27T20:34:49.156360+0000","last_clean":"2023-07-27T20:34:49.156360+0000","last_became_active":"2023-07-27T20:34:34.296594+0000","last_became_peered":"2023-07-27T20:34:34.296594+0000","last_unstale":"2023-07-27T20:34:49.156360+0000","last_undegraded":"2023-07-27T20:34:49.156360+0000","last_fullsized":"2023-07-27T20:34:49.156360+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:01:48.226485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.158254+0000","last_change":"2023-07-27T20:34:34.316000+0000","last_active":"2023-07-27T20:34:49.158254+0000","last_peered":"2023-07-27T20:34:49.158254+0000","last_clean":"2023-07-27T20:34:49.158254+0000","last_became_active":"2023-07-27T20:34:34.315494+0000","last_became_peered":"2023-07-27T20:34:34.315494+0000","last_unstale":"2023-07-27T20:34:49.158254+0000","last_undegraded":"2023-07-27T20:34:49.158254+0000","last_fullsized":"2023-07-27T20:34:49.158254+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:57:36.260593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.160620+0000","last_change":"2023-07-27T20:34:34.310257+0000","last_active":"2023-07-27T20:34:49.160620+0000","last_peered":"2023-07-27T20:34:49.160620+0000","last_clean":"2023-07-27T20:34:49.160620+0000","last_became_active":"2023-07-27T20:34:34.309918+0000","last_became_peered":"2023-07-27T20:34:34.309918+0000","last_unstale":"2023-07-27T20:34:49.160620+0000","last_undegraded":"2023-07-27T20:34:49.160620+0000","last_fullsized":"2023-07-27T20:34:49.160620+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:26:30.304005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.163089+0000","last_change":"2023-07-27T20:34:34.319670+0000","last_active":"2023-07-27T20:34:49.163089+0000","last_peered":"2023-07-27T20:34:49.163089+0000","last_clean":"2023-07-27T20:34:49.163089+0000","last_became_active":"2023-07-27T20:34:34.319356+0000","last_became_peered":"2023-07-27T20:34:34.319356+0000","last_unstale":"2023-07-27T20:34:49.163089+0000","last_undegraded":"2023-07-27T20:34:49.163089+0000","last_fullsized":"2023-07-27T20:34:49.163089+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:08:06.361073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.154149+0000","last_change":"2023-07-27T20:34:34.300907+0000","last_active":"2023-07-27T20:34:49.154149+0000","last_peered":"2023-07-27T20:34:49.154149+0000","last_clean":"2023-07-27T20:34:49.154149+0000","last_became_active":"2023-07-27T20:34:34.300633+0000","last_became_peered":"2023-07-27T20:34:34.300633+0000","last_unstale":"2023-07-27T20:34:49.154149+0000","last_undegraded":"2023-07-27T20:34:49.154149+0000","last_fullsized":"2023-07-27T20:34:49.154149+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:53:59.110579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.163018+0000","last_change":"2023-07-27T20:34:34.320735+0000","last_active":"2023-07-27T20:34:49.163018+0000","last_peered":"2023-07-27T20:34:49.163018+0000","last_clean":"2023-07-27T20:34:49.163018+0000","last_became_active":"2023-07-27T20:34:34.320086+0000","last_became_peered":"2023-07-27T20:34:34.320086+0000","last_unstale":"2023-07-27T20:34:49.163018+0000","last_undegraded":"2023-07-27T20:34:49.163018+0000","last_fullsized":"2023-07-27T20:34:49.163018+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:37:00.088890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.162009+0000","last_change":"2023-07-27T20:34:34.304314+0000","last_active":"2023-07-27T20:34:49.162009+0000","last_peered":"2023-07-27T20:34:49.162009+0000","last_clean":"2023-07-27T20:34:49.162009+0000","last_became_active":"2023-07-27T20:34:34.304042+0000","last_became_peered":"2023-07-27T20:34:34.304042+0000","last_unstale":"2023-07-27T20:34:49.162009+0000","last_undegraded":"2023-07-27T20:34:49.162009+0000","last_fullsized":"2023-07-27T20:34:49.162009+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:07:41.809462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.159019+0000","last_change":"2023-07-27T20:34:34.302549+0000","last_active":"2023-07-27T20:34:49.159019+0000","last_peered":"2023-07-27T20:34:49.159019+0000","last_clean":"2023-07-27T20:34:49.159019+0000","last_became_active":"2023-07-27T20:34:34.301699+0000","last_became_peered":"2023-07-27T20:34:34.301699+0000","last_unstale":"2023-07-27T20:34:49.159019+0000","last_undegraded":"2023-07-27T20:34:49.159019+0000","last_fullsized":"2023-07-27T20:34:49.159019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:01:48.226485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.154716+0000","last_change":"2023-07-27T20:34:34.313419+0000","last_active":"2023-07-27T20:34:49.154716+0000","last_peered":"2023-07-27T20:34:49.154716+0000","last_clean":"2023-07-27T20:34:49.154716+0000","last_became_active":"2023-07-27T20:34:34.313089+0000","last_became_peered":"2023-07-27T20:34:34.313089+0000","last_unstale":"2023-07-27T20:34:49.154716+0000","last_undegraded":"2023-07-27T20:34:49.154716+0000","last_fullsized":"2023-07-27T20:34:49.154716+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:22:39.673260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.158388+0000","last_change":"2023-07-27T20:34:34.298435+0000","last_active":"2023-07-27T20:34:49.158388+0000","last_peered":"2023-07-27T20:34:49.158388+0000","last_clean":"2023-07-27T20:34:49.158388+0000","last_became_active":"2023-07-27T20:34:34.298143+0000","last_became_peered":"2023-07-27T20:34:34.298143+0000","last_unstale":"2023-07-27T20:34:49.158388+0000","last_undegraded":"2023-07-27T20:34:49.158388+0000","last_fullsized":"2023-07-27T20:34:49.158388+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:59:35.844198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.151966+0000","last_change":"2023-07-27T20:34:34.316878+0000","last_active":"2023-07-27T20:34:49.151966+0000","last_peered":"2023-07-27T20:34:49.151966+0000","last_clean":"2023-07-27T20:34:49.151966+0000","last_became_active":"2023-07-27T20:34:34.316610+0000","last_became_peered":"2023-07-27T20:34:34.316610+0000","last_unstale":"2023-07-27T20:34:49.151966+0000","last_undegraded":"2023-07-27T20:34:49.151966+0000","last_fullsized":"2023-07-27T20:34:49.151966+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:13:03.759838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.160779+0000","last_change":"2023-07-27T20:34:34.297203+0000","last_active":"2023-07-27T20:34:49.160779+0000","last_peered":"2023-07-27T20:34:49.160779+0000","last_clean":"2023-07-27T20:34:49.160779+0000","last_became_active":"2023-07-27T20:34:34.296957+0000","last_became_peered":"2023-07-27T20:34:34.296957+0000","last_unstale":"2023-07-27T20:34:49.160779+0000","last_undegraded":"2023-07-27T20:34:49.160779+0000","last_fullsized":"2023-07-27T20:34:49.160779+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:04:33.468676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.151829+0000","last_change":"2023-07-27T20:34:34.294995+0000","last_active":"2023-07-27T20:34:49.151829+0000","last_peered":"2023-07-27T20:34:49.151829+0000","last_clean":"2023-07-27T20:34:49.151829+0000","last_became_active":"2023-07-27T20:34:34.294646+0000","last_became_peered":"2023-07-27T20:34:34.294646+0000","last_unstale":"2023-07-27T20:34:49.151829+0000","last_undegraded":"2023-07-27T20:34:49.151829+0000","last_fullsized":"2023-07-27T20:34:49.151829+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:25:42.182409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.158094+0000","last_change":"2023-07-27T20:34:34.309167+0000","last_active":"2023-07-27T20:34:49.158094+0000","last_peered":"2023-07-27T20:34:49.158094+0000","last_clean":"2023-07-27T20:34:49.158094+0000","last_became_active":"2023-07-27T20:34:34.308831+0000","last_became_peered":"2023-07-27T20:34:34.308831+0000","last_unstale":"2023-07-27T20:34:49.158094+0000","last_undegraded":"2023-07-27T20:34:49.158094+0000","last_fullsized":"2023-07-27T20:34:49.158094+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:09:19.279175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.162008+0000","last_change":"2023-07-27T20:34:34.298405+0000","last_active":"2023-07-27T20:34:49.162008+0000","last_peered":"2023-07-27T20:34:49.162008+0000","last_clean":"2023-07-27T20:34:49.162008+0000","last_became_active":"2023-07-27T20:34:34.298150+0000","last_became_peered":"2023-07-27T20:34:34.298150+0000","last_unstale":"2023-07-27T20:34:49.162008+0000","last_undegraded":"2023-07-27T20:34:49.162008+0000","last_fullsized":"2023-07-27T20:34:49.162008+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:27:45.358766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.158193+0000","last_change":"2023-07-27T20:34:34.316418+0000","last_active":"2023-07-27T20:34:49.158193+0000","last_peered":"2023-07-27T20:34:49.158193+0000","last_clean":"2023-07-27T20:34:49.158193+0000","last_became_active":"2023-07-27T20:34:34.316164+0000","last_became_peered":"2023-07-27T20:34:34.316164+0000","last_unstale":"2023-07-27T20:34:49.158193+0000","last_undegraded":"2023-07-27T20:34:49.158193+0000","last_fullsized":"2023-07-27T20:34:49.158193+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:57:09.026861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.163708+0000","last_change":"2023-07-27T20:34:34.322046+0000","last_active":"2023-07-27T20:34:49.163708+0000","last_peered":"2023-07-27T20:34:49.163708+0000","last_clean":"2023-07-27T20:34:49.163708+0000","last_became_active":"2023-07-27T20:34:34.321751+0000","last_became_peered":"2023-07-27T20:34:34.321751+0000","last_unstale":"2023-07-27T20:34:49.163708+0000","last_undegraded":"2023-07-27T20:34:49.163708+0000","last_fullsized":"2023-07-27T20:34:49.163708+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:15:19.381194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.152003+0000","last_change":"2023-07-27T20:34:34.298450+0000","last_active":"2023-07-27T20:34:49.152003+0000","last_peered":"2023-07-27T20:34:49.152003+0000","last_clean":"2023-07-27T20:34:49.152003+0000","last_became_active":"2023-07-27T20:34:34.298194+0000","last_became_peered":"2023-07-27T20:34:34.298194+0000","last_unstale":"2023-07-27T20:34:49.152003+0000","last_undegraded":"2023-07-27T20:34:49.152003+0000","last_fullsized":"2023-07-27T20:34:49.152003+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:34:27.632697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.158713+0000","last_change":"2023-07-27T20:34:34.295428+0000","last_active":"2023-07-27T20:34:49.158713+0000","last_peered":"2023-07-27T20:34:49.158713+0000","last_clean":"2023-07-27T20:34:49.158713+0000","last_became_active":"2023-07-27T20:34:34.295069+0000","last_became_peered":"2023-07-27T20:34:34.295069+0000","last_unstale":"2023-07-27T20:34:49.158713+0000","last_undegraded":"2023-07-27T20:34:49.158713+0000","last_fullsized":"2023-07-27T20:34:49.158713+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:54:18.189843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.158699+0000","last_change":"2023-07-27T20:34:34.300794+0000","last_active":"2023-07-27T20:34:49.158699+0000","last_peered":"2023-07-27T20:34:49.158699+0000","last_clean":"2023-07-27T20:34:49.158699+0000","last_became_active":"2023-07-27T20:34:34.300470+0000","last_became_peered":"2023-07-27T20:34:34.300470+0000","last_unstale":"2023-07-27T20:34:49.158699+0000","last_undegraded":"2023-07-27T20:34:49.158699+0000","last_fullsized":"2023-07-27T20:34:49.158699+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:12:47.413814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.153483+0000","last_change":"2023-07-27T20:34:34.306170+0000","last_active":"2023-07-27T20:34:49.153483+0000","last_peered":"2023-07-27T20:34:49.153483+0000","last_clean":"2023-07-27T20:34:49.153483+0000","last_became_active":"2023-07-27T20:34:34.305895+0000","last_became_peered":"2023-07-27T20:34:34.305895+0000","last_unstale":"2023-07-27T20:34:49.153483+0000","last_undegraded":"2023-07-27T20:34:49.153483+0000","last_fullsized":"2023-07-27T20:34:49.153483+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:08:39.732716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.153665+0000","last_change":"2023-07-27T20:34:34.324172+0000","last_active":"2023-07-27T20:34:49.153665+0000","last_peered":"2023-07-27T20:34:49.153665+0000","last_clean":"2023-07-27T20:34:49.153665+0000","last_became_active":"2023-07-27T20:34:34.323886+0000","last_became_peered":"2023-07-27T20:34:34.323886+0000","last_unstale":"2023-07-27T20:34:49.153665+0000","last_undegraded":"2023-07-27T20:34:49.153665+0000","last_fullsized":"2023-07-27T20:34:49.153665+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:06:44.358382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.158777+0000","last_change":"2023-07-27T20:34:34.312549+0000","last_active":"2023-07-27T20:34:49.158777+0000","last_peered":"2023-07-27T20:34:49.158777+0000","last_clean":"2023-07-27T20:34:49.158777+0000","last_became_active":"2023-07-27T20:34:34.311940+0000","last_became_peered":"2023-07-27T20:34:34.311940+0000","last_unstale":"2023-07-27T20:34:49.158777+0000","last_undegraded":"2023-07-27T20:34:49.158777+0000","last_fullsized":"2023-07-27T20:34:49.158777+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:58:23.176880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.155053+0000","last_change":"2023-07-27T20:34:34.315088+0000","last_active":"2023-07-27T20:34:49.155053+0000","last_peered":"2023-07-27T20:34:49.155053+0000","last_clean":"2023-07-27T20:34:49.155053+0000","last_became_active":"2023-07-27T20:34:34.314823+0000","last_became_peered":"2023-07-27T20:34:34.314823+0000","last_unstale":"2023-07-27T20:34:49.155053+0000","last_undegraded":"2023-07-27T20:34:49.155053+0000","last_fullsized":"2023-07-27T20:34:49.155053+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:57:27.220593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.156477+0000","last_change":"2023-07-27T20:34:34.309744+0000","last_active":"2023-07-27T20:34:49.156477+0000","last_peered":"2023-07-27T20:34:49.156477+0000","last_clean":"2023-07-27T20:34:49.156477+0000","last_became_active":"2023-07-27T20:34:34.309438+0000","last_became_peered":"2023-07-27T20:34:34.309438+0000","last_unstale":"2023-07-27T20:34:49.156477+0000","last_undegraded":"2023-07-27T20:34:49.156477+0000","last_fullsized":"2023-07-27T20:34:49.156477+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:32:37.897239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.158923+0000","last_change":"2023-07-27T20:34:34.300111+0000","last_active":"2023-07-27T20:34:49.158923+0000","last_peered":"2023-07-27T20:34:49.158923+0000","last_clean":"2023-07-27T20:34:49.158923+0000","last_became_active":"2023-07-27T20:34:34.298555+0000","last_became_peered":"2023-07-27T20:34:34.298555+0000","last_unstale":"2023-07-27T20:34:49.158923+0000","last_undegraded":"2023-07-27T20:34:49.158923+0000","last_fullsized":"2023-07-27T20:34:49.158923+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:33:33.672903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.156655+0000","last_change":"2023-07-27T20:34:34.299682+0000","last_active":"2023-07-27T20:34:49.156655+0000","last_peered":"2023-07-27T20:34:49.156655+0000","last_clean":"2023-07-27T20:34:49.156655+0000","last_became_active":"2023-07-27T20:34:34.299402+0000","last_became_peered":"2023-07-27T20:34:34.299402+0000","last_unstale":"2023-07-27T20:34:49.156655+0000","last_undegraded":"2023-07-27T20:34:49.156655+0000","last_fullsized":"2023-07-27T20:34:49.156655+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:50:09.306756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.153607+0000","last_change":"2023-07-27T20:34:34.320185+0000","last_active":"2023-07-27T20:34:49.153607+0000","last_peered":"2023-07-27T20:34:49.153607+0000","last_clean":"2023-07-27T20:34:49.153607+0000","last_became_active":"2023-07-27T20:34:34.319865+0000","last_became_peered":"2023-07-27T20:34:34.319865+0000","last_unstale":"2023-07-27T20:34:49.153607+0000","last_undegraded":"2023-07-27T20:34:49.153607+0000","last_fullsized":"2023-07-27T20:34:49.153607+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:52:46.464966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.154330+0000","last_change":"2023-07-27T20:34:34.297379+0000","last_active":"2023-07-27T20:34:49.154330+0000","last_peered":"2023-07-27T20:34:49.154330+0000","last_clean":"2023-07-27T20:34:49.154330+0000","last_became_active":"2023-07-27T20:34:34.297105+0000","last_became_peered":"2023-07-27T20:34:34.297105+0000","last_unstale":"2023-07-27T20:34:49.154330+0000","last_undegraded":"2023-07-27T20:34:49.154330+0000","last_fullsized":"2023-07-27T20:34:49.154330+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:14:10.177189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.163048+0000","last_change":"2023-07-27T20:34:34.321045+0000","last_active":"2023-07-27T20:34:49.163048+0000","last_peered":"2023-07-27T20:34:49.163048+0000","last_clean":"2023-07-27T20:34:49.163048+0000","last_became_active":"2023-07-27T20:34:34.320433+0000","last_became_peered":"2023-07-27T20:34:34.320433+0000","last_unstale":"2023-07-27T20:34:49.163048+0000","last_undegraded":"2023-07-27T20:34:49.163048+0000","last_fullsized":"2023-07-27T20:34:49.163048+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:05:05.214592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.154252+0000","last_change":"2023-07-27T20:34:49.154252+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.154252+0000","last_undegraded":"2023-07-27T20:34:49.154252+0000","last_fullsized":"2023-07-27T20:34:49.154252+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.154639+0000","last_change":"2023-07-27T20:34:34.325790+0000","last_active":"2023-07-27T20:34:49.154639+0000","last_peered":"2023-07-27T20:34:49.154639+0000","last_clean":"2023-07-27T20:34:49.154639+0000","last_became_active":"2023-07-27T20:34:34.325387+0000","last_became_peered":"2023-07-27T20:34:34.325387+0000","last_unstale":"2023-07-27T20:34:49.154639+0000","last_undegraded":"2023-07-27T20:34:49.154639+0000","last_fullsized":"2023-07-27T20:34:49.154639+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:42:19.886381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"61'4","reported_seq":19,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.155258+0000","last_change":"2023-07-27T20:34:33.303138+0000","last_active":"2023-07-27T20:34:49.155258+0000","last_peered":"2023-07-27T20:34:49.155258+0000","last_clean":"2023-07-27T20:34:49.155258+0000","last_became_active":"2023-07-27T20:34:33.302808+0000","last_became_peered":"2023-07-27T20:34:33.302808+0000","last_unstale":"2023-07-27T20:34:49.155258+0000","last_undegraded":"2023-07-27T20:34:49.155258+0000","last_fullsized":"2023-07-27T20:34:49.155258+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:34:47.776999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.156049+0000","last_change":"2023-07-27T20:34:49.156049+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.156049+0000","last_undegraded":"2023-07-27T20:34:49.156049+0000","last_fullsized":"2023-07-27T20:34:49.156049+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.162128+0000","last_change":"2023-07-27T20:34:34.298335+0000","last_active":"2023-07-27T20:34:49.162128+0000","last_peered":"2023-07-27T20:34:49.162128+0000","last_clean":"2023-07-27T20:34:49.162128+0000","last_became_active":"2023-07-27T20:34:34.298050+0000","last_became_peered":"2023-07-27T20:34:34.298050+0000","last_unstale":"2023-07-27T20:34:49.162128+0000","last_undegraded":"2023-07-27T20:34:49.162128+0000","last_fullsized":"2023-07-27T20:34:49.162128+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:27:35.353575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"61'1","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.152203+0000","last_change":"2023-07-27T20:34:33.298365+0000","last_active":"2023-07-27T20:34:49.152203+0000","last_peered":"2023-07-27T20:34:49.152203+0000","last_clean":"2023-07-27T20:34:49.152203+0000","last_became_active":"2023-07-27T20:34:33.298105+0000","last_became_peered":"2023-07-27T20:34:33.298105+0000","last_unstale":"2023-07-27T20:34:49.152203+0000","last_undegraded":"2023-07-27T20:34:49.152203+0000","last_fullsized":"2023-07-27T20:34:49.152203+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:51:16.894541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.157025+0000","last_change":"2023-07-27T20:34:49.157025+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.157025+0000","last_undegraded":"2023-07-27T20:34:49.157025+0000","last_fullsized":"2023-07-27T20:34:49.157025+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.163569+0000","last_change":"2023-07-27T20:34:34.323261+0000","last_active":"2023-07-27T20:34:49.163569+0000","last_peered":"2023-07-27T20:34:49.163569+0000","last_clean":"2023-07-27T20:34:49.163569+0000","last_became_active":"2023-07-27T20:34:34.322945+0000","last_became_peered":"2023-07-27T20:34:34.322945+0000","last_unstale":"2023-07-27T20:34:49.163569+0000","last_undegraded":"2023-07-27T20:34:49.163569+0000","last_fullsized":"2023-07-27T20:34:49.163569+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:14:40.775158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"61'2","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.158956+0000","last_change":"2023-07-27T20:34:33.303171+0000","last_active":"2023-07-27T20:34:49.158956+0000","last_peered":"2023-07-27T20:34:49.158956+0000","last_clean":"2023-07-27T20:34:49.158956+0000","last_became_active":"2023-07-27T20:34:33.302865+0000","last_became_peered":"2023-07-27T20:34:33.302865+0000","last_unstale":"2023-07-27T20:34:49.158956+0000","last_undegraded":"2023-07-27T20:34:49.158956+0000","last_fullsized":"2023-07-27T20:34:49.158956+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:33:01.060593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.157759+0000","last_change":"2023-07-27T20:34:49.157759+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.157759+0000","last_undegraded":"2023-07-27T20:34:49.157759+0000","last_fullsized":"2023-07-27T20:34:49.157759+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.154863+0000","last_change":"2023-07-27T20:34:34.314330+0000","last_active":"2023-07-27T20:34:49.154863+0000","last_peered":"2023-07-27T20:34:49.154863+0000","last_clean":"2023-07-27T20:34:49.154863+0000","last_became_active":"2023-07-27T20:34:34.314054+0000","last_became_peered":"2023-07-27T20:34:34.314054+0000","last_unstale":"2023-07-27T20:34:49.154863+0000","last_undegraded":"2023-07-27T20:34:49.154863+0000","last_fullsized":"2023-07-27T20:34:49.154863+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:26:48.653404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"61'2","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.163826+0000","last_change":"2023-07-27T20:34:33.307004+0000","last_active":"2023-07-27T20:34:49.163826+0000","last_peered":"2023-07-27T20:34:49.163826+0000","last_clean":"2023-07-27T20:34:49.163826+0000","last_became_active":"2023-07-27T20:34:33.306710+0000","last_became_peered":"2023-07-27T20:34:33.306710+0000","last_unstale":"2023-07-27T20:34:49.163826+0000","last_undegraded":"2023-07-27T20:34:49.163826+0000","last_fullsized":"2023-07-27T20:34:49.163826+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:51:29.915647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.154932+0000","last_change":"2023-07-27T20:34:49.154932+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.154932+0000","last_undegraded":"2023-07-27T20:34:49.154932+0000","last_fullsized":"2023-07-27T20:34:49.154932+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.153869+0000","last_change":"2023-07-27T20:34:34.304872+0000","last_active":"2023-07-27T20:34:49.153869+0000","last_peered":"2023-07-27T20:34:49.153869+0000","last_clean":"2023-07-27T20:34:49.153869+0000","last_became_active":"2023-07-27T20:34:34.304583+0000","last_became_peered":"2023-07-27T20:34:34.304583+0000","last_unstale":"2023-07-27T20:34:49.153869+0000","last_undegraded":"2023-07-27T20:34:49.153869+0000","last_fullsized":"2023-07-27T20:34:49.153869+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:16:10.931367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"61'1","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.156957+0000","last_change":"2023-07-27T20:34:33.303472+0000","last_active":"2023-07-27T20:34:49.156957+0000","last_peered":"2023-07-27T20:34:49.156957+0000","last_clean":"2023-07-27T20:34:49.156957+0000","last_became_active":"2023-07-27T20:34:33.303211+0000","last_became_peered":"2023-07-27T20:34:33.303211+0000","last_unstale":"2023-07-27T20:34:49.156957+0000","last_undegraded":"2023-07-27T20:34:49.156957+0000","last_fullsized":"2023-07-27T20:34:49.156957+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:45:42.296046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.155023+0000","last_change":"2023-07-27T20:34:49.155023+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.155023+0000","last_undegraded":"2023-07-27T20:34:49.155023+0000","last_fullsized":"2023-07-27T20:34:49.155023+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.158957+0000","last_change":"2023-07-27T20:34:34.309855+0000","last_active":"2023-07-27T20:34:49.158957+0000","last_peered":"2023-07-27T20:34:49.158957+0000","last_clean":"2023-07-27T20:34:49.158957+0000","last_became_active":"2023-07-27T20:34:34.309553+0000","last_became_peered":"2023-07-27T20:34:34.309553+0000","last_unstale":"2023-07-27T20:34:49.158957+0000","last_undegraded":"2023-07-27T20:34:49.158957+0000","last_fullsized":"2023-07-27T20:34:49.158957+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:45:52.450376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"61'1","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.163193+0000","last_change":"2023-07-27T20:34:33.307265+0000","last_active":"2023-07-27T20:34:49.163193+0000","last_peered":"2023-07-27T20:34:49.163193+0000","last_clean":"2023-07-27T20:34:49.163193+0000","last_became_active":"2023-07-27T20:34:33.306583+0000","last_became_peered":"2023-07-27T20:34:33.306583+0000","last_unstale":"2023-07-27T20:34:49.163193+0000","last_undegraded":"2023-07-27T20:34:49.163193+0000","last_fullsized":"2023-07-27T20:34:49.163193+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:05:02.789753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.162353+0000","last_change":"2023-07-27T20:34:49.162353+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.162353+0000","last_undegraded":"2023-07-27T20:34:49.162353+0000","last_fullsized":"2023-07-27T20:34:49.162353+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.159725+0000","last_change":"2023-07-27T20:34:34.305104+0000","last_active":"2023-07-27T20:34:49.159725+0000","last_peered":"2023-07-27T20:34:49.159725+0000","last_clean":"2023-07-27T20:34:49.159725+0000","last_became_active":"2023-07-27T20:34:34.304828+0000","last_became_peered":"2023-07-27T20:34:34.304828+0000","last_unstale":"2023-07-27T20:34:49.159725+0000","last_undegraded":"2023-07-27T20:34:49.159725+0000","last_fullsized":"2023-07-27T20:34:49.159725+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:28:26.215983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.157532+0000","last_change":"2023-07-27T20:34:33.304005+0000","last_active":"2023-07-27T20:34:49.157532+0000","last_peered":"2023-07-27T20:34:49.157532+0000","last_clean":"2023-07-27T20:34:49.157532+0000","last_became_active":"2023-07-27T20:34:33.303744+0000","last_became_peered":"2023-07-27T20:34:33.303744+0000","last_unstale":"2023-07-27T20:34:49.157532+0000","last_undegraded":"2023-07-27T20:34:49.157532+0000","last_fullsized":"2023-07-27T20:34:49.157532+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:35:04.860322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.156981+0000","last_change":"2023-07-27T20:34:49.156981+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.156981+0000","last_undegraded":"2023-07-27T20:34:49.156981+0000","last_fullsized":"2023-07-27T20:34:49.156981+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.151885+0000","last_change":"2023-07-27T20:34:34.310350+0000","last_active":"2023-07-27T20:34:49.151885+0000","last_peered":"2023-07-27T20:34:49.151885+0000","last_clean":"2023-07-27T20:34:49.151885+0000","last_became_active":"2023-07-27T20:34:34.310068+0000","last_became_peered":"2023-07-27T20:34:34.310068+0000","last_unstale":"2023-07-27T20:34:49.151885+0000","last_undegraded":"2023-07-27T20:34:49.151885+0000","last_fullsized":"2023-07-27T20:34:49.151885+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:59:08.804625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.159915+0000","last_change":"2023-07-27T20:34:33.299254+0000","last_active":"2023-07-27T20:34:49.159915+0000","last_peered":"2023-07-27T20:34:49.159915+0000","last_clean":"2023-07-27T20:34:49.159915+0000","last_became_active":"2023-07-27T20:34:33.298978+0000","last_became_peered":"2023-07-27T20:34:33.298978+0000","last_unstale":"2023-07-27T20:34:49.159915+0000","last_undegraded":"2023-07-27T20:34:49.159915+0000","last_fullsized":"2023-07-27T20:34:49.159915+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:48:52.025296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.153002+0000","last_change":"2023-07-27T20:34:49.153002+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.153002+0000","last_undegraded":"2023-07-27T20:34:49.153002+0000","last_fullsized":"2023-07-27T20:34:49.153002+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.155179+0000","last_change":"2023-07-27T20:34:34.313397+0000","last_active":"2023-07-27T20:34:49.155179+0000","last_peered":"2023-07-27T20:34:49.155179+0000","last_clean":"2023-07-27T20:34:49.155179+0000","last_became_active":"2023-07-27T20:34:34.313128+0000","last_became_peered":"2023-07-27T20:34:34.313128+0000","last_unstale":"2023-07-27T20:34:49.155179+0000","last_undegraded":"2023-07-27T20:34:49.155179+0000","last_fullsized":"2023-07-27T20:34:49.155179+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:23:24.266770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.158958+0000","last_change":"2023-07-27T20:34:33.299760+0000","last_active":"2023-07-27T20:34:49.158958+0000","last_peered":"2023-07-27T20:34:49.158958+0000","last_clean":"2023-07-27T20:34:49.158958+0000","last_became_active":"2023-07-27T20:34:33.299488+0000","last_became_peered":"2023-07-27T20:34:33.299488+0000","last_unstale":"2023-07-27T20:34:49.158958+0000","last_undegraded":"2023-07-27T20:34:49.158958+0000","last_fullsized":"2023-07-27T20:34:49.158958+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:16:26.061594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.154318+0000","last_change":"2023-07-27T20:34:49.154318+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.154318+0000","last_undegraded":"2023-07-27T20:34:49.154318+0000","last_fullsized":"2023-07-27T20:34:49.154318+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.155031+0000","last_change":"2023-07-27T20:34:34.324198+0000","last_active":"2023-07-27T20:34:49.155031+0000","last_peered":"2023-07-27T20:34:49.155031+0000","last_clean":"2023-07-27T20:34:49.155031+0000","last_became_active":"2023-07-27T20:34:34.323865+0000","last_became_peered":"2023-07-27T20:34:34.323865+0000","last_unstale":"2023-07-27T20:34:49.155031+0000","last_undegraded":"2023-07-27T20:34:49.155031+0000","last_fullsized":"2023-07-27T20:34:49.155031+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:36:23.221362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.164171+0000","last_change":"2023-07-27T20:34:33.309943+0000","last_active":"2023-07-27T20:34:49.164171+0000","last_peered":"2023-07-27T20:34:49.164171+0000","last_clean":"2023-07-27T20:34:49.164171+0000","last_became_active":"2023-07-27T20:34:33.309650+0000","last_became_peered":"2023-07-27T20:34:33.309650+0000","last_unstale":"2023-07-27T20:34:49.164171+0000","last_undegraded":"2023-07-27T20:34:49.164171+0000","last_fullsized":"2023-07-27T20:34:49.164171+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:33:12.225937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.155657+0000","last_change":"2023-07-27T20:34:49.155657+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.155657+0000","last_undegraded":"2023-07-27T20:34:49.155657+0000","last_fullsized":"2023-07-27T20:34:49.155657+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.163573+0000","last_change":"2023-07-27T20:34:34.313276+0000","last_active":"2023-07-27T20:34:49.163573+0000","last_peered":"2023-07-27T20:34:49.163573+0000","last_clean":"2023-07-27T20:34:49.163573+0000","last_became_active":"2023-07-27T20:34:34.310175+0000","last_became_peered":"2023-07-27T20:34:34.310175+0000","last_unstale":"2023-07-27T20:34:49.163573+0000","last_undegraded":"2023-07-27T20:34:49.163573+0000","last_fullsized":"2023-07-27T20:34:49.163573+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:02:18.049530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"61'3","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.156602+0000","last_change":"2023-07-27T20:34:33.302814+0000","last_active":"2023-07-27T20:34:49.156602+0000","last_peered":"2023-07-27T20:34:49.156602+0000","last_clean":"2023-07-27T20:34:49.156602+0000","last_became_active":"2023-07-27T20:34:33.302504+0000","last_became_peered":"2023-07-27T20:34:33.302504+0000","last_unstale":"2023-07-27T20:34:49.156602+0000","last_undegraded":"2023-07-27T20:34:49.156602+0000","last_fullsized":"2023-07-27T20:34:49.156602+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:04:04.636272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.157460+0000","last_change":"2023-07-27T20:34:49.157460+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.157460+0000","last_undegraded":"2023-07-27T20:34:49.157460+0000","last_fullsized":"2023-07-27T20:34:49.157460+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.161552+0000","last_change":"2023-07-27T20:34:34.302062+0000","last_active":"2023-07-27T20:34:49.161552+0000","last_peered":"2023-07-27T20:34:49.161552+0000","last_clean":"2023-07-27T20:34:49.161552+0000","last_became_active":"2023-07-27T20:34:34.301760+0000","last_became_peered":"2023-07-27T20:34:34.301760+0000","last_unstale":"2023-07-27T20:34:49.161552+0000","last_undegraded":"2023-07-27T20:34:49.161552+0000","last_fullsized":"2023-07-27T20:34:49.161552+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:13:24.872931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"62'8","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.158634+0000","last_change":"2023-07-27T20:34:33.300792+0000","last_active":"2023-07-27T20:34:49.158634+0000","last_peered":"2023-07-27T20:34:49.158634+0000","last_clean":"2023-07-27T20:34:49.158634+0000","last_became_active":"2023-07-27T20:34:33.300452+0000","last_became_peered":"2023-07-27T20:34:33.300452+0000","last_unstale":"2023-07-27T20:34:49.158634+0000","last_undegraded":"2023-07-27T20:34:49.158634+0000","last_fullsized":"2023-07-27T20:34:49.158634+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:38:59.151258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3261,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.161717+0000","last_change":"2023-07-27T20:34:49.161717+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.161717+0000","last_undegraded":"2023-07-27T20:34:49.161717+0000","last_fullsized":"2023-07-27T20:34:49.161717+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.153513+0000","last_change":"2023-07-27T20:34:34.309848+0000","last_active":"2023-07-27T20:34:49.153513+0000","last_peered":"2023-07-27T20:34:49.153513+0000","last_clean":"2023-07-27T20:34:49.153513+0000","last_became_active":"2023-07-27T20:34:34.309567+0000","last_became_peered":"2023-07-27T20:34:34.309567+0000","last_unstale":"2023-07-27T20:34:49.153513+0000","last_undegraded":"2023-07-27T20:34:49.153513+0000","last_fullsized":"2023-07-27T20:34:49.153513+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:01:37.482193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"61'2","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.159448+0000","last_change":"2023-07-27T20:34:33.303304+0000","last_active":"2023-07-27T20:34:49.159448+0000","last_peered":"2023-07-27T20:34:49.159448+0000","last_clean":"2023-07-27T20:34:49.159448+0000","last_became_active":"2023-07-27T20:34:33.303051+0000","last_became_peered":"2023-07-27T20:34:33.303051+0000","last_unstale":"2023-07-27T20:34:49.159448+0000","last_undegraded":"2023-07-27T20:34:49.159448+0000","last_fullsized":"2023-07-27T20:34:49.159448+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:58:37.721794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.152985+0000","last_change":"2023-07-27T20:34:49.152985+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.152985+0000","last_undegraded":"2023-07-27T20:34:49.152985+0000","last_fullsized":"2023-07-27T20:34:49.152985+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.153780+0000","last_change":"2023-07-27T20:34:34.297996+0000","last_active":"2023-07-27T20:34:49.153780+0000","last_peered":"2023-07-27T20:34:49.153780+0000","last_clean":"2023-07-27T20:34:49.153780+0000","last_became_active":"2023-07-27T20:34:34.297650+0000","last_became_peered":"2023-07-27T20:34:34.297650+0000","last_unstale":"2023-07-27T20:34:49.153780+0000","last_undegraded":"2023-07-27T20:34:49.153780+0000","last_fullsized":"2023-07-27T20:34:49.153780+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:06:47.873925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.163448+0000","last_change":"2023-07-27T20:34:33.307281+0000","last_active":"2023-07-27T20:34:49.163448+0000","last_peered":"2023-07-27T20:34:49.163448+0000","last_clean":"2023-07-27T20:34:49.163448+0000","last_became_active":"2023-07-27T20:34:33.306983+0000","last_became_peered":"2023-07-27T20:34:33.306983+0000","last_unstale":"2023-07-27T20:34:49.163448+0000","last_undegraded":"2023-07-27T20:34:49.163448+0000","last_fullsized":"2023-07-27T20:34:49.163448+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:53:41.579455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.161893+0000","last_change":"2023-07-27T20:34:49.161893+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.161893+0000","last_undegraded":"2023-07-27T20:34:49.161893+0000","last_fullsized":"2023-07-27T20:34:49.161893+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.151755+0000","last_change":"2023-07-27T20:34:34.317382+0000","last_active":"2023-07-27T20:34:49.151755+0000","last_peered":"2023-07-27T20:34:49.151755+0000","last_clean":"2023-07-27T20:34:49.151755+0000","last_became_active":"2023-07-27T20:34:34.317102+0000","last_became_peered":"2023-07-27T20:34:34.317102+0000","last_unstale":"2023-07-27T20:34:49.151755+0000","last_undegraded":"2023-07-27T20:34:49.151755+0000","last_fullsized":"2023-07-27T20:34:49.151755+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:58:19.455457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.154528+0000","last_change":"2023-07-27T20:34:33.301597+0000","last_active":"2023-07-27T20:34:49.154528+0000","last_peered":"2023-07-27T20:34:49.154528+0000","last_clean":"2023-07-27T20:34:49.154528+0000","last_became_active":"2023-07-27T20:34:33.301302+0000","last_became_peered":"2023-07-27T20:34:33.301302+0000","last_unstale":"2023-07-27T20:34:49.154528+0000","last_undegraded":"2023-07-27T20:34:49.154528+0000","last_fullsized":"2023-07-27T20:34:49.154528+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:16:21.244868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.161090+0000","last_change":"2023-07-27T20:34:49.161090+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.161090+0000","last_undegraded":"2023-07-27T20:34:49.161090+0000","last_fullsized":"2023-07-27T20:34:49.161090+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.160159+0000","last_change":"2023-07-27T20:34:34.299216+0000","last_active":"2023-07-27T20:34:49.160159+0000","last_peered":"2023-07-27T20:34:49.160159+0000","last_clean":"2023-07-27T20:34:49.160159+0000","last_became_active":"2023-07-27T20:34:34.298877+0000","last_became_peered":"2023-07-27T20:34:34.298877+0000","last_unstale":"2023-07-27T20:34:49.160159+0000","last_undegraded":"2023-07-27T20:34:49.160159+0000","last_fullsized":"2023-07-27T20:34:49.160159+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:02:51.885628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"61'8","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.158206+0000","last_change":"2023-07-27T20:34:33.301967+0000","last_active":"2023-07-27T20:34:49.158206+0000","last_peered":"2023-07-27T20:34:49.158206+0000","last_clean":"2023-07-27T20:34:49.158206+0000","last_became_active":"2023-07-27T20:34:33.301702+0000","last_became_peered":"2023-07-27T20:34:33.301702+0000","last_unstale":"2023-07-27T20:34:49.158206+0000","last_undegraded":"2023-07-27T20:34:49.158206+0000","last_fullsized":"2023-07-27T20:34:49.158206+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:43:17.714323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.161300+0000","last_change":"2023-07-27T20:34:49.161300+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.161300+0000","last_undegraded":"2023-07-27T20:34:49.161300+0000","last_fullsized":"2023-07-27T20:34:49.161300+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.152222+0000","last_change":"2023-07-27T20:34:34.294954+0000","last_active":"2023-07-27T20:34:49.152222+0000","last_peered":"2023-07-27T20:34:49.152222+0000","last_clean":"2023-07-27T20:34:49.152222+0000","last_became_active":"2023-07-27T20:34:34.294073+0000","last_became_peered":"2023-07-27T20:34:34.294073+0000","last_unstale":"2023-07-27T20:34:49.152222+0000","last_undegraded":"2023-07-27T20:34:49.152222+0000","last_fullsized":"2023-07-27T20:34:49.152222+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:54:12.550947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"61'2","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.164253+0000","last_change":"2023-07-27T20:34:33.308165+0000","last_active":"2023-07-27T20:34:49.164253+0000","last_peered":"2023-07-27T20:34:49.164253+0000","last_clean":"2023-07-27T20:34:49.164253+0000","last_became_active":"2023-07-27T20:34:33.307868+0000","last_became_peered":"2023-07-27T20:34:33.307868+0000","last_unstale":"2023-07-27T20:34:49.164253+0000","last_undegraded":"2023-07-27T20:34:49.164253+0000","last_fullsized":"2023-07-27T20:34:49.164253+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:45:15.282156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.156857+0000","last_change":"2023-07-27T20:34:49.156857+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.156857+0000","last_undegraded":"2023-07-27T20:34:49.156857+0000","last_fullsized":"2023-07-27T20:34:49.156857+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.155053+0000","last_change":"2023-07-27T20:34:34.307218+0000","last_active":"2023-07-27T20:34:49.155053+0000","last_peered":"2023-07-27T20:34:49.155053+0000","last_clean":"2023-07-27T20:34:49.155053+0000","last_became_active":"2023-07-27T20:34:34.306781+0000","last_became_peered":"2023-07-27T20:34:34.306781+0000","last_unstale":"2023-07-27T20:34:49.155053+0000","last_undegraded":"2023-07-27T20:34:49.155053+0000","last_fullsized":"2023-07-27T20:34:49.155053+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:14:23.090548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"62'1","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.155220+0000","last_change":"2023-07-27T20:34:33.301802+0000","last_active":"2023-07-27T20:34:49.155220+0000","last_peered":"2023-07-27T20:34:49.155220+0000","last_clean":"2023-07-27T20:34:49.155220+0000","last_became_active":"2023-07-27T20:34:33.301453+0000","last_became_peered":"2023-07-27T20:34:33.301453+0000","last_unstale":"2023-07-27T20:34:49.155220+0000","last_undegraded":"2023-07-27T20:34:49.155220+0000","last_fullsized":"2023-07-27T20:34:49.155220+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:17:01.638537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.153818+0000","last_change":"2023-07-27T20:34:49.153818+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.153818+0000","last_undegraded":"2023-07-27T20:34:49.153818+0000","last_fullsized":"2023-07-27T20:34:49.153818+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.154077+0000","last_change":"2023-07-27T20:34:34.325646+0000","last_active":"2023-07-27T20:34:49.154077+0000","last_peered":"2023-07-27T20:34:49.154077+0000","last_clean":"2023-07-27T20:34:49.154077+0000","last_became_active":"2023-07-27T20:34:34.325379+0000","last_became_peered":"2023-07-27T20:34:34.325379+0000","last_unstale":"2023-07-27T20:34:49.154077+0000","last_undegraded":"2023-07-27T20:34:49.154077+0000","last_fullsized":"2023-07-27T20:34:49.154077+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:18:57.338563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.161812+0000","last_change":"2023-07-27T20:34:33.297891+0000","last_active":"2023-07-27T20:34:49.161812+0000","last_peered":"2023-07-27T20:34:49.161812+0000","last_clean":"2023-07-27T20:34:49.161812+0000","last_became_active":"2023-07-27T20:34:33.297052+0000","last_became_peered":"2023-07-27T20:34:33.297052+0000","last_unstale":"2023-07-27T20:34:49.161812+0000","last_undegraded":"2023-07-27T20:34:49.161812+0000","last_fullsized":"2023-07-27T20:34:49.161812+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:24:52.420953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.156927+0000","last_change":"2023-07-27T20:34:49.156927+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.156927+0000","last_undegraded":"2023-07-27T20:34:49.156927+0000","last_fullsized":"2023-07-27T20:34:49.156927+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.154983+0000","last_change":"2023-07-27T20:34:34.315817+0000","last_active":"2023-07-27T20:34:49.154983+0000","last_peered":"2023-07-27T20:34:49.154983+0000","last_clean":"2023-07-27T20:34:49.154983+0000","last_became_active":"2023-07-27T20:34:34.315521+0000","last_became_peered":"2023-07-27T20:34:34.315521+0000","last_unstale":"2023-07-27T20:34:49.154983+0000","last_undegraded":"2023-07-27T20:34:49.154983+0000","last_fullsized":"2023-07-27T20:34:49.154983+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:08:10.988771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.152007+0000","last_change":"2023-07-27T20:34:33.303481+0000","last_active":"2023-07-27T20:34:49.152007+0000","last_peered":"2023-07-27T20:34:49.152007+0000","last_clean":"2023-07-27T20:34:49.152007+0000","last_became_active":"2023-07-27T20:34:33.303145+0000","last_became_peered":"2023-07-27T20:34:33.303145+0000","last_unstale":"2023-07-27T20:34:49.152007+0000","last_undegraded":"2023-07-27T20:34:49.152007+0000","last_fullsized":"2023-07-27T20:34:49.152007+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:46:20.023372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.161161+0000","last_change":"2023-07-27T20:34:49.161161+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.161161+0000","last_undegraded":"2023-07-27T20:34:49.161161+0000","last_fullsized":"2023-07-27T20:34:49.161161+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.160910+0000","last_change":"2023-07-27T20:34:34.304160+0000","last_active":"2023-07-27T20:34:49.160910+0000","last_peered":"2023-07-27T20:34:49.160910+0000","last_clean":"2023-07-27T20:34:49.160910+0000","last_became_active":"2023-07-27T20:34:34.303895+0000","last_became_peered":"2023-07-27T20:34:34.303895+0000","last_unstale":"2023-07-27T20:34:49.160910+0000","last_undegraded":"2023-07-27T20:34:49.160910+0000","last_fullsized":"2023-07-27T20:34:49.160910+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:14:13.099388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.160810+0000","last_change":"2023-07-27T20:34:33.308129+0000","last_active":"2023-07-27T20:34:49.160810+0000","last_peered":"2023-07-27T20:34:49.160810+0000","last_clean":"2023-07-27T20:34:49.160810+0000","last_became_active":"2023-07-27T20:34:33.307849+0000","last_became_peered":"2023-07-27T20:34:33.307849+0000","last_unstale":"2023-07-27T20:34:49.160810+0000","last_undegraded":"2023-07-27T20:34:49.160810+0000","last_fullsized":"2023-07-27T20:34:49.160810+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:43:34.583277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.161063+0000","last_change":"2023-07-27T20:34:49.161063+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.161063+0000","last_undegraded":"2023-07-27T20:34:49.161063+0000","last_fullsized":"2023-07-27T20:34:49.161063+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.163240+0000","last_change":"2023-07-27T20:34:34.323167+0000","last_active":"2023-07-27T20:34:49.163240+0000","last_peered":"2023-07-27T20:34:49.163240+0000","last_clean":"2023-07-27T20:34:49.163240+0000","last_became_active":"2023-07-27T20:34:34.322891+0000","last_became_peered":"2023-07-27T20:34:34.322891+0000","last_unstale":"2023-07-27T20:34:49.163240+0000","last_undegraded":"2023-07-27T20:34:49.163240+0000","last_fullsized":"2023-07-27T20:34:49.163240+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:46:36.050164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.157638+0000","last_change":"2023-07-27T20:34:33.303415+0000","last_active":"2023-07-27T20:34:49.157638+0000","last_peered":"2023-07-27T20:34:49.157638+0000","last_clean":"2023-07-27T20:34:49.157638+0000","last_became_active":"2023-07-27T20:34:33.303145+0000","last_became_peered":"2023-07-27T20:34:33.303145+0000","last_unstale":"2023-07-27T20:34:49.157638+0000","last_undegraded":"2023-07-27T20:34:49.157638+0000","last_fullsized":"2023-07-27T20:34:49.157638+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:06:47.373051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.155870+0000","last_change":"2023-07-27T20:34:49.155870+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.155870+0000","last_undegraded":"2023-07-27T20:34:49.155870+0000","last_fullsized":"2023-07-27T20:34:49.155870+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.157244+0000","last_change":"2023-07-27T20:34:34.298297+0000","last_active":"2023-07-27T20:34:49.157244+0000","last_peered":"2023-07-27T20:34:49.157244+0000","last_clean":"2023-07-27T20:34:49.157244+0000","last_became_active":"2023-07-27T20:34:34.297997+0000","last_became_peered":"2023-07-27T20:34:34.297997+0000","last_unstale":"2023-07-27T20:34:49.157244+0000","last_undegraded":"2023-07-27T20:34:49.157244+0000","last_fullsized":"2023-07-27T20:34:49.157244+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:23:46.012307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.158421+0000","last_change":"2023-07-27T20:34:33.301354+0000","last_active":"2023-07-27T20:34:49.158421+0000","last_peered":"2023-07-27T20:34:49.158421+0000","last_clean":"2023-07-27T20:34:49.158421+0000","last_became_active":"2023-07-27T20:34:33.301082+0000","last_became_peered":"2023-07-27T20:34:33.301082+0000","last_unstale":"2023-07-27T20:34:49.158421+0000","last_undegraded":"2023-07-27T20:34:49.158421+0000","last_fullsized":"2023-07-27T20:34:49.158421+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:21:44.490320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.156163+0000","last_change":"2023-07-27T20:34:49.156163+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.156163+0000","last_undegraded":"2023-07-27T20:34:49.156163+0000","last_fullsized":"2023-07-27T20:34:49.156163+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.163364+0000","last_change":"2023-07-27T20:34:34.321962+0000","last_active":"2023-07-27T20:34:49.163364+0000","last_peered":"2023-07-27T20:34:49.163364+0000","last_clean":"2023-07-27T20:34:49.163364+0000","last_became_active":"2023-07-27T20:34:34.321611+0000","last_became_peered":"2023-07-27T20:34:34.321611+0000","last_unstale":"2023-07-27T20:34:49.163364+0000","last_undegraded":"2023-07-27T20:34:49.163364+0000","last_fullsized":"2023-07-27T20:34:49.163364+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:44:42.207766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.163221+0000","last_change":"2023-07-27T20:34:33.305936+0000","last_active":"2023-07-27T20:34:49.163221+0000","last_peered":"2023-07-27T20:34:49.163221+0000","last_clean":"2023-07-27T20:34:49.163221+0000","last_became_active":"2023-07-27T20:34:33.305405+0000","last_became_peered":"2023-07-27T20:34:33.305405+0000","last_unstale":"2023-07-27T20:34:49.163221+0000","last_undegraded":"2023-07-27T20:34:49.163221+0000","last_fullsized":"2023-07-27T20:34:49.163221+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:46:27.154263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.159349+0000","last_change":"2023-07-27T20:34:49.159349+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.159349+0000","last_undegraded":"2023-07-27T20:34:49.159349+0000","last_fullsized":"2023-07-27T20:34:49.159349+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.159175+0000","last_change":"2023-07-27T20:34:34.306247+0000","last_active":"2023-07-27T20:34:49.159175+0000","last_peered":"2023-07-27T20:34:49.159175+0000","last_clean":"2023-07-27T20:34:49.159175+0000","last_became_active":"2023-07-27T20:34:34.305974+0000","last_became_peered":"2023-07-27T20:34:34.305974+0000","last_unstale":"2023-07-27T20:34:49.159175+0000","last_undegraded":"2023-07-27T20:34:49.159175+0000","last_fullsized":"2023-07-27T20:34:49.159175+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:32:37.897239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"61'1","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.164133+0000","last_change":"2023-07-27T20:34:33.308128+0000","last_active":"2023-07-27T20:34:49.164133+0000","last_peered":"2023-07-27T20:34:49.164133+0000","last_clean":"2023-07-27T20:34:49.164133+0000","last_became_active":"2023-07-27T20:34:33.307832+0000","last_became_peered":"2023-07-27T20:34:33.307832+0000","last_unstale":"2023-07-27T20:34:49.164133+0000","last_undegraded":"2023-07-27T20:34:49.164133+0000","last_fullsized":"2023-07-27T20:34:49.164133+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:31:44.429705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":90,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.164091+0000","last_change":"2023-07-27T20:31:22.846540+0000","last_active":"2023-07-27T20:34:49.164091+0000","last_peered":"2023-07-27T20:34:49.164091+0000","last_clean":"2023-07-27T20:34:49.164091+0000","last_became_active":"2023-07-27T20:31:22.846128+0000","last_became_peered":"2023-07-27T20:31:22.846128+0000","last_unstale":"2023-07-27T20:34:49.164091+0000","last_undegraded":"2023-07-27T20:34:49.164091+0000","last_fullsized":"2023-07-27T20:34:49.164091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:48:26.550047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.157032+0000","last_change":"2023-07-27T20:34:49.157032+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.157032+0000","last_undegraded":"2023-07-27T20:34:49.157032+0000","last_fullsized":"2023-07-27T20:34:49.157032+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.155163+0000","last_change":"2023-07-27T20:34:34.311641+0000","last_active":"2023-07-27T20:34:49.155163+0000","last_peered":"2023-07-27T20:34:49.155163+0000","last_clean":"2023-07-27T20:34:49.155163+0000","last_became_active":"2023-07-27T20:34:34.311381+0000","last_became_peered":"2023-07-27T20:34:34.311381+0000","last_unstale":"2023-07-27T20:34:49.155163+0000","last_undegraded":"2023-07-27T20:34:49.155163+0000","last_fullsized":"2023-07-27T20:34:49.155163+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:33:32.123237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"61'2","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.159257+0000","last_change":"2023-07-27T20:34:33.303573+0000","last_active":"2023-07-27T20:34:49.159257+0000","last_peered":"2023-07-27T20:34:49.159257+0000","last_clean":"2023-07-27T20:34:49.159257+0000","last_became_active":"2023-07-27T20:34:33.303293+0000","last_became_peered":"2023-07-27T20:34:33.303293+0000","last_unstale":"2023-07-27T20:34:49.159257+0000","last_undegraded":"2023-07-27T20:34:49.159257+0000","last_fullsized":"2023-07-27T20:34:49.159257+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:04:04.636272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":90,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.158302+0000","last_change":"2023-07-27T20:31:22.845641+0000","last_active":"2023-07-27T20:34:49.158302+0000","last_peered":"2023-07-27T20:34:49.158302+0000","last_clean":"2023-07-27T20:34:49.158302+0000","last_became_active":"2023-07-27T20:31:22.845368+0000","last_became_peered":"2023-07-27T20:31:22.845368+0000","last_unstale":"2023-07-27T20:34:49.158302+0000","last_undegraded":"2023-07-27T20:34:49.158302+0000","last_fullsized":"2023-07-27T20:34:49.158302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:23:53.818080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.156336+0000","last_change":"2023-07-27T20:34:49.156336+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.156336+0000","last_undegraded":"2023-07-27T20:34:49.156336+0000","last_fullsized":"2023-07-27T20:34:49.156336+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.158518+0000","last_change":"2023-07-27T20:34:34.296863+0000","last_active":"2023-07-27T20:34:49.158518+0000","last_peered":"2023-07-27T20:34:49.158518+0000","last_clean":"2023-07-27T20:34:49.158518+0000","last_became_active":"2023-07-27T20:34:34.296556+0000","last_became_peered":"2023-07-27T20:34:34.296556+0000","last_unstale":"2023-07-27T20:34:49.158518+0000","last_undegraded":"2023-07-27T20:34:49.158518+0000","last_fullsized":"2023-07-27T20:34:49.158518+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:28:08.203613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"61'1","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.163717+0000","last_change":"2023-07-27T20:34:33.303035+0000","last_active":"2023-07-27T20:34:49.163717+0000","last_peered":"2023-07-27T20:34:49.163717+0000","last_clean":"2023-07-27T20:34:49.163717+0000","last_became_active":"2023-07-27T20:34:33.302764+0000","last_became_peered":"2023-07-27T20:34:33.302764+0000","last_unstale":"2023-07-27T20:34:49.163717+0000","last_undegraded":"2023-07-27T20:34:49.163717+0000","last_fullsized":"2023-07-27T20:34:49.163717+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:37:40.417036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":94,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.155107+0000","last_change":"2023-07-27T20:31:22.848025+0000","last_active":"2023-07-27T20:34:49.155107+0000","last_peered":"2023-07-27T20:34:49.155107+0000","last_clean":"2023-07-27T20:34:49.155107+0000","last_became_active":"2023-07-27T20:31:22.847603+0000","last_became_peered":"2023-07-27T20:31:22.847603+0000","last_unstale":"2023-07-27T20:34:49.155107+0000","last_undegraded":"2023-07-27T20:34:49.155107+0000","last_fullsized":"2023-07-27T20:34:49.155107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:43:36.260108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.153793+0000","last_change":"2023-07-27T20:34:49.153793+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.153793+0000","last_undegraded":"2023-07-27T20:34:49.153793+0000","last_fullsized":"2023-07-27T20:34:49.153793+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.157216+0000","last_change":"2023-07-27T20:34:34.315837+0000","last_active":"2023-07-27T20:34:49.157216+0000","last_peered":"2023-07-27T20:34:49.157216+0000","last_clean":"2023-07-27T20:34:49.157216+0000","last_became_active":"2023-07-27T20:34:34.315452+0000","last_became_peered":"2023-07-27T20:34:34.315452+0000","last_unstale":"2023-07-27T20:34:49.157216+0000","last_undegraded":"2023-07-27T20:34:49.157216+0000","last_fullsized":"2023-07-27T20:34:49.157216+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:38:15.606270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.151747+0000","last_change":"2023-07-27T20:34:33.298534+0000","last_active":"2023-07-27T20:34:49.151747+0000","last_peered":"2023-07-27T20:34:49.151747+0000","last_clean":"2023-07-27T20:34:49.151747+0000","last_became_active":"2023-07-27T20:34:33.298170+0000","last_became_peered":"2023-07-27T20:34:33.298170+0000","last_unstale":"2023-07-27T20:34:49.151747+0000","last_undegraded":"2023-07-27T20:34:49.151747+0000","last_fullsized":"2023-07-27T20:34:49.151747+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:38:16.744717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":94,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.153521+0000","last_change":"2023-07-27T20:31:22.848181+0000","last_active":"2023-07-27T20:34:49.153521+0000","last_peered":"2023-07-27T20:34:49.153521+0000","last_clean":"2023-07-27T20:34:49.153521+0000","last_became_active":"2023-07-27T20:31:22.847865+0000","last_became_peered":"2023-07-27T20:31:22.847865+0000","last_unstale":"2023-07-27T20:34:49.153521+0000","last_undegraded":"2023-07-27T20:34:49.153521+0000","last_fullsized":"2023-07-27T20:34:49.153521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:00:09.852891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.152852+0000","last_change":"2023-07-27T20:34:49.152852+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.152852+0000","last_undegraded":"2023-07-27T20:34:49.152852+0000","last_fullsized":"2023-07-27T20:34:49.152852+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.159491+0000","last_change":"2023-07-27T20:34:34.320803+0000","last_active":"2023-07-27T20:34:49.159491+0000","last_peered":"2023-07-27T20:34:49.159491+0000","last_clean":"2023-07-27T20:34:49.159491+0000","last_became_active":"2023-07-27T20:34:34.320444+0000","last_became_peered":"2023-07-27T20:34:34.320444+0000","last_unstale":"2023-07-27T20:34:49.159491+0000","last_undegraded":"2023-07-27T20:34:49.159491+0000","last_fullsized":"2023-07-27T20:34:49.159491+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:25:20.209180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"61'2","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.163320+0000","last_change":"2023-07-27T20:34:33.306873+0000","last_active":"2023-07-27T20:34:49.163320+0000","last_peered":"2023-07-27T20:34:49.163320+0000","last_clean":"2023-07-27T20:34:49.163320+0000","last_became_active":"2023-07-27T20:34:33.306519+0000","last_became_peered":"2023-07-27T20:34:33.306519+0000","last_unstale":"2023-07-27T20:34:49.163320+0000","last_undegraded":"2023-07-27T20:34:49.163320+0000","last_fullsized":"2023-07-27T20:34:49.163320+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:05:13.323144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":250,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.153816+0000","last_change":"2023-07-27T20:31:15.812727+0000","last_active":"2023-07-27T20:34:49.153816+0000","last_peered":"2023-07-27T20:34:49.153816+0000","last_clean":"2023-07-27T20:34:49.153816+0000","last_became_active":"2023-07-27T20:31:15.811803+0000","last_became_peered":"2023-07-27T20:31:15.811803+0000","last_unstale":"2023-07-27T20:34:49.153816+0000","last_undegraded":"2023-07-27T20:34:49.153816+0000","last_fullsized":"2023-07-27T20:34:49.153816+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:14.789257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:14.789257+0000","last_clean_scrub_stamp":"2023-07-27T20:31:14.789257+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:27:51.372094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":88,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.153914+0000","last_change":"2023-07-27T20:31:22.847766+0000","last_active":"2023-07-27T20:34:49.153914+0000","last_peered":"2023-07-27T20:34:49.153914+0000","last_clean":"2023-07-27T20:34:49.153914+0000","last_became_active":"2023-07-27T20:31:22.847396+0000","last_became_peered":"2023-07-27T20:31:22.847396+0000","last_unstale":"2023-07-27T20:34:49.153914+0000","last_undegraded":"2023-07-27T20:34:49.153914+0000","last_fullsized":"2023-07-27T20:34:49.153914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:19:28.120599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.161209+0000","last_change":"2023-07-27T20:34:49.161209+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.161209+0000","last_undegraded":"2023-07-27T20:34:49.161209+0000","last_fullsized":"2023-07-27T20:34:49.161209+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.157334+0000","last_change":"2023-07-27T20:34:34.320690+0000","last_active":"2023-07-27T20:34:49.157334+0000","last_peered":"2023-07-27T20:34:49.157334+0000","last_clean":"2023-07-27T20:34:49.157334+0000","last_became_active":"2023-07-27T20:34:34.320232+0000","last_became_peered":"2023-07-27T20:34:34.320232+0000","last_unstale":"2023-07-27T20:34:49.157334+0000","last_undegraded":"2023-07-27T20:34:49.157334+0000","last_fullsized":"2023-07-27T20:34:49.157334+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:24:18.338597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.154659+0000","last_change":"2023-07-27T20:34:33.308050+0000","last_active":"2023-07-27T20:34:49.154659+0000","last_peered":"2023-07-27T20:34:49.154659+0000","last_clean":"2023-07-27T20:34:49.154659+0000","last_became_active":"2023-07-27T20:34:33.307761+0000","last_became_peered":"2023-07-27T20:34:33.307761+0000","last_unstale":"2023-07-27T20:34:49.154659+0000","last_undegraded":"2023-07-27T20:34:49.154659+0000","last_fullsized":"2023-07-27T20:34:49.154659+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:54:21.765008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":88,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.160393+0000","last_change":"2023-07-27T20:31:22.959811+0000","last_active":"2023-07-27T20:34:49.160393+0000","last_peered":"2023-07-27T20:34:49.160393+0000","last_clean":"2023-07-27T20:34:49.160393+0000","last_became_active":"2023-07-27T20:31:22.959449+0000","last_became_peered":"2023-07-27T20:31:22.959449+0000","last_unstale":"2023-07-27T20:34:49.160393+0000","last_undegraded":"2023-07-27T20:34:49.160393+0000","last_fullsized":"2023-07-27T20:34:49.160393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:11:53.979596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.153792+0000","last_change":"2023-07-27T20:34:49.153792+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.153792+0000","last_undegraded":"2023-07-27T20:34:49.153792+0000","last_fullsized":"2023-07-27T20:34:49.153792+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.156801+0000","last_change":"2023-07-27T20:34:34.301811+0000","last_active":"2023-07-27T20:34:49.156801+0000","last_peered":"2023-07-27T20:34:49.156801+0000","last_clean":"2023-07-27T20:34:49.156801+0000","last_became_active":"2023-07-27T20:34:34.301525+0000","last_became_peered":"2023-07-27T20:34:34.301525+0000","last_unstale":"2023-07-27T20:34:49.156801+0000","last_undegraded":"2023-07-27T20:34:49.156801+0000","last_fullsized":"2023-07-27T20:34:49.156801+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:04:52.499591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.163477+0000","last_change":"2023-07-27T20:34:33.301467+0000","last_active":"2023-07-27T20:34:49.163477+0000","last_peered":"2023-07-27T20:34:49.163477+0000","last_clean":"2023-07-27T20:34:49.163477+0000","last_became_active":"2023-07-27T20:34:33.301160+0000","last_became_peered":"2023-07-27T20:34:33.301160+0000","last_unstale":"2023-07-27T20:34:49.163477+0000","last_undegraded":"2023-07-27T20:34:49.163477+0000","last_fullsized":"2023-07-27T20:34:49.163477+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:08:35.154187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":88,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.153742+0000","last_change":"2023-07-27T20:31:22.849178+0000","last_active":"2023-07-27T20:34:49.153742+0000","last_peered":"2023-07-27T20:34:49.153742+0000","last_clean":"2023-07-27T20:34:49.153742+0000","last_became_active":"2023-07-27T20:31:22.848856+0000","last_became_peered":"2023-07-27T20:31:22.848856+0000","last_unstale":"2023-07-27T20:34:49.153742+0000","last_undegraded":"2023-07-27T20:34:49.153742+0000","last_fullsized":"2023-07-27T20:34:49.153742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:19:42.901336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T20:34:50.149912+0000","last_change":"2023-07-27T20:34:50.149912+0000","last_active":"2023-07-27T20:34:50.149912+0000","last_peered":"2023-07-27T20:34:50.149912+0000","last_clean":"2023-07-27T20:34:50.149912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:50.149912+0000","last_undegraded":"2023-07-27T20:34:50.149912+0000","last_fullsized":"2023-07-27T20:34:50.149912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-27T20:34:49.158747+0000","last_change":"2023-07-27T20:34:49.158747+0000","last_active":"2023-07-27T20:34:49.143065+0000","last_peered":"2023-07-27T20:34:49.143065+0000","last_clean":"2023-07-27T20:34:49.143065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T20:34:49.158747+0000","last_undegraded":"2023-07-27T20:34:49.158747+0000","last_fullsized":"2023-07-27T20:34:49.158747+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.161682+0000","last_change":"2023-07-27T20:34:34.296711+0000","last_active":"2023-07-27T20:34:49.161682+0000","last_peered":"2023-07-27T20:34:49.161682+0000","last_clean":"2023-07-27T20:34:49.161682+0000","last_became_active":"2023-07-27T20:34:34.296442+0000","last_became_peered":"2023-07-27T20:34:34.296442+0000","last_unstale":"2023-07-27T20:34:49.161682+0000","last_undegraded":"2023-07-27T20:34:49.161682+0000","last_fullsized":"2023-07-27T20:34:49.161682+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:04:23.247427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.154200+0000","last_change":"2023-07-27T20:34:33.304301+0000","last_active":"2023-07-27T20:34:49.154200+0000","last_peered":"2023-07-27T20:34:49.154200+0000","last_clean":"2023-07-27T20:34:49.154200+0000","last_became_active":"2023-07-27T20:34:33.303739+0000","last_became_peered":"2023-07-27T20:34:33.303739+0000","last_unstale":"2023-07-27T20:34:49.154200+0000","last_undegraded":"2023-07-27T20:34:49.154200+0000","last_fullsized":"2023-07-27T20:34:49.154200+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:37:02.578882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":90,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-27T20:34:49.158772+0000","last_change":"2023-07-27T20:31:22.848698+0000","last_active":"2023-07-27T20:34:49.158772+0000","last_peered":"2023-07-27T20:34:49.158772+0000","last_clean":"2023-07-27T20:34:49.158772+0000","last_became_active":"2023-07-27T20:31:22.848346+0000","last_became_peered":"2023-07-27T20:31:22.848346+0000","last_unstale":"2023-07-27T20:34:49.158772+0000","last_undegraded":"2023-07-27T20:34:49.158772+0000","last_fullsized":"2023-07-27T20:34:49.158772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:08:27.172282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":4059,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28352,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343488,"statfs":{"total":96636764160,"available":96607731712,"internally_reserved":0,"allocated":1363968,"data_stored":956042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.75800000000000001,"15min":0.80300000000000005},"min":{"1min":0.42499999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90000000000000002,"5min":3.5609999999999999,"15min":3.5609999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.70799999999999996,"15min":0.72699999999999998},"min":{"1min":0.39500000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88800000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.59299999999999997}]},{"osd":1,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.69599999999999995,"15min":0.71599999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.84999999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.81000000000000005,"15min":0.86399999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.86699999999999999,"5min":3.927,"15min":3.927},"last":0.65600000000000003}]},{"osd":2,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.80200000000000005,"15min":0.84099999999999997},"min":{"1min":0.47099999999999997,"5min":0.443,"15min":0.443},"max":{"1min":0.86699999999999999,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.76500000000000001,"15min":0.80900000000000005},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85799999999999998,"5min":2.093,"15min":2.093},"last":0.64300000000000002}]},{"osd":3,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.76000000000000001,"15min":0.81200000000000006},"min":{"1min":0.46000000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.76600000000000001,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.85099999999999998,"15min":0.90100000000000002},"min":{"1min":0.57399999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.94099999999999995,"5min":3.1080000000000001,"15min":3.1080000000000001},"last":0.628}]},{"osd":4,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.754,"15min":0.78800000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.91100000000000003,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.79800000000000004,"15min":0.83399999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.85799999999999998,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.60999999999999999}]},{"osd":5,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.90600000000000003,"15min":0.999},"min":{"1min":0.47899999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.91400000000000003,"5min":6.1619999999999999,"15min":6.1619999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.94299999999999995,"15min":1.042},"min":{"1min":0.432,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96499999999999997,"5min":6.2729999999999997,"15min":6.2729999999999997},"last":0.67800000000000005}]},{"osd":6,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.81799999999999995,"15min":0.84599999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.075,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.84699999999999998,"15min":0.90500000000000003},"min":{"1min":0.52900000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93799999999999994,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":0.54000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":770048,"data_stored":365150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.67700000000000005,"15min":0.68899999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.871,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.66300000000000003,"15min":0.66800000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.85499999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.622}]},{"osd":1,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69999999999999996,"15min":0.72199999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84399999999999997,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70099999999999996,"15min":0.70799999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.85499999999999998,"5min":1.266,"15min":1.266},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.69499999999999995,"15min":0.71799999999999997},"min":{"1min":0.51100000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83899999999999997,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.747,"15min":0.76300000000000001},"min":{"1min":0.56499999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.90200000000000002,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.69199999999999995}]},{"osd":3,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.72899999999999998,"15min":0.745},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.84199999999999997,"5min":1.377,"15min":1.377},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.73299999999999998,"15min":0.75700000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92800000000000005,"5min":1.736,"15min":1.736},"last":0.72399999999999998}]},{"osd":4,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69599999999999995,"15min":0.69799999999999995},"min":{"1min":0.47099999999999997,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90300000000000002,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69699999999999995,"15min":0.69299999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.95599999999999996,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.78600000000000003}]},{"osd":5,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.67100000000000004,"15min":0.66500000000000004},"min":{"1min":0.47799999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.88600000000000001,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.74099999999999999,"15min":0.73199999999999998},"min":{"1min":0.45100000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93700000000000006,"5min":1.081,"15min":1.081},"last":0.80400000000000005}]},{"osd":7,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.749,"15min":0.753},"min":{"1min":0.496,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.94699999999999995,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.749},{"interface":"front","average":{"1min":0.753,"5min":0.73999999999999999,"15min":0.73599999999999999},"min":{"1min":0.59499999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97599999999999998,"5min":1.119,"15min":1.119},"last":0.82199999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":782336,"data_stored":368935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40899999999999997,"15min":0.40600000000000003},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47199999999999998,"15min":0.47899999999999998},"min":{"1min":0.32300000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.39500000000000002}]},{"osd":2,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44,"15min":0.436},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.436},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.47599999999999998,"15min":0.47399999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.45300000000000001}]},{"osd":3,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53400000000000003,"15min":0.53200000000000003},"min":{"1min":0.39400000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.502,"15min":0.504},"min":{"1min":0.374,"5min":0.31,"15min":0.31},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.48699999999999999}]},{"osd":4,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73499999999999999,"15min":0.745},"min":{"1min":0.56699999999999995,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73599999999999999,"15min":0.73199999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72299999999999998,"15min":0.73199999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.76200000000000001,"15min":0.75700000000000001},"min":{"1min":0.623,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.9630000000000001,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":0.64800000000000002}]},{"osd":6,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.77500000000000002,"15min":0.79500000000000004},"min":{"1min":0.53600000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1419999999999999,"5min":1.347,"15min":1.347},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.80400000000000005,"15min":0.81999999999999995},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.206,"5min":1.409,"15min":1.409},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.77100000000000002,"15min":0.77700000000000002},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.95099999999999996,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78800000000000003,"15min":0.80300000000000005},"min":{"1min":0.55400000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.71699999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28344,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343496,"statfs":{"total":96636764160,"available":96607739904,"internally_reserved":0,"allocated":1355776,"data_stored":955426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.38700000000000001,"15min":0.39100000000000001},"min":{"1min":0.27700000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.46000000000000002,"15min":0.46400000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.45100000000000001}]},{"osd":2,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47999999999999998,"15min":0.48899999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.60399999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.44800000000000001,"15min":0.45400000000000001},"min":{"1min":0.34200000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46600000000000003,"15min":0.47099999999999997},"min":{"1min":0.35299999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.65900000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53200000000000003,"15min":0.54200000000000004},"min":{"1min":0.40699999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.63400000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70499999999999996,"15min":0.71199999999999997},"min":{"1min":0.55900000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0529999999999999,"5min":1.069,"15min":1.069},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.71799999999999997,"15min":0.73199999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97799999999999998,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.69099999999999995}]},{"osd":5,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.73099999999999998,"15min":0.745},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.90000000000000002,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.73499999999999999,"15min":0.751},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0940000000000001,"5min":1.196,"15min":1.196},"last":0.73799999999999999}]},{"osd":6,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.72199999999999998,"15min":0.73599999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0129999999999999,"5min":1.05,"15min":1.05},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.755,"15min":0.77600000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.88400000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.72799999999999998}]},{"osd":7,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.752,"15min":0.76900000000000002},"min":{"1min":0.54800000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.755,"15min":0.77200000000000002},"min":{"1min":0.58199999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.751}]}]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":761856,"data_stored":360975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45700000000000002,"15min":0.48099999999999998},"min":{"1min":0.29799999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.54700000000000004,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.624,"15min":0.70999999999999996},"min":{"1min":0.32500000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70099999999999996,"5min":3.2999999999999998,"15min":3.2999999999999998},"last":0.42899999999999999}]},{"osd":1,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.56000000000000005,"15min":0.61499999999999999},"min":{"1min":0.309,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.67200000000000004,"5min":3.0600000000000001,"15min":3.0600000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.60999999999999999,"15min":0.67000000000000004},"min":{"1min":0.36499999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.623,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.86399999999999999,"15min":1.036},"min":{"1min":0.40000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72099999999999997,"5min":9.2200000000000006,"15min":9.2200000000000006},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.57099999999999995,"15min":0.59499999999999997},"min":{"1min":0.40799999999999997,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.66600000000000004,"5min":1.552,"15min":1.552},"last":0.505}]},{"osd":4,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.85999999999999999,"15min":0.92600000000000005},"min":{"1min":0.52200000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0049999999999999,"5min":4.2930000000000001,"15min":4.2930000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.75600000000000001,"15min":0.77900000000000003},"min":{"1min":0.55400000000000005,"5min":0.499,"15min":0.499},"max":{"1min":0.93999999999999995,"5min":1.24,"15min":1.24},"last":0.76300000000000001}]},{"osd":5,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.754,"15min":0.76900000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98399999999999999,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.84699999999999998,"15min":0.90700000000000003},"min":{"1min":0.53800000000000003,"5min":0.5,"15min":0.5},"max":{"1min":0.90700000000000003,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.64900000000000002}]},{"osd":6,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.88300000000000001,"15min":0.94399999999999995},"min":{"1min":0.55300000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.024,"5min":3.3999999999999999,"15min":3.3999999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.91300000000000003,"15min":0.99099999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.97199999999999998,"5min":3.4990000000000001,"15min":3.4990000000000001},"last":0.71899999999999997}]},{"osd":7,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.81100000000000005,"15min":0.84499999999999997},"min":{"1min":0.58199999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.95199999999999996,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.86099999999999999,"15min":0.89700000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.95999999999999996,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.77900000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":770048,"data_stored":365170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.44900000000000001,"15min":0.47099999999999997},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.626,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.51600000000000001,"15min":0.54400000000000004},"min":{"1min":0.309,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.627,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":0.35099999999999998}]},{"osd":1,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.47699999999999998,"15min":0.5},"min":{"1min":0.33400000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.55400000000000005,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.44},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.52900000000000003,"15min":0.56699999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.63,"5min":1.788,"15min":1.788},"last":0.54500000000000004}]},{"osd":2,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.56200000000000006,"15min":0.59199999999999997},"min":{"1min":0.41699999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.73299999999999998,"5min":2.117,"15min":2.117},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59999999999999998,"15min":0.63400000000000001},"min":{"1min":0.42999999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.68400000000000005,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.73199999999999998}]},{"osd":4,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71899999999999997,"15min":0.72199999999999998},"min":{"1min":0.53800000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0249999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.79000000000000004,"15min":0.81399999999999995},"min":{"1min":0.53000000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.95199999999999996,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.69499999999999995}]},{"osd":5,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.72499999999999998,"15min":0.73299999999999998},"min":{"1min":0.505,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92200000000000004,"5min":1.125,"15min":1.125},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.79400000000000004,"15min":0.82799999999999996},"min":{"1min":0.54200000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0569999999999999,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.76900000000000002}]},{"osd":6,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.78600000000000003,"15min":0.81299999999999994},"min":{"1min":0.59199999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93100000000000005,"5min":1.758,"15min":1.758},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.80900000000000005,"15min":0.83499999999999996},"min":{"1min":0.55000000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.095,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.751}]},{"osd":7,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.81599999999999995,"15min":0.84799999999999998},"min":{"1min":0.55400000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0289999999999999,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.75800000000000001,"15min":0.76700000000000002},"min":{"1min":0.59099999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.99199999999999999,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.71499999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":753664,"data_stored":357784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.69699999999999995,"15min":0.69799999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.84299999999999997,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70699999999999996,"15min":0.71199999999999997},"min":{"1min":0.53900000000000003,"5min":0.5,"15min":0.5},"max":{"1min":0.86499999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.65800000000000003}]},{"osd":1,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.52200000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.874,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73499999999999999,"15min":0.73799999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88900000000000001,"5min":1.002,"15min":1.002},"last":0.63300000000000001}]},{"osd":2,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.67500000000000004,"15min":0.66900000000000004},"min":{"1min":0.504,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81899999999999995,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68899999999999995,"15min":0.69499999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.93700000000000006,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.68300000000000005}]},{"osd":3,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.73099999999999998,"15min":0.751},"min":{"1min":0.49299999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91300000000000003,"5min":1.645,"15min":1.645},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.747,"15min":0.75900000000000001},"min":{"1min":0.51700000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96899999999999997,"5min":1.708,"15min":1.708},"last":0.53900000000000003}]},{"osd":5,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61799999999999999,"15min":0.61699999999999999},"min":{"1min":0.41499999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84499999999999997,"5min":1.113,"15min":1.113},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68799999999999994,"15min":0.69499999999999995},"min":{"1min":0.502,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91200000000000003,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.72599999999999998}]},{"osd":6,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70599999999999996,"15min":0.70699999999999996},"min":{"1min":0.48299999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.92100000000000004,"5min":1.127,"15min":1.127},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.74099999999999999,"15min":0.74199999999999999},"min":{"1min":0.442,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0009999999999999,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.81399999999999995}]},{"osd":7,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.54700000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.98499999999999999,"5min":1.198,"15min":1.198},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.81299999999999994,"15min":0.81699999999999995},"min":{"1min":0.65300000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":0.96299999999999997,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.79300000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":765952,"data_stored":365148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.65300000000000002,"15min":0.629},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.85499999999999998,"5min":4.0510000000000002,"15min":4.0510000000000002},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.71299999999999997,"15min":0.67900000000000005},"min":{"1min":0.39300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.94899999999999995,"5min":6.431,"15min":6.431},"last":0.55900000000000005}]},{"osd":1,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.68300000000000005,"15min":0.65500000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.91300000000000003,"5min":5.3330000000000002,"15min":5.3330000000000002},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.69499999999999995,"15min":0.67100000000000004},"min":{"1min":0.47299999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.81299999999999994,"5min":4.2169999999999996,"15min":4.2169999999999996},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.70699999999999996,"15min":0.66500000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.94799999999999995,"5min":6.4850000000000003,"15min":6.4850000000000003},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.68200000000000005,"15min":0.66200000000000003},"min":{"1min":0.48099999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.80800000000000005,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":0.52300000000000002}]},{"osd":3,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.749,"15min":0.73899999999999999},"min":{"1min":0.44900000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89500000000000002,"5min":4.7809999999999997,"15min":4.7809999999999997},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.76100000000000001,"15min":0.73799999999999999},"min":{"1min":0.55100000000000005,"5min":0.503,"15min":0.503},"max":{"1min":0.86299999999999999,"5min":5.423,"15min":5.423},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.67200000000000004,"15min":0.65500000000000003},"min":{"1min":0.432,"5min":0.375,"15min":0.375},"max":{"1min":0.879,"5min":3.988,"15min":3.988},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.749,"15min":0.72699999999999998},"min":{"1min":0.46100000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.84599999999999997,"5min":4.827,"15min":4.827},"last":0.64200000000000002}]},{"osd":6,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.77800000000000002,"15min":0.73199999999999998},"min":{"1min":0.53600000000000003,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.92000000000000004,"5min":7.7000000000000002,"15min":7.7000000000000002},"last":0.747},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.75,"15min":0.72799999999999998},"min":{"1min":0.53000000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91900000000000004,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":0.501}]},{"osd":7,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.83199999999999996,"15min":0.78000000000000003},"min":{"1min":0.52300000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.91900000000000004,"5min":9.1180000000000003,"15min":9.1180000000000003},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.82699999999999996,"15min":0.80100000000000005},"min":{"1min":0.53700000000000003,"5min":0.505,"15min":0.505},"max":{"1min":0.91900000000000004,"5min":5.2880000000000003,"15min":5.2880000000000003},"last":0.78900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T20:34:56.150 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T20:34:56.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.385+0000 7f052c1ff700 1 Processor -- start 2023-07-27T20:34:56.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.386+0000 7f052c1ff700 1 -- start start 2023-07-27T20:34:56.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.387+0000 7f052c1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f05240c4400 0x7f05240c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:56.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.387+0000 7f052c1ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f05241549f0 0x7f05241514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:56.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.387+0000 7f052c1ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f052406b710 con 0x7f052406b150 2023-07-27T20:34:56.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.387+0000 7f052c1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05241545d0 con 0x7f05240c4400 2023-07-27T20:34:56.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.387+0000 7f052c1ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f052406c860 con 0x7f05241549f0 2023-07-27T20:34:56.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.387+0000 7f0529f9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f05240c4400 0x7f05240c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:56.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.387+0000 7f0529f9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f05240c4400 0x7f05240c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48408/0 (socket says 172.21.15.72:48408) 2023-07-27T20:34:56.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.387+0000 7f0529f9b700 1 -- 172.21.15.72:0/275086328 learned_addr learned my addr 172.21.15.72:0/275086328 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:56.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.387+0000 7f0529f9b700 1 -- 172.21.15.72:0/275086328 >> v2:172.21.15.173:3300/0 conn(0x7f05241549f0 msgr2=0x7f05241514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:56.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.387+0000 7f0529f9b700 1 --2- 172.21.15.72:0/275086328 >> v2:172.21.15.173:3300/0 conn(0x7f05241549f0 0x7f05241514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:56.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.387+0000 7f0529f9b700 1 -- 172.21.15.72:0/275086328 >> v1:172.21.15.173:6789/0 conn(0x7f052406b150 legacy=0x7f05240c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:56.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.387+0000 7f0529f9b700 1 -- 172.21.15.72:0/275086328 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052406b9f0 con 0x7f05240c4400 2023-07-27T20:34:56.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.388+0000 7f0529f9b700 1 --2- 172.21.15.72:0/275086328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05240c4400 0x7f05240c7710 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f05240af950 tx=0x7f0520009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44773ee8cfaa7588 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:56.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.388+0000 7f0528f99700 1 -- 172.21.15.72:0/275086328 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0520004230 con 0x7f05240c4400 2023-07-27T20:34:56.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.388+0000 7f0528f99700 1 -- 172.21.15.72:0/275086328 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0520004390 con 0x7f05240c4400 2023-07-27T20:34:56.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.388+0000 7f0528f99700 1 -- 172.21.15.72:0/275086328 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05200036a0 con 0x7f05240c4400 2023-07-27T20:34:56.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.388+0000 7f052c1ff700 1 -- 172.21.15.72:0/275086328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05240c4400 msgr2=0x7f05240c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:56.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.388+0000 7f052c1ff700 1 --2- 172.21.15.72:0/275086328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05240c4400 0x7f05240c7710 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f05240af950 tx=0x7f0520009bd0 comp rx=0 tx=0).stop 2023-07-27T20:34:56.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.388+0000 7f052c1ff700 1 -- 172.21.15.72:0/275086328 shutdown_connections 2023-07-27T20:34:56.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.388+0000 7f052c1ff700 1 --2- 172.21.15.72:0/275086328 >> v2:172.21.15.173:3300/0 conn(0x7f05241549f0 0x7f05241514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:56.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.388+0000 7f052c1ff700 1 --2- 172.21.15.72:0/275086328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05240c4400 0x7f05240c7710 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:56.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.388+0000 7f052c1ff700 1 -- 172.21.15.72:0/275086328 >> 172.21.15.72:0/275086328 conn(0x7f05240ab300 msgr2=0x7f05240ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:56.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.389+0000 7f052c1ff700 1 -- 172.21.15.72:0/275086328 shutdown_connections 2023-07-27T20:34:56.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.389+0000 7f052c1ff700 1 -- 172.21.15.72:0/275086328 wait complete. 2023-07-27T20:34:56.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.391+0000 7f052c1ff700 1 Processor -- start 2023-07-27T20:34:56.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.391+0000 7f052c1ff700 1 -- start start 2023-07-27T20:34:56.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.392+0000 7f052c1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f052406b150 0x7f05241ea390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:56.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.392+0000 7f052c1ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05240c4400 0x7f05240c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:56.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.392+0000 7f052c1ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05241549f0 0x7f052414b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:56.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.392+0000 7f052c1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05240c3c40 con 0x7f052406b150 2023-07-27T20:34:56.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.392+0000 7f052c1ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05240ae0a0 con 0x7f05241549f0 2023-07-27T20:34:56.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.392+0000 7f052c1ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05240af690 con 0x7f05240c4400 2023-07-27T20:34:56.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.392+0000 7f0529f9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f052406b150 0x7f05241ea390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:56.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.392+0000 7f0529f9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f052406b150 0x7f05241ea390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48424/0 (socket says 172.21.15.72:48424) 2023-07-27T20:34:56.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.392+0000 7f0529f9b700 1 -- 172.21.15.72:0/1453888099 learned_addr learned my addr 172.21.15.72:0/1453888099 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:56.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.393+0000 7f052979a700 1 --2- 172.21.15.72:0/1453888099 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05240c4400 0x7f05240c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:56.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.393+0000 7f052a79c700 1 --2- 172.21.15.72:0/1453888099 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05241549f0 0x7f052414b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:56.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.393+0000 7f0529f9b700 1 -- 172.21.15.72:0/1453888099 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05240c4400 msgr2=0x7f05240c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:56.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.393+0000 7f0529f9b700 1 --2- 172.21.15.72:0/1453888099 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05240c4400 0x7f05240c7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:56.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.393+0000 7f0529f9b700 1 -- 172.21.15.72:0/1453888099 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05241549f0 msgr2=0x7f052414b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:56.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.393+0000 7f0529f9b700 1 --2- 172.21.15.72:0/1453888099 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05241549f0 0x7f052414b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:56.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.393+0000 7f0529f9b700 1 -- 172.21.15.72:0/1453888099 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0520009550 con 0x7f052406b150 2023-07-27T20:34:56.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.393+0000 7f0529f9b700 1 --2- 172.21.15.72:0/1453888099 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f052406b150 0x7f05241ea390 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f0520009130 tx=0x7f0520004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:56.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.393+0000 7f051a7fc700 1 -- 172.21.15.72:0/1453888099 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0520003d10 con 0x7f052406b150 2023-07-27T20:34:56.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.393+0000 7f051a7fc700 1 -- 172.21.15.72:0/1453888099 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052001f070 con 0x7f052406b150 2023-07-27T20:34:56.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.393+0000 7f051a7fc700 1 -- 172.21.15.72:0/1453888099 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0520011870 con 0x7f052406b150 2023-07-27T20:34:56.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.393+0000 7f052c1ff700 1 -- 172.21.15.72:0/1453888099 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f052414dae0 con 0x7f052406b150 2023-07-27T20:34:56.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.394+0000 7f052c1ff700 1 -- 172.21.15.72:0/1453888099 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f052414e0a0 con 0x7f052406b150 2023-07-27T20:34:56.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.395+0000 7f052c1ff700 1 -- 172.21.15.72:0/1453888099 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05241537b0 con 0x7f052406b150 2023-07-27T20:34:56.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.396+0000 7f051a7fc700 1 -- 172.21.15.72:0/1453888099 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0520021030 con 0x7f052406b150 2023-07-27T20:34:56.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.396+0000 7f051a7fc700 1 --2- 172.21.15.72:0/1453888099 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f050806ace0 0x7f050806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:56.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.397+0000 7f051a7fc700 1 -- 172.21.15.72:0/1453888099 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f052008ae40 con 0x7f052406b150 2023-07-27T20:34:56.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.397+0000 7f052979a700 1 --2- 172.21.15.72:0/1453888099 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f050806ace0 0x7f050806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:56.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.398+0000 7f052979a700 1 --2- 172.21.15.72:0/1453888099 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f050806ace0 0x7f050806d1a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f052414ea90 tx=0x7f0514009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:56.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.401+0000 7f051a7fc700 1 -- 172.21.15.72:0/1453888099 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0520055c00 con 0x7f052406b150 2023-07-27T20:34:56.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.591+0000 7f052c1ff700 1 -- 172.21.15.72:0/1453888099 --> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0524154180 con 0x7f050806ace0 2023-07-27T20:34:56.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.606+0000 7f051a7fc700 1 -- 172.21.15.72:0/1453888099 <== mgr.4107 v2:172.21.15.173:6832/910681537 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+550099 (secure 0 0 0) 0x7f0514001500 con 0x7f050806ace0 2023-07-27T20:34:56.600 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:34:56.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.613+0000 7f052c1ff700 1 -- 172.21.15.72:0/1453888099 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f050806ace0 msgr2=0x7f050806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:56.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.613+0000 7f052c1ff700 1 --2- 172.21.15.72:0/1453888099 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f050806ace0 0x7f050806d1a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f052414ea90 tx=0x7f0514009040 comp rx=0 tx=0).stop 2023-07-27T20:34:56.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.613+0000 7f052c1ff700 1 -- 172.21.15.72:0/1453888099 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f052406b150 msgr2=0x7f05241ea390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:56.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.613+0000 7f052c1ff700 1 --2- 172.21.15.72:0/1453888099 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f052406b150 0x7f05241ea390 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f0520009130 tx=0x7f0520004750 comp rx=0 tx=0).stop 2023-07-27T20:34:56.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.613+0000 7f052c1ff700 1 -- 172.21.15.72:0/1453888099 shutdown_connections 2023-07-27T20:34:56.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.613+0000 7f052c1ff700 1 --2- 172.21.15.72:0/1453888099 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05241549f0 0x7f052414b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:56.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.613+0000 7f052c1ff700 1 --2- 172.21.15.72:0/1453888099 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f052406b150 0x7f05241ea390 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:56.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.613+0000 7f052c1ff700 1 --2- 172.21.15.72:0/1453888099 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f050806ace0 0x7f050806d1a0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:56.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.613+0000 7f052c1ff700 1 --2- 172.21.15.72:0/1453888099 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05240c4400 0x7f05240c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:56.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.613+0000 7f052c1ff700 1 -- 172.21.15.72:0/1453888099 >> 172.21.15.72:0/1453888099 conn(0x7f05240ab300 msgr2=0x7f0524151270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:56.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.613+0000 7f052c1ff700 1 -- 172.21.15.72:0/1453888099 shutdown_connections 2023-07-27T20:34:56.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.613+0000 7f052c1ff700 1 -- 172.21.15.72:0/1453888099 wait complete. 2023-07-27T20:34:56.605 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-07-27T20:34:56.618 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":170,"stamp":"2023-07-27T20:34:56.580477+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596789,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":250,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":402,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223708,"kb_used_data":7528,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754751012,"statfs":{"total":773094113280,"available":772865036288,"internally_reserved":0,"allocated":7708672,"data_stored":4305554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.419005"},"pg_stats":[{"pgid":"13.39","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938318+0000","last_change":"2023-07-27T20:34:51.146030+0000","last_active":"2023-07-27T20:34:52.938318+0000","last_peered":"2023-07-27T20:34:52.938318+0000","last_clean":"2023-07-27T20:34:52.938318+0000","last_became_active":"2023-07-27T20:34:51.145726+0000","last_became_peered":"2023-07-27T20:34:51.145726+0000","last_unstale":"2023-07-27T20:34:52.938318+0000","last_undegraded":"2023-07-27T20:34:52.938318+0000","last_fullsized":"2023-07-27T20:34:52.938318+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:55:07.037931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132896+0000","last_change":"2023-07-27T20:34:34.316234+0000","last_active":"2023-07-27T20:34:52.132896+0000","last_peered":"2023-07-27T20:34:52.132896+0000","last_clean":"2023-07-27T20:34:52.132896+0000","last_became_active":"2023-07-27T20:34:34.315976+0000","last_became_peered":"2023-07-27T20:34:34.315976+0000","last_unstale":"2023-07-27T20:34:52.132896+0000","last_undegraded":"2023-07-27T20:34:52.132896+0000","last_fullsized":"2023-07-27T20:34:52.132896+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:57:04.577992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.552554+0000","last_change":"2023-07-27T20:34:51.158344+0000","last_active":"2023-07-27T20:34:53.552554+0000","last_peered":"2023-07-27T20:34:53.552554+0000","last_clean":"2023-07-27T20:34:53.552554+0000","last_became_active":"2023-07-27T20:34:51.158001+0000","last_became_peered":"2023-07-27T20:34:51.158001+0000","last_unstale":"2023-07-27T20:34:53.552554+0000","last_undegraded":"2023-07-27T20:34:53.552554+0000","last_fullsized":"2023-07-27T20:34:53.552554+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:50:35.181709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210376+0000","last_change":"2023-07-27T20:34:34.314798+0000","last_active":"2023-07-27T20:34:53.210376+0000","last_peered":"2023-07-27T20:34:53.210376+0000","last_clean":"2023-07-27T20:34:53.210376+0000","last_became_active":"2023-07-27T20:34:34.314515+0000","last_became_peered":"2023-07-27T20:34:34.314515+0000","last_unstale":"2023-07-27T20:34:53.210376+0000","last_undegraded":"2023-07-27T20:34:53.210376+0000","last_fullsized":"2023-07-27T20:34:53.210376+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:09:19.279175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131971+0000","last_change":"2023-07-27T20:34:51.153611+0000","last_active":"2023-07-27T20:34:52.131971+0000","last_peered":"2023-07-27T20:34:52.131971+0000","last_clean":"2023-07-27T20:34:52.131971+0000","last_became_active":"2023-07-27T20:34:51.153320+0000","last_became_peered":"2023-07-27T20:34:51.153320+0000","last_unstale":"2023-07-27T20:34:52.131971+0000","last_undegraded":"2023-07-27T20:34:52.131971+0000","last_fullsized":"2023-07-27T20:34:52.131971+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:59:14.981939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389460+0000","last_change":"2023-07-27T20:34:34.296875+0000","last_active":"2023-07-27T20:34:52.389460+0000","last_peered":"2023-07-27T20:34:52.389460+0000","last_clean":"2023-07-27T20:34:52.389460+0000","last_became_active":"2023-07-27T20:34:34.296594+0000","last_became_peered":"2023-07-27T20:34:34.296594+0000","last_unstale":"2023-07-27T20:34:52.389460+0000","last_undegraded":"2023-07-27T20:34:52.389460+0000","last_fullsized":"2023-07-27T20:34:52.389460+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:12:46.064183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.552894+0000","last_change":"2023-07-27T20:34:51.151531+0000","last_active":"2023-07-27T20:34:53.552894+0000","last_peered":"2023-07-27T20:34:53.552894+0000","last_clean":"2023-07-27T20:34:53.552894+0000","last_became_active":"2023-07-27T20:34:51.151241+0000","last_became_peered":"2023-07-27T20:34:51.151241+0000","last_unstale":"2023-07-27T20:34:53.552894+0000","last_undegraded":"2023-07-27T20:34:53.552894+0000","last_fullsized":"2023-07-27T20:34:53.552894+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:31:26.732750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590169+0000","last_change":"2023-07-27T20:34:34.316000+0000","last_active":"2023-07-27T20:34:52.590169+0000","last_peered":"2023-07-27T20:34:52.590169+0000","last_clean":"2023-07-27T20:34:52.590169+0000","last_became_active":"2023-07-27T20:34:34.315494+0000","last_became_peered":"2023-07-27T20:34:34.315494+0000","last_unstale":"2023-07-27T20:34:52.590169+0000","last_undegraded":"2023-07-27T20:34:52.590169+0000","last_fullsized":"2023-07-27T20:34:52.590169+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:12:23.304991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.133167+0000","last_change":"2023-07-27T20:34:51.155618+0000","last_active":"2023-07-27T20:34:52.133167+0000","last_peered":"2023-07-27T20:34:52.133167+0000","last_clean":"2023-07-27T20:34:52.133167+0000","last_became_active":"2023-07-27T20:34:51.155297+0000","last_became_peered":"2023-07-27T20:34:51.155297+0000","last_unstale":"2023-07-27T20:34:52.133167+0000","last_undegraded":"2023-07-27T20:34:52.133167+0000","last_fullsized":"2023-07-27T20:34:52.133167+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:24:43.146014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938985+0000","last_change":"2023-07-27T20:34:34.310257+0000","last_active":"2023-07-27T20:34:52.938985+0000","last_peered":"2023-07-27T20:34:52.938985+0000","last_clean":"2023-07-27T20:34:52.938985+0000","last_became_active":"2023-07-27T20:34:34.309918+0000","last_became_peered":"2023-07-27T20:34:34.309918+0000","last_unstale":"2023-07-27T20:34:52.938985+0000","last_undegraded":"2023-07-27T20:34:52.938985+0000","last_fullsized":"2023-07-27T20:34:52.938985+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:37:41.424554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938562+0000","last_change":"2023-07-27T20:34:51.156185+0000","last_active":"2023-07-27T20:34:52.938562+0000","last_peered":"2023-07-27T20:34:52.938562+0000","last_clean":"2023-07-27T20:34:52.938562+0000","last_became_active":"2023-07-27T20:34:51.155841+0000","last_became_peered":"2023-07-27T20:34:51.155841+0000","last_unstale":"2023-07-27T20:34:52.938562+0000","last_undegraded":"2023-07-27T20:34:52.938562+0000","last_fullsized":"2023-07-27T20:34:52.938562+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:05:20.675611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209213+0000","last_change":"2023-07-27T20:34:34.319670+0000","last_active":"2023-07-27T20:34:53.209213+0000","last_peered":"2023-07-27T20:34:53.209213+0000","last_clean":"2023-07-27T20:34:53.209213+0000","last_became_active":"2023-07-27T20:34:34.319356+0000","last_became_peered":"2023-07-27T20:34:34.319356+0000","last_unstale":"2023-07-27T20:34:53.209213+0000","last_undegraded":"2023-07-27T20:34:53.209213+0000","last_fullsized":"2023-07-27T20:34:53.209213+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:11:10.950594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210437+0000","last_change":"2023-07-27T20:34:51.152669+0000","last_active":"2023-07-27T20:34:53.210437+0000","last_peered":"2023-07-27T20:34:53.210437+0000","last_clean":"2023-07-27T20:34:53.210437+0000","last_became_active":"2023-07-27T20:34:51.151988+0000","last_became_peered":"2023-07-27T20:34:51.151988+0000","last_unstale":"2023-07-27T20:34:53.210437+0000","last_undegraded":"2023-07-27T20:34:53.210437+0000","last_fullsized":"2023-07-27T20:34:53.210437+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:02:26.072707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.553014+0000","last_change":"2023-07-27T20:34:34.300907+0000","last_active":"2023-07-27T20:34:53.553014+0000","last_peered":"2023-07-27T20:34:53.553014+0000","last_clean":"2023-07-27T20:34:53.553014+0000","last_became_active":"2023-07-27T20:34:34.300633+0000","last_became_peered":"2023-07-27T20:34:34.300633+0000","last_unstale":"2023-07-27T20:34:53.553014+0000","last_undegraded":"2023-07-27T20:34:53.553014+0000","last_fullsized":"2023-07-27T20:34:53.553014+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:22:39.673260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590334+0000","last_change":"2023-07-27T20:34:51.159055+0000","last_active":"2023-07-27T20:34:52.590334+0000","last_peered":"2023-07-27T20:34:52.590334+0000","last_clean":"2023-07-27T20:34:52.590334+0000","last_became_active":"2023-07-27T20:34:51.158750+0000","last_became_peered":"2023-07-27T20:34:51.158750+0000","last_unstale":"2023-07-27T20:34:52.590334+0000","last_undegraded":"2023-07-27T20:34:52.590334+0000","last_fullsized":"2023-07-27T20:34:52.590334+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:45:05.617819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209289+0000","last_change":"2023-07-27T20:34:34.320735+0000","last_active":"2023-07-27T20:34:53.209289+0000","last_peered":"2023-07-27T20:34:53.209289+0000","last_clean":"2023-07-27T20:34:53.209289+0000","last_became_active":"2023-07-27T20:34:34.320086+0000","last_became_peered":"2023-07-27T20:34:34.320086+0000","last_unstale":"2023-07-27T20:34:53.209289+0000","last_undegraded":"2023-07-27T20:34:53.209289+0000","last_fullsized":"2023-07-27T20:34:53.209289+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:46:52.049065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389208+0000","last_change":"2023-07-27T20:34:51.142025+0000","last_active":"2023-07-27T20:34:52.389208+0000","last_peered":"2023-07-27T20:34:52.389208+0000","last_clean":"2023-07-27T20:34:52.389208+0000","last_became_active":"2023-07-27T20:34:51.141766+0000","last_became_peered":"2023-07-27T20:34:51.141766+0000","last_unstale":"2023-07-27T20:34:52.389208+0000","last_undegraded":"2023-07-27T20:34:52.389208+0000","last_fullsized":"2023-07-27T20:34:52.389208+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:47:04.588935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.939577+0000","last_change":"2023-07-27T20:34:34.304314+0000","last_active":"2023-07-27T20:34:52.939577+0000","last_peered":"2023-07-27T20:34:52.939577+0000","last_clean":"2023-07-27T20:34:52.939577+0000","last_became_active":"2023-07-27T20:34:34.304042+0000","last_became_peered":"2023-07-27T20:34:34.304042+0000","last_unstale":"2023-07-27T20:34:52.939577+0000","last_undegraded":"2023-07-27T20:34:52.939577+0000","last_fullsized":"2023-07-27T20:34:52.939577+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:25:33.856127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131024+0000","last_change":"2023-07-27T20:34:51.156837+0000","last_active":"2023-07-27T20:34:52.131024+0000","last_peered":"2023-07-27T20:34:52.131024+0000","last_clean":"2023-07-27T20:34:52.131024+0000","last_became_active":"2023-07-27T20:34:51.156487+0000","last_became_peered":"2023-07-27T20:34:51.156487+0000","last_unstale":"2023-07-27T20:34:52.131024+0000","last_undegraded":"2023-07-27T20:34:52.131024+0000","last_fullsized":"2023-07-27T20:34:52.131024+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:12:02.541917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132260+0000","last_change":"2023-07-27T20:34:34.302549+0000","last_active":"2023-07-27T20:34:52.132260+0000","last_peered":"2023-07-27T20:34:52.132260+0000","last_clean":"2023-07-27T20:34:52.132260+0000","last_became_active":"2023-07-27T20:34:34.301699+0000","last_became_peered":"2023-07-27T20:34:34.301699+0000","last_unstale":"2023-07-27T20:34:52.132260+0000","last_undegraded":"2023-07-27T20:34:52.132260+0000","last_fullsized":"2023-07-27T20:34:52.132260+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:41:12.976042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132365+0000","last_change":"2023-07-27T20:34:51.144061+0000","last_active":"2023-07-27T20:34:52.132365+0000","last_peered":"2023-07-27T20:34:52.132365+0000","last_clean":"2023-07-27T20:34:52.132365+0000","last_became_active":"2023-07-27T20:34:51.143785+0000","last_became_peered":"2023-07-27T20:34:51.143785+0000","last_unstale":"2023-07-27T20:34:52.132365+0000","last_undegraded":"2023-07-27T20:34:52.132365+0000","last_fullsized":"2023-07-27T20:34:52.132365+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:14:18.507561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132935+0000","last_change":"2023-07-27T20:34:34.313419+0000","last_active":"2023-07-27T20:34:52.132935+0000","last_peered":"2023-07-27T20:34:52.132935+0000","last_clean":"2023-07-27T20:34:52.132935+0000","last_became_active":"2023-07-27T20:34:34.313089+0000","last_became_peered":"2023-07-27T20:34:34.313089+0000","last_unstale":"2023-07-27T20:34:52.132935+0000","last_undegraded":"2023-07-27T20:34:52.132935+0000","last_fullsized":"2023-07-27T20:34:52.132935+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:28:39.205723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938526+0000","last_change":"2023-07-27T20:34:51.158340+0000","last_active":"2023-07-27T20:34:52.938526+0000","last_peered":"2023-07-27T20:34:52.938526+0000","last_clean":"2023-07-27T20:34:52.938526+0000","last_became_active":"2023-07-27T20:34:51.158022+0000","last_became_peered":"2023-07-27T20:34:51.158022+0000","last_unstale":"2023-07-27T20:34:52.938526+0000","last_undegraded":"2023-07-27T20:34:52.938526+0000","last_fullsized":"2023-07-27T20:34:52.938526+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:46:52.928504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590333+0000","last_change":"2023-07-27T20:34:34.298435+0000","last_active":"2023-07-27T20:34:52.590333+0000","last_peered":"2023-07-27T20:34:52.590333+0000","last_clean":"2023-07-27T20:34:52.590333+0000","last_became_active":"2023-07-27T20:34:34.298143+0000","last_became_peered":"2023-07-27T20:34:34.298143+0000","last_unstale":"2023-07-27T20:34:52.590333+0000","last_undegraded":"2023-07-27T20:34:52.590333+0000","last_fullsized":"2023-07-27T20:34:52.590333+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:55:19.530682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590340+0000","last_change":"2023-07-27T20:34:51.152168+0000","last_active":"2023-07-27T20:34:52.590340+0000","last_peered":"2023-07-27T20:34:52.590340+0000","last_clean":"2023-07-27T20:34:52.590340+0000","last_became_active":"2023-07-27T20:34:51.151876+0000","last_became_peered":"2023-07-27T20:34:51.151876+0000","last_unstale":"2023-07-27T20:34:52.590340+0000","last_undegraded":"2023-07-27T20:34:52.590340+0000","last_fullsized":"2023-07-27T20:34:52.590340+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:11:27.828934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130963+0000","last_change":"2023-07-27T20:34:34.316878+0000","last_active":"2023-07-27T20:34:52.130963+0000","last_peered":"2023-07-27T20:34:52.130963+0000","last_clean":"2023-07-27T20:34:52.130963+0000","last_became_active":"2023-07-27T20:34:34.316610+0000","last_became_peered":"2023-07-27T20:34:34.316610+0000","last_unstale":"2023-07-27T20:34:52.130963+0000","last_undegraded":"2023-07-27T20:34:52.130963+0000","last_fullsized":"2023-07-27T20:34:52.130963+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:54:00.744549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210557+0000","last_change":"2023-07-27T20:34:51.145667+0000","last_active":"2023-07-27T20:34:53.210557+0000","last_peered":"2023-07-27T20:34:53.210557+0000","last_clean":"2023-07-27T20:34:53.210557+0000","last_became_active":"2023-07-27T20:34:51.145343+0000","last_became_peered":"2023-07-27T20:34:51.145343+0000","last_unstale":"2023-07-27T20:34:53.210557+0000","last_undegraded":"2023-07-27T20:34:53.210557+0000","last_fullsized":"2023-07-27T20:34:53.210557+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:22:02.376178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.939202+0000","last_change":"2023-07-27T20:34:34.297203+0000","last_active":"2023-07-27T20:34:52.939202+0000","last_peered":"2023-07-27T20:34:52.939202+0000","last_clean":"2023-07-27T20:34:52.939202+0000","last_became_active":"2023-07-27T20:34:34.296957+0000","last_became_peered":"2023-07-27T20:34:34.296957+0000","last_unstale":"2023-07-27T20:34:52.939202+0000","last_undegraded":"2023-07-27T20:34:52.939202+0000","last_fullsized":"2023-07-27T20:34:52.939202+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:33:13.233455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.553381+0000","last_change":"2023-07-27T20:34:51.153480+0000","last_active":"2023-07-27T20:34:53.553381+0000","last_peered":"2023-07-27T20:34:53.553381+0000","last_clean":"2023-07-27T20:34:53.553381+0000","last_became_active":"2023-07-27T20:34:51.153217+0000","last_became_peered":"2023-07-27T20:34:51.153217+0000","last_unstale":"2023-07-27T20:34:53.553381+0000","last_undegraded":"2023-07-27T20:34:53.553381+0000","last_fullsized":"2023-07-27T20:34:53.553381+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:33:49.001577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130270+0000","last_change":"2023-07-27T20:34:34.294995+0000","last_active":"2023-07-27T20:34:52.130270+0000","last_peered":"2023-07-27T20:34:52.130270+0000","last_clean":"2023-07-27T20:34:52.130270+0000","last_became_active":"2023-07-27T20:34:34.294646+0000","last_became_peered":"2023-07-27T20:34:34.294646+0000","last_unstale":"2023-07-27T20:34:52.130270+0000","last_undegraded":"2023-07-27T20:34:52.130270+0000","last_fullsized":"2023-07-27T20:34:52.130270+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:19:48.357135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210130+0000","last_change":"2023-07-27T20:34:51.152117+0000","last_active":"2023-07-27T20:34:53.210130+0000","last_peered":"2023-07-27T20:34:53.210130+0000","last_clean":"2023-07-27T20:34:53.210130+0000","last_became_active":"2023-07-27T20:34:51.151720+0000","last_became_peered":"2023-07-27T20:34:51.151720+0000","last_unstale":"2023-07-27T20:34:53.210130+0000","last_undegraded":"2023-07-27T20:34:53.210130+0000","last_fullsized":"2023-07-27T20:34:53.210130+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:17:19.524394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130883+0000","last_change":"2023-07-27T20:34:34.309167+0000","last_active":"2023-07-27T20:34:52.130883+0000","last_peered":"2023-07-27T20:34:52.130883+0000","last_clean":"2023-07-27T20:34:52.130883+0000","last_became_active":"2023-07-27T20:34:34.308831+0000","last_became_peered":"2023-07-27T20:34:34.308831+0000","last_unstale":"2023-07-27T20:34:52.130883+0000","last_undegraded":"2023-07-27T20:34:52.130883+0000","last_fullsized":"2023-07-27T20:34:52.130883+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:43:07.447940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209667+0000","last_change":"2023-07-27T20:34:51.148798+0000","last_active":"2023-07-27T20:34:53.209667+0000","last_peered":"2023-07-27T20:34:53.209667+0000","last_clean":"2023-07-27T20:34:53.209667+0000","last_became_active":"2023-07-27T20:34:51.148492+0000","last_became_peered":"2023-07-27T20:34:51.148492+0000","last_unstale":"2023-07-27T20:34:53.209667+0000","last_undegraded":"2023-07-27T20:34:53.209667+0000","last_fullsized":"2023-07-27T20:34:53.209667+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:53:03.343306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.939220+0000","last_change":"2023-07-27T20:34:34.298405+0000","last_active":"2023-07-27T20:34:52.939220+0000","last_peered":"2023-07-27T20:34:52.939220+0000","last_clean":"2023-07-27T20:34:52.939220+0000","last_became_active":"2023-07-27T20:34:34.298150+0000","last_became_peered":"2023-07-27T20:34:34.298150+0000","last_unstale":"2023-07-27T20:34:52.939220+0000","last_undegraded":"2023-07-27T20:34:52.939220+0000","last_fullsized":"2023-07-27T20:34:52.939220+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:45:16.289674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938436+0000","last_change":"2023-07-27T20:34:51.146714+0000","last_active":"2023-07-27T20:34:52.938436+0000","last_peered":"2023-07-27T20:34:52.938436+0000","last_clean":"2023-07-27T20:34:52.938436+0000","last_became_active":"2023-07-27T20:34:51.145799+0000","last_became_peered":"2023-07-27T20:34:51.145799+0000","last_unstale":"2023-07-27T20:34:52.938436+0000","last_undegraded":"2023-07-27T20:34:52.938436+0000","last_fullsized":"2023-07-27T20:34:52.938436+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:05:22.092932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590468+0000","last_change":"2023-07-27T20:34:34.316418+0000","last_active":"2023-07-27T20:34:52.590468+0000","last_peered":"2023-07-27T20:34:52.590468+0000","last_clean":"2023-07-27T20:34:52.590468+0000","last_became_active":"2023-07-27T20:34:34.316164+0000","last_became_peered":"2023-07-27T20:34:34.316164+0000","last_unstale":"2023-07-27T20:34:52.590468+0000","last_undegraded":"2023-07-27T20:34:52.590468+0000","last_fullsized":"2023-07-27T20:34:52.590468+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:19:54.428946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938627+0000","last_change":"2023-07-27T20:34:51.150712+0000","last_active":"2023-07-27T20:34:52.938627+0000","last_peered":"2023-07-27T20:34:52.938627+0000","last_clean":"2023-07-27T20:34:52.938627+0000","last_became_active":"2023-07-27T20:34:51.150384+0000","last_became_peered":"2023-07-27T20:34:51.150384+0000","last_unstale":"2023-07-27T20:34:52.938627+0000","last_undegraded":"2023-07-27T20:34:52.938627+0000","last_fullsized":"2023-07-27T20:34:52.938627+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:05:31.209001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210276+0000","last_change":"2023-07-27T20:34:34.322046+0000","last_active":"2023-07-27T20:34:53.210276+0000","last_peered":"2023-07-27T20:34:53.210276+0000","last_clean":"2023-07-27T20:34:53.210276+0000","last_became_active":"2023-07-27T20:34:34.321751+0000","last_became_peered":"2023-07-27T20:34:34.321751+0000","last_unstale":"2023-07-27T20:34:53.210276+0000","last_undegraded":"2023-07-27T20:34:53.210276+0000","last_fullsized":"2023-07-27T20:34:53.210276+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:05:28.688422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590016+0000","last_change":"2023-07-27T20:34:51.152143+0000","last_active":"2023-07-27T20:34:52.590016+0000","last_peered":"2023-07-27T20:34:52.590016+0000","last_clean":"2023-07-27T20:34:52.590016+0000","last_became_active":"2023-07-27T20:34:51.151836+0000","last_became_peered":"2023-07-27T20:34:51.151836+0000","last_unstale":"2023-07-27T20:34:52.590016+0000","last_undegraded":"2023-07-27T20:34:52.590016+0000","last_fullsized":"2023-07-27T20:34:52.590016+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:45:27.883128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130915+0000","last_change":"2023-07-27T20:34:34.298450+0000","last_active":"2023-07-27T20:34:52.130915+0000","last_peered":"2023-07-27T20:34:52.130915+0000","last_clean":"2023-07-27T20:34:52.130915+0000","last_became_active":"2023-07-27T20:34:34.298194+0000","last_became_peered":"2023-07-27T20:34:34.298194+0000","last_unstale":"2023-07-27T20:34:52.130915+0000","last_undegraded":"2023-07-27T20:34:52.130915+0000","last_fullsized":"2023-07-27T20:34:52.130915+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:01:23.041905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130916+0000","last_change":"2023-07-27T20:34:51.141249+0000","last_active":"2023-07-27T20:34:52.130916+0000","last_peered":"2023-07-27T20:34:52.130916+0000","last_clean":"2023-07-27T20:34:52.130916+0000","last_became_active":"2023-07-27T20:34:51.140088+0000","last_became_peered":"2023-07-27T20:34:51.140088+0000","last_unstale":"2023-07-27T20:34:52.130916+0000","last_undegraded":"2023-07-27T20:34:52.130916+0000","last_fullsized":"2023-07-27T20:34:52.130916+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:50:38.557507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.133123+0000","last_change":"2023-07-27T20:34:34.295428+0000","last_active":"2023-07-27T20:34:52.133123+0000","last_peered":"2023-07-27T20:34:52.133123+0000","last_clean":"2023-07-27T20:34:52.133123+0000","last_became_active":"2023-07-27T20:34:34.295069+0000","last_became_peered":"2023-07-27T20:34:34.295069+0000","last_unstale":"2023-07-27T20:34:52.133123+0000","last_undegraded":"2023-07-27T20:34:52.133123+0000","last_fullsized":"2023-07-27T20:34:52.133123+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:47:08.096237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938771+0000","last_change":"2023-07-27T20:34:51.147380+0000","last_active":"2023-07-27T20:34:52.938771+0000","last_peered":"2023-07-27T20:34:52.938771+0000","last_clean":"2023-07-27T20:34:52.938771+0000","last_became_active":"2023-07-27T20:34:51.147121+0000","last_became_peered":"2023-07-27T20:34:51.147121+0000","last_unstale":"2023-07-27T20:34:52.938771+0000","last_undegraded":"2023-07-27T20:34:52.938771+0000","last_fullsized":"2023-07-27T20:34:52.938771+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:08:53.040045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131834+0000","last_change":"2023-07-27T20:34:34.300794+0000","last_active":"2023-07-27T20:34:52.131834+0000","last_peered":"2023-07-27T20:34:52.131834+0000","last_clean":"2023-07-27T20:34:52.131834+0000","last_became_active":"2023-07-27T20:34:34.300470+0000","last_became_peered":"2023-07-27T20:34:34.300470+0000","last_unstale":"2023-07-27T20:34:52.131834+0000","last_undegraded":"2023-07-27T20:34:52.131834+0000","last_fullsized":"2023-07-27T20:34:52.131834+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:27:32.975304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132074+0000","last_change":"2023-07-27T20:34:51.148096+0000","last_active":"2023-07-27T20:34:52.132074+0000","last_peered":"2023-07-27T20:34:52.132074+0000","last_clean":"2023-07-27T20:34:52.132074+0000","last_became_active":"2023-07-27T20:34:51.147825+0000","last_became_peered":"2023-07-27T20:34:51.147825+0000","last_unstale":"2023-07-27T20:34:52.132074+0000","last_undegraded":"2023-07-27T20:34:52.132074+0000","last_fullsized":"2023-07-27T20:34:52.132074+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:42:31.002737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132207+0000","last_change":"2023-07-27T20:34:34.306170+0000","last_active":"2023-07-27T20:34:52.132207+0000","last_peered":"2023-07-27T20:34:52.132207+0000","last_clean":"2023-07-27T20:34:52.132207+0000","last_became_active":"2023-07-27T20:34:34.305895+0000","last_became_peered":"2023-07-27T20:34:34.305895+0000","last_unstale":"2023-07-27T20:34:52.132207+0000","last_undegraded":"2023-07-27T20:34:52.132207+0000","last_fullsized":"2023-07-27T20:34:52.132207+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:16:03.687360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938951+0000","last_change":"2023-07-27T20:34:51.158753+0000","last_active":"2023-07-27T20:34:52.938951+0000","last_peered":"2023-07-27T20:34:52.938951+0000","last_clean":"2023-07-27T20:34:52.938951+0000","last_became_active":"2023-07-27T20:34:51.158473+0000","last_became_peered":"2023-07-27T20:34:51.158473+0000","last_unstale":"2023-07-27T20:34:52.938951+0000","last_undegraded":"2023-07-27T20:34:52.938951+0000","last_fullsized":"2023-07-27T20:34:52.938951+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:02:34.927869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132107+0000","last_change":"2023-07-27T20:34:34.324172+0000","last_active":"2023-07-27T20:34:52.132107+0000","last_peered":"2023-07-27T20:34:52.132107+0000","last_clean":"2023-07-27T20:34:52.132107+0000","last_became_active":"2023-07-27T20:34:34.323886+0000","last_became_peered":"2023-07-27T20:34:34.323886+0000","last_unstale":"2023-07-27T20:34:52.132107+0000","last_undegraded":"2023-07-27T20:34:52.132107+0000","last_fullsized":"2023-07-27T20:34:52.132107+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:31:01.753346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131405+0000","last_change":"2023-07-27T20:34:51.142015+0000","last_active":"2023-07-27T20:34:52.131405+0000","last_peered":"2023-07-27T20:34:52.131405+0000","last_clean":"2023-07-27T20:34:52.131405+0000","last_became_active":"2023-07-27T20:34:51.141535+0000","last_became_peered":"2023-07-27T20:34:51.141535+0000","last_unstale":"2023-07-27T20:34:52.131405+0000","last_undegraded":"2023-07-27T20:34:52.131405+0000","last_fullsized":"2023-07-27T20:34:52.131405+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:27:47.573714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132172+0000","last_change":"2023-07-27T20:34:34.312549+0000","last_active":"2023-07-27T20:34:52.132172+0000","last_peered":"2023-07-27T20:34:52.132172+0000","last_clean":"2023-07-27T20:34:52.132172+0000","last_became_active":"2023-07-27T20:34:34.311940+0000","last_became_peered":"2023-07-27T20:34:34.311940+0000","last_unstale":"2023-07-27T20:34:52.132172+0000","last_undegraded":"2023-07-27T20:34:52.132172+0000","last_fullsized":"2023-07-27T20:34:52.132172+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:01:23.041905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209046+0000","last_change":"2023-07-27T20:34:51.158019+0000","last_active":"2023-07-27T20:34:53.209046+0000","last_peered":"2023-07-27T20:34:53.209046+0000","last_clean":"2023-07-27T20:34:53.209046+0000","last_became_active":"2023-07-27T20:34:51.157766+0000","last_became_peered":"2023-07-27T20:34:51.157766+0000","last_unstale":"2023-07-27T20:34:53.209046+0000","last_undegraded":"2023-07-27T20:34:53.209046+0000","last_fullsized":"2023-07-27T20:34:53.209046+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:38:18.284531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.553359+0000","last_change":"2023-07-27T20:34:34.315088+0000","last_active":"2023-07-27T20:34:53.553359+0000","last_peered":"2023-07-27T20:34:53.553359+0000","last_clean":"2023-07-27T20:34:53.553359+0000","last_became_active":"2023-07-27T20:34:34.314823+0000","last_became_peered":"2023-07-27T20:34:34.314823+0000","last_unstale":"2023-07-27T20:34:53.553359+0000","last_undegraded":"2023-07-27T20:34:53.553359+0000","last_fullsized":"2023-07-27T20:34:53.553359+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:42:57.971705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590034+0000","last_change":"2023-07-27T20:34:51.152285+0000","last_active":"2023-07-27T20:34:52.590034+0000","last_peered":"2023-07-27T20:34:52.590034+0000","last_clean":"2023-07-27T20:34:52.590034+0000","last_became_active":"2023-07-27T20:34:51.151991+0000","last_became_peered":"2023-07-27T20:34:51.151991+0000","last_unstale":"2023-07-27T20:34:52.590034+0000","last_undegraded":"2023-07-27T20:34:52.590034+0000","last_fullsized":"2023-07-27T20:34:52.590034+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:43:57.635951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389600+0000","last_change":"2023-07-27T20:34:34.309744+0000","last_active":"2023-07-27T20:34:52.389600+0000","last_peered":"2023-07-27T20:34:52.389600+0000","last_clean":"2023-07-27T20:34:52.389600+0000","last_became_active":"2023-07-27T20:34:34.309438+0000","last_became_peered":"2023-07-27T20:34:34.309438+0000","last_unstale":"2023-07-27T20:34:52.389600+0000","last_undegraded":"2023-07-27T20:34:52.389600+0000","last_fullsized":"2023-07-27T20:34:52.389600+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:46:11.189341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590580+0000","last_change":"2023-07-27T20:34:51.157055+0000","last_active":"2023-07-27T20:34:52.590580+0000","last_peered":"2023-07-27T20:34:52.590580+0000","last_clean":"2023-07-27T20:34:52.590580+0000","last_became_active":"2023-07-27T20:34:51.156703+0000","last_became_peered":"2023-07-27T20:34:51.156703+0000","last_unstale":"2023-07-27T20:34:52.590580+0000","last_undegraded":"2023-07-27T20:34:52.590580+0000","last_fullsized":"2023-07-27T20:34:52.590580+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:09:29.041164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131929+0000","last_change":"2023-07-27T20:34:34.300111+0000","last_active":"2023-07-27T20:34:52.131929+0000","last_peered":"2023-07-27T20:34:52.131929+0000","last_clean":"2023-07-27T20:34:52.131929+0000","last_became_active":"2023-07-27T20:34:34.298555+0000","last_became_peered":"2023-07-27T20:34:34.298555+0000","last_unstale":"2023-07-27T20:34:52.131929+0000","last_undegraded":"2023-07-27T20:34:52.131929+0000","last_fullsized":"2023-07-27T20:34:52.131929+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:08:36.407199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.133088+0000","last_change":"2023-07-27T20:34:51.144866+0000","last_active":"2023-07-27T20:34:52.133088+0000","last_peered":"2023-07-27T20:34:52.133088+0000","last_clean":"2023-07-27T20:34:52.133088+0000","last_became_active":"2023-07-27T20:34:51.143994+0000","last_became_peered":"2023-07-27T20:34:51.143994+0000","last_unstale":"2023-07-27T20:34:52.133088+0000","last_undegraded":"2023-07-27T20:34:52.133088+0000","last_fullsized":"2023-07-27T20:34:52.133088+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:54:17.622889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389507+0000","last_change":"2023-07-27T20:34:34.299682+0000","last_active":"2023-07-27T20:34:52.389507+0000","last_peered":"2023-07-27T20:34:52.389507+0000","last_clean":"2023-07-27T20:34:52.389507+0000","last_became_active":"2023-07-27T20:34:34.299402+0000","last_became_peered":"2023-07-27T20:34:34.299402+0000","last_unstale":"2023-07-27T20:34:52.389507+0000","last_undegraded":"2023-07-27T20:34:52.389507+0000","last_fullsized":"2023-07-27T20:34:52.389507+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:16:30.544846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209756+0000","last_change":"2023-07-27T20:34:51.160605+0000","last_active":"2023-07-27T20:34:53.209756+0000","last_peered":"2023-07-27T20:34:53.209756+0000","last_clean":"2023-07-27T20:34:53.209756+0000","last_became_active":"2023-07-27T20:34:51.160330+0000","last_became_peered":"2023-07-27T20:34:51.160330+0000","last_unstale":"2023-07-27T20:34:53.209756+0000","last_undegraded":"2023-07-27T20:34:53.209756+0000","last_fullsized":"2023-07-27T20:34:53.209756+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:16:27.809706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.552868+0000","last_change":"2023-07-27T20:34:34.320185+0000","last_active":"2023-07-27T20:34:53.552868+0000","last_peered":"2023-07-27T20:34:53.552868+0000","last_clean":"2023-07-27T20:34:53.552868+0000","last_became_active":"2023-07-27T20:34:34.319865+0000","last_became_peered":"2023-07-27T20:34:34.319865+0000","last_unstale":"2023-07-27T20:34:53.552868+0000","last_undegraded":"2023-07-27T20:34:53.552868+0000","last_fullsized":"2023-07-27T20:34:53.552868+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:18:57.338563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590718+0000","last_change":"2023-07-27T20:34:51.160280+0000","last_active":"2023-07-27T20:34:52.590718+0000","last_peered":"2023-07-27T20:34:52.590718+0000","last_clean":"2023-07-27T20:34:52.590718+0000","last_became_active":"2023-07-27T20:34:51.159951+0000","last_became_peered":"2023-07-27T20:34:51.159951+0000","last_unstale":"2023-07-27T20:34:52.590718+0000","last_undegraded":"2023-07-27T20:34:52.590718+0000","last_fullsized":"2023-07-27T20:34:52.590718+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:16:27.809706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.552968+0000","last_change":"2023-07-27T20:34:34.297379+0000","last_active":"2023-07-27T20:34:53.552968+0000","last_peered":"2023-07-27T20:34:53.552968+0000","last_clean":"2023-07-27T20:34:53.552968+0000","last_became_active":"2023-07-27T20:34:34.297105+0000","last_became_peered":"2023-07-27T20:34:34.297105+0000","last_unstale":"2023-07-27T20:34:53.552968+0000","last_undegraded":"2023-07-27T20:34:53.552968+0000","last_fullsized":"2023-07-27T20:34:53.552968+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:37:03.586400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132127+0000","last_change":"2023-07-27T20:34:51.153937+0000","last_active":"2023-07-27T20:34:52.132127+0000","last_peered":"2023-07-27T20:34:52.132127+0000","last_clean":"2023-07-27T20:34:52.132127+0000","last_became_active":"2023-07-27T20:34:51.153655+0000","last_became_peered":"2023-07-27T20:34:51.153655+0000","last_unstale":"2023-07-27T20:34:52.132127+0000","last_undegraded":"2023-07-27T20:34:52.132127+0000","last_fullsized":"2023-07-27T20:34:52.132127+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:53:22.181258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209311+0000","last_change":"2023-07-27T20:34:34.321045+0000","last_active":"2023-07-27T20:34:53.209311+0000","last_peered":"2023-07-27T20:34:53.209311+0000","last_clean":"2023-07-27T20:34:53.209311+0000","last_became_active":"2023-07-27T20:34:34.320433+0000","last_became_peered":"2023-07-27T20:34:34.320433+0000","last_unstale":"2023-07-27T20:34:53.209311+0000","last_undegraded":"2023-07-27T20:34:53.209311+0000","last_fullsized":"2023-07-27T20:34:53.209311+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:56:42.150862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131465+0000","last_change":"2023-07-27T20:34:51.136021+0000","last_active":"2023-07-27T20:34:52.131465+0000","last_peered":"2023-07-27T20:34:52.131465+0000","last_clean":"2023-07-27T20:34:52.131465+0000","last_became_active":"2023-07-27T20:34:51.135735+0000","last_became_peered":"2023-07-27T20:34:51.135735+0000","last_unstale":"2023-07-27T20:34:52.131465+0000","last_undegraded":"2023-07-27T20:34:52.131465+0000","last_fullsized":"2023-07-27T20:34:52.131465+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:57:15.496059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130567+0000","last_change":"2023-07-27T20:34:50.180048+0000","last_active":"2023-07-27T20:34:52.130567+0000","last_peered":"2023-07-27T20:34:52.130567+0000","last_clean":"2023-07-27T20:34:52.130567+0000","last_became_active":"2023-07-27T20:34:50.179711+0000","last_became_peered":"2023-07-27T20:34:50.179711+0000","last_unstale":"2023-07-27T20:34:52.130567+0000","last_undegraded":"2023-07-27T20:34:52.130567+0000","last_fullsized":"2023-07-27T20:34:52.130567+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:41:28.847534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132591+0000","last_change":"2023-07-27T20:34:34.325790+0000","last_active":"2023-07-27T20:34:52.132591+0000","last_peered":"2023-07-27T20:34:52.132591+0000","last_clean":"2023-07-27T20:34:52.132591+0000","last_became_active":"2023-07-27T20:34:34.325387+0000","last_became_peered":"2023-07-27T20:34:34.325387+0000","last_unstale":"2023-07-27T20:34:52.132591+0000","last_undegraded":"2023-07-27T20:34:52.132591+0000","last_fullsized":"2023-07-27T20:34:52.132591+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:01:22.177518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"61'4","reported_seq":25,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.133234+0000","last_change":"2023-07-27T20:34:33.303138+0000","last_active":"2023-07-27T20:34:52.133234+0000","last_peered":"2023-07-27T20:34:52.133234+0000","last_clean":"2023-07-27T20:34:52.133234+0000","last_became_active":"2023-07-27T20:34:33.302808+0000","last_became_peered":"2023-07-27T20:34:33.302808+0000","last_unstale":"2023-07-27T20:34:52.133234+0000","last_undegraded":"2023-07-27T20:34:52.133234+0000","last_fullsized":"2023-07-27T20:34:52.133234+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:01:49.260152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389560+0000","last_change":"2023-07-27T20:34:51.145286+0000","last_active":"2023-07-27T20:34:52.389560+0000","last_peered":"2023-07-27T20:34:52.389560+0000","last_clean":"2023-07-27T20:34:52.389560+0000","last_became_active":"2023-07-27T20:34:51.145030+0000","last_became_peered":"2023-07-27T20:34:51.145030+0000","last_unstale":"2023-07-27T20:34:52.389560+0000","last_undegraded":"2023-07-27T20:34:52.389560+0000","last_fullsized":"2023-07-27T20:34:52.389560+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:55:19.156844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.589690+0000","last_change":"2023-07-27T20:34:50.179618+0000","last_active":"2023-07-27T20:34:52.589690+0000","last_peered":"2023-07-27T20:34:52.589690+0000","last_clean":"2023-07-27T20:34:52.589690+0000","last_became_active":"2023-07-27T20:34:50.179116+0000","last_became_peered":"2023-07-27T20:34:50.179116+0000","last_unstale":"2023-07-27T20:34:52.589690+0000","last_undegraded":"2023-07-27T20:34:52.589690+0000","last_fullsized":"2023-07-27T20:34:52.589690+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:03:50.637289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.939065+0000","last_change":"2023-07-27T20:34:34.298335+0000","last_active":"2023-07-27T20:34:52.939065+0000","last_peered":"2023-07-27T20:34:52.939065+0000","last_clean":"2023-07-27T20:34:52.939065+0000","last_became_active":"2023-07-27T20:34:34.298050+0000","last_became_peered":"2023-07-27T20:34:34.298050+0000","last_unstale":"2023-07-27T20:34:52.939065+0000","last_undegraded":"2023-07-27T20:34:52.939065+0000","last_fullsized":"2023-07-27T20:34:52.939065+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:41:23.899695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"61'1","reported_seq":22,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131076+0000","last_change":"2023-07-27T20:34:33.298365+0000","last_active":"2023-07-27T20:34:52.131076+0000","last_peered":"2023-07-27T20:34:52.131076+0000","last_clean":"2023-07-27T20:34:52.131076+0000","last_became_active":"2023-07-27T20:34:33.298105+0000","last_became_peered":"2023-07-27T20:34:33.298105+0000","last_unstale":"2023-07-27T20:34:52.131076+0000","last_undegraded":"2023-07-27T20:34:52.131076+0000","last_fullsized":"2023-07-27T20:34:52.131076+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:55:41.265066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.589923+0000","last_change":"2023-07-27T20:34:51.157751+0000","last_active":"2023-07-27T20:34:52.589923+0000","last_peered":"2023-07-27T20:34:52.589923+0000","last_clean":"2023-07-27T20:34:52.589923+0000","last_became_active":"2023-07-27T20:34:51.157398+0000","last_became_peered":"2023-07-27T20:34:51.157398+0000","last_unstale":"2023-07-27T20:34:52.589923+0000","last_undegraded":"2023-07-27T20:34:52.589923+0000","last_fullsized":"2023-07-27T20:34:52.589923+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:07:47.085566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"65'1","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132078+0000","last_change":"2023-07-27T20:34:50.182478+0000","last_active":"2023-07-27T20:34:52.132078+0000","last_peered":"2023-07-27T20:34:52.132078+0000","last_clean":"2023-07-27T20:34:52.132078+0000","last_became_active":"2023-07-27T20:34:50.182129+0000","last_became_peered":"2023-07-27T20:34:50.182129+0000","last_unstale":"2023-07-27T20:34:52.132078+0000","last_undegraded":"2023-07-27T20:34:52.132078+0000","last_fullsized":"2023-07-27T20:34:52.132078+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:21:54.178397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210569+0000","last_change":"2023-07-27T20:34:34.323261+0000","last_active":"2023-07-27T20:34:53.210569+0000","last_peered":"2023-07-27T20:34:53.210569+0000","last_clean":"2023-07-27T20:34:53.210569+0000","last_became_active":"2023-07-27T20:34:34.322945+0000","last_became_peered":"2023-07-27T20:34:34.322945+0000","last_unstale":"2023-07-27T20:34:53.210569+0000","last_undegraded":"2023-07-27T20:34:53.210569+0000","last_fullsized":"2023-07-27T20:34:53.210569+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:54:18.189843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"61'2","reported_seq":23,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132465+0000","last_change":"2023-07-27T20:34:33.303171+0000","last_active":"2023-07-27T20:34:52.132465+0000","last_peered":"2023-07-27T20:34:52.132465+0000","last_clean":"2023-07-27T20:34:52.132465+0000","last_became_active":"2023-07-27T20:34:33.302865+0000","last_became_peered":"2023-07-27T20:34:33.302865+0000","last_unstale":"2023-07-27T20:34:52.132465+0000","last_undegraded":"2023-07-27T20:34:52.132465+0000","last_fullsized":"2023-07-27T20:34:52.132465+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:19:24.761135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.133053+0000","last_change":"2023-07-27T20:34:51.151625+0000","last_active":"2023-07-27T20:34:52.133053+0000","last_peered":"2023-07-27T20:34:52.133053+0000","last_clean":"2023-07-27T20:34:52.133053+0000","last_became_active":"2023-07-27T20:34:51.151311+0000","last_became_peered":"2023-07-27T20:34:51.151311+0000","last_unstale":"2023-07-27T20:34:52.133053+0000","last_undegraded":"2023-07-27T20:34:52.133053+0000","last_fullsized":"2023-07-27T20:34:52.133053+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:50:38.557507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"65'1","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131461+0000","last_change":"2023-07-27T20:34:50.177790+0000","last_active":"2023-07-27T20:34:52.131461+0000","last_peered":"2023-07-27T20:34:52.131461+0000","last_clean":"2023-07-27T20:34:52.131461+0000","last_became_active":"2023-07-27T20:34:50.177484+0000","last_became_peered":"2023-07-27T20:34:50.177484+0000","last_unstale":"2023-07-27T20:34:52.131461+0000","last_undegraded":"2023-07-27T20:34:52.131461+0000","last_fullsized":"2023-07-27T20:34:52.131461+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:54:50.777487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.133055+0000","last_change":"2023-07-27T20:34:34.314330+0000","last_active":"2023-07-27T20:34:52.133055+0000","last_peered":"2023-07-27T20:34:52.133055+0000","last_clean":"2023-07-27T20:34:52.133055+0000","last_became_active":"2023-07-27T20:34:34.314054+0000","last_became_peered":"2023-07-27T20:34:34.314054+0000","last_unstale":"2023-07-27T20:34:52.133055+0000","last_undegraded":"2023-07-27T20:34:52.133055+0000","last_fullsized":"2023-07-27T20:34:52.133055+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:44:22.109843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"61'2","reported_seq":23,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210010+0000","last_change":"2023-07-27T20:34:33.307004+0000","last_active":"2023-07-27T20:34:53.210010+0000","last_peered":"2023-07-27T20:34:53.210010+0000","last_clean":"2023-07-27T20:34:53.210010+0000","last_became_active":"2023-07-27T20:34:33.306710+0000","last_became_peered":"2023-07-27T20:34:33.306710+0000","last_unstale":"2023-07-27T20:34:53.210010+0000","last_undegraded":"2023-07-27T20:34:53.210010+0000","last_fullsized":"2023-07-27T20:34:53.210010+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:14:22.083030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209886+0000","last_change":"2023-07-27T20:34:51.158511+0000","last_active":"2023-07-27T20:34:53.209886+0000","last_peered":"2023-07-27T20:34:53.209886+0000","last_clean":"2023-07-27T20:34:53.209886+0000","last_became_active":"2023-07-27T20:34:51.158268+0000","last_became_peered":"2023-07-27T20:34:51.158268+0000","last_unstale":"2023-07-27T20:34:53.209886+0000","last_undegraded":"2023-07-27T20:34:53.209886+0000","last_fullsized":"2023-07-27T20:34:53.209886+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:54:15.988919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"65'2","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130531+0000","last_change":"2023-07-27T20:34:50.180037+0000","last_active":"2023-07-27T20:34:52.130531+0000","last_peered":"2023-07-27T20:34:52.130531+0000","last_clean":"2023-07-27T20:34:52.130531+0000","last_became_active":"2023-07-27T20:34:50.179747+0000","last_became_peered":"2023-07-27T20:34:50.179747+0000","last_unstale":"2023-07-27T20:34:52.130531+0000","last_undegraded":"2023-07-27T20:34:52.130531+0000","last_fullsized":"2023-07-27T20:34:52.130531+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:10:01.966530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.553071+0000","last_change":"2023-07-27T20:34:34.304872+0000","last_active":"2023-07-27T20:34:53.553071+0000","last_peered":"2023-07-27T20:34:53.553071+0000","last_clean":"2023-07-27T20:34:53.553071+0000","last_became_active":"2023-07-27T20:34:34.304583+0000","last_became_peered":"2023-07-27T20:34:34.304583+0000","last_unstale":"2023-07-27T20:34:53.553071+0000","last_undegraded":"2023-07-27T20:34:53.553071+0000","last_fullsized":"2023-07-27T20:34:53.553071+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:33:06.823968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"61'1","reported_seq":22,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389706+0000","last_change":"2023-07-27T20:34:33.303472+0000","last_active":"2023-07-27T20:34:52.389706+0000","last_peered":"2023-07-27T20:34:52.389706+0000","last_clean":"2023-07-27T20:34:52.389706+0000","last_became_active":"2023-07-27T20:34:33.303211+0000","last_became_peered":"2023-07-27T20:34:33.303211+0000","last_unstale":"2023-07-27T20:34:52.389706+0000","last_undegraded":"2023-07-27T20:34:52.389706+0000","last_fullsized":"2023-07-27T20:34:52.389706+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:46:04.542928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132813+0000","last_change":"2023-07-27T20:34:51.151356+0000","last_active":"2023-07-27T20:34:52.132813+0000","last_peered":"2023-07-27T20:34:52.132813+0000","last_clean":"2023-07-27T20:34:52.132813+0000","last_became_active":"2023-07-27T20:34:51.151082+0000","last_became_peered":"2023-07-27T20:34:51.151082+0000","last_unstale":"2023-07-27T20:34:52.132813+0000","last_undegraded":"2023-07-27T20:34:52.132813+0000","last_fullsized":"2023-07-27T20:34:52.132813+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:30:31.686019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"65'2","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130615+0000","last_change":"2023-07-27T20:34:50.181891+0000","last_active":"2023-07-27T20:34:52.130615+0000","last_peered":"2023-07-27T20:34:52.130615+0000","last_clean":"2023-07-27T20:34:52.130615+0000","last_became_active":"2023-07-27T20:34:50.181567+0000","last_became_peered":"2023-07-27T20:34:50.181567+0000","last_unstale":"2023-07-27T20:34:52.130615+0000","last_undegraded":"2023-07-27T20:34:52.130615+0000","last_fullsized":"2023-07-27T20:34:52.130615+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:22:09.691362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131948+0000","last_change":"2023-07-27T20:34:34.309855+0000","last_active":"2023-07-27T20:34:52.131948+0000","last_peered":"2023-07-27T20:34:52.131948+0000","last_clean":"2023-07-27T20:34:52.131948+0000","last_became_active":"2023-07-27T20:34:34.309553+0000","last_became_peered":"2023-07-27T20:34:34.309553+0000","last_unstale":"2023-07-27T20:34:52.131948+0000","last_undegraded":"2023-07-27T20:34:52.131948+0000","last_fullsized":"2023-07-27T20:34:52.131948+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:19:48.357135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"61'1","reported_seq":22,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209328+0000","last_change":"2023-07-27T20:34:33.307265+0000","last_active":"2023-07-27T20:34:53.209328+0000","last_peered":"2023-07-27T20:34:53.209328+0000","last_clean":"2023-07-27T20:34:53.209328+0000","last_became_active":"2023-07-27T20:34:33.306583+0000","last_became_peered":"2023-07-27T20:34:33.306583+0000","last_unstale":"2023-07-27T20:34:53.209328+0000","last_undegraded":"2023-07-27T20:34:53.209328+0000","last_fullsized":"2023-07-27T20:34:53.209328+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:09:11.155306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132022+0000","last_change":"2023-07-27T20:34:51.155271+0000","last_active":"2023-07-27T20:34:52.132022+0000","last_peered":"2023-07-27T20:34:52.132022+0000","last_clean":"2023-07-27T20:34:52.132022+0000","last_became_active":"2023-07-27T20:34:51.154957+0000","last_became_peered":"2023-07-27T20:34:51.154957+0000","last_unstale":"2023-07-27T20:34:52.132022+0000","last_undegraded":"2023-07-27T20:34:52.132022+0000","last_fullsized":"2023-07-27T20:34:52.132022+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:57:48.534355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"65'4","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210538+0000","last_change":"2023-07-27T20:34:50.193860+0000","last_active":"2023-07-27T20:34:53.210538+0000","last_peered":"2023-07-27T20:34:53.210538+0000","last_clean":"2023-07-27T20:34:53.210538+0000","last_became_active":"2023-07-27T20:34:50.193550+0000","last_became_peered":"2023-07-27T20:34:50.193550+0000","last_unstale":"2023-07-27T20:34:53.210538+0000","last_undegraded":"2023-07-27T20:34:53.210538+0000","last_fullsized":"2023-07-27T20:34:53.210538+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:13:03.285306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938426+0000","last_change":"2023-07-27T20:34:34.305104+0000","last_active":"2023-07-27T20:34:52.938426+0000","last_peered":"2023-07-27T20:34:52.938426+0000","last_clean":"2023-07-27T20:34:52.938426+0000","last_became_active":"2023-07-27T20:34:34.304828+0000","last_became_peered":"2023-07-27T20:34:34.304828+0000","last_unstale":"2023-07-27T20:34:52.938426+0000","last_undegraded":"2023-07-27T20:34:52.938426+0000","last_fullsized":"2023-07-27T20:34:52.938426+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:46:28.161781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.589779+0000","last_change":"2023-07-27T20:34:33.304005+0000","last_active":"2023-07-27T20:34:52.589779+0000","last_peered":"2023-07-27T20:34:52.589779+0000","last_clean":"2023-07-27T20:34:52.589779+0000","last_became_active":"2023-07-27T20:34:33.303744+0000","last_became_peered":"2023-07-27T20:34:33.303744+0000","last_unstale":"2023-07-27T20:34:52.589779+0000","last_undegraded":"2023-07-27T20:34:52.589779+0000","last_fullsized":"2023-07-27T20:34:52.589779+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:08:35.251600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210344+0000","last_change":"2023-07-27T20:34:51.152510+0000","last_active":"2023-07-27T20:34:53.210344+0000","last_peered":"2023-07-27T20:34:53.210344+0000","last_clean":"2023-07-27T20:34:53.210344+0000","last_became_active":"2023-07-27T20:34:51.151665+0000","last_became_peered":"2023-07-27T20:34:51.151665+0000","last_unstale":"2023-07-27T20:34:53.210344+0000","last_undegraded":"2023-07-27T20:34:53.210344+0000","last_fullsized":"2023-07-27T20:34:53.210344+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:56:38.080744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"65'1","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132059+0000","last_change":"2023-07-27T20:34:50.180779+0000","last_active":"2023-07-27T20:34:52.132059+0000","last_peered":"2023-07-27T20:34:52.132059+0000","last_clean":"2023-07-27T20:34:52.132059+0000","last_became_active":"2023-07-27T20:34:50.180337+0000","last_became_peered":"2023-07-27T20:34:50.180337+0000","last_unstale":"2023-07-27T20:34:52.132059+0000","last_undegraded":"2023-07-27T20:34:52.132059+0000","last_fullsized":"2023-07-27T20:34:52.132059+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:10:01.966530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130184+0000","last_change":"2023-07-27T20:34:34.310350+0000","last_active":"2023-07-27T20:34:52.130184+0000","last_peered":"2023-07-27T20:34:52.130184+0000","last_clean":"2023-07-27T20:34:52.130184+0000","last_became_active":"2023-07-27T20:34:34.310068+0000","last_became_peered":"2023-07-27T20:34:34.310068+0000","last_unstale":"2023-07-27T20:34:52.130184+0000","last_undegraded":"2023-07-27T20:34:52.130184+0000","last_fullsized":"2023-07-27T20:34:52.130184+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:27:32.975304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938196+0000","last_change":"2023-07-27T20:34:33.299254+0000","last_active":"2023-07-27T20:34:52.938196+0000","last_peered":"2023-07-27T20:34:52.938196+0000","last_clean":"2023-07-27T20:34:52.938196+0000","last_became_active":"2023-07-27T20:34:33.298978+0000","last_became_peered":"2023-07-27T20:34:33.298978+0000","last_unstale":"2023-07-27T20:34:52.938196+0000","last_undegraded":"2023-07-27T20:34:52.938196+0000","last_fullsized":"2023-07-27T20:34:52.938196+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:57:02.656808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.589662+0000","last_change":"2023-07-27T20:34:51.157170+0000","last_active":"2023-07-27T20:34:52.589662+0000","last_peered":"2023-07-27T20:34:52.589662+0000","last_clean":"2023-07-27T20:34:52.589662+0000","last_became_active":"2023-07-27T20:34:51.156897+0000","last_became_peered":"2023-07-27T20:34:51.156897+0000","last_unstale":"2023-07-27T20:34:52.589662+0000","last_undegraded":"2023-07-27T20:34:52.589662+0000","last_fullsized":"2023-07-27T20:34:52.589662+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:32:50.988054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.553210+0000","last_change":"2023-07-27T20:34:50.185449+0000","last_active":"2023-07-27T20:34:53.553210+0000","last_peered":"2023-07-27T20:34:53.553210+0000","last_clean":"2023-07-27T20:34:53.553210+0000","last_became_active":"2023-07-27T20:34:50.185157+0000","last_became_peered":"2023-07-27T20:34:50.185157+0000","last_unstale":"2023-07-27T20:34:53.553210+0000","last_undegraded":"2023-07-27T20:34:53.553210+0000","last_fullsized":"2023-07-27T20:34:53.553210+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:47:03.582088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.553357+0000","last_change":"2023-07-27T20:34:34.313397+0000","last_active":"2023-07-27T20:34:53.553357+0000","last_peered":"2023-07-27T20:34:53.553357+0000","last_clean":"2023-07-27T20:34:53.553357+0000","last_became_active":"2023-07-27T20:34:34.313128+0000","last_became_peered":"2023-07-27T20:34:34.313128+0000","last_unstale":"2023-07-27T20:34:53.553357+0000","last_undegraded":"2023-07-27T20:34:53.553357+0000","last_fullsized":"2023-07-27T20:34:53.553357+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:34:48.784517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132509+0000","last_change":"2023-07-27T20:34:33.299760+0000","last_active":"2023-07-27T20:34:52.132509+0000","last_peered":"2023-07-27T20:34:52.132509+0000","last_clean":"2023-07-27T20:34:52.132509+0000","last_became_active":"2023-07-27T20:34:33.299488+0000","last_became_peered":"2023-07-27T20:34:33.299488+0000","last_unstale":"2023-07-27T20:34:52.132509+0000","last_undegraded":"2023-07-27T20:34:52.132509+0000","last_fullsized":"2023-07-27T20:34:52.132509+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:42:21.819263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.589729+0000","last_change":"2023-07-27T20:34:51.158440+0000","last_active":"2023-07-27T20:34:52.589729+0000","last_peered":"2023-07-27T20:34:52.589729+0000","last_clean":"2023-07-27T20:34:52.589729+0000","last_became_active":"2023-07-27T20:34:51.158195+0000","last_became_peered":"2023-07-27T20:34:51.158195+0000","last_unstale":"2023-07-27T20:34:52.589729+0000","last_undegraded":"2023-07-27T20:34:52.589729+0000","last_fullsized":"2023-07-27T20:34:52.589729+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:54:25.575394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"65'8","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130247+0000","last_change":"2023-07-27T20:34:50.174398+0000","last_active":"2023-07-27T20:34:52.130247+0000","last_peered":"2023-07-27T20:34:52.130247+0000","last_clean":"2023-07-27T20:34:52.130247+0000","last_became_active":"2023-07-27T20:34:50.174069+0000","last_became_peered":"2023-07-27T20:34:50.174069+0000","last_unstale":"2023-07-27T20:34:52.130247+0000","last_undegraded":"2023-07-27T20:34:52.130247+0000","last_fullsized":"2023-07-27T20:34:52.130247+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:59:13.975092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.133051+0000","last_change":"2023-07-27T20:34:34.324198+0000","last_active":"2023-07-27T20:34:52.133051+0000","last_peered":"2023-07-27T20:34:52.133051+0000","last_clean":"2023-07-27T20:34:52.133051+0000","last_became_active":"2023-07-27T20:34:34.323865+0000","last_became_peered":"2023-07-27T20:34:34.323865+0000","last_unstale":"2023-07-27T20:34:52.133051+0000","last_undegraded":"2023-07-27T20:34:52.133051+0000","last_fullsized":"2023-07-27T20:34:52.133051+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:03:17.266643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210618+0000","last_change":"2023-07-27T20:34:33.309943+0000","last_active":"2023-07-27T20:34:53.210618+0000","last_peered":"2023-07-27T20:34:53.210618+0000","last_clean":"2023-07-27T20:34:53.210618+0000","last_became_active":"2023-07-27T20:34:33.309650+0000","last_became_peered":"2023-07-27T20:34:33.309650+0000","last_unstale":"2023-07-27T20:34:53.210618+0000","last_undegraded":"2023-07-27T20:34:53.210618+0000","last_fullsized":"2023-07-27T20:34:53.210618+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:58:22.169362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130293+0000","last_change":"2023-07-27T20:34:51.142784+0000","last_active":"2023-07-27T20:34:52.130293+0000","last_peered":"2023-07-27T20:34:52.130293+0000","last_clean":"2023-07-27T20:34:52.130293+0000","last_became_active":"2023-07-27T20:34:51.142488+0000","last_became_peered":"2023-07-27T20:34:51.142488+0000","last_unstale":"2023-07-27T20:34:52.130293+0000","last_undegraded":"2023-07-27T20:34:52.130293+0000","last_fullsized":"2023-07-27T20:34:52.130293+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:08:53.285539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"65'2","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590315+0000","last_change":"2023-07-27T20:34:50.184191+0000","last_active":"2023-07-27T20:34:52.590315+0000","last_peered":"2023-07-27T20:34:52.590315+0000","last_clean":"2023-07-27T20:34:52.590315+0000","last_became_active":"2023-07-27T20:34:50.183938+0000","last_became_peered":"2023-07-27T20:34:50.183938+0000","last_unstale":"2023-07-27T20:34:52.590315+0000","last_undegraded":"2023-07-27T20:34:52.590315+0000","last_fullsized":"2023-07-27T20:34:52.590315+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:56:58.022354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210337+0000","last_change":"2023-07-27T20:34:34.313276+0000","last_active":"2023-07-27T20:34:53.210337+0000","last_peered":"2023-07-27T20:34:53.210337+0000","last_clean":"2023-07-27T20:34:53.210337+0000","last_became_active":"2023-07-27T20:34:34.310175+0000","last_became_peered":"2023-07-27T20:34:34.310175+0000","last_unstale":"2023-07-27T20:34:53.210337+0000","last_undegraded":"2023-07-27T20:34:53.210337+0000","last_fullsized":"2023-07-27T20:34:53.210337+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:59:03.811289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"61'3","reported_seq":24,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389745+0000","last_change":"2023-07-27T20:34:33.302814+0000","last_active":"2023-07-27T20:34:52.389745+0000","last_peered":"2023-07-27T20:34:52.389745+0000","last_clean":"2023-07-27T20:34:52.389745+0000","last_became_active":"2023-07-27T20:34:33.302504+0000","last_became_peered":"2023-07-27T20:34:33.302504+0000","last_unstale":"2023-07-27T20:34:52.389745+0000","last_undegraded":"2023-07-27T20:34:52.389745+0000","last_fullsized":"2023-07-27T20:34:52.389745+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:43:06.440422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132547+0000","last_change":"2023-07-27T20:34:51.136033+0000","last_active":"2023-07-27T20:34:52.132547+0000","last_peered":"2023-07-27T20:34:52.132547+0000","last_clean":"2023-07-27T20:34:52.132547+0000","last_became_active":"2023-07-27T20:34:51.135756+0000","last_became_peered":"2023-07-27T20:34:51.135756+0000","last_unstale":"2023-07-27T20:34:52.132547+0000","last_undegraded":"2023-07-27T20:34:52.132547+0000","last_fullsized":"2023-07-27T20:34:52.132547+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:51:33.389165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389229+0000","last_change":"2023-07-27T20:34:50.177834+0000","last_active":"2023-07-27T20:34:52.389229+0000","last_peered":"2023-07-27T20:34:52.389229+0000","last_clean":"2023-07-27T20:34:52.389229+0000","last_became_active":"2023-07-27T20:34:50.177565+0000","last_became_peered":"2023-07-27T20:34:50.177565+0000","last_unstale":"2023-07-27T20:34:52.389229+0000","last_undegraded":"2023-07-27T20:34:52.389229+0000","last_fullsized":"2023-07-27T20:34:52.389229+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:33:47.994729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.939052+0000","last_change":"2023-07-27T20:34:34.302062+0000","last_active":"2023-07-27T20:34:52.939052+0000","last_peered":"2023-07-27T20:34:52.939052+0000","last_clean":"2023-07-27T20:34:52.939052+0000","last_became_active":"2023-07-27T20:34:34.301760+0000","last_became_peered":"2023-07-27T20:34:34.301760+0000","last_unstale":"2023-07-27T20:34:52.939052+0000","last_undegraded":"2023-07-27T20:34:52.939052+0000","last_fullsized":"2023-07-27T20:34:52.939052+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:51:30.923164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"62'8","reported_seq":29,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590580+0000","last_change":"2023-07-27T20:34:33.300792+0000","last_active":"2023-07-27T20:34:52.590580+0000","last_peered":"2023-07-27T20:34:52.590580+0000","last_clean":"2023-07-27T20:34:52.590580+0000","last_became_active":"2023-07-27T20:34:33.300452+0000","last_became_peered":"2023-07-27T20:34:33.300452+0000","last_unstale":"2023-07-27T20:34:52.590580+0000","last_undegraded":"2023-07-27T20:34:52.590580+0000","last_fullsized":"2023-07-27T20:34:52.590580+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:34:08.093182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3261,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130524+0000","last_change":"2023-07-27T20:34:51.158451+0000","last_active":"2023-07-27T20:34:52.130524+0000","last_peered":"2023-07-27T20:34:52.130524+0000","last_clean":"2023-07-27T20:34:52.130524+0000","last_became_active":"2023-07-27T20:34:51.158192+0000","last_became_peered":"2023-07-27T20:34:51.158192+0000","last_unstale":"2023-07-27T20:34:52.130524+0000","last_undegraded":"2023-07-27T20:34:52.130524+0000","last_fullsized":"2023-07-27T20:34:52.130524+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:21:55.185244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"65'3","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209761+0000","last_change":"2023-07-27T20:34:50.189853+0000","last_active":"2023-07-27T20:34:53.209761+0000","last_peered":"2023-07-27T20:34:53.209761+0000","last_clean":"2023-07-27T20:34:53.209761+0000","last_became_active":"2023-07-27T20:34:50.189179+0000","last_became_peered":"2023-07-27T20:34:50.189179+0000","last_unstale":"2023-07-27T20:34:53.209761+0000","last_undegraded":"2023-07-27T20:34:53.209761+0000","last_fullsized":"2023-07-27T20:34:53.209761+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:16:38.123878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132109+0000","last_change":"2023-07-27T20:34:34.309848+0000","last_active":"2023-07-27T20:34:52.132109+0000","last_peered":"2023-07-27T20:34:52.132109+0000","last_clean":"2023-07-27T20:34:52.132109+0000","last_became_active":"2023-07-27T20:34:34.309567+0000","last_became_peered":"2023-07-27T20:34:34.309567+0000","last_unstale":"2023-07-27T20:34:52.132109+0000","last_undegraded":"2023-07-27T20:34:52.132109+0000","last_fullsized":"2023-07-27T20:34:52.132109+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:26:56.593889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"61'2","reported_seq":23,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.589878+0000","last_change":"2023-07-27T20:34:33.303304+0000","last_active":"2023-07-27T20:34:52.589878+0000","last_peered":"2023-07-27T20:34:52.589878+0000","last_clean":"2023-07-27T20:34:52.589878+0000","last_became_active":"2023-07-27T20:34:33.303051+0000","last_became_peered":"2023-07-27T20:34:33.303051+0000","last_unstale":"2023-07-27T20:34:52.589878+0000","last_undegraded":"2023-07-27T20:34:52.589878+0000","last_fullsized":"2023-07-27T20:34:52.589878+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:19:38.812347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131831+0000","last_change":"2023-07-27T20:34:51.145057+0000","last_active":"2023-07-27T20:34:52.131831+0000","last_peered":"2023-07-27T20:34:52.131831+0000","last_clean":"2023-07-27T20:34:52.131831+0000","last_became_active":"2023-07-27T20:34:51.144291+0000","last_became_peered":"2023-07-27T20:34:51.144291+0000","last_unstale":"2023-07-27T20:34:52.131831+0000","last_undegraded":"2023-07-27T20:34:52.131831+0000","last_fullsized":"2023-07-27T20:34:52.131831+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:20:46.883871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"65'6","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.552994+0000","last_change":"2023-07-27T20:34:50.184498+0000","last_active":"2023-07-27T20:34:53.552994+0000","last_peered":"2023-07-27T20:34:53.552994+0000","last_clean":"2023-07-27T20:34:53.552994+0000","last_became_active":"2023-07-27T20:34:50.184171+0000","last_became_peered":"2023-07-27T20:34:50.184171+0000","last_unstale":"2023-07-27T20:34:53.552994+0000","last_undegraded":"2023-07-27T20:34:53.552994+0000","last_fullsized":"2023-07-27T20:34:53.552994+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:42:35.757873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.552917+0000","last_change":"2023-07-27T20:34:34.297996+0000","last_active":"2023-07-27T20:34:53.552917+0000","last_peered":"2023-07-27T20:34:53.552917+0000","last_clean":"2023-07-27T20:34:53.552917+0000","last_became_active":"2023-07-27T20:34:34.297650+0000","last_became_peered":"2023-07-27T20:34:34.297650+0000","last_unstale":"2023-07-27T20:34:53.552917+0000","last_undegraded":"2023-07-27T20:34:53.552917+0000","last_fullsized":"2023-07-27T20:34:53.552917+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:26:48.653404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209475+0000","last_change":"2023-07-27T20:34:33.307281+0000","last_active":"2023-07-27T20:34:53.209475+0000","last_peered":"2023-07-27T20:34:53.209475+0000","last_clean":"2023-07-27T20:34:53.209475+0000","last_became_active":"2023-07-27T20:34:33.306983+0000","last_became_peered":"2023-07-27T20:34:33.306983+0000","last_unstale":"2023-07-27T20:34:53.209475+0000","last_undegraded":"2023-07-27T20:34:53.209475+0000","last_fullsized":"2023-07-27T20:34:53.209475+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:34:08.093182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389560+0000","last_change":"2023-07-27T20:34:51.154228+0000","last_active":"2023-07-27T20:34:52.389560+0000","last_peered":"2023-07-27T20:34:52.389560+0000","last_clean":"2023-07-27T20:34:52.389560+0000","last_became_active":"2023-07-27T20:34:51.153077+0000","last_became_peered":"2023-07-27T20:34:51.153077+0000","last_unstale":"2023-07-27T20:34:52.389560+0000","last_undegraded":"2023-07-27T20:34:52.389560+0000","last_fullsized":"2023-07-27T20:34:52.389560+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:07:01.033930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210836+0000","last_change":"2023-07-27T20:34:50.197307+0000","last_active":"2023-07-27T20:34:53.210836+0000","last_peered":"2023-07-27T20:34:53.210836+0000","last_clean":"2023-07-27T20:34:53.210836+0000","last_became_active":"2023-07-27T20:34:50.196986+0000","last_became_peered":"2023-07-27T20:34:50.196986+0000","last_unstale":"2023-07-27T20:34:53.210836+0000","last_undegraded":"2023-07-27T20:34:53.210836+0000","last_fullsized":"2023-07-27T20:34:53.210836+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:46:08.321868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130376+0000","last_change":"2023-07-27T20:34:34.317382+0000","last_active":"2023-07-27T20:34:52.130376+0000","last_peered":"2023-07-27T20:34:52.130376+0000","last_clean":"2023-07-27T20:34:52.130376+0000","last_became_active":"2023-07-27T20:34:34.317102+0000","last_became_peered":"2023-07-27T20:34:34.317102+0000","last_unstale":"2023-07-27T20:34:52.130376+0000","last_undegraded":"2023-07-27T20:34:52.130376+0000","last_fullsized":"2023-07-27T20:34:52.130376+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:57:31.656015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.552801+0000","last_change":"2023-07-27T20:34:33.301597+0000","last_active":"2023-07-27T20:34:53.552801+0000","last_peered":"2023-07-27T20:34:53.552801+0000","last_clean":"2023-07-27T20:34:53.552801+0000","last_became_active":"2023-07-27T20:34:33.301302+0000","last_became_peered":"2023-07-27T20:34:33.301302+0000","last_unstale":"2023-07-27T20:34:53.552801+0000","last_undegraded":"2023-07-27T20:34:53.552801+0000","last_fullsized":"2023-07-27T20:34:53.552801+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:03:20.295861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.553421+0000","last_change":"2023-07-27T20:34:51.154405+0000","last_active":"2023-07-27T20:34:53.553421+0000","last_peered":"2023-07-27T20:34:53.553421+0000","last_clean":"2023-07-27T20:34:53.553421+0000","last_became_active":"2023-07-27T20:34:51.152287+0000","last_became_peered":"2023-07-27T20:34:51.152287+0000","last_unstale":"2023-07-27T20:34:53.553421+0000","last_undegraded":"2023-07-27T20:34:53.553421+0000","last_fullsized":"2023-07-27T20:34:53.553421+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:13:02.942523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210022+0000","last_change":"2023-07-27T20:34:50.193278+0000","last_active":"2023-07-27T20:34:53.210022+0000","last_peered":"2023-07-27T20:34:53.210022+0000","last_clean":"2023-07-27T20:34:53.210022+0000","last_became_active":"2023-07-27T20:34:50.192976+0000","last_became_peered":"2023-07-27T20:34:50.192976+0000","last_unstale":"2023-07-27T20:34:53.210022+0000","last_undegraded":"2023-07-27T20:34:53.210022+0000","last_fullsized":"2023-07-27T20:34:53.210022+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:57:43.092086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938650+0000","last_change":"2023-07-27T20:34:34.299216+0000","last_active":"2023-07-27T20:34:52.938650+0000","last_peered":"2023-07-27T20:34:52.938650+0000","last_clean":"2023-07-27T20:34:52.938650+0000","last_became_active":"2023-07-27T20:34:34.298877+0000","last_became_peered":"2023-07-27T20:34:34.298877+0000","last_unstale":"2023-07-27T20:34:52.938650+0000","last_undegraded":"2023-07-27T20:34:52.938650+0000","last_fullsized":"2023-07-27T20:34:52.938650+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:44:42.207766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"61'8","reported_seq":29,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131198+0000","last_change":"2023-07-27T20:34:33.301967+0000","last_active":"2023-07-27T20:34:52.131198+0000","last_peered":"2023-07-27T20:34:52.131198+0000","last_clean":"2023-07-27T20:34:52.131198+0000","last_became_active":"2023-07-27T20:34:33.301702+0000","last_became_peered":"2023-07-27T20:34:33.301702+0000","last_unstale":"2023-07-27T20:34:52.131198+0000","last_undegraded":"2023-07-27T20:34:52.131198+0000","last_fullsized":"2023-07-27T20:34:52.131198+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:18:44.105047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130917+0000","last_change":"2023-07-27T20:34:51.157532+0000","last_active":"2023-07-27T20:34:52.130917+0000","last_peered":"2023-07-27T20:34:52.130917+0000","last_clean":"2023-07-27T20:34:52.130917+0000","last_became_active":"2023-07-27T20:34:51.157253+0000","last_became_peered":"2023-07-27T20:34:51.157253+0000","last_unstale":"2023-07-27T20:34:52.130917+0000","last_undegraded":"2023-07-27T20:34:52.130917+0000","last_fullsized":"2023-07-27T20:34:52.130917+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:48:58.682955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209299+0000","last_change":"2023-07-27T20:34:50.197449+0000","last_active":"2023-07-27T20:34:53.209299+0000","last_peered":"2023-07-27T20:34:53.209299+0000","last_clean":"2023-07-27T20:34:53.209299+0000","last_became_active":"2023-07-27T20:34:50.196997+0000","last_became_peered":"2023-07-27T20:34:50.196997+0000","last_unstale":"2023-07-27T20:34:53.209299+0000","last_undegraded":"2023-07-27T20:34:53.209299+0000","last_fullsized":"2023-07-27T20:34:53.209299+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:55:35.402174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130997+0000","last_change":"2023-07-27T20:34:34.294954+0000","last_active":"2023-07-27T20:34:52.130997+0000","last_peered":"2023-07-27T20:34:52.130997+0000","last_clean":"2023-07-27T20:34:52.130997+0000","last_became_active":"2023-07-27T20:34:34.294073+0000","last_became_peered":"2023-07-27T20:34:34.294073+0000","last_unstale":"2023-07-27T20:34:52.130997+0000","last_undegraded":"2023-07-27T20:34:52.130997+0000","last_fullsized":"2023-07-27T20:34:52.130997+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:47:08.096237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"61'2","reported_seq":23,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210763+0000","last_change":"2023-07-27T20:34:33.308165+0000","last_active":"2023-07-27T20:34:53.210763+0000","last_peered":"2023-07-27T20:34:53.210763+0000","last_clean":"2023-07-27T20:34:53.210763+0000","last_became_active":"2023-07-27T20:34:33.307868+0000","last_became_peered":"2023-07-27T20:34:33.307868+0000","last_unstale":"2023-07-27T20:34:53.210763+0000","last_undegraded":"2023-07-27T20:34:53.210763+0000","last_fullsized":"2023-07-27T20:34:53.210763+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:33:01.060593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209248+0000","last_change":"2023-07-27T20:34:51.151384+0000","last_active":"2023-07-27T20:34:53.209248+0000","last_peered":"2023-07-27T20:34:53.209248+0000","last_clean":"2023-07-27T20:34:53.209248+0000","last_became_active":"2023-07-27T20:34:51.151112+0000","last_became_peered":"2023-07-27T20:34:51.151112+0000","last_unstale":"2023-07-27T20:34:53.209248+0000","last_undegraded":"2023-07-27T20:34:53.209248+0000","last_fullsized":"2023-07-27T20:34:53.209248+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:45:49.617914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131050+0000","last_change":"2023-07-27T20:34:50.190131+0000","last_active":"2023-07-27T20:34:52.131050+0000","last_peered":"2023-07-27T20:34:52.131050+0000","last_clean":"2023-07-27T20:34:52.131050+0000","last_became_active":"2023-07-27T20:34:50.189800+0000","last_became_peered":"2023-07-27T20:34:50.189800+0000","last_unstale":"2023-07-27T20:34:52.131050+0000","last_undegraded":"2023-07-27T20:34:52.131050+0000","last_fullsized":"2023-07-27T20:34:52.131050+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:06:00.701313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.553446+0000","last_change":"2023-07-27T20:34:34.307218+0000","last_active":"2023-07-27T20:34:53.553446+0000","last_peered":"2023-07-27T20:34:53.553446+0000","last_clean":"2023-07-27T20:34:53.553446+0000","last_became_active":"2023-07-27T20:34:34.306781+0000","last_became_peered":"2023-07-27T20:34:34.306781+0000","last_unstale":"2023-07-27T20:34:53.553446+0000","last_undegraded":"2023-07-27T20:34:53.553446+0000","last_fullsized":"2023-07-27T20:34:53.553446+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:55:02.278504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"62'1","reported_seq":22,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.553481+0000","last_change":"2023-07-27T20:34:33.301802+0000","last_active":"2023-07-27T20:34:53.553481+0000","last_peered":"2023-07-27T20:34:53.553481+0000","last_clean":"2023-07-27T20:34:53.553481+0000","last_became_active":"2023-07-27T20:34:33.301453+0000","last_became_peered":"2023-07-27T20:34:33.301453+0000","last_unstale":"2023-07-27T20:34:53.553481+0000","last_undegraded":"2023-07-27T20:34:53.553481+0000","last_fullsized":"2023-07-27T20:34:53.553481+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:06:43.148072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.552694+0000","last_change":"2023-07-27T20:34:51.152536+0000","last_active":"2023-07-27T20:34:53.552694+0000","last_peered":"2023-07-27T20:34:53.552694+0000","last_clean":"2023-07-27T20:34:53.552694+0000","last_became_active":"2023-07-27T20:34:51.152266+0000","last_became_peered":"2023-07-27T20:34:51.152266+0000","last_unstale":"2023-07-27T20:34:53.552694+0000","last_undegraded":"2023-07-27T20:34:53.552694+0000","last_fullsized":"2023-07-27T20:34:53.552694+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:01:54.360533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131077+0000","last_change":"2023-07-27T20:34:50.177951+0000","last_active":"2023-07-27T20:34:52.131077+0000","last_peered":"2023-07-27T20:34:52.131077+0000","last_clean":"2023-07-27T20:34:52.131077+0000","last_became_active":"2023-07-27T20:34:50.177630+0000","last_became_peered":"2023-07-27T20:34:50.177630+0000","last_unstale":"2023-07-27T20:34:52.131077+0000","last_undegraded":"2023-07-27T20:34:52.131077+0000","last_fullsized":"2023-07-27T20:34:52.131077+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:05:48.894914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132549+0000","last_change":"2023-07-27T20:34:34.325646+0000","last_active":"2023-07-27T20:34:52.132549+0000","last_peered":"2023-07-27T20:34:52.132549+0000","last_clean":"2023-07-27T20:34:52.132549+0000","last_became_active":"2023-07-27T20:34:34.325379+0000","last_became_peered":"2023-07-27T20:34:34.325379+0000","last_unstale":"2023-07-27T20:34:52.132549+0000","last_undegraded":"2023-07-27T20:34:52.132549+0000","last_fullsized":"2023-07-27T20:34:52.132549+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:45:22.310599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.939236+0000","last_change":"2023-07-27T20:34:33.297891+0000","last_active":"2023-07-27T20:34:52.939236+0000","last_peered":"2023-07-27T20:34:52.939236+0000","last_clean":"2023-07-27T20:34:52.939236+0000","last_became_active":"2023-07-27T20:34:33.297052+0000","last_became_peered":"2023-07-27T20:34:33.297052+0000","last_unstale":"2023-07-27T20:34:52.939236+0000","last_undegraded":"2023-07-27T20:34:52.939236+0000","last_fullsized":"2023-07-27T20:34:52.939236+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:44:52.958881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130809+0000","last_change":"2023-07-27T20:34:51.143769+0000","last_active":"2023-07-27T20:34:52.130809+0000","last_peered":"2023-07-27T20:34:52.130809+0000","last_clean":"2023-07-27T20:34:52.130809+0000","last_became_active":"2023-07-27T20:34:51.143499+0000","last_became_peered":"2023-07-27T20:34:51.143499+0000","last_unstale":"2023-07-27T20:34:52.130809+0000","last_undegraded":"2023-07-27T20:34:52.130809+0000","last_fullsized":"2023-07-27T20:34:52.130809+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:18:27.673510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131556+0000","last_change":"2023-07-27T20:34:50.179895+0000","last_active":"2023-07-27T20:34:52.131556+0000","last_peered":"2023-07-27T20:34:52.131556+0000","last_clean":"2023-07-27T20:34:52.131556+0000","last_became_active":"2023-07-27T20:34:50.177798+0000","last_became_peered":"2023-07-27T20:34:50.177798+0000","last_unstale":"2023-07-27T20:34:52.131556+0000","last_undegraded":"2023-07-27T20:34:52.131556+0000","last_fullsized":"2023-07-27T20:34:52.131556+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:36:21.810013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.133223+0000","last_change":"2023-07-27T20:34:34.315817+0000","last_active":"2023-07-27T20:34:52.133223+0000","last_peered":"2023-07-27T20:34:52.133223+0000","last_clean":"2023-07-27T20:34:52.133223+0000","last_became_active":"2023-07-27T20:34:34.315521+0000","last_became_peered":"2023-07-27T20:34:34.315521+0000","last_unstale":"2023-07-27T20:34:52.133223+0000","last_undegraded":"2023-07-27T20:34:52.133223+0000","last_fullsized":"2023-07-27T20:34:52.133223+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:08:52.033698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131040+0000","last_change":"2023-07-27T20:34:33.303481+0000","last_active":"2023-07-27T20:34:52.131040+0000","last_peered":"2023-07-27T20:34:52.131040+0000","last_clean":"2023-07-27T20:34:52.131040+0000","last_became_active":"2023-07-27T20:34:33.303145+0000","last_became_peered":"2023-07-27T20:34:33.303145+0000","last_unstale":"2023-07-27T20:34:52.131040+0000","last_undegraded":"2023-07-27T20:34:52.131040+0000","last_fullsized":"2023-07-27T20:34:52.131040+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:21:49.795906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209939+0000","last_change":"2023-07-27T20:34:51.156858+0000","last_active":"2023-07-27T20:34:53.209939+0000","last_peered":"2023-07-27T20:34:53.209939+0000","last_clean":"2023-07-27T20:34:53.209939+0000","last_became_active":"2023-07-27T20:34:51.156411+0000","last_became_peered":"2023-07-27T20:34:51.156411+0000","last_unstale":"2023-07-27T20:34:53.209939+0000","last_undegraded":"2023-07-27T20:34:53.209939+0000","last_fullsized":"2023-07-27T20:34:53.209939+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:54:39.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209799+0000","last_change":"2023-07-27T20:34:50.189144+0000","last_active":"2023-07-27T20:34:53.209799+0000","last_peered":"2023-07-27T20:34:53.209799+0000","last_clean":"2023-07-27T20:34:53.209799+0000","last_became_active":"2023-07-27T20:34:50.188791+0000","last_became_peered":"2023-07-27T20:34:50.188791+0000","last_unstale":"2023-07-27T20:34:53.209799+0000","last_undegraded":"2023-07-27T20:34:53.209799+0000","last_fullsized":"2023-07-27T20:34:53.209799+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:14:26.048681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.939252+0000","last_change":"2023-07-27T20:34:34.304160+0000","last_active":"2023-07-27T20:34:52.939252+0000","last_peered":"2023-07-27T20:34:52.939252+0000","last_clean":"2023-07-27T20:34:52.939252+0000","last_became_active":"2023-07-27T20:34:34.303895+0000","last_became_peered":"2023-07-27T20:34:34.303895+0000","last_unstale":"2023-07-27T20:34:52.939252+0000","last_undegraded":"2023-07-27T20:34:52.939252+0000","last_fullsized":"2023-07-27T20:34:52.939252+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:49:58.678558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938972+0000","last_change":"2023-07-27T20:34:33.308129+0000","last_active":"2023-07-27T20:34:52.938972+0000","last_peered":"2023-07-27T20:34:52.938972+0000","last_clean":"2023-07-27T20:34:52.938972+0000","last_became_active":"2023-07-27T20:34:33.307849+0000","last_became_peered":"2023-07-27T20:34:33.307849+0000","last_unstale":"2023-07-27T20:34:52.938972+0000","last_undegraded":"2023-07-27T20:34:52.938972+0000","last_fullsized":"2023-07-27T20:34:52.938972+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:15:18.373676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131657+0000","last_change":"2023-07-27T20:34:51.145256+0000","last_active":"2023-07-27T20:34:52.131657+0000","last_peered":"2023-07-27T20:34:52.131657+0000","last_clean":"2023-07-27T20:34:52.131657+0000","last_became_active":"2023-07-27T20:34:51.144586+0000","last_became_peered":"2023-07-27T20:34:51.144586+0000","last_unstale":"2023-07-27T20:34:52.131657+0000","last_undegraded":"2023-07-27T20:34:52.131657+0000","last_fullsized":"2023-07-27T20:34:52.131657+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:25:19.538837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210262+0000","last_change":"2023-07-27T20:34:50.197348+0000","last_active":"2023-07-27T20:34:53.210262+0000","last_peered":"2023-07-27T20:34:53.210262+0000","last_clean":"2023-07-27T20:34:53.210262+0000","last_became_active":"2023-07-27T20:34:50.197009+0000","last_became_peered":"2023-07-27T20:34:50.197009+0000","last_unstale":"2023-07-27T20:34:53.210262+0000","last_undegraded":"2023-07-27T20:34:53.210262+0000","last_fullsized":"2023-07-27T20:34:53.210262+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:48:41.949565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209386+0000","last_change":"2023-07-27T20:34:34.323167+0000","last_active":"2023-07-27T20:34:53.209386+0000","last_peered":"2023-07-27T20:34:53.209386+0000","last_clean":"2023-07-27T20:34:53.209386+0000","last_became_active":"2023-07-27T20:34:34.322891+0000","last_became_peered":"2023-07-27T20:34:34.322891+0000","last_unstale":"2023-07-27T20:34:53.209386+0000","last_undegraded":"2023-07-27T20:34:53.209386+0000","last_fullsized":"2023-07-27T20:34:53.209386+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:19:54.428946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590181+0000","last_change":"2023-07-27T20:34:33.303415+0000","last_active":"2023-07-27T20:34:52.590181+0000","last_peered":"2023-07-27T20:34:52.590181+0000","last_clean":"2023-07-27T20:34:52.590181+0000","last_became_active":"2023-07-27T20:34:33.303145+0000","last_became_peered":"2023-07-27T20:34:33.303145+0000","last_unstale":"2023-07-27T20:34:52.590181+0000","last_undegraded":"2023-07-27T20:34:52.590181+0000","last_fullsized":"2023-07-27T20:34:52.590181+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:38:00.398673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131777+0000","last_change":"2023-07-27T20:34:51.149547+0000","last_active":"2023-07-27T20:34:52.131777+0000","last_peered":"2023-07-27T20:34:52.131777+0000","last_clean":"2023-07-27T20:34:52.131777+0000","last_became_active":"2023-07-27T20:34:51.149269+0000","last_became_peered":"2023-07-27T20:34:51.149269+0000","last_unstale":"2023-07-27T20:34:52.131777+0000","last_undegraded":"2023-07-27T20:34:52.131777+0000","last_fullsized":"2023-07-27T20:34:52.131777+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:51:28.367151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"65'2","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590648+0000","last_change":"2023-07-27T20:34:50.182629+0000","last_active":"2023-07-27T20:34:52.590648+0000","last_peered":"2023-07-27T20:34:52.590648+0000","last_clean":"2023-07-27T20:34:52.590648+0000","last_became_active":"2023-07-27T20:34:50.182365+0000","last_became_peered":"2023-07-27T20:34:50.182365+0000","last_unstale":"2023-07-27T20:34:52.590648+0000","last_undegraded":"2023-07-27T20:34:52.590648+0000","last_fullsized":"2023-07-27T20:34:52.590648+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:07:03.745417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590031+0000","last_change":"2023-07-27T20:34:34.298297+0000","last_active":"2023-07-27T20:34:52.590031+0000","last_peered":"2023-07-27T20:34:52.590031+0000","last_clean":"2023-07-27T20:34:52.590031+0000","last_became_active":"2023-07-27T20:34:34.297997+0000","last_became_peered":"2023-07-27T20:34:34.297997+0000","last_unstale":"2023-07-27T20:34:52.590031+0000","last_undegraded":"2023-07-27T20:34:52.590031+0000","last_fullsized":"2023-07-27T20:34:52.590031+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:07:46.697965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131421+0000","last_change":"2023-07-27T20:34:33.301354+0000","last_active":"2023-07-27T20:34:52.131421+0000","last_peered":"2023-07-27T20:34:52.131421+0000","last_clean":"2023-07-27T20:34:52.131421+0000","last_became_active":"2023-07-27T20:34:33.301082+0000","last_became_peered":"2023-07-27T20:34:33.301082+0000","last_unstale":"2023-07-27T20:34:52.131421+0000","last_undegraded":"2023-07-27T20:34:52.131421+0000","last_fullsized":"2023-07-27T20:34:52.131421+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:07:16.899217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132799+0000","last_change":"2023-07-27T20:34:51.155856+0000","last_active":"2023-07-27T20:34:52.132799+0000","last_peered":"2023-07-27T20:34:52.132799+0000","last_clean":"2023-07-27T20:34:52.132799+0000","last_became_active":"2023-07-27T20:34:51.155341+0000","last_became_peered":"2023-07-27T20:34:51.155341+0000","last_unstale":"2023-07-27T20:34:52.132799+0000","last_undegraded":"2023-07-27T20:34:52.132799+0000","last_fullsized":"2023-07-27T20:34:52.132799+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:09:28.611086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590185+0000","last_change":"2023-07-27T20:34:50.188180+0000","last_active":"2023-07-27T20:34:52.590185+0000","last_peered":"2023-07-27T20:34:52.590185+0000","last_clean":"2023-07-27T20:34:52.590185+0000","last_became_active":"2023-07-27T20:34:50.187928+0000","last_became_peered":"2023-07-27T20:34:50.187928+0000","last_unstale":"2023-07-27T20:34:52.590185+0000","last_undegraded":"2023-07-27T20:34:52.590185+0000","last_fullsized":"2023-07-27T20:34:52.590185+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:21:12.020163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209668+0000","last_change":"2023-07-27T20:34:34.321962+0000","last_active":"2023-07-27T20:34:53.209668+0000","last_peered":"2023-07-27T20:34:53.209668+0000","last_clean":"2023-07-27T20:34:53.209668+0000","last_became_active":"2023-07-27T20:34:34.321611+0000","last_became_peered":"2023-07-27T20:34:34.321611+0000","last_unstale":"2023-07-27T20:34:53.209668+0000","last_undegraded":"2023-07-27T20:34:53.209668+0000","last_fullsized":"2023-07-27T20:34:53.209668+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:22:39.571086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209946+0000","last_change":"2023-07-27T20:34:33.305936+0000","last_active":"2023-07-27T20:34:53.209946+0000","last_peered":"2023-07-27T20:34:53.209946+0000","last_clean":"2023-07-27T20:34:53.209946+0000","last_became_active":"2023-07-27T20:34:33.305405+0000","last_became_peered":"2023-07-27T20:34:33.305405+0000","last_unstale":"2023-07-27T20:34:53.209946+0000","last_undegraded":"2023-07-27T20:34:53.209946+0000","last_fullsized":"2023-07-27T20:34:53.209946+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:23:23.259253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938598+0000","last_change":"2023-07-27T20:34:51.148128+0000","last_active":"2023-07-27T20:34:52.938598+0000","last_peered":"2023-07-27T20:34:52.938598+0000","last_clean":"2023-07-27T20:34:52.938598+0000","last_became_active":"2023-07-27T20:34:51.147880+0000","last_became_peered":"2023-07-27T20:34:51.147880+0000","last_unstale":"2023-07-27T20:34:52.938598+0000","last_undegraded":"2023-07-27T20:34:52.938598+0000","last_fullsized":"2023-07-27T20:34:52.938598+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:08:23.239413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938773+0000","last_change":"2023-07-27T20:34:50.189383+0000","last_active":"2023-07-27T20:34:52.938773+0000","last_peered":"2023-07-27T20:34:52.938773+0000","last_clean":"2023-07-27T20:34:52.938773+0000","last_became_active":"2023-07-27T20:34:50.189101+0000","last_became_peered":"2023-07-27T20:34:50.189101+0000","last_unstale":"2023-07-27T20:34:52.938773+0000","last_undegraded":"2023-07-27T20:34:52.938773+0000","last_fullsized":"2023-07-27T20:34:52.938773+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:14:56.646651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132304+0000","last_change":"2023-07-27T20:34:34.306247+0000","last_active":"2023-07-27T20:34:52.132304+0000","last_peered":"2023-07-27T20:34:52.132304+0000","last_clean":"2023-07-27T20:34:52.132304+0000","last_became_active":"2023-07-27T20:34:34.305974+0000","last_became_peered":"2023-07-27T20:34:34.305974+0000","last_unstale":"2023-07-27T20:34:52.132304+0000","last_undegraded":"2023-07-27T20:34:52.132304+0000","last_fullsized":"2023-07-27T20:34:52.132304+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:21:53.819869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"61'1","reported_seq":22,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210672+0000","last_change":"2023-07-27T20:34:33.308128+0000","last_active":"2023-07-27T20:34:53.210672+0000","last_peered":"2023-07-27T20:34:53.210672+0000","last_clean":"2023-07-27T20:34:53.210672+0000","last_became_active":"2023-07-27T20:34:33.307832+0000","last_became_peered":"2023-07-27T20:34:33.307832+0000","last_unstale":"2023-07-27T20:34:53.210672+0000","last_undegraded":"2023-07-27T20:34:53.210672+0000","last_fullsized":"2023-07-27T20:34:53.210672+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:16:26.061594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":96,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210631+0000","last_change":"2023-07-27T20:31:22.846540+0000","last_active":"2023-07-27T20:34:53.210631+0000","last_peered":"2023-07-27T20:34:53.210631+0000","last_clean":"2023-07-27T20:34:53.210631+0000","last_became_active":"2023-07-27T20:31:22.846128+0000","last_became_peered":"2023-07-27T20:31:22.846128+0000","last_unstale":"2023-07-27T20:34:53.210631+0000","last_undegraded":"2023-07-27T20:34:53.210631+0000","last_fullsized":"2023-07-27T20:34:53.210631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:30:22.222415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.552605+0000","last_change":"2023-07-27T20:34:51.149993+0000","last_active":"2023-07-27T20:34:53.552605+0000","last_peered":"2023-07-27T20:34:53.552605+0000","last_clean":"2023-07-27T20:34:53.552605+0000","last_became_active":"2023-07-27T20:34:51.149708+0000","last_became_peered":"2023-07-27T20:34:51.149708+0000","last_unstale":"2023-07-27T20:34:53.552605+0000","last_undegraded":"2023-07-27T20:34:53.552605+0000","last_fullsized":"2023-07-27T20:34:53.552605+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:36:23.226827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.388985+0000","last_change":"2023-07-27T20:34:50.183371+0000","last_active":"2023-07-27T20:34:52.388985+0000","last_peered":"2023-07-27T20:34:52.388985+0000","last_clean":"2023-07-27T20:34:52.388985+0000","last_became_active":"2023-07-27T20:34:50.183044+0000","last_became_peered":"2023-07-27T20:34:50.183044+0000","last_unstale":"2023-07-27T20:34:52.388985+0000","last_undegraded":"2023-07-27T20:34:52.388985+0000","last_fullsized":"2023-07-27T20:34:52.388985+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:08:26.860263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.133069+0000","last_change":"2023-07-27T20:34:34.311641+0000","last_active":"2023-07-27T20:34:52.133069+0000","last_peered":"2023-07-27T20:34:52.133069+0000","last_clean":"2023-07-27T20:34:52.133069+0000","last_became_active":"2023-07-27T20:34:34.311381+0000","last_became_peered":"2023-07-27T20:34:34.311381+0000","last_unstale":"2023-07-27T20:34:52.133069+0000","last_undegraded":"2023-07-27T20:34:52.133069+0000","last_fullsized":"2023-07-27T20:34:52.133069+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:59:38.957572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"61'2","reported_seq":23,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132392+0000","last_change":"2023-07-27T20:34:33.303573+0000","last_active":"2023-07-27T20:34:52.132392+0000","last_peered":"2023-07-27T20:34:52.132392+0000","last_clean":"2023-07-27T20:34:52.132392+0000","last_became_active":"2023-07-27T20:34:33.303293+0000","last_became_peered":"2023-07-27T20:34:33.303293+0000","last_unstale":"2023-07-27T20:34:52.132392+0000","last_undegraded":"2023-07-27T20:34:52.132392+0000","last_fullsized":"2023-07-27T20:34:52.132392+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:18:09.787653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":96,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590595+0000","last_change":"2023-07-27T20:31:22.845641+0000","last_active":"2023-07-27T20:34:52.590595+0000","last_peered":"2023-07-27T20:34:52.590595+0000","last_clean":"2023-07-27T20:34:52.590595+0000","last_became_active":"2023-07-27T20:31:22.845368+0000","last_became_peered":"2023-07-27T20:31:22.845368+0000","last_unstale":"2023-07-27T20:34:52.590595+0000","last_undegraded":"2023-07-27T20:34:52.590595+0000","last_fullsized":"2023-07-27T20:34:52.590595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:49:35.014478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938809+0000","last_change":"2023-07-27T20:34:51.158083+0000","last_active":"2023-07-27T20:34:52.938809+0000","last_peered":"2023-07-27T20:34:52.938809+0000","last_clean":"2023-07-27T20:34:52.938809+0000","last_became_active":"2023-07-27T20:34:51.157594+0000","last_became_peered":"2023-07-27T20:34:51.157594+0000","last_unstale":"2023-07-27T20:34:52.938809+0000","last_undegraded":"2023-07-27T20:34:52.938809+0000","last_fullsized":"2023-07-27T20:34:52.938809+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:53:59.465313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"65'2","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389297+0000","last_change":"2023-07-27T20:34:50.184319+0000","last_active":"2023-07-27T20:34:52.389297+0000","last_peered":"2023-07-27T20:34:52.389297+0000","last_clean":"2023-07-27T20:34:52.389297+0000","last_became_active":"2023-07-27T20:34:50.183566+0000","last_became_peered":"2023-07-27T20:34:50.183566+0000","last_unstale":"2023-07-27T20:34:52.389297+0000","last_undegraded":"2023-07-27T20:34:52.389297+0000","last_fullsized":"2023-07-27T20:34:52.389297+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:43:13.843198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590454+0000","last_change":"2023-07-27T20:34:34.296863+0000","last_active":"2023-07-27T20:34:52.590454+0000","last_peered":"2023-07-27T20:34:52.590454+0000","last_clean":"2023-07-27T20:34:52.590454+0000","last_became_active":"2023-07-27T20:34:34.296556+0000","last_became_peered":"2023-07-27T20:34:34.296556+0000","last_unstale":"2023-07-27T20:34:52.590454+0000","last_undegraded":"2023-07-27T20:34:52.590454+0000","last_fullsized":"2023-07-27T20:34:52.590454+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:46:52.049065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"61'1","reported_seq":22,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210334+0000","last_change":"2023-07-27T20:34:33.303035+0000","last_active":"2023-07-27T20:34:53.210334+0000","last_peered":"2023-07-27T20:34:53.210334+0000","last_clean":"2023-07-27T20:34:53.210334+0000","last_became_active":"2023-07-27T20:34:33.302764+0000","last_became_peered":"2023-07-27T20:34:33.302764+0000","last_unstale":"2023-07-27T20:34:53.210334+0000","last_undegraded":"2023-07-27T20:34:53.210334+0000","last_fullsized":"2023-07-27T20:34:53.210334+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:35:21.613222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":100,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.133263+0000","last_change":"2023-07-27T20:31:22.848025+0000","last_active":"2023-07-27T20:34:52.133263+0000","last_peered":"2023-07-27T20:34:52.133263+0000","last_clean":"2023-07-27T20:34:52.133263+0000","last_became_active":"2023-07-27T20:31:22.847603+0000","last_became_peered":"2023-07-27T20:31:22.847603+0000","last_unstale":"2023-07-27T20:34:52.133263+0000","last_undegraded":"2023-07-27T20:34:52.133263+0000","last_fullsized":"2023-07-27T20:34:52.133263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:26:35.659170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210533+0000","last_change":"2023-07-27T20:34:51.152340+0000","last_active":"2023-07-27T20:34:53.210533+0000","last_peered":"2023-07-27T20:34:53.210533+0000","last_clean":"2023-07-27T20:34:53.210533+0000","last_became_active":"2023-07-27T20:34:51.151332+0000","last_became_peered":"2023-07-27T20:34:51.151332+0000","last_unstale":"2023-07-27T20:34:53.210533+0000","last_undegraded":"2023-07-27T20:34:53.210533+0000","last_fullsized":"2023-07-27T20:34:53.210533+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:43:35.600181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"65'2","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130801+0000","last_change":"2023-07-27T20:34:50.174082+0000","last_active":"2023-07-27T20:34:52.130801+0000","last_peered":"2023-07-27T20:34:52.130801+0000","last_clean":"2023-07-27T20:34:52.130801+0000","last_became_active":"2023-07-27T20:34:50.173729+0000","last_became_peered":"2023-07-27T20:34:50.173729+0000","last_unstale":"2023-07-27T20:34:52.130801+0000","last_undegraded":"2023-07-27T20:34:52.130801+0000","last_fullsized":"2023-07-27T20:34:52.130801+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:42:38.698273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389258+0000","last_change":"2023-07-27T20:34:34.315837+0000","last_active":"2023-07-27T20:34:52.389258+0000","last_peered":"2023-07-27T20:34:52.389258+0000","last_clean":"2023-07-27T20:34:52.389258+0000","last_became_active":"2023-07-27T20:34:34.315452+0000","last_became_peered":"2023-07-27T20:34:34.315452+0000","last_unstale":"2023-07-27T20:34:52.389258+0000","last_undegraded":"2023-07-27T20:34:52.389258+0000","last_fullsized":"2023-07-27T20:34:52.389258+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:34:48.784517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130455+0000","last_change":"2023-07-27T20:34:33.298534+0000","last_active":"2023-07-27T20:34:52.130455+0000","last_peered":"2023-07-27T20:34:52.130455+0000","last_clean":"2023-07-27T20:34:52.130455+0000","last_became_active":"2023-07-27T20:34:33.298170+0000","last_became_peered":"2023-07-27T20:34:33.298170+0000","last_unstale":"2023-07-27T20:34:52.130455+0000","last_undegraded":"2023-07-27T20:34:52.130455+0000","last_fullsized":"2023-07-27T20:34:52.130455+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:42:13.116879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":100,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131167+0000","last_change":"2023-07-27T20:31:22.848181+0000","last_active":"2023-07-27T20:34:52.131167+0000","last_peered":"2023-07-27T20:34:52.131167+0000","last_clean":"2023-07-27T20:34:52.131167+0000","last_became_active":"2023-07-27T20:31:22.847865+0000","last_became_peered":"2023-07-27T20:31:22.847865+0000","last_unstale":"2023-07-27T20:34:52.131167+0000","last_undegraded":"2023-07-27T20:34:52.131167+0000","last_fullsized":"2023-07-27T20:34:52.131167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:25:29.020423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590244+0000","last_change":"2023-07-27T20:34:51.152241+0000","last_active":"2023-07-27T20:34:52.590244+0000","last_peered":"2023-07-27T20:34:52.590244+0000","last_clean":"2023-07-27T20:34:52.590244+0000","last_became_active":"2023-07-27T20:34:51.151898+0000","last_became_peered":"2023-07-27T20:34:51.151898+0000","last_unstale":"2023-07-27T20:34:52.590244+0000","last_undegraded":"2023-07-27T20:34:52.590244+0000","last_fullsized":"2023-07-27T20:34:52.590244+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:45:49.617914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"65'1","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132798+0000","last_change":"2023-07-27T20:34:50.189207+0000","last_active":"2023-07-27T20:34:52.132798+0000","last_peered":"2023-07-27T20:34:52.132798+0000","last_clean":"2023-07-27T20:34:52.132798+0000","last_became_active":"2023-07-27T20:34:50.188918+0000","last_became_peered":"2023-07-27T20:34:50.188918+0000","last_unstale":"2023-07-27T20:34:52.132798+0000","last_undegraded":"2023-07-27T20:34:52.132798+0000","last_fullsized":"2023-07-27T20:34:52.132798+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:50:58.313491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389699+0000","last_change":"2023-07-27T20:34:34.320803+0000","last_active":"2023-07-27T20:34:52.389699+0000","last_peered":"2023-07-27T20:34:52.389699+0000","last_clean":"2023-07-27T20:34:52.389699+0000","last_became_active":"2023-07-27T20:34:34.320444+0000","last_became_peered":"2023-07-27T20:34:34.320444+0000","last_unstale":"2023-07-27T20:34:52.389699+0000","last_undegraded":"2023-07-27T20:34:52.389699+0000","last_fullsized":"2023-07-27T20:34:52.389699+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:55:01.033091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"61'2","reported_seq":23,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209569+0000","last_change":"2023-07-27T20:34:33.306873+0000","last_active":"2023-07-27T20:34:53.209569+0000","last_peered":"2023-07-27T20:34:53.209569+0000","last_clean":"2023-07-27T20:34:53.209569+0000","last_became_active":"2023-07-27T20:34:33.306519+0000","last_became_peered":"2023-07-27T20:34:33.306519+0000","last_unstale":"2023-07-27T20:34:53.209569+0000","last_undegraded":"2023-07-27T20:34:53.209569+0000","last_fullsized":"2023-07-27T20:34:53.209569+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:22:53.344306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":256,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132249+0000","last_change":"2023-07-27T20:31:15.812727+0000","last_active":"2023-07-27T20:34:52.132249+0000","last_peered":"2023-07-27T20:34:52.132249+0000","last_clean":"2023-07-27T20:34:52.132249+0000","last_became_active":"2023-07-27T20:31:15.811803+0000","last_became_peered":"2023-07-27T20:31:15.811803+0000","last_unstale":"2023-07-27T20:34:52.132249+0000","last_undegraded":"2023-07-27T20:34:52.132249+0000","last_fullsized":"2023-07-27T20:34:52.132249+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:14.789257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:14.789257+0000","last_clean_scrub_stamp":"2023-07-27T20:31:14.789257+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:35:24.123835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":94,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.553077+0000","last_change":"2023-07-27T20:31:22.847766+0000","last_active":"2023-07-27T20:34:53.553077+0000","last_peered":"2023-07-27T20:34:53.553077+0000","last_clean":"2023-07-27T20:34:53.553077+0000","last_became_active":"2023-07-27T20:31:22.847396+0000","last_became_peered":"2023-07-27T20:31:22.847396+0000","last_unstale":"2023-07-27T20:34:53.553077+0000","last_undegraded":"2023-07-27T20:34:53.553077+0000","last_fullsized":"2023-07-27T20:34:53.553077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:04:59.538283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131959+0000","last_change":"2023-07-27T20:34:51.149498+0000","last_active":"2023-07-27T20:34:52.131959+0000","last_peered":"2023-07-27T20:34:52.131959+0000","last_clean":"2023-07-27T20:34:52.131959+0000","last_became_active":"2023-07-27T20:34:51.149234+0000","last_became_peered":"2023-07-27T20:34:51.149234+0000","last_unstale":"2023-07-27T20:34:52.131959+0000","last_undegraded":"2023-07-27T20:34:52.131959+0000","last_fullsized":"2023-07-27T20:34:52.131959+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:41:58.386686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"65'1","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210901+0000","last_change":"2023-07-27T20:34:50.193255+0000","last_active":"2023-07-27T20:34:53.210901+0000","last_peered":"2023-07-27T20:34:53.210901+0000","last_clean":"2023-07-27T20:34:53.210901+0000","last_became_active":"2023-07-27T20:34:50.192937+0000","last_became_peered":"2023-07-27T20:34:50.192937+0000","last_unstale":"2023-07-27T20:34:53.210901+0000","last_undegraded":"2023-07-27T20:34:53.210901+0000","last_fullsized":"2023-07-27T20:34:53.210901+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:02:04.097977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389081+0000","last_change":"2023-07-27T20:34:34.320690+0000","last_active":"2023-07-27T20:34:52.389081+0000","last_peered":"2023-07-27T20:34:52.389081+0000","last_clean":"2023-07-27T20:34:52.389081+0000","last_became_active":"2023-07-27T20:34:34.320232+0000","last_became_peered":"2023-07-27T20:34:34.320232+0000","last_unstale":"2023-07-27T20:34:52.389081+0000","last_undegraded":"2023-07-27T20:34:52.389081+0000","last_fullsized":"2023-07-27T20:34:52.389081+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:36:23.221362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.552587+0000","last_change":"2023-07-27T20:34:33.308050+0000","last_active":"2023-07-27T20:34:53.552587+0000","last_peered":"2023-07-27T20:34:53.552587+0000","last_clean":"2023-07-27T20:34:53.552587+0000","last_became_active":"2023-07-27T20:34:33.307761+0000","last_became_peered":"2023-07-27T20:34:33.307761+0000","last_unstale":"2023-07-27T20:34:53.552587+0000","last_undegraded":"2023-07-27T20:34:53.552587+0000","last_fullsized":"2023-07-27T20:34:53.552587+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:08:38.725198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":94,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938324+0000","last_change":"2023-07-27T20:31:22.959811+0000","last_active":"2023-07-27T20:34:52.938324+0000","last_peered":"2023-07-27T20:34:52.938324+0000","last_clean":"2023-07-27T20:34:52.938324+0000","last_became_active":"2023-07-27T20:31:22.959449+0000","last_became_peered":"2023-07-27T20:31:22.959449+0000","last_unstale":"2023-07-27T20:34:52.938324+0000","last_undegraded":"2023-07-27T20:34:52.938324+0000","last_fullsized":"2023-07-27T20:34:52.938324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:33:48.638402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131486+0000","last_change":"2023-07-27T20:34:51.153070+0000","last_active":"2023-07-27T20:34:52.131486+0000","last_peered":"2023-07-27T20:34:52.131486+0000","last_clean":"2023-07-27T20:34:52.131486+0000","last_became_active":"2023-07-27T20:34:51.152803+0000","last_became_peered":"2023-07-27T20:34:51.152803+0000","last_unstale":"2023-07-27T20:34:52.131486+0000","last_undegraded":"2023-07-27T20:34:52.131486+0000","last_fullsized":"2023-07-27T20:34:52.131486+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:53:08.452027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130786+0000","last_change":"2023-07-27T20:34:50.180986+0000","last_active":"2023-07-27T20:34:52.130786+0000","last_peered":"2023-07-27T20:34:52.130786+0000","last_clean":"2023-07-27T20:34:52.130786+0000","last_became_active":"2023-07-27T20:34:50.180736+0000","last_became_peered":"2023-07-27T20:34:50.180736+0000","last_unstale":"2023-07-27T20:34:52.130786+0000","last_undegraded":"2023-07-27T20:34:52.130786+0000","last_fullsized":"2023-07-27T20:34:52.130786+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:19:41.640145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389603+0000","last_change":"2023-07-27T20:34:34.301811+0000","last_active":"2023-07-27T20:34:52.389603+0000","last_peered":"2023-07-27T20:34:52.389603+0000","last_clean":"2023-07-27T20:34:52.389603+0000","last_became_active":"2023-07-27T20:34:34.301525+0000","last_became_peered":"2023-07-27T20:34:34.301525+0000","last_unstale":"2023-07-27T20:34:52.389603+0000","last_undegraded":"2023-07-27T20:34:52.389603+0000","last_fullsized":"2023-07-27T20:34:52.389603+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:31:19.688642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209626+0000","last_change":"2023-07-27T20:34:33.301467+0000","last_active":"2023-07-27T20:34:53.209626+0000","last_peered":"2023-07-27T20:34:53.209626+0000","last_clean":"2023-07-27T20:34:53.209626+0000","last_became_active":"2023-07-27T20:34:33.301160+0000","last_became_peered":"2023-07-27T20:34:33.301160+0000","last_unstale":"2023-07-27T20:34:53.209626+0000","last_undegraded":"2023-07-27T20:34:53.209626+0000","last_fullsized":"2023-07-27T20:34:53.209626+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:06:46.866407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":94,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.553162+0000","last_change":"2023-07-27T20:31:22.849178+0000","last_active":"2023-07-27T20:34:53.553162+0000","last_peered":"2023-07-27T20:34:53.553162+0000","last_clean":"2023-07-27T20:34:53.553162+0000","last_became_active":"2023-07-27T20:31:22.848856+0000","last_became_peered":"2023-07-27T20:31:22.848856+0000","last_unstale":"2023-07-27T20:34:53.553162+0000","last_undegraded":"2023-07-27T20:34:53.553162+0000","last_fullsized":"2023-07-27T20:34:53.553162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:33:11.770874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.552958+0000","last_change":"2023-07-27T20:34:51.149654+0000","last_active":"2023-07-27T20:34:53.552958+0000","last_peered":"2023-07-27T20:34:53.552958+0000","last_clean":"2023-07-27T20:34:53.552958+0000","last_became_active":"2023-07-27T20:34:51.149343+0000","last_became_peered":"2023-07-27T20:34:51.149343+0000","last_unstale":"2023-07-27T20:34:53.552958+0000","last_undegraded":"2023-07-27T20:34:53.552958+0000","last_fullsized":"2023-07-27T20:34:53.552958+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:07:01.236721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.939101+0000","last_change":"2023-07-27T20:34:50.184967+0000","last_active":"2023-07-27T20:34:52.939101+0000","last_peered":"2023-07-27T20:34:52.939101+0000","last_clean":"2023-07-27T20:34:52.939101+0000","last_became_active":"2023-07-27T20:34:50.184725+0000","last_became_peered":"2023-07-27T20:34:50.184725+0000","last_unstale":"2023-07-27T20:34:52.939101+0000","last_undegraded":"2023-07-27T20:34:52.939101+0000","last_fullsized":"2023-07-27T20:34:52.939101+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:51:53.872027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.939161+0000","last_change":"2023-07-27T20:34:34.296711+0000","last_active":"2023-07-27T20:34:52.939161+0000","last_peered":"2023-07-27T20:34:52.939161+0000","last_clean":"2023-07-27T20:34:52.939161+0000","last_became_active":"2023-07-27T20:34:34.296442+0000","last_became_peered":"2023-07-27T20:34:34.296442+0000","last_unstale":"2023-07-27T20:34:52.939161+0000","last_undegraded":"2023-07-27T20:34:52.939161+0000","last_fullsized":"2023-07-27T20:34:52.939161+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:31:45.437223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132712+0000","last_change":"2023-07-27T20:34:33.304301+0000","last_active":"2023-07-27T20:34:52.132712+0000","last_peered":"2023-07-27T20:34:52.132712+0000","last_clean":"2023-07-27T20:34:52.132712+0000","last_became_active":"2023-07-27T20:34:33.303739+0000","last_became_peered":"2023-07-27T20:34:33.303739+0000","last_unstale":"2023-07-27T20:34:52.132712+0000","last_undegraded":"2023-07-27T20:34:52.132712+0000","last_fullsized":"2023-07-27T20:34:52.132712+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:34:53.026886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":96,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590657+0000","last_change":"2023-07-27T20:31:22.848698+0000","last_active":"2023-07-27T20:34:52.590657+0000","last_peered":"2023-07-27T20:34:52.590657+0000","last_clean":"2023-07-27T20:34:52.590657+0000","last_became_active":"2023-07-27T20:31:22.848346+0000","last_became_peered":"2023-07-27T20:31:22.848346+0000","last_unstale":"2023-07-27T20:34:52.590657+0000","last_undegraded":"2023-07-27T20:34:52.590657+0000","last_fullsized":"2023-07-27T20:34:52.590657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:19:42.901336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":4059,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28396,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343444,"statfs":{"total":96636764160,"available":96607686656,"internally_reserved":0,"allocated":1404928,"data_stored":980051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.75800000000000001,"15min":0.80300000000000005},"min":{"1min":0.42499999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90000000000000002,"5min":3.5609999999999999,"15min":3.5609999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.70799999999999996,"15min":0.72699999999999998},"min":{"1min":0.39500000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88800000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.58199999999999996}]},{"osd":1,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.69599999999999995,"15min":0.71599999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.84999999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.81000000000000005,"15min":0.86399999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.86699999999999999,"5min":3.927,"15min":3.927},"last":0.65200000000000002}]},{"osd":2,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.80200000000000005,"15min":0.84099999999999997},"min":{"1min":0.47099999999999997,"5min":0.443,"15min":0.443},"max":{"1min":0.86699999999999999,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.76500000000000001,"15min":0.80900000000000005},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85799999999999998,"5min":2.093,"15min":2.093},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.76000000000000001,"15min":0.81200000000000006},"min":{"1min":0.46000000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.76600000000000001,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.85099999999999998,"15min":0.90100000000000002},"min":{"1min":0.57399999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.94099999999999995,"5min":3.1080000000000001,"15min":3.1080000000000001},"last":0.88500000000000001}]},{"osd":4,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.754,"15min":0.78800000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.91100000000000003,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.79800000000000004,"15min":0.83399999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.85799999999999998,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.80400000000000005}]},{"osd":5,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.90600000000000003,"15min":0.999},"min":{"1min":0.47899999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.91400000000000003,"5min":6.1619999999999999,"15min":6.1619999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.94299999999999995,"15min":1.042},"min":{"1min":0.432,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96499999999999997,"5min":6.2729999999999997,"15min":6.2729999999999997},"last":0.74199999999999999}]},{"osd":6,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.81799999999999995,"15min":0.84599999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.075,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.84699999999999998,"15min":0.90500000000000003},"min":{"1min":0.52900000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93799999999999994,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":0.83099999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":389783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.67700000000000005,"15min":0.68899999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.871,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.66300000000000003,"15min":0.66800000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.85499999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.746}]},{"osd":1,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69999999999999996,"15min":0.72199999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84399999999999997,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70099999999999996,"15min":0.70799999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.85499999999999998,"5min":1.266,"15min":1.266},"last":0.60199999999999998}]},{"osd":2,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.69499999999999995,"15min":0.71799999999999997},"min":{"1min":0.51100000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83899999999999997,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.747,"15min":0.76300000000000001},"min":{"1min":0.56499999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.90200000000000002,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.86299999999999999}]},{"osd":3,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.72899999999999998,"15min":0.745},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.84199999999999997,"5min":1.377,"15min":1.377},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.73299999999999998,"15min":0.75700000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92800000000000005,"5min":1.736,"15min":1.736},"last":0.90000000000000002}]},{"osd":4,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69599999999999995,"15min":0.69799999999999995},"min":{"1min":0.47099999999999997,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90300000000000002,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":1.012},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69699999999999995,"15min":0.69299999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.95599999999999996,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.81699999999999995}]},{"osd":5,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.67100000000000004,"15min":0.66500000000000004},"min":{"1min":0.47799999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.88600000000000001,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":1.117},{"interface":"front","average":{"1min":0.748,"5min":0.74099999999999999,"15min":0.73199999999999998},"min":{"1min":0.45100000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93700000000000006,"5min":1.081,"15min":1.081},"last":1.0629999999999999}]},{"osd":7,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.749,"15min":0.753},"min":{"1min":0.496,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.94699999999999995,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.878},{"interface":"front","average":{"1min":0.753,"5min":0.73999999999999999,"15min":0.73599999999999999},"min":{"1min":0.59499999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97599999999999998,"5min":1.119,"15min":1.119},"last":0.99099999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":831488,"data_stored":393068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40899999999999997,"15min":0.40600000000000003},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47199999999999998,"15min":0.47899999999999998},"min":{"1min":0.32300000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44,"15min":0.436},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.375},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.47599999999999998,"15min":0.47399999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53400000000000003,"15min":0.53200000000000003},"min":{"1min":0.39400000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.502,"15min":0.504},"min":{"1min":0.374,"5min":0.31,"15min":0.31},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.437}]},{"osd":4,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73499999999999999,"15min":0.745},"min":{"1min":0.56699999999999995,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73599999999999999,"15min":0.73199999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.752}]},{"osd":5,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72299999999999998,"15min":0.73199999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.76200000000000001,"15min":0.75700000000000001},"min":{"1min":0.623,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.9630000000000001,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.77500000000000002,"15min":0.79500000000000004},"min":{"1min":0.53600000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1419999999999999,"5min":1.347,"15min":1.347},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.80400000000000005,"15min":0.81999999999999995},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.206,"5min":1.409,"15min":1.409},"last":0.78900000000000003}]},{"osd":7,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.77100000000000002,"15min":0.77700000000000002},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.95099999999999996,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78800000000000003,"15min":0.80300000000000005},"min":{"1min":0.55400000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.68999999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28384,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343456,"statfs":{"total":96636764160,"available":96607698944,"internally_reserved":0,"allocated":1396736,"data_stored":979399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.38700000000000001,"15min":0.39100000000000001},"min":{"1min":0.27700000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.46000000000000002,"15min":0.46400000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47999999999999998,"15min":0.48899999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.60399999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.439,"5min":0.44800000000000001,"15min":0.45400000000000001},"min":{"1min":0.34200000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.44800000000000001}]},{"osd":3,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46600000000000003,"15min":0.47099999999999997},"min":{"1min":0.35299999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.65900000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53200000000000003,"15min":0.54200000000000004},"min":{"1min":0.40699999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.63400000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.63300000000000001}]},{"osd":4,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70499999999999996,"15min":0.71199999999999997},"min":{"1min":0.55900000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0529999999999999,"5min":1.069,"15min":1.069},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.71799999999999997,"15min":0.73199999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97799999999999998,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.61599999999999999}]},{"osd":5,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.73099999999999998,"15min":0.745},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.90000000000000002,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.73499999999999999,"15min":0.751},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0940000000000001,"5min":1.196,"15min":1.196},"last":0.71899999999999997}]},{"osd":6,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.72199999999999998,"15min":0.73599999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0129999999999999,"5min":1.05,"15min":1.05},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.755,"15min":0.77600000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.88400000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.69999999999999996}]},{"osd":7,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.752,"15min":0.76900000000000002},"min":{"1min":0.54800000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.755,"15min":0.77200000000000002},"min":{"1min":0.58199999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.68500000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":815104,"data_stored":392840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45700000000000002,"15min":0.48099999999999998},"min":{"1min":0.29799999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.54700000000000004,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.624,"15min":0.70999999999999996},"min":{"1min":0.32500000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70099999999999996,"5min":3.2999999999999998,"15min":3.2999999999999998},"last":0.65000000000000002}]},{"osd":1,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.56000000000000005,"15min":0.61499999999999999},"min":{"1min":0.309,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.67200000000000004,"5min":3.0600000000000001,"15min":3.0600000000000001},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.60999999999999999,"15min":0.67000000000000004},"min":{"1min":0.36499999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.623,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.42199999999999999}]},{"osd":3,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.86399999999999999,"15min":1.036},"min":{"1min":0.40000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72099999999999997,"5min":9.2200000000000006,"15min":9.2200000000000006},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.57099999999999995,"15min":0.59499999999999997},"min":{"1min":0.40799999999999997,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.66600000000000004,"5min":1.552,"15min":1.552},"last":0.47299999999999998}]},{"osd":4,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.85999999999999999,"15min":0.92600000000000005},"min":{"1min":0.52200000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0049999999999999,"5min":4.2930000000000001,"15min":4.2930000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.75600000000000001,"15min":0.77900000000000003},"min":{"1min":0.55400000000000005,"5min":0.499,"15min":0.499},"max":{"1min":0.93999999999999995,"5min":1.24,"15min":1.24},"last":0.72299999999999998}]},{"osd":5,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.754,"15min":0.76900000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98399999999999999,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.84699999999999998,"15min":0.90700000000000003},"min":{"1min":0.53800000000000003,"5min":0.5,"15min":0.5},"max":{"1min":0.90700000000000003,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.746}]},{"osd":6,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.88300000000000001,"15min":0.94399999999999995},"min":{"1min":0.55300000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.024,"5min":3.3999999999999999,"15min":3.3999999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.91300000000000003,"15min":0.99099999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.97199999999999998,"5min":3.4990000000000001,"15min":3.4990000000000001},"last":0.77000000000000002}]},{"osd":7,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.81100000000000005,"15min":0.84499999999999997},"min":{"1min":0.58199999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.95199999999999996,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.86099999999999999,"15min":0.89700000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.95999999999999996,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.83099999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":390673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.44900000000000001,"15min":0.47099999999999997},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.626,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.621},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.51600000000000001,"15min":0.54400000000000004},"min":{"1min":0.309,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.627,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":0.42199999999999999}]},{"osd":1,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.47699999999999998,"15min":0.5},"min":{"1min":0.33400000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.55400000000000005,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.52900000000000003,"15min":0.56699999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.63,"5min":1.788,"15min":1.788},"last":0.58199999999999996}]},{"osd":2,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.56200000000000006,"15min":0.59199999999999997},"min":{"1min":0.41699999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.73299999999999998,"5min":2.117,"15min":2.117},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59999999999999998,"15min":0.63400000000000001},"min":{"1min":0.42999999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.68400000000000005,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.64700000000000002}]},{"osd":4,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71899999999999997,"15min":0.72199999999999998},"min":{"1min":0.53800000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0249999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.79000000000000004,"15min":0.81399999999999995},"min":{"1min":0.53000000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.95199999999999996,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.71899999999999997}]},{"osd":5,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.72499999999999998,"15min":0.73299999999999998},"min":{"1min":0.505,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92200000000000004,"5min":1.125,"15min":1.125},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.79400000000000004,"15min":0.82799999999999996},"min":{"1min":0.54200000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0569999999999999,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.75700000000000001}]},{"osd":6,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.78600000000000003,"15min":0.81299999999999994},"min":{"1min":0.59199999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93100000000000005,"5min":1.758,"15min":1.758},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.80900000000000005,"15min":0.83499999999999996},"min":{"1min":0.55000000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.095,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.60599999999999998}]},{"osd":7,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.81599999999999995,"15min":0.84799999999999998},"min":{"1min":0.55400000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0289999999999999,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.75800000000000001,"15min":0.76700000000000002},"min":{"1min":0.59099999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.99199999999999999,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.73799999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":389067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.69699999999999995,"15min":0.69799999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.84299999999999997,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70699999999999996,"15min":0.71199999999999997},"min":{"1min":0.53900000000000003,"5min":0.5,"15min":0.5},"max":{"1min":0.86499999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.52200000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.874,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73499999999999999,"15min":0.73799999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88900000000000001,"5min":1.002,"15min":1.002},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.67500000000000004,"15min":0.66900000000000004},"min":{"1min":0.504,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81899999999999995,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68899999999999995,"15min":0.69499999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.93700000000000006,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.54100000000000004}]},{"osd":3,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.73099999999999998,"15min":0.751},"min":{"1min":0.49299999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91300000000000003,"5min":1.645,"15min":1.645},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.747,"15min":0.75900000000000001},"min":{"1min":0.51700000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96899999999999997,"5min":1.708,"15min":1.708},"last":0.46200000000000002}]},{"osd":5,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61799999999999999,"15min":0.61699999999999999},"min":{"1min":0.41499999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84499999999999997,"5min":1.113,"15min":1.113},"last":0.499},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68799999999999994,"15min":0.69499999999999995},"min":{"1min":0.502,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91200000000000003,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.78500000000000003}]},{"osd":6,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70599999999999996,"15min":0.70699999999999996},"min":{"1min":0.48299999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.92100000000000004,"5min":1.127,"15min":1.127},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.74099999999999999,"15min":0.74199999999999999},"min":{"1min":0.442,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0009999999999999,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.76700000000000002}]},{"osd":7,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.54700000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.98499999999999999,"5min":1.198,"15min":1.198},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.81299999999999994,"15min":0.81699999999999995},"min":{"1min":0.65300000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":0.96299999999999997,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.80800000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574896,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":390673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.65300000000000002,"15min":0.629},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.85499999999999998,"5min":4.0510000000000002,"15min":4.0510000000000002},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.71299999999999997,"15min":0.67900000000000005},"min":{"1min":0.39300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.94899999999999995,"5min":6.431,"15min":6.431},"last":0.71999999999999997}]},{"osd":1,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.68300000000000005,"15min":0.65500000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.91300000000000003,"5min":5.3330000000000002,"15min":5.3330000000000002},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.69499999999999995,"15min":0.67100000000000004},"min":{"1min":0.47299999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.81299999999999994,"5min":4.2169999999999996,"15min":4.2169999999999996},"last":0.66300000000000003}]},{"osd":2,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.70699999999999996,"15min":0.66500000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.94799999999999995,"5min":6.4850000000000003,"15min":6.4850000000000003},"last":0.627},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.68200000000000005,"15min":0.66200000000000003},"min":{"1min":0.48099999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.80800000000000005,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":0.80800000000000005}]},{"osd":3,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.749,"15min":0.73899999999999999},"min":{"1min":0.44900000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89500000000000002,"5min":4.7809999999999997,"15min":4.7809999999999997},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.76100000000000001,"15min":0.73799999999999999},"min":{"1min":0.55100000000000005,"5min":0.503,"15min":0.503},"max":{"1min":0.86299999999999999,"5min":5.423,"15min":5.423},"last":0.86799999999999999}]},{"osd":4,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.67200000000000004,"15min":0.65500000000000003},"min":{"1min":0.432,"5min":0.375,"15min":0.375},"max":{"1min":0.879,"5min":3.988,"15min":3.988},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.749,"15min":0.72699999999999998},"min":{"1min":0.46100000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.84599999999999997,"5min":4.827,"15min":4.827},"last":0.77600000000000002}]},{"osd":6,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.77800000000000002,"15min":0.73199999999999998},"min":{"1min":0.53600000000000003,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.92000000000000004,"5min":7.7000000000000002,"15min":7.7000000000000002},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.75,"15min":0.72799999999999998},"min":{"1min":0.53000000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91900000000000004,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.83199999999999996,"15min":0.78000000000000003},"min":{"1min":0.52300000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.91900000000000004,"5min":9.1180000000000003,"15min":9.1180000000000003},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.82699999999999996,"15min":0.80100000000000005},"min":{"1min":0.53700000000000003,"5min":0.505,"15min":0.505},"max":{"1min":0.91900000000000004,"5min":5.2880000000000003,"15min":5.2880000000000003},"last":0.89200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T20:34:56.631 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-27T20:34:56.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.865+0000 7fd9f4fff700 1 Processor -- start 2023-07-27T20:34:56.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.865+0000 7fd9f4fff700 1 -- start start 2023-07-27T20:34:56.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.866+0000 7fd9f4fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd9f014dca0 0x7fd9f006d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:56.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.866+0000 7fd9f4fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd9f0071f20 0x7fd9f006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:56.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.866+0000 7fd9f4fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9f0153ae0 con 0x7fd9f00c2360 2023-07-27T20:34:56.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.866+0000 7fd9f4fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9f0154760 con 0x7fd9f014dca0 2023-07-27T20:34:56.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.866+0000 7fd9f4fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f0153dc0 con 0x7fd9f0071f20 2023-07-27T20:34:56.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.866+0000 7fd9ee59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd9f00c2360 0x7fd9f014d590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54028/0 (socket says 172.21.15.72:54028) 2023-07-27T20:34:56.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.866+0000 7fd9ee59c700 1 -- 172.21.15.72:0/2675683932 learned_addr learned my addr 172.21.15.72:0/2675683932 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:56.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.866+0000 7fd9edd9b700 1 --2- 172.21.15.72:0/2675683932 >> v2:172.21.15.72:3300/0 conn(0x7fd9f014dca0 0x7fd9f006d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:56.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.867+0000 7fd9eed9d700 1 --2- 172.21.15.72:0/2675683932 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd9f0071f20 0x7fd9f006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:56.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.867+0000 7fd9edd9b700 1 -- 172.21.15.72:0/2675683932 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd9f0071f20 msgr2=0x7fd9f006d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:56.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.867+0000 7fd9edd9b700 1 --2- 172.21.15.72:0/2675683932 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd9f0071f20 0x7fd9f006d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:56.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.867+0000 7fd9edd9b700 1 -- 172.21.15.72:0/2675683932 >> v1:172.21.15.72:6789/0 conn(0x7fd9f00c2360 legacy=0x7fd9f014d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:56.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.867+0000 7fd9edd9b700 1 -- 172.21.15.72:0/2675683932 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f01540a0 con 0x7fd9f014dca0 2023-07-27T20:34:56.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.867+0000 7fd9ed59a700 1 -- 172.21.15.72:0/2675683932 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2456042366 0 0) 0x7fd9f0153ae0 con 0x7fd9f00c2360 2023-07-27T20:34:56.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.867+0000 7fd9edd9b700 1 --2- 172.21.15.72:0/2675683932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9f014dca0 0x7fd9f006d270 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4009840 tx=0x7fd9e4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=769ad455036aa179 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:56.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.867+0000 7fd9ed59a700 1 -- 172.21.15.72:0/2675683932 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e4011830 con 0x7fd9f014dca0 2023-07-27T20:34:56.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.868+0000 7fd9ed59a700 1 -- 172.21.15.72:0/2675683932 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e4011990 con 0x7fd9f014dca0 2023-07-27T20:34:56.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.868+0000 7fd9ed59a700 1 -- 172.21.15.72:0/2675683932 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e4011d20 con 0x7fd9f014dca0 2023-07-27T20:34:56.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.868+0000 7fd9f4fff700 1 -- 172.21.15.72:0/2675683932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9f014dca0 msgr2=0x7fd9f006d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:56.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.868+0000 7fd9f4fff700 1 --2- 172.21.15.72:0/2675683932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9f014dca0 0x7fd9f006d270 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4009840 tx=0x7fd9e4009b50 comp rx=0 tx=0).stop 2023-07-27T20:34:56.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.868+0000 7fd9f4fff700 1 -- 172.21.15.72:0/2675683932 shutdown_connections 2023-07-27T20:34:56.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.868+0000 7fd9f4fff700 1 --2- 172.21.15.72:0/2675683932 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd9f0071f20 0x7fd9f006d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:56.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.868+0000 7fd9f4fff700 1 --2- 172.21.15.72:0/2675683932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9f014dca0 0x7fd9f006d270 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:56.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.868+0000 7fd9f4fff700 1 -- 172.21.15.72:0/2675683932 >> 172.21.15.72:0/2675683932 conn(0x7fd9f00a7b40 msgr2=0x7fd9f006a190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:56.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.868+0000 7fd9f4fff700 1 -- 172.21.15.72:0/2675683932 shutdown_connections 2023-07-27T20:34:56.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.868+0000 7fd9f4fff700 1 -- 172.21.15.72:0/2675683932 wait complete. 2023-07-27T20:34:56.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.870+0000 7fd9f4fff700 1 Processor -- start 2023-07-27T20:34:56.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.870+0000 7fd9f4fff700 1 -- start start 2023-07-27T20:34:56.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.871+0000 7fd9f4fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd9f0071f20 0x7fd9f0144510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:56.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.871+0000 7fd9f4fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9f00c2360 0x7fd9f01e9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:56.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.871+0000 7fd9f4fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9f014dca0 0x7fd9f0142130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:56.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.871+0000 7fd9f4fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f0148ec0 con 0x7fd9f00c2360 2023-07-27T20:34:56.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.871+0000 7fd9f4fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f0147b90 con 0x7fd9f014dca0 2023-07-27T20:34:56.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.871+0000 7fd9f4fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f0144f90 con 0x7fd9f0071f20 2023-07-27T20:34:56.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.871+0000 7fd9edd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9f00c2360 0x7fd9f01e9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:56.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.871+0000 7fd9edd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9f00c2360 0x7fd9f01e9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48442/0 (socket says 172.21.15.72:48442) 2023-07-27T20:34:56.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.871+0000 7fd9edd9b700 1 -- 172.21.15.72:0/1673600227 learned_addr learned my addr 172.21.15.72:0/1673600227 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:56.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.871+0000 7fd9ee59c700 1 --2- 172.21.15.72:0/1673600227 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd9f0071f20 0x7fd9f0144510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:56.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.871+0000 7fd9eed9d700 1 --2- 172.21.15.72:0/1673600227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9f014dca0 0x7fd9f0142130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:56.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.872+0000 7fd9edd9b700 1 -- 172.21.15.72:0/1673600227 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd9f0071f20 msgr2=0x7fd9f0144510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:56.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.872+0000 7fd9edd9b700 1 --2- 172.21.15.72:0/1673600227 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd9f0071f20 0x7fd9f0144510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:56.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.872+0000 7fd9edd9b700 1 -- 172.21.15.72:0/1673600227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9f014dca0 msgr2=0x7fd9f0142130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:56.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.872+0000 7fd9edd9b700 1 --2- 172.21.15.72:0/1673600227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9f014dca0 0x7fd9f0142130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:56.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.872+0000 7fd9edd9b700 1 -- 172.21.15.72:0/1673600227 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e40094a0 con 0x7fd9f00c2360 2023-07-27T20:34:56.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.872+0000 7fd9ee59c700 1 --2- 172.21.15.72:0/1673600227 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd9f0071f20 0x7fd9f0144510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:56.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.872+0000 7fd9edd9b700 1 --2- 172.21.15.72:0/1673600227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9f00c2360 0x7fd9f01e9b20 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fd9e40090b0 tx=0x7fd9e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:56.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.872+0000 7fd9deffd700 1 -- 172.21.15.72:0/1673600227 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e40036a0 con 0x7fd9f00c2360 2023-07-27T20:34:56.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.872+0000 7fd9deffd700 1 -- 172.21.15.72:0/1673600227 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e401f070 con 0x7fd9f00c2360 2023-07-27T20:34:56.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.872+0000 7fd9f4fff700 1 -- 172.21.15.72:0/1673600227 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9f01eddf0 con 0x7fd9f00c2360 2023-07-27T20:34:56.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.872+0000 7fd9deffd700 1 -- 172.21.15.72:0/1673600227 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e4003a40 con 0x7fd9f00c2360 2023-07-27T20:34:56.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.872+0000 7fd9f4fff700 1 -- 172.21.15.72:0/1673600227 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9f0148080 con 0x7fd9f00c2360 2023-07-27T20:34:56.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.873+0000 7fd9f4fff700 1 -- 172.21.15.72:0/1673600227 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9f00bb960 con 0x7fd9f00c2360 2023-07-27T20:34:56.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.874+0000 7fd9deffd700 1 -- 172.21.15.72:0/1673600227 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd9e4003ba0 con 0x7fd9f00c2360 2023-07-27T20:34:56.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.875+0000 7fd9deffd700 1 --2- 172.21.15.72:0/1673600227 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd9d006ace0 0x7fd9d006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:56.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.875+0000 7fd9deffd700 1 -- 172.21.15.72:0/1673600227 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7238+0+0 (secure 0 0 0) 0x7fd9e4021070 con 0x7fd9f00c2360 2023-07-27T20:34:56.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.875+0000 7fd9ee59c700 1 --2- 172.21.15.72:0/1673600227 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd9d006ace0 0x7fd9d006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:56.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.876+0000 7fd9ee59c700 1 --2- 172.21.15.72:0/1673600227 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd9d006ace0 0x7fd9d006d1a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0000f60 tx=0x7fd9e0007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:56.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:56.879+0000 7fd9deffd700 1 -- 172.21.15.72:0/1673600227 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd9e4055d70 con 0x7fd9f00c2360 2023-07-27T20:34:57.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.149+0000 7fd9f4fff700 1 -- 172.21.15.72:0/1673600227 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd9f004e470 con 0x7fd9f00c2360 2023-07-27T20:34:57.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.150+0000 7fd9deffd700 1 -- 172.21.15.72:0/1673600227 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1374 (secure 0 0 0) 0x7fd9e4059390 con 0x7fd9f00c2360 2023-07-27T20:34:57.138 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:34:57.139 INFO:teuthology.orchestra.run.smithi072.stdout:{"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":235,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":66,"num_osds":8,"num_up_osds":8,"osd_up_since":1690489873,"num_in_osds":8,"osd_in_since":1690489864,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105},{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32}],"num_pgs":201,"num_pools":6,"num_objects":24,"data_bytes":594427,"bytes_used":228671488,"bytes_avail":772865441792,"bytes_total":773094113280,"unknown_pgs_ratio":0.31840795278549194,"inactive_pgs_ratio":0.15920397639274597},"fsmap":{"epoch":38,"id":4,"up":1,"in":1,"max":1,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"c","status":"up:active","gid":6333},{"filesystem_id":4,"rank":0,"name":"b","status":"up:active","gid":6336}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2023-07-27T20:34:04.566674+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-27T20:34:57.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.152+0000 7fd9f4fff700 1 -- 172.21.15.72:0/1673600227 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd9d006ace0 msgr2=0x7fd9d006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:57.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.152+0000 7fd9f4fff700 1 --2- 172.21.15.72:0/1673600227 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd9d006ace0 0x7fd9d006d1a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0000f60 tx=0x7fd9e0007d30 comp rx=0 tx=0).stop 2023-07-27T20:34:57.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.152+0000 7fd9f4fff700 1 -- 172.21.15.72:0/1673600227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9f00c2360 msgr2=0x7fd9f01e9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:57.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.152+0000 7fd9f4fff700 1 --2- 172.21.15.72:0/1673600227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9f00c2360 0x7fd9f01e9b20 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fd9e40090b0 tx=0x7fd9e4004750 comp rx=0 tx=0).stop 2023-07-27T20:34:57.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.152+0000 7fd9f4fff700 1 -- 172.21.15.72:0/1673600227 shutdown_connections 2023-07-27T20:34:57.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.152+0000 7fd9f4fff700 1 --2- 172.21.15.72:0/1673600227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9f014dca0 0x7fd9f0142130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:57.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.153+0000 7fd9f4fff700 1 --2- 172.21.15.72:0/1673600227 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd9d006ace0 0x7fd9d006d1a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:57.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.153+0000 7fd9f4fff700 1 --2- 172.21.15.72:0/1673600227 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd9f0071f20 0x7fd9f0144510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:57.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.153+0000 7fd9f4fff700 1 --2- 172.21.15.72:0/1673600227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9f00c2360 0x7fd9f01e9b20 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:57.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.153+0000 7fd9f4fff700 1 -- 172.21.15.72:0/1673600227 >> 172.21.15.72:0/1673600227 conn(0x7fd9f00a7b40 msgr2=0x7fd9f006d200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:57.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.153+0000 7fd9f4fff700 1 -- 172.21.15.72:0/1673600227 shutdown_connections 2023-07-27T20:34:57.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.153+0000 7fd9f4fff700 1 -- 172.21.15.72:0/1673600227 wait complete. 2023-07-27T20:34:57.158 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-27T20:34:57.158 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T20:34:57.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.369+0000 7fe4a6dff700 1 Processor -- start 2023-07-27T20:34:57.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.370+0000 7fe4a6dff700 1 -- start start 2023-07-27T20:34:57.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.371+0000 7fe4a6dff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe4a006b150 0x7fe4a00c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:57.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.371+0000 7fe4a6dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe4a01549f0 0x7fe4a01514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:57.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.371+0000 7fe4a6dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a006b710 con 0x7fe4a00c4400 2023-07-27T20:34:57.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.371+0000 7fe4a6dff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a01545d0 con 0x7fe4a006b150 2023-07-27T20:34:57.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.371+0000 7fe4a6dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a006c860 con 0x7fe4a01549f0 2023-07-27T20:34:57.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.372+0000 7fe4a4b9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe4a00c4400 0x7fe4a00c4cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54038/0 (socket says 172.21.15.72:54038) 2023-07-27T20:34:57.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.372+0000 7fe4a4b9b700 1 -- 172.21.15.72:0/4035700137 learned_addr learned my addr 172.21.15.72:0/4035700137 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:34:57.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.372+0000 7fe49f7fe700 1 -- 172.21.15.72:0/4035700137 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 664523687 0 0) 0x7fe4a006b710 con 0x7fe4a00c4400 2023-07-27T20:34:57.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.372+0000 7fe49f7fe700 1 -- 172.21.15.72:0/4035700137 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4900035b0 con 0x7fe4a00c4400 2023-07-27T20:34:57.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.372+0000 7fe49ffff700 1 --2- 172.21.15.72:0/4035700137 >> v2:172.21.15.173:3300/0 conn(0x7fe4a006b150 0x7fe4a00c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:57.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.372+0000 7fe4a539c700 1 --2- 172.21.15.72:0/4035700137 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe4a01549f0 0x7fe4a01514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:57.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.372+0000 7fe49f7fe700 1 -- 172.21.15.72:0/4035700137 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 438533838 0 0) 0x7fe4900035b0 con 0x7fe4a00c4400 2023-07-27T20:34:57.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.372+0000 7fe49f7fe700 1 -- 172.21.15.72:0/4035700137 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe4a01549f0 msgr2=0x7fe4a01514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:57.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.372+0000 7fe49f7fe700 1 --2- 172.21.15.72:0/4035700137 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe4a01549f0 0x7fe4a01514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:57.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.372+0000 7fe49f7fe700 1 -- 172.21.15.72:0/4035700137 >> v2:172.21.15.173:3300/0 conn(0x7fe4a006b150 msgr2=0x7fe4a00c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:57.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.372+0000 7fe49f7fe700 1 --2- 172.21.15.72:0/4035700137 >> v2:172.21.15.173:3300/0 conn(0x7fe4a006b150 0x7fe4a00c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:57.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.372+0000 7fe49f7fe700 1 -- 172.21.15.72:0/4035700137 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a006b9f0 con 0x7fe4a00c4400 2023-07-27T20:34:57.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.372+0000 7fe49f7fe700 1 -- 172.21.15.72:0/4035700137 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7fe494001670 con 0x7fe4a00c4400 2023-07-27T20:34:57.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.372+0000 7fe49f7fe700 1 -- 172.21.15.72:0/4035700137 >> v1:172.21.15.72:6789/0 conn(0x7fe4a00c4400 legacy=0x7fe4a00c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:57.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.372+0000 7fe49f7fe700 1 --2- 172.21.15.72:0/4035700137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe490003a00 0x7fe490003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:57.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.372+0000 7fe49f7fe700 1 --2- 172.21.15.72:0/4035700137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe490004850 0x7fe490004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:57.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.373+0000 7fe49f7fe700 1 --2- 172.21.15.72:0/4035700137 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe4a01549f0 0x7fe490005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:57.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.373+0000 7fe49f7fe700 1 -- 172.21.15.72:0/4035700137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a01545d0 con 0x7fe490003a00 2023-07-27T20:34:57.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.373+0000 7fe49f7fe700 1 -- 172.21.15.72:0/4035700137 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49000bac0 con 0x7fe490004850 2023-07-27T20:34:57.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.373+0000 7fe49f7fe700 1 -- 172.21.15.72:0/4035700137 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49000bc30 con 0x7fe4a01549f0 2023-07-27T20:34:57.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.373+0000 7fe4a4b9b700 1 --2- 172.21.15.72:0/4035700137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe490003a00 0x7fe490003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:57.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.373+0000 7fe49ffff700 1 --2- 172.21.15.72:0/4035700137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe490004850 0x7fe490004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:57.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.373+0000 7fe4a539c700 1 --2- 172.21.15.72:0/4035700137 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe4a01549f0 0x7fe490005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:57.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.373+0000 7fe4a4b9b700 1 -- 172.21.15.72:0/4035700137 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe4a01549f0 msgr2=0x7fe490005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:57.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.373+0000 7fe4a4b9b700 1 --2- 172.21.15.72:0/4035700137 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe4a01549f0 0x7fe490005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:57.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.373+0000 7fe4a4b9b700 1 -- 172.21.15.72:0/4035700137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe490004850 msgr2=0x7fe490004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:34:57.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.373+0000 7fe4a4b9b700 1 --2- 172.21.15.72:0/4035700137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe490004850 0x7fe490004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:57.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.373+0000 7fe4a4b9b700 1 -- 172.21.15.72:0/4035700137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4900035b0 con 0x7fe490003a00 2023-07-27T20:34:57.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.373+0000 7fe4a4b9b700 1 --2- 172.21.15.72:0/4035700137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe490003a00 0x7fe490003e20 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fe494001050 tx=0x7fe490005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=838dd7101c0fad1c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:57.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.374+0000 7fe49f7fe700 1 -- 172.21.15.72:0/4035700137 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49400cd20 con 0x7fe490003a00 2023-07-27T20:34:57.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.374+0000 7fe49f7fe700 1 -- 172.21.15.72:0/4035700137 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49400ce80 con 0x7fe490003a00 2023-07-27T20:34:57.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.374+0000 7fe49f7fe700 1 -- 172.21.15.72:0/4035700137 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe494005ba0 con 0x7fe490003a00 2023-07-27T20:34:57.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.374+0000 7fe4a6dff700 1 -- 172.21.15.72:0/4035700137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe490003a00 msgr2=0x7fe490003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:57.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.374+0000 7fe4a6dff700 1 --2- 172.21.15.72:0/4035700137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe490003a00 0x7fe490003e20 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fe494001050 tx=0x7fe490005880 comp rx=0 tx=0).stop 2023-07-27T20:34:57.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.374+0000 7fe4a539c700 1 -- 172.21.15.72:0/4035700137 reap_dead start 2023-07-27T20:34:57.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.374+0000 7fe4a6dff700 1 -- 172.21.15.72:0/4035700137 shutdown_connections 2023-07-27T20:34:57.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.374+0000 7fe4a6dff700 1 -- 172.21.15.72:0/4035700137 >> 172.21.15.72:0/4035700137 conn(0x7fe4a00ab300 msgr2=0x7fe4a00ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:57.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.374+0000 7fe4a6dff700 1 -- 172.21.15.72:0/4035700137 shutdown_connections 2023-07-27T20:34:57.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.374+0000 7fe4a6dff700 1 -- 172.21.15.72:0/4035700137 wait complete. 2023-07-27T20:34:57.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.376+0000 7fe4a6dff700 1 Processor -- start 2023-07-27T20:34:57.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.376+0000 7fe4a6dff700 1 -- start start 2023-07-27T20:34:57.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.377+0000 7fe4a6dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe490003a00 0x7fe4a01ed5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:57.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.377+0000 7fe4a6dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4a00c22e0 0x7fe4a014f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:57.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.377+0000 7fe4a6dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe4a01e9670 0x7fe4a00c08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:57.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.377+0000 7fe4a6dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a01edb30 con 0x7fe490003a00 2023-07-27T20:34:57.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.377+0000 7fe4a6dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a014eb10 con 0x7fe4a00c22e0 2023-07-27T20:34:57.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.377+0000 7fe4a6dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a00c3140 con 0x7fe4a01e9670 2023-07-27T20:34:57.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.377+0000 7fe4a4b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe490003a00 0x7fe4a01ed5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:57.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.377+0000 7fe4a4b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe490003a00 0x7fe4a01ed5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48460/0 (socket says 172.21.15.72:48460) 2023-07-27T20:34:57.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.377+0000 7fe4a4b9b700 1 -- 172.21.15.72:0/2744491505 learned_addr learned my addr 172.21.15.72:0/2744491505 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:34:57.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.377+0000 7fe49ffff700 1 --2- 172.21.15.72:0/2744491505 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4a00c22e0 0x7fe4a014f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:57.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.378+0000 7fe4a539c700 1 --2- 172.21.15.72:0/2744491505 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe4a01e9670 0x7fe4a00c08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:57.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.378+0000 7fe4a4b9b700 1 -- 172.21.15.72:0/2744491505 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe4a01e9670 msgr2=0x7fe4a00c08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:57.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.378+0000 7fe4a4b9b700 1 --2- 172.21.15.72:0/2744491505 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe4a01e9670 0x7fe4a00c08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:57.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.378+0000 7fe4a4b9b700 1 -- 172.21.15.72:0/2744491505 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4a00c22e0 msgr2=0x7fe4a014f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:57.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.378+0000 7fe4a4b9b700 1 --2- 172.21.15.72:0/2744491505 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4a00c22e0 0x7fe4a014f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:57.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.378+0000 7fe4a4b9b700 1 -- 172.21.15.72:0/2744491505 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a00c3420 con 0x7fe490003a00 2023-07-27T20:34:57.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.378+0000 7fe49ffff700 1 --2- 172.21.15.72:0/2744491505 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4a00c22e0 0x7fe4a014f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:34:57.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.378+0000 7fe4a4b9b700 1 --2- 172.21.15.72:0/2744491505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe490003a00 0x7fe4a01ed5f0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fe494001eb0 tx=0x7fe494000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:57.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.378+0000 7fe49d7fa700 1 -- 172.21.15.72:0/2744491505 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4940072d0 con 0x7fe490003a00 2023-07-27T20:34:57.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.378+0000 7fe49d7fa700 1 -- 172.21.15.72:0/2744491505 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe494007430 con 0x7fe490003a00 2023-07-27T20:34:57.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.378+0000 7fe4a6dff700 1 -- 172.21.15.72:0/2744491505 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a014e4c0 con 0x7fe490003a00 2023-07-27T20:34:57.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.378+0000 7fe49d7fa700 1 -- 172.21.15.72:0/2744491505 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4940077e0 con 0x7fe490003a00 2023-07-27T20:34:57.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.378+0000 7fe4a6dff700 1 -- 172.21.15.72:0/2744491505 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a00c2760 con 0x7fe490003a00 2023-07-27T20:34:57.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.379+0000 7fe4a6dff700 1 -- 172.21.15.72:0/2744491505 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a00c2130 con 0x7fe490003a00 2023-07-27T20:34:57.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.380+0000 7fe49d7fa700 1 -- 172.21.15.72:0/2744491505 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe49401e430 con 0x7fe490003a00 2023-07-27T20:34:57.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.381+0000 7fe49d7fa700 1 --2- 172.21.15.72:0/2744491505 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe48406ace0 0x7fe48406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:34:57.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.381+0000 7fe49d7fa700 1 -- 172.21.15.72:0/2744491505 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7238+0+0 (secure 0 0 0) 0x7fe49408a940 con 0x7fe490003a00 2023-07-27T20:34:57.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.382+0000 7fe49ffff700 1 --2- 172.21.15.72:0/2744491505 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe48406ace0 0x7fe48406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:34:57.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.383+0000 7fe49ffff700 1 --2- 172.21.15.72:0/2744491505 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe48406ace0 0x7fe48406d1a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fe4a014ecf0 tx=0x7fe48c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:34:57.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.385+0000 7fe49d7fa700 1 -- 172.21.15.72:0/2744491505 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe4940555c0 con 0x7fe490003a00 2023-07-27T20:34:57.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.576+0000 7fe4a6dff700 1 -- 172.21.15.72:0/2744491505 --> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe4a01edb30 con 0x7fe48406ace0 2023-07-27T20:34:57.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.592+0000 7fe49d7fa700 1 -- 172.21.15.72:0/2744491505 <== mgr.4107 v2:172.21.15.173:6832/910681537 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+550099 (secure 0 0 0) 0x7fe4a01edb30 con 0x7fe48406ace0 2023-07-27T20:34:57.586 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:34:57.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.598+0000 7fe4a6dff700 1 -- 172.21.15.72:0/2744491505 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe48406ace0 msgr2=0x7fe48406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:57.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.598+0000 7fe4a6dff700 1 --2- 172.21.15.72:0/2744491505 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe48406ace0 0x7fe48406d1a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fe4a014ecf0 tx=0x7fe48c008040 comp rx=0 tx=0).stop 2023-07-27T20:34:57.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.598+0000 7fe4a6dff700 1 -- 172.21.15.72:0/2744491505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe490003a00 msgr2=0x7fe4a01ed5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:34:57.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.598+0000 7fe4a6dff700 1 --2- 172.21.15.72:0/2744491505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe490003a00 0x7fe4a01ed5f0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fe494001eb0 tx=0x7fe494000fe0 comp rx=0 tx=0).stop 2023-07-27T20:34:57.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.598+0000 7fe4a6dff700 1 -- 172.21.15.72:0/2744491505 shutdown_connections 2023-07-27T20:34:57.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.598+0000 7fe4a6dff700 1 --2- 172.21.15.72:0/2744491505 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe48406ace0 0x7fe48406d1a0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:57.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.598+0000 7fe4a6dff700 1 --2- 172.21.15.72:0/2744491505 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe4a01e9670 0x7fe4a00c08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:57.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.598+0000 7fe4a6dff700 1 --2- 172.21.15.72:0/2744491505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe490003a00 0x7fe4a01ed5f0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:57.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.598+0000 7fe4a6dff700 1 --2- 172.21.15.72:0/2744491505 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4a00c22e0 0x7fe4a014f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:34:57.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.598+0000 7fe4a6dff700 1 -- 172.21.15.72:0/2744491505 >> 172.21.15.72:0/2744491505 conn(0x7fe4a00ab300 msgr2=0x7fe4a01527d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:34:57.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.598+0000 7fe4a6dff700 1 -- 172.21.15.72:0/2744491505 shutdown_connections 2023-07-27T20:34:57.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:34:57.598+0000 7fe4a6dff700 1 -- 172.21.15.72:0/2744491505 wait complete. 2023-07-27T20:34:57.592 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-07-27T20:34:57.603 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":170,"stamp":"2023-07-27T20:34:56.580477+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596789,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":250,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":402,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223708,"kb_used_data":7528,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754751012,"statfs":{"total":773094113280,"available":772865036288,"internally_reserved":0,"allocated":7708672,"data_stored":4305554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.419005"},"pg_stats":[{"pgid":"13.39","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938318+0000","last_change":"2023-07-27T20:34:51.146030+0000","last_active":"2023-07-27T20:34:52.938318+0000","last_peered":"2023-07-27T20:34:52.938318+0000","last_clean":"2023-07-27T20:34:52.938318+0000","last_became_active":"2023-07-27T20:34:51.145726+0000","last_became_peered":"2023-07-27T20:34:51.145726+0000","last_unstale":"2023-07-27T20:34:52.938318+0000","last_undegraded":"2023-07-27T20:34:52.938318+0000","last_fullsized":"2023-07-27T20:34:52.938318+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:55:07.037931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132896+0000","last_change":"2023-07-27T20:34:34.316234+0000","last_active":"2023-07-27T20:34:52.132896+0000","last_peered":"2023-07-27T20:34:52.132896+0000","last_clean":"2023-07-27T20:34:52.132896+0000","last_became_active":"2023-07-27T20:34:34.315976+0000","last_became_peered":"2023-07-27T20:34:34.315976+0000","last_unstale":"2023-07-27T20:34:52.132896+0000","last_undegraded":"2023-07-27T20:34:52.132896+0000","last_fullsized":"2023-07-27T20:34:52.132896+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:57:04.577992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.552554+0000","last_change":"2023-07-27T20:34:51.158344+0000","last_active":"2023-07-27T20:34:53.552554+0000","last_peered":"2023-07-27T20:34:53.552554+0000","last_clean":"2023-07-27T20:34:53.552554+0000","last_became_active":"2023-07-27T20:34:51.158001+0000","last_became_peered":"2023-07-27T20:34:51.158001+0000","last_unstale":"2023-07-27T20:34:53.552554+0000","last_undegraded":"2023-07-27T20:34:53.552554+0000","last_fullsized":"2023-07-27T20:34:53.552554+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:50:35.181709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210376+0000","last_change":"2023-07-27T20:34:34.314798+0000","last_active":"2023-07-27T20:34:53.210376+0000","last_peered":"2023-07-27T20:34:53.210376+0000","last_clean":"2023-07-27T20:34:53.210376+0000","last_became_active":"2023-07-27T20:34:34.314515+0000","last_became_peered":"2023-07-27T20:34:34.314515+0000","last_unstale":"2023-07-27T20:34:53.210376+0000","last_undegraded":"2023-07-27T20:34:53.210376+0000","last_fullsized":"2023-07-27T20:34:53.210376+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:09:19.279175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131971+0000","last_change":"2023-07-27T20:34:51.153611+0000","last_active":"2023-07-27T20:34:52.131971+0000","last_peered":"2023-07-27T20:34:52.131971+0000","last_clean":"2023-07-27T20:34:52.131971+0000","last_became_active":"2023-07-27T20:34:51.153320+0000","last_became_peered":"2023-07-27T20:34:51.153320+0000","last_unstale":"2023-07-27T20:34:52.131971+0000","last_undegraded":"2023-07-27T20:34:52.131971+0000","last_fullsized":"2023-07-27T20:34:52.131971+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:59:14.981939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389460+0000","last_change":"2023-07-27T20:34:34.296875+0000","last_active":"2023-07-27T20:34:52.389460+0000","last_peered":"2023-07-27T20:34:52.389460+0000","last_clean":"2023-07-27T20:34:52.389460+0000","last_became_active":"2023-07-27T20:34:34.296594+0000","last_became_peered":"2023-07-27T20:34:34.296594+0000","last_unstale":"2023-07-27T20:34:52.389460+0000","last_undegraded":"2023-07-27T20:34:52.389460+0000","last_fullsized":"2023-07-27T20:34:52.389460+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:12:46.064183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.552894+0000","last_change":"2023-07-27T20:34:51.151531+0000","last_active":"2023-07-27T20:34:53.552894+0000","last_peered":"2023-07-27T20:34:53.552894+0000","last_clean":"2023-07-27T20:34:53.552894+0000","last_became_active":"2023-07-27T20:34:51.151241+0000","last_became_peered":"2023-07-27T20:34:51.151241+0000","last_unstale":"2023-07-27T20:34:53.552894+0000","last_undegraded":"2023-07-27T20:34:53.552894+0000","last_fullsized":"2023-07-27T20:34:53.552894+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:31:26.732750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590169+0000","last_change":"2023-07-27T20:34:34.316000+0000","last_active":"2023-07-27T20:34:52.590169+0000","last_peered":"2023-07-27T20:34:52.590169+0000","last_clean":"2023-07-27T20:34:52.590169+0000","last_became_active":"2023-07-27T20:34:34.315494+0000","last_became_peered":"2023-07-27T20:34:34.315494+0000","last_unstale":"2023-07-27T20:34:52.590169+0000","last_undegraded":"2023-07-27T20:34:52.590169+0000","last_fullsized":"2023-07-27T20:34:52.590169+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:12:23.304991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.133167+0000","last_change":"2023-07-27T20:34:51.155618+0000","last_active":"2023-07-27T20:34:52.133167+0000","last_peered":"2023-07-27T20:34:52.133167+0000","last_clean":"2023-07-27T20:34:52.133167+0000","last_became_active":"2023-07-27T20:34:51.155297+0000","last_became_peered":"2023-07-27T20:34:51.155297+0000","last_unstale":"2023-07-27T20:34:52.133167+0000","last_undegraded":"2023-07-27T20:34:52.133167+0000","last_fullsized":"2023-07-27T20:34:52.133167+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:24:43.146014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938985+0000","last_change":"2023-07-27T20:34:34.310257+0000","last_active":"2023-07-27T20:34:52.938985+0000","last_peered":"2023-07-27T20:34:52.938985+0000","last_clean":"2023-07-27T20:34:52.938985+0000","last_became_active":"2023-07-27T20:34:34.309918+0000","last_became_peered":"2023-07-27T20:34:34.309918+0000","last_unstale":"2023-07-27T20:34:52.938985+0000","last_undegraded":"2023-07-27T20:34:52.938985+0000","last_fullsized":"2023-07-27T20:34:52.938985+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:37:41.424554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938562+0000","last_change":"2023-07-27T20:34:51.156185+0000","last_active":"2023-07-27T20:34:52.938562+0000","last_peered":"2023-07-27T20:34:52.938562+0000","last_clean":"2023-07-27T20:34:52.938562+0000","last_became_active":"2023-07-27T20:34:51.155841+0000","last_became_peered":"2023-07-27T20:34:51.155841+0000","last_unstale":"2023-07-27T20:34:52.938562+0000","last_undegraded":"2023-07-27T20:34:52.938562+0000","last_fullsized":"2023-07-27T20:34:52.938562+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:05:20.675611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209213+0000","last_change":"2023-07-27T20:34:34.319670+0000","last_active":"2023-07-27T20:34:53.209213+0000","last_peered":"2023-07-27T20:34:53.209213+0000","last_clean":"2023-07-27T20:34:53.209213+0000","last_became_active":"2023-07-27T20:34:34.319356+0000","last_became_peered":"2023-07-27T20:34:34.319356+0000","last_unstale":"2023-07-27T20:34:53.209213+0000","last_undegraded":"2023-07-27T20:34:53.209213+0000","last_fullsized":"2023-07-27T20:34:53.209213+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:11:10.950594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210437+0000","last_change":"2023-07-27T20:34:51.152669+0000","last_active":"2023-07-27T20:34:53.210437+0000","last_peered":"2023-07-27T20:34:53.210437+0000","last_clean":"2023-07-27T20:34:53.210437+0000","last_became_active":"2023-07-27T20:34:51.151988+0000","last_became_peered":"2023-07-27T20:34:51.151988+0000","last_unstale":"2023-07-27T20:34:53.210437+0000","last_undegraded":"2023-07-27T20:34:53.210437+0000","last_fullsized":"2023-07-27T20:34:53.210437+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:02:26.072707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.553014+0000","last_change":"2023-07-27T20:34:34.300907+0000","last_active":"2023-07-27T20:34:53.553014+0000","last_peered":"2023-07-27T20:34:53.553014+0000","last_clean":"2023-07-27T20:34:53.553014+0000","last_became_active":"2023-07-27T20:34:34.300633+0000","last_became_peered":"2023-07-27T20:34:34.300633+0000","last_unstale":"2023-07-27T20:34:53.553014+0000","last_undegraded":"2023-07-27T20:34:53.553014+0000","last_fullsized":"2023-07-27T20:34:53.553014+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:22:39.673260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590334+0000","last_change":"2023-07-27T20:34:51.159055+0000","last_active":"2023-07-27T20:34:52.590334+0000","last_peered":"2023-07-27T20:34:52.590334+0000","last_clean":"2023-07-27T20:34:52.590334+0000","last_became_active":"2023-07-27T20:34:51.158750+0000","last_became_peered":"2023-07-27T20:34:51.158750+0000","last_unstale":"2023-07-27T20:34:52.590334+0000","last_undegraded":"2023-07-27T20:34:52.590334+0000","last_fullsized":"2023-07-27T20:34:52.590334+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:45:05.617819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209289+0000","last_change":"2023-07-27T20:34:34.320735+0000","last_active":"2023-07-27T20:34:53.209289+0000","last_peered":"2023-07-27T20:34:53.209289+0000","last_clean":"2023-07-27T20:34:53.209289+0000","last_became_active":"2023-07-27T20:34:34.320086+0000","last_became_peered":"2023-07-27T20:34:34.320086+0000","last_unstale":"2023-07-27T20:34:53.209289+0000","last_undegraded":"2023-07-27T20:34:53.209289+0000","last_fullsized":"2023-07-27T20:34:53.209289+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:46:52.049065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389208+0000","last_change":"2023-07-27T20:34:51.142025+0000","last_active":"2023-07-27T20:34:52.389208+0000","last_peered":"2023-07-27T20:34:52.389208+0000","last_clean":"2023-07-27T20:34:52.389208+0000","last_became_active":"2023-07-27T20:34:51.141766+0000","last_became_peered":"2023-07-27T20:34:51.141766+0000","last_unstale":"2023-07-27T20:34:52.389208+0000","last_undegraded":"2023-07-27T20:34:52.389208+0000","last_fullsized":"2023-07-27T20:34:52.389208+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:47:04.588935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.939577+0000","last_change":"2023-07-27T20:34:34.304314+0000","last_active":"2023-07-27T20:34:52.939577+0000","last_peered":"2023-07-27T20:34:52.939577+0000","last_clean":"2023-07-27T20:34:52.939577+0000","last_became_active":"2023-07-27T20:34:34.304042+0000","last_became_peered":"2023-07-27T20:34:34.304042+0000","last_unstale":"2023-07-27T20:34:52.939577+0000","last_undegraded":"2023-07-27T20:34:52.939577+0000","last_fullsized":"2023-07-27T20:34:52.939577+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:25:33.856127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131024+0000","last_change":"2023-07-27T20:34:51.156837+0000","last_active":"2023-07-27T20:34:52.131024+0000","last_peered":"2023-07-27T20:34:52.131024+0000","last_clean":"2023-07-27T20:34:52.131024+0000","last_became_active":"2023-07-27T20:34:51.156487+0000","last_became_peered":"2023-07-27T20:34:51.156487+0000","last_unstale":"2023-07-27T20:34:52.131024+0000","last_undegraded":"2023-07-27T20:34:52.131024+0000","last_fullsized":"2023-07-27T20:34:52.131024+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:12:02.541917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132260+0000","last_change":"2023-07-27T20:34:34.302549+0000","last_active":"2023-07-27T20:34:52.132260+0000","last_peered":"2023-07-27T20:34:52.132260+0000","last_clean":"2023-07-27T20:34:52.132260+0000","last_became_active":"2023-07-27T20:34:34.301699+0000","last_became_peered":"2023-07-27T20:34:34.301699+0000","last_unstale":"2023-07-27T20:34:52.132260+0000","last_undegraded":"2023-07-27T20:34:52.132260+0000","last_fullsized":"2023-07-27T20:34:52.132260+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:41:12.976042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132365+0000","last_change":"2023-07-27T20:34:51.144061+0000","last_active":"2023-07-27T20:34:52.132365+0000","last_peered":"2023-07-27T20:34:52.132365+0000","last_clean":"2023-07-27T20:34:52.132365+0000","last_became_active":"2023-07-27T20:34:51.143785+0000","last_became_peered":"2023-07-27T20:34:51.143785+0000","last_unstale":"2023-07-27T20:34:52.132365+0000","last_undegraded":"2023-07-27T20:34:52.132365+0000","last_fullsized":"2023-07-27T20:34:52.132365+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:14:18.507561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132935+0000","last_change":"2023-07-27T20:34:34.313419+0000","last_active":"2023-07-27T20:34:52.132935+0000","last_peered":"2023-07-27T20:34:52.132935+0000","last_clean":"2023-07-27T20:34:52.132935+0000","last_became_active":"2023-07-27T20:34:34.313089+0000","last_became_peered":"2023-07-27T20:34:34.313089+0000","last_unstale":"2023-07-27T20:34:52.132935+0000","last_undegraded":"2023-07-27T20:34:52.132935+0000","last_fullsized":"2023-07-27T20:34:52.132935+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:28:39.205723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938526+0000","last_change":"2023-07-27T20:34:51.158340+0000","last_active":"2023-07-27T20:34:52.938526+0000","last_peered":"2023-07-27T20:34:52.938526+0000","last_clean":"2023-07-27T20:34:52.938526+0000","last_became_active":"2023-07-27T20:34:51.158022+0000","last_became_peered":"2023-07-27T20:34:51.158022+0000","last_unstale":"2023-07-27T20:34:52.938526+0000","last_undegraded":"2023-07-27T20:34:52.938526+0000","last_fullsized":"2023-07-27T20:34:52.938526+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:46:52.928504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590333+0000","last_change":"2023-07-27T20:34:34.298435+0000","last_active":"2023-07-27T20:34:52.590333+0000","last_peered":"2023-07-27T20:34:52.590333+0000","last_clean":"2023-07-27T20:34:52.590333+0000","last_became_active":"2023-07-27T20:34:34.298143+0000","last_became_peered":"2023-07-27T20:34:34.298143+0000","last_unstale":"2023-07-27T20:34:52.590333+0000","last_undegraded":"2023-07-27T20:34:52.590333+0000","last_fullsized":"2023-07-27T20:34:52.590333+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:55:19.530682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590340+0000","last_change":"2023-07-27T20:34:51.152168+0000","last_active":"2023-07-27T20:34:52.590340+0000","last_peered":"2023-07-27T20:34:52.590340+0000","last_clean":"2023-07-27T20:34:52.590340+0000","last_became_active":"2023-07-27T20:34:51.151876+0000","last_became_peered":"2023-07-27T20:34:51.151876+0000","last_unstale":"2023-07-27T20:34:52.590340+0000","last_undegraded":"2023-07-27T20:34:52.590340+0000","last_fullsized":"2023-07-27T20:34:52.590340+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:11:27.828934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130963+0000","last_change":"2023-07-27T20:34:34.316878+0000","last_active":"2023-07-27T20:34:52.130963+0000","last_peered":"2023-07-27T20:34:52.130963+0000","last_clean":"2023-07-27T20:34:52.130963+0000","last_became_active":"2023-07-27T20:34:34.316610+0000","last_became_peered":"2023-07-27T20:34:34.316610+0000","last_unstale":"2023-07-27T20:34:52.130963+0000","last_undegraded":"2023-07-27T20:34:52.130963+0000","last_fullsized":"2023-07-27T20:34:52.130963+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:54:00.744549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210557+0000","last_change":"2023-07-27T20:34:51.145667+0000","last_active":"2023-07-27T20:34:53.210557+0000","last_peered":"2023-07-27T20:34:53.210557+0000","last_clean":"2023-07-27T20:34:53.210557+0000","last_became_active":"2023-07-27T20:34:51.145343+0000","last_became_peered":"2023-07-27T20:34:51.145343+0000","last_unstale":"2023-07-27T20:34:53.210557+0000","last_undegraded":"2023-07-27T20:34:53.210557+0000","last_fullsized":"2023-07-27T20:34:53.210557+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:22:02.376178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.939202+0000","last_change":"2023-07-27T20:34:34.297203+0000","last_active":"2023-07-27T20:34:52.939202+0000","last_peered":"2023-07-27T20:34:52.939202+0000","last_clean":"2023-07-27T20:34:52.939202+0000","last_became_active":"2023-07-27T20:34:34.296957+0000","last_became_peered":"2023-07-27T20:34:34.296957+0000","last_unstale":"2023-07-27T20:34:52.939202+0000","last_undegraded":"2023-07-27T20:34:52.939202+0000","last_fullsized":"2023-07-27T20:34:52.939202+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:33:13.233455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.553381+0000","last_change":"2023-07-27T20:34:51.153480+0000","last_active":"2023-07-27T20:34:53.553381+0000","last_peered":"2023-07-27T20:34:53.553381+0000","last_clean":"2023-07-27T20:34:53.553381+0000","last_became_active":"2023-07-27T20:34:51.153217+0000","last_became_peered":"2023-07-27T20:34:51.153217+0000","last_unstale":"2023-07-27T20:34:53.553381+0000","last_undegraded":"2023-07-27T20:34:53.553381+0000","last_fullsized":"2023-07-27T20:34:53.553381+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:33:49.001577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130270+0000","last_change":"2023-07-27T20:34:34.294995+0000","last_active":"2023-07-27T20:34:52.130270+0000","last_peered":"2023-07-27T20:34:52.130270+0000","last_clean":"2023-07-27T20:34:52.130270+0000","last_became_active":"2023-07-27T20:34:34.294646+0000","last_became_peered":"2023-07-27T20:34:34.294646+0000","last_unstale":"2023-07-27T20:34:52.130270+0000","last_undegraded":"2023-07-27T20:34:52.130270+0000","last_fullsized":"2023-07-27T20:34:52.130270+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:19:48.357135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210130+0000","last_change":"2023-07-27T20:34:51.152117+0000","last_active":"2023-07-27T20:34:53.210130+0000","last_peered":"2023-07-27T20:34:53.210130+0000","last_clean":"2023-07-27T20:34:53.210130+0000","last_became_active":"2023-07-27T20:34:51.151720+0000","last_became_peered":"2023-07-27T20:34:51.151720+0000","last_unstale":"2023-07-27T20:34:53.210130+0000","last_undegraded":"2023-07-27T20:34:53.210130+0000","last_fullsized":"2023-07-27T20:34:53.210130+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:17:19.524394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130883+0000","last_change":"2023-07-27T20:34:34.309167+0000","last_active":"2023-07-27T20:34:52.130883+0000","last_peered":"2023-07-27T20:34:52.130883+0000","last_clean":"2023-07-27T20:34:52.130883+0000","last_became_active":"2023-07-27T20:34:34.308831+0000","last_became_peered":"2023-07-27T20:34:34.308831+0000","last_unstale":"2023-07-27T20:34:52.130883+0000","last_undegraded":"2023-07-27T20:34:52.130883+0000","last_fullsized":"2023-07-27T20:34:52.130883+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:43:07.447940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209667+0000","last_change":"2023-07-27T20:34:51.148798+0000","last_active":"2023-07-27T20:34:53.209667+0000","last_peered":"2023-07-27T20:34:53.209667+0000","last_clean":"2023-07-27T20:34:53.209667+0000","last_became_active":"2023-07-27T20:34:51.148492+0000","last_became_peered":"2023-07-27T20:34:51.148492+0000","last_unstale":"2023-07-27T20:34:53.209667+0000","last_undegraded":"2023-07-27T20:34:53.209667+0000","last_fullsized":"2023-07-27T20:34:53.209667+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:53:03.343306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.939220+0000","last_change":"2023-07-27T20:34:34.298405+0000","last_active":"2023-07-27T20:34:52.939220+0000","last_peered":"2023-07-27T20:34:52.939220+0000","last_clean":"2023-07-27T20:34:52.939220+0000","last_became_active":"2023-07-27T20:34:34.298150+0000","last_became_peered":"2023-07-27T20:34:34.298150+0000","last_unstale":"2023-07-27T20:34:52.939220+0000","last_undegraded":"2023-07-27T20:34:52.939220+0000","last_fullsized":"2023-07-27T20:34:52.939220+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:45:16.289674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938436+0000","last_change":"2023-07-27T20:34:51.146714+0000","last_active":"2023-07-27T20:34:52.938436+0000","last_peered":"2023-07-27T20:34:52.938436+0000","last_clean":"2023-07-27T20:34:52.938436+0000","last_became_active":"2023-07-27T20:34:51.145799+0000","last_became_peered":"2023-07-27T20:34:51.145799+0000","last_unstale":"2023-07-27T20:34:52.938436+0000","last_undegraded":"2023-07-27T20:34:52.938436+0000","last_fullsized":"2023-07-27T20:34:52.938436+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:05:22.092932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590468+0000","last_change":"2023-07-27T20:34:34.316418+0000","last_active":"2023-07-27T20:34:52.590468+0000","last_peered":"2023-07-27T20:34:52.590468+0000","last_clean":"2023-07-27T20:34:52.590468+0000","last_became_active":"2023-07-27T20:34:34.316164+0000","last_became_peered":"2023-07-27T20:34:34.316164+0000","last_unstale":"2023-07-27T20:34:52.590468+0000","last_undegraded":"2023-07-27T20:34:52.590468+0000","last_fullsized":"2023-07-27T20:34:52.590468+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:19:54.428946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938627+0000","last_change":"2023-07-27T20:34:51.150712+0000","last_active":"2023-07-27T20:34:52.938627+0000","last_peered":"2023-07-27T20:34:52.938627+0000","last_clean":"2023-07-27T20:34:52.938627+0000","last_became_active":"2023-07-27T20:34:51.150384+0000","last_became_peered":"2023-07-27T20:34:51.150384+0000","last_unstale":"2023-07-27T20:34:52.938627+0000","last_undegraded":"2023-07-27T20:34:52.938627+0000","last_fullsized":"2023-07-27T20:34:52.938627+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:05:31.209001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210276+0000","last_change":"2023-07-27T20:34:34.322046+0000","last_active":"2023-07-27T20:34:53.210276+0000","last_peered":"2023-07-27T20:34:53.210276+0000","last_clean":"2023-07-27T20:34:53.210276+0000","last_became_active":"2023-07-27T20:34:34.321751+0000","last_became_peered":"2023-07-27T20:34:34.321751+0000","last_unstale":"2023-07-27T20:34:53.210276+0000","last_undegraded":"2023-07-27T20:34:53.210276+0000","last_fullsized":"2023-07-27T20:34:53.210276+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:05:28.688422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590016+0000","last_change":"2023-07-27T20:34:51.152143+0000","last_active":"2023-07-27T20:34:52.590016+0000","last_peered":"2023-07-27T20:34:52.590016+0000","last_clean":"2023-07-27T20:34:52.590016+0000","last_became_active":"2023-07-27T20:34:51.151836+0000","last_became_peered":"2023-07-27T20:34:51.151836+0000","last_unstale":"2023-07-27T20:34:52.590016+0000","last_undegraded":"2023-07-27T20:34:52.590016+0000","last_fullsized":"2023-07-27T20:34:52.590016+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:45:27.883128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130915+0000","last_change":"2023-07-27T20:34:34.298450+0000","last_active":"2023-07-27T20:34:52.130915+0000","last_peered":"2023-07-27T20:34:52.130915+0000","last_clean":"2023-07-27T20:34:52.130915+0000","last_became_active":"2023-07-27T20:34:34.298194+0000","last_became_peered":"2023-07-27T20:34:34.298194+0000","last_unstale":"2023-07-27T20:34:52.130915+0000","last_undegraded":"2023-07-27T20:34:52.130915+0000","last_fullsized":"2023-07-27T20:34:52.130915+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:01:23.041905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130916+0000","last_change":"2023-07-27T20:34:51.141249+0000","last_active":"2023-07-27T20:34:52.130916+0000","last_peered":"2023-07-27T20:34:52.130916+0000","last_clean":"2023-07-27T20:34:52.130916+0000","last_became_active":"2023-07-27T20:34:51.140088+0000","last_became_peered":"2023-07-27T20:34:51.140088+0000","last_unstale":"2023-07-27T20:34:52.130916+0000","last_undegraded":"2023-07-27T20:34:52.130916+0000","last_fullsized":"2023-07-27T20:34:52.130916+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:50:38.557507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.133123+0000","last_change":"2023-07-27T20:34:34.295428+0000","last_active":"2023-07-27T20:34:52.133123+0000","last_peered":"2023-07-27T20:34:52.133123+0000","last_clean":"2023-07-27T20:34:52.133123+0000","last_became_active":"2023-07-27T20:34:34.295069+0000","last_became_peered":"2023-07-27T20:34:34.295069+0000","last_unstale":"2023-07-27T20:34:52.133123+0000","last_undegraded":"2023-07-27T20:34:52.133123+0000","last_fullsized":"2023-07-27T20:34:52.133123+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:47:08.096237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938771+0000","last_change":"2023-07-27T20:34:51.147380+0000","last_active":"2023-07-27T20:34:52.938771+0000","last_peered":"2023-07-27T20:34:52.938771+0000","last_clean":"2023-07-27T20:34:52.938771+0000","last_became_active":"2023-07-27T20:34:51.147121+0000","last_became_peered":"2023-07-27T20:34:51.147121+0000","last_unstale":"2023-07-27T20:34:52.938771+0000","last_undegraded":"2023-07-27T20:34:52.938771+0000","last_fullsized":"2023-07-27T20:34:52.938771+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:08:53.040045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131834+0000","last_change":"2023-07-27T20:34:34.300794+0000","last_active":"2023-07-27T20:34:52.131834+0000","last_peered":"2023-07-27T20:34:52.131834+0000","last_clean":"2023-07-27T20:34:52.131834+0000","last_became_active":"2023-07-27T20:34:34.300470+0000","last_became_peered":"2023-07-27T20:34:34.300470+0000","last_unstale":"2023-07-27T20:34:52.131834+0000","last_undegraded":"2023-07-27T20:34:52.131834+0000","last_fullsized":"2023-07-27T20:34:52.131834+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:27:32.975304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132074+0000","last_change":"2023-07-27T20:34:51.148096+0000","last_active":"2023-07-27T20:34:52.132074+0000","last_peered":"2023-07-27T20:34:52.132074+0000","last_clean":"2023-07-27T20:34:52.132074+0000","last_became_active":"2023-07-27T20:34:51.147825+0000","last_became_peered":"2023-07-27T20:34:51.147825+0000","last_unstale":"2023-07-27T20:34:52.132074+0000","last_undegraded":"2023-07-27T20:34:52.132074+0000","last_fullsized":"2023-07-27T20:34:52.132074+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:42:31.002737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132207+0000","last_change":"2023-07-27T20:34:34.306170+0000","last_active":"2023-07-27T20:34:52.132207+0000","last_peered":"2023-07-27T20:34:52.132207+0000","last_clean":"2023-07-27T20:34:52.132207+0000","last_became_active":"2023-07-27T20:34:34.305895+0000","last_became_peered":"2023-07-27T20:34:34.305895+0000","last_unstale":"2023-07-27T20:34:52.132207+0000","last_undegraded":"2023-07-27T20:34:52.132207+0000","last_fullsized":"2023-07-27T20:34:52.132207+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:16:03.687360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938951+0000","last_change":"2023-07-27T20:34:51.158753+0000","last_active":"2023-07-27T20:34:52.938951+0000","last_peered":"2023-07-27T20:34:52.938951+0000","last_clean":"2023-07-27T20:34:52.938951+0000","last_became_active":"2023-07-27T20:34:51.158473+0000","last_became_peered":"2023-07-27T20:34:51.158473+0000","last_unstale":"2023-07-27T20:34:52.938951+0000","last_undegraded":"2023-07-27T20:34:52.938951+0000","last_fullsized":"2023-07-27T20:34:52.938951+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:02:34.927869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132107+0000","last_change":"2023-07-27T20:34:34.324172+0000","last_active":"2023-07-27T20:34:52.132107+0000","last_peered":"2023-07-27T20:34:52.132107+0000","last_clean":"2023-07-27T20:34:52.132107+0000","last_became_active":"2023-07-27T20:34:34.323886+0000","last_became_peered":"2023-07-27T20:34:34.323886+0000","last_unstale":"2023-07-27T20:34:52.132107+0000","last_undegraded":"2023-07-27T20:34:52.132107+0000","last_fullsized":"2023-07-27T20:34:52.132107+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:31:01.753346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131405+0000","last_change":"2023-07-27T20:34:51.142015+0000","last_active":"2023-07-27T20:34:52.131405+0000","last_peered":"2023-07-27T20:34:52.131405+0000","last_clean":"2023-07-27T20:34:52.131405+0000","last_became_active":"2023-07-27T20:34:51.141535+0000","last_became_peered":"2023-07-27T20:34:51.141535+0000","last_unstale":"2023-07-27T20:34:52.131405+0000","last_undegraded":"2023-07-27T20:34:52.131405+0000","last_fullsized":"2023-07-27T20:34:52.131405+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:27:47.573714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132172+0000","last_change":"2023-07-27T20:34:34.312549+0000","last_active":"2023-07-27T20:34:52.132172+0000","last_peered":"2023-07-27T20:34:52.132172+0000","last_clean":"2023-07-27T20:34:52.132172+0000","last_became_active":"2023-07-27T20:34:34.311940+0000","last_became_peered":"2023-07-27T20:34:34.311940+0000","last_unstale":"2023-07-27T20:34:52.132172+0000","last_undegraded":"2023-07-27T20:34:52.132172+0000","last_fullsized":"2023-07-27T20:34:52.132172+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:01:23.041905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209046+0000","last_change":"2023-07-27T20:34:51.158019+0000","last_active":"2023-07-27T20:34:53.209046+0000","last_peered":"2023-07-27T20:34:53.209046+0000","last_clean":"2023-07-27T20:34:53.209046+0000","last_became_active":"2023-07-27T20:34:51.157766+0000","last_became_peered":"2023-07-27T20:34:51.157766+0000","last_unstale":"2023-07-27T20:34:53.209046+0000","last_undegraded":"2023-07-27T20:34:53.209046+0000","last_fullsized":"2023-07-27T20:34:53.209046+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:38:18.284531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.553359+0000","last_change":"2023-07-27T20:34:34.315088+0000","last_active":"2023-07-27T20:34:53.553359+0000","last_peered":"2023-07-27T20:34:53.553359+0000","last_clean":"2023-07-27T20:34:53.553359+0000","last_became_active":"2023-07-27T20:34:34.314823+0000","last_became_peered":"2023-07-27T20:34:34.314823+0000","last_unstale":"2023-07-27T20:34:53.553359+0000","last_undegraded":"2023-07-27T20:34:53.553359+0000","last_fullsized":"2023-07-27T20:34:53.553359+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:42:57.971705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590034+0000","last_change":"2023-07-27T20:34:51.152285+0000","last_active":"2023-07-27T20:34:52.590034+0000","last_peered":"2023-07-27T20:34:52.590034+0000","last_clean":"2023-07-27T20:34:52.590034+0000","last_became_active":"2023-07-27T20:34:51.151991+0000","last_became_peered":"2023-07-27T20:34:51.151991+0000","last_unstale":"2023-07-27T20:34:52.590034+0000","last_undegraded":"2023-07-27T20:34:52.590034+0000","last_fullsized":"2023-07-27T20:34:52.590034+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:43:57.635951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389600+0000","last_change":"2023-07-27T20:34:34.309744+0000","last_active":"2023-07-27T20:34:52.389600+0000","last_peered":"2023-07-27T20:34:52.389600+0000","last_clean":"2023-07-27T20:34:52.389600+0000","last_became_active":"2023-07-27T20:34:34.309438+0000","last_became_peered":"2023-07-27T20:34:34.309438+0000","last_unstale":"2023-07-27T20:34:52.389600+0000","last_undegraded":"2023-07-27T20:34:52.389600+0000","last_fullsized":"2023-07-27T20:34:52.389600+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:46:11.189341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590580+0000","last_change":"2023-07-27T20:34:51.157055+0000","last_active":"2023-07-27T20:34:52.590580+0000","last_peered":"2023-07-27T20:34:52.590580+0000","last_clean":"2023-07-27T20:34:52.590580+0000","last_became_active":"2023-07-27T20:34:51.156703+0000","last_became_peered":"2023-07-27T20:34:51.156703+0000","last_unstale":"2023-07-27T20:34:52.590580+0000","last_undegraded":"2023-07-27T20:34:52.590580+0000","last_fullsized":"2023-07-27T20:34:52.590580+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:09:29.041164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131929+0000","last_change":"2023-07-27T20:34:34.300111+0000","last_active":"2023-07-27T20:34:52.131929+0000","last_peered":"2023-07-27T20:34:52.131929+0000","last_clean":"2023-07-27T20:34:52.131929+0000","last_became_active":"2023-07-27T20:34:34.298555+0000","last_became_peered":"2023-07-27T20:34:34.298555+0000","last_unstale":"2023-07-27T20:34:52.131929+0000","last_undegraded":"2023-07-27T20:34:52.131929+0000","last_fullsized":"2023-07-27T20:34:52.131929+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:08:36.407199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.133088+0000","last_change":"2023-07-27T20:34:51.144866+0000","last_active":"2023-07-27T20:34:52.133088+0000","last_peered":"2023-07-27T20:34:52.133088+0000","last_clean":"2023-07-27T20:34:52.133088+0000","last_became_active":"2023-07-27T20:34:51.143994+0000","last_became_peered":"2023-07-27T20:34:51.143994+0000","last_unstale":"2023-07-27T20:34:52.133088+0000","last_undegraded":"2023-07-27T20:34:52.133088+0000","last_fullsized":"2023-07-27T20:34:52.133088+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:54:17.622889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389507+0000","last_change":"2023-07-27T20:34:34.299682+0000","last_active":"2023-07-27T20:34:52.389507+0000","last_peered":"2023-07-27T20:34:52.389507+0000","last_clean":"2023-07-27T20:34:52.389507+0000","last_became_active":"2023-07-27T20:34:34.299402+0000","last_became_peered":"2023-07-27T20:34:34.299402+0000","last_unstale":"2023-07-27T20:34:52.389507+0000","last_undegraded":"2023-07-27T20:34:52.389507+0000","last_fullsized":"2023-07-27T20:34:52.389507+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:16:30.544846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209756+0000","last_change":"2023-07-27T20:34:51.160605+0000","last_active":"2023-07-27T20:34:53.209756+0000","last_peered":"2023-07-27T20:34:53.209756+0000","last_clean":"2023-07-27T20:34:53.209756+0000","last_became_active":"2023-07-27T20:34:51.160330+0000","last_became_peered":"2023-07-27T20:34:51.160330+0000","last_unstale":"2023-07-27T20:34:53.209756+0000","last_undegraded":"2023-07-27T20:34:53.209756+0000","last_fullsized":"2023-07-27T20:34:53.209756+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:16:27.809706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.552868+0000","last_change":"2023-07-27T20:34:34.320185+0000","last_active":"2023-07-27T20:34:53.552868+0000","last_peered":"2023-07-27T20:34:53.552868+0000","last_clean":"2023-07-27T20:34:53.552868+0000","last_became_active":"2023-07-27T20:34:34.319865+0000","last_became_peered":"2023-07-27T20:34:34.319865+0000","last_unstale":"2023-07-27T20:34:53.552868+0000","last_undegraded":"2023-07-27T20:34:53.552868+0000","last_fullsized":"2023-07-27T20:34:53.552868+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:18:57.338563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590718+0000","last_change":"2023-07-27T20:34:51.160280+0000","last_active":"2023-07-27T20:34:52.590718+0000","last_peered":"2023-07-27T20:34:52.590718+0000","last_clean":"2023-07-27T20:34:52.590718+0000","last_became_active":"2023-07-27T20:34:51.159951+0000","last_became_peered":"2023-07-27T20:34:51.159951+0000","last_unstale":"2023-07-27T20:34:52.590718+0000","last_undegraded":"2023-07-27T20:34:52.590718+0000","last_fullsized":"2023-07-27T20:34:52.590718+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:16:27.809706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.552968+0000","last_change":"2023-07-27T20:34:34.297379+0000","last_active":"2023-07-27T20:34:53.552968+0000","last_peered":"2023-07-27T20:34:53.552968+0000","last_clean":"2023-07-27T20:34:53.552968+0000","last_became_active":"2023-07-27T20:34:34.297105+0000","last_became_peered":"2023-07-27T20:34:34.297105+0000","last_unstale":"2023-07-27T20:34:53.552968+0000","last_undegraded":"2023-07-27T20:34:53.552968+0000","last_fullsized":"2023-07-27T20:34:53.552968+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:37:03.586400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132127+0000","last_change":"2023-07-27T20:34:51.153937+0000","last_active":"2023-07-27T20:34:52.132127+0000","last_peered":"2023-07-27T20:34:52.132127+0000","last_clean":"2023-07-27T20:34:52.132127+0000","last_became_active":"2023-07-27T20:34:51.153655+0000","last_became_peered":"2023-07-27T20:34:51.153655+0000","last_unstale":"2023-07-27T20:34:52.132127+0000","last_undegraded":"2023-07-27T20:34:52.132127+0000","last_fullsized":"2023-07-27T20:34:52.132127+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:53:22.181258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209311+0000","last_change":"2023-07-27T20:34:34.321045+0000","last_active":"2023-07-27T20:34:53.209311+0000","last_peered":"2023-07-27T20:34:53.209311+0000","last_clean":"2023-07-27T20:34:53.209311+0000","last_became_active":"2023-07-27T20:34:34.320433+0000","last_became_peered":"2023-07-27T20:34:34.320433+0000","last_unstale":"2023-07-27T20:34:53.209311+0000","last_undegraded":"2023-07-27T20:34:53.209311+0000","last_fullsized":"2023-07-27T20:34:53.209311+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:56:42.150862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131465+0000","last_change":"2023-07-27T20:34:51.136021+0000","last_active":"2023-07-27T20:34:52.131465+0000","last_peered":"2023-07-27T20:34:52.131465+0000","last_clean":"2023-07-27T20:34:52.131465+0000","last_became_active":"2023-07-27T20:34:51.135735+0000","last_became_peered":"2023-07-27T20:34:51.135735+0000","last_unstale":"2023-07-27T20:34:52.131465+0000","last_undegraded":"2023-07-27T20:34:52.131465+0000","last_fullsized":"2023-07-27T20:34:52.131465+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:57:15.496059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130567+0000","last_change":"2023-07-27T20:34:50.180048+0000","last_active":"2023-07-27T20:34:52.130567+0000","last_peered":"2023-07-27T20:34:52.130567+0000","last_clean":"2023-07-27T20:34:52.130567+0000","last_became_active":"2023-07-27T20:34:50.179711+0000","last_became_peered":"2023-07-27T20:34:50.179711+0000","last_unstale":"2023-07-27T20:34:52.130567+0000","last_undegraded":"2023-07-27T20:34:52.130567+0000","last_fullsized":"2023-07-27T20:34:52.130567+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:41:28.847534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132591+0000","last_change":"2023-07-27T20:34:34.325790+0000","last_active":"2023-07-27T20:34:52.132591+0000","last_peered":"2023-07-27T20:34:52.132591+0000","last_clean":"2023-07-27T20:34:52.132591+0000","last_became_active":"2023-07-27T20:34:34.325387+0000","last_became_peered":"2023-07-27T20:34:34.325387+0000","last_unstale":"2023-07-27T20:34:52.132591+0000","last_undegraded":"2023-07-27T20:34:52.132591+0000","last_fullsized":"2023-07-27T20:34:52.132591+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:01:22.177518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"61'4","reported_seq":25,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.133234+0000","last_change":"2023-07-27T20:34:33.303138+0000","last_active":"2023-07-27T20:34:52.133234+0000","last_peered":"2023-07-27T20:34:52.133234+0000","last_clean":"2023-07-27T20:34:52.133234+0000","last_became_active":"2023-07-27T20:34:33.302808+0000","last_became_peered":"2023-07-27T20:34:33.302808+0000","last_unstale":"2023-07-27T20:34:52.133234+0000","last_undegraded":"2023-07-27T20:34:52.133234+0000","last_fullsized":"2023-07-27T20:34:52.133234+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:01:49.260152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389560+0000","last_change":"2023-07-27T20:34:51.145286+0000","last_active":"2023-07-27T20:34:52.389560+0000","last_peered":"2023-07-27T20:34:52.389560+0000","last_clean":"2023-07-27T20:34:52.389560+0000","last_became_active":"2023-07-27T20:34:51.145030+0000","last_became_peered":"2023-07-27T20:34:51.145030+0000","last_unstale":"2023-07-27T20:34:52.389560+0000","last_undegraded":"2023-07-27T20:34:52.389560+0000","last_fullsized":"2023-07-27T20:34:52.389560+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:55:19.156844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.589690+0000","last_change":"2023-07-27T20:34:50.179618+0000","last_active":"2023-07-27T20:34:52.589690+0000","last_peered":"2023-07-27T20:34:52.589690+0000","last_clean":"2023-07-27T20:34:52.589690+0000","last_became_active":"2023-07-27T20:34:50.179116+0000","last_became_peered":"2023-07-27T20:34:50.179116+0000","last_unstale":"2023-07-27T20:34:52.589690+0000","last_undegraded":"2023-07-27T20:34:52.589690+0000","last_fullsized":"2023-07-27T20:34:52.589690+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:03:50.637289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.939065+0000","last_change":"2023-07-27T20:34:34.298335+0000","last_active":"2023-07-27T20:34:52.939065+0000","last_peered":"2023-07-27T20:34:52.939065+0000","last_clean":"2023-07-27T20:34:52.939065+0000","last_became_active":"2023-07-27T20:34:34.298050+0000","last_became_peered":"2023-07-27T20:34:34.298050+0000","last_unstale":"2023-07-27T20:34:52.939065+0000","last_undegraded":"2023-07-27T20:34:52.939065+0000","last_fullsized":"2023-07-27T20:34:52.939065+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:41:23.899695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"61'1","reported_seq":22,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131076+0000","last_change":"2023-07-27T20:34:33.298365+0000","last_active":"2023-07-27T20:34:52.131076+0000","last_peered":"2023-07-27T20:34:52.131076+0000","last_clean":"2023-07-27T20:34:52.131076+0000","last_became_active":"2023-07-27T20:34:33.298105+0000","last_became_peered":"2023-07-27T20:34:33.298105+0000","last_unstale":"2023-07-27T20:34:52.131076+0000","last_undegraded":"2023-07-27T20:34:52.131076+0000","last_fullsized":"2023-07-27T20:34:52.131076+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:55:41.265066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.589923+0000","last_change":"2023-07-27T20:34:51.157751+0000","last_active":"2023-07-27T20:34:52.589923+0000","last_peered":"2023-07-27T20:34:52.589923+0000","last_clean":"2023-07-27T20:34:52.589923+0000","last_became_active":"2023-07-27T20:34:51.157398+0000","last_became_peered":"2023-07-27T20:34:51.157398+0000","last_unstale":"2023-07-27T20:34:52.589923+0000","last_undegraded":"2023-07-27T20:34:52.589923+0000","last_fullsized":"2023-07-27T20:34:52.589923+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:07:47.085566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"65'1","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132078+0000","last_change":"2023-07-27T20:34:50.182478+0000","last_active":"2023-07-27T20:34:52.132078+0000","last_peered":"2023-07-27T20:34:52.132078+0000","last_clean":"2023-07-27T20:34:52.132078+0000","last_became_active":"2023-07-27T20:34:50.182129+0000","last_became_peered":"2023-07-27T20:34:50.182129+0000","last_unstale":"2023-07-27T20:34:52.132078+0000","last_undegraded":"2023-07-27T20:34:52.132078+0000","last_fullsized":"2023-07-27T20:34:52.132078+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:21:54.178397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210569+0000","last_change":"2023-07-27T20:34:34.323261+0000","last_active":"2023-07-27T20:34:53.210569+0000","last_peered":"2023-07-27T20:34:53.210569+0000","last_clean":"2023-07-27T20:34:53.210569+0000","last_became_active":"2023-07-27T20:34:34.322945+0000","last_became_peered":"2023-07-27T20:34:34.322945+0000","last_unstale":"2023-07-27T20:34:53.210569+0000","last_undegraded":"2023-07-27T20:34:53.210569+0000","last_fullsized":"2023-07-27T20:34:53.210569+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:54:18.189843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"61'2","reported_seq":23,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132465+0000","last_change":"2023-07-27T20:34:33.303171+0000","last_active":"2023-07-27T20:34:52.132465+0000","last_peered":"2023-07-27T20:34:52.132465+0000","last_clean":"2023-07-27T20:34:52.132465+0000","last_became_active":"2023-07-27T20:34:33.302865+0000","last_became_peered":"2023-07-27T20:34:33.302865+0000","last_unstale":"2023-07-27T20:34:52.132465+0000","last_undegraded":"2023-07-27T20:34:52.132465+0000","last_fullsized":"2023-07-27T20:34:52.132465+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:19:24.761135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.133053+0000","last_change":"2023-07-27T20:34:51.151625+0000","last_active":"2023-07-27T20:34:52.133053+0000","last_peered":"2023-07-27T20:34:52.133053+0000","last_clean":"2023-07-27T20:34:52.133053+0000","last_became_active":"2023-07-27T20:34:51.151311+0000","last_became_peered":"2023-07-27T20:34:51.151311+0000","last_unstale":"2023-07-27T20:34:52.133053+0000","last_undegraded":"2023-07-27T20:34:52.133053+0000","last_fullsized":"2023-07-27T20:34:52.133053+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:50:38.557507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"65'1","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131461+0000","last_change":"2023-07-27T20:34:50.177790+0000","last_active":"2023-07-27T20:34:52.131461+0000","last_peered":"2023-07-27T20:34:52.131461+0000","last_clean":"2023-07-27T20:34:52.131461+0000","last_became_active":"2023-07-27T20:34:50.177484+0000","last_became_peered":"2023-07-27T20:34:50.177484+0000","last_unstale":"2023-07-27T20:34:52.131461+0000","last_undegraded":"2023-07-27T20:34:52.131461+0000","last_fullsized":"2023-07-27T20:34:52.131461+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:54:50.777487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.133055+0000","last_change":"2023-07-27T20:34:34.314330+0000","last_active":"2023-07-27T20:34:52.133055+0000","last_peered":"2023-07-27T20:34:52.133055+0000","last_clean":"2023-07-27T20:34:52.133055+0000","last_became_active":"2023-07-27T20:34:34.314054+0000","last_became_peered":"2023-07-27T20:34:34.314054+0000","last_unstale":"2023-07-27T20:34:52.133055+0000","last_undegraded":"2023-07-27T20:34:52.133055+0000","last_fullsized":"2023-07-27T20:34:52.133055+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:44:22.109843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"61'2","reported_seq":23,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210010+0000","last_change":"2023-07-27T20:34:33.307004+0000","last_active":"2023-07-27T20:34:53.210010+0000","last_peered":"2023-07-27T20:34:53.210010+0000","last_clean":"2023-07-27T20:34:53.210010+0000","last_became_active":"2023-07-27T20:34:33.306710+0000","last_became_peered":"2023-07-27T20:34:33.306710+0000","last_unstale":"2023-07-27T20:34:53.210010+0000","last_undegraded":"2023-07-27T20:34:53.210010+0000","last_fullsized":"2023-07-27T20:34:53.210010+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:14:22.083030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209886+0000","last_change":"2023-07-27T20:34:51.158511+0000","last_active":"2023-07-27T20:34:53.209886+0000","last_peered":"2023-07-27T20:34:53.209886+0000","last_clean":"2023-07-27T20:34:53.209886+0000","last_became_active":"2023-07-27T20:34:51.158268+0000","last_became_peered":"2023-07-27T20:34:51.158268+0000","last_unstale":"2023-07-27T20:34:53.209886+0000","last_undegraded":"2023-07-27T20:34:53.209886+0000","last_fullsized":"2023-07-27T20:34:53.209886+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:54:15.988919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"65'2","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130531+0000","last_change":"2023-07-27T20:34:50.180037+0000","last_active":"2023-07-27T20:34:52.130531+0000","last_peered":"2023-07-27T20:34:52.130531+0000","last_clean":"2023-07-27T20:34:52.130531+0000","last_became_active":"2023-07-27T20:34:50.179747+0000","last_became_peered":"2023-07-27T20:34:50.179747+0000","last_unstale":"2023-07-27T20:34:52.130531+0000","last_undegraded":"2023-07-27T20:34:52.130531+0000","last_fullsized":"2023-07-27T20:34:52.130531+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:10:01.966530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.553071+0000","last_change":"2023-07-27T20:34:34.304872+0000","last_active":"2023-07-27T20:34:53.553071+0000","last_peered":"2023-07-27T20:34:53.553071+0000","last_clean":"2023-07-27T20:34:53.553071+0000","last_became_active":"2023-07-27T20:34:34.304583+0000","last_became_peered":"2023-07-27T20:34:34.304583+0000","last_unstale":"2023-07-27T20:34:53.553071+0000","last_undegraded":"2023-07-27T20:34:53.553071+0000","last_fullsized":"2023-07-27T20:34:53.553071+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:33:06.823968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"61'1","reported_seq":22,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389706+0000","last_change":"2023-07-27T20:34:33.303472+0000","last_active":"2023-07-27T20:34:52.389706+0000","last_peered":"2023-07-27T20:34:52.389706+0000","last_clean":"2023-07-27T20:34:52.389706+0000","last_became_active":"2023-07-27T20:34:33.303211+0000","last_became_peered":"2023-07-27T20:34:33.303211+0000","last_unstale":"2023-07-27T20:34:52.389706+0000","last_undegraded":"2023-07-27T20:34:52.389706+0000","last_fullsized":"2023-07-27T20:34:52.389706+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:46:04.542928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132813+0000","last_change":"2023-07-27T20:34:51.151356+0000","last_active":"2023-07-27T20:34:52.132813+0000","last_peered":"2023-07-27T20:34:52.132813+0000","last_clean":"2023-07-27T20:34:52.132813+0000","last_became_active":"2023-07-27T20:34:51.151082+0000","last_became_peered":"2023-07-27T20:34:51.151082+0000","last_unstale":"2023-07-27T20:34:52.132813+0000","last_undegraded":"2023-07-27T20:34:52.132813+0000","last_fullsized":"2023-07-27T20:34:52.132813+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:30:31.686019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"65'2","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130615+0000","last_change":"2023-07-27T20:34:50.181891+0000","last_active":"2023-07-27T20:34:52.130615+0000","last_peered":"2023-07-27T20:34:52.130615+0000","last_clean":"2023-07-27T20:34:52.130615+0000","last_became_active":"2023-07-27T20:34:50.181567+0000","last_became_peered":"2023-07-27T20:34:50.181567+0000","last_unstale":"2023-07-27T20:34:52.130615+0000","last_undegraded":"2023-07-27T20:34:52.130615+0000","last_fullsized":"2023-07-27T20:34:52.130615+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:22:09.691362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131948+0000","last_change":"2023-07-27T20:34:34.309855+0000","last_active":"2023-07-27T20:34:52.131948+0000","last_peered":"2023-07-27T20:34:52.131948+0000","last_clean":"2023-07-27T20:34:52.131948+0000","last_became_active":"2023-07-27T20:34:34.309553+0000","last_became_peered":"2023-07-27T20:34:34.309553+0000","last_unstale":"2023-07-27T20:34:52.131948+0000","last_undegraded":"2023-07-27T20:34:52.131948+0000","last_fullsized":"2023-07-27T20:34:52.131948+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:19:48.357135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"61'1","reported_seq":22,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209328+0000","last_change":"2023-07-27T20:34:33.307265+0000","last_active":"2023-07-27T20:34:53.209328+0000","last_peered":"2023-07-27T20:34:53.209328+0000","last_clean":"2023-07-27T20:34:53.209328+0000","last_became_active":"2023-07-27T20:34:33.306583+0000","last_became_peered":"2023-07-27T20:34:33.306583+0000","last_unstale":"2023-07-27T20:34:53.209328+0000","last_undegraded":"2023-07-27T20:34:53.209328+0000","last_fullsized":"2023-07-27T20:34:53.209328+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:09:11.155306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132022+0000","last_change":"2023-07-27T20:34:51.155271+0000","last_active":"2023-07-27T20:34:52.132022+0000","last_peered":"2023-07-27T20:34:52.132022+0000","last_clean":"2023-07-27T20:34:52.132022+0000","last_became_active":"2023-07-27T20:34:51.154957+0000","last_became_peered":"2023-07-27T20:34:51.154957+0000","last_unstale":"2023-07-27T20:34:52.132022+0000","last_undegraded":"2023-07-27T20:34:52.132022+0000","last_fullsized":"2023-07-27T20:34:52.132022+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:57:48.534355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"65'4","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210538+0000","last_change":"2023-07-27T20:34:50.193860+0000","last_active":"2023-07-27T20:34:53.210538+0000","last_peered":"2023-07-27T20:34:53.210538+0000","last_clean":"2023-07-27T20:34:53.210538+0000","last_became_active":"2023-07-27T20:34:50.193550+0000","last_became_peered":"2023-07-27T20:34:50.193550+0000","last_unstale":"2023-07-27T20:34:53.210538+0000","last_undegraded":"2023-07-27T20:34:53.210538+0000","last_fullsized":"2023-07-27T20:34:53.210538+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:13:03.285306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938426+0000","last_change":"2023-07-27T20:34:34.305104+0000","last_active":"2023-07-27T20:34:52.938426+0000","last_peered":"2023-07-27T20:34:52.938426+0000","last_clean":"2023-07-27T20:34:52.938426+0000","last_became_active":"2023-07-27T20:34:34.304828+0000","last_became_peered":"2023-07-27T20:34:34.304828+0000","last_unstale":"2023-07-27T20:34:52.938426+0000","last_undegraded":"2023-07-27T20:34:52.938426+0000","last_fullsized":"2023-07-27T20:34:52.938426+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:46:28.161781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.589779+0000","last_change":"2023-07-27T20:34:33.304005+0000","last_active":"2023-07-27T20:34:52.589779+0000","last_peered":"2023-07-27T20:34:52.589779+0000","last_clean":"2023-07-27T20:34:52.589779+0000","last_became_active":"2023-07-27T20:34:33.303744+0000","last_became_peered":"2023-07-27T20:34:33.303744+0000","last_unstale":"2023-07-27T20:34:52.589779+0000","last_undegraded":"2023-07-27T20:34:52.589779+0000","last_fullsized":"2023-07-27T20:34:52.589779+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:08:35.251600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210344+0000","last_change":"2023-07-27T20:34:51.152510+0000","last_active":"2023-07-27T20:34:53.210344+0000","last_peered":"2023-07-27T20:34:53.210344+0000","last_clean":"2023-07-27T20:34:53.210344+0000","last_became_active":"2023-07-27T20:34:51.151665+0000","last_became_peered":"2023-07-27T20:34:51.151665+0000","last_unstale":"2023-07-27T20:34:53.210344+0000","last_undegraded":"2023-07-27T20:34:53.210344+0000","last_fullsized":"2023-07-27T20:34:53.210344+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:56:38.080744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"65'1","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132059+0000","last_change":"2023-07-27T20:34:50.180779+0000","last_active":"2023-07-27T20:34:52.132059+0000","last_peered":"2023-07-27T20:34:52.132059+0000","last_clean":"2023-07-27T20:34:52.132059+0000","last_became_active":"2023-07-27T20:34:50.180337+0000","last_became_peered":"2023-07-27T20:34:50.180337+0000","last_unstale":"2023-07-27T20:34:52.132059+0000","last_undegraded":"2023-07-27T20:34:52.132059+0000","last_fullsized":"2023-07-27T20:34:52.132059+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:10:01.966530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130184+0000","last_change":"2023-07-27T20:34:34.310350+0000","last_active":"2023-07-27T20:34:52.130184+0000","last_peered":"2023-07-27T20:34:52.130184+0000","last_clean":"2023-07-27T20:34:52.130184+0000","last_became_active":"2023-07-27T20:34:34.310068+0000","last_became_peered":"2023-07-27T20:34:34.310068+0000","last_unstale":"2023-07-27T20:34:52.130184+0000","last_undegraded":"2023-07-27T20:34:52.130184+0000","last_fullsized":"2023-07-27T20:34:52.130184+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:27:32.975304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938196+0000","last_change":"2023-07-27T20:34:33.299254+0000","last_active":"2023-07-27T20:34:52.938196+0000","last_peered":"2023-07-27T20:34:52.938196+0000","last_clean":"2023-07-27T20:34:52.938196+0000","last_became_active":"2023-07-27T20:34:33.298978+0000","last_became_peered":"2023-07-27T20:34:33.298978+0000","last_unstale":"2023-07-27T20:34:52.938196+0000","last_undegraded":"2023-07-27T20:34:52.938196+0000","last_fullsized":"2023-07-27T20:34:52.938196+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:57:02.656808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.589662+0000","last_change":"2023-07-27T20:34:51.157170+0000","last_active":"2023-07-27T20:34:52.589662+0000","last_peered":"2023-07-27T20:34:52.589662+0000","last_clean":"2023-07-27T20:34:52.589662+0000","last_became_active":"2023-07-27T20:34:51.156897+0000","last_became_peered":"2023-07-27T20:34:51.156897+0000","last_unstale":"2023-07-27T20:34:52.589662+0000","last_undegraded":"2023-07-27T20:34:52.589662+0000","last_fullsized":"2023-07-27T20:34:52.589662+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:32:50.988054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.553210+0000","last_change":"2023-07-27T20:34:50.185449+0000","last_active":"2023-07-27T20:34:53.553210+0000","last_peered":"2023-07-27T20:34:53.553210+0000","last_clean":"2023-07-27T20:34:53.553210+0000","last_became_active":"2023-07-27T20:34:50.185157+0000","last_became_peered":"2023-07-27T20:34:50.185157+0000","last_unstale":"2023-07-27T20:34:53.553210+0000","last_undegraded":"2023-07-27T20:34:53.553210+0000","last_fullsized":"2023-07-27T20:34:53.553210+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:47:03.582088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.553357+0000","last_change":"2023-07-27T20:34:34.313397+0000","last_active":"2023-07-27T20:34:53.553357+0000","last_peered":"2023-07-27T20:34:53.553357+0000","last_clean":"2023-07-27T20:34:53.553357+0000","last_became_active":"2023-07-27T20:34:34.313128+0000","last_became_peered":"2023-07-27T20:34:34.313128+0000","last_unstale":"2023-07-27T20:34:53.553357+0000","last_undegraded":"2023-07-27T20:34:53.553357+0000","last_fullsized":"2023-07-27T20:34:53.553357+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:34:48.784517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132509+0000","last_change":"2023-07-27T20:34:33.299760+0000","last_active":"2023-07-27T20:34:52.132509+0000","last_peered":"2023-07-27T20:34:52.132509+0000","last_clean":"2023-07-27T20:34:52.132509+0000","last_became_active":"2023-07-27T20:34:33.299488+0000","last_became_peered":"2023-07-27T20:34:33.299488+0000","last_unstale":"2023-07-27T20:34:52.132509+0000","last_undegraded":"2023-07-27T20:34:52.132509+0000","last_fullsized":"2023-07-27T20:34:52.132509+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:42:21.819263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.589729+0000","last_change":"2023-07-27T20:34:51.158440+0000","last_active":"2023-07-27T20:34:52.589729+0000","last_peered":"2023-07-27T20:34:52.589729+0000","last_clean":"2023-07-27T20:34:52.589729+0000","last_became_active":"2023-07-27T20:34:51.158195+0000","last_became_peered":"2023-07-27T20:34:51.158195+0000","last_unstale":"2023-07-27T20:34:52.589729+0000","last_undegraded":"2023-07-27T20:34:52.589729+0000","last_fullsized":"2023-07-27T20:34:52.589729+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:54:25.575394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"65'8","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130247+0000","last_change":"2023-07-27T20:34:50.174398+0000","last_active":"2023-07-27T20:34:52.130247+0000","last_peered":"2023-07-27T20:34:52.130247+0000","last_clean":"2023-07-27T20:34:52.130247+0000","last_became_active":"2023-07-27T20:34:50.174069+0000","last_became_peered":"2023-07-27T20:34:50.174069+0000","last_unstale":"2023-07-27T20:34:52.130247+0000","last_undegraded":"2023-07-27T20:34:52.130247+0000","last_fullsized":"2023-07-27T20:34:52.130247+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:59:13.975092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.133051+0000","last_change":"2023-07-27T20:34:34.324198+0000","last_active":"2023-07-27T20:34:52.133051+0000","last_peered":"2023-07-27T20:34:52.133051+0000","last_clean":"2023-07-27T20:34:52.133051+0000","last_became_active":"2023-07-27T20:34:34.323865+0000","last_became_peered":"2023-07-27T20:34:34.323865+0000","last_unstale":"2023-07-27T20:34:52.133051+0000","last_undegraded":"2023-07-27T20:34:52.133051+0000","last_fullsized":"2023-07-27T20:34:52.133051+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:03:17.266643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210618+0000","last_change":"2023-07-27T20:34:33.309943+0000","last_active":"2023-07-27T20:34:53.210618+0000","last_peered":"2023-07-27T20:34:53.210618+0000","last_clean":"2023-07-27T20:34:53.210618+0000","last_became_active":"2023-07-27T20:34:33.309650+0000","last_became_peered":"2023-07-27T20:34:33.309650+0000","last_unstale":"2023-07-27T20:34:53.210618+0000","last_undegraded":"2023-07-27T20:34:53.210618+0000","last_fullsized":"2023-07-27T20:34:53.210618+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:58:22.169362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130293+0000","last_change":"2023-07-27T20:34:51.142784+0000","last_active":"2023-07-27T20:34:52.130293+0000","last_peered":"2023-07-27T20:34:52.130293+0000","last_clean":"2023-07-27T20:34:52.130293+0000","last_became_active":"2023-07-27T20:34:51.142488+0000","last_became_peered":"2023-07-27T20:34:51.142488+0000","last_unstale":"2023-07-27T20:34:52.130293+0000","last_undegraded":"2023-07-27T20:34:52.130293+0000","last_fullsized":"2023-07-27T20:34:52.130293+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:08:53.285539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"65'2","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590315+0000","last_change":"2023-07-27T20:34:50.184191+0000","last_active":"2023-07-27T20:34:52.590315+0000","last_peered":"2023-07-27T20:34:52.590315+0000","last_clean":"2023-07-27T20:34:52.590315+0000","last_became_active":"2023-07-27T20:34:50.183938+0000","last_became_peered":"2023-07-27T20:34:50.183938+0000","last_unstale":"2023-07-27T20:34:52.590315+0000","last_undegraded":"2023-07-27T20:34:52.590315+0000","last_fullsized":"2023-07-27T20:34:52.590315+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:56:58.022354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210337+0000","last_change":"2023-07-27T20:34:34.313276+0000","last_active":"2023-07-27T20:34:53.210337+0000","last_peered":"2023-07-27T20:34:53.210337+0000","last_clean":"2023-07-27T20:34:53.210337+0000","last_became_active":"2023-07-27T20:34:34.310175+0000","last_became_peered":"2023-07-27T20:34:34.310175+0000","last_unstale":"2023-07-27T20:34:53.210337+0000","last_undegraded":"2023-07-27T20:34:53.210337+0000","last_fullsized":"2023-07-27T20:34:53.210337+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:59:03.811289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"61'3","reported_seq":24,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389745+0000","last_change":"2023-07-27T20:34:33.302814+0000","last_active":"2023-07-27T20:34:52.389745+0000","last_peered":"2023-07-27T20:34:52.389745+0000","last_clean":"2023-07-27T20:34:52.389745+0000","last_became_active":"2023-07-27T20:34:33.302504+0000","last_became_peered":"2023-07-27T20:34:33.302504+0000","last_unstale":"2023-07-27T20:34:52.389745+0000","last_undegraded":"2023-07-27T20:34:52.389745+0000","last_fullsized":"2023-07-27T20:34:52.389745+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:43:06.440422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132547+0000","last_change":"2023-07-27T20:34:51.136033+0000","last_active":"2023-07-27T20:34:52.132547+0000","last_peered":"2023-07-27T20:34:52.132547+0000","last_clean":"2023-07-27T20:34:52.132547+0000","last_became_active":"2023-07-27T20:34:51.135756+0000","last_became_peered":"2023-07-27T20:34:51.135756+0000","last_unstale":"2023-07-27T20:34:52.132547+0000","last_undegraded":"2023-07-27T20:34:52.132547+0000","last_fullsized":"2023-07-27T20:34:52.132547+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:51:33.389165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389229+0000","last_change":"2023-07-27T20:34:50.177834+0000","last_active":"2023-07-27T20:34:52.389229+0000","last_peered":"2023-07-27T20:34:52.389229+0000","last_clean":"2023-07-27T20:34:52.389229+0000","last_became_active":"2023-07-27T20:34:50.177565+0000","last_became_peered":"2023-07-27T20:34:50.177565+0000","last_unstale":"2023-07-27T20:34:52.389229+0000","last_undegraded":"2023-07-27T20:34:52.389229+0000","last_fullsized":"2023-07-27T20:34:52.389229+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:33:47.994729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.939052+0000","last_change":"2023-07-27T20:34:34.302062+0000","last_active":"2023-07-27T20:34:52.939052+0000","last_peered":"2023-07-27T20:34:52.939052+0000","last_clean":"2023-07-27T20:34:52.939052+0000","last_became_active":"2023-07-27T20:34:34.301760+0000","last_became_peered":"2023-07-27T20:34:34.301760+0000","last_unstale":"2023-07-27T20:34:52.939052+0000","last_undegraded":"2023-07-27T20:34:52.939052+0000","last_fullsized":"2023-07-27T20:34:52.939052+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:51:30.923164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"62'8","reported_seq":29,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590580+0000","last_change":"2023-07-27T20:34:33.300792+0000","last_active":"2023-07-27T20:34:52.590580+0000","last_peered":"2023-07-27T20:34:52.590580+0000","last_clean":"2023-07-27T20:34:52.590580+0000","last_became_active":"2023-07-27T20:34:33.300452+0000","last_became_peered":"2023-07-27T20:34:33.300452+0000","last_unstale":"2023-07-27T20:34:52.590580+0000","last_undegraded":"2023-07-27T20:34:52.590580+0000","last_fullsized":"2023-07-27T20:34:52.590580+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:34:08.093182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3261,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130524+0000","last_change":"2023-07-27T20:34:51.158451+0000","last_active":"2023-07-27T20:34:52.130524+0000","last_peered":"2023-07-27T20:34:52.130524+0000","last_clean":"2023-07-27T20:34:52.130524+0000","last_became_active":"2023-07-27T20:34:51.158192+0000","last_became_peered":"2023-07-27T20:34:51.158192+0000","last_unstale":"2023-07-27T20:34:52.130524+0000","last_undegraded":"2023-07-27T20:34:52.130524+0000","last_fullsized":"2023-07-27T20:34:52.130524+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:21:55.185244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"65'3","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209761+0000","last_change":"2023-07-27T20:34:50.189853+0000","last_active":"2023-07-27T20:34:53.209761+0000","last_peered":"2023-07-27T20:34:53.209761+0000","last_clean":"2023-07-27T20:34:53.209761+0000","last_became_active":"2023-07-27T20:34:50.189179+0000","last_became_peered":"2023-07-27T20:34:50.189179+0000","last_unstale":"2023-07-27T20:34:53.209761+0000","last_undegraded":"2023-07-27T20:34:53.209761+0000","last_fullsized":"2023-07-27T20:34:53.209761+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:16:38.123878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132109+0000","last_change":"2023-07-27T20:34:34.309848+0000","last_active":"2023-07-27T20:34:52.132109+0000","last_peered":"2023-07-27T20:34:52.132109+0000","last_clean":"2023-07-27T20:34:52.132109+0000","last_became_active":"2023-07-27T20:34:34.309567+0000","last_became_peered":"2023-07-27T20:34:34.309567+0000","last_unstale":"2023-07-27T20:34:52.132109+0000","last_undegraded":"2023-07-27T20:34:52.132109+0000","last_fullsized":"2023-07-27T20:34:52.132109+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:26:56.593889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"61'2","reported_seq":23,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.589878+0000","last_change":"2023-07-27T20:34:33.303304+0000","last_active":"2023-07-27T20:34:52.589878+0000","last_peered":"2023-07-27T20:34:52.589878+0000","last_clean":"2023-07-27T20:34:52.589878+0000","last_became_active":"2023-07-27T20:34:33.303051+0000","last_became_peered":"2023-07-27T20:34:33.303051+0000","last_unstale":"2023-07-27T20:34:52.589878+0000","last_undegraded":"2023-07-27T20:34:52.589878+0000","last_fullsized":"2023-07-27T20:34:52.589878+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:19:38.812347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131831+0000","last_change":"2023-07-27T20:34:51.145057+0000","last_active":"2023-07-27T20:34:52.131831+0000","last_peered":"2023-07-27T20:34:52.131831+0000","last_clean":"2023-07-27T20:34:52.131831+0000","last_became_active":"2023-07-27T20:34:51.144291+0000","last_became_peered":"2023-07-27T20:34:51.144291+0000","last_unstale":"2023-07-27T20:34:52.131831+0000","last_undegraded":"2023-07-27T20:34:52.131831+0000","last_fullsized":"2023-07-27T20:34:52.131831+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:20:46.883871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"65'6","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.552994+0000","last_change":"2023-07-27T20:34:50.184498+0000","last_active":"2023-07-27T20:34:53.552994+0000","last_peered":"2023-07-27T20:34:53.552994+0000","last_clean":"2023-07-27T20:34:53.552994+0000","last_became_active":"2023-07-27T20:34:50.184171+0000","last_became_peered":"2023-07-27T20:34:50.184171+0000","last_unstale":"2023-07-27T20:34:53.552994+0000","last_undegraded":"2023-07-27T20:34:53.552994+0000","last_fullsized":"2023-07-27T20:34:53.552994+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:42:35.757873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.552917+0000","last_change":"2023-07-27T20:34:34.297996+0000","last_active":"2023-07-27T20:34:53.552917+0000","last_peered":"2023-07-27T20:34:53.552917+0000","last_clean":"2023-07-27T20:34:53.552917+0000","last_became_active":"2023-07-27T20:34:34.297650+0000","last_became_peered":"2023-07-27T20:34:34.297650+0000","last_unstale":"2023-07-27T20:34:53.552917+0000","last_undegraded":"2023-07-27T20:34:53.552917+0000","last_fullsized":"2023-07-27T20:34:53.552917+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:26:48.653404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209475+0000","last_change":"2023-07-27T20:34:33.307281+0000","last_active":"2023-07-27T20:34:53.209475+0000","last_peered":"2023-07-27T20:34:53.209475+0000","last_clean":"2023-07-27T20:34:53.209475+0000","last_became_active":"2023-07-27T20:34:33.306983+0000","last_became_peered":"2023-07-27T20:34:33.306983+0000","last_unstale":"2023-07-27T20:34:53.209475+0000","last_undegraded":"2023-07-27T20:34:53.209475+0000","last_fullsized":"2023-07-27T20:34:53.209475+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:34:08.093182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389560+0000","last_change":"2023-07-27T20:34:51.154228+0000","last_active":"2023-07-27T20:34:52.389560+0000","last_peered":"2023-07-27T20:34:52.389560+0000","last_clean":"2023-07-27T20:34:52.389560+0000","last_became_active":"2023-07-27T20:34:51.153077+0000","last_became_peered":"2023-07-27T20:34:51.153077+0000","last_unstale":"2023-07-27T20:34:52.389560+0000","last_undegraded":"2023-07-27T20:34:52.389560+0000","last_fullsized":"2023-07-27T20:34:52.389560+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:07:01.033930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210836+0000","last_change":"2023-07-27T20:34:50.197307+0000","last_active":"2023-07-27T20:34:53.210836+0000","last_peered":"2023-07-27T20:34:53.210836+0000","last_clean":"2023-07-27T20:34:53.210836+0000","last_became_active":"2023-07-27T20:34:50.196986+0000","last_became_peered":"2023-07-27T20:34:50.196986+0000","last_unstale":"2023-07-27T20:34:53.210836+0000","last_undegraded":"2023-07-27T20:34:53.210836+0000","last_fullsized":"2023-07-27T20:34:53.210836+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:46:08.321868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130376+0000","last_change":"2023-07-27T20:34:34.317382+0000","last_active":"2023-07-27T20:34:52.130376+0000","last_peered":"2023-07-27T20:34:52.130376+0000","last_clean":"2023-07-27T20:34:52.130376+0000","last_became_active":"2023-07-27T20:34:34.317102+0000","last_became_peered":"2023-07-27T20:34:34.317102+0000","last_unstale":"2023-07-27T20:34:52.130376+0000","last_undegraded":"2023-07-27T20:34:52.130376+0000","last_fullsized":"2023-07-27T20:34:52.130376+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:57:31.656015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.552801+0000","last_change":"2023-07-27T20:34:33.301597+0000","last_active":"2023-07-27T20:34:53.552801+0000","last_peered":"2023-07-27T20:34:53.552801+0000","last_clean":"2023-07-27T20:34:53.552801+0000","last_became_active":"2023-07-27T20:34:33.301302+0000","last_became_peered":"2023-07-27T20:34:33.301302+0000","last_unstale":"2023-07-27T20:34:53.552801+0000","last_undegraded":"2023-07-27T20:34:53.552801+0000","last_fullsized":"2023-07-27T20:34:53.552801+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:03:20.295861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.553421+0000","last_change":"2023-07-27T20:34:51.154405+0000","last_active":"2023-07-27T20:34:53.553421+0000","last_peered":"2023-07-27T20:34:53.553421+0000","last_clean":"2023-07-27T20:34:53.553421+0000","last_became_active":"2023-07-27T20:34:51.152287+0000","last_became_peered":"2023-07-27T20:34:51.152287+0000","last_unstale":"2023-07-27T20:34:53.553421+0000","last_undegraded":"2023-07-27T20:34:53.553421+0000","last_fullsized":"2023-07-27T20:34:53.553421+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:13:02.942523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210022+0000","last_change":"2023-07-27T20:34:50.193278+0000","last_active":"2023-07-27T20:34:53.210022+0000","last_peered":"2023-07-27T20:34:53.210022+0000","last_clean":"2023-07-27T20:34:53.210022+0000","last_became_active":"2023-07-27T20:34:50.192976+0000","last_became_peered":"2023-07-27T20:34:50.192976+0000","last_unstale":"2023-07-27T20:34:53.210022+0000","last_undegraded":"2023-07-27T20:34:53.210022+0000","last_fullsized":"2023-07-27T20:34:53.210022+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:57:43.092086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938650+0000","last_change":"2023-07-27T20:34:34.299216+0000","last_active":"2023-07-27T20:34:52.938650+0000","last_peered":"2023-07-27T20:34:52.938650+0000","last_clean":"2023-07-27T20:34:52.938650+0000","last_became_active":"2023-07-27T20:34:34.298877+0000","last_became_peered":"2023-07-27T20:34:34.298877+0000","last_unstale":"2023-07-27T20:34:52.938650+0000","last_undegraded":"2023-07-27T20:34:52.938650+0000","last_fullsized":"2023-07-27T20:34:52.938650+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:44:42.207766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"61'8","reported_seq":29,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131198+0000","last_change":"2023-07-27T20:34:33.301967+0000","last_active":"2023-07-27T20:34:52.131198+0000","last_peered":"2023-07-27T20:34:52.131198+0000","last_clean":"2023-07-27T20:34:52.131198+0000","last_became_active":"2023-07-27T20:34:33.301702+0000","last_became_peered":"2023-07-27T20:34:33.301702+0000","last_unstale":"2023-07-27T20:34:52.131198+0000","last_undegraded":"2023-07-27T20:34:52.131198+0000","last_fullsized":"2023-07-27T20:34:52.131198+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:18:44.105047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130917+0000","last_change":"2023-07-27T20:34:51.157532+0000","last_active":"2023-07-27T20:34:52.130917+0000","last_peered":"2023-07-27T20:34:52.130917+0000","last_clean":"2023-07-27T20:34:52.130917+0000","last_became_active":"2023-07-27T20:34:51.157253+0000","last_became_peered":"2023-07-27T20:34:51.157253+0000","last_unstale":"2023-07-27T20:34:52.130917+0000","last_undegraded":"2023-07-27T20:34:52.130917+0000","last_fullsized":"2023-07-27T20:34:52.130917+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:48:58.682955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209299+0000","last_change":"2023-07-27T20:34:50.197449+0000","last_active":"2023-07-27T20:34:53.209299+0000","last_peered":"2023-07-27T20:34:53.209299+0000","last_clean":"2023-07-27T20:34:53.209299+0000","last_became_active":"2023-07-27T20:34:50.196997+0000","last_became_peered":"2023-07-27T20:34:50.196997+0000","last_unstale":"2023-07-27T20:34:53.209299+0000","last_undegraded":"2023-07-27T20:34:53.209299+0000","last_fullsized":"2023-07-27T20:34:53.209299+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:55:35.402174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130997+0000","last_change":"2023-07-27T20:34:34.294954+0000","last_active":"2023-07-27T20:34:52.130997+0000","last_peered":"2023-07-27T20:34:52.130997+0000","last_clean":"2023-07-27T20:34:52.130997+0000","last_became_active":"2023-07-27T20:34:34.294073+0000","last_became_peered":"2023-07-27T20:34:34.294073+0000","last_unstale":"2023-07-27T20:34:52.130997+0000","last_undegraded":"2023-07-27T20:34:52.130997+0000","last_fullsized":"2023-07-27T20:34:52.130997+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:47:08.096237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"61'2","reported_seq":23,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210763+0000","last_change":"2023-07-27T20:34:33.308165+0000","last_active":"2023-07-27T20:34:53.210763+0000","last_peered":"2023-07-27T20:34:53.210763+0000","last_clean":"2023-07-27T20:34:53.210763+0000","last_became_active":"2023-07-27T20:34:33.307868+0000","last_became_peered":"2023-07-27T20:34:33.307868+0000","last_unstale":"2023-07-27T20:34:53.210763+0000","last_undegraded":"2023-07-27T20:34:53.210763+0000","last_fullsized":"2023-07-27T20:34:53.210763+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:33:01.060593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209248+0000","last_change":"2023-07-27T20:34:51.151384+0000","last_active":"2023-07-27T20:34:53.209248+0000","last_peered":"2023-07-27T20:34:53.209248+0000","last_clean":"2023-07-27T20:34:53.209248+0000","last_became_active":"2023-07-27T20:34:51.151112+0000","last_became_peered":"2023-07-27T20:34:51.151112+0000","last_unstale":"2023-07-27T20:34:53.209248+0000","last_undegraded":"2023-07-27T20:34:53.209248+0000","last_fullsized":"2023-07-27T20:34:53.209248+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:45:49.617914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131050+0000","last_change":"2023-07-27T20:34:50.190131+0000","last_active":"2023-07-27T20:34:52.131050+0000","last_peered":"2023-07-27T20:34:52.131050+0000","last_clean":"2023-07-27T20:34:52.131050+0000","last_became_active":"2023-07-27T20:34:50.189800+0000","last_became_peered":"2023-07-27T20:34:50.189800+0000","last_unstale":"2023-07-27T20:34:52.131050+0000","last_undegraded":"2023-07-27T20:34:52.131050+0000","last_fullsized":"2023-07-27T20:34:52.131050+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:06:00.701313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.553446+0000","last_change":"2023-07-27T20:34:34.307218+0000","last_active":"2023-07-27T20:34:53.553446+0000","last_peered":"2023-07-27T20:34:53.553446+0000","last_clean":"2023-07-27T20:34:53.553446+0000","last_became_active":"2023-07-27T20:34:34.306781+0000","last_became_peered":"2023-07-27T20:34:34.306781+0000","last_unstale":"2023-07-27T20:34:53.553446+0000","last_undegraded":"2023-07-27T20:34:53.553446+0000","last_fullsized":"2023-07-27T20:34:53.553446+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:55:02.278504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"62'1","reported_seq":22,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.553481+0000","last_change":"2023-07-27T20:34:33.301802+0000","last_active":"2023-07-27T20:34:53.553481+0000","last_peered":"2023-07-27T20:34:53.553481+0000","last_clean":"2023-07-27T20:34:53.553481+0000","last_became_active":"2023-07-27T20:34:33.301453+0000","last_became_peered":"2023-07-27T20:34:33.301453+0000","last_unstale":"2023-07-27T20:34:53.553481+0000","last_undegraded":"2023-07-27T20:34:53.553481+0000","last_fullsized":"2023-07-27T20:34:53.553481+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:06:43.148072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.552694+0000","last_change":"2023-07-27T20:34:51.152536+0000","last_active":"2023-07-27T20:34:53.552694+0000","last_peered":"2023-07-27T20:34:53.552694+0000","last_clean":"2023-07-27T20:34:53.552694+0000","last_became_active":"2023-07-27T20:34:51.152266+0000","last_became_peered":"2023-07-27T20:34:51.152266+0000","last_unstale":"2023-07-27T20:34:53.552694+0000","last_undegraded":"2023-07-27T20:34:53.552694+0000","last_fullsized":"2023-07-27T20:34:53.552694+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:01:54.360533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131077+0000","last_change":"2023-07-27T20:34:50.177951+0000","last_active":"2023-07-27T20:34:52.131077+0000","last_peered":"2023-07-27T20:34:52.131077+0000","last_clean":"2023-07-27T20:34:52.131077+0000","last_became_active":"2023-07-27T20:34:50.177630+0000","last_became_peered":"2023-07-27T20:34:50.177630+0000","last_unstale":"2023-07-27T20:34:52.131077+0000","last_undegraded":"2023-07-27T20:34:52.131077+0000","last_fullsized":"2023-07-27T20:34:52.131077+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:05:48.894914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132549+0000","last_change":"2023-07-27T20:34:34.325646+0000","last_active":"2023-07-27T20:34:52.132549+0000","last_peered":"2023-07-27T20:34:52.132549+0000","last_clean":"2023-07-27T20:34:52.132549+0000","last_became_active":"2023-07-27T20:34:34.325379+0000","last_became_peered":"2023-07-27T20:34:34.325379+0000","last_unstale":"2023-07-27T20:34:52.132549+0000","last_undegraded":"2023-07-27T20:34:52.132549+0000","last_fullsized":"2023-07-27T20:34:52.132549+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:45:22.310599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.939236+0000","last_change":"2023-07-27T20:34:33.297891+0000","last_active":"2023-07-27T20:34:52.939236+0000","last_peered":"2023-07-27T20:34:52.939236+0000","last_clean":"2023-07-27T20:34:52.939236+0000","last_became_active":"2023-07-27T20:34:33.297052+0000","last_became_peered":"2023-07-27T20:34:33.297052+0000","last_unstale":"2023-07-27T20:34:52.939236+0000","last_undegraded":"2023-07-27T20:34:52.939236+0000","last_fullsized":"2023-07-27T20:34:52.939236+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:44:52.958881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130809+0000","last_change":"2023-07-27T20:34:51.143769+0000","last_active":"2023-07-27T20:34:52.130809+0000","last_peered":"2023-07-27T20:34:52.130809+0000","last_clean":"2023-07-27T20:34:52.130809+0000","last_became_active":"2023-07-27T20:34:51.143499+0000","last_became_peered":"2023-07-27T20:34:51.143499+0000","last_unstale":"2023-07-27T20:34:52.130809+0000","last_undegraded":"2023-07-27T20:34:52.130809+0000","last_fullsized":"2023-07-27T20:34:52.130809+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:18:27.673510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131556+0000","last_change":"2023-07-27T20:34:50.179895+0000","last_active":"2023-07-27T20:34:52.131556+0000","last_peered":"2023-07-27T20:34:52.131556+0000","last_clean":"2023-07-27T20:34:52.131556+0000","last_became_active":"2023-07-27T20:34:50.177798+0000","last_became_peered":"2023-07-27T20:34:50.177798+0000","last_unstale":"2023-07-27T20:34:52.131556+0000","last_undegraded":"2023-07-27T20:34:52.131556+0000","last_fullsized":"2023-07-27T20:34:52.131556+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:36:21.810013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.133223+0000","last_change":"2023-07-27T20:34:34.315817+0000","last_active":"2023-07-27T20:34:52.133223+0000","last_peered":"2023-07-27T20:34:52.133223+0000","last_clean":"2023-07-27T20:34:52.133223+0000","last_became_active":"2023-07-27T20:34:34.315521+0000","last_became_peered":"2023-07-27T20:34:34.315521+0000","last_unstale":"2023-07-27T20:34:52.133223+0000","last_undegraded":"2023-07-27T20:34:52.133223+0000","last_fullsized":"2023-07-27T20:34:52.133223+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:08:52.033698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131040+0000","last_change":"2023-07-27T20:34:33.303481+0000","last_active":"2023-07-27T20:34:52.131040+0000","last_peered":"2023-07-27T20:34:52.131040+0000","last_clean":"2023-07-27T20:34:52.131040+0000","last_became_active":"2023-07-27T20:34:33.303145+0000","last_became_peered":"2023-07-27T20:34:33.303145+0000","last_unstale":"2023-07-27T20:34:52.131040+0000","last_undegraded":"2023-07-27T20:34:52.131040+0000","last_fullsized":"2023-07-27T20:34:52.131040+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:21:49.795906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209939+0000","last_change":"2023-07-27T20:34:51.156858+0000","last_active":"2023-07-27T20:34:53.209939+0000","last_peered":"2023-07-27T20:34:53.209939+0000","last_clean":"2023-07-27T20:34:53.209939+0000","last_became_active":"2023-07-27T20:34:51.156411+0000","last_became_peered":"2023-07-27T20:34:51.156411+0000","last_unstale":"2023-07-27T20:34:53.209939+0000","last_undegraded":"2023-07-27T20:34:53.209939+0000","last_fullsized":"2023-07-27T20:34:53.209939+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:54:39.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209799+0000","last_change":"2023-07-27T20:34:50.189144+0000","last_active":"2023-07-27T20:34:53.209799+0000","last_peered":"2023-07-27T20:34:53.209799+0000","last_clean":"2023-07-27T20:34:53.209799+0000","last_became_active":"2023-07-27T20:34:50.188791+0000","last_became_peered":"2023-07-27T20:34:50.188791+0000","last_unstale":"2023-07-27T20:34:53.209799+0000","last_undegraded":"2023-07-27T20:34:53.209799+0000","last_fullsized":"2023-07-27T20:34:53.209799+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:14:26.048681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.939252+0000","last_change":"2023-07-27T20:34:34.304160+0000","last_active":"2023-07-27T20:34:52.939252+0000","last_peered":"2023-07-27T20:34:52.939252+0000","last_clean":"2023-07-27T20:34:52.939252+0000","last_became_active":"2023-07-27T20:34:34.303895+0000","last_became_peered":"2023-07-27T20:34:34.303895+0000","last_unstale":"2023-07-27T20:34:52.939252+0000","last_undegraded":"2023-07-27T20:34:52.939252+0000","last_fullsized":"2023-07-27T20:34:52.939252+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:49:58.678558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938972+0000","last_change":"2023-07-27T20:34:33.308129+0000","last_active":"2023-07-27T20:34:52.938972+0000","last_peered":"2023-07-27T20:34:52.938972+0000","last_clean":"2023-07-27T20:34:52.938972+0000","last_became_active":"2023-07-27T20:34:33.307849+0000","last_became_peered":"2023-07-27T20:34:33.307849+0000","last_unstale":"2023-07-27T20:34:52.938972+0000","last_undegraded":"2023-07-27T20:34:52.938972+0000","last_fullsized":"2023-07-27T20:34:52.938972+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:15:18.373676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131657+0000","last_change":"2023-07-27T20:34:51.145256+0000","last_active":"2023-07-27T20:34:52.131657+0000","last_peered":"2023-07-27T20:34:52.131657+0000","last_clean":"2023-07-27T20:34:52.131657+0000","last_became_active":"2023-07-27T20:34:51.144586+0000","last_became_peered":"2023-07-27T20:34:51.144586+0000","last_unstale":"2023-07-27T20:34:52.131657+0000","last_undegraded":"2023-07-27T20:34:52.131657+0000","last_fullsized":"2023-07-27T20:34:52.131657+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:25:19.538837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210262+0000","last_change":"2023-07-27T20:34:50.197348+0000","last_active":"2023-07-27T20:34:53.210262+0000","last_peered":"2023-07-27T20:34:53.210262+0000","last_clean":"2023-07-27T20:34:53.210262+0000","last_became_active":"2023-07-27T20:34:50.197009+0000","last_became_peered":"2023-07-27T20:34:50.197009+0000","last_unstale":"2023-07-27T20:34:53.210262+0000","last_undegraded":"2023-07-27T20:34:53.210262+0000","last_fullsized":"2023-07-27T20:34:53.210262+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:48:41.949565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209386+0000","last_change":"2023-07-27T20:34:34.323167+0000","last_active":"2023-07-27T20:34:53.209386+0000","last_peered":"2023-07-27T20:34:53.209386+0000","last_clean":"2023-07-27T20:34:53.209386+0000","last_became_active":"2023-07-27T20:34:34.322891+0000","last_became_peered":"2023-07-27T20:34:34.322891+0000","last_unstale":"2023-07-27T20:34:53.209386+0000","last_undegraded":"2023-07-27T20:34:53.209386+0000","last_fullsized":"2023-07-27T20:34:53.209386+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:19:54.428946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590181+0000","last_change":"2023-07-27T20:34:33.303415+0000","last_active":"2023-07-27T20:34:52.590181+0000","last_peered":"2023-07-27T20:34:52.590181+0000","last_clean":"2023-07-27T20:34:52.590181+0000","last_became_active":"2023-07-27T20:34:33.303145+0000","last_became_peered":"2023-07-27T20:34:33.303145+0000","last_unstale":"2023-07-27T20:34:52.590181+0000","last_undegraded":"2023-07-27T20:34:52.590181+0000","last_fullsized":"2023-07-27T20:34:52.590181+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:38:00.398673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131777+0000","last_change":"2023-07-27T20:34:51.149547+0000","last_active":"2023-07-27T20:34:52.131777+0000","last_peered":"2023-07-27T20:34:52.131777+0000","last_clean":"2023-07-27T20:34:52.131777+0000","last_became_active":"2023-07-27T20:34:51.149269+0000","last_became_peered":"2023-07-27T20:34:51.149269+0000","last_unstale":"2023-07-27T20:34:52.131777+0000","last_undegraded":"2023-07-27T20:34:52.131777+0000","last_fullsized":"2023-07-27T20:34:52.131777+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:51:28.367151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"65'2","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590648+0000","last_change":"2023-07-27T20:34:50.182629+0000","last_active":"2023-07-27T20:34:52.590648+0000","last_peered":"2023-07-27T20:34:52.590648+0000","last_clean":"2023-07-27T20:34:52.590648+0000","last_became_active":"2023-07-27T20:34:50.182365+0000","last_became_peered":"2023-07-27T20:34:50.182365+0000","last_unstale":"2023-07-27T20:34:52.590648+0000","last_undegraded":"2023-07-27T20:34:52.590648+0000","last_fullsized":"2023-07-27T20:34:52.590648+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:07:03.745417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590031+0000","last_change":"2023-07-27T20:34:34.298297+0000","last_active":"2023-07-27T20:34:52.590031+0000","last_peered":"2023-07-27T20:34:52.590031+0000","last_clean":"2023-07-27T20:34:52.590031+0000","last_became_active":"2023-07-27T20:34:34.297997+0000","last_became_peered":"2023-07-27T20:34:34.297997+0000","last_unstale":"2023-07-27T20:34:52.590031+0000","last_undegraded":"2023-07-27T20:34:52.590031+0000","last_fullsized":"2023-07-27T20:34:52.590031+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:07:46.697965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131421+0000","last_change":"2023-07-27T20:34:33.301354+0000","last_active":"2023-07-27T20:34:52.131421+0000","last_peered":"2023-07-27T20:34:52.131421+0000","last_clean":"2023-07-27T20:34:52.131421+0000","last_became_active":"2023-07-27T20:34:33.301082+0000","last_became_peered":"2023-07-27T20:34:33.301082+0000","last_unstale":"2023-07-27T20:34:52.131421+0000","last_undegraded":"2023-07-27T20:34:52.131421+0000","last_fullsized":"2023-07-27T20:34:52.131421+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:07:16.899217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132799+0000","last_change":"2023-07-27T20:34:51.155856+0000","last_active":"2023-07-27T20:34:52.132799+0000","last_peered":"2023-07-27T20:34:52.132799+0000","last_clean":"2023-07-27T20:34:52.132799+0000","last_became_active":"2023-07-27T20:34:51.155341+0000","last_became_peered":"2023-07-27T20:34:51.155341+0000","last_unstale":"2023-07-27T20:34:52.132799+0000","last_undegraded":"2023-07-27T20:34:52.132799+0000","last_fullsized":"2023-07-27T20:34:52.132799+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:09:28.611086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590185+0000","last_change":"2023-07-27T20:34:50.188180+0000","last_active":"2023-07-27T20:34:52.590185+0000","last_peered":"2023-07-27T20:34:52.590185+0000","last_clean":"2023-07-27T20:34:52.590185+0000","last_became_active":"2023-07-27T20:34:50.187928+0000","last_became_peered":"2023-07-27T20:34:50.187928+0000","last_unstale":"2023-07-27T20:34:52.590185+0000","last_undegraded":"2023-07-27T20:34:52.590185+0000","last_fullsized":"2023-07-27T20:34:52.590185+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:21:12.020163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209668+0000","last_change":"2023-07-27T20:34:34.321962+0000","last_active":"2023-07-27T20:34:53.209668+0000","last_peered":"2023-07-27T20:34:53.209668+0000","last_clean":"2023-07-27T20:34:53.209668+0000","last_became_active":"2023-07-27T20:34:34.321611+0000","last_became_peered":"2023-07-27T20:34:34.321611+0000","last_unstale":"2023-07-27T20:34:53.209668+0000","last_undegraded":"2023-07-27T20:34:53.209668+0000","last_fullsized":"2023-07-27T20:34:53.209668+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:22:39.571086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209946+0000","last_change":"2023-07-27T20:34:33.305936+0000","last_active":"2023-07-27T20:34:53.209946+0000","last_peered":"2023-07-27T20:34:53.209946+0000","last_clean":"2023-07-27T20:34:53.209946+0000","last_became_active":"2023-07-27T20:34:33.305405+0000","last_became_peered":"2023-07-27T20:34:33.305405+0000","last_unstale":"2023-07-27T20:34:53.209946+0000","last_undegraded":"2023-07-27T20:34:53.209946+0000","last_fullsized":"2023-07-27T20:34:53.209946+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:23:23.259253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938598+0000","last_change":"2023-07-27T20:34:51.148128+0000","last_active":"2023-07-27T20:34:52.938598+0000","last_peered":"2023-07-27T20:34:52.938598+0000","last_clean":"2023-07-27T20:34:52.938598+0000","last_became_active":"2023-07-27T20:34:51.147880+0000","last_became_peered":"2023-07-27T20:34:51.147880+0000","last_unstale":"2023-07-27T20:34:52.938598+0000","last_undegraded":"2023-07-27T20:34:52.938598+0000","last_fullsized":"2023-07-27T20:34:52.938598+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:08:23.239413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938773+0000","last_change":"2023-07-27T20:34:50.189383+0000","last_active":"2023-07-27T20:34:52.938773+0000","last_peered":"2023-07-27T20:34:52.938773+0000","last_clean":"2023-07-27T20:34:52.938773+0000","last_became_active":"2023-07-27T20:34:50.189101+0000","last_became_peered":"2023-07-27T20:34:50.189101+0000","last_unstale":"2023-07-27T20:34:52.938773+0000","last_undegraded":"2023-07-27T20:34:52.938773+0000","last_fullsized":"2023-07-27T20:34:52.938773+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:14:56.646651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132304+0000","last_change":"2023-07-27T20:34:34.306247+0000","last_active":"2023-07-27T20:34:52.132304+0000","last_peered":"2023-07-27T20:34:52.132304+0000","last_clean":"2023-07-27T20:34:52.132304+0000","last_became_active":"2023-07-27T20:34:34.305974+0000","last_became_peered":"2023-07-27T20:34:34.305974+0000","last_unstale":"2023-07-27T20:34:52.132304+0000","last_undegraded":"2023-07-27T20:34:52.132304+0000","last_fullsized":"2023-07-27T20:34:52.132304+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:21:53.819869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"61'1","reported_seq":22,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210672+0000","last_change":"2023-07-27T20:34:33.308128+0000","last_active":"2023-07-27T20:34:53.210672+0000","last_peered":"2023-07-27T20:34:53.210672+0000","last_clean":"2023-07-27T20:34:53.210672+0000","last_became_active":"2023-07-27T20:34:33.307832+0000","last_became_peered":"2023-07-27T20:34:33.307832+0000","last_unstale":"2023-07-27T20:34:53.210672+0000","last_undegraded":"2023-07-27T20:34:53.210672+0000","last_fullsized":"2023-07-27T20:34:53.210672+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:16:26.061594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":96,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210631+0000","last_change":"2023-07-27T20:31:22.846540+0000","last_active":"2023-07-27T20:34:53.210631+0000","last_peered":"2023-07-27T20:34:53.210631+0000","last_clean":"2023-07-27T20:34:53.210631+0000","last_became_active":"2023-07-27T20:31:22.846128+0000","last_became_peered":"2023-07-27T20:31:22.846128+0000","last_unstale":"2023-07-27T20:34:53.210631+0000","last_undegraded":"2023-07-27T20:34:53.210631+0000","last_fullsized":"2023-07-27T20:34:53.210631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:30:22.222415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.552605+0000","last_change":"2023-07-27T20:34:51.149993+0000","last_active":"2023-07-27T20:34:53.552605+0000","last_peered":"2023-07-27T20:34:53.552605+0000","last_clean":"2023-07-27T20:34:53.552605+0000","last_became_active":"2023-07-27T20:34:51.149708+0000","last_became_peered":"2023-07-27T20:34:51.149708+0000","last_unstale":"2023-07-27T20:34:53.552605+0000","last_undegraded":"2023-07-27T20:34:53.552605+0000","last_fullsized":"2023-07-27T20:34:53.552605+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:36:23.226827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.388985+0000","last_change":"2023-07-27T20:34:50.183371+0000","last_active":"2023-07-27T20:34:52.388985+0000","last_peered":"2023-07-27T20:34:52.388985+0000","last_clean":"2023-07-27T20:34:52.388985+0000","last_became_active":"2023-07-27T20:34:50.183044+0000","last_became_peered":"2023-07-27T20:34:50.183044+0000","last_unstale":"2023-07-27T20:34:52.388985+0000","last_undegraded":"2023-07-27T20:34:52.388985+0000","last_fullsized":"2023-07-27T20:34:52.388985+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:08:26.860263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.133069+0000","last_change":"2023-07-27T20:34:34.311641+0000","last_active":"2023-07-27T20:34:52.133069+0000","last_peered":"2023-07-27T20:34:52.133069+0000","last_clean":"2023-07-27T20:34:52.133069+0000","last_became_active":"2023-07-27T20:34:34.311381+0000","last_became_peered":"2023-07-27T20:34:34.311381+0000","last_unstale":"2023-07-27T20:34:52.133069+0000","last_undegraded":"2023-07-27T20:34:52.133069+0000","last_fullsized":"2023-07-27T20:34:52.133069+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:59:38.957572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"61'2","reported_seq":23,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132392+0000","last_change":"2023-07-27T20:34:33.303573+0000","last_active":"2023-07-27T20:34:52.132392+0000","last_peered":"2023-07-27T20:34:52.132392+0000","last_clean":"2023-07-27T20:34:52.132392+0000","last_became_active":"2023-07-27T20:34:33.303293+0000","last_became_peered":"2023-07-27T20:34:33.303293+0000","last_unstale":"2023-07-27T20:34:52.132392+0000","last_undegraded":"2023-07-27T20:34:52.132392+0000","last_fullsized":"2023-07-27T20:34:52.132392+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:18:09.787653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":96,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590595+0000","last_change":"2023-07-27T20:31:22.845641+0000","last_active":"2023-07-27T20:34:52.590595+0000","last_peered":"2023-07-27T20:34:52.590595+0000","last_clean":"2023-07-27T20:34:52.590595+0000","last_became_active":"2023-07-27T20:31:22.845368+0000","last_became_peered":"2023-07-27T20:31:22.845368+0000","last_unstale":"2023-07-27T20:34:52.590595+0000","last_undegraded":"2023-07-27T20:34:52.590595+0000","last_fullsized":"2023-07-27T20:34:52.590595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:49:35.014478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938809+0000","last_change":"2023-07-27T20:34:51.158083+0000","last_active":"2023-07-27T20:34:52.938809+0000","last_peered":"2023-07-27T20:34:52.938809+0000","last_clean":"2023-07-27T20:34:52.938809+0000","last_became_active":"2023-07-27T20:34:51.157594+0000","last_became_peered":"2023-07-27T20:34:51.157594+0000","last_unstale":"2023-07-27T20:34:52.938809+0000","last_undegraded":"2023-07-27T20:34:52.938809+0000","last_fullsized":"2023-07-27T20:34:52.938809+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:53:59.465313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"65'2","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389297+0000","last_change":"2023-07-27T20:34:50.184319+0000","last_active":"2023-07-27T20:34:52.389297+0000","last_peered":"2023-07-27T20:34:52.389297+0000","last_clean":"2023-07-27T20:34:52.389297+0000","last_became_active":"2023-07-27T20:34:50.183566+0000","last_became_peered":"2023-07-27T20:34:50.183566+0000","last_unstale":"2023-07-27T20:34:52.389297+0000","last_undegraded":"2023-07-27T20:34:52.389297+0000","last_fullsized":"2023-07-27T20:34:52.389297+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:43:13.843198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590454+0000","last_change":"2023-07-27T20:34:34.296863+0000","last_active":"2023-07-27T20:34:52.590454+0000","last_peered":"2023-07-27T20:34:52.590454+0000","last_clean":"2023-07-27T20:34:52.590454+0000","last_became_active":"2023-07-27T20:34:34.296556+0000","last_became_peered":"2023-07-27T20:34:34.296556+0000","last_unstale":"2023-07-27T20:34:52.590454+0000","last_undegraded":"2023-07-27T20:34:52.590454+0000","last_fullsized":"2023-07-27T20:34:52.590454+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:46:52.049065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"61'1","reported_seq":22,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210334+0000","last_change":"2023-07-27T20:34:33.303035+0000","last_active":"2023-07-27T20:34:53.210334+0000","last_peered":"2023-07-27T20:34:53.210334+0000","last_clean":"2023-07-27T20:34:53.210334+0000","last_became_active":"2023-07-27T20:34:33.302764+0000","last_became_peered":"2023-07-27T20:34:33.302764+0000","last_unstale":"2023-07-27T20:34:53.210334+0000","last_undegraded":"2023-07-27T20:34:53.210334+0000","last_fullsized":"2023-07-27T20:34:53.210334+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:35:21.613222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":100,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.133263+0000","last_change":"2023-07-27T20:31:22.848025+0000","last_active":"2023-07-27T20:34:52.133263+0000","last_peered":"2023-07-27T20:34:52.133263+0000","last_clean":"2023-07-27T20:34:52.133263+0000","last_became_active":"2023-07-27T20:31:22.847603+0000","last_became_peered":"2023-07-27T20:31:22.847603+0000","last_unstale":"2023-07-27T20:34:52.133263+0000","last_undegraded":"2023-07-27T20:34:52.133263+0000","last_fullsized":"2023-07-27T20:34:52.133263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:26:35.659170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210533+0000","last_change":"2023-07-27T20:34:51.152340+0000","last_active":"2023-07-27T20:34:53.210533+0000","last_peered":"2023-07-27T20:34:53.210533+0000","last_clean":"2023-07-27T20:34:53.210533+0000","last_became_active":"2023-07-27T20:34:51.151332+0000","last_became_peered":"2023-07-27T20:34:51.151332+0000","last_unstale":"2023-07-27T20:34:53.210533+0000","last_undegraded":"2023-07-27T20:34:53.210533+0000","last_fullsized":"2023-07-27T20:34:53.210533+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:43:35.600181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"65'2","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130801+0000","last_change":"2023-07-27T20:34:50.174082+0000","last_active":"2023-07-27T20:34:52.130801+0000","last_peered":"2023-07-27T20:34:52.130801+0000","last_clean":"2023-07-27T20:34:52.130801+0000","last_became_active":"2023-07-27T20:34:50.173729+0000","last_became_peered":"2023-07-27T20:34:50.173729+0000","last_unstale":"2023-07-27T20:34:52.130801+0000","last_undegraded":"2023-07-27T20:34:52.130801+0000","last_fullsized":"2023-07-27T20:34:52.130801+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:42:38.698273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389258+0000","last_change":"2023-07-27T20:34:34.315837+0000","last_active":"2023-07-27T20:34:52.389258+0000","last_peered":"2023-07-27T20:34:52.389258+0000","last_clean":"2023-07-27T20:34:52.389258+0000","last_became_active":"2023-07-27T20:34:34.315452+0000","last_became_peered":"2023-07-27T20:34:34.315452+0000","last_unstale":"2023-07-27T20:34:52.389258+0000","last_undegraded":"2023-07-27T20:34:52.389258+0000","last_fullsized":"2023-07-27T20:34:52.389258+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:34:48.784517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130455+0000","last_change":"2023-07-27T20:34:33.298534+0000","last_active":"2023-07-27T20:34:52.130455+0000","last_peered":"2023-07-27T20:34:52.130455+0000","last_clean":"2023-07-27T20:34:52.130455+0000","last_became_active":"2023-07-27T20:34:33.298170+0000","last_became_peered":"2023-07-27T20:34:33.298170+0000","last_unstale":"2023-07-27T20:34:52.130455+0000","last_undegraded":"2023-07-27T20:34:52.130455+0000","last_fullsized":"2023-07-27T20:34:52.130455+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:42:13.116879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":100,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131167+0000","last_change":"2023-07-27T20:31:22.848181+0000","last_active":"2023-07-27T20:34:52.131167+0000","last_peered":"2023-07-27T20:34:52.131167+0000","last_clean":"2023-07-27T20:34:52.131167+0000","last_became_active":"2023-07-27T20:31:22.847865+0000","last_became_peered":"2023-07-27T20:31:22.847865+0000","last_unstale":"2023-07-27T20:34:52.131167+0000","last_undegraded":"2023-07-27T20:34:52.131167+0000","last_fullsized":"2023-07-27T20:34:52.131167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:25:29.020423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590244+0000","last_change":"2023-07-27T20:34:51.152241+0000","last_active":"2023-07-27T20:34:52.590244+0000","last_peered":"2023-07-27T20:34:52.590244+0000","last_clean":"2023-07-27T20:34:52.590244+0000","last_became_active":"2023-07-27T20:34:51.151898+0000","last_became_peered":"2023-07-27T20:34:51.151898+0000","last_unstale":"2023-07-27T20:34:52.590244+0000","last_undegraded":"2023-07-27T20:34:52.590244+0000","last_fullsized":"2023-07-27T20:34:52.590244+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:45:49.617914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"65'1","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132798+0000","last_change":"2023-07-27T20:34:50.189207+0000","last_active":"2023-07-27T20:34:52.132798+0000","last_peered":"2023-07-27T20:34:52.132798+0000","last_clean":"2023-07-27T20:34:52.132798+0000","last_became_active":"2023-07-27T20:34:50.188918+0000","last_became_peered":"2023-07-27T20:34:50.188918+0000","last_unstale":"2023-07-27T20:34:52.132798+0000","last_undegraded":"2023-07-27T20:34:52.132798+0000","last_fullsized":"2023-07-27T20:34:52.132798+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:50:58.313491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389699+0000","last_change":"2023-07-27T20:34:34.320803+0000","last_active":"2023-07-27T20:34:52.389699+0000","last_peered":"2023-07-27T20:34:52.389699+0000","last_clean":"2023-07-27T20:34:52.389699+0000","last_became_active":"2023-07-27T20:34:34.320444+0000","last_became_peered":"2023-07-27T20:34:34.320444+0000","last_unstale":"2023-07-27T20:34:52.389699+0000","last_undegraded":"2023-07-27T20:34:52.389699+0000","last_fullsized":"2023-07-27T20:34:52.389699+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:55:01.033091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"61'2","reported_seq":23,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209569+0000","last_change":"2023-07-27T20:34:33.306873+0000","last_active":"2023-07-27T20:34:53.209569+0000","last_peered":"2023-07-27T20:34:53.209569+0000","last_clean":"2023-07-27T20:34:53.209569+0000","last_became_active":"2023-07-27T20:34:33.306519+0000","last_became_peered":"2023-07-27T20:34:33.306519+0000","last_unstale":"2023-07-27T20:34:53.209569+0000","last_undegraded":"2023-07-27T20:34:53.209569+0000","last_fullsized":"2023-07-27T20:34:53.209569+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:22:53.344306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":256,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132249+0000","last_change":"2023-07-27T20:31:15.812727+0000","last_active":"2023-07-27T20:34:52.132249+0000","last_peered":"2023-07-27T20:34:52.132249+0000","last_clean":"2023-07-27T20:34:52.132249+0000","last_became_active":"2023-07-27T20:31:15.811803+0000","last_became_peered":"2023-07-27T20:31:15.811803+0000","last_unstale":"2023-07-27T20:34:52.132249+0000","last_undegraded":"2023-07-27T20:34:52.132249+0000","last_fullsized":"2023-07-27T20:34:52.132249+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:14.789257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:14.789257+0000","last_clean_scrub_stamp":"2023-07-27T20:31:14.789257+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:35:24.123835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":94,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.553077+0000","last_change":"2023-07-27T20:31:22.847766+0000","last_active":"2023-07-27T20:34:53.553077+0000","last_peered":"2023-07-27T20:34:53.553077+0000","last_clean":"2023-07-27T20:34:53.553077+0000","last_became_active":"2023-07-27T20:31:22.847396+0000","last_became_peered":"2023-07-27T20:31:22.847396+0000","last_unstale":"2023-07-27T20:34:53.553077+0000","last_undegraded":"2023-07-27T20:34:53.553077+0000","last_fullsized":"2023-07-27T20:34:53.553077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:04:59.538283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131959+0000","last_change":"2023-07-27T20:34:51.149498+0000","last_active":"2023-07-27T20:34:52.131959+0000","last_peered":"2023-07-27T20:34:52.131959+0000","last_clean":"2023-07-27T20:34:52.131959+0000","last_became_active":"2023-07-27T20:34:51.149234+0000","last_became_peered":"2023-07-27T20:34:51.149234+0000","last_unstale":"2023-07-27T20:34:52.131959+0000","last_undegraded":"2023-07-27T20:34:52.131959+0000","last_fullsized":"2023-07-27T20:34:52.131959+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:41:58.386686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"65'1","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210901+0000","last_change":"2023-07-27T20:34:50.193255+0000","last_active":"2023-07-27T20:34:53.210901+0000","last_peered":"2023-07-27T20:34:53.210901+0000","last_clean":"2023-07-27T20:34:53.210901+0000","last_became_active":"2023-07-27T20:34:50.192937+0000","last_became_peered":"2023-07-27T20:34:50.192937+0000","last_unstale":"2023-07-27T20:34:53.210901+0000","last_undegraded":"2023-07-27T20:34:53.210901+0000","last_fullsized":"2023-07-27T20:34:53.210901+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:02:04.097977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389081+0000","last_change":"2023-07-27T20:34:34.320690+0000","last_active":"2023-07-27T20:34:52.389081+0000","last_peered":"2023-07-27T20:34:52.389081+0000","last_clean":"2023-07-27T20:34:52.389081+0000","last_became_active":"2023-07-27T20:34:34.320232+0000","last_became_peered":"2023-07-27T20:34:34.320232+0000","last_unstale":"2023-07-27T20:34:52.389081+0000","last_undegraded":"2023-07-27T20:34:52.389081+0000","last_fullsized":"2023-07-27T20:34:52.389081+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:36:23.221362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.552587+0000","last_change":"2023-07-27T20:34:33.308050+0000","last_active":"2023-07-27T20:34:53.552587+0000","last_peered":"2023-07-27T20:34:53.552587+0000","last_clean":"2023-07-27T20:34:53.552587+0000","last_became_active":"2023-07-27T20:34:33.307761+0000","last_became_peered":"2023-07-27T20:34:33.307761+0000","last_unstale":"2023-07-27T20:34:53.552587+0000","last_undegraded":"2023-07-27T20:34:53.552587+0000","last_fullsized":"2023-07-27T20:34:53.552587+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:08:38.725198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":94,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938324+0000","last_change":"2023-07-27T20:31:22.959811+0000","last_active":"2023-07-27T20:34:52.938324+0000","last_peered":"2023-07-27T20:34:52.938324+0000","last_clean":"2023-07-27T20:34:52.938324+0000","last_became_active":"2023-07-27T20:31:22.959449+0000","last_became_peered":"2023-07-27T20:31:22.959449+0000","last_unstale":"2023-07-27T20:34:52.938324+0000","last_undegraded":"2023-07-27T20:34:52.938324+0000","last_fullsized":"2023-07-27T20:34:52.938324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:33:48.638402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131486+0000","last_change":"2023-07-27T20:34:51.153070+0000","last_active":"2023-07-27T20:34:52.131486+0000","last_peered":"2023-07-27T20:34:52.131486+0000","last_clean":"2023-07-27T20:34:52.131486+0000","last_became_active":"2023-07-27T20:34:51.152803+0000","last_became_peered":"2023-07-27T20:34:51.152803+0000","last_unstale":"2023-07-27T20:34:52.131486+0000","last_undegraded":"2023-07-27T20:34:52.131486+0000","last_fullsized":"2023-07-27T20:34:52.131486+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:53:08.452027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130786+0000","last_change":"2023-07-27T20:34:50.180986+0000","last_active":"2023-07-27T20:34:52.130786+0000","last_peered":"2023-07-27T20:34:52.130786+0000","last_clean":"2023-07-27T20:34:52.130786+0000","last_became_active":"2023-07-27T20:34:50.180736+0000","last_became_peered":"2023-07-27T20:34:50.180736+0000","last_unstale":"2023-07-27T20:34:52.130786+0000","last_undegraded":"2023-07-27T20:34:52.130786+0000","last_fullsized":"2023-07-27T20:34:52.130786+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:19:41.640145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389603+0000","last_change":"2023-07-27T20:34:34.301811+0000","last_active":"2023-07-27T20:34:52.389603+0000","last_peered":"2023-07-27T20:34:52.389603+0000","last_clean":"2023-07-27T20:34:52.389603+0000","last_became_active":"2023-07-27T20:34:34.301525+0000","last_became_peered":"2023-07-27T20:34:34.301525+0000","last_unstale":"2023-07-27T20:34:52.389603+0000","last_undegraded":"2023-07-27T20:34:52.389603+0000","last_fullsized":"2023-07-27T20:34:52.389603+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:31:19.688642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209626+0000","last_change":"2023-07-27T20:34:33.301467+0000","last_active":"2023-07-27T20:34:53.209626+0000","last_peered":"2023-07-27T20:34:53.209626+0000","last_clean":"2023-07-27T20:34:53.209626+0000","last_became_active":"2023-07-27T20:34:33.301160+0000","last_became_peered":"2023-07-27T20:34:33.301160+0000","last_unstale":"2023-07-27T20:34:53.209626+0000","last_undegraded":"2023-07-27T20:34:53.209626+0000","last_fullsized":"2023-07-27T20:34:53.209626+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:06:46.866407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":94,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.553162+0000","last_change":"2023-07-27T20:31:22.849178+0000","last_active":"2023-07-27T20:34:53.553162+0000","last_peered":"2023-07-27T20:34:53.553162+0000","last_clean":"2023-07-27T20:34:53.553162+0000","last_became_active":"2023-07-27T20:31:22.848856+0000","last_became_peered":"2023-07-27T20:31:22.848856+0000","last_unstale":"2023-07-27T20:34:53.553162+0000","last_undegraded":"2023-07-27T20:34:53.553162+0000","last_fullsized":"2023-07-27T20:34:53.553162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:33:11.770874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.552958+0000","last_change":"2023-07-27T20:34:51.149654+0000","last_active":"2023-07-27T20:34:53.552958+0000","last_peered":"2023-07-27T20:34:53.552958+0000","last_clean":"2023-07-27T20:34:53.552958+0000","last_became_active":"2023-07-27T20:34:51.149343+0000","last_became_peered":"2023-07-27T20:34:51.149343+0000","last_unstale":"2023-07-27T20:34:53.552958+0000","last_undegraded":"2023-07-27T20:34:53.552958+0000","last_fullsized":"2023-07-27T20:34:53.552958+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:07:01.236721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.939101+0000","last_change":"2023-07-27T20:34:50.184967+0000","last_active":"2023-07-27T20:34:52.939101+0000","last_peered":"2023-07-27T20:34:52.939101+0000","last_clean":"2023-07-27T20:34:52.939101+0000","last_became_active":"2023-07-27T20:34:50.184725+0000","last_became_peered":"2023-07-27T20:34:50.184725+0000","last_unstale":"2023-07-27T20:34:52.939101+0000","last_undegraded":"2023-07-27T20:34:52.939101+0000","last_fullsized":"2023-07-27T20:34:52.939101+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:51:53.872027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.939161+0000","last_change":"2023-07-27T20:34:34.296711+0000","last_active":"2023-07-27T20:34:52.939161+0000","last_peered":"2023-07-27T20:34:52.939161+0000","last_clean":"2023-07-27T20:34:52.939161+0000","last_became_active":"2023-07-27T20:34:34.296442+0000","last_became_peered":"2023-07-27T20:34:34.296442+0000","last_unstale":"2023-07-27T20:34:52.939161+0000","last_undegraded":"2023-07-27T20:34:52.939161+0000","last_fullsized":"2023-07-27T20:34:52.939161+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:31:45.437223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132712+0000","last_change":"2023-07-27T20:34:33.304301+0000","last_active":"2023-07-27T20:34:52.132712+0000","last_peered":"2023-07-27T20:34:52.132712+0000","last_clean":"2023-07-27T20:34:52.132712+0000","last_became_active":"2023-07-27T20:34:33.303739+0000","last_became_peered":"2023-07-27T20:34:33.303739+0000","last_unstale":"2023-07-27T20:34:52.132712+0000","last_undegraded":"2023-07-27T20:34:52.132712+0000","last_fullsized":"2023-07-27T20:34:52.132712+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:34:53.026886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":96,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590657+0000","last_change":"2023-07-27T20:31:22.848698+0000","last_active":"2023-07-27T20:34:52.590657+0000","last_peered":"2023-07-27T20:34:52.590657+0000","last_clean":"2023-07-27T20:34:52.590657+0000","last_became_active":"2023-07-27T20:31:22.848346+0000","last_became_peered":"2023-07-27T20:31:22.848346+0000","last_unstale":"2023-07-27T20:34:52.590657+0000","last_undegraded":"2023-07-27T20:34:52.590657+0000","last_fullsized":"2023-07-27T20:34:52.590657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:19:42.901336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":4059,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28396,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343444,"statfs":{"total":96636764160,"available":96607686656,"internally_reserved":0,"allocated":1404928,"data_stored":980051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.75800000000000001,"15min":0.80300000000000005},"min":{"1min":0.42499999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90000000000000002,"5min":3.5609999999999999,"15min":3.5609999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.70799999999999996,"15min":0.72699999999999998},"min":{"1min":0.39500000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88800000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.58199999999999996}]},{"osd":1,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.69599999999999995,"15min":0.71599999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.84999999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.81000000000000005,"15min":0.86399999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.86699999999999999,"5min":3.927,"15min":3.927},"last":0.65200000000000002}]},{"osd":2,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.80200000000000005,"15min":0.84099999999999997},"min":{"1min":0.47099999999999997,"5min":0.443,"15min":0.443},"max":{"1min":0.86699999999999999,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.76500000000000001,"15min":0.80900000000000005},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85799999999999998,"5min":2.093,"15min":2.093},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.76000000000000001,"15min":0.81200000000000006},"min":{"1min":0.46000000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.76600000000000001,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.85099999999999998,"15min":0.90100000000000002},"min":{"1min":0.57399999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.94099999999999995,"5min":3.1080000000000001,"15min":3.1080000000000001},"last":0.88500000000000001}]},{"osd":4,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.754,"15min":0.78800000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.91100000000000003,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.79800000000000004,"15min":0.83399999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.85799999999999998,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.80400000000000005}]},{"osd":5,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.90600000000000003,"15min":0.999},"min":{"1min":0.47899999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.91400000000000003,"5min":6.1619999999999999,"15min":6.1619999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.94299999999999995,"15min":1.042},"min":{"1min":0.432,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96499999999999997,"5min":6.2729999999999997,"15min":6.2729999999999997},"last":0.74199999999999999}]},{"osd":6,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.81799999999999995,"15min":0.84599999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.075,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.84699999999999998,"15min":0.90500000000000003},"min":{"1min":0.52900000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93799999999999994,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":0.83099999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":389783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.67700000000000005,"15min":0.68899999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.871,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.66300000000000003,"15min":0.66800000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.85499999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.746}]},{"osd":1,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69999999999999996,"15min":0.72199999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84399999999999997,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70099999999999996,"15min":0.70799999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.85499999999999998,"5min":1.266,"15min":1.266},"last":0.60199999999999998}]},{"osd":2,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.69499999999999995,"15min":0.71799999999999997},"min":{"1min":0.51100000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83899999999999997,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.747,"15min":0.76300000000000001},"min":{"1min":0.56499999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.90200000000000002,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.86299999999999999}]},{"osd":3,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.72899999999999998,"15min":0.745},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.84199999999999997,"5min":1.377,"15min":1.377},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.73299999999999998,"15min":0.75700000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92800000000000005,"5min":1.736,"15min":1.736},"last":0.90000000000000002}]},{"osd":4,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69599999999999995,"15min":0.69799999999999995},"min":{"1min":0.47099999999999997,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90300000000000002,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":1.012},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69699999999999995,"15min":0.69299999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.95599999999999996,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.81699999999999995}]},{"osd":5,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.67100000000000004,"15min":0.66500000000000004},"min":{"1min":0.47799999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.88600000000000001,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":1.117},{"interface":"front","average":{"1min":0.748,"5min":0.74099999999999999,"15min":0.73199999999999998},"min":{"1min":0.45100000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93700000000000006,"5min":1.081,"15min":1.081},"last":1.0629999999999999}]},{"osd":7,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.749,"15min":0.753},"min":{"1min":0.496,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.94699999999999995,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.878},{"interface":"front","average":{"1min":0.753,"5min":0.73999999999999999,"15min":0.73599999999999999},"min":{"1min":0.59499999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97599999999999998,"5min":1.119,"15min":1.119},"last":0.99099999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":831488,"data_stored":393068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40899999999999997,"15min":0.40600000000000003},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47199999999999998,"15min":0.47899999999999998},"min":{"1min":0.32300000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44,"15min":0.436},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.375},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.47599999999999998,"15min":0.47399999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53400000000000003,"15min":0.53200000000000003},"min":{"1min":0.39400000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.502,"15min":0.504},"min":{"1min":0.374,"5min":0.31,"15min":0.31},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.437}]},{"osd":4,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73499999999999999,"15min":0.745},"min":{"1min":0.56699999999999995,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73599999999999999,"15min":0.73199999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.752}]},{"osd":5,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72299999999999998,"15min":0.73199999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.76200000000000001,"15min":0.75700000000000001},"min":{"1min":0.623,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.9630000000000001,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.77500000000000002,"15min":0.79500000000000004},"min":{"1min":0.53600000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1419999999999999,"5min":1.347,"15min":1.347},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.80400000000000005,"15min":0.81999999999999995},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.206,"5min":1.409,"15min":1.409},"last":0.78900000000000003}]},{"osd":7,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.77100000000000002,"15min":0.77700000000000002},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.95099999999999996,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78800000000000003,"15min":0.80300000000000005},"min":{"1min":0.55400000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.68999999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28384,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343456,"statfs":{"total":96636764160,"available":96607698944,"internally_reserved":0,"allocated":1396736,"data_stored":979399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.38700000000000001,"15min":0.39100000000000001},"min":{"1min":0.27700000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.46000000000000002,"15min":0.46400000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47999999999999998,"15min":0.48899999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.60399999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.439,"5min":0.44800000000000001,"15min":0.45400000000000001},"min":{"1min":0.34200000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.44800000000000001}]},{"osd":3,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46600000000000003,"15min":0.47099999999999997},"min":{"1min":0.35299999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.65900000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53200000000000003,"15min":0.54200000000000004},"min":{"1min":0.40699999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.63400000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.63300000000000001}]},{"osd":4,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70499999999999996,"15min":0.71199999999999997},"min":{"1min":0.55900000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0529999999999999,"5min":1.069,"15min":1.069},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.71799999999999997,"15min":0.73199999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97799999999999998,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.61599999999999999}]},{"osd":5,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.73099999999999998,"15min":0.745},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.90000000000000002,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.73499999999999999,"15min":0.751},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0940000000000001,"5min":1.196,"15min":1.196},"last":0.71899999999999997}]},{"osd":6,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.72199999999999998,"15min":0.73599999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0129999999999999,"5min":1.05,"15min":1.05},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.755,"15min":0.77600000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.88400000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.69999999999999996}]},{"osd":7,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.752,"15min":0.76900000000000002},"min":{"1min":0.54800000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.755,"15min":0.77200000000000002},"min":{"1min":0.58199999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.68500000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":815104,"data_stored":392840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45700000000000002,"15min":0.48099999999999998},"min":{"1min":0.29799999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.54700000000000004,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.624,"15min":0.70999999999999996},"min":{"1min":0.32500000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70099999999999996,"5min":3.2999999999999998,"15min":3.2999999999999998},"last":0.65000000000000002}]},{"osd":1,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.56000000000000005,"15min":0.61499999999999999},"min":{"1min":0.309,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.67200000000000004,"5min":3.0600000000000001,"15min":3.0600000000000001},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.60999999999999999,"15min":0.67000000000000004},"min":{"1min":0.36499999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.623,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.42199999999999999}]},{"osd":3,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.86399999999999999,"15min":1.036},"min":{"1min":0.40000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72099999999999997,"5min":9.2200000000000006,"15min":9.2200000000000006},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.57099999999999995,"15min":0.59499999999999997},"min":{"1min":0.40799999999999997,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.66600000000000004,"5min":1.552,"15min":1.552},"last":0.47299999999999998}]},{"osd":4,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.85999999999999999,"15min":0.92600000000000005},"min":{"1min":0.52200000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0049999999999999,"5min":4.2930000000000001,"15min":4.2930000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.75600000000000001,"15min":0.77900000000000003},"min":{"1min":0.55400000000000005,"5min":0.499,"15min":0.499},"max":{"1min":0.93999999999999995,"5min":1.24,"15min":1.24},"last":0.72299999999999998}]},{"osd":5,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.754,"15min":0.76900000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98399999999999999,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.84699999999999998,"15min":0.90700000000000003},"min":{"1min":0.53800000000000003,"5min":0.5,"15min":0.5},"max":{"1min":0.90700000000000003,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.746}]},{"osd":6,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.88300000000000001,"15min":0.94399999999999995},"min":{"1min":0.55300000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.024,"5min":3.3999999999999999,"15min":3.3999999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.91300000000000003,"15min":0.99099999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.97199999999999998,"5min":3.4990000000000001,"15min":3.4990000000000001},"last":0.77000000000000002}]},{"osd":7,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.81100000000000005,"15min":0.84499999999999997},"min":{"1min":0.58199999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.95199999999999996,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.86099999999999999,"15min":0.89700000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.95999999999999996,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.83099999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":390673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.44900000000000001,"15min":0.47099999999999997},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.626,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.621},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.51600000000000001,"15min":0.54400000000000004},"min":{"1min":0.309,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.627,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":0.42199999999999999}]},{"osd":1,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.47699999999999998,"15min":0.5},"min":{"1min":0.33400000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.55400000000000005,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.52900000000000003,"15min":0.56699999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.63,"5min":1.788,"15min":1.788},"last":0.58199999999999996}]},{"osd":2,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.56200000000000006,"15min":0.59199999999999997},"min":{"1min":0.41699999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.73299999999999998,"5min":2.117,"15min":2.117},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59999999999999998,"15min":0.63400000000000001},"min":{"1min":0.42999999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.68400000000000005,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.64700000000000002}]},{"osd":4,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71899999999999997,"15min":0.72199999999999998},"min":{"1min":0.53800000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0249999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.79000000000000004,"15min":0.81399999999999995},"min":{"1min":0.53000000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.95199999999999996,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.71899999999999997}]},{"osd":5,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.72499999999999998,"15min":0.73299999999999998},"min":{"1min":0.505,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92200000000000004,"5min":1.125,"15min":1.125},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.79400000000000004,"15min":0.82799999999999996},"min":{"1min":0.54200000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0569999999999999,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.75700000000000001}]},{"osd":6,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.78600000000000003,"15min":0.81299999999999994},"min":{"1min":0.59199999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93100000000000005,"5min":1.758,"15min":1.758},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.80900000000000005,"15min":0.83499999999999996},"min":{"1min":0.55000000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.095,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.60599999999999998}]},{"osd":7,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.81599999999999995,"15min":0.84799999999999998},"min":{"1min":0.55400000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0289999999999999,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.75800000000000001,"15min":0.76700000000000002},"min":{"1min":0.59099999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.99199999999999999,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.73799999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":389067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.69699999999999995,"15min":0.69799999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.84299999999999997,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70699999999999996,"15min":0.71199999999999997},"min":{"1min":0.53900000000000003,"5min":0.5,"15min":0.5},"max":{"1min":0.86499999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.52200000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.874,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73499999999999999,"15min":0.73799999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88900000000000001,"5min":1.002,"15min":1.002},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.67500000000000004,"15min":0.66900000000000004},"min":{"1min":0.504,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81899999999999995,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68899999999999995,"15min":0.69499999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.93700000000000006,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.54100000000000004}]},{"osd":3,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.73099999999999998,"15min":0.751},"min":{"1min":0.49299999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91300000000000003,"5min":1.645,"15min":1.645},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.747,"15min":0.75900000000000001},"min":{"1min":0.51700000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96899999999999997,"5min":1.708,"15min":1.708},"last":0.46200000000000002}]},{"osd":5,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61799999999999999,"15min":0.61699999999999999},"min":{"1min":0.41499999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84499999999999997,"5min":1.113,"15min":1.113},"last":0.499},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68799999999999994,"15min":0.69499999999999995},"min":{"1min":0.502,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91200000000000003,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.78500000000000003}]},{"osd":6,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70599999999999996,"15min":0.70699999999999996},"min":{"1min":0.48299999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.92100000000000004,"5min":1.127,"15min":1.127},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.74099999999999999,"15min":0.74199999999999999},"min":{"1min":0.442,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0009999999999999,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.76700000000000002}]},{"osd":7,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.54700000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.98499999999999999,"5min":1.198,"15min":1.198},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.81299999999999994,"15min":0.81699999999999995},"min":{"1min":0.65300000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":0.96299999999999997,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.80800000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574896,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":390673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.65300000000000002,"15min":0.629},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.85499999999999998,"5min":4.0510000000000002,"15min":4.0510000000000002},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.71299999999999997,"15min":0.67900000000000005},"min":{"1min":0.39300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.94899999999999995,"5min":6.431,"15min":6.431},"last":0.71999999999999997}]},{"osd":1,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.68300000000000005,"15min":0.65500000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.91300000000000003,"5min":5.3330000000000002,"15min":5.3330000000000002},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.69499999999999995,"15min":0.67100000000000004},"min":{"1min":0.47299999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.81299999999999994,"5min":4.2169999999999996,"15min":4.2169999999999996},"last":0.66300000000000003}]},{"osd":2,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.70699999999999996,"15min":0.66500000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.94799999999999995,"5min":6.4850000000000003,"15min":6.4850000000000003},"last":0.627},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.68200000000000005,"15min":0.66200000000000003},"min":{"1min":0.48099999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.80800000000000005,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":0.80800000000000005}]},{"osd":3,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.749,"15min":0.73899999999999999},"min":{"1min":0.44900000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89500000000000002,"5min":4.7809999999999997,"15min":4.7809999999999997},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.76100000000000001,"15min":0.73799999999999999},"min":{"1min":0.55100000000000005,"5min":0.503,"15min":0.503},"max":{"1min":0.86299999999999999,"5min":5.423,"15min":5.423},"last":0.86799999999999999}]},{"osd":4,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.67200000000000004,"15min":0.65500000000000003},"min":{"1min":0.432,"5min":0.375,"15min":0.375},"max":{"1min":0.879,"5min":3.988,"15min":3.988},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.749,"15min":0.72699999999999998},"min":{"1min":0.46100000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.84599999999999997,"5min":4.827,"15min":4.827},"last":0.77600000000000002}]},{"osd":6,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.77800000000000002,"15min":0.73199999999999998},"min":{"1min":0.53600000000000003,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.92000000000000004,"5min":7.7000000000000002,"15min":7.7000000000000002},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.75,"15min":0.72799999999999998},"min":{"1min":0.53000000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91900000000000004,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.83199999999999996,"15min":0.78000000000000003},"min":{"1min":0.52300000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.91900000000000004,"5min":9.1180000000000003,"15min":9.1180000000000003},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.82699999999999996,"15min":0.80100000000000005},"min":{"1min":0.53700000000000003,"5min":0.505,"15min":0.505},"max":{"1min":0.91900000000000004,"5min":5.2880000000000003,"15min":5.2880000000000003},"last":0.89200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T20:35:00.616 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T20:35:00.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.834+0000 7f313bfff700 1 Processor -- start 2023-07-27T20:35:00.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.834+0000 7f313bfff700 1 -- start start 2023-07-27T20:35:00.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.835+0000 7f313bfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3134139f80 0x7f31340c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:00.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.836+0000 7f313bfff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31340c1810 con 0x7f3134139960 2023-07-27T20:35:00.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.836+0000 7f313bfff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3134139d40 con 0x7f31341542e0 2023-07-27T20:35:00.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.836+0000 7f313bfff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31340c0ee0 con 0x7f3134139f80 2023-07-27T20:35:00.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.836+0000 7f3139d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3134139960 0x7f31340c1e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60376/0 (socket says 172.21.15.72:60376) 2023-07-27T20:35:00.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.836+0000 7f3139d9b700 1 -- 172.21.15.72:0/1963522005 learned_addr learned my addr 172.21.15.72:0/1963522005 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:35:00.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.836+0000 7f313959a700 1 --2- 172.21.15.72:0/1963522005 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3134139f80 0x7f31340c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:00.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.836+0000 7f3138d99700 1 -- 172.21.15.72:0/1963522005 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1155307365 0 0) 0x7f31340c1810 con 0x7f3134139960 2023-07-27T20:35:00.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.836+0000 7f3138d99700 1 -- 172.21.15.72:0/1963522005 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31200035b0 con 0x7f3134139960 2023-07-27T20:35:00.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.836+0000 7f3138d99700 1 -- 172.21.15.72:0/1963522005 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4215295091 0 0) 0x7f31200035b0 con 0x7f3134139960 2023-07-27T20:35:00.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.837+0000 7f3138d99700 1 -- 172.21.15.72:0/1963522005 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3134139f80 msgr2=0x7f31340c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:35:00.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.837+0000 7f3138d99700 1 --2- 172.21.15.72:0/1963522005 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3134139f80 0x7f31340c12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:00.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.837+0000 7f3138d99700 1 -- 172.21.15.72:0/1963522005 >> v1:172.21.15.173:6789/0 conn(0x7f31341542e0 legacy=0x7f3134154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:00.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.837+0000 7f3138d99700 1 -- 172.21.15.72:0/1963522005 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3134151060 con 0x7f3134139960 2023-07-27T20:35:00.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.837+0000 7f3138d99700 1 -- 172.21.15.72:0/1963522005 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f3130001670 con 0x7f3134139960 2023-07-27T20:35:00.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.837+0000 7f3138d99700 1 -- 172.21.15.72:0/1963522005 >> v1:172.21.15.72:6789/0 conn(0x7f3134139960 legacy=0x7f31340c1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:00.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.837+0000 7f3138d99700 1 --2- 172.21.15.72:0/1963522005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3120003a30 0x7f3120003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:00.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.837+0000 7f3138d99700 1 --2- 172.21.15.72:0/1963522005 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31200043e0 0x7f31200048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:00.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.837+0000 7f3138d99700 1 --2- 172.21.15.72:0/1963522005 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3134139f80 0x7f31200051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:00.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.837+0000 7f3138d99700 1 -- 172.21.15.72:0/1963522005 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31340c0ee0 con 0x7f3120003a30 2023-07-27T20:35:00.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.837+0000 7f3138d99700 1 -- 172.21.15.72:0/1963522005 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312000baf0 con 0x7f31200043e0 2023-07-27T20:35:00.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.837+0000 7f3138d99700 1 -- 172.21.15.72:0/1963522005 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f312000dec0 con 0x7f3134139f80 2023-07-27T20:35:00.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.837+0000 7f3139d9b700 1 --2- 172.21.15.72:0/1963522005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3120003a30 0x7f3120003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:00.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.837+0000 7f313959a700 1 --2- 172.21.15.72:0/1963522005 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31200043e0 0x7f31200048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:00.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.837+0000 7f313a59c700 1 --2- 172.21.15.72:0/1963522005 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3134139f80 0x7f31200051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:00.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.837+0000 7f3139d9b700 1 -- 172.21.15.72:0/1963522005 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3134139f80 msgr2=0x7f31200051b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:35:00.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.837+0000 7f3139d9b700 1 --2- 172.21.15.72:0/1963522005 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3134139f80 0x7f31200051b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:00.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.837+0000 7f3139d9b700 1 -- 172.21.15.72:0/1963522005 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31200043e0 msgr2=0x7f31200048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:35:00.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.837+0000 7f3139d9b700 1 --2- 172.21.15.72:0/1963522005 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31200043e0 0x7f31200048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:00.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.837+0000 7f3139d9b700 1 -- 172.21.15.72:0/1963522005 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31200035b0 con 0x7f3120003a30 2023-07-27T20:35:00.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.838+0000 7f3139d9b700 1 --2- 172.21.15.72:0/1963522005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3120003a30 0x7f3120003e10 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f313000c240 tx=0x7f3120005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=233265f2f6bd78a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:00.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.838+0000 7f3138d99700 1 -- 172.21.15.72:0/1963522005 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313000cd80 con 0x7f3120003a30 2023-07-27T20:35:00.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.838+0000 7f3138d99700 1 -- 172.21.15.72:0/1963522005 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3130005960 con 0x7f3120003a30 2023-07-27T20:35:00.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.838+0000 7f3138d99700 1 -- 172.21.15.72:0/1963522005 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3130005d10 con 0x7f3120003a30 2023-07-27T20:35:00.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.838+0000 7f313bfff700 1 -- 172.21.15.72:0/1963522005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3120003a30 msgr2=0x7f3120003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:00.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.838+0000 7f313bfff700 1 --2- 172.21.15.72:0/1963522005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3120003a30 0x7f3120003e10 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f313000c240 tx=0x7f3120005880 comp rx=0 tx=0).stop 2023-07-27T20:35:00.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.838+0000 7f313a59c700 1 -- 172.21.15.72:0/1963522005 reap_dead start 2023-07-27T20:35:00.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.838+0000 7f313bfff700 1 -- 172.21.15.72:0/1963522005 shutdown_connections 2023-07-27T20:35:00.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.838+0000 7f313bfff700 1 -- 172.21.15.72:0/1963522005 >> 172.21.15.72:0/1963522005 conn(0x7f313406a190 msgr2=0x7f313406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:00.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.838+0000 7f313bfff700 1 -- 172.21.15.72:0/1963522005 shutdown_connections 2023-07-27T20:35:00.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.839+0000 7f313bfff700 1 -- 172.21.15.72:0/1963522005 wait complete. 2023-07-27T20:35:00.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.840+0000 7f313bfff700 1 Processor -- start 2023-07-27T20:35:00.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.840+0000 7f313bfff700 1 -- start start 2023-07-27T20:35:00.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.841+0000 7f313bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3120003a30 0x7f31340a9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:00.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.841+0000 7f313bfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31340a9df0 0x7f31341ed6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:00.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.841+0000 7f313bfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3134134ef0 0x7f3134152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:00.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.841+0000 7f313bfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31341ecc50 con 0x7f3120003a30 2023-07-27T20:35:00.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.841+0000 7f313bfff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31341ed210 con 0x7f31340a9df0 2023-07-27T20:35:00.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.841+0000 7f313bfff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31340aa2f0 con 0x7f3134134ef0 2023-07-27T20:35:00.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.841+0000 7f3139d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3120003a30 0x7f31340a9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:00.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.841+0000 7f3139d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3120003a30 0x7f31340a9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48244/0 (socket says 172.21.15.72:48244) 2023-07-27T20:35:00.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.841+0000 7f3139d9b700 1 -- 172.21.15.72:0/4205302718 learned_addr learned my addr 172.21.15.72:0/4205302718 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:35:00.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.842+0000 7f313959a700 1 --2- 172.21.15.72:0/4205302718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31340a9df0 0x7f31341ed6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:00.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.842+0000 7f313a59c700 1 --2- 172.21.15.72:0/4205302718 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3134134ef0 0x7f3134152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:00.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.842+0000 7f3139d9b700 1 -- 172.21.15.72:0/4205302718 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3134134ef0 msgr2=0x7f3134152340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:00.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.842+0000 7f3139d9b700 1 --2- 172.21.15.72:0/4205302718 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3134134ef0 0x7f3134152340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:00.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.842+0000 7f3139d9b700 1 -- 172.21.15.72:0/4205302718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31340a9df0 msgr2=0x7f31341ed6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:00.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.842+0000 7f3139d9b700 1 --2- 172.21.15.72:0/4205302718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31340a9df0 0x7f31341ed6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:00.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.842+0000 7f3139d9b700 1 -- 172.21.15.72:0/4205302718 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31340aa5d0 con 0x7f3120003a30 2023-07-27T20:35:00.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.842+0000 7f3139d9b700 1 --2- 172.21.15.72:0/4205302718 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3120003a30 0x7f31340a9370 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f313000cdb0 tx=0x7f3130001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:00.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.842+0000 7f312a7fc700 1 -- 172.21.15.72:0/4205302718 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313000ce90 con 0x7f3120003a30 2023-07-27T20:35:00.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.842+0000 7f312a7fc700 1 -- 172.21.15.72:0/4205302718 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3130004870 con 0x7f3120003a30 2023-07-27T20:35:00.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.842+0000 7f313bfff700 1 -- 172.21.15.72:0/4205302718 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31341ecea0 con 0x7f3120003a30 2023-07-27T20:35:00.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.842+0000 7f312a7fc700 1 -- 172.21.15.72:0/4205302718 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3130004c20 con 0x7f3120003a30 2023-07-27T20:35:00.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.843+0000 7f313bfff700 1 -- 172.21.15.72:0/4205302718 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3134131e20 con 0x7f3120003a30 2023-07-27T20:35:00.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.844+0000 7f313bfff700 1 -- 172.21.15.72:0/4205302718 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3134074310 con 0x7f3120003a30 2023-07-27T20:35:00.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.844+0000 7f312a7fc700 1 -- 172.21.15.72:0/4205302718 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3130019070 con 0x7f3120003a30 2023-07-27T20:35:00.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.845+0000 7f312a7fc700 1 --2- 172.21.15.72:0/4205302718 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f311806ad10 0x7f311806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:00.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.846+0000 7f312a7fc700 1 -- 172.21.15.72:0/4205302718 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f3130089ce0 con 0x7f3120003a30 2023-07-27T20:35:00.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.846+0000 7f313959a700 1 --2- 172.21.15.72:0/4205302718 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f311806ad10 0x7f311806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:00.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.847+0000 7f313959a700 1 --2- 172.21.15.72:0/4205302718 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f311806ad10 0x7f311806d1d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3134136d20 tx=0x7f3124009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:00.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:00.849+0000 7f312a7fc700 1 -- 172.21.15.72:0/4205302718 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f31300548e0 con 0x7f3120003a30 2023-07-27T20:35:01.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.038+0000 7f313bfff700 1 -- 172.21.15.72:0/4205302718 --> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3134151620 con 0x7f311806ad10 2023-07-27T20:35:01.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.055+0000 7f312a7fc700 1 -- 172.21.15.72:0/4205302718 <== mgr.4107 v2:172.21.15.173:6832/910681537 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+549974 (secure 0 0 0) 0x7f3124019070 con 0x7f311806ad10 2023-07-27T20:35:01.049 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:35:01.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.060+0000 7f313bfff700 1 -- 172.21.15.72:0/4205302718 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f311806ad10 msgr2=0x7f311806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:01.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.060+0000 7f313bfff700 1 --2- 172.21.15.72:0/4205302718 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f311806ad10 0x7f311806d1d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3134136d20 tx=0x7f3124009210 comp rx=0 tx=0).stop 2023-07-27T20:35:01.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.060+0000 7f313bfff700 1 -- 172.21.15.72:0/4205302718 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3120003a30 msgr2=0x7f31340a9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:01.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.060+0000 7f313bfff700 1 --2- 172.21.15.72:0/4205302718 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3120003a30 0x7f31340a9370 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f313000cdb0 tx=0x7f3130001980 comp rx=0 tx=0).stop 2023-07-27T20:35:01.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.060+0000 7f313bfff700 1 -- 172.21.15.72:0/4205302718 shutdown_connections 2023-07-27T20:35:01.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.060+0000 7f313bfff700 1 --2- 172.21.15.72:0/4205302718 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f311806ad10 0x7f311806d1d0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:01.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.060+0000 7f313bfff700 1 --2- 172.21.15.72:0/4205302718 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3134134ef0 0x7f3134152340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:01.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.060+0000 7f313bfff700 1 --2- 172.21.15.72:0/4205302718 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3120003a30 0x7f31340a9370 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:01.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.060+0000 7f313bfff700 1 --2- 172.21.15.72:0/4205302718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31340a9df0 0x7f31341ed6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:01.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.060+0000 7f313bfff700 1 -- 172.21.15.72:0/4205302718 >> 172.21.15.72:0/4205302718 conn(0x7f313406a190 msgr2=0x7f31340bfc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:01.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.060+0000 7f313bfff700 1 -- 172.21.15.72:0/4205302718 shutdown_connections 2023-07-27T20:35:01.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.061+0000 7f313bfff700 1 -- 172.21.15.72:0/4205302718 wait complete. 2023-07-27T20:35:01.054 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-07-27T20:35:01.066 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":172,"stamp":"2023-07-27T20:35:00.582017+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596789,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":402,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223708,"kb_used_data":7528,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754751012,"statfs":{"total":773094113280,"available":772865036288,"internally_reserved":0,"allocated":7708672,"data_stored":4305554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.454010"},"pg_stats":[{"pgid":"13.39","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938318+0000","last_change":"2023-07-27T20:34:51.146030+0000","last_active":"2023-07-27T20:34:52.938318+0000","last_peered":"2023-07-27T20:34:52.938318+0000","last_clean":"2023-07-27T20:34:52.938318+0000","last_became_active":"2023-07-27T20:34:51.145726+0000","last_became_peered":"2023-07-27T20:34:51.145726+0000","last_unstale":"2023-07-27T20:34:52.938318+0000","last_undegraded":"2023-07-27T20:34:52.938318+0000","last_fullsized":"2023-07-27T20:34:52.938318+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:55:07.037931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132896+0000","last_change":"2023-07-27T20:34:34.316234+0000","last_active":"2023-07-27T20:34:52.132896+0000","last_peered":"2023-07-27T20:34:52.132896+0000","last_clean":"2023-07-27T20:34:52.132896+0000","last_became_active":"2023-07-27T20:34:34.315976+0000","last_became_peered":"2023-07-27T20:34:34.315976+0000","last_unstale":"2023-07-27T20:34:52.132896+0000","last_undegraded":"2023-07-27T20:34:52.132896+0000","last_fullsized":"2023-07-27T20:34:52.132896+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:57:04.577992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.552554+0000","last_change":"2023-07-27T20:34:51.158344+0000","last_active":"2023-07-27T20:34:53.552554+0000","last_peered":"2023-07-27T20:34:53.552554+0000","last_clean":"2023-07-27T20:34:53.552554+0000","last_became_active":"2023-07-27T20:34:51.158001+0000","last_became_peered":"2023-07-27T20:34:51.158001+0000","last_unstale":"2023-07-27T20:34:53.552554+0000","last_undegraded":"2023-07-27T20:34:53.552554+0000","last_fullsized":"2023-07-27T20:34:53.552554+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:50:35.181709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210376+0000","last_change":"2023-07-27T20:34:34.314798+0000","last_active":"2023-07-27T20:34:53.210376+0000","last_peered":"2023-07-27T20:34:53.210376+0000","last_clean":"2023-07-27T20:34:53.210376+0000","last_became_active":"2023-07-27T20:34:34.314515+0000","last_became_peered":"2023-07-27T20:34:34.314515+0000","last_unstale":"2023-07-27T20:34:53.210376+0000","last_undegraded":"2023-07-27T20:34:53.210376+0000","last_fullsized":"2023-07-27T20:34:53.210376+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:09:19.279175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131971+0000","last_change":"2023-07-27T20:34:51.153611+0000","last_active":"2023-07-27T20:34:52.131971+0000","last_peered":"2023-07-27T20:34:52.131971+0000","last_clean":"2023-07-27T20:34:52.131971+0000","last_became_active":"2023-07-27T20:34:51.153320+0000","last_became_peered":"2023-07-27T20:34:51.153320+0000","last_unstale":"2023-07-27T20:34:52.131971+0000","last_undegraded":"2023-07-27T20:34:52.131971+0000","last_fullsized":"2023-07-27T20:34:52.131971+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:59:14.981939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389460+0000","last_change":"2023-07-27T20:34:34.296875+0000","last_active":"2023-07-27T20:34:52.389460+0000","last_peered":"2023-07-27T20:34:52.389460+0000","last_clean":"2023-07-27T20:34:52.389460+0000","last_became_active":"2023-07-27T20:34:34.296594+0000","last_became_peered":"2023-07-27T20:34:34.296594+0000","last_unstale":"2023-07-27T20:34:52.389460+0000","last_undegraded":"2023-07-27T20:34:52.389460+0000","last_fullsized":"2023-07-27T20:34:52.389460+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:12:46.064183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.552894+0000","last_change":"2023-07-27T20:34:51.151531+0000","last_active":"2023-07-27T20:34:53.552894+0000","last_peered":"2023-07-27T20:34:53.552894+0000","last_clean":"2023-07-27T20:34:53.552894+0000","last_became_active":"2023-07-27T20:34:51.151241+0000","last_became_peered":"2023-07-27T20:34:51.151241+0000","last_unstale":"2023-07-27T20:34:53.552894+0000","last_undegraded":"2023-07-27T20:34:53.552894+0000","last_fullsized":"2023-07-27T20:34:53.552894+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:31:26.732750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590169+0000","last_change":"2023-07-27T20:34:34.316000+0000","last_active":"2023-07-27T20:34:52.590169+0000","last_peered":"2023-07-27T20:34:52.590169+0000","last_clean":"2023-07-27T20:34:52.590169+0000","last_became_active":"2023-07-27T20:34:34.315494+0000","last_became_peered":"2023-07-27T20:34:34.315494+0000","last_unstale":"2023-07-27T20:34:52.590169+0000","last_undegraded":"2023-07-27T20:34:52.590169+0000","last_fullsized":"2023-07-27T20:34:52.590169+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:12:23.304991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.133167+0000","last_change":"2023-07-27T20:34:51.155618+0000","last_active":"2023-07-27T20:34:52.133167+0000","last_peered":"2023-07-27T20:34:52.133167+0000","last_clean":"2023-07-27T20:34:52.133167+0000","last_became_active":"2023-07-27T20:34:51.155297+0000","last_became_peered":"2023-07-27T20:34:51.155297+0000","last_unstale":"2023-07-27T20:34:52.133167+0000","last_undegraded":"2023-07-27T20:34:52.133167+0000","last_fullsized":"2023-07-27T20:34:52.133167+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:24:43.146014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938985+0000","last_change":"2023-07-27T20:34:34.310257+0000","last_active":"2023-07-27T20:34:52.938985+0000","last_peered":"2023-07-27T20:34:52.938985+0000","last_clean":"2023-07-27T20:34:52.938985+0000","last_became_active":"2023-07-27T20:34:34.309918+0000","last_became_peered":"2023-07-27T20:34:34.309918+0000","last_unstale":"2023-07-27T20:34:52.938985+0000","last_undegraded":"2023-07-27T20:34:52.938985+0000","last_fullsized":"2023-07-27T20:34:52.938985+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:37:41.424554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938562+0000","last_change":"2023-07-27T20:34:51.156185+0000","last_active":"2023-07-27T20:34:52.938562+0000","last_peered":"2023-07-27T20:34:52.938562+0000","last_clean":"2023-07-27T20:34:52.938562+0000","last_became_active":"2023-07-27T20:34:51.155841+0000","last_became_peered":"2023-07-27T20:34:51.155841+0000","last_unstale":"2023-07-27T20:34:52.938562+0000","last_undegraded":"2023-07-27T20:34:52.938562+0000","last_fullsized":"2023-07-27T20:34:52.938562+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:05:20.675611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209213+0000","last_change":"2023-07-27T20:34:34.319670+0000","last_active":"2023-07-27T20:34:53.209213+0000","last_peered":"2023-07-27T20:34:53.209213+0000","last_clean":"2023-07-27T20:34:53.209213+0000","last_became_active":"2023-07-27T20:34:34.319356+0000","last_became_peered":"2023-07-27T20:34:34.319356+0000","last_unstale":"2023-07-27T20:34:53.209213+0000","last_undegraded":"2023-07-27T20:34:53.209213+0000","last_fullsized":"2023-07-27T20:34:53.209213+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:11:10.950594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210437+0000","last_change":"2023-07-27T20:34:51.152669+0000","last_active":"2023-07-27T20:34:53.210437+0000","last_peered":"2023-07-27T20:34:53.210437+0000","last_clean":"2023-07-27T20:34:53.210437+0000","last_became_active":"2023-07-27T20:34:51.151988+0000","last_became_peered":"2023-07-27T20:34:51.151988+0000","last_unstale":"2023-07-27T20:34:53.210437+0000","last_undegraded":"2023-07-27T20:34:53.210437+0000","last_fullsized":"2023-07-27T20:34:53.210437+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:02:26.072707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.553014+0000","last_change":"2023-07-27T20:34:34.300907+0000","last_active":"2023-07-27T20:34:53.553014+0000","last_peered":"2023-07-27T20:34:53.553014+0000","last_clean":"2023-07-27T20:34:53.553014+0000","last_became_active":"2023-07-27T20:34:34.300633+0000","last_became_peered":"2023-07-27T20:34:34.300633+0000","last_unstale":"2023-07-27T20:34:53.553014+0000","last_undegraded":"2023-07-27T20:34:53.553014+0000","last_fullsized":"2023-07-27T20:34:53.553014+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:22:39.673260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590334+0000","last_change":"2023-07-27T20:34:51.159055+0000","last_active":"2023-07-27T20:34:52.590334+0000","last_peered":"2023-07-27T20:34:52.590334+0000","last_clean":"2023-07-27T20:34:52.590334+0000","last_became_active":"2023-07-27T20:34:51.158750+0000","last_became_peered":"2023-07-27T20:34:51.158750+0000","last_unstale":"2023-07-27T20:34:52.590334+0000","last_undegraded":"2023-07-27T20:34:52.590334+0000","last_fullsized":"2023-07-27T20:34:52.590334+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:45:05.617819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209289+0000","last_change":"2023-07-27T20:34:34.320735+0000","last_active":"2023-07-27T20:34:53.209289+0000","last_peered":"2023-07-27T20:34:53.209289+0000","last_clean":"2023-07-27T20:34:53.209289+0000","last_became_active":"2023-07-27T20:34:34.320086+0000","last_became_peered":"2023-07-27T20:34:34.320086+0000","last_unstale":"2023-07-27T20:34:53.209289+0000","last_undegraded":"2023-07-27T20:34:53.209289+0000","last_fullsized":"2023-07-27T20:34:53.209289+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:46:52.049065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389208+0000","last_change":"2023-07-27T20:34:51.142025+0000","last_active":"2023-07-27T20:34:52.389208+0000","last_peered":"2023-07-27T20:34:52.389208+0000","last_clean":"2023-07-27T20:34:52.389208+0000","last_became_active":"2023-07-27T20:34:51.141766+0000","last_became_peered":"2023-07-27T20:34:51.141766+0000","last_unstale":"2023-07-27T20:34:52.389208+0000","last_undegraded":"2023-07-27T20:34:52.389208+0000","last_fullsized":"2023-07-27T20:34:52.389208+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:47:04.588935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.939577+0000","last_change":"2023-07-27T20:34:34.304314+0000","last_active":"2023-07-27T20:34:52.939577+0000","last_peered":"2023-07-27T20:34:52.939577+0000","last_clean":"2023-07-27T20:34:52.939577+0000","last_became_active":"2023-07-27T20:34:34.304042+0000","last_became_peered":"2023-07-27T20:34:34.304042+0000","last_unstale":"2023-07-27T20:34:52.939577+0000","last_undegraded":"2023-07-27T20:34:52.939577+0000","last_fullsized":"2023-07-27T20:34:52.939577+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:25:33.856127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131024+0000","last_change":"2023-07-27T20:34:51.156837+0000","last_active":"2023-07-27T20:34:52.131024+0000","last_peered":"2023-07-27T20:34:52.131024+0000","last_clean":"2023-07-27T20:34:52.131024+0000","last_became_active":"2023-07-27T20:34:51.156487+0000","last_became_peered":"2023-07-27T20:34:51.156487+0000","last_unstale":"2023-07-27T20:34:52.131024+0000","last_undegraded":"2023-07-27T20:34:52.131024+0000","last_fullsized":"2023-07-27T20:34:52.131024+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:12:02.541917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132260+0000","last_change":"2023-07-27T20:34:34.302549+0000","last_active":"2023-07-27T20:34:52.132260+0000","last_peered":"2023-07-27T20:34:52.132260+0000","last_clean":"2023-07-27T20:34:52.132260+0000","last_became_active":"2023-07-27T20:34:34.301699+0000","last_became_peered":"2023-07-27T20:34:34.301699+0000","last_unstale":"2023-07-27T20:34:52.132260+0000","last_undegraded":"2023-07-27T20:34:52.132260+0000","last_fullsized":"2023-07-27T20:34:52.132260+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:41:12.976042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132365+0000","last_change":"2023-07-27T20:34:51.144061+0000","last_active":"2023-07-27T20:34:52.132365+0000","last_peered":"2023-07-27T20:34:52.132365+0000","last_clean":"2023-07-27T20:34:52.132365+0000","last_became_active":"2023-07-27T20:34:51.143785+0000","last_became_peered":"2023-07-27T20:34:51.143785+0000","last_unstale":"2023-07-27T20:34:52.132365+0000","last_undegraded":"2023-07-27T20:34:52.132365+0000","last_fullsized":"2023-07-27T20:34:52.132365+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:14:18.507561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132935+0000","last_change":"2023-07-27T20:34:34.313419+0000","last_active":"2023-07-27T20:34:52.132935+0000","last_peered":"2023-07-27T20:34:52.132935+0000","last_clean":"2023-07-27T20:34:52.132935+0000","last_became_active":"2023-07-27T20:34:34.313089+0000","last_became_peered":"2023-07-27T20:34:34.313089+0000","last_unstale":"2023-07-27T20:34:52.132935+0000","last_undegraded":"2023-07-27T20:34:52.132935+0000","last_fullsized":"2023-07-27T20:34:52.132935+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:28:39.205723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938526+0000","last_change":"2023-07-27T20:34:51.158340+0000","last_active":"2023-07-27T20:34:52.938526+0000","last_peered":"2023-07-27T20:34:52.938526+0000","last_clean":"2023-07-27T20:34:52.938526+0000","last_became_active":"2023-07-27T20:34:51.158022+0000","last_became_peered":"2023-07-27T20:34:51.158022+0000","last_unstale":"2023-07-27T20:34:52.938526+0000","last_undegraded":"2023-07-27T20:34:52.938526+0000","last_fullsized":"2023-07-27T20:34:52.938526+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:46:52.928504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590333+0000","last_change":"2023-07-27T20:34:34.298435+0000","last_active":"2023-07-27T20:34:52.590333+0000","last_peered":"2023-07-27T20:34:52.590333+0000","last_clean":"2023-07-27T20:34:52.590333+0000","last_became_active":"2023-07-27T20:34:34.298143+0000","last_became_peered":"2023-07-27T20:34:34.298143+0000","last_unstale":"2023-07-27T20:34:52.590333+0000","last_undegraded":"2023-07-27T20:34:52.590333+0000","last_fullsized":"2023-07-27T20:34:52.590333+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:55:19.530682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590340+0000","last_change":"2023-07-27T20:34:51.152168+0000","last_active":"2023-07-27T20:34:52.590340+0000","last_peered":"2023-07-27T20:34:52.590340+0000","last_clean":"2023-07-27T20:34:52.590340+0000","last_became_active":"2023-07-27T20:34:51.151876+0000","last_became_peered":"2023-07-27T20:34:51.151876+0000","last_unstale":"2023-07-27T20:34:52.590340+0000","last_undegraded":"2023-07-27T20:34:52.590340+0000","last_fullsized":"2023-07-27T20:34:52.590340+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:11:27.828934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130963+0000","last_change":"2023-07-27T20:34:34.316878+0000","last_active":"2023-07-27T20:34:52.130963+0000","last_peered":"2023-07-27T20:34:52.130963+0000","last_clean":"2023-07-27T20:34:52.130963+0000","last_became_active":"2023-07-27T20:34:34.316610+0000","last_became_peered":"2023-07-27T20:34:34.316610+0000","last_unstale":"2023-07-27T20:34:52.130963+0000","last_undegraded":"2023-07-27T20:34:52.130963+0000","last_fullsized":"2023-07-27T20:34:52.130963+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:54:00.744549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210557+0000","last_change":"2023-07-27T20:34:51.145667+0000","last_active":"2023-07-27T20:34:53.210557+0000","last_peered":"2023-07-27T20:34:53.210557+0000","last_clean":"2023-07-27T20:34:53.210557+0000","last_became_active":"2023-07-27T20:34:51.145343+0000","last_became_peered":"2023-07-27T20:34:51.145343+0000","last_unstale":"2023-07-27T20:34:53.210557+0000","last_undegraded":"2023-07-27T20:34:53.210557+0000","last_fullsized":"2023-07-27T20:34:53.210557+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:22:02.376178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.939202+0000","last_change":"2023-07-27T20:34:34.297203+0000","last_active":"2023-07-27T20:34:52.939202+0000","last_peered":"2023-07-27T20:34:52.939202+0000","last_clean":"2023-07-27T20:34:52.939202+0000","last_became_active":"2023-07-27T20:34:34.296957+0000","last_became_peered":"2023-07-27T20:34:34.296957+0000","last_unstale":"2023-07-27T20:34:52.939202+0000","last_undegraded":"2023-07-27T20:34:52.939202+0000","last_fullsized":"2023-07-27T20:34:52.939202+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:33:13.233455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.553381+0000","last_change":"2023-07-27T20:34:51.153480+0000","last_active":"2023-07-27T20:34:53.553381+0000","last_peered":"2023-07-27T20:34:53.553381+0000","last_clean":"2023-07-27T20:34:53.553381+0000","last_became_active":"2023-07-27T20:34:51.153217+0000","last_became_peered":"2023-07-27T20:34:51.153217+0000","last_unstale":"2023-07-27T20:34:53.553381+0000","last_undegraded":"2023-07-27T20:34:53.553381+0000","last_fullsized":"2023-07-27T20:34:53.553381+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:33:49.001577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130270+0000","last_change":"2023-07-27T20:34:34.294995+0000","last_active":"2023-07-27T20:34:52.130270+0000","last_peered":"2023-07-27T20:34:52.130270+0000","last_clean":"2023-07-27T20:34:52.130270+0000","last_became_active":"2023-07-27T20:34:34.294646+0000","last_became_peered":"2023-07-27T20:34:34.294646+0000","last_unstale":"2023-07-27T20:34:52.130270+0000","last_undegraded":"2023-07-27T20:34:52.130270+0000","last_fullsized":"2023-07-27T20:34:52.130270+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:19:48.357135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210130+0000","last_change":"2023-07-27T20:34:51.152117+0000","last_active":"2023-07-27T20:34:53.210130+0000","last_peered":"2023-07-27T20:34:53.210130+0000","last_clean":"2023-07-27T20:34:53.210130+0000","last_became_active":"2023-07-27T20:34:51.151720+0000","last_became_peered":"2023-07-27T20:34:51.151720+0000","last_unstale":"2023-07-27T20:34:53.210130+0000","last_undegraded":"2023-07-27T20:34:53.210130+0000","last_fullsized":"2023-07-27T20:34:53.210130+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:17:19.524394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130883+0000","last_change":"2023-07-27T20:34:34.309167+0000","last_active":"2023-07-27T20:34:52.130883+0000","last_peered":"2023-07-27T20:34:52.130883+0000","last_clean":"2023-07-27T20:34:52.130883+0000","last_became_active":"2023-07-27T20:34:34.308831+0000","last_became_peered":"2023-07-27T20:34:34.308831+0000","last_unstale":"2023-07-27T20:34:52.130883+0000","last_undegraded":"2023-07-27T20:34:52.130883+0000","last_fullsized":"2023-07-27T20:34:52.130883+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:43:07.447940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209667+0000","last_change":"2023-07-27T20:34:51.148798+0000","last_active":"2023-07-27T20:34:53.209667+0000","last_peered":"2023-07-27T20:34:53.209667+0000","last_clean":"2023-07-27T20:34:53.209667+0000","last_became_active":"2023-07-27T20:34:51.148492+0000","last_became_peered":"2023-07-27T20:34:51.148492+0000","last_unstale":"2023-07-27T20:34:53.209667+0000","last_undegraded":"2023-07-27T20:34:53.209667+0000","last_fullsized":"2023-07-27T20:34:53.209667+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:53:03.343306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.939220+0000","last_change":"2023-07-27T20:34:34.298405+0000","last_active":"2023-07-27T20:34:52.939220+0000","last_peered":"2023-07-27T20:34:52.939220+0000","last_clean":"2023-07-27T20:34:52.939220+0000","last_became_active":"2023-07-27T20:34:34.298150+0000","last_became_peered":"2023-07-27T20:34:34.298150+0000","last_unstale":"2023-07-27T20:34:52.939220+0000","last_undegraded":"2023-07-27T20:34:52.939220+0000","last_fullsized":"2023-07-27T20:34:52.939220+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:45:16.289674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938436+0000","last_change":"2023-07-27T20:34:51.146714+0000","last_active":"2023-07-27T20:34:52.938436+0000","last_peered":"2023-07-27T20:34:52.938436+0000","last_clean":"2023-07-27T20:34:52.938436+0000","last_became_active":"2023-07-27T20:34:51.145799+0000","last_became_peered":"2023-07-27T20:34:51.145799+0000","last_unstale":"2023-07-27T20:34:52.938436+0000","last_undegraded":"2023-07-27T20:34:52.938436+0000","last_fullsized":"2023-07-27T20:34:52.938436+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:05:22.092932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590468+0000","last_change":"2023-07-27T20:34:34.316418+0000","last_active":"2023-07-27T20:34:52.590468+0000","last_peered":"2023-07-27T20:34:52.590468+0000","last_clean":"2023-07-27T20:34:52.590468+0000","last_became_active":"2023-07-27T20:34:34.316164+0000","last_became_peered":"2023-07-27T20:34:34.316164+0000","last_unstale":"2023-07-27T20:34:52.590468+0000","last_undegraded":"2023-07-27T20:34:52.590468+0000","last_fullsized":"2023-07-27T20:34:52.590468+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:19:54.428946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938627+0000","last_change":"2023-07-27T20:34:51.150712+0000","last_active":"2023-07-27T20:34:52.938627+0000","last_peered":"2023-07-27T20:34:52.938627+0000","last_clean":"2023-07-27T20:34:52.938627+0000","last_became_active":"2023-07-27T20:34:51.150384+0000","last_became_peered":"2023-07-27T20:34:51.150384+0000","last_unstale":"2023-07-27T20:34:52.938627+0000","last_undegraded":"2023-07-27T20:34:52.938627+0000","last_fullsized":"2023-07-27T20:34:52.938627+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:05:31.209001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210276+0000","last_change":"2023-07-27T20:34:34.322046+0000","last_active":"2023-07-27T20:34:53.210276+0000","last_peered":"2023-07-27T20:34:53.210276+0000","last_clean":"2023-07-27T20:34:53.210276+0000","last_became_active":"2023-07-27T20:34:34.321751+0000","last_became_peered":"2023-07-27T20:34:34.321751+0000","last_unstale":"2023-07-27T20:34:53.210276+0000","last_undegraded":"2023-07-27T20:34:53.210276+0000","last_fullsized":"2023-07-27T20:34:53.210276+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:05:28.688422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590016+0000","last_change":"2023-07-27T20:34:51.152143+0000","last_active":"2023-07-27T20:34:52.590016+0000","last_peered":"2023-07-27T20:34:52.590016+0000","last_clean":"2023-07-27T20:34:52.590016+0000","last_became_active":"2023-07-27T20:34:51.151836+0000","last_became_peered":"2023-07-27T20:34:51.151836+0000","last_unstale":"2023-07-27T20:34:52.590016+0000","last_undegraded":"2023-07-27T20:34:52.590016+0000","last_fullsized":"2023-07-27T20:34:52.590016+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:45:27.883128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130915+0000","last_change":"2023-07-27T20:34:34.298450+0000","last_active":"2023-07-27T20:34:52.130915+0000","last_peered":"2023-07-27T20:34:52.130915+0000","last_clean":"2023-07-27T20:34:52.130915+0000","last_became_active":"2023-07-27T20:34:34.298194+0000","last_became_peered":"2023-07-27T20:34:34.298194+0000","last_unstale":"2023-07-27T20:34:52.130915+0000","last_undegraded":"2023-07-27T20:34:52.130915+0000","last_fullsized":"2023-07-27T20:34:52.130915+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:01:23.041905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130916+0000","last_change":"2023-07-27T20:34:51.141249+0000","last_active":"2023-07-27T20:34:52.130916+0000","last_peered":"2023-07-27T20:34:52.130916+0000","last_clean":"2023-07-27T20:34:52.130916+0000","last_became_active":"2023-07-27T20:34:51.140088+0000","last_became_peered":"2023-07-27T20:34:51.140088+0000","last_unstale":"2023-07-27T20:34:52.130916+0000","last_undegraded":"2023-07-27T20:34:52.130916+0000","last_fullsized":"2023-07-27T20:34:52.130916+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:50:38.557507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.133123+0000","last_change":"2023-07-27T20:34:34.295428+0000","last_active":"2023-07-27T20:34:52.133123+0000","last_peered":"2023-07-27T20:34:52.133123+0000","last_clean":"2023-07-27T20:34:52.133123+0000","last_became_active":"2023-07-27T20:34:34.295069+0000","last_became_peered":"2023-07-27T20:34:34.295069+0000","last_unstale":"2023-07-27T20:34:52.133123+0000","last_undegraded":"2023-07-27T20:34:52.133123+0000","last_fullsized":"2023-07-27T20:34:52.133123+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:47:08.096237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938771+0000","last_change":"2023-07-27T20:34:51.147380+0000","last_active":"2023-07-27T20:34:52.938771+0000","last_peered":"2023-07-27T20:34:52.938771+0000","last_clean":"2023-07-27T20:34:52.938771+0000","last_became_active":"2023-07-27T20:34:51.147121+0000","last_became_peered":"2023-07-27T20:34:51.147121+0000","last_unstale":"2023-07-27T20:34:52.938771+0000","last_undegraded":"2023-07-27T20:34:52.938771+0000","last_fullsized":"2023-07-27T20:34:52.938771+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:08:53.040045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131834+0000","last_change":"2023-07-27T20:34:34.300794+0000","last_active":"2023-07-27T20:34:52.131834+0000","last_peered":"2023-07-27T20:34:52.131834+0000","last_clean":"2023-07-27T20:34:52.131834+0000","last_became_active":"2023-07-27T20:34:34.300470+0000","last_became_peered":"2023-07-27T20:34:34.300470+0000","last_unstale":"2023-07-27T20:34:52.131834+0000","last_undegraded":"2023-07-27T20:34:52.131834+0000","last_fullsized":"2023-07-27T20:34:52.131834+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:27:32.975304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132074+0000","last_change":"2023-07-27T20:34:51.148096+0000","last_active":"2023-07-27T20:34:52.132074+0000","last_peered":"2023-07-27T20:34:52.132074+0000","last_clean":"2023-07-27T20:34:52.132074+0000","last_became_active":"2023-07-27T20:34:51.147825+0000","last_became_peered":"2023-07-27T20:34:51.147825+0000","last_unstale":"2023-07-27T20:34:52.132074+0000","last_undegraded":"2023-07-27T20:34:52.132074+0000","last_fullsized":"2023-07-27T20:34:52.132074+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:42:31.002737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132207+0000","last_change":"2023-07-27T20:34:34.306170+0000","last_active":"2023-07-27T20:34:52.132207+0000","last_peered":"2023-07-27T20:34:52.132207+0000","last_clean":"2023-07-27T20:34:52.132207+0000","last_became_active":"2023-07-27T20:34:34.305895+0000","last_became_peered":"2023-07-27T20:34:34.305895+0000","last_unstale":"2023-07-27T20:34:52.132207+0000","last_undegraded":"2023-07-27T20:34:52.132207+0000","last_fullsized":"2023-07-27T20:34:52.132207+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:16:03.687360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938951+0000","last_change":"2023-07-27T20:34:51.158753+0000","last_active":"2023-07-27T20:34:52.938951+0000","last_peered":"2023-07-27T20:34:52.938951+0000","last_clean":"2023-07-27T20:34:52.938951+0000","last_became_active":"2023-07-27T20:34:51.158473+0000","last_became_peered":"2023-07-27T20:34:51.158473+0000","last_unstale":"2023-07-27T20:34:52.938951+0000","last_undegraded":"2023-07-27T20:34:52.938951+0000","last_fullsized":"2023-07-27T20:34:52.938951+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:02:34.927869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132107+0000","last_change":"2023-07-27T20:34:34.324172+0000","last_active":"2023-07-27T20:34:52.132107+0000","last_peered":"2023-07-27T20:34:52.132107+0000","last_clean":"2023-07-27T20:34:52.132107+0000","last_became_active":"2023-07-27T20:34:34.323886+0000","last_became_peered":"2023-07-27T20:34:34.323886+0000","last_unstale":"2023-07-27T20:34:52.132107+0000","last_undegraded":"2023-07-27T20:34:52.132107+0000","last_fullsized":"2023-07-27T20:34:52.132107+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:31:01.753346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131405+0000","last_change":"2023-07-27T20:34:51.142015+0000","last_active":"2023-07-27T20:34:52.131405+0000","last_peered":"2023-07-27T20:34:52.131405+0000","last_clean":"2023-07-27T20:34:52.131405+0000","last_became_active":"2023-07-27T20:34:51.141535+0000","last_became_peered":"2023-07-27T20:34:51.141535+0000","last_unstale":"2023-07-27T20:34:52.131405+0000","last_undegraded":"2023-07-27T20:34:52.131405+0000","last_fullsized":"2023-07-27T20:34:52.131405+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:27:47.573714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132172+0000","last_change":"2023-07-27T20:34:34.312549+0000","last_active":"2023-07-27T20:34:52.132172+0000","last_peered":"2023-07-27T20:34:52.132172+0000","last_clean":"2023-07-27T20:34:52.132172+0000","last_became_active":"2023-07-27T20:34:34.311940+0000","last_became_peered":"2023-07-27T20:34:34.311940+0000","last_unstale":"2023-07-27T20:34:52.132172+0000","last_undegraded":"2023-07-27T20:34:52.132172+0000","last_fullsized":"2023-07-27T20:34:52.132172+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:01:23.041905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209046+0000","last_change":"2023-07-27T20:34:51.158019+0000","last_active":"2023-07-27T20:34:53.209046+0000","last_peered":"2023-07-27T20:34:53.209046+0000","last_clean":"2023-07-27T20:34:53.209046+0000","last_became_active":"2023-07-27T20:34:51.157766+0000","last_became_peered":"2023-07-27T20:34:51.157766+0000","last_unstale":"2023-07-27T20:34:53.209046+0000","last_undegraded":"2023-07-27T20:34:53.209046+0000","last_fullsized":"2023-07-27T20:34:53.209046+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:38:18.284531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.553359+0000","last_change":"2023-07-27T20:34:34.315088+0000","last_active":"2023-07-27T20:34:53.553359+0000","last_peered":"2023-07-27T20:34:53.553359+0000","last_clean":"2023-07-27T20:34:53.553359+0000","last_became_active":"2023-07-27T20:34:34.314823+0000","last_became_peered":"2023-07-27T20:34:34.314823+0000","last_unstale":"2023-07-27T20:34:53.553359+0000","last_undegraded":"2023-07-27T20:34:53.553359+0000","last_fullsized":"2023-07-27T20:34:53.553359+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:42:57.971705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590034+0000","last_change":"2023-07-27T20:34:51.152285+0000","last_active":"2023-07-27T20:34:52.590034+0000","last_peered":"2023-07-27T20:34:52.590034+0000","last_clean":"2023-07-27T20:34:52.590034+0000","last_became_active":"2023-07-27T20:34:51.151991+0000","last_became_peered":"2023-07-27T20:34:51.151991+0000","last_unstale":"2023-07-27T20:34:52.590034+0000","last_undegraded":"2023-07-27T20:34:52.590034+0000","last_fullsized":"2023-07-27T20:34:52.590034+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:43:57.635951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389600+0000","last_change":"2023-07-27T20:34:34.309744+0000","last_active":"2023-07-27T20:34:52.389600+0000","last_peered":"2023-07-27T20:34:52.389600+0000","last_clean":"2023-07-27T20:34:52.389600+0000","last_became_active":"2023-07-27T20:34:34.309438+0000","last_became_peered":"2023-07-27T20:34:34.309438+0000","last_unstale":"2023-07-27T20:34:52.389600+0000","last_undegraded":"2023-07-27T20:34:52.389600+0000","last_fullsized":"2023-07-27T20:34:52.389600+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:46:11.189341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590580+0000","last_change":"2023-07-27T20:34:51.157055+0000","last_active":"2023-07-27T20:34:52.590580+0000","last_peered":"2023-07-27T20:34:52.590580+0000","last_clean":"2023-07-27T20:34:52.590580+0000","last_became_active":"2023-07-27T20:34:51.156703+0000","last_became_peered":"2023-07-27T20:34:51.156703+0000","last_unstale":"2023-07-27T20:34:52.590580+0000","last_undegraded":"2023-07-27T20:34:52.590580+0000","last_fullsized":"2023-07-27T20:34:52.590580+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:09:29.041164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131929+0000","last_change":"2023-07-27T20:34:34.300111+0000","last_active":"2023-07-27T20:34:52.131929+0000","last_peered":"2023-07-27T20:34:52.131929+0000","last_clean":"2023-07-27T20:34:52.131929+0000","last_became_active":"2023-07-27T20:34:34.298555+0000","last_became_peered":"2023-07-27T20:34:34.298555+0000","last_unstale":"2023-07-27T20:34:52.131929+0000","last_undegraded":"2023-07-27T20:34:52.131929+0000","last_fullsized":"2023-07-27T20:34:52.131929+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:08:36.407199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.133088+0000","last_change":"2023-07-27T20:34:51.144866+0000","last_active":"2023-07-27T20:34:52.133088+0000","last_peered":"2023-07-27T20:34:52.133088+0000","last_clean":"2023-07-27T20:34:52.133088+0000","last_became_active":"2023-07-27T20:34:51.143994+0000","last_became_peered":"2023-07-27T20:34:51.143994+0000","last_unstale":"2023-07-27T20:34:52.133088+0000","last_undegraded":"2023-07-27T20:34:52.133088+0000","last_fullsized":"2023-07-27T20:34:52.133088+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:54:17.622889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389507+0000","last_change":"2023-07-27T20:34:34.299682+0000","last_active":"2023-07-27T20:34:52.389507+0000","last_peered":"2023-07-27T20:34:52.389507+0000","last_clean":"2023-07-27T20:34:52.389507+0000","last_became_active":"2023-07-27T20:34:34.299402+0000","last_became_peered":"2023-07-27T20:34:34.299402+0000","last_unstale":"2023-07-27T20:34:52.389507+0000","last_undegraded":"2023-07-27T20:34:52.389507+0000","last_fullsized":"2023-07-27T20:34:52.389507+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:16:30.544846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209756+0000","last_change":"2023-07-27T20:34:51.160605+0000","last_active":"2023-07-27T20:34:53.209756+0000","last_peered":"2023-07-27T20:34:53.209756+0000","last_clean":"2023-07-27T20:34:53.209756+0000","last_became_active":"2023-07-27T20:34:51.160330+0000","last_became_peered":"2023-07-27T20:34:51.160330+0000","last_unstale":"2023-07-27T20:34:53.209756+0000","last_undegraded":"2023-07-27T20:34:53.209756+0000","last_fullsized":"2023-07-27T20:34:53.209756+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:16:27.809706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.552868+0000","last_change":"2023-07-27T20:34:34.320185+0000","last_active":"2023-07-27T20:34:53.552868+0000","last_peered":"2023-07-27T20:34:53.552868+0000","last_clean":"2023-07-27T20:34:53.552868+0000","last_became_active":"2023-07-27T20:34:34.319865+0000","last_became_peered":"2023-07-27T20:34:34.319865+0000","last_unstale":"2023-07-27T20:34:53.552868+0000","last_undegraded":"2023-07-27T20:34:53.552868+0000","last_fullsized":"2023-07-27T20:34:53.552868+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:18:57.338563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590718+0000","last_change":"2023-07-27T20:34:51.160280+0000","last_active":"2023-07-27T20:34:52.590718+0000","last_peered":"2023-07-27T20:34:52.590718+0000","last_clean":"2023-07-27T20:34:52.590718+0000","last_became_active":"2023-07-27T20:34:51.159951+0000","last_became_peered":"2023-07-27T20:34:51.159951+0000","last_unstale":"2023-07-27T20:34:52.590718+0000","last_undegraded":"2023-07-27T20:34:52.590718+0000","last_fullsized":"2023-07-27T20:34:52.590718+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:16:27.809706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.552968+0000","last_change":"2023-07-27T20:34:34.297379+0000","last_active":"2023-07-27T20:34:53.552968+0000","last_peered":"2023-07-27T20:34:53.552968+0000","last_clean":"2023-07-27T20:34:53.552968+0000","last_became_active":"2023-07-27T20:34:34.297105+0000","last_became_peered":"2023-07-27T20:34:34.297105+0000","last_unstale":"2023-07-27T20:34:53.552968+0000","last_undegraded":"2023-07-27T20:34:53.552968+0000","last_fullsized":"2023-07-27T20:34:53.552968+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:37:03.586400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132127+0000","last_change":"2023-07-27T20:34:51.153937+0000","last_active":"2023-07-27T20:34:52.132127+0000","last_peered":"2023-07-27T20:34:52.132127+0000","last_clean":"2023-07-27T20:34:52.132127+0000","last_became_active":"2023-07-27T20:34:51.153655+0000","last_became_peered":"2023-07-27T20:34:51.153655+0000","last_unstale":"2023-07-27T20:34:52.132127+0000","last_undegraded":"2023-07-27T20:34:52.132127+0000","last_fullsized":"2023-07-27T20:34:52.132127+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:53:22.181258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209311+0000","last_change":"2023-07-27T20:34:34.321045+0000","last_active":"2023-07-27T20:34:53.209311+0000","last_peered":"2023-07-27T20:34:53.209311+0000","last_clean":"2023-07-27T20:34:53.209311+0000","last_became_active":"2023-07-27T20:34:34.320433+0000","last_became_peered":"2023-07-27T20:34:34.320433+0000","last_unstale":"2023-07-27T20:34:53.209311+0000","last_undegraded":"2023-07-27T20:34:53.209311+0000","last_fullsized":"2023-07-27T20:34:53.209311+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:56:42.150862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131465+0000","last_change":"2023-07-27T20:34:51.136021+0000","last_active":"2023-07-27T20:34:52.131465+0000","last_peered":"2023-07-27T20:34:52.131465+0000","last_clean":"2023-07-27T20:34:52.131465+0000","last_became_active":"2023-07-27T20:34:51.135735+0000","last_became_peered":"2023-07-27T20:34:51.135735+0000","last_unstale":"2023-07-27T20:34:52.131465+0000","last_undegraded":"2023-07-27T20:34:52.131465+0000","last_fullsized":"2023-07-27T20:34:52.131465+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:57:15.496059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130567+0000","last_change":"2023-07-27T20:34:50.180048+0000","last_active":"2023-07-27T20:34:52.130567+0000","last_peered":"2023-07-27T20:34:52.130567+0000","last_clean":"2023-07-27T20:34:52.130567+0000","last_became_active":"2023-07-27T20:34:50.179711+0000","last_became_peered":"2023-07-27T20:34:50.179711+0000","last_unstale":"2023-07-27T20:34:52.130567+0000","last_undegraded":"2023-07-27T20:34:52.130567+0000","last_fullsized":"2023-07-27T20:34:52.130567+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:41:28.847534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132591+0000","last_change":"2023-07-27T20:34:34.325790+0000","last_active":"2023-07-27T20:34:52.132591+0000","last_peered":"2023-07-27T20:34:52.132591+0000","last_clean":"2023-07-27T20:34:52.132591+0000","last_became_active":"2023-07-27T20:34:34.325387+0000","last_became_peered":"2023-07-27T20:34:34.325387+0000","last_unstale":"2023-07-27T20:34:52.132591+0000","last_undegraded":"2023-07-27T20:34:52.132591+0000","last_fullsized":"2023-07-27T20:34:52.132591+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:01:22.177518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"61'4","reported_seq":25,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.133234+0000","last_change":"2023-07-27T20:34:33.303138+0000","last_active":"2023-07-27T20:34:52.133234+0000","last_peered":"2023-07-27T20:34:52.133234+0000","last_clean":"2023-07-27T20:34:52.133234+0000","last_became_active":"2023-07-27T20:34:33.302808+0000","last_became_peered":"2023-07-27T20:34:33.302808+0000","last_unstale":"2023-07-27T20:34:52.133234+0000","last_undegraded":"2023-07-27T20:34:52.133234+0000","last_fullsized":"2023-07-27T20:34:52.133234+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:01:49.260152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389560+0000","last_change":"2023-07-27T20:34:51.145286+0000","last_active":"2023-07-27T20:34:52.389560+0000","last_peered":"2023-07-27T20:34:52.389560+0000","last_clean":"2023-07-27T20:34:52.389560+0000","last_became_active":"2023-07-27T20:34:51.145030+0000","last_became_peered":"2023-07-27T20:34:51.145030+0000","last_unstale":"2023-07-27T20:34:52.389560+0000","last_undegraded":"2023-07-27T20:34:52.389560+0000","last_fullsized":"2023-07-27T20:34:52.389560+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:55:19.156844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.589690+0000","last_change":"2023-07-27T20:34:50.179618+0000","last_active":"2023-07-27T20:34:52.589690+0000","last_peered":"2023-07-27T20:34:52.589690+0000","last_clean":"2023-07-27T20:34:52.589690+0000","last_became_active":"2023-07-27T20:34:50.179116+0000","last_became_peered":"2023-07-27T20:34:50.179116+0000","last_unstale":"2023-07-27T20:34:52.589690+0000","last_undegraded":"2023-07-27T20:34:52.589690+0000","last_fullsized":"2023-07-27T20:34:52.589690+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:03:50.637289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.939065+0000","last_change":"2023-07-27T20:34:34.298335+0000","last_active":"2023-07-27T20:34:52.939065+0000","last_peered":"2023-07-27T20:34:52.939065+0000","last_clean":"2023-07-27T20:34:52.939065+0000","last_became_active":"2023-07-27T20:34:34.298050+0000","last_became_peered":"2023-07-27T20:34:34.298050+0000","last_unstale":"2023-07-27T20:34:52.939065+0000","last_undegraded":"2023-07-27T20:34:52.939065+0000","last_fullsized":"2023-07-27T20:34:52.939065+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:41:23.899695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"61'1","reported_seq":22,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131076+0000","last_change":"2023-07-27T20:34:33.298365+0000","last_active":"2023-07-27T20:34:52.131076+0000","last_peered":"2023-07-27T20:34:52.131076+0000","last_clean":"2023-07-27T20:34:52.131076+0000","last_became_active":"2023-07-27T20:34:33.298105+0000","last_became_peered":"2023-07-27T20:34:33.298105+0000","last_unstale":"2023-07-27T20:34:52.131076+0000","last_undegraded":"2023-07-27T20:34:52.131076+0000","last_fullsized":"2023-07-27T20:34:52.131076+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:55:41.265066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.589923+0000","last_change":"2023-07-27T20:34:51.157751+0000","last_active":"2023-07-27T20:34:52.589923+0000","last_peered":"2023-07-27T20:34:52.589923+0000","last_clean":"2023-07-27T20:34:52.589923+0000","last_became_active":"2023-07-27T20:34:51.157398+0000","last_became_peered":"2023-07-27T20:34:51.157398+0000","last_unstale":"2023-07-27T20:34:52.589923+0000","last_undegraded":"2023-07-27T20:34:52.589923+0000","last_fullsized":"2023-07-27T20:34:52.589923+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:07:47.085566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"65'1","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132078+0000","last_change":"2023-07-27T20:34:50.182478+0000","last_active":"2023-07-27T20:34:52.132078+0000","last_peered":"2023-07-27T20:34:52.132078+0000","last_clean":"2023-07-27T20:34:52.132078+0000","last_became_active":"2023-07-27T20:34:50.182129+0000","last_became_peered":"2023-07-27T20:34:50.182129+0000","last_unstale":"2023-07-27T20:34:52.132078+0000","last_undegraded":"2023-07-27T20:34:52.132078+0000","last_fullsized":"2023-07-27T20:34:52.132078+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:21:54.178397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210569+0000","last_change":"2023-07-27T20:34:34.323261+0000","last_active":"2023-07-27T20:34:53.210569+0000","last_peered":"2023-07-27T20:34:53.210569+0000","last_clean":"2023-07-27T20:34:53.210569+0000","last_became_active":"2023-07-27T20:34:34.322945+0000","last_became_peered":"2023-07-27T20:34:34.322945+0000","last_unstale":"2023-07-27T20:34:53.210569+0000","last_undegraded":"2023-07-27T20:34:53.210569+0000","last_fullsized":"2023-07-27T20:34:53.210569+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:54:18.189843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"61'2","reported_seq":23,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132465+0000","last_change":"2023-07-27T20:34:33.303171+0000","last_active":"2023-07-27T20:34:52.132465+0000","last_peered":"2023-07-27T20:34:52.132465+0000","last_clean":"2023-07-27T20:34:52.132465+0000","last_became_active":"2023-07-27T20:34:33.302865+0000","last_became_peered":"2023-07-27T20:34:33.302865+0000","last_unstale":"2023-07-27T20:34:52.132465+0000","last_undegraded":"2023-07-27T20:34:52.132465+0000","last_fullsized":"2023-07-27T20:34:52.132465+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:19:24.761135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.133053+0000","last_change":"2023-07-27T20:34:51.151625+0000","last_active":"2023-07-27T20:34:52.133053+0000","last_peered":"2023-07-27T20:34:52.133053+0000","last_clean":"2023-07-27T20:34:52.133053+0000","last_became_active":"2023-07-27T20:34:51.151311+0000","last_became_peered":"2023-07-27T20:34:51.151311+0000","last_unstale":"2023-07-27T20:34:52.133053+0000","last_undegraded":"2023-07-27T20:34:52.133053+0000","last_fullsized":"2023-07-27T20:34:52.133053+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:50:38.557507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"65'1","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131461+0000","last_change":"2023-07-27T20:34:50.177790+0000","last_active":"2023-07-27T20:34:52.131461+0000","last_peered":"2023-07-27T20:34:52.131461+0000","last_clean":"2023-07-27T20:34:52.131461+0000","last_became_active":"2023-07-27T20:34:50.177484+0000","last_became_peered":"2023-07-27T20:34:50.177484+0000","last_unstale":"2023-07-27T20:34:52.131461+0000","last_undegraded":"2023-07-27T20:34:52.131461+0000","last_fullsized":"2023-07-27T20:34:52.131461+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:54:50.777487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.133055+0000","last_change":"2023-07-27T20:34:34.314330+0000","last_active":"2023-07-27T20:34:52.133055+0000","last_peered":"2023-07-27T20:34:52.133055+0000","last_clean":"2023-07-27T20:34:52.133055+0000","last_became_active":"2023-07-27T20:34:34.314054+0000","last_became_peered":"2023-07-27T20:34:34.314054+0000","last_unstale":"2023-07-27T20:34:52.133055+0000","last_undegraded":"2023-07-27T20:34:52.133055+0000","last_fullsized":"2023-07-27T20:34:52.133055+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:44:22.109843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"61'2","reported_seq":23,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210010+0000","last_change":"2023-07-27T20:34:33.307004+0000","last_active":"2023-07-27T20:34:53.210010+0000","last_peered":"2023-07-27T20:34:53.210010+0000","last_clean":"2023-07-27T20:34:53.210010+0000","last_became_active":"2023-07-27T20:34:33.306710+0000","last_became_peered":"2023-07-27T20:34:33.306710+0000","last_unstale":"2023-07-27T20:34:53.210010+0000","last_undegraded":"2023-07-27T20:34:53.210010+0000","last_fullsized":"2023-07-27T20:34:53.210010+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:14:22.083030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209886+0000","last_change":"2023-07-27T20:34:51.158511+0000","last_active":"2023-07-27T20:34:53.209886+0000","last_peered":"2023-07-27T20:34:53.209886+0000","last_clean":"2023-07-27T20:34:53.209886+0000","last_became_active":"2023-07-27T20:34:51.158268+0000","last_became_peered":"2023-07-27T20:34:51.158268+0000","last_unstale":"2023-07-27T20:34:53.209886+0000","last_undegraded":"2023-07-27T20:34:53.209886+0000","last_fullsized":"2023-07-27T20:34:53.209886+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:54:15.988919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"65'2","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130531+0000","last_change":"2023-07-27T20:34:50.180037+0000","last_active":"2023-07-27T20:34:52.130531+0000","last_peered":"2023-07-27T20:34:52.130531+0000","last_clean":"2023-07-27T20:34:52.130531+0000","last_became_active":"2023-07-27T20:34:50.179747+0000","last_became_peered":"2023-07-27T20:34:50.179747+0000","last_unstale":"2023-07-27T20:34:52.130531+0000","last_undegraded":"2023-07-27T20:34:52.130531+0000","last_fullsized":"2023-07-27T20:34:52.130531+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:10:01.966530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.553071+0000","last_change":"2023-07-27T20:34:34.304872+0000","last_active":"2023-07-27T20:34:53.553071+0000","last_peered":"2023-07-27T20:34:53.553071+0000","last_clean":"2023-07-27T20:34:53.553071+0000","last_became_active":"2023-07-27T20:34:34.304583+0000","last_became_peered":"2023-07-27T20:34:34.304583+0000","last_unstale":"2023-07-27T20:34:53.553071+0000","last_undegraded":"2023-07-27T20:34:53.553071+0000","last_fullsized":"2023-07-27T20:34:53.553071+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:33:06.823968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"61'1","reported_seq":22,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389706+0000","last_change":"2023-07-27T20:34:33.303472+0000","last_active":"2023-07-27T20:34:52.389706+0000","last_peered":"2023-07-27T20:34:52.389706+0000","last_clean":"2023-07-27T20:34:52.389706+0000","last_became_active":"2023-07-27T20:34:33.303211+0000","last_became_peered":"2023-07-27T20:34:33.303211+0000","last_unstale":"2023-07-27T20:34:52.389706+0000","last_undegraded":"2023-07-27T20:34:52.389706+0000","last_fullsized":"2023-07-27T20:34:52.389706+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:46:04.542928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132813+0000","last_change":"2023-07-27T20:34:51.151356+0000","last_active":"2023-07-27T20:34:52.132813+0000","last_peered":"2023-07-27T20:34:52.132813+0000","last_clean":"2023-07-27T20:34:52.132813+0000","last_became_active":"2023-07-27T20:34:51.151082+0000","last_became_peered":"2023-07-27T20:34:51.151082+0000","last_unstale":"2023-07-27T20:34:52.132813+0000","last_undegraded":"2023-07-27T20:34:52.132813+0000","last_fullsized":"2023-07-27T20:34:52.132813+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:30:31.686019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"65'2","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130615+0000","last_change":"2023-07-27T20:34:50.181891+0000","last_active":"2023-07-27T20:34:52.130615+0000","last_peered":"2023-07-27T20:34:52.130615+0000","last_clean":"2023-07-27T20:34:52.130615+0000","last_became_active":"2023-07-27T20:34:50.181567+0000","last_became_peered":"2023-07-27T20:34:50.181567+0000","last_unstale":"2023-07-27T20:34:52.130615+0000","last_undegraded":"2023-07-27T20:34:52.130615+0000","last_fullsized":"2023-07-27T20:34:52.130615+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:22:09.691362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131948+0000","last_change":"2023-07-27T20:34:34.309855+0000","last_active":"2023-07-27T20:34:52.131948+0000","last_peered":"2023-07-27T20:34:52.131948+0000","last_clean":"2023-07-27T20:34:52.131948+0000","last_became_active":"2023-07-27T20:34:34.309553+0000","last_became_peered":"2023-07-27T20:34:34.309553+0000","last_unstale":"2023-07-27T20:34:52.131948+0000","last_undegraded":"2023-07-27T20:34:52.131948+0000","last_fullsized":"2023-07-27T20:34:52.131948+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:19:48.357135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"61'1","reported_seq":22,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209328+0000","last_change":"2023-07-27T20:34:33.307265+0000","last_active":"2023-07-27T20:34:53.209328+0000","last_peered":"2023-07-27T20:34:53.209328+0000","last_clean":"2023-07-27T20:34:53.209328+0000","last_became_active":"2023-07-27T20:34:33.306583+0000","last_became_peered":"2023-07-27T20:34:33.306583+0000","last_unstale":"2023-07-27T20:34:53.209328+0000","last_undegraded":"2023-07-27T20:34:53.209328+0000","last_fullsized":"2023-07-27T20:34:53.209328+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:09:11.155306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132022+0000","last_change":"2023-07-27T20:34:51.155271+0000","last_active":"2023-07-27T20:34:52.132022+0000","last_peered":"2023-07-27T20:34:52.132022+0000","last_clean":"2023-07-27T20:34:52.132022+0000","last_became_active":"2023-07-27T20:34:51.154957+0000","last_became_peered":"2023-07-27T20:34:51.154957+0000","last_unstale":"2023-07-27T20:34:52.132022+0000","last_undegraded":"2023-07-27T20:34:52.132022+0000","last_fullsized":"2023-07-27T20:34:52.132022+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:57:48.534355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"65'4","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210538+0000","last_change":"2023-07-27T20:34:50.193860+0000","last_active":"2023-07-27T20:34:53.210538+0000","last_peered":"2023-07-27T20:34:53.210538+0000","last_clean":"2023-07-27T20:34:53.210538+0000","last_became_active":"2023-07-27T20:34:50.193550+0000","last_became_peered":"2023-07-27T20:34:50.193550+0000","last_unstale":"2023-07-27T20:34:53.210538+0000","last_undegraded":"2023-07-27T20:34:53.210538+0000","last_fullsized":"2023-07-27T20:34:53.210538+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:13:03.285306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938426+0000","last_change":"2023-07-27T20:34:34.305104+0000","last_active":"2023-07-27T20:34:52.938426+0000","last_peered":"2023-07-27T20:34:52.938426+0000","last_clean":"2023-07-27T20:34:52.938426+0000","last_became_active":"2023-07-27T20:34:34.304828+0000","last_became_peered":"2023-07-27T20:34:34.304828+0000","last_unstale":"2023-07-27T20:34:52.938426+0000","last_undegraded":"2023-07-27T20:34:52.938426+0000","last_fullsized":"2023-07-27T20:34:52.938426+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:46:28.161781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.589779+0000","last_change":"2023-07-27T20:34:33.304005+0000","last_active":"2023-07-27T20:34:52.589779+0000","last_peered":"2023-07-27T20:34:52.589779+0000","last_clean":"2023-07-27T20:34:52.589779+0000","last_became_active":"2023-07-27T20:34:33.303744+0000","last_became_peered":"2023-07-27T20:34:33.303744+0000","last_unstale":"2023-07-27T20:34:52.589779+0000","last_undegraded":"2023-07-27T20:34:52.589779+0000","last_fullsized":"2023-07-27T20:34:52.589779+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:08:35.251600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210344+0000","last_change":"2023-07-27T20:34:51.152510+0000","last_active":"2023-07-27T20:34:53.210344+0000","last_peered":"2023-07-27T20:34:53.210344+0000","last_clean":"2023-07-27T20:34:53.210344+0000","last_became_active":"2023-07-27T20:34:51.151665+0000","last_became_peered":"2023-07-27T20:34:51.151665+0000","last_unstale":"2023-07-27T20:34:53.210344+0000","last_undegraded":"2023-07-27T20:34:53.210344+0000","last_fullsized":"2023-07-27T20:34:53.210344+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:56:38.080744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"65'1","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132059+0000","last_change":"2023-07-27T20:34:50.180779+0000","last_active":"2023-07-27T20:34:52.132059+0000","last_peered":"2023-07-27T20:34:52.132059+0000","last_clean":"2023-07-27T20:34:52.132059+0000","last_became_active":"2023-07-27T20:34:50.180337+0000","last_became_peered":"2023-07-27T20:34:50.180337+0000","last_unstale":"2023-07-27T20:34:52.132059+0000","last_undegraded":"2023-07-27T20:34:52.132059+0000","last_fullsized":"2023-07-27T20:34:52.132059+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:10:01.966530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130184+0000","last_change":"2023-07-27T20:34:34.310350+0000","last_active":"2023-07-27T20:34:52.130184+0000","last_peered":"2023-07-27T20:34:52.130184+0000","last_clean":"2023-07-27T20:34:52.130184+0000","last_became_active":"2023-07-27T20:34:34.310068+0000","last_became_peered":"2023-07-27T20:34:34.310068+0000","last_unstale":"2023-07-27T20:34:52.130184+0000","last_undegraded":"2023-07-27T20:34:52.130184+0000","last_fullsized":"2023-07-27T20:34:52.130184+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:27:32.975304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938196+0000","last_change":"2023-07-27T20:34:33.299254+0000","last_active":"2023-07-27T20:34:52.938196+0000","last_peered":"2023-07-27T20:34:52.938196+0000","last_clean":"2023-07-27T20:34:52.938196+0000","last_became_active":"2023-07-27T20:34:33.298978+0000","last_became_peered":"2023-07-27T20:34:33.298978+0000","last_unstale":"2023-07-27T20:34:52.938196+0000","last_undegraded":"2023-07-27T20:34:52.938196+0000","last_fullsized":"2023-07-27T20:34:52.938196+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:57:02.656808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.589662+0000","last_change":"2023-07-27T20:34:51.157170+0000","last_active":"2023-07-27T20:34:52.589662+0000","last_peered":"2023-07-27T20:34:52.589662+0000","last_clean":"2023-07-27T20:34:52.589662+0000","last_became_active":"2023-07-27T20:34:51.156897+0000","last_became_peered":"2023-07-27T20:34:51.156897+0000","last_unstale":"2023-07-27T20:34:52.589662+0000","last_undegraded":"2023-07-27T20:34:52.589662+0000","last_fullsized":"2023-07-27T20:34:52.589662+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:32:50.988054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.553210+0000","last_change":"2023-07-27T20:34:50.185449+0000","last_active":"2023-07-27T20:34:53.553210+0000","last_peered":"2023-07-27T20:34:53.553210+0000","last_clean":"2023-07-27T20:34:53.553210+0000","last_became_active":"2023-07-27T20:34:50.185157+0000","last_became_peered":"2023-07-27T20:34:50.185157+0000","last_unstale":"2023-07-27T20:34:53.553210+0000","last_undegraded":"2023-07-27T20:34:53.553210+0000","last_fullsized":"2023-07-27T20:34:53.553210+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:47:03.582088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.553357+0000","last_change":"2023-07-27T20:34:34.313397+0000","last_active":"2023-07-27T20:34:53.553357+0000","last_peered":"2023-07-27T20:34:53.553357+0000","last_clean":"2023-07-27T20:34:53.553357+0000","last_became_active":"2023-07-27T20:34:34.313128+0000","last_became_peered":"2023-07-27T20:34:34.313128+0000","last_unstale":"2023-07-27T20:34:53.553357+0000","last_undegraded":"2023-07-27T20:34:53.553357+0000","last_fullsized":"2023-07-27T20:34:53.553357+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:34:48.784517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132509+0000","last_change":"2023-07-27T20:34:33.299760+0000","last_active":"2023-07-27T20:34:52.132509+0000","last_peered":"2023-07-27T20:34:52.132509+0000","last_clean":"2023-07-27T20:34:52.132509+0000","last_became_active":"2023-07-27T20:34:33.299488+0000","last_became_peered":"2023-07-27T20:34:33.299488+0000","last_unstale":"2023-07-27T20:34:52.132509+0000","last_undegraded":"2023-07-27T20:34:52.132509+0000","last_fullsized":"2023-07-27T20:34:52.132509+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:42:21.819263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.589729+0000","last_change":"2023-07-27T20:34:51.158440+0000","last_active":"2023-07-27T20:34:52.589729+0000","last_peered":"2023-07-27T20:34:52.589729+0000","last_clean":"2023-07-27T20:34:52.589729+0000","last_became_active":"2023-07-27T20:34:51.158195+0000","last_became_peered":"2023-07-27T20:34:51.158195+0000","last_unstale":"2023-07-27T20:34:52.589729+0000","last_undegraded":"2023-07-27T20:34:52.589729+0000","last_fullsized":"2023-07-27T20:34:52.589729+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:54:25.575394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"65'8","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130247+0000","last_change":"2023-07-27T20:34:50.174398+0000","last_active":"2023-07-27T20:34:52.130247+0000","last_peered":"2023-07-27T20:34:52.130247+0000","last_clean":"2023-07-27T20:34:52.130247+0000","last_became_active":"2023-07-27T20:34:50.174069+0000","last_became_peered":"2023-07-27T20:34:50.174069+0000","last_unstale":"2023-07-27T20:34:52.130247+0000","last_undegraded":"2023-07-27T20:34:52.130247+0000","last_fullsized":"2023-07-27T20:34:52.130247+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:59:13.975092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.133051+0000","last_change":"2023-07-27T20:34:34.324198+0000","last_active":"2023-07-27T20:34:52.133051+0000","last_peered":"2023-07-27T20:34:52.133051+0000","last_clean":"2023-07-27T20:34:52.133051+0000","last_became_active":"2023-07-27T20:34:34.323865+0000","last_became_peered":"2023-07-27T20:34:34.323865+0000","last_unstale":"2023-07-27T20:34:52.133051+0000","last_undegraded":"2023-07-27T20:34:52.133051+0000","last_fullsized":"2023-07-27T20:34:52.133051+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:03:17.266643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210618+0000","last_change":"2023-07-27T20:34:33.309943+0000","last_active":"2023-07-27T20:34:53.210618+0000","last_peered":"2023-07-27T20:34:53.210618+0000","last_clean":"2023-07-27T20:34:53.210618+0000","last_became_active":"2023-07-27T20:34:33.309650+0000","last_became_peered":"2023-07-27T20:34:33.309650+0000","last_unstale":"2023-07-27T20:34:53.210618+0000","last_undegraded":"2023-07-27T20:34:53.210618+0000","last_fullsized":"2023-07-27T20:34:53.210618+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:58:22.169362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130293+0000","last_change":"2023-07-27T20:34:51.142784+0000","last_active":"2023-07-27T20:34:52.130293+0000","last_peered":"2023-07-27T20:34:52.130293+0000","last_clean":"2023-07-27T20:34:52.130293+0000","last_became_active":"2023-07-27T20:34:51.142488+0000","last_became_peered":"2023-07-27T20:34:51.142488+0000","last_unstale":"2023-07-27T20:34:52.130293+0000","last_undegraded":"2023-07-27T20:34:52.130293+0000","last_fullsized":"2023-07-27T20:34:52.130293+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:08:53.285539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"65'2","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590315+0000","last_change":"2023-07-27T20:34:50.184191+0000","last_active":"2023-07-27T20:34:52.590315+0000","last_peered":"2023-07-27T20:34:52.590315+0000","last_clean":"2023-07-27T20:34:52.590315+0000","last_became_active":"2023-07-27T20:34:50.183938+0000","last_became_peered":"2023-07-27T20:34:50.183938+0000","last_unstale":"2023-07-27T20:34:52.590315+0000","last_undegraded":"2023-07-27T20:34:52.590315+0000","last_fullsized":"2023-07-27T20:34:52.590315+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:56:58.022354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210337+0000","last_change":"2023-07-27T20:34:34.313276+0000","last_active":"2023-07-27T20:34:53.210337+0000","last_peered":"2023-07-27T20:34:53.210337+0000","last_clean":"2023-07-27T20:34:53.210337+0000","last_became_active":"2023-07-27T20:34:34.310175+0000","last_became_peered":"2023-07-27T20:34:34.310175+0000","last_unstale":"2023-07-27T20:34:53.210337+0000","last_undegraded":"2023-07-27T20:34:53.210337+0000","last_fullsized":"2023-07-27T20:34:53.210337+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:59:03.811289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"61'3","reported_seq":24,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389745+0000","last_change":"2023-07-27T20:34:33.302814+0000","last_active":"2023-07-27T20:34:52.389745+0000","last_peered":"2023-07-27T20:34:52.389745+0000","last_clean":"2023-07-27T20:34:52.389745+0000","last_became_active":"2023-07-27T20:34:33.302504+0000","last_became_peered":"2023-07-27T20:34:33.302504+0000","last_unstale":"2023-07-27T20:34:52.389745+0000","last_undegraded":"2023-07-27T20:34:52.389745+0000","last_fullsized":"2023-07-27T20:34:52.389745+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:43:06.440422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132547+0000","last_change":"2023-07-27T20:34:51.136033+0000","last_active":"2023-07-27T20:34:52.132547+0000","last_peered":"2023-07-27T20:34:52.132547+0000","last_clean":"2023-07-27T20:34:52.132547+0000","last_became_active":"2023-07-27T20:34:51.135756+0000","last_became_peered":"2023-07-27T20:34:51.135756+0000","last_unstale":"2023-07-27T20:34:52.132547+0000","last_undegraded":"2023-07-27T20:34:52.132547+0000","last_fullsized":"2023-07-27T20:34:52.132547+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:51:33.389165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389229+0000","last_change":"2023-07-27T20:34:50.177834+0000","last_active":"2023-07-27T20:34:52.389229+0000","last_peered":"2023-07-27T20:34:52.389229+0000","last_clean":"2023-07-27T20:34:52.389229+0000","last_became_active":"2023-07-27T20:34:50.177565+0000","last_became_peered":"2023-07-27T20:34:50.177565+0000","last_unstale":"2023-07-27T20:34:52.389229+0000","last_undegraded":"2023-07-27T20:34:52.389229+0000","last_fullsized":"2023-07-27T20:34:52.389229+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:33:47.994729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.939052+0000","last_change":"2023-07-27T20:34:34.302062+0000","last_active":"2023-07-27T20:34:52.939052+0000","last_peered":"2023-07-27T20:34:52.939052+0000","last_clean":"2023-07-27T20:34:52.939052+0000","last_became_active":"2023-07-27T20:34:34.301760+0000","last_became_peered":"2023-07-27T20:34:34.301760+0000","last_unstale":"2023-07-27T20:34:52.939052+0000","last_undegraded":"2023-07-27T20:34:52.939052+0000","last_fullsized":"2023-07-27T20:34:52.939052+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:51:30.923164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"62'8","reported_seq":29,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590580+0000","last_change":"2023-07-27T20:34:33.300792+0000","last_active":"2023-07-27T20:34:52.590580+0000","last_peered":"2023-07-27T20:34:52.590580+0000","last_clean":"2023-07-27T20:34:52.590580+0000","last_became_active":"2023-07-27T20:34:33.300452+0000","last_became_peered":"2023-07-27T20:34:33.300452+0000","last_unstale":"2023-07-27T20:34:52.590580+0000","last_undegraded":"2023-07-27T20:34:52.590580+0000","last_fullsized":"2023-07-27T20:34:52.590580+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:34:08.093182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3261,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130524+0000","last_change":"2023-07-27T20:34:51.158451+0000","last_active":"2023-07-27T20:34:52.130524+0000","last_peered":"2023-07-27T20:34:52.130524+0000","last_clean":"2023-07-27T20:34:52.130524+0000","last_became_active":"2023-07-27T20:34:51.158192+0000","last_became_peered":"2023-07-27T20:34:51.158192+0000","last_unstale":"2023-07-27T20:34:52.130524+0000","last_undegraded":"2023-07-27T20:34:52.130524+0000","last_fullsized":"2023-07-27T20:34:52.130524+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:21:55.185244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"65'3","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209761+0000","last_change":"2023-07-27T20:34:50.189853+0000","last_active":"2023-07-27T20:34:53.209761+0000","last_peered":"2023-07-27T20:34:53.209761+0000","last_clean":"2023-07-27T20:34:53.209761+0000","last_became_active":"2023-07-27T20:34:50.189179+0000","last_became_peered":"2023-07-27T20:34:50.189179+0000","last_unstale":"2023-07-27T20:34:53.209761+0000","last_undegraded":"2023-07-27T20:34:53.209761+0000","last_fullsized":"2023-07-27T20:34:53.209761+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:16:38.123878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132109+0000","last_change":"2023-07-27T20:34:34.309848+0000","last_active":"2023-07-27T20:34:52.132109+0000","last_peered":"2023-07-27T20:34:52.132109+0000","last_clean":"2023-07-27T20:34:52.132109+0000","last_became_active":"2023-07-27T20:34:34.309567+0000","last_became_peered":"2023-07-27T20:34:34.309567+0000","last_unstale":"2023-07-27T20:34:52.132109+0000","last_undegraded":"2023-07-27T20:34:52.132109+0000","last_fullsized":"2023-07-27T20:34:52.132109+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:26:56.593889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"61'2","reported_seq":23,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.589878+0000","last_change":"2023-07-27T20:34:33.303304+0000","last_active":"2023-07-27T20:34:52.589878+0000","last_peered":"2023-07-27T20:34:52.589878+0000","last_clean":"2023-07-27T20:34:52.589878+0000","last_became_active":"2023-07-27T20:34:33.303051+0000","last_became_peered":"2023-07-27T20:34:33.303051+0000","last_unstale":"2023-07-27T20:34:52.589878+0000","last_undegraded":"2023-07-27T20:34:52.589878+0000","last_fullsized":"2023-07-27T20:34:52.589878+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:19:38.812347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131831+0000","last_change":"2023-07-27T20:34:51.145057+0000","last_active":"2023-07-27T20:34:52.131831+0000","last_peered":"2023-07-27T20:34:52.131831+0000","last_clean":"2023-07-27T20:34:52.131831+0000","last_became_active":"2023-07-27T20:34:51.144291+0000","last_became_peered":"2023-07-27T20:34:51.144291+0000","last_unstale":"2023-07-27T20:34:52.131831+0000","last_undegraded":"2023-07-27T20:34:52.131831+0000","last_fullsized":"2023-07-27T20:34:52.131831+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:20:46.883871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"65'6","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.552994+0000","last_change":"2023-07-27T20:34:50.184498+0000","last_active":"2023-07-27T20:34:53.552994+0000","last_peered":"2023-07-27T20:34:53.552994+0000","last_clean":"2023-07-27T20:34:53.552994+0000","last_became_active":"2023-07-27T20:34:50.184171+0000","last_became_peered":"2023-07-27T20:34:50.184171+0000","last_unstale":"2023-07-27T20:34:53.552994+0000","last_undegraded":"2023-07-27T20:34:53.552994+0000","last_fullsized":"2023-07-27T20:34:53.552994+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:42:35.757873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.552917+0000","last_change":"2023-07-27T20:34:34.297996+0000","last_active":"2023-07-27T20:34:53.552917+0000","last_peered":"2023-07-27T20:34:53.552917+0000","last_clean":"2023-07-27T20:34:53.552917+0000","last_became_active":"2023-07-27T20:34:34.297650+0000","last_became_peered":"2023-07-27T20:34:34.297650+0000","last_unstale":"2023-07-27T20:34:53.552917+0000","last_undegraded":"2023-07-27T20:34:53.552917+0000","last_fullsized":"2023-07-27T20:34:53.552917+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:26:48.653404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209475+0000","last_change":"2023-07-27T20:34:33.307281+0000","last_active":"2023-07-27T20:34:53.209475+0000","last_peered":"2023-07-27T20:34:53.209475+0000","last_clean":"2023-07-27T20:34:53.209475+0000","last_became_active":"2023-07-27T20:34:33.306983+0000","last_became_peered":"2023-07-27T20:34:33.306983+0000","last_unstale":"2023-07-27T20:34:53.209475+0000","last_undegraded":"2023-07-27T20:34:53.209475+0000","last_fullsized":"2023-07-27T20:34:53.209475+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:34:08.093182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389560+0000","last_change":"2023-07-27T20:34:51.154228+0000","last_active":"2023-07-27T20:34:52.389560+0000","last_peered":"2023-07-27T20:34:52.389560+0000","last_clean":"2023-07-27T20:34:52.389560+0000","last_became_active":"2023-07-27T20:34:51.153077+0000","last_became_peered":"2023-07-27T20:34:51.153077+0000","last_unstale":"2023-07-27T20:34:52.389560+0000","last_undegraded":"2023-07-27T20:34:52.389560+0000","last_fullsized":"2023-07-27T20:34:52.389560+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:07:01.033930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210836+0000","last_change":"2023-07-27T20:34:50.197307+0000","last_active":"2023-07-27T20:34:53.210836+0000","last_peered":"2023-07-27T20:34:53.210836+0000","last_clean":"2023-07-27T20:34:53.210836+0000","last_became_active":"2023-07-27T20:34:50.196986+0000","last_became_peered":"2023-07-27T20:34:50.196986+0000","last_unstale":"2023-07-27T20:34:53.210836+0000","last_undegraded":"2023-07-27T20:34:53.210836+0000","last_fullsized":"2023-07-27T20:34:53.210836+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:46:08.321868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130376+0000","last_change":"2023-07-27T20:34:34.317382+0000","last_active":"2023-07-27T20:34:52.130376+0000","last_peered":"2023-07-27T20:34:52.130376+0000","last_clean":"2023-07-27T20:34:52.130376+0000","last_became_active":"2023-07-27T20:34:34.317102+0000","last_became_peered":"2023-07-27T20:34:34.317102+0000","last_unstale":"2023-07-27T20:34:52.130376+0000","last_undegraded":"2023-07-27T20:34:52.130376+0000","last_fullsized":"2023-07-27T20:34:52.130376+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:57:31.656015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.552801+0000","last_change":"2023-07-27T20:34:33.301597+0000","last_active":"2023-07-27T20:34:53.552801+0000","last_peered":"2023-07-27T20:34:53.552801+0000","last_clean":"2023-07-27T20:34:53.552801+0000","last_became_active":"2023-07-27T20:34:33.301302+0000","last_became_peered":"2023-07-27T20:34:33.301302+0000","last_unstale":"2023-07-27T20:34:53.552801+0000","last_undegraded":"2023-07-27T20:34:53.552801+0000","last_fullsized":"2023-07-27T20:34:53.552801+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:03:20.295861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.553421+0000","last_change":"2023-07-27T20:34:51.154405+0000","last_active":"2023-07-27T20:34:53.553421+0000","last_peered":"2023-07-27T20:34:53.553421+0000","last_clean":"2023-07-27T20:34:53.553421+0000","last_became_active":"2023-07-27T20:34:51.152287+0000","last_became_peered":"2023-07-27T20:34:51.152287+0000","last_unstale":"2023-07-27T20:34:53.553421+0000","last_undegraded":"2023-07-27T20:34:53.553421+0000","last_fullsized":"2023-07-27T20:34:53.553421+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:13:02.942523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210022+0000","last_change":"2023-07-27T20:34:50.193278+0000","last_active":"2023-07-27T20:34:53.210022+0000","last_peered":"2023-07-27T20:34:53.210022+0000","last_clean":"2023-07-27T20:34:53.210022+0000","last_became_active":"2023-07-27T20:34:50.192976+0000","last_became_peered":"2023-07-27T20:34:50.192976+0000","last_unstale":"2023-07-27T20:34:53.210022+0000","last_undegraded":"2023-07-27T20:34:53.210022+0000","last_fullsized":"2023-07-27T20:34:53.210022+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:57:43.092086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938650+0000","last_change":"2023-07-27T20:34:34.299216+0000","last_active":"2023-07-27T20:34:52.938650+0000","last_peered":"2023-07-27T20:34:52.938650+0000","last_clean":"2023-07-27T20:34:52.938650+0000","last_became_active":"2023-07-27T20:34:34.298877+0000","last_became_peered":"2023-07-27T20:34:34.298877+0000","last_unstale":"2023-07-27T20:34:52.938650+0000","last_undegraded":"2023-07-27T20:34:52.938650+0000","last_fullsized":"2023-07-27T20:34:52.938650+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:44:42.207766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"61'8","reported_seq":29,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131198+0000","last_change":"2023-07-27T20:34:33.301967+0000","last_active":"2023-07-27T20:34:52.131198+0000","last_peered":"2023-07-27T20:34:52.131198+0000","last_clean":"2023-07-27T20:34:52.131198+0000","last_became_active":"2023-07-27T20:34:33.301702+0000","last_became_peered":"2023-07-27T20:34:33.301702+0000","last_unstale":"2023-07-27T20:34:52.131198+0000","last_undegraded":"2023-07-27T20:34:52.131198+0000","last_fullsized":"2023-07-27T20:34:52.131198+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:18:44.105047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130917+0000","last_change":"2023-07-27T20:34:51.157532+0000","last_active":"2023-07-27T20:34:52.130917+0000","last_peered":"2023-07-27T20:34:52.130917+0000","last_clean":"2023-07-27T20:34:52.130917+0000","last_became_active":"2023-07-27T20:34:51.157253+0000","last_became_peered":"2023-07-27T20:34:51.157253+0000","last_unstale":"2023-07-27T20:34:52.130917+0000","last_undegraded":"2023-07-27T20:34:52.130917+0000","last_fullsized":"2023-07-27T20:34:52.130917+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:48:58.682955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209299+0000","last_change":"2023-07-27T20:34:50.197449+0000","last_active":"2023-07-27T20:34:53.209299+0000","last_peered":"2023-07-27T20:34:53.209299+0000","last_clean":"2023-07-27T20:34:53.209299+0000","last_became_active":"2023-07-27T20:34:50.196997+0000","last_became_peered":"2023-07-27T20:34:50.196997+0000","last_unstale":"2023-07-27T20:34:53.209299+0000","last_undegraded":"2023-07-27T20:34:53.209299+0000","last_fullsized":"2023-07-27T20:34:53.209299+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:55:35.402174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130997+0000","last_change":"2023-07-27T20:34:34.294954+0000","last_active":"2023-07-27T20:34:52.130997+0000","last_peered":"2023-07-27T20:34:52.130997+0000","last_clean":"2023-07-27T20:34:52.130997+0000","last_became_active":"2023-07-27T20:34:34.294073+0000","last_became_peered":"2023-07-27T20:34:34.294073+0000","last_unstale":"2023-07-27T20:34:52.130997+0000","last_undegraded":"2023-07-27T20:34:52.130997+0000","last_fullsized":"2023-07-27T20:34:52.130997+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:47:08.096237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"61'2","reported_seq":23,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210763+0000","last_change":"2023-07-27T20:34:33.308165+0000","last_active":"2023-07-27T20:34:53.210763+0000","last_peered":"2023-07-27T20:34:53.210763+0000","last_clean":"2023-07-27T20:34:53.210763+0000","last_became_active":"2023-07-27T20:34:33.307868+0000","last_became_peered":"2023-07-27T20:34:33.307868+0000","last_unstale":"2023-07-27T20:34:53.210763+0000","last_undegraded":"2023-07-27T20:34:53.210763+0000","last_fullsized":"2023-07-27T20:34:53.210763+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:33:01.060593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209248+0000","last_change":"2023-07-27T20:34:51.151384+0000","last_active":"2023-07-27T20:34:53.209248+0000","last_peered":"2023-07-27T20:34:53.209248+0000","last_clean":"2023-07-27T20:34:53.209248+0000","last_became_active":"2023-07-27T20:34:51.151112+0000","last_became_peered":"2023-07-27T20:34:51.151112+0000","last_unstale":"2023-07-27T20:34:53.209248+0000","last_undegraded":"2023-07-27T20:34:53.209248+0000","last_fullsized":"2023-07-27T20:34:53.209248+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:45:49.617914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131050+0000","last_change":"2023-07-27T20:34:50.190131+0000","last_active":"2023-07-27T20:34:52.131050+0000","last_peered":"2023-07-27T20:34:52.131050+0000","last_clean":"2023-07-27T20:34:52.131050+0000","last_became_active":"2023-07-27T20:34:50.189800+0000","last_became_peered":"2023-07-27T20:34:50.189800+0000","last_unstale":"2023-07-27T20:34:52.131050+0000","last_undegraded":"2023-07-27T20:34:52.131050+0000","last_fullsized":"2023-07-27T20:34:52.131050+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:06:00.701313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.553446+0000","last_change":"2023-07-27T20:34:34.307218+0000","last_active":"2023-07-27T20:34:53.553446+0000","last_peered":"2023-07-27T20:34:53.553446+0000","last_clean":"2023-07-27T20:34:53.553446+0000","last_became_active":"2023-07-27T20:34:34.306781+0000","last_became_peered":"2023-07-27T20:34:34.306781+0000","last_unstale":"2023-07-27T20:34:53.553446+0000","last_undegraded":"2023-07-27T20:34:53.553446+0000","last_fullsized":"2023-07-27T20:34:53.553446+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:55:02.278504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"62'1","reported_seq":22,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.553481+0000","last_change":"2023-07-27T20:34:33.301802+0000","last_active":"2023-07-27T20:34:53.553481+0000","last_peered":"2023-07-27T20:34:53.553481+0000","last_clean":"2023-07-27T20:34:53.553481+0000","last_became_active":"2023-07-27T20:34:33.301453+0000","last_became_peered":"2023-07-27T20:34:33.301453+0000","last_unstale":"2023-07-27T20:34:53.553481+0000","last_undegraded":"2023-07-27T20:34:53.553481+0000","last_fullsized":"2023-07-27T20:34:53.553481+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:06:43.148072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.552694+0000","last_change":"2023-07-27T20:34:51.152536+0000","last_active":"2023-07-27T20:34:53.552694+0000","last_peered":"2023-07-27T20:34:53.552694+0000","last_clean":"2023-07-27T20:34:53.552694+0000","last_became_active":"2023-07-27T20:34:51.152266+0000","last_became_peered":"2023-07-27T20:34:51.152266+0000","last_unstale":"2023-07-27T20:34:53.552694+0000","last_undegraded":"2023-07-27T20:34:53.552694+0000","last_fullsized":"2023-07-27T20:34:53.552694+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:01:54.360533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131077+0000","last_change":"2023-07-27T20:34:50.177951+0000","last_active":"2023-07-27T20:34:52.131077+0000","last_peered":"2023-07-27T20:34:52.131077+0000","last_clean":"2023-07-27T20:34:52.131077+0000","last_became_active":"2023-07-27T20:34:50.177630+0000","last_became_peered":"2023-07-27T20:34:50.177630+0000","last_unstale":"2023-07-27T20:34:52.131077+0000","last_undegraded":"2023-07-27T20:34:52.131077+0000","last_fullsized":"2023-07-27T20:34:52.131077+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:05:48.894914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132549+0000","last_change":"2023-07-27T20:34:34.325646+0000","last_active":"2023-07-27T20:34:52.132549+0000","last_peered":"2023-07-27T20:34:52.132549+0000","last_clean":"2023-07-27T20:34:52.132549+0000","last_became_active":"2023-07-27T20:34:34.325379+0000","last_became_peered":"2023-07-27T20:34:34.325379+0000","last_unstale":"2023-07-27T20:34:52.132549+0000","last_undegraded":"2023-07-27T20:34:52.132549+0000","last_fullsized":"2023-07-27T20:34:52.132549+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:45:22.310599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.939236+0000","last_change":"2023-07-27T20:34:33.297891+0000","last_active":"2023-07-27T20:34:52.939236+0000","last_peered":"2023-07-27T20:34:52.939236+0000","last_clean":"2023-07-27T20:34:52.939236+0000","last_became_active":"2023-07-27T20:34:33.297052+0000","last_became_peered":"2023-07-27T20:34:33.297052+0000","last_unstale":"2023-07-27T20:34:52.939236+0000","last_undegraded":"2023-07-27T20:34:52.939236+0000","last_fullsized":"2023-07-27T20:34:52.939236+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:44:52.958881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130809+0000","last_change":"2023-07-27T20:34:51.143769+0000","last_active":"2023-07-27T20:34:52.130809+0000","last_peered":"2023-07-27T20:34:52.130809+0000","last_clean":"2023-07-27T20:34:52.130809+0000","last_became_active":"2023-07-27T20:34:51.143499+0000","last_became_peered":"2023-07-27T20:34:51.143499+0000","last_unstale":"2023-07-27T20:34:52.130809+0000","last_undegraded":"2023-07-27T20:34:52.130809+0000","last_fullsized":"2023-07-27T20:34:52.130809+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:18:27.673510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131556+0000","last_change":"2023-07-27T20:34:50.179895+0000","last_active":"2023-07-27T20:34:52.131556+0000","last_peered":"2023-07-27T20:34:52.131556+0000","last_clean":"2023-07-27T20:34:52.131556+0000","last_became_active":"2023-07-27T20:34:50.177798+0000","last_became_peered":"2023-07-27T20:34:50.177798+0000","last_unstale":"2023-07-27T20:34:52.131556+0000","last_undegraded":"2023-07-27T20:34:52.131556+0000","last_fullsized":"2023-07-27T20:34:52.131556+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:36:21.810013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.133223+0000","last_change":"2023-07-27T20:34:34.315817+0000","last_active":"2023-07-27T20:34:52.133223+0000","last_peered":"2023-07-27T20:34:52.133223+0000","last_clean":"2023-07-27T20:34:52.133223+0000","last_became_active":"2023-07-27T20:34:34.315521+0000","last_became_peered":"2023-07-27T20:34:34.315521+0000","last_unstale":"2023-07-27T20:34:52.133223+0000","last_undegraded":"2023-07-27T20:34:52.133223+0000","last_fullsized":"2023-07-27T20:34:52.133223+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:08:52.033698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131040+0000","last_change":"2023-07-27T20:34:33.303481+0000","last_active":"2023-07-27T20:34:52.131040+0000","last_peered":"2023-07-27T20:34:52.131040+0000","last_clean":"2023-07-27T20:34:52.131040+0000","last_became_active":"2023-07-27T20:34:33.303145+0000","last_became_peered":"2023-07-27T20:34:33.303145+0000","last_unstale":"2023-07-27T20:34:52.131040+0000","last_undegraded":"2023-07-27T20:34:52.131040+0000","last_fullsized":"2023-07-27T20:34:52.131040+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:21:49.795906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209939+0000","last_change":"2023-07-27T20:34:51.156858+0000","last_active":"2023-07-27T20:34:53.209939+0000","last_peered":"2023-07-27T20:34:53.209939+0000","last_clean":"2023-07-27T20:34:53.209939+0000","last_became_active":"2023-07-27T20:34:51.156411+0000","last_became_peered":"2023-07-27T20:34:51.156411+0000","last_unstale":"2023-07-27T20:34:53.209939+0000","last_undegraded":"2023-07-27T20:34:53.209939+0000","last_fullsized":"2023-07-27T20:34:53.209939+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:54:39.650866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209799+0000","last_change":"2023-07-27T20:34:50.189144+0000","last_active":"2023-07-27T20:34:53.209799+0000","last_peered":"2023-07-27T20:34:53.209799+0000","last_clean":"2023-07-27T20:34:53.209799+0000","last_became_active":"2023-07-27T20:34:50.188791+0000","last_became_peered":"2023-07-27T20:34:50.188791+0000","last_unstale":"2023-07-27T20:34:53.209799+0000","last_undegraded":"2023-07-27T20:34:53.209799+0000","last_fullsized":"2023-07-27T20:34:53.209799+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:14:26.048681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.939252+0000","last_change":"2023-07-27T20:34:34.304160+0000","last_active":"2023-07-27T20:34:52.939252+0000","last_peered":"2023-07-27T20:34:52.939252+0000","last_clean":"2023-07-27T20:34:52.939252+0000","last_became_active":"2023-07-27T20:34:34.303895+0000","last_became_peered":"2023-07-27T20:34:34.303895+0000","last_unstale":"2023-07-27T20:34:52.939252+0000","last_undegraded":"2023-07-27T20:34:52.939252+0000","last_fullsized":"2023-07-27T20:34:52.939252+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:49:58.678558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938972+0000","last_change":"2023-07-27T20:34:33.308129+0000","last_active":"2023-07-27T20:34:52.938972+0000","last_peered":"2023-07-27T20:34:52.938972+0000","last_clean":"2023-07-27T20:34:52.938972+0000","last_became_active":"2023-07-27T20:34:33.307849+0000","last_became_peered":"2023-07-27T20:34:33.307849+0000","last_unstale":"2023-07-27T20:34:52.938972+0000","last_undegraded":"2023-07-27T20:34:52.938972+0000","last_fullsized":"2023-07-27T20:34:52.938972+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:15:18.373676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131657+0000","last_change":"2023-07-27T20:34:51.145256+0000","last_active":"2023-07-27T20:34:52.131657+0000","last_peered":"2023-07-27T20:34:52.131657+0000","last_clean":"2023-07-27T20:34:52.131657+0000","last_became_active":"2023-07-27T20:34:51.144586+0000","last_became_peered":"2023-07-27T20:34:51.144586+0000","last_unstale":"2023-07-27T20:34:52.131657+0000","last_undegraded":"2023-07-27T20:34:52.131657+0000","last_fullsized":"2023-07-27T20:34:52.131657+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:25:19.538837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210262+0000","last_change":"2023-07-27T20:34:50.197348+0000","last_active":"2023-07-27T20:34:53.210262+0000","last_peered":"2023-07-27T20:34:53.210262+0000","last_clean":"2023-07-27T20:34:53.210262+0000","last_became_active":"2023-07-27T20:34:50.197009+0000","last_became_peered":"2023-07-27T20:34:50.197009+0000","last_unstale":"2023-07-27T20:34:53.210262+0000","last_undegraded":"2023-07-27T20:34:53.210262+0000","last_fullsized":"2023-07-27T20:34:53.210262+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:48:41.949565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209386+0000","last_change":"2023-07-27T20:34:34.323167+0000","last_active":"2023-07-27T20:34:53.209386+0000","last_peered":"2023-07-27T20:34:53.209386+0000","last_clean":"2023-07-27T20:34:53.209386+0000","last_became_active":"2023-07-27T20:34:34.322891+0000","last_became_peered":"2023-07-27T20:34:34.322891+0000","last_unstale":"2023-07-27T20:34:53.209386+0000","last_undegraded":"2023-07-27T20:34:53.209386+0000","last_fullsized":"2023-07-27T20:34:53.209386+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:19:54.428946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590181+0000","last_change":"2023-07-27T20:34:33.303415+0000","last_active":"2023-07-27T20:34:52.590181+0000","last_peered":"2023-07-27T20:34:52.590181+0000","last_clean":"2023-07-27T20:34:52.590181+0000","last_became_active":"2023-07-27T20:34:33.303145+0000","last_became_peered":"2023-07-27T20:34:33.303145+0000","last_unstale":"2023-07-27T20:34:52.590181+0000","last_undegraded":"2023-07-27T20:34:52.590181+0000","last_fullsized":"2023-07-27T20:34:52.590181+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:38:00.398673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131777+0000","last_change":"2023-07-27T20:34:51.149547+0000","last_active":"2023-07-27T20:34:52.131777+0000","last_peered":"2023-07-27T20:34:52.131777+0000","last_clean":"2023-07-27T20:34:52.131777+0000","last_became_active":"2023-07-27T20:34:51.149269+0000","last_became_peered":"2023-07-27T20:34:51.149269+0000","last_unstale":"2023-07-27T20:34:52.131777+0000","last_undegraded":"2023-07-27T20:34:52.131777+0000","last_fullsized":"2023-07-27T20:34:52.131777+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:51:28.367151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"65'2","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590648+0000","last_change":"2023-07-27T20:34:50.182629+0000","last_active":"2023-07-27T20:34:52.590648+0000","last_peered":"2023-07-27T20:34:52.590648+0000","last_clean":"2023-07-27T20:34:52.590648+0000","last_became_active":"2023-07-27T20:34:50.182365+0000","last_became_peered":"2023-07-27T20:34:50.182365+0000","last_unstale":"2023-07-27T20:34:52.590648+0000","last_undegraded":"2023-07-27T20:34:52.590648+0000","last_fullsized":"2023-07-27T20:34:52.590648+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:07:03.745417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590031+0000","last_change":"2023-07-27T20:34:34.298297+0000","last_active":"2023-07-27T20:34:52.590031+0000","last_peered":"2023-07-27T20:34:52.590031+0000","last_clean":"2023-07-27T20:34:52.590031+0000","last_became_active":"2023-07-27T20:34:34.297997+0000","last_became_peered":"2023-07-27T20:34:34.297997+0000","last_unstale":"2023-07-27T20:34:52.590031+0000","last_undegraded":"2023-07-27T20:34:52.590031+0000","last_fullsized":"2023-07-27T20:34:52.590031+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:07:46.697965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131421+0000","last_change":"2023-07-27T20:34:33.301354+0000","last_active":"2023-07-27T20:34:52.131421+0000","last_peered":"2023-07-27T20:34:52.131421+0000","last_clean":"2023-07-27T20:34:52.131421+0000","last_became_active":"2023-07-27T20:34:33.301082+0000","last_became_peered":"2023-07-27T20:34:33.301082+0000","last_unstale":"2023-07-27T20:34:52.131421+0000","last_undegraded":"2023-07-27T20:34:52.131421+0000","last_fullsized":"2023-07-27T20:34:52.131421+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:07:16.899217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132799+0000","last_change":"2023-07-27T20:34:51.155856+0000","last_active":"2023-07-27T20:34:52.132799+0000","last_peered":"2023-07-27T20:34:52.132799+0000","last_clean":"2023-07-27T20:34:52.132799+0000","last_became_active":"2023-07-27T20:34:51.155341+0000","last_became_peered":"2023-07-27T20:34:51.155341+0000","last_unstale":"2023-07-27T20:34:52.132799+0000","last_undegraded":"2023-07-27T20:34:52.132799+0000","last_fullsized":"2023-07-27T20:34:52.132799+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:09:28.611086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"66'1","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590224+0000","last_change":"2023-07-27T20:34:50.188180+0000","last_active":"2023-07-27T20:34:52.590224+0000","last_peered":"2023-07-27T20:34:52.590224+0000","last_clean":"2023-07-27T20:34:52.590224+0000","last_became_active":"2023-07-27T20:34:50.187928+0000","last_became_peered":"2023-07-27T20:34:50.187928+0000","last_unstale":"2023-07-27T20:34:52.590224+0000","last_undegraded":"2023-07-27T20:34:52.590224+0000","last_fullsized":"2023-07-27T20:34:52.590224+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:21:12.020163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209668+0000","last_change":"2023-07-27T20:34:34.321962+0000","last_active":"2023-07-27T20:34:53.209668+0000","last_peered":"2023-07-27T20:34:53.209668+0000","last_clean":"2023-07-27T20:34:53.209668+0000","last_became_active":"2023-07-27T20:34:34.321611+0000","last_became_peered":"2023-07-27T20:34:34.321611+0000","last_unstale":"2023-07-27T20:34:53.209668+0000","last_undegraded":"2023-07-27T20:34:53.209668+0000","last_fullsized":"2023-07-27T20:34:53.209668+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:22:39.571086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209946+0000","last_change":"2023-07-27T20:34:33.305936+0000","last_active":"2023-07-27T20:34:53.209946+0000","last_peered":"2023-07-27T20:34:53.209946+0000","last_clean":"2023-07-27T20:34:53.209946+0000","last_became_active":"2023-07-27T20:34:33.305405+0000","last_became_peered":"2023-07-27T20:34:33.305405+0000","last_unstale":"2023-07-27T20:34:53.209946+0000","last_undegraded":"2023-07-27T20:34:53.209946+0000","last_fullsized":"2023-07-27T20:34:53.209946+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:23:23.259253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938598+0000","last_change":"2023-07-27T20:34:51.148128+0000","last_active":"2023-07-27T20:34:52.938598+0000","last_peered":"2023-07-27T20:34:52.938598+0000","last_clean":"2023-07-27T20:34:52.938598+0000","last_became_active":"2023-07-27T20:34:51.147880+0000","last_became_peered":"2023-07-27T20:34:51.147880+0000","last_unstale":"2023-07-27T20:34:52.938598+0000","last_undegraded":"2023-07-27T20:34:52.938598+0000","last_fullsized":"2023-07-27T20:34:52.938598+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:08:23.239413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938773+0000","last_change":"2023-07-27T20:34:50.189383+0000","last_active":"2023-07-27T20:34:52.938773+0000","last_peered":"2023-07-27T20:34:52.938773+0000","last_clean":"2023-07-27T20:34:52.938773+0000","last_became_active":"2023-07-27T20:34:50.189101+0000","last_became_peered":"2023-07-27T20:34:50.189101+0000","last_unstale":"2023-07-27T20:34:52.938773+0000","last_undegraded":"2023-07-27T20:34:52.938773+0000","last_fullsized":"2023-07-27T20:34:52.938773+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T05:14:56.646651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132304+0000","last_change":"2023-07-27T20:34:34.306247+0000","last_active":"2023-07-27T20:34:52.132304+0000","last_peered":"2023-07-27T20:34:52.132304+0000","last_clean":"2023-07-27T20:34:52.132304+0000","last_became_active":"2023-07-27T20:34:34.305974+0000","last_became_peered":"2023-07-27T20:34:34.305974+0000","last_unstale":"2023-07-27T20:34:52.132304+0000","last_undegraded":"2023-07-27T20:34:52.132304+0000","last_fullsized":"2023-07-27T20:34:52.132304+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:21:53.819869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"61'1","reported_seq":22,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210672+0000","last_change":"2023-07-27T20:34:33.308128+0000","last_active":"2023-07-27T20:34:53.210672+0000","last_peered":"2023-07-27T20:34:53.210672+0000","last_clean":"2023-07-27T20:34:53.210672+0000","last_became_active":"2023-07-27T20:34:33.307832+0000","last_became_peered":"2023-07-27T20:34:33.307832+0000","last_unstale":"2023-07-27T20:34:53.210672+0000","last_undegraded":"2023-07-27T20:34:53.210672+0000","last_fullsized":"2023-07-27T20:34:53.210672+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:16:26.061594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":96,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210631+0000","last_change":"2023-07-27T20:31:22.846540+0000","last_active":"2023-07-27T20:34:53.210631+0000","last_peered":"2023-07-27T20:34:53.210631+0000","last_clean":"2023-07-27T20:34:53.210631+0000","last_became_active":"2023-07-27T20:31:22.846128+0000","last_became_peered":"2023-07-27T20:31:22.846128+0000","last_unstale":"2023-07-27T20:34:53.210631+0000","last_undegraded":"2023-07-27T20:34:53.210631+0000","last_fullsized":"2023-07-27T20:34:53.210631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:30:22.222415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.552605+0000","last_change":"2023-07-27T20:34:51.149993+0000","last_active":"2023-07-27T20:34:53.552605+0000","last_peered":"2023-07-27T20:34:53.552605+0000","last_clean":"2023-07-27T20:34:53.552605+0000","last_became_active":"2023-07-27T20:34:51.149708+0000","last_became_peered":"2023-07-27T20:34:51.149708+0000","last_unstale":"2023-07-27T20:34:53.552605+0000","last_undegraded":"2023-07-27T20:34:53.552605+0000","last_fullsized":"2023-07-27T20:34:53.552605+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:36:23.226827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.388985+0000","last_change":"2023-07-27T20:34:50.183371+0000","last_active":"2023-07-27T20:34:52.388985+0000","last_peered":"2023-07-27T20:34:52.388985+0000","last_clean":"2023-07-27T20:34:52.388985+0000","last_became_active":"2023-07-27T20:34:50.183044+0000","last_became_peered":"2023-07-27T20:34:50.183044+0000","last_unstale":"2023-07-27T20:34:52.388985+0000","last_undegraded":"2023-07-27T20:34:52.388985+0000","last_fullsized":"2023-07-27T20:34:52.388985+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:08:26.860263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.133069+0000","last_change":"2023-07-27T20:34:34.311641+0000","last_active":"2023-07-27T20:34:52.133069+0000","last_peered":"2023-07-27T20:34:52.133069+0000","last_clean":"2023-07-27T20:34:52.133069+0000","last_became_active":"2023-07-27T20:34:34.311381+0000","last_became_peered":"2023-07-27T20:34:34.311381+0000","last_unstale":"2023-07-27T20:34:52.133069+0000","last_undegraded":"2023-07-27T20:34:52.133069+0000","last_fullsized":"2023-07-27T20:34:52.133069+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:59:38.957572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"61'2","reported_seq":23,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132392+0000","last_change":"2023-07-27T20:34:33.303573+0000","last_active":"2023-07-27T20:34:52.132392+0000","last_peered":"2023-07-27T20:34:52.132392+0000","last_clean":"2023-07-27T20:34:52.132392+0000","last_became_active":"2023-07-27T20:34:33.303293+0000","last_became_peered":"2023-07-27T20:34:33.303293+0000","last_unstale":"2023-07-27T20:34:52.132392+0000","last_undegraded":"2023-07-27T20:34:52.132392+0000","last_fullsized":"2023-07-27T20:34:52.132392+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:18:09.787653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":96,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590595+0000","last_change":"2023-07-27T20:31:22.845641+0000","last_active":"2023-07-27T20:34:52.590595+0000","last_peered":"2023-07-27T20:34:52.590595+0000","last_clean":"2023-07-27T20:34:52.590595+0000","last_became_active":"2023-07-27T20:31:22.845368+0000","last_became_peered":"2023-07-27T20:31:22.845368+0000","last_unstale":"2023-07-27T20:34:52.590595+0000","last_undegraded":"2023-07-27T20:34:52.590595+0000","last_fullsized":"2023-07-27T20:34:52.590595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:49:35.014478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938809+0000","last_change":"2023-07-27T20:34:51.158083+0000","last_active":"2023-07-27T20:34:52.938809+0000","last_peered":"2023-07-27T20:34:52.938809+0000","last_clean":"2023-07-27T20:34:52.938809+0000","last_became_active":"2023-07-27T20:34:51.157594+0000","last_became_peered":"2023-07-27T20:34:51.157594+0000","last_unstale":"2023-07-27T20:34:52.938809+0000","last_undegraded":"2023-07-27T20:34:52.938809+0000","last_fullsized":"2023-07-27T20:34:52.938809+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:53:59.465313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"65'2","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389297+0000","last_change":"2023-07-27T20:34:50.184319+0000","last_active":"2023-07-27T20:34:52.389297+0000","last_peered":"2023-07-27T20:34:52.389297+0000","last_clean":"2023-07-27T20:34:52.389297+0000","last_became_active":"2023-07-27T20:34:50.183566+0000","last_became_peered":"2023-07-27T20:34:50.183566+0000","last_unstale":"2023-07-27T20:34:52.389297+0000","last_undegraded":"2023-07-27T20:34:52.389297+0000","last_fullsized":"2023-07-27T20:34:52.389297+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:43:13.843198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590454+0000","last_change":"2023-07-27T20:34:34.296863+0000","last_active":"2023-07-27T20:34:52.590454+0000","last_peered":"2023-07-27T20:34:52.590454+0000","last_clean":"2023-07-27T20:34:52.590454+0000","last_became_active":"2023-07-27T20:34:34.296556+0000","last_became_peered":"2023-07-27T20:34:34.296556+0000","last_unstale":"2023-07-27T20:34:52.590454+0000","last_undegraded":"2023-07-27T20:34:52.590454+0000","last_fullsized":"2023-07-27T20:34:52.590454+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:46:52.049065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"61'1","reported_seq":22,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210334+0000","last_change":"2023-07-27T20:34:33.303035+0000","last_active":"2023-07-27T20:34:53.210334+0000","last_peered":"2023-07-27T20:34:53.210334+0000","last_clean":"2023-07-27T20:34:53.210334+0000","last_became_active":"2023-07-27T20:34:33.302764+0000","last_became_peered":"2023-07-27T20:34:33.302764+0000","last_unstale":"2023-07-27T20:34:53.210334+0000","last_undegraded":"2023-07-27T20:34:53.210334+0000","last_fullsized":"2023-07-27T20:34:53.210334+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:35:21.613222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":100,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.133263+0000","last_change":"2023-07-27T20:31:22.848025+0000","last_active":"2023-07-27T20:34:52.133263+0000","last_peered":"2023-07-27T20:34:52.133263+0000","last_clean":"2023-07-27T20:34:52.133263+0000","last_became_active":"2023-07-27T20:31:22.847603+0000","last_became_peered":"2023-07-27T20:31:22.847603+0000","last_unstale":"2023-07-27T20:34:52.133263+0000","last_undegraded":"2023-07-27T20:34:52.133263+0000","last_fullsized":"2023-07-27T20:34:52.133263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:26:35.659170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210533+0000","last_change":"2023-07-27T20:34:51.152340+0000","last_active":"2023-07-27T20:34:53.210533+0000","last_peered":"2023-07-27T20:34:53.210533+0000","last_clean":"2023-07-27T20:34:53.210533+0000","last_became_active":"2023-07-27T20:34:51.151332+0000","last_became_peered":"2023-07-27T20:34:51.151332+0000","last_unstale":"2023-07-27T20:34:53.210533+0000","last_undegraded":"2023-07-27T20:34:53.210533+0000","last_fullsized":"2023-07-27T20:34:53.210533+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:43:35.600181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"65'2","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130801+0000","last_change":"2023-07-27T20:34:50.174082+0000","last_active":"2023-07-27T20:34:52.130801+0000","last_peered":"2023-07-27T20:34:52.130801+0000","last_clean":"2023-07-27T20:34:52.130801+0000","last_became_active":"2023-07-27T20:34:50.173729+0000","last_became_peered":"2023-07-27T20:34:50.173729+0000","last_unstale":"2023-07-27T20:34:52.130801+0000","last_undegraded":"2023-07-27T20:34:52.130801+0000","last_fullsized":"2023-07-27T20:34:52.130801+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:42:38.698273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389258+0000","last_change":"2023-07-27T20:34:34.315837+0000","last_active":"2023-07-27T20:34:52.389258+0000","last_peered":"2023-07-27T20:34:52.389258+0000","last_clean":"2023-07-27T20:34:52.389258+0000","last_became_active":"2023-07-27T20:34:34.315452+0000","last_became_peered":"2023-07-27T20:34:34.315452+0000","last_unstale":"2023-07-27T20:34:52.389258+0000","last_undegraded":"2023-07-27T20:34:52.389258+0000","last_fullsized":"2023-07-27T20:34:52.389258+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:34:48.784517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130455+0000","last_change":"2023-07-27T20:34:33.298534+0000","last_active":"2023-07-27T20:34:52.130455+0000","last_peered":"2023-07-27T20:34:52.130455+0000","last_clean":"2023-07-27T20:34:52.130455+0000","last_became_active":"2023-07-27T20:34:33.298170+0000","last_became_peered":"2023-07-27T20:34:33.298170+0000","last_unstale":"2023-07-27T20:34:52.130455+0000","last_undegraded":"2023-07-27T20:34:52.130455+0000","last_fullsized":"2023-07-27T20:34:52.130455+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:42:13.116879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":100,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131167+0000","last_change":"2023-07-27T20:31:22.848181+0000","last_active":"2023-07-27T20:34:52.131167+0000","last_peered":"2023-07-27T20:34:52.131167+0000","last_clean":"2023-07-27T20:34:52.131167+0000","last_became_active":"2023-07-27T20:31:22.847865+0000","last_became_peered":"2023-07-27T20:31:22.847865+0000","last_unstale":"2023-07-27T20:34:52.131167+0000","last_undegraded":"2023-07-27T20:34:52.131167+0000","last_fullsized":"2023-07-27T20:34:52.131167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T08:25:29.020423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590244+0000","last_change":"2023-07-27T20:34:51.152241+0000","last_active":"2023-07-27T20:34:52.590244+0000","last_peered":"2023-07-27T20:34:52.590244+0000","last_clean":"2023-07-27T20:34:52.590244+0000","last_became_active":"2023-07-27T20:34:51.151898+0000","last_became_peered":"2023-07-27T20:34:51.151898+0000","last_unstale":"2023-07-27T20:34:52.590244+0000","last_undegraded":"2023-07-27T20:34:52.590244+0000","last_fullsized":"2023-07-27T20:34:52.590244+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:45:49.617914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"65'1","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132798+0000","last_change":"2023-07-27T20:34:50.189207+0000","last_active":"2023-07-27T20:34:52.132798+0000","last_peered":"2023-07-27T20:34:52.132798+0000","last_clean":"2023-07-27T20:34:52.132798+0000","last_became_active":"2023-07-27T20:34:50.188918+0000","last_became_peered":"2023-07-27T20:34:50.188918+0000","last_unstale":"2023-07-27T20:34:52.132798+0000","last_undegraded":"2023-07-27T20:34:52.132798+0000","last_fullsized":"2023-07-27T20:34:52.132798+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:50:58.313491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389699+0000","last_change":"2023-07-27T20:34:34.320803+0000","last_active":"2023-07-27T20:34:52.389699+0000","last_peered":"2023-07-27T20:34:52.389699+0000","last_clean":"2023-07-27T20:34:52.389699+0000","last_became_active":"2023-07-27T20:34:34.320444+0000","last_became_peered":"2023-07-27T20:34:34.320444+0000","last_unstale":"2023-07-27T20:34:52.389699+0000","last_undegraded":"2023-07-27T20:34:52.389699+0000","last_fullsized":"2023-07-27T20:34:52.389699+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:55:01.033091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"61'2","reported_seq":23,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209569+0000","last_change":"2023-07-27T20:34:33.306873+0000","last_active":"2023-07-27T20:34:53.209569+0000","last_peered":"2023-07-27T20:34:53.209569+0000","last_clean":"2023-07-27T20:34:53.209569+0000","last_became_active":"2023-07-27T20:34:33.306519+0000","last_became_peered":"2023-07-27T20:34:33.306519+0000","last_unstale":"2023-07-27T20:34:53.209569+0000","last_undegraded":"2023-07-27T20:34:53.209569+0000","last_fullsized":"2023-07-27T20:34:53.209569+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:22:53.344306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":256,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132249+0000","last_change":"2023-07-27T20:31:15.812727+0000","last_active":"2023-07-27T20:34:52.132249+0000","last_peered":"2023-07-27T20:34:52.132249+0000","last_clean":"2023-07-27T20:34:52.132249+0000","last_became_active":"2023-07-27T20:31:15.811803+0000","last_became_peered":"2023-07-27T20:31:15.811803+0000","last_unstale":"2023-07-27T20:34:52.132249+0000","last_undegraded":"2023-07-27T20:34:52.132249+0000","last_fullsized":"2023-07-27T20:34:52.132249+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:14.789257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:14.789257+0000","last_clean_scrub_stamp":"2023-07-27T20:31:14.789257+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T01:35:24.123835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":94,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.553077+0000","last_change":"2023-07-27T20:31:22.847766+0000","last_active":"2023-07-27T20:34:53.553077+0000","last_peered":"2023-07-27T20:34:53.553077+0000","last_clean":"2023-07-27T20:34:53.553077+0000","last_became_active":"2023-07-27T20:31:22.847396+0000","last_became_peered":"2023-07-27T20:31:22.847396+0000","last_unstale":"2023-07-27T20:34:53.553077+0000","last_undegraded":"2023-07-27T20:34:53.553077+0000","last_fullsized":"2023-07-27T20:34:53.553077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:04:59.538283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131959+0000","last_change":"2023-07-27T20:34:51.149498+0000","last_active":"2023-07-27T20:34:52.131959+0000","last_peered":"2023-07-27T20:34:52.131959+0000","last_clean":"2023-07-27T20:34:52.131959+0000","last_became_active":"2023-07-27T20:34:51.149234+0000","last_became_peered":"2023-07-27T20:34:51.149234+0000","last_unstale":"2023-07-27T20:34:52.131959+0000","last_undegraded":"2023-07-27T20:34:52.131959+0000","last_fullsized":"2023-07-27T20:34:52.131959+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T02:41:58.386686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"65'1","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.210901+0000","last_change":"2023-07-27T20:34:50.193255+0000","last_active":"2023-07-27T20:34:53.210901+0000","last_peered":"2023-07-27T20:34:53.210901+0000","last_clean":"2023-07-27T20:34:53.210901+0000","last_became_active":"2023-07-27T20:34:50.192937+0000","last_became_peered":"2023-07-27T20:34:50.192937+0000","last_unstale":"2023-07-27T20:34:53.210901+0000","last_undegraded":"2023-07-27T20:34:53.210901+0000","last_fullsized":"2023-07-27T20:34:53.210901+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:02:04.097977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389081+0000","last_change":"2023-07-27T20:34:34.320690+0000","last_active":"2023-07-27T20:34:52.389081+0000","last_peered":"2023-07-27T20:34:52.389081+0000","last_clean":"2023-07-27T20:34:52.389081+0000","last_became_active":"2023-07-27T20:34:34.320232+0000","last_became_peered":"2023-07-27T20:34:34.320232+0000","last_unstale":"2023-07-27T20:34:52.389081+0000","last_undegraded":"2023-07-27T20:34:52.389081+0000","last_fullsized":"2023-07-27T20:34:52.389081+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:36:23.221362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.552587+0000","last_change":"2023-07-27T20:34:33.308050+0000","last_active":"2023-07-27T20:34:53.552587+0000","last_peered":"2023-07-27T20:34:53.552587+0000","last_clean":"2023-07-27T20:34:53.552587+0000","last_became_active":"2023-07-27T20:34:33.307761+0000","last_became_peered":"2023-07-27T20:34:33.307761+0000","last_unstale":"2023-07-27T20:34:53.552587+0000","last_undegraded":"2023-07-27T20:34:53.552587+0000","last_fullsized":"2023-07-27T20:34:53.552587+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T07:08:38.725198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":94,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.938324+0000","last_change":"2023-07-27T20:31:22.959811+0000","last_active":"2023-07-27T20:34:52.938324+0000","last_peered":"2023-07-27T20:34:52.938324+0000","last_clean":"2023-07-27T20:34:52.938324+0000","last_became_active":"2023-07-27T20:31:22.959449+0000","last_became_peered":"2023-07-27T20:31:22.959449+0000","last_unstale":"2023-07-27T20:34:52.938324+0000","last_undegraded":"2023-07-27T20:34:52.938324+0000","last_fullsized":"2023-07-27T20:34:52.938324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T21:33:48.638402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.131486+0000","last_change":"2023-07-27T20:34:51.153070+0000","last_active":"2023-07-27T20:34:52.131486+0000","last_peered":"2023-07-27T20:34:52.131486+0000","last_clean":"2023-07-27T20:34:52.131486+0000","last_became_active":"2023-07-27T20:34:51.152803+0000","last_became_peered":"2023-07-27T20:34:51.152803+0000","last_unstale":"2023-07-27T20:34:52.131486+0000","last_undegraded":"2023-07-27T20:34:52.131486+0000","last_fullsized":"2023-07-27T20:34:52.131486+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:53:08.452027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.130786+0000","last_change":"2023-07-27T20:34:50.180986+0000","last_active":"2023-07-27T20:34:52.130786+0000","last_peered":"2023-07-27T20:34:52.130786+0000","last_clean":"2023-07-27T20:34:52.130786+0000","last_became_active":"2023-07-27T20:34:50.180736+0000","last_became_peered":"2023-07-27T20:34:50.180736+0000","last_unstale":"2023-07-27T20:34:52.130786+0000","last_undegraded":"2023-07-27T20:34:52.130786+0000","last_fullsized":"2023-07-27T20:34:52.130786+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T06:19:41.640145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.389603+0000","last_change":"2023-07-27T20:34:34.301811+0000","last_active":"2023-07-27T20:34:52.389603+0000","last_peered":"2023-07-27T20:34:52.389603+0000","last_clean":"2023-07-27T20:34:52.389603+0000","last_became_active":"2023-07-27T20:34:34.301525+0000","last_became_peered":"2023-07-27T20:34:34.301525+0000","last_unstale":"2023-07-27T20:34:52.389603+0000","last_undegraded":"2023-07-27T20:34:52.389603+0000","last_fullsized":"2023-07-27T20:34:52.389603+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:31:19.688642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.209626+0000","last_change":"2023-07-27T20:34:33.301467+0000","last_active":"2023-07-27T20:34:53.209626+0000","last_peered":"2023-07-27T20:34:53.209626+0000","last_clean":"2023-07-27T20:34:53.209626+0000","last_became_active":"2023-07-27T20:34:33.301160+0000","last_became_peered":"2023-07-27T20:34:33.301160+0000","last_unstale":"2023-07-27T20:34:53.209626+0000","last_undegraded":"2023-07-27T20:34:53.209626+0000","last_fullsized":"2023-07-27T20:34:53.209626+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:06:46.866407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":94,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.553162+0000","last_change":"2023-07-27T20:31:22.849178+0000","last_active":"2023-07-27T20:34:53.553162+0000","last_peered":"2023-07-27T20:34:53.553162+0000","last_clean":"2023-07-27T20:34:53.553162+0000","last_became_active":"2023-07-27T20:31:22.848856+0000","last_became_peered":"2023-07-27T20:31:22.848856+0000","last_unstale":"2023-07-27T20:34:53.553162+0000","last_undegraded":"2023-07-27T20:34:53.553162+0000","last_fullsized":"2023-07-27T20:34:53.553162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T00:33:11.770874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:53.552958+0000","last_change":"2023-07-27T20:34:51.149654+0000","last_active":"2023-07-27T20:34:53.552958+0000","last_peered":"2023-07-27T20:34:53.552958+0000","last_clean":"2023-07-27T20:34:53.552958+0000","last_became_active":"2023-07-27T20:34:51.149343+0000","last_became_peered":"2023-07-27T20:34:51.149343+0000","last_unstale":"2023-07-27T20:34:53.552958+0000","last_undegraded":"2023-07-27T20:34:53.552958+0000","last_fullsized":"2023-07-27T20:34:53.552958+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:50.149912+0000","last_clean_scrub_stamp":"2023-07-27T20:34:50.149912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T04:07:01.236721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.939101+0000","last_change":"2023-07-27T20:34:50.184967+0000","last_active":"2023-07-27T20:34:52.939101+0000","last_peered":"2023-07-27T20:34:52.939101+0000","last_clean":"2023-07-27T20:34:52.939101+0000","last_became_active":"2023-07-27T20:34:50.184725+0000","last_became_peered":"2023-07-27T20:34:50.184725+0000","last_unstale":"2023-07-27T20:34:52.939101+0000","last_undegraded":"2023-07-27T20:34:52.939101+0000","last_fullsized":"2023-07-27T20:34:52.939101+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:49.143065+0000","last_clean_scrub_stamp":"2023-07-27T20:34:49.143065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T20:51:53.872027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.939161+0000","last_change":"2023-07-27T20:34:34.296711+0000","last_active":"2023-07-27T20:34:52.939161+0000","last_peered":"2023-07-27T20:34:52.939161+0000","last_clean":"2023-07-27T20:34:52.939161+0000","last_became_active":"2023-07-27T20:34:34.296442+0000","last_became_peered":"2023-07-27T20:34:34.296442+0000","last_unstale":"2023-07-27T20:34:52.939161+0000","last_undegraded":"2023-07-27T20:34:52.939161+0000","last_fullsized":"2023-07-27T20:34:52.939161+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:33.271573+0000","last_clean_scrub_stamp":"2023-07-27T20:34:33.271573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T23:31:45.437223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.132712+0000","last_change":"2023-07-27T20:34:33.304301+0000","last_active":"2023-07-27T20:34:52.132712+0000","last_peered":"2023-07-27T20:34:52.132712+0000","last_clean":"2023-07-27T20:34:52.132712+0000","last_became_active":"2023-07-27T20:34:33.303739+0000","last_became_peered":"2023-07-27T20:34:33.303739+0000","last_unstale":"2023-07-27T20:34:52.132712+0000","last_undegraded":"2023-07-27T20:34:52.132712+0000","last_fullsized":"2023-07-27T20:34:52.132712+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:34:32.264055+0000","last_clean_scrub_stamp":"2023-07-27T20:34:32.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-29T03:34:53.026886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":96,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T20:34:52.590657+0000","last_change":"2023-07-27T20:31:22.848698+0000","last_active":"2023-07-27T20:34:52.590657+0000","last_peered":"2023-07-27T20:34:52.590657+0000","last_clean":"2023-07-27T20:34:52.590657+0000","last_became_active":"2023-07-27T20:31:22.848346+0000","last_became_peered":"2023-07-27T20:31:22.848346+0000","last_unstale":"2023-07-27T20:34:52.590657+0000","last_undegraded":"2023-07-27T20:34:52.590657+0000","last_fullsized":"2023-07-27T20:34:52.590657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T20:31:21.821085+0000","last_clean_scrub_stamp":"2023-07-27T20:31:21.821085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-28T22:19:42.901336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":4059,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574897,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28396,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343444,"statfs":{"total":96636764160,"available":96607686656,"internally_reserved":0,"allocated":1404928,"data_stored":980051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.75800000000000001,"15min":0.80300000000000005},"min":{"1min":0.42499999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90000000000000002,"5min":3.5609999999999999,"15min":3.5609999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.70799999999999996,"15min":0.72699999999999998},"min":{"1min":0.39500000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88800000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.53400000000000003}]},{"osd":1,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.69599999999999995,"15min":0.71599999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.84999999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.81000000000000005,"15min":0.86399999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.86699999999999999,"5min":3.927,"15min":3.927},"last":0.79000000000000004}]},{"osd":2,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.80200000000000005,"15min":0.84099999999999997},"min":{"1min":0.47099999999999997,"5min":0.443,"15min":0.443},"max":{"1min":0.86699999999999999,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.76500000000000001,"15min":0.80900000000000005},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85799999999999998,"5min":2.093,"15min":2.093},"last":0.64300000000000002}]},{"osd":3,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.76000000000000001,"15min":0.81200000000000006},"min":{"1min":0.46000000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.76600000000000001,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.85099999999999998,"15min":0.90100000000000002},"min":{"1min":0.57399999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.94099999999999995,"5min":3.1080000000000001,"15min":3.1080000000000001},"last":0.98199999999999998}]},{"osd":4,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.754,"15min":0.78800000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.91100000000000003,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.79800000000000004,"15min":0.83399999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.85799999999999998,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.93899999999999995}]},{"osd":5,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.90600000000000003,"15min":0.999},"min":{"1min":0.47899999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.91400000000000003,"5min":6.1619999999999999,"15min":6.1619999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.94299999999999995,"15min":1.042},"min":{"1min":0.432,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96499999999999997,"5min":6.2729999999999997,"15min":6.2729999999999997},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Jul 27 20:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.81799999999999995,"15min":0.84599999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.075,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.84699999999999998,"15min":0.90500000000000003},"min":{"1min":0.52900000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93799999999999994,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":0.80500000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":389783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.67700000000000005,"15min":0.68899999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.871,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.66300000000000003,"15min":0.66800000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.85499999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.625}]},{"osd":1,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69999999999999996,"15min":0.72199999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84399999999999997,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70099999999999996,"15min":0.70799999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.85499999999999998,"5min":1.266,"15min":1.266},"last":0.73499999999999999}]},{"osd":2,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.69499999999999995,"15min":0.71799999999999997},"min":{"1min":0.51100000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83899999999999997,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.747,"15min":0.76300000000000001},"min":{"1min":0.56499999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.90200000000000002,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.64300000000000002}]},{"osd":3,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.72899999999999998,"15min":0.745},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.84199999999999997,"5min":1.377,"15min":1.377},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.73299999999999998,"15min":0.75700000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92800000000000005,"5min":1.736,"15min":1.736},"last":0.84299999999999997}]},{"osd":4,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69599999999999995,"15min":0.69799999999999995},"min":{"1min":0.47099999999999997,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90300000000000002,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69699999999999995,"15min":0.69299999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.95599999999999996,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.81699999999999995}]},{"osd":5,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.67100000000000004,"15min":0.66500000000000004},"min":{"1min":0.47799999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.88600000000000001,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.74099999999999999,"15min":0.73199999999999998},"min":{"1min":0.45100000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93700000000000006,"5min":1.081,"15min":1.081},"last":0.86099999999999999}]},{"osd":7,"last update":"Thu Jul 27 20:34:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.749,"15min":0.753},"min":{"1min":0.496,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.94699999999999995,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.873},{"interface":"front","average":{"1min":0.753,"5min":0.73999999999999999,"15min":0.73599999999999999},"min":{"1min":0.59499999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97599999999999998,"5min":1.119,"15min":1.119},"last":0.93799999999999994}]}]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":831488,"data_stored":393068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40899999999999997,"15min":0.40600000000000003},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47199999999999998,"15min":0.47899999999999998},"min":{"1min":0.32300000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.378}]},{"osd":2,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44,"15min":0.436},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.47599999999999998,"15min":0.47399999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.42199999999999999}]},{"osd":3,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53400000000000003,"15min":0.53200000000000003},"min":{"1min":0.39400000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.502,"15min":0.504},"min":{"1min":0.374,"5min":0.31,"15min":0.31},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.35099999999999998}]},{"osd":4,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73499999999999999,"15min":0.745},"min":{"1min":0.56699999999999995,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73599999999999999,"15min":0.73199999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72299999999999998,"15min":0.73199999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.498},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.76200000000000001,"15min":0.75700000000000001},"min":{"1min":0.623,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.9630000000000001,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":0.66500000000000004}]},{"osd":6,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.77500000000000002,"15min":0.79500000000000004},"min":{"1min":0.53600000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1419999999999999,"5min":1.347,"15min":1.347},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.80400000000000005,"15min":0.81999999999999995},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.206,"5min":1.409,"15min":1.409},"last":0.60399999999999998}]},{"osd":7,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.77100000000000002,"15min":0.77700000000000002},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.95099999999999996,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78800000000000003,"15min":0.80300000000000005},"min":{"1min":0.55400000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.624}]}]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28384,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343456,"statfs":{"total":96636764160,"available":96607698944,"internally_reserved":0,"allocated":1396736,"data_stored":979399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.38700000000000001,"15min":0.39100000000000001},"min":{"1min":0.27700000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.46000000000000002,"15min":0.46400000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.27400000000000002}]},{"osd":2,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47999999999999998,"15min":0.48899999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.60399999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.44800000000000001,"15min":0.45400000000000001},"min":{"1min":0.34200000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.45900000000000002}]},{"osd":3,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46600000000000003,"15min":0.47099999999999997},"min":{"1min":0.35299999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.65900000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53200000000000003,"15min":0.54200000000000004},"min":{"1min":0.40699999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.63400000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.44}]},{"osd":4,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70499999999999996,"15min":0.71199999999999997},"min":{"1min":0.55900000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0529999999999999,"5min":1.069,"15min":1.069},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.71799999999999997,"15min":0.73199999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97799999999999998,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.79800000000000004}]},{"osd":5,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.73099999999999998,"15min":0.745},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.90000000000000002,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.73499999999999999,"15min":0.751},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0940000000000001,"5min":1.196,"15min":1.196},"last":0.66700000000000004}]},{"osd":6,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.72199999999999998,"15min":0.73599999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0129999999999999,"5min":1.05,"15min":1.05},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.755,"15min":0.77600000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.88400000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.81000000000000005}]},{"osd":7,"last update":"Thu Jul 27 20:34:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.752,"15min":0.76900000000000002},"min":{"1min":0.54800000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.755,"15min":0.77200000000000002},"min":{"1min":0.58199999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.71899999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574897,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":815104,"data_stored":392840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45700000000000002,"15min":0.48099999999999998},"min":{"1min":0.29799999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.54700000000000004,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.624,"15min":0.70999999999999996},"min":{"1min":0.32500000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70099999999999996,"5min":3.2999999999999998,"15min":3.2999999999999998},"last":0.32600000000000001}]},{"osd":1,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.56000000000000005,"15min":0.61499999999999999},"min":{"1min":0.309,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.67200000000000004,"5min":3.0600000000000001,"15min":3.0600000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.60999999999999999,"15min":0.67000000000000004},"min":{"1min":0.36499999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.623,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.86399999999999999,"15min":1.036},"min":{"1min":0.40000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72099999999999997,"5min":9.2200000000000006,"15min":9.2200000000000006},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.57099999999999995,"15min":0.59499999999999997},"min":{"1min":0.40799999999999997,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.66600000000000004,"5min":1.552,"15min":1.552},"last":0.42199999999999999}]},{"osd":4,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.85999999999999999,"15min":0.92600000000000005},"min":{"1min":0.52200000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0049999999999999,"5min":4.2930000000000001,"15min":4.2930000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.75600000000000001,"15min":0.77900000000000003},"min":{"1min":0.55400000000000005,"5min":0.499,"15min":0.499},"max":{"1min":0.93999999999999995,"5min":1.24,"15min":1.24},"last":0.71399999999999997}]},{"osd":5,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.754,"15min":0.76900000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98399999999999999,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.84699999999999998,"15min":0.90700000000000003},"min":{"1min":0.53800000000000003,"5min":0.5,"15min":0.5},"max":{"1min":0.90700000000000003,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.73799999999999999}]},{"osd":6,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.88300000000000001,"15min":0.94399999999999995},"min":{"1min":0.55300000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.024,"5min":3.3999999999999999,"15min":3.3999999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.91300000000000003,"15min":0.99099999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.97199999999999998,"5min":3.4990000000000001,"15min":3.4990000000000001},"last":0.82499999999999996}]},{"osd":7,"last update":"Thu Jul 27 20:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.81100000000000005,"15min":0.84499999999999997},"min":{"1min":0.58199999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.95199999999999996,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.86099999999999999,"15min":0.89700000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.95999999999999996,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.76100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":390673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.44900000000000001,"15min":0.47099999999999997},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.626,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.317},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.51600000000000001,"15min":0.54400000000000004},"min":{"1min":0.309,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.627,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":0.26700000000000002}]},{"osd":1,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.47699999999999998,"15min":0.5},"min":{"1min":0.33400000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.55400000000000005,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.52900000000000003,"15min":0.56699999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.63,"5min":1.788,"15min":1.788},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.56200000000000006,"15min":0.59199999999999997},"min":{"1min":0.41699999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.73299999999999998,"5min":2.117,"15min":2.117},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59999999999999998,"15min":0.63400000000000001},"min":{"1min":0.42999999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.68400000000000005,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.46100000000000002}]},{"osd":4,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71899999999999997,"15min":0.72199999999999998},"min":{"1min":0.53800000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0249999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.499},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.79000000000000004,"15min":0.81399999999999995},"min":{"1min":0.53000000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.95199999999999996,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.624}]},{"osd":5,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.72499999999999998,"15min":0.73299999999999998},"min":{"1min":0.505,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92200000000000004,"5min":1.125,"15min":1.125},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.79400000000000004,"15min":0.82799999999999996},"min":{"1min":0.54200000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0569999999999999,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.70299999999999996}]},{"osd":6,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.78600000000000003,"15min":0.81299999999999994},"min":{"1min":0.59199999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93100000000000005,"5min":1.758,"15min":1.758},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.80900000000000005,"15min":0.83499999999999996},"min":{"1min":0.55000000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.095,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.56999999999999995}]},{"osd":7,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.81599999999999995,"15min":0.84799999999999998},"min":{"1min":0.55400000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0289999999999999,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.75800000000000001,"15min":0.76700000000000002},"min":{"1min":0.59099999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.99199999999999999,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.72899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":389067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.69699999999999995,"15min":0.69799999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.84299999999999997,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70699999999999996,"15min":0.71199999999999997},"min":{"1min":0.53900000000000003,"5min":0.5,"15min":0.5},"max":{"1min":0.86499999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.77500000000000002}]},{"osd":1,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.52200000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.874,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73499999999999999,"15min":0.73799999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88900000000000001,"5min":1.002,"15min":1.002},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.67500000000000004,"15min":0.66900000000000004},"min":{"1min":0.504,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81899999999999995,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.626},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68899999999999995,"15min":0.69499999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.93700000000000006,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.73799999999999999}]},{"osd":3,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.73099999999999998,"15min":0.751},"min":{"1min":0.49299999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91300000000000003,"5min":1.645,"15min":1.645},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.747,"15min":0.75900000000000001},"min":{"1min":0.51700000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96899999999999997,"5min":1.708,"15min":1.708},"last":0.83699999999999997}]},{"osd":5,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61799999999999999,"15min":0.61699999999999999},"min":{"1min":0.41499999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84499999999999997,"5min":1.113,"15min":1.113},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68799999999999994,"15min":0.69499999999999995},"min":{"1min":0.502,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91200000000000003,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.69699999999999995}]},{"osd":6,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70599999999999996,"15min":0.70699999999999996},"min":{"1min":0.48299999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.92100000000000004,"5min":1.127,"15min":1.127},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.74099999999999999,"15min":0.74199999999999999},"min":{"1min":0.442,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0009999999999999,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.79300000000000004}]},{"osd":7,"last update":"Thu Jul 27 20:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.54700000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.98499999999999999,"5min":1.198,"15min":1.198},"last":0.502},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.81299999999999994,"15min":0.81699999999999995},"min":{"1min":0.65300000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":0.96299999999999997,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.81100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":390673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.65300000000000002,"15min":0.629},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.85499999999999998,"5min":4.0510000000000002,"15min":4.0510000000000002},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.71299999999999997,"15min":0.67900000000000005},"min":{"1min":0.39300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.94899999999999995,"5min":6.431,"15min":6.431},"last":0.63100000000000001}]},{"osd":1,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.68300000000000005,"15min":0.65500000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.91300000000000003,"5min":5.3330000000000002,"15min":5.3330000000000002},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.69499999999999995,"15min":0.67100000000000004},"min":{"1min":0.47299999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.81299999999999994,"5min":4.2169999999999996,"15min":4.2169999999999996},"last":0.58999999999999997}]},{"osd":2,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.70699999999999996,"15min":0.66500000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.94799999999999995,"5min":6.4850000000000003,"15min":6.4850000000000003},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.68200000000000005,"15min":0.66200000000000003},"min":{"1min":0.48099999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.80800000000000005,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":0.60999999999999999}]},{"osd":3,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.749,"15min":0.73899999999999999},"min":{"1min":0.44900000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89500000000000002,"5min":4.7809999999999997,"15min":4.7809999999999997},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.76100000000000001,"15min":0.73799999999999999},"min":{"1min":0.55100000000000005,"5min":0.503,"15min":0.503},"max":{"1min":0.86299999999999999,"5min":5.423,"15min":5.423},"last":0.70799999999999996}]},{"osd":4,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.67200000000000004,"15min":0.65500000000000003},"min":{"1min":0.432,"5min":0.375,"15min":0.375},"max":{"1min":0.879,"5min":3.988,"15min":3.988},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.749,"15min":0.72699999999999998},"min":{"1min":0.46100000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.84599999999999997,"5min":4.827,"15min":4.827},"last":0.69099999999999995}]},{"osd":6,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.77800000000000002,"15min":0.73199999999999998},"min":{"1min":0.53600000000000003,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.92000000000000004,"5min":7.7000000000000002,"15min":7.7000000000000002},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.75,"15min":0.72799999999999998},"min":{"1min":0.53000000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91900000000000004,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":0.73299999999999998}]},{"osd":7,"last update":"Thu Jul 27 20:34:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.83199999999999996,"15min":0.78000000000000003},"min":{"1min":0.52300000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.91900000000000004,"5min":9.1180000000000003,"15min":9.1180000000000003},"last":0.745},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.82699999999999996,"15min":0.80100000000000005},"min":{"1min":0.53700000000000003,"5min":0.505,"15min":0.505},"max":{"1min":0.91900000000000004,"5min":5.2880000000000003,"15min":5.2880000000000003},"last":0.75900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T20:35:01.078 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-27T20:35:01.079 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-07-27T20:35:01.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.323+0000 7f3ef43ff700 1 Processor -- start 2023-07-27T20:35:01.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.323+0000 7f3ef43ff700 1 -- start start 2023-07-27T20:35:01.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.324+0000 7f3ef43ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3eec0c4d60 0x7f3eec0c45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:01.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.324+0000 7f3ef43ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3eec0c7760 0x7f3eec15e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:01.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.324+0000 7f3ef43ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eec0ca7f0 con 0x7f3eec0c41e0 2023-07-27T20:35:01.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.324+0000 7f3ef43ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eec154060 con 0x7f3eec0c7760 2023-07-27T20:35:01.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.324+0000 7f3ef43ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec0c5990 con 0x7f3eec0c4d60 2023-07-27T20:35:01.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.324+0000 7f3ef219b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3eec0c41e0 0x7f3eec154770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60390/0 (socket says 172.21.15.72:60390) 2023-07-27T20:35:01.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.324+0000 7f3ef219b700 1 -- 172.21.15.72:0/1982288536 learned_addr learned my addr 172.21.15.72:0/1982288536 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:35:01.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.324+0000 7f3ef299c700 1 --2- 172.21.15.72:0/1982288536 >> v2:172.21.15.173:3300/0 conn(0x7f3eec0c7760 0x7f3eec15e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:01.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.324+0000 7f3ef199a700 1 --2- 172.21.15.72:0/1982288536 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3eec0c4d60 0x7f3eec0c45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:01.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.325+0000 7f3ef1199700 1 -- 172.21.15.72:0/1982288536 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4286436611 0 0) 0x7f3ee8001110 con 0x7f3eec0c41e0 2023-07-27T20:35:01.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.325+0000 7f3ef1199700 1 -- 172.21.15.72:0/1982288536 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ed80035b0 con 0x7f3eec0c41e0 2023-07-27T20:35:01.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.325+0000 7f3ef1199700 1 -- 172.21.15.72:0/1982288536 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 872538211 0 0) 0x7f3ed80035b0 con 0x7f3eec0c41e0 2023-07-27T20:35:01.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.325+0000 7f3ef1199700 1 -- 172.21.15.72:0/1982288536 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3eec0c4d60 msgr2=0x7f3eec0c45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:35:01.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.325+0000 7f3ef1199700 1 --2- 172.21.15.72:0/1982288536 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3eec0c4d60 0x7f3eec0c45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:01.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.325+0000 7f3ef1199700 1 -- 172.21.15.72:0/1982288536 >> v2:172.21.15.173:3300/0 conn(0x7f3eec0c7760 msgr2=0x7f3eec15e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:35:01.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.325+0000 7f3ef1199700 1 --2- 172.21.15.72:0/1982288536 >> v2:172.21.15.173:3300/0 conn(0x7f3eec0c7760 0x7f3eec15e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:01.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.325+0000 7f3ef1199700 1 -- 172.21.15.72:0/1982288536 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eec0c5c10 con 0x7f3eec0c41e0 2023-07-27T20:35:01.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.325+0000 7f3ef1199700 1 -- 172.21.15.72:0/1982288536 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f3ee8001800 con 0x7f3eec0c41e0 2023-07-27T20:35:01.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.325+0000 7f3ef1199700 1 -- 172.21.15.72:0/1982288536 >> v1:172.21.15.72:6789/0 conn(0x7f3eec0c41e0 legacy=0x7f3eec154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:01.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.325+0000 7f3ef1199700 1 --2- 172.21.15.72:0/1982288536 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ed8003a00 0x7f3ed8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:01.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.325+0000 7f3ef1199700 1 --2- 172.21.15.72:0/1982288536 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3eec0c4d60 0x7f3ed8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:01.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.325+0000 7f3ef1199700 1 --2- 172.21.15.72:0/1982288536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ed8004d90 0x7f3ed8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:01.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.325+0000 7f3ef1199700 1 -- 172.21.15.72:0/1982288536 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec0c5990 con 0x7f3ed8003a00 2023-07-27T20:35:01.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.325+0000 7f3ef1199700 1 -- 172.21.15.72:0/1982288536 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed800ba60 con 0x7f3ed8004d90 2023-07-27T20:35:01.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.325+0000 7f3ef1199700 1 -- 172.21.15.72:0/1982288536 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed800bc20 con 0x7f3eec0c4d60 2023-07-27T20:35:01.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.325+0000 7f3ef219b700 1 --2- 172.21.15.72:0/1982288536 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ed8003a00 0x7f3ed8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:01.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.325+0000 7f3ef199a700 1 --2- 172.21.15.72:0/1982288536 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3eec0c4d60 0x7f3ed8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:01.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.326+0000 7f3ef299c700 1 --2- 172.21.15.72:0/1982288536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ed8004d90 0x7f3ed8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:01.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.326+0000 7f3ef219b700 1 -- 172.21.15.72:0/1982288536 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3eec0c4d60 msgr2=0x7f3ed8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:35:01.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.326+0000 7f3ef219b700 1 --2- 172.21.15.72:0/1982288536 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3eec0c4d60 0x7f3ed8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:01.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.326+0000 7f3ef219b700 1 -- 172.21.15.72:0/1982288536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ed8004d90 msgr2=0x7f3ed8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:35:01.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.326+0000 7f3ef219b700 1 --2- 172.21.15.72:0/1982288536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ed8004d90 0x7f3ed8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:01.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.326+0000 7f3ef219b700 1 -- 172.21.15.72:0/1982288536 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed80035b0 con 0x7f3ed8003a00 2023-07-27T20:35:01.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.326+0000 7f3ef299c700 1 --2- 172.21.15.72:0/1982288536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ed8004d90 0x7f3ed8005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:35:01.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.326+0000 7f3ef219b700 1 --2- 172.21.15.72:0/1982288536 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ed8003a00 0x7f3ed8003e20 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f3ee800c190 tx=0x7f3ed8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c204086ba57cc913 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:01.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.326+0000 7f3ef1199700 1 -- 172.21.15.72:0/1982288536 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8007d00 con 0x7f3ed8003a00 2023-07-27T20:35:01.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.326+0000 7f3ef1199700 1 -- 172.21.15.72:0/1982288536 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee800cc90 con 0x7f3ed8003a00 2023-07-27T20:35:01.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.326+0000 7f3ef1199700 1 -- 172.21.15.72:0/1982288536 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8005960 con 0x7f3ed8003a00 2023-07-27T20:35:01.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.327+0000 7f3ef43ff700 1 -- 172.21.15.72:0/1982288536 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ed8003a00 msgr2=0x7f3ed8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:01.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.327+0000 7f3ef43ff700 1 --2- 172.21.15.72:0/1982288536 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ed8003a00 0x7f3ed8003e20 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f3ee800c190 tx=0x7f3ed8005880 comp rx=0 tx=0).stop 2023-07-27T20:35:01.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.327+0000 7f3ef299c700 1 -- 172.21.15.72:0/1982288536 reap_dead start 2023-07-27T20:35:01.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.327+0000 7f3ef43ff700 1 -- 172.21.15.72:0/1982288536 shutdown_connections 2023-07-27T20:35:01.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.327+0000 7f3ef43ff700 1 -- 172.21.15.72:0/1982288536 >> 172.21.15.72:0/1982288536 conn(0x7f3eec0c9860 msgr2=0x7f3eec0c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:01.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.327+0000 7f3ef43ff700 1 -- 172.21.15.72:0/1982288536 shutdown_connections 2023-07-27T20:35:01.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.327+0000 7f3ef43ff700 1 -- 172.21.15.72:0/1982288536 wait complete. 2023-07-27T20:35:01.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.329+0000 7f3ef43ff700 1 Processor -- start 2023-07-27T20:35:01.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.329+0000 7f3ef43ff700 1 -- start start 2023-07-27T20:35:01.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.330+0000 7f3ef43ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ed8003a00 0x7f3eec1e9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:01.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.331+0000 7f3ef43ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3eec14f2b0 0x7f3eec157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:01.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.331+0000 7f3ef43ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3eec14dff0 0x7f3eec1ec6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:01.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.331+0000 7f3ef43ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec1e9820 con 0x7f3ed8003a00 2023-07-27T20:35:01.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.331+0000 7f3ef43ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec157ea0 con 0x7f3eec14f2b0 2023-07-27T20:35:01.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.331+0000 7f3ef43ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec158080 con 0x7f3eec14dff0 2023-07-27T20:35:01.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.331+0000 7f3ef219b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ed8003a00 0x7f3eec1e9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:01.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.331+0000 7f3ef219b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ed8003a00 0x7f3eec1e9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48252/0 (socket says 172.21.15.72:48252) 2023-07-27T20:35:01.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.331+0000 7f3ef219b700 1 -- 172.21.15.72:0/750172333 learned_addr learned my addr 172.21.15.72:0/750172333 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:35:01.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.331+0000 7f3ef199a700 1 --2- 172.21.15.72:0/750172333 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3eec14f2b0 0x7f3eec157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:01.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.331+0000 7f3ef299c700 1 --2- 172.21.15.72:0/750172333 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3eec14dff0 0x7f3eec1ec6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:01.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.331+0000 7f3ef219b700 1 -- 172.21.15.72:0/750172333 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3eec14dff0 msgr2=0x7f3eec1ec6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:01.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.331+0000 7f3ef219b700 1 --2- 172.21.15.72:0/750172333 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3eec14dff0 0x7f3eec1ec6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:01.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.331+0000 7f3ef219b700 1 -- 172.21.15.72:0/750172333 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3eec14f2b0 msgr2=0x7f3eec157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:01.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.331+0000 7f3ef219b700 1 --2- 172.21.15.72:0/750172333 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3eec14f2b0 0x7f3eec157960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:01.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.331+0000 7f3ef219b700 1 -- 172.21.15.72:0/750172333 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eec158360 con 0x7f3ed8003a00 2023-07-27T20:35:01.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.331+0000 7f3ef219b700 1 --2- 172.21.15.72:0/750172333 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ed8003a00 0x7f3eec1e9c40 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800ba30 tx=0x7f3ee8001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:01.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.332+0000 7f3ee2ffd700 1 -- 172.21.15.72:0/750172333 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8001180 con 0x7f3ed8003a00 2023-07-27T20:35:01.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.332+0000 7f3ee2ffd700 1 -- 172.21.15.72:0/750172333 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee8004c80 con 0x7f3ed8003a00 2023-07-27T20:35:01.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.332+0000 7f3ee2ffd700 1 -- 172.21.15.72:0/750172333 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee80070d0 con 0x7f3ed8003a00 2023-07-27T20:35:01.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.332+0000 7f3ef43ff700 1 -- 172.21.15.72:0/750172333 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eec1e9440 con 0x7f3ed8003a00 2023-07-27T20:35:01.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.332+0000 7f3ef43ff700 1 -- 172.21.15.72:0/750172333 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eec14e480 con 0x7f3ed8003a00 2023-07-27T20:35:01.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.333+0000 7f3ef43ff700 1 -- 172.21.15.72:0/750172333 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eec04e470 con 0x7f3ed8003a00 2023-07-27T20:35:01.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.334+0000 7f3ee2ffd700 1 -- 172.21.15.72:0/750172333 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3ee8019070 con 0x7f3ed8003a00 2023-07-27T20:35:01.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.335+0000 7f3ee2ffd700 1 --2- 172.21.15.72:0/750172333 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3ed006ace0 0x7f3ed006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:01.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.335+0000 7f3ee2ffd700 1 -- 172.21.15.72:0/750172333 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f3ee808a110 con 0x7f3ed8003a00 2023-07-27T20:35:01.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.335+0000 7f3ef199a700 1 --2- 172.21.15.72:0/750172333 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3ed006ace0 0x7f3ed006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:01.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.336+0000 7f3ef199a700 1 --2- 172.21.15.72:0/750172333 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3ed006ace0 0x7f3ed006d1a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3eec152150 tx=0x7f3edc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:01.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.340+0000 7f3ee2ffd700 1 -- 172.21.15.72:0/750172333 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3ee8054ed0 con 0x7f3ed8003a00 2023-07-27T20:35:01.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.613+0000 7f3ef43ff700 1 -- 172.21.15.72:0/750172333 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f3eec0ca7f0 con 0x7f3ed8003a00 2023-07-27T20:35:01.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.618+0000 7f3ee2ffd700 1 -- 172.21.15.72:0/750172333 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v16) v1 ==== 185+0+142 (secure 0 0 0) 0x7f3eec0ca7f0 con 0x7f3ed8003a00 2023-07-27T20:35:01.605 INFO:teuthology.orchestra.run.smithi072.stdout:[client.1] 2023-07-27T20:35:01.606 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDh08JktvSlExAAay3fDYh/8Ju3iIWOXW8wmw== 2023-07-27T20:35:01.606 INFO:teuthology.orchestra.run.smithi072.stdout: caps mds = "allow" 2023-07-27T20:35:01.606 INFO:teuthology.orchestra.run.smithi072.stdout: caps mon = "allow r" 2023-07-27T20:35:01.606 INFO:teuthology.orchestra.run.smithi072.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-07-27T20:35:01.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.620+0000 7f3ef43ff700 1 -- 172.21.15.72:0/750172333 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3ed006ace0 msgr2=0x7f3ed006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:01.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.620+0000 7f3ef43ff700 1 --2- 172.21.15.72:0/750172333 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3ed006ace0 0x7f3ed006d1a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3eec152150 tx=0x7f3edc008040 comp rx=0 tx=0).stop 2023-07-27T20:35:01.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.620+0000 7f3ef43ff700 1 -- 172.21.15.72:0/750172333 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ed8003a00 msgr2=0x7f3eec1e9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:01.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.620+0000 7f3ef43ff700 1 --2- 172.21.15.72:0/750172333 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ed8003a00 0x7f3eec1e9c40 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800ba30 tx=0x7f3ee8001ac0 comp rx=0 tx=0).stop 2023-07-27T20:35:01.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.620+0000 7f3ef43ff700 1 -- 172.21.15.72:0/750172333 shutdown_connections 2023-07-27T20:35:01.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.620+0000 7f3ef43ff700 1 --2- 172.21.15.72:0/750172333 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f3ed006ace0 0x7f3ed006d1a0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:01.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.620+0000 7f3ef43ff700 1 --2- 172.21.15.72:0/750172333 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3eec14dff0 0x7f3eec1ec6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:01.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.620+0000 7f3ef43ff700 1 --2- 172.21.15.72:0/750172333 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ed8003a00 0x7f3eec1e9c40 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:01.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.620+0000 7f3ef43ff700 1 --2- 172.21.15.72:0/750172333 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3eec14f2b0 0x7f3eec157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:01.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.621+0000 7f3ef43ff700 1 -- 172.21.15.72:0/750172333 >> 172.21.15.72:0/750172333 conn(0x7f3eec0c9860 msgr2=0x7f3eec14fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:01.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.621+0000 7f3ef43ff700 1 -- 172.21.15.72:0/750172333 shutdown_connections 2023-07-27T20:35:01.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.621+0000 7f3ef43ff700 1 -- 172.21.15.72:0/750172333 wait complete. 2023-07-27T20:35:01.610 INFO:teuthology.orchestra.run.smithi072.stderr:updated caps for client.1 2023-07-27T20:35:01.625 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-07-27T20:35:01.626 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-27T20:35:01.678 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:35:01.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.885+0000 7f94fd9ff700 1 Processor -- start 2023-07-27T20:35:01.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.886+0000 7f94fd9ff700 1 -- start start 2023-07-27T20:35:01.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.887+0000 7f94fd9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f94f806b150 0x7f94f80c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:01.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.887+0000 7f94fd9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94f806b710 con 0x7f94f80c4400 2023-07-27T20:35:01.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.887+0000 7f94fd9ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94f806b9f0 con 0x7f94f81549f0 2023-07-27T20:35:01.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.887+0000 7f94fd9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94f81545d0 con 0x7f94f806b150 2023-07-27T20:35:01.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.887+0000 7f94effff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f94f806b150 0x7f94f80c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:01.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.887+0000 7f94effff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f94f806b150 0x7f94f80c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48262/0 (socket says 172.21.15.72:48262) 2023-07-27T20:35:01.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.887+0000 7f94effff700 1 -- 172.21.15.72:0/3535005280 learned_addr learned my addr 172.21.15.72:0/3535005280 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:35:01.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.887+0000 7f94effff700 1 -- 172.21.15.72:0/3535005280 >> v1:172.21.15.173:6789/0 conn(0x7f94f81549f0 legacy=0x7f94f81514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:35:01.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.887+0000 7f94effff700 1 -- 172.21.15.72:0/3535005280 >> v1:172.21.15.72:6789/0 conn(0x7f94f80c4400 legacy=0x7f94f80c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:01.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.888+0000 7f94effff700 1 -- 172.21.15.72:0/3535005280 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f806bcd0 con 0x7f94f806b150 2023-07-27T20:35:01.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.888+0000 7f94f67fc700 1 -- 172.21.15.72:0/3535005280 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4074533407 0 0) 0x7f94f806b710 con 0x7f94f80c4400 2023-07-27T20:35:01.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.888+0000 7f94effff700 1 --2- 172.21.15.72:0/3535005280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94f806b150 0x7f94f80c7710 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f94e00098f0 tx=0x7f94e0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b2ea1f8185e0d67 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:01.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.888+0000 7f94f67fc700 1 -- 172.21.15.72:0/3535005280 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e0004230 con 0x7f94f806b150 2023-07-27T20:35:01.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.888+0000 7f94f67fc700 1 -- 172.21.15.72:0/3535005280 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e0004390 con 0x7f94f806b150 2023-07-27T20:35:01.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.888+0000 7f94f67fc700 1 -- 172.21.15.72:0/3535005280 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e00036a0 con 0x7f94f806b150 2023-07-27T20:35:01.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.888+0000 7f94fd9ff700 1 -- 172.21.15.72:0/3535005280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94f806b150 msgr2=0x7f94f80c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:01.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.888+0000 7f94fd9ff700 1 --2- 172.21.15.72:0/3535005280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94f806b150 0x7f94f80c7710 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f94e00098f0 tx=0x7f94e0009c00 comp rx=0 tx=0).stop 2023-07-27T20:35:01.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.889+0000 7f94fd9ff700 1 -- 172.21.15.72:0/3535005280 shutdown_connections 2023-07-27T20:35:01.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.889+0000 7f94fd9ff700 1 --2- 172.21.15.72:0/3535005280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94f806b150 0x7f94f80c7710 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:01.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.889+0000 7f94fd9ff700 1 -- 172.21.15.72:0/3535005280 >> 172.21.15.72:0/3535005280 conn(0x7f94f80ab300 msgr2=0x7f94f80ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:01.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.889+0000 7f94fd9ff700 1 -- 172.21.15.72:0/3535005280 shutdown_connections 2023-07-27T20:35:01.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.889+0000 7f94fd9ff700 1 -- 172.21.15.72:0/3535005280 wait complete. 2023-07-27T20:35:01.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.890+0000 7f94fd9ff700 1 Processor -- start 2023-07-27T20:35:01.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.890+0000 7f94fd9ff700 1 -- start start 2023-07-27T20:35:01.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.891+0000 7f94fd9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94f806b150 0x7f94f814e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:01.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.891+0000 7f94fd9ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94f80c4400 0x7f94f80c11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:01.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.891+0000 7f94fd9ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94f81549f0 0x7f94f8149fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:01.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.891+0000 7f94fd9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f814e0c0 con 0x7f94f806b150 2023-07-27T20:35:01.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.891+0000 7f94fd9ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f80c2f60 con 0x7f94f80c4400 2023-07-27T20:35:01.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.891+0000 7f94fd9ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f80c3240 con 0x7f94f81549f0 2023-07-27T20:35:01.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.891+0000 7f94f6ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94f806b150 0x7f94f814e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:01.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.892+0000 7f94f6ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94f806b150 0x7f94f814e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48266/0 (socket says 172.21.15.72:48266) 2023-07-27T20:35:01.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.892+0000 7f94f6ffd700 1 -- 172.21.15.72:0/2623073583 learned_addr learned my addr 172.21.15.72:0/2623073583 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:35:01.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.892+0000 7f94effff700 1 --2- 172.21.15.72:0/2623073583 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94f80c4400 0x7f94f80c11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:01.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.892+0000 7f94f6ffd700 1 -- 172.21.15.72:0/2623073583 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94f81549f0 msgr2=0x7f94f8149fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:01.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.892+0000 7f94f77fe700 1 --2- 172.21.15.72:0/2623073583 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94f81549f0 0x7f94f8149fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:01.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.892+0000 7f94f6ffd700 1 --2- 172.21.15.72:0/2623073583 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94f81549f0 0x7f94f8149fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:01.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.892+0000 7f94f6ffd700 1 -- 172.21.15.72:0/2623073583 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94f80c4400 msgr2=0x7f94f80c11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:01.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.892+0000 7f94f6ffd700 1 --2- 172.21.15.72:0/2623073583 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94f80c4400 0x7f94f80c11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:01.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.892+0000 7f94f6ffd700 1 -- 172.21.15.72:0/2623073583 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e0009550 con 0x7f94f806b150 2023-07-27T20:35:01.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.892+0000 7f94effff700 1 --2- 172.21.15.72:0/2623073583 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94f80c4400 0x7f94f80c11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:35:01.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.892+0000 7f94f77fe700 1 --2- 172.21.15.72:0/2623073583 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94f81549f0 0x7f94f8149fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:35:01.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.892+0000 7f94f6ffd700 1 --2- 172.21.15.72:0/2623073583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94f806b150 0x7f94f814e4b0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f94e8001eb0 tx=0x7f94e800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:01.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.892+0000 7f94f4ff9700 1 -- 172.21.15.72:0/2623073583 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e80054e0 con 0x7f94f806b150 2023-07-27T20:35:01.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.892+0000 7f94f4ff9700 1 -- 172.21.15.72:0/2623073583 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e8003680 con 0x7f94f806b150 2023-07-27T20:35:01.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.892+0000 7f94f4ff9700 1 -- 172.21.15.72:0/2623073583 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e80039f0 con 0x7f94f806b150 2023-07-27T20:35:01.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.892+0000 7f94fd9ff700 1 -- 172.21.15.72:0/2623073583 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94f80c3520 con 0x7f94f806b150 2023-07-27T20:35:01.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.893+0000 7f94fd9ff700 1 -- 172.21.15.72:0/2623073583 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94f80c3ae0 con 0x7f94f806b150 2023-07-27T20:35:01.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.893+0000 7f94fd9ff700 1 -- 172.21.15.72:0/2623073583 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94f8074310 con 0x7f94f806b150 2023-07-27T20:35:01.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.894+0000 7f94f4ff9700 1 -- 172.21.15.72:0/2623073583 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f94e8003b50 con 0x7f94f806b150 2023-07-27T20:35:01.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.896+0000 7f94f4ff9700 1 --2- 172.21.15.72:0/2623073583 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f94d806ace0 0x7f94d806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:01.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.896+0000 7f94f4ff9700 1 -- 172.21.15.72:0/2623073583 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f94e8088db0 con 0x7f94f806b150 2023-07-27T20:35:01.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.896+0000 7f94effff700 1 --2- 172.21.15.72:0/2623073583 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f94d806ace0 0x7f94d806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:01.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.897+0000 7f94effff700 1 --2- 172.21.15.72:0/2623073583 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f94d806ace0 0x7f94d806d1a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f94f80c0ae0 tx=0x7f94e0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:01.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:01.900+0000 7f94f4ff9700 1 -- 172.21.15.72:0/2623073583 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f94e808d070 con 0x7f94f806b150 2023-07-27T20:35:02.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.096+0000 7f94fd9ff700 1 -- 172.21.15.72:0/2623073583 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94f80abeb0 con 0x7f94f806b150 2023-07-27T20:35:02.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.098+0000 7f94f4ff9700 1 -- 172.21.15.72:0/2623073583 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+22261 (secure 0 0 0) 0x7f94e8017090 con 0x7f94f806b150 2023-07-27T20:35:02.086 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:35:02.086 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":66,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:34:52.125660+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:34:31.480063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-07-27T20:34:32.755579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_metadata","create_time":"2023-07-27T20:34:48.900422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs2_data","create_time":"2023-07-27T20:34:49.633712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:35:02.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.100+0000 7f94fd9ff700 1 -- 172.21.15.72:0/2623073583 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f94d806ace0 msgr2=0x7f94d806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:02.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.100+0000 7f94fd9ff700 1 --2- 172.21.15.72:0/2623073583 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f94d806ace0 0x7f94d806d1a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f94f80c0ae0 tx=0x7f94e0008030 comp rx=0 tx=0).stop 2023-07-27T20:35:02.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.100+0000 7f94fd9ff700 1 -- 172.21.15.72:0/2623073583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94f806b150 msgr2=0x7f94f814e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:02.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.100+0000 7f94fd9ff700 1 --2- 172.21.15.72:0/2623073583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94f806b150 0x7f94f814e4b0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f94e8001eb0 tx=0x7f94e800c8b0 comp rx=0 tx=0).stop 2023-07-27T20:35:02.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.100+0000 7f94fd9ff700 1 -- 172.21.15.72:0/2623073583 shutdown_connections 2023-07-27T20:35:02.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.100+0000 7f94fd9ff700 1 --2- 172.21.15.72:0/2623073583 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f94d806ace0 0x7f94d806d1a0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:02.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.100+0000 7f94fd9ff700 1 --2- 172.21.15.72:0/2623073583 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94f81549f0 0x7f94f8149fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:02.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.100+0000 7f94fd9ff700 1 --2- 172.21.15.72:0/2623073583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94f806b150 0x7f94f814e4b0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:02.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.100+0000 7f94fd9ff700 1 --2- 172.21.15.72:0/2623073583 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94f80c4400 0x7f94f80c11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:02.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.100+0000 7f94fd9ff700 1 -- 172.21.15.72:0/2623073583 >> 172.21.15.72:0/2623073583 conn(0x7f94f80ab300 msgr2=0x7f94f8152160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:02.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.101+0000 7f94fd9ff700 1 -- 172.21.15.72:0/2623073583 shutdown_connections 2023-07-27T20:35:02.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.101+0000 7f94fd9ff700 1 -- 172.21.15.72:0/2623073583 wait complete. 2023-07-27T20:35:02.106 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-27T20:31:14.581785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T20:31:21.077941+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T20:34:31.480063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T20:34:32.755579+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-07-27T20:34:48.900422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs2_data', 'create_time': '2023-07-27T20:34:49.633712+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-27T20:35:02.107 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-27T20:35:02.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.320+0000 7f99f3bff700 1 Processor -- start 2023-07-27T20:35:02.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.321+0000 7f99f3bff700 1 -- start start 2023-07-27T20:35:02.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.322+0000 7f99f3bff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f99ec14aab0 0x7f99ec154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:02.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.322+0000 7f99f3bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99ec0c7c50 con 0x7f99ec06c1d0 2023-07-27T20:35:02.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.322+0000 7f99f3bff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99ec06bd40 con 0x7f99ec0c7740 2023-07-27T20:35:02.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.322+0000 7f99f3bff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99ec0c62f0 con 0x7f99ec14aab0 2023-07-27T20:35:02.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.322+0000 7f99f219c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f99ec06c1d0 0x7f99ec06c5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60404/0 (socket says 172.21.15.72:60404) 2023-07-27T20:35:02.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.322+0000 7f99f219c700 1 -- 172.21.15.72:0/1549721796 learned_addr learned my addr 172.21.15.72:0/1549721796 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:35:02.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.322+0000 7f99f199b700 1 --2- 172.21.15.72:0/1549721796 >> v2:172.21.15.173:3300/0 conn(0x7f99ec14aab0 0x7f99ec154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:02.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.322+0000 7f99f0999700 1 -- 172.21.15.72:0/1549721796 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1394571754 0 0) 0x7f99ec0c7c50 con 0x7f99ec06c1d0 2023-07-27T20:35:02.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.323+0000 7f99f0999700 1 -- 172.21.15.72:0/1549721796 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99d80035b0 con 0x7f99ec06c1d0 2023-07-27T20:35:02.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.323+0000 7f99f0999700 1 -- 172.21.15.72:0/1549721796 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4195393092 0 0) 0x7f99ec06bd40 con 0x7f99ec0c7740 2023-07-27T20:35:02.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.323+0000 7f99f0999700 1 -- 172.21.15.72:0/1549721796 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99ec0c7c50 con 0x7f99ec0c7740 2023-07-27T20:35:02.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.323+0000 7f99f199b700 1 -- 172.21.15.72:0/1549721796 >> v1:172.21.15.173:6789/0 conn(0x7f99ec0c7740 legacy=0x7f99ec0c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:02.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.323+0000 7f99f199b700 1 -- 172.21.15.72:0/1549721796 >> v1:172.21.15.72:6789/0 conn(0x7f99ec06c1d0 legacy=0x7f99ec06c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:02.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.323+0000 7f99f199b700 1 -- 172.21.15.72:0/1549721796 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ec06cd00 con 0x7f99ec14aab0 2023-07-27T20:35:02.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.323+0000 7f99f199b700 1 --2- 172.21.15.72:0/1549721796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99ec14aab0 0x7f99ec154b10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f99e8009840 tx=0x7f99e8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39972208fc1e43d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:02.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.323+0000 7f99f0999700 1 -- 172.21.15.72:0/1549721796 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e8011830 con 0x7f99ec14aab0 2023-07-27T20:35:02.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.323+0000 7f99f0999700 1 -- 172.21.15.72:0/1549721796 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e8011990 con 0x7f99ec14aab0 2023-07-27T20:35:02.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.323+0000 7f99f0999700 1 -- 172.21.15.72:0/1549721796 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e8011d20 con 0x7f99ec14aab0 2023-07-27T20:35:02.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.324+0000 7f99f3bff700 1 -- 172.21.15.72:0/1549721796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99ec14aab0 msgr2=0x7f99ec154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:02.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.324+0000 7f99f3bff700 1 --2- 172.21.15.72:0/1549721796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99ec14aab0 0x7f99ec154b10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f99e8009840 tx=0x7f99e8009b50 comp rx=0 tx=0).stop 2023-07-27T20:35:02.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.324+0000 7f99f3bff700 1 -- 172.21.15.72:0/1549721796 shutdown_connections 2023-07-27T20:35:02.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.324+0000 7f99f3bff700 1 --2- 172.21.15.72:0/1549721796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99ec14aab0 0x7f99ec154b10 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:02.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.324+0000 7f99f3bff700 1 -- 172.21.15.72:0/1549721796 >> 172.21.15.72:0/1549721796 conn(0x7f99ec0ab3f0 msgr2=0x7f99ec0ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:02.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.324+0000 7f99f3bff700 1 -- 172.21.15.72:0/1549721796 shutdown_connections 2023-07-27T20:35:02.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.324+0000 7f99f3bff700 1 -- 172.21.15.72:0/1549721796 wait complete. 2023-07-27T20:35:02.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.326+0000 7f99f3bff700 1 Processor -- start 2023-07-27T20:35:02.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.326+0000 7f99f3bff700 1 -- start start 2023-07-27T20:35:02.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.327+0000 7f99f3bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f99ec06c1d0 0x7f99ec150190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:02.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.327+0000 7f99f3bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99ec0c7740 0x7f99ec0aa650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:02.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.327+0000 7f99f3bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99ec14aab0 0x7f99ec147810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:02.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.327+0000 7f99f3bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec0af830 con 0x7f99ec0c7740 2023-07-27T20:35:02.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.327+0000 7f99f3bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec1ead50 con 0x7f99ec14aab0 2023-07-27T20:35:02.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.327+0000 7f99f3bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec150f40 con 0x7f99ec06c1d0 2023-07-27T20:35:02.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.327+0000 7f99f119a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99ec0c7740 0x7f99ec0aa650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:02.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.327+0000 7f99f119a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99ec0c7740 0x7f99ec0aa650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48280/0 (socket says 172.21.15.72:48280) 2023-07-27T20:35:02.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.327+0000 7f99f119a700 1 -- 172.21.15.72:0/3629265193 learned_addr learned my addr 172.21.15.72:0/3629265193 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:35:02.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.327+0000 7f99f199b700 1 --2- 172.21.15.72:0/3629265193 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f99ec06c1d0 0x7f99ec150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:02.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.328+0000 7f99f119a700 1 -- 172.21.15.72:0/3629265193 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f99ec06c1d0 msgr2=0x7f99ec150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:02.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.328+0000 7f99f119a700 1 --2- 172.21.15.72:0/3629265193 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f99ec06c1d0 0x7f99ec150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:02.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.328+0000 7f99f119a700 1 -- 172.21.15.72:0/3629265193 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99ec14aab0 msgr2=0x7f99ec147810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:02.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.328+0000 7f99f219c700 1 --2- 172.21.15.72:0/3629265193 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99ec14aab0 0x7f99ec147810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:02.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.328+0000 7f99f119a700 1 --2- 172.21.15.72:0/3629265193 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99ec14aab0 0x7f99ec147810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:02.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.328+0000 7f99f119a700 1 -- 172.21.15.72:0/3629265193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e80094a0 con 0x7f99ec0c7740 2023-07-27T20:35:02.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.328+0000 7f99f199b700 1 --2- 172.21.15.72:0/3629265193 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f99ec06c1d0 0x7f99ec150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:35:02.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.328+0000 7f99f219c700 1 --2- 172.21.15.72:0/3629265193 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99ec14aab0 0x7f99ec147810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:35:02.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.328+0000 7f99f119a700 1 --2- 172.21.15.72:0/3629265193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99ec0c7740 0x7f99ec0aa650 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f99dc00c550 tx=0x7f99dc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:02.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.328+0000 7f99e27fc700 1 -- 172.21.15.72:0/3629265193 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99dc0052d0 con 0x7f99ec0c7740 2023-07-27T20:35:02.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.328+0000 7f99e27fc700 1 -- 172.21.15.72:0/3629265193 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99dc005430 con 0x7f99ec0c7740 2023-07-27T20:35:02.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.328+0000 7f99f3bff700 1 -- 172.21.15.72:0/3629265193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99ec151220 con 0x7f99ec0c7740 2023-07-27T20:35:02.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.328+0000 7f99e27fc700 1 -- 172.21.15.72:0/3629265193 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99dc0038c0 con 0x7f99ec0c7740 2023-07-27T20:35:02.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.328+0000 7f99f3bff700 1 -- 172.21.15.72:0/3629265193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99ec1eb280 con 0x7f99ec0c7740 2023-07-27T20:35:02.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.329+0000 7f99f3bff700 1 -- 172.21.15.72:0/3629265193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99ec0c6540 con 0x7f99ec0c7740 2023-07-27T20:35:02.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.330+0000 7f99e27fc700 1 -- 172.21.15.72:0/3629265193 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f99dc003a20 con 0x7f99ec0c7740 2023-07-27T20:35:02.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.331+0000 7f99e27fc700 1 --2- 172.21.15.72:0/3629265193 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f99d006ace0 0x7f99d006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:02.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.331+0000 7f99e27fc700 1 -- 172.21.15.72:0/3629265193 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f99dc088eb0 con 0x7f99ec0c7740 2023-07-27T20:35:02.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.332+0000 7f99f199b700 1 --2- 172.21.15.72:0/3629265193 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f99d006ace0 0x7f99d006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:02.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.332+0000 7f99f199b700 1 --2- 172.21.15.72:0/3629265193 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f99d006ace0 0x7f99d006d1a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f99e8000c00 tx=0x7f99e801c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:02.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.335+0000 7f99e27fc700 1 -- 172.21.15.72:0/3629265193 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f99ec0c6540 con 0x7f99ec0c7740 2023-07-27T20:35:02.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.528+0000 7f99f3bff700 1 -- 172.21.15.72:0/3629265193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f99ec0c6540 con 0x7f99ec0c7740 2023-07-27T20:35:02.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.528+0000 7f99e27fc700 1 -- 172.21.15.72:0/3629265193 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v66) v1 ==== 93+0+10 (secure 0 0 0) 0x7f99dc017020 con 0x7f99ec0c7740 2023-07-27T20:35:02.516 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-27T20:35:02.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.530+0000 7f99f3bff700 1 -- 172.21.15.72:0/3629265193 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f99d006ace0 msgr2=0x7f99d006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:02.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.530+0000 7f99f3bff700 1 --2- 172.21.15.72:0/3629265193 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f99d006ace0 0x7f99d006d1a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f99e8000c00 tx=0x7f99e801c040 comp rx=0 tx=0).stop 2023-07-27T20:35:02.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.530+0000 7f99f3bff700 1 -- 172.21.15.72:0/3629265193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99ec0c7740 msgr2=0x7f99ec0aa650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:02.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.530+0000 7f99f3bff700 1 --2- 172.21.15.72:0/3629265193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99ec0c7740 0x7f99ec0aa650 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f99dc00c550 tx=0x7f99dc00c910 comp rx=0 tx=0).stop 2023-07-27T20:35:02.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.530+0000 7f99f3bff700 1 -- 172.21.15.72:0/3629265193 shutdown_connections 2023-07-27T20:35:02.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.530+0000 7f99f3bff700 1 --2- 172.21.15.72:0/3629265193 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99ec14aab0 0x7f99ec147810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:02.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.530+0000 7f99f3bff700 1 --2- 172.21.15.72:0/3629265193 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f99d006ace0 0x7f99d006d1a0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:02.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.530+0000 7f99f3bff700 1 --2- 172.21.15.72:0/3629265193 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f99ec06c1d0 0x7f99ec150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:02.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.530+0000 7f99f3bff700 1 --2- 172.21.15.72:0/3629265193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99ec0c7740 0x7f99ec0aa650 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:02.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.530+0000 7f99f3bff700 1 -- 172.21.15.72:0/3629265193 >> 172.21.15.72:0/3629265193 conn(0x7f99ec0ab3f0 msgr2=0x7f99ec0c40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:02.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.531+0000 7f99f3bff700 1 -- 172.21.15.72:0/3629265193 shutdown_connections 2023-07-27T20:35:02.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.531+0000 7f99f3bff700 1 -- 172.21.15.72:0/3629265193 wait complete. 2023-07-27T20:35:02.536 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T20:35:02.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.749+0000 7f07d8bff700 1 Processor -- start 2023-07-27T20:35:02.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.749+0000 7f07d8bff700 1 -- start start 2023-07-27T20:35:02.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.750+0000 7f07d8bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f07d406c1d0 0x7f07d406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:02.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.750+0000 7f07d8bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07d40c7c50 con 0x7f07d414aab0 2023-07-27T20:35:02.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.750+0000 7f07d8bff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07d406bd40 con 0x7f07d40c7740 2023-07-27T20:35:02.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.750+0000 7f07d8bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07d40c62f0 con 0x7f07d406c1d0 2023-07-27T20:35:02.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.750+0000 7f07d2d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f07d406c1d0 0x7f07d406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:02.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.750+0000 7f07d2d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f07d406c1d0 0x7f07d406c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48294/0 (socket says 172.21.15.72:48294) 2023-07-27T20:35:02.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.750+0000 7f07d2d9d700 1 -- 172.21.15.72:0/112674967 learned_addr learned my addr 172.21.15.72:0/112674967 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:35:02.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.750+0000 7f07d259c700 1 --1- 172.21.15.72:0/112674967 >> v1:172.21.15.72:6789/0 conn(0x7f07d414aab0 0x7f07d4154b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60418/0 (socket says 172.21.15.72:60418) 2023-07-27T20:35:02.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.751+0000 7f07d2d9d700 1 -- 172.21.15.72:0/112674967 >> v1:172.21.15.173:6789/0 conn(0x7f07d40c7740 legacy=0x7f07d40c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:02.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.751+0000 7f07d2d9d700 1 -- 172.21.15.72:0/112674967 >> v1:172.21.15.72:6789/0 conn(0x7f07d414aab0 legacy=0x7f07d4154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:02.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.751+0000 7f07d2d9d700 1 -- 172.21.15.72:0/112674967 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d406d200 con 0x7f07d406c1d0 2023-07-27T20:35:02.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.751+0000 7f07d1d9b700 1 -- 172.21.15.72:0/112674967 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1312091090 0 0) 0x7f07d40c7c50 con 0x7f07d414aab0 2023-07-27T20:35:02.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.751+0000 7f07d2d9d700 1 --2- 172.21.15.72:0/112674967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07d406c1d0 0x7f07d406c5f0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f07cc009e50 tx=0x7f07cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12308e091ab7fde9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:02.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.751+0000 7f07d1d9b700 1 -- 172.21.15.72:0/112674967 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07cc00e070 con 0x7f07d406c1d0 2023-07-27T20:35:02.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.751+0000 7f07d1d9b700 1 -- 172.21.15.72:0/112674967 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07cc00b9c0 con 0x7f07d406c1d0 2023-07-27T20:35:02.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.751+0000 7f07d1d9b700 1 -- 172.21.15.72:0/112674967 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07cc00bd70 con 0x7f07d406c1d0 2023-07-27T20:35:02.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.752+0000 7f07d8bff700 1 -- 172.21.15.72:0/112674967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07d406c1d0 msgr2=0x7f07d406c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:02.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.752+0000 7f07d8bff700 1 --2- 172.21.15.72:0/112674967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07d406c1d0 0x7f07d406c5f0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f07cc009e50 tx=0x7f07cc00b330 comp rx=0 tx=0).stop 2023-07-27T20:35:02.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.752+0000 7f07d8bff700 1 -- 172.21.15.72:0/112674967 shutdown_connections 2023-07-27T20:35:02.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.752+0000 7f07d8bff700 1 --2- 172.21.15.72:0/112674967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07d406c1d0 0x7f07d406c5f0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:02.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.752+0000 7f07d8bff700 1 -- 172.21.15.72:0/112674967 >> 172.21.15.72:0/112674967 conn(0x7f07d40ab3f0 msgr2=0x7f07d40ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:02.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.752+0000 7f07d8bff700 1 -- 172.21.15.72:0/112674967 shutdown_connections 2023-07-27T20:35:02.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.752+0000 7f07d8bff700 1 -- 172.21.15.72:0/112674967 wait complete. 2023-07-27T20:35:02.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.754+0000 7f07d8bff700 1 Processor -- start 2023-07-27T20:35:02.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.754+0000 7f07d8bff700 1 -- start start 2023-07-27T20:35:02.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.755+0000 7f07d8bff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f07d406c1d0 0x7f07d41e94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:02.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.756+0000 7f07d8bff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f07d40c7740 0x7f07d41eca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:02.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.756+0000 7f07d8bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07d414aab0 0x7f07d4158070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:02.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.756+0000 7f07d8bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d40c2f70 con 0x7f07d414aab0 2023-07-27T20:35:02.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.756+0000 7f07d8bff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d41ed9f0 con 0x7f07d406c1d0 2023-07-27T20:35:02.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.756+0000 7f07d8bff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d41585b0 con 0x7f07d40c7740 2023-07-27T20:35:02.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.756+0000 7f07d2d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07d414aab0 0x7f07d4158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:02.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.756+0000 7f07d2d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07d414aab0 0x7f07d4158070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48298/0 (socket says 172.21.15.72:48298) 2023-07-27T20:35:02.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.756+0000 7f07d2d9d700 1 -- 172.21.15.72:0/2597849215 learned_addr learned my addr 172.21.15.72:0/2597849215 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:35:02.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.756+0000 7f07d259c700 1 --2- 172.21.15.72:0/2597849215 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f07d406c1d0 0x7f07d41e94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:02.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.756+0000 7f07cbfff700 1 --2- 172.21.15.72:0/2597849215 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f07d40c7740 0x7f07d41eca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:02.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.756+0000 7f07d2d9d700 1 -- 172.21.15.72:0/2597849215 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f07d40c7740 msgr2=0x7f07d41eca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:02.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.756+0000 7f07d2d9d700 1 --2- 172.21.15.72:0/2597849215 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f07d40c7740 0x7f07d41eca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:02.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.756+0000 7f07d2d9d700 1 -- 172.21.15.72:0/2597849215 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f07d406c1d0 msgr2=0x7f07d41e94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:02.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.756+0000 7f07d2d9d700 1 --2- 172.21.15.72:0/2597849215 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f07d406c1d0 0x7f07d41e94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:02.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.756+0000 7f07d2d9d700 1 -- 172.21.15.72:0/2597849215 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07cc009b30 con 0x7f07d414aab0 2023-07-27T20:35:02.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.756+0000 7f07d2d9d700 1 --2- 172.21.15.72:0/2597849215 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07d414aab0 0x7f07d4158070 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f07cc00b730 tx=0x7f07cc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:02.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.757+0000 7f07caffd700 1 -- 172.21.15.72:0/2597849215 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07cc01c640 con 0x7f07d414aab0 2023-07-27T20:35:02.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.757+0000 7f07caffd700 1 -- 172.21.15.72:0/2597849215 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07cc01c7c0 con 0x7f07d414aab0 2023-07-27T20:35:02.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.757+0000 7f07d8bff700 1 -- 172.21.15.72:0/2597849215 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07d41ed150 con 0x7f07d414aab0 2023-07-27T20:35:02.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.757+0000 7f07caffd700 1 -- 172.21.15.72:0/2597849215 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07cc01cb70 con 0x7f07d414aab0 2023-07-27T20:35:02.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.757+0000 7f07d8bff700 1 -- 172.21.15.72:0/2597849215 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07d41ed710 con 0x7f07d414aab0 2023-07-27T20:35:02.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.758+0000 7f07d8bff700 1 -- 172.21.15.72:0/2597849215 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07d404e470 con 0x7f07d414aab0 2023-07-27T20:35:02.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.759+0000 7f07caffd700 1 -- 172.21.15.72:0/2597849215 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f07cc01ccd0 con 0x7f07d414aab0 2023-07-27T20:35:02.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.760+0000 7f07caffd700 1 --2- 172.21.15.72:0/2597849215 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f07b406ace0 0x7f07b406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:02.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.760+0000 7f07caffd700 1 -- 172.21.15.72:0/2597849215 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f07cc08b790 con 0x7f07d414aab0 2023-07-27T20:35:02.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.760+0000 7f07d259c700 1 --2- 172.21.15.72:0/2597849215 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f07b406ace0 0x7f07b406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:02.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.761+0000 7f07d259c700 1 --2- 172.21.15.72:0/2597849215 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f07b406ace0 0x7f07b406d1a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f07c4000f60 tx=0x7f07c4004a50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:02.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.764+0000 7f07caffd700 1 -- 172.21.15.72:0/2597849215 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f07cc056430 con 0x7f07d414aab0 2023-07-27T20:35:02.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.956+0000 7f07d8bff700 1 -- 172.21.15.72:0/2597849215 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f07d406cf00 con 0x7f07d414aab0 2023-07-27T20:35:02.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.957+0000 7f07caffd700 1 -- 172.21.15.72:0/2597849215 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v66) v1 ==== 92+0+10 (secure 0 0 0) 0x7f07cc059a50 con 0x7f07d414aab0 2023-07-27T20:35:02.945 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-27T20:35:02.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.959+0000 7f07d8bff700 1 -- 172.21.15.72:0/2597849215 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f07b406ace0 msgr2=0x7f07b406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:02.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.959+0000 7f07d8bff700 1 --2- 172.21.15.72:0/2597849215 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f07b406ace0 0x7f07b406d1a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f07c4000f60 tx=0x7f07c4004a50 comp rx=0 tx=0).stop 2023-07-27T20:35:02.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.959+0000 7f07d8bff700 1 -- 172.21.15.72:0/2597849215 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07d414aab0 msgr2=0x7f07d4158070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:02.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.959+0000 7f07d8bff700 1 --2- 172.21.15.72:0/2597849215 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07d414aab0 0x7f07d4158070 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f07cc00b730 tx=0x7f07cc004ad0 comp rx=0 tx=0).stop 2023-07-27T20:35:02.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.959+0000 7f07d8bff700 1 -- 172.21.15.72:0/2597849215 shutdown_connections 2023-07-27T20:35:02.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.960+0000 7f07d8bff700 1 --2- 172.21.15.72:0/2597849215 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07d414aab0 0x7f07d4158070 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:02.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.960+0000 7f07d8bff700 1 --2- 172.21.15.72:0/2597849215 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f07d406c1d0 0x7f07d41e94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:02.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.960+0000 7f07d8bff700 1 --2- 172.21.15.72:0/2597849215 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f07b406ace0 0x7f07b406d1a0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:02.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.960+0000 7f07d8bff700 1 --2- 172.21.15.72:0/2597849215 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f07d40c7740 0x7f07d41eca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:02.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.960+0000 7f07d8bff700 1 -- 172.21.15.72:0/2597849215 >> 172.21.15.72:0/2597849215 conn(0x7f07d40ab3f0 msgr2=0x7f07d4149ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:02.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.960+0000 7f07d8bff700 1 -- 172.21.15.72:0/2597849215 shutdown_connections 2023-07-27T20:35:02.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:02.960+0000 7f07d8bff700 1 -- 172.21.15.72:0/2597849215 wait complete. 2023-07-27T20:35:02.965 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T20:35:03.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.175+0000 7f6f533ff700 1 Processor -- start 2023-07-27T20:35:03.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.175+0000 7f6f533ff700 1 -- start start 2023-07-27T20:35:03.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.176+0000 7f6f533ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6f4c06e140 0x7f6f4c0ba310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:03.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.176+0000 7f6f533ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f4c06ce10 con 0x7f6f4c0ba850 2023-07-27T20:35:03.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.176+0000 7f6f533ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f4c152680 con 0x7f6f4c13b150 2023-07-27T20:35:03.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.176+0000 7f6f533ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f4c152960 con 0x7f6f4c06e140 2023-07-27T20:35:03.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.176+0000 7f6f5099a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6f4c06e140 0x7f6f4c0ba310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:03.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.176+0000 7f6f5199c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6f4c0ba850 0x7f6f4c06d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60428/0 (socket says 172.21.15.72:60428) 2023-07-27T20:35:03.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.176+0000 7f6f5199c700 1 -- 172.21.15.72:0/3890455527 learned_addr learned my addr 172.21.15.72:0/3890455527 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:35:03.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.177+0000 7f6f5099a700 1 -- 172.21.15.72:0/3890455527 >> v1:172.21.15.173:6789/0 conn(0x7f6f4c13b150 legacy=0x7f6f4c151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:03.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.177+0000 7f6f5099a700 1 -- 172.21.15.72:0/3890455527 >> v1:172.21.15.72:6789/0 conn(0x7f6f4c0ba850 legacy=0x7f6f4c06d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:03.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.177+0000 7f6f5099a700 1 -- 172.21.15.72:0/3890455527 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f4c152c40 con 0x7f6f4c06e140 2023-07-27T20:35:03.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.177+0000 7f6f43fff700 1 -- 172.21.15.72:0/3890455527 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2436591226 0 0) 0x7f6f4c06ce10 con 0x7f6f4c0ba850 2023-07-27T20:35:03.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.177+0000 7f6f5099a700 1 --2- 172.21.15.72:0/3890455527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f4c06e140 0x7f6f4c0ba310 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c009840 tx=0x7f6f3c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b84a94d26fb98693 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:03.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.177+0000 7f6f43fff700 1 -- 172.21.15.72:0/3890455527 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c011830 con 0x7f6f4c06e140 2023-07-27T20:35:03.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.177+0000 7f6f43fff700 1 -- 172.21.15.72:0/3890455527 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f3c011990 con 0x7f6f4c06e140 2023-07-27T20:35:03.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.177+0000 7f6f43fff700 1 -- 172.21.15.72:0/3890455527 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c011d20 con 0x7f6f4c06e140 2023-07-27T20:35:03.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.178+0000 7f6f533ff700 1 -- 172.21.15.72:0/3890455527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f4c06e140 msgr2=0x7f6f4c0ba310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:03.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.178+0000 7f6f533ff700 1 --2- 172.21.15.72:0/3890455527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f4c06e140 0x7f6f4c0ba310 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c009840 tx=0x7f6f3c009b50 comp rx=0 tx=0).stop 2023-07-27T20:35:03.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.178+0000 7f6f533ff700 1 -- 172.21.15.72:0/3890455527 shutdown_connections 2023-07-27T20:35:03.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.178+0000 7f6f533ff700 1 --2- 172.21.15.72:0/3890455527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f4c06e140 0x7f6f4c0ba310 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:03.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.178+0000 7f6f533ff700 1 -- 172.21.15.72:0/3890455527 >> 172.21.15.72:0/3890455527 conn(0x7f6f4c06a190 msgr2=0x7f6f4c06a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:03.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.178+0000 7f6f533ff700 1 -- 172.21.15.72:0/3890455527 shutdown_connections 2023-07-27T20:35:03.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.178+0000 7f6f533ff700 1 -- 172.21.15.72:0/3890455527 wait complete. 2023-07-27T20:35:03.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.180+0000 7f6f533ff700 1 Processor -- start 2023-07-27T20:35:03.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.180+0000 7f6f533ff700 1 -- start start 2023-07-27T20:35:03.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.181+0000 7f6f533ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f4c06e140 0x7f6f4c137df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:03.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.181+0000 7f6f533ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f4c0ba850 0x7f6f4c0c54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:03.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.181+0000 7f6f533ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f4c13b150 0x7f6f4c0a8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:03.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.181+0000 7f6f533ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c0aa110 con 0x7f6f4c0ba850 2023-07-27T20:35:03.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.181+0000 7f6f533ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c1383d0 con 0x7f6f4c13b150 2023-07-27T20:35:03.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.181+0000 7f6f533ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c0c44c0 con 0x7f6f4c06e140 2023-07-27T20:35:03.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.181+0000 7f6f5099a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f4c0ba850 0x7f6f4c0c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:03.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.181+0000 7f6f5099a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f4c0ba850 0x7f6f4c0c54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48316/0 (socket says 172.21.15.72:48316) 2023-07-27T20:35:03.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.181+0000 7f6f5099a700 1 -- 172.21.15.72:0/4073817126 learned_addr learned my addr 172.21.15.72:0/4073817126 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:35:03.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.181+0000 7f6f5199c700 1 --2- 172.21.15.72:0/4073817126 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f4c13b150 0x7f6f4c0a8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:03.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.181+0000 7f6f5119b700 1 --2- 172.21.15.72:0/4073817126 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f4c06e140 0x7f6f4c137df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:03.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.181+0000 7f6f5099a700 1 -- 172.21.15.72:0/4073817126 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f4c06e140 msgr2=0x7f6f4c137df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:03.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.181+0000 7f6f5099a700 1 --2- 172.21.15.72:0/4073817126 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f4c06e140 0x7f6f4c137df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:03.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.181+0000 7f6f5099a700 1 -- 172.21.15.72:0/4073817126 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f4c13b150 msgr2=0x7f6f4c0a8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:03.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.181+0000 7f6f5099a700 1 --2- 172.21.15.72:0/4073817126 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f4c13b150 0x7f6f4c0a8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:03.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.181+0000 7f6f5099a700 1 -- 172.21.15.72:0/4073817126 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f3c0094a0 con 0x7f6f4c0ba850 2023-07-27T20:35:03.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.181+0000 7f6f5119b700 1 --2- 172.21.15.72:0/4073817126 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f4c06e140 0x7f6f4c137df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:35:03.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.182+0000 7f6f5099a700 1 --2- 172.21.15.72:0/4073817126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f4c0ba850 0x7f6f4c0c54e0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c009b90 tx=0x7f6f3c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:03.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.182+0000 7f6f41ffb700 1 -- 172.21.15.72:0/4073817126 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c0036a0 con 0x7f6f4c0ba850 2023-07-27T20:35:03.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.182+0000 7f6f41ffb700 1 -- 172.21.15.72:0/4073817126 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f3c01e070 con 0x7f6f4c0ba850 2023-07-27T20:35:03.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.182+0000 7f6f533ff700 1 -- 172.21.15.72:0/4073817126 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f4c0c3b90 con 0x7f6f4c0ba850 2023-07-27T20:35:03.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.182+0000 7f6f41ffb700 1 -- 172.21.15.72:0/4073817126 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c003a00 con 0x7f6f4c0ba850 2023-07-27T20:35:03.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.182+0000 7f6f533ff700 1 -- 172.21.15.72:0/4073817126 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f4c0c4150 con 0x7f6f4c0ba850 2023-07-27T20:35:03.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.183+0000 7f6f533ff700 1 -- 172.21.15.72:0/4073817126 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f4c0c4630 con 0x7f6f4c0ba850 2023-07-27T20:35:03.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.184+0000 7f6f41ffb700 1 -- 172.21.15.72:0/4073817126 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6f3c003b60 con 0x7f6f4c0ba850 2023-07-27T20:35:03.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.185+0000 7f6f41ffb700 1 --2- 172.21.15.72:0/4073817126 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f6f3006ace0 0x7f6f3006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:03.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.185+0000 7f6f41ffb700 1 -- 172.21.15.72:0/4073817126 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f6f3c08ab70 con 0x7f6f4c0ba850 2023-07-27T20:35:03.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.185+0000 7f6f5119b700 1 --2- 172.21.15.72:0/4073817126 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f6f3006ace0 0x7f6f3006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:03.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.186+0000 7f6f5119b700 1 --2- 172.21.15.72:0/4073817126 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f6f3006ace0 0x7f6f3006d1a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6f48000f60 tx=0x7f6f48009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:03.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.189+0000 7f6f41ffb700 1 -- 172.21.15.72:0/4073817126 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6f3c055770 con 0x7f6f4c0ba850 2023-07-27T20:35:03.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.384+0000 7f6f533ff700 1 -- 172.21.15.72:0/4073817126 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6f4c04e470 con 0x7f6f4c0ba850 2023-07-27T20:35:03.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.384+0000 7f6f41ffb700 1 -- 172.21.15.72:0/4073817126 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v66) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6f3c020020 con 0x7f6f4c0ba850 2023-07-27T20:35:03.372 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:35:03.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.386+0000 7f6f533ff700 1 -- 172.21.15.72:0/4073817126 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f6f3006ace0 msgr2=0x7f6f3006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:03.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.386+0000 7f6f533ff700 1 --2- 172.21.15.72:0/4073817126 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f6f3006ace0 0x7f6f3006d1a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6f48000f60 tx=0x7f6f48009040 comp rx=0 tx=0).stop 2023-07-27T20:35:03.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.387+0000 7f6f533ff700 1 -- 172.21.15.72:0/4073817126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f4c0ba850 msgr2=0x7f6f4c0c54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:03.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.387+0000 7f6f533ff700 1 --2- 172.21.15.72:0/4073817126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f4c0ba850 0x7f6f4c0c54e0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c009b90 tx=0x7f6f3c004750 comp rx=0 tx=0).stop 2023-07-27T20:35:03.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.387+0000 7f6f533ff700 1 -- 172.21.15.72:0/4073817126 shutdown_connections 2023-07-27T20:35:03.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.387+0000 7f6f533ff700 1 --2- 172.21.15.72:0/4073817126 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f4c13b150 0x7f6f4c0a8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:03.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.387+0000 7f6f533ff700 1 --2- 172.21.15.72:0/4073817126 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f6f3006ace0 0x7f6f3006d1a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:03.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.387+0000 7f6f533ff700 1 --2- 172.21.15.72:0/4073817126 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f4c06e140 0x7f6f4c137df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:03.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.387+0000 7f6f533ff700 1 --2- 172.21.15.72:0/4073817126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f4c0ba850 0x7f6f4c0c54e0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:03.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.387+0000 7f6f533ff700 1 -- 172.21.15.72:0/4073817126 >> 172.21.15.72:0/4073817126 conn(0x7f6f4c06a190 msgr2=0x7f6f4c06a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:03.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.387+0000 7f6f533ff700 1 -- 172.21.15.72:0/4073817126 shutdown_connections 2023-07-27T20:35:03.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.387+0000 7f6f533ff700 1 -- 172.21.15.72:0/4073817126 wait complete. 2023-07-27T20:35:03.392 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T20:35:03.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.603+0000 7f0f55dff700 1 Processor -- start 2023-07-27T20:35:03.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.603+0000 7f0f55dff700 1 -- start start 2023-07-27T20:35:03.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.604+0000 7f0f55dff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0f5014aab0 0x7f0f50154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:03.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.604+0000 7f0f55dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f5006c1d0 0x7f0f5006c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:03.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.604+0000 7f0f55dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f500c7c50 con 0x7f0f500c7740 2023-07-27T20:35:03.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.604+0000 7f0f55dff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f5006bd40 con 0x7f0f5014aab0 2023-07-27T20:35:03.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.604+0000 7f0f55dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f500c62f0 con 0x7f0f5006c1d0 2023-07-27T20:35:03.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.604+0000 7f0f4effd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0f500c7740 0x7f0f500c41c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60438/0 (socket says 172.21.15.72:60438) 2023-07-27T20:35:03.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.605+0000 7f0f4effd700 1 -- 172.21.15.72:0/2585124398 learned_addr learned my addr 172.21.15.72:0/2585124398 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:35:03.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.605+0000 7f0f4ffff700 1 --2- 172.21.15.72:0/2585124398 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f5006c1d0 0x7f0f5006c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:03.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.605+0000 7f0f4e7fc700 1 -- 172.21.15.72:0/2585124398 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1058491296 0 0) 0x7f0f500c7c50 con 0x7f0f500c7740 2023-07-27T20:35:03.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.605+0000 7f0f4e7fc700 1 -- 172.21.15.72:0/2585124398 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f380035b0 con 0x7f0f500c7740 2023-07-27T20:35:03.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.605+0000 7f0f4f7fe700 1 --2- 172.21.15.72:0/2585124398 >> v2:172.21.15.173:3300/0 conn(0x7f0f5014aab0 0x7f0f50154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:03.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.605+0000 7f0f4e7fc700 1 -- 172.21.15.72:0/2585124398 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 766752356 0 0) 0x7f0f380035b0 con 0x7f0f500c7740 2023-07-27T20:35:03.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.605+0000 7f0f4e7fc700 1 -- 172.21.15.72:0/2585124398 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f5006c1d0 msgr2=0x7f0f5006c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:35:03.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.605+0000 7f0f4e7fc700 1 --2- 172.21.15.72:0/2585124398 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f5006c1d0 0x7f0f5006c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:03.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.605+0000 7f0f4e7fc700 1 -- 172.21.15.72:0/2585124398 >> v2:172.21.15.173:3300/0 conn(0x7f0f5014aab0 msgr2=0x7f0f50154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:35:03.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.605+0000 7f0f4e7fc700 1 --2- 172.21.15.72:0/2585124398 >> v2:172.21.15.173:3300/0 conn(0x7f0f5014aab0 0x7f0f50154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:03.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.605+0000 7f0f4e7fc700 1 -- 172.21.15.72:0/2585124398 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f50155050 con 0x7f0f500c7740 2023-07-27T20:35:03.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.605+0000 7f0f4e7fc700 1 -- 172.21.15.72:0/2585124398 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f0f44001670 con 0x7f0f500c7740 2023-07-27T20:35:03.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.605+0000 7f0f4e7fc700 1 -- 172.21.15.72:0/2585124398 >> v1:172.21.15.72:6789/0 conn(0x7f0f500c7740 legacy=0x7f0f500c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:03.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.605+0000 7f0f4e7fc700 1 --2- 172.21.15.72:0/2585124398 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f5006c1d0 0x7f0f38003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:03.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.605+0000 7f0f4e7fc700 1 --2- 172.21.15.72:0/2585124398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f38003f80 0x7f0f38004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:03.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.606+0000 7f0f4e7fc700 1 --2- 172.21.15.72:0/2585124398 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f38004d90 0x7f0f38005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:03.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.606+0000 7f0f4e7fc700 1 -- 172.21.15.72:0/2585124398 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5006bd40 con 0x7f0f38003f80 2023-07-27T20:35:03.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.606+0000 7f0f4e7fc700 1 -- 172.21.15.72:0/2585124398 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f500c62f0 con 0x7f0f38004d90 2023-07-27T20:35:03.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.606+0000 7f0f4e7fc700 1 -- 172.21.15.72:0/2585124398 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3800ba10 con 0x7f0f5006c1d0 2023-07-27T20:35:03.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.606+0000 7f0f4effd700 1 --2- 172.21.15.72:0/2585124398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f38003f80 0x7f0f38004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:03.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.606+0000 7f0f4f7fe700 1 --2- 172.21.15.72:0/2585124398 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f5006c1d0 0x7f0f38003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:03.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.606+0000 7f0f4ffff700 1 --2- 172.21.15.72:0/2585124398 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f38004d90 0x7f0f38005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:03.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.606+0000 7f0f4effd700 1 -- 172.21.15.72:0/2585124398 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f5006c1d0 msgr2=0x7f0f38003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:35:03.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.606+0000 7f0f4effd700 1 --2- 172.21.15.72:0/2585124398 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f5006c1d0 0x7f0f38003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:03.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.606+0000 7f0f4effd700 1 -- 172.21.15.72:0/2585124398 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f38004d90 msgr2=0x7f0f38005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:35:03.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.606+0000 7f0f4effd700 1 --2- 172.21.15.72:0/2585124398 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f38004d90 0x7f0f38005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:03.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.606+0000 7f0f4effd700 1 -- 172.21.15.72:0/2585124398 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f380035b0 con 0x7f0f38003f80 2023-07-27T20:35:03.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.606+0000 7f0f4effd700 1 --2- 172.21.15.72:0/2585124398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f38003f80 0x7f0f38004850 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f0f4400c240 tx=0x7f0f38005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82ca688ae203693c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:03.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.607+0000 7f0f4e7fc700 1 -- 172.21.15.72:0/2585124398 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4400cd80 con 0x7f0f38003f80 2023-07-27T20:35:03.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.607+0000 7f0f4e7fc700 1 -- 172.21.15.72:0/2585124398 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f44007ba0 con 0x7f0f38003f80 2023-07-27T20:35:03.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.607+0000 7f0f4e7fc700 1 -- 172.21.15.72:0/2585124398 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f44005ba0 con 0x7f0f38003f80 2023-07-27T20:35:03.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.607+0000 7f0f55dff700 1 -- 172.21.15.72:0/2585124398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f38003f80 msgr2=0x7f0f38004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:03.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.607+0000 7f0f55dff700 1 --2- 172.21.15.72:0/2585124398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f38003f80 0x7f0f38004850 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f0f4400c240 tx=0x7f0f38005880 comp rx=0 tx=0).stop 2023-07-27T20:35:03.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.607+0000 7f0f4ffff700 1 -- 172.21.15.72:0/2585124398 reap_dead start 2023-07-27T20:35:03.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.607+0000 7f0f55dff700 1 -- 172.21.15.72:0/2585124398 shutdown_connections 2023-07-27T20:35:03.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.607+0000 7f0f55dff700 1 -- 172.21.15.72:0/2585124398 >> 172.21.15.72:0/2585124398 conn(0x7f0f500ab3f0 msgr2=0x7f0f500ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:03.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.607+0000 7f0f55dff700 1 -- 172.21.15.72:0/2585124398 shutdown_connections 2023-07-27T20:35:03.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.607+0000 7f0f55dff700 1 -- 172.21.15.72:0/2585124398 wait complete. 2023-07-27T20:35:03.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.609+0000 7f0f55dff700 1 Processor -- start 2023-07-27T20:35:03.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.609+0000 7f0f55dff700 1 -- start start 2023-07-27T20:35:03.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.610+0000 7f0f55dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f38003f80 0x7f0f500c3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:03.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.610+0000 7f0f55dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f500c04a0 0x7f0f501e6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:03.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.610+0000 7f0f55dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f500ac6f0 0x7f0f501e6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:03.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.610+0000 7f0f55dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f500ae9c0 con 0x7f0f500c04a0 2023-07-27T20:35:03.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.610+0000 7f0f55dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f501e74a0 con 0x7f0f500ac6f0 2023-07-27T20:35:03.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.610+0000 7f0f55dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f500c0910 con 0x7f0f38003f80 2023-07-27T20:35:03.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.610+0000 7f0f4effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f500c04a0 0x7f0f501e6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:03.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.610+0000 7f0f4effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f500c04a0 0x7f0f501e6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48336/0 (socket says 172.21.15.72:48336) 2023-07-27T20:35:03.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.610+0000 7f0f4effd700 1 -- 172.21.15.72:0/758862250 learned_addr learned my addr 172.21.15.72:0/758862250 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:35:03.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.610+0000 7f0f4f7fe700 1 --2- 172.21.15.72:0/758862250 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f38003f80 0x7f0f500c3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:03.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.610+0000 7f0f4ffff700 1 --2- 172.21.15.72:0/758862250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f500ac6f0 0x7f0f501e6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:03.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.611+0000 7f0f4effd700 1 -- 172.21.15.72:0/758862250 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f38003f80 msgr2=0x7f0f500c3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:03.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.611+0000 7f0f4effd700 1 --2- 172.21.15.72:0/758862250 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f38003f80 0x7f0f500c3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:03.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.611+0000 7f0f4effd700 1 -- 172.21.15.72:0/758862250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f500ac6f0 msgr2=0x7f0f501e6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:03.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.611+0000 7f0f4effd700 1 --2- 172.21.15.72:0/758862250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f500ac6f0 0x7f0f501e6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:03.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.611+0000 7f0f4effd700 1 -- 172.21.15.72:0/758862250 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f500c1170 con 0x7f0f500c04a0 2023-07-27T20:35:03.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.611+0000 7f0f4effd700 1 --2- 172.21.15.72:0/758862250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f500c04a0 0x7f0f501e6a20 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f0f44001930 tx=0x7f0f500c6030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:03.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.611+0000 7f0f37fff700 1 -- 172.21.15.72:0/758862250 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f44004c80 con 0x7f0f500c04a0 2023-07-27T20:35:03.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.611+0000 7f0f37fff700 1 -- 172.21.15.72:0/758862250 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f44004de0 con 0x7f0f500c04a0 2023-07-27T20:35:03.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.611+0000 7f0f55dff700 1 -- 172.21.15.72:0/758862250 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f501ea570 con 0x7f0f500c04a0 2023-07-27T20:35:03.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.611+0000 7f0f37fff700 1 -- 172.21.15.72:0/758862250 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f440072d0 con 0x7f0f500c04a0 2023-07-27T20:35:03.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.611+0000 7f0f55dff700 1 -- 172.21.15.72:0/758862250 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f500c0e00 con 0x7f0f500c04a0 2023-07-27T20:35:03.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.612+0000 7f0f55dff700 1 -- 172.21.15.72:0/758862250 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f500c1300 con 0x7f0f500c04a0 2023-07-27T20:35:03.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.613+0000 7f0f37fff700 1 -- 172.21.15.72:0/758862250 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0f44019030 con 0x7f0f500c04a0 2023-07-27T20:35:03.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.614+0000 7f0f37fff700 1 --2- 172.21.15.72:0/758862250 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0f3c06ace0 0x7f0f3c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:03.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.614+0000 7f0f37fff700 1 -- 172.21.15.72:0/758862250 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f0f4408a6c0 con 0x7f0f500c04a0 2023-07-27T20:35:03.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.615+0000 7f0f4f7fe700 1 --2- 172.21.15.72:0/758862250 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0f3c06ace0 0x7f0f3c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:03.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.616+0000 7f0f4f7fe700 1 --2- 172.21.15.72:0/758862250 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0f3c06ace0 0x7f0f3c06d1a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0f40009c60 tx=0x7f0f40009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:03.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.619+0000 7f0f37fff700 1 -- 172.21.15.72:0/758862250 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0f440552c0 con 0x7f0f500c04a0 2023-07-27T20:35:03.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.811+0000 7f0f55dff700 1 -- 172.21.15.72:0/758862250 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0f5004e470 con 0x7f0f500c04a0 2023-07-27T20:35:03.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.812+0000 7f0f37fff700 1 -- 172.21.15.72:0/758862250 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v66) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0f440588e0 con 0x7f0f500c04a0 2023-07-27T20:35:03.800 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-27T20:35:03.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.814+0000 7f0f55dff700 1 -- 172.21.15.72:0/758862250 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0f3c06ace0 msgr2=0x7f0f3c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:03.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.814+0000 7f0f55dff700 1 --2- 172.21.15.72:0/758862250 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0f3c06ace0 0x7f0f3c06d1a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0f40009c60 tx=0x7f0f40009210 comp rx=0 tx=0).stop 2023-07-27T20:35:03.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.814+0000 7f0f55dff700 1 -- 172.21.15.72:0/758862250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f500c04a0 msgr2=0x7f0f501e6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:03.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.814+0000 7f0f55dff700 1 --2- 172.21.15.72:0/758862250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f500c04a0 0x7f0f501e6a20 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f0f44001930 tx=0x7f0f500c6030 comp rx=0 tx=0).stop 2023-07-27T20:35:03.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.814+0000 7f0f55dff700 1 -- 172.21.15.72:0/758862250 shutdown_connections 2023-07-27T20:35:03.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.814+0000 7f0f55dff700 1 --2- 172.21.15.72:0/758862250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f500ac6f0 0x7f0f501e6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:03.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.814+0000 7f0f55dff700 1 --2- 172.21.15.72:0/758862250 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f0f3c06ace0 0x7f0f3c06d1a0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:03.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.814+0000 7f0f55dff700 1 --2- 172.21.15.72:0/758862250 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f38003f80 0x7f0f500c3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:03.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.814+0000 7f0f55dff700 1 --2- 172.21.15.72:0/758862250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f500c04a0 0x7f0f501e6a20 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:03.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.814+0000 7f0f55dff700 1 -- 172.21.15.72:0/758862250 >> 172.21.15.72:0/758862250 conn(0x7f0f500ab3f0 msgr2=0x7f0f500a9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:03.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.814+0000 7f0f55dff700 1 -- 172.21.15.72:0/758862250 shutdown_connections 2023-07-27T20:35:03.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:03.814+0000 7f0f55dff700 1 -- 172.21.15.72:0/758862250 wait complete. 2023-07-27T20:35:03.820 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-07-27T20:35:04.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.032+0000 7fb4f57ff700 1 Processor -- start 2023-07-27T20:35:04.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.032+0000 7fb4f57ff700 1 -- start start 2023-07-27T20:35:04.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.033+0000 7fb4f57ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb4f014aab0 0x7fb4f0154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:04.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.033+0000 7fb4f57ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4f00c7740 0x7fb4f00c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:04.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.033+0000 7fb4f57ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f00c7c50 con 0x7fb4f00c4700 2023-07-27T20:35:04.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.033+0000 7fb4f57ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4f006bd40 con 0x7fb4f014aab0 2023-07-27T20:35:04.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.033+0000 7fb4f57ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f00c62f0 con 0x7fb4f00c7740 2023-07-27T20:35:04.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.033+0000 7fb4ef7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb4f00c4700 0x7fb4f006c1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60446/0 (socket says 172.21.15.72:60446) 2023-07-27T20:35:04.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.033+0000 7fb4ef7fe700 1 -- 172.21.15.72:0/978900367 learned_addr learned my addr 172.21.15.72:0/978900367 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:35:04.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.033+0000 7fb4ee7fc700 1 --2- 172.21.15.72:0/978900367 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4f00c7740 0x7fb4f00c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:04.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.033+0000 7fb4eeffd700 1 --2- 172.21.15.72:0/978900367 >> v2:172.21.15.173:3300/0 conn(0x7fb4f014aab0 0x7fb4f0154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:04.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.034+0000 7fb4edffb700 1 -- 172.21.15.72:0/978900367 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3214253555 0 0) 0x7fb4f00c7c50 con 0x7fb4f00c4700 2023-07-27T20:35:04.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.034+0000 7fb4edffb700 1 -- 172.21.15.72:0/978900367 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4d80035b0 con 0x7fb4f00c4700 2023-07-27T20:35:04.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.034+0000 7fb4edffb700 1 -- 172.21.15.72:0/978900367 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1194053810 0 0) 0x7fb4d80035b0 con 0x7fb4f00c4700 2023-07-27T20:35:04.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.034+0000 7fb4ee7fc700 1 -- 172.21.15.72:0/978900367 >> v2:172.21.15.173:3300/0 conn(0x7fb4f014aab0 msgr2=0x7fb4f0154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:35:04.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.034+0000 7fb4ee7fc700 1 --2- 172.21.15.72:0/978900367 >> v2:172.21.15.173:3300/0 conn(0x7fb4f014aab0 0x7fb4f0154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:04.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.034+0000 7fb4ee7fc700 1 -- 172.21.15.72:0/978900367 >> v1:172.21.15.72:6789/0 conn(0x7fb4f00c4700 legacy=0x7fb4f006c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:04.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.034+0000 7fb4ee7fc700 1 -- 172.21.15.72:0/978900367 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f0155050 con 0x7fb4f00c7740 2023-07-27T20:35:04.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.034+0000 7fb4ee7fc700 1 --2- 172.21.15.72:0/978900367 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4f00c7740 0x7fb4f00c41c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4009840 tx=0x7fb4e4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b47a2d5eb0e43c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:04.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.034+0000 7fb4edffb700 1 -- 172.21.15.72:0/978900367 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e80019f0 con 0x7fb4f00c7740 2023-07-27T20:35:04.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.035+0000 7fb4edffb700 1 -- 172.21.15.72:0/978900367 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e4004030 con 0x7fb4f00c7740 2023-07-27T20:35:04.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.035+0000 7fb4edffb700 1 -- 172.21.15.72:0/978900367 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e40043c0 con 0x7fb4f00c7740 2023-07-27T20:35:04.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.035+0000 7fb4f57ff700 1 -- 172.21.15.72:0/978900367 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4f00c7740 msgr2=0x7fb4f00c41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:04.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.035+0000 7fb4f57ff700 1 --2- 172.21.15.72:0/978900367 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4f00c7740 0x7fb4f00c41c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4009840 tx=0x7fb4e4009b50 comp rx=0 tx=0).stop 2023-07-27T20:35:04.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.035+0000 7fb4f57ff700 1 -- 172.21.15.72:0/978900367 shutdown_connections 2023-07-27T20:35:04.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.035+0000 7fb4f57ff700 1 --2- 172.21.15.72:0/978900367 >> v2:172.21.15.173:3300/0 conn(0x7fb4f014aab0 0x7fb4f0154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:04.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.035+0000 7fb4f57ff700 1 --2- 172.21.15.72:0/978900367 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4f00c7740 0x7fb4f00c41c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:04.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.035+0000 7fb4f57ff700 1 -- 172.21.15.72:0/978900367 >> 172.21.15.72:0/978900367 conn(0x7fb4f00ab3f0 msgr2=0x7fb4f00ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:04.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.035+0000 7fb4f57ff700 1 -- 172.21.15.72:0/978900367 shutdown_connections 2023-07-27T20:35:04.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.035+0000 7fb4f57ff700 1 -- 172.21.15.72:0/978900367 wait complete. 2023-07-27T20:35:04.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.037+0000 7fb4f57ff700 1 Processor -- start 2023-07-27T20:35:04.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.037+0000 7fb4f57ff700 1 -- start start 2023-07-27T20:35:04.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.038+0000 7fb4f57ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4f00c4700 0x7fb4f01563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:04.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.038+0000 7fb4f57ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4f00c7740 0x7fb4f00a99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:04.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.038+0000 7fb4f57ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4f014aab0 0x7fb4f01e9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:04.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.038+0000 7fb4f57ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f01e9890 con 0x7fb4f00c4700 2023-07-27T20:35:04.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.038+0000 7fb4f57ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f0157d80 con 0x7fb4f00c7740 2023-07-27T20:35:04.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.038+0000 7fb4f57ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f0158060 con 0x7fb4f014aab0 2023-07-27T20:35:04.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.038+0000 7fb4eeffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4f00c4700 0x7fb4f01563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:04.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.038+0000 7fb4eeffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4f00c4700 0x7fb4f01563b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48348/0 (socket says 172.21.15.72:48348) 2023-07-27T20:35:04.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.038+0000 7fb4eeffd700 1 -- 172.21.15.72:0/1867862905 learned_addr learned my addr 172.21.15.72:0/1867862905 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:35:04.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.039+0000 7fb4ee7fc700 1 --2- 172.21.15.72:0/1867862905 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4f00c7740 0x7fb4f00a99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:04.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.039+0000 7fb4ef7fe700 1 --2- 172.21.15.72:0/1867862905 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4f014aab0 0x7fb4f01e9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:04.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.039+0000 7fb4eeffd700 1 -- 172.21.15.72:0/1867862905 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4f014aab0 msgr2=0x7fb4f01e9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:04.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.039+0000 7fb4eeffd700 1 --2- 172.21.15.72:0/1867862905 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4f014aab0 0x7fb4f01e9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:04.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.039+0000 7fb4eeffd700 1 -- 172.21.15.72:0/1867862905 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4f00c7740 msgr2=0x7fb4f00a99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:04.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.039+0000 7fb4eeffd700 1 --2- 172.21.15.72:0/1867862905 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4f00c7740 0x7fb4f00a99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:04.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.039+0000 7fb4eeffd700 1 -- 172.21.15.72:0/1867862905 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e40094a0 con 0x7fb4f00c4700 2023-07-27T20:35:04.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.039+0000 7fb4ef7fe700 1 --2- 172.21.15.72:0/1867862905 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4f014aab0 0x7fb4f01e9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:35:04.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.039+0000 7fb4eeffd700 1 --2- 172.21.15.72:0/1867862905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4f00c4700 0x7fb4f01563b0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fb4e000e870 tx=0x7fb4e000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:04.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.039+0000 7fb4d77fe700 1 -- 172.21.15.72:0/1867862905 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e0009590 con 0x7fb4f00c4700 2023-07-27T20:35:04.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.039+0000 7fb4d77fe700 1 -- 172.21.15.72:0/1867862905 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e000ee70 con 0x7fb4f00c4700 2023-07-27T20:35:04.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.039+0000 7fb4f57ff700 1 -- 172.21.15.72:0/1867862905 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f0158340 con 0x7fb4f00c4700 2023-07-27T20:35:04.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.039+0000 7fb4d77fe700 1 -- 172.21.15.72:0/1867862905 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e000ca50 con 0x7fb4f00c4700 2023-07-27T20:35:04.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.039+0000 7fb4f57ff700 1 -- 172.21.15.72:0/1867862905 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f00a9ee0 con 0x7fb4f00c4700 2023-07-27T20:35:04.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.040+0000 7fb4f57ff700 1 -- 172.21.15.72:0/1867862905 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4f01e9ce0 con 0x7fb4f00c4700 2023-07-27T20:35:04.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.041+0000 7fb4d77fe700 1 -- 172.21.15.72:0/1867862905 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb4e000cbb0 con 0x7fb4f00c4700 2023-07-27T20:35:04.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.042+0000 7fb4d77fe700 1 --2- 172.21.15.72:0/1867862905 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb4dc06ace0 0x7fb4dc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:04.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.042+0000 7fb4d77fe700 1 -- 172.21.15.72:0/1867862905 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7238+0+0 (secure 0 0 0) 0x7fb4e0089900 con 0x7fb4f00c4700 2023-07-27T20:35:04.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.043+0000 7fb4ee7fc700 1 --2- 172.21.15.72:0/1867862905 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb4dc06ace0 0x7fb4dc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:04.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.043+0000 7fb4ee7fc700 1 --2- 172.21.15.72:0/1867862905 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb4dc06ace0 0x7fb4dc06d1a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4009840 tx=0x7fb4e4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:04.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.046+0000 7fb4d77fe700 1 -- 172.21.15.72:0/1867862905 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb4f01e9ce0 con 0x7fb4f00c4700 2023-07-27T20:35:04.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.243+0000 7fb4f57ff700 1 -- 172.21.15.72:0/1867862905 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb4f01e9ce0 con 0x7fb4f00c4700 2023-07-27T20:35:04.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.244+0000 7fb4d77fe700 1 -- 172.21.15.72:0/1867862905 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v66) v1 ==== 105+0+11 (secure 0 0 0) 0x7fb4f01e9ce0 con 0x7fb4f00c4700 2023-07-27T20:35:04.231 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:35:04.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.246+0000 7fb4f57ff700 1 -- 172.21.15.72:0/1867862905 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb4dc06ace0 msgr2=0x7fb4dc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:04.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.246+0000 7fb4f57ff700 1 --2- 172.21.15.72:0/1867862905 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb4dc06ace0 0x7fb4dc06d1a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4009840 tx=0x7fb4e4008030 comp rx=0 tx=0).stop 2023-07-27T20:35:04.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.246+0000 7fb4f57ff700 1 -- 172.21.15.72:0/1867862905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4f00c4700 msgr2=0x7fb4f01563b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:04.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.246+0000 7fb4f57ff700 1 --2- 172.21.15.72:0/1867862905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4f00c4700 0x7fb4f01563b0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fb4e000e870 tx=0x7fb4e000ec30 comp rx=0 tx=0).stop 2023-07-27T20:35:04.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.246+0000 7fb4f57ff700 1 -- 172.21.15.72:0/1867862905 shutdown_connections 2023-07-27T20:35:04.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.246+0000 7fb4f57ff700 1 --2- 172.21.15.72:0/1867862905 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fb4dc06ace0 0x7fb4dc06d1a0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:04.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.246+0000 7fb4f57ff700 1 --2- 172.21.15.72:0/1867862905 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4f014aab0 0x7fb4f01e9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:04.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.246+0000 7fb4f57ff700 1 --2- 172.21.15.72:0/1867862905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4f00c4700 0x7fb4f01563b0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:04.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.246+0000 7fb4f57ff700 1 --2- 172.21.15.72:0/1867862905 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4f00c7740 0x7fb4f00a99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:04.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.246+0000 7fb4f57ff700 1 -- 172.21.15.72:0/1867862905 >> 172.21.15.72:0/1867862905 conn(0x7fb4f00ab3f0 msgr2=0x7fb4f01497a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:04.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.246+0000 7fb4f57ff700 1 -- 172.21.15.72:0/1867862905 shutdown_connections 2023-07-27T20:35:04.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.246+0000 7fb4f57ff700 1 -- 172.21.15.72:0/1867862905 wait complete. 2023-07-27T20:35:04.251 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-07-27T20:35:04.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.464+0000 7f00e93ff700 1 Processor -- start 2023-07-27T20:35:04.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.464+0000 7f00e93ff700 1 -- start start 2023-07-27T20:35:04.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.465+0000 7f00e93ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f00e406ffc0 0x7f00e40c6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:04.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.465+0000 7f00e93ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e406d1c0 con 0x7f00e40c6c50 2023-07-27T20:35:04.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.465+0000 7f00e93ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e4155070 con 0x7f00e40c77c0 2023-07-27T20:35:04.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.465+0000 7f00e93ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00e406ce90 con 0x7f00e406ffc0 2023-07-27T20:35:04.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.465+0000 7f00e37fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f00e40c6c50 0x7f00e40c3e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60462/0 (socket says 172.21.15.72:60462) 2023-07-27T20:35:04.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.465+0000 7f00e37fe700 1 -- 172.21.15.72:0/1027415987 learned_addr learned my addr 172.21.15.72:0/1027415987 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:35:04.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.466+0000 7f00e27fc700 1 --2- 172.21.15.72:0/1027415987 >> v2:172.21.15.173:3300/0 conn(0x7f00e406ffc0 0x7f00e40c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:04.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.466+0000 7f00e1ffb700 1 -- 172.21.15.72:0/1027415987 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2639070835 0 0) 0x7f00e406d1c0 con 0x7f00e40c6c50 2023-07-27T20:35:04.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.466+0000 7f00e1ffb700 1 -- 172.21.15.72:0/1027415987 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00cc0035b0 con 0x7f00e40c6c50 2023-07-27T20:35:04.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.466+0000 7f00e27fc700 1 -- 172.21.15.72:0/1027415987 >> v1:172.21.15.173:6789/0 conn(0x7f00e40c77c0 legacy=0x7f00e4151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:04.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.466+0000 7f00e27fc700 1 -- 172.21.15.72:0/1027415987 >> v1:172.21.15.72:6789/0 conn(0x7f00e40c6c50 legacy=0x7f00e40c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:04.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.466+0000 7f00e1ffb700 1 -- 172.21.15.72:0/1027415987 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3299667817 0 0) 0x7f00cc0035b0 con 0x7f00e40c6c50 2023-07-27T20:35:04.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.466+0000 7f00e27fc700 1 -- 172.21.15.72:0/1027415987 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e4154d90 con 0x7f00e406ffc0 2023-07-27T20:35:04.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.466+0000 7f00e27fc700 1 --2- 172.21.15.72:0/1027415987 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00e406ffc0 0x7f00e40c6710 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f00d8009840 tx=0x7f00d8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6fbeb1aae233da2 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:04.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.467+0000 7f00e1ffb700 1 -- 172.21.15.72:0/1027415987 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc0019f0 con 0x7f00e406ffc0 2023-07-27T20:35:04.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.467+0000 7f00e1ffb700 1 -- 172.21.15.72:0/1027415987 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d8004030 con 0x7f00e406ffc0 2023-07-27T20:35:04.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.467+0000 7f00e1ffb700 1 -- 172.21.15.72:0/1027415987 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d80043c0 con 0x7f00e406ffc0 2023-07-27T20:35:04.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.467+0000 7f00e93ff700 1 -- 172.21.15.72:0/1027415987 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00e406ffc0 msgr2=0x7f00e40c6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:04.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.467+0000 7f00e93ff700 1 --2- 172.21.15.72:0/1027415987 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00e406ffc0 0x7f00e40c6710 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f00d8009840 tx=0x7f00d8009b50 comp rx=0 tx=0).stop 2023-07-27T20:35:04.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.467+0000 7f00e93ff700 1 -- 172.21.15.72:0/1027415987 shutdown_connections 2023-07-27T20:35:04.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.467+0000 7f00e93ff700 1 --2- 172.21.15.72:0/1027415987 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00e406ffc0 0x7f00e40c6710 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:04.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.467+0000 7f00e93ff700 1 -- 172.21.15.72:0/1027415987 >> 172.21.15.72:0/1027415987 conn(0x7f00e406a190 msgr2=0x7f00e406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:04.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.467+0000 7f00e93ff700 1 -- 172.21.15.72:0/1027415987 shutdown_connections 2023-07-27T20:35:04.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.467+0000 7f00e93ff700 1 -- 172.21.15.72:0/1027415987 wait complete. 2023-07-27T20:35:04.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.469+0000 7f00e93ff700 1 Processor -- start 2023-07-27T20:35:04.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.469+0000 7f00e93ff700 1 -- start start 2023-07-27T20:35:04.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.470+0000 7f00e93ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00e406ffc0 0x7f00e40be370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:04.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.470+0000 7f00e93ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00e40c6c50 0x7f00e40bfde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:04.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.470+0000 7f00e93ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00e40c77c0 0x7f00e40ad0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:04.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.470+0000 7f00e93ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e40bed40 con 0x7f00e40c6c50 2023-07-27T20:35:04.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.470+0000 7f00e93ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e40bf020 con 0x7f00e406ffc0 2023-07-27T20:35:04.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.470+0000 7f00e93ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e40bf300 con 0x7f00e40c77c0 2023-07-27T20:35:04.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.470+0000 7f00e27fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00e40c6c50 0x7f00e40bfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:04.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.470+0000 7f00e27fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00e40c6c50 0x7f00e40bfde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48358/0 (socket says 172.21.15.72:48358) 2023-07-27T20:35:04.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.470+0000 7f00e27fc700 1 -- 172.21.15.72:0/659252920 learned_addr learned my addr 172.21.15.72:0/659252920 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:35:04.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.470+0000 7f00e27fc700 1 -- 172.21.15.72:0/659252920 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00e40c77c0 msgr2=0x7f00e40ad0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:04.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.470+0000 7f00e27fc700 1 --2- 172.21.15.72:0/659252920 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00e40c77c0 0x7f00e40ad0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:04.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.470+0000 7f00e27fc700 1 -- 172.21.15.72:0/659252920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00e406ffc0 msgr2=0x7f00e40be370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:04.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.470+0000 7f00e27fc700 1 --2- 172.21.15.72:0/659252920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00e406ffc0 0x7f00e40be370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:04.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.470+0000 7f00e27fc700 1 -- 172.21.15.72:0/659252920 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d80094a0 con 0x7f00e40c6c50 2023-07-27T20:35:04.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.471+0000 7f00e27fc700 1 --2- 172.21.15.72:0/659252920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00e40c6c50 0x7f00e40bfde0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f00d8009b90 tx=0x7f00d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:04.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.471+0000 7f00cb7fe700 1 -- 172.21.15.72:0/659252920 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d8011830 con 0x7f00e40c6c50 2023-07-27T20:35:04.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.471+0000 7f00cb7fe700 1 -- 172.21.15.72:0/659252920 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d801f070 con 0x7f00e40c6c50 2023-07-27T20:35:04.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.471+0000 7f00e93ff700 1 -- 172.21.15.72:0/659252920 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e40bf5e0 con 0x7f00e40c6c50 2023-07-27T20:35:04.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.471+0000 7f00cb7fe700 1 -- 172.21.15.72:0/659252920 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d8011bd0 con 0x7f00e40c6c50 2023-07-27T20:35:04.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.471+0000 7f00e93ff700 1 -- 172.21.15.72:0/659252920 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e40ad620 con 0x7f00e40c6c50 2023-07-27T20:35:04.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.472+0000 7f00e93ff700 1 -- 172.21.15.72:0/659252920 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e40bfb00 con 0x7f00e40c6c50 2023-07-27T20:35:04.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.473+0000 7f00cb7fe700 1 -- 172.21.15.72:0/659252920 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f00d8011d30 con 0x7f00e40c6c50 2023-07-27T20:35:04.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.474+0000 7f00cb7fe700 1 --2- 172.21.15.72:0/659252920 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f00d006ace0 0x7f00d006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:04.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.474+0000 7f00cb7fe700 1 -- 172.21.15.72:0/659252920 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f00d8021070 con 0x7f00e40c6c50 2023-07-27T20:35:04.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.474+0000 7f00e2ffd700 1 --2- 172.21.15.72:0/659252920 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f00d006ace0 0x7f00d006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:04.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.475+0000 7f00e2ffd700 1 --2- 172.21.15.72:0/659252920 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f00d006ace0 0x7f00d006d1a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f00d4000f60 tx=0x7f00d4007a60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:04.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.478+0000 7f00cb7fe700 1 -- 172.21.15.72:0/659252920 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f00e40bfb00 con 0x7f00e40c6c50 2023-07-27T20:35:04.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.672+0000 7f00e93ff700 1 -- 172.21.15.72:0/659252920 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f00e40bfb00 con 0x7f00e40c6c50 2023-07-27T20:35:04.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.673+0000 7f00cb7fe700 1 -- 172.21.15.72:0/659252920 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v66) v1 ==== 101+0+11 (secure 0 0 0) 0x7f00e40bfb00 con 0x7f00e40c6c50 2023-07-27T20:35:04.660 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-27T20:35:04.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.675+0000 7f00e93ff700 1 -- 172.21.15.72:0/659252920 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f00d006ace0 msgr2=0x7f00d006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:04.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.675+0000 7f00e93ff700 1 --2- 172.21.15.72:0/659252920 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f00d006ace0 0x7f00d006d1a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f00d4000f60 tx=0x7f00d4007a60 comp rx=0 tx=0).stop 2023-07-27T20:35:04.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.675+0000 7f00e93ff700 1 -- 172.21.15.72:0/659252920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00e40c6c50 msgr2=0x7f00e40bfde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:04.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.675+0000 7f00e93ff700 1 --2- 172.21.15.72:0/659252920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00e40c6c50 0x7f00e40bfde0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f00d8009b90 tx=0x7f00d8004750 comp rx=0 tx=0).stop 2023-07-27T20:35:04.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.675+0000 7f00e93ff700 1 -- 172.21.15.72:0/659252920 shutdown_connections 2023-07-27T20:35:04.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.675+0000 7f00e93ff700 1 --2- 172.21.15.72:0/659252920 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f00d006ace0 0x7f00d006d1a0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:04.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.675+0000 7f00e93ff700 1 --2- 172.21.15.72:0/659252920 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00e40c77c0 0x7f00e40ad0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:04.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.675+0000 7f00e93ff700 1 --2- 172.21.15.72:0/659252920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00e406ffc0 0x7f00e40be370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:04.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.675+0000 7f00e93ff700 1 --2- 172.21.15.72:0/659252920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00e40c6c50 0x7f00e40bfde0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:04.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.675+0000 7f00e93ff700 1 -- 172.21.15.72:0/659252920 >> 172.21.15.72:0/659252920 conn(0x7f00e406a190 msgr2=0x7f00e406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:04.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.675+0000 7f00e93ff700 1 -- 172.21.15.72:0/659252920 shutdown_connections 2023-07-27T20:35:04.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.675+0000 7f00e93ff700 1 -- 172.21.15.72:0/659252920 wait complete. 2023-07-27T20:35:04.681 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-27T20:35:04.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.892+0000 7fe87cfff700 1 Processor -- start 2023-07-27T20:35:04.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.892+0000 7fe87cfff700 1 -- start start 2023-07-27T20:35:04.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.893+0000 7fe87cfff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe87813b2c0 0x7fe8780aa420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:04.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.893+0000 7fe87cfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe8780bfd90 0x7fe8780aa960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:04.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.893+0000 7fe87cfff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8780aaea0 con 0x7fe8780a83a0 2023-07-27T20:35:04.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.893+0000 7fe87cfff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8780a9620 con 0x7fe87813b2c0 2023-07-27T20:35:04.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.893+0000 7fe87cfff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe878155600 con 0x7fe8780bfd90 2023-07-27T20:35:04.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.894+0000 7fe876d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe8780a83a0 0x7fe8780a8820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60478/0 (socket says 172.21.15.72:60478) 2023-07-27T20:35:04.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.894+0000 7fe876d9d700 1 -- 172.21.15.72:0/4206529160 learned_addr learned my addr 172.21.15.72:0/4206529160 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:35:04.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.894+0000 7fe87659c700 1 --2- 172.21.15.72:0/4206529160 >> v2:172.21.15.173:3300/0 conn(0x7fe87813b2c0 0x7fe8780aa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:04.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.894+0000 7fe875d9b700 1 --2- 172.21.15.72:0/4206529160 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe8780bfd90 0x7fe8780aa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:04.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.894+0000 7fe87559a700 1 -- 172.21.15.72:0/4206529160 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 122343176 0 0) 0x7fe8780aaea0 con 0x7fe8780a83a0 2023-07-27T20:35:04.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.894+0000 7fe87559a700 1 -- 172.21.15.72:0/4206529160 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8600035b0 con 0x7fe8780a83a0 2023-07-27T20:35:04.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.894+0000 7fe87559a700 1 -- 172.21.15.72:0/4206529160 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 78781784 0 0) 0x7fe8600035b0 con 0x7fe8780a83a0 2023-07-27T20:35:04.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.894+0000 7fe87559a700 1 -- 172.21.15.72:0/4206529160 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe8780bfd90 msgr2=0x7fe8780aa960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:35:04.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.894+0000 7fe87559a700 1 --2- 172.21.15.72:0/4206529160 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe8780bfd90 0x7fe8780aa960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:04.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.894+0000 7fe87559a700 1 -- 172.21.15.72:0/4206529160 >> v2:172.21.15.173:3300/0 conn(0x7fe87813b2c0 msgr2=0x7fe8780aa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:35:04.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.894+0000 7fe87559a700 1 --2- 172.21.15.72:0/4206529160 >> v2:172.21.15.173:3300/0 conn(0x7fe87813b2c0 0x7fe8780aa420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:04.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.894+0000 7fe87559a700 1 -- 172.21.15.72:0/4206529160 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe878155320 con 0x7fe8780a83a0 2023-07-27T20:35:04.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.894+0000 7fe87559a700 1 -- 172.21.15.72:0/4206529160 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7fe8700019f0 con 0x7fe8780a83a0 2023-07-27T20:35:04.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.894+0000 7fe87659c700 1 --2- 172.21.15.72:0/4206529160 >> v2:172.21.15.173:3300/0 conn(0x7fe87813b2c0 0x7fe8780aa420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:35:04.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.894+0000 7fe87559a700 1 -- 172.21.15.72:0/4206529160 >> v1:172.21.15.72:6789/0 conn(0x7fe8780a83a0 legacy=0x7fe8780a8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:04.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.894+0000 7fe87559a700 1 --2- 172.21.15.72:0/4206529160 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe860003a00 0x7fe860003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:04.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.894+0000 7fe87559a700 1 --2- 172.21.15.72:0/4206529160 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe8780bfd90 0x7fe860004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:04.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.894+0000 7fe87559a700 1 --2- 172.21.15.72:0/4206529160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe860004d90 0x7fe860005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:04.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.894+0000 7fe87559a700 1 -- 172.21.15.72:0/4206529160 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8780a9620 con 0x7fe860004d90 2023-07-27T20:35:04.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.894+0000 7fe87559a700 1 -- 172.21.15.72:0/4206529160 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe878155600 con 0x7fe860003a00 2023-07-27T20:35:04.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.894+0000 7fe87559a700 1 -- 172.21.15.72:0/4206529160 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe86000ba10 con 0x7fe8780bfd90 2023-07-27T20:35:04.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.895+0000 7fe87659c700 1 --2- 172.21.15.72:0/4206529160 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe860003a00 0x7fe860003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:04.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.895+0000 7fe876d9d700 1 --2- 172.21.15.72:0/4206529160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe860004d90 0x7fe860005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:04.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.895+0000 7fe875d9b700 1 --2- 172.21.15.72:0/4206529160 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe8780bfd90 0x7fe860004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:04.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.895+0000 7fe87659c700 1 -- 172.21.15.72:0/4206529160 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe8780bfd90 msgr2=0x7fe860004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:35:04.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.895+0000 7fe87659c700 1 --2- 172.21.15.72:0/4206529160 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe8780bfd90 0x7fe860004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:04.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.895+0000 7fe87659c700 1 -- 172.21.15.72:0/4206529160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe860004d90 msgr2=0x7fe860005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:35:04.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.895+0000 7fe87659c700 1 --2- 172.21.15.72:0/4206529160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe860004d90 0x7fe860005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:04.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.895+0000 7fe87659c700 1 -- 172.21.15.72:0/4206529160 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8600035b0 con 0x7fe860003a00 2023-07-27T20:35:04.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.895+0000 7fe87659c700 1 --2- 172.21.15.72:0/4206529160 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe860003a00 0x7fe860003e20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe868009d30 tx=0x7fe860005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0ba630b5691f43c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:04.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.896+0000 7fe87559a700 1 -- 172.21.15.72:0/4206529160 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe868009e80 con 0x7fe860003a00 2023-07-27T20:35:04.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.896+0000 7fe87559a700 1 -- 172.21.15.72:0/4206529160 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86800e9a0 con 0x7fe860003a00 2023-07-27T20:35:04.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.896+0000 7fe87559a700 1 -- 172.21.15.72:0/4206529160 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86800ed30 con 0x7fe860003a00 2023-07-27T20:35:04.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.896+0000 7fe87cfff700 1 -- 172.21.15.72:0/4206529160 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe860003a00 msgr2=0x7fe860003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:04.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.896+0000 7fe87cfff700 1 --2- 172.21.15.72:0/4206529160 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe860003a00 0x7fe860003e20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe868009d30 tx=0x7fe860005880 comp rx=0 tx=0).stop 2023-07-27T20:35:04.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.896+0000 7fe876d9d700 1 -- 172.21.15.72:0/4206529160 reap_dead start 2023-07-27T20:35:04.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.896+0000 7fe87cfff700 1 -- 172.21.15.72:0/4206529160 shutdown_connections 2023-07-27T20:35:04.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.896+0000 7fe87cfff700 1 -- 172.21.15.72:0/4206529160 >> 172.21.15.72:0/4206529160 conn(0x7fe87806a190 msgr2=0x7fe87806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:04.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.896+0000 7fe87cfff700 1 -- 172.21.15.72:0/4206529160 shutdown_connections 2023-07-27T20:35:04.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.896+0000 7fe87cfff700 1 -- 172.21.15.72:0/4206529160 wait complete. 2023-07-27T20:35:04.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.899+0000 7fe87cfff700 1 Processor -- start 2023-07-27T20:35:04.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.899+0000 7fe87cfff700 1 -- start start 2023-07-27T20:35:04.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.900+0000 7fe87cfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe860003a00 0x7fe8781eaa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:04.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.900+0000 7fe87cfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe878150f00 0x7fe878150720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:04.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.900+0000 7fe87cfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8780c2660 0x7fe878154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:04.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.900+0000 7fe87cfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8780c1ab0 con 0x7fe860003a00 2023-07-27T20:35:04.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.900+0000 7fe87cfff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe878150290 con 0x7fe8780c2660 2023-07-27T20:35:04.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.900+0000 7fe87cfff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8780c1840 con 0x7fe878150f00 2023-07-27T20:35:04.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.900+0000 7fe87659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe860003a00 0x7fe8781eaa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:04.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.900+0000 7fe87659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe860003a00 0x7fe8781eaa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48372/0 (socket says 172.21.15.72:48372) 2023-07-27T20:35:04.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.900+0000 7fe87659c700 1 -- 172.21.15.72:0/2294867722 learned_addr learned my addr 172.21.15.72:0/2294867722 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:35:04.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.900+0000 7fe875d9b700 1 --2- 172.21.15.72:0/2294867722 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe878150f00 0x7fe878150720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:04.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.900+0000 7fe876d9d700 1 --2- 172.21.15.72:0/2294867722 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8780c2660 0x7fe878154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:04.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.900+0000 7fe87659c700 1 -- 172.21.15.72:0/2294867722 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe878150f00 msgr2=0x7fe878150720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:04.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.900+0000 7fe87659c700 1 --2- 172.21.15.72:0/2294867722 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe878150f00 0x7fe878150720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:04.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.900+0000 7fe87659c700 1 -- 172.21.15.72:0/2294867722 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8780c2660 msgr2=0x7fe878154510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:04.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.900+0000 7fe87659c700 1 --2- 172.21.15.72:0/2294867722 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8780c2660 0x7fe878154510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:04.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.900+0000 7fe87659c700 1 -- 172.21.15.72:0/2294867722 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8781eafa0 con 0x7fe860003a00 2023-07-27T20:35:04.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.900+0000 7fe876d9d700 1 --2- 172.21.15.72:0/2294867722 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8780c2660 0x7fe878154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:35:04.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.901+0000 7fe87659c700 1 --2- 172.21.15.72:0/2294867722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe860003a00 0x7fe8781eaa60 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fe86800e790 tx=0x7fe8680047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:04.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.901+0000 7fe866ffd700 1 -- 172.21.15.72:0/2294867722 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe868006e60 con 0x7fe860003a00 2023-07-27T20:35:04.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.901+0000 7fe866ffd700 1 -- 172.21.15.72:0/2294867722 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe868003ad0 con 0x7fe860003a00 2023-07-27T20:35:04.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.901+0000 7fe87cfff700 1 -- 172.21.15.72:0/2294867722 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe87814fc40 con 0x7fe860003a00 2023-07-27T20:35:04.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.901+0000 7fe866ffd700 1 -- 172.21.15.72:0/2294867722 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe868003e80 con 0x7fe860003a00 2023-07-27T20:35:04.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.901+0000 7fe87cfff700 1 -- 172.21.15.72:0/2294867722 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe87806d220 con 0x7fe860003a00 2023-07-27T20:35:04.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.902+0000 7fe87cfff700 1 -- 172.21.15.72:0/2294867722 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe878074310 con 0x7fe860003a00 2023-07-27T20:35:04.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.903+0000 7fe866ffd700 1 -- 172.21.15.72:0/2294867722 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe868013470 con 0x7fe860003a00 2023-07-27T20:35:04.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.904+0000 7fe866ffd700 1 --2- 172.21.15.72:0/2294867722 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe85806ace0 0x7fe85806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:04.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.904+0000 7fe866ffd700 1 -- 172.21.15.72:0/2294867722 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7238+0+0 (secure 0 0 0) 0x7fe86808b340 con 0x7fe860003a00 2023-07-27T20:35:04.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.904+0000 7fe875d9b700 1 --2- 172.21.15.72:0/2294867722 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe85806ace0 0x7fe85806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:04.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.905+0000 7fe875d9b700 1 --2- 172.21.15.72:0/2294867722 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe85806ace0 0x7fe85806d1a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe87806e1d0 tx=0x7fe86c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:04.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:04.908+0000 7fe866ffd700 1 -- 172.21.15.72:0/2294867722 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe868055f40 con 0x7fe860003a00 2023-07-27T20:35:05.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.117+0000 7fe87cfff700 1 -- 172.21.15.72:0/2294867722 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe8780c1ab0 con 0x7fe860003a00 2023-07-27T20:35:05.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.117+0000 7fe866ffd700 1 -- 172.21.15.72:0/2294867722 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v66) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe868059560 con 0x7fe860003a00 2023-07-27T20:35:05.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.119+0000 7fe87cfff700 1 -- 172.21.15.72:0/2294867722 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe85806ace0 msgr2=0x7fe85806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:05.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.119+0000 7fe87cfff700 1 --2- 172.21.15.72:0/2294867722 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe85806ace0 0x7fe85806d1a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe87806e1d0 tx=0x7fe86c008040 comp rx=0 tx=0).stop 2023-07-27T20:35:05.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.119+0000 7fe87cfff700 1 -- 172.21.15.72:0/2294867722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe860003a00 msgr2=0x7fe8781eaa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:05.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.119+0000 7fe87cfff700 1 --2- 172.21.15.72:0/2294867722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe860003a00 0x7fe8781eaa60 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fe86800e790 tx=0x7fe8680047c0 comp rx=0 tx=0).stop 2023-07-27T20:35:05.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.119+0000 7fe87cfff700 1 -- 172.21.15.72:0/2294867722 shutdown_connections 2023-07-27T20:35:05.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.119+0000 7fe87cfff700 1 --2- 172.21.15.72:0/2294867722 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8780c2660 0x7fe878154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:05.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.119+0000 7fe87cfff700 1 --2- 172.21.15.72:0/2294867722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe860003a00 0x7fe8781eaa60 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:05.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.119+0000 7fe87cfff700 1 --2- 172.21.15.72:0/2294867722 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe85806ace0 0x7fe85806d1a0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:05.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.119+0000 7fe87cfff700 1 --2- 172.21.15.72:0/2294867722 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe878150f00 0x7fe878150720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:05.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.119+0000 7fe87cfff700 1 -- 172.21.15.72:0/2294867722 >> 172.21.15.72:0/2294867722 conn(0x7fe87806a190 msgr2=0x7fe878138a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:05.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.120+0000 7fe87cfff700 1 -- 172.21.15.72:0/2294867722 shutdown_connections 2023-07-27T20:35:05.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.120+0000 7fe87cfff700 1 -- 172.21.15.72:0/2294867722 wait complete. 2023-07-27T20:35:05.109 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-07-27T20:35:05.124 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-07-27T20:35:05.125 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-27T20:35:05.174 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T20:35:05.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.385+0000 7f82619ff700 1 Processor -- start 2023-07-27T20:35:05.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.385+0000 7f82619ff700 1 -- start start 2023-07-27T20:35:05.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.386+0000 7f82619ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f825c06b150 0x7f825c0c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:05.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.386+0000 7f82619ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f825c06b710 con 0x7f825c0c4400 2023-07-27T20:35:05.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.386+0000 7f82619ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f825c06b9f0 con 0x7f825c1549f0 2023-07-27T20:35:05.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.386+0000 7f82619ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f825c1545d0 con 0x7f825c06b150 2023-07-27T20:35:05.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.386+0000 7f825a7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f825c06b150 0x7f825c0c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:05.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.386+0000 7f825a7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f825c06b150 0x7f825c0c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48382/0 (socket says 172.21.15.72:48382) 2023-07-27T20:35:05.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.386+0000 7f825a7fc700 1 -- 172.21.15.72:0/2872919509 learned_addr learned my addr 172.21.15.72:0/2872919509 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:35:05.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.387+0000 7f825a7fc700 1 -- 172.21.15.72:0/2872919509 >> v1:172.21.15.173:6789/0 conn(0x7f825c1549f0 legacy=0x7f825c1514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:05.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.387+0000 7f825a7fc700 1 -- 172.21.15.72:0/2872919509 >> v1:172.21.15.72:6789/0 conn(0x7f825c0c4400 legacy=0x7f825c0c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:05.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.387+0000 7f825a7fc700 1 -- 172.21.15.72:0/2872919509 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f825c06bcd0 con 0x7f825c06b150 2023-07-27T20:35:05.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.387+0000 7f8259ffb700 1 -- 172.21.15.72:0/2872919509 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2195775803 0 0) 0x7f825c06b710 con 0x7f825c0c4400 2023-07-27T20:35:05.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.387+0000 7f825a7fc700 1 --2- 172.21.15.72:0/2872919509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f825c06b150 0x7f825c0c7710 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f82500098f0 tx=0x7f8250009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709e51ad1190dec5 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:05.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.387+0000 7f8259ffb700 1 -- 172.21.15.72:0/2872919509 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825000b8a0 con 0x7f825c06b150 2023-07-27T20:35:05.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.387+0000 7f8259ffb700 1 -- 172.21.15.72:0/2872919509 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825000ba00 con 0x7f825c06b150 2023-07-27T20:35:05.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.387+0000 7f8259ffb700 1 -- 172.21.15.72:0/2872919509 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825000bd90 con 0x7f825c06b150 2023-07-27T20:35:05.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.388+0000 7f82619ff700 1 -- 172.21.15.72:0/2872919509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f825c06b150 msgr2=0x7f825c0c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:05.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.388+0000 7f82619ff700 1 --2- 172.21.15.72:0/2872919509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f825c06b150 0x7f825c0c7710 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f82500098f0 tx=0x7f8250009c00 comp rx=0 tx=0).stop 2023-07-27T20:35:05.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.388+0000 7f82619ff700 1 -- 172.21.15.72:0/2872919509 shutdown_connections 2023-07-27T20:35:05.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.388+0000 7f82619ff700 1 --2- 172.21.15.72:0/2872919509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f825c06b150 0x7f825c0c7710 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:05.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.388+0000 7f82619ff700 1 -- 172.21.15.72:0/2872919509 >> 172.21.15.72:0/2872919509 conn(0x7f825c0ab300 msgr2=0x7f825c0ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:05.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.388+0000 7f82619ff700 1 -- 172.21.15.72:0/2872919509 shutdown_connections 2023-07-27T20:35:05.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.388+0000 7f82619ff700 1 -- 172.21.15.72:0/2872919509 wait complete. 2023-07-27T20:35:05.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.390+0000 7f82619ff700 1 Processor -- start 2023-07-27T20:35:05.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.390+0000 7f82619ff700 1 -- start start 2023-07-27T20:35:05.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.391+0000 7f82619ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f825c06b150 0x7f825c1e98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:05.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.391+0000 7f82619ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f825c0c4400 0x7f825c14a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:05.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.391+0000 7f82619ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f825c1549f0 0x7f825c0ae810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:05.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.391+0000 7f82619ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c0c3830 con 0x7f825c1549f0 2023-07-27T20:35:05.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.391+0000 7f82619ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c0bf700 con 0x7f825c06b150 2023-07-27T20:35:05.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.391+0000 7f82619ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f825c1e9e00 con 0x7f825c0c4400 2023-07-27T20:35:05.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.391+0000 7f825b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f825c1549f0 0x7f825c0ae810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:05.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.392+0000 7f825b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f825c1549f0 0x7f825c0ae810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48388/0 (socket says 172.21.15.72:48388) 2023-07-27T20:35:05.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.392+0000 7f825b7fe700 1 -- 172.21.15.72:0/3562061846 learned_addr learned my addr 172.21.15.72:0/3562061846 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:35:05.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.392+0000 7f825a7fc700 1 --2- 172.21.15.72:0/3562061846 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f825c0c4400 0x7f825c14a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:05.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.392+0000 7f825affd700 1 --2- 172.21.15.72:0/3562061846 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f825c06b150 0x7f825c1e98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:05.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.392+0000 7f825b7fe700 1 -- 172.21.15.72:0/3562061846 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f825c0c4400 msgr2=0x7f825c14a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:05.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.392+0000 7f825b7fe700 1 --2- 172.21.15.72:0/3562061846 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f825c0c4400 0x7f825c14a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:05.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.392+0000 7f825b7fe700 1 -- 172.21.15.72:0/3562061846 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f825c06b150 msgr2=0x7f825c1e98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:05.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.392+0000 7f825b7fe700 1 --2- 172.21.15.72:0/3562061846 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f825c06b150 0x7f825c1e98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:05.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.392+0000 7f825b7fe700 1 -- 172.21.15.72:0/3562061846 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8250009550 con 0x7f825c1549f0 2023-07-27T20:35:05.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.392+0000 7f825b7fe700 1 --2- 172.21.15.72:0/3562061846 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f825c1549f0 0x7f825c0ae810 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f825400cc80 tx=0x7f825400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:05.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.392+0000 7f8243fff700 1 -- 172.21.15.72:0/3562061846 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825400ad40 con 0x7f825c1549f0 2023-07-27T20:35:05.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.392+0000 7f8243fff700 1 -- 172.21.15.72:0/3562061846 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825400ce80 con 0x7f825c1549f0 2023-07-27T20:35:05.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.392+0000 7f8243fff700 1 -- 172.21.15.72:0/3562061846 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825400aea0 con 0x7f825c1549f0 2023-07-27T20:35:05.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.392+0000 7f82619ff700 1 -- 172.21.15.72:0/3562061846 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f825c0bff80 con 0x7f825c1549f0 2023-07-27T20:35:05.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.393+0000 7f82619ff700 1 -- 172.21.15.72:0/3562061846 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f825c14f410 con 0x7f825c1549f0 2023-07-27T20:35:05.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.394+0000 7f82619ff700 1 -- 172.21.15.72:0/3562061846 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f825c0bdfb0 con 0x7f825c1549f0 2023-07-27T20:35:05.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.394+0000 7f8243fff700 1 -- 172.21.15.72:0/3562061846 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8254003c40 con 0x7f825c1549f0 2023-07-27T20:35:05.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.395+0000 7f8243fff700 1 --2- 172.21.15.72:0/3562061846 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f824806ace0 0x7f824806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:05.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.395+0000 7f8243fff700 1 -- 172.21.15.72:0/3562061846 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f8254089a30 con 0x7f825c1549f0 2023-07-27T20:35:05.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.396+0000 7f825affd700 1 --2- 172.21.15.72:0/3562061846 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f824806ace0 0x7f824806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:05.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.397+0000 7f825affd700 1 --2- 172.21.15.72:0/3562061846 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f824806ace0 0x7f824806d1a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f825c0bd720 tx=0x7f824c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:05.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.399+0000 7f8243fff700 1 -- 172.21.15.72:0/3562061846 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8254054630 con 0x7f825c1549f0 2023-07-27T20:35:05.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.593+0000 7f82619ff700 1 -- 172.21.15.72:0/3562061846 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f825c0c0110 con 0x7f825c1549f0 2023-07-27T20:35:05.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.595+0000 7f8243fff700 1 -- 172.21.15.72:0/3562061846 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+22261 (secure 0 0 0) 0x7f8254057c50 con 0x7f825c1549f0 2023-07-27T20:35:05.583 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-27T20:35:05.583 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":66,"fsid":"173d349e-573f-4bc7-9f3a-2e1b4345c501","created":"2023-07-27T20:31:01.244409+0000","modified":"2023-07-27T20:34:52.125660+0000","last_up_change":"2023-07-27T20:31:13.735306+0000","last_in_change":"2023-07-27T20:31:04.712970+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-27T20:31:14.581785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T20:31:21.077941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-07-27T20:34:31.480063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-07-27T20:34:32.755579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_metadata","create_time":"2023-07-27T20:34:48.900422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs2_data","create_time":"2023-07-27T20:34:49.633712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9a156f94-04f1-4ea4-8c5d-18c725fb149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6821","nonce":1712741452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6826","nonce":1712741452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6831","nonce":1712741452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1712741452},{"type":"v1","addr":"172.21.15.72:6829","nonce":1712741452}]},"public_addr":"172.21.15.72:6821/1712741452","cluster_addr":"172.21.15.72:6826/1712741452","heartbeat_back_addr":"172.21.15.72:6831/1712741452","heartbeat_front_addr":"172.21.15.72:6829/1712741452","state":["exists","up"]},{"osd":1,"uuid":"bc0cda62-2569-42b5-bb6f-c2916a9199e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6801","nonce":3619214830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6803","nonce":3619214830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6810","nonce":3619214830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3619214830},{"type":"v1","addr":"172.21.15.72:6806","nonce":3619214830}]},"public_addr":"172.21.15.72:6801/3619214830","cluster_addr":"172.21.15.72:6803/3619214830","heartbeat_back_addr":"172.21.15.72:6810/3619214830","heartbeat_front_addr":"172.21.15.72:6806/3619214830","state":["exists","up"]},{"osd":2,"uuid":"dc042e43-6b4a-424b-afb1-2e96e3c7136a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6807","nonce":2307669444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6811","nonce":2307669444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6815","nonce":2307669444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2307669444},{"type":"v1","addr":"172.21.15.72:6813","nonce":2307669444}]},"public_addr":"172.21.15.72:6807/2307669444","cluster_addr":"172.21.15.72:6811/2307669444","heartbeat_back_addr":"172.21.15.72:6815/2307669444","heartbeat_front_addr":"172.21.15.72:6813/2307669444","state":["exists","up"]},{"osd":3,"uuid":"380f0099-5c43-41cb-97ab-5a326bb3b42e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6817","nonce":2537282190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6820","nonce":2537282190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6827","nonce":2537282190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2537282190},{"type":"v1","addr":"172.21.15.72:6823","nonce":2537282190}]},"public_addr":"172.21.15.72:6817/2537282190","cluster_addr":"172.21.15.72:6820/2537282190","heartbeat_back_addr":"172.21.15.72:6827/2537282190","heartbeat_front_addr":"172.21.15.72:6823/2537282190","state":["exists","up"]},{"osd":4,"uuid":"cd446a99-81c1-4dc2-9bd5-bea127288d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6808","nonce":3445931157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6811","nonce":3445931157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6815","nonce":3445931157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3445931157},{"type":"v1","addr":"172.21.15.173:6813","nonce":3445931157}]},"public_addr":"172.21.15.173:6808/3445931157","cluster_addr":"172.21.15.173:6811/3445931157","heartbeat_back_addr":"172.21.15.173:6815/3445931157","heartbeat_front_addr":"172.21.15.173:6813/3445931157","state":["exists","up"]},{"osd":5,"uuid":"1d11c1a0-af5b-4e77-bd23-ce4b09ce1dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6801","nonce":1077261990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6803","nonce":1077261990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6809","nonce":1077261990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1077261990},{"type":"v1","addr":"172.21.15.173:6805","nonce":1077261990}]},"public_addr":"172.21.15.173:6801/1077261990","cluster_addr":"172.21.15.173:6803/1077261990","heartbeat_back_addr":"172.21.15.173:6809/1077261990","heartbeat_front_addr":"172.21.15.173:6805/1077261990","state":["exists","up"]},{"osd":6,"uuid":"ed072ddf-60c6-4166-a82c-88152409c957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6817","nonce":898998598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6819","nonce":898998598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6823","nonce":898998598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":898998598},{"type":"v1","addr":"172.21.15.173:6821","nonce":898998598}]},"public_addr":"172.21.15.173:6817/898998598","cluster_addr":"172.21.15.173:6819/898998598","heartbeat_back_addr":"172.21.15.173:6823/898998598","heartbeat_front_addr":"172.21.15.173:6821/898998598","state":["exists","up"]},{"osd":7,"uuid":"b8281df4-63c4-439c-a11f-9f32573463b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6825","nonce":3471340321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6827","nonce":3471340321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6831","nonce":3471340321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3471340321},{"type":"v1","addr":"172.21.15.173:6829","nonce":3471340321}]},"public_addr":"172.21.15.173:6825/3471340321","cluster_addr":"172.21.15.173:6827/3471340321","heartbeat_back_addr":"172.21.15.173:6831/3471340321","heartbeat_front_addr":"172.21.15.173:6829/3471340321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.074588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.086622+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.303535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.028489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:09.967353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.244120+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.035200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T20:31:10.358780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T20:35:05.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.597+0000 7f82619ff700 1 -- 172.21.15.72:0/3562061846 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f824806ace0 msgr2=0x7f824806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:05.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.597+0000 7f82619ff700 1 --2- 172.21.15.72:0/3562061846 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f824806ace0 0x7f824806d1a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f825c0bd720 tx=0x7f824c009040 comp rx=0 tx=0).stop 2023-07-27T20:35:05.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.597+0000 7f82619ff700 1 -- 172.21.15.72:0/3562061846 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f825c1549f0 msgr2=0x7f825c0ae810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:05.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.597+0000 7f82619ff700 1 --2- 172.21.15.72:0/3562061846 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f825c1549f0 0x7f825c0ae810 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f825400cc80 tx=0x7f825400a340 comp rx=0 tx=0).stop 2023-07-27T20:35:05.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.597+0000 7f82619ff700 1 -- 172.21.15.72:0/3562061846 shutdown_connections 2023-07-27T20:35:05.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.597+0000 7f82619ff700 1 --2- 172.21.15.72:0/3562061846 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f825c1549f0 0x7f825c0ae810 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:05.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.597+0000 7f82619ff700 1 --2- 172.21.15.72:0/3562061846 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f825c06b150 0x7f825c1e98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:05.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.597+0000 7f82619ff700 1 --2- 172.21.15.72:0/3562061846 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f824806ace0 0x7f824806d1a0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:05.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.597+0000 7f82619ff700 1 --2- 172.21.15.72:0/3562061846 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f825c0c4400 0x7f825c14a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:05.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.597+0000 7f82619ff700 1 -- 172.21.15.72:0/3562061846 >> 172.21.15.72:0/3562061846 conn(0x7f825c0ab300 msgr2=0x7f825c0c73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:05.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.598+0000 7f82619ff700 1 -- 172.21.15.72:0/3562061846 shutdown_connections 2023-07-27T20:35:05.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.598+0000 7f82619ff700 1 -- 172.21.15.72:0/3562061846 wait complete. 2023-07-27T20:35:05.603 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-27T20:31:14.581785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T20:31:21.077941+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T20:34:31.480063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T20:34:32.755579+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-07-27T20:34:48.900422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs2_data', 'create_time': '2023-07-27T20:34:49.633712+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-27T20:35:05.604 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-27T20:35:05.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.814+0000 7f4edebff700 1 Processor -- start 2023-07-27T20:35:05.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.815+0000 7f4edebff700 1 -- start start 2023-07-27T20:35:05.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.816+0000 7f4edebff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4ed814aab0 0x7f4ed8154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:05.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.816+0000 7f4edebff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed80c7c50 con 0x7f4ed806c1d0 2023-07-27T20:35:05.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.816+0000 7f4edebff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed806bd40 con 0x7f4ed80c7740 2023-07-27T20:35:05.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.816+0000 7f4edebff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed80c62f0 con 0x7f4ed814aab0 2023-07-27T20:35:05.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.816+0000 7f4edd19c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4ed806c1d0 0x7f4ed806c5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60498/0 (socket says 172.21.15.72:60498) 2023-07-27T20:35:05.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.816+0000 7f4edd19c700 1 -- 172.21.15.72:0/1423795505 learned_addr learned my addr 172.21.15.72:0/1423795505 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:35:05.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.816+0000 7f4edc99b700 1 --2- 172.21.15.72:0/1423795505 >> v2:172.21.15.173:3300/0 conn(0x7f4ed814aab0 0x7f4ed8154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:05.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.816+0000 7f4ed77fe700 1 -- 172.21.15.72:0/1423795505 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2570336117 0 0) 0x7f4ed80c7c50 con 0x7f4ed806c1d0 2023-07-27T20:35:05.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.816+0000 7f4ed77fe700 1 -- 172.21.15.72:0/1423795505 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ec80035b0 con 0x7f4ed806c1d0 2023-07-27T20:35:05.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.817+0000 7f4ed77fe700 1 -- 172.21.15.72:0/1423795505 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2043868821 0 0) 0x7f4ed806bd40 con 0x7f4ed80c7740 2023-07-27T20:35:05.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.817+0000 7f4ed77fe700 1 -- 172.21.15.72:0/1423795505 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ed80c7c50 con 0x7f4ed80c7740 2023-07-27T20:35:05.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.817+0000 7f4ed77fe700 1 -- 172.21.15.72:0/1423795505 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3672659542 0 0) 0x7f4ec80035b0 con 0x7f4ed806c1d0 2023-07-27T20:35:05.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.817+0000 7f4ed77fe700 1 -- 172.21.15.72:0/1423795505 >> v2:172.21.15.173:3300/0 conn(0x7f4ed814aab0 msgr2=0x7f4ed8154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:35:05.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.817+0000 7f4ed77fe700 1 --2- 172.21.15.72:0/1423795505 >> v2:172.21.15.173:3300/0 conn(0x7f4ed814aab0 0x7f4ed8154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:05.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.817+0000 7f4ed77fe700 1 -- 172.21.15.72:0/1423795505 >> v1:172.21.15.173:6789/0 conn(0x7f4ed80c7740 legacy=0x7f4ed80c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:05.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.817+0000 7f4ed77fe700 1 -- 172.21.15.72:0/1423795505 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed806cd00 con 0x7f4ed806c1d0 2023-07-27T20:35:05.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.817+0000 7f4ed77fe700 1 -- 172.21.15.72:0/1423795505 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7f4ed00019f0 con 0x7f4ed806c1d0 2023-07-27T20:35:05.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.817+0000 7f4ed77fe700 1 -- 172.21.15.72:0/1423795505 >> v1:172.21.15.72:6789/0 conn(0x7f4ed806c1d0 legacy=0x7f4ed806c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:05.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.817+0000 7f4ed77fe700 1 --2- 172.21.15.72:0/1423795505 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4ec8003b90 0x7f4ec8003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:05.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.817+0000 7f4ed77fe700 1 --2- 172.21.15.72:0/1423795505 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ec8004850 0x7f4ec8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:05.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.817+0000 7f4ed77fe700 1 --2- 172.21.15.72:0/1423795505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ec8005210 0x7f4ec800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:05.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.817+0000 7f4ed77fe700 1 -- 172.21.15.72:0/1423795505 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed80c62f0 con 0x7f4ec8005210 2023-07-27T20:35:05.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.817+0000 7f4ed77fe700 1 -- 172.21.15.72:0/1423795505 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec800c090 con 0x7f4ec8004850 2023-07-27T20:35:05.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.817+0000 7f4ed77fe700 1 -- 172.21.15.72:0/1423795505 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec800c250 con 0x7f4ec8003b90 2023-07-27T20:35:05.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.817+0000 7f4edd19c700 1 --2- 172.21.15.72:0/1423795505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ec8005210 0x7f4ec800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:05.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.817+0000 7f4edc99b700 1 --2- 172.21.15.72:0/1423795505 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4ec8003b90 0x7f4ec8003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:05.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.817+0000 7f4ed7fff700 1 --2- 172.21.15.72:0/1423795505 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ec8004850 0x7f4ec8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:05.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.817+0000 7f4edd19c700 1 -- 172.21.15.72:0/1423795505 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4ec8003b90 msgr2=0x7f4ec8003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:35:05.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.817+0000 7f4edd19c700 1 --2- 172.21.15.72:0/1423795505 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4ec8003b90 0x7f4ec8003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:05.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.817+0000 7f4edd19c700 1 -- 172.21.15.72:0/1423795505 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ec8004850 msgr2=0x7f4ec8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:35:05.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.817+0000 7f4edd19c700 1 --2- 172.21.15.72:0/1423795505 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ec8004850 0x7f4ec8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:05.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.818+0000 7f4edd19c700 1 -- 172.21.15.72:0/1423795505 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec80035b0 con 0x7f4ec8005210 2023-07-27T20:35:05.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.818+0000 7f4edd19c700 1 -- 172.21.15.72:0/1423795505 reap_dead start 2023-07-27T20:35:05.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.818+0000 7f4edd19c700 1 --2- 172.21.15.72:0/1423795505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ec8005210 0x7f4ec800ba10 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f4ed000a7b0 tx=0x7f4ec8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6983a05c5b1d64b7 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:05.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.818+0000 7f4ed77fe700 1 -- 172.21.15.72:0/1423795505 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed0012600 con 0x7f4ec8005210 2023-07-27T20:35:05.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.818+0000 7f4ed77fe700 1 -- 172.21.15.72:0/1423795505 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed00127a0 con 0x7f4ec8005210 2023-07-27T20:35:05.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.818+0000 7f4ed77fe700 1 -- 172.21.15.72:0/1423795505 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed0012b50 con 0x7f4ec8005210 2023-07-27T20:35:05.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.818+0000 7f4edebff700 1 -- 172.21.15.72:0/1423795505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ec8005210 msgr2=0x7f4ec800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:05.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.818+0000 7f4edebff700 1 --2- 172.21.15.72:0/1423795505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ec8005210 0x7f4ec800ba10 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f4ed000a7b0 tx=0x7f4ec8005880 comp rx=0 tx=0).stop 2023-07-27T20:35:05.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.818+0000 7f4edebff700 1 -- 172.21.15.72:0/1423795505 shutdown_connections 2023-07-27T20:35:05.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.818+0000 7f4edebff700 1 --2- 172.21.15.72:0/1423795505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ec8005210 0x7f4ec800ba10 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:05.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.818+0000 7f4edebff700 1 -- 172.21.15.72:0/1423795505 >> 172.21.15.72:0/1423795505 conn(0x7f4ed80ab3f0 msgr2=0x7f4ed80ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:05.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.819+0000 7f4edebff700 1 -- 172.21.15.72:0/1423795505 shutdown_connections 2023-07-27T20:35:05.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.819+0000 7f4edebff700 1 -- 172.21.15.72:0/1423795505 wait complete. 2023-07-27T20:35:05.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.820+0000 7f4edebff700 1 Processor -- start 2023-07-27T20:35:05.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.820+0000 7f4edebff700 1 -- start start 2023-07-27T20:35:05.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.821+0000 7f4edebff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ec8005210 0x7f4ed81eca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:05.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.821+0000 7f4edebff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ed81ecf40 0x7f4ed80c0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:05.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.821+0000 7f4edebff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4ed81580d0 0x7f4ed80c0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:05.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.821+0000 7f4edebff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed81ed6d0 con 0x7f4ec8005210 2023-07-27T20:35:05.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.821+0000 7f4edebff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed80c3490 con 0x7f4ed81ecf40 2023-07-27T20:35:05.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.821+0000 7f4edebff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed80c3770 con 0x7f4ed81580d0 2023-07-27T20:35:05.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.821+0000 7f4edc99b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ec8005210 0x7f4ed81eca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:05.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.821+0000 7f4edc99b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ec8005210 0x7f4ed81eca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48398/0 (socket says 172.21.15.72:48398) 2023-07-27T20:35:05.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.821+0000 7f4edc99b700 1 -- 172.21.15.72:0/1110975822 learned_addr learned my addr 172.21.15.72:0/1110975822 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:35:05.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.822+0000 7f4edc99b700 1 -- 172.21.15.72:0/1110975822 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4ed81580d0 msgr2=0x7f4ed80c0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:05.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.822+0000 7f4ed7fff700 1 --2- 172.21.15.72:0/1110975822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ed81ecf40 0x7f4ed80c0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:05.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.822+0000 7f4edd19c700 1 --2- 172.21.15.72:0/1110975822 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4ed81580d0 0x7f4ed80c0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:05.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.822+0000 7f4edc99b700 1 --2- 172.21.15.72:0/1110975822 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4ed81580d0 0x7f4ed80c0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:05.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.822+0000 7f4edc99b700 1 -- 172.21.15.72:0/1110975822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ed81ecf40 msgr2=0x7f4ed80c0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:05.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.822+0000 7f4edc99b700 1 --2- 172.21.15.72:0/1110975822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ed81ecf40 0x7f4ed80c0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:05.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.822+0000 7f4edc99b700 1 -- 172.21.15.72:0/1110975822 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed81ed3f0 con 0x7f4ec8005210 2023-07-27T20:35:05.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.822+0000 7f4ed7fff700 1 --2- 172.21.15.72:0/1110975822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ed81ecf40 0x7f4ed80c0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:35:05.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.822+0000 7f4edc99b700 1 --2- 172.21.15.72:0/1110975822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ec8005210 0x7f4ed81eca00 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc0119a0 tx=0x7f4ecc011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:05.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.822+0000 7f4ed57fa700 1 -- 172.21.15.72:0/1110975822 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc00f940 con 0x7f4ec8005210 2023-07-27T20:35:05.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.822+0000 7f4ed57fa700 1 -- 172.21.15.72:0/1110975822 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ecc00faa0 con 0x7f4ec8005210 2023-07-27T20:35:05.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.822+0000 7f4ed57fa700 1 -- 172.21.15.72:0/1110975822 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc00fe30 con 0x7f4ec8005210 2023-07-27T20:35:05.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.822+0000 7f4edebff700 1 -- 172.21.15.72:0/1110975822 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed80c2380 con 0x7f4ec8005210 2023-07-27T20:35:05.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.822+0000 7f4edebff700 1 -- 172.21.15.72:0/1110975822 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed80c3280 con 0x7f4ec8005210 2023-07-27T20:35:05.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.823+0000 7f4edebff700 1 -- 172.21.15.72:0/1110975822 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed804e470 con 0x7f4ec8005210 2023-07-27T20:35:05.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.824+0000 7f4ed57fa700 1 -- 172.21.15.72:0/1110975822 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4ecc014440 con 0x7f4ec8005210 2023-07-27T20:35:05.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.826+0000 7f4ed57fa700 1 --2- 172.21.15.72:0/1110975822 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4ebc06ace0 0x7f4ebc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:05.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.826+0000 7f4ed57fa700 1 -- 172.21.15.72:0/1110975822 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f4ecc089ff0 con 0x7f4ec8005210 2023-07-27T20:35:05.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.826+0000 7f4ed7fff700 1 --2- 172.21.15.72:0/1110975822 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4ebc06ace0 0x7f4ebc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:05.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.827+0000 7f4ed7fff700 1 --2- 172.21.15.72:0/1110975822 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4ebc06ace0 0x7f4ebc06d1a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4ed81ed320 tx=0x7f4ec4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:05.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:05.829+0000 7f4ed57fa700 1 -- 172.21.15.72:0/1110975822 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4ecc0bc310 con 0x7f4ec8005210 2023-07-27T20:35:06.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.020+0000 7f4edebff700 1 -- 172.21.15.72:0/1110975822 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4ed806cf00 con 0x7f4ec8005210 2023-07-27T20:35:06.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.021+0000 7f4ed57fa700 1 -- 172.21.15.72:0/1110975822 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v66) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4ecc0586c0 con 0x7f4ec8005210 2023-07-27T20:35:06.009 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-27T20:35:06.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.023+0000 7f4edebff700 1 -- 172.21.15.72:0/1110975822 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4ebc06ace0 msgr2=0x7f4ebc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:06.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.023+0000 7f4edebff700 1 --2- 172.21.15.72:0/1110975822 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4ebc06ace0 0x7f4ebc06d1a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4ed81ed320 tx=0x7f4ec4009040 comp rx=0 tx=0).stop 2023-07-27T20:35:06.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.023+0000 7f4edebff700 1 -- 172.21.15.72:0/1110975822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ec8005210 msgr2=0x7f4ed81eca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:06.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.023+0000 7f4edebff700 1 --2- 172.21.15.72:0/1110975822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ec8005210 0x7f4ed81eca00 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc0119a0 tx=0x7f4ecc011d60 comp rx=0 tx=0).stop 2023-07-27T20:35:06.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.023+0000 7f4edebff700 1 -- 172.21.15.72:0/1110975822 shutdown_connections 2023-07-27T20:35:06.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.023+0000 7f4edebff700 1 --2- 172.21.15.72:0/1110975822 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f4ebc06ace0 0x7f4ebc06d1a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:06.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.023+0000 7f4edebff700 1 --2- 172.21.15.72:0/1110975822 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4ed81580d0 0x7f4ed80c0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:06.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.023+0000 7f4edebff700 1 --2- 172.21.15.72:0/1110975822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ec8005210 0x7f4ed81eca00 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:06.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.023+0000 7f4edebff700 1 --2- 172.21.15.72:0/1110975822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ed81ecf40 0x7f4ed80c0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:06.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.023+0000 7f4edebff700 1 -- 172.21.15.72:0/1110975822 >> 172.21.15.72:0/1110975822 conn(0x7f4ed80ab3f0 msgr2=0x7f4ed8149e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:06.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.023+0000 7f4edebff700 1 -- 172.21.15.72:0/1110975822 shutdown_connections 2023-07-27T20:35:06.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.023+0000 7f4edebff700 1 -- 172.21.15.72:0/1110975822 wait complete. 2023-07-27T20:35:06.028 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T20:35:06.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.243+0000 7f7aa83ff700 1 Processor -- start 2023-07-27T20:35:06.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.243+0000 7f7aa83ff700 1 -- start start 2023-07-27T20:35:06.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.244+0000 7f7aa83ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7aa014aab0 0x7f7aa0154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:06.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.245+0000 7f7aa83ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aa00c7c50 con 0x7f7aa006c1d0 2023-07-27T20:35:06.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.245+0000 7f7aa83ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aa006bd40 con 0x7f7aa00c7740 2023-07-27T20:35:06.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.245+0000 7f7aa83ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aa00c62f0 con 0x7f7aa014aab0 2023-07-27T20:35:06.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.245+0000 7f7aa619b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7aa014aab0 0x7f7aa0154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:06.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.245+0000 7f7aa619b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7aa014aab0 0x7f7aa0154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48406/0 (socket says 172.21.15.72:48406) 2023-07-27T20:35:06.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.245+0000 7f7aa619b700 1 -- 172.21.15.72:0/2781607845 learned_addr learned my addr 172.21.15.72:0/2781607845 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:35:06.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.245+0000 7f7aa699c700 1 --1- 172.21.15.72:0/2781607845 >> v1:172.21.15.72:6789/0 conn(0x7f7aa006c1d0 0x7f7aa006c5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60502/0 (socket says 172.21.15.72:60502) 2023-07-27T20:35:06.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.245+0000 7f7aa619b700 1 -- 172.21.15.72:0/2781607845 >> v1:172.21.15.173:6789/0 conn(0x7f7aa00c7740 legacy=0x7f7aa00c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:06.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.245+0000 7f7aa619b700 1 -- 172.21.15.72:0/2781607845 >> v1:172.21.15.72:6789/0 conn(0x7f7aa006c1d0 legacy=0x7f7aa006c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:06.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.245+0000 7f7aa619b700 1 -- 172.21.15.72:0/2781607845 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa006cd00 con 0x7f7aa014aab0 2023-07-27T20:35:06.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.246+0000 7f7aa619b700 1 --2- 172.21.15.72:0/2781607845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aa014aab0 0x7f7aa0154b10 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c0098f0 tx=0x7f7a9c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7684a1d8212a1240 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:06.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.246+0000 7f7aa5199700 1 -- 172.21.15.72:0/2781607845 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c00b8a0 con 0x7f7aa014aab0 2023-07-27T20:35:06.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.246+0000 7f7aa5199700 1 -- 172.21.15.72:0/2781607845 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a9c00ba00 con 0x7f7aa014aab0 2023-07-27T20:35:06.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.246+0000 7f7aa5199700 1 -- 172.21.15.72:0/2781607845 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c00bd90 con 0x7f7aa014aab0 2023-07-27T20:35:06.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.246+0000 7f7aa83ff700 1 -- 172.21.15.72:0/2781607845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aa014aab0 msgr2=0x7f7aa0154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:06.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.246+0000 7f7aa83ff700 1 --2- 172.21.15.72:0/2781607845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aa014aab0 0x7f7aa0154b10 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c0098f0 tx=0x7f7a9c009c00 comp rx=0 tx=0).stop 2023-07-27T20:35:06.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.246+0000 7f7aa83ff700 1 -- 172.21.15.72:0/2781607845 shutdown_connections 2023-07-27T20:35:06.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.246+0000 7f7aa83ff700 1 --2- 172.21.15.72:0/2781607845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aa014aab0 0x7f7aa0154b10 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:06.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.246+0000 7f7aa83ff700 1 -- 172.21.15.72:0/2781607845 >> 172.21.15.72:0/2781607845 conn(0x7f7aa00ab3f0 msgr2=0x7f7aa00ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:06.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.246+0000 7f7aa83ff700 1 -- 172.21.15.72:0/2781607845 shutdown_connections 2023-07-27T20:35:06.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.246+0000 7f7aa83ff700 1 -- 172.21.15.72:0/2781607845 wait complete. 2023-07-27T20:35:06.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.248+0000 7f7aa83ff700 1 Processor -- start 2023-07-27T20:35:06.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.248+0000 7f7aa83ff700 1 -- start start 2023-07-27T20:35:06.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.249+0000 7f7aa83ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7aa006c1d0 0x7f7aa00a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:06.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.249+0000 7f7aa83ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7aa00c7740 0x7f7aa00adca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:06.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.249+0000 7f7aa83ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aa014aab0 0x7f7aa01466e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:06.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.249+0000 7f7aa83ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa00ad530 con 0x7f7aa014aab0 2023-07-27T20:35:06.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.249+0000 7f7aa83ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa0147710 con 0x7f7aa006c1d0 2023-07-27T20:35:06.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.249+0000 7f7aa83ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa0147430 con 0x7f7aa00c7740 2023-07-27T20:35:06.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.249+0000 7f7aa699c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aa014aab0 0x7f7aa01466e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:06.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.249+0000 7f7aa699c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aa014aab0 0x7f7aa01466e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48418/0 (socket says 172.21.15.72:48418) 2023-07-27T20:35:06.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.249+0000 7f7aa699c700 1 -- 172.21.15.72:0/827648418 learned_addr learned my addr 172.21.15.72:0/827648418 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:35:06.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.250+0000 7f7aa619b700 1 --2- 172.21.15.72:0/827648418 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7aa006c1d0 0x7f7aa00a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:06.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.250+0000 7f7aa599a700 1 --2- 172.21.15.72:0/827648418 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7aa00c7740 0x7f7aa00adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:06.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.250+0000 7f7aa699c700 1 -- 172.21.15.72:0/827648418 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7aa00c7740 msgr2=0x7f7aa00adca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:06.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.250+0000 7f7aa699c700 1 --2- 172.21.15.72:0/827648418 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7aa00c7740 0x7f7aa00adca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:06.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.250+0000 7f7aa699c700 1 -- 172.21.15.72:0/827648418 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7aa006c1d0 msgr2=0x7f7aa00a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:06.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.250+0000 7f7aa699c700 1 --2- 172.21.15.72:0/827648418 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7aa006c1d0 0x7f7aa00a9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:06.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.250+0000 7f7aa699c700 1 -- 172.21.15.72:0/827648418 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a9c009550 con 0x7f7aa014aab0 2023-07-27T20:35:06.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.250+0000 7f7aa619b700 1 --2- 172.21.15.72:0/827648418 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7aa006c1d0 0x7f7aa00a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:35:06.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.250+0000 7f7aa699c700 1 --2- 172.21.15.72:0/827648418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aa014aab0 0x7f7aa01466e0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f7a9800cbd0 tx=0x7f7a9800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:06.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.250+0000 7f7a96ffd700 1 -- 172.21.15.72:0/827648418 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9800abb0 con 0x7f7aa014aab0 2023-07-27T20:35:06.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.250+0000 7f7a96ffd700 1 -- 172.21.15.72:0/827648418 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a9800ad10 con 0x7f7aa014aab0 2023-07-27T20:35:06.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.250+0000 7f7aa83ff700 1 -- 172.21.15.72:0/827648418 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa01ed790 con 0x7f7aa014aab0 2023-07-27T20:35:06.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.250+0000 7f7a96ffd700 1 -- 172.21.15.72:0/827648418 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a98007270 con 0x7f7aa014aab0 2023-07-27T20:35:06.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.251+0000 7f7aa83ff700 1 -- 172.21.15.72:0/827648418 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa00ad780 con 0x7f7aa014aab0 2023-07-27T20:35:06.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.252+0000 7f7aa83ff700 1 -- 172.21.15.72:0/827648418 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aa004e470 con 0x7f7aa014aab0 2023-07-27T20:35:06.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.253+0000 7f7a96ffd700 1 -- 172.21.15.72:0/827648418 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7a980073d0 con 0x7f7aa014aab0 2023-07-27T20:35:06.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.254+0000 7f7a96ffd700 1 --2- 172.21.15.72:0/827648418 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f7a8406ace0 0x7f7a8406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:06.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.254+0000 7f7a96ffd700 1 -- 172.21.15.72:0/827648418 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f7a98089730 con 0x7f7aa014aab0 2023-07-27T20:35:06.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.255+0000 7f7aa619b700 1 --2- 172.21.15.72:0/827648418 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f7a8406ace0 0x7f7a8406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:06.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.255+0000 7f7aa619b700 1 --2- 172.21.15.72:0/827648418 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f7a8406ace0 0x7f7a8406d1a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c014040 tx=0x7f7a9c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:06.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.259+0000 7f7a96ffd700 1 -- 172.21.15.72:0/827648418 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7a98054350 con 0x7f7aa014aab0 2023-07-27T20:35:06.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.458+0000 7f7aa83ff700 1 -- 172.21.15.72:0/827648418 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7aa006cf00 con 0x7f7aa014aab0 2023-07-27T20:35:06.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.458+0000 7f7a96ffd700 1 -- 172.21.15.72:0/827648418 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v66) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7a980170a0 con 0x7f7aa014aab0 2023-07-27T20:35:06.446 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-27T20:35:06.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.461+0000 7f7aa83ff700 1 -- 172.21.15.72:0/827648418 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f7a8406ace0 msgr2=0x7f7a8406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:06.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.461+0000 7f7aa83ff700 1 --2- 172.21.15.72:0/827648418 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f7a8406ace0 0x7f7a8406d1a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c014040 tx=0x7f7a9c008030 comp rx=0 tx=0).stop 2023-07-27T20:35:06.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.461+0000 7f7aa83ff700 1 -- 172.21.15.72:0/827648418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aa014aab0 msgr2=0x7f7aa01466e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:06.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.461+0000 7f7aa83ff700 1 --2- 172.21.15.72:0/827648418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aa014aab0 0x7f7aa01466e0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f7a9800cbd0 tx=0x7f7a9800cf90 comp rx=0 tx=0).stop 2023-07-27T20:35:06.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.461+0000 7f7aa83ff700 1 -- 172.21.15.72:0/827648418 shutdown_connections 2023-07-27T20:35:06.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.461+0000 7f7aa83ff700 1 --2- 172.21.15.72:0/827648418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aa014aab0 0x7f7aa01466e0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:06.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.461+0000 7f7aa83ff700 1 --2- 172.21.15.72:0/827648418 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7aa006c1d0 0x7f7aa00a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:06.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.461+0000 7f7aa83ff700 1 --2- 172.21.15.72:0/827648418 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f7a8406ace0 0x7f7a8406d1a0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:06.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.461+0000 7f7aa83ff700 1 --2- 172.21.15.72:0/827648418 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7aa00c7740 0x7f7aa00adca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:06.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.461+0000 7f7aa83ff700 1 -- 172.21.15.72:0/827648418 >> 172.21.15.72:0/827648418 conn(0x7f7aa00ab3f0 msgr2=0x7f7aa00c40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:06.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.461+0000 7f7aa83ff700 1 -- 172.21.15.72:0/827648418 shutdown_connections 2023-07-27T20:35:06.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.461+0000 7f7aa83ff700 1 -- 172.21.15.72:0/827648418 wait complete. 2023-07-27T20:35:06.466 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T20:35:06.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.679+0000 7fccf21ff700 1 Processor -- start 2023-07-27T20:35:06.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.679+0000 7fccf21ff700 1 -- start start 2023-07-27T20:35:06.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.680+0000 7fccf21ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fccec0a86c0 0x7fccec158100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:06.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.680+0000 7fccf21ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fccec071190 0x7fccec0a8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:06.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.680+0000 7fccf21ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccec071700 con 0x7fccec154a10 2023-07-27T20:35:06.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.680+0000 7fccf21ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccec0c3e30 con 0x7fccec071190 2023-07-27T20:35:06.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.680+0000 7fccf21ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccec0c2ca0 con 0x7fccec0a86c0 2023-07-27T20:35:06.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.681+0000 7fcceaffd700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fccec071190 0x7fccec0a8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:06.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.681+0000 7fcceb7fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fccec0a86c0 0x7fccec158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:06.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.681+0000 7fcceaffd700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fccec071190 0x7fccec0a8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.72:52838/0 (socket says 172.21.15.72:52838) 2023-07-27T20:35:06.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.681+0000 7fcceaffd700 1 -- 172.21.15.72:0/1377956306 learned_addr learned my addr 172.21.15.72:0/1377956306 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:35:06.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.681+0000 7fccebfff700 1 --1- 172.21.15.72:0/1377956306 >> v1:172.21.15.173:6789/0 conn(0x7fccec154a10 0x7fccec06b2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.72:50332/0 (socket says 172.21.15.72:50332) 2023-07-27T20:35:06.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.681+0000 7fcceaffd700 1 -- 172.21.15.72:0/1377956306 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fccec0a86c0 msgr2=0x7fccec158100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:35:06.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.681+0000 7fcceaffd700 1 --2- 172.21.15.72:0/1377956306 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fccec0a86c0 0x7fccec158100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:06.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.681+0000 7fcceaffd700 1 -- 172.21.15.72:0/1377956306 >> v1:172.21.15.173:6789/0 conn(0x7fccec154a10 legacy=0x7fccec06b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:06.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.681+0000 7fcceaffd700 1 -- 172.21.15.72:0/1377956306 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccec0719e0 con 0x7fccec071190 2023-07-27T20:35:06.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.681+0000 7fcceb7fe700 1 --2- 172.21.15.72:0/1377956306 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fccec0a86c0 0x7fccec158100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:35:06.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.681+0000 7fcceaffd700 1 --2- 172.21.15.72:0/1377956306 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccec071190 0x7fccec0a8aa0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fcce00098f0 tx=0x7fcce0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddf4cf216ec57858 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:06.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.682+0000 7fccea7fc700 1 -- 172.21.15.72:0/1377956306 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce0011830 con 0x7fccec071190 2023-07-27T20:35:06.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.682+0000 7fccea7fc700 1 -- 172.21.15.72:0/1377956306 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce0011990 con 0x7fccec071190 2023-07-27T20:35:06.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.682+0000 7fccea7fc700 1 -- 172.21.15.72:0/1377956306 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce0011d20 con 0x7fccec071190 2023-07-27T20:35:06.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.682+0000 7fccf21ff700 1 -- 172.21.15.72:0/1377956306 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccec071190 msgr2=0x7fccec0a8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:06.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.682+0000 7fccf21ff700 1 --2- 172.21.15.72:0/1377956306 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccec071190 0x7fccec0a8aa0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fcce00098f0 tx=0x7fcce0009c00 comp rx=0 tx=0).stop 2023-07-27T20:35:06.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.682+0000 7fccf21ff700 1 -- 172.21.15.72:0/1377956306 shutdown_connections 2023-07-27T20:35:06.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.682+0000 7fccf21ff700 1 --2- 172.21.15.72:0/1377956306 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fccec0a86c0 0x7fccec158100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:06.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.682+0000 7fccf21ff700 1 --2- 172.21.15.72:0/1377956306 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccec071190 0x7fccec0a8aa0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:06.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.682+0000 7fccf21ff700 1 -- 172.21.15.72:0/1377956306 >> 172.21.15.72:0/1377956306 conn(0x7fccec0c2fd0 msgr2=0x7fccec0c33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:06.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.682+0000 7fccf21ff700 1 -- 172.21.15.72:0/1377956306 shutdown_connections 2023-07-27T20:35:06.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.682+0000 7fccf21ff700 1 -- 172.21.15.72:0/1377956306 wait complete. 2023-07-27T20:35:06.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.685+0000 7fccf21ff700 1 Processor -- start 2023-07-27T20:35:06.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.685+0000 7fccf21ff700 1 -- start start 2023-07-27T20:35:06.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.686+0000 7fccf21ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fccec071190 0x7fccec1e9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:06.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.686+0000 7fccf21ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccec0a86c0 0x7fccec14fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:06.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.686+0000 7fccf21ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccec154a10 0x7fccec0bb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:06.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.686+0000 7fccf21ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccec151040 con 0x7fccec0a86c0 2023-07-27T20:35:06.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.686+0000 7fccf21ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccec1ea3b0 con 0x7fccec154a10 2023-07-27T20:35:06.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.686+0000 7fccf21ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccec0c52a0 con 0x7fccec071190 2023-07-27T20:35:06.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.686+0000 7fcceaffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccec0a86c0 0x7fccec14fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:06.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.686+0000 7fcceaffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccec0a86c0 0x7fccec14fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48426/0 (socket says 172.21.15.72:48426) 2023-07-27T20:35:06.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.686+0000 7fcceaffd700 1 -- 172.21.15.72:0/69097155 learned_addr learned my addr 172.21.15.72:0/69097155 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:35:06.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.686+0000 7fcceb7fe700 1 --2- 172.21.15.72:0/69097155 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fccec071190 0x7fccec1e9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:06.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.687+0000 7fccebfff700 1 --2- 172.21.15.72:0/69097155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccec154a10 0x7fccec0bb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:06.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.687+0000 7fcceaffd700 1 -- 172.21.15.72:0/69097155 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fccec071190 msgr2=0x7fccec1e9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:06.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.687+0000 7fcceaffd700 1 --2- 172.21.15.72:0/69097155 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fccec071190 0x7fccec1e9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:06.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.687+0000 7fcceaffd700 1 -- 172.21.15.72:0/69097155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccec154a10 msgr2=0x7fccec0bb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:06.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.687+0000 7fcceaffd700 1 --2- 172.21.15.72:0/69097155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccec154a10 0x7fccec0bb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:06.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.687+0000 7fcceaffd700 1 -- 172.21.15.72:0/69097155 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccdc0094a0 con 0x7fccec0a86c0 2023-07-27T20:35:06.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.687+0000 7fcceaffd700 1 --2- 172.21.15.72:0/69097155 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccec0a86c0 0x7fccec14fa00 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fcce0000c00 tx=0x7fcce0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:06.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.687+0000 7fccd3fff700 1 -- 172.21.15.72:0/69097155 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce0004480 con 0x7fccec0a86c0 2023-07-27T20:35:06.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.687+0000 7fccd3fff700 1 -- 172.21.15.72:0/69097155 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce001f070 con 0x7fccec0a86c0 2023-07-27T20:35:06.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.687+0000 7fccd3fff700 1 -- 172.21.15.72:0/69097155 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce00038c0 con 0x7fccec0a86c0 2023-07-27T20:35:06.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.687+0000 7fccf21ff700 1 -- 172.21.15.72:0/69097155 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce0009550 con 0x7fccec0a86c0 2023-07-27T20:35:06.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.687+0000 7fccf21ff700 1 -- 172.21.15.72:0/69097155 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccec14f570 con 0x7fccec0a86c0 2023-07-27T20:35:06.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.688+0000 7fccf21ff700 1 -- 172.21.15.72:0/69097155 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccec04e470 con 0x7fccec0a86c0 2023-07-27T20:35:06.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.689+0000 7fccd3fff700 1 -- 172.21.15.72:0/69097155 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcce0021030 con 0x7fccec0a86c0 2023-07-27T20:35:06.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.691+0000 7fccd3fff700 1 --2- 172.21.15.72:0/69097155 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fccd806ace0 0x7fccd806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:06.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.691+0000 7fccd3fff700 1 -- 172.21.15.72:0/69097155 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7238+0+0 (secure 0 0 0) 0x7fcce008af60 con 0x7fccec0a86c0 2023-07-27T20:35:06.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.691+0000 7fcceb7fe700 1 --2- 172.21.15.72:0/69097155 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fccd806ace0 0x7fccd806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:06.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.692+0000 7fcceb7fe700 1 --2- 172.21.15.72:0/69097155 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fccd806ace0 0x7fccd806d1a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fccec0bb060 tx=0x7fccdc009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:06.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.695+0000 7fccd3fff700 1 -- 172.21.15.72:0/69097155 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcce0055c80 con 0x7fccec0a86c0 2023-07-27T20:35:06.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.891+0000 7fccf21ff700 1 -- 172.21.15.72:0/69097155 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fccec072360 con 0x7fccec0a86c0 2023-07-27T20:35:06.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.891+0000 7fccd3fff700 1 -- 172.21.15.72:0/69097155 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v66) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcce0015020 con 0x7fccec0a86c0 2023-07-27T20:35:06.879 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:35:06.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.894+0000 7fccf21ff700 1 -- 172.21.15.72:0/69097155 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fccd806ace0 msgr2=0x7fccd806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:06.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.894+0000 7fccf21ff700 1 --2- 172.21.15.72:0/69097155 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fccd806ace0 0x7fccd806d1a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fccec0bb060 tx=0x7fccdc009210 comp rx=0 tx=0).stop 2023-07-27T20:35:06.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.894+0000 7fccf21ff700 1 -- 172.21.15.72:0/69097155 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccec0a86c0 msgr2=0x7fccec14fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:06.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.894+0000 7fccf21ff700 1 --2- 172.21.15.72:0/69097155 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccec0a86c0 0x7fccec14fa00 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fcce0000c00 tx=0x7fcce0004750 comp rx=0 tx=0).stop 2023-07-27T20:35:06.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.894+0000 7fccf21ff700 1 -- 172.21.15.72:0/69097155 shutdown_connections 2023-07-27T20:35:06.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.894+0000 7fccf21ff700 1 --2- 172.21.15.72:0/69097155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccec154a10 0x7fccec0bb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:06.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.894+0000 7fccf21ff700 1 --2- 172.21.15.72:0/69097155 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fccd806ace0 0x7fccd806d1a0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:06.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.894+0000 7fccf21ff700 1 --2- 172.21.15.72:0/69097155 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fccec071190 0x7fccec1e9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:06.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.894+0000 7fccf21ff700 1 --2- 172.21.15.72:0/69097155 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccec0a86c0 0x7fccec14fa00 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:06.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.894+0000 7fccf21ff700 1 -- 172.21.15.72:0/69097155 >> 172.21.15.72:0/69097155 conn(0x7fccec0c2fd0 msgr2=0x7fccec0c0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:06.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.894+0000 7fccf21ff700 1 -- 172.21.15.72:0/69097155 shutdown_connections 2023-07-27T20:35:06.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:06.894+0000 7fccf21ff700 1 -- 172.21.15.72:0/69097155 wait complete. 2023-07-27T20:35:06.899 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T20:35:07.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.111+0000 7efd9bfff700 1 Processor -- start 2023-07-27T20:35:07.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.111+0000 7efd9bfff700 1 -- start start 2023-07-27T20:35:07.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.112+0000 7efd9bfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd940c77c0 0x7efd94151210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:07.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.112+0000 7efd9bfff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7efd9406ffc0 0x7efd94151750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:07.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.112+0000 7efd9bfff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd9406d1c0 con 0x7efd940c6710 2023-07-27T20:35:07.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.112+0000 7efd9bfff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd94155070 con 0x7efd9406ffc0 2023-07-27T20:35:07.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.112+0000 7efd9bfff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd9406ce90 con 0x7efd940c77c0 2023-07-27T20:35:07.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.112+0000 7efd9a59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7efd940c6710 0x7efd940c6bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60516/0 (socket says 172.21.15.72:60516) 2023-07-27T20:35:07.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.112+0000 7efd9a59c700 1 -- 172.21.15.72:0/628253569 learned_addr learned my addr 172.21.15.72:0/628253569 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:35:07.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.112+0000 7efd9959a700 1 --2- 172.21.15.72:0/628253569 >> v2:172.21.15.173:3300/0 conn(0x7efd9406ffc0 0x7efd94151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:07.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.113+0000 7efd99d9b700 1 --2- 172.21.15.72:0/628253569 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd940c77c0 0x7efd94151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:07.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.113+0000 7efd98d99700 1 -- 172.21.15.72:0/628253569 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804052708 0 0) 0x7efd9406d1c0 con 0x7efd940c6710 2023-07-27T20:35:07.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.113+0000 7efd98d99700 1 -- 172.21.15.72:0/628253569 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd800035b0 con 0x7efd940c6710 2023-07-27T20:35:07.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.113+0000 7efd98d99700 1 -- 172.21.15.72:0/628253569 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 561529230 0 0) 0x7efd800035b0 con 0x7efd940c6710 2023-07-27T20:35:07.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.113+0000 7efd98d99700 1 -- 172.21.15.72:0/628253569 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd940c77c0 msgr2=0x7efd94151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:35:07.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.113+0000 7efd98d99700 1 --2- 172.21.15.72:0/628253569 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd940c77c0 0x7efd94151210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:07.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.113+0000 7efd98d99700 1 -- 172.21.15.72:0/628253569 >> v2:172.21.15.173:3300/0 conn(0x7efd9406ffc0 msgr2=0x7efd94151750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:35:07.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.113+0000 7efd98d99700 1 --2- 172.21.15.72:0/628253569 >> v2:172.21.15.173:3300/0 conn(0x7efd9406ffc0 0x7efd94151750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:07.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.113+0000 7efd98d99700 1 -- 172.21.15.72:0/628253569 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd94154d90 con 0x7efd940c6710 2023-07-27T20:35:07.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.113+0000 7efd98d99700 1 -- 172.21.15.72:0/628253569 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4185260736 0 0) 0x7efd8c0019f0 con 0x7efd940c6710 2023-07-27T20:35:07.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.113+0000 7efd98d99700 1 -- 172.21.15.72:0/628253569 >> v1:172.21.15.72:6789/0 conn(0x7efd940c6710 legacy=0x7efd940c6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:07.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.113+0000 7efd98d99700 1 --2- 172.21.15.72:0/628253569 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd940c77c0 0x7efd80003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:07.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.113+0000 7efd98d99700 1 --2- 172.21.15.72:0/628253569 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd80003f80 0x7efd80004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:07.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.113+0000 7efd98d99700 1 --2- 172.21.15.72:0/628253569 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd80004d90 0x7efd80005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:07.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.113+0000 7efd98d99700 1 -- 172.21.15.72:0/628253569 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd94155070 con 0x7efd80003f80 2023-07-27T20:35:07.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.113+0000 7efd98d99700 1 -- 172.21.15.72:0/628253569 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9406ce90 con 0x7efd80004d90 2023-07-27T20:35:07.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.113+0000 7efd98d99700 1 -- 172.21.15.72:0/628253569 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd8000baf0 con 0x7efd940c77c0 2023-07-27T20:35:07.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.113+0000 7efd9959a700 1 --2- 172.21.15.72:0/628253569 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd80003f80 0x7efd80004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:07.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.114+0000 7efd9a59c700 1 --2- 172.21.15.72:0/628253569 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd80004d90 0x7efd80005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:07.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.114+0000 7efd99d9b700 1 --2- 172.21.15.72:0/628253569 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd940c77c0 0x7efd80003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:07.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.114+0000 7efd9959a700 1 -- 172.21.15.72:0/628253569 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd940c77c0 msgr2=0x7efd80003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:35:07.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.114+0000 7efd9959a700 1 --2- 172.21.15.72:0/628253569 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd940c77c0 0x7efd80003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:07.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.114+0000 7efd9959a700 1 -- 172.21.15.72:0/628253569 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd80004d90 msgr2=0x7efd80005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:35:07.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.114+0000 7efd9959a700 1 --2- 172.21.15.72:0/628253569 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd80004d90 0x7efd80005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:07.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.114+0000 7efd9959a700 1 -- 172.21.15.72:0/628253569 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd800035b0 con 0x7efd80003f80 2023-07-27T20:35:07.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.114+0000 7efd99d9b700 1 --2- 172.21.15.72:0/628253569 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd940c77c0 0x7efd80003a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:35:07.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.114+0000 7efd9959a700 1 --2- 172.21.15.72:0/628253569 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd80003f80 0x7efd80004850 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7efd84009b30 tx=0x7efd80005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e422001d57e69b86 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:07.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.114+0000 7efd98d99700 1 -- 172.21.15.72:0/628253569 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8400e6c0 con 0x7efd80003f80 2023-07-27T20:35:07.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.114+0000 7efd98d99700 1 -- 172.21.15.72:0/628253569 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd8400e820 con 0x7efd80003f80 2023-07-27T20:35:07.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.114+0000 7efd98d99700 1 -- 172.21.15.72:0/628253569 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8400eb90 con 0x7efd80003f80 2023-07-27T20:35:07.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.115+0000 7efd9bfff700 1 -- 172.21.15.72:0/628253569 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd80003f80 msgr2=0x7efd80004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:07.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.115+0000 7efd9bfff700 1 --2- 172.21.15.72:0/628253569 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd80003f80 0x7efd80004850 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7efd84009b30 tx=0x7efd80005880 comp rx=0 tx=0).stop 2023-07-27T20:35:07.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.115+0000 7efd9a59c700 1 -- 172.21.15.72:0/628253569 reap_dead start 2023-07-27T20:35:07.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.115+0000 7efd9bfff700 1 -- 172.21.15.72:0/628253569 shutdown_connections 2023-07-27T20:35:07.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.115+0000 7efd9bfff700 1 -- 172.21.15.72:0/628253569 >> 172.21.15.72:0/628253569 conn(0x7efd9406a190 msgr2=0x7efd9406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:07.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.115+0000 7efd9bfff700 1 -- 172.21.15.72:0/628253569 shutdown_connections 2023-07-27T20:35:07.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.115+0000 7efd9bfff700 1 -- 172.21.15.72:0/628253569 wait complete. 2023-07-27T20:35:07.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.117+0000 7efd9bfff700 1 Processor -- start 2023-07-27T20:35:07.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.117+0000 7efd9bfff700 1 -- start start 2023-07-27T20:35:07.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.117+0000 7efd9bfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd80003f80 0x7efd941ea7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:07.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.118+0000 7efd9bfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd940c3f40 0x7efd941ecb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:07.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.118+0000 7efd9bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd940be290 0x7efd940abde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:07.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.118+0000 7efd9bfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd940ab950 con 0x7efd940be290 2023-07-27T20:35:07.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.118+0000 7efd9bfff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd940c44f0 con 0x7efd80003f80 2023-07-27T20:35:07.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.118+0000 7efd9bfff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd941ed4a0 con 0x7efd940c3f40 2023-07-27T20:35:07.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.118+0000 7efd9a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd940be290 0x7efd940abde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:07.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.118+0000 7efd9a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd940be290 0x7efd940abde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48434/0 (socket says 172.21.15.72:48434) 2023-07-27T20:35:07.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.118+0000 7efd9a59c700 1 -- 172.21.15.72:0/194013784 learned_addr learned my addr 172.21.15.72:0/194013784 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:35:07.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.118+0000 7efd99d9b700 1 --2- 172.21.15.72:0/194013784 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd80003f80 0x7efd941ea7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:07.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.118+0000 7efd9959a700 1 --2- 172.21.15.72:0/194013784 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd940c3f40 0x7efd941ecb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:07.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.118+0000 7efd9a59c700 1 -- 172.21.15.72:0/194013784 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd940c3f40 msgr2=0x7efd941ecb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:07.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.118+0000 7efd9a59c700 1 --2- 172.21.15.72:0/194013784 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd940c3f40 0x7efd941ecb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:07.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.118+0000 7efd9a59c700 1 -- 172.21.15.72:0/194013784 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd80003f80 msgr2=0x7efd941ea7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:07.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.118+0000 7efd9a59c700 1 --2- 172.21.15.72:0/194013784 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd80003f80 0x7efd941ea7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:07.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.118+0000 7efd9a59c700 1 -- 172.21.15.72:0/194013784 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd940ab300 con 0x7efd940be290 2023-07-27T20:35:07.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.118+0000 7efd99d9b700 1 --2- 172.21.15.72:0/194013784 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd80003f80 0x7efd941ea7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:35:07.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.118+0000 7efd9959a700 1 --2- 172.21.15.72:0/194013784 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd940c3f40 0x7efd941ecb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:35:07.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.118+0000 7efd9a59c700 1 --2- 172.21.15.72:0/194013784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd940be290 0x7efd940abde0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7efd8c000f80 tx=0x7efd8c00e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:07.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.119+0000 7efd8a7fc700 1 -- 172.21.15.72:0/194013784 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8c00ec70 con 0x7efd940be290 2023-07-27T20:35:07.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.119+0000 7efd8a7fc700 1 -- 172.21.15.72:0/194013784 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd8c00edf0 con 0x7efd940be290 2023-07-27T20:35:07.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.119+0000 7efd9bfff700 1 -- 172.21.15.72:0/194013784 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd940ab5e0 con 0x7efd940be290 2023-07-27T20:35:07.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.119+0000 7efd8a7fc700 1 -- 172.21.15.72:0/194013784 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8c013660 con 0x7efd940be290 2023-07-27T20:35:07.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.119+0000 7efd9bfff700 1 -- 172.21.15.72:0/194013784 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd941ed0a0 con 0x7efd940be290 2023-07-27T20:35:07.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.120+0000 7efd9bfff700 1 -- 172.21.15.72:0/194013784 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd940abac0 con 0x7efd940be290 2023-07-27T20:35:07.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.121+0000 7efd8a7fc700 1 -- 172.21.15.72:0/194013784 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efd8c0137c0 con 0x7efd940be290 2023-07-27T20:35:07.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.121+0000 7efd8a7fc700 1 --2- 172.21.15.72:0/194013784 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7efd7806ad10 0x7efd7806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:07.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.122+0000 7efd8a7fc700 1 -- 172.21.15.72:0/194013784 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7238+0+0 (secure 0 0 0) 0x7efd8c089df0 con 0x7efd940be290 2023-07-27T20:35:07.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.122+0000 7efd99d9b700 1 --2- 172.21.15.72:0/194013784 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7efd7806ad10 0x7efd7806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:07.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.123+0000 7efd99d9b700 1 --2- 172.21.15.72:0/194013784 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7efd7806ad10 0x7efd7806d1d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7efd90006d90 tx=0x7efd90008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:07.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.126+0000 7efd8a7fc700 1 -- 172.21.15.72:0/194013784 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7efd8c0549f0 con 0x7efd940be290 2023-07-27T20:35:07.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.327+0000 7efd9bfff700 1 -- 172.21.15.72:0/194013784 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efd9404e470 con 0x7efd940be290 2023-07-27T20:35:07.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.327+0000 7efd8a7fc700 1 -- 172.21.15.72:0/194013784 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v66) v1 ==== 100+0+11 (secure 0 0 0) 0x7efd8c058010 con 0x7efd940be290 2023-07-27T20:35:07.315 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-27T20:35:07.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.329+0000 7efd9bfff700 1 -- 172.21.15.72:0/194013784 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7efd7806ad10 msgr2=0x7efd7806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:07.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.329+0000 7efd9bfff700 1 --2- 172.21.15.72:0/194013784 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7efd7806ad10 0x7efd7806d1d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7efd90006d90 tx=0x7efd90008040 comp rx=0 tx=0).stop 2023-07-27T20:35:07.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.329+0000 7efd9bfff700 1 -- 172.21.15.72:0/194013784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd940be290 msgr2=0x7efd940abde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:07.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.329+0000 7efd9bfff700 1 --2- 172.21.15.72:0/194013784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd940be290 0x7efd940abde0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7efd8c000f80 tx=0x7efd8c00e440 comp rx=0 tx=0).stop 2023-07-27T20:35:07.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.330+0000 7efd9bfff700 1 -- 172.21.15.72:0/194013784 shutdown_connections 2023-07-27T20:35:07.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.330+0000 7efd9bfff700 1 --2- 172.21.15.72:0/194013784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd940be290 0x7efd940abde0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:07.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.330+0000 7efd9bfff700 1 --2- 172.21.15.72:0/194013784 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd80003f80 0x7efd941ea7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:07.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.330+0000 7efd9bfff700 1 --2- 172.21.15.72:0/194013784 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7efd7806ad10 0x7efd7806d1d0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:07.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.330+0000 7efd9bfff700 1 --2- 172.21.15.72:0/194013784 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd940c3f40 0x7efd941ecb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:07.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.330+0000 7efd9bfff700 1 -- 172.21.15.72:0/194013784 >> 172.21.15.72:0/194013784 conn(0x7efd9406a190 msgr2=0x7efd940c4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:07.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.330+0000 7efd9bfff700 1 -- 172.21.15.72:0/194013784 shutdown_connections 2023-07-27T20:35:07.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.330+0000 7efd9bfff700 1 -- 172.21.15.72:0/194013784 wait complete. 2023-07-27T20:35:07.334 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-07-27T20:35:07.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.545+0000 7ffab25ff700 1 Processor -- start 2023-07-27T20:35:07.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.546+0000 7ffab25ff700 1 -- start start 2023-07-27T20:35:07.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.547+0000 7ffab25ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ffaac14aab0 0x7ffaac154b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:07.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.547+0000 7ffab25ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffaac0c7740 0x7ffaac0c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:07.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.547+0000 7ffab25ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffaac0c4700 0x7ffaac06c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:07.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.547+0000 7ffab25ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaac0c7c50 con 0x7ffaac0c7740 2023-07-27T20:35:07.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.547+0000 7ffab25ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaac06bd40 con 0x7ffaac14aab0 2023-07-27T20:35:07.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.547+0000 7ffab25ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac0c62f0 con 0x7ffaac0c4700 2023-07-27T20:35:07.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.547+0000 7ffaab7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffaac0c7740 0x7ffaac0c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:07.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.547+0000 7ffaab7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffaac0c7740 0x7ffaac0c41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48438/0 (socket says 172.21.15.72:48438) 2023-07-27T20:35:07.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.547+0000 7ffaab7fe700 1 -- 172.21.15.72:0/4122138259 learned_addr learned my addr 172.21.15.72:0/4122138259 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:35:07.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.547+0000 7ffaab7fe700 1 -- 172.21.15.72:0/4122138259 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffaac0c4700 msgr2=0x7ffaac06c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:35:07.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.547+0000 7ffaab7fe700 1 --2- 172.21.15.72:0/4122138259 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffaac0c4700 0x7ffaac06c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:07.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.547+0000 7ffaab7fe700 1 -- 172.21.15.72:0/4122138259 >> v2:172.21.15.173:3300/0 conn(0x7ffaac14aab0 msgr2=0x7ffaac154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:35:07.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.547+0000 7ffaabfff700 1 --2- 172.21.15.72:0/4122138259 >> v2:172.21.15.173:3300/0 conn(0x7ffaac14aab0 0x7ffaac154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:07.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.547+0000 7ffaab7fe700 1 --2- 172.21.15.72:0/4122138259 >> v2:172.21.15.173:3300/0 conn(0x7ffaac14aab0 0x7ffaac154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:07.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.547+0000 7ffaab7fe700 1 -- 172.21.15.72:0/4122138259 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaac155050 con 0x7ffaac0c7740 2023-07-27T20:35:07.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.548+0000 7ffaabfff700 1 --2- 172.21.15.72:0/4122138259 >> v2:172.21.15.173:3300/0 conn(0x7ffaac14aab0 0x7ffaac154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-27T20:35:07.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.548+0000 7ffaab7fe700 1 --2- 172.21.15.72:0/4122138259 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaac0c7740 0x7ffaac0c41c0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7ffaac06ad20 tx=0x7ffaa0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f26a590a7e6250e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:07.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.548+0000 7ffaaaffd700 1 -- 172.21.15.72:0/4122138259 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa000b870 con 0x7ffaac0c7740 2023-07-27T20:35:07.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.548+0000 7ffaaaffd700 1 -- 172.21.15.72:0/4122138259 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa000b9d0 con 0x7ffaac0c7740 2023-07-27T20:35:07.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.548+0000 7ffaaaffd700 1 -- 172.21.15.72:0/4122138259 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa000bd60 con 0x7ffaac0c7740 2023-07-27T20:35:07.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.548+0000 7ffab25ff700 1 -- 172.21.15.72:0/4122138259 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaac0c7740 msgr2=0x7ffaac0c41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:07.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.548+0000 7ffab25ff700 1 --2- 172.21.15.72:0/4122138259 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaac0c7740 0x7ffaac0c41c0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7ffaac06ad20 tx=0x7ffaa0009bd0 comp rx=0 tx=0).stop 2023-07-27T20:35:07.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.549+0000 7ffab25ff700 1 -- 172.21.15.72:0/4122138259 shutdown_connections 2023-07-27T20:35:07.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.549+0000 7ffab25ff700 1 --2- 172.21.15.72:0/4122138259 >> v2:172.21.15.173:3300/0 conn(0x7ffaac14aab0 0x7ffaac154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:07.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.549+0000 7ffab25ff700 1 --2- 172.21.15.72:0/4122138259 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffaac0c4700 0x7ffaac06c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:07.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.549+0000 7ffab25ff700 1 --2- 172.21.15.72:0/4122138259 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaac0c7740 0x7ffaac0c41c0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:07.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.549+0000 7ffab25ff700 1 -- 172.21.15.72:0/4122138259 >> 172.21.15.72:0/4122138259 conn(0x7ffaac0ab3f0 msgr2=0x7ffaac0ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:07.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.549+0000 7ffab25ff700 1 -- 172.21.15.72:0/4122138259 shutdown_connections 2023-07-27T20:35:07.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.549+0000 7ffab25ff700 1 -- 172.21.15.72:0/4122138259 wait complete. 2023-07-27T20:35:07.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.550+0000 7ffab25ff700 1 Processor -- start 2023-07-27T20:35:07.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.551+0000 7ffab25ff700 1 -- start start 2023-07-27T20:35:07.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.551+0000 7ffab25ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffaac0c4700 0x7ffaac143fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:07.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.551+0000 7ffab25ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaac0c7740 0x7ffaac1ea380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:07.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.551+0000 7ffab25ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffaac14aab0 0x7ffaac157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:07.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.551+0000 7ffab25ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac1566d0 con 0x7ffaac0c7740 2023-07-27T20:35:07.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.551+0000 7ffab25ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac142b80 con 0x7ffaac0c4700 2023-07-27T20:35:07.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.551+0000 7ffab25ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac1e9ef0 con 0x7ffaac14aab0 2023-07-27T20:35:07.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.552+0000 7ffaab7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaac0c7740 0x7ffaac1ea380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:07.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.552+0000 7ffaab7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaac0c7740 0x7ffaac1ea380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48446/0 (socket says 172.21.15.72:48446) 2023-07-27T20:35:07.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.552+0000 7ffaab7fe700 1 -- 172.21.15.72:0/2222497551 learned_addr learned my addr 172.21.15.72:0/2222497551 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:35:07.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.552+0000 7ffaab7fe700 1 -- 172.21.15.72:0/2222497551 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffaac14aab0 msgr2=0x7ffaac157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:07.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.552+0000 7ffaab7fe700 1 --2- 172.21.15.72:0/2222497551 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffaac14aab0 0x7ffaac157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:07.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.552+0000 7ffaab7fe700 1 -- 172.21.15.72:0/2222497551 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffaac0c4700 msgr2=0x7ffaac143fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:07.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.552+0000 7ffaab7fe700 1 --2- 172.21.15.72:0/2222497551 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffaac0c4700 0x7ffaac143fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:07.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.552+0000 7ffaab7fe700 1 -- 172.21.15.72:0/2222497551 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa0009550 con 0x7ffaac0c7740 2023-07-27T20:35:07.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.552+0000 7ffaab7fe700 1 --2- 172.21.15.72:0/2222497551 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaac0c7740 0x7ffaac1ea380 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7ffaac0a9200 tx=0x7ffaa0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:07.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.552+0000 7ffaa8ff9700 1 -- 172.21.15.72:0/2222497551 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa0004310 con 0x7ffaac0c7740 2023-07-27T20:35:07.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.552+0000 7ffaa8ff9700 1 -- 172.21.15.72:0/2222497551 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa001f070 con 0x7ffaac0c7740 2023-07-27T20:35:07.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.552+0000 7ffab25ff700 1 -- 172.21.15.72:0/2222497551 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaac1e9ba0 con 0x7ffaac0c7740 2023-07-27T20:35:07.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.552+0000 7ffaa8ff9700 1 -- 172.21.15.72:0/2222497551 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa00036a0 con 0x7ffaac0c7740 2023-07-27T20:35:07.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.553+0000 7ffab25ff700 1 -- 172.21.15.72:0/2222497551 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaac1edbc0 con 0x7ffaac0c7740 2023-07-27T20:35:07.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.554+0000 7ffab25ff700 1 -- 172.21.15.72:0/2222497551 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaac04e470 con 0x7ffaac0c7740 2023-07-27T20:35:07.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.555+0000 7ffaa8ff9700 1 -- 172.21.15.72:0/2222497551 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffaa0021030 con 0x7ffaac0c7740 2023-07-27T20:35:07.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.555+0000 7ffaa8ff9700 1 --2- 172.21.15.72:0/2222497551 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ffa9806ace0 0x7ffa9806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:07.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.556+0000 7ffaa8ff9700 1 -- 172.21.15.72:0/2222497551 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7238+0+0 (secure 0 0 0) 0x7ffaa008ade0 con 0x7ffaac0c7740 2023-07-27T20:35:07.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.556+0000 7ffaabfff700 1 --2- 172.21.15.72:0/2222497551 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ffa9806ace0 0x7ffa9806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:07.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.557+0000 7ffaabfff700 1 --2- 172.21.15.72:0/2222497551 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ffa9806ace0 0x7ffa9806d1a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c00a8b0 tx=0x7ffa9c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:07.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.560+0000 7ffaa8ff9700 1 -- 172.21.15.72:0/2222497551 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ffaa00559e0 con 0x7ffaac0c7740 2023-07-27T20:35:07.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.753+0000 7ffab25ff700 1 -- 172.21.15.72:0/2222497551 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffaac06cf00 con 0x7ffaac0c7740 2023-07-27T20:35:07.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.753+0000 7ffaa8ff9700 1 -- 172.21.15.72:0/2222497551 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v66) v1 ==== 105+0+11 (secure 0 0 0) 0x7ffaa0059000 con 0x7ffaac0c7740 2023-07-27T20:35:07.741 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-27T20:35:07.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.755+0000 7ffab25ff700 1 -- 172.21.15.72:0/2222497551 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ffa9806ace0 msgr2=0x7ffa9806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:07.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.755+0000 7ffab25ff700 1 --2- 172.21.15.72:0/2222497551 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ffa9806ace0 0x7ffa9806d1a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c00a8b0 tx=0x7ffa9c008040 comp rx=0 tx=0).stop 2023-07-27T20:35:07.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.755+0000 7ffab25ff700 1 -- 172.21.15.72:0/2222497551 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaac0c7740 msgr2=0x7ffaac1ea380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:07.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.755+0000 7ffab25ff700 1 --2- 172.21.15.72:0/2222497551 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaac0c7740 0x7ffaac1ea380 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7ffaac0a9200 tx=0x7ffaa0004750 comp rx=0 tx=0).stop 2023-07-27T20:35:07.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.755+0000 7ffab25ff700 1 -- 172.21.15.72:0/2222497551 shutdown_connections 2023-07-27T20:35:07.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.755+0000 7ffab25ff700 1 --2- 172.21.15.72:0/2222497551 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7ffa9806ace0 0x7ffa9806d1a0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:07.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.755+0000 7ffab25ff700 1 --2- 172.21.15.72:0/2222497551 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffaac14aab0 0x7ffaac157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:07.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.755+0000 7ffab25ff700 1 --2- 172.21.15.72:0/2222497551 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffaac0c4700 0x7ffaac143fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:07.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.755+0000 7ffab25ff700 1 --2- 172.21.15.72:0/2222497551 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaac0c7740 0x7ffaac1ea380 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:07.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.755+0000 7ffab25ff700 1 -- 172.21.15.72:0/2222497551 >> 172.21.15.72:0/2222497551 conn(0x7ffaac0ab3f0 msgr2=0x7ffaac153ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:07.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.755+0000 7ffab25ff700 1 -- 172.21.15.72:0/2222497551 shutdown_connections 2023-07-27T20:35:07.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.755+0000 7ffab25ff700 1 -- 172.21.15.72:0/2222497551 wait complete. 2023-07-27T20:35:07.760 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-07-27T20:35:07.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.972+0000 7fe5e81ff700 1 Processor -- start 2023-07-27T20:35:07.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.972+0000 7fe5e81ff700 1 -- start start 2023-07-27T20:35:07.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.974+0000 7fe5e81ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe5e013b150 0x7fe5e0151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:07.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.974+0000 7fe5e81ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe5e006d5d0 0x7fe5e006da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:07.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.974+0000 7fe5e81ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5e006ce10 con 0x7fe5e006e140 2023-07-27T20:35:07.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.974+0000 7fe5e81ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5e006df40 con 0x7fe5e013b150 2023-07-27T20:35:07.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.974+0000 7fe5e81ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e0152680 con 0x7fe5e006d5d0 2023-07-27T20:35:07.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.974+0000 7fe5e679c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe5e006d5d0 0x7fe5e006da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:07.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.974+0000 7fe5e5f9b700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe5e013b150 0x7fe5e0151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:07.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.974+0000 7fe5e579a700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fe5e006e140 0x7fe5e00ba310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.72:50346/0 (socket says 172.21.15.72:50346) 2023-07-27T20:35:07.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.974+0000 7fe5e579a700 1 -- 172.21.15.72:0/4239188060 learned_addr learned my addr 172.21.15.72:0/4239188060 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:35:07.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.974+0000 7fe5e4f99700 1 -- 172.21.15.72:0/4239188060 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3240594231 0 0) 0x7fe5e006ce10 con 0x7fe5e006e140 2023-07-27T20:35:07.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.975+0000 7fe5e4f99700 1 -- 172.21.15.72:0/4239188060 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5cc0035b0 con 0x7fe5e006e140 2023-07-27T20:35:07.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.975+0000 7fe5e679c700 1 -- 172.21.15.72:0/4239188060 >> v2:172.21.15.173:3300/0 conn(0x7fe5e013b150 msgr2=0x7fe5e0151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:35:07.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.975+0000 7fe5e679c700 1 --2- 172.21.15.72:0/4239188060 >> v2:172.21.15.173:3300/0 conn(0x7fe5e013b150 0x7fe5e0151dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:07.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.975+0000 7fe5e679c700 1 -- 172.21.15.72:0/4239188060 >> v1:172.21.15.173:6789/0 conn(0x7fe5e006e140 legacy=0x7fe5e00ba310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:07.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.975+0000 7fe5e679c700 1 -- 172.21.15.72:0/4239188060 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e0152960 con 0x7fe5e006d5d0 2023-07-27T20:35:07.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.975+0000 7fe5e5f9b700 1 --2- 172.21.15.72:0/4239188060 >> v2:172.21.15.173:3300/0 conn(0x7fe5e013b150 0x7fe5e0151dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-27T20:35:07.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.975+0000 7fe5e679c700 1 --2- 172.21.15.72:0/4239188060 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe5e006d5d0 0x7fe5e006da00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe5d8009d90 tx=0x7fe5d800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77375270c52f6a32 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:07.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.975+0000 7fe5e4f99700 1 -- 172.21.15.72:0/4239188060 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d800e070 con 0x7fe5e006d5d0 2023-07-27T20:35:07.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.975+0000 7fe5e4f99700 1 -- 172.21.15.72:0/4239188060 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d800bb20 con 0x7fe5e006d5d0 2023-07-27T20:35:07.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.975+0000 7fe5e4f99700 1 -- 172.21.15.72:0/4239188060 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d800be90 con 0x7fe5e006d5d0 2023-07-27T20:35:07.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.976+0000 7fe5e81ff700 1 -- 172.21.15.72:0/4239188060 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe5e006d5d0 msgr2=0x7fe5e006da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:07.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.976+0000 7fe5e81ff700 1 --2- 172.21.15.72:0/4239188060 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe5e006d5d0 0x7fe5e006da00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe5d8009d90 tx=0x7fe5d800b330 comp rx=0 tx=0).stop 2023-07-27T20:35:07.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.976+0000 7fe5e81ff700 1 -- 172.21.15.72:0/4239188060 shutdown_connections 2023-07-27T20:35:07.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.976+0000 7fe5e81ff700 1 --2- 172.21.15.72:0/4239188060 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe5e006d5d0 0x7fe5e006da00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:07.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.976+0000 7fe5e81ff700 1 --2- 172.21.15.72:0/4239188060 >> v2:172.21.15.173:3300/0 conn(0x7fe5e013b150 0x7fe5e0151dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:07.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.976+0000 7fe5e81ff700 1 -- 172.21.15.72:0/4239188060 >> 172.21.15.72:0/4239188060 conn(0x7fe5e006a190 msgr2=0x7fe5e006a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:07.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.976+0000 7fe5e81ff700 1 -- 172.21.15.72:0/4239188060 shutdown_connections 2023-07-27T20:35:07.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.976+0000 7fe5e81ff700 1 -- 172.21.15.72:0/4239188060 wait complete. 2023-07-27T20:35:07.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.977+0000 7fe5e81ff700 1 Processor -- start 2023-07-27T20:35:07.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.978+0000 7fe5e81ff700 1 -- start start 2023-07-27T20:35:07.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.979+0000 7fe5e81ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5e006d5d0 0x7fe5e01e7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:07.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.979+0000 7fe5e81ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe5e006e140 0x7fe5e01e78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:07.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.979+0000 7fe5e81ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe5e013b150 0x7fe5e01377a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:07.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.979+0000 7fe5e81ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e00c5dc0 con 0x7fe5e006d5d0 2023-07-27T20:35:07.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.979+0000 7fe5e81ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e00c62f0 con 0x7fe5e013b150 2023-07-27T20:35:07.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.979+0000 7fe5e81ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e01e7de0 con 0x7fe5e006e140 2023-07-27T20:35:07.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.979+0000 7fe5e5f9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5e006d5d0 0x7fe5e01e7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:07.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.979+0000 7fe5e5f9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5e006d5d0 0x7fe5e01e7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48448/0 (socket says 172.21.15.72:48448) 2023-07-27T20:35:07.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.979+0000 7fe5e5f9b700 1 -- 172.21.15.72:0/3416685412 learned_addr learned my addr 172.21.15.72:0/3416685412 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:35:07.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.979+0000 7fe5e579a700 1 --2- 172.21.15.72:0/3416685412 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe5e006e140 0x7fe5e01e78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:07.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.979+0000 7fe5e679c700 1 --2- 172.21.15.72:0/3416685412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe5e013b150 0x7fe5e01377a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:07.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.980+0000 7fe5e5f9b700 1 -- 172.21.15.72:0/3416685412 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe5e006e140 msgr2=0x7fe5e01e78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:07.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.980+0000 7fe5e5f9b700 1 --2- 172.21.15.72:0/3416685412 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe5e006e140 0x7fe5e01e78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:07.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.980+0000 7fe5e5f9b700 1 -- 172.21.15.72:0/3416685412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe5e013b150 msgr2=0x7fe5e01377a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:07.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.980+0000 7fe5e5f9b700 1 --2- 172.21.15.72:0/3416685412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe5e013b150 0x7fe5e01377a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:07.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.980+0000 7fe5e5f9b700 1 -- 172.21.15.72:0/3416685412 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5dc0094a0 con 0x7fe5e006d5d0 2023-07-27T20:35:07.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.980+0000 7fe5e579a700 1 --2- 172.21.15.72:0/3416685412 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe5e006e140 0x7fe5e01e78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:35:07.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.980+0000 7fe5e5f9b700 1 --2- 172.21.15.72:0/3416685412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5e006d5d0 0x7fe5e01e7360 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc00ec10 tx=0x7fe5dc009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:07.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.980+0000 7fe5d67fc700 1 -- 172.21.15.72:0/3416685412 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5dc00c940 con 0x7fe5e006d5d0 2023-07-27T20:35:07.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.980+0000 7fe5d67fc700 1 -- 172.21.15.72:0/3416685412 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5dc00caa0 con 0x7fe5e006d5d0 2023-07-27T20:35:07.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.980+0000 7fe5d67fc700 1 -- 172.21.15.72:0/3416685412 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5dc00ce10 con 0x7fe5e006d5d0 2023-07-27T20:35:07.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.980+0000 7fe5e81ff700 1 -- 172.21.15.72:0/3416685412 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5d8009a70 con 0x7fe5e006d5d0 2023-07-27T20:35:07.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.980+0000 7fe5e81ff700 1 -- 172.21.15.72:0/3416685412 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5e00c3110 con 0x7fe5e006d5d0 2023-07-27T20:35:07.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.981+0000 7fe5e81ff700 1 -- 172.21.15.72:0/3416685412 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5e004e470 con 0x7fe5e006d5d0 2023-07-27T20:35:07.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.982+0000 7fe5d67fc700 1 -- 172.21.15.72:0/3416685412 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe5dc013470 con 0x7fe5e006d5d0 2023-07-27T20:35:07.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.983+0000 7fe5d67fc700 1 --2- 172.21.15.72:0/3416685412 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe5c406ad10 0x7fe5c406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:07.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.983+0000 7fe5d67fc700 1 -- 172.21.15.72:0/3416685412 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7238+0+0 (secure 0 0 0) 0x7fe5dc089e00 con 0x7fe5e006d5d0 2023-07-27T20:35:07.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.983+0000 7fe5e579a700 1 --2- 172.21.15.72:0/3416685412 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe5c406ad10 0x7fe5c406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:07.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.984+0000 7fe5e579a700 1 --2- 172.21.15.72:0/3416685412 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe5c406ad10 0x7fe5c406d1d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0150090 tx=0x7fe5d0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:07.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:07.987+0000 7fe5d67fc700 1 -- 172.21.15.72:0/3416685412 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe5dc054a00 con 0x7fe5e006d5d0 2023-07-27T20:35:08.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.180+0000 7fe5e81ff700 1 -- 172.21.15.72:0/3416685412 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fe5e00bfdb0 con 0x7fe5e006d5d0 2023-07-27T20:35:08.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.181+0000 7fe5d67fc700 1 -- 172.21.15.72:0/3416685412 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v66) v1 ==== 101+0+11 (secure 0 0 0) 0x7fe5dc058020 con 0x7fe5e006d5d0 2023-07-27T20:35:08.168 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-27T20:35:08.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.183+0000 7fe5e81ff700 1 -- 172.21.15.72:0/3416685412 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe5c406ad10 msgr2=0x7fe5c406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:08.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.183+0000 7fe5e81ff700 1 --2- 172.21.15.72:0/3416685412 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe5c406ad10 0x7fe5c406d1d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0150090 tx=0x7fe5d0009040 comp rx=0 tx=0).stop 2023-07-27T20:35:08.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.183+0000 7fe5e81ff700 1 -- 172.21.15.72:0/3416685412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5e006d5d0 msgr2=0x7fe5e01e7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:08.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.183+0000 7fe5e81ff700 1 --2- 172.21.15.72:0/3416685412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5e006d5d0 0x7fe5e01e7360 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc00ec10 tx=0x7fe5dc009ec0 comp rx=0 tx=0).stop 2023-07-27T20:35:08.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.183+0000 7fe5e81ff700 1 -- 172.21.15.72:0/3416685412 shutdown_connections 2023-07-27T20:35:08.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.183+0000 7fe5e81ff700 1 --2- 172.21.15.72:0/3416685412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe5e013b150 0x7fe5e01377a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:08.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.183+0000 7fe5e81ff700 1 --2- 172.21.15.72:0/3416685412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5e006d5d0 0x7fe5e01e7360 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:08.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.183+0000 7fe5e81ff700 1 --2- 172.21.15.72:0/3416685412 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fe5c406ad10 0x7fe5c406d1d0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:08.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.183+0000 7fe5e81ff700 1 --2- 172.21.15.72:0/3416685412 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe5e006e140 0x7fe5e01e78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:08.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.183+0000 7fe5e81ff700 1 -- 172.21.15.72:0/3416685412 >> 172.21.15.72:0/3416685412 conn(0x7fe5e006a190 msgr2=0x7fe5e01559f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:08.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.183+0000 7fe5e81ff700 1 -- 172.21.15.72:0/3416685412 shutdown_connections 2023-07-27T20:35:08.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.183+0000 7fe5e81ff700 1 -- 172.21.15.72:0/3416685412 wait complete. 2023-07-27T20:35:08.188 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-27T20:35:08.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.399+0000 7faf2d9ff700 1 Processor -- start 2023-07-27T20:35:08.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.399+0000 7faf2d9ff700 1 -- start start 2023-07-27T20:35:08.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.400+0000 7faf2d9ff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7faf280c5c00 0x7faf280c1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:08.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.400+0000 7faf2d9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf280706f0 con 0x7faf28154960 2023-07-27T20:35:08.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.400+0000 7faf2d9ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf281585d0 con 0x7faf28151800 2023-07-27T20:35:08.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.400+0000 7faf2d9ff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf28154510 con 0x7faf280c5c00 2023-07-27T20:35:08.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.401+0000 7faf277fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7faf28154960 0x7faf2815eb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60524/0 (socket says 172.21.15.72:60524) 2023-07-27T20:35:08.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.401+0000 7faf277fe700 1 -- 172.21.15.72:0/563995213 learned_addr learned my addr 172.21.15.72:0/563995213 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:35:08.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.401+0000 7faf267fc700 1 --2- 172.21.15.72:0/563995213 >> v2:172.21.15.173:3300/0 conn(0x7faf280c5c00 0x7faf280c1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:08.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.401+0000 7faf25ffb700 1 -- 172.21.15.72:0/563995213 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2691435357 0 0) 0x7faf280706f0 con 0x7faf28154960 2023-07-27T20:35:08.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.401+0000 7faf25ffb700 1 -- 172.21.15.72:0/563995213 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf100035b0 con 0x7faf28154960 2023-07-27T20:35:08.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.401+0000 7faf267fc700 1 -- 172.21.15.72:0/563995213 >> v1:172.21.15.173:6789/0 conn(0x7faf28151800 legacy=0x7faf280a9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:08.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.401+0000 7faf267fc700 1 -- 172.21.15.72:0/563995213 >> v1:172.21.15.72:6789/0 conn(0x7faf28154960 legacy=0x7faf2815eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:08.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.401+0000 7faf267fc700 1 -- 172.21.15.72:0/563995213 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf280709b0 con 0x7faf280c5c00 2023-07-27T20:35:08.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.401+0000 7faf267fc700 1 --2- 172.21.15.72:0/563995213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf280c5c00 0x7faf280c1fb0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7faf1c009840 tx=0x7faf1c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ad077680d5d6b47 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:08.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.402+0000 7faf25ffb700 1 -- 172.21.15.72:0/563995213 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c011830 con 0x7faf280c5c00 2023-07-27T20:35:08.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.402+0000 7faf25ffb700 1 -- 172.21.15.72:0/563995213 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1c011990 con 0x7faf280c5c00 2023-07-27T20:35:08.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.402+0000 7faf25ffb700 1 -- 172.21.15.72:0/563995213 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c011d20 con 0x7faf280c5c00 2023-07-27T20:35:08.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.402+0000 7faf2d9ff700 1 -- 172.21.15.72:0/563995213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf280c5c00 msgr2=0x7faf280c1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:08.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.402+0000 7faf2d9ff700 1 --2- 172.21.15.72:0/563995213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf280c5c00 0x7faf280c1fb0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7faf1c009840 tx=0x7faf1c009b50 comp rx=0 tx=0).stop 2023-07-27T20:35:08.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.402+0000 7faf2d9ff700 1 -- 172.21.15.72:0/563995213 shutdown_connections 2023-07-27T20:35:08.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.402+0000 7faf2d9ff700 1 --2- 172.21.15.72:0/563995213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf280c5c00 0x7faf280c1fb0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:08.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.402+0000 7faf2d9ff700 1 -- 172.21.15.72:0/563995213 >> 172.21.15.72:0/563995213 conn(0x7faf2806a7c0 msgr2=0x7faf280c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:08.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.402+0000 7faf2d9ff700 1 -- 172.21.15.72:0/563995213 shutdown_connections 2023-07-27T20:35:08.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.402+0000 7faf2d9ff700 1 -- 172.21.15.72:0/563995213 wait complete. 2023-07-27T20:35:08.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.404+0000 7faf2d9ff700 1 Processor -- start 2023-07-27T20:35:08.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.404+0000 7faf2d9ff700 1 -- start start 2023-07-27T20:35:08.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.405+0000 7faf2d9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf280c5c00 0x7faf2814e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:08.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.405+0000 7faf2d9ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faf28151800 0x7faf281ec7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:08.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.405+0000 7faf2d9ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf28154960 0x7faf281ecd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:08.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.405+0000 7faf2d9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf281eb2f0 con 0x7faf280c5c00 2023-07-27T20:35:08.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.405+0000 7faf2d9ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2814ec80 con 0x7faf28154960 2023-07-27T20:35:08.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.405+0000 7faf2d9ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf281ea6e0 con 0x7faf28151800 2023-07-27T20:35:08.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.405+0000 7faf26ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf280c5c00 0x7faf2814e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:08.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.405+0000 7faf26ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf280c5c00 0x7faf2814e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48458/0 (socket says 172.21.15.72:48458) 2023-07-27T20:35:08.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.405+0000 7faf26ffd700 1 -- 172.21.15.72:0/218376452 learned_addr learned my addr 172.21.15.72:0/218376452 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:35:08.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.405+0000 7faf267fc700 1 --2- 172.21.15.72:0/218376452 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faf28151800 0x7faf281ec7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:08.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.405+0000 7faf277fe700 1 --2- 172.21.15.72:0/218376452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf28154960 0x7faf281ecd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:08.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.405+0000 7faf26ffd700 1 -- 172.21.15.72:0/218376452 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faf28151800 msgr2=0x7faf281ec7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:08.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.405+0000 7faf26ffd700 1 --2- 172.21.15.72:0/218376452 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faf28151800 0x7faf281ec7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:08.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.405+0000 7faf26ffd700 1 -- 172.21.15.72:0/218376452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf28154960 msgr2=0x7faf281ecd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:08.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.405+0000 7faf26ffd700 1 --2- 172.21.15.72:0/218376452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf28154960 0x7faf281ecd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:08.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.405+0000 7faf26ffd700 1 -- 172.21.15.72:0/218376452 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf1c0094a0 con 0x7faf280c5c00 2023-07-27T20:35:08.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.406+0000 7faf26ffd700 1 --2- 172.21.15.72:0/218376452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf280c5c00 0x7faf2814e740 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7faf1800c730 tx=0x7faf1800caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:08.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.406+0000 7faf0ffff700 1 -- 172.21.15.72:0/218376452 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf180052d0 con 0x7faf280c5c00 2023-07-27T20:35:08.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.406+0000 7faf0ffff700 1 -- 172.21.15.72:0/218376452 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf18005430 con 0x7faf280c5c00 2023-07-27T20:35:08.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.406+0000 7faf0ffff700 1 -- 172.21.15.72:0/218376452 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf180038a0 con 0x7faf280c5c00 2023-07-27T20:35:08.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.406+0000 7faf2d9ff700 1 -- 172.21.15.72:0/218376452 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf281ea9c0 con 0x7faf280c5c00 2023-07-27T20:35:08.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.406+0000 7faf2d9ff700 1 -- 172.21.15.72:0/218376452 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf281eaf80 con 0x7faf280c5c00 2023-07-27T20:35:08.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.407+0000 7faf2d9ff700 1 -- 172.21.15.72:0/218376452 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf28070c90 con 0x7faf280c5c00 2023-07-27T20:35:08.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.408+0000 7faf0ffff700 1 -- 172.21.15.72:0/218376452 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faf18003a00 con 0x7faf280c5c00 2023-07-27T20:35:08.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.409+0000 7faf0ffff700 1 --2- 172.21.15.72:0/218376452 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7faf1406ace0 0x7faf1406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:08.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.409+0000 7faf0ffff700 1 -- 172.21.15.72:0/218376452 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7238+0+0 (secure 0 0 0) 0x7faf18088d70 con 0x7faf280c5c00 2023-07-27T20:35:08.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.409+0000 7faf267fc700 1 --2- 172.21.15.72:0/218376452 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7faf1406ace0 0x7faf1406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:08.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.410+0000 7faf267fc700 1 --2- 172.21.15.72:0/218376452 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7faf1406ace0 0x7faf1406d1a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7faf1c0090b0 tx=0x7faf1c01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:08.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.413+0000 7faf0ffff700 1 -- 172.21.15.72:0/218376452 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7faf18053a10 con 0x7faf280c5c00 2023-07-27T20:35:08.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.625+0000 7faf2d9ff700 1 -- 172.21.15.72:0/218376452 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7faf28074310 con 0x7faf280c5c00 2023-07-27T20:35:08.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.625+0000 7faf0ffff700 1 -- 172.21.15.72:0/218376452 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v66) v1 ==== 80+0+0 (secure 0 0 0) 0x7faf18003cb0 con 0x7faf280c5c00 2023-07-27T20:35:08.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.627+0000 7faf2d9ff700 1 -- 172.21.15.72:0/218376452 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7faf1406ace0 msgr2=0x7faf1406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:08.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.627+0000 7faf2d9ff700 1 --2- 172.21.15.72:0/218376452 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7faf1406ace0 0x7faf1406d1a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7faf1c0090b0 tx=0x7faf1c01c040 comp rx=0 tx=0).stop 2023-07-27T20:35:08.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.627+0000 7faf2d9ff700 1 -- 172.21.15.72:0/218376452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf280c5c00 msgr2=0x7faf2814e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:08.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.627+0000 7faf2d9ff700 1 --2- 172.21.15.72:0/218376452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf280c5c00 0x7faf2814e740 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7faf1800c730 tx=0x7faf1800caf0 comp rx=0 tx=0).stop 2023-07-27T20:35:08.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.627+0000 7faf2d9ff700 1 -- 172.21.15.72:0/218376452 shutdown_connections 2023-07-27T20:35:08.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.627+0000 7faf2d9ff700 1 --2- 172.21.15.72:0/218376452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf28154960 0x7faf281ecd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:08.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.627+0000 7faf2d9ff700 1 --2- 172.21.15.72:0/218376452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf280c5c00 0x7faf2814e740 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:08.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.627+0000 7faf2d9ff700 1 --2- 172.21.15.72:0/218376452 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7faf1406ace0 0x7faf1406d1a0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:08.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.627+0000 7faf2d9ff700 1 --2- 172.21.15.72:0/218376452 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faf28151800 0x7faf281ec7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:08.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.627+0000 7faf2d9ff700 1 -- 172.21.15.72:0/218376452 >> 172.21.15.72:0/218376452 conn(0x7faf2806a7c0 msgr2=0x7faf280c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:08.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.627+0000 7faf2d9ff700 1 -- 172.21.15.72:0/218376452 shutdown_connections 2023-07-27T20:35:08.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:08.627+0000 7faf2d9ff700 1 -- 172.21.15.72:0/218376452 wait complete. 2023-07-27T20:35:08.617 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-07-27T20:35:08.633 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi173.front.sepia.ceph.com... 2023-07-27T20:35:08.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:35:08.634 DEBUG:teuthology.orchestra.run.smithi173:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-07-27T20:35:08.707 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi173.stderr:ceph-fuse[150348]: fuse finished with error 0 and tester_r 0 2023-07-27T20:35:08.711 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T20:35:08.789 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi173.front.sepia.ceph.com 2023-07-27T20:35:08.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:35:08.790 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-27T20:35:08.838 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-07-27T20:35:08.838 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-27T20:35:08.884 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345584k,nr_inodes=4086396,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275012k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 2023-07-27T20:35:08.884 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-27T20:35:09.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.095+0000 7fd2dd7ff700 1 Processor -- start 2023-07-27T20:35:09.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.095+0000 7fd2dd7ff700 1 -- start start 2023-07-27T20:35:09.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.096+0000 7fd2dd7ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd2d80aab30 0x7fd2d80a8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:09.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.096+0000 7fd2dd7ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d8155600 con 0x7fd2d80bfd90 2023-07-27T20:35:09.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.096+0000 7fd2dd7ff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d8155320 con 0x7fd2d813b2c0 2023-07-27T20:35:09.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.096+0000 7fd2dd7ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2d80a9620 con 0x7fd2d80aab30 2023-07-27T20:35:09.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.097+0000 7fd2d77fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd2d80aab30 0x7fd2d80a8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:09.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.097+0000 7fd2d77fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd2d80aab30 0x7fd2d80a8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48462/0 (socket says 172.21.15.72:48462) 2023-07-27T20:35:09.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.097+0000 7fd2d77fe700 1 -- 172.21.15.72:0/2131973795 learned_addr learned my addr 172.21.15.72:0/2131973795 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:35:09.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.097+0000 7fd2d67fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd2d80bfd90 0x7fd2d80a83a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60536/0 (socket says 172.21.15.72:60536) 2023-07-27T20:35:09.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.097+0000 7fd2d77fe700 1 -- 172.21.15.72:0/2131973795 >> v1:172.21.15.173:6789/0 conn(0x7fd2d813b2c0 legacy=0x7fd2d80aa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:09.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.097+0000 7fd2d77fe700 1 -- 172.21.15.72:0/2131973795 >> v1:172.21.15.72:6789/0 conn(0x7fd2d80bfd90 legacy=0x7fd2d80a83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:09.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.097+0000 7fd2d77fe700 1 -- 172.21.15.72:0/2131973795 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d8151e40 con 0x7fd2d80aab30 2023-07-27T20:35:09.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.097+0000 7fd2d77fe700 1 --2- 172.21.15.72:0/2131973795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2d80aab30 0x7fd2d80a8ab0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0009e50 tx=0x7fd2d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=477d6c59d8b46e4c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:09.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.097+0000 7fd2d5ffb700 1 -- 172.21.15.72:0/2131973795 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d000e070 con 0x7fd2d80aab30 2023-07-27T20:35:09.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.098+0000 7fd2d5ffb700 1 -- 172.21.15.72:0/2131973795 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d000b9c0 con 0x7fd2d80aab30 2023-07-27T20:35:09.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.098+0000 7fd2d5ffb700 1 -- 172.21.15.72:0/2131973795 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d000bd70 con 0x7fd2d80aab30 2023-07-27T20:35:09.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.098+0000 7fd2dd7ff700 1 -- 172.21.15.72:0/2131973795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2d80aab30 msgr2=0x7fd2d80a8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:09.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.098+0000 7fd2dd7ff700 1 --2- 172.21.15.72:0/2131973795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2d80aab30 0x7fd2d80a8ab0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0009e50 tx=0x7fd2d000b330 comp rx=0 tx=0).stop 2023-07-27T20:35:09.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.098+0000 7fd2dd7ff700 1 -- 172.21.15.72:0/2131973795 shutdown_connections 2023-07-27T20:35:09.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.098+0000 7fd2dd7ff700 1 --2- 172.21.15.72:0/2131973795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2d80aab30 0x7fd2d80a8ab0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:09.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.098+0000 7fd2dd7ff700 1 -- 172.21.15.72:0/2131973795 >> 172.21.15.72:0/2131973795 conn(0x7fd2d806a190 msgr2=0x7fd2d806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:09.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.098+0000 7fd2dd7ff700 1 -- 172.21.15.72:0/2131973795 shutdown_connections 2023-07-27T20:35:09.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.098+0000 7fd2dd7ff700 1 -- 172.21.15.72:0/2131973795 wait complete. 2023-07-27T20:35:09.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.100+0000 7fd2dd7ff700 1 Processor -- start 2023-07-27T20:35:09.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.100+0000 7fd2dd7ff700 1 -- start start 2023-07-27T20:35:09.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.101+0000 7fd2dd7ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2d80aab30 0x7fd2d80c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:09.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.101+0000 7fd2dd7ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd2d80bfd90 0x7fd2d8071440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:09.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.101+0000 7fd2dd7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2d813b2c0 0x7fd2d8071980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:09.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.101+0000 7fd2dd7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d80c33c0 con 0x7fd2d813b2c0 2023-07-27T20:35:09.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.101+0000 7fd2dd7ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d80c36a0 con 0x7fd2d80aab30 2023-07-27T20:35:09.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.101+0000 7fd2dd7ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d80c3980 con 0x7fd2d80bfd90 2023-07-27T20:35:09.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.101+0000 7fd2d77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2d813b2c0 0x7fd2d8071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:09.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.101+0000 7fd2d77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2d813b2c0 0x7fd2d8071980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48466/0 (socket says 172.21.15.72:48466) 2023-07-27T20:35:09.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.101+0000 7fd2d77fe700 1 -- 172.21.15.72:0/3803477183 learned_addr learned my addr 172.21.15.72:0/3803477183 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:35:09.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.101+0000 7fd2d77fe700 1 -- 172.21.15.72:0/3803477183 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd2d80bfd90 msgr2=0x7fd2d8071440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:09.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.101+0000 7fd2d77fe700 1 --2- 172.21.15.72:0/3803477183 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd2d80bfd90 0x7fd2d8071440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:09.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.101+0000 7fd2d77fe700 1 -- 172.21.15.72:0/3803477183 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2d80aab30 msgr2=0x7fd2d80c3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:09.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.102+0000 7fd2d77fe700 1 --2- 172.21.15.72:0/3803477183 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2d80aab30 0x7fd2d80c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:09.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.102+0000 7fd2d77fe700 1 -- 172.21.15.72:0/3803477183 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d0009b30 con 0x7fd2d813b2c0 2023-07-27T20:35:09.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.102+0000 7fd2d77fe700 1 --2- 172.21.15.72:0/3803477183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2d813b2c0 0x7fd2d8071980 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fd2d80723d0 tx=0x7fd2d0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:09.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.102+0000 7fd2bf7fe700 1 -- 172.21.15.72:0/3803477183 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0004960 con 0x7fd2d813b2c0 2023-07-27T20:35:09.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.102+0000 7fd2bf7fe700 1 -- 172.21.15.72:0/3803477183 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d00099b0 con 0x7fd2d813b2c0 2023-07-27T20:35:09.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.102+0000 7fd2dd7ff700 1 -- 172.21.15.72:0/3803477183 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2d80be7c0 con 0x7fd2d813b2c0 2023-07-27T20:35:09.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.102+0000 7fd2bf7fe700 1 -- 172.21.15.72:0/3803477183 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d001c680 con 0x7fd2d813b2c0 2023-07-27T20:35:09.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.102+0000 7fd2dd7ff700 1 -- 172.21.15.72:0/3803477183 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d80c4360 con 0x7fd2d813b2c0 2023-07-27T20:35:09.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.103+0000 7fd2dd7ff700 1 -- 172.21.15.72:0/3803477183 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2d80bec80 con 0x7fd2d813b2c0 2023-07-27T20:35:09.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.104+0000 7fd2bf7fe700 1 -- 172.21.15.72:0/3803477183 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd2d001c7e0 con 0x7fd2d813b2c0 2023-07-27T20:35:09.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.105+0000 7fd2bf7fe700 1 --2- 172.21.15.72:0/3803477183 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd2c406ace0 0x7fd2c406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:09.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.105+0000 7fd2bf7fe700 1 -- 172.21.15.72:0/3803477183 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7238+0+0 (secure 0 0 0) 0x7fd2d008b820 con 0x7fd2d813b2c0 2023-07-27T20:35:09.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.105+0000 7fd2d6ffd700 1 --2- 172.21.15.72:0/3803477183 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd2c406ace0 0x7fd2c406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:09.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.106+0000 7fd2d6ffd700 1 --2- 172.21.15.72:0/3803477183 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd2c406ace0 0x7fd2c406d1a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8000f60 tx=0x7fd2c8007a40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:09.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.109+0000 7fd2bf7fe700 1 -- 172.21.15.72:0/3803477183 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd2d0059eb0 con 0x7fd2d813b2c0 2023-07-27T20:35:09.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.347+0000 7fd2dd7ff700 1 -- 172.21.15.72:0/3803477183 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd2d8074310 con 0x7fd2d813b2c0 2023-07-27T20:35:09.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.347+0000 7fd2bf7fe700 1 -- 172.21.15.72:0/3803477183 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v38) v1 ==== 53+0+149 (secure 0 0 0) 0x7fd2d0059a40 con 0x7fd2d813b2c0 2023-07-27T20:35:09.335 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-27T20:35:09.335 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-07-27T20:35:09.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.350+0000 7fd2dd7ff700 1 -- 172.21.15.72:0/3803477183 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd2c406ace0 msgr2=0x7fd2c406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:09.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.350+0000 7fd2dd7ff700 1 --2- 172.21.15.72:0/3803477183 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd2c406ace0 0x7fd2c406d1a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8000f60 tx=0x7fd2c8007a40 comp rx=0 tx=0).stop 2023-07-27T20:35:09.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.350+0000 7fd2dd7ff700 1 -- 172.21.15.72:0/3803477183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2d813b2c0 msgr2=0x7fd2d8071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:09.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.350+0000 7fd2dd7ff700 1 --2- 172.21.15.72:0/3803477183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2d813b2c0 0x7fd2d8071980 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fd2d80723d0 tx=0x7fd2d0004ad0 comp rx=0 tx=0).stop 2023-07-27T20:35:09.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.350+0000 7fd2dd7ff700 1 -- 172.21.15.72:0/3803477183 shutdown_connections 2023-07-27T20:35:09.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.350+0000 7fd2dd7ff700 1 --2- 172.21.15.72:0/3803477183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2d813b2c0 0x7fd2d8071980 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:09.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.350+0000 7fd2dd7ff700 1 --2- 172.21.15.72:0/3803477183 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2d80aab30 0x7fd2d80c3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:09.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.350+0000 7fd2dd7ff700 1 --2- 172.21.15.72:0/3803477183 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7fd2c406ace0 0x7fd2c406d1a0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:09.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.350+0000 7fd2dd7ff700 1 --2- 172.21.15.72:0/3803477183 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd2d80bfd90 0x7fd2d8071440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:09.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.350+0000 7fd2dd7ff700 1 -- 172.21.15.72:0/3803477183 >> 172.21.15.72:0/3803477183 conn(0x7fd2d806a190 msgr2=0x7fd2d81505b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:09.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.350+0000 7fd2dd7ff700 1 -- 172.21.15.72:0/3803477183 shutdown_connections 2023-07-27T20:35:09.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:09.350+0000 7fd2dd7ff700 1 -- 172.21.15.72:0/3803477183 wait complete. 2023-07-27T20:35:09.355 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-07-27T20:35:09.355 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T20:35:09.356 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi173.front.sepia.ceph.com 2023-07-27T20:35:09.356 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-27T20:35:09.356 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-27T20:35:09.357 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-07-27T20:35:09.357 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-27T20:35:09.357 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-27T20:35:09.357 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-27T20:35:09.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:35:09.358 DEBUG:teuthology.orchestra.run.smithi173:> ip addr 2023-07-27T20:35:09.405 INFO:teuthology.orchestra.run.smithi173.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T20:35:09.405 INFO:teuthology.orchestra.run.smithi173.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T20:35:09.405 INFO:teuthology.orchestra.run.smithi173.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T20:35:09.406 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:35:09.406 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 ::1/128 scope host 2023-07-27T20:35:09.406 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:35:09.406 INFO:teuthology.orchestra.run.smithi173.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T20:35:09.406 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6a brd ff:ff:ff:ff:ff:ff 2023-07-27T20:35:09.406 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f0 2023-07-27T20:35:09.406 INFO:teuthology.orchestra.run.smithi173.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T20:35:09.407 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6b brd ff:ff:ff:ff:ff:ff 2023-07-27T20:35:09.407 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f1 2023-07-27T20:35:09.407 INFO:teuthology.orchestra.run.smithi173.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T20:35:09.407 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:58 brd ff:ff:ff:ff:ff:ff 2023-07-27T20:35:09.407 INFO:teuthology.orchestra.run.smithi173.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T20:35:09.407 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:59 brd ff:ff:ff:ff:ff:ff 2023-07-27T20:35:09.407 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.21.15.173/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T20:35:09.407 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft 39806sec preferred_lft 39806sec 2023-07-27T20:35:09.408 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::ec4:7aff:fe88:7259/64 scope link 2023-07-27T20:35:09.408 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:35:09.408 INFO:teuthology.orchestra.run.smithi173.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-27T20:35:09.408 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether f2:7f:58:8c:3b:de brd ff:ff:ff:ff:ff:ff 2023-07-27T20:35:09.408 INFO:teuthology.orchestra.run.smithi173.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-27T20:35:09.408 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:35:09.408 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::84ab:86ff:fec2:f207/64 scope link 2023-07-27T20:35:09.409 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:35:09.409 INFO:teuthology.orchestra.run.smithi173.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T20:35:09.409 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether f2:7f:58:8c:3b:de brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-27T20:35:09.409 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::f07f:58ff:fe8c:3bde/64 scope link 2023-07-27T20:35:09.409 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-07-27T20:35:09.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:35:09.410 DEBUG:teuthology.orchestra.run.smithi173:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T20:35:09.477 INFO:teuthology.orchestra.run.smithi173.stdout:1 2023-07-27T20:35:09.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:35:09.480 DEBUG:teuthology.orchestra.run.smithi173:> route 2023-07-27T20:35:09.529 INFO:teuthology.orchestra.run.smithi173.stdout:Kernel IP routing table 2023-07-27T20:35:09.530 INFO:teuthology.orchestra.run.smithi173.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T20:35:09.530 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T20:35:09.530 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T20:35:09.530 INFO:teuthology.orchestra.run.smithi173.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T20:35:09.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:35:09.531 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2023-07-27T20:35:09.531 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2023-07-27T20:35:09.532 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T20:35:09.532 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T20:35:09.532 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T20:35:09.532 DEBUG:teuthology.orchestra.run.smithi173:> ') 2023-07-27T20:35:09.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:35:09.701 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list 2023-07-27T20:35:09.747 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-27T20:35:09.748 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-27T20:35:09.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:35:09.749 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set brx.0 up 2023-07-27T20:35:09.819 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-07-27T20:35:09.819 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-27T20:35:09.820 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-27T20:35:09.865 INFO:teuthology.orchestra.run.smithi173.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-27T20:35:09.866 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-27T20:35:09.866 DEBUG:teuthology.orchestra.run.smithi173:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-27T20:35:09.951 DEBUG:teuthology.orchestra.run.smithi173:> sudo modprobe fuse 2023-07-27T20:35:10.061 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-27T20:35:10.062 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-27T20:35:10.129 INFO:teuthology.orchestra.run.smithi173.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-27T20:35:10.193 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-27T20:35:10.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:35:10.194 DEBUG:teuthology.orchestra.run.smithi173:> ls /sys/fs/fuse/connections 2023-07-27T20:35:10.240 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-27T20:35:10.241 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1 --client_fs=cephfs2) 2023-07-27T20:35:10.285 DEBUG:teuthology.orchestra.run.smithi173:> sudo modprobe fuse 2023-07-27T20:35:10.356 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-27T20:35:10.356 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-27T20:35:10.425 INFO:teuthology.orchestra.run.smithi173.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-27T20:35:10.427 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-27T20:35:10.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:35:10.429 DEBUG:teuthology.orchestra.run.smithi173:> ls /sys/fs/fuse/connections 2023-07-27T20:35:10.452 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi173.stderr:2023-07-27T20:35:10.465+0000 7f5b8a5d65c0 -1 init, newargv = 0x55916e608450 newargc=15 2023-07-27T20:35:10.453 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi173.stderr:ceph-fuse[151001]: starting ceph client 2023-07-27T20:35:10.462 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi173.stderr:ceph-fuse[151001]: starting fuse 2023-07-27T20:35:10.479 INFO:teuthology.orchestra.run.smithi173.stdout:43 2023-07-27T20:35:10.479 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-07-27T20:35:10.479 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-27T20:35:10.480 DEBUG:teuthology.orchestra.run.smithi173:> import glob 2023-07-27T20:35:10.480 DEBUG:teuthology.orchestra.run.smithi173:> import re 2023-07-27T20:35:10.480 DEBUG:teuthology.orchestra.run.smithi173:> import os 2023-07-27T20:35:10.481 DEBUG:teuthology.orchestra.run.smithi173:> import subprocess 2023-07-27T20:35:10.481 DEBUG:teuthology.orchestra.run.smithi173:> 2023-07-27T20:35:10.481 DEBUG:teuthology.orchestra.run.smithi173:> def _find_admin_socket(client_name): 2023-07-27T20:35:10.482 DEBUG:teuthology.orchestra.run.smithi173:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-07-27T20:35:10.482 DEBUG:teuthology.orchestra.run.smithi173:> files = glob.glob(asok_path) 2023-07-27T20:35:10.482 DEBUG:teuthology.orchestra.run.smithi173:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-07-27T20:35:10.483 DEBUG:teuthology.orchestra.run.smithi173:> 2023-07-27T20:35:10.483 DEBUG:teuthology.orchestra.run.smithi173:> # Given a non-glob path, it better be there 2023-07-27T20:35:10.483 DEBUG:teuthology.orchestra.run.smithi173:> if "*" not in asok_path: 2023-07-27T20:35:10.483 DEBUG:teuthology.orchestra.run.smithi173:> assert(len(files) == 1) 2023-07-27T20:35:10.484 DEBUG:teuthology.orchestra.run.smithi173:> return files[0] 2023-07-27T20:35:10.484 DEBUG:teuthology.orchestra.run.smithi173:> 2023-07-27T20:35:10.484 DEBUG:teuthology.orchestra.run.smithi173:> for f in files: 2023-07-27T20:35:10.485 DEBUG:teuthology.orchestra.run.smithi173:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-27T20:35:10.485 DEBUG:teuthology.orchestra.run.smithi173:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-27T20:35:10.485 DEBUG:teuthology.orchestra.run.smithi173:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-27T20:35:10.486 DEBUG:teuthology.orchestra.run.smithi173:> contents = proc_f.read() 2023-07-27T20:35:10.486 DEBUG:teuthology.orchestra.run.smithi173:> if mountpoint in contents: 2023-07-27T20:35:10.486 DEBUG:teuthology.orchestra.run.smithi173:> return f 2023-07-27T20:35:10.487 DEBUG:teuthology.orchestra.run.smithi173:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-27T20:35:10.487 DEBUG:teuthology.orchestra.run.smithi173:> 2023-07-27T20:35:10.487 DEBUG:teuthology.orchestra.run.smithi173:> print(_find_admin_socket("client.1")) 2023-07-27T20:35:10.487 DEBUG:teuthology.orchestra.run.smithi173:> ' 2023-07-27T20:35:10.662 INFO:teuthology.orchestra.run.smithi173.stdout:/var/run/ceph/ceph-client.1.151001.asok 2023-07-27T20:35:10.840 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.151001.asok 2023-07-27T20:35:10.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:35:10.841 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.151001.asok status 2023-07-27T20:35:11.067 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2023-07-27T20:35:11.067 INFO:teuthology.orchestra.run.smithi173.stdout: "metadata": { 2023-07-27T20:35:11.067 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_sha1": "a5d48e8c688c2543997a98b8acbae2ce9635578c", 2023-07-27T20:35:11.067 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_version": "ceph version 18.0.0-5128-ga5d48e8c (a5d48e8c688c2543997a98b8acbae2ce9635578c) reef (dev)", 2023-07-27T20:35:11.067 INFO:teuthology.orchestra.run.smithi173.stdout: "entity_id": "1", 2023-07-27T20:35:11.068 INFO:teuthology.orchestra.run.smithi173.stdout: "hostname": "smithi173", 2023-07-27T20:35:11.068 INFO:teuthology.orchestra.run.smithi173.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-07-27T20:35:11.068 INFO:teuthology.orchestra.run.smithi173.stdout: "pid": "151001", 2023-07-27T20:35:11.068 INFO:teuthology.orchestra.run.smithi173.stdout: "root": "/" 2023-07-27T20:35:11.068 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-07-27T20:35:11.068 INFO:teuthology.orchestra.run.smithi173.stdout: "dentry_count": 0, 2023-07-27T20:35:11.068 INFO:teuthology.orchestra.run.smithi173.stdout: "dentry_pinned_count": 0, 2023-07-27T20:35:11.068 INFO:teuthology.orchestra.run.smithi173.stdout: "id": 6415, 2023-07-27T20:35:11.069 INFO:teuthology.orchestra.run.smithi173.stdout: "inst": { 2023-07-27T20:35:11.069 INFO:teuthology.orchestra.run.smithi173.stdout: "name": { 2023-07-27T20:35:11.069 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "client", 2023-07-27T20:35:11.069 INFO:teuthology.orchestra.run.smithi173.stdout: "num": 6415 2023-07-27T20:35:11.069 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-07-27T20:35:11.069 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": { 2023-07-27T20:35:11.069 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "v1", 2023-07-27T20:35:11.070 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": "192.168.0.1:0", 2023-07-27T20:35:11.070 INFO:teuthology.orchestra.run.smithi173.stdout: "nonce": 2551689461 2023-07-27T20:35:11.070 INFO:teuthology.orchestra.run.smithi173.stdout: } 2023-07-27T20:35:11.070 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-07-27T20:35:11.070 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": { 2023-07-27T20:35:11.070 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "v1", 2023-07-27T20:35:11.070 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": "192.168.0.1:0", 2023-07-27T20:35:11.070 INFO:teuthology.orchestra.run.smithi173.stdout: "nonce": 2551689461 2023-07-27T20:35:11.071 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-07-27T20:35:11.071 INFO:teuthology.orchestra.run.smithi173.stdout: "inst_str": "client.6415 192.168.0.1:0/2551689461", 2023-07-27T20:35:11.071 INFO:teuthology.orchestra.run.smithi173.stdout: "addr_str": "192.168.0.1:0/2551689461", 2023-07-27T20:35:11.071 INFO:teuthology.orchestra.run.smithi173.stdout: "inode_count": 1, 2023-07-27T20:35:11.071 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_epoch": 38, 2023-07-27T20:35:11.071 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_epoch": 67, 2023-07-27T20:35:11.071 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_epoch_barrier": 0, 2023-07-27T20:35:11.072 INFO:teuthology.orchestra.run.smithi173.stdout: "blocklisted": false, 2023-07-27T20:35:11.072 INFO:teuthology.orchestra.run.smithi173.stdout: "fs_name": "cephfs2" 2023-07-27T20:35:11.072 INFO:teuthology.orchestra.run.smithi173.stdout:} 2023-07-27T20:35:11.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:35:11.082 DEBUG:teuthology.orchestra.run.smithi173:> stat --file-system '--printf=%T 2023-07-27T20:35:11.082 DEBUG:teuthology.orchestra.run.smithi173:> ' -- /home/ubuntu/cephtest/mnt.1 2023-07-27T20:35:11.129 INFO:teuthology.orchestra.run.smithi173.stdout:fuseblk 2023-07-27T20:35:11.130 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-07-27T20:35:11.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T20:35:11.130 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-27T20:35:11.201 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth add client.testuser mon 'allow rw fsname=cephfs, allow rw fsname=cephfs2' osd 'allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2' mds 'allow rw fsname=cephfs' 2023-07-27T20:35:11.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.430+0000 7f1a09dff700 1 Processor -- start 2023-07-27T20:35:11.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.430+0000 7f1a09dff700 1 -- start start 2023-07-27T20:35:11.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.431+0000 7f1a09dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1a040c4d60 0x7f1a040c45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:11.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.431+0000 7f1a09dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a040ca7f0 con 0x7f1a040c7760 2023-07-27T20:35:11.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.431+0000 7f1a09dff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a040c5990 con 0x7f1a040c41e0 2023-07-27T20:35:11.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.431+0000 7f1a09dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a04154060 con 0x7f1a040c4d60 2023-07-27T20:35:11.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.432+0000 7f1a02ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1a040c4d60 0x7f1a040c45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:11.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.432+0000 7f1a03fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1a040c7760 0x7f1a0415e900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55420/0 (socket says 172.21.15.72:55420) 2023-07-27T20:35:11.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.432+0000 7f1a02ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1a040c4d60 0x7f1a040c45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35814/0 (socket says 172.21.15.72:35814) 2023-07-27T20:35:11.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.432+0000 7f1a03fff700 1 -- 172.21.15.72:0/2970153872 learned_addr learned my addr 172.21.15.72:0/2970153872 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-27T20:35:11.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.432+0000 7f1a02ffd700 1 -- 172.21.15.72:0/2970153872 >> v1:172.21.15.173:6789/0 conn(0x7f1a040c41e0 legacy=0x7f1a04154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:11.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.432+0000 7f1a02ffd700 1 -- 172.21.15.72:0/2970153872 >> v1:172.21.15.72:6789/0 conn(0x7f1a040c7760 legacy=0x7f1a0415e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:11.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.432+0000 7f1a02ffd700 1 -- 172.21.15.72:0/2970153872 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a040c5c10 con 0x7f1a040c4d60 2023-07-27T20:35:11.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.432+0000 7f1a027fc700 1 -- 172.21.15.72:0/2970153872 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4022192664 0 0) 0x7f19fc001490 con 0x7f1a040c7760 2023-07-27T20:35:11.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.432+0000 7f1a02ffd700 1 --2- 172.21.15.72:0/2970153872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a040c4d60 0x7f1a040c45c0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f19f8009840 tx=0x7f19f8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=754aa9ff1c97b6c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:11.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.432+0000 7f1a027fc700 1 -- 172.21.15.72:0/2970153872 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f8011830 con 0x7f1a040c4d60 2023-07-27T20:35:11.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.433+0000 7f1a027fc700 1 -- 172.21.15.72:0/2970153872 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f8011990 con 0x7f1a040c4d60 2023-07-27T20:35:11.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.433+0000 7f1a027fc700 1 -- 172.21.15.72:0/2970153872 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f8011d20 con 0x7f1a040c4d60 2023-07-27T20:35:11.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.433+0000 7f1a09dff700 1 -- 172.21.15.72:0/2970153872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a040c4d60 msgr2=0x7f1a040c45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:11.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.433+0000 7f1a09dff700 1 --2- 172.21.15.72:0/2970153872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a040c4d60 0x7f1a040c45c0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f19f8009840 tx=0x7f19f8009b50 comp rx=0 tx=0).stop 2023-07-27T20:35:11.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.433+0000 7f1a09dff700 1 -- 172.21.15.72:0/2970153872 shutdown_connections 2023-07-27T20:35:11.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.433+0000 7f1a09dff700 1 --2- 172.21.15.72:0/2970153872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a040c4d60 0x7f1a040c45c0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:11.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.433+0000 7f1a09dff700 1 -- 172.21.15.72:0/2970153872 >> 172.21.15.72:0/2970153872 conn(0x7f1a040c9860 msgr2=0x7f1a040c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:11.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.433+0000 7f1a09dff700 1 -- 172.21.15.72:0/2970153872 shutdown_connections 2023-07-27T20:35:11.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.433+0000 7f1a09dff700 1 -- 172.21.15.72:0/2970153872 wait complete. 2023-07-27T20:35:11.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.435+0000 7f1a09dff700 1 Processor -- start 2023-07-27T20:35:11.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.435+0000 7f1a09dff700 1 -- start start 2023-07-27T20:35:11.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.436+0000 7f1a09dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a040c41e0 0x7f1a041df880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:11.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.436+0000 7f1a09dff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a040c4d60 0x7f1a0414ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:11.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.436+0000 7f1a09dff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a040c7760 0x7f1a040c0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:11.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.436+0000 7f1a09dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a041deca0 con 0x7f1a040c41e0 2023-07-27T20:35:11.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.436+0000 7f1a09dff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a040c3ad0 con 0x7f1a040c7760 2023-07-27T20:35:11.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.436+0000 7f1a09dff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a041deef0 con 0x7f1a040c4d60 2023-07-27T20:35:11.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.436+0000 7f1a037fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a040c41e0 0x7f1a041df880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:11.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.436+0000 7f1a037fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a040c41e0 0x7f1a041df880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35822/0 (socket says 172.21.15.72:35822) 2023-07-27T20:35:11.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.436+0000 7f1a037fe700 1 -- 172.21.15.72:0/856769089 learned_addr learned my addr 172.21.15.72:0/856769089 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:35:11.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.436+0000 7f1a03fff700 1 --2- 172.21.15.72:0/856769089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a040c7760 0x7f1a040c0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:11.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.436+0000 7f1a02ffd700 1 --2- 172.21.15.72:0/856769089 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a040c4d60 0x7f1a0414ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:11.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.437+0000 7f1a037fe700 1 -- 172.21.15.72:0/856769089 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a040c4d60 msgr2=0x7f1a0414ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:11.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.437+0000 7f1a037fe700 1 --2- 172.21.15.72:0/856769089 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a040c4d60 0x7f1a0414ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:11.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.437+0000 7f1a037fe700 1 -- 172.21.15.72:0/856769089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a040c7760 msgr2=0x7f1a040c0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:11.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.437+0000 7f1a037fe700 1 --2- 172.21.15.72:0/856769089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a040c7760 0x7f1a040c0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:11.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.437+0000 7f1a037fe700 1 -- 172.21.15.72:0/856769089 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f80094a0 con 0x7f1a040c41e0 2023-07-27T20:35:11.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.437+0000 7f1a037fe700 1 --2- 172.21.15.72:0/856769089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a040c41e0 0x7f1a041df880 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f19f400c4e0 tx=0x7f19f400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:11.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.437+0000 7f19ebfff700 1 -- 172.21.15.72:0/856769089 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f40052d0 con 0x7f1a040c41e0 2023-07-27T20:35:11.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.437+0000 7f19ebfff700 1 -- 172.21.15.72:0/856769089 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f4005430 con 0x7f1a040c41e0 2023-07-27T20:35:11.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.437+0000 7f1a09dff700 1 -- 172.21.15.72:0/856769089 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a041df1d0 con 0x7f1a040c41e0 2023-07-27T20:35:11.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.437+0000 7f19ebfff700 1 -- 172.21.15.72:0/856769089 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f40038c0 con 0x7f1a040c41e0 2023-07-27T20:35:11.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.437+0000 7f1a09dff700 1 -- 172.21.15.72:0/856769089 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a0414d750 con 0x7f1a040c41e0 2023-07-27T20:35:11.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.438+0000 7f1a09dff700 1 -- 172.21.15.72:0/856769089 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a040c0af0 con 0x7f1a040c41e0 2023-07-27T20:35:11.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.439+0000 7f19ebfff700 1 -- 172.21.15.72:0/856769089 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f19f4003a20 con 0x7f1a040c41e0 2023-07-27T20:35:11.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.440+0000 7f19ebfff700 1 --2- 172.21.15.72:0/856769089 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f19f006ace0 0x7f19f006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:11.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.440+0000 7f19ebfff700 1 -- 172.21.15.72:0/856769089 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 7412+0+0 (secure 0 0 0) 0x7f19f4088d80 con 0x7f1a040c41e0 2023-07-27T20:35:11.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.440+0000 7f1a02ffd700 1 --2- 172.21.15.72:0/856769089 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f19f006ace0 0x7f19f006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:11.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.441+0000 7f1a02ffd700 1 --2- 172.21.15.72:0/856769089 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f19f006ace0 0x7f19f006d1a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f19f80090b0 tx=0x7f19f801c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:11.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.445+0000 7f19ebfff700 1 -- 172.21.15.72:0/856769089 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f19f40538d0 con 0x7f1a040c41e0 2023-07-27T20:35:11.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.719+0000 7f1a09dff700 1 -- 172.21.15.72:0/856769089 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]} v 0) v1 -- 0x7f1a0404e470 con 0x7f1a040c41e0 2023-07-27T20:35:11.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.723+0000 7f19ebfff700 1 -- 172.21.15.72:0/856769089 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]}]=0 added key for client.testuser v17) v1 ==== 291+0+0 (secure 0 0 0) 0x7f19f4056ef0 con 0x7f1a040c41e0 2023-07-27T20:35:11.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.726+0000 7f1a09dff700 1 -- 172.21.15.72:0/856769089 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f19f006ace0 msgr2=0x7f19f006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:11.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.726+0000 7f1a09dff700 1 --2- 172.21.15.72:0/856769089 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f19f006ace0 0x7f19f006d1a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f19f80090b0 tx=0x7f19f801c040 comp rx=0 tx=0).stop 2023-07-27T20:35:11.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.726+0000 7f1a09dff700 1 -- 172.21.15.72:0/856769089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a040c41e0 msgr2=0x7f1a041df880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:11.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.726+0000 7f1a09dff700 1 --2- 172.21.15.72:0/856769089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a040c41e0 0x7f1a041df880 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f19f400c4e0 tx=0x7f19f400c7f0 comp rx=0 tx=0).stop 2023-07-27T20:35:11.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.726+0000 7f1a09dff700 1 -- 172.21.15.72:0/856769089 shutdown_connections 2023-07-27T20:35:11.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.726+0000 7f1a09dff700 1 --2- 172.21.15.72:0/856769089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a040c7760 0x7f1a040c0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:11.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.726+0000 7f1a09dff700 1 --2- 172.21.15.72:0/856769089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a040c41e0 0x7f1a041df880 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:11.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.726+0000 7f1a09dff700 1 --2- 172.21.15.72:0/856769089 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f19f006ace0 0x7f19f006d1a0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:11.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.726+0000 7f1a09dff700 1 --2- 172.21.15.72:0/856769089 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a040c4d60 0x7f1a0414ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:11.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.726+0000 7f1a09dff700 1 -- 172.21.15.72:0/856769089 >> 172.21.15.72:0/856769089 conn(0x7f1a040c9860 msgr2=0x7f1a040730d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:11.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.726+0000 7f1a09dff700 1 -- 172.21.15.72:0/856769089 shutdown_connections 2023-07-27T20:35:11.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.726+0000 7f1a09dff700 1 -- 172.21.15.72:0/856769089 wait complete. 2023-07-27T20:35:11.715 INFO:teuthology.orchestra.run.smithi072.stderr:added key for client.testuser 2023-07-27T20:35:11.731 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.testuser 2023-07-27T20:35:11.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.940+0000 7f66ab1ff700 1 Processor -- start 2023-07-27T20:35:11.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.940+0000 7f66ab1ff700 1 -- start start 2023-07-27T20:35:11.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.941+0000 7f66ab1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f66a406ef00 0x7f66a40a8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:11.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.941+0000 7f66ab1ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f66a406b900 0x7f66a4154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:11.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.941+0000 7f66ab1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a406bd90 con 0x7f66a406b520 2023-07-27T20:35:11.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.941+0000 7f66ab1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a40c1850 con 0x7f66a406ef00 2023-07-27T20:35:11.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.941+0000 7f66ab1ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a406e270 con 0x7f66a406b900 2023-07-27T20:35:11.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.941+0000 7f66a3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f66a406ef00 0x7f66a40a8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:11.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.942+0000 7f66a3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f66a406ef00 0x7f66a40a8de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35836/0 (socket says 172.21.15.72:35836) 2023-07-27T20:35:11.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.942+0000 7f66a3fff700 1 -- 172.21.15.72:0/3288112976 learned_addr learned my addr 172.21.15.72:0/3288112976 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:35:11.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.941+0000 7f66a8f9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f66a406b520 0x7f66a4158000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55424/0 (socket says 172.21.15.72:55424) 2023-07-27T20:35:11.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.942+0000 7f66a979c700 1 --2- 172.21.15.72:0/3288112976 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f66a406b900 0x7f66a4154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:11.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.942+0000 7f66a3fff700 1 -- 172.21.15.72:0/3288112976 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f66a406b900 msgr2=0x7f66a4154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T20:35:11.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.942+0000 7f66a3fff700 1 --2- 172.21.15.72:0/3288112976 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f66a406b900 0x7f66a4154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:11.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.942+0000 7f66a3fff700 1 -- 172.21.15.72:0/3288112976 >> v1:172.21.15.72:6789/0 conn(0x7f66a406b520 legacy=0x7f66a4158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:11.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.942+0000 7f66a3fff700 1 -- 172.21.15.72:0/3288112976 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a406e7a0 con 0x7f66a406ef00 2023-07-27T20:35:11.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.942+0000 7f66a37fe700 1 -- 172.21.15.72:0/3288112976 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2496702574 0 0) 0x7f6698001110 con 0x7f66a406b520 2023-07-27T20:35:11.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.942+0000 7f66a3fff700 1 --2- 172.21.15.72:0/3288112976 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66a406ef00 0x7f66a40a8de0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f66900098f0 tx=0x7f6690009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c241165b75445f0c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:11.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.942+0000 7f66a37fe700 1 -- 172.21.15.72:0/3288112976 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6690011830 con 0x7f66a406ef00 2023-07-27T20:35:11.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.942+0000 7f66a37fe700 1 -- 172.21.15.72:0/3288112976 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6690011990 con 0x7f66a406ef00 2023-07-27T20:35:11.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.942+0000 7f66a37fe700 1 -- 172.21.15.72:0/3288112976 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6690011d20 con 0x7f66a406ef00 2023-07-27T20:35:11.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.943+0000 7f66ab1ff700 1 -- 172.21.15.72:0/3288112976 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66a406ef00 msgr2=0x7f66a40a8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:11.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.943+0000 7f66ab1ff700 1 --2- 172.21.15.72:0/3288112976 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66a406ef00 0x7f66a40a8de0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f66900098f0 tx=0x7f6690009c00 comp rx=0 tx=0).stop 2023-07-27T20:35:11.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.943+0000 7f66ab1ff700 1 -- 172.21.15.72:0/3288112976 shutdown_connections 2023-07-27T20:35:11.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.943+0000 7f66ab1ff700 1 --2- 172.21.15.72:0/3288112976 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f66a406b900 0x7f66a4154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:11.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.943+0000 7f66ab1ff700 1 --2- 172.21.15.72:0/3288112976 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66a406ef00 0x7f66a40a8de0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:11.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.943+0000 7f66ab1ff700 1 -- 172.21.15.72:0/3288112976 >> 172.21.15.72:0/3288112976 conn(0x7f66a40c6800 msgr2=0x7f66a40c6c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:11.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.943+0000 7f66ab1ff700 1 -- 172.21.15.72:0/3288112976 shutdown_connections 2023-07-27T20:35:11.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.943+0000 7f66ab1ff700 1 -- 172.21.15.72:0/3288112976 wait complete. 2023-07-27T20:35:11.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.945+0000 7f66ab1ff700 1 Processor -- start 2023-07-27T20:35:11.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.945+0000 7f66ab1ff700 1 -- start start 2023-07-27T20:35:11.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.946+0000 7f66ab1ff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f66a406b520 0x7f66a40c5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:11.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.946+0000 7f66ab1ff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f66a406b900 0x7f66a41ead10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:11.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.946+0000 7f66ab1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66a406ef00 0x7f66a41eb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:11.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.946+0000 7f66ab1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a41eb790 con 0x7f66a406ef00 2023-07-27T20:35:11.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.946+0000 7f66ab1ff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a40a6de0 con 0x7f66a406b520 2023-07-27T20:35:11.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.946+0000 7f66ab1ff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a40a6210 con 0x7f66a406b900 2023-07-27T20:35:11.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.946+0000 7f66a979c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66a406ef00 0x7f66a41eb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:11.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.946+0000 7f66a979c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66a406ef00 0x7f66a41eb250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35850/0 (socket says 172.21.15.72:35850) 2023-07-27T20:35:11.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.946+0000 7f66a979c700 1 -- 172.21.15.72:0/3744189574 learned_addr learned my addr 172.21.15.72:0/3744189574 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-27T20:35:11.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.946+0000 7f66a8f9b700 1 --2- 172.21.15.72:0/3744189574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f66a406b520 0x7f66a40c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:11.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.946+0000 7f66a3fff700 1 --2- 172.21.15.72:0/3744189574 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f66a406b900 0x7f66a41ead10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:11.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.946+0000 7f66a979c700 1 -- 172.21.15.72:0/3744189574 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f66a406b900 msgr2=0x7f66a41ead10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:11.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.946+0000 7f66a979c700 1 --2- 172.21.15.72:0/3744189574 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f66a406b900 0x7f66a41ead10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:11.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.946+0000 7f66a979c700 1 -- 172.21.15.72:0/3744189574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f66a406b520 msgr2=0x7f66a40c5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:11.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.946+0000 7f66a979c700 1 --2- 172.21.15.72:0/3744189574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f66a406b520 0x7f66a40c5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:11.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.946+0000 7f66a979c700 1 -- 172.21.15.72:0/3744189574 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6690009550 con 0x7f66a406ef00 2023-07-27T20:35:11.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.946+0000 7f66a8f9b700 1 --2- 172.21.15.72:0/3744189574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f66a406b520 0x7f66a40c5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T20:35:11.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.947+0000 7f66a979c700 1 --2- 172.21.15.72:0/3744189574 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66a406ef00 0x7f66a41eb250 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f669c00efc0 tx=0x7f669c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:11.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.947+0000 7f66a17fa700 1 -- 172.21.15.72:0/3744189574 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669c009ea0 con 0x7f66a406ef00 2023-07-27T20:35:11.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.947+0000 7f66a17fa700 1 -- 172.21.15.72:0/3744189574 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669c00f040 con 0x7f66a406ef00 2023-07-27T20:35:11.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.947+0000 7f66a17fa700 1 -- 172.21.15.72:0/3744189574 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669c014480 con 0x7f66a406ef00 2023-07-27T20:35:11.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.947+0000 7f66ab1ff700 1 -- 172.21.15.72:0/3744189574 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a40a64b0 con 0x7f66a406ef00 2023-07-27T20:35:11.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.947+0000 7f66ab1ff700 1 -- 172.21.15.72:0/3744189574 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a40a6a70 con 0x7f66a406ef00 2023-07-27T20:35:11.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.948+0000 7f66ab1ff700 1 -- 172.21.15.72:0/3744189574 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a4074310 con 0x7f66a406ef00 2023-07-27T20:35:11.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.949+0000 7f66a17fa700 1 -- 172.21.15.72:0/3744189574 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f669c0145e0 con 0x7f66a406ef00 2023-07-27T20:35:11.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.950+0000 7f66a17fa700 1 --2- 172.21.15.72:0/3744189574 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f668806ace0 0x7f668806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-27T20:35:11.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.950+0000 7f66a17fa700 1 -- 172.21.15.72:0/3744189574 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 7412+0+0 (secure 0 0 0) 0x7f669c08a310 con 0x7f66a406ef00 2023-07-27T20:35:11.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.951+0000 7f66a8f9b700 1 --2- 172.21.15.72:0/3744189574 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f668806ace0 0x7f668806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-27T20:35:11.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.951+0000 7f66a8f9b700 1 --2- 172.21.15.72:0/3744189574 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f668806ace0 0x7f668806d1a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f6698000f60 tx=0x7f6698007ae0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T20:35:11.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:11.954+0000 7f66a17fa700 1 -- 172.21.15.72:0/3744189574 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f669c054e60 con 0x7f66a406ef00 2023-07-27T20:35:12.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:12.229+0000 7f66ab1ff700 1 -- 172.21.15.72:0/3744189574 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.testuser"} v 0) v1 -- 0x7f66a40c07f0 con 0x7f66a406ef00 2023-07-27T20:35:12.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:12.229+0000 7f66a17fa700 1 -- 172.21.15.72:0/3744189574 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.testuser"}]=0 v17) v1 ==== 85+0+245 (secure 0 0 0) 0x7f669c058480 con 0x7f66a406ef00 2023-07-27T20:35:12.217 INFO:teuthology.orchestra.run.smithi072.stdout:[client.testuser] 2023-07-27T20:35:12.217 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQD/1MJksfz1KhAAI7uUb03XO0YH1s+66oJJnA== 2023-07-27T20:35:12.217 INFO:teuthology.orchestra.run.smithi072.stdout: caps mds = "allow rw fsname=cephfs" 2023-07-27T20:35:12.217 INFO:teuthology.orchestra.run.smithi072.stdout: caps mon = "allow rw fsname=cephfs, allow rw fsname=cephfs2" 2023-07-27T20:35:12.218 INFO:teuthology.orchestra.run.smithi072.stdout: caps osd = "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2023-07-27T20:35:12.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:12.232+0000 7f66ab1ff700 1 -- 172.21.15.72:0/3744189574 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f668806ace0 msgr2=0x7f668806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:12.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:12.232+0000 7f66ab1ff700 1 --2- 172.21.15.72:0/3744189574 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f668806ace0 0x7f668806d1a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f6698000f60 tx=0x7f6698007ae0 comp rx=0 tx=0).stop 2023-07-27T20:35:12.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:12.232+0000 7f66ab1ff700 1 -- 172.21.15.72:0/3744189574 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66a406ef00 msgr2=0x7f66a41eb250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T20:35:12.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:12.232+0000 7f66ab1ff700 1 --2- 172.21.15.72:0/3744189574 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66a406ef00 0x7f66a41eb250 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f669c00efc0 tx=0x7f669c00c3a0 comp rx=0 tx=0).stop 2023-07-27T20:35:12.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:12.232+0000 7f66ab1ff700 1 -- 172.21.15.72:0/3744189574 shutdown_connections 2023-07-27T20:35:12.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:12.232+0000 7f66ab1ff700 1 --2- 172.21.15.72:0/3744189574 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66a406ef00 0x7f66a41eb250 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:12.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:12.232+0000 7f66ab1ff700 1 --2- 172.21.15.72:0/3744189574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f66a406b520 0x7f66a40c5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:12.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:12.232+0000 7f66ab1ff700 1 --2- 172.21.15.72:0/3744189574 >> [v2:172.21.15.173:6832/910681537,v1:172.21.15.173:6833/910681537] conn(0x7f668806ace0 0x7f668806d1a0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:12.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:12.232+0000 7f66ab1ff700 1 --2- 172.21.15.72:0/3744189574 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f66a406b900 0x7f66a41ead10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-27T20:35:12.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:12.232+0000 7f66ab1ff700 1 -- 172.21.15.72:0/3744189574 >> 172.21.15.72:0/3744189574 conn(0x7f66a40c6800 msgr2=0x7f66a4071a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T20:35:12.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:12.232+0000 7f66ab1ff700 1 -- 172.21.15.72:0/3744189574 shutdown_connections 2023-07-27T20:35:12.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-27T20:35:12.232+0000 7f66ab1ff700 1 -- 172.21.15.72:0/3744189574 wait complete. 2023-07-27T20:35:12.237 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2023-07-27T20:35:12.282 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.xNrp1XTxWe 2023-07-27T20:35:12.283 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-27T20:35:12.283 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/tmp/tmp.xNrp1XTxWe 2023-07-27T20:35:12.332 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/orchestra/run.py", line 309, in copy_and_close shutil.copyfileobj(src, fdst) File "/usr/lib/python3.8/shutil.py", line 199, in copyfileobj fsrc_read = fsrc.read AttributeError: 'RemoteProcess' object has no attribute 'read' 2023-07-27T20:35:22.317 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:35:22.323 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:35:52.433 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:35:52.439 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:36:22.589 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:36:22.596 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:36:52.707 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:36:52.713 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:37:22.825 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:37:22.831 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:37:53.025 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:37:53.030 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:38:23.142 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:38:23.148 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:38:53.260 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:38:53.266 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:39:23.383 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:39:23.388 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:39:53.502 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:39:53.508 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:40:23.617 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:40:23.623 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:40:53.740 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:40:53.746 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:41:23.929 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:41:23.935 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:41:54.127 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:41:54.133 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:42:24.275 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:42:24.280 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:42:54.397 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:42:54.402 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:43:24.527 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:43:24.533 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:43:54.659 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:43:54.664 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:44:24.790 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:44:24.795 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:44:54.970 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:44:54.976 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:45:25.144 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:45:25.149 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:45:55.366 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:45:55.372 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:46:25.546 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:46:25.551 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:46:55.743 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:46:55.748 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:47:25.932 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:47:25.937 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:47:56.130 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:47:56.136 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:48:26.302 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:48:26.308 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:48:56.433 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:48:56.439 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:49:26.621 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:49:26.627 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:49:56.761 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:49:56.766 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:50:26.925 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:50:26.931 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:50:57.039 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:50:57.044 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:51:27.244 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:51:27.250 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:51:57.359 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:51:57.365 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:52:27.539 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:52:27.545 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:52:57.645 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:52:57.650 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:53:27.759 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:53:27.764 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:53:57.956 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:53:57.961 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:54:28.078 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:54:28.083 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:54:58.259 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:54:58.264 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:55:28.365 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:55:28.370 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:55:58.480 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:55:58.485 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:56:28.643 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:56:28.649 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:56:58.823 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:56:58.828 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:57:29.003 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:57:29.009 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:57:59.176 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:57:59.181 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:58:29.306 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:58:29.311 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:58:59.478 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:58:59.485 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:59:29.692 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:59:29.697 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:59:59.798 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T20:59:59.804 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:00:29.913 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:00:29.919 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:01:00.028 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:01:00.033 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:01:30.225 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:01:30.231 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:02:00.373 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:02:00.379 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:02:30.504 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:02:30.510 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:03:00.676 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:03:00.682 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:03:30.807 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:03:30.813 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:04:00.979 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:04:00.985 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:04:31.176 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:04:31.182 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:05:01.283 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:05:01.288 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:05:31.472 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:05:31.478 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:06:01.653 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:06:01.659 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:06:31.759 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:06:31.764 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:07:01.956 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:07:01.961 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:07:32.095 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:07:32.101 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:08:02.309 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:08:02.316 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:08:32.423 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:08:32.428 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:09:02.563 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:09:02.570 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:09:32.760 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:09:32.766 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:10:02.874 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:10:02.880 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:10:33.005 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:10:33.011 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:11:03.185 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:11:03.191 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:11:33.300 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:11:33.306 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:12:03.429 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:12:03.435 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:12:33.602 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:12:33.607 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:13:03.789 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:13:03.794 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:13:33.902 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:13:33.907 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:14:04.067 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:14:04.089 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:14:34.272 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:14:34.277 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:15:04.486 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:15:04.491 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:15:34.674 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:15:34.679 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:16:04.788 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:16:04.793 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:16:34.927 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:16:34.932 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:17:05.141 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:17:05.146 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:17:35.347 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:17:35.353 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:18:05.459 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:18:05.464 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:18:35.573 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:18:35.578 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:19:05.778 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:19:05.783 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:19:36.000 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:19:36.006 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:20:06.155 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:20:06.160 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:20:36.335 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:20:36.340 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:21:06.507 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:21:06.513 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:21:36.713 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:21:36.718 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:22:06.818 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:22:06.823 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:22:36.949 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:22:36.954 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:23:07.137 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:23:07.142 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:23:37.301 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:23:37.307 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:24:07.481 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:24:07.487 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:24:37.662 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:24:37.667 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:25:07.771 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:25:07.777 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:25:38.005 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:25:38.010 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:26:08.113 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:26:08.118 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:26:38.276 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:26:38.281 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:27:08.399 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:27:08.404 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:27:38.522 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:27:38.527 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:28:08.642 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:28:08.648 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:28:38.839 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:28:38.844 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:29:09.012 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:29:09.018 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:29:39.126 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:29:39.131 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:30:09.246 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:30:09.251 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:30:39.387 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:30:39.393 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:31:09.505 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:31:09.510 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:31:39.699 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:31:39.704 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:32:09.838 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:32:09.843 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:32:40.026 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:32:40.031 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:33:10.157 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:33:10.162 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:33:40.354 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:33:40.359 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:34:10.535 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:34:10.540 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:34:40.773 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:34:40.778 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:35:10.888 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:35:10.894 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:35:41.071 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:35:41.076 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:36:11.184 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:36:11.189 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:36:41.366 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:36:41.371 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:37:11.521 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:37:11.527 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:37:41.727 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:37:41.733 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:38:11.932 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:38:11.938 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:38:42.080 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:38:42.086 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:39:12.194 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:39:12.200 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:39:42.374 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:39:42.380 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:40:12.555 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:40:12.561 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:40:42.703 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:40:42.709 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:41:12.826 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:41:12.831 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:41:42.965 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:41:42.971 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:42:13.079 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:42:13.084 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:42:43.200 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:42:43.206 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:43:13.300 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:43:13.306 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:43:43.486 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:43:43.492 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:44:13.609 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:44:13.615 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:44:43.789 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:44:43.795 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:45:13.952 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:45:13.962 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:45:44.067 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:45:44.074 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:46:14.280 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:46:14.286 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:46:44.476 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:46:44.482 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:47:14.640 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:47:14.645 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:47:44.802 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:47:44.807 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:48:14.974 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:48:14.979 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:48:45.094 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:48:45.099 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:49:15.291 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:49:15.297 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:49:45.488 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:49:45.494 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:50:15.643 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:50:15.649 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:50:45.756 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:50:45.761 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:51:15.882 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:51:15.888 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:51:46.066 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:51:46.071 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:52:16.246 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:52:16.251 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:52:46.434 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:52:46.439 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:53:16.573 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:53:16.578 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:53:46.769 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:53:46.774 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:54:16.875 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:54:16.880 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:54:47.247 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:54:47.252 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:55:17.376 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:55:17.382 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:55:47.498 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:55:47.503 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:56:17.670 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:56:17.676 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:56:47.875 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:56:47.880 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:57:18.047 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:57:18.052 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:57:48.235 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:57:48.240 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:58:18.350 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:58:18.355 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:58:48.505 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:58:48.510 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:59:18.760 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:59:18.766 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:59:48.924 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T21:59:48.929 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:00:19.121 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:00:19.127 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:00:49.310 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:00:49.316 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:01:19.423 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:01:19.429 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:01:49.613 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:01:49.618 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:02:19.769 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:02:19.774 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:02:49.957 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:02:49.963 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:03:20.130 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:03:20.135 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:03:50.244 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:03:50.251 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:04:20.615 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:04:20.621 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:04:50.745 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:04:50.750 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:05:20.869 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:05:20.875 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:05:50.980 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:05:50.985 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:06:21.186 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:06:21.192 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:06:51.292 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:06:51.298 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:07:21.472 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:07:21.477 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:07:51.595 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:07:51.600 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:08:21.726 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:08:21.731 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:08:51.914 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:08:51.920 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:09:22.136 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:09:22.142 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:09:52.325 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:09:52.330 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:10:22.464 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:10:22.469 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:10:52.603 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:10:52.608 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:11:22.733 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:11:22.739 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:11:52.896 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:11:52.902 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:12:23.093 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:12:23.099 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:12:53.283 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:12:53.289 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:13:23.397 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:13:23.403 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:13:53.594 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:13:53.599 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:14:23.723 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:14:23.729 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:14:53.937 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:14:53.943 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:15:24.053 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:15:24.058 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:15:54.208 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:15:54.213 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:16:24.389 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:16:24.395 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:16:54.544 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:16:54.549 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:17:24.691 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:17:24.696 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:17:54.829 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:17:54.834 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:18:24.939 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:18:24.945 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:18:55.056 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:18:55.062 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:19:25.244 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:19:25.250 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:19:55.417 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:19:55.438 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:20:25.606 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:20:25.612 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:20:55.784 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:20:55.789 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:21:25.900 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:21:25.905 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:21:56.058 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:21:56.065 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:22:26.255 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:22:26.260 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:22:56.446 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:22:56.452 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:23:26.568 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:23:26.573 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:23:56.690 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:23:56.696 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:24:26.801 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:24:26.808 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:24:56.909 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:24:56.914 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:25:27.026 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:25:27.032 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:25:57.141 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:25:57.146 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:26:27.264 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:26:27.269 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:26:57.405 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:26:57.411 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:27:27.521 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:27:27.527 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:27:57.632 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:27:57.638 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:28:27.764 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:28:27.770 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:28:57.937 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:28:57.942 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:29:28.092 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:29:28.097 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:29:58.257 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:29:58.262 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:30:28.420 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:30:28.425 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:30:58.585 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:30:58.591 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:31:28.799 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:31:28.805 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:31:58.989 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:31:58.994 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:32:29.136 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:32:29.141 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:32:59.334 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:32:59.339 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:33:29.507 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:33:29.512 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:33:59.662 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:33:59.668 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:34:29.860 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:34:29.865 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:35:00.024 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:35:00.030 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:35:30.188 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:35:30.193 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:36:00.402 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:36:00.407 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:36:30.516 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:36:30.522 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:37:00.623 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:37:00.628 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:37:30.769 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:37:30.774 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:38:00.925 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:38:00.930 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:38:31.097 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:38:31.102 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:39:01.267 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:39:01.274 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:39:31.393 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:39:31.398 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:40:01.581 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:40:01.586 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:40:31.712 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:40:31.718 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:41:01.826 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:41:01.832 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:41:32.032 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:41:32.038 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:42:02.163 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:42:02.169 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:42:32.286 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:42:32.291 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:43:02.440 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:43:02.445 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:43:32.654 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:43:32.662 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:44:02.859 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:44:02.865 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:44:32.981 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:44:32.986 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:45:03.179 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:45:03.184 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:45:33.318 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:45:33.324 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:46:03.432 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:46:03.438 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:46:33.571 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:46:33.577 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:47:03.760 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:47:03.766 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:47:33.867 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:47:33.872 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:48:04.030 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:48:04.035 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:48:34.194 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:48:34.199 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:49:04.400 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:49:04.405 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:49:34.581 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:49:34.640 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:50:04.745 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:50:04.750 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:50:34.852 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:50:34.857 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:51:04.989 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:51:04.995 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:51:35.162 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:51:35.167 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:52:05.301 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:52:05.306 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:52:35.415 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:52:35.420 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:53:05.578 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:53:05.583 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:53:35.710 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:53:35.715 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:54:05.883 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:54:05.889 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:54:36.071 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:54:36.076 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:55:06.268 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:55:06.274 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:55:36.448 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:55:36.453 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:56:06.611 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:56:06.616 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:56:36.817 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:56:36.822 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:57:06.988 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:57:06.993 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:57:37.161 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:57:37.166 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:58:07.317 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:58:07.322 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:58:37.514 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:58:37.519 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:59:07.710 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:59:07.716 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:59:37.882 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T22:59:37.888 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:00:07.993 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:00:07.998 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:00:38.159 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:00:38.165 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:01:08.349 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:01:08.354 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:01:38.471 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:01:38.476 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:02:08.627 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:02:08.632 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:02:38.782 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:02:38.788 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:03:08.954 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:03:08.959 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:03:39.201 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:03:39.206 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:04:09.381 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:04:09.386 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:04:39.486 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:04:39.492 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:05:09.617 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:05:09.622 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:05:39.764 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:05:39.769 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:06:09.904 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:06:09.909 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:06:40.124 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:06:40.129 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:07:10.289 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:07:10.295 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:07:40.429 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:07:40.434 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:08:10.592 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:08:10.597 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:08:40.739 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:08:40.745 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:09:10.861 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:09:10.867 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:09:41.042 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:09:41.047 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:10:11.221 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:10:11.227 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:10:41.395 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:10:41.400 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:11:11.558 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:11:11.563 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:11:41.688 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:11:41.694 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:12:11.886 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:12:11.891 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:12:41.991 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:12:41.996 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:13:12.159 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:13:12.164 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:13:42.279 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:13:42.284 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:14:12.390 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:14:12.395 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:14:42.588 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:14:42.594 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:15:12.752 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:15:12.757 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:15:42.923 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:15:42.928 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:16:13.045 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:16:13.050 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:16:43.242 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:16:43.247 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:17:13.381 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:17:13.387 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:17:43.587 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:17:43.592 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:18:13.695 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:18:13.700 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:18:43.839 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:18:43.844 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:19:14.044 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:19:14.050 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:19:44.225 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:19:44.231 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:20:14.423 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:20:14.431 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:20:44.538 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:20:44.543 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:21:14.683 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:21:14.689 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:21:44.855 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:21:44.862 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:22:15.035 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:22:15.040 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:22:45.155 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:22:45.162 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:23:15.347 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:23:15.352 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:23:45.527 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:23:45.532 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:24:15.691 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:24:15.697 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:24:45.798 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:24:45.804 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:25:15.917 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:25:15.923 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:25:46.094 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:25:46.099 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:26:16.274 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:26:16.280 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:26:46.455 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:26:46.460 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:27:16.585 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:27:16.591 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:27:46.783 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:27:46.788 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:28:16.996 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:28:17.002 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:28:47.203 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:28:47.208 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:29:17.376 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:29:17.381 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:29:47.575 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:29:47.582 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:30:17.683 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:30:17.688 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:30:47.890 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:30:47.895 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:31:18.030 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:31:18.035 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:31:48.195 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:31:48.201 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:32:18.302 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:32:18.308 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:32:48.477 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:32:48.483 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:33:18.633 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:33:18.638 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:33:48.764 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:33:48.769 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:34:18.921 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:34:18.926 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:34:49.052 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:34:49.058 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:35:19.193 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:35:19.198 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:35:49.374 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:35:49.379 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:36:19.547 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:36:19.553 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:36:49.653 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:36:49.658 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:37:19.801 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:37:19.807 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:37:49.948 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:37:49.954 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:38:20.145 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:38:20.150 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:38:50.335 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:38:50.340 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:39:20.516 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:39:20.522 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:39:50.722 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:39:50.728 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:40:20.830 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:40:20.836 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:40:50.967 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:40:50.972 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:41:21.149 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:41:21.154 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:41:51.255 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:41:51.261 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:42:21.461 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:42:21.466 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:42:51.651 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:42:51.656 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:43:21.831 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:43:21.836 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:43:51.987 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:43:51.993 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:44:22.118 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:44:22.123 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:44:52.241 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:44:52.246 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:45:22.380 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:45:22.385 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:45:52.552 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:45:52.558 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:46:22.666 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:46:22.672 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:46:52.839 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:46:52.844 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:47:23.061 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:47:23.067 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:47:53.251 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:47:53.256 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:48:23.440 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:48:23.446 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:48:53.622 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:48:53.627 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:49:23.785 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:49:23.790 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:49:53.949 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:49:53.955 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:50:24.071 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:50:24.076 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:50:54.193 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:50:54.198 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:51:24.308 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:51:24.314 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:51:54.498 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:51:54.503 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:52:24.696 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:52:24.701 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:52:54.843 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:52:54.849 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:53:24.957 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:53:24.962 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:53:55.130 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:53:55.136 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:54:25.230 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:54:25.235 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:54:55.347 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:54:55.353 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:55:25.497 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:55:25.503 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:55:55.669 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:55:55.675 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:56:25.809 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:56:25.816 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:56:55.989 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:56:55.995 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:57:26.186 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:57:26.192 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:57:56.317 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:57:56.322 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:58:26.505 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:58:26.512 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:58:56.695 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:58:56.700 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:59:26.909 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:59:26.914 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:59:57.081 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T23:59:57.086 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:00:27.229 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:00:27.237 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:00:57.351 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:00:57.356 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:01:27.465 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:01:27.471 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:01:57.647 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:01:57.653 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:02:27.795 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:02:27.800 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:02:57.917 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:02:57.922 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:03:28.026 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:03:28.031 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:03:58.161 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:03:58.167 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:04:28.358 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:04:28.365 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:04:58.497 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:04:58.502 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:05:28.702 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:05:28.708 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:05:58.891 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:05:58.896 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:06:29.089 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:06:29.096 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:06:59.278 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:06:59.285 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:07:29.441 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:07:29.447 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:07:59.565 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:07:59.570 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:08:29.752 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:08:29.763 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:08:59.875 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:08:59.880 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:09:30.081 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:09:30.087 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:10:00.270 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:10:00.275 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:10:30.458 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:10:30.463 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:11:00.621 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:11:00.627 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:11:30.761 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:11:30.767 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:12:00.959 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:12:00.964 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:12:31.130 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:12:31.135 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:13:01.277 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:13:01.283 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:13:31.392 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:13:31.397 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:14:01.530 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:14:01.535 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:14:31.652 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:14:31.657 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:15:01.849 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:15:01.854 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:15:31.963 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:15:31.969 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:16:02.161 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:16:02.166 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:16:32.284 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:16:32.290 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:17:02.464 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:17:02.470 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:17:32.578 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:17:32.584 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:18:02.684 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:18:02.689 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:18:32.873 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:18:32.879 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:19:03.070 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:19:03.075 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:19:33.259 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:19:33.264 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:20:03.431 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:20:03.438 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:20:33.619 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:20:33.625 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:21:03.726 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:21:03.732 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:21:33.881 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:21:33.887 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:22:04.036 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:22:04.042 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:22:34.175 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:22:34.180 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:23:04.357 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:23:04.363 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:23:34.545 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:23:34.550 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:24:04.651 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:24:04.657 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:24:34.758 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:24:34.763 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:25:04.870 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:25:04.875 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:25:34.976 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:25:34.982 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:26:05.156 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:26:05.162 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:26:35.286 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:26:35.292 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:27:05.442 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:27:05.448 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:27:35.606 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:27:35.611 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:28:05.712 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:28:05.718 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:28:35.826 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:28:35.831 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:29:06.006 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:29:06.011 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:29:36.203 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:29:36.209 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:30:06.384 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:30:06.389 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:30:36.557 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:30:36.563 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:31:06.762 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:31:06.767 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:31:36.883 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:31:36.889 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:32:07.064 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:32:07.070 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:32:37.203 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:32:37.208 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:33:07.367 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:33:07.373 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:33:37.481 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:33:37.486 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:34:07.603 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:34:07.609 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:34:37.777 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:34:37.782 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:35:07.907 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:35:07.912 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:35:38.096 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:35:38.101 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:36:08.310 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:36:08.316 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:36:38.413 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:36:38.418 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:37:08.522 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:37:08.528 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:37:38.684 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:37:38.689 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:38:08.856 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:38:08.862 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:38:38.986 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:38:38.992 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:39:09.191 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:39:09.196 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:39:39.394 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:39:39.399 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:40:09.516 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:40:09.521 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:40:39.704 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:40:39.710 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:41:09.825 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:41:09.830 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:41:40.004 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:41:40.010 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:42:10.201 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:42:10.207 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:42:40.323 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:42:40.328 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:43:10.486 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:43:10.492 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:43:40.650 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:43:40.655 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:44:10.846 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:44:10.851 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:44:40.960 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:44:40.966 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:45:11.073 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:45:11.078 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:45:41.254 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:45:41.259 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:46:11.426 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:46:11.431 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:46:41.580 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:46:41.586 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:47:11.770 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:47:11.775 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:47:41.916 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:47:41.922 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:48:12.113 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:48:12.118 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:48:42.236 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:48:42.242 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:49:12.523 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:49:12.530 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:49:42.670 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:49:42.676 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:50:12.783 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:50:12.788 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:50:42.938 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:50:42.944 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:51:13.119 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:51:13.124 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:51:43.315 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:51:43.321 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:52:13.639 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:52:13.645 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:52:43.761 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:52:43.767 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:53:13.916 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:53:13.930 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:53:44.114 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:53:44.119 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:54:14.251 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:54:14.257 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:54:44.367 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:54:44.373 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:55:14.487 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:55:14.493 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:55:44.692 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:55:44.698 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:56:14.823 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:56:14.828 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:56:44.982 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:56:44.987 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:57:15.093 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:57:15.098 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:57:45.206 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:57:45.212 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:58:15.388 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:58:15.393 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:58:45.593 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:58:45.598 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:59:15.715 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:59:15.720 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:59:45.862 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T00:59:45.867 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:00:16.043 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:00:16.048 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:00:46.215 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:00:46.221 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:01:16.349 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:01:16.354 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:01:46.527 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:01:46.532 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:02:16.708 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:02:16.713 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:02:46.839 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:02:46.844 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:03:16.961 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:03:16.966 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:03:47.067 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:03:47.072 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:04:17.240 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:04:17.245 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:04:47.386 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:04:47.391 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:05:17.534 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:05:17.539 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:05:47.723 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:05:47.728 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:06:17.828 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:06:17.833 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:06:48.017 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:06:48.023 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:07:18.165 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:07:18.170 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:07:48.362 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:07:48.367 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:08:18.517 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:08:18.522 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:08:48.731 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:08:48.736 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:09:18.911 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:09:18.916 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:09:49.075 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:09:49.081 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:10:19.222 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:10:19.227 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:10:49.411 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:10:49.416 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:11:19.608 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:11:19.613 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:11:49.764 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:11:49.770 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:12:19.885 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:12:19.891 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:12:50.025 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:12:50.030 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:13:20.155 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:13:20.160 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:13:50.345 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:13:50.350 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:14:20.500 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:14:20.506 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:14:50.690 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:14:50.695 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:15:20.878 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:15:20.883 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:15:51.067 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:15:51.073 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:16:21.256 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:16:21.262 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:16:51.386 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:16:51.391 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:17:21.492 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:17:21.497 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:17:51.722 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:17:51.727 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:18:21.920 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:18:21.926 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:18:52.100 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:18:52.105 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:19:22.239 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:19:22.245 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:19:52.479 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:19:52.484 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:20:22.609 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:20:22.614 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:20:52.731 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:20:52.737 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:21:22.937 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:21:22.943 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:21:53.127 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:21:53.132 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:22:23.299 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:22:23.305 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:22:53.413 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:22:53.418 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:23:23.523 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:23:23.528 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:23:53.683 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:23:53.688 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:24:23.838 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:24:23.844 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:24:53.955 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:24:53.961 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:25:24.124 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:25:24.129 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:25:54.240 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:25:54.245 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:26:24.394 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:26:24.399 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:26:54.583 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:26:54.588 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:27:24.691 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:27:24.697 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:27:54.860 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:27:54.865 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:28:24.999 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:28:25.004 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:28:55.146 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:28:55.152 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:29:25.318 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:29:25.323 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:29:55.532 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:29:55.537 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:30:25.633 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:30:25.639 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:30:55.760 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:30:55.765 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:31:25.890 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:31:25.895 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:31:56.029 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:31:56.034 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:32:26.201 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:32:26.207 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:32:56.390 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:32:56.395 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:33:26.579 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:33:26.584 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:33:56.725 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:33:56.730 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:34:26.939 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:34:26.982 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:34:57.079 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:34:57.084 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:35:27.209 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:35:27.214 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:35:57.390 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:35:57.396 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:36:27.537 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:36:27.542 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:36:57.743 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:36:57.748 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:37:27.865 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:37:27.870 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:37:58.004 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:37:58.009 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:38:28.176 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:38:28.181 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:38:58.381 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:38:58.386 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:39:28.546 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:39:28.551 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:39:58.654 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:39:58.659 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:40:28.757 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:40:28.762 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:40:58.930 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:40:58.935 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:41:29.094 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:41:29.099 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:41:59.206 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:41:59.211 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:42:29.322 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:42:29.327 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:42:59.503 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:42:59.508 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:43:29.700 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:43:29.705 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:43:59.822 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:43:59.827 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:44:29.969 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:44:29.974 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:45:00.159 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:45:00.164 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:45:30.272 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:45:30.277 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:46:00.459 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:46:00.464 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:46:30.662 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:46:30.667 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:47:00.866 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:47:00.871 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:47:31.011 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:47:31.016 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:48:01.129 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:48:01.135 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:48:31.302 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:48:31.308 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:49:01.481 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:49:01.487 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:49:31.602 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:49:31.607 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:50:01.789 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:50:01.794 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:50:31.912 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:50:31.917 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:51:02.083 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:51:02.088 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:51:32.212 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:51:32.217 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:52:02.399 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:52:02.405 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:52:32.604 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:52:32.609 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:53:02.800 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:53:02.805 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:53:32.905 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:53:32.910 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:54:03.076 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:54:03.081 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:54:33.229 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:54:33.234 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:55:03.400 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:55:03.406 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:55:33.521 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:55:33.527 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:56:03.726 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:56:03.731 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:56:33.905 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:56:33.911 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:57:04.118 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:57:04.123 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:57:34.240 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:57:34.245 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:58:04.436 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:58:04.441 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:58:34.543 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:58:34.548 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:59:04.728 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:59:04.733 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:59:34.833 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T01:59:34.839 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:00:04.971 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:00:04.976 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:00:35.160 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:00:35.166 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:01:05.281 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:01:05.286 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:01:35.437 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:01:35.443 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:02:05.633 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:02:05.638 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:02:35.796 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:02:35.801 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:03:05.985 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:03:05.990 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:03:36.106 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:03:36.111 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:04:06.236 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:04:06.241 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:04:36.424 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:04:36.430 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:05:06.571 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:05:06.576 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:05:36.751 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:05:36.756 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:06:06.855 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:06:06.861 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:06:37.103 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:06:37.109 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:07:07.223 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:07:07.229 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:07:37.328 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:07:37.333 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:08:07.483 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:08:07.488 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:08:37.591 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:08:37.596 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:09:07.759 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:09:07.765 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:09:37.907 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:09:37.912 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:10:08.086 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:10:08.091 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:10:38.191 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:10:38.196 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:11:08.337 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:11:08.342 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:11:38.448 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:11:38.453 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:12:08.547 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:12:08.552 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:12:38.669 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:12:38.674 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:13:08.799 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:13:08.804 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:13:38.949 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:13:38.954 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:14:09.101 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:14:09.107 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:14:39.223 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:14:39.228 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:15:09.411 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:15:09.417 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:15:39.584 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:15:39.589 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:16:09.704 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:16:09.710 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:16:39.818 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:16:39.823 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:17:09.973 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:17:09.978 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:17:40.162 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:17:40.167 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:18:10.266 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:18:10.271 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:18:40.396 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:18:40.401 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:19:10.534 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:19:10.540 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:19:40.673 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:19:40.679 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:20:10.851 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:20:10.856 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:20:40.978 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:20:40.984 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:21:11.152 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:21:11.158 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:21:41.278 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:21:41.283 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:22:11.489 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:22:11.494 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:22:41.620 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:22:41.625 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:23:11.817 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:23:11.823 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:23:42.015 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:23:42.020 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:24:12.204 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:24:12.211 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:24:42.352 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:24:42.357 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:25:12.458 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:25:12.463 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:25:42.589 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:25:42.595 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:26:12.753 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:26:12.758 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:26:42.892 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:26:42.898 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:27:13.081 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:27:13.086 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:27:43.246 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:27:43.251 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:28:13.410 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:28:13.415 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:28:43.532 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:28:43.538 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:29:13.654 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:29:13.659 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:29:43.777 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:29:43.782 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:30:13.933 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:30:13.938 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:30:44.113 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:30:44.118 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:31:14.286 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:31:14.291 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:31:44.475 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:31:44.480 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:32:14.672 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:32:14.677 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:32:44.819 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:32:44.825 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:33:15.008 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:33:15.013 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:33:45.223 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:33:45.228 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:34:15.347 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:34:15.352 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:34:45.466 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:34:45.472 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:35:15.590 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:35:15.595 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:35:45.786 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:35:45.792 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:36:15.975 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:36:15.980 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:36:46.189 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:36:46.194 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:37:16.377 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:37:16.382 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:37:46.533 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:37:46.539 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:38:16.738 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:38:16.743 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:38:47.076 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:38:47.082 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:39:17.207 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:39:17.212 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:39:47.320 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:39:47.325 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:40:17.434 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:40:17.439 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:40:47.615 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:40:47.620 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:41:17.812 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:41:17.817 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:41:47.933 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:41:47.939 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:42:18.139 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:42:18.144 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:42:48.302 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:42:48.307 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:43:18.616 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:43:18.622 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:43:48.771 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:43:48.777 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:44:18.893 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:44:18.898 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:44:49.073 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:44:49.079 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:45:19.207 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:45:19.212 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:45:49.359 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:45:49.364 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:46:19.538 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:46:19.544 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:46:49.732 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:46:49.737 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:47:19.858 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:47:19.863 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:47:50.013 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:47:50.018 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:48:20.185 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:48:20.190 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:48:50.374 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:48:50.379 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:49:20.520 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:49:20.526 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:49:50.702 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:49:50.707 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:50:20.874 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:50:20.879 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:50:51.037 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:50:51.043 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:51:21.209 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:51:21.214 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:51:51.414 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:51:51.419 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:52:21.528 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:52:21.533 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:52:51.683 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:52:51.688 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:53:21.880 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:53:21.885 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:53:52.068 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:53:52.074 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:54:22.259 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:54:22.264 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:54:52.465 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:54:52.470 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:55:22.645 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:55:22.650 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:55:52.793 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:55:52.798 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:56:22.948 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:56:22.954 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:56:53.104 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:56:53.110 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:57:23.310 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:57:23.316 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:57:53.440 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:57:53.445 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:58:23.571 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:58:23.576 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:58:53.752 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:58:53.757 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:59:23.900 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:59:23.905 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:59:54.114 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T02:59:54.119 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:00:24.319 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:00:24.325 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:00:54.475 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:00:54.480 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:01:24.665 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:01:24.670 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:01:54.845 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:01:54.851 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:02:25.043 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:02:25.048 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:02:55.153 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:02:55.160 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:03:25.347 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:03:25.352 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:03:55.543 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:03:55.548 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:04:25.740 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:04:25.745 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:04:55.896 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:04:55.902 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:05:26.086 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:05:26.091 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:05:56.216 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:05:56.221 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:06:26.405 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:06:26.410 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:06:56.577 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:06:56.582 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:07:26.691 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:07:26.696 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:07:56.807 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:07:56.813 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:08:26.924 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:08:26.929 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:08:57.109 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:08:57.115 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:09:27.224 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:09:27.230 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:09:57.405 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:09:57.410 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:10:27.576 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:10:27.582 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:10:57.684 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:10:57.689 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:11:28.106 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:11:28.111 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:11:58.219 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:11:58.224 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:12:28.337 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:12:28.342 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:12:58.505 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:12:58.510 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:13:28.702 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:13:28.708 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:13:58.874 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:13:58.880 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:14:28.988 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:14:28.994 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:14:59.093 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:14:59.098 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:15:29.291 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:15:29.297 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:15:59.479 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:15:59.484 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:16:29.601 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:16:29.607 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:16:59.714 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:16:59.720 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:17:29.820 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:17:29.826 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:18:00.008 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:18:00.013 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:18:30.197 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:18:30.203 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:19:00.377 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:19:00.383 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:19:30.574 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:19:30.580 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:20:00.679 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:20:00.684 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:20:30.810 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:20:30.815 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:21:00.926 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:21:00.931 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:21:31.037 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:21:31.042 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:22:01.150 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:22:01.155 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:22:31.339 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:22:31.345 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:23:01.445 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:23:01.451 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:23:31.633 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:23:31.638 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:24:01.797 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:24:01.802 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:24:31.961 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:24:31.966 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:25:02.074 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:25:02.079 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:25:32.179 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:25:32.185 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:26:02.393 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:26:02.398 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:26:32.506 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:26:32.512 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:27:02.670 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:27:02.675 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:27:32.884 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:27:32.889 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:28:03.015 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:28:03.020 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:28:33.146 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:28:33.151 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:29:03.261 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:29:03.266 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:29:33.384 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:29:33.389 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:30:03.509 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:30:03.515 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:30:33.646 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:30:33.651 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:31:03.785 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:31:03.790 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:31:33.892 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:31:33.906 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:32:04.097 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:32:04.103 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:32:34.262 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:32:34.267 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:33:04.434 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:33:04.439 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:33:34.590 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:33:34.595 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:34:04.695 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:34:04.700 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:34:34.910 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:34:34.915 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:35:05.124 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:35:05.129 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:35:35.304 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:35:35.309 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:36:05.494 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:36:05.499 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:36:35.650 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:36:35.655 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:37:05.788 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:37:05.794 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:37:35.977 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:37:35.982 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:38:06.115 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:38:06.120 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:38:36.221 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:38:36.227 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:39:06.344 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:39:06.350 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:39:36.575 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:39:36.580 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:40:06.712 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:40:06.717 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:40:36.919 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:40:36.924 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:41:07.075 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:41:07.080 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:41:37.272 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:41:37.277 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:42:07.478 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:42:07.483 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:42:37.658 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:42:37.664 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:43:07.864 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:43:07.870 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:43:38.054 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:43:38.059 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:44:08.268 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:44:08.276 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:44:38.624 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:44:38.629 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:45:08.738 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:45:08.743 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:45:38.952 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:45:38.958 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:46:09.115 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:46:09.121 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:46:39.322 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:46:39.327 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:47:09.509 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:47:09.515 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:47:39.699 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:47:39.705 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:48:09.813 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:48:09.819 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:48:39.938 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:48:39.943 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:49:10.058 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:49:10.063 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:49:40.196 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:49:40.201 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:50:10.306 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:50:10.311 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:50:40.501 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:50:40.506 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:51:10.688 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:51:10.693 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:51:40.810 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:51:40.816 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:52:11.000 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:52:11.005 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:52:41.189 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:52:41.194 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:53:11.303 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:53:11.309 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:53:41.425 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:53:41.430 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:54:11.589 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:54:11.594 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:54:41.770 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:54:41.775 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:55:11.942 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:55:11.947 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:55:42.123 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:55:42.128 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:56:12.245 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:56:12.250 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:56:42.434 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:56:42.439 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:57:12.589 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:57:12.594 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:57:42.803 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:57:42.808 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:58:12.966 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:58:12.972 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:58:43.122 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:58:43.127 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:59:13.278 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:59:13.283 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:59:43.451 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T03:59:43.456 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:00:13.606 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:00:13.611 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:00:43.720 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:00:43.726 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:01:13.875 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:01:13.880 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:01:44.005 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:01:44.011 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:02:14.145 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:02:14.150 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:02:44.251 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:02:44.256 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:03:14.448 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:03:14.453 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:03:44.637 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:03:44.642 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:04:14.760 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:04:14.765 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:04:44.924 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:04:44.929 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:05:15.078 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:05:15.084 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:05:45.276 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:05:45.281 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:06:15.456 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:06:15.462 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:06:45.562 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:06:45.568 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:07:15.760 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:07:15.765 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:07:45.874 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:07:45.879 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:08:15.997 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:08:16.002 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:08:46.105 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:08:46.110 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:09:16.232 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:09:16.237 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:09:46.347 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:09:46.353 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:10:16.477 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:10:16.483 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:10:46.600 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:10:46.606 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:11:16.739 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:11:16.744 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:11:46.844 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:11:46.849 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:12:16.983 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:12:16.989 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:12:47.086 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:12:47.091 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:13:17.195 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:13:17.200 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:13:47.325 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:13:47.330 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:14:17.437 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:14:17.443 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:14:47.556 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:14:47.561 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:15:17.685 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:15:17.690 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:15:47.790 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:15:47.795 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:16:17.897 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:16:17.902 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:16:48.035 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:16:48.040 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:17:18.150 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:17:18.155 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:17:48.253 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:17:48.259 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:18:18.442 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:18:18.448 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:18:48.599 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:18:48.604 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:19:18.795 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:19:18.801 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:19:48.914 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:19:48.920 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:20:19.089 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:20:19.095 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:20:49.278 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:20:49.283 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:21:19.484 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:21:19.490 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:21:49.606 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:21:49.612 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:22:19.737 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:22:19.742 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:22:49.908 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:22:49.914 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:23:20.031 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:23:20.036 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:23:50.221 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:23:50.226 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:24:20.326 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:24:20.333 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:24:50.441 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:24:50.447 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:25:20.620 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:25:20.626 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:25:50.818 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:25:50.823 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:26:20.959 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:26:20.964 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:26:51.064 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:26:51.069 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:27:21.262 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:27:21.267 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:27:51.426 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:27:51.431 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:28:21.640 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:28:21.645 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:28:51.754 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:28:51.759 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:29:21.869 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:29:21.874 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:29:51.982 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:29:51.987 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:30:22.093 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:30:22.098 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:30:52.211 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:30:52.216 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:31:22.327 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:31:22.332 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:31:52.455 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:31:52.460 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:32:22.569 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:32:22.575 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:32:52.677 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:32:52.682 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:33:22.789 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:33:22.794 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:33:52.912 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:33:52.917 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:34:23.018 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:34:23.023 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:34:53.123 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:34:53.129 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:35:23.236 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:35:23.241 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:35:53.360 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:35:53.365 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:36:23.473 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:36:23.478 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:36:53.584 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:36:53.590 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:37:23.698 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:37:23.704 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:37:53.810 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:37:53.816 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:38:23.937 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:38:23.942 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:38:54.044 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:38:54.049 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:39:24.167 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:39:24.173 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:39:54.362 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:39:54.367 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:40:24.558 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:40:24.563 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:40:54.729 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:40:54.734 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:41:24.856 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:41:24.861 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:41:54.971 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:41:54.976 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:42:25.093 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:42:25.099 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:42:55.223 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:42:55.229 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:43:25.345 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:43:25.350 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:43:55.461 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:43:55.467 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:44:25.593 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:44:25.598 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:44:55.708 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:44:55.714 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:45:25.814 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:45:25.820 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:45:55.920 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:45:55.925 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:46:26.041 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:46:26.047 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:46:56.154 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:46:56.159 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:47:26.273 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:47:26.279 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:47:56.398 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:47:56.403 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:48:26.520 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:48:26.526 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:48:56.658 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:48:56.664 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:49:26.789 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:49:26.794 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:49:56.919 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:49:56.925 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:50:27.025 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:50:27.030 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:50:57.129 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:50:57.134 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:51:27.252 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:51:27.257 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:51:57.391 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:51:57.397 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:52:27.571 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:52:27.576 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:52:57.751 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:52:57.757 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:53:27.865 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:53:27.870 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:53:58.036 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:53:58.042 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:54:28.159 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:54:28.164 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:54:58.280 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:54:58.286 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:55:28.386 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:55:28.391 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:55:58.500 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:55:58.506 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:56:28.623 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:56:28.628 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:56:58.748 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:56:58.753 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:57:28.866 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:57:28.871 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:57:58.972 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:57:58.977 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:58:29.076 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:58:29.081 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:58:59.198 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:58:59.204 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:59:29.305 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:59:29.310 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:59:59.460 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T04:59:59.465 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:00:29.572 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:00:29.577 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:00:59.696 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:00:59.701 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:01:29.801 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:01:29.807 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:01:59.931 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:01:59.936 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:02:30.038 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:02:30.043 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:03:00.156 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:03:00.161 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:03:30.271 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:03:30.277 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:04:00.372 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:04:00.378 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:04:30.490 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:04:30.495 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:05:00.606 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:05:00.611 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:05:30.715 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:05:30.720 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:06:00.834 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:06:00.839 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:06:30.948 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:06:30.953 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:07:01.071 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:07:01.077 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:07:31.269 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:07:31.274 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:08:01.465 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:08:01.470 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:08:31.588 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:08:31.593 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:09:01.777 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:09:01.782 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:09:31.957 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:09:31.962 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:10:02.096 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:10:02.101 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:10:32.310 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:10:32.315 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:11:02.493 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:11:02.498 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:11:32.700 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:11:32.706 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:12:02.873 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:12:02.878 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:12:33.071 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:12:33.077 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:13:03.195 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:13:03.201 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:13:33.410 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:13:33.416 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:14:03.525 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:14:03.530 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:14:33.723 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:14:33.729 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:15:03.913 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:15:03.918 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:15:34.054 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:15:34.059 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:16:04.159 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:16:04.165 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:16:34.266 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:16:34.271 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:17:04.389 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:17:04.394 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:17:34.504 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:17:34.509 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:18:04.618 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:18:04.623 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:18:34.745 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:18:34.751 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:19:04.854 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:19:04.859 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:19:34.962 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:19:34.967 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:20:05.105 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:20:05.110 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:20:35.233 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:20:35.239 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:21:05.346 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:21:05.351 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:21:35.472 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:21:35.477 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:22:05.588 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:22:05.593 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:22:35.716 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:22:35.722 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:23:05.824 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:23:05.830 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:23:35.955 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:23:35.960 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:24:06.061 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:24:06.066 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:24:36.183 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:24:36.188 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:25:06.299 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:25:06.304 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:25:36.420 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:25:36.425 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:26:06.543 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:26:06.549 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:26:36.665 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:26:36.671 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:27:06.780 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:27:06.785 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:27:36.894 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:27:36.899 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:28:07.091 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:28:07.096 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:28:37.198 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:28:37.203 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:29:07.304 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:29:07.309 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:29:37.409 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:29:37.414 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:30:07.516 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:30:07.522 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:30:37.648 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:30:37.653 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:31:07.748 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:31:07.753 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:31:37.876 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:31:37.881 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:32:07.990 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:32:07.995 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:32:38.112 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:32:38.117 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:33:08.234 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:33:08.239 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:33:38.357 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:33:38.362 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:34:08.482 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:34:08.487 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:34:38.612 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:34:38.617 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:35:08.717 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:35:08.723 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:35:38.831 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:35:38.837 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:36:08.953 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:36:08.959 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:36:39.068 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:36:39.073 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:37:09.257 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:37:09.262 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:37:39.365 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:37:39.371 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:38:09.477 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:38:09.482 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:38:39.600 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:38:39.605 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:39:09.715 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:39:09.721 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:39:39.821 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:39:39.827 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:40:09.951 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:40:09.956 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:40:40.081 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:40:40.086 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:41:10.204 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:41:10.209 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:41:40.393 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:41:40.399 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:42:10.516 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:42:10.521 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:42:40.747 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:42:40.752 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:43:10.860 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:43:10.866 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:43:40.978 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:43:40.984 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:44:11.089 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:44:11.094 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:44:41.210 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:44:41.215 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:45:11.357 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:45:11.362 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:45:41.461 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:45:41.466 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:46:11.574 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:46:11.579 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:46:41.682 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:46:41.688 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:47:11.789 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:47:11.794 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:47:41.916 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:47:41.921 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:48:12.027 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:48:12.032 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:48:42.133 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:48:42.138 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:49:12.313 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:49:12.318 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:49:42.484 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:49:42.489 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:50:12.630 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:50:12.636 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:50:42.828 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:50:42.833 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:51:12.966 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:51:12.972 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:51:43.146 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:51:43.152 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:52:13.260 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:52:13.266 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:52:43.456 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:52:43.462 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:53:13.570 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:53:13.575 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:53:43.683 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:53:43.688 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:54:13.888 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:54:13.893 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:54:44.018 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:54:44.023 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:55:14.132 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:55:14.137 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:55:44.260 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:55:44.265 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:56:14.367 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:56:14.372 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:56:44.483 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:56:44.488 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:57:14.591 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:57:14.597 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:57:44.732 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:57:44.737 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:58:14.837 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:58:14.843 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:58:44.943 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:58:44.948 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:59:15.048 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:59:15.054 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:59:45.155 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T05:59:45.161 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:00:15.281 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:00:15.287 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:00:45.414 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:00:45.419 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:01:15.645 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:01:15.651 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:01:45.756 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:01:45.761 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:02:15.863 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:02:15.868 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:02:45.978 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:02:45.983 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:03:16.098 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:03:16.103 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:03:46.214 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:03:46.219 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:04:16.315 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:04:16.320 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:04:46.425 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:04:46.430 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:05:16.532 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:05:16.537 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:05:46.648 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:05:46.653 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:06:16.791 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:06:16.797 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:06:46.896 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:06:46.902 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:07:17.018 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:07:17.024 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:07:47.141 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:07:47.146 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:08:17.265 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:08:17.270 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:08:47.400 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:08:47.406 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:09:17.508 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:09:17.513 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:09:47.620 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:09:47.626 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:10:17.735 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:10:17.740 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:10:47.859 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:10:47.864 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:11:17.983 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:11:17.989 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:11:48.093 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:11:48.098 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:12:18.206 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:12:18.211 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:12:48.321 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:12:48.326 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:13:18.428 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:13:18.433 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:13:48.540 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:13:48.545 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:14:18.663 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:14:18.668 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:14:48.779 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:14:48.784 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:15:18.921 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:15:18.926 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:15:49.021 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:15:49.026 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:16:19.151 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:16:19.157 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:16:49.281 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:16:49.287 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:17:19.409 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:17:19.415 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:17:49.517 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:17:49.522 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:18:19.622 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:18:19.627 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:18:49.754 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:18:49.759 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:19:19.877 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:19:19.882 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:19:49.983 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:19:49.989 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:20:20.096 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:20:20.102 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:20:50.297 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:20:50.303 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:21:20.487 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:21:20.492 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:21:50.644 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:21:50.649 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:22:20.792 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:22:20.797 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:22:51.033 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:22:51.038 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:23:21.142 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:23:21.147 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:23:51.255 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:23:51.261 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:24:21.362 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:24:21.367 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:24:51.559 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:24:51.565 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:25:21.724 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:25:21.730 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:25:51.897 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:25:51.902 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:26:22.004 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:26:22.011 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:26:52.158 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:26:52.164 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:27:22.273 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:27:22.279 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:27:52.378 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:27:52.384 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:28:22.524 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:28:22.529 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:28:52.659 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:28:52.664 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:29:22.772 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:29:22.778 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:29:52.893 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:29:52.898 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:30:23.001 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:30:23.007 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:30:53.107 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:30:53.113 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:31:23.213 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:31:23.218 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:31:53.319 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:31:53.325 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:32:23.433 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:32:23.438 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:32:53.563 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:32:53.569 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:33:23.681 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:33:23.686 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:33:53.792 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:33:53.797 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:34:23.898 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:34:23.904 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:34:54.020 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:34:54.025 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:35:24.142 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:35:24.147 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:35:54.390 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:35:54.396 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:36:24.498 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:36:24.504 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:36:54.610 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:36:54.616 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:37:24.732 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:37:24.738 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:37:54.855 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:37:54.860 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:38:24.969 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:38:24.975 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:38:55.167 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:38:55.172 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:39:25.348 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:39:25.353 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:39:55.535 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:39:55.541 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:40:25.716 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:40:25.721 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:40:55.906 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:40:55.911 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:41:26.019 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:41:26.024 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:41:56.209 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:41:56.215 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:42:26.372 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:42:26.378 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:42:56.536 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:42:56.541 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:43:26.654 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:43:26.659 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:43:56.772 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:43:56.778 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:44:26.967 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:44:26.973 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:44:57.083 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:44:57.088 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:45:27.281 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:45:27.286 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:45:57.452 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:45:57.458 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:46:27.625 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:46:27.631 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:46:57.797 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:46:57.802 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:47:27.986 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:47:27.992 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:47:58.108 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:47:58.114 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:48:28.306 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:48:28.311 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:48:58.486 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:48:58.491 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:49:28.608 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:49:28.614 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:49:58.807 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:49:58.812 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:50:28.995 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:50:29.001 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:50:59.118 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:50:59.124 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:51:29.308 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:51:29.314 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:51:59.521 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:51:59.526 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:52:29.702 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:52:29.708 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:52:59.849 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:52:59.854 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:53:30.014 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:53:30.019 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:54:00.153 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:54:00.158 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:54:30.350 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:54:30.356 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:55:00.548 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:55:00.553 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:55:30.662 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:55:30.667 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:56:00.843 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:56:00.848 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:56:31.057 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:56:31.063 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:57:01.212 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:57:01.218 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:57:31.394 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:57:31.399 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:58:01.766 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:58:01.772 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:58:31.963 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:58:31.969 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:59:02.153 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:59:02.158 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:59:32.342 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T06:59:32.396 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:00:02.530 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:00:02.535 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:00:32.702 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:00:32.708 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:01:02.900 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:01:02.906 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:01:33.040 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:01:33.045 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:02:03.179 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:02:03.185 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:02:33.293 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:02:33.299 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:03:03.490 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:03:03.496 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:03:33.612 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:03:33.618 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:04:03.736 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:04:03.751 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:04:33.941 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:04:33.948 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:05:04.105 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:05:04.111 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:05:34.212 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:05:34.218 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:06:04.325 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:06:04.330 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:06:34.431 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:06:34.437 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:07:04.555 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:07:04.562 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:07:34.671 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:07:34.677 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:08:04.781 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:08:04.787 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:08:34.892 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:08:34.897 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:09:05.018 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:09:05.026 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:09:35.133 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:09:35.144 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:10:05.278 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:10:05.284 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:10:35.389 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:10:35.397 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:11:05.593 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:11:05.599 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:11:35.712 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:11:35.718 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:12:05.916 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:12:05.923 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:12:36.128 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:12:36.137 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:13:06.281 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:13:06.287 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:13:36.426 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:13:36.433 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-28T07:13:44.602 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-07-28T07:13:44.603 DEBUG:teuthology.task.console_log:Killing console logger for smithi072 2023-07-28T07:13:44.605 DEBUG:teuthology.task.console_log:Killing console logger for smithi173 2023-07-28T07:13:44.606 DEBUG:teuthology.exit:Finished running handlers